2023-08-10T11:16:14.131 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-10T11:16:14.132 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364589 --name rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/blogbench}} --owner scheduled_rishabh@teuthology -- /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364589/orig.config.yaml 2023-08-10T11:16:14.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T11:16:14.281 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364589 branch: wip-rishabh-2023Aug1-3 description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/blogbench}} email: null first_in_suite: false job_id: '7364589' kernel: client: sha1: distro flavor: default kdb: true sha1: a7fb1265323db972dd333f71b9a53e9479f62e37 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-rishabh-2023Aug1-3 ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - nowsync syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023Aug1-3 sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-2023Aug1-3 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi073.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi152.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi156.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1M - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6M3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/blogbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 7fda95956ac10132c9b74016ba832db907df09fa timestamp: 2023-08-10_09:50:44 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2224 2023-08-10T11:16:14.282 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa; will attempt to use it 2023-08-10T11:16:14.283 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks 2023-08-10T11:16:14.283 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-08-10T11:16:14.285 INFO:teuthology.task.internal:Checking packages... 2023-08-10T11:16:14.323 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'a8bf445f2d27d8e12e060dff0fd151d481b5290b' 2023-08-10T11:16:14.323 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-08-10T11:16:14.324 INFO:teuthology.packaging:ref: None 2023-08-10T11:16:14.324 INFO:teuthology.packaging:tag: None 2023-08-10T11:16:14.325 INFO:teuthology.packaging:branch: wip-rishabh-2023Aug1-3 2023-08-10T11:16:14.325 INFO:teuthology.packaging:sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T11:16:14.326 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-rishabh-2023Aug1-3 2023-08-10T11:16:14.543 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5118.ga8bf445f 2023-08-10T11:16:14.544 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-08-10T11:16:14.551 INFO:teuthology.task.internal:no buildpackages task found 2023-08-10T11:16:14.551 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-08-10T11:16:14.571 INFO:teuthology.task.internal:Saving configuration 2023-08-10T11:16:14.593 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-08-10T11:16:14.599 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-10T11:16:14.621 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364589', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 11:10:57.427127', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-10T11:16:14.637 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364589', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 11:10:57.425924', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-10T11:16:14.657 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364589', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 11:10:57.424373', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-10T11:16:14.657 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-08-10T11:16:14.664 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-08-10T11:16:14.664 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-08-10T11:16:14.665 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-08-10T11:16:14.665 INFO:teuthology.run_tasks:Running task console_log... 2023-08-10T11:16:14.772 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f82f7b0b0d0>, signals=[15]) 2023-08-10T11:16:14.773 INFO:teuthology.run_tasks:Running task internal.connect... 2023-08-10T11:16:14.780 INFO:teuthology.task.internal:Opening connections... 2023-08-10T11:16:14.780 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2023-08-10T11:16:14.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T11:16:14.851 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi152.front.sepia.ceph.com 2023-08-10T11:16:14.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T11:16:14.919 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi156.front.sepia.ceph.com 2023-08-10T11:16:14.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T11:16:14.987 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-08-10T11:16:14.993 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2023-08-10T11:16:15.013 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2023-08-10T11:16:15.014 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2023-08-10T11:16:15.072 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Red Hat Enterprise Linux" 2023-08-10T11:16:15.073 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8.6 (Ootpa)" 2023-08-10T11:16:15.073 INFO:teuthology.orchestra.run.smithi073.stdout:ID="rhel" 2023-08-10T11:16:15.073 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="fedora" 2023-08-10T11:16:15.073 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8.6" 2023-08-10T11:16:15.073 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2023-08-10T11:16:15.073 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-10T11:16:15.073 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2023-08-10T11:16:15.074 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-10T11:16:15.074 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.redhat.com/" 2023-08-10T11:16:15.074 INFO:teuthology.orchestra.run.smithi073.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-10T11:16:15.074 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T11:16:15.074 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:16:15.074 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T11:16:15.074 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-10T11:16:15.075 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-10T11:16:15.075 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-10T11:16:15.075 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-08-10T11:16:15.114 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2023-08-10T11:16:15.134 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2023-08-10T11:16:15.135 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-08-10T11:16:15.194 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Red Hat Enterprise Linux" 2023-08-10T11:16:15.194 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8.6 (Ootpa)" 2023-08-10T11:16:15.194 INFO:teuthology.orchestra.run.smithi152.stdout:ID="rhel" 2023-08-10T11:16:15.194 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="fedora" 2023-08-10T11:16:15.195 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8.6" 2023-08-10T11:16:15.195 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2023-08-10T11:16:15.195 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-10T11:16:15.195 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-08-10T11:16:15.195 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-10T11:16:15.195 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.redhat.com/" 2023-08-10T11:16:15.195 INFO:teuthology.orchestra.run.smithi152.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-10T11:16:15.195 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T11:16:15.196 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-08-10T11:16:15.196 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T11:16:15.196 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-10T11:16:15.196 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-10T11:16:15.196 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-10T11:16:15.196 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-08-10T11:16:15.221 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2023-08-10T11:16:15.241 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2023-08-10T11:16:15.241 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-08-10T11:16:15.300 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Red Hat Enterprise Linux" 2023-08-10T11:16:15.300 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8.6 (Ootpa)" 2023-08-10T11:16:15.300 INFO:teuthology.orchestra.run.smithi156.stdout:ID="rhel" 2023-08-10T11:16:15.301 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="fedora" 2023-08-10T11:16:15.301 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8.6" 2023-08-10T11:16:15.301 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2023-08-10T11:16:15.301 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-10T11:16:15.301 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-08-10T11:16:15.301 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-10T11:16:15.301 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.redhat.com/" 2023-08-10T11:16:15.302 INFO:teuthology.orchestra.run.smithi156.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-10T11:16:15.302 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T11:16:15.302 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-08-10T11:16:15.302 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T11:16:15.302 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-10T11:16:15.302 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-10T11:16:15.303 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-10T11:16:15.303 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-08-10T11:16:15.329 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-08-10T11:16:15.340 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-08-10T11:16:15.345 INFO:teuthology.task.internal:Checking for old test directory... 2023-08-10T11:16:15.345 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2023-08-10T11:16:15.348 DEBUG:teuthology.orchestra.run.smithi152:> test '!' -e /home/ubuntu/cephtest 2023-08-10T11:16:15.350 DEBUG:teuthology.orchestra.run.smithi156:> test '!' -e /home/ubuntu/cephtest 2023-08-10T11:16:15.369 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-08-10T11:16:15.377 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-08-10T11:16:15.377 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2023-08-10T11:16:15.407 DEBUG:teuthology.orchestra.run.smithi152:> test -z $(ls -A /var/lib/ceph) 2023-08-10T11:16:15.410 DEBUG:teuthology.orchestra.run.smithi156:> test -z $(ls -A /var/lib/ceph) 2023-08-10T11:16:15.436 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-08-10T11:16:15.509 INFO:teuthology.run_tasks:Running task kernel... 2023-08-10T11:16:15.524 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a7fb1265323db972dd333f71b9a53e9479f62e37'} 2023-08-10T11:16:15.525 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2023-08-10T11:16:15.526 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2023-08-10T11:16:15.526 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-10T11:16:15.545 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T11:16:15.546 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2023-08-10T11:16:15.606 INFO:teuthology.orchestra.run.smithi073.stdout:4.18.0-372.9.1.el8.x86_64 2023-08-10T11:16:15.625 INFO:teuthology.task.kernel:Running kernel on smithi073: 4.18.0-372.9.1.el8.x86_64 2023-08-10T11:16:15.626 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum install -y kernel 2023-08-10T11:16:16.856 INFO:teuthology.orchestra.run.smithi073.stdout:Updating Subscription Management repositories. 2023-08-10T11:16:16.856 INFO:teuthology.orchestra.run.smithi073.stdout:Unable to read consumer identity 2023-08-10T11:16:18.450 INFO:teuthology.orchestra.run.smithi073.stdout:Copr repo for python3-asyncssh owned by ceph 10 kB/s | 3.5 kB 00:00 2023-08-10T11:16:19.317 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2023-08-10T11:16:22.701 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 460 kB/s | 24 kB 00:00 2023-08-10T11:16:23.403 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-08-10T11:16:23.457 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-08-10T11:16:23.459 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2023-08-10T11:16:23.459 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-08-10T11:16:23.609 DEBUG:teuthology.orchestra.run.smithi073:> echo no | sudo yum reinstall kernel || true 2023-08-10T11:16:23.939 INFO:teuthology.orchestra.run.smithi073.stdout:Updating Subscription Management repositories. 2023-08-10T11:16:23.939 INFO:teuthology.orchestra.run.smithi073.stdout:Unable to read consumer identity 2023-08-10T11:16:24.193 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:02 ago on Thu 10 Aug 2023 11:16:22 AM UTC. 2023-08-10T11:16:24.234 INFO:teuthology.orchestra.run.smithi073.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-10T11:16:24.267 INFO:teuthology.orchestra.run.smithi073.stderr:Error: No packages marked for reinstall. 2023-08-10T11:16:24.313 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum reinstall -y kernel || true 2023-08-10T11:16:24.641 INFO:teuthology.orchestra.run.smithi073.stdout:Updating Subscription Management repositories. 2023-08-10T11:16:24.641 INFO:teuthology.orchestra.run.smithi073.stdout:Unable to read consumer identity 2023-08-10T11:16:24.892 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:02 ago on Thu 10 Aug 2023 11:16:22 AM UTC. 2023-08-10T11:16:24.932 INFO:teuthology.orchestra.run.smithi073.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-10T11:16:24.965 INFO:teuthology.orchestra.run.smithi073.stderr:Error: No packages marked for reinstall. 2023-08-10T11:16:25.016 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel | sort -rV | head -n 1 2023-08-10T11:16:25.094 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-08-10T11:16:25.095 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-08-10T11:16:25.095 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-08-10T11:16:25.096 DEBUG:teuthology.parallel:result is None 2023-08-10T11:16:25.096 INFO:teuthology.run_tasks:Running task internal.base... 2023-08-10T11:16:25.103 INFO:teuthology.task.internal:Creating test directory... 2023-08-10T11:16:25.103 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-10T11:16:25.106 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-10T11:16:25.109 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-10T11:16:25.129 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-08-10T11:16:25.136 INFO:teuthology.run_tasks:Running task internal.archive... 2023-08-10T11:16:25.147 INFO:teuthology.task.internal:Creating archive directory... 2023-08-10T11:16:25.147 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-10T11:16:25.162 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-10T11:16:25.169 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-10T11:16:25.203 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-08-10T11:16:25.210 INFO:teuthology.task.internal:Enabling coredump saving... 2023-08-10T11:16:25.211 DEBUG:teuthology.orchestra.run.smithi152:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-10T11:16:25.254 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T11:16:25.256 DEBUG:teuthology.orchestra.run.smithi156:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-10T11:16:25.274 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T11:16:25.275 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-10T11:16:25.278 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-10T11:16:25.298 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-10T11:16:25.314 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-10T11:16:25.325 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-10T11:16:25.329 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-10T11:16:25.347 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-10T11:16:25.351 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-10T11:16:25.368 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-10T11:16:25.370 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-08-10T11:16:25.377 INFO:teuthology.task.internal:Configuring sudo... 2023-08-10T11:16:25.377 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-10T11:16:25.379 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-10T11:16:25.391 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-10T11:16:25.440 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-08-10T11:16:25.448 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-08-10T11:16:25.449 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-10T11:16:25.451 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-10T11:16:25.460 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-10T11:16:25.498 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-10T11:16:25.545 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-10T11:16:25.623 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-10T11:16:25.665 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-10T11:16:25.706 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-08-10T11:16:25.706 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-10T11:16:25.782 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-10T11:16:25.826 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-10T11:16:25.879 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-10T11:16:25.962 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-10T11:16:26.005 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-08-10T11:16:26.005 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-10T11:16:26.072 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-10T11:16:26.118 DEBUG:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-10T11:16:26.170 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-10T11:16:26.256 DEBUG:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-10T11:16:26.300 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-08-10T11:16:26.301 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-10T11:16:26.370 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2023-08-10T11:16:26.373 DEBUG:teuthology.orchestra.run.smithi152:> sudo service rsyslog restart 2023-08-10T11:16:26.375 DEBUG:teuthology.orchestra.run.smithi156:> sudo service rsyslog restart 2023-08-10T11:16:26.433 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-10T11:16:26.458 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-10T11:16:26.478 INFO:teuthology.orchestra.run.smithi156.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-10T11:16:26.779 INFO:teuthology.run_tasks:Running task internal.timer... 2023-08-10T11:16:26.787 INFO:teuthology.task.internal:Starting timer... 2023-08-10T11:16:26.788 INFO:teuthology.run_tasks:Running task pcp... 2023-08-10T11:16:26.812 INFO:teuthology.run_tasks:Running task selinux... 2023-08-10T11:16:26.820 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-08-10T11:16:26.821 DEBUG:teuthology.orchestra.run.smithi073:> sudo service auditd rotate 2023-08-10T11:16:26.894 INFO:teuthology.orchestra.run.smithi073.stdout:Rotating logs: 2023-08-10T11:16:26.896 DEBUG:teuthology.orchestra.run.smithi152:> sudo service auditd rotate 2023-08-10T11:16:26.958 INFO:teuthology.orchestra.run.smithi152.stdout:Rotating logs: 2023-08-10T11:16:26.960 DEBUG:teuthology.orchestra.run.smithi156:> sudo service auditd rotate 2023-08-10T11:16:27.015 INFO:teuthology.orchestra.run.smithi156.stdout:Rotating logs: 2023-08-10T11:16:27.016 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-08-10T11:16:27.017 DEBUG:teuthology.orchestra.run.smithi073:> /usr/sbin/getenforce 2023-08-10T11:16:27.037 INFO:teuthology.orchestra.run.smithi073.stdout:Permissive 2023-08-10T11:16:27.038 DEBUG:teuthology.orchestra.run.smithi152:> /usr/sbin/getenforce 2023-08-10T11:16:27.058 INFO:teuthology.orchestra.run.smithi152.stdout:Permissive 2023-08-10T11:16:27.059 DEBUG:teuthology.orchestra.run.smithi156:> /usr/sbin/getenforce 2023-08-10T11:16:27.081 INFO:teuthology.orchestra.run.smithi156.stdout:Permissive 2023-08-10T11:16:27.081 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi073.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi152.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi156.front.sepia.ceph.com': 'permissive'} 2023-08-10T11:16:27.082 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-10T11:16:27.108 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T11:16:27.109 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-10T11:16:27.136 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T11:16:27.137 DEBUG:teuthology.orchestra.run.smithi156:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-10T11:16:27.165 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T11:16:27.166 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-08-10T11:16:27.166 DEBUG:teuthology.orchestra.run.smithi073:> sudo /usr/sbin/setenforce permissive 2023-08-10T11:16:27.192 DEBUG:teuthology.orchestra.run.smithi152:> sudo /usr/sbin/setenforce permissive 2023-08-10T11:16:27.220 DEBUG:teuthology.orchestra.run.smithi156:> sudo /usr/sbin/setenforce permissive 2023-08-10T11:16:27.246 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-08-10T11:16:27.255 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-08-10T11:16:27.256 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-08-10T11:16:27.276 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-08-10T11:16:27.278 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi073.front.sepia.ceph.com,smithi152.front.sepia.ceph.com,smithi156.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-08-10T11:31:37.758 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi152.front.sepia.ceph.com'), Remote(name='ubuntu@smithi156.front.sepia.ceph.com')] 2023-08-10T11:31:37.760 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-08-10T11:31:37.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T11:31:37.830 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-08-10T11:31:37.853 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-08-10T11:31:37.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-08-10T11:31:37.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T11:31:37.920 DEBUG:teuthology.orchestra.run.smithi152:> true 2023-08-10T11:31:37.989 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-08-10T11:31:37.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-08-10T11:31:37.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T11:31:38.056 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-08-10T11:31:38.120 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-08-10T11:31:38.121 INFO:teuthology.run_tasks:Running task clock... 2023-08-10T11:31:38.132 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-08-10T11:31:38.133 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-10T11:31:38.134 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-10T11:31:38.136 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-10T11:31:38.136 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-10T11:31:38.138 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-10T11:31:38.138 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-10T11:31:38.165 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-10T11:31:38.167 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-10T11:31:38.180 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-10T11:31:38.182 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-10T11:31:38.191 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-10T11:31:38.205 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-10T11:31:38.254 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: ntpd: command not found 2023-08-10T11:31:38.260 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: ntpd: command not found 2023-08-10T11:31:38.266 INFO:teuthology.orchestra.run.smithi073.stdout:506 Cannot talk to daemon 2023-08-10T11:31:38.272 INFO:teuthology.orchestra.run.smithi152.stdout:506 Cannot talk to daemon 2023-08-10T11:31:38.275 INFO:teuthology.orchestra.run.smithi156.stderr:sudo: ntpd: command not found 2023-08-10T11:31:38.280 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-10T11:31:38.286 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-10T11:31:38.287 INFO:teuthology.orchestra.run.smithi156.stdout:506 Cannot talk to daemon 2023-08-10T11:31:38.294 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-10T11:31:38.301 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-10T11:31:38.301 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-10T11:31:38.315 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-10T11:31:38.369 INFO:teuthology.orchestra.run.smithi073.stderr:bash: ntpq: command not found 2023-08-10T11:31:38.373 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-10T11:31:38.373 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2023-08-10T11:31:38.373 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T11:31:38.373 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T11:31:38.373 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T11:31:38.374 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T11:31:38.376 INFO:teuthology.orchestra.run.smithi152.stderr:bash: ntpq: command not found 2023-08-10T11:31:38.379 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-10T11:31:38.380 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2023-08-10T11:31:38.380 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T11:31:38.380 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T11:31:38.380 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T11:31:38.380 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T11:31:38.381 INFO:teuthology.orchestra.run.smithi156.stderr:bash: ntpq: command not found 2023-08-10T11:31:38.384 INFO:teuthology.orchestra.run.smithi156.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-10T11:31:38.384 INFO:teuthology.orchestra.run.smithi156.stdout:=============================================================================== 2023-08-10T11:31:38.384 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T11:31:38.385 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T11:31:38.385 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T11:31:38.385 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T11:31:38.386 INFO:teuthology.run_tasks:Running task pexec... 2023-08-10T11:31:38.400 INFO:teuthology.task.pexec:Executing custom commands... 2023-08-10T11:31:38.402 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi073.front.sepia.ceph.com 2023-08-10T11:31:38.402 DEBUG:teuthology.orchestra.run.smithi073:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-08-10T11:31:38.403 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi152.front.sepia.ceph.com 2023-08-10T11:31:38.403 DEBUG:teuthology.orchestra.run.smithi152:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-08-10T11:31:38.404 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi156.front.sepia.ceph.com 2023-08-10T11:31:38.404 DEBUG:teuthology.orchestra.run.smithi156:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-08-10T11:31:38.783 INFO:teuthology.orchestra.run.smithi073.stdout:Updating Subscription Management repositories. 2023-08-10T11:31:38.795 INFO:teuthology.orchestra.run.smithi152.stdout:Updating Subscription Management repositories. 2023-08-10T11:31:38.800 INFO:teuthology.orchestra.run.smithi156.stdout:Updating Subscription Management repositories. 2023-08-10T11:31:39.621 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:24 ago on Thu 10 Aug 2023 11:30:15 AM UTC. 2023-08-10T11:31:39.658 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:38 ago on Thu 10 Aug 2023 11:30:01 AM UTC. 2023-08-10T11:31:39.658 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:27 ago on Thu 10 Aug 2023 11:30:12 AM UTC. 2023-08-10T11:31:41.374 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-08-10T11:31:41.375 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-08-10T11:31:41.375 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2023-08-10T11:31:41.375 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-08-10T11:31:41.375 INFO:teuthology.orchestra.run.smithi073.stdout:Resetting modules: 2023-08-10T11:31:41.375 INFO:teuthology.orchestra.run.smithi073.stdout: container-tools 2023-08-10T11:31:41.376 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:31:41.376 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2023-08-10T11:31:41.376 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-08-10T11:31:41.376 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:31:41.384 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-08-10T11:31:41.385 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-08-10T11:31:41.385 INFO:teuthology.orchestra.run.smithi156.stdout: Package Architecture Version Repository Size 2023-08-10T11:31:41.385 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-08-10T11:31:41.385 INFO:teuthology.orchestra.run.smithi156.stdout:Resetting modules: 2023-08-10T11:31:41.385 INFO:teuthology.orchestra.run.smithi156.stdout: container-tools 2023-08-10T11:31:41.386 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-08-10T11:31:41.386 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-08-10T11:31:41.386 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-08-10T11:31:41.386 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-08-10T11:31:41.490 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-08-10T11:31:41.491 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-08-10T11:31:41.491 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2023-08-10T11:31:41.492 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-08-10T11:31:41.492 INFO:teuthology.orchestra.run.smithi152.stdout:Resetting modules: 2023-08-10T11:31:41.492 INFO:teuthology.orchestra.run.smithi152.stdout: container-tools 2023-08-10T11:31:41.492 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-08-10T11:31:41.492 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-08-10T11:31:41.492 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-08-10T11:31:41.492 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-08-10T11:31:42.331 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:29 ago on Thu 10 Aug 2023 11:30:12 AM UTC. 2023-08-10T11:31:42.332 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:40 ago on Thu 10 Aug 2023 11:30:01 AM UTC. 2023-08-10T11:31:42.472 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:27 ago on Thu 10 Aug 2023 11:30:15 AM UTC. 2023-08-10T11:31:45.135 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-08-10T11:31:45.136 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-08-10T11:31:45.244 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-08-10T11:31:45.587 INFO:teuthology.orchestra.run.smithi073.stdout:Updating Subscription Management repositories. 2023-08-10T11:31:45.620 INFO:teuthology.orchestra.run.smithi156.stdout:Updating Subscription Management repositories. 2023-08-10T11:31:45.730 INFO:teuthology.orchestra.run.smithi152.stdout:Updating Subscription Management repositories. 2023-08-10T11:31:46.387 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:44 ago on Thu 10 Aug 2023 11:30:01 AM UTC. 2023-08-10T11:31:46.403 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:33 ago on Thu 10 Aug 2023 11:30:12 AM UTC. 2023-08-10T11:31:46.564 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:31 ago on Thu 10 Aug 2023 11:30:15 AM UTC. 2023-08-10T11:31:48.170 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-08-10T11:31:48.261 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================================================ 2023-08-10T11:31:48.261 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2023-08-10T11:31:48.262 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================================================ 2023-08-10T11:31:48.262 INFO:teuthology.orchestra.run.smithi073.stdout:Installing group/module packages: 2023-08-10T11:31:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-08-10T11:31:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-08-10T11:31:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-08-10T11:31:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-08-10T11:31:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-08-10T11:31:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-08-10T11:31:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-08-10T11:31:48.263 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2023-08-10T11:31:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-08-10T11:31:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-08-10T11:31:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-08-10T11:31:48.263 INFO:teuthology.orchestra.run.smithi073.stdout:Installing module profiles: 2023-08-10T11:31:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: container-tools/common 2023-08-10T11:31:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:31:48.264 INFO:teuthology.orchestra.run.smithi073.stdout:Enabling module streams: 2023-08-10T11:31:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: container-tools rhel8 2023-08-10T11:31:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:31:48.264 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2023-08-10T11:31:48.264 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================================================ 2023-08-10T11:31:48.264 INFO:teuthology.orchestra.run.smithi073.stdout:Install 10 Packages 2023-08-10T11:31:48.265 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:31:48.265 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 18 M 2023-08-10T11:31:48.265 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 65 M 2023-08-10T11:31:48.265 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2023-08-10T11:31:48.269 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-08-10T11:31:48.283 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-08-10T11:31:48.333 INFO:teuthology.orchestra.run.smithi073.stdout:(1/10): python3-pytoml-0.1.14-5.git7dea353.el8. 357 kB/s | 25 kB 00:00 2023-08-10T11:31:48.350 INFO:teuthology.orchestra.run.smithi073.stdout:(2/10): yajl-2.1.0-10.el8.x86_64.rpm 471 kB/s | 41 kB 00:00 2023-08-10T11:31:48.363 INFO:teuthology.orchestra.run.smithi156.stdout:============================================================================================================ 2023-08-10T11:31:48.364 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-08-10T11:31:48.364 INFO:teuthology.orchestra.run.smithi156.stdout:============================================================================================================ 2023-08-10T11:31:48.364 INFO:teuthology.orchestra.run.smithi156.stdout:Installing group/module packages: 2023-08-10T11:31:48.364 INFO:teuthology.orchestra.run.smithi156.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-08-10T11:31:48.364 INFO:teuthology.orchestra.run.smithi156.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-08-10T11:31:48.365 INFO:teuthology.orchestra.run.smithi156.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-08-10T11:31:48.365 INFO:teuthology.orchestra.run.smithi156.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-08-10T11:31:48.365 INFO:teuthology.orchestra.run.smithi156.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-08-10T11:31:48.365 INFO:teuthology.orchestra.run.smithi156.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-08-10T11:31:48.365 INFO:teuthology.orchestra.run.smithi156.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-08-10T11:31:48.365 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-08-10T11:31:48.365 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-08-10T11:31:48.366 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-08-10T11:31:48.366 INFO:teuthology.orchestra.run.smithi156.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-08-10T11:31:48.366 INFO:teuthology.orchestra.run.smithi156.stdout:Installing module profiles: 2023-08-10T11:31:48.366 INFO:teuthology.orchestra.run.smithi156.stdout: container-tools/common 2023-08-10T11:31:48.366 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-08-10T11:31:48.366 INFO:teuthology.orchestra.run.smithi156.stdout:Enabling module streams: 2023-08-10T11:31:48.366 INFO:teuthology.orchestra.run.smithi156.stdout: container-tools rhel8 2023-08-10T11:31:48.366 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-08-10T11:31:48.367 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-08-10T11:31:48.367 INFO:teuthology.orchestra.run.smithi156.stdout:============================================================================================================ 2023-08-10T11:31:48.367 INFO:teuthology.orchestra.run.smithi156.stdout:Install 10 Packages 2023-08-10T11:31:48.367 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-08-10T11:31:48.367 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 18 M 2023-08-10T11:31:48.368 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 65 M 2023-08-10T11:31:48.368 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-08-10T11:31:48.376 INFO:teuthology.orchestra.run.smithi073.stdout:(3/10): python3-pyxdg-0.25-16.el8.noarch.rpm 839 kB/s | 94 kB 00:00 2023-08-10T11:31:48.376 INFO:teuthology.orchestra.run.smithi152.stdout:============================================================================================================ 2023-08-10T11:31:48.377 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2023-08-10T11:31:48.377 INFO:teuthology.orchestra.run.smithi152.stdout:============================================================================================================ 2023-08-10T11:31:48.377 INFO:teuthology.orchestra.run.smithi152.stdout:Installing group/module packages: 2023-08-10T11:31:48.377 INFO:teuthology.orchestra.run.smithi152.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-08-10T11:31:48.377 INFO:teuthology.orchestra.run.smithi152.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-08-10T11:31:48.377 INFO:teuthology.orchestra.run.smithi152.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-08-10T11:31:48.377 INFO:teuthology.orchestra.run.smithi152.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-08-10T11:31:48.378 INFO:teuthology.orchestra.run.smithi152.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-08-10T11:31:48.378 INFO:teuthology.orchestra.run.smithi152.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-08-10T11:31:48.378 INFO:teuthology.orchestra.run.smithi152.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-08-10T11:31:48.378 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2023-08-10T11:31:48.378 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-08-10T11:31:48.378 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-08-10T11:31:48.378 INFO:teuthology.orchestra.run.smithi152.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-08-10T11:31:48.379 INFO:teuthology.orchestra.run.smithi152.stdout:Installing module profiles: 2023-08-10T11:31:48.379 INFO:teuthology.orchestra.run.smithi152.stdout: container-tools/common 2023-08-10T11:31:48.379 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-08-10T11:31:48.379 INFO:teuthology.orchestra.run.smithi152.stdout:Enabling module streams: 2023-08-10T11:31:48.379 INFO:teuthology.orchestra.run.smithi152.stdout: container-tools rhel8 2023-08-10T11:31:48.379 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-08-10T11:31:48.379 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-08-10T11:31:48.379 INFO:teuthology.orchestra.run.smithi152.stdout:============================================================================================================ 2023-08-10T11:31:48.380 INFO:teuthology.orchestra.run.smithi152.stdout:Install 10 Packages 2023-08-10T11:31:48.380 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-08-10T11:31:48.380 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 18 M 2023-08-10T11:31:48.380 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 65 M 2023-08-10T11:31:48.381 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-08-10T11:31:48.392 INFO:teuthology.orchestra.run.smithi073.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 839 kB/s | 49 kB 00:00 2023-08-10T11:31:48.426 INFO:teuthology.orchestra.run.smithi073.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.8 MB/s | 524 kB 00:00 2023-08-10T11:31:48.452 INFO:teuthology.orchestra.run.smithi152.stdout:(1/10): python3-pytoml-0.1.14-5.git7dea353.el8. 342 kB/s | 25 kB 00:00 2023-08-10T11:31:48.453 INFO:teuthology.orchestra.run.smithi156.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 1.1 MB/s | 94 kB 00:00 2023-08-10T11:31:48.477 INFO:teuthology.orchestra.run.smithi152.stdout:(2/10): yajl-2.1.0-10.el8.x86_64.rpm 415 kB/s | 41 kB 00:00 2023-08-10T11:31:48.478 INFO:teuthology.orchestra.run.smithi156.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 222 kB/s | 25 kB 00:00 2023-08-10T11:31:48.481 INFO:teuthology.orchestra.run.smithi073.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 1.7 MB/s | 149 kB 00:00 2023-08-10T11:31:48.503 INFO:teuthology.orchestra.run.smithi152.stdout:(3/10): python3-pyxdg-0.25-16.el8.noarch.rpm 760 kB/s | 94 kB 00:00 2023-08-10T11:31:48.504 INFO:teuthology.orchestra.run.smithi156.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 297 kB/s | 41 kB 00:00 2023-08-10T11:31:48.510 INFO:teuthology.orchestra.run.smithi073.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 2.5 MB/s | 213 kB 00:00 2023-08-10T11:31:48.519 INFO:teuthology.orchestra.run.smithi152.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 734 kB/s | 49 kB 00:00 2023-08-10T11:31:48.529 INFO:teuthology.orchestra.run.smithi156.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 654 kB/s | 49 kB 00:00 2023-08-10T11:31:48.553 INFO:teuthology.orchestra.run.smithi152.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.8 MB/s | 524 kB 00:00 2023-08-10T11:31:48.562 INFO:teuthology.orchestra.run.smithi156.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.1 MB/s | 524 kB 00:00 2023-08-10T11:31:48.570 INFO:teuthology.orchestra.run.smithi152.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.9 MB/s | 149 kB 00:00 2023-08-10T11:31:48.588 INFO:teuthology.orchestra.run.smithi156.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.5 MB/s | 149 kB 00:00 2023-08-10T11:31:48.595 INFO:teuthology.orchestra.run.smithi152.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 5.0 MB/s | 213 kB 00:00 2023-08-10T11:31:48.610 INFO:teuthology.orchestra.run.smithi073.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 22 MB/s | 2.2 MB 00:00 2023-08-10T11:31:48.613 INFO:teuthology.orchestra.run.smithi156.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 4.1 MB/s | 213 kB 00:00 2023-08-10T11:31:48.696 INFO:teuthology.orchestra.run.smithi152.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 22 MB/s | 2.2 MB 00:00 2023-08-10T11:31:48.722 INFO:teuthology.orchestra.run.smithi156.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 20 MB/s | 2.2 MB 00:00 2023-08-10T11:31:48.735 INFO:teuthology.orchestra.run.smithi073.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 28 MB/s | 7.0 MB 00:00 2023-08-10T11:31:48.827 INFO:teuthology.orchestra.run.smithi073.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 18 MB/s | 8.0 MB 00:00 2023-08-10T11:31:48.828 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2023-08-10T11:31:48.828 INFO:teuthology.orchestra.run.smithi073.stdout:Total 32 MB/s | 18 MB 00:00 2023-08-10T11:31:48.846 INFO:teuthology.orchestra.run.smithi152.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 25 MB/s | 7.0 MB 00:00 2023-08-10T11:31:48.847 INFO:teuthology.orchestra.run.smithi156.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 27 MB/s | 7.0 MB 00:00 2023-08-10T11:31:48.939 INFO:teuthology.orchestra.run.smithi156.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 18 MB/s | 8.0 MB 00:00 2023-08-10T11:31:48.939 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-08-10T11:31:48.939 INFO:teuthology.orchestra.run.smithi156.stdout:Total 32 MB/s | 18 MB 00:00 2023-08-10T11:31:48.946 INFO:teuthology.orchestra.run.smithi152.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 18 MB/s | 8.0 MB 00:00 2023-08-10T11:31:48.947 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-08-10T11:31:48.947 INFO:teuthology.orchestra.run.smithi152.stdout:Total 32 MB/s | 18 MB 00:00 2023-08-10T11:31:49.028 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2023-08-10T11:31:49.046 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2023-08-10T11:31:49.047 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2023-08-10T11:31:49.142 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-08-10T11:31:49.150 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-08-10T11:31:49.161 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-08-10T11:31:49.161 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-08-10T11:31:49.169 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-08-10T11:31:49.169 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-08-10T11:31:49.227 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2023-08-10T11:31:49.231 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2023-08-10T11:31:49.344 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-08-10T11:31:49.347 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-08-10T11:31:49.353 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-08-10T11:31:49.357 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-08-10T11:31:49.861 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-08-10T11:31:49.884 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-08-10T11:31:49.939 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2023-08-10T11:31:50.031 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-08-10T11:31:50.054 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-08-10T11:31:50.115 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-08-10T11:31:50.227 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-08-10T11:31:50.257 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-08-10T11:31:50.329 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-08-10T11:31:50.429 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-08-10T11:31:50.460 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-08-10T11:31:50.515 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-08-10T11:31:50.657 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-08-10T11:31:50.676 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-08-10T11:31:50.735 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-08-10T11:31:51.008 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-08-10T11:31:51.027 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-08-10T11:31:51.100 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-08-10T11:31:51.782 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-08-10T11:31:51.798 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-08-10T11:31:51.861 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-08-10T11:31:52.676 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-08-10T11:31:52.692 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-08-10T11:31:52.772 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-08-10T11:31:52.872 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-08-10T11:31:52.922 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-08-10T11:31:53.014 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-08-10T11:31:53.034 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-08-10T11:31:53.097 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-08-10T11:31:53.178 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-08-10T11:31:53.211 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-08-10T11:31:53.266 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-08-10T11:31:53.389 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-08-10T11:31:53.481 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-08-10T11:31:53.482 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-08-10T11:31:53.482 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-08-10T11:31:53.482 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-08-10T11:31:53.482 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-08-10T11:31:53.482 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-08-10T11:31:53.482 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-08-10T11:31:53.483 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-08-10T11:31:53.483 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-08-10T11:31:53.483 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-08-10T11:31:53.543 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-08-10T11:31:53.543 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-08-10T11:31:53.544 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-08-10T11:31:53.544 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-08-10T11:31:53.544 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-08-10T11:31:53.544 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-08-10T11:31:53.544 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-08-10T11:31:53.544 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-08-10T11:31:53.545 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-08-10T11:31:53.545 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-08-10T11:31:53.658 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-08-10T11:31:53.658 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-08-10T11:31:53.658 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-08-10T11:31:53.659 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-08-10T11:31:53.659 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-08-10T11:31:53.659 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-08-10T11:31:53.659 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-08-10T11:31:53.659 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-08-10T11:31:53.659 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-08-10T11:31:53.659 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-08-10T11:31:54.672 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-08-10T11:31:54.673 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:39 ago on Thu 10 Aug 2023 11:30:15 AM UTC. 2023-08-10T11:31:54.756 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-08-10T11:31:54.756 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:42 ago on Thu 10 Aug 2023 11:30:12 AM UTC. 2023-08-10T11:31:54.843 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-08-10T11:31:54.843 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:53 ago on Thu 10 Aug 2023 11:30:01 AM UTC. 2023-08-10T11:31:58.259 INFO:teuthology.orchestra.run.smithi073.stdout:Installed products updated. 2023-08-10T11:31:58.401 INFO:teuthology.orchestra.run.smithi156.stdout:Installed products updated. 2023-08-10T11:31:58.445 INFO:teuthology.orchestra.run.smithi152.stdout:Installed products updated. 2023-08-10T11:31:58.461 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:31:58.462 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2023-08-10T11:31:58.462 INFO:teuthology.orchestra.run.smithi073.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-08-10T11:31:58.462 INFO:teuthology.orchestra.run.smithi073.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-08-10T11:31:58.462 INFO:teuthology.orchestra.run.smithi073.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-08-10T11:31:58.462 INFO:teuthology.orchestra.run.smithi073.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-08-10T11:31:58.462 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-08-10T11:31:58.463 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-08-10T11:31:58.463 INFO:teuthology.orchestra.run.smithi073.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-08-10T11:31:58.463 INFO:teuthology.orchestra.run.smithi073.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-08-10T11:31:58.463 INFO:teuthology.orchestra.run.smithi073.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-08-10T11:31:58.463 INFO:teuthology.orchestra.run.smithi073.stdout: yajl-2.1.0-10.el8.x86_64 2023-08-10T11:31:58.463 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:31:58.463 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-08-10T11:31:58.603 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-08-10T11:31:58.604 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-08-10T11:31:58.604 INFO:teuthology.orchestra.run.smithi156.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-08-10T11:31:58.604 INFO:teuthology.orchestra.run.smithi156.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-08-10T11:31:58.604 INFO:teuthology.orchestra.run.smithi156.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-08-10T11:31:58.604 INFO:teuthology.orchestra.run.smithi156.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-08-10T11:31:58.604 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-08-10T11:31:58.605 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-08-10T11:31:58.605 INFO:teuthology.orchestra.run.smithi156.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-08-10T11:31:58.605 INFO:teuthology.orchestra.run.smithi156.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-08-10T11:31:58.605 INFO:teuthology.orchestra.run.smithi156.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-08-10T11:31:58.605 INFO:teuthology.orchestra.run.smithi156.stdout: yajl-2.1.0-10.el8.x86_64 2023-08-10T11:31:58.605 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-08-10T11:31:58.605 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-08-10T11:31:58.627 DEBUG:teuthology.parallel:result is None 2023-08-10T11:31:58.695 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-08-10T11:31:58.695 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-08-10T11:31:58.696 INFO:teuthology.orchestra.run.smithi152.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-08-10T11:31:58.696 INFO:teuthology.orchestra.run.smithi152.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-08-10T11:31:58.696 INFO:teuthology.orchestra.run.smithi152.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-08-10T11:31:58.696 INFO:teuthology.orchestra.run.smithi152.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-08-10T11:31:58.696 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-08-10T11:31:58.696 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-08-10T11:31:58.697 INFO:teuthology.orchestra.run.smithi152.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-08-10T11:31:58.697 INFO:teuthology.orchestra.run.smithi152.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-08-10T11:31:58.697 INFO:teuthology.orchestra.run.smithi152.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-08-10T11:31:58.697 INFO:teuthology.orchestra.run.smithi152.stdout: yajl-2.1.0-10.el8.x86_64 2023-08-10T11:31:58.697 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-08-10T11:31:58.697 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-08-10T11:31:58.805 DEBUG:teuthology.parallel:result is None 2023-08-10T11:31:58.857 DEBUG:teuthology.parallel:result is None 2023-08-10T11:31:58.858 INFO:teuthology.run_tasks:Running task install... 2023-08-10T11:31:58.873 DEBUG:teuthology.task.install:project ceph 2023-08-10T11:31:58.873 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b'}} 2023-08-10T11:31:58.874 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b'} 2023-08-10T11:31:58.874 INFO:teuthology.task.install:Using flavor: default 2023-08-10T11:31:58.879 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-08-10T11:31:58.880 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-08-10T11:31:58.880 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b', 'tag': None, 'wait_for_package': False} 2023-08-10T11:31:58.881 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T11:31:58.883 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b', 'tag': None, 'wait_for_package': False} 2023-08-10T11:31:58.883 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T11:31:58.884 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b', 'tag': None, 'wait_for_package': False} 2023-08-10T11:31:58.885 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T11:31:59.031 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/ 2023-08-10T11:31:59.031 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5118.ga8bf445f 2023-08-10T11:31:59.036 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/ 2023-08-10T11:31:59.036 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5118.ga8bf445f 2023-08-10T11:31:59.040 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/ 2023-08-10T11:31:59.041 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5118.ga8bf445f 2023-08-10T11:31:59.137 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-10T11:31:59.137 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-08-10T11:31:59.137 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-10T11:31:59.140 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-10T11:31:59.140 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-08-10T11:31:59.140 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-10T11:31:59.163 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-10T11:31:59.163 DEBUG:teuthology.orchestra.run.smithi156:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8bf445f2d27d8e12e060dff0fd151d481b5290b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-10T11:31:59.167 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-10T11:31:59.167 DEBUG:teuthology.orchestra.run.smithi073:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8bf445f2d27d8e12e060dff0fd151d481b5290b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-10T11:31:59.203 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-10T11:31:59.204 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-08-10T11:31:59.204 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-10T11:31:59.230 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-10T11:31:59.230 DEBUG:teuthology.orchestra.run.smithi152:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8bf445f2d27d8e12e060dff0fd151d481b5290b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-10T11:31:59.231 DEBUG:teuthology.orchestra.run.smithi156:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-10T11:31:59.233 DEBUG:teuthology.orchestra.run.smithi073:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-10T11:31:59.297 DEBUG:teuthology.orchestra.run.smithi152:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-10T11:31:59.309 DEBUG:teuthology.orchestra.run.smithi156:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-10T11:31:59.310 DEBUG:teuthology.orchestra.run.smithi073:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-10T11:31:59.375 DEBUG:teuthology.orchestra.run.smithi152:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-10T11:31:59.376 INFO:teuthology.orchestra.run.smithi156.stdout:check_obsoletes = 1 2023-08-10T11:31:59.376 INFO:teuthology.orchestra.run.smithi073.stdout:check_obsoletes = 1 2023-08-10T11:31:59.377 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum clean all 2023-08-10T11:31:59.378 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum clean all 2023-08-10T11:31:59.440 INFO:teuthology.orchestra.run.smithi152.stdout:check_obsoletes = 1 2023-08-10T11:31:59.441 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum clean all 2023-08-10T11:31:59.770 INFO:teuthology.orchestra.run.smithi073.stdout:Updating Subscription Management repositories. 2023-08-10T11:31:59.788 INFO:teuthology.orchestra.run.smithi156.stdout:Updating Subscription Management repositories. 2023-08-10T11:31:59.858 INFO:teuthology.orchestra.run.smithi152.stdout:Updating Subscription Management repositories. 2023-08-10T11:32:00.023 INFO:teuthology.orchestra.run.smithi073.stdout:44 files removed 2023-08-10T11:32:00.049 INFO:teuthology.orchestra.run.smithi156.stdout:44 files removed 2023-08-10T11:32:00.077 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-10T11:32:00.103 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-10T11:32:00.141 INFO:teuthology.orchestra.run.smithi152.stdout:44 files removed 2023-08-10T11:32:00.195 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-10T11:32:00.431 INFO:teuthology.orchestra.run.smithi073.stdout:Updating Subscription Management repositories. 2023-08-10T11:32:00.489 INFO:teuthology.orchestra.run.smithi156.stdout:Updating Subscription Management repositories. 2023-08-10T11:32:00.569 INFO:teuthology.orchestra.run.smithi152.stdout:Updating Subscription Management repositories. 2023-08-10T11:32:01.217 INFO:teuthology.orchestra.run.smithi073.stdout:ceph packages for x86_64 224 kB/s | 81 kB 00:00 2023-08-10T11:32:01.237 INFO:teuthology.orchestra.run.smithi156.stdout:ceph packages for x86_64 261 kB/s | 81 kB 00:00 2023-08-10T11:32:01.398 INFO:teuthology.orchestra.run.smithi152.stdout:ceph packages for x86_64 207 kB/s | 81 kB 00:00 2023-08-10T11:32:01.543 INFO:teuthology.orchestra.run.smithi073.stdout:ceph noarch packages 33 kB/s | 9.4 kB 00:00 2023-08-10T11:32:01.588 INFO:teuthology.orchestra.run.smithi156.stdout:ceph noarch packages 30 kB/s | 9.4 kB 00:00 2023-08-10T11:32:01.700 INFO:teuthology.orchestra.run.smithi152.stdout:ceph noarch packages 35 kB/s | 9.4 kB 00:00 2023-08-10T11:32:01.872 INFO:teuthology.orchestra.run.smithi156.stdout:ceph source packages 5.7 kB/s | 1.5 kB 00:00 2023-08-10T11:32:01.927 INFO:teuthology.orchestra.run.smithi073.stdout:ceph source packages 4.2 kB/s | 1.5 kB 00:00 2023-08-10T11:32:01.952 INFO:teuthology.orchestra.run.smithi152.stdout:ceph source packages 6.5 kB/s | 1.5 kB 00:00 2023-08-10T11:32:02.031 INFO:teuthology.orchestra.run.smithi156.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-08-10T11:32:02.128 INFO:teuthology.orchestra.run.smithi073.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-08-10T11:32:02.136 INFO:teuthology.orchestra.run.smithi152.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2023-08-10T11:36:24.901 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 61 kB/s | 16 MB 04:22 2023-08-10T11:36:25.517 INFO:teuthology.orchestra.run.smithi156.stdout:Extra Packages for Enterprise Linux 61 kB/s | 16 MB 04:23 2023-08-10T11:36:25.824 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 61 kB/s | 16 MB 04:23 2023-08-10T11:36:28.357 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 440 kB/s | 24 kB 00:00 2023-08-10T11:36:28.933 INFO:teuthology.orchestra.run.smithi156.stdout:lab-extras 411 kB/s | 24 kB 00:00 2023-08-10T11:36:29.249 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 350 kB/s | 24 kB 00:00 2023-08-10T11:36:29.259 INFO:teuthology.orchestra.run.smithi073.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 57 MB/s | 47 MB 00:00 2023-08-10T11:36:29.852 INFO:teuthology.orchestra.run.smithi156.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 56 MB/s | 47 MB 00:00 2023-08-10T11:36:30.210 INFO:teuthology.orchestra.run.smithi152.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 53 MB/s | 47 MB 00:00 2023-08-10T11:36:37.134 INFO:teuthology.orchestra.run.smithi073.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 62 MB/s | 53 MB 00:00 2023-08-10T11:36:37.736 INFO:teuthology.orchestra.run.smithi156.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 63 MB/s | 53 MB 00:00 2023-08-10T11:36:38.194 INFO:teuthology.orchestra.run.smithi152.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 58 MB/s | 53 MB 00:00 2023-08-10T11:36:48.215 INFO:teuthology.orchestra.run.smithi073.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-10T11:36:48.217 INFO:teuthology.orchestra.run.smithi073.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-10T11:36:48.231 INFO:teuthology.orchestra.run.smithi073.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-08-10T11:36:48.232 INFO:teuthology.orchestra.run.smithi073.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-08-10T11:36:48.233 INFO:teuthology.orchestra.run.smithi073.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-08-10T11:36:48.234 INFO:teuthology.orchestra.run.smithi073.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-10T11:36:48.237 INFO:teuthology.orchestra.run.smithi073.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-10T11:36:48.240 INFO:teuthology.orchestra.run.smithi073.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-10T11:36:48.241 INFO:teuthology.orchestra.run.smithi073.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-10T11:36:48.372 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-08-10T11:36:48.384 INFO:teuthology.orchestra.run.smithi073.stdout:=========================================================================================================================== 2023-08-10T11:36:48.385 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2023-08-10T11:36:48.385 INFO:teuthology.orchestra.run.smithi073.stdout:=========================================================================================================================== 2023-08-10T11:36:48.385 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2023-08-10T11:36:48.385 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-08-10T11:36:48.385 INFO:teuthology.orchestra.run.smithi073.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-10T11:36:48.386 INFO:teuthology.orchestra.run.smithi073.stdout: ceph x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 6.4 k 2023-08-10T11:36:48.386 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 5.4 M 2023-08-10T11:36:48.386 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 849 k 2023-08-10T11:36:48.386 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 167 k 2023-08-10T11:36:48.386 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 1.6 M 2023-08-10T11:36:48.386 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 129 k 2023-08-10T11:36:48.386 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 1.7 M 2023-08-10T11:36:48.386 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 7.4 M 2023-08-10T11:36:48.387 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 47 k 2023-08-10T11:36:48.387 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 14 M 2023-08-10T11:36:48.387 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 48 M 2023-08-10T11:36:48.387 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 258 k 2023-08-10T11:36:48.387 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 168 k 2023-08-10T11:36:48.387 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 260 k 2023-08-10T11:36:48.387 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-top noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 18 k 2023-08-10T11:36:48.388 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-08-10T11:36:48.388 INFO:teuthology.orchestra.run.smithi073.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-10T11:36:48.388 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-10T11:36:48.388 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 31 k 2023-08-10T11:36:48.388 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 772 k 2023-08-10T11:36:48.388 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 139 k 2023-08-10T11:36:48.388 INFO:teuthology.orchestra.run.smithi073.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-10T11:36:48.389 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-08-10T11:36:48.389 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-10T11:36:48.389 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-08-10T11:36:48.389 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-08-10T11:36:48.389 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-08-10T11:36:48.389 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 197 k 2023-08-10T11:36:48.389 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 371 k 2023-08-10T11:36:48.390 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 364 k 2023-08-10T11:36:48.390 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 107 k 2023-08-10T11:36:48.390 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 93 k 2023-08-10T11:36:48.390 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.5 M 2023-08-10T11:36:48.390 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 179 k 2023-08-10T11:36:48.390 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-08-10T11:36:48.390 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrading: 2023-08-10T11:36:48.391 INFO:teuthology.orchestra.run.smithi073.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-08-10T11:36:48.391 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.7 M 2023-08-10T11:36:48.391 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.6 M 2023-08-10T11:36:48.391 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2023-08-10T11:36:48.391 INFO:teuthology.orchestra.run.smithi073.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-10T11:36:48.391 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 22 M 2023-08-10T11:36:48.391 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 23 k 2023-08-10T11:36:48.392 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 2.3 M 2023-08-10T11:36:48.392 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 241 k 2023-08-10T11:36:48.392 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 4.6 M 2023-08-10T11:36:48.392 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 18 M 2023-08-10T11:36:48.392 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 15 k 2023-08-10T11:36:48.392 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 24 k 2023-08-10T11:36:48.392 INFO:teuthology.orchestra.run.smithi073.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-10T11:36:48.392 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-10T11:36:48.393 INFO:teuthology.orchestra.run.smithi073.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-08-10T11:36:48.393 INFO:teuthology.orchestra.run.smithi073.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-10T11:36:48.393 INFO:teuthology.orchestra.run.smithi073.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-08-10T11:36:48.393 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 139 k 2023-08-10T11:36:48.393 INFO:teuthology.orchestra.run.smithi073.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-08-10T11:36:48.393 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-08-10T11:36:48.393 INFO:teuthology.orchestra.run.smithi073.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-10T11:36:48.394 INFO:teuthology.orchestra.run.smithi073.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-08-10T11:36:48.394 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-08-10T11:36:48.394 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-10T11:36:48.394 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 473 k 2023-08-10T11:36:48.394 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-08-10T11:36:48.394 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 6.8 M 2023-08-10T11:36:48.394 INFO:teuthology.orchestra.run.smithi073.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-10T11:36:48.395 INFO:teuthology.orchestra.run.smithi073.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-08-10T11:36:48.395 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-10T11:36:48.395 INFO:teuthology.orchestra.run.smithi073.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-10T11:36:48.395 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-10T11:36:48.395 INFO:teuthology.orchestra.run.smithi073.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-10T11:36:48.395 INFO:teuthology.orchestra.run.smithi073.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-10T11:36:48.395 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-08-10T11:36:48.395 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-10T11:36:48.396 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-10T11:36:48.396 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-10T11:36:48.396 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-10T11:36:48.396 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-10T11:36:48.396 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-10T11:36:48.396 INFO:teuthology.orchestra.run.smithi073.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-10T11:36:48.396 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-10T11:36:48.397 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 45 k 2023-08-10T11:36:48.397 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 122 k 2023-08-10T11:36:48.397 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-10T11:36:48.397 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-08-10T11:36:48.397 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-10T11:36:48.397 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-10T11:36:48.397 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-10T11:36:48.397 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-10T11:36:48.398 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-10T11:36:48.398 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-10T11:36:48.398 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-10T11:36:48.398 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-10T11:36:48.398 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-10T11:36:48.398 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-10T11:36:48.398 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-10T11:36:48.398 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-10T11:36:48.399 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-10T11:36:48.399 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-10T11:36:48.399 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-10T11:36:48.399 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-10T11:36:48.399 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-10T11:36:48.399 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-10T11:36:48.399 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-10T11:36:48.400 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-10T11:36:48.400 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-10T11:36:48.400 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-10T11:36:48.400 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-08-10T11:36:48.400 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-10T11:36:48.400 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-10T11:36:48.400 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-08-10T11:36:48.400 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-10T11:36:48.401 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-10T11:36:48.401 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-10T11:36:48.401 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-10T11:36:48.401 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-10T11:36:48.401 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-08-10T11:36:48.401 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-10T11:36:48.401 INFO:teuthology.orchestra.run.smithi073.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-10T11:36:48.402 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-10T11:36:48.402 INFO:teuthology.orchestra.run.smithi073.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-10T11:36:48.402 INFO:teuthology.orchestra.run.smithi073.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-10T11:36:48.402 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-10T11:36:48.402 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-10T11:36:48.402 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-10T11:36:48.402 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-10T11:36:48.402 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-10T11:36:48.403 INFO:teuthology.orchestra.run.smithi073.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-08-10T11:36:48.403 INFO:teuthology.orchestra.run.smithi073.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-10T11:36:48.403 INFO:teuthology.orchestra.run.smithi073.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-08-10T11:36:48.403 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-10T11:36:48.403 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-10T11:36:48.403 INFO:teuthology.orchestra.run.smithi073.stdout:Enabling module streams: 2023-08-10T11:36:48.403 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql 10 2023-08-10T11:36:48.404 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:36:48.404 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2023-08-10T11:36:48.404 INFO:teuthology.orchestra.run.smithi073.stdout:=========================================================================================================================== 2023-08-10T11:36:48.404 INFO:teuthology.orchestra.run.smithi073.stdout:Install 128 Packages 2023-08-10T11:36:48.404 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrade 3 Packages 2023-08-10T11:36:48.404 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:36:48.405 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 206 M 2023-08-10T11:36:48.405 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2023-08-10T11:36:48.651 INFO:teuthology.orchestra.run.smithi073.stdout:(1/131): ceph-18.0.0-5118.ga8bf445f.el8.x86_64. 48 kB/s | 6.4 kB 00:00 2023-08-10T11:36:48.833 INFO:teuthology.orchestra.run.smithi156.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-10T11:36:48.834 INFO:teuthology.orchestra.run.smithi156.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-10T11:36:48.849 INFO:teuthology.orchestra.run.smithi156.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-08-10T11:36:48.850 INFO:teuthology.orchestra.run.smithi156.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-08-10T11:36:48.851 INFO:teuthology.orchestra.run.smithi156.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-08-10T11:36:48.852 INFO:teuthology.orchestra.run.smithi156.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-10T11:36:48.854 INFO:teuthology.orchestra.run.smithi156.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-10T11:36:48.857 INFO:teuthology.orchestra.run.smithi156.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-10T11:36:48.858 INFO:teuthology.orchestra.run.smithi156.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-10T11:36:48.990 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-08-10T11:36:48.993 INFO:teuthology.orchestra.run.smithi073.stdout:(2/131): ceph-base-18.0.0-5118.ga8bf445f.el8.x8 11 MB/s | 5.4 MB 00:00 2023-08-10T11:36:49.002 INFO:teuthology.orchestra.run.smithi156.stdout:=========================================================================================================================== 2023-08-10T11:36:49.002 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-08-10T11:36:49.002 INFO:teuthology.orchestra.run.smithi156.stdout:=========================================================================================================================== 2023-08-10T11:36:49.002 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-08-10T11:36:49.002 INFO:teuthology.orchestra.run.smithi156.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-08-10T11:36:49.003 INFO:teuthology.orchestra.run.smithi156.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-10T11:36:49.003 INFO:teuthology.orchestra.run.smithi156.stdout: ceph x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 6.4 k 2023-08-10T11:36:49.003 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 5.4 M 2023-08-10T11:36:49.003 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 849 k 2023-08-10T11:36:49.003 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 167 k 2023-08-10T11:36:49.003 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 1.6 M 2023-08-10T11:36:49.003 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 129 k 2023-08-10T11:36:49.003 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 1.7 M 2023-08-10T11:36:49.004 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 7.4 M 2023-08-10T11:36:49.004 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 47 k 2023-08-10T11:36:49.004 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 14 M 2023-08-10T11:36:49.004 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 48 M 2023-08-10T11:36:49.004 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-volume noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 258 k 2023-08-10T11:36:49.004 INFO:teuthology.orchestra.run.smithi156.stdout: cephadm noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 168 k 2023-08-10T11:36:49.004 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-mirror x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 260 k 2023-08-10T11:36:49.005 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-top noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 18 k 2023-08-10T11:36:49.005 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-08-10T11:36:49.005 INFO:teuthology.orchestra.run.smithi156.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-10T11:36:49.005 INFO:teuthology.orchestra.run.smithi156.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-10T11:36:49.005 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 31 k 2023-08-10T11:36:49.005 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 772 k 2023-08-10T11:36:49.005 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 139 k 2023-08-10T11:36:49.005 INFO:teuthology.orchestra.run.smithi156.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-10T11:36:49.006 INFO:teuthology.orchestra.run.smithi156.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-08-10T11:36:49.006 INFO:teuthology.orchestra.run.smithi156.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-10T11:36:49.006 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-08-10T11:36:49.006 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-08-10T11:36:49.006 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-08-10T11:36:49.006 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 197 k 2023-08-10T11:36:49.006 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 371 k 2023-08-10T11:36:49.007 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 364 k 2023-08-10T11:36:49.007 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 107 k 2023-08-10T11:36:49.007 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 93 k 2023-08-10T11:36:49.007 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.5 M 2023-08-10T11:36:49.007 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 179 k 2023-08-10T11:36:49.007 INFO:teuthology.orchestra.run.smithi156.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-08-10T11:36:49.007 INFO:teuthology.orchestra.run.smithi156.stdout:Upgrading: 2023-08-10T11:36:49.007 INFO:teuthology.orchestra.run.smithi156.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-08-10T11:36:49.008 INFO:teuthology.orchestra.run.smithi156.stdout: librados2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.7 M 2023-08-10T11:36:49.008 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.6 M 2023-08-10T11:36:49.008 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-08-10T11:36:49.008 INFO:teuthology.orchestra.run.smithi156.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-10T11:36:49.008 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 22 M 2023-08-10T11:36:49.008 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 23 k 2023-08-10T11:36:49.009 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 2.3 M 2023-08-10T11:36:49.009 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 241 k 2023-08-10T11:36:49.009 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 4.6 M 2023-08-10T11:36:49.009 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 18 M 2023-08-10T11:36:49.009 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 15 k 2023-08-10T11:36:49.010 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 24 k 2023-08-10T11:36:49.010 INFO:teuthology.orchestra.run.smithi156.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-10T11:36:49.010 INFO:teuthology.orchestra.run.smithi156.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-10T11:36:49.010 INFO:teuthology.orchestra.run.smithi156.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-08-10T11:36:49.010 INFO:teuthology.orchestra.run.smithi156.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-10T11:36:49.010 INFO:teuthology.orchestra.run.smithi156.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-08-10T11:36:49.010 INFO:teuthology.orchestra.run.smithi156.stdout: libcephsqlite x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 139 k 2023-08-10T11:36:49.011 INFO:teuthology.orchestra.run.smithi156.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-08-10T11:36:49.011 INFO:teuthology.orchestra.run.smithi156.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-08-10T11:36:49.011 INFO:teuthology.orchestra.run.smithi156.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-10T11:36:49.011 INFO:teuthology.orchestra.run.smithi156.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-08-10T11:36:49.011 INFO:teuthology.orchestra.run.smithi156.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-08-10T11:36:49.011 INFO:teuthology.orchestra.run.smithi156.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-10T11:36:49.011 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 473 k 2023-08-10T11:36:49.011 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-08-10T11:36:49.012 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 6.8 M 2023-08-10T11:36:49.012 INFO:teuthology.orchestra.run.smithi156.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-10T11:36:49.012 INFO:teuthology.orchestra.run.smithi156.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-08-10T11:36:49.012 INFO:teuthology.orchestra.run.smithi156.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-10T11:36:49.012 INFO:teuthology.orchestra.run.smithi156.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-10T11:36:49.012 INFO:teuthology.orchestra.run.smithi156.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-10T11:36:49.012 INFO:teuthology.orchestra.run.smithi156.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-10T11:36:49.012 INFO:teuthology.orchestra.run.smithi156.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-10T11:36:49.013 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-08-10T11:36:49.013 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-10T11:36:49.013 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-10T11:36:49.013 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-10T11:36:49.013 INFO:teuthology.orchestra.run.smithi156.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-10T11:36:49.013 INFO:teuthology.orchestra.run.smithi156.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-10T11:36:49.013 INFO:teuthology.orchestra.run.smithi156.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-10T11:36:49.014 INFO:teuthology.orchestra.run.smithi156.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-10T11:36:49.014 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-10T11:36:49.014 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 45 k 2023-08-10T11:36:49.014 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 122 k 2023-08-10T11:36:49.014 INFO:teuthology.orchestra.run.smithi156.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-10T11:36:49.014 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-08-10T11:36:49.014 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-10T11:36:49.014 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-10T11:36:49.015 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-10T11:36:49.015 INFO:teuthology.orchestra.run.smithi156.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-10T11:36:49.015 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-10T11:36:49.015 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-10T11:36:49.015 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-10T11:36:49.015 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-10T11:36:49.015 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-10T11:36:49.015 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-10T11:36:49.016 INFO:teuthology.orchestra.run.smithi156.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-10T11:36:49.016 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-10T11:36:49.016 INFO:teuthology.orchestra.run.smithi156.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-10T11:36:49.016 INFO:teuthology.orchestra.run.smithi156.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-10T11:36:49.016 INFO:teuthology.orchestra.run.smithi156.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-10T11:36:49.016 INFO:teuthology.orchestra.run.smithi156.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-10T11:36:49.016 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-10T11:36:49.017 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-10T11:36:49.017 INFO:teuthology.orchestra.run.smithi156.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-10T11:36:49.017 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-10T11:36:49.017 INFO:teuthology.orchestra.run.smithi156.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-10T11:36:49.017 INFO:teuthology.orchestra.run.smithi156.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-10T11:36:49.017 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-08-10T11:36:49.017 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-10T11:36:49.018 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-10T11:36:49.018 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-08-10T11:36:49.018 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-10T11:36:49.018 INFO:teuthology.orchestra.run.smithi156.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-10T11:36:49.018 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-10T11:36:49.018 INFO:teuthology.orchestra.run.smithi156.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-10T11:36:49.018 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-10T11:36:49.018 INFO:teuthology.orchestra.run.smithi156.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-08-10T11:36:49.019 INFO:teuthology.orchestra.run.smithi156.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-10T11:36:49.019 INFO:teuthology.orchestra.run.smithi156.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-10T11:36:49.019 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-10T11:36:49.019 INFO:teuthology.orchestra.run.smithi156.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-10T11:36:49.019 INFO:teuthology.orchestra.run.smithi156.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-10T11:36:49.019 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-10T11:36:49.019 INFO:teuthology.orchestra.run.smithi156.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-10T11:36:49.020 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-10T11:36:49.020 INFO:teuthology.orchestra.run.smithi156.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-10T11:36:49.020 INFO:teuthology.orchestra.run.smithi156.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-10T11:36:49.020 INFO:teuthology.orchestra.run.smithi156.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-08-10T11:36:49.020 INFO:teuthology.orchestra.run.smithi156.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-10T11:36:49.020 INFO:teuthology.orchestra.run.smithi156.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-08-10T11:36:49.021 INFO:teuthology.orchestra.run.smithi156.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-10T11:36:49.021 INFO:teuthology.orchestra.run.smithi156.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-10T11:36:49.021 INFO:teuthology.orchestra.run.smithi156.stdout:Enabling module streams: 2023-08-10T11:36:49.021 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql 10 2023-08-10T11:36:49.021 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-08-10T11:36:49.021 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-08-10T11:36:49.021 INFO:teuthology.orchestra.run.smithi156.stdout:=========================================================================================================================== 2023-08-10T11:36:49.022 INFO:teuthology.orchestra.run.smithi156.stdout:Install 128 Packages 2023-08-10T11:36:49.022 INFO:teuthology.orchestra.run.smithi156.stdout:Upgrade 3 Packages 2023-08-10T11:36:49.022 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-08-10T11:36:49.022 INFO:teuthology.orchestra.run.smithi073.stdout:(3/131): ceph-fuse-18.0.0-5118.ga8bf445f.el8.x8 2.3 MB/s | 849 kB 00:00 2023-08-10T11:36:49.023 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 206 M 2023-08-10T11:36:49.023 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-08-10T11:36:49.043 INFO:teuthology.orchestra.run.smithi073.stdout:(4/131): ceph-immutable-object-cache-18.0.0-511 3.3 MB/s | 167 kB 00:00 2023-08-10T11:36:49.169 INFO:teuthology.orchestra.run.smithi073.stdout:(5/131): ceph-mgr-18.0.0-5118.ga8bf445f.el8.x86 12 MB/s | 1.6 MB 00:00 2023-08-10T11:36:49.353 INFO:teuthology.orchestra.run.smithi156.stdout:(1/131): ceph-18.0.0-5118.ga8bf445f.el8.x86_64. 21 kB/s | 6.4 kB 00:00 2023-08-10T11:36:49.434 INFO:teuthology.orchestra.run.smithi152.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-10T11:36:49.435 INFO:teuthology.orchestra.run.smithi152.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-10T11:36:49.449 INFO:teuthology.orchestra.run.smithi152.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-08-10T11:36:49.451 INFO:teuthology.orchestra.run.smithi152.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-08-10T11:36:49.452 INFO:teuthology.orchestra.run.smithi152.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-08-10T11:36:49.453 INFO:teuthology.orchestra.run.smithi152.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-10T11:36:49.455 INFO:teuthology.orchestra.run.smithi152.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-10T11:36:49.458 INFO:teuthology.orchestra.run.smithi152.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-10T11:36:49.459 INFO:teuthology.orchestra.run.smithi152.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-10T11:36:49.469 INFO:teuthology.orchestra.run.smithi073.stdout:(6/131): ceph-mon-18.0.0-5118.ga8bf445f.el8.x86 15 MB/s | 4.6 MB 00:00 2023-08-10T11:36:49.519 INFO:teuthology.orchestra.run.smithi073.stdout:(7/131): ceph-mds-18.0.0-5118.ga8bf445f.el8.x86 4.6 MB/s | 2.3 MB 00:00 2023-08-10T11:36:49.591 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-08-10T11:36:49.604 INFO:teuthology.orchestra.run.smithi152.stdout:=========================================================================================================================== 2023-08-10T11:36:49.605 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2023-08-10T11:36:49.605 INFO:teuthology.orchestra.run.smithi152.stdout:=========================================================================================================================== 2023-08-10T11:36:49.605 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-08-10T11:36:49.605 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-08-10T11:36:49.606 INFO:teuthology.orchestra.run.smithi152.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-10T11:36:49.606 INFO:teuthology.orchestra.run.smithi152.stdout: ceph x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 6.4 k 2023-08-10T11:36:49.606 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 5.4 M 2023-08-10T11:36:49.606 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 849 k 2023-08-10T11:36:49.607 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 167 k 2023-08-10T11:36:49.607 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 1.6 M 2023-08-10T11:36:49.607 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 129 k 2023-08-10T11:36:49.607 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 1.7 M 2023-08-10T11:36:49.608 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 7.4 M 2023-08-10T11:36:49.608 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 47 k 2023-08-10T11:36:49.608 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 14 M 2023-08-10T11:36:49.608 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 48 M 2023-08-10T11:36:49.609 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 258 k 2023-08-10T11:36:49.609 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 168 k 2023-08-10T11:36:49.609 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-mirror x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 260 k 2023-08-10T11:36:49.610 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-top noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 18 k 2023-08-10T11:36:49.610 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-08-10T11:36:49.610 INFO:teuthology.orchestra.run.smithi152.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-10T11:36:49.610 INFO:teuthology.orchestra.run.smithi152.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-10T11:36:49.611 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 31 k 2023-08-10T11:36:49.611 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 772 k 2023-08-10T11:36:49.611 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 139 k 2023-08-10T11:36:49.611 INFO:teuthology.orchestra.run.smithi152.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-10T11:36:49.611 INFO:teuthology.orchestra.run.smithi152.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-08-10T11:36:49.611 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-10T11:36:49.612 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-08-10T11:36:49.612 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-08-10T11:36:49.612 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-08-10T11:36:49.612 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 197 k 2023-08-10T11:36:49.612 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 371 k 2023-08-10T11:36:49.612 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 364 k 2023-08-10T11:36:49.612 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 107 k 2023-08-10T11:36:49.612 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 93 k 2023-08-10T11:36:49.613 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.5 M 2023-08-10T11:36:49.613 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 179 k 2023-08-10T11:36:49.613 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-08-10T11:36:49.613 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrading: 2023-08-10T11:36:49.613 INFO:teuthology.orchestra.run.smithi152.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-08-10T11:36:49.613 INFO:teuthology.orchestra.run.smithi152.stdout: librados2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.7 M 2023-08-10T11:36:49.613 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.6 M 2023-08-10T11:36:49.614 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2023-08-10T11:36:49.614 INFO:teuthology.orchestra.run.smithi152.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-10T11:36:49.614 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 22 M 2023-08-10T11:36:49.614 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 23 k 2023-08-10T11:36:49.614 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 2.3 M 2023-08-10T11:36:49.614 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 241 k 2023-08-10T11:36:49.614 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 4.6 M 2023-08-10T11:36:49.615 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 18 M 2023-08-10T11:36:49.615 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 15 k 2023-08-10T11:36:49.615 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 24 k 2023-08-10T11:36:49.615 INFO:teuthology.orchestra.run.smithi152.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-10T11:36:49.615 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-10T11:36:49.615 INFO:teuthology.orchestra.run.smithi152.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-08-10T11:36:49.615 INFO:teuthology.orchestra.run.smithi152.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-10T11:36:49.615 INFO:teuthology.orchestra.run.smithi152.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-08-10T11:36:49.616 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 139 k 2023-08-10T11:36:49.616 INFO:teuthology.orchestra.run.smithi152.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-08-10T11:36:49.616 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-08-10T11:36:49.616 INFO:teuthology.orchestra.run.smithi152.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-10T11:36:49.616 INFO:teuthology.orchestra.run.smithi152.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-08-10T11:36:49.616 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-08-10T11:36:49.616 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-10T11:36:49.617 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 473 k 2023-08-10T11:36:49.617 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-08-10T11:36:49.617 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 6.8 M 2023-08-10T11:36:49.617 INFO:teuthology.orchestra.run.smithi152.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-10T11:36:49.617 INFO:teuthology.orchestra.run.smithi152.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-08-10T11:36:49.617 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-10T11:36:49.617 INFO:teuthology.orchestra.run.smithi152.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-10T11:36:49.618 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-10T11:36:49.618 INFO:teuthology.orchestra.run.smithi152.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-10T11:36:49.618 INFO:teuthology.orchestra.run.smithi152.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-10T11:36:49.618 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-08-10T11:36:49.618 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-10T11:36:49.618 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-10T11:36:49.618 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-10T11:36:49.619 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-10T11:36:49.619 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-10T11:36:49.619 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-10T11:36:49.619 INFO:teuthology.orchestra.run.smithi152.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-10T11:36:49.619 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-10T11:36:49.620 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 45 k 2023-08-10T11:36:49.620 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 122 k 2023-08-10T11:36:49.620 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-10T11:36:49.620 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-08-10T11:36:49.620 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-10T11:36:49.620 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-10T11:36:49.621 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-10T11:36:49.621 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-10T11:36:49.621 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-10T11:36:49.621 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-10T11:36:49.621 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-10T11:36:49.621 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-10T11:36:49.621 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-10T11:36:49.622 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-10T11:36:49.622 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-10T11:36:49.622 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-10T11:36:49.622 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-10T11:36:49.622 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-10T11:36:49.622 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-10T11:36:49.622 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-10T11:36:49.622 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-10T11:36:49.623 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-10T11:36:49.623 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-10T11:36:49.623 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-10T11:36:49.623 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-10T11:36:49.623 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-10T11:36:49.623 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-08-10T11:36:49.623 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-10T11:36:49.624 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-10T11:36:49.624 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-08-10T11:36:49.624 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-10T11:36:49.624 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-10T11:36:49.624 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-10T11:36:49.624 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-10T11:36:49.624 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-10T11:36:49.625 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-08-10T11:36:49.625 INFO:teuthology.orchestra.run.smithi152.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-10T11:36:49.625 INFO:teuthology.orchestra.run.smithi152.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-10T11:36:49.625 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-10T11:36:49.625 INFO:teuthology.orchestra.run.smithi152.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-10T11:36:49.625 INFO:teuthology.orchestra.run.smithi152.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-10T11:36:49.625 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-10T11:36:49.626 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-10T11:36:49.626 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-10T11:36:49.626 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-10T11:36:49.626 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-10T11:36:49.626 INFO:teuthology.orchestra.run.smithi152.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-08-10T11:36:49.626 INFO:teuthology.orchestra.run.smithi152.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-10T11:36:49.626 INFO:teuthology.orchestra.run.smithi152.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-08-10T11:36:49.627 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-10T11:36:49.627 INFO:teuthology.orchestra.run.smithi152.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-10T11:36:49.627 INFO:teuthology.orchestra.run.smithi152.stdout:Enabling module streams: 2023-08-10T11:36:49.627 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql 10 2023-08-10T11:36:49.627 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-08-10T11:36:49.627 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-08-10T11:36:49.627 INFO:teuthology.orchestra.run.smithi152.stdout:=========================================================================================================================== 2023-08-10T11:36:49.628 INFO:teuthology.orchestra.run.smithi152.stdout:Install 128 Packages 2023-08-10T11:36:49.628 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrade 3 Packages 2023-08-10T11:36:49.628 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-08-10T11:36:49.629 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 206 M 2023-08-10T11:36:49.629 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-08-10T11:36:50.203 INFO:teuthology.orchestra.run.smithi152.stdout:(1/131): ceph-18.0.0-5118.ga8bf445f.el8.x86_64. 26 kB/s | 6.4 kB 00:00 2023-08-10T11:36:50.445 INFO:teuthology.orchestra.run.smithi156.stdout:(2/131): ceph-fuse-18.0.0-5118.ga8bf445f.el8.x8 778 kB/s | 849 kB 00:01 2023-08-10T11:36:50.595 INFO:teuthology.orchestra.run.smithi073.stdout:(8/131): ceph-osd-18.0.0-5118.ga8bf445f.el8.x86 16 MB/s | 18 MB 00:01 2023-08-10T11:36:50.612 INFO:teuthology.orchestra.run.smithi156.stdout:(3/131): ceph-immutable-object-cache-18.0.0-511 1.0 MB/s | 167 kB 00:00 2023-08-10T11:36:50.637 INFO:teuthology.orchestra.run.smithi073.stdout:(9/131): ceph-selinux-18.0.0-5118.ga8bf445f.el8 586 kB/s | 24 kB 00:00 2023-08-10T11:36:50.653 INFO:teuthology.orchestra.run.smithi152.stdout:(2/131): ceph-fuse-18.0.0-5118.ga8bf445f.el8.x8 1.8 MB/s | 849 kB 00:00 2023-08-10T11:36:50.820 INFO:teuthology.orchestra.run.smithi152.stdout:(3/131): ceph-immutable-object-cache-18.0.0-511 1.0 MB/s | 167 kB 00:00 2023-08-10T11:36:51.953 INFO:teuthology.orchestra.run.smithi152.stdout:(4/131): ceph-base-18.0.0-5118.ga8bf445f.el8.x8 2.7 MB/s | 5.4 MB 00:01 2023-08-10T11:36:52.004 INFO:teuthology.orchestra.run.smithi152.stdout:(5/131): ceph-mds-18.0.0-5118.ga8bf445f.el8.x86 1.9 MB/s | 2.3 MB 00:01 2023-08-10T11:36:52.029 INFO:teuthology.orchestra.run.smithi156.stdout:(4/131): ceph-mds-18.0.0-5118.ga8bf445f.el8.x86 1.6 MB/s | 2.3 MB 00:01 2023-08-10T11:36:52.446 INFO:teuthology.orchestra.run.smithi152.stdout:(6/131): ceph-mgr-18.0.0-5118.ga8bf445f.el8.x86 3.2 MB/s | 1.6 MB 00:00 2023-08-10T11:36:52.687 INFO:teuthology.orchestra.run.smithi156.stdout:(5/131): ceph-mgr-18.0.0-5118.ga8bf445f.el8.x86 2.4 MB/s | 1.6 MB 00:00 2023-08-10T11:36:52.862 INFO:teuthology.orchestra.run.smithi073.stdout:(10/131): ceph-radosgw-18.0.0-5118.ga8bf445f.el 4.1 MB/s | 14 MB 00:03 2023-08-10T11:36:53.021 INFO:teuthology.orchestra.run.smithi156.stdout:(6/131): ceph-base-18.0.0-5118.ga8bf445f.el8.x8 1.4 MB/s | 5.4 MB 00:03 2023-08-10T11:36:53.037 INFO:teuthology.orchestra.run.smithi073.stdout:(11/131): cephfs-mirror-18.0.0-5118.ga8bf445f.e 1.5 MB/s | 260 kB 00:00 2023-08-10T11:36:53.129 INFO:teuthology.orchestra.run.smithi073.stdout:(12/131): libcephfs-devel-18.0.0-5118.ga8bf445f 338 kB/s | 31 kB 00:00 2023-08-10T11:36:53.154 INFO:teuthology.orchestra.run.smithi152.stdout:(7/131): ceph-mon-18.0.0-5118.ga8bf445f.el8.x86 4.0 MB/s | 4.6 MB 00:01 2023-08-10T11:36:53.746 INFO:teuthology.orchestra.run.smithi073.stdout:(13/131): libcephfs2-18.0.0-5118.ga8bf445f.el8. 1.2 MB/s | 772 kB 00:00 2023-08-10T11:36:54.204 INFO:teuthology.orchestra.run.smithi073.stdout:(14/131): libcephsqlite-18.0.0-5118.ga8bf445f.e 303 kB/s | 139 kB 00:00 2023-08-10T11:36:54.221 INFO:teuthology.orchestra.run.smithi156.stdout:(7/131): ceph-mon-18.0.0-5118.ga8bf445f.el8.x86 3.0 MB/s | 4.6 MB 00:01 2023-08-10T11:36:54.380 INFO:teuthology.orchestra.run.smithi073.stdout:(15/131): librados-devel-18.0.0-5118.ga8bf445f. 795 kB/s | 139 kB 00:00 2023-08-10T11:36:54.713 INFO:teuthology.orchestra.run.smithi073.stdout:(16/131): libradosstriper1-18.0.0-5118.ga8bf445 1.4 MB/s | 473 kB 00:00 2023-08-10T11:36:55.163 INFO:teuthology.orchestra.run.smithi152.stdout:(8/131): ceph-radosgw-18.0.0-5118.ga8bf445f.el8 6.7 MB/s | 14 MB 00:02 2023-08-10T11:36:55.263 INFO:teuthology.orchestra.run.smithi152.stdout:(9/131): ceph-selinux-18.0.0-5118.ga8bf445f.el8 243 kB/s | 24 kB 00:00 2023-08-10T11:36:56.463 INFO:teuthology.orchestra.run.smithi152.stdout:(10/131): ceph-common-18.0.0-5118.ga8bf445f.el8 3.4 MB/s | 22 MB 00:06 2023-08-10T11:36:56.597 INFO:teuthology.orchestra.run.smithi152.stdout:(11/131): cephfs-mirror-18.0.0-5118.ga8bf445f.e 1.9 MB/s | 260 kB 00:00 2023-08-10T11:36:56.672 INFO:teuthology.orchestra.run.smithi152.stdout:(12/131): libcephfs-devel-18.0.0-5118.ga8bf445f 413 kB/s | 31 kB 00:00 2023-08-10T11:36:56.872 INFO:teuthology.orchestra.run.smithi073.stdout:(17/131): ceph-test-18.0.0-5118.ga8bf445f.el8.x 7.7 MB/s | 48 MB 00:06 2023-08-10T11:36:56.922 INFO:teuthology.orchestra.run.smithi152.stdout:(13/131): libcephfs2-18.0.0-5118.ga8bf445f.el8. 3.0 MB/s | 772 kB 00:00 2023-08-10T11:36:56.947 INFO:teuthology.orchestra.run.smithi073.stdout:(18/131): python3-ceph-argparse-18.0.0-5118.ga8 599 kB/s | 45 kB 00:00 2023-08-10T11:36:57.014 INFO:teuthology.orchestra.run.smithi152.stdout:(14/131): libcephsqlite-18.0.0-5118.ga8bf445f.e 1.5 MB/s | 139 kB 00:00 2023-08-10T11:36:57.072 INFO:teuthology.orchestra.run.smithi073.stdout:(19/131): python3-ceph-common-18.0.0-5118.ga8bf 982 kB/s | 122 kB 00:00 2023-08-10T11:36:57.098 INFO:teuthology.orchestra.run.smithi152.stdout:(15/131): librados-devel-18.0.0-5118.ga8bf445f. 1.6 MB/s | 139 kB 00:00 2023-08-10T11:36:57.164 INFO:teuthology.orchestra.run.smithi073.stdout:(20/131): python3-cephfs-18.0.0-5118.ga8bf445f. 2.1 MB/s | 197 kB 00:00 2023-08-10T11:36:57.257 INFO:teuthology.orchestra.run.smithi152.stdout:(16/131): libradosstriper1-18.0.0-5118.ga8bf445 2.9 MB/s | 473 kB 00:00 2023-08-10T11:36:57.314 INFO:teuthology.orchestra.run.smithi073.stdout:(21/131): python3-rados-18.0.0-5118.ga8bf445f.e 2.4 MB/s | 371 kB 00:00 2023-08-10T11:36:57.398 INFO:teuthology.orchestra.run.smithi073.stdout:(22/131): python3-rbd-18.0.0-5118.ga8bf445f.el8 4.3 MB/s | 364 kB 00:00 2023-08-10T11:36:57.473 INFO:teuthology.orchestra.run.smithi073.stdout:(23/131): python3-rgw-18.0.0-5118.ga8bf445f.el8 1.4 MB/s | 107 kB 00:00 2023-08-10T11:36:57.557 INFO:teuthology.orchestra.run.smithi073.stdout:(24/131): rbd-fuse-18.0.0-5118.ga8bf445f.el8.x8 1.1 MB/s | 93 kB 00:00 2023-08-10T11:36:57.904 INFO:teuthology.orchestra.run.smithi156.stdout:(8/131): ceph-radosgw-18.0.0-5118.ga8bf445f.el8 3.7 MB/s | 14 MB 00:03 2023-08-10T11:36:57.974 INFO:teuthology.orchestra.run.smithi073.stdout:(25/131): librgw2-18.0.0-5118.ga8bf445f.el8.x86 2.1 MB/s | 6.8 MB 00:03 2023-08-10T11:36:58.013 INFO:teuthology.orchestra.run.smithi156.stdout:(9/131): ceph-selinux-18.0.0-5118.ga8bf445f.el8 225 kB/s | 24 kB 00:00 2023-08-10T11:36:58.166 INFO:teuthology.orchestra.run.smithi073.stdout:(26/131): rbd-nbd-18.0.0-5118.ga8bf445f.el8.x86 935 kB/s | 179 kB 00:00 2023-08-10T11:36:58.225 INFO:teuthology.orchestra.run.smithi073.stdout:(27/131): rbd-mirror-18.0.0-5118.ga8bf445f.el8. 5.3 MB/s | 3.5 MB 00:00 2023-08-10T11:36:58.250 INFO:teuthology.orchestra.run.smithi073.stdout:(28/131): ceph-grafana-dashboards-18.0.0-5118.g 276 kB/s | 23 kB 00:00 2023-08-10T11:36:58.300 INFO:teuthology.orchestra.run.smithi073.stdout:(29/131): ceph-mgr-cephadm-18.0.0-5118.ga8bf445 1.7 MB/s | 129 kB 00:00 2023-08-10T11:36:58.923 INFO:teuthology.orchestra.run.smithi152.stdout:(17/131): librgw2-18.0.0-5118.ga8bf445f.el8.x86 4.1 MB/s | 6.8 MB 00:01 2023-08-10T11:36:59.007 INFO:teuthology.orchestra.run.smithi152.stdout:(18/131): python3-ceph-argparse-18.0.0-5118.ga8 538 kB/s | 45 kB 00:00 2023-08-10T11:36:59.059 INFO:teuthology.orchestra.run.smithi073.stdout:(30/131): ceph-mgr-dashboard-18.0.0-5118.ga8bf4 2.1 MB/s | 1.7 MB 00:00 2023-08-10T11:36:59.091 INFO:teuthology.orchestra.run.smithi152.stdout:(19/131): python3-ceph-common-18.0.0-5118.ga8bf 1.4 MB/s | 122 kB 00:00 2023-08-10T11:36:59.225 INFO:teuthology.orchestra.run.smithi073.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5118.ga8 1.4 MB/s | 241 kB 00:00 2023-08-10T11:36:59.258 INFO:teuthology.orchestra.run.smithi152.stdout:(20/131): python3-cephfs-18.0.0-5118.ga8bf445f. 1.2 MB/s | 197 kB 00:00 2023-08-10T11:36:59.292 INFO:teuthology.orchestra.run.smithi073.stdout:(32/131): ceph-mgr-rook-18.0.0-5118.ga8bf445f.e 711 kB/s | 47 kB 00:00 2023-08-10T11:36:59.393 INFO:teuthology.orchestra.run.smithi073.stdout:(33/131): ceph-prometheus-alerts-18.0.0-5118.ga 145 kB/s | 15 kB 00:00 2023-08-10T11:36:59.517 INFO:teuthology.orchestra.run.smithi152.stdout:(21/131): ceph-osd-18.0.0-5118.ga8bf445f.el8.x8 2.5 MB/s | 18 MB 00:07 2023-08-10T11:36:59.542 INFO:teuthology.orchestra.run.smithi152.stdout:(22/131): python3-rados-18.0.0-5118.ga8bf445f.e 1.3 MB/s | 371 kB 00:00 2023-08-10T11:36:59.576 INFO:teuthology.orchestra.run.smithi073.stdout:(34/131): ceph-mgr-diskprediction-local-18.0.0- 5.8 MB/s | 7.4 MB 00:01 2023-08-10T11:36:59.602 INFO:teuthology.orchestra.run.smithi073.stdout:(35/131): ceph-volume-18.0.0-5118.ga8bf445f.el8 1.2 MB/s | 258 kB 00:00 2023-08-10T11:36:59.609 INFO:teuthology.orchestra.run.smithi152.stdout:(23/131): python3-rgw-18.0.0-5118.ga8bf445f.el8 1.6 MB/s | 107 kB 00:00 2023-08-10T11:36:59.652 INFO:teuthology.orchestra.run.smithi073.stdout:(36/131): cephadm-18.0.0-5118.ga8bf445f.el8.noa 2.2 MB/s | 168 kB 00:00 2023-08-10T11:36:59.669 INFO:teuthology.orchestra.run.smithi073.stdout:(37/131): cephfs-top-18.0.0-5118.ga8bf445f.el8. 269 kB/s | 18 kB 00:00 2023-08-10T11:36:59.684 INFO:teuthology.orchestra.run.smithi152.stdout:(24/131): python3-rbd-18.0.0-5118.ga8bf445f.el8 2.1 MB/s | 364 kB 00:00 2023-08-10T11:36:59.709 INFO:teuthology.orchestra.run.smithi152.stdout:(25/131): rbd-fuse-18.0.0-5118.ga8bf445f.el8.x8 934 kB/s | 93 kB 00:00 2023-08-10T11:36:59.776 INFO:teuthology.orchestra.run.smithi152.stdout:(26/131): rbd-nbd-18.0.0-5118.ga8bf445f.el8.x86 2.6 MB/s | 179 kB 00:00 2023-08-10T11:36:59.852 INFO:teuthology.orchestra.run.smithi152.stdout:(27/131): ceph-grafana-dashboards-18.0.0-5118.g 308 kB/s | 23 kB 00:00 2023-08-10T11:36:59.927 INFO:teuthology.orchestra.run.smithi152.stdout:(28/131): ceph-mgr-cephadm-18.0.0-5118.ga8bf445 1.7 MB/s | 129 kB 00:00 2023-08-10T11:37:00.377 INFO:teuthology.orchestra.run.smithi152.stdout:(29/131): ceph-mgr-dashboard-18.0.0-5118.ga8bf4 3.8 MB/s | 1.7 MB 00:00 2023-08-10T11:37:00.686 INFO:teuthology.orchestra.run.smithi152.stdout:(30/131): rbd-mirror-18.0.0-5118.ga8bf445f.el8. 3.5 MB/s | 3.5 MB 00:01 2023-08-10T11:37:01.145 INFO:teuthology.orchestra.run.smithi152.stdout:(31/131): ceph-test-18.0.0-5118.ga8bf445f.el8.x 8.2 MB/s | 48 MB 00:05 2023-08-10T11:37:01.170 INFO:teuthology.orchestra.run.smithi152.stdout:(32/131): ceph-mgr-modules-core-18.0.0-5118.ga8 498 kB/s | 241 kB 00:00 2023-08-10T11:37:01.196 INFO:teuthology.orchestra.run.smithi152.stdout:(33/131): ceph-mgr-rook-18.0.0-5118.ga8bf445f.e 950 kB/s | 47 kB 00:00 2023-08-10T11:37:01.254 INFO:teuthology.orchestra.run.smithi152.stdout:(34/131): ceph-prometheus-alerts-18.0.0-5118.ga 174 kB/s | 15 kB 00:00 2023-08-10T11:37:01.321 INFO:teuthology.orchestra.run.smithi152.stdout:(35/131): ceph-volume-18.0.0-5118.ga8bf445f.el8 2.0 MB/s | 258 kB 00:00 2023-08-10T11:37:01.380 INFO:teuthology.orchestra.run.smithi152.stdout:(36/131): cephadm-18.0.0-5118.ga8bf445f.el8.noa 1.3 MB/s | 168 kB 00:00 2023-08-10T11:37:01.397 INFO:teuthology.orchestra.run.smithi152.stdout:(37/131): cephfs-top-18.0.0-5118.ga8bf445f.el8. 239 kB/s | 18 kB 00:00 2023-08-10T11:37:01.631 INFO:teuthology.orchestra.run.smithi152.stdout:(38/131): ceph-mgr-diskprediction-local-18.0.0- 5.9 MB/s | 7.4 MB 00:01 2023-08-10T11:37:01.637 INFO:teuthology.orchestra.run.smithi156.stdout:(10/131): ceph-osd-18.0.0-5118.ga8bf445f.el8.x8 2.1 MB/s | 18 MB 00:08 2023-08-10T11:37:01.821 INFO:teuthology.orchestra.run.smithi156.stdout:(11/131): cephfs-mirror-18.0.0-5118.ga8bf445f.e 1.4 MB/s | 260 kB 00:00 2023-08-10T11:37:01.836 INFO:teuthology.orchestra.run.smithi073.stdout:(38/131): ceph-common-18.0.0-5118.ga8bf445f.el8 1.7 MB/s | 22 MB 00:13 2023-08-10T11:37:02.096 INFO:teuthology.orchestra.run.smithi156.stdout:(12/131): libcephfs-devel-18.0.0-5118.ga8bf445f 113 kB/s | 31 kB 00:00 2023-08-10T11:37:02.355 INFO:teuthology.orchestra.run.smithi156.stdout:(13/131): libcephfs2-18.0.0-5118.ga8bf445f.el8. 2.9 MB/s | 772 kB 00:00 2023-08-10T11:37:02.455 INFO:teuthology.orchestra.run.smithi156.stdout:(14/131): libcephsqlite-18.0.0-5118.ga8bf445f.e 1.4 MB/s | 139 kB 00:00 2023-08-10T11:37:02.539 INFO:teuthology.orchestra.run.smithi156.stdout:(15/131): librados-devel-18.0.0-5118.ga8bf445f. 1.6 MB/s | 139 kB 00:00 2023-08-10T11:37:02.806 INFO:teuthology.orchestra.run.smithi156.stdout:(16/131): ceph-common-18.0.0-5118.ga8bf445f.el8 1.6 MB/s | 22 MB 00:13 2023-08-10T11:37:02.831 INFO:teuthology.orchestra.run.smithi156.stdout:(17/131): libradosstriper1-18.0.0-5118.ga8bf445 1.6 MB/s | 473 kB 00:00 2023-08-10T11:37:02.898 INFO:teuthology.orchestra.run.smithi156.stdout:(18/131): python3-ceph-argparse-18.0.0-5118.ga8 671 kB/s | 45 kB 00:00 2023-08-10T11:37:02.990 INFO:teuthology.orchestra.run.smithi156.stdout:(19/131): python3-ceph-common-18.0.0-5118.ga8bf 1.3 MB/s | 122 kB 00:00 2023-08-10T11:37:03.065 INFO:teuthology.orchestra.run.smithi156.stdout:(20/131): python3-cephfs-18.0.0-5118.ga8bf445f. 2.6 MB/s | 197 kB 00:00 2023-08-10T11:37:03.182 INFO:teuthology.orchestra.run.smithi156.stdout:(21/131): python3-rados-18.0.0-5118.ga8bf445f.e 3.1 MB/s | 371 kB 00:00 2023-08-10T11:37:03.333 INFO:teuthology.orchestra.run.smithi156.stdout:(22/131): python3-rbd-18.0.0-5118.ga8bf445f.el8 2.4 MB/s | 364 kB 00:00 2023-08-10T11:37:03.425 INFO:teuthology.orchestra.run.smithi156.stdout:(23/131): python3-rgw-18.0.0-5118.ga8bf445f.el8 1.1 MB/s | 107 kB 00:00 2023-08-10T11:37:03.508 INFO:teuthology.orchestra.run.smithi156.stdout:(24/131): rbd-fuse-18.0.0-5118.ga8bf445f.el8.x8 1.1 MB/s | 93 kB 00:00 2023-08-10T11:37:04.009 INFO:teuthology.orchestra.run.smithi156.stdout:(25/131): librgw2-18.0.0-5118.ga8bf445f.el8.x86 5.6 MB/s | 6.8 MB 00:01 2023-08-10T11:37:04.092 INFO:teuthology.orchestra.run.smithi156.stdout:(26/131): rbd-nbd-18.0.0-5118.ga8bf445f.el8.x86 2.1 MB/s | 179 kB 00:00 2023-08-10T11:37:04.184 INFO:teuthology.orchestra.run.smithi156.stdout:(27/131): ceph-grafana-dashboards-18.0.0-5118.g 252 kB/s | 23 kB 00:00 2023-08-10T11:37:04.284 INFO:teuthology.orchestra.run.smithi156.stdout:(28/131): ceph-mgr-cephadm-18.0.0-5118.ga8bf445 1.3 MB/s | 129 kB 00:00 2023-08-10T11:37:04.690 INFO:teuthology.orchestra.run.smithi156.stdout:(29/131): rbd-mirror-18.0.0-5118.ga8bf445f.el8. 3.0 MB/s | 3.5 MB 00:01 2023-08-10T11:37:04.735 INFO:teuthology.orchestra.run.smithi156.stdout:(30/131): ceph-mgr-dashboard-18.0.0-5118.ga8bf4 3.8 MB/s | 1.7 MB 00:00 2023-08-10T11:37:04.844 INFO:teuthology.orchestra.run.smithi156.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5118.ga8 2.2 MB/s | 241 kB 00:00 2023-08-10T11:37:04.936 INFO:teuthology.orchestra.run.smithi156.stdout:(32/131): ceph-mgr-rook-18.0.0-5118.ga8bf445f.e 517 kB/s | 47 kB 00:00 2023-08-10T11:37:05.069 INFO:teuthology.orchestra.run.smithi156.stdout:(33/131): ceph-prometheus-alerts-18.0.0-5118.ga 109 kB/s | 15 kB 00:00 2023-08-10T11:37:05.195 INFO:teuthology.orchestra.run.smithi156.stdout:(34/131): ceph-volume-18.0.0-5118.ga8bf445f.el8 2.0 MB/s | 258 kB 00:00 2023-08-10T11:37:05.336 INFO:teuthology.orchestra.run.smithi156.stdout:(35/131): cephadm-18.0.0-5118.ga8bf445f.el8.noa 1.2 MB/s | 168 kB 00:00 2023-08-10T11:37:05.453 INFO:teuthology.orchestra.run.smithi156.stdout:(36/131): cephfs-top-18.0.0-5118.ga8bf445f.el8. 154 kB/s | 18 kB 00:00 2023-08-10T11:37:06.829 INFO:teuthology.orchestra.run.smithi156.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 3.5 MB/s | 7.4 MB 00:02 2023-08-10T11:37:08.043 INFO:teuthology.orchestra.run.smithi156.stdout:(38/131): ceph-test-18.0.0-5118.ga8bf445f.el8.x 4.8 MB/s | 48 MB 00:10 2023-08-10T11:39:12.123 INFO:teuthology.orchestra.run.smithi073.stdout:[MIRROR] gperftools-libs-2.7-9.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/g/gperftools-libs-2.7-9.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T11:39:12.124 INFO:teuthology.orchestra.run.smithi073.stdout:[MIRROR] liboath-2.6.2-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/liboath-2.6.2-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T11:39:12.124 INFO:teuthology.orchestra.run.smithi073.stdout:[MIRROR] libunwind-1.3.1-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/libunwind-1.3.1-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T11:39:12.285 INFO:teuthology.orchestra.run.smithi073.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 454 B/s | 59 kB 02:12 2023-08-10T11:39:12.302 INFO:teuthology.orchestra.run.smithi073.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 589 B/s | 75 kB 02:10 2023-08-10T11:39:12.353 INFO:teuthology.orchestra.run.smithi073.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 873 kB/s | 44 kB 00:00 2023-08-10T11:39:12.378 INFO:teuthology.orchestra.run.smithi073.stdout:(42/131): gperftools-libs-2.7-9.el8.x86_64.rpm 2.3 kB/s | 306 kB 02:12 2023-08-10T11:39:12.420 INFO:teuthology.orchestra.run.smithi073.stdout:(43/131): python3-asyncssh-2.7.0-2.el8.noarch.r 3.5 MB/s | 476 kB 00:00 2023-08-10T11:39:12.445 INFO:teuthology.orchestra.run.smithi073.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 495 kB/s | 33 kB 00:00 2023-08-10T11:39:12.470 INFO:teuthology.orchestra.run.smithi073.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 325 kB/s | 16 kB 00:00 2023-08-10T11:39:12.496 INFO:teuthology.orchestra.run.smithi073.stdout:(46/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.3 MB/s | 185 kB 00:00 2023-08-10T11:39:12.521 INFO:teuthology.orchestra.run.smithi073.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.2 MB/s | 173 kB 00:00 2023-08-10T11:39:12.546 INFO:teuthology.orchestra.run.smithi073.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.6 MB/s | 81 kB 00:00 2023-08-10T11:39:12.571 INFO:teuthology.orchestra.run.smithi073.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 222 kB/s | 11 kB 00:00 2023-08-10T11:39:12.597 INFO:teuthology.orchestra.run.smithi073.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 350 kB/s | 18 kB 00:00 2023-08-10T11:39:12.622 INFO:teuthology.orchestra.run.smithi073.stdout:(51/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.5 MB/s | 384 kB 00:00 2023-08-10T11:39:12.647 INFO:teuthology.orchestra.run.smithi073.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 971 kB/s | 49 kB 00:00 2023-08-10T11:39:12.695 INFO:teuthology.orchestra.run.smithi073.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 810 kB/s | 59 kB 00:00 2023-08-10T11:39:12.731 INFO:teuthology.orchestra.run.smithi073.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 722 kB/s | 60 kB 00:00 2023-08-10T11:39:12.756 INFO:teuthology.orchestra.run.smithi073.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 4.5 MB/s | 283 kB 00:00 2023-08-10T11:39:12.782 INFO:teuthology.orchestra.run.smithi073.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 310 kB/s | 16 kB 00:00 2023-08-10T11:39:12.816 INFO:teuthology.orchestra.run.smithi073.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 573 kB/s | 34 kB 00:00 2023-08-10T11:39:12.841 INFO:teuthology.orchestra.run.smithi073.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 3.3 MB/s | 196 kB 00:00 2023-08-10T11:39:12.866 INFO:teuthology.orchestra.run.smithi073.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 1.3 MB/s | 64 kB 00:00 2023-08-10T11:39:12.891 INFO:teuthology.orchestra.run.smithi073.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 373 kB/s | 19 kB 00:00 2023-08-10T11:39:12.917 INFO:teuthology.orchestra.run.smithi073.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 477 kB/s | 24 kB 00:00 2023-08-10T11:39:12.942 INFO:teuthology.orchestra.run.smithi073.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 583 kB/s | 29 kB 00:00 2023-08-10T11:39:12.967 INFO:teuthology.orchestra.run.smithi073.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 548 kB/s | 27 kB 00:00 2023-08-10T11:39:13.001 INFO:teuthology.orchestra.run.smithi073.stdout:(64/131): python3-kubernetes-11.0.0-6.el8.noarc 2.7 MB/s | 1.2 MB 00:00 2023-08-10T11:39:13.026 INFO:teuthology.orchestra.run.smithi073.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 3.0 MB/s | 255 kB 00:00 2023-08-10T11:39:13.052 INFO:teuthology.orchestra.run.smithi073.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-08-10T11:39:13.077 INFO:teuthology.orchestra.run.smithi073.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2023-08-10T11:39:13.132 INFO:teuthology.orchestra.run.smithi073.stdout:(68/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.5 MB/s | 251 kB 00:00 2023-08-10T11:39:13.161 INFO:teuthology.orchestra.run.smithi073.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 211 kB/s | 23 kB 00:00 2023-08-10T11:39:13.186 INFO:teuthology.orchestra.run.smithi073.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.3 MB/s | 70 kB 00:00 2023-08-10T11:39:13.231 INFO:teuthology.orchestra.run.smithi152.stdout:[MIRROR] gperftools-libs-2.7-9.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/g/gperftools-libs-2.7-9.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T11:39:13.231 INFO:teuthology.orchestra.run.smithi152.stdout:[MIRROR] liboath-2.6.2-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/liboath-2.6.2-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T11:39:13.232 INFO:teuthology.orchestra.run.smithi152.stdout:[MIRROR] libunwind-1.3.1-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/libunwind-1.3.1-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T11:39:13.253 INFO:teuthology.orchestra.run.smithi073.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 9.9 MB/s | 1.7 MB 00:00 2023-08-10T11:39:13.278 INFO:teuthology.orchestra.run.smithi073.stdout:(72/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.2 MB/s | 110 kB 00:00 2023-08-10T11:39:13.328 INFO:teuthology.orchestra.run.smithi073.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 721 kB/s | 54 kB 00:00 2023-08-10T11:39:13.354 INFO:teuthology.orchestra.run.smithi073.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.6 MB/s | 259 kB 00:00 2023-08-10T11:39:13.387 INFO:teuthology.orchestra.run.smithi073.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-08-10T11:39:13.395 INFO:teuthology.orchestra.run.smithi152.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 583 B/s | 75 kB 02:11 2023-08-10T11:39:13.412 INFO:teuthology.orchestra.run.smithi073.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 663 kB/s | 39 kB 00:00 2023-08-10T11:39:13.446 INFO:teuthology.orchestra.run.smithi073.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 11 MB/s | 688 kB 00:00 2023-08-10T11:39:13.480 INFO:teuthology.orchestra.run.smithi073.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 7.8 MB/s | 538 kB 00:00 2023-08-10T11:39:13.505 INFO:teuthology.orchestra.run.smithi073.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-08-10T11:39:13.561 INFO:teuthology.orchestra.run.smithi073.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 2.3 MB/s | 187 kB 00:00 2023-08-10T11:39:13.614 INFO:teuthology.orchestra.run.smithi073.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 6.4 MB/s | 713 kB 00:00 2023-08-10T11:39:13.656 INFO:teuthology.orchestra.run.smithi073.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 638 kB/s | 27 kB 00:00 2023-08-10T11:39:13.687 INFO:teuthology.orchestra.run.smithi152.stdout:(40/131): liboath-2.6.2-3.el8.x86_64.rpm 455 B/s | 59 kB 02:12 2023-08-10T11:39:13.706 INFO:teuthology.orchestra.run.smithi073.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 6.3 MB/s | 320 kB 00:00 2023-08-10T11:39:13.748 INFO:teuthology.orchestra.run.smithi073.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.0 MB/s | 44 kB 00:00 2023-08-10T11:39:13.831 INFO:teuthology.orchestra.run.smithi073.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 18 MB/s | 4.8 MB 00:00 2023-08-10T11:39:13.890 INFO:teuthology.orchestra.run.smithi073.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 7.7 MB/s | 457 kB 00:00 2023-08-10T11:39:13.941 INFO:teuthology.orchestra.run.smithi073.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 4.4 MB/s | 225 kB 00:00 2023-08-10T11:39:14.033 INFO:teuthology.orchestra.run.smithi073.stdout:(88/131): python3-numpy-1.14.3-10.el8.x86_64.rp 13 MB/s | 3.7 MB 00:00 2023-08-10T11:39:14.058 INFO:teuthology.orchestra.run.smithi073.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 547 kB/s | 64 kB 00:00 2023-08-10T11:39:14.200 INFO:teuthology.orchestra.run.smithi073.stdout:(90/131): python3-scipy-1.0.0-21.module+el8.5.0 13 MB/s | 14 MB 00:01 2023-08-10T11:39:14.217 INFO:teuthology.orchestra.run.smithi073.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 126 kB/s | 20 kB 00:00 2023-08-10T11:39:14.242 INFO:teuthology.orchestra.run.smithi073.stdout:(92/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 605 kB/s | 126 kB 00:00 2023-08-10T11:39:14.267 INFO:teuthology.orchestra.run.smithi073.stdout:(93/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.5 MB/s | 103 kB 00:00 2023-08-10T11:39:14.301 INFO:teuthology.orchestra.run.smithi073.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 8.3 MB/s | 709 kB 00:00 2023-08-10T11:39:14.334 INFO:teuthology.orchestra.run.smithi073.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 2.9 MB/s | 198 kB 00:00 2023-08-10T11:39:14.376 INFO:teuthology.orchestra.run.smithi073.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2023-08-10T11:39:14.452 INFO:teuthology.orchestra.run.smithi073.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 4.6 MB/s | 354 kB 00:00 2023-08-10T11:39:14.544 INFO:teuthology.orchestra.run.smithi073.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 16 MB/s | 4.9 MB 00:00 2023-08-10T11:39:14.587 INFO:teuthology.orchestra.run.smithi152.stdout:(41/131): gperftools-libs-2.7-9.el8.x86_64.rpm 2.3 kB/s | 306 kB 02:13 2023-08-10T11:39:14.627 INFO:teuthology.orchestra.run.smithi073.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2023-08-10T11:39:14.669 INFO:teuthology.orchestra.run.smithi073.stdout:(100/131): postgresql-contrib-10.21-2.module+el 6.3 MB/s | 808 kB 00:00 2023-08-10T11:39:14.671 INFO:teuthology.orchestra.run.smithi152.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 44 kB/s | 44 kB 00:00 2023-08-10T11:39:14.703 INFO:teuthology.orchestra.run.smithi073.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2023-08-10T11:39:14.745 INFO:teuthology.orchestra.run.smithi073.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 13 MB/s | 1.5 MB 00:00 2023-08-10T11:39:14.770 INFO:teuthology.orchestra.run.smithi073.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.9 MB/s | 200 kB 00:00 2023-08-10T11:39:14.795 INFO:teuthology.orchestra.run.smithi073.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 847 kB/s | 43 kB 00:00 2023-08-10T11:39:14.820 INFO:teuthology.orchestra.run.smithi073.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-08-10T11:39:14.879 INFO:teuthology.orchestra.run.smithi073.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 575 kB/s | 48 kB 00:00 2023-08-10T11:39:14.905 INFO:teuthology.orchestra.run.smithi073.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.0 MB/s | 87 kB 00:00 2023-08-10T11:39:14.930 INFO:teuthology.orchestra.run.smithi073.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 853 kB/s | 43 kB 00:00 2023-08-10T11:39:14.955 INFO:teuthology.orchestra.run.smithi073.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-08-10T11:39:14.980 INFO:teuthology.orchestra.run.smithi073.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-08-10T11:39:15.056 INFO:teuthology.orchestra.run.smithi073.stdout:(111/131): postgresql-server-10.21-2.module+el8 8.4 MB/s | 5.1 MB 00:00 2023-08-10T11:39:15.081 INFO:teuthology.orchestra.run.smithi073.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 186 kB/s | 19 kB 00:00 2023-08-10T11:39:15.106 INFO:teuthology.orchestra.run.smithi073.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-08-10T11:39:15.131 INFO:teuthology.orchestra.run.smithi073.stdout:(114/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.1 MB/s | 560 kB 00:00 2023-08-10T11:39:15.157 INFO:teuthology.orchestra.run.smithi073.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 357 kB/s | 18 kB 00:00 2023-08-10T11:39:15.191 INFO:teuthology.orchestra.run.smithi073.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 5.0 MB/s | 559 kB 00:00 2023-08-10T11:39:15.233 INFO:teuthology.orchestra.run.smithi073.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.9 MB/s | 605 kB 00:00 2023-08-10T11:39:15.302 INFO:teuthology.orchestra.run.smithi073.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.6 MB/s | 238 kB 00:00 2023-08-10T11:39:15.333 INFO:teuthology.orchestra.run.smithi073.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 721 kB/s | 72 kB 00:00 2023-08-10T11:39:15.358 INFO:teuthology.orchestra.run.smithi073.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.5 MB/s | 83 kB 00:00 2023-08-10T11:39:15.384 INFO:teuthology.orchestra.run.smithi073.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-08-10T11:39:15.409 INFO:teuthology.orchestra.run.smithi073.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-08-10T11:39:15.434 INFO:teuthology.orchestra.run.smithi073.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-08-10T11:39:15.459 INFO:teuthology.orchestra.run.smithi073.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 770 kB/s | 39 kB 00:00 2023-08-10T11:39:15.460 INFO:teuthology.orchestra.run.smithi156.stdout:[MIRROR] gperftools-libs-2.7-9.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/g/gperftools-libs-2.7-9.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T11:39:15.460 INFO:teuthology.orchestra.run.smithi156.stdout:[MIRROR] liboath-2.6.2-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/liboath-2.6.2-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T11:39:15.493 INFO:teuthology.orchestra.run.smithi073.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 11 MB/s | 644 kB 00:00 2023-08-10T11:39:15.518 INFO:teuthology.orchestra.run.smithi073.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.9 MB/s | 171 kB 00:00 2023-08-10T11:39:15.544 INFO:teuthology.orchestra.run.smithi073.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-08-10T11:39:15.594 INFO:teuthology.orchestra.run.smithi073.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 5.8 MB/s | 2.3 MB 00:00 2023-08-10T11:39:15.611 INFO:teuthology.orchestra.run.smithi156.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 467 B/s | 59 kB 02:08 2023-08-10T11:39:15.652 INFO:teuthology.orchestra.run.smithi073.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 15 MB/s | 798 kB 00:00 2023-08-10T11:39:15.661 INFO:teuthology.orchestra.run.smithi156.stdout:(40/131): gperftools-libs-2.7-9.el8.x86_64.rpm 2.4 kB/s | 306 kB 02:10 2023-08-10T11:39:15.721 INFO:teuthology.orchestra.run.smithi152.stdout:(43/131): python3-asyncssh-2.7.0-2.el8.noarch.r 205 kB/s | 476 kB 00:02 2023-08-10T11:39:16.344 INFO:teuthology.orchestra.run.smithi073.stdout:(130/131): librados2-18.0.0-5118.ga8bf445f.el8. 4.5 MB/s | 3.7 MB 00:00 2023-08-10T11:39:16.403 INFO:teuthology.orchestra.run.smithi073.stdout:(131/131): librbd1-18.0.0-5118.ga8bf445f.el8.x8 4.2 MB/s | 3.6 MB 00:00 2023-08-10T11:39:16.406 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2023-08-10T11:39:16.406 INFO:teuthology.orchestra.run.smithi073.stdout:Total 1.4 MB/s | 206 MB 02:28 2023-08-10T11:39:16.897 INFO:teuthology.orchestra.run.smithi152.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 14 kB/s | 16 kB 00:01 2023-08-10T11:39:16.930 INFO:teuthology.orchestra.run.smithi152.stdout:(45/131): python3-beautifulsoup4-4.6.3-2.el8.1. 79 kB/s | 185 kB 00:02 2023-08-10T11:39:17.097 INFO:teuthology.orchestra.run.smithi152.stdout:(46/131): python3-cachetools-3.1.1-4.el8.noarch 14 kB/s | 33 kB 00:02 2023-08-10T11:39:17.179 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2023-08-10T11:39:17.299 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2023-08-10T11:39:17.300 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2023-08-10T11:39:17.342 INFO:teuthology.orchestra.run.smithi152.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 388 kB/s | 173 kB 00:00 2023-08-10T11:39:17.615 INFO:teuthology.orchestra.run.smithi152.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 157 kB/s | 81 kB 00:00 2023-08-10T11:39:17.907 INFO:teuthology.orchestra.run.smithi152.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 60 kB/s | 18 kB 00:00 2023-08-10T11:39:18.165 INFO:teuthology.orchestra.run.smithi152.stdout:(50/131): python3-cherrypy-18.4.0-1.el8.noarch. 311 kB/s | 384 kB 00:01 2023-08-10T11:39:18.299 INFO:teuthology.orchestra.run.smithi152.stdout:(51/131): python3-jaraco-6.2-6.el8.noarch.rpm 12 kB/s | 11 kB 00:00 2023-08-10T11:39:18.417 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2023-08-10T11:39:18.421 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2023-08-10T11:39:18.466 INFO:teuthology.orchestra.run.smithi152.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 162 kB/s | 49 kB 00:00 2023-08-10T11:39:18.701 INFO:teuthology.orchestra.run.smithi152.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 146 kB/s | 59 kB 00:00 2023-08-10T11:39:18.958 INFO:teuthology.orchestra.run.smithi152.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 122 kB/s | 60 kB 00:00 2023-08-10T11:39:19.225 INFO:teuthology.orchestra.run.smithi152.stdout:(55/131): python3-kubernetes-11.0.0-6.el8.noarc 906 kB/s | 1.2 MB 00:01 2023-08-10T11:39:19.550 INFO:teuthology.orchestra.run.smithi152.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 103 kB/s | 34 kB 00:00 2023-08-10T11:39:19.834 INFO:teuthology.orchestra.run.smithi152.stdout:(57/131): python3-pecan-1.3.2-9.el8.noarch.rpm 250 kB/s | 283 kB 00:01 2023-08-10T11:39:19.865 INFO:teuthology.orchestra.run.smithi156.stdout:[MIRROR] libunwind-1.3.1-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/libunwind-1.3.1-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T11:39:19.934 INFO:teuthology.orchestra.run.smithi152.stdout:(58/131): python3-portend-2.6-1.el8.noarch.rpm 16 kB/s | 16 kB 00:00 2023-08-10T11:39:19.960 INFO:teuthology.orchestra.run.smithi156.stdout:(41/131): libunwind-1.3.1-3.el8.x86_64.rpm 582 B/s | 75 kB 02:11 2023-08-10T11:39:19.976 INFO:teuthology.orchestra.run.smithi152.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 452 kB/s | 64 kB 00:00 2023-08-10T11:39:20.001 INFO:teuthology.orchestra.run.smithi152.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 280 kB/s | 19 kB 00:00 2023-08-10T11:39:20.053 INFO:teuthology.orchestra.run.smithi156.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.0 MB/s | 185 kB 00:00 2023-08-10T11:39:20.095 INFO:teuthology.orchestra.run.smithi156.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 793 kB/s | 33 kB 00:00 2023-08-10T11:39:20.136 INFO:teuthology.orchestra.run.smithi156.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 392 kB/s | 16 kB 00:00 2023-08-10T11:39:20.178 INFO:teuthology.orchestra.run.smithi156.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 4.1 MB/s | 173 kB 00:00 2023-08-10T11:39:20.254 INFO:teuthology.orchestra.run.smithi156.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 5.0 MB/s | 384 kB 00:00 2023-08-10T11:39:20.268 INFO:teuthology.orchestra.run.smithi152.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 82 kB/s | 24 kB 00:00 2023-08-10T11:39:20.304 INFO:teuthology.orchestra.run.smithi156.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.6 MB/s | 81 kB 00:00 2023-08-10T11:39:20.354 INFO:teuthology.orchestra.run.smithi156.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 222 kB/s | 11 kB 00:00 2023-08-10T11:39:20.421 INFO:teuthology.orchestra.run.smithi156.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 263 kB/s | 18 kB 00:00 2023-08-10T11:39:20.497 INFO:teuthology.orchestra.run.smithi156.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 16 MB/s | 1.2 MB 00:00 2023-08-10T11:39:20.519 INFO:teuthology.orchestra.run.smithi152.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 56 kB/s | 29 kB 00:00 2023-08-10T11:39:20.547 INFO:teuthology.orchestra.run.smithi156.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 977 kB/s | 49 kB 00:00 2023-08-10T11:39:20.597 INFO:teuthology.orchestra.run.smithi156.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-08-10T11:39:20.647 INFO:teuthology.orchestra.run.smithi156.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-08-10T11:39:20.669 INFO:teuthology.orchestra.run.smithi152.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 69 kB/s | 27 kB 00:00 2023-08-10T11:39:20.698 INFO:teuthology.orchestra.run.smithi156.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 5.5 MB/s | 283 kB 00:00 2023-08-10T11:39:20.773 INFO:teuthology.orchestra.run.smithi156.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 208 kB/s | 16 kB 00:00 2023-08-10T11:39:20.824 INFO:teuthology.orchestra.run.smithi156.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 674 kB/s | 34 kB 00:00 2023-08-10T11:39:20.874 INFO:teuthology.orchestra.run.smithi156.stdout:(57/131): python3-routes-2.4.1-12.el8.noarch.rp 3.8 MB/s | 196 kB 00:00 2023-08-10T11:39:20.924 INFO:teuthology.orchestra.run.smithi156.stdout:(58/131): python3-rsa-4.9-2.el8.noarch.rpm 1.3 MB/s | 64 kB 00:00 2023-08-10T11:39:20.974 INFO:teuthology.orchestra.run.smithi156.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 374 kB/s | 19 kB 00:00 2023-08-10T11:39:21.024 INFO:teuthology.orchestra.run.smithi156.stdout:(60/131): python3-singledispatch-3.4.0.3-18.el8 479 kB/s | 24 kB 00:00 2023-08-10T11:39:21.075 INFO:teuthology.orchestra.run.smithi156.stdout:(61/131): python3-tempora-1.14.1-5.el8.noarch.r 584 kB/s | 29 kB 00:00 2023-08-10T11:39:21.142 INFO:teuthology.orchestra.run.smithi156.stdout:(62/131): python3-trustme-0.6.0-4.el8.noarch.rp 414 kB/s | 27 kB 00:00 2023-08-10T11:39:21.192 INFO:teuthology.orchestra.run.smithi156.stdout:(63/131): python3-waitress-1.4.3-1.el8.noarch.r 5.0 MB/s | 255 kB 00:00 2023-08-10T11:39:21.242 INFO:teuthology.orchestra.run.smithi156.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 4.9 MB/s | 251 kB 00:00 2023-08-10T11:39:21.293 INFO:teuthology.orchestra.run.smithi156.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-08-10T11:39:21.343 INFO:teuthology.orchestra.run.smithi156.stdout:(66/131): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2023-08-10T11:39:21.393 INFO:teuthology.orchestra.run.smithi156.stdout:(67/131): python3-zc-lockfile-2.0-2.el8.noarch. 461 kB/s | 23 kB 00:00 2023-08-10T11:39:21.493 INFO:teuthology.orchestra.run.smithi156.stdout:(68/131): thrift-0.13.0-2.el8.x86_64.rpm 17 MB/s | 1.7 MB 00:00 2023-08-10T11:39:21.519 INFO:teuthology.orchestra.run.smithi156.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-08-10T11:39:21.519 INFO:teuthology.orchestra.run.smithi152.stdout:(64/131): python3-routes-2.4.1-12.el8.noarch.rp 100 kB/s | 196 kB 00:01 2023-08-10T11:39:21.794 INFO:teuthology.orchestra.run.smithi156.stdout:(70/131): python3-scipy-1.0.0-21.module+el8.5.0 50 MB/s | 14 MB 00:00 2023-08-10T11:39:21.861 INFO:teuthology.orchestra.run.smithi156.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.6 MB/s | 110 kB 00:00 2023-08-10T11:39:21.903 INFO:teuthology.orchestra.run.smithi156.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-08-10T11:39:21.919 INFO:teuthology.orchestra.run.smithi152.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 182 kB/s | 255 kB 00:01 2023-08-10T11:39:21.936 INFO:teuthology.orchestra.run.smithi152.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 147 kB/s | 61 kB 00:00 2023-08-10T11:39:21.944 INFO:teuthology.orchestra.run.smithi156.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-08-10T11:39:22.003 INFO:teuthology.orchestra.run.smithi156.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-08-10T11:39:22.037 INFO:teuthology.orchestra.run.smithi156.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 1.1 MB/s | 39 kB 00:00 2023-08-10T11:39:22.095 INFO:teuthology.orchestra.run.smithi156.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-08-10T11:39:22.137 INFO:teuthology.orchestra.run.smithi156.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 13 MB/s | 538 kB 00:00 2023-08-10T11:39:22.214 INFO:teuthology.orchestra.run.smithi156.stdout:(78/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.0 MB/s | 157 kB 00:00 2023-08-10T11:39:22.263 INFO:teuthology.orchestra.run.smithi156.stdout:(79/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.8 MB/s | 187 kB 00:00 2023-08-10T11:39:22.322 INFO:teuthology.orchestra.run.smithi156.stdout:(80/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-08-10T11:39:22.447 INFO:teuthology.orchestra.run.smithi156.stdout:(81/131): python3-babel-2.5.1-7.el8.noarch.rpm 38 MB/s | 4.8 MB 00:00 2023-08-10T11:39:22.481 INFO:teuthology.orchestra.run.smithi156.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 802 kB/s | 27 kB 00:00 2023-08-10T11:39:22.522 INFO:teuthology.orchestra.run.smithi156.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-08-10T11:39:22.598 INFO:teuthology.orchestra.run.smithi156.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 586 kB/s | 44 kB 00:00 2023-08-10T11:39:22.715 INFO:teuthology.orchestra.run.smithi156.stdout:(85/131): python3-numpy-1.14.3-10.el8.x86_64.rp 32 MB/s | 3.7 MB 00:00 2023-08-10T11:39:22.757 INFO:teuthology.orchestra.run.smithi156.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 11 MB/s | 457 kB 00:00 2023-08-10T11:39:22.778 INFO:teuthology.orchestra.run.smithi152.stdout:(67/131): python3-webob-1.8.5-1.el8.1.noarch.rp 119 kB/s | 251 kB 00:02 2023-08-10T11:39:22.799 INFO:teuthology.orchestra.run.smithi156.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-08-10T11:39:22.841 INFO:teuthology.orchestra.run.smithi156.stdout:(88/131): uuid-1.6.2-43.el8.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2023-08-10T11:39:22.882 INFO:teuthology.orchestra.run.smithi156.stdout:(89/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 3.0 MB/s | 126 kB 00:00 2023-08-10T11:39:22.949 INFO:teuthology.orchestra.run.smithi156.stdout:(90/131): python3-jsonpointer-1.10-11.el8.noarc 300 kB/s | 20 kB 00:00 2023-08-10T11:39:22.991 INFO:teuthology.orchestra.run.smithi156.stdout:(91/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.4 MB/s | 103 kB 00:00 2023-08-10T11:39:23.042 INFO:teuthology.orchestra.run.smithi156.stdout:(92/131): libtool-2.4.6-25.el8.x86_64.rpm 14 MB/s | 709 kB 00:00 2023-08-10T11:39:23.159 INFO:teuthology.orchestra.run.smithi156.stdout:(93/131): openblas-threads-0.3.15-3.el8.x86_64. 42 MB/s | 4.9 MB 00:00 2023-08-10T11:39:23.200 INFO:teuthology.orchestra.run.smithi156.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.7 MB/s | 198 kB 00:00 2023-08-10T11:39:23.342 INFO:teuthology.orchestra.run.smithi156.stdout:(95/131): openblas-0.3.15-3.el8.x86_64.rpm 33 MB/s | 4.7 MB 00:00 2023-08-10T11:39:23.384 INFO:teuthology.orchestra.run.smithi156.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2023-08-10T11:39:23.396 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2023-08-10T11:39:23.426 INFO:teuthology.orchestra.run.smithi156.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-08-10T11:39:23.537 INFO:teuthology.orchestra.run.smithi152.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 53 kB/s | 85 kB 00:01 2023-08-10T11:39:23.543 INFO:teuthology.orchestra.run.smithi156.stdout:(98/131): postgresql-server-10.21-2.module+el8. 43 MB/s | 5.1 MB 00:00 2023-08-10T11:39:23.562 INFO:teuthology.orchestra.run.smithi152.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-08-10T11:39:23.594 INFO:teuthology.orchestra.run.smithi156.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 16 MB/s | 808 kB 00:00 2023-08-10T11:39:23.612 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-08-10T11:39:23.685 INFO:teuthology.orchestra.run.smithi156.stdout:(100/131): postgresql-10.21-2.module+el8.6.0+15 16 MB/s | 1.5 MB 00:00 2023-08-10T11:39:23.727 INFO:teuthology.orchestra.run.smithi156.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2023-08-10T11:39:23.769 INFO:teuthology.orchestra.run.smithi156.stdout:(102/131): libselinux-devel-2.9-5.el8.x86_64.rp 4.7 MB/s | 200 kB 00:00 2023-08-10T11:39:23.780 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-08-10T11:39:23.803 INFO:teuthology.orchestra.run.smithi156.stdout:(103/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.2 MB/s | 43 kB 00:00 2023-08-10T11:39:23.845 INFO:teuthology.orchestra.run.smithi156.stdout:(104/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.2 MB/s | 220 kB 00:00 2023-08-10T11:39:23.871 INFO:teuthology.orchestra.run.smithi152.stdout:(70/131): python3-scipy-1.0.0-21.module+el8.5.0 44 MB/s | 14 MB 00:00 2023-08-10T11:39:23.878 INFO:teuthology.orchestra.run.smithi156.stdout:(105/131): keyutils-libs-devel-1.5.10-9.el8.x86 1.4 MB/s | 48 kB 00:00 2023-08-10T11:39:23.904 INFO:teuthology.orchestra.run.smithi152.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 3.2 MB/s | 110 kB 00:00 2023-08-10T11:39:23.920 INFO:teuthology.orchestra.run.smithi156.stdout:(106/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-08-10T11:39:23.938 INFO:teuthology.orchestra.run.smithi152.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2023-08-10T11:39:23.954 INFO:teuthology.orchestra.run.smithi156.stdout:(107/131): python3-requests-oauthlib-1.0.0-1.el 1.3 MB/s | 43 kB 00:00 2023-08-10T11:39:23.980 INFO:teuthology.orchestra.run.smithi152.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.0 MB/s | 259 kB 00:00 2023-08-10T11:39:24.022 INFO:teuthology.orchestra.run.smithi152.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-08-10T11:39:24.030 INFO:teuthology.orchestra.run.smithi156.stdout:(108/131): python3-pycparser-2.14-14.el8.noarch 1.4 MB/s | 109 kB 00:00 2023-08-10T11:39:24.030 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-08-10T11:39:24.064 INFO:teuthology.orchestra.run.smithi152.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 932 kB/s | 39 kB 00:00 2023-08-10T11:39:24.080 INFO:teuthology.orchestra.run.smithi156.stdout:(109/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-08-10T11:39:24.122 INFO:teuthology.orchestra.run.smithi156.stdout:(110/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 13 MB/s | 560 kB 00:00 2023-08-10T11:39:24.123 INFO:teuthology.orchestra.run.smithi152.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-08-10T11:39:24.155 INFO:teuthology.orchestra.run.smithi156.stdout:(111/131): libaio-devel-0.3.112-1.el8.x86_64.rp 562 kB/s | 19 kB 00:00 2023-08-10T11:39:24.165 INFO:teuthology.orchestra.run.smithi152.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 13 MB/s | 538 kB 00:00 2023-08-10T11:39:24.197 INFO:teuthology.orchestra.run.smithi156.stdout:(112/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.6 MB/s | 155 kB 00:00 2023-08-10T11:39:24.207 INFO:teuthology.orchestra.run.smithi152.stdout:(78/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-08-10T11:39:24.215 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-10T11:39:24.239 INFO:teuthology.orchestra.run.smithi156.stdout:(113/131): python3-cryptography-3.2.1-5.el8.x86 13 MB/s | 559 kB 00:00 2023-08-10T11:39:24.240 INFO:teuthology.orchestra.run.smithi152.stdout:(79/131): oniguruma-6.8.2-2.el8.x86_64.rpm 5.5 MB/s | 187 kB 00:00 2023-08-10T11:39:24.281 INFO:teuthology.orchestra.run.smithi156.stdout:(114/131): libverto-devel-0.3.0-5.el8.x86_64.rp 430 kB/s | 18 kB 00:00 2023-08-10T11:39:24.299 INFO:teuthology.orchestra.run.smithi152.stdout:(80/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-08-10T11:39:24.318 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-10T11:39:24.323 INFO:teuthology.orchestra.run.smithi156.stdout:(115/131): pcre2-devel-10.32-2.el8.x86_64.rpm 14 MB/s | 605 kB 00:00 2023-08-10T11:39:24.393 INFO:teuthology.orchestra.run.smithi156.stdout:(116/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.4 MB/s | 238 kB 00:00 2023-08-10T11:39:24.424 INFO:teuthology.orchestra.run.smithi152.stdout:(81/131): python3-babel-2.5.1-7.el8.noarch.rpm 38 MB/s | 4.8 MB 00:00 2023-08-10T11:39:24.458 INFO:teuthology.orchestra.run.smithi152.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 798 kB/s | 27 kB 00:00 2023-08-10T11:39:24.482 INFO:teuthology.orchestra.run.smithi156.stdout:(117/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 26 MB/s | 2.3 MB 00:00 2023-08-10T11:39:24.500 INFO:teuthology.orchestra.run.smithi152.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-08-10T11:39:24.524 INFO:teuthology.orchestra.run.smithi156.stdout:(118/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.7 MB/s | 72 kB 00:00 2023-08-10T11:39:24.558 INFO:teuthology.orchestra.run.smithi156.stdout:(119/131): fuse-2.9.7-15.el8.x86_64.rpm 2.4 MB/s | 83 kB 00:00 2023-08-10T11:39:24.567 INFO:teuthology.orchestra.run.smithi152.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 658 kB/s | 44 kB 00:00 2023-08-10T11:39:24.600 INFO:teuthology.orchestra.run.smithi156.stdout:(120/131): elfutils-libelf-devel-0.186-1.el8.x8 1.4 MB/s | 60 kB 00:00 2023-08-10T11:39:24.615 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-10T11:39:24.633 INFO:teuthology.orchestra.run.smithi156.stdout:(121/131): libuuid-devel-2.32.1-35.el8.x86_64.r 2.9 MB/s | 98 kB 00:00 2023-08-10T11:39:24.675 INFO:teuthology.orchestra.run.smithi156.stdout:(122/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.4 MB/s | 58 kB 00:00 2023-08-10T11:39:24.676 INFO:teuthology.orchestra.run.smithi152.stdout:(85/131): python3-numpy-1.14.3-10.el8.x86_64.rp 34 MB/s | 3.7 MB 00:00 2023-08-10T11:39:24.717 INFO:teuthology.orchestra.run.smithi156.stdout:(123/131): libcom_err-devel-1.45.6-4.el8.x86_64 928 kB/s | 39 kB 00:00 2023-08-10T11:39:24.718 INFO:teuthology.orchestra.run.smithi152.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 11 MB/s | 457 kB 00:00 2023-08-10T11:39:24.760 INFO:teuthology.orchestra.run.smithi152.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-08-10T11:39:24.784 INFO:teuthology.orchestra.run.smithi156.stdout:(124/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 9.4 MB/s | 644 kB 00:00 2023-08-10T11:39:24.793 INFO:teuthology.orchestra.run.smithi152.stdout:(88/131): uuid-1.6.2-43.el8.x86_64.rpm 1.9 MB/s | 64 kB 00:00 2023-08-10T11:39:24.826 INFO:teuthology.orchestra.run.smithi156.stdout:(125/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 4.0 MB/s | 171 kB 00:00 2023-08-10T11:39:24.835 INFO:teuthology.orchestra.run.smithi152.stdout:(89/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 3.0 MB/s | 126 kB 00:00 2023-08-10T11:39:24.868 INFO:teuthology.orchestra.run.smithi156.stdout:(126/131): NetworkManager-initscripts-updown-1. 3.2 MB/s | 138 kB 00:00 2023-08-10T11:39:24.869 INFO:teuthology.orchestra.run.smithi152.stdout:(90/131): python3-jsonpointer-1.10-11.el8.noarc 602 kB/s | 20 kB 00:00 2023-08-10T11:39:24.911 INFO:teuthology.orchestra.run.smithi152.stdout:(91/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.4 MB/s | 103 kB 00:00 2023-08-10T11:39:24.961 INFO:teuthology.orchestra.run.smithi152.stdout:(92/131): libtool-2.4.6-25.el8.x86_64.rpm 14 MB/s | 709 kB 00:00 2023-08-10T11:39:25.003 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-10T11:39:25.095 INFO:teuthology.orchestra.run.smithi152.stdout:(93/131): openblas-threads-0.3.15-3.el8.x86_64. 36 MB/s | 4.9 MB 00:00 2023-08-10T11:39:25.128 INFO:teuthology.orchestra.run.smithi152.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 5.8 MB/s | 198 kB 00:00 2023-08-10T11:39:25.223 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 6/134 2023-08-10T11:39:25.262 INFO:teuthology.orchestra.run.smithi152.stdout:(95/131): openblas-0.3.15-3.el8.x86_64.rpm 35 MB/s | 4.7 MB 00:00 2023-08-10T11:39:25.304 INFO:teuthology.orchestra.run.smithi152.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-08-10T11:39:25.346 INFO:teuthology.orchestra.run.smithi152.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-08-10T11:39:25.371 INFO:teuthology.orchestra.run.smithi152.stdout:(98/131): python3-zc-lockfile-2.0-2.el8.noarch. 6.7 kB/s | 23 kB 00:03 2023-08-10T11:39:25.472 INFO:teuthology.orchestra.run.smithi152.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 7.9 MB/s | 808 kB 00:00 2023-08-10T11:39:25.564 INFO:teuthology.orchestra.run.smithi152.stdout:(100/131): postgresql-server-10.21-2.module+el8 23 MB/s | 5.1 MB 00:00 2023-08-10T11:39:25.606 INFO:teuthology.orchestra.run.smithi152.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-08-10T11:39:25.608 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 6/134 2023-08-10T11:39:25.631 INFO:teuthology.orchestra.run.smithi152.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 703 kB/s | 47 kB 00:00 2023-08-10T11:39:25.656 INFO:teuthology.orchestra.run.smithi152.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 3.9 MB/s | 200 kB 00:00 2023-08-10T11:39:25.673 INFO:teuthology.orchestra.run.smithi152.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-08-10T11:39:25.707 INFO:teuthology.orchestra.run.smithi152.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-08-10T11:39:25.724 INFO:teuthology.orchestra.run.smithi152.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 955 kB/s | 48 kB 00:00 2023-08-10T11:39:25.749 INFO:teuthology.orchestra.run.smithi152.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-08-10T11:39:25.766 INFO:teuthology.orchestra.run.smithi152.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 1.0 MB/s | 43 kB 00:00 2023-08-10T11:39:25.792 INFO:teuthology.orchestra.run.smithi152.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.5 MB/s | 109 kB 00:00 2023-08-10T11:39:25.817 INFO:teuthology.orchestra.run.smithi152.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-08-10T11:39:25.831 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 7/134 2023-08-10T11:39:25.850 INFO:teuthology.orchestra.run.smithi152.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.3 MB/s | 560 kB 00:00 2023-08-10T11:39:25.910 INFO:teuthology.orchestra.run.smithi152.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 201 kB/s | 19 kB 00:00 2023-08-10T11:39:25.943 INFO:teuthology.orchestra.run.smithi152.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.6 MB/s | 155 kB 00:00 2023-08-10T11:39:25.944 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 7/134 2023-08-10T11:39:25.976 INFO:teuthology.orchestra.run.smithi156.stdout:(127/131): librados2-18.0.0-5118.ga8bf445f.el8. 3.3 MB/s | 3.7 MB 00:01 2023-08-10T11:39:25.977 INFO:teuthology.orchestra.run.smithi152.stdout:(114/131): python3-cryptography-3.2.1-5.el8.x86 8.3 MB/s | 559 kB 00:00 2023-08-10T11:39:26.002 INFO:teuthology.orchestra.run.smithi152.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 305 kB/s | 18 kB 00:00 2023-08-10T11:39:26.035 INFO:teuthology.orchestra.run.smithi152.stdout:(116/131): pcre2-devel-10.32-2.el8.x86_64.rpm 10 MB/s | 605 kB 00:00 2023-08-10T11:39:26.061 INFO:teuthology.orchestra.run.smithi152.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-08-10T11:39:26.103 INFO:teuthology.orchestra.run.smithi152.stdout:(118/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.7 MB/s | 72 kB 00:00 2023-08-10T11:39:26.114 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 8/134 2023-08-10T11:39:26.153 INFO:teuthology.orchestra.run.smithi152.stdout:(119/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 20 MB/s | 2.3 MB 00:00 2023-08-10T11:39:26.178 INFO:teuthology.orchestra.run.smithi152.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2023-08-10T11:39:26.203 INFO:teuthology.orchestra.run.smithi152.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-08-10T11:39:26.229 INFO:teuthology.orchestra.run.smithi152.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-08-10T11:39:26.232 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 8/134 2023-08-10T11:39:26.263 INFO:teuthology.orchestra.run.smithi152.stdout:(123/131): thrift-0.13.0-2.el8.x86_64.rpm 510 kB/s | 1.7 MB 00:03 2023-08-10T11:39:26.288 INFO:teuthology.orchestra.run.smithi152.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 657 kB/s | 39 kB 00:00 2023-08-10T11:39:26.322 INFO:teuthology.orchestra.run.smithi152.stdout:(125/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 489 kB/s | 58 kB 00:00 2023-08-10T11:39:26.326 INFO:teuthology.orchestra.run.smithi156.stdout:(128/131): librbd1-18.0.0-5118.ga8bf445f.el8.x8 10 MB/s | 3.6 MB 00:00 2023-08-10T11:39:26.381 INFO:teuthology.orchestra.run.smithi152.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.9 MB/s | 171 kB 00:00 2023-08-10T11:39:26.385 INFO:teuthology.orchestra.run.smithi156.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-08-10T11:39:26.406 INFO:teuthology.orchestra.run.smithi152.stdout:(127/131): NetworkManager-initscripts-updown-1. 1.6 MB/s | 138 kB 00:00 2023-08-10T11:39:26.424 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 9/134 2023-08-10T11:39:26.448 INFO:teuthology.orchestra.run.smithi152.stdout:(128/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 3.4 MB/s | 644 kB 00:00 2023-08-10T11:39:26.498 INFO:teuthology.orchestra.run.smithi152.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-08-10T11:39:26.709 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-08-10T11:39:26.901 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-08-10T11:39:27.318 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-08-10T11:39:27.331 INFO:teuthology.orchestra.run.smithi152.stdout:(130/131): librbd1-18.0.0-5118.ga8bf445f.el8.x8 3.9 MB/s | 3.6 MB 00:00 2023-08-10T11:39:27.585 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-08-10T11:39:27.714 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 14/134 2023-08-10T11:39:27.807 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 14/134 2023-08-10T11:39:27.998 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 15/134 2023-08-10T11:39:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 15/134 2023-08-10T11:39:28.197 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-10T11:39:28.334 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-10T11:39:28.523 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-10T11:39:29.115 INFO:teuthology.orchestra.run.smithi152.stdout:(131/131): librados2-18.0.0-5118.ga8bf445f.el8. 1.3 MB/s | 3.7 MB 00:02 2023-08-10T11:39:29.118 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-08-10T11:39:29.118 INFO:teuthology.orchestra.run.smithi152.stdout:Total 1.3 MB/s | 206 MB 02:39 2023-08-10T11:39:29.134 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-10T11:39:29.339 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-10T11:39:29.899 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-08-10T11:39:29.934 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-10T11:39:30.019 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-08-10T11:39:30.019 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-08-10T11:39:30.147 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-08-10T11:39:30.850 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-08-10T11:39:31.120 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-08-10T11:39:31.136 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-08-10T11:39:31.141 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-08-10T11:39:31.347 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-08-10T11:39:31.575 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-08-10T11:39:31.761 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-08-10T11:39:31.985 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-08-10T11:39:32.199 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-08-10T11:39:32.387 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8. 26/134 2023-08-10T11:39:32.492 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el 27/134 2023-08-10T11:39:33.428 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_6 28/134 2023-08-10T11:39:33.743 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-08-10T11:39:34.023 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-08-10T11:39:34.264 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-08-10T11:39:34.488 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-10T11:39:36.080 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-08-10T11:39:36.231 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-10T11:39:36.292 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-08-10T11:39:36.465 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-08-10T11:39:36.538 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-08-10T11:39:36.670 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-08-10T11:39:36.766 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-08-10T11:39:36.889 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-10T11:39:36.965 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-08-10T11:39:36.994 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-10T11:39:37.185 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 36/134 2023-08-10T11:39:37.264 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-10T11:39:37.358 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_6 37/134 2023-08-10T11:39:37.553 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-08-10T11:39:37.660 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-10T11:39:37.715 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-08-10T11:39:37.890 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-08-10T11:39:37.914 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 6/134 2023-08-10T11:39:38.075 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-08-10T11:39:38.279 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-08-10T11:39:38.302 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 6/134 2023-08-10T11:39:38.488 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 7/134 2023-08-10T11:39:38.494 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-08-10T11:39:38.637 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 7/134 2023-08-10T11:39:38.805 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 8/134 2023-08-10T11:39:38.850 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-08-10T11:39:38.896 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 8/134 2023-08-10T11:39:39.114 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 9/134 2023-08-10T11:39:39.132 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-08-10T11:39:39.334 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-08-10T11:39:39.373 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-08-10T11:39:39.567 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-08-10T11:39:39.577 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-08-10T11:39:39.843 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-08-10T11:39:39.950 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-08-10T11:39:40.172 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-08-10T11:39:40.209 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-08-10T11:39:40.387 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-08-10T11:39:40.396 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 14/134 2023-08-10T11:39:40.508 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 14/134 2023-08-10T11:39:40.553 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-08-10T11:39:40.672 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 15/134 2023-08-10T11:39:40.754 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 15/134 2023-08-10T11:39:40.775 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-08-10T11:39:40.913 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-10T11:39:40.950 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-08-10T11:39:41.041 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-10T11:39:41.149 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-08-10T11:39:41.197 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-10T11:39:41.459 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-08-10T11:39:41.703 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-08-10T11:39:41.792 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-10T11:39:41.967 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-08-10T11:39:41.981 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-10T11:39:42.185 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-08-10T11:39:42.395 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-08-10T11:39:42.530 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-08-10T11:39:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-10T11:39:42.703 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-08-10T11:39:42.786 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-08-10T11:39:42.805 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-08-10T11:39:43.037 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-08-10T11:39:43.266 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-08-10T11:39:43.420 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-10T11:39:43.478 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-08-10T11:39:43.498 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-10T11:39:43.752 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-08-10T11:39:43.786 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-08-10T11:39:43.922 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-08-10T11:39:43.988 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-08-10T11:39:44.112 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-08-10T11:39:44.225 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-08-10T11:39:44.283 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-08-10T11:39:44.418 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-08-10T11:39:44.509 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-08-10T11:39:44.669 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-08-10T11:39:44.736 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-08-10T11:39:44.875 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-08-10T11:39:44.906 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-08-10T11:39:45.040 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-08-10T11:39:45.094 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8. 26/134 2023-08-10T11:39:45.223 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-08-10T11:39:45.224 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el 27/134 2023-08-10T11:39:45.450 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-08-10T11:39:45.623 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-08-10T11:39:45.815 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-08-10T11:39:45.959 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-08-10T11:39:46.166 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-08-10T11:39:46.171 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_6 28/134 2023-08-10T11:39:46.424 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-08-10T11:39:46.486 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-08-10T11:39:46.592 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-08-10T11:39:46.792 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-08-10T11:39:46.849 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-08-10T11:39:47.052 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-08-10T11:39:47.061 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-08-10T11:39:47.235 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-08-10T11:39:47.287 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-10T11:39:47.436 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-08-10T11:39:48.563 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-08-10T11:39:48.814 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-08-10T11:39:49.045 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-10T11:39:49.077 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-08-10T11:39:49.363 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-08-10T11:39:49.376 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-08-10T11:39:49.591 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-08-10T11:39:49.650 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-08-10T11:39:49.772 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-08-10T11:39:49.914 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-08-10T11:39:50.009 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 36/134 2023-08-10T11:39:50.174 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_6 37/134 2023-08-10T11:39:50.335 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-08-10T11:39:50.540 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-08-10T11:39:50.707 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-08-10T11:39:50.722 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-08-10T11:39:50.861 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 92/134 2023-08-10T11:39:50.916 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-08-10T11:39:50.932 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 92/134 2023-08-10T11:39:51.119 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 93/134 2023-08-10T11:39:51.136 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-08-10T11:39:51.356 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-08-10T11:39:51.727 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-08-10T11:39:52.198 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-08-10T11:39:52.430 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-08-10T11:39:52.650 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-08-10T11:39:52.933 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-08-10T11:39:53.270 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-08-10T11:39:53.469 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-08-10T11:39:53.687 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-08-10T11:39:53.916 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-08-10T11:39:54.115 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-08-10T11:39:54.298 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-08-10T11:39:54.629 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-08-10T11:39:54.786 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 94/134 2023-08-10T11:39:54.883 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-08-10T11:39:55.141 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-08-10T11:39:55.343 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-08-10T11:39:55.552 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-08-10T11:39:55.704 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-08-10T11:39:55.784 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 94/134 2023-08-10T11:39:55.902 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-08-10T11:39:55.958 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-08-10T11:39:56.197 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-08-10T11:39:56.372 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 94/134 2023-08-10T11:39:56.414 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-08-10T11:39:56.561 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-10T11:39:56.633 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 95/134 2023-08-10T11:39:56.636 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-10T11:39:56.718 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 95/134 2023-08-10T11:39:56.865 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-08-10T11:39:56.894 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 96/134 2023-08-10T11:39:57.028 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-08-10T11:39:57.194 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-08-10T11:39:57.405 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-08-10T11:39:57.654 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-08-10T11:39:57.901 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-08-10T11:39:58.048 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-08-10T11:39:58.214 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-08-10T11:39:58.405 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-08-10T11:39:58.590 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-08-10T11:39:58.789 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-08-10T11:39:58.955 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-08-10T11:39:59.125 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-08-10T11:39:59.366 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-08-10T11:39:59.639 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-08-10T11:39:59.825 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-08-10T11:40:00.106 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-08-10T11:40:00.284 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-08-10T11:40:00.476 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-08-10T11:40:00.685 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-08-10T11:40:01.815 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-08-10T11:40:02.139 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-08-10T11:40:02.443 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-08-10T11:40:02.752 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-08-10T11:40:03.018 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-08-10T11:40:03.237 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-08-10T11:40:04.018 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-08-10T11:40:04.184 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 92/134 2023-08-10T11:40:04.243 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 92/134 2023-08-10T11:40:04.418 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 93/134 2023-08-10T11:40:08.154 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 94/134 2023-08-10T11:40:08.393 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 94/134 2023-08-10T11:40:08.991 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 94/134 2023-08-10T11:40:09.296 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 95/134 2023-08-10T11:40:09.379 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 95/134 2023-08-10T11:40:09.543 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 96/134 2023-08-10T11:40:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 96/134 2023-08-10T11:40:15.670 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /sys 2023-08-10T11:40:15.670 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /proc 2023-08-10T11:40:15.670 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /dev 2023-08-10T11:40:15.670 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /run 2023-08-10T11:40:15.671 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /mnt 2023-08-10T11:40:15.671 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /var/tmp 2023-08-10T11:40:15.671 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /home 2023-08-10T11:40:15.671 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /tmp 2023-08-10T11:40:15.671 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /dev 2023-08-10T11:40:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:40:16.033 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 97/134 2023-08-10T11:40:17.629 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 97/134 2023-08-10T11:40:17.780 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 98/134 2023-08-10T11:40:17.997 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 98/134 2023-08-10T11:40:18.215 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 99/134 2023-08-10T11:40:18.672 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 99/134 2023-08-10T11:40:18.823 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 100/134 2023-08-10T11:40:18.840 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 100/134 2023-08-10T11:40:20.558 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 101/134 2023-08-10T11:40:20.774 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 101/134 2023-08-10T11:40:20.887 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.e 102/134 2023-08-10T11:40:21.088 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f. 103/134 2023-08-10T11:40:21.273 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 104/134 2023-08-10T11:40:21.486 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 104/134 2023-08-10T11:40:21.796 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 105/134 2023-08-10T11:40:22.752 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 105/134 2023-08-10T11:40:22.914 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 106/134 2023-08-10T11:40:23.004 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 106/134 2023-08-10T11:40:23.357 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el 107/134 2023-08-10T11:40:23.571 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 108/134 2023-08-10T11:40:23.607 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 108/134 2023-08-10T11:40:23.789 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 109/134 2023-08-10T11:40:23.800 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 109/134 2023-08-10T11:40:25.102 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 110/134 2023-08-10T11:40:25.264 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 111/134 2023-08-10T11:40:25.297 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 111/134 2023-08-10T11:40:25.467 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 112/134 2023-08-10T11:40:25.508 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 112/134 2023-08-10T11:40:25.648 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 113/134 2023-08-10T11:40:25.999 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 113/134 2023-08-10T11:40:26.156 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 114/134 2023-08-10T11:40:28.184 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 96/134 2023-08-10T11:40:28.185 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /sys 2023-08-10T11:40:28.185 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /proc 2023-08-10T11:40:28.185 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /dev 2023-08-10T11:40:28.185 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /run 2023-08-10T11:40:28.186 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /mnt 2023-08-10T11:40:28.186 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /var/tmp 2023-08-10T11:40:28.186 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /home 2023-08-10T11:40:28.186 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /tmp 2023-08-10T11:40:28.186 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /dev 2023-08-10T11:40:28.187 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-08-10T11:40:28.565 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 97/134 2023-08-10T11:40:30.146 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 97/134 2023-08-10T11:40:30.359 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 98/134 2023-08-10T11:40:30.577 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 98/134 2023-08-10T11:40:30.713 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 114/134 2023-08-10T11:40:30.814 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 99/134 2023-08-10T11:40:30.985 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 115/134 2023-08-10T11:40:31.180 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-08-10T11:40:31.280 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 99/134 2023-08-10T11:40:31.369 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-08-10T11:40:31.447 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 100/134 2023-08-10T11:40:31.463 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 100/134 2023-08-10T11:40:32.285 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-08-10T11:40:32.619 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-08-10T11:40:32.807 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 119/134 2023-08-10T11:40:33.033 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-10T11:40:33.162 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 101/134 2023-08-10T11:40:33.217 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_ 121/134 2023-08-10T11:40:33.361 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 101/134 2023-08-10T11:40:33.405 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-10T11:40:33.528 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.e 102/134 2023-08-10T11:40:33.711 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f. 103/134 2023-08-10T11:40:33.897 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 104/134 2023-08-10T11:40:34.109 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 104/134 2023-08-10T11:40:34.416 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 105/134 2023-08-10T11:40:35.380 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 105/134 2023-08-10T11:40:35.538 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 106/134 2023-08-10T11:40:35.594 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-10T11:40:35.628 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 106/134 2023-08-10T11:40:35.863 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-10T11:40:35.881 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-10T11:40:36.029 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el 107/134 2023-08-10T11:40:36.103 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 124/134 2023-08-10T11:40:36.263 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 108/134 2023-08-10T11:40:36.298 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 108/134 2023-08-10T11:40:36.370 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 125/134 2023-08-10T11:40:36.446 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 109/134 2023-08-10T11:40:36.457 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 109/134 2023-08-10T11:40:36.677 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 126/134 2023-08-10T11:40:36.997 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-08-10T11:40:37.121 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-10T11:40:37.128 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-10T11:40:37.348 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-08-10T11:40:37.537 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-08-10T11:40:37.628 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-08-10T11:40:37.735 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 110/134 2023-08-10T11:40:37.837 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-08-10T11:40:37.850 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-08-10T11:40:37.850 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-10T11:40:37.912 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 111/134 2023-08-10T11:40:37.944 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 111/134 2023-08-10T11:40:38.032 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-10T11:40:38.032 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-10T11:40:38.130 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 112/134 2023-08-10T11:40:38.171 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 112/134 2023-08-10T11:40:38.285 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-10T11:40:38.321 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 113/134 2023-08-10T11:40:38.553 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-10T11:40:38.673 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 113/134 2023-08-10T11:40:38.821 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 114/134 2023-08-10T11:40:39.067 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-08-10T11:40:39.067 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 1/134 2023-08-10T11:40:39.067 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 2/134 2023-08-10T11:40:39.068 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 3/134 2023-08-10T11:40:39.068 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 4/134 2023-08-10T11:40:39.068 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 5/134 2023-08-10T11:40:39.068 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 6/134 2023-08-10T11:40:39.069 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 7/134 2023-08-10T11:40:39.069 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 8/134 2023-08-10T11:40:39.069 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 9/134 2023-08-10T11:40:39.069 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 10/134 2023-08-10T11:40:39.069 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 11/134 2023-08-10T11:40:39.070 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 12/134 2023-08-10T11:40:39.070 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 13/134 2023-08-10T11:40:39.070 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_ 14/134 2023-08-10T11:40:39.070 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 15/134 2023-08-10T11:40:39.070 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 16/134 2023-08-10T11:40:39.071 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_6 17/134 2023-08-10T11:40:39.071 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 18/134 2023-08-10T11:40:39.071 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 19/134 2023-08-10T11:40:39.071 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el 20/134 2023-08-10T11:40:39.071 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8. 21/134 2023-08-10T11:40:39.072 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_6 22/134 2023-08-10T11:40:39.072 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 23/134 2023-08-10T11:40:39.072 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 24/134 2023-08-10T11:40:39.072 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 25/134 2023-08-10T11:40:39.073 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 26/134 2023-08-10T11:40:39.073 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 27/134 2023-08-10T11:40:39.073 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 28/134 2023-08-10T11:40:39.073 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f. 29/134 2023-08-10T11:40:39.074 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 30/134 2023-08-10T11:40:39.074 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 31/134 2023-08-10T11:40:39.074 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 32/134 2023-08-10T11:40:39.074 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el 33/134 2023-08-10T11:40:39.074 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 34/134 2023-08-10T11:40:39.075 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.e 35/134 2023-08-10T11:40:39.075 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 36/134 2023-08-10T11:40:39.075 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 37/134 2023-08-10T11:40:39.075 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 38/134 2023-08-10T11:40:39.076 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-08-10T11:40:39.076 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-08-10T11:40:39.076 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-08-10T11:40:39.076 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-08-10T11:40:39.077 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-08-10T11:40:39.077 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-08-10T11:40:39.077 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-08-10T11:40:39.077 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-08-10T11:40:39.078 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-08-10T11:40:39.078 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-08-10T11:40:39.078 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-08-10T11:40:39.078 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-08-10T11:40:39.078 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-08-10T11:40:39.079 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-08-10T11:40:39.079 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-08-10T11:40:39.079 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-08-10T11:40:39.079 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-08-10T11:40:39.080 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-08-10T11:40:39.080 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-08-10T11:40:39.080 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-08-10T11:40:39.080 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-08-10T11:40:39.081 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-08-10T11:40:39.081 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-08-10T11:40:39.081 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-08-10T11:40:39.081 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-08-10T11:40:39.082 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-08-10T11:40:39.082 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-08-10T11:40:39.082 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-08-10T11:40:39.082 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-08-10T11:40:39.083 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-08-10T11:40:39.083 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-08-10T11:40:39.083 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-08-10T11:40:39.083 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-08-10T11:40:39.083 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-08-10T11:40:39.084 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-08-10T11:40:39.084 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-08-10T11:40:39.084 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-08-10T11:40:39.084 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-08-10T11:40:39.085 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-08-10T11:40:39.085 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-08-10T11:40:39.085 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-08-10T11:40:39.085 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-08-10T11:40:39.086 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-08-10T11:40:39.086 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-08-10T11:40:39.086 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-08-10T11:40:39.086 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-08-10T11:40:39.087 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-08-10T11:40:39.087 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-08-10T11:40:39.087 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-08-10T11:40:39.087 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-08-10T11:40:39.088 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-08-10T11:40:39.088 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-08-10T11:40:39.088 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-08-10T11:40:39.088 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-08-10T11:40:39.089 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-08-10T11:40:39.089 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-08-10T11:40:39.089 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-08-10T11:40:39.089 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-08-10T11:40:39.089 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-08-10T11:40:39.089 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-08-10T11:40:39.089 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-08-10T11:40:39.090 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-08-10T11:40:39.090 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-08-10T11:40:39.090 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-08-10T11:40:39.090 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-08-10T11:40:39.090 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-08-10T11:40:39.090 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-08-10T11:40:39.090 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-08-10T11:40:39.091 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-08-10T11:40:39.091 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-08-10T11:40:39.091 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-08-10T11:40:39.091 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-08-10T11:40:39.091 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-08-10T11:40:39.091 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-08-10T11:40:39.091 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-08-10T11:40:39.092 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-08-10T11:40:39.092 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-08-10T11:40:39.092 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-08-10T11:40:39.092 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-08-10T11:40:39.092 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-08-10T11:40:39.092 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-08-10T11:40:39.092 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-10T11:40:39.092 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-08-10T11:40:39.093 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-10T11:40:39.093 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-08-10T11:40:39.093 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-08-10T11:40:39.093 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-08-10T11:40:39.093 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-08-10T11:40:39.093 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-08-10T11:40:39.093 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-10T11:40:39.094 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 129/134 2023-08-10T11:40:39.094 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-08-10T11:40:39.094 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 131/134 2023-08-10T11:40:39.094 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-10T11:40:39.094 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-08-10T11:40:41.614 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-10T11:40:41.614 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:04:05 ago on Thu 10 Aug 2023 11:36:36 AM UTC. 2023-08-10T11:40:43.383 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 114/134 2023-08-10T11:40:43.691 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 115/134 2023-08-10T11:40:43.845 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-08-10T11:40:44.036 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-08-10T11:40:44.254 INFO:teuthology.orchestra.run.smithi073.stdout:Installed products updated. 2023-08-10T11:40:44.468 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:40:44.468 INFO:teuthology.orchestra.run.smithi073.stdout:Upgraded: 2023-08-10T11:40:44.468 INFO:teuthology.orchestra.run.smithi073.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-08-10T11:40:44.469 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.469 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.469 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2023-08-10T11:40:44.469 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-08-10T11:40:44.469 INFO:teuthology.orchestra.run.smithi073.stdout: automake-1.16.1-7.el8.noarch 2023-08-10T11:40:44.469 INFO:teuthology.orchestra.run.smithi073.stdout: bison-3.0.4-10.el8.x86_64 2023-08-10T11:40:44.469 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.470 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.470 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.470 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.470 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:40:44.470 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.470 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.470 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.471 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:40:44.471 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:40:44.471 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:40:44.471 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:40:44.471 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:40:44.471 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.471 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.471 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:40:44.472 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.472 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.472 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.472 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:40:44.472 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:40:44.472 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.472 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:40:44.473 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-08-10T11:40:44.473 INFO:teuthology.orchestra.run.smithi073.stdout: flex-2.6.1-9.el8.x86_64 2023-08-10T11:40:44.473 INFO:teuthology.orchestra.run.smithi073.stdout: fuse-2.9.7-15.el8.x86_64 2023-08-10T11:40:44.473 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-10T11:40:44.473 INFO:teuthology.orchestra.run.smithi073.stdout: jq-1.6-3.el8.x86_64 2023-08-10T11:40:44.473 INFO:teuthology.orchestra.run.smithi073.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-10T11:40:44.473 INFO:teuthology.orchestra.run.smithi073.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-08-10T11:40:44.473 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-10T11:40:44.474 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.474 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.474 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.474 INFO:teuthology.orchestra.run.smithi073.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-08-10T11:40:44.474 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-08-10T11:40:44.474 INFO:teuthology.orchestra.run.smithi073.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-10T11:40:44.474 INFO:teuthology.orchestra.run.smithi073.stdout: libpq-13.5-1.el8.x86_64 2023-08-10T11:40:44.475 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-08-10T11:40:44.475 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-10T11:40:44.475 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.475 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.475 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-10T11:40:44.475 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.475 INFO:teuthology.orchestra.run.smithi073.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-10T11:40:44.475 INFO:teuthology.orchestra.run.smithi073.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-10T11:40:44.476 INFO:teuthology.orchestra.run.smithi073.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-10T11:40:44.476 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-10T11:40:44.476 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-08-10T11:40:44.476 INFO:teuthology.orchestra.run.smithi073.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-10T11:40:44.476 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-10T11:40:44.476 INFO:teuthology.orchestra.run.smithi073.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-10T11:40:44.476 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-0.3.15-3.el8.x86_64 2023-08-10T11:40:44.477 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-08-10T11:40:44.477 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-08-10T11:40:44.477 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-10T11:40:44.477 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-10T11:40:44.477 INFO:teuthology.orchestra.run.smithi073.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-10T11:40:44.477 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-10T11:40:44.477 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-10T11:40:44.478 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-10T11:40:44.478 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-10T11:40:44.478 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-10T11:40:44.478 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-10T11:40:44.478 INFO:teuthology.orchestra.run.smithi073.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-10T11:40:44.478 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-10T11:40:44.478 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.478 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.479 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.479 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-10T11:40:44.479 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-08-10T11:40:44.479 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-10T11:40:44.479 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-10T11:40:44.479 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-08-10T11:40:44.479 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-10T11:40:44.479 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-10T11:40:44.480 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-10T11:40:44.480 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-10T11:40:44.480 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-10T11:40:44.480 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-10T11:40:44.480 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-10T11:40:44.480 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-10T11:40:44.480 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-10T11:40:44.481 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-10T11:40:44.481 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-10T11:40:44.481 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-10T11:40:44.481 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-10T11:40:44.481 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-10T11:40:44.481 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-10T11:40:44.481 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-10T11:40:44.482 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-10T11:40:44.482 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend-2.6-1.el8.noarch 2023-08-10T11:40:44.482 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-10T11:40:44.482 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-10T11:40:44.482 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-10T11:40:44.482 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-10T11:40:44.482 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-10T11:40:44.482 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-10T11:40:44.483 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.483 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.483 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-10T11:40:44.483 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-10T11:40:44.483 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.483 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-10T11:40:44.483 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-10T11:40:44.484 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-08-10T11:40:44.484 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-10T11:40:44.484 INFO:teuthology.orchestra.run.smithi073.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-10T11:40:44.484 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-10T11:40:44.484 INFO:teuthology.orchestra.run.smithi073.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-10T11:40:44.484 INFO:teuthology.orchestra.run.smithi073.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-10T11:40:44.484 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-10T11:40:44.485 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-10T11:40:44.485 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-10T11:40:44.485 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-10T11:40:44.485 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-10T11:40:44.485 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.485 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.485 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:44.485 INFO:teuthology.orchestra.run.smithi073.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-10T11:40:44.486 INFO:teuthology.orchestra.run.smithi073.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-10T11:40:44.486 INFO:teuthology.orchestra.run.smithi073.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-10T11:40:44.486 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-08-10T11:40:44.486 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-10T11:40:44.486 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-08-10T11:40:44.487 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:40:44.487 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-08-10T11:40:44.660 DEBUG:teuthology.parallel:result is None 2023-08-10T11:40:44.977 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-08-10T11:40:45.276 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-08-10T11:40:45.448 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 119/134 2023-08-10T11:40:45.615 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-10T11:40:45.782 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_ 121/134 2023-08-10T11:40:45.912 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-10T11:40:48.158 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-10T11:40:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-10T11:40:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-10T11:40:48.673 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 124/134 2023-08-10T11:40:48.935 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 125/134 2023-08-10T11:40:49.239 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 126/134 2023-08-10T11:40:49.563 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-08-10T11:40:49.711 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-10T11:40:49.719 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-10T11:40:49.946 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-08-10T11:40:50.094 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-08-10T11:40:50.179 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-08-10T11:40:50.411 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-08-10T11:40:50.423 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-08-10T11:40:50.424 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-10T11:40:50.597 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-10T11:40:50.597 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-10T11:40:50.867 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-10T11:40:51.051 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-10T11:40:51.549 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-08-10T11:40:51.549 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 1/134 2023-08-10T11:40:51.549 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 2/134 2023-08-10T11:40:51.549 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 3/134 2023-08-10T11:40:51.549 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 4/134 2023-08-10T11:40:51.550 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 5/134 2023-08-10T11:40:51.550 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 6/134 2023-08-10T11:40:51.550 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 7/134 2023-08-10T11:40:51.550 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 8/134 2023-08-10T11:40:51.550 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 9/134 2023-08-10T11:40:51.550 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 10/134 2023-08-10T11:40:51.550 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 11/134 2023-08-10T11:40:51.551 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 12/134 2023-08-10T11:40:51.551 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 13/134 2023-08-10T11:40:51.551 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_ 14/134 2023-08-10T11:40:51.551 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 15/134 2023-08-10T11:40:51.551 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 16/134 2023-08-10T11:40:51.551 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_6 17/134 2023-08-10T11:40:51.551 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 18/134 2023-08-10T11:40:51.552 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 19/134 2023-08-10T11:40:51.552 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el 20/134 2023-08-10T11:40:51.552 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8. 21/134 2023-08-10T11:40:51.552 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_6 22/134 2023-08-10T11:40:51.552 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 23/134 2023-08-10T11:40:51.552 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 24/134 2023-08-10T11:40:51.552 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 25/134 2023-08-10T11:40:51.553 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 26/134 2023-08-10T11:40:51.553 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 27/134 2023-08-10T11:40:51.553 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 28/134 2023-08-10T11:40:51.553 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f. 29/134 2023-08-10T11:40:51.553 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 30/134 2023-08-10T11:40:51.560 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 31/134 2023-08-10T11:40:51.560 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 32/134 2023-08-10T11:40:51.561 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el 33/134 2023-08-10T11:40:51.561 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 34/134 2023-08-10T11:40:51.561 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.e 35/134 2023-08-10T11:40:51.561 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 36/134 2023-08-10T11:40:51.561 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 37/134 2023-08-10T11:40:51.561 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 38/134 2023-08-10T11:40:51.562 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-08-10T11:40:51.562 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-08-10T11:40:51.562 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-08-10T11:40:51.562 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-08-10T11:40:51.562 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-08-10T11:40:51.562 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-08-10T11:40:51.562 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-08-10T11:40:51.563 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-08-10T11:40:51.563 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-08-10T11:40:51.563 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-08-10T11:40:51.563 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-08-10T11:40:51.563 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-08-10T11:40:51.563 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-08-10T11:40:51.563 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-08-10T11:40:51.563 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-08-10T11:40:51.564 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-08-10T11:40:51.564 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-08-10T11:40:51.564 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-08-10T11:40:51.564 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-08-10T11:40:51.564 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-08-10T11:40:51.564 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-08-10T11:40:51.564 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-08-10T11:40:51.565 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-08-10T11:40:51.565 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-08-10T11:40:51.565 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-08-10T11:40:51.565 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-08-10T11:40:51.565 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-08-10T11:40:51.565 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-08-10T11:40:51.565 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-08-10T11:40:51.566 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-08-10T11:40:51.566 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-08-10T11:40:51.566 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-08-10T11:40:51.566 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-08-10T11:40:51.566 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-08-10T11:40:51.566 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-08-10T11:40:51.566 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-08-10T11:40:51.567 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-08-10T11:40:51.567 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-08-10T11:40:51.567 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-08-10T11:40:51.567 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-08-10T11:40:51.567 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-08-10T11:40:51.567 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-08-10T11:40:51.567 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-08-10T11:40:51.568 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-08-10T11:40:51.568 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-08-10T11:40:51.568 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-08-10T11:40:51.568 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-08-10T11:40:51.568 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-08-10T11:40:51.568 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-08-10T11:40:51.568 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-08-10T11:40:51.569 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-08-10T11:40:51.569 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-08-10T11:40:51.569 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-08-10T11:40:51.569 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-08-10T11:40:51.569 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-08-10T11:40:51.569 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-08-10T11:40:51.569 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-08-10T11:40:51.570 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-08-10T11:40:51.570 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-08-10T11:40:51.570 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-08-10T11:40:51.570 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-08-10T11:40:51.570 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-08-10T11:40:51.570 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-08-10T11:40:51.570 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-08-10T11:40:51.571 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-08-10T11:40:51.571 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-08-10T11:40:51.571 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-08-10T11:40:51.571 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-08-10T11:40:51.571 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-08-10T11:40:51.571 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-08-10T11:40:51.571 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-08-10T11:40:51.572 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-08-10T11:40:51.572 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-08-10T11:40:51.572 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-08-10T11:40:51.572 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-08-10T11:40:51.572 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-08-10T11:40:51.572 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-08-10T11:40:51.572 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-08-10T11:40:51.573 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-08-10T11:40:51.573 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-08-10T11:40:51.573 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-08-10T11:40:51.573 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-10T11:40:51.573 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-08-10T11:40:51.573 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-10T11:40:51.573 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-08-10T11:40:51.574 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-08-10T11:40:51.574 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-08-10T11:40:51.574 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-08-10T11:40:51.574 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-08-10T11:40:51.574 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-10T11:40:51.575 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 129/134 2023-08-10T11:40:51.575 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-08-10T11:40:51.575 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 131/134 2023-08-10T11:40:51.575 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-10T11:40:51.575 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-08-10T11:40:54.087 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-10T11:40:54.087 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:04:17 ago on Thu 10 Aug 2023 11:36:37 AM UTC. 2023-08-10T11:40:56.685 INFO:teuthology.orchestra.run.smithi152.stdout:Installed products updated. 2023-08-10T11:40:56.905 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-08-10T11:40:56.905 INFO:teuthology.orchestra.run.smithi152.stdout:Upgraded: 2023-08-10T11:40:56.905 INFO:teuthology.orchestra.run.smithi152.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-08-10T11:40:56.906 INFO:teuthology.orchestra.run.smithi152.stdout: librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.906 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.906 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-08-10T11:40:56.906 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-08-10T11:40:56.906 INFO:teuthology.orchestra.run.smithi152.stdout: automake-1.16.1-7.el8.noarch 2023-08-10T11:40:56.906 INFO:teuthology.orchestra.run.smithi152.stdout: bison-3.0.4-10.el8.x86_64 2023-08-10T11:40:56.906 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.907 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.907 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.907 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.907 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:40:56.907 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.907 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.907 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.908 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:40:56.908 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:40:56.908 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:40:56.908 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:40:56.908 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:40:56.908 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.908 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.909 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:40:56.909 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.909 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.909 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.909 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:40:56.909 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:40:56.909 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.909 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:40:56.910 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-08-10T11:40:56.910 INFO:teuthology.orchestra.run.smithi152.stdout: flex-2.6.1-9.el8.x86_64 2023-08-10T11:40:56.910 INFO:teuthology.orchestra.run.smithi152.stdout: fuse-2.9.7-15.el8.x86_64 2023-08-10T11:40:56.910 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-10T11:40:56.910 INFO:teuthology.orchestra.run.smithi152.stdout: jq-1.6-3.el8.x86_64 2023-08-10T11:40:56.910 INFO:teuthology.orchestra.run.smithi152.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-10T11:40:56.910 INFO:teuthology.orchestra.run.smithi152.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-08-10T11:40:56.911 INFO:teuthology.orchestra.run.smithi152.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-10T11:40:56.911 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.911 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.911 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.911 INFO:teuthology.orchestra.run.smithi152.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-08-10T11:40:56.911 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-08-10T11:40:56.911 INFO:teuthology.orchestra.run.smithi152.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-10T11:40:56.911 INFO:teuthology.orchestra.run.smithi152.stdout: libpq-13.5-1.el8.x86_64 2023-08-10T11:40:56.912 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-08-10T11:40:56.912 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-10T11:40:56.912 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.912 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.912 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-10T11:40:56.912 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.912 INFO:teuthology.orchestra.run.smithi152.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-10T11:40:56.913 INFO:teuthology.orchestra.run.smithi152.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-10T11:40:56.913 INFO:teuthology.orchestra.run.smithi152.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-10T11:40:56.913 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-10T11:40:56.913 INFO:teuthology.orchestra.run.smithi152.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-08-10T11:40:56.913 INFO:teuthology.orchestra.run.smithi152.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-10T11:40:56.913 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-10T11:40:56.913 INFO:teuthology.orchestra.run.smithi152.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-10T11:40:56.913 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-0.3.15-3.el8.x86_64 2023-08-10T11:40:56.914 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-08-10T11:40:56.914 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-08-10T11:40:56.914 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-10T11:40:56.914 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-10T11:40:56.914 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-10T11:40:56.914 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-10T11:40:56.914 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-10T11:40:56.914 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-10T11:40:56.915 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-10T11:40:56.915 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-10T11:40:56.915 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-10T11:40:56.915 INFO:teuthology.orchestra.run.smithi152.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-10T11:40:56.915 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-10T11:40:56.915 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.915 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.916 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.916 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-10T11:40:56.916 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-08-10T11:40:56.916 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-10T11:40:56.916 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-10T11:40:56.916 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-08-10T11:40:56.916 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-10T11:40:56.916 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-10T11:40:56.917 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-10T11:40:56.917 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-10T11:40:56.917 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-10T11:40:56.917 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-10T11:40:56.917 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-10T11:40:56.917 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-10T11:40:56.917 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-10T11:40:56.917 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-10T11:40:56.918 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-10T11:40:56.918 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-10T11:40:56.918 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-10T11:40:56.918 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-10T11:40:56.918 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-10T11:40:56.918 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-10T11:40:56.918 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-10T11:40:56.919 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend-2.6-1.el8.noarch 2023-08-10T11:40:56.919 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-10T11:40:56.919 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-10T11:40:56.919 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-10T11:40:56.919 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-10T11:40:56.919 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-10T11:40:56.919 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-10T11:40:56.919 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.920 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.920 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-10T11:40:56.920 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-10T11:40:56.920 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.920 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-10T11:40:56.920 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-10T11:40:56.920 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-08-10T11:40:56.921 INFO:teuthology.orchestra.run.smithi152.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-10T11:40:56.921 INFO:teuthology.orchestra.run.smithi152.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-10T11:40:56.921 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-10T11:40:56.921 INFO:teuthology.orchestra.run.smithi152.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-10T11:40:56.921 INFO:teuthology.orchestra.run.smithi152.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-10T11:40:56.921 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-10T11:40:56.921 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-10T11:40:56.921 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-10T11:40:56.922 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-10T11:40:56.922 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-10T11:40:56.922 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.922 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.922 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:40:56.922 INFO:teuthology.orchestra.run.smithi152.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-10T11:40:56.922 INFO:teuthology.orchestra.run.smithi152.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-10T11:40:56.923 INFO:teuthology.orchestra.run.smithi152.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-10T11:40:56.923 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-08-10T11:40:56.923 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-10T11:40:56.923 INFO:teuthology.orchestra.run.smithi152.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-08-10T11:40:56.923 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-08-10T11:40:56.924 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-08-10T11:40:57.087 DEBUG:teuthology.parallel:result is None 2023-08-10T11:41:26.974 INFO:teuthology.orchestra.run.smithi156.stdout:[MIRROR] python3-asyncssh-2.7.0-2.el8.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/p/python3-asyncssh-2.7.0-2.el8.noarch.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T11:41:26.975 INFO:teuthology.orchestra.run.smithi156.stdout:[MIRROR] python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/p/python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T11:41:27.127 INFO:teuthology.orchestra.run.smithi156.stdout:(130/131): python3-bcrypt-3.1.6-2.el8.1.x86_64. 339 B/s | 44 kB 02:11 2023-08-10T11:41:27.218 INFO:teuthology.orchestra.run.smithi156.stdout:(131/131): python3-asyncssh-2.7.0-2.el8.noarch. 3.6 kB/s | 476 kB 02:11 2023-08-10T11:41:27.220 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-08-10T11:41:27.221 INFO:teuthology.orchestra.run.smithi156.stdout:Total 758 kB/s | 206 MB 04:38 2023-08-10T11:41:27.996 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-08-10T11:41:28.115 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-08-10T11:41:28.115 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-08-10T11:41:29.231 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-08-10T11:41:29.235 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-08-10T11:41:34.286 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-08-10T11:41:34.481 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-08-10T11:41:34.674 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-08-10T11:41:34.865 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-08-10T11:41:35.067 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-10T11:41:35.178 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-10T11:41:35.467 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-10T11:41:35.863 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-10T11:41:36.133 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 6/134 2023-08-10T11:41:36.514 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 6/134 2023-08-10T11:41:36.708 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 7/134 2023-08-10T11:41:36.835 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 7/134 2023-08-10T11:41:37.025 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 8/134 2023-08-10T11:41:37.124 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 8/134 2023-08-10T11:41:37.333 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 9/134 2023-08-10T11:41:37.570 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-08-10T11:41:37.802 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-08-10T11:41:38.233 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-08-10T11:41:38.528 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-08-10T11:41:38.699 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 14/134 2023-08-10T11:41:38.798 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 14/134 2023-08-10T11:41:38.958 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 15/134 2023-08-10T11:41:39.034 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 15/134 2023-08-10T11:41:39.190 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-10T11:41:39.319 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-10T11:41:39.541 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-10T11:41:40.155 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-10T11:41:40.349 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-10T11:41:40.946 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-10T11:41:41.140 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-08-10T11:41:41.836 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-08-10T11:41:42.130 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-08-10T11:41:42.349 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-08-10T11:41:42.577 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-08-10T11:41:42.812 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-08-10T11:41:43.012 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-08-10T11:41:43.275 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-08-10T11:41:43.421 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8. 26/134 2023-08-10T11:41:43.567 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el 27/134 2023-08-10T11:41:44.461 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_6 28/134 2023-08-10T11:41:44.829 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-08-10T11:41:45.134 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-08-10T11:41:45.418 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-08-10T11:41:45.656 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-10T11:41:47.405 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-10T11:41:47.749 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-08-10T11:41:47.993 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-08-10T11:41:48.183 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-08-10T11:41:48.420 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 36/134 2023-08-10T11:41:48.643 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_6 37/134 2023-08-10T11:41:48.814 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-08-10T11:41:49.029 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-08-10T11:41:49.217 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-08-10T11:41:49.418 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-08-10T11:41:49.630 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-08-10T11:41:49.855 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-08-10T11:41:50.221 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-08-10T11:41:50.526 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-08-10T11:41:50.733 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-08-10T11:41:50.988 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-08-10T11:41:51.295 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-08-10T11:41:51.660 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-08-10T11:41:51.855 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-08-10T11:41:52.059 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-08-10T11:41:52.303 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-08-10T11:41:52.468 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-08-10T11:41:52.676 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-08-10T11:41:52.988 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-08-10T11:41:53.257 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-08-10T11:41:53.511 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-08-10T11:41:53.762 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-08-10T11:41:53.912 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-08-10T11:41:54.056 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-08-10T11:41:54.255 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-08-10T11:41:54.339 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-08-10T11:41:54.633 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-08-10T11:41:54.875 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-08-10T11:41:55.047 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-10T11:41:55.109 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-10T11:41:55.370 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-08-10T11:41:55.599 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-08-10T11:41:55.739 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-08-10T11:41:55.894 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-08-10T11:41:56.170 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-08-10T11:41:56.421 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-08-10T11:41:56.560 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-08-10T11:41:56.766 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-08-10T11:41:56.949 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-08-10T11:41:57.176 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-08-10T11:41:57.765 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-08-10T11:41:57.974 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-08-10T11:41:58.111 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-08-10T11:41:58.360 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-08-10T11:41:58.592 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-08-10T11:41:58.785 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-08-10T11:41:59.061 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-08-10T11:41:59.338 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-08-10T11:41:59.504 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-08-10T11:41:59.764 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-08-10T11:42:00.885 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-08-10T11:42:01.183 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-08-10T11:42:01.445 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-08-10T11:42:01.782 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-08-10T11:42:02.076 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-08-10T11:42:02.320 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-08-10T11:42:03.121 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-08-10T11:42:03.312 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 92/134 2023-08-10T11:42:03.386 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 92/134 2023-08-10T11:42:03.537 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 93/134 2023-08-10T11:42:07.330 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 94/134 2023-08-10T11:42:07.587 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 94/134 2023-08-10T11:42:08.167 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 94/134 2023-08-10T11:42:08.977 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 95/134 2023-08-10T11:42:09.067 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 95/134 2023-08-10T11:42:09.236 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 96/134 2023-08-10T11:42:28.353 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 96/134 2023-08-10T11:42:28.353 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /sys 2023-08-10T11:42:28.353 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /proc 2023-08-10T11:42:28.354 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /dev 2023-08-10T11:42:28.354 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /run 2023-08-10T11:42:28.354 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /mnt 2023-08-10T11:42:28.354 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /var/tmp 2023-08-10T11:42:28.354 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /home 2023-08-10T11:42:28.354 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /tmp 2023-08-10T11:42:28.354 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /dev 2023-08-10T11:42:28.355 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-08-10T11:42:28.742 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 97/134 2023-08-10T11:42:30.326 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 97/134 2023-08-10T11:42:30.556 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 98/134 2023-08-10T11:42:30.774 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 98/134 2023-08-10T11:42:31.008 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 99/134 2023-08-10T11:42:31.472 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 99/134 2023-08-10T11:42:31.658 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 100/134 2023-08-10T11:42:31.674 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 100/134 2023-08-10T11:42:33.432 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 101/134 2023-08-10T11:42:33.625 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 101/134 2023-08-10T11:42:33.772 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.e 102/134 2023-08-10T11:42:33.955 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f. 103/134 2023-08-10T11:42:34.174 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 104/134 2023-08-10T11:42:34.391 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 104/134 2023-08-10T11:42:34.697 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 105/134 2023-08-10T11:42:35.663 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 105/134 2023-08-10T11:42:35.815 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 106/134 2023-08-10T11:42:35.906 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 106/134 2023-08-10T11:42:36.284 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el 107/134 2023-08-10T11:42:36.516 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 108/134 2023-08-10T11:42:36.550 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 108/134 2023-08-10T11:42:36.740 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 109/134 2023-08-10T11:42:36.751 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 109/134 2023-08-10T11:42:38.038 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 110/134 2023-08-10T11:42:38.250 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 111/134 2023-08-10T11:42:38.284 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 111/134 2023-08-10T11:42:38.415 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 112/134 2023-08-10T11:42:38.456 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 112/134 2023-08-10T11:42:38.623 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 113/134 2023-08-10T11:42:38.975 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 113/134 2023-08-10T11:42:39.156 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 114/134 2023-08-10T11:42:43.713 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 114/134 2023-08-10T11:42:44.046 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 115/134 2023-08-10T11:42:44.195 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-08-10T11:42:44.378 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-08-10T11:42:45.308 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-08-10T11:42:45.654 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-08-10T11:42:45.866 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 119/134 2023-08-10T11:42:46.109 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-10T11:42:46.292 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_ 121/134 2023-08-10T11:42:46.465 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-10T11:42:48.635 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-10T11:42:48.888 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-10T11:42:48.906 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-10T11:42:49.088 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 124/134 2023-08-10T11:42:49.421 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 125/134 2023-08-10T11:42:49.721 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 126/134 2023-08-10T11:42:50.090 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-08-10T11:42:50.229 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-10T11:42:50.237 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-10T11:42:50.418 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-08-10T11:42:50.654 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-08-10T11:42:50.736 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-08-10T11:42:50.996 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-08-10T11:42:51.008 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-08-10T11:42:51.008 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-10T11:42:51.240 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-10T11:42:51.241 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-10T11:42:51.480 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-10T11:42:51.719 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-10T11:42:52.216 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-08-10T11:42:52.217 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 1/134 2023-08-10T11:42:52.217 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 2/134 2023-08-10T11:42:52.217 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 3/134 2023-08-10T11:42:52.217 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 4/134 2023-08-10T11:42:52.217 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 5/134 2023-08-10T11:42:52.217 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 6/134 2023-08-10T11:42:52.217 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 7/134 2023-08-10T11:42:52.218 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 8/134 2023-08-10T11:42:52.218 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 9/134 2023-08-10T11:42:52.218 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 10/134 2023-08-10T11:42:52.218 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 11/134 2023-08-10T11:42:52.218 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 12/134 2023-08-10T11:42:52.218 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 13/134 2023-08-10T11:42:52.218 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_ 14/134 2023-08-10T11:42:52.219 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 15/134 2023-08-10T11:42:52.220 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 16/134 2023-08-10T11:42:52.220 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_6 17/134 2023-08-10T11:42:52.220 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 18/134 2023-08-10T11:42:52.220 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 19/134 2023-08-10T11:42:52.220 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el 20/134 2023-08-10T11:42:52.220 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8. 21/134 2023-08-10T11:42:52.220 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_6 22/134 2023-08-10T11:42:52.221 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 23/134 2023-08-10T11:42:52.221 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 24/134 2023-08-10T11:42:52.221 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 25/134 2023-08-10T11:42:52.221 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 26/134 2023-08-10T11:42:52.221 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 27/134 2023-08-10T11:42:52.228 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 28/134 2023-08-10T11:42:52.228 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f. 29/134 2023-08-10T11:42:52.228 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 30/134 2023-08-10T11:42:52.228 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 31/134 2023-08-10T11:42:52.228 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 32/134 2023-08-10T11:42:52.229 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el 33/134 2023-08-10T11:42:52.229 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 34/134 2023-08-10T11:42:52.229 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.e 35/134 2023-08-10T11:42:52.229 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 36/134 2023-08-10T11:42:52.229 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 37/134 2023-08-10T11:42:52.229 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 38/134 2023-08-10T11:42:52.229 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-08-10T11:42:52.230 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-08-10T11:42:52.230 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-08-10T11:42:52.230 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-08-10T11:42:52.230 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-08-10T11:42:52.230 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-08-10T11:42:52.230 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-08-10T11:42:52.230 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-08-10T11:42:52.230 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-08-10T11:42:52.231 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-08-10T11:42:52.231 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-08-10T11:42:52.231 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-08-10T11:42:52.231 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-08-10T11:42:52.231 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-08-10T11:42:52.231 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-08-10T11:42:52.231 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-08-10T11:42:52.231 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-08-10T11:42:52.232 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-08-10T11:42:52.232 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-08-10T11:42:52.232 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-08-10T11:42:52.232 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-08-10T11:42:52.232 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-08-10T11:42:52.232 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-08-10T11:42:52.232 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-08-10T11:42:52.233 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-08-10T11:42:52.233 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-08-10T11:42:52.233 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-08-10T11:42:52.233 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-08-10T11:42:52.233 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-08-10T11:42:52.233 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-08-10T11:42:52.233 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-08-10T11:42:52.233 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-08-10T11:42:52.234 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-08-10T11:42:52.234 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-08-10T11:42:52.234 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-08-10T11:42:52.234 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-08-10T11:42:52.234 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-08-10T11:42:52.234 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-08-10T11:42:52.234 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-08-10T11:42:52.234 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-08-10T11:42:52.235 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-08-10T11:42:52.235 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-08-10T11:42:52.235 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-08-10T11:42:52.235 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-08-10T11:42:52.235 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-08-10T11:42:52.235 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-08-10T11:42:52.235 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-08-10T11:42:52.235 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-08-10T11:42:52.236 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-08-10T11:42:52.236 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-08-10T11:42:52.236 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-08-10T11:42:52.236 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-08-10T11:42:52.236 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-08-10T11:42:52.236 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-08-10T11:42:52.236 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-08-10T11:42:52.236 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-08-10T11:42:52.237 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-08-10T11:42:52.237 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-08-10T11:42:52.237 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-08-10T11:42:52.237 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-08-10T11:42:52.237 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-08-10T11:42:52.237 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-08-10T11:42:52.237 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-08-10T11:42:52.238 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-08-10T11:42:52.238 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-08-10T11:42:52.238 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-08-10T11:42:52.238 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-08-10T11:42:52.238 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-08-10T11:42:52.238 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-08-10T11:42:52.238 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-08-10T11:42:52.238 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-08-10T11:42:52.239 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-08-10T11:42:52.239 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-08-10T11:42:52.239 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-08-10T11:42:52.239 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-08-10T11:42:52.239 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-08-10T11:42:52.239 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-08-10T11:42:52.239 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-08-10T11:42:52.239 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-08-10T11:42:52.240 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-08-10T11:42:52.240 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-08-10T11:42:52.240 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-10T11:42:52.240 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-08-10T11:42:52.240 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-10T11:42:52.240 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-08-10T11:42:52.240 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-08-10T11:42:52.240 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-08-10T11:42:52.241 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-08-10T11:42:52.241 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-08-10T11:42:52.241 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-10T11:42:52.241 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 129/134 2023-08-10T11:42:52.241 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-08-10T11:42:52.241 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 131/134 2023-08-10T11:42:52.241 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-10T11:42:52.241 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-08-10T11:42:54.813 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-10T11:42:54.813 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:06:17 ago on Thu 10 Aug 2023 11:36:37 AM UTC. 2023-08-10T11:42:57.390 INFO:teuthology.orchestra.run.smithi156.stdout:Installed products updated. 2023-08-10T11:42:57.604 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-08-10T11:42:57.605 INFO:teuthology.orchestra.run.smithi156.stdout:Upgraded: 2023-08-10T11:42:57.605 INFO:teuthology.orchestra.run.smithi156.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-08-10T11:42:57.605 INFO:teuthology.orchestra.run.smithi156.stdout: librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.605 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.606 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-08-10T11:42:57.606 INFO:teuthology.orchestra.run.smithi156.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-08-10T11:42:57.606 INFO:teuthology.orchestra.run.smithi156.stdout: automake-1.16.1-7.el8.noarch 2023-08-10T11:42:57.606 INFO:teuthology.orchestra.run.smithi156.stdout: bison-3.0.4-10.el8.x86_64 2023-08-10T11:42:57.607 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.607 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.607 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.607 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.608 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:42:57.608 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-immutable-object-cache-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.608 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.608 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.609 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:42:57.609 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:42:57.609 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:42:57.609 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:42:57.610 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:42:57.610 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.610 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.610 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:42:57.611 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.611 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.611 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.611 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:42:57.612 INFO:teuthology.orchestra.run.smithi156.stdout: cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:42:57.612 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.612 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T11:42:57.613 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-08-10T11:42:57.613 INFO:teuthology.orchestra.run.smithi156.stdout: flex-2.6.1-9.el8.x86_64 2023-08-10T11:42:57.613 INFO:teuthology.orchestra.run.smithi156.stdout: fuse-2.9.7-15.el8.x86_64 2023-08-10T11:42:57.613 INFO:teuthology.orchestra.run.smithi156.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-10T11:42:57.614 INFO:teuthology.orchestra.run.smithi156.stdout: jq-1.6-3.el8.x86_64 2023-08-10T11:42:57.614 INFO:teuthology.orchestra.run.smithi156.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-10T11:42:57.614 INFO:teuthology.orchestra.run.smithi156.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-08-10T11:42:57.614 INFO:teuthology.orchestra.run.smithi156.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-10T11:42:57.615 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.615 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.615 INFO:teuthology.orchestra.run.smithi156.stdout: libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.615 INFO:teuthology.orchestra.run.smithi156.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-08-10T11:42:57.616 INFO:teuthology.orchestra.run.smithi156.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-08-10T11:42:57.616 INFO:teuthology.orchestra.run.smithi156.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-10T11:42:57.616 INFO:teuthology.orchestra.run.smithi156.stdout: libpq-13.5-1.el8.x86_64 2023-08-10T11:42:57.616 INFO:teuthology.orchestra.run.smithi156.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-08-10T11:42:57.617 INFO:teuthology.orchestra.run.smithi156.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-10T11:42:57.617 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.617 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.617 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-10T11:42:57.618 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.618 INFO:teuthology.orchestra.run.smithi156.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-10T11:42:57.618 INFO:teuthology.orchestra.run.smithi156.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-10T11:42:57.618 INFO:teuthology.orchestra.run.smithi156.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-10T11:42:57.619 INFO:teuthology.orchestra.run.smithi156.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-10T11:42:57.619 INFO:teuthology.orchestra.run.smithi156.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-08-10T11:42:57.619 INFO:teuthology.orchestra.run.smithi156.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-10T11:42:57.620 INFO:teuthology.orchestra.run.smithi156.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-10T11:42:57.620 INFO:teuthology.orchestra.run.smithi156.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-10T11:42:57.620 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-0.3.15-3.el8.x86_64 2023-08-10T11:42:57.620 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-08-10T11:42:57.621 INFO:teuthology.orchestra.run.smithi156.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-08-10T11:42:57.621 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-10T11:42:57.621 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-10T11:42:57.621 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-10T11:42:57.622 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-10T11:42:57.622 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-10T11:42:57.622 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-10T11:42:57.622 INFO:teuthology.orchestra.run.smithi156.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-10T11:42:57.623 INFO:teuthology.orchestra.run.smithi156.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-10T11:42:57.623 INFO:teuthology.orchestra.run.smithi156.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-10T11:42:57.623 INFO:teuthology.orchestra.run.smithi156.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-10T11:42:57.623 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-10T11:42:57.624 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.624 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.624 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.624 INFO:teuthology.orchestra.run.smithi156.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-10T11:42:57.625 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-08-10T11:42:57.625 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-10T11:42:57.625 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-10T11:42:57.625 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-08-10T11:42:57.626 INFO:teuthology.orchestra.run.smithi156.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-10T11:42:57.626 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-10T11:42:57.626 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-10T11:42:57.626 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-10T11:42:57.627 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-10T11:42:57.627 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-10T11:42:57.627 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-10T11:42:57.627 INFO:teuthology.orchestra.run.smithi156.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-10T11:42:57.628 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-10T11:42:57.628 INFO:teuthology.orchestra.run.smithi156.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-10T11:42:57.628 INFO:teuthology.orchestra.run.smithi156.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-10T11:42:57.628 INFO:teuthology.orchestra.run.smithi156.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-10T11:42:57.629 INFO:teuthology.orchestra.run.smithi156.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-10T11:42:57.629 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-10T11:42:57.629 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-10T11:42:57.629 INFO:teuthology.orchestra.run.smithi156.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-10T11:42:57.630 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-10T11:42:57.630 INFO:teuthology.orchestra.run.smithi156.stdout: python3-portend-2.6-1.el8.noarch 2023-08-10T11:42:57.630 INFO:teuthology.orchestra.run.smithi156.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-10T11:42:57.630 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-10T11:42:57.631 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-10T11:42:57.631 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-10T11:42:57.631 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-10T11:42:57.631 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-10T11:42:57.632 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.632 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.632 INFO:teuthology.orchestra.run.smithi156.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-10T11:42:57.632 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-10T11:42:57.633 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.633 INFO:teuthology.orchestra.run.smithi156.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-10T11:42:57.633 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-10T11:42:57.633 INFO:teuthology.orchestra.run.smithi156.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-08-10T11:42:57.634 INFO:teuthology.orchestra.run.smithi156.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-10T11:42:57.634 INFO:teuthology.orchestra.run.smithi156.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-10T11:42:57.634 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-10T11:42:57.634 INFO:teuthology.orchestra.run.smithi156.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-10T11:42:57.635 INFO:teuthology.orchestra.run.smithi156.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-10T11:42:57.635 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-10T11:42:57.635 INFO:teuthology.orchestra.run.smithi156.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-10T11:42:57.635 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-10T11:42:57.636 INFO:teuthology.orchestra.run.smithi156.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-10T11:42:57.636 INFO:teuthology.orchestra.run.smithi156.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-10T11:42:57.636 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.636 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.637 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T11:42:57.637 INFO:teuthology.orchestra.run.smithi156.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-10T11:42:57.637 INFO:teuthology.orchestra.run.smithi156.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-10T11:42:57.637 INFO:teuthology.orchestra.run.smithi156.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-10T11:42:57.638 INFO:teuthology.orchestra.run.smithi156.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-08-10T11:42:57.638 INFO:teuthology.orchestra.run.smithi156.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-10T11:42:57.639 INFO:teuthology.orchestra.run.smithi156.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-08-10T11:42:57.639 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-08-10T11:42:57.639 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-08-10T11:42:57.841 DEBUG:teuthology.parallel:result is None 2023-08-10T11:42:57.842 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T11:42:57.986 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-10T11:42:58.014 INFO:teuthology.orchestra.run.smithi073.stdout:18.0.0-5118.ga8bf445f.el8 2023-08-10T11:42:58.015 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5118.ga8bf445f.el8 2023-08-10T11:42:58.015 INFO:teuthology.task.install:The correct ceph version 18.0.0-5118.ga8bf445f is installed. 2023-08-10T11:42:58.016 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T11:42:58.248 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-10T11:42:58.278 INFO:teuthology.orchestra.run.smithi152.stdout:18.0.0-5118.ga8bf445f.el8 2023-08-10T11:42:58.279 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5118.ga8bf445f.el8 2023-08-10T11:42:58.280 INFO:teuthology.task.install:The correct ceph version 18.0.0-5118.ga8bf445f is installed. 2023-08-10T11:42:58.281 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T11:42:58.511 DEBUG:teuthology.orchestra.run.smithi156:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-10T11:42:58.539 INFO:teuthology.orchestra.run.smithi156.stdout:18.0.0-5118.ga8bf445f.el8 2023-08-10T11:42:58.539 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5118.ga8bf445f.el8 2023-08-10T11:42:58.540 INFO:teuthology.task.install:The correct ceph version 18.0.0-5118.ga8bf445f is installed. 2023-08-10T11:42:58.540 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-08-10T11:42:58.540 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-08-10T11:42:58.541 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-10T11:42:58.588 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-08-10T11:42:58.588 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-10T11:42:58.636 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-08-10T11:42:58.637 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-10T11:42:58.683 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-08-10T11:42:58.683 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-08-10T11:42:58.683 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2023-08-10T11:42:58.713 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-10T11:42:58.784 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-08-10T11:42:58.784 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/daemon-helper 2023-08-10T11:42:58.815 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-10T11:42:58.884 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-08-10T11:42:58.885 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/daemon-helper 2023-08-10T11:42:58.915 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-10T11:42:58.984 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-08-10T11:42:58.984 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-08-10T11:42:58.985 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-10T11:42:59.014 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-10T11:42:59.082 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-08-10T11:42:59.083 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-10T11:42:59.113 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-10T11:42:59.182 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-08-10T11:42:59.182 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-10T11:42:59.212 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-10T11:42:59.281 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-08-10T11:42:59.281 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-08-10T11:42:59.282 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2023-08-10T11:42:59.311 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-10T11:42:59.381 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-08-10T11:42:59.382 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/stdin-killer 2023-08-10T11:42:59.410 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-10T11:42:59.479 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-08-10T11:42:59.480 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/stdin-killer 2023-08-10T11:42:59.510 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-10T11:42:59.580 INFO:teuthology.run_tasks:Running task cephadm... 2023-08-10T11:42:59.688 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2023-08-10T11:42:59.690 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T11:42:59.711 INFO:tasks.cephadm:Cluster fsid is 0e619a74-3773-11ee-9b37-001a4aab830c 2023-08-10T11:42:59.711 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-08-10T11:42:59.712 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.73', 'mon.b': '172.21.15.152', 'mon.c': '172.21.15.156'} 2023-08-10T11:42:59.712 INFO:tasks.cephadm:First mon is mon.a on smithi073 2023-08-10T11:42:59.712 INFO:tasks.cephadm:First mgr is x 2023-08-10T11:42:59.713 INFO:tasks.cephadm:Normalizing hostnames... 2023-08-10T11:42:59.713 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname $(hostname -s) 2023-08-10T11:42:59.746 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname $(hostname -s) 2023-08-10T11:42:59.776 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname $(hostname -s) 2023-08-10T11:42:59.809 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-08-10T11:42:59.810 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T11:42:59.974 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/71841/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-5118-ga8bf445f', 'node_name': '172.21.2.5+braggi05', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-5118.ga8bf445f'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-08-03 14:58:59.502988', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-2023Aug1-3', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2023-08-10T11:43:00.117 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-rishabh-2023Aug1-3, sha1 a8bf445f2d27d8e12e060dff0fd151d481b5290b from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T11:43:00.118 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/x86_64/flavors/default/cephadm 2023-08-10T11:43:00.118 DEBUG:teuthology.orchestra.run.smithi073:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-08-10T11:43:00.493 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-rw-r--. 1 ubuntu ubuntu 670007 Aug 10 11:43 /home/ubuntu/cephtest/cephadm 2023-08-10T11:43:00.494 DEBUG:teuthology.orchestra.run.smithi152:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-08-10T11:43:00.843 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-rw-r--. 1 ubuntu ubuntu 670007 Aug 10 11:43 /home/ubuntu/cephtest/cephadm 2023-08-10T11:43:00.844 DEBUG:teuthology.orchestra.run.smithi156:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-08-10T11:43:01.502 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-rw-r--. 1 ubuntu ubuntu 670007 Aug 10 11:43 /home/ubuntu/cephtest/cephadm 2023-08-10T11:43:01.503 DEBUG:teuthology.orchestra.run.smithi073:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-08-10T11:43:01.525 DEBUG:teuthology.orchestra.run.smithi152:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-08-10T11:43:01.547 DEBUG:teuthology.orchestra.run.smithi156:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-08-10T11:43:01.583 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b on all hosts... 2023-08-10T11:43:01.583 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b pull 2023-08-10T11:43:01.586 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b pull 2023-08-10T11:43:01.589 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b pull 2023-08-10T11:43:02.867 INFO:teuthology.orchestra.run.smithi152.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b... 2023-08-10T11:43:02.873 INFO:teuthology.orchestra.run.smithi073.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b... 2023-08-10T11:43:07.545 INFO:teuthology.orchestra.run.smithi156.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b... 2023-08-10T11:43:35.927 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2023-08-10T11:43:35.927 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_version": "ceph version 18.0.0-5118-ga8bf445f (a8bf445f2d27d8e12e060dff0fd151d481b5290b) reef (dev)", 2023-08-10T11:43:35.928 INFO:teuthology.orchestra.run.smithi156.stdout: "image_id": "97af32c09d742b2a6ea432ce98c21da04dbcc0be5a0d3cb00a27bd1a1d70a52e", 2023-08-10T11:43:35.928 INFO:teuthology.orchestra.run.smithi156.stdout: "repo_digests": [ 2023-08-10T11:43:35.928 INFO:teuthology.orchestra.run.smithi156.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ac5117ff7e66d24d9c7c962bd24dac658fc55abae75f6360257e176fd9162a06" 2023-08-10T11:43:35.928 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-08-10T11:43:35.928 INFO:teuthology.orchestra.run.smithi156.stdout:} 2023-08-10T11:43:40.104 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-08-10T11:43:40.104 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 18.0.0-5118-ga8bf445f (a8bf445f2d27d8e12e060dff0fd151d481b5290b) reef (dev)", 2023-08-10T11:43:40.104 INFO:teuthology.orchestra.run.smithi152.stdout: "image_id": "97af32c09d742b2a6ea432ce98c21da04dbcc0be5a0d3cb00a27bd1a1d70a52e", 2023-08-10T11:43:40.104 INFO:teuthology.orchestra.run.smithi152.stdout: "repo_digests": [ 2023-08-10T11:43:40.105 INFO:teuthology.orchestra.run.smithi152.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ac5117ff7e66d24d9c7c962bd24dac658fc55abae75f6360257e176fd9162a06" 2023-08-10T11:43:40.105 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2023-08-10T11:43:40.105 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-08-10T11:43:45.857 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:43:45.858 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 18.0.0-5118-ga8bf445f (a8bf445f2d27d8e12e060dff0fd151d481b5290b) reef (dev)", 2023-08-10T11:43:45.858 INFO:teuthology.orchestra.run.smithi073.stdout: "image_id": "97af32c09d742b2a6ea432ce98c21da04dbcc0be5a0d3cb00a27bd1a1d70a52e", 2023-08-10T11:43:45.858 INFO:teuthology.orchestra.run.smithi073.stdout: "repo_digests": [ 2023-08-10T11:43:45.858 INFO:teuthology.orchestra.run.smithi073.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ac5117ff7e66d24d9c7c962bd24dac658fc55abae75f6360257e176fd9162a06" 2023-08-10T11:43:45.858 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-08-10T11:43:45.858 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:43:45.877 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph 2023-08-10T11:43:45.906 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /etc/ceph 2023-08-10T11:43:45.943 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /etc/ceph 2023-08-10T11:43:45.980 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /etc/ceph 2023-08-10T11:43:46.006 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 777 /etc/ceph 2023-08-10T11:43:46.036 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 777 /etc/ceph 2023-08-10T11:43:46.065 INFO:tasks.cephadm:Writing seed config... 2023-08-10T11:43:46.066 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-08-10T11:43:46.067 INFO:tasks.cephadm: override: [client] debug client = 20 2023-08-10T11:43:46.067 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-08-10T11:43:46.067 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-08-10T11:43:46.067 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-08-10T11:43:46.068 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2023-08-10T11:43:46.068 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-08-10T11:43:46.068 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-08-10T11:43:46.068 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-08-10T11:43:46.068 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2023-08-10T11:43:46.069 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2023-08-10T11:43:46.069 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2023-08-10T11:43:46.069 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2023-08-10T11:43:46.069 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-08-10T11:43:46.069 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-08-10T11:43:46.070 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-08-10T11:43:46.070 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-08-10T11:43:46.070 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2023-08-10T11:43:46.070 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-08-10T11:43:46.070 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-08-10T11:43:46.071 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-08-10T11:43:46.071 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-08-10T11:43:46.071 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2023-08-10T11:43:46.071 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-08-10T11:43:46.071 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-08-10T11:43:46.072 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-08-10T11:43:46.072 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-08-10T11:43:46.072 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-08-10T11:43:46.072 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-08-10T11:43:46.072 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2023-08-10T11:43:46.073 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2023-08-10T11:43:46.073 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2023-08-10T11:43:46.073 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-08-10T11:43:46.074 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-08-10T11:43:46.074 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2023-08-10T11:43:46.074 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2023-08-10T11:43:46.074 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-08-10T11:43:46.074 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-08-10T11:43:46.075 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2023-08-10T11:43:46.075 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-08-10T11:43:46.075 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-08-10T11:43:46.075 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-08-10T11:43:46.075 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-08-10T11:43:46.076 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-08-10T11:43:46.076 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-08-10T11:43:46.076 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-08-10T11:43:46.076 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2023-08-10T11:43:46.077 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-08-10T11:43:46.077 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-08-10T11:43:46.094 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 0e619a74-3773-11ee-9b37-001a4aab830c ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-08-10T11:43:46.094 DEBUG:teuthology.orchestra.run.smithi073:mon.a> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@mon.a.service 2023-08-10T11:43:46.136 DEBUG:teuthology.orchestra.run.smithi073:mgr.x> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@mgr.x.service 2023-08-10T11:43:46.162 INFO:journalctl@ceph.mon.a.smithi073.stdout:-- Logs begin at Thu 2023-08-10 11:15:25 UTC. -- 2023-08-10T11:43:46.162 INFO:tasks.cephadm:Bootstrapping... 2023-08-10T11:43:46.163 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b -v bootstrap --fsid 0e619a74-3773-11ee-9b37-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.73 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-08-10T11:43:46.188 INFO:journalctl@ceph.mgr.x.smithi073.stdout:-- Logs begin at Thu 2023-08-10 11:15:25 UTC. -- 2023-08-10T11:43:46.319 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2023-08-10T11:43:46.320 INFO:teuthology.orchestra.run.smithi073.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b', '-v', 'bootstrap', '--fsid', '0e619a74-3773-11ee-9b37-001a4aab830c', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.73', '--skip-admin-label'] 2023-08-10T11:43:46.465 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stdout 4.1.1 2023-08-10T11:43:46.466 INFO:teuthology.orchestra.run.smithi073.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-08-10T11:43:46.466 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying podman|docker is present... 2023-08-10T11:43:46.611 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stdout 4.1.1 2023-08-10T11:43:46.612 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying lvm2 is present... 2023-08-10T11:43:46.612 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying time synchronization is in place... 2023-08-10T11:43:46.619 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-08-10T11:43:46.619 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-08-10T11:43:46.624 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-08-10T11:43:46.625 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout inactive 2023-08-10T11:43:46.630 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout enabled 2023-08-10T11:43:46.636 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout active 2023-08-10T11:43:46.636 INFO:teuthology.orchestra.run.smithi073.stdout:Unit chronyd.service is enabled and running 2023-08-10T11:43:46.636 INFO:teuthology.orchestra.run.smithi073.stdout:Repeating the final host check... 2023-08-10T11:43:46.782 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stdout 4.1.1 2023-08-10T11:43:46.782 INFO:teuthology.orchestra.run.smithi073.stdout:podman (/bin/podman) version 4.1.1 is present 2023-08-10T11:43:46.782 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl is present 2023-08-10T11:43:46.782 INFO:teuthology.orchestra.run.smithi073.stdout:lvcreate is present 2023-08-10T11:43:46.788 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-08-10T11:43:46.788 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-08-10T11:43:46.793 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-08-10T11:43:46.793 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout inactive 2023-08-10T11:43:46.799 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout enabled 2023-08-10T11:43:46.805 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout active 2023-08-10T11:43:46.805 INFO:teuthology.orchestra.run.smithi073.stdout:Unit chronyd.service is enabled and running 2023-08-10T11:43:46.805 INFO:teuthology.orchestra.run.smithi073.stdout:Host looks OK 2023-08-10T11:43:46.805 INFO:teuthology.orchestra.run.smithi073.stdout:Cluster fsid: 0e619a74-3773-11ee-9b37-001a4aab830c 2023-08-10T11:43:46.805 INFO:teuthology.orchestra.run.smithi073.stdout:Acquiring lock 140586089318888 on /run/cephadm/0e619a74-3773-11ee-9b37-001a4aab830c.lock 2023-08-10T11:43:46.806 INFO:teuthology.orchestra.run.smithi073.stdout:Lock 140586089318888 acquired on /run/cephadm/0e619a74-3773-11ee-9b37-001a4aab830c.lock 2023-08-10T11:43:46.806 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying IP 172.21.15.73 port 3300 ... 2023-08-10T11:43:46.806 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying IP 172.21.15.73 port 6789 ... 2023-08-10T11:43:46.806 INFO:teuthology.orchestra.run.smithi073.stdout:Base mon IP(s) is [172.21.15.73:3300, 172.21.15.73:6789], mon addrv is [v2:172.21.15.73:3300,v1:172.21.15.73:6789] 2023-08-10T11:43:46.809 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp metric 100 2023-08-10T11:43:46.809 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.73 metric 100 2023-08-10T11:43:46.812 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-08-10T11:43:46.812 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2023-08-10T11:43:46.812 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2023-08-10T11:43:46.814 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-08-10T11:43:46.814 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-08-10T11:43:46.814 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-08-10T11:43:46.815 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2023-08-10T11:43:46.815 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout inet6 fe80::c422:4ecc:c537:3a4c/64 scope link noprefixroute 2023-08-10T11:43:46.815 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-08-10T11:43:46.815 INFO:teuthology.orchestra.run.smithi073.stdout:Mon IP `172.21.15.73` is in CIDR network `172.21.0.0/20` 2023-08-10T11:43:46.816 INFO:teuthology.orchestra.run.smithi073.stdout:Mon IP `172.21.15.73` is in CIDR network `172.21.0.0/20` 2023-08-10T11:43:46.816 INFO:teuthology.orchestra.run.smithi073.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-08-10T11:43:46.816 INFO:teuthology.orchestra.run.smithi073.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-08-10T11:43:46.817 INFO:teuthology.orchestra.run.smithi073.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b... 2023-08-10T11:43:47.264 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stdout 97af32c09d742b2a6ea432ce98c21da04dbcc0be5a0d3cb00a27bd1a1d70a52e 2023-08-10T11:43:47.264 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b... 2023-08-10T11:43:47.264 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stderr Getting image source signatures 2023-08-10T11:43:47.265 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stderr Copying blob sha256:39d70b65b369c6d58e403c39285d11b8f4bfcaf0a5e142f386f4e8ab865f72a5 2023-08-10T11:43:47.265 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stderr Copying blob sha256:6022c611d474f2b306ddd1edfc8360123ece5266119096f25fde843d7967e636 2023-08-10T11:43:47.265 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stderr Copying config sha256:97af32c09d742b2a6ea432ce98c21da04dbcc0be5a0d3cb00a27bd1a1d70a52e 2023-08-10T11:43:47.265 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stderr Writing manifest to image destination 2023-08-10T11:43:47.265 INFO:teuthology.orchestra.run.smithi073.stdout:/bin/podman: stderr Storing signatures 2023-08-10T11:43:48.118 INFO:teuthology.orchestra.run.smithi073.stdout:ceph: stdout ceph version 18.0.0-5118-ga8bf445f (a8bf445f2d27d8e12e060dff0fd151d481b5290b) reef (dev) 2023-08-10T11:43:48.119 INFO:teuthology.orchestra.run.smithi073.stdout:Ceph version: ceph version 18.0.0-5118-ga8bf445f (a8bf445f2d27d8e12e060dff0fd151d481b5290b) reef (dev) 2023-08-10T11:43:48.119 INFO:teuthology.orchestra.run.smithi073.stdout:Extracting ceph user uid/gid from container image... 2023-08-10T11:43:48.765 INFO:teuthology.orchestra.run.smithi073.stdout:stat: stdout 167 167 2023-08-10T11:43:48.766 INFO:teuthology.orchestra.run.smithi073.stdout:Creating initial keys... 2023-08-10T11:43:49.513 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph-authtool: stdout AQB1zdRkg1IeBxAAw97T6l1TypJp5Mku2B+9hA== 2023-08-10T11:43:50.459 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph-authtool: stdout AQB2zdRkqgoaBxAABtgI2zBfL1hGDRphJWLNJw== 2023-08-10T11:43:51.310 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph-authtool: stdout AQB2zdRkHeVMMhAAJbWhbGAfaOYNh3APc2epQQ== 2023-08-10T11:43:51.311 INFO:teuthology.orchestra.run.smithi073.stdout:Creating initial monmap... 2023-08-10T11:43:52.056 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-08-10T11:43:52.056 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-08-10T11:43:52.056 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 0e619a74-3773-11ee-9b37-001a4aab830c 2023-08-10T11:43:52.057 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-08-10T11:43:52.057 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool for a [v2:172.21.15.73:3300,v1:172.21.15.73:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-08-10T11:43:52.057 INFO:teuthology.orchestra.run.smithi073.stdout:setting min_mon_release = pacific 2023-08-10T11:43:52.057 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/monmaptool: set fsid to 0e619a74-3773-11ee-9b37-001a4aab830c 2023-08-10T11:43:52.057 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-08-10T11:43:52.057 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:43:52.057 INFO:teuthology.orchestra.run.smithi073.stdout:Creating mon... 2023-08-10T11:43:52.807 INFO:teuthology.orchestra.run.smithi073.stdout:create mon.a on 2023-08-10T11:43:52.948 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-08-10T11:43:53.036 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-08-10T11:43:53.144 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-0e619a74-3773-11ee-9b37-001a4aab830c.target → /etc/systemd/system/ceph-0e619a74-3773-11ee-9b37-001a4aab830c.target. 2023-08-10T11:43:53.145 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-0e619a74-3773-11ee-9b37-001a4aab830c.target → /etc/systemd/system/ceph-0e619a74-3773-11ee-9b37-001a4aab830c.target. 2023-08-10T11:43:53.303 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-0e619a74-3773-11ee-9b37-001a4aab830c@mon.a 2023-08-10T11:43:53.304 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Failed to reset failed state of unit ceph-0e619a74-3773-11ee-9b37-001a4aab830c@mon.a.service: Unit ceph-0e619a74-3773-11ee-9b37-001a4aab830c@mon.a.service not loaded. 2023-08-10T11:43:53.391 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-0e619a74-3773-11ee-9b37-001a4aab830c.target.wants/ceph-0e619a74-3773-11ee-9b37-001a4aab830c@mon.a.service → /etc/systemd/system/ceph-0e619a74-3773-11ee-9b37-001a4aab830c@.service. 2023-08-10T11:43:53.401 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:53 smithi073 systemd[1]: Starting Ceph mon.a for 0e619a74-3773-11ee-9b37-001a4aab830c... 2023-08-10T11:43:53.977 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:53 smithi073 podman[128326]: 2023-08-10T11:43:53.977 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:53 smithi073 bash[128326]: 31149ea2bedc8779091ec1431bee3cf3c20f64f2fd801b06803c24850d5cb9b0 2023-08-10T11:43:53.998 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-08-10T11:43:53.998 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout disabled 2023-08-10T11:43:54.005 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-08-10T11:43:54.005 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout inactive 2023-08-10T11:43:54.005 INFO:teuthology.orchestra.run.smithi073.stdout:firewalld.service is not enabled 2023-08-10T11:43:54.006 INFO:teuthology.orchestra.run.smithi073.stdout:Not possible to enable service . firewalld.service is not available 2023-08-10T11:43:54.006 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for mon to start... 2023-08-10T11:43:54.006 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for mon... 2023-08-10T11:43:54.256 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:53 smithi073 ceph-mon[128366]: mkfs 0e619a74-3773-11ee-9b37-001a4aab830c 2023-08-10T11:43:54.256 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:53 smithi073 ceph-mon[128366]: mon.a is new leader, mons a in quorum (ranks 0) 2023-08-10T11:43:54.256 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:53 smithi073 systemd[1]: Started Ceph mon.a for 0e619a74-3773-11ee-9b37-001a4aab830c. 2023-08-10T11:43:54.957 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout cluster: 2023-08-10T11:43:54.957 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout id: 0e619a74-3773-11ee-9b37-001a4aab830c 2023-08-10T11:43:54.957 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-08-10T11:43:54.958 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2023-08-10T11:43:54.958 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout services: 2023-08-10T11:43:54.958 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.610977s) 2023-08-10T11:43:54.958 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-08-10T11:43:54.958 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-08-10T11:43:54.958 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2023-08-10T11:43:54.958 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout data: 2023-08-10T11:43:54.958 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-08-10T11:43:54.959 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-08-10T11:43:54.959 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-08-10T11:43:54.959 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout pgs: 2023-08-10T11:43:54.959 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2023-08-10T11:43:54.959 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.507+0000 7f3e95174700 1 Processor -- start 2023-08-10T11:43:54.959 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.507+0000 7f3e95174700 1 -- start start 2023-08-10T11:43:54.959 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.507+0000 7f3e95174700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e90105100 0x7f3e90105520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:43:54.960 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.507+0000 7f3e95174700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e90105af0 con 0x7f3e90105100 2023-08-10T11:43:54.960 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.507+0000 7f3e8ed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e90105100 0x7f3e90105520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:43:54.960 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.507+0000 7f3e8ed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e90105100 0x7f3e90105520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57588/0 (socket says 172.21.15.73:57588) 2023-08-10T11:43:54.960 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.507+0000 7f3e8ed9d700 1 -- 172.21.15.73:0/3185611392 learned_addr learned my addr 172.21.15.73:0/3185611392 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:43:54.960 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.508+0000 7f3e8ed9d700 1 -- 172.21.15.73:0/3185611392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e90106300 con 0x7f3e90105100 2023-08-10T11:43:54.960 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.508+0000 7f3e8ed9d700 1 --2- 172.21.15.73:0/3185611392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e90105100 0x7f3e90105520 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3e840098a0 tx=0x7f3e84009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb07d3bc51d092c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:43:54.960 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.508+0000 7f3e8dd9b700 1 -- 172.21.15.73:0/3185611392 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e84004160 con 0x7f3e90105100 2023-08-10T11:43:54.960 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.508+0000 7f3e8dd9b700 1 -- 172.21.15.73:0/3185611392 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e840042c0 con 0x7f3e90105100 2023-08-10T11:43:54.961 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.508+0000 7f3e8dd9b700 1 -- 172.21.15.73:0/3185611392 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e840045a0 con 0x7f3e90105100 2023-08-10T11:43:54.961 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.508+0000 7f3e95174700 1 -- 172.21.15.73:0/3185611392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e90105100 msgr2=0x7f3e90105520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:43:54.961 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.508+0000 7f3e95174700 1 --2- 172.21.15.73:0/3185611392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e90105100 0x7f3e90105520 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3e840098a0 tx=0x7f3e84009bb0 comp rx=0 tx=0).stop 2023-08-10T11:43:54.961 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.508+0000 7f3e95174700 1 -- 172.21.15.73:0/3185611392 shutdown_connections 2023-08-10T11:43:54.961 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.508+0000 7f3e95174700 1 --2- 172.21.15.73:0/3185611392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e90105100 0x7f3e90105520 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:43:54.961 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.508+0000 7f3e95174700 1 -- 172.21.15.73:0/3185611392 >> 172.21.15.73:0/3185611392 conn(0x7f3e90100680 msgr2=0x7f3e90102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:43:54.961 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.508+0000 7f3e95174700 1 -- 172.21.15.73:0/3185611392 shutdown_connections 2023-08-10T11:43:54.962 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.508+0000 7f3e95174700 1 -- 172.21.15.73:0/3185611392 wait complete. 2023-08-10T11:43:54.962 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.509+0000 7f3e95174700 1 Processor -- start 2023-08-10T11:43:54.962 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.510+0000 7f3e95174700 1 -- start start 2023-08-10T11:43:54.962 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.510+0000 7f3e95174700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e90105100 0x7f3e901996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:43:54.962 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.510+0000 7f3e95174700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e90199c10 con 0x7f3e90105100 2023-08-10T11:43:54.962 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.510+0000 7f3e8ed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e90105100 0x7f3e901996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:43:54.962 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.510+0000 7f3e8ed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e90105100 0x7f3e901996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57590/0 (socket says 172.21.15.73:57590) 2023-08-10T11:43:54.962 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.510+0000 7f3e8ed9d700 1 -- 172.21.15.73:0/2090601815 learned_addr learned my addr 172.21.15.73:0/2090601815 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:43:54.963 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.510+0000 7f3e8ed9d700 1 -- 172.21.15.73:0/2090601815 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e84009550 con 0x7f3e90105100 2023-08-10T11:43:54.963 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.510+0000 7f3e8ed9d700 1 --2- 172.21.15.73:0/2090601815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e90105100 0x7f3e901996d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3e84004000 tx=0x7f3e84004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:43:54.963 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.510+0000 7f3e77fff700 1 -- 172.21.15.73:0/2090601815 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e84011630 con 0x7f3e90105100 2023-08-10T11:43:54.963 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.510+0000 7f3e77fff700 1 -- 172.21.15.73:0/2090601815 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e84011790 con 0x7f3e90105100 2023-08-10T11:43:54.963 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.510+0000 7f3e95174700 1 -- 172.21.15.73:0/2090601815 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e90199e10 con 0x7f3e90105100 2023-08-10T11:43:54.963 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.510+0000 7f3e77fff700 1 -- 172.21.15.73:0/2090601815 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e84011a30 con 0x7f3e90105100 2023-08-10T11:43:54.963 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.510+0000 7f3e95174700 1 -- 172.21.15.73:0/2090601815 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e9019a230 con 0x7f3e90105100 2023-08-10T11:43:54.963 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.511+0000 7f3e77fff700 1 -- 172.21.15.73:0/2090601815 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3e84022070 con 0x7f3e90105100 2023-08-10T11:43:54.964 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.511+0000 7f3e77fff700 1 -- 172.21.15.73:0/2090601815 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3e8401c450 con 0x7f3e90105100 2023-08-10T11:43:54.964 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.511+0000 7f3e95174700 1 -- 172.21.15.73:0/2090601815 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e90192fa0 con 0x7f3e90105100 2023-08-10T11:43:54.964 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.514+0000 7f3e77fff700 1 -- 172.21.15.73:0/2090601815 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f3e8401b450 con 0x7f3e90105100 2023-08-10T11:43:54.964 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.583+0000 7f3e95174700 1 -- 172.21.15.73:0/2090601815 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f3e90061380 con 0x7f3e90105100 2023-08-10T11:43:54.964 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.583+0000 7f3e77fff700 1 -- 172.21.15.73:0/2090601815 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f3e8401b5f0 con 0x7f3e90105100 2023-08-10T11:43:54.964 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.584+0000 7f3e95174700 1 -- 172.21.15.73:0/2090601815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e90105100 msgr2=0x7f3e901996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:43:54.964 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.584+0000 7f3e95174700 1 --2- 172.21.15.73:0/2090601815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e90105100 0x7f3e901996d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3e84004000 tx=0x7f3e84004750 comp rx=0 tx=0).stop 2023-08-10T11:43:54.965 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.584+0000 7f3e95174700 1 -- 172.21.15.73:0/2090601815 shutdown_connections 2023-08-10T11:43:54.965 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.584+0000 7f3e95174700 1 --2- 172.21.15.73:0/2090601815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e90105100 0x7f3e901996d0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:43:54.965 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.584+0000 7f3e95174700 1 -- 172.21.15.73:0/2090601815 >> 172.21.15.73:0/2090601815 conn(0x7f3e90100680 msgr2=0x7f3e90073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:43:54.965 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.584+0000 7f3e95174700 1 -- 172.21.15.73:0/2090601815 shutdown_connections 2023-08-10T11:43:54.965 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:54.584+0000 7f3e95174700 1 -- 172.21.15.73:0/2090601815 wait complete. 2023-08-10T11:43:54.965 INFO:teuthology.orchestra.run.smithi073.stdout:mon is available 2023-08-10T11:43:54.965 INFO:teuthology.orchestra.run.smithi073.stdout:Assimilating anything we can from ceph.conf... 2023-08-10T11:43:55.201 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:54 smithi073 ceph-mon[128366]: mon.a is new leader, mons a in quorum (ranks 0) 2023-08-10T11:43:55.201 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:54 smithi073 ceph-mon[128366]: monmap e1: 1 mons at {a=[v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0]} removed_ranks: {} 2023-08-10T11:43:55.201 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:54 smithi073 ceph-mon[128366]: fsmap 2023-08-10T11:43:55.201 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:54 smithi073 ceph-mon[128366]: osdmap e1: 0 total, 0 up, 0 in 2023-08-10T11:43:55.202 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:54 smithi073 ceph-mon[128366]: mgrmap e1: no daemons active 2023-08-10T11:43:55.202 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:54 smithi073 ceph-mon[128366]: from='client.? 172.21.15.73:0/2090601815' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-08-10T11:43:55.900 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2023-08-10T11:43:55.900 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout [global] 2023-08-10T11:43:55.900 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout fsid = 0e619a74-3773-11ee-9b37-001a4aab830c 2023-08-10T11:43:55.901 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.73:3300,v1:172.21.15.73:6789] 2023-08-10T11:43:55.901 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-08-10T11:43:55.901 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-08-10T11:43:55.901 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-08-10T11:43:55.901 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-08-10T11:43:55.901 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2023-08-10T11:43:55.901 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout [mgr] 2023-08-10T11:43:55.902 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-08-10T11:43:55.902 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2023-08-10T11:43:55.902 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout [osd] 2023-08-10T11:43:55.902 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-08-10T11:43:55.902 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-08-10T11:43:55.902 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-08-10T11:43:55.902 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-08-10T11:43:55.902 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-08-10T11:43:55.903 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.413+0000 7f932cfe3700 1 Processor -- start 2023-08-10T11:43:55.903 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.413+0000 7f932cfe3700 1 -- start start 2023-08-10T11:43:55.903 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.414+0000 7f932cfe3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9328106cb0 0x7f93281090a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:43:55.903 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.414+0000 7f932cfe3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9328073f70 con 0x7f9328106cb0 2023-08-10T11:43:55.903 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.414+0000 7f932659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9328106cb0 0x7f93281090a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:43:55.903 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.414+0000 7f932659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9328106cb0 0x7f93281090a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57592/0 (socket says 172.21.15.73:57592) 2023-08-10T11:43:55.903 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.414+0000 7f932659c700 1 -- 172.21.15.73:0/2403800587 learned_addr learned my addr 172.21.15.73:0/2403800587 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:43:55.904 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.414+0000 7f932659c700 1 -- 172.21.15.73:0/2403800587 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93281095e0 con 0x7f9328106cb0 2023-08-10T11:43:55.904 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.414+0000 7f932659c700 1 --2- 172.21.15.73:0/2403800587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9328106cb0 0x7f93281090a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f931c0098a0 tx=0x7f931c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9153fad0fba1d407 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:43:55.904 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.415+0000 7f932559a700 1 -- 172.21.15.73:0/2403800587 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f931c004160 con 0x7f9328106cb0 2023-08-10T11:43:55.904 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.415+0000 7f932559a700 1 -- 172.21.15.73:0/2403800587 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931c0042c0 con 0x7f9328106cb0 2023-08-10T11:43:55.904 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.415+0000 7f932559a700 1 -- 172.21.15.73:0/2403800587 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f931c0045a0 con 0x7f9328106cb0 2023-08-10T11:43:55.904 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.415+0000 7f932cfe3700 1 -- 172.21.15.73:0/2403800587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9328106cb0 msgr2=0x7f93281090a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:43:55.904 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.415+0000 7f932cfe3700 1 --2- 172.21.15.73:0/2403800587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9328106cb0 0x7f93281090a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f931c0098a0 tx=0x7f931c009bb0 comp rx=0 tx=0).stop 2023-08-10T11:43:55.904 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.415+0000 7f932cfe3700 1 -- 172.21.15.73:0/2403800587 shutdown_connections 2023-08-10T11:43:55.905 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.415+0000 7f932cfe3700 1 --2- 172.21.15.73:0/2403800587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9328106cb0 0x7f93281090a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:43:55.905 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.415+0000 7f932cfe3700 1 -- 172.21.15.73:0/2403800587 >> 172.21.15.73:0/2403800587 conn(0x7f9328100680 msgr2=0x7f9328102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:43:55.905 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.415+0000 7f932cfe3700 1 -- 172.21.15.73:0/2403800587 shutdown_connections 2023-08-10T11:43:55.905 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.415+0000 7f932cfe3700 1 -- 172.21.15.73:0/2403800587 wait complete. 2023-08-10T11:43:55.905 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.416+0000 7f932cfe3700 1 Processor -- start 2023-08-10T11:43:55.905 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.416+0000 7f932cfe3700 1 -- start start 2023-08-10T11:43:55.905 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.417+0000 7f932cfe3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9328106cb0 0x7f93281996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:43:55.906 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.417+0000 7f932cfe3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9328199be0 con 0x7f9328106cb0 2023-08-10T11:43:55.906 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.417+0000 7f932659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9328106cb0 0x7f93281996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:43:55.906 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.417+0000 7f932659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9328106cb0 0x7f93281996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57594/0 (socket says 172.21.15.73:57594) 2023-08-10T11:43:55.906 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.417+0000 7f932659c700 1 -- 172.21.15.73:0/3744154373 learned_addr learned my addr 172.21.15.73:0/3744154373 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:43:55.906 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.417+0000 7f932659c700 1 -- 172.21.15.73:0/3744154373 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931c009550 con 0x7f9328106cb0 2023-08-10T11:43:55.906 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.417+0000 7f932659c700 1 --2- 172.21.15.73:0/3744154373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9328106cb0 0x7f93281996a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f93280733b0 tx=0x7f931c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:43:55.906 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.417+0000 7f93177fe700 1 -- 172.21.15.73:0/3744154373 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f931c011630 con 0x7f9328106cb0 2023-08-10T11:43:55.906 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.417+0000 7f93177fe700 1 -- 172.21.15.73:0/3744154373 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931c011790 con 0x7f9328106cb0 2023-08-10T11:43:55.907 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.417+0000 7f932cfe3700 1 -- 172.21.15.73:0/3744154373 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9328199de0 con 0x7f9328106cb0 2023-08-10T11:43:55.907 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.417+0000 7f93177fe700 1 -- 172.21.15.73:0/3744154373 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f931c011a30 con 0x7f9328106cb0 2023-08-10T11:43:55.907 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.417+0000 7f932cfe3700 1 -- 172.21.15.73:0/3744154373 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932819a200 con 0x7f9328106cb0 2023-08-10T11:43:55.907 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.417+0000 7f93177fe700 1 -- 172.21.15.73:0/3744154373 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f931c022070 con 0x7f9328106cb0 2023-08-10T11:43:55.907 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.418+0000 7f93177fe700 1 -- 172.21.15.73:0/3744154373 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f931c01c450 con 0x7f9328106cb0 2023-08-10T11:43:55.907 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.418+0000 7f932cfe3700 1 -- 172.21.15.73:0/3744154373 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9328193500 con 0x7f9328106cb0 2023-08-10T11:43:55.907 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.420+0000 7f93177fe700 1 -- 172.21.15.73:0/3744154373 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f931c01b450 con 0x7f9328106cb0 2023-08-10T11:43:55.908 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.487+0000 7f932cfe3700 1 -- 172.21.15.73:0/3744154373 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f932802cb00 con 0x7f9328106cb0 2023-08-10T11:43:55.908 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.490+0000 7f93177fe700 1 -- 172.21.15.73:0/3744154373 <== mon.0 v2:172.21.15.73:3300/0 7 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f931c01b5f0 con 0x7f9328106cb0 2023-08-10T11:43:55.908 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.490+0000 7f93177fe700 1 -- 172.21.15.73:0/3744154373 <== mon.0 v2:172.21.15.73:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f931c0375f0 con 0x7f9328106cb0 2023-08-10T11:43:55.908 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.491+0000 7f932cfe3700 1 -- 172.21.15.73:0/3744154373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9328106cb0 msgr2=0x7f93281996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:43:55.908 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.491+0000 7f932cfe3700 1 --2- 172.21.15.73:0/3744154373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9328106cb0 0x7f93281996a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f93280733b0 tx=0x7f931c004750 comp rx=0 tx=0).stop 2023-08-10T11:43:55.908 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.491+0000 7f932cfe3700 1 -- 172.21.15.73:0/3744154373 shutdown_connections 2023-08-10T11:43:55.908 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.491+0000 7f932cfe3700 1 --2- 172.21.15.73:0/3744154373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9328106cb0 0x7f93281996a0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:43:55.908 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.491+0000 7f932cfe3700 1 -- 172.21.15.73:0/3744154373 >> 172.21.15.73:0/3744154373 conn(0x7f9328100680 msgr2=0x7f9328101fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:43:55.909 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.491+0000 7f932cfe3700 1 -- 172.21.15.73:0/3744154373 shutdown_connections 2023-08-10T11:43:55.909 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:55.491+0000 7f932cfe3700 1 -- 172.21.15.73:0/3744154373 wait complete. 2023-08-10T11:43:55.909 INFO:teuthology.orchestra.run.smithi073.stdout:Generating new minimal ceph.conf... 2023-08-10T11:43:56.118 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:55 smithi073 ceph-mon[128366]: from='client.? 172.21.15.73:0/3744154373' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-08-10T11:43:56.118 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:55 smithi073 ceph-mon[128366]: from='client.? 172.21.15.73:0/3744154373' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-08-10T11:43:56.842 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.379+0000 7fd1f528f700 1 Processor -- start 2023-08-10T11:43:56.842 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.379+0000 7fd1f528f700 1 -- start start 2023-08-10T11:43:56.843 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.380+0000 7fd1f528f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f0104500 0x7fd1f0104920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:43:56.843 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.380+0000 7fd1f528f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f0104ef0 con 0x7fd1f0104500 2023-08-10T11:43:56.843 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.380+0000 7fd1eeffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f0104500 0x7fd1f0104920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:43:56.843 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.380+0000 7fd1eeffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f0104500 0x7fd1f0104920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57596/0 (socket says 172.21.15.73:57596) 2023-08-10T11:43:56.843 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.380+0000 7fd1eeffd700 1 -- 172.21.15.73:0/1907084737 learned_addr learned my addr 172.21.15.73:0/1907084737 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:43:56.843 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.380+0000 7fd1eeffd700 1 -- 172.21.15.73:0/1907084737 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f0107490 con 0x7fd1f0104500 2023-08-10T11:43:56.843 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.380+0000 7fd1eeffd700 1 --2- 172.21.15.73:0/1907084737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f0104500 0x7fd1f0104920 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd1d80098a0 tx=0x7fd1d8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7b4b9bf15780b2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:43:56.844 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.380+0000 7fd1edffb700 1 -- 172.21.15.73:0/1907084737 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1d8004160 con 0x7fd1f0104500 2023-08-10T11:43:56.844 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.381+0000 7fd1edffb700 1 -- 172.21.15.73:0/1907084737 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd1d80042c0 con 0x7fd1f0104500 2023-08-10T11:43:56.844 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.381+0000 7fd1edffb700 1 -- 172.21.15.73:0/1907084737 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1d8011a00 con 0x7fd1f0104500 2023-08-10T11:43:56.844 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.381+0000 7fd1f528f700 1 -- 172.21.15.73:0/1907084737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f0104500 msgr2=0x7fd1f0104920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:43:56.844 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.381+0000 7fd1f528f700 1 --2- 172.21.15.73:0/1907084737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f0104500 0x7fd1f0104920 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd1d80098a0 tx=0x7fd1d8009bb0 comp rx=0 tx=0).stop 2023-08-10T11:43:56.844 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.381+0000 7fd1f528f700 1 -- 172.21.15.73:0/1907084737 shutdown_connections 2023-08-10T11:43:56.844 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.381+0000 7fd1f528f700 1 --2- 172.21.15.73:0/1907084737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f0104500 0x7fd1f0104920 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:43:56.845 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.381+0000 7fd1f528f700 1 -- 172.21.15.73:0/1907084737 >> 172.21.15.73:0/1907084737 conn(0x7fd1f00ffe10 msgr2=0x7fd1f0102270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:43:56.845 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.381+0000 7fd1f528f700 1 -- 172.21.15.73:0/1907084737 shutdown_connections 2023-08-10T11:43:56.845 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.381+0000 7fd1f528f700 1 -- 172.21.15.73:0/1907084737 wait complete. 2023-08-10T11:43:56.845 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.382+0000 7fd1f528f700 1 Processor -- start 2023-08-10T11:43:56.845 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.382+0000 7fd1f528f700 1 -- start start 2023-08-10T11:43:56.845 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.382+0000 7fd1f528f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f0104500 0x7fd1f019c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:43:56.845 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.382+0000 7fd1f528f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f019c690 con 0x7fd1f0104500 2023-08-10T11:43:56.846 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.382+0000 7fd1eeffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f0104500 0x7fd1f019c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:43:56.846 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.382+0000 7fd1eeffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f0104500 0x7fd1f019c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57598/0 (socket says 172.21.15.73:57598) 2023-08-10T11:43:56.846 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.382+0000 7fd1eeffd700 1 -- 172.21.15.73:0/3383662634 learned_addr learned my addr 172.21.15.73:0/3383662634 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:43:56.846 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.382+0000 7fd1eeffd700 1 -- 172.21.15.73:0/3383662634 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d8009550 con 0x7fd1f0104500 2023-08-10T11:43:56.846 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.382+0000 7fd1eeffd700 1 --2- 172.21.15.73:0/3383662634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f0104500 0x7fd1f019c150 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8009fb0 tx=0x7fd1d8011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:43:56.846 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.383+0000 7fd1e7fff700 1 -- 172.21.15.73:0/3383662634 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1d8003a40 con 0x7fd1f0104500 2023-08-10T11:43:56.846 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.383+0000 7fd1f528f700 1 -- 172.21.15.73:0/3383662634 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f019c890 con 0x7fd1f0104500 2023-08-10T11:43:56.846 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.383+0000 7fd1e7fff700 1 -- 172.21.15.73:0/3383662634 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd1d8003ba0 con 0x7fd1f0104500 2023-08-10T11:43:56.847 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.383+0000 7fd1e7fff700 1 -- 172.21.15.73:0/3383662634 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1d801a750 con 0x7fd1f0104500 2023-08-10T11:43:56.847 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.383+0000 7fd1f528f700 1 -- 172.21.15.73:0/3383662634 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f019ccb0 con 0x7fd1f0104500 2023-08-10T11:43:56.847 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.383+0000 7fd1e7fff700 1 -- 172.21.15.73:0/3383662634 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd1d801acd0 con 0x7fd1f0104500 2023-08-10T11:43:56.847 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.383+0000 7fd1e7fff700 1 -- 172.21.15.73:0/3383662634 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd1d80193c0 con 0x7fd1f0104500 2023-08-10T11:43:56.847 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.384+0000 7fd1f528f700 1 -- 172.21.15.73:0/3383662634 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f0061da0 con 0x7fd1f0104500 2023-08-10T11:43:56.847 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.386+0000 7fd1e7fff700 1 -- 172.21.15.73:0/3383662634 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fd1d802de40 con 0x7fd1f0104500 2023-08-10T11:43:56.847 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.452+0000 7fd1f528f700 1 -- 172.21.15.73:0/3383662634 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fd1f010a680 con 0x7fd1f0104500 2023-08-10T11:43:56.848 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.453+0000 7fd1e7fff700 1 -- 172.21.15.73:0/3383662634 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7fd1d8024b60 con 0x7fd1f0104500 2023-08-10T11:43:56.848 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.453+0000 7fd1f528f700 1 -- 172.21.15.73:0/3383662634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f0104500 msgr2=0x7fd1f019c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:43:56.848 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.453+0000 7fd1f528f700 1 --2- 172.21.15.73:0/3383662634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f0104500 0x7fd1f019c150 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8009fb0 tx=0x7fd1d8011ad0 comp rx=0 tx=0).stop 2023-08-10T11:43:56.848 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.453+0000 7fd1f528f700 1 -- 172.21.15.73:0/3383662634 shutdown_connections 2023-08-10T11:43:56.848 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.453+0000 7fd1f528f700 1 --2- 172.21.15.73:0/3383662634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1f0104500 0x7fd1f019c150 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:43:56.848 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.453+0000 7fd1f528f700 1 -- 172.21.15.73:0/3383662634 >> 172.21.15.73:0/3383662634 conn(0x7fd1f00ffe10 msgr2=0x7fd1f0101510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:43:56.848 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.453+0000 7fd1f528f700 1 -- 172.21.15.73:0/3383662634 shutdown_connections 2023-08-10T11:43:56.849 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:56.454+0000 7fd1f528f700 1 -- 172.21.15.73:0/3383662634 wait complete. 2023-08-10T11:43:56.849 INFO:teuthology.orchestra.run.smithi073.stdout:Restarting the monitor... 2023-08-10T11:43:57.200 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:56 smithi073 systemd[1]: Stopping Ceph mon.a for 0e619a74-3773-11ee-9b37-001a4aab830c... 2023-08-10T11:43:57.200 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:56 smithi073 ceph-mon[128366]: from='client.? 172.21.15.73:0/3383662634' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:43:57.496 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:57 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mon-a[128342]: 2023-08-10T11:43:57.198+0000 7f965fabd700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:43:57.496 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:57 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mon-a[128342]: 2023-08-10T11:43:57.198+0000 7f965fabd700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-08-10T11:43:57.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:57 smithi073 bash[128705]: ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mon-a 2023-08-10T11:43:58.206 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:57 smithi073 systemd[1]: ceph-0e619a74-3773-11ee-9b37-001a4aab830c@mon.a.service: Succeeded. 2023-08-10T11:43:58.206 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:57 smithi073 systemd[1]: Stopped Ceph mon.a for 0e619a74-3773-11ee-9b37-001a4aab830c. 2023-08-10T11:43:58.206 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:57 smithi073 systemd[1]: Starting Ceph mon.a for 0e619a74-3773-11ee-9b37-001a4aab830c... 2023-08-10T11:43:58.400 INFO:teuthology.orchestra.run.smithi073.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2023-08-10T11:43:58.467 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 podman[128829]: 2023-08-10T11:43:58.468 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: set uid:gid to 167:167 (ceph:ceph) 2023-08-10T11:43:58.468 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: ceph version 18.0.0-5118-ga8bf445f (a8bf445f2d27d8e12e060dff0fd151d481b5290b) reef (dev), process ceph-mon, pid 7 2023-08-10T11:43:58.468 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: pidfile_write: ignore empty --pid-file 2023-08-10T11:43:58.468 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 bash[128829]: ab60269aff983ebba610a97626112f0f9a8626b4a9cda3e8d4eabe328912cbd9 2023-08-10T11:43:58.468 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: load: jerasure load: lrc 2023-08-10T11:43:58.468 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: RocksDB version: 7.9.2 2023-08-10T11:43:58.468 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Git sha 0 2023-08-10T11:43:58.469 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Compile date 2023-08-03 13:43:35 2023-08-10T11:43:58.469 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: DB SUMMARY 2023-08-10T11:43:58.469 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: DB Session ID: R5NEM1JCH7I9XAP484EN 2023-08-10T11:43:58.469 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: CURRENT file: CURRENT 2023-08-10T11:43:58.469 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: IDENTITY file: IDENTITY 2023-08-10T11:43:58.469 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-08-10T11:43:58.469 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-08-10T11:43:58.469 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 100055 ; 2023-08-10T11:43:58.470 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.error_if_exists: 0 2023-08-10T11:43:58.470 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.create_if_missing: 0 2023-08-10T11:43:58.470 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.paranoid_checks: 1 2023-08-10T11:43:58.470 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.flush_verify_memtable_count: 1 2023-08-10T11:43:58.470 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-08-10T11:43:58.470 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-08-10T11:43:58.470 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.env: 0x55c7d0a1bc60 2023-08-10T11:43:58.471 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.fs: PosixFileSystem 2023-08-10T11:43:58.471 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.info_log: 0x55c7d2bfd2c0 2023-08-10T11:43:58.471 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.max_file_opening_threads: 16 2023-08-10T11:43:58.471 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.statistics: (nil) 2023-08-10T11:43:58.471 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.use_fsync: 0 2023-08-10T11:43:58.471 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.max_log_file_size: 0 2023-08-10T11:43:58.471 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-08-10T11:43:58.471 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.log_file_time_to_roll: 0 2023-08-10T11:43:58.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.keep_log_file_num: 1000 2023-08-10T11:43:58.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.recycle_log_file_num: 0 2023-08-10T11:43:58.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.allow_fallocate: 1 2023-08-10T11:43:58.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.allow_mmap_reads: 0 2023-08-10T11:43:58.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.allow_mmap_writes: 0 2023-08-10T11:43:58.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.use_direct_reads: 0 2023-08-10T11:43:58.472 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-08-10T11:43:58.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.create_missing_column_families: 0 2023-08-10T11:43:58.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.db_log_dir: 2023-08-10T11:43:58.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.wal_dir: 2023-08-10T11:43:58.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.table_cache_numshardbits: 6 2023-08-10T11:43:58.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.WAL_ttl_seconds: 0 2023-08-10T11:43:58.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.WAL_size_limit_MB: 0 2023-08-10T11:43:58.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-08-10T11:43:58.473 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-08-10T11:43:58.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.is_fd_close_on_exec: 1 2023-08-10T11:43:58.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.advise_random_on_open: 1 2023-08-10T11:43:58.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.db_write_buffer_size: 0 2023-08-10T11:43:58.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.write_buffer_manager: 0x55c7d2b1e3c0 2023-08-10T11:43:58.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-08-10T11:43:58.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-08-10T11:43:58.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.use_adaptive_mutex: 0 2023-08-10T11:43:58.474 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.rate_limiter: (nil) 2023-08-10T11:43:58.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-08-10T11:43:58.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.wal_recovery_mode: 2 2023-08-10T11:43:58.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.enable_thread_tracking: 0 2023-08-10T11:43:58.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.enable_pipelined_write: 0 2023-08-10T11:43:58.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.unordered_write: 0 2023-08-10T11:43:58.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-08-10T11:43:58.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-08-10T11:43:58.475 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-08-10T11:43:58.476 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-08-10T11:43:58.476 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.row_cache: None 2023-08-10T11:43:58.476 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.wal_filter: None 2023-08-10T11:43:58.476 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-08-10T11:43:58.476 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.allow_ingest_behind: 0 2023-08-10T11:43:58.476 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.two_write_queues: 0 2023-08-10T11:43:58.476 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.manual_wal_flush: 0 2023-08-10T11:43:58.477 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.wal_compression: 0 2023-08-10T11:43:58.477 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.atomic_flush: 0 2023-08-10T11:43:58.477 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-08-10T11:43:58.477 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.persist_stats_to_disk: 0 2023-08-10T11:43:58.477 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.write_dbid_to_manifest: 0 2023-08-10T11:43:58.477 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.log_readahead_size: 0 2023-08-10T11:43:58.477 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-08-10T11:43:58.477 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.best_efforts_recovery: 0 2023-08-10T11:43:58.478 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-08-10T11:43:58.478 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-08-10T11:43:58.478 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.allow_data_in_errors: 0 2023-08-10T11:43:58.478 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.db_host_id: __hostname__ 2023-08-10T11:43:58.478 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.enforce_single_del_contracts: true 2023-08-10T11:43:58.478 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.max_background_jobs: 2 2023-08-10T11:43:58.478 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.max_background_compactions: -1 2023-08-10T11:43:58.478 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.max_subcompactions: 1 2023-08-10T11:43:58.479 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-08-10T11:43:58.479 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-08-10T11:43:58.479 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.delayed_write_rate : 16777216 2023-08-10T11:43:58.479 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.max_total_wal_size: 0 2023-08-10T11:43:58.479 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-08-10T11:43:58.479 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.stats_dump_period_sec: 600 2023-08-10T11:43:58.479 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.stats_persist_period_sec: 600 2023-08-10T11:43:58.479 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-08-10T11:43:58.480 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.max_open_files: -1 2023-08-10T11:43:58.480 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.bytes_per_sync: 0 2023-08-10T11:43:58.480 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.wal_bytes_per_sync: 0 2023-08-10T11:43:58.480 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.strict_bytes_per_sync: 0 2023-08-10T11:43:58.480 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.compaction_readahead_size: 0 2023-08-10T11:43:58.480 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.max_background_flushes: -1 2023-08-10T11:43:58.480 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Compression algorithms supported: 2023-08-10T11:43:58.481 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-08-10T11:43:58.481 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: kZSTD supported: 0 2023-08-10T11:43:58.481 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: kXpressCompression supported: 0 2023-08-10T11:43:58.481 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: kLZ4HCCompression supported: 1 2023-08-10T11:43:58.481 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: kZlibCompression supported: 1 2023-08-10T11:43:58.481 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: kSnappyCompression supported: 1 2023-08-10T11:43:58.481 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: kLZ4Compression supported: 1 2023-08-10T11:43:58.481 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: kBZip2Compression supported: 0 2023-08-10T11:43:58.482 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Fast CRC32 supported: Supported on x86 2023-08-10T11:43:58.482 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: DMutex implementation: pthread_mutex_t 2023-08-10T11:43:58.482 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-08-10T11:43:58.482 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-08-10T11:43:58.482 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-08-10T11:43:58.482 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.merge_operator: 2023-08-10T11:43:58.482 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.compaction_filter: None 2023-08-10T11:43:58.482 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.compaction_filter_factory: None 2023-08-10T11:43:58.483 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.sst_partitioner_factory: None 2023-08-10T11:43:58.483 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.memtable_factory: SkipListFactory 2023-08-10T11:43:58.483 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.table_factory: BlockBasedTable 2023-08-10T11:43:58.484 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c7d2bfd3c0) 2023-08-10T11:43:58.484 INFO:journalctl@ceph.mon.a.smithi073.stdout: cache_index_and_filter_blocks: 1 2023-08-10T11:43:58.484 INFO:journalctl@ceph.mon.a.smithi073.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-08-10T11:43:58.484 INFO:journalctl@ceph.mon.a.smithi073.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-08-10T11:43:58.484 INFO:journalctl@ceph.mon.a.smithi073.stdout: pin_top_level_index_and_filter: 1 2023-08-10T11:43:58.484 INFO:journalctl@ceph.mon.a.smithi073.stdout: index_type: 0 2023-08-10T11:43:58.485 INFO:journalctl@ceph.mon.a.smithi073.stdout: data_block_index_type: 0 2023-08-10T11:43:58.485 INFO:journalctl@ceph.mon.a.smithi073.stdout: index_shortening: 1 2023-08-10T11:43:58.485 INFO:journalctl@ceph.mon.a.smithi073.stdout: data_block_hash_table_util_ratio: 0.750000 2023-08-10T11:43:58.485 INFO:journalctl@ceph.mon.a.smithi073.stdout: checksum: 4 2023-08-10T11:43:58.485 INFO:journalctl@ceph.mon.a.smithi073.stdout: no_block_cache: 0 2023-08-10T11:43:58.485 INFO:journalctl@ceph.mon.a.smithi073.stdout: block_cache: 0x55c7d2bbd1f0 2023-08-10T11:43:58.485 INFO:journalctl@ceph.mon.a.smithi073.stdout: block_cache_name: BinnedLRUCache 2023-08-10T11:43:58.486 INFO:journalctl@ceph.mon.a.smithi073.stdout: block_cache_options: 2023-08-10T11:43:58.486 INFO:journalctl@ceph.mon.a.smithi073.stdout: capacity : 536870912 2023-08-10T11:43:58.486 INFO:journalctl@ceph.mon.a.smithi073.stdout: num_shard_bits : 4 2023-08-10T11:43:58.486 INFO:journalctl@ceph.mon.a.smithi073.stdout: strict_capacity_limit : 0 2023-08-10T11:43:58.486 INFO:journalctl@ceph.mon.a.smithi073.stdout: high_pri_pool_ratio: 0.000 2023-08-10T11:43:58.486 INFO:journalctl@ceph.mon.a.smithi073.stdout: block_cache_compressed: (nil) 2023-08-10T11:43:58.486 INFO:journalctl@ceph.mon.a.smithi073.stdout: persistent_cache: (nil) 2023-08-10T11:43:58.486 INFO:journalctl@ceph.mon.a.smithi073.stdout: block_size: 4096 2023-08-10T11:43:58.487 INFO:journalctl@ceph.mon.a.smithi073.stdout: block_size_deviation: 10 2023-08-10T11:43:58.487 INFO:journalctl@ceph.mon.a.smithi073.stdout: block_restart_interval: 16 2023-08-10T11:43:58.487 INFO:journalctl@ceph.mon.a.smithi073.stdout: index_block_restart_interval: 1 2023-08-10T11:43:58.487 INFO:journalctl@ceph.mon.a.smithi073.stdout: metadata_block_size: 4096 2023-08-10T11:43:58.487 INFO:journalctl@ceph.mon.a.smithi073.stdout: partition_filters: 0 2023-08-10T11:43:58.487 INFO:journalctl@ceph.mon.a.smithi073.stdout: use_delta_encoding: 1 2023-08-10T11:43:58.487 INFO:journalctl@ceph.mon.a.smithi073.stdout: filter_policy: bloomfilter 2023-08-10T11:43:58.487 INFO:journalctl@ceph.mon.a.smithi073.stdout: whole_key_filtering: 1 2023-08-10T11:43:58.488 INFO:journalctl@ceph.mon.a.smithi073.stdout: verify_compression: 0 2023-08-10T11:43:58.488 INFO:journalctl@ceph.mon.a.smithi073.stdout: read_amp_bytes_per_bit: 0 2023-08-10T11:43:58.488 INFO:journalctl@ceph.mon.a.smithi073.stdout: format_version: 5 2023-08-10T11:43:58.488 INFO:journalctl@ceph.mon.a.smithi073.stdout: enable_index_compression: 1 2023-08-10T11:43:58.488 INFO:journalctl@ceph.mon.a.smithi073.stdout: block_align: 0 2023-08-10T11:43:58.488 INFO:journalctl@ceph.mon.a.smithi073.stdout: max_auto_readahead_size: 262144 2023-08-10T11:43:58.488 INFO:journalctl@ceph.mon.a.smithi073.stdout: prepopulate_block_cache: 0 2023-08-10T11:43:58.489 INFO:journalctl@ceph.mon.a.smithi073.stdout: initial_auto_readahead_size: 8192 2023-08-10T11:43:58.489 INFO:journalctl@ceph.mon.a.smithi073.stdout: num_file_reads_for_auto_readahead: 2 2023-08-10T11:43:58.489 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.write_buffer_size: 33554432 2023-08-10T11:43:58.489 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.max_write_buffer_number: 2 2023-08-10T11:43:58.489 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.compression: NoCompression 2023-08-10T11:43:58.489 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.bottommost_compression: Disabled 2023-08-10T11:43:58.489 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.prefix_extractor: nullptr 2023-08-10T11:43:58.489 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-08-10T11:43:58.490 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.num_levels: 7 2023-08-10T11:43:58.490 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-08-10T11:43:58.490 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-08-10T11:43:58.490 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-08-10T11:43:58.490 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-08-10T11:43:58.490 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-08-10T11:43:58.490 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-08-10T11:43:58.490 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-08-10T11:43:58.491 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-08-10T11:43:58.491 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-08-10T11:43:58.491 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-08-10T11:43:58.491 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-08-10T11:43:58.491 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-08-10T11:43:58.491 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.compression_opts.window_bits: -14 2023-08-10T11:43:58.491 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.compression_opts.level: 32767 2023-08-10T11:43:58.491 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.compression_opts.strategy: 0 2023-08-10T11:43:58.492 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-08-10T11:43:58.492 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-08-10T11:43:58.492 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-08-10T11:43:58.492 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-08-10T11:43:58.492 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.compression_opts.enabled: false 2023-08-10T11:43:58.492 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-08-10T11:43:58.492 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-08-10T11:43:58.493 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-08-10T11:43:58.493 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-08-10T11:43:58.493 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.target_file_size_base: 67108864 2023-08-10T11:43:58.493 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.target_file_size_multiplier: 1 2023-08-10T11:43:58.493 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-08-10T11:43:58.493 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-08-10T11:43:58.493 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-08-10T11:43:58.493 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-08-10T11:43:58.494 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-08-10T11:43:58.494 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-08-10T11:43:58.494 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-08-10T11:43:58.494 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-08-10T11:43:58.494 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-08-10T11:43:58.494 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-08-10T11:43:58.494 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-08-10T11:43:58.494 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-08-10T11:43:58.495 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-08-10T11:43:58.495 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.arena_block_size: 1048576 2023-08-10T11:43:58.495 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-08-10T11:43:58.495 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-08-10T11:43:58.495 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.disable_auto_compactions: 0 2023-08-10T11:43:58.495 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-08-10T11:43:58.495 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-08-10T11:43:58.496 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-08-10T11:43:58.496 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-08-10T11:43:58.496 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-08-10T11:43:58.496 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-08-10T11:43:58.496 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-08-10T11:43:58.496 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-08-10T11:43:58.496 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-08-10T11:43:58.496 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-08-10T11:43:58.497 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.table_properties_collectors: 2023-08-10T11:43:58.497 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.inplace_update_support: 0 2023-08-10T11:43:58.497 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.inplace_update_num_locks: 10000 2023-08-10T11:43:58.497 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-08-10T11:43:58.497 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-08-10T11:43:58.497 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.memtable_huge_page_size: 0 2023-08-10T11:43:58.497 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.bloom_locality: 0 2023-08-10T11:43:58.497 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.max_successive_merges: 0 2023-08-10T11:43:58.498 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.optimize_filters_for_hits: 0 2023-08-10T11:43:58.498 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.paranoid_file_checks: 0 2023-08-10T11:43:58.498 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.force_consistency_checks: 1 2023-08-10T11:43:58.498 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.report_bg_io_stats: 0 2023-08-10T11:43:58.498 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.ttl: 2592000 2023-08-10T11:43:58.498 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.periodic_compaction_seconds: 0 2023-08-10T11:43:58.498 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-08-10T11:43:58.498 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-08-10T11:43:58.499 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.enable_blob_files: false 2023-08-10T11:43:58.499 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.min_blob_size: 0 2023-08-10T11:43:58.499 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.blob_file_size: 268435456 2023-08-10T11:43:58.499 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.blob_compression_type: NoCompression 2023-08-10T11:43:58.499 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.enable_blob_garbage_collection: false 2023-08-10T11:43:58.499 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-08-10T11:43:58.499 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-08-10T11:43:58.500 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-08-10T11:43:58.500 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.blob_file_starting_level: 0 2023-08-10T11:43:58.500 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-08-10T11:43:58.500 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-08-10T11:43:58.500 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-08-10T11:43:58.500 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 11be612f-da1b-497e-9156-c987fbd4a88d 2023-08-10T11:43:58.500 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: EVENT_LOG_v1 {"time_micros": 1691667838390366, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-08-10T11:43:58.500 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-08-10T11:43:58.501 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: EVENT_LOG_v1 {"time_micros": 1691667838391374, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 95167, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 320, "table_properties": {"data_size": 93155, "index_size": 294, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13991, "raw_average_key_size": 50, "raw_value_size": 85545, "raw_average_value_size": 306, "num_data_blocks": 11, "num_entries": 279, "num_filter_entries": 279, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1691667838, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "11be612f-da1b-497e-9156-c987fbd4a88d", "db_session_id": "R5NEM1JCH7I9XAP484EN", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-08-10T11:43:58.501 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: EVENT_LOG_v1 {"time_micros": 1691667838391445, "job": 1, "event": "recovery_finished"} 2023-08-10T11:43:58.501 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-08-10T11:43:58.501 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-08-10T11:43:58.501 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c7d2c56000 2023-08-10T11:43:58.501 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: DB pointer 0x55c7d2c42000 2023-08-10T11:43:58.501 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-08-10T11:43:58.501 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-08-10T11:43:58.502 INFO:journalctl@ceph.mon.a.smithi073.stdout: ** DB Stats ** 2023-08-10T11:43:58.502 INFO:journalctl@ceph.mon.a.smithi073.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-08-10T11:43:58.502 INFO:journalctl@ceph.mon.a.smithi073.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-08-10T11:43:58.502 INFO:journalctl@ceph.mon.a.smithi073.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-08-10T11:43:58.502 INFO:journalctl@ceph.mon.a.smithi073.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-08-10T11:43:58.502 INFO:journalctl@ceph.mon.a.smithi073.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-08-10T11:43:58.502 INFO:journalctl@ceph.mon.a.smithi073.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-08-10T11:43:58.502 INFO:journalctl@ceph.mon.a.smithi073.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-08-10T11:43:58.503 INFO:journalctl@ceph.mon.a.smithi073.stdout: 2023-08-10T11:43:58.503 INFO:journalctl@ceph.mon.a.smithi073.stdout: ** Compaction Stats [default] ** 2023-08-10T11:43:58.503 INFO:journalctl@ceph.mon.a.smithi073.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-08-10T11:43:58.503 INFO:journalctl@ceph.mon.a.smithi073.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-08-10T11:43:58.503 INFO:journalctl@ceph.mon.a.smithi073.stdout: L0 2/0 94.77 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 140.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-08-10T11:43:58.503 INFO:journalctl@ceph.mon.a.smithi073.stdout: Sum 2/0 94.77 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 140.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-08-10T11:43:58.503 INFO:journalctl@ceph.mon.a.smithi073.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 140.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-08-10T11:43:58.504 INFO:journalctl@ceph.mon.a.smithi073.stdout: 2023-08-10T11:43:58.504 INFO:journalctl@ceph.mon.a.smithi073.stdout: ** Compaction Stats [default] ** 2023-08-10T11:43:58.504 INFO:journalctl@ceph.mon.a.smithi073.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-08-10T11:43:58.504 INFO:journalctl@ceph.mon.a.smithi073.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-08-10T11:43:58.504 INFO:journalctl@ceph.mon.a.smithi073.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 140.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-08-10T11:43:58.504 INFO:journalctl@ceph.mon.a.smithi073.stdout: 2023-08-10T11:43:58.504 INFO:journalctl@ceph.mon.a.smithi073.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-08-10T11:43:58.504 INFO:journalctl@ceph.mon.a.smithi073.stdout: 2023-08-10T11:43:58.505 INFO:journalctl@ceph.mon.a.smithi073.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-08-10T11:43:58.505 INFO:journalctl@ceph.mon.a.smithi073.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-08-10T11:43:58.505 INFO:journalctl@ceph.mon.a.smithi073.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-08-10T11:43:58.505 INFO:journalctl@ceph.mon.a.smithi073.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-08-10T11:43:58.505 INFO:journalctl@ceph.mon.a.smithi073.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-08-10T11:43:58.505 INFO:journalctl@ceph.mon.a.smithi073.stdout: AddFile(Keys): cumulative 0, interval 0 2023-08-10T11:43:58.505 INFO:journalctl@ceph.mon.a.smithi073.stdout: Cumulative compaction: 0.00 GB write, 16.71 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-08-10T11:43:58.505 INFO:journalctl@ceph.mon.a.smithi073.stdout: Interval compaction: 0.00 GB write, 16.71 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-08-10T11:43:58.506 INFO:journalctl@ceph.mon.a.smithi073.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-08-10T11:43:58.506 INFO:journalctl@ceph.mon.a.smithi073.stdout: Block cache BinnedLRUCache@0x55c7d2bbd1f0#7 capacity: 512.00 MB usage: 1.39 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-08-10T11:43:58.506 INFO:journalctl@ceph.mon.a.smithi073.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2023-08-10T11:43:58.506 INFO:journalctl@ceph.mon.a.smithi073.stdout: 2023-08-10T11:43:58.506 INFO:journalctl@ceph.mon.a.smithi073.stdout: ** File Read Latency Histogram By Level [default] ** 2023-08-10T11:43:58.506 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: starting mon.a rank 0 at public addrs [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] at bind addrs [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 0e619a74-3773-11ee-9b37-001a4aab830c 2023-08-10T11:43:58.506 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: mon.a@-1(???) e1 preinit fsid 0e619a74-3773-11ee-9b37-001a4aab830c 2023-08-10T11:43:58.507 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: mon.a@-1(???).mds e1 new map 2023-08-10T11:43:58.507 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: mon.a@-1(???).mds e1 print_map 2023-08-10T11:43:58.507 INFO:journalctl@ceph.mon.a.smithi073.stdout: e1 2023-08-10T11:43:58.507 INFO:journalctl@ceph.mon.a.smithi073.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-08-10T11:43:58.507 INFO:journalctl@ceph.mon.a.smithi073.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-08-10T11:43:58.507 INFO:journalctl@ceph.mon.a.smithi073.stdout: legacy client fscid: -1 2023-08-10T11:43:58.507 INFO:journalctl@ceph.mon.a.smithi073.stdout: 2023-08-10T11:43:58.507 INFO:journalctl@ceph.mon.a.smithi073.stdout: No filesystems configured 2023-08-10T11:43:58.508 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-08-10T11:43:58.508 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-08-10T11:43:58.508 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-08-10T11:43:58.508 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-08-10T11:43:58.508 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-08-10T11:43:58.508 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 systemd[1]: Started Ceph mon.a for 0e619a74-3773-11ee-9b37-001a4aab830c. 2023-08-10T11:43:58.508 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: expand_channel_meta expand map: {default=false} 2023-08-10T11:43:58.508 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: expand_channel_meta from 'false' to 'false' 2023-08-10T11:43:58.509 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: expand_channel_meta expanded map: {default=false} 2023-08-10T11:43:58.509 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: expand_channel_meta expand map: {default=info} 2023-08-10T11:43:58.509 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: expand_channel_meta from 'info' to 'info' 2023-08-10T11:43:58.509 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: expand_channel_meta expanded map: {default=info} 2023-08-10T11:43:58.509 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: expand_channel_meta expand map: {default=daemon} 2023-08-10T11:43:58.509 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: expand_channel_meta from 'daemon' to 'daemon' 2023-08-10T11:43:58.509 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: expand_channel_meta expanded map: {default=daemon} 2023-08-10T11:43:58.509 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: expand_channel_meta expand map: {default=debug} 2023-08-10T11:43:58.510 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: expand_channel_meta from 'debug' to 'debug' 2023-08-10T11:43:58.510 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: expand_channel_meta expanded map: {default=debug} 2023-08-10T11:43:58.510 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: mon.a is new leader, mons a in quorum (ranks 0) 2023-08-10T11:43:58.510 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: monmap e1: 1 mons at {a=[v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0]} removed_ranks: {} 2023-08-10T11:43:58.510 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: fsmap 2023-08-10T11:43:58.510 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: osdmap e1: 0 total, 0 up, 0 in 2023-08-10T11:43:58.510 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:58 smithi073 ceph-mon[128869]: mgrmap e1: no daemons active 2023-08-10T11:43:59.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.889+0000 7f5f74a37700 1 Processor -- start 2023-08-10T11:43:59.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.889+0000 7f5f74a37700 1 -- start start 2023-08-10T11:43:59.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.890+0000 7f5f74a37700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f70106720 0x7f5f70106b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:43:59.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.890+0000 7f5f74a37700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f70107110 con 0x7f5f70106720 2023-08-10T11:43:59.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.890+0000 7f5f6e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f70106720 0x7f5f70106b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:43:59.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.890+0000 7f5f6e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f70106720 0x7f5f70106b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57600/0 (socket says 172.21.15.73:57600) 2023-08-10T11:43:59.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.890+0000 7f5f6e59c700 1 -- 172.21.15.73:0/285653126 learned_addr learned my addr 172.21.15.73:0/285653126 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:43:59.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.891+0000 7f5f6e59c700 1 -- 172.21.15.73:0/285653126 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f70107250 con 0x7f5f70106720 2023-08-10T11:43:59.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.891+0000 7f5f6e59c700 1 --2- 172.21.15.73:0/285653126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f70106720 0x7f5f70106b40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5f580098a0 tx=0x7f5f58009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee8b8cbe5d5ff164 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:43:59.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.891+0000 7f5f6d59a700 1 -- 172.21.15.73:0/285653126 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f58004160 con 0x7f5f70106720 2023-08-10T11:43:59.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.891+0000 7f5f6d59a700 1 -- 172.21.15.73:0/285653126 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5f580042c0 con 0x7f5f70106720 2023-08-10T11:43:59.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.891+0000 7f5f6d59a700 1 -- 172.21.15.73:0/285653126 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f58011a00 con 0x7f5f70106720 2023-08-10T11:43:59.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.891+0000 7f5f74a37700 1 -- 172.21.15.73:0/285653126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f70106720 msgr2=0x7f5f70106b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:43:59.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.891+0000 7f5f74a37700 1 --2- 172.21.15.73:0/285653126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f70106720 0x7f5f70106b40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5f580098a0 tx=0x7f5f58009bb0 comp rx=0 tx=0).stop 2023-08-10T11:43:59.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.891+0000 7f5f74a37700 1 -- 172.21.15.73:0/285653126 shutdown_connections 2023-08-10T11:43:59.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.891+0000 7f5f74a37700 1 --2- 172.21.15.73:0/285653126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f70106720 0x7f5f70106b40 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:43:59.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.891+0000 7f5f74a37700 1 -- 172.21.15.73:0/285653126 >> 172.21.15.73:0/285653126 conn(0x7f5f700ffe10 msgr2=0x7f5f70102270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:43:59.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.892+0000 7f5f74a37700 1 -- 172.21.15.73:0/285653126 shutdown_connections 2023-08-10T11:43:59.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.892+0000 7f5f74a37700 1 -- 172.21.15.73:0/285653126 wait complete. 2023-08-10T11:43:59.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.892+0000 7f5f74a37700 1 Processor -- start 2023-08-10T11:43:59.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.892+0000 7f5f74a37700 1 -- start start 2023-08-10T11:43:59.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.892+0000 7f5f74a37700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f70106720 0x7f5f7019c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:43:59.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.892+0000 7f5f74a37700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7019c6c0 con 0x7f5f70106720 2023-08-10T11:43:59.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.893+0000 7f5f6e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f70106720 0x7f5f7019c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:43:59.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.893+0000 7f5f6e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f70106720 0x7f5f7019c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57602/0 (socket says 172.21.15.73:57602) 2023-08-10T11:43:59.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.893+0000 7f5f6e59c700 1 -- 172.21.15.73:0/1136495189 learned_addr learned my addr 172.21.15.73:0/1136495189 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:43:59.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.893+0000 7f5f6e59c700 1 -- 172.21.15.73:0/1136495189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f58009550 con 0x7f5f70106720 2023-08-10T11:43:59.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.893+0000 7f5f6e59c700 1 --2- 172.21.15.73:0/1136495189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f70106720 0x7f5f7019c180 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5f58009130 tx=0x7f5f58011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:43:59.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.893+0000 7f5f677fe700 1 -- 172.21.15.73:0/1136495189 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f58003ab0 con 0x7f5f70106720 2023-08-10T11:43:59.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.893+0000 7f5f677fe700 1 -- 172.21.15.73:0/1136495189 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5f58003c10 con 0x7f5f70106720 2023-08-10T11:43:59.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.893+0000 7f5f74a37700 1 -- 172.21.15.73:0/1136495189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7019c8c0 con 0x7f5f70106720 2023-08-10T11:43:59.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.893+0000 7f5f677fe700 1 -- 172.21.15.73:0/1136495189 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f580247d0 con 0x7f5f70106720 2023-08-10T11:43:59.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.893+0000 7f5f74a37700 1 -- 172.21.15.73:0/1136495189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7019cce0 con 0x7f5f70106720 2023-08-10T11:43:59.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.894+0000 7f5f677fe700 1 -- 172.21.15.73:0/1136495189 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5f58024a50 con 0x7f5f70106720 2023-08-10T11:43:59.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.894+0000 7f5f677fe700 1 -- 172.21.15.73:0/1136495189 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5f5802db70 con 0x7f5f70106720 2023-08-10T11:43:59.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.894+0000 7f5f74a37700 1 -- 172.21.15.73:0/1136495189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f70195e10 con 0x7f5f70106720 2023-08-10T11:43:59.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.897+0000 7f5f677fe700 1 -- 172.21.15.73:0/1136495189 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f5f5801a8d0 con 0x7f5f70106720 2023-08-10T11:43:59.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.962+0000 7f5f74a37700 1 -- 172.21.15.73:0/1136495189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f5f70061da0 con 0x7f5f70106720 2023-08-10T11:43:59.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.967+0000 7f5f677fe700 1 -- 172.21.15.73:0/1136495189 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f5f58031070 con 0x7f5f70106720 2023-08-10T11:43:59.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.968+0000 7f5f74a37700 1 -- 172.21.15.73:0/1136495189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f70106720 msgr2=0x7f5f7019c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:43:59.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.968+0000 7f5f74a37700 1 --2- 172.21.15.73:0/1136495189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f70106720 0x7f5f7019c180 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5f58009130 tx=0x7f5f58011ad0 comp rx=0 tx=0).stop 2023-08-10T11:43:59.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.968+0000 7f5f74a37700 1 -- 172.21.15.73:0/1136495189 shutdown_connections 2023-08-10T11:43:59.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.968+0000 7f5f74a37700 1 --2- 172.21.15.73:0/1136495189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f70106720 0x7f5f7019c180 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:43:59.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.968+0000 7f5f74a37700 1 -- 172.21.15.73:0/1136495189 >> 172.21.15.73:0/1136495189 conn(0x7f5f700ffe10 msgr2=0x7f5f70192f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:43:59.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.968+0000 7f5f74a37700 1 -- 172.21.15.73:0/1136495189 shutdown_connections 2023-08-10T11:43:59.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:43:58.968+0000 7f5f74a37700 1 -- 172.21.15.73:0/1136495189 wait complete. 2023-08-10T11:43:59.354 INFO:teuthology.orchestra.run.smithi073.stdout:Wrote config to /etc/ceph/ceph.conf 2023-08-10T11:43:59.378 INFO:teuthology.orchestra.run.smithi073.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-08-10T11:43:59.378 INFO:teuthology.orchestra.run.smithi073.stdout:Creating mgr... 2023-08-10T11:43:59.378 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying port 9283 ... 2023-08-10T11:43:59.379 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying port 8765 ... 2023-08-10T11:43:59.572 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-0e619a74-3773-11ee-9b37-001a4aab830c@mgr.x 2023-08-10T11:43:59.572 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Failed to reset failed state of unit ceph-0e619a74-3773-11ee-9b37-001a4aab830c@mgr.x.service: Unit ceph-0e619a74-3773-11ee-9b37-001a4aab830c@mgr.x.service not loaded. 2023-08-10T11:43:59.659 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-0e619a74-3773-11ee-9b37-001a4aab830c.target.wants/ceph-0e619a74-3773-11ee-9b37-001a4aab830c@mgr.x.service → /etc/systemd/system/ceph-0e619a74-3773-11ee-9b37-001a4aab830c@.service. 2023-08-10T11:43:59.666 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:43:59 smithi073 systemd[1]: Starting Ceph mgr.x for 0e619a74-3773-11ee-9b37-001a4aab830c... 2023-08-10T11:44:00.236 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:43:59 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1136495189' entity='client.admin' 2023-08-10T11:44:00.236 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:43:59 smithi073 podman[129102]: 2023-08-10T11:44:00.261 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-08-10T11:44:00.262 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout disabled 2023-08-10T11:44:00.269 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-08-10T11:44:00.269 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout inactive 2023-08-10T11:44:00.269 INFO:teuthology.orchestra.run.smithi073.stdout:firewalld.service is not enabled 2023-08-10T11:44:00.270 INFO:teuthology.orchestra.run.smithi073.stdout:Not possible to enable service . firewalld.service is not available 2023-08-10T11:44:00.277 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-08-10T11:44:00.277 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout disabled 2023-08-10T11:44:00.285 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-08-10T11:44:00.285 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout inactive 2023-08-10T11:44:00.285 INFO:teuthology.orchestra.run.smithi073.stdout:firewalld.service is not enabled 2023-08-10T11:44:00.285 INFO:teuthology.orchestra.run.smithi073.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-08-10T11:44:00.285 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for mgr to start... 2023-08-10T11:44:00.285 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for mgr... 2023-08-10T11:44:00.511 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:00 smithi073 bash[129102]: da36eba39ca70d47b0488d21f08dd4b09c0f3e37541f7c5237d6e1c5eb543c53 2023-08-10T11:44:00.511 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:00 smithi073 systemd[1]: Started Ceph mgr.x for 0e619a74-3773-11ee-9b37-001a4aab830c. 2023-08-10T11:44:00.511 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:00 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:00.336+0000 7fc8a5406200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-10T11:44:00.511 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:00 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:00.417+0000 7fc8a5406200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-10T11:44:00.767 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:00 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:00.508+0000 7fc8a5406200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-10T11:44:00.768 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:00 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:00.609+0000 7fc8a5406200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-10T11:44:01.078 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:00 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2912138591' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-08-10T11:44:01.078 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:00 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:00.785+0000 7fc8a5406200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-10T11:44:01.335 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2023-08-10T11:44:01.335 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2023-08-10T11:44:01.335 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "fsid": "0e619a74-3773-11ee-9b37-001a4aab830c", 2023-08-10T11:44:01.335 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "health": { 2023-08-10T11:44:01.335 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-08-10T11:44:01.336 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-08-10T11:44:01.336 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-08-10T11:44:01.336 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:01.336 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-08-10T11:44:01.336 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-08-10T11:44:01.336 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 0 2023-08-10T11:44:01.336 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2023-08-10T11:44:01.337 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-08-10T11:44:01.337 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "a" 2023-08-10T11:44:01.337 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2023-08-10T11:44:01.337 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2023-08-10T11:44:01.337 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "monmap": { 2023-08-10T11:44:01.337 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T11:44:01.337 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-08-10T11:44:01.337 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-08-10T11:44:01.338 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:01.338 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-08-10T11:44:01.338 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T11:44:01.338 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-08-10T11:44:01.338 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-08-10T11:44:01.338 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-08-10T11:44:01.344 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-08-10T11:44:01.344 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-08-10T11:44:01.344 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-08-10T11:44:01.344 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:01.344 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-08-10T11:44:01.345 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-08-10T11:44:01.345 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-08-10T11:44:01.345 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-08-10T11:44:01.345 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-08-10T11:44:01.345 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-08-10T11:44:01.345 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-08-10T11:44:01.345 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-08-10T11:44:01.346 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-08-10T11:44:01.346 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:01.346 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-08-10T11:44:01.346 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T11:44:01.346 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-08-10T11:44:01.346 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-08-10T11:44:01.346 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:01.346 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-08-10T11:44:01.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "available": false, 2023-08-10T11:44:01.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-08-10T11:44:01.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "modules": [ 2023-08-10T11:44:01.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "iostat", 2023-08-10T11:44:01.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "nfs", 2023-08-10T11:44:01.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "restful" 2023-08-10T11:44:01.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2023-08-10T11:44:01.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "services": {} 2023-08-10T11:44:01.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:01.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-08-10T11:44:01.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T11:44:01.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "modified": "2023-08-10T11:43:53.975232+0000", 2023-08-10T11:44:01.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "services": {} 2023-08-10T11:44:01.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:01.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-08-10T11:44:01.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2023-08-10T11:44:01.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.816+0000 7fc1519b6700 1 Processor -- start 2023-08-10T11:44:01.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.816+0000 7fc1519b6700 1 -- start start 2023-08-10T11:44:01.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.816+0000 7fc1519b6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc14c104ac0 0x7fc14c104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:01.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.816+0000 7fc1519b6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c073f50 con 0x7fc14c104ac0 2023-08-10T11:44:01.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.817+0000 7fc14affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc14c104ac0 0x7fc14c104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:01.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.817+0000 7fc14affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc14c104ac0 0x7fc14c104ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57608/0 (socket says 172.21.15.73:57608) 2023-08-10T11:44:01.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.817+0000 7fc14affd700 1 -- 172.21.15.73:0/331667542 learned_addr learned my addr 172.21.15.73:0/331667542 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:01.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.817+0000 7fc14affd700 1 -- 172.21.15.73:0/331667542 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14c105420 con 0x7fc14c104ac0 2023-08-10T11:44:01.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.817+0000 7fc14affd700 1 --2- 172.21.15.73:0/331667542 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc14c104ac0 0x7fc14c104ee0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc13c0098a0 tx=0x7fc13c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=940bd8c7db5d6537 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:01.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.817+0000 7fc149ffb700 1 -- 172.21.15.73:0/331667542 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc13c004160 con 0x7fc14c104ac0 2023-08-10T11:44:01.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.817+0000 7fc149ffb700 1 -- 172.21.15.73:0/331667542 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc13c0042c0 con 0x7fc14c104ac0 2023-08-10T11:44:01.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.817+0000 7fc149ffb700 1 -- 172.21.15.73:0/331667542 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc13c011a00 con 0x7fc14c104ac0 2023-08-10T11:44:01.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.818+0000 7fc1519b6700 1 -- 172.21.15.73:0/331667542 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc14c104ac0 msgr2=0x7fc14c104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:01.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.818+0000 7fc1519b6700 1 --2- 172.21.15.73:0/331667542 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc14c104ac0 0x7fc14c104ee0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc13c0098a0 tx=0x7fc13c009bb0 comp rx=0 tx=0).stop 2023-08-10T11:44:01.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.818+0000 7fc1519b6700 1 -- 172.21.15.73:0/331667542 shutdown_connections 2023-08-10T11:44:01.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.818+0000 7fc1519b6700 1 --2- 172.21.15.73:0/331667542 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc14c104ac0 0x7fc14c104ee0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:01.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.818+0000 7fc1519b6700 1 -- 172.21.15.73:0/331667542 >> 172.21.15.73:0/331667542 conn(0x7fc14c100680 msgr2=0x7fc14c102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:01.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.818+0000 7fc1519b6700 1 -- 172.21.15.73:0/331667542 shutdown_connections 2023-08-10T11:44:01.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.818+0000 7fc1519b6700 1 -- 172.21.15.73:0/331667542 wait complete. 2023-08-10T11:44:01.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.818+0000 7fc1519b6700 1 Processor -- start 2023-08-10T11:44:01.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.819+0000 7fc1519b6700 1 -- start start 2023-08-10T11:44:01.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.819+0000 7fc1519b6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc14c104ac0 0x7fc14c19c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:01.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.819+0000 7fc1519b6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c19c680 con 0x7fc14c104ac0 2023-08-10T11:44:01.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.819+0000 7fc14affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc14c104ac0 0x7fc14c19c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:01.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.819+0000 7fc14affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc14c104ac0 0x7fc14c19c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57610/0 (socket says 172.21.15.73:57610) 2023-08-10T11:44:01.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.819+0000 7fc14affd700 1 -- 172.21.15.73:0/2912138591 learned_addr learned my addr 172.21.15.73:0/2912138591 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:01.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.819+0000 7fc14affd700 1 -- 172.21.15.73:0/2912138591 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13c009550 con 0x7fc14c104ac0 2023-08-10T11:44:01.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.819+0000 7fc14affd700 1 --2- 172.21.15.73:0/2912138591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc14c104ac0 0x7fc14c19c140 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc13c009130 tx=0x7fc13c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:01.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.820+0000 7fc1509b4700 1 -- 172.21.15.73:0/2912138591 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc13c003b70 con 0x7fc14c104ac0 2023-08-10T11:44:01.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.820+0000 7fc1509b4700 1 -- 172.21.15.73:0/2912138591 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc13c003cd0 con 0x7fc14c104ac0 2023-08-10T11:44:01.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.820+0000 7fc1519b6700 1 -- 172.21.15.73:0/2912138591 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc14c19c880 con 0x7fc14c104ac0 2023-08-10T11:44:01.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.820+0000 7fc1509b4700 1 -- 172.21.15.73:0/2912138591 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc13c0197d0 con 0x7fc14c104ac0 2023-08-10T11:44:01.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.820+0000 7fc1519b6700 1 -- 172.21.15.73:0/2912138591 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc14c19cca0 con 0x7fc14c104ac0 2023-08-10T11:44:01.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.820+0000 7fc1509b4700 1 -- 172.21.15.73:0/2912138591 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc13c019a10 con 0x7fc14c104ac0 2023-08-10T11:44:01.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.820+0000 7fc1509b4700 1 -- 172.21.15.73:0/2912138591 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc13c00b720 con 0x7fc14c104ac0 2023-08-10T11:44:01.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.821+0000 7fc1519b6700 1 -- 172.21.15.73:0/2912138591 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc14c195a00 con 0x7fc14c104ac0 2023-08-10T11:44:01.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.823+0000 7fc1509b4700 1 -- 172.21.15.73:0/2912138591 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fc13c02a060 con 0x7fc14c104ac0 2023-08-10T11:44:01.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.904+0000 7fc1519b6700 1 -- 172.21.15.73:0/2912138591 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fc14c061da0 con 0x7fc14c104ac0 2023-08-10T11:44:01.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.904+0000 7fc1509b4700 1 -- 172.21.15.73:0/2912138591 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7fc13c019e50 con 0x7fc14c104ac0 2023-08-10T11:44:01.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.905+0000 7fc1519b6700 1 -- 172.21.15.73:0/2912138591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc14c104ac0 msgr2=0x7fc14c19c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:01.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.905+0000 7fc1519b6700 1 --2- 172.21.15.73:0/2912138591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc14c104ac0 0x7fc14c19c140 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc13c009130 tx=0x7fc13c011ad0 comp rx=0 tx=0).stop 2023-08-10T11:44:01.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.905+0000 7fc1519b6700 1 -- 172.21.15.73:0/2912138591 shutdown_connections 2023-08-10T11:44:01.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.905+0000 7fc1519b6700 1 --2- 172.21.15.73:0/2912138591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc14c104ac0 0x7fc14c19c140 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:01.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.905+0000 7fc1519b6700 1 -- 172.21.15.73:0/2912138591 >> 172.21.15.73:0/2912138591 conn(0x7fc14c100680 msgr2=0x7fc14c190680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:01.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.905+0000 7fc1519b6700 1 -- 172.21.15.73:0/2912138591 shutdown_connections 2023-08-10T11:44:01.355 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:00.905+0000 7fc1519b6700 1 -- 172.21.15.73:0/2912138591 wait complete. 2023-08-10T11:44:01.355 INFO:teuthology.orchestra.run.smithi073.stdout:mgr not available, waiting (1/15)... 2023-08-10T11:44:01.355 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:01 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:01.122+0000 7fc8a5406200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-10T11:44:01.356 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:01 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:01.211+0000 7fc8a5406200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-10T11:44:01.767 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:01 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:01.344+0000 7fc8a5406200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-10T11:44:01.767 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:01 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:01.438+0000 7fc8a5406200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-10T11:44:02.267 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:01 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:01.855+0000 7fc8a5406200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-10T11:44:02.767 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:02 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:02.425+0000 7fc8a5406200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-10T11:44:02.767 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:02 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:02.594+0000 7fc8a5406200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-10T11:44:03.635 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:03 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:03.357+0000 7fc8a5406200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-10T11:44:03.635 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:03 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:03.452+0000 7fc8a5406200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-10T11:44:03.925 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:03 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:03.634+0000 7fc8a5406200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-10T11:44:04.267 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:03 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:03.925+0000 7fc8a5406200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-10T11:44:04.267 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:04 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:04.160+0000 7fc8a5406200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-10T11:44:04.282 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2023-08-10T11:44:04.284 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2023-08-10T11:44:04.285 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "fsid": "0e619a74-3773-11ee-9b37-001a4aab830c", 2023-08-10T11:44:04.285 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "health": { 2023-08-10T11:44:04.285 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-08-10T11:44:04.285 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-08-10T11:44:04.285 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-08-10T11:44:04.285 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:04.285 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-08-10T11:44:04.286 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-08-10T11:44:04.286 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 0 2023-08-10T11:44:04.286 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2023-08-10T11:44:04.286 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-08-10T11:44:04.286 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "a" 2023-08-10T11:44:04.286 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2023-08-10T11:44:04.286 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2023-08-10T11:44:04.286 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "monmap": { 2023-08-10T11:44:04.287 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T11:44:04.287 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-08-10T11:44:04.287 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-08-10T11:44:04.287 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:04.287 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-08-10T11:44:04.287 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T11:44:04.287 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-08-10T11:44:04.288 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-08-10T11:44:04.288 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-08-10T11:44:04.293 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-08-10T11:44:04.293 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-08-10T11:44:04.293 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-08-10T11:44:04.294 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:04.294 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-08-10T11:44:04.294 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-08-10T11:44:04.294 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-08-10T11:44:04.294 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-08-10T11:44:04.294 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-08-10T11:44:04.294 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-08-10T11:44:04.294 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-08-10T11:44:04.295 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-08-10T11:44:04.295 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-08-10T11:44:04.295 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:04.295 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-08-10T11:44:04.295 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T11:44:04.295 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-08-10T11:44:04.295 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-08-10T11:44:04.295 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:04.296 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-08-10T11:44:04.296 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "available": false, 2023-08-10T11:44:04.296 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-08-10T11:44:04.296 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "modules": [ 2023-08-10T11:44:04.296 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "iostat", 2023-08-10T11:44:04.296 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "nfs", 2023-08-10T11:44:04.296 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "restful" 2023-08-10T11:44:04.297 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2023-08-10T11:44:04.297 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "services": {} 2023-08-10T11:44:04.297 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:04.297 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-08-10T11:44:04.297 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T11:44:04.297 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "modified": "2023-08-10T11:43:53.975232+0000", 2023-08-10T11:44:04.297 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "services": {} 2023-08-10T11:44:04.297 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:04.298 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-08-10T11:44:04.298 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2023-08-10T11:44:04.298 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.819+0000 7f5a2e589700 1 Processor -- start 2023-08-10T11:44:04.298 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.819+0000 7f5a2e589700 1 -- start start 2023-08-10T11:44:04.298 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.819+0000 7f5a2e589700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a281050f0 0x7f5a28105510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:04.298 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.819+0000 7f5a2e589700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a28105ae0 con 0x7f5a281050f0 2023-08-10T11:44:04.298 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.820+0000 7f5a27fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a281050f0 0x7f5a28105510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:04.298 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.820+0000 7f5a27fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a281050f0 0x7f5a28105510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57612/0 (socket says 172.21.15.73:57612) 2023-08-10T11:44:04.299 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.820+0000 7f5a27fff700 1 -- 172.21.15.73:0/2613117787 learned_addr learned my addr 172.21.15.73:0/2613117787 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:04.299 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.820+0000 7f5a27fff700 1 -- 172.21.15.73:0/2613117787 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a281062f0 con 0x7f5a281050f0 2023-08-10T11:44:04.299 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.820+0000 7f5a27fff700 1 --2- 172.21.15.73:0/2613117787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a281050f0 0x7f5a28105510 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c0098a0 tx=0x7f5a1c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2294a13f0d7a7ffb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:04.299 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.820+0000 7f5a26ffd700 1 -- 172.21.15.73:0/2613117787 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a1c004160 con 0x7f5a281050f0 2023-08-10T11:44:04.299 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.820+0000 7f5a26ffd700 1 -- 172.21.15.73:0/2613117787 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5a1c0042c0 con 0x7f5a281050f0 2023-08-10T11:44:04.299 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.820+0000 7f5a26ffd700 1 -- 172.21.15.73:0/2613117787 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a1c011a00 con 0x7f5a281050f0 2023-08-10T11:44:04.299 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.821+0000 7f5a2e589700 1 -- 172.21.15.73:0/2613117787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a281050f0 msgr2=0x7f5a28105510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:04.299 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.821+0000 7f5a2e589700 1 --2- 172.21.15.73:0/2613117787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a281050f0 0x7f5a28105510 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c0098a0 tx=0x7f5a1c009bb0 comp rx=0 tx=0).stop 2023-08-10T11:44:04.300 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.821+0000 7f5a2e589700 1 -- 172.21.15.73:0/2613117787 shutdown_connections 2023-08-10T11:44:04.300 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.821+0000 7f5a2e589700 1 --2- 172.21.15.73:0/2613117787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a281050f0 0x7f5a28105510 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:04.300 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.821+0000 7f5a2e589700 1 -- 172.21.15.73:0/2613117787 >> 172.21.15.73:0/2613117787 conn(0x7f5a281006b0 msgr2=0x7f5a28102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:04.300 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.821+0000 7f5a2e589700 1 -- 172.21.15.73:0/2613117787 shutdown_connections 2023-08-10T11:44:04.300 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.821+0000 7f5a2e589700 1 -- 172.21.15.73:0/2613117787 wait complete. 2023-08-10T11:44:04.300 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.822+0000 7f5a2e589700 1 Processor -- start 2023-08-10T11:44:04.300 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.822+0000 7f5a2e589700 1 -- start start 2023-08-10T11:44:04.301 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.822+0000 7f5a2e589700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a281050f0 0x7f5a28198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:04.301 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.823+0000 7f5a2e589700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a28199360 con 0x7f5a281050f0 2023-08-10T11:44:04.301 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.823+0000 7f5a27fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a281050f0 0x7f5a28198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:04.301 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.823+0000 7f5a27fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a281050f0 0x7f5a28198e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57614/0 (socket says 172.21.15.73:57614) 2023-08-10T11:44:04.301 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.823+0000 7f5a27fff700 1 -- 172.21.15.73:0/242432107 learned_addr learned my addr 172.21.15.73:0/242432107 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:04.301 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.823+0000 7f5a27fff700 1 -- 172.21.15.73:0/242432107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1c009550 con 0x7f5a281050f0 2023-08-10T11:44:04.301 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.823+0000 7f5a27fff700 1 --2- 172.21.15.73:0/242432107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a281050f0 0x7f5a28198e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c006af0 tx=0x7f5a1c003980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:04.301 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.823+0000 7f5a257fa700 1 -- 172.21.15.73:0/242432107 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a1c003ba0 con 0x7f5a281050f0 2023-08-10T11:44:04.302 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.823+0000 7f5a257fa700 1 -- 172.21.15.73:0/242432107 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5a1c020070 con 0x7f5a281050f0 2023-08-10T11:44:04.302 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.823+0000 7f5a2e589700 1 -- 172.21.15.73:0/242432107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a28199560 con 0x7f5a281050f0 2023-08-10T11:44:04.302 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.823+0000 7f5a257fa700 1 -- 172.21.15.73:0/242432107 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a1c01c670 con 0x7f5a281050f0 2023-08-10T11:44:04.302 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.823+0000 7f5a2e589700 1 -- 172.21.15.73:0/242432107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a28199980 con 0x7f5a281050f0 2023-08-10T11:44:04.302 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.824+0000 7f5a257fa700 1 -- 172.21.15.73:0/242432107 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5a1c022030 con 0x7f5a281050f0 2023-08-10T11:44:04.302 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.824+0000 7f5a257fa700 1 -- 172.21.15.73:0/242432107 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5a1c02ebc0 con 0x7f5a281050f0 2023-08-10T11:44:04.302 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.824+0000 7f5a2e589700 1 -- 172.21.15.73:0/242432107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a28061da0 con 0x7f5a281050f0 2023-08-10T11:44:04.303 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.828+0000 7f5a257fa700 1 -- 172.21.15.73:0/242432107 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f5a1c02ee20 con 0x7f5a281050f0 2023-08-10T11:44:04.303 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.900+0000 7f5a2e589700 1 -- 172.21.15.73:0/242432107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f5a281094f0 con 0x7f5a281050f0 2023-08-10T11:44:04.303 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.901+0000 7f5a257fa700 1 -- 172.21.15.73:0/242432107 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f5a1c01cd80 con 0x7f5a281050f0 2023-08-10T11:44:04.303 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.902+0000 7f5a2e589700 1 -- 172.21.15.73:0/242432107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a281050f0 msgr2=0x7f5a28198e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:04.303 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.902+0000 7f5a2e589700 1 --2- 172.21.15.73:0/242432107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a281050f0 0x7f5a28198e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c006af0 tx=0x7f5a1c003980 comp rx=0 tx=0).stop 2023-08-10T11:44:04.303 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.902+0000 7f5a2e589700 1 -- 172.21.15.73:0/242432107 shutdown_connections 2023-08-10T11:44:04.303 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.902+0000 7f5a2e589700 1 --2- 172.21.15.73:0/242432107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a281050f0 0x7f5a28198e20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:04.303 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.902+0000 7f5a2e589700 1 -- 172.21.15.73:0/242432107 >> 172.21.15.73:0/242432107 conn(0x7f5a281006b0 msgr2=0x7f5a28101d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:04.304 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.902+0000 7f5a2e589700 1 -- 172.21.15.73:0/242432107 shutdown_connections 2023-08-10T11:44:04.304 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:03.902+0000 7f5a2e589700 1 -- 172.21.15.73:0/242432107 wait complete. 2023-08-10T11:44:04.304 INFO:teuthology.orchestra.run.smithi073.stdout:mgr not available, waiting (2/15)... 2023-08-10T11:44:04.577 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:04 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:04.312+0000 7fc8a5406200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-10T11:44:04.577 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:04 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/242432107' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-08-10T11:44:05.017 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:04 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:04.576+0000 7fc8a5406200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-10T11:44:05.597 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:05 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:05.274+0000 7fc8a5406200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-10T11:44:05.598 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:05 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:05.405+0000 7fc8a5406200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-10T11:44:05.926 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:05 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:05.597+0000 7fc8a5406200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-10T11:44:05.926 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:05 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:05.709+0000 7fc8a5406200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-10T11:44:06.267 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:05 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:05.925+0000 7fc8a5406200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-10T11:44:07.267 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:06 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:06.796+0000 7fc8a5406200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-10T11:44:07.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:06 smithi073 ceph-mon[128869]: Activating manager daemon x 2023-08-10T11:44:07.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:06 smithi073 ceph-mon[128869]: mgrmap e2: x(active, starting, since 0.00312193s) 2023-08-10T11:44:07.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:06 smithi073 ceph-mon[128869]: from='mgr.14100 172.21.15.73:0/2999566135' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-08-10T11:44:07.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:06 smithi073 ceph-mon[128869]: from='mgr.14100 172.21.15.73:0/2999566135' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-08-10T11:44:07.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:06 smithi073 ceph-mon[128869]: from='mgr.14100 172.21.15.73:0/2999566135' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-08-10T11:44:07.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:06 smithi073 ceph-mon[128869]: from='mgr.14100 172.21.15.73:0/2999566135' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T11:44:07.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:06 smithi073 ceph-mon[128869]: from='mgr.14100 172.21.15.73:0/2999566135' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-08-10T11:44:07.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:06 smithi073 ceph-mon[128869]: Manager daemon x is now available 2023-08-10T11:44:07.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:06 smithi073 ceph-mon[128869]: from='mgr.14100 172.21.15.73:0/2999566135' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-08-10T11:44:07.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:06 smithi073 ceph-mon[128869]: from='mgr.14100 172.21.15.73:0/2999566135' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-08-10T11:44:07.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:06 smithi073 ceph-mon[128869]: from='mgr.14100 172.21.15.73:0/2999566135' entity='mgr.x' 2023-08-10T11:44:07.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:06 smithi073 ceph-mon[128869]: from='mgr.14100 172.21.15.73:0/2999566135' entity='mgr.x' 2023-08-10T11:44:07.333 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2023-08-10T11:44:07.333 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2023-08-10T11:44:07.333 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "fsid": "0e619a74-3773-11ee-9b37-001a4aab830c", 2023-08-10T11:44:07.333 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "health": { 2023-08-10T11:44:07.333 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-08-10T11:44:07.334 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-08-10T11:44:07.334 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-08-10T11:44:07.334 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:07.334 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-08-10T11:44:07.334 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-08-10T11:44:07.334 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 0 2023-08-10T11:44:07.334 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2023-08-10T11:44:07.335 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-08-10T11:44:07.335 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "a" 2023-08-10T11:44:07.335 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2023-08-10T11:44:07.335 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2023-08-10T11:44:07.335 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "monmap": { 2023-08-10T11:44:07.335 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T11:44:07.335 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-08-10T11:44:07.335 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-08-10T11:44:07.336 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:07.336 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-08-10T11:44:07.336 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T11:44:07.336 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-08-10T11:44:07.342 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-08-10T11:44:07.342 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-08-10T11:44:07.342 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-08-10T11:44:07.342 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-08-10T11:44:07.342 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-08-10T11:44:07.342 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:07.343 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-08-10T11:44:07.343 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-08-10T11:44:07.343 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-08-10T11:44:07.343 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-08-10T11:44:07.343 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-08-10T11:44:07.343 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-08-10T11:44:07.343 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-08-10T11:44:07.343 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-08-10T11:44:07.344 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-08-10T11:44:07.344 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:07.344 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-08-10T11:44:07.344 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T11:44:07.344 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-08-10T11:44:07.344 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-08-10T11:44:07.344 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:07.345 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-08-10T11:44:07.345 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "available": false, 2023-08-10T11:44:07.345 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-08-10T11:44:07.345 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "modules": [ 2023-08-10T11:44:07.345 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "iostat", 2023-08-10T11:44:07.345 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "nfs", 2023-08-10T11:44:07.345 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "restful" 2023-08-10T11:44:07.345 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2023-08-10T11:44:07.346 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "services": {} 2023-08-10T11:44:07.346 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:07.346 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-08-10T11:44:07.346 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T11:44:07.346 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "modified": "2023-08-10T11:43:53.975232+0000", 2023-08-10T11:44:07.346 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "services": {} 2023-08-10T11:44:07.346 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:07.346 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-08-10T11:44:07.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2023-08-10T11:44:07.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.816+0000 7f6bb292d700 1 Processor -- start 2023-08-10T11:44:07.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.816+0000 7f6bb292d700 1 -- start start 2023-08-10T11:44:07.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.816+0000 7f6bb292d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bac106790 0x7f6bac106bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:07.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.816+0000 7f6bb292d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac107180 con 0x7f6bac106790 2023-08-10T11:44:07.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.816+0000 7f6babfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bac106790 0x7f6bac106bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:07.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.816+0000 7f6babfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bac106790 0x7f6bac106bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57622/0 (socket says 172.21.15.73:57622) 2023-08-10T11:44:07.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.816+0000 7f6babfff700 1 -- 172.21.15.73:0/1678710876 learned_addr learned my addr 172.21.15.73:0/1678710876 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:07.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.816+0000 7f6babfff700 1 -- 172.21.15.73:0/1678710876 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac1072c0 con 0x7f6bac106790 2023-08-10T11:44:07.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.817+0000 7f6babfff700 1 --2- 172.21.15.73:0/1678710876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bac106790 0x7f6bac106bb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c0098a0 tx=0x7f6b9c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b28e4ab26d7f4b7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:07.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.817+0000 7f6baaffd700 1 -- 172.21.15.73:0/1678710876 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b9c004160 con 0x7f6bac106790 2023-08-10T11:44:07.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.817+0000 7f6baaffd700 1 -- 172.21.15.73:0/1678710876 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6b9c0042c0 con 0x7f6bac106790 2023-08-10T11:44:07.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.817+0000 7f6baaffd700 1 -- 172.21.15.73:0/1678710876 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b9c011a00 con 0x7f6bac106790 2023-08-10T11:44:07.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.817+0000 7f6bb292d700 1 -- 172.21.15.73:0/1678710876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bac106790 msgr2=0x7f6bac106bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:07.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.817+0000 7f6bb292d700 1 --2- 172.21.15.73:0/1678710876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bac106790 0x7f6bac106bb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c0098a0 tx=0x7f6b9c009bb0 comp rx=0 tx=0).stop 2023-08-10T11:44:07.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.817+0000 7f6bb292d700 1 -- 172.21.15.73:0/1678710876 shutdown_connections 2023-08-10T11:44:07.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.817+0000 7f6bb292d700 1 --2- 172.21.15.73:0/1678710876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bac106790 0x7f6bac106bb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:07.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.817+0000 7f6bb292d700 1 -- 172.21.15.73:0/1678710876 >> 172.21.15.73:0/1678710876 conn(0x7f6bac0ffe10 msgr2=0x7f6bac102270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:07.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.817+0000 7f6bb292d700 1 -- 172.21.15.73:0/1678710876 shutdown_connections 2023-08-10T11:44:07.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.817+0000 7f6bb292d700 1 -- 172.21.15.73:0/1678710876 wait complete. 2023-08-10T11:44:07.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.818+0000 7f6bb292d700 1 Processor -- start 2023-08-10T11:44:07.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.818+0000 7f6bb292d700 1 -- start start 2023-08-10T11:44:07.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.818+0000 7f6bb292d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bac106790 0x7f6bac19c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:07.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.818+0000 7f6bb292d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac19c6b0 con 0x7f6bac106790 2023-08-10T11:44:07.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.819+0000 7f6babfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bac106790 0x7f6bac19c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:07.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.819+0000 7f6babfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bac106790 0x7f6bac19c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57624/0 (socket says 172.21.15.73:57624) 2023-08-10T11:44:07.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.819+0000 7f6babfff700 1 -- 172.21.15.73:0/2191781794 learned_addr learned my addr 172.21.15.73:0/2191781794 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:07.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.819+0000 7f6babfff700 1 -- 172.21.15.73:0/2191781794 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9c009550 con 0x7f6bac106790 2023-08-10T11:44:07.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.819+0000 7f6babfff700 1 --2- 172.21.15.73:0/2191781794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bac106790 0x7f6bac19c170 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009130 tx=0x7f6b9c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:07.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.819+0000 7f6ba97fa700 1 -- 172.21.15.73:0/2191781794 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b9c003b70 con 0x7f6bac106790 2023-08-10T11:44:07.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.819+0000 7f6ba97fa700 1 -- 172.21.15.73:0/2191781794 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6b9c003cd0 con 0x7f6bac106790 2023-08-10T11:44:07.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.819+0000 7f6bb292d700 1 -- 172.21.15.73:0/2191781794 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bac19c8b0 con 0x7f6bac106790 2023-08-10T11:44:07.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.819+0000 7f6ba97fa700 1 -- 172.21.15.73:0/2191781794 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b9c0197d0 con 0x7f6bac106790 2023-08-10T11:44:07.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.819+0000 7f6bb292d700 1 -- 172.21.15.73:0/2191781794 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bac19ccd0 con 0x7f6bac106790 2023-08-10T11:44:07.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.820+0000 7f6bb292d700 1 -- 172.21.15.73:0/2191781794 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bac195df0 con 0x7f6bac106790 2023-08-10T11:44:07.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.821+0000 7f6ba97fa700 1 -- 172.21.15.73:0/2191781794 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 2) v1 ==== 45239+0+0 (secure 0 0 0) 0x7f6b9c01abb0 con 0x7f6bac106790 2023-08-10T11:44:07.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.821+0000 7f6ba97fa700 1 -- 172.21.15.73:0/2191781794 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6b9c04c9d0 con 0x7f6bac106790 2023-08-10T11:44:07.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.823+0000 7f6ba97fa700 1 -- 172.21.15.73:0/2191781794 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f6b9c0199c0 con 0x7f6bac106790 2023-08-10T11:44:07.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.897+0000 7f6bb292d700 1 -- 172.21.15.73:0/2191781794 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f6bac061da0 con 0x7f6bac106790 2023-08-10T11:44:07.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.897+0000 7f6ba97fa700 1 -- 172.21.15.73:0/2191781794 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f6b9c024bb0 con 0x7f6bac106790 2023-08-10T11:44:07.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.898+0000 7f6bb292d700 1 -- 172.21.15.73:0/2191781794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bac106790 msgr2=0x7f6bac19c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:07.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.898+0000 7f6bb292d700 1 --2- 172.21.15.73:0/2191781794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bac106790 0x7f6bac19c170 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009130 tx=0x7f6b9c011ad0 comp rx=0 tx=0).stop 2023-08-10T11:44:07.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.898+0000 7f6bb292d700 1 -- 172.21.15.73:0/2191781794 shutdown_connections 2023-08-10T11:44:07.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.898+0000 7f6bb292d700 1 --2- 172.21.15.73:0/2191781794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bac106790 0x7f6bac19c170 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:07.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.898+0000 7f6bb292d700 1 -- 172.21.15.73:0/2191781794 >> 172.21.15.73:0/2191781794 conn(0x7f6bac0ffe10 msgr2=0x7f6bac192f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:07.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.898+0000 7f6bb292d700 1 -- 172.21.15.73:0/2191781794 shutdown_connections 2023-08-10T11:44:07.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:06.898+0000 7f6bb292d700 1 -- 172.21.15.73:0/2191781794 wait complete. 2023-08-10T11:44:07.353 INFO:teuthology.orchestra.run.smithi073.stdout:mgr not available, waiting (3/15)... 2023-08-10T11:44:08.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:07 smithi073 ceph-mon[128869]: from='mgr.14100 172.21.15.73:0/2999566135' entity='mgr.x' 2023-08-10T11:44:08.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:07 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2191781794' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-08-10T11:44:08.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:07 smithi073 ceph-mon[128869]: mgrmap e3: x(active, since 1.00692s) 2023-08-10T11:44:10.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:10 smithi073 ceph-mon[128869]: mgrmap e4: x(active, since 2s) 2023-08-10T11:44:10.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:10 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2032346818' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-08-10T11:44:10.987 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2023-08-10T11:44:10.988 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2023-08-10T11:44:10.988 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "fsid": "0e619a74-3773-11ee-9b37-001a4aab830c", 2023-08-10T11:44:10.988 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "health": { 2023-08-10T11:44:10.988 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-08-10T11:44:10.988 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-08-10T11:44:10.988 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-08-10T11:44:10.989 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:10.989 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-08-10T11:44:10.989 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-08-10T11:44:10.989 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 0 2023-08-10T11:44:10.989 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2023-08-10T11:44:10.989 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-08-10T11:44:10.989 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "a" 2023-08-10T11:44:10.990 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2023-08-10T11:44:10.990 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2023-08-10T11:44:10.990 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "monmap": { 2023-08-10T11:44:10.990 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T11:44:10.990 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-08-10T11:44:10.990 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-08-10T11:44:10.990 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:10.990 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-08-10T11:44:10.991 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T11:44:10.991 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-08-10T11:44:10.991 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-08-10T11:44:10.991 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-08-10T11:44:10.997 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-08-10T11:44:10.998 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-08-10T11:44:10.998 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-08-10T11:44:10.998 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:10.998 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-08-10T11:44:10.998 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-08-10T11:44:10.999 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-08-10T11:44:10.999 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-08-10T11:44:10.999 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-08-10T11:44:10.999 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-08-10T11:44:10.999 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-08-10T11:44:10.999 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-08-10T11:44:10.999 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-08-10T11:44:10.999 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:11.000 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-08-10T11:44:11.000 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T11:44:11.000 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-08-10T11:44:11.000 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-08-10T11:44:11.000 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:11.000 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-08-10T11:44:11.001 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "available": true, 2023-08-10T11:44:11.001 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-08-10T11:44:11.001 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "modules": [ 2023-08-10T11:44:11.001 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "iostat", 2023-08-10T11:44:11.001 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "nfs", 2023-08-10T11:44:11.001 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "restful" 2023-08-10T11:44:11.002 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ], 2023-08-10T11:44:11.002 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "services": {} 2023-08-10T11:44:11.002 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:11.002 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-08-10T11:44:11.002 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T11:44:11.003 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "modified": "2023-08-10T11:43:53.975232+0000", 2023-08-10T11:44:11.003 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "services": {} 2023-08-10T11:44:11.003 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout }, 2023-08-10T11:44:11.003 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-08-10T11:44:11.003 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2023-08-10T11:44:11.003 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.822+0000 7fb485939700 1 Processor -- start 2023-08-10T11:44:11.003 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.822+0000 7fb485939700 1 -- start start 2023-08-10T11:44:11.003 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.822+0000 7fb485939700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb480104500 0x7fb480104920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:11.004 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.822+0000 7fb485939700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb480104ef0 con 0x7fb480104500 2023-08-10T11:44:11.004 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.822+0000 7fb47effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb480104500 0x7fb480104920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:11.004 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.822+0000 7fb47effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb480104500 0x7fb480104920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57646/0 (socket says 172.21.15.73:57646) 2023-08-10T11:44:11.004 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.822+0000 7fb47effd700 1 -- 172.21.15.73:0/562826649 learned_addr learned my addr 172.21.15.73:0/562826649 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:11.005 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.822+0000 7fb47effd700 1 -- 172.21.15.73:0/562826649 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb480107490 con 0x7fb480104500 2023-08-10T11:44:11.005 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.823+0000 7fb47effd700 1 --2- 172.21.15.73:0/562826649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb480104500 0x7fb480104920 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb4700098a0 tx=0x7fb470009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba96ed912b57087 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:11.005 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.823+0000 7fb47dffb700 1 -- 172.21.15.73:0/562826649 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb470004160 con 0x7fb480104500 2023-08-10T11:44:11.005 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.823+0000 7fb47dffb700 1 -- 172.21.15.73:0/562826649 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb4700042c0 con 0x7fb480104500 2023-08-10T11:44:11.005 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.823+0000 7fb47dffb700 1 -- 172.21.15.73:0/562826649 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb470011a00 con 0x7fb480104500 2023-08-10T11:44:11.005 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.823+0000 7fb485939700 1 -- 172.21.15.73:0/562826649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb480104500 msgr2=0x7fb480104920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:11.005 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.823+0000 7fb485939700 1 --2- 172.21.15.73:0/562826649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb480104500 0x7fb480104920 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb4700098a0 tx=0x7fb470009bb0 comp rx=0 tx=0).stop 2023-08-10T11:44:11.005 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.823+0000 7fb485939700 1 -- 172.21.15.73:0/562826649 shutdown_connections 2023-08-10T11:44:11.006 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.823+0000 7fb485939700 1 --2- 172.21.15.73:0/562826649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb480104500 0x7fb480104920 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:11.006 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.823+0000 7fb485939700 1 -- 172.21.15.73:0/562826649 >> 172.21.15.73:0/562826649 conn(0x7fb4800ffe10 msgr2=0x7fb480102270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:11.006 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.823+0000 7fb485939700 1 -- 172.21.15.73:0/562826649 shutdown_connections 2023-08-10T11:44:11.006 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.823+0000 7fb485939700 1 -- 172.21.15.73:0/562826649 wait complete. 2023-08-10T11:44:11.006 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.824+0000 7fb485939700 1 Processor -- start 2023-08-10T11:44:11.006 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.824+0000 7fb485939700 1 -- start start 2023-08-10T11:44:11.006 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.824+0000 7fb485939700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb480104500 0x7fb480199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:11.007 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.824+0000 7fb485939700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48019a490 con 0x7fb480104500 2023-08-10T11:44:11.007 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.824+0000 7fb47effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb480104500 0x7fb480199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:11.007 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.824+0000 7fb47effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb480104500 0x7fb480199f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57648/0 (socket says 172.21.15.73:57648) 2023-08-10T11:44:11.007 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.824+0000 7fb47effd700 1 -- 172.21.15.73:0/2032346818 learned_addr learned my addr 172.21.15.73:0/2032346818 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:11.007 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.825+0000 7fb47effd700 1 -- 172.21.15.73:0/2032346818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb470009550 con 0x7fb480104500 2023-08-10T11:44:11.007 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.825+0000 7fb47effd700 1 --2- 172.21.15.73:0/2032346818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb480104500 0x7fb480199f50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb470009fb0 tx=0x7fb470011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:11.007 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.825+0000 7fb484937700 1 -- 172.21.15.73:0/2032346818 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb470003a40 con 0x7fb480104500 2023-08-10T11:44:11.007 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.825+0000 7fb484937700 1 -- 172.21.15.73:0/2032346818 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb470003ba0 con 0x7fb480104500 2023-08-10T11:44:11.008 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.825+0000 7fb484937700 1 -- 172.21.15.73:0/2032346818 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb47001a750 con 0x7fb480104500 2023-08-10T11:44:11.008 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.825+0000 7fb485939700 1 -- 172.21.15.73:0/2032346818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb48019a690 con 0x7fb480104500 2023-08-10T11:44:11.008 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.825+0000 7fb485939700 1 -- 172.21.15.73:0/2032346818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb48019aab0 con 0x7fb480104500 2023-08-10T11:44:11.008 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.826+0000 7fb484937700 1 -- 172.21.15.73:0/2032346818 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) v1 ==== 45472+0+0 (secure 0 0 0) 0x7fb47001a980 con 0x7fb480104500 2023-08-10T11:44:11.008 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.826+0000 7fb485939700 1 -- 172.21.15.73:0/2032346818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb480061da0 con 0x7fb480104500 2023-08-10T11:44:11.008 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.826+0000 7fb484937700 1 --2- 172.21.15.73:0/2032346818 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7fb4680386c0 0x7fb46803ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:11.009 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.826+0000 7fb484937700 1 -- 172.21.15.73:0/2032346818 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb47004c480 con 0x7fb480104500 2023-08-10T11:44:11.009 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.826+0000 7fb47e7fc700 1 --2- 172.21.15.73:0/2032346818 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7fb4680386c0 0x7fb46803ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:11.009 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.826+0000 7fb47e7fc700 1 --2- 172.21.15.73:0/2032346818 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7fb4680386c0 0x7fb46803ab80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb474006fd0 tx=0x7fb474006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:11.009 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:09.831+0000 7fb484937700 1 -- 172.21.15.73:0/2032346818 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fb47001ac30 con 0x7fb480104500 2023-08-10T11:44:11.009 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:10.089+0000 7fb485939700 1 -- 172.21.15.73:0/2032346818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fb48019db60 con 0x7fb480104500 2023-08-10T11:44:11.009 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:10.089+0000 7fb484937700 1 -- 172.21.15.73:0/2032346818 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7fb470018350 con 0x7fb480104500 2023-08-10T11:44:11.010 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:10.091+0000 7fb485939700 1 -- 172.21.15.73:0/2032346818 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7fb4680386c0 msgr2=0x7fb46803ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:11.010 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:10.091+0000 7fb485939700 1 --2- 172.21.15.73:0/2032346818 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7fb4680386c0 0x7fb46803ab80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb474006fd0 tx=0x7fb474006e40 comp rx=0 tx=0).stop 2023-08-10T11:44:11.010 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:10.091+0000 7fb485939700 1 -- 172.21.15.73:0/2032346818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb480104500 msgr2=0x7fb480199f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:11.010 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:10.091+0000 7fb485939700 1 --2- 172.21.15.73:0/2032346818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb480104500 0x7fb480199f50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb470009fb0 tx=0x7fb470011ad0 comp rx=0 tx=0).stop 2023-08-10T11:44:11.010 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:10.091+0000 7fb485939700 1 -- 172.21.15.73:0/2032346818 shutdown_connections 2023-08-10T11:44:11.010 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:10.091+0000 7fb485939700 1 --2- 172.21.15.73:0/2032346818 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7fb4680386c0 0x7fb46803ab80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:11.011 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:10.091+0000 7fb485939700 1 --2- 172.21.15.73:0/2032346818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb480104500 0x7fb480199f50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:11.011 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:10.091+0000 7fb485939700 1 -- 172.21.15.73:0/2032346818 >> 172.21.15.73:0/2032346818 conn(0x7fb4800ffe10 msgr2=0x7fb480101550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:11.011 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:10.091+0000 7fb485939700 1 -- 172.21.15.73:0/2032346818 shutdown_connections 2023-08-10T11:44:11.011 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:10.091+0000 7fb485939700 1 -- 172.21.15.73:0/2032346818 wait complete. 2023-08-10T11:44:11.011 INFO:teuthology.orchestra.run.smithi073.stdout:mgr is available 2023-08-10T11:44:13.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:12 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3357064028' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-08-10T11:44:16.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2023-08-10T11:44:16.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout [global] 2023-08-10T11:44:16.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout fsid = 0e619a74-3773-11ee-9b37-001a4aab830c 2023-08-10T11:44:16.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-08-10T11:44:16.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-08-10T11:44:16.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-08-10T11:44:16.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-08-10T11:44:16.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2023-08-10T11:44:16.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout [mgr] 2023-08-10T11:44:16.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-08-10T11:44:16.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 2023-08-10T11:44:16.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout [osd] 2023-08-10T11:44:16.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-08-10T11:44:16.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-08-10T11:44:16.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-08-10T11:44:16.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-08-10T11:44:16.354 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-08-10T11:44:16.358 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.510+0000 7f3ceca25700 1 Processor -- start 2023-08-10T11:44:16.358 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.511+0000 7f3ceca25700 1 -- start start 2023-08-10T11:44:16.358 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.511+0000 7f3ceca25700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce81061f0 0x7f3ce8106610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:16.358 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.511+0000 7f3ceca25700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce8106be0 con 0x7f3ce81061f0 2023-08-10T11:44:16.359 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.511+0000 7f3ce659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce81061f0 0x7f3ce8106610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:16.359 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.511+0000 7f3ce659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce81061f0 0x7f3ce8106610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57652/0 (socket says 172.21.15.73:57652) 2023-08-10T11:44:16.359 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.511+0000 7f3ce659c700 1 -- 172.21.15.73:0/3322525309 learned_addr learned my addr 172.21.15.73:0/3322525309 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:16.359 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.511+0000 7f3ce659c700 1 -- 172.21.15.73:0/3322525309 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce81073f0 con 0x7f3ce81061f0 2023-08-10T11:44:16.359 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.512+0000 7f3ce659c700 1 --2- 172.21.15.73:0/3322525309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce81061f0 0x7f3ce8106610 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3cd80098a0 tx=0x7f3cd8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ea7dd71c2f1a09 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:16.359 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.512+0000 7f3ce559a700 1 -- 172.21.15.73:0/3322525309 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cd8004160 con 0x7f3ce81061f0 2023-08-10T11:44:16.359 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.512+0000 7f3ce559a700 1 -- 172.21.15.73:0/3322525309 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3cd80042c0 con 0x7f3ce81061f0 2023-08-10T11:44:16.360 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.512+0000 7f3ce559a700 1 -- 172.21.15.73:0/3322525309 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cd8011a00 con 0x7f3ce81061f0 2023-08-10T11:44:16.360 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.512+0000 7f3ceca25700 1 -- 172.21.15.73:0/3322525309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce81061f0 msgr2=0x7f3ce8106610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:16.360 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.512+0000 7f3ceca25700 1 --2- 172.21.15.73:0/3322525309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce81061f0 0x7f3ce8106610 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3cd80098a0 tx=0x7f3cd8009bb0 comp rx=0 tx=0).stop 2023-08-10T11:44:16.360 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.512+0000 7f3ceca25700 1 -- 172.21.15.73:0/3322525309 shutdown_connections 2023-08-10T11:44:16.360 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.512+0000 7f3ceca25700 1 --2- 172.21.15.73:0/3322525309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce81061f0 0x7f3ce8106610 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:16.360 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.512+0000 7f3ceca25700 1 -- 172.21.15.73:0/3322525309 >> 172.21.15.73:0/3322525309 conn(0x7f3ce8101790 msgr2=0x7f3ce8103bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:16.361 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.512+0000 7f3ceca25700 1 -- 172.21.15.73:0/3322525309 shutdown_connections 2023-08-10T11:44:16.361 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.512+0000 7f3ceca25700 1 -- 172.21.15.73:0/3322525309 wait complete. 2023-08-10T11:44:16.361 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.513+0000 7f3ceca25700 1 Processor -- start 2023-08-10T11:44:16.361 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.513+0000 7f3ceca25700 1 -- start start 2023-08-10T11:44:16.361 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.513+0000 7f3ceca25700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce81061f0 0x7f3ce8199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:16.361 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.513+0000 7f3ceca25700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce819a490 con 0x7f3ce81061f0 2023-08-10T11:44:16.361 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.513+0000 7f3ce659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce81061f0 0x7f3ce8199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:16.362 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.513+0000 7f3ce659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce81061f0 0x7f3ce8199f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57654/0 (socket says 172.21.15.73:57654) 2023-08-10T11:44:16.362 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.513+0000 7f3ce659c700 1 -- 172.21.15.73:0/3357064028 learned_addr learned my addr 172.21.15.73:0/3357064028 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:16.362 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.514+0000 7f3ce659c700 1 -- 172.21.15.73:0/3357064028 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd8009550 con 0x7f3ce81061f0 2023-08-10T11:44:16.362 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.514+0000 7f3ce659c700 1 --2- 172.21.15.73:0/3357064028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce81061f0 0x7f3ce8199f50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8009fb0 tx=0x7f3cd8011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:16.362 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.514+0000 7f3cd77fe700 1 -- 172.21.15.73:0/3357064028 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cd8003a40 con 0x7f3ce81061f0 2023-08-10T11:44:16.362 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.514+0000 7f3cd77fe700 1 -- 172.21.15.73:0/3357064028 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3cd8003ba0 con 0x7f3ce81061f0 2023-08-10T11:44:16.362 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.514+0000 7f3ceca25700 1 -- 172.21.15.73:0/3357064028 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce819a690 con 0x7f3ce81061f0 2023-08-10T11:44:16.362 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.514+0000 7f3cd77fe700 1 -- 172.21.15.73:0/3357064028 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cd801a750 con 0x7f3ce81061f0 2023-08-10T11:44:16.363 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.514+0000 7f3ceca25700 1 -- 172.21.15.73:0/3357064028 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce819aab0 con 0x7f3ce81061f0 2023-08-10T11:44:16.363 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.515+0000 7f3ceca25700 1 -- 172.21.15.73:0/3357064028 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce8061da0 con 0x7f3ce81061f0 2023-08-10T11:44:16.363 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.515+0000 7f3cd77fe700 1 -- 172.21.15.73:0/3357064028 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) v1 ==== 45472+0+0 (secure 0 0 0) 0x7f3cd8024b60 con 0x7f3ce81061f0 2023-08-10T11:44:16.363 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.516+0000 7f3cd77fe700 1 --2- 172.21.15.73:0/3357064028 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7f3cd0038670 0x7f3cd003ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:16.363 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.516+0000 7f3cd77fe700 1 -- 172.21.15.73:0/3357064028 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3cd804c430 con 0x7f3ce81061f0 2023-08-10T11:44:16.363 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.516+0000 7f3ce5d9b700 1 --2- 172.21.15.73:0/3357064028 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7f3cd0038670 0x7f3cd003ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:16.363 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.516+0000 7f3ce5d9b700 1 --2- 172.21.15.73:0/3357064028 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7f3cd0038670 0x7f3cd003ab30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc006fd0 tx=0x7f3cdc006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:16.364 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.520+0000 7f3cd77fe700 1 -- 172.21.15.73:0/3357064028 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f3cd801a9d0 con 0x7f3ce81061f0 2023-08-10T11:44:16.364 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.705+0000 7f3ceca25700 1 -- 172.21.15.73:0/3357064028 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f3ce810a5f0 con 0x7f3ce81061f0 2023-08-10T11:44:16.364 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.706+0000 7f3cd77fe700 1 -- 172.21.15.73:0/3357064028 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f3cd800b3e0 con 0x7f3ce81061f0 2023-08-10T11:44:16.364 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.708+0000 7f3ceca25700 1 -- 172.21.15.73:0/3357064028 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7f3cd0038670 msgr2=0x7f3cd003ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:16.364 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.708+0000 7f3ceca25700 1 --2- 172.21.15.73:0/3357064028 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7f3cd0038670 0x7f3cd003ab30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc006fd0 tx=0x7f3cdc006e40 comp rx=0 tx=0).stop 2023-08-10T11:44:16.364 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.708+0000 7f3ceca25700 1 -- 172.21.15.73:0/3357064028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce81061f0 msgr2=0x7f3ce8199f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:16.364 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.708+0000 7f3ceca25700 1 --2- 172.21.15.73:0/3357064028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce81061f0 0x7f3ce8199f50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8009fb0 tx=0x7f3cd8011ad0 comp rx=0 tx=0).stop 2023-08-10T11:44:16.364 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.708+0000 7f3ceca25700 1 -- 172.21.15.73:0/3357064028 shutdown_connections 2023-08-10T11:44:16.365 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.708+0000 7f3ceca25700 1 --2- 172.21.15.73:0/3357064028 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7f3cd0038670 0x7f3cd003ab30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:16.365 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.708+0000 7f3ceca25700 1 --2- 172.21.15.73:0/3357064028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ce81061f0 0x7f3ce8199f50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:16.365 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.708+0000 7f3ceca25700 1 -- 172.21.15.73:0/3357064028 >> 172.21.15.73:0/3357064028 conn(0x7f3ce8101790 msgr2=0x7f3ce8102ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:16.365 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.708+0000 7f3ceca25700 1 -- 172.21.15.73:0/3357064028 shutdown_connections 2023-08-10T11:44:16.365 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:12.708+0000 7f3ceca25700 1 -- 172.21.15.73:0/3357064028 wait complete. 2023-08-10T11:44:16.365 INFO:teuthology.orchestra.run.smithi073.stdout:Enabling cephadm module... 2023-08-10T11:44:19.659 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:19 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2380349396' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-08-10T11:44:19.660 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:19 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: ignoring --setuser ceph since I am not root 2023-08-10T11:44:19.660 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:19 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: ignoring --setgroup ceph since I am not root 2023-08-10T11:44:19.660 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:19 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:19.579+0000 7f2d21087200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-10T11:44:19.660 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:19 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:19.658+0000 7f2d21087200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-10T11:44:20.016 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:19 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:19.754+0000 7f2d21087200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-10T11:44:20.017 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:19 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:19.846+0000 7f2d21087200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-10T11:44:20.267 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:20 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:20.015+0000 7f2d21087200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-10T11:44:20.634 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:20 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2380349396' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-08-10T11:44:20.635 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:20 smithi073 ceph-mon[128869]: mgrmap e5: x(active, since 12s) 2023-08-10T11:44:20.635 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:20 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:20.325+0000 7f2d21087200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-10T11:44:20.635 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:20 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:20.413+0000 7f2d21087200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-10T11:44:20.635 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:20 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:20.540+0000 7f2d21087200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-10T11:44:20.635 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:20 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:20.634+0000 7f2d21087200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-10T11:44:20.814 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.395+0000 7f0cb2b75700 1 Processor -- start 2023-08-10T11:44:20.814 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.395+0000 7f0cb2b75700 1 -- start start 2023-08-10T11:44:20.814 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.395+0000 7f0cb2b75700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cac104570 0x7f0cac104990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:20.814 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.395+0000 7f0cb2b75700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cac104f60 con 0x7f0cac104570 2023-08-10T11:44:20.815 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.395+0000 7f0cb0911700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cac104570 0x7f0cac104990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:20.815 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.395+0000 7f0cb0911700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cac104570 0x7f0cac104990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57658/0 (socket says 172.21.15.73:57658) 2023-08-10T11:44:20.815 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.395+0000 7f0cb0911700 1 -- 172.21.15.73:0/3033291179 learned_addr learned my addr 172.21.15.73:0/3033291179 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:20.815 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.395+0000 7f0cb0911700 1 -- 172.21.15.73:0/3033291179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cac107510 con 0x7f0cac104570 2023-08-10T11:44:20.815 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.396+0000 7f0cb0911700 1 --2- 172.21.15.73:0/3033291179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cac104570 0x7f0cac104990 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0ca00098a0 tx=0x7f0ca0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea5889e30c30ad1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:20.815 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.396+0000 7f0cab7fe700 1 -- 172.21.15.73:0/3033291179 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ca0004160 con 0x7f0cac104570 2023-08-10T11:44:20.815 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.396+0000 7f0cab7fe700 1 -- 172.21.15.73:0/3033291179 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0ca00042c0 con 0x7f0cac104570 2023-08-10T11:44:20.815 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.396+0000 7f0cab7fe700 1 -- 172.21.15.73:0/3033291179 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ca0011a00 con 0x7f0cac104570 2023-08-10T11:44:20.816 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.396+0000 7f0cb2b75700 1 -- 172.21.15.73:0/3033291179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cac104570 msgr2=0x7f0cac104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:20.816 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.396+0000 7f0cb2b75700 1 --2- 172.21.15.73:0/3033291179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cac104570 0x7f0cac104990 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0ca00098a0 tx=0x7f0ca0009bb0 comp rx=0 tx=0).stop 2023-08-10T11:44:20.816 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.396+0000 7f0cb2b75700 1 -- 172.21.15.73:0/3033291179 shutdown_connections 2023-08-10T11:44:20.816 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.396+0000 7f0cb2b75700 1 --2- 172.21.15.73:0/3033291179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cac104570 0x7f0cac104990 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:20.816 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.396+0000 7f0cb2b75700 1 -- 172.21.15.73:0/3033291179 >> 172.21.15.73:0/3033291179 conn(0x7f0cac0ffe10 msgr2=0x7f0cac102270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:20.816 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.396+0000 7f0cb2b75700 1 -- 172.21.15.73:0/3033291179 shutdown_connections 2023-08-10T11:44:20.816 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.396+0000 7f0cb2b75700 1 -- 172.21.15.73:0/3033291179 wait complete. 2023-08-10T11:44:20.817 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.397+0000 7f0cb2b75700 1 Processor -- start 2023-08-10T11:44:20.817 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.397+0000 7f0cb2b75700 1 -- start start 2023-08-10T11:44:20.817 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.397+0000 7f0cb2b75700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cac104570 0x7f0cac106e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:20.817 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.397+0000 7f0cb2b75700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cac1073b0 con 0x7f0cac104570 2023-08-10T11:44:20.817 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.397+0000 7f0cb0911700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cac104570 0x7f0cac106e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:20.817 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.397+0000 7f0cb0911700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cac104570 0x7f0cac106e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57660/0 (socket says 172.21.15.73:57660) 2023-08-10T11:44:20.817 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.397+0000 7f0cb0911700 1 -- 172.21.15.73:0/2380349396 learned_addr learned my addr 172.21.15.73:0/2380349396 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:20.818 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.398+0000 7f0cb0911700 1 -- 172.21.15.73:0/2380349396 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca0009550 con 0x7f0cac104570 2023-08-10T11:44:20.818 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.398+0000 7f0cb0911700 1 --2- 172.21.15.73:0/2380349396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cac104570 0x7f0cac106e70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0009fb0 tx=0x7f0ca0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:20.818 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.398+0000 7f0ca9ffb700 1 -- 172.21.15.73:0/2380349396 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ca0003a40 con 0x7f0cac104570 2023-08-10T11:44:20.818 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.398+0000 7f0ca9ffb700 1 -- 172.21.15.73:0/2380349396 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0ca0003ba0 con 0x7f0cac104570 2023-08-10T11:44:20.818 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.398+0000 7f0cb2b75700 1 -- 172.21.15.73:0/2380349396 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cac1054c0 con 0x7f0cac104570 2023-08-10T11:44:20.818 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.398+0000 7f0ca9ffb700 1 -- 172.21.15.73:0/2380349396 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ca001a750 con 0x7f0cac104570 2023-08-10T11:44:20.818 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.398+0000 7f0cb2b75700 1 -- 172.21.15.73:0/2380349396 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cac1058e0 con 0x7f0cac104570 2023-08-10T11:44:20.818 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.399+0000 7f0ca9ffb700 1 -- 172.21.15.73:0/2380349396 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) v1 ==== 45472+0+0 (secure 0 0 0) 0x7f0ca0024430 con 0x7f0cac104570 2023-08-10T11:44:20.819 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.399+0000 7f0cb2b75700 1 -- 172.21.15.73:0/2380349396 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cac061da0 con 0x7f0cac104570 2023-08-10T11:44:20.819 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.399+0000 7f0ca9ffb700 1 --2- 172.21.15.73:0/2380349396 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7f0c9c0386c0 0x7f0c9c03ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:20.819 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.399+0000 7f0ca9ffb700 1 -- 172.21.15.73:0/2380349396 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0ca004c2d0 con 0x7f0cac104570 2023-08-10T11:44:20.819 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.399+0000 7f0cabfff700 1 --2- 172.21.15.73:0/2380349396 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7f0c9c0386c0 0x7f0c9c03ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:20.819 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.400+0000 7f0cabfff700 1 --2- 172.21.15.73:0/2380349396 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7f0c9c0386c0 0x7f0c9c03ab80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0c98006fd0 tx=0x7f0c98006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:20.819 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.404+0000 7f0ca9ffb700 1 -- 172.21.15.73:0/2380349396 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0ca0024b60 con 0x7f0cac104570 2023-08-10T11:44:20.819 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:18.643+0000 7f0cb2b75700 1 -- 172.21.15.73:0/2380349396 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f0cac10a710 con 0x7f0cac104570 2023-08-10T11:44:20.820 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:19.410+0000 7f0ca9ffb700 1 -- 172.21.15.73:0/2380349396 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 5) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f0ca002d3f0 con 0x7f0cac104570 2023-08-10T11:44:20.820 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:19.411+0000 7f0ca9ffb700 1 -- 172.21.15.73:0/2380349396 <== mon.0 v2:172.21.15.73:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f0ca002cc00 con 0x7f0cac104570 2023-08-10T11:44:20.820 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:19.415+0000 7f0cb2b75700 1 -- 172.21.15.73:0/2380349396 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7f0c9c0386c0 msgr2=0x7f0c9c03ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:20.820 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:19.415+0000 7f0cb2b75700 1 --2- 172.21.15.73:0/2380349396 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7f0c9c0386c0 0x7f0c9c03ab80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0c98006fd0 tx=0x7f0c98006e40 comp rx=0 tx=0).stop 2023-08-10T11:44:20.820 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:19.415+0000 7f0cb2b75700 1 -- 172.21.15.73:0/2380349396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cac104570 msgr2=0x7f0cac106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:20.820 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:19.415+0000 7f0cb2b75700 1 --2- 172.21.15.73:0/2380349396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cac104570 0x7f0cac106e70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0009fb0 tx=0x7f0ca0011ad0 comp rx=0 tx=0).stop 2023-08-10T11:44:20.820 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:19.415+0000 7f0cb2b75700 1 -- 172.21.15.73:0/2380349396 shutdown_connections 2023-08-10T11:44:20.820 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:19.415+0000 7f0cb2b75700 1 --2- 172.21.15.73:0/2380349396 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7f0c9c0386c0 0x7f0c9c03ab80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:20.821 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:19.415+0000 7f0cb2b75700 1 --2- 172.21.15.73:0/2380349396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cac104570 0x7f0cac106e70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:20.821 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:19.415+0000 7f0cb2b75700 1 -- 172.21.15.73:0/2380349396 >> 172.21.15.73:0/2380349396 conn(0x7f0cac0ffe10 msgr2=0x7f0cac101500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:20.821 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:19.416+0000 7f0cb2b75700 1 -- 172.21.15.73:0/2380349396 shutdown_connections 2023-08-10T11:44:20.821 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:19.416+0000 7f0cb2b75700 1 -- 172.21.15.73:0/2380349396 wait complete. 2023-08-10T11:44:21.517 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:21 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:21.072+0000 7f2d21087200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-10T11:44:21.907 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:21 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2989946926' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-08-10T11:44:21.908 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:21 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:21.659+0000 7f2d21087200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-10T11:44:21.908 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:21 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:21.830+0000 7f2d21087200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-10T11:44:21.964 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2023-08-10T11:44:21.965 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-08-10T11:44:21.965 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "available": true, 2023-08-10T11:44:21.965 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-08-10T11:44:21.965 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-08-10T11:44:21.965 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2023-08-10T11:44:21.966 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.283+0000 7f11d0276700 1 Processor -- start 2023-08-10T11:44:21.966 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.283+0000 7f11d0276700 1 -- start start 2023-08-10T11:44:21.966 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.283+0000 7f11d0276700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11c8106c70 0x7f11c8109060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:21.966 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.283+0000 7f11d0276700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c8073fb0 con 0x7f11c8106c70 2023-08-10T11:44:21.966 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.283+0000 7f11ce012700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11c8106c70 0x7f11c8109060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:21.966 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.283+0000 7f11ce012700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11c8106c70 0x7f11c8109060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57676/0 (socket says 172.21.15.73:57676) 2023-08-10T11:44:21.966 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.283+0000 7f11ce012700 1 -- 172.21.15.73:0/357021699 learned_addr learned my addr 172.21.15.73:0/357021699 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:21.966 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.284+0000 7f11ce012700 1 -- 172.21.15.73:0/357021699 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c81095a0 con 0x7f11c8106c70 2023-08-10T11:44:21.967 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.284+0000 7f11ce012700 1 --2- 172.21.15.73:0/357021699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11c8106c70 0x7f11c8109060 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f11c40098a0 tx=0x7f11c4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b0ee190efe65c9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:21.967 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.284+0000 7f11cd010700 1 -- 172.21.15.73:0/357021699 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11c4004160 con 0x7f11c8106c70 2023-08-10T11:44:21.967 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.284+0000 7f11cd010700 1 -- 172.21.15.73:0/357021699 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f11c40042c0 con 0x7f11c8106c70 2023-08-10T11:44:21.967 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.284+0000 7f11cd010700 1 -- 172.21.15.73:0/357021699 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11c4011a00 con 0x7f11c8106c70 2023-08-10T11:44:21.967 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.284+0000 7f11d0276700 1 -- 172.21.15.73:0/357021699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11c8106c70 msgr2=0x7f11c8109060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:21.967 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.284+0000 7f11d0276700 1 --2- 172.21.15.73:0/357021699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11c8106c70 0x7f11c8109060 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f11c40098a0 tx=0x7f11c4009bb0 comp rx=0 tx=0).stop 2023-08-10T11:44:21.967 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.285+0000 7f11d0276700 1 -- 172.21.15.73:0/357021699 shutdown_connections 2023-08-10T11:44:21.968 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.285+0000 7f11d0276700 1 --2- 172.21.15.73:0/357021699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11c8106c70 0x7f11c8109060 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:21.968 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.285+0000 7f11d0276700 1 -- 172.21.15.73:0/357021699 >> 172.21.15.73:0/357021699 conn(0x7f11c8100680 msgr2=0x7f11c8102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:21.968 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.285+0000 7f11d0276700 1 -- 172.21.15.73:0/357021699 shutdown_connections 2023-08-10T11:44:21.968 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.285+0000 7f11d0276700 1 -- 172.21.15.73:0/357021699 wait complete. 2023-08-10T11:44:21.968 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.285+0000 7f11d0276700 1 Processor -- start 2023-08-10T11:44:21.968 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.285+0000 7f11d0276700 1 -- start start 2023-08-10T11:44:21.968 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.285+0000 7f11d0276700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11c8106c70 0x7f11c819c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:21.968 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.285+0000 7f11d0276700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c819c600 con 0x7f11c8106c70 2023-08-10T11:44:21.969 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.286+0000 7f11ce012700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11c8106c70 0x7f11c819c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:21.969 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.286+0000 7f11ce012700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11c8106c70 0x7f11c819c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57678/0 (socket says 172.21.15.73:57678) 2023-08-10T11:44:21.969 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.286+0000 7f11ce012700 1 -- 172.21.15.73:0/2989946926 learned_addr learned my addr 172.21.15.73:0/2989946926 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:21.969 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.286+0000 7f11ce012700 1 -- 172.21.15.73:0/2989946926 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c4009550 con 0x7f11c8106c70 2023-08-10T11:44:21.969 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.286+0000 7f11ce012700 1 --2- 172.21.15.73:0/2989946926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11c8106c70 0x7f11c819c0c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009fb0 tx=0x7f11c4011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:21.969 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.286+0000 7f11bf7fe700 1 -- 172.21.15.73:0/2989946926 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11c4003a40 con 0x7f11c8106c70 2023-08-10T11:44:21.969 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.286+0000 7f11bf7fe700 1 -- 172.21.15.73:0/2989946926 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f11c4003ba0 con 0x7f11c8106c70 2023-08-10T11:44:21.970 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.286+0000 7f11d0276700 1 -- 172.21.15.73:0/2989946926 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c819c800 con 0x7f11c8106c70 2023-08-10T11:44:21.970 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.286+0000 7f11bf7fe700 1 -- 172.21.15.73:0/2989946926 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11c401a750 con 0x7f11c8106c70 2023-08-10T11:44:21.970 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.286+0000 7f11d0276700 1 -- 172.21.15.73:0/2989946926 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c819cc20 con 0x7f11c8106c70 2023-08-10T11:44:21.970 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.287+0000 7f11bf7fe700 1 -- 172.21.15.73:0/2989946926 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f11c401a980 con 0x7f11c8106c70 2023-08-10T11:44:21.970 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.287+0000 7f11d0276700 1 -- 172.21.15.73:0/2989946926 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c8061da0 con 0x7f11c8106c70 2023-08-10T11:44:21.970 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.287+0000 7f11bf7fe700 1 --2- 172.21.15.73:0/2989946926 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7f11b4038710 0x7f11b403abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:21.970 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.287+0000 7f11cd811700 1 -- 172.21.15.73:0/2989946926 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7f11b4038710 msgr2=0x7f11b403abd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/3290717807 2023-08-10T11:44:21.970 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.287+0000 7f11bf7fe700 1 -- 172.21.15.73:0/2989946926 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f11c404c5b0 con 0x7f11c8106c70 2023-08-10T11:44:21.971 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.287+0000 7f11cd811700 1 --2- 172.21.15.73:0/2989946926 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7f11b4038710 0x7f11b403abd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-10T11:44:21.971 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.292+0000 7f11bf7fe700 1 -- 172.21.15.73:0/2989946926 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f11c4018b80 con 0x7f11c8106c70 2023-08-10T11:44:21.971 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.488+0000 7f11cd811700 1 -- 172.21.15.73:0/2989946926 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7f11b4038710 msgr2=0x7f11b403abd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/3290717807 2023-08-10T11:44:21.971 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.488+0000 7f11cd811700 1 --2- 172.21.15.73:0/2989946926 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7f11b4038710 0x7f11b403abd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-10T11:44:21.971 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.571+0000 7f11d0276700 1 -- 172.21.15.73:0/2989946926 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f11c819f660 con 0x7f11c8106c70 2023-08-10T11:44:21.971 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.571+0000 7f11bf7fe700 1 -- 172.21.15.73:0/2989946926 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f11c4018350 con 0x7f11c8106c70 2023-08-10T11:44:21.971 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.573+0000 7f11d0276700 1 -- 172.21.15.73:0/2989946926 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7f11b4038710 msgr2=0x7f11b403abd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T11:44:21.972 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.573+0000 7f11d0276700 1 --2- 172.21.15.73:0/2989946926 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7f11b4038710 0x7f11b403abd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:21.972 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.573+0000 7f11d0276700 1 -- 172.21.15.73:0/2989946926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11c8106c70 msgr2=0x7f11c819c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:21.972 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.573+0000 7f11d0276700 1 --2- 172.21.15.73:0/2989946926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11c8106c70 0x7f11c819c0c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009fb0 tx=0x7f11c4011ad0 comp rx=0 tx=0).stop 2023-08-10T11:44:21.972 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.573+0000 7f11d0276700 1 -- 172.21.15.73:0/2989946926 shutdown_connections 2023-08-10T11:44:21.972 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.573+0000 7f11d0276700 1 --2- 172.21.15.73:0/2989946926 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7f11b4038710 0x7f11b403abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:21.972 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.573+0000 7f11d0276700 1 --2- 172.21.15.73:0/2989946926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11c8106c70 0x7f11c819c0c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:21.972 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.573+0000 7f11d0276700 1 -- 172.21.15.73:0/2989946926 >> 172.21.15.73:0/2989946926 conn(0x7f11c8100680 msgr2=0x7f11c8101d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:21.972 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.573+0000 7f11d0276700 1 -- 172.21.15.73:0/2989946926 shutdown_connections 2023-08-10T11:44:21.973 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:21.573+0000 7f11d0276700 1 -- 172.21.15.73:0/2989946926 wait complete. 2023-08-10T11:44:21.973 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for the mgr to restart... 2023-08-10T11:44:21.973 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for mgr epoch 5... 2023-08-10T11:44:22.888 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:22 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:22.628+0000 7f2d21087200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-10T11:44:22.888 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:22 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:22.718+0000 7f2d21087200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-10T11:44:23.161 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:22 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:22.887+0000 7f2d21087200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-10T11:44:23.517 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:23 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:23.161+0000 7f2d21087200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-10T11:44:23.517 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:23 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:23.383+0000 7f2d21087200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-10T11:44:23.787 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:23 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:23.529+0000 7f2d21087200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-10T11:44:24.267 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:23 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:23.786+0000 7f2d21087200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-10T11:44:24.768 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:24 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:24.476+0000 7f2d21087200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-10T11:44:24.768 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:24 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:24.605+0000 7f2d21087200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-10T11:44:25.116 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:24 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:24.792+0000 7f2d21087200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-10T11:44:25.116 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:24 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:24.904+0000 7f2d21087200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-10T11:44:25.517 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:25 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:25.115+0000 7f2d21087200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-10T11:44:26.267 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:25 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:25.961+0000 7f2d21087200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-10T11:44:26.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:26 smithi073 ceph-mon[128869]: Active manager daemon x restarted 2023-08-10T11:44:26.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:26 smithi073 ceph-mon[128869]: Activating manager daemon x 2023-08-10T11:44:26.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:26 smithi073 ceph-mon[128869]: osdmap e2: 0 total, 0 up, 0 in 2023-08-10T11:44:26.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:26 smithi073 ceph-mon[128869]: mgrmap e6: x(active, starting, since 0.003289s) 2023-08-10T11:44:26.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:26 smithi073 ceph-mon[128869]: from='mgr.14120 172.21.15.73:0/1146817848' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T11:44:26.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:26 smithi073 ceph-mon[128869]: from='mgr.14120 172.21.15.73:0/1146817848' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-08-10T11:44:26.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:26 smithi073 ceph-mon[128869]: from='mgr.14120 172.21.15.73:0/1146817848' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-08-10T11:44:26.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:26 smithi073 ceph-mon[128869]: from='mgr.14120 172.21.15.73:0/1146817848' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-08-10T11:44:26.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:26 smithi073 ceph-mon[128869]: from='mgr.14120 172.21.15.73:0/1146817848' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-08-10T11:44:26.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:26 smithi073 ceph-mon[128869]: Manager daemon x is now available 2023-08-10T11:44:26.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:26 smithi073 ceph-mon[128869]: from='mgr.14120 172.21.15.73:0/1146817848' entity='mgr.x' 2023-08-10T11:44:26.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:26 smithi073 ceph-mon[128869]: from='mgr.14120 172.21.15.73:0/1146817848' entity='mgr.x' 2023-08-10T11:44:26.270 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:26 smithi073 ceph-mon[128869]: from='mgr.14120 172.21.15.73:0/1146817848' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:44:26.270 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:26 smithi073 ceph-mon[128869]: from='mgr.14120 172.21.15.73:0/1146817848' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:44:26.270 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:26 smithi073 ceph-mon[128869]: from='mgr.14120 172.21.15.73:0/1146817848' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:44:27.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:27 smithi073 ceph-mon[128869]: Found migration_current of "None". Setting to last migration. 2023-08-10T11:44:27.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:27 smithi073 ceph-mon[128869]: from='mgr.14120 172.21.15.73:0/1146817848' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-08-10T11:44:27.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:27 smithi073 ceph-mon[128869]: from='mgr.14120 172.21.15.73:0/1146817848' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-08-10T11:44:27.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:27 smithi073 ceph-mon[128869]: from='mgr.14120 172.21.15.73:0/1146817848' entity='mgr.x' 2023-08-10T11:44:27.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:27 smithi073 ceph-mon[128869]: from='mgr.14120 172.21.15.73:0/1146817848' entity='mgr.x' 2023-08-10T11:44:27.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:27 smithi073 ceph-mon[128869]: mgrmap e7: x(active, since 1.00528s) 2023-08-10T11:44:27.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2023-08-10T11:44:27.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-08-10T11:44:27.419 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "initialized": true 2023-08-10T11:44:27.420 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2023-08-10T11:44:27.420 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.466+0000 7fce111f3700 1 Processor -- start 2023-08-10T11:44:27.420 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.466+0000 7fce111f3700 1 -- start start 2023-08-10T11:44:27.420 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.466+0000 7fce111f3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce0c104ad0 0x7fce0c104ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:27.420 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.466+0000 7fce111f3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c079dc0 con 0x7fce0c104ad0 2023-08-10T11:44:27.420 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.467+0000 7fce0ad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce0c104ad0 0x7fce0c104ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:27.421 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.467+0000 7fce0ad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce0c104ad0 0x7fce0c104ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57686/0 (socket says 172.21.15.73:57686) 2023-08-10T11:44:27.421 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.467+0000 7fce0ad9d700 1 -- 172.21.15.73:0/701217517 learned_addr learned my addr 172.21.15.73:0/701217517 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:27.421 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.467+0000 7fce0ad9d700 1 -- 172.21.15.73:0/701217517 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0c105430 con 0x7fce0c104ad0 2023-08-10T11:44:27.421 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.467+0000 7fce0ad9d700 1 --2- 172.21.15.73:0/701217517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce0c104ad0 0x7fce0c104ef0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0098a0 tx=0x7fcdfc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132e992663d74df5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:27.421 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.467+0000 7fce09d9b700 1 -- 172.21.15.73:0/701217517 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdfc004160 con 0x7fce0c104ad0 2023-08-10T11:44:27.422 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.467+0000 7fce09d9b700 1 -- 172.21.15.73:0/701217517 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcdfc0042c0 con 0x7fce0c104ad0 2023-08-10T11:44:27.422 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.467+0000 7fce09d9b700 1 -- 172.21.15.73:0/701217517 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdfc011a00 con 0x7fce0c104ad0 2023-08-10T11:44:27.422 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.468+0000 7fce111f3700 1 -- 172.21.15.73:0/701217517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce0c104ad0 msgr2=0x7fce0c104ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:27.422 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.468+0000 7fce111f3700 1 --2- 172.21.15.73:0/701217517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce0c104ad0 0x7fce0c104ef0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0098a0 tx=0x7fcdfc009bb0 comp rx=0 tx=0).stop 2023-08-10T11:44:27.422 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.468+0000 7fce111f3700 1 -- 172.21.15.73:0/701217517 shutdown_connections 2023-08-10T11:44:27.422 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.468+0000 7fce111f3700 1 --2- 172.21.15.73:0/701217517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce0c104ad0 0x7fce0c104ef0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:27.422 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.468+0000 7fce111f3700 1 -- 172.21.15.73:0/701217517 >> 172.21.15.73:0/701217517 conn(0x7fce0c100670 msgr2=0x7fce0c102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:27.423 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.468+0000 7fce111f3700 1 -- 172.21.15.73:0/701217517 shutdown_connections 2023-08-10T11:44:27.423 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.468+0000 7fce111f3700 1 -- 172.21.15.73:0/701217517 wait complete. 2023-08-10T11:44:27.423 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.469+0000 7fce111f3700 1 Processor -- start 2023-08-10T11:44:27.423 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.469+0000 7fce111f3700 1 -- start start 2023-08-10T11:44:27.423 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.469+0000 7fce111f3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce0c104ad0 0x7fce0c19c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:27.423 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.469+0000 7fce111f3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c19c6a0 con 0x7fce0c104ad0 2023-08-10T11:44:27.423 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.470+0000 7fce0ad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce0c104ad0 0x7fce0c19c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:27.423 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.470+0000 7fce0ad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce0c104ad0 0x7fce0c19c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57688/0 (socket says 172.21.15.73:57688) 2023-08-10T11:44:27.424 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.470+0000 7fce0ad9d700 1 -- 172.21.15.73:0/770001506 learned_addr learned my addr 172.21.15.73:0/770001506 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:27.424 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.470+0000 7fce0ad9d700 1 -- 172.21.15.73:0/770001506 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdfc009550 con 0x7fce0c104ad0 2023-08-10T11:44:27.424 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.470+0000 7fce0ad9d700 1 --2- 172.21.15.73:0/770001506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce0c104ad0 0x7fce0c19c160 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc009fb0 tx=0x7fcdfc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:27.424 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.470+0000 7fcdf3fff700 1 -- 172.21.15.73:0/770001506 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdfc003a40 con 0x7fce0c104ad0 2023-08-10T11:44:27.424 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.470+0000 7fce111f3700 1 -- 172.21.15.73:0/770001506 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce0c19c8a0 con 0x7fce0c104ad0 2023-08-10T11:44:27.424 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.470+0000 7fcdf3fff700 1 -- 172.21.15.73:0/770001506 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcdfc003ba0 con 0x7fce0c104ad0 2023-08-10T11:44:27.424 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.470+0000 7fcdf3fff700 1 -- 172.21.15.73:0/770001506 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdfc01a750 con 0x7fce0c104ad0 2023-08-10T11:44:27.425 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.470+0000 7fce111f3700 1 -- 172.21.15.73:0/770001506 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce0c19ccc0 con 0x7fce0c104ad0 2023-08-10T11:44:27.425 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.471+0000 7fcdf3fff700 1 -- 172.21.15.73:0/770001506 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 45483+0+0 (secure 0 0 0) 0x7fcdfc01a9d0 con 0x7fce0c104ad0 2023-08-10T11:44:27.425 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.471+0000 7fcdf3fff700 1 --2- 172.21.15.73:0/770001506 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7fcdf40386c0 0x7fcdf403ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:27.425 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.471+0000 7fcdf3fff700 1 -- 172.21.15.73:0/770001506 --> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcdf403b290 con 0x7fcdf40386c0 2023-08-10T11:44:27.425 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.472+0000 7fce0a59c700 1 -- 172.21.15.73:0/770001506 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7fcdf40386c0 msgr2=0x7fcdf403ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/3290717807 2023-08-10T11:44:27.425 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.472+0000 7fcdf3fff700 1 -- 172.21.15.73:0/770001506 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fcdfc04c3d0 con 0x7fce0c104ad0 2023-08-10T11:44:27.425 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.472+0000 7fce0a59c700 1 --2- 172.21.15.73:0/770001506 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7fcdf40386c0 0x7fcdf403ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-10T11:44:27.425 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.673+0000 7fce0a59c700 1 -- 172.21.15.73:0/770001506 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7fcdf40386c0 msgr2=0x7fcdf403ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/3290717807 2023-08-10T11:44:27.426 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:22.673+0000 7fce0a59c700 1 --2- 172.21.15.73:0/770001506 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7fcdf40386c0 0x7fcdf403ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-10T11:44:27.426 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:23.074+0000 7fce0a59c700 1 -- 172.21.15.73:0/770001506 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7fcdf40386c0 msgr2=0x7fcdf403ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/3290717807 2023-08-10T11:44:27.426 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:23.074+0000 7fce0a59c700 1 --2- 172.21.15.73:0/770001506 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7fcdf40386c0 0x7fcdf403ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-08-10T11:44:27.426 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:23.875+0000 7fce0a59c700 1 -- 172.21.15.73:0/770001506 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7fcdf40386c0 msgr2=0x7fcdf403ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/3290717807 2023-08-10T11:44:27.426 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:23.875+0000 7fce0a59c700 1 --2- 172.21.15.73:0/770001506 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7fcdf40386c0 0x7fcdf403ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-08-10T11:44:27.426 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:25.476+0000 7fce0a59c700 1 -- 172.21.15.73:0/770001506 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7fcdf40386c0 msgr2=0x7fcdf403ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/3290717807 2023-08-10T11:44:27.426 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:25.476+0000 7fce0a59c700 1 --2- 172.21.15.73:0/770001506 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7fcdf40386c0 0x7fcdf403ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-08-10T11:44:27.427 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:25.976+0000 7fcdf3fff700 1 -- 172.21.15.73:0/770001506 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mgrmap(e 6) v1 ==== 45250+0+0 (secure 0 0 0) 0x7fcdfc02d9b0 con 0x7fce0c104ad0 2023-08-10T11:44:27.427 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:25.976+0000 7fcdf3fff700 1 -- 172.21.15.73:0/770001506 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7fcdf40386c0 msgr2=0x7fcdf403ab80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T11:44:27.427 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:25.976+0000 7fcdf3fff700 1 --2- 172.21.15.73:0/770001506 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7fcdf40386c0 0x7fcdf403ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:27.427 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:26.977+0000 7fcdf3fff700 1 -- 172.21.15.73:0/770001506 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 7) v1 ==== 45377+0+0 (secure 0 0 0) 0x7fcdfc00bac0 con 0x7fce0c104ad0 2023-08-10T11:44:27.427 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:26.978+0000 7fcdf3fff700 1 --2- 172.21.15.73:0/770001506 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fcdf403bff0 0x7fcdf403e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:27.427 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:26.978+0000 7fcdf3fff700 1 -- 172.21.15.73:0/770001506 --> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcdf403b290 con 0x7fcdf403bff0 2023-08-10T11:44:27.427 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:26.978+0000 7fce0a59c700 1 --2- 172.21.15.73:0/770001506 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fcdf403bff0 0x7fcdf403e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:27.428 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:26.978+0000 7fce0a59c700 1 --2- 172.21.15.73:0/770001506 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fcdf403bff0 0x7fcdf403e3e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fce00003a10 tx=0x7fce00009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:27.428 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:26.979+0000 7fcdf3fff700 1 -- 172.21.15.73:0/770001506 <== mgr.14120 v2:172.21.15.73:6800/16358451 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7fcdf403b290 con 0x7fcdf403bff0 2023-08-10T11:44:27.428 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:26.985+0000 7fce111f3700 1 -- 172.21.15.73:0/770001506 --> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fce0c19d4a0 con 0x7fcdf403bff0 2023-08-10T11:44:27.428 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:26.985+0000 7fcdf3fff700 1 -- 172.21.15.73:0/770001506 <== mgr.14120 v2:172.21.15.73:6800/16358451 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fce0c19d4a0 con 0x7fcdf403bff0 2023-08-10T11:44:27.428 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:26.985+0000 7fce111f3700 1 -- 172.21.15.73:0/770001506 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fcdf403bff0 msgr2=0x7fcdf403e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:27.428 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:26.985+0000 7fce111f3700 1 --2- 172.21.15.73:0/770001506 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fcdf403bff0 0x7fcdf403e3e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fce00003a10 tx=0x7fce00009290 comp rx=0 tx=0).stop 2023-08-10T11:44:27.428 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:26.985+0000 7fce111f3700 1 -- 172.21.15.73:0/770001506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce0c104ad0 msgr2=0x7fce0c19c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:27.428 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:26.985+0000 7fce111f3700 1 --2- 172.21.15.73:0/770001506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce0c104ad0 0x7fce0c19c160 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc009fb0 tx=0x7fcdfc011ad0 comp rx=0 tx=0).stop 2023-08-10T11:44:27.429 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:26.986+0000 7fce111f3700 1 -- 172.21.15.73:0/770001506 shutdown_connections 2023-08-10T11:44:27.429 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:26.986+0000 7fce111f3700 1 --2- 172.21.15.73:0/770001506 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fcdf403bff0 0x7fcdf403e3e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:27.429 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:26.986+0000 7fce111f3700 1 --2- 172.21.15.73:0/770001506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce0c104ad0 0x7fce0c19c160 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:27.429 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:26.986+0000 7fce111f3700 1 --2- 172.21.15.73:0/770001506 >> [v2:172.21.15.73:6800/3290717807,v1:172.21.15.73:6801/3290717807] conn(0x7fcdf40386c0 0x7fcdf403ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:27.429 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:26.986+0000 7fce111f3700 1 -- 172.21.15.73:0/770001506 >> 172.21.15.73:0/770001506 conn(0x7fce0c100670 msgr2=0x7fce0c190690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:27.429 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:26.986+0000 7fce111f3700 1 -- 172.21.15.73:0/770001506 shutdown_connections 2023-08-10T11:44:27.429 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:26.986+0000 7fce111f3700 1 -- 172.21.15.73:0/770001506 wait complete. 2023-08-10T11:44:27.430 INFO:teuthology.orchestra.run.smithi073.stdout:mgr epoch 5 is available 2023-08-10T11:44:27.430 INFO:teuthology.orchestra.run.smithi073.stdout:Setting orchestrator backend to cephadm... 2023-08-10T11:44:28.462 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.869+0000 7feeb6153700 1 Processor -- start 2023-08-10T11:44:28.463 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.869+0000 7feeb6153700 1 -- start start 2023-08-10T11:44:28.463 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.869+0000 7feeb6153700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feeb0105100 0x7feeb0105520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:28.463 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.869+0000 7feeb6153700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb0105af0 con 0x7feeb0105100 2023-08-10T11:44:28.463 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.869+0000 7feeaf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feeb0105100 0x7feeb0105520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:28.463 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.869+0000 7feeaf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feeb0105100 0x7feeb0105520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57738/0 (socket says 172.21.15.73:57738) 2023-08-10T11:44:28.463 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.869+0000 7feeaf7fe700 1 -- 172.21.15.73:0/3483023448 learned_addr learned my addr 172.21.15.73:0/3483023448 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:28.464 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.869+0000 7feeaf7fe700 1 -- 172.21.15.73:0/3483023448 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb0106300 con 0x7feeb0105100 2023-08-10T11:44:28.464 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.869+0000 7feeaf7fe700 1 --2- 172.21.15.73:0/3483023448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feeb0105100 0x7feeb0105520 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7feea00098a0 tx=0x7feea0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df3e690677cc24dc server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:28.464 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.870+0000 7feeae7fc700 1 -- 172.21.15.73:0/3483023448 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feea0004160 con 0x7feeb0105100 2023-08-10T11:44:28.464 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.870+0000 7feeae7fc700 1 -- 172.21.15.73:0/3483023448 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feea00042c0 con 0x7feeb0105100 2023-08-10T11:44:28.464 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.870+0000 7feeae7fc700 1 -- 172.21.15.73:0/3483023448 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feea0011a00 con 0x7feeb0105100 2023-08-10T11:44:28.464 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.870+0000 7feeb6153700 1 -- 172.21.15.73:0/3483023448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feeb0105100 msgr2=0x7feeb0105520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:28.464 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.870+0000 7feeb6153700 1 --2- 172.21.15.73:0/3483023448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feeb0105100 0x7feeb0105520 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7feea00098a0 tx=0x7feea0009bb0 comp rx=0 tx=0).stop 2023-08-10T11:44:28.465 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.870+0000 7feeb6153700 1 -- 172.21.15.73:0/3483023448 shutdown_connections 2023-08-10T11:44:28.465 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.870+0000 7feeb6153700 1 --2- 172.21.15.73:0/3483023448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feeb0105100 0x7feeb0105520 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:28.465 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.870+0000 7feeb6153700 1 -- 172.21.15.73:0/3483023448 >> 172.21.15.73:0/3483023448 conn(0x7feeb0100680 msgr2=0x7feeb0102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:28.465 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.870+0000 7feeb6153700 1 -- 172.21.15.73:0/3483023448 shutdown_connections 2023-08-10T11:44:28.465 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.870+0000 7feeb6153700 1 -- 172.21.15.73:0/3483023448 wait complete. 2023-08-10T11:44:28.465 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.871+0000 7feeb6153700 1 Processor -- start 2023-08-10T11:44:28.465 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.871+0000 7feeb6153700 1 -- start start 2023-08-10T11:44:28.466 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.871+0000 7feeb6153700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feeb0105100 0x7feeb0073c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:28.466 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.871+0000 7feeb6153700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb019cc60 con 0x7feeb0105100 2023-08-10T11:44:28.466 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.871+0000 7feeaf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feeb0105100 0x7feeb0073c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:28.466 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.871+0000 7feeaf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feeb0105100 0x7feeb0073c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57740/0 (socket says 172.21.15.73:57740) 2023-08-10T11:44:28.466 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.871+0000 7feeaf7fe700 1 -- 172.21.15.73:0/750885495 learned_addr learned my addr 172.21.15.73:0/750885495 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:28.466 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.871+0000 7feeaf7fe700 1 -- 172.21.15.73:0/750885495 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea0009550 con 0x7feeb0105100 2023-08-10T11:44:28.466 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.872+0000 7feeaf7fe700 1 --2- 172.21.15.73:0/750885495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feeb0105100 0x7feeb0073c50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7feea0009130 tx=0x7feea0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:28.466 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.872+0000 7feeacff9700 1 -- 172.21.15.73:0/750885495 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feea0003ab0 con 0x7feeb0105100 2023-08-10T11:44:28.467 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.872+0000 7feeacff9700 1 -- 172.21.15.73:0/750885495 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feea0003c10 con 0x7feeb0105100 2023-08-10T11:44:28.467 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.872+0000 7feeacff9700 1 -- 172.21.15.73:0/750885495 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feea00247d0 con 0x7feeb0105100 2023-08-10T11:44:28.467 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.872+0000 7feeb6153700 1 -- 172.21.15.73:0/750885495 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb019cda0 con 0x7feeb0105100 2023-08-10T11:44:28.467 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.872+0000 7feeb6153700 1 -- 172.21.15.73:0/750885495 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb019d1c0 con 0x7feeb0105100 2023-08-10T11:44:28.467 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.873+0000 7feeacff9700 1 -- 172.21.15.73:0/750885495 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 7) v1 ==== 45377+0+0 (secure 0 0 0) 0x7feea001a430 con 0x7feeb0105100 2023-08-10T11:44:28.467 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.873+0000 7feeacff9700 1 --2- 172.21.15.73:0/750885495 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fee98038630 0x7fee9803aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:28.467 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.873+0000 7feeacff9700 1 -- 172.21.15.73:0/750885495 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7feea004c630 con 0x7feeb0105100 2023-08-10T11:44:28.467 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.873+0000 7feeaeffd700 1 --2- 172.21.15.73:0/750885495 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fee98038630 0x7fee9803aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:28.468 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.873+0000 7feeb6153700 1 -- 172.21.15.73:0/750885495 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb0061da0 con 0x7feeb0105100 2023-08-10T11:44:28.468 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.873+0000 7feeaeffd700 1 --2- 172.21.15.73:0/750885495 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fee98038630 0x7fee9803aaf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7feea4006fd0 tx=0x7feea4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:28.468 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:27.878+0000 7feeacff9700 1 -- 172.21.15.73:0/750885495 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7feea001a730 con 0x7feeb0105100 2023-08-10T11:44:28.468 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.029+0000 7feeacff9700 1 -- 172.21.15.73:0/750885495 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7feea002d910 con 0x7feeb0105100 2023-08-10T11:44:28.468 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.080+0000 7feeb6153700 1 -- 172.21.15.73:0/750885495 --> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7feeb0102a00 con 0x7fee98038630 2023-08-10T11:44:28.468 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.085+0000 7feeacff9700 1 -- 172.21.15.73:0/750885495 <== mgr.14120 v2:172.21.15.73:6800/16358451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7feeb0102a00 con 0x7fee98038630 2023-08-10T11:44:28.468 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.087+0000 7feeb6153700 1 -- 172.21.15.73:0/750885495 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fee98038630 msgr2=0x7fee9803aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:28.469 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.087+0000 7feeb6153700 1 --2- 172.21.15.73:0/750885495 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fee98038630 0x7fee9803aaf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7feea4006fd0 tx=0x7feea4006e40 comp rx=0 tx=0).stop 2023-08-10T11:44:28.469 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.087+0000 7feeb6153700 1 -- 172.21.15.73:0/750885495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feeb0105100 msgr2=0x7feeb0073c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:28.469 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.087+0000 7feeb6153700 1 --2- 172.21.15.73:0/750885495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feeb0105100 0x7feeb0073c50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7feea0009130 tx=0x7feea0011ad0 comp rx=0 tx=0).stop 2023-08-10T11:44:28.469 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.087+0000 7feeb6153700 1 -- 172.21.15.73:0/750885495 shutdown_connections 2023-08-10T11:44:28.469 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.087+0000 7feeb6153700 1 --2- 172.21.15.73:0/750885495 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fee98038630 0x7fee9803aaf0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:28.469 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.087+0000 7feeb6153700 1 --2- 172.21.15.73:0/750885495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feeb0105100 0x7feeb0073c50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:28.469 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.087+0000 7feeb6153700 1 -- 172.21.15.73:0/750885495 >> 172.21.15.73:0/750885495 conn(0x7feeb0100680 msgr2=0x7feeb0101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:28.469 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.087+0000 7feeb6153700 1 -- 172.21.15.73:0/750885495 shutdown_connections 2023-08-10T11:44:28.470 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.087+0000 7feeb6153700 1 -- 172.21.15.73:0/750885495 wait complete. 2023-08-10T11:44:28.483 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:28 smithi073 ceph-mon[128869]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-08-10T11:44:28.483 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:28 smithi073 ceph-mon[128869]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-08-10T11:44:28.483 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:28 smithi073 ceph-mon[128869]: [10/Aug/2023:11:44:27] ENGINE Bus STARTING 2023-08-10T11:44:28.483 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:28 smithi073 ceph-mon[128869]: from='mgr.14120 172.21.15.73:0/1146817848' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:44:29.495 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:29 smithi073 ceph-mon[128869]: [10/Aug/2023:11:44:27] ENGINE Serving on http://172.21.15.73:8765 2023-08-10T11:44:29.496 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:29 smithi073 ceph-mon[128869]: [10/Aug/2023:11:44:27] ENGINE Serving on https://172.21.15.73:7150 2023-08-10T11:44:29.496 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:29 smithi073 ceph-mon[128869]: [10/Aug/2023:11:44:27] ENGINE Bus STARTED 2023-08-10T11:44:29.496 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:29 smithi073 ceph-mon[128869]: mgrmap e8: x(active, since 2s) 2023-08-10T11:44:29.496 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:29 smithi073 ceph-mon[128869]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:44:29.496 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:29 smithi073 ceph-mon[128869]: from='mgr.14120 172.21.15.73:0/1146817848' entity='mgr.x' 2023-08-10T11:44:29.496 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:29 smithi073 ceph-mon[128869]: from='mgr.14120 172.21.15.73:0/1146817848' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:44:29.505 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout value unchanged 2023-08-10T11:44:29.505 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.910+0000 7f387ddea700 1 Processor -- start 2023-08-10T11:44:29.505 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.910+0000 7f387ddea700 1 -- start start 2023-08-10T11:44:29.506 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.910+0000 7f387ddea700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3878104500 0x7f3878104920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:29.506 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.910+0000 7f387ddea700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3878104ef0 con 0x7f3878104500 2023-08-10T11:44:29.506 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.910+0000 7f38777fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3878104500 0x7f3878104920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:29.506 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.910+0000 7f38777fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3878104500 0x7f3878104920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57744/0 (socket says 172.21.15.73:57744) 2023-08-10T11:44:29.506 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.910+0000 7f38777fe700 1 -- 172.21.15.73:0/1499124232 learned_addr learned my addr 172.21.15.73:0/1499124232 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:29.506 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.910+0000 7f38777fe700 1 -- 172.21.15.73:0/1499124232 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3878105030 con 0x7f3878104500 2023-08-10T11:44:29.506 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.910+0000 7f38777fe700 1 --2- 172.21.15.73:0/1499124232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3878104500 0x7f3878104920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f38680098a0 tx=0x7f3868009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66ea6e47b668795 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:29.507 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.911+0000 7f38767fc700 1 -- 172.21.15.73:0/1499124232 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3868004160 con 0x7f3878104500 2023-08-10T11:44:29.507 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.911+0000 7f38767fc700 1 -- 172.21.15.73:0/1499124232 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f38680042c0 con 0x7f3878104500 2023-08-10T11:44:29.507 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.911+0000 7f38767fc700 1 -- 172.21.15.73:0/1499124232 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3868011a00 con 0x7f3878104500 2023-08-10T11:44:29.507 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.911+0000 7f387ddea700 1 -- 172.21.15.73:0/1499124232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3878104500 msgr2=0x7f3878104920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:29.507 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.911+0000 7f387ddea700 1 --2- 172.21.15.73:0/1499124232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3878104500 0x7f3878104920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f38680098a0 tx=0x7f3868009bb0 comp rx=0 tx=0).stop 2023-08-10T11:44:29.507 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.911+0000 7f387ddea700 1 -- 172.21.15.73:0/1499124232 shutdown_connections 2023-08-10T11:44:29.507 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.911+0000 7f387ddea700 1 --2- 172.21.15.73:0/1499124232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3878104500 0x7f3878104920 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:29.507 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.911+0000 7f387ddea700 1 -- 172.21.15.73:0/1499124232 >> 172.21.15.73:0/1499124232 conn(0x7f38780ffe10 msgr2=0x7f3878102270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:29.508 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.911+0000 7f387ddea700 1 -- 172.21.15.73:0/1499124232 shutdown_connections 2023-08-10T11:44:29.508 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.911+0000 7f387ddea700 1 -- 172.21.15.73:0/1499124232 wait complete. 2023-08-10T11:44:29.508 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.912+0000 7f387ddea700 1 Processor -- start 2023-08-10T11:44:29.508 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.912+0000 7f387ddea700 1 -- start start 2023-08-10T11:44:29.508 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.912+0000 7f387ddea700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3878104500 0x7f3878199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:29.508 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.912+0000 7f387ddea700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387819a480 con 0x7f3878104500 2023-08-10T11:44:29.508 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.912+0000 7f38777fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3878104500 0x7f3878199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:29.509 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.912+0000 7f38777fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3878104500 0x7f3878199f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57746/0 (socket says 172.21.15.73:57746) 2023-08-10T11:44:29.509 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.912+0000 7f38777fe700 1 -- 172.21.15.73:0/3334430362 learned_addr learned my addr 172.21.15.73:0/3334430362 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:29.509 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.912+0000 7f38777fe700 1 -- 172.21.15.73:0/3334430362 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3868009550 con 0x7f3878104500 2023-08-10T11:44:29.509 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.913+0000 7f38777fe700 1 --2- 172.21.15.73:0/3334430362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3878104500 0x7f3878199f40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3868009130 tx=0x7f3868011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:29.509 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.913+0000 7f3874ff9700 1 -- 172.21.15.73:0/3334430362 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3868003ab0 con 0x7f3878104500 2023-08-10T11:44:29.509 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.913+0000 7f387ddea700 1 -- 172.21.15.73:0/3334430362 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f387819a680 con 0x7f3878104500 2023-08-10T11:44:29.509 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.913+0000 7f3874ff9700 1 -- 172.21.15.73:0/3334430362 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3868003c10 con 0x7f3878104500 2023-08-10T11:44:29.509 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.913+0000 7f3874ff9700 1 -- 172.21.15.73:0/3334430362 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38680247d0 con 0x7f3878104500 2023-08-10T11:44:29.510 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.913+0000 7f387ddea700 1 -- 172.21.15.73:0/3334430362 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f387819aaa0 con 0x7f3878104500 2023-08-10T11:44:29.510 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.914+0000 7f387ddea700 1 -- 172.21.15.73:0/3334430362 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3878061da0 con 0x7f3878104500 2023-08-10T11:44:29.510 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.914+0000 7f3874ff9700 1 -- 172.21.15.73:0/3334430362 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f386801abb0 con 0x7f3878104500 2023-08-10T11:44:29.510 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.914+0000 7f3874ff9700 1 --2- 172.21.15.73:0/3334430362 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f3860038710 0x7f386003abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:29.510 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.914+0000 7f3874ff9700 1 -- 172.21.15.73:0/3334430362 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f386804c820 con 0x7f3878104500 2023-08-10T11:44:29.510 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.914+0000 7f3876ffd700 1 --2- 172.21.15.73:0/3334430362 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f3860038710 0x7f386003abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:29.510 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.914+0000 7f3876ffd700 1 --2- 172.21.15.73:0/3334430362 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f3860038710 0x7f386003abd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f386c006fd0 tx=0x7f386c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:29.511 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:28.919+0000 7f3874ff9700 1 -- 172.21.15.73:0/3334430362 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f3868018920 con 0x7f3878104500 2023-08-10T11:44:29.511 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.106+0000 7f387ddea700 1 -- 172.21.15.73:0/3334430362 --> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f387810a730 con 0x7f3860038710 2023-08-10T11:44:29.511 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.106+0000 7f3874ff9700 1 -- 172.21.15.73:0/3334430362 <== mgr.14120 v2:172.21.15.73:6800/16358451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f387810a730 con 0x7f3860038710 2023-08-10T11:44:29.511 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.108+0000 7f387ddea700 1 -- 172.21.15.73:0/3334430362 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f3860038710 msgr2=0x7f386003abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:29.511 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.108+0000 7f387ddea700 1 --2- 172.21.15.73:0/3334430362 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f3860038710 0x7f386003abd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f386c006fd0 tx=0x7f386c006e40 comp rx=0 tx=0).stop 2023-08-10T11:44:29.511 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.108+0000 7f387ddea700 1 -- 172.21.15.73:0/3334430362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3878104500 msgr2=0x7f3878199f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:29.511 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.108+0000 7f387ddea700 1 --2- 172.21.15.73:0/3334430362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3878104500 0x7f3878199f40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3868009130 tx=0x7f3868011ad0 comp rx=0 tx=0).stop 2023-08-10T11:44:29.512 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.109+0000 7f387ddea700 1 -- 172.21.15.73:0/3334430362 shutdown_connections 2023-08-10T11:44:29.512 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.109+0000 7f387ddea700 1 --2- 172.21.15.73:0/3334430362 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f3860038710 0x7f386003abd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:29.512 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.109+0000 7f387ddea700 1 --2- 172.21.15.73:0/3334430362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3878104500 0x7f3878199f40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:29.512 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.109+0000 7f387ddea700 1 -- 172.21.15.73:0/3334430362 >> 172.21.15.73:0/3334430362 conn(0x7f38780ffe10 msgr2=0x7f38781014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:29.512 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.109+0000 7f387ddea700 1 -- 172.21.15.73:0/3334430362 shutdown_connections 2023-08-10T11:44:29.512 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.109+0000 7f387ddea700 1 -- 172.21.15.73:0/3334430362 wait complete. 2023-08-10T11:44:29.512 INFO:teuthology.orchestra.run.smithi073.stdout:Generating ssh key... 2023-08-10T11:44:30.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:30 smithi073 ceph-mon[128869]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:44:31.017 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:30 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: Generating public/private rsa key pair. 2023-08-10T11:44:31.018 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:30 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: Your identification has been saved in /tmp/tmpzras8aac/key. 2023-08-10T11:44:31.018 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:30 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: Your public key has been saved in /tmp/tmpzras8aac/key.pub. 2023-08-10T11:44:31.018 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:30 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: The key fingerprint is: 2023-08-10T11:44:31.018 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:30 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: SHA256:GRUyAEqqhxJy9oSvpjwtni+d2vhSVB7xyU1mHnMABLA ceph-0e619a74-3773-11ee-9b37-001a4aab830c 2023-08-10T11:44:31.018 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:30 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: The key's randomart image is: 2023-08-10T11:44:31.019 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:30 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: +---[RSA 3072]----+ 2023-08-10T11:44:31.019 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:30 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: | ..o+=++B+o | 2023-08-10T11:44:31.019 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:30 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: | o o.oo B++ | 2023-08-10T11:44:31.019 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:30 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: |+ =E+ .+.o | 2023-08-10T11:44:31.019 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:30 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: |o= = . o | 2023-08-10T11:44:31.019 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:30 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: |+ o o S | 2023-08-10T11:44:31.019 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:30 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: |.. o | 2023-08-10T11:44:31.019 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:30 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: | * . | 2023-08-10T11:44:31.020 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:30 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: |.B++ | 2023-08-10T11:44:31.020 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:30 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: |o*O+ | 2023-08-10T11:44:31.020 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:30 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: +----[SHA256]-----+ 2023-08-10T11:44:31.046 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.941+0000 7f165acf7700 1 Processor -- start 2023-08-10T11:44:31.047 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.941+0000 7f165acf7700 1 -- start start 2023-08-10T11:44:31.047 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.942+0000 7f165acf7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16541066f0 0x7f1654106b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:31.047 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.942+0000 7f165acf7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16541070e0 con 0x7f16541066f0 2023-08-10T11:44:31.047 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.942+0000 7f1658a93700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16541066f0 0x7f1654106b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:31.047 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.942+0000 7f1658a93700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16541066f0 0x7f1654106b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57750/0 (socket says 172.21.15.73:57750) 2023-08-10T11:44:31.047 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.942+0000 7f1658a93700 1 -- 172.21.15.73:0/1723710762 learned_addr learned my addr 172.21.15.73:0/1723710762 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:31.047 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.942+0000 7f1658a93700 1 -- 172.21.15.73:0/1723710762 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1654107220 con 0x7f16541066f0 2023-08-10T11:44:31.048 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.942+0000 7f1658a93700 1 --2- 172.21.15.73:0/1723710762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16541066f0 0x7f1654106b10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f16480098a0 tx=0x7f1648009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4366857271ed34af server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:31.048 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.942+0000 7f16537fe700 1 -- 172.21.15.73:0/1723710762 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1648004160 con 0x7f16541066f0 2023-08-10T11:44:31.048 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.942+0000 7f16537fe700 1 -- 172.21.15.73:0/1723710762 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f16480042c0 con 0x7f16541066f0 2023-08-10T11:44:31.048 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.942+0000 7f16537fe700 1 -- 172.21.15.73:0/1723710762 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1648011a00 con 0x7f16541066f0 2023-08-10T11:44:31.048 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.943+0000 7f165acf7700 1 -- 172.21.15.73:0/1723710762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16541066f0 msgr2=0x7f1654106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:31.048 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.943+0000 7f165acf7700 1 --2- 172.21.15.73:0/1723710762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16541066f0 0x7f1654106b10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f16480098a0 tx=0x7f1648009bb0 comp rx=0 tx=0).stop 2023-08-10T11:44:31.048 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.943+0000 7f165acf7700 1 -- 172.21.15.73:0/1723710762 shutdown_connections 2023-08-10T11:44:31.048 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.943+0000 7f165acf7700 1 --2- 172.21.15.73:0/1723710762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16541066f0 0x7f1654106b10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:31.049 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.943+0000 7f165acf7700 1 -- 172.21.15.73:0/1723710762 >> 172.21.15.73:0/1723710762 conn(0x7f16540ffe10 msgr2=0x7f1654102270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:31.049 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.943+0000 7f165acf7700 1 -- 172.21.15.73:0/1723710762 shutdown_connections 2023-08-10T11:44:31.049 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.943+0000 7f165acf7700 1 -- 172.21.15.73:0/1723710762 wait complete. 2023-08-10T11:44:31.049 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.943+0000 7f165acf7700 1 Processor -- start 2023-08-10T11:44:31.049 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.944+0000 7f165acf7700 1 -- start start 2023-08-10T11:44:31.049 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.944+0000 7f165acf7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16541066f0 0x7f1654198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:31.049 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.944+0000 7f165acf7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1654199390 con 0x7f16541066f0 2023-08-10T11:44:31.050 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.944+0000 7f1658a93700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16541066f0 0x7f1654198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:31.050 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.944+0000 7f1658a93700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16541066f0 0x7f1654198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57752/0 (socket says 172.21.15.73:57752) 2023-08-10T11:44:31.050 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.944+0000 7f1658a93700 1 -- 172.21.15.73:0/1227848887 learned_addr learned my addr 172.21.15.73:0/1227848887 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:31.050 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.944+0000 7f1658a93700 1 -- 172.21.15.73:0/1227848887 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1648009550 con 0x7f16541066f0 2023-08-10T11:44:31.050 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.944+0000 7f1658a93700 1 --2- 172.21.15.73:0/1227848887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16541066f0 0x7f1654198e50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1648009130 tx=0x7f1648011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:31.050 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.944+0000 7f1651ffb700 1 -- 172.21.15.73:0/1227848887 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1648003ab0 con 0x7f16541066f0 2023-08-10T11:44:31.050 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.944+0000 7f1651ffb700 1 -- 172.21.15.73:0/1227848887 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1648003c10 con 0x7f16541066f0 2023-08-10T11:44:31.050 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.944+0000 7f165acf7700 1 -- 172.21.15.73:0/1227848887 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1654199590 con 0x7f16541066f0 2023-08-10T11:44:31.051 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.944+0000 7f1651ffb700 1 -- 172.21.15.73:0/1227848887 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f16480247d0 con 0x7f16541066f0 2023-08-10T11:44:31.051 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.945+0000 7f165acf7700 1 -- 172.21.15.73:0/1227848887 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16541999b0 con 0x7f16541066f0 2023-08-10T11:44:31.051 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.945+0000 7f1651ffb700 1 -- 172.21.15.73:0/1227848887 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f164802d3f0 con 0x7f16541066f0 2023-08-10T11:44:31.051 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.945+0000 7f165acf7700 1 -- 172.21.15.73:0/1227848887 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1654061da0 con 0x7f16541066f0 2023-08-10T11:44:31.051 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.945+0000 7f1651ffb700 1 --2- 172.21.15.73:0/1227848887 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f1644038760 0x7f164403ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:31.051 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.946+0000 7f1651ffb700 1 -- 172.21.15.73:0/1227848887 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f164804c670 con 0x7f16541066f0 2023-08-10T11:44:31.051 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.946+0000 7f1653fff700 1 --2- 172.21.15.73:0/1227848887 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f1644038760 0x7f164403ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:31.052 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.946+0000 7f1653fff700 1 --2- 172.21.15.73:0/1227848887 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f1644038760 0x7f164403ac20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1640006fd0 tx=0x7f1640006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:31.052 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:29.950+0000 7f1651ffb700 1 -- 172.21.15.73:0/1227848887 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f1648010970 con 0x7f16541066f0 2023-08-10T11:44:31.052 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:30.139+0000 7f165acf7700 1 -- 172.21.15.73:0/1227848887 --> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f1654107220 con 0x7f1644038760 2023-08-10T11:44:31.052 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:30.586+0000 7f1651ffb700 1 -- 172.21.15.73:0/1227848887 <== mgr.14120 v2:172.21.15.73:6800/16358451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1654107220 con 0x7f1644038760 2023-08-10T11:44:31.052 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:30.588+0000 7f165acf7700 1 -- 172.21.15.73:0/1227848887 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f1644038760 msgr2=0x7f164403ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:31.052 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:30.588+0000 7f165acf7700 1 --2- 172.21.15.73:0/1227848887 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f1644038760 0x7f164403ac20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1640006fd0 tx=0x7f1640006e40 comp rx=0 tx=0).stop 2023-08-10T11:44:31.052 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:30.588+0000 7f165acf7700 1 -- 172.21.15.73:0/1227848887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16541066f0 msgr2=0x7f1654198e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:31.053 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:30.588+0000 7f165acf7700 1 --2- 172.21.15.73:0/1227848887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16541066f0 0x7f1654198e50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1648009130 tx=0x7f1648011ad0 comp rx=0 tx=0).stop 2023-08-10T11:44:31.053 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:30.588+0000 7f165acf7700 1 -- 172.21.15.73:0/1227848887 shutdown_connections 2023-08-10T11:44:31.053 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:30.588+0000 7f165acf7700 1 --2- 172.21.15.73:0/1227848887 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f1644038760 0x7f164403ac20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:31.053 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:30.588+0000 7f165acf7700 1 --2- 172.21.15.73:0/1227848887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16541066f0 0x7f1654198e50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:31.053 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:30.588+0000 7f165acf7700 1 -- 172.21.15.73:0/1227848887 >> 172.21.15.73:0/1227848887 conn(0x7f16540ffe10 msgr2=0x7f1654101520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:31.053 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:30.588+0000 7f165acf7700 1 -- 172.21.15.73:0/1227848887 shutdown_connections 2023-08-10T11:44:31.053 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:30.588+0000 7f165acf7700 1 -- 172.21.15.73:0/1227848887 wait complete. 2023-08-10T11:44:31.285 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:31 smithi073 ceph-mon[128869]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:44:31.285 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:31 smithi073 ceph-mon[128869]: Generating ssh key... 2023-08-10T11:44:31.286 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:31 smithi073 ceph-mon[128869]: from='mgr.14120 172.21.15.73:0/1146817848' entity='mgr.x' 2023-08-10T11:44:31.286 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:31 smithi073 ceph-mon[128869]: from='mgr.14120 172.21.15.73:0/1146817848' entity='mgr.x' 2023-08-10T11:44:32.091 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5Ts7CFlBXxmj7d7yM9982+hF3wyx44CXXEVft04+OZd7JptchKVCTjijzm013r/O7KC5/hmZ9ESnrrl5NoSPOsuojNuOTX/T68cKiGAz/d2971Fq2K82fR8tpWG/l9R4HbqofEAUugc09W0F6BTlXqZUjI+NsQyFV+to73OfLTzCdsyn5cXTw3iRM2NYQjYW/6zywwF/kpQoYV9YeKZoQl63UE78H9yL7n84MtqPUKwO6Z9m3POr8gW5MdYvWjhQRMcg38UuUsz6t0tPPf/QEKNr+2gv8re0RpI9l/1fhoYHywoZNz6uZhB5EjP7GMy4MYifm9RLiz8AZU4NoxrlKTxBedhDIJR7xWtHjb8ysS1McaW8z9wW07Jqu8ZH9HJME+OQ39nVaevrkU82Yj0CHhT/sq1QZiQRaf6iPuQxMBzIPI8Vd/f1XPlWkbqhPhFFftubzMCqaP/BoCxAiGGHsLyvZGzczsp+cGju3owjz9d9qqXbzb/qstE3tVJRhE6U= ceph-0e619a74-3773-11ee-9b37-001a4aab830c 2023-08-10T11:44:32.091 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.515+0000 7fa9b764e700 1 Processor -- start 2023-08-10T11:44:32.091 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.516+0000 7fa9b764e700 1 -- start start 2023-08-10T11:44:32.091 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.516+0000 7fa9b764e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9b0106ca0 0x7fa9b0109090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:32.092 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.516+0000 7fa9b764e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b0079e00 con 0x7fa9b0106ca0 2023-08-10T11:44:32.092 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.516+0000 7fa9b53ea700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9b0106ca0 0x7fa9b0109090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:32.092 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.516+0000 7fa9b53ea700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9b0106ca0 0x7fa9b0109090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57756/0 (socket says 172.21.15.73:57756) 2023-08-10T11:44:32.092 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.516+0000 7fa9b53ea700 1 -- 172.21.15.73:0/1898131577 learned_addr learned my addr 172.21.15.73:0/1898131577 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:32.092 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.516+0000 7fa9b53ea700 1 -- 172.21.15.73:0/1898131577 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b01095d0 con 0x7fa9b0106ca0 2023-08-10T11:44:32.092 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.516+0000 7fa9b53ea700 1 --2- 172.21.15.73:0/1898131577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9b0106ca0 0x7fa9b0109090 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00098a0 tx=0x7fa9a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a79b90510debfe8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:32.093 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.517+0000 7fa9a7fff700 1 -- 172.21.15.73:0/1898131577 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9a0004160 con 0x7fa9b0106ca0 2023-08-10T11:44:32.093 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.517+0000 7fa9a7fff700 1 -- 172.21.15.73:0/1898131577 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa9a00042c0 con 0x7fa9b0106ca0 2023-08-10T11:44:32.093 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.517+0000 7fa9a7fff700 1 -- 172.21.15.73:0/1898131577 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9a0011a00 con 0x7fa9b0106ca0 2023-08-10T11:44:32.093 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.517+0000 7fa9b764e700 1 -- 172.21.15.73:0/1898131577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9b0106ca0 msgr2=0x7fa9b0109090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:32.093 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.517+0000 7fa9b764e700 1 --2- 172.21.15.73:0/1898131577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9b0106ca0 0x7fa9b0109090 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00098a0 tx=0x7fa9a0009bb0 comp rx=0 tx=0).stop 2023-08-10T11:44:32.094 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.517+0000 7fa9b764e700 1 -- 172.21.15.73:0/1898131577 shutdown_connections 2023-08-10T11:44:32.094 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.517+0000 7fa9b764e700 1 --2- 172.21.15.73:0/1898131577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9b0106ca0 0x7fa9b0109090 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:32.094 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.517+0000 7fa9b764e700 1 -- 172.21.15.73:0/1898131577 >> 172.21.15.73:0/1898131577 conn(0x7fa9b0100670 msgr2=0x7fa9b0102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:32.094 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.517+0000 7fa9b764e700 1 -- 172.21.15.73:0/1898131577 shutdown_connections 2023-08-10T11:44:32.094 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.517+0000 7fa9b764e700 1 -- 172.21.15.73:0/1898131577 wait complete. 2023-08-10T11:44:32.094 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.518+0000 7fa9b764e700 1 Processor -- start 2023-08-10T11:44:32.094 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.518+0000 7fa9b764e700 1 -- start start 2023-08-10T11:44:32.095 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.518+0000 7fa9b764e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9b0106ca0 0x7fa9b0106600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:32.095 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.518+0000 7fa9b764e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b0106b40 con 0x7fa9b0106ca0 2023-08-10T11:44:32.095 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.518+0000 7fa9b53ea700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9b0106ca0 0x7fa9b0106600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:32.095 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.518+0000 7fa9b53ea700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9b0106ca0 0x7fa9b0106600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57758/0 (socket says 172.21.15.73:57758) 2023-08-10T11:44:32.095 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.518+0000 7fa9b53ea700 1 -- 172.21.15.73:0/2687786894 learned_addr learned my addr 172.21.15.73:0/2687786894 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:32.095 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.518+0000 7fa9b53ea700 1 -- 172.21.15.73:0/2687786894 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a0009550 con 0x7fa9b0106ca0 2023-08-10T11:44:32.095 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.519+0000 7fa9b53ea700 1 --2- 172.21.15.73:0/2687786894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9b0106ca0 0x7fa9b0106600 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0009130 tx=0x7fa9a0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:32.096 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.519+0000 7fa9a67fc700 1 -- 172.21.15.73:0/2687786894 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9a0003b70 con 0x7fa9b0106ca0 2023-08-10T11:44:32.096 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.519+0000 7fa9a67fc700 1 -- 172.21.15.73:0/2687786894 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa9a0003cd0 con 0x7fa9b0106ca0 2023-08-10T11:44:32.096 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.519+0000 7fa9a67fc700 1 -- 172.21.15.73:0/2687786894 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9a00197d0 con 0x7fa9b0106ca0 2023-08-10T11:44:32.096 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.519+0000 7fa9b764e700 1 -- 172.21.15.73:0/2687786894 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b0104c50 con 0x7fa9b0106ca0 2023-08-10T11:44:32.096 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.519+0000 7fa9b764e700 1 -- 172.21.15.73:0/2687786894 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b0105070 con 0x7fa9b0106ca0 2023-08-10T11:44:32.096 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.520+0000 7fa9a67fc700 1 -- 172.21.15.73:0/2687786894 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7fa9a00199c0 con 0x7fa9b0106ca0 2023-08-10T11:44:32.096 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.520+0000 7fa9b764e700 1 -- 172.21.15.73:0/2687786894 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b0061da0 con 0x7fa9b0106ca0 2023-08-10T11:44:32.097 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.520+0000 7fa9a67fc700 1 --2- 172.21.15.73:0/2687786894 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fa99c038760 0x7fa99c03ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:32.097 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.520+0000 7fa9a67fc700 1 -- 172.21.15.73:0/2687786894 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa9a004ca80 con 0x7fa9b0106ca0 2023-08-10T11:44:32.097 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.520+0000 7fa9b4be9700 1 --2- 172.21.15.73:0/2687786894 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fa99c038760 0x7fa99c03ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:32.097 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.520+0000 7fa9b4be9700 1 --2- 172.21.15.73:0/2687786894 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fa99c038760 0x7fa99c03ac20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac006fd0 tx=0x7fa9ac006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:32.097 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.525+0000 7fa9a67fc700 1 -- 172.21.15.73:0/2687786894 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fa9a0018530 con 0x7fa9b0106ca0 2023-08-10T11:44:32.097 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.709+0000 7fa9b764e700 1 -- 172.21.15.73:0/2687786894 --> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9b01029e0 con 0x7fa99c038760 2023-08-10T11:44:32.097 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.710+0000 7fa9a67fc700 1 -- 172.21.15.73:0/2687786894 <== mgr.14120 v2:172.21.15.73:6800/16358451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fa9b01029e0 con 0x7fa99c038760 2023-08-10T11:44:32.097 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.711+0000 7fa9b764e700 1 -- 172.21.15.73:0/2687786894 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fa99c038760 msgr2=0x7fa99c03ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:32.098 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.711+0000 7fa9b764e700 1 --2- 172.21.15.73:0/2687786894 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fa99c038760 0x7fa99c03ac20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac006fd0 tx=0x7fa9ac006e40 comp rx=0 tx=0).stop 2023-08-10T11:44:32.098 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.711+0000 7fa9b764e700 1 -- 172.21.15.73:0/2687786894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9b0106ca0 msgr2=0x7fa9b0106600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:32.098 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.711+0000 7fa9b764e700 1 --2- 172.21.15.73:0/2687786894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9b0106ca0 0x7fa9b0106600 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0009130 tx=0x7fa9a0011ad0 comp rx=0 tx=0).stop 2023-08-10T11:44:32.098 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.712+0000 7fa9b764e700 1 -- 172.21.15.73:0/2687786894 shutdown_connections 2023-08-10T11:44:32.098 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.712+0000 7fa9b764e700 1 --2- 172.21.15.73:0/2687786894 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fa99c038760 0x7fa99c03ac20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:32.099 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.712+0000 7fa9b764e700 1 --2- 172.21.15.73:0/2687786894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9b0106ca0 0x7fa9b0106600 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:32.099 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.712+0000 7fa9b764e700 1 -- 172.21.15.73:0/2687786894 >> 172.21.15.73:0/2687786894 conn(0x7fa9b0100670 msgr2=0x7fa9b0101dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:32.099 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.712+0000 7fa9b764e700 1 -- 172.21.15.73:0/2687786894 shutdown_connections 2023-08-10T11:44:32.099 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:31.712+0000 7fa9b764e700 1 -- 172.21.15.73:0/2687786894 wait complete. 2023-08-10T11:44:32.099 INFO:teuthology.orchestra.run.smithi073.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-08-10T11:44:32.099 INFO:teuthology.orchestra.run.smithi073.stdout:Adding key to root@localhost authorized_keys... 2023-08-10T11:44:32.100 INFO:teuthology.orchestra.run.smithi073.stdout:Adding host smithi073... 2023-08-10T11:44:32.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:32 smithi073 ceph-mon[128869]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:44:34.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:34 smithi073 ceph-mon[128869]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi073", "addr": "172.21.15.73", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:44:34.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:34 smithi073 ceph-mon[128869]: Deploying cephadm binary to smithi073 2023-08-10T11:44:35.344 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout Added host 'smithi073' with addr '172.21.15.73' 2023-08-10T11:44:35.344 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.536+0000 7f85fe5e1700 1 Processor -- start 2023-08-10T11:44:35.344 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.536+0000 7f85fe5e1700 1 -- start start 2023-08-10T11:44:35.344 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.536+0000 7f85fe5e1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85f8104500 0x7f85f8104920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:35.345 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.536+0000 7f85fe5e1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f8104ef0 con 0x7f85f8104500 2023-08-10T11:44:35.345 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.537+0000 7f85f7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85f8104500 0x7f85f8104920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:35.345 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.537+0000 7f85f7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85f8104500 0x7f85f8104920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57762/0 (socket says 172.21.15.73:57762) 2023-08-10T11:44:35.345 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.537+0000 7f85f7fff700 1 -- 172.21.15.73:0/709185642 learned_addr learned my addr 172.21.15.73:0/709185642 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:35.345 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.537+0000 7f85f7fff700 1 -- 172.21.15.73:0/709185642 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f8107490 con 0x7f85f8104500 2023-08-10T11:44:35.345 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.537+0000 7f85f7fff700 1 --2- 172.21.15.73:0/709185642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85f8104500 0x7f85f8104920 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f85ec0098a0 tx=0x7f85ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b8752fad4dcec server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:35.345 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.537+0000 7f85f6ffd700 1 -- 172.21.15.73:0/709185642 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85ec004160 con 0x7f85f8104500 2023-08-10T11:44:35.346 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.537+0000 7f85f6ffd700 1 -- 172.21.15.73:0/709185642 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f85ec0042c0 con 0x7f85f8104500 2023-08-10T11:44:35.346 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.537+0000 7f85f6ffd700 1 -- 172.21.15.73:0/709185642 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85ec011a00 con 0x7f85f8104500 2023-08-10T11:44:35.346 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.538+0000 7f85fe5e1700 1 -- 172.21.15.73:0/709185642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85f8104500 msgr2=0x7f85f8104920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:35.346 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.538+0000 7f85fe5e1700 1 --2- 172.21.15.73:0/709185642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85f8104500 0x7f85f8104920 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f85ec0098a0 tx=0x7f85ec009bb0 comp rx=0 tx=0).stop 2023-08-10T11:44:35.346 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.538+0000 7f85fe5e1700 1 -- 172.21.15.73:0/709185642 shutdown_connections 2023-08-10T11:44:35.346 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.538+0000 7f85fe5e1700 1 --2- 172.21.15.73:0/709185642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85f8104500 0x7f85f8104920 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:35.346 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.538+0000 7f85fe5e1700 1 -- 172.21.15.73:0/709185642 >> 172.21.15.73:0/709185642 conn(0x7f85f80ffe10 msgr2=0x7f85f8102270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:35.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.538+0000 7f85fe5e1700 1 -- 172.21.15.73:0/709185642 shutdown_connections 2023-08-10T11:44:35.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.538+0000 7f85fe5e1700 1 -- 172.21.15.73:0/709185642 wait complete. 2023-08-10T11:44:35.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.538+0000 7f85fe5e1700 1 Processor -- start 2023-08-10T11:44:35.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.539+0000 7f85fe5e1700 1 -- start start 2023-08-10T11:44:35.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.539+0000 7f85fe5e1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85f8104500 0x7f85f8199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:35.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.539+0000 7f85fe5e1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f819a410 con 0x7f85f8104500 2023-08-10T11:44:35.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.539+0000 7f85f7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85f8104500 0x7f85f8199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:35.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.539+0000 7f85f7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85f8104500 0x7f85f8199ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57764/0 (socket says 172.21.15.73:57764) 2023-08-10T11:44:35.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.539+0000 7f85f7fff700 1 -- 172.21.15.73:0/1640454531 learned_addr learned my addr 172.21.15.73:0/1640454531 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:35.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.539+0000 7f85f7fff700 1 -- 172.21.15.73:0/1640454531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ec009550 con 0x7f85f8104500 2023-08-10T11:44:35.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.539+0000 7f85f7fff700 1 --2- 172.21.15.73:0/1640454531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85f8104500 0x7f85f8199ed0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f85ec009fb0 tx=0x7f85ec011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:35.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.540+0000 7f85f57fa700 1 -- 172.21.15.73:0/1640454531 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85ec003a40 con 0x7f85f8104500 2023-08-10T11:44:35.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.540+0000 7f85fe5e1700 1 -- 172.21.15.73:0/1640454531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f819a610 con 0x7f85f8104500 2023-08-10T11:44:35.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.540+0000 7f85f57fa700 1 -- 172.21.15.73:0/1640454531 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f85ec003ba0 con 0x7f85f8104500 2023-08-10T11:44:35.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.540+0000 7f85f57fa700 1 -- 172.21.15.73:0/1640454531 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85ec01a750 con 0x7f85f8104500 2023-08-10T11:44:35.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.540+0000 7f85fe5e1700 1 -- 172.21.15.73:0/1640454531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f819aa30 con 0x7f85f8104500 2023-08-10T11:44:35.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.540+0000 7f85f57fa700 1 -- 172.21.15.73:0/1640454531 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f85ec024430 con 0x7f85f8104500 2023-08-10T11:44:35.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.541+0000 7f85fe5e1700 1 -- 172.21.15.73:0/1640454531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f8194000 con 0x7f85f8104500 2023-08-10T11:44:35.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.541+0000 7f85f57fa700 1 --2- 172.21.15.73:0/1640454531 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f85e00386c0 0x7f85e003ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:35.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.541+0000 7f85f57fa700 1 -- 172.21.15.73:0/1640454531 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f85ec04c7b0 con 0x7f85f8104500 2023-08-10T11:44:35.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.541+0000 7f85f77fe700 1 --2- 172.21.15.73:0/1640454531 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f85e00386c0 0x7f85e003ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:35.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.541+0000 7f85f77fe700 1 --2- 172.21.15.73:0/1640454531 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f85e00386c0 0x7f85e003ab80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f85e8006fd0 tx=0x7f85e8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:35.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.545+0000 7f85f57fa700 1 -- 172.21.15.73:0/1640454531 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f85ec0246e0 con 0x7f85f8104500 2023-08-10T11:44:35.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:32.735+0000 7f85fe5e1700 1 -- 172.21.15.73:0/1640454531 --> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi073", "addr": "172.21.15.73", "target": ["mon-mgr", ""]}) v1 -- 0x7f85f8060bb0 con 0x7f85e00386c0 2023-08-10T11:44:35.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.000+0000 7f85f57fa700 1 -- 172.21.15.73:0/1640454531 <== mgr.14120 v2:172.21.15.73:6800/16358451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f85f8060bb0 con 0x7f85e00386c0 2023-08-10T11:44:35.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.003+0000 7f85fe5e1700 1 -- 172.21.15.73:0/1640454531 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f85e00386c0 msgr2=0x7f85e003ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:35.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.003+0000 7f85fe5e1700 1 --2- 172.21.15.73:0/1640454531 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f85e00386c0 0x7f85e003ab80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f85e8006fd0 tx=0x7f85e8006e40 comp rx=0 tx=0).stop 2023-08-10T11:44:35.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.003+0000 7f85fe5e1700 1 -- 172.21.15.73:0/1640454531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85f8104500 msgr2=0x7f85f8199ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:35.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.003+0000 7f85fe5e1700 1 --2- 172.21.15.73:0/1640454531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85f8104500 0x7f85f8199ed0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f85ec009fb0 tx=0x7f85ec011ad0 comp rx=0 tx=0).stop 2023-08-10T11:44:35.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.004+0000 7f85fe5e1700 1 -- 172.21.15.73:0/1640454531 shutdown_connections 2023-08-10T11:44:35.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.004+0000 7f85fe5e1700 1 --2- 172.21.15.73:0/1640454531 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f85e00386c0 0x7f85e003ab80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:35.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.004+0000 7f85fe5e1700 1 --2- 172.21.15.73:0/1640454531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85f8104500 0x7f85f8199ed0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:35.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.004+0000 7f85fe5e1700 1 -- 172.21.15.73:0/1640454531 >> 172.21.15.73:0/1640454531 conn(0x7f85f80ffe10 msgr2=0x7f85f81015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:35.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.004+0000 7f85fe5e1700 1 -- 172.21.15.73:0/1640454531 shutdown_connections 2023-08-10T11:44:35.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.004+0000 7f85fe5e1700 1 -- 172.21.15.73:0/1640454531 wait complete. 2023-08-10T11:44:35.352 INFO:teuthology.orchestra.run.smithi073.stdout:Deploying unmanaged mon service... 2023-08-10T11:44:36.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:36 smithi073 ceph-mon[128869]: from='mgr.14120 172.21.15.73:0/1146817848' entity='mgr.x' 2023-08-10T11:44:36.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:36 smithi073 ceph-mon[128869]: Added host smithi073 2023-08-10T11:44:36.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:36 smithi073 ceph-mon[128869]: from='mgr.14120 172.21.15.73:0/1146817848' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:44:36.505 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-08-10T11:44:36.510 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.843+0000 7f8249641700 1 Processor -- start 2023-08-10T11:44:36.510 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.843+0000 7f8249641700 1 -- start start 2023-08-10T11:44:36.510 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.844+0000 7f8249641700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8244106ca0 0x7f8244109090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:36.510 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.844+0000 7f8249641700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8244079e00 con 0x7f8244106ca0 2023-08-10T11:44:36.510 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.844+0000 7f8242ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8244106ca0 0x7f8244109090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:36.510 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.844+0000 7f8242ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8244106ca0 0x7f8244109090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57798/0 (socket says 172.21.15.73:57798) 2023-08-10T11:44:36.511 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.844+0000 7f8242ffd700 1 -- 172.21.15.73:0/1286461308 learned_addr learned my addr 172.21.15.73:0/1286461308 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:36.511 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.844+0000 7f8242ffd700 1 -- 172.21.15.73:0/1286461308 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82441095d0 con 0x7f8244106ca0 2023-08-10T11:44:36.511 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.845+0000 7f8242ffd700 1 --2- 172.21.15.73:0/1286461308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8244106ca0 0x7f8244109090 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f822c0098a0 tx=0x7f822c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ac0f6acda1a7e5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:36.511 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.845+0000 7f8241ffb700 1 -- 172.21.15.73:0/1286461308 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f822c004160 con 0x7f8244106ca0 2023-08-10T11:44:36.511 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.845+0000 7f8241ffb700 1 -- 172.21.15.73:0/1286461308 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f822c0042c0 con 0x7f8244106ca0 2023-08-10T11:44:36.511 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.845+0000 7f8241ffb700 1 -- 172.21.15.73:0/1286461308 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f822c011a00 con 0x7f8244106ca0 2023-08-10T11:44:36.511 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.845+0000 7f8249641700 1 -- 172.21.15.73:0/1286461308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8244106ca0 msgr2=0x7f8244109090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:36.512 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.845+0000 7f8249641700 1 --2- 172.21.15.73:0/1286461308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8244106ca0 0x7f8244109090 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f822c0098a0 tx=0x7f822c009bb0 comp rx=0 tx=0).stop 2023-08-10T11:44:36.512 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.845+0000 7f8249641700 1 -- 172.21.15.73:0/1286461308 shutdown_connections 2023-08-10T11:44:36.512 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.845+0000 7f8249641700 1 --2- 172.21.15.73:0/1286461308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8244106ca0 0x7f8244109090 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:36.512 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.845+0000 7f8249641700 1 -- 172.21.15.73:0/1286461308 >> 172.21.15.73:0/1286461308 conn(0x7f8244100670 msgr2=0x7f8244102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:36.512 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.846+0000 7f8249641700 1 -- 172.21.15.73:0/1286461308 shutdown_connections 2023-08-10T11:44:36.512 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.846+0000 7f8249641700 1 -- 172.21.15.73:0/1286461308 wait complete. 2023-08-10T11:44:36.512 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.846+0000 7f8249641700 1 Processor -- start 2023-08-10T11:44:36.513 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.847+0000 7f8249641700 1 -- start start 2023-08-10T11:44:36.513 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.847+0000 7f8249641700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8244106ca0 0x7f8244199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:36.513 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.847+0000 7f8249641700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824419a470 con 0x7f8244106ca0 2023-08-10T11:44:36.513 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.847+0000 7f8242ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8244106ca0 0x7f8244199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:36.513 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.847+0000 7f8242ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8244106ca0 0x7f8244199f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57800/0 (socket says 172.21.15.73:57800) 2023-08-10T11:44:36.513 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.847+0000 7f8242ffd700 1 -- 172.21.15.73:0/1313343530 learned_addr learned my addr 172.21.15.73:0/1313343530 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:36.513 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.847+0000 7f8242ffd700 1 -- 172.21.15.73:0/1313343530 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822c009550 con 0x7f8244106ca0 2023-08-10T11:44:36.514 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.847+0000 7f8242ffd700 1 --2- 172.21.15.73:0/1313343530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8244106ca0 0x7f8244199f30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f822c009fb0 tx=0x7f822c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:36.514 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.847+0000 7f823bfff700 1 -- 172.21.15.73:0/1313343530 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f822c003a40 con 0x7f8244106ca0 2023-08-10T11:44:36.514 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.847+0000 7f823bfff700 1 -- 172.21.15.73:0/1313343530 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f822c003ba0 con 0x7f8244106ca0 2023-08-10T11:44:36.514 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.847+0000 7f8249641700 1 -- 172.21.15.73:0/1313343530 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f824419a670 con 0x7f8244106ca0 2023-08-10T11:44:36.514 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.847+0000 7f823bfff700 1 -- 172.21.15.73:0/1313343530 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f822c01a750 con 0x7f8244106ca0 2023-08-10T11:44:36.514 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.847+0000 7f8249641700 1 -- 172.21.15.73:0/1313343530 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f824419aa90 con 0x7f8244106ca0 2023-08-10T11:44:36.514 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.848+0000 7f823bfff700 1 -- 172.21.15.73:0/1313343530 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f822c01a9d0 con 0x7f8244106ca0 2023-08-10T11:44:36.514 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.848+0000 7f8249641700 1 -- 172.21.15.73:0/1313343530 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8244061da0 con 0x7f8244106ca0 2023-08-10T11:44:36.515 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.848+0000 7f823bfff700 1 --2- 172.21.15.73:0/1313343530 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f82300386c0 0x7f823003ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:36.515 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.849+0000 7f823bfff700 1 -- 172.21.15.73:0/1313343530 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f822c04c740 con 0x7f8244106ca0 2023-08-10T11:44:36.515 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.849+0000 7f82427fc700 1 --2- 172.21.15.73:0/1313343530 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f82300386c0 0x7f823003ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:36.515 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.849+0000 7f82427fc700 1 --2- 172.21.15.73:0/1313343530 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f82300386c0 0x7f823003ab80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8234006fd0 tx=0x7f8234006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:36.515 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:35.853+0000 7f823bfff700 1 -- 172.21.15.73:0/1313343530 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f822c018b80 con 0x7f8244106ca0 2023-08-10T11:44:36.515 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:36.057+0000 7f8249641700 1 -- 172.21.15.73:0/1313343530 --> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f824419d4d0 con 0x7f82300386c0 2023-08-10T11:44:36.515 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:36.061+0000 7f823bfff700 1 -- 172.21.15.73:0/1313343530 <== mgr.14120 v2:172.21.15.73:6800/16358451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f824419d4d0 con 0x7f82300386c0 2023-08-10T11:44:36.515 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:36.063+0000 7f8249641700 1 -- 172.21.15.73:0/1313343530 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f82300386c0 msgr2=0x7f823003ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:36.516 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:36.063+0000 7f8249641700 1 --2- 172.21.15.73:0/1313343530 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f82300386c0 0x7f823003ab80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8234006fd0 tx=0x7f8234006e40 comp rx=0 tx=0).stop 2023-08-10T11:44:36.516 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:36.063+0000 7f8249641700 1 -- 172.21.15.73:0/1313343530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8244106ca0 msgr2=0x7f8244199f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:36.516 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:36.063+0000 7f8249641700 1 --2- 172.21.15.73:0/1313343530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8244106ca0 0x7f8244199f30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f822c009fb0 tx=0x7f822c011ad0 comp rx=0 tx=0).stop 2023-08-10T11:44:36.516 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:36.063+0000 7f8249641700 1 -- 172.21.15.73:0/1313343530 shutdown_connections 2023-08-10T11:44:36.516 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:36.063+0000 7f8249641700 1 --2- 172.21.15.73:0/1313343530 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f82300386c0 0x7f823003ab80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:36.516 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:36.063+0000 7f8249641700 1 --2- 172.21.15.73:0/1313343530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8244106ca0 0x7f8244199f30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:36.517 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:36.063+0000 7f8249641700 1 -- 172.21.15.73:0/1313343530 >> 172.21.15.73:0/1313343530 conn(0x7f8244100670 msgr2=0x7f8244101dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:36.517 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:36.063+0000 7f8249641700 1 -- 172.21.15.73:0/1313343530 shutdown_connections 2023-08-10T11:44:36.517 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:36.063+0000 7f8249641700 1 -- 172.21.15.73:0/1313343530 wait complete. 2023-08-10T11:44:36.517 INFO:teuthology.orchestra.run.smithi073.stdout:Deploying unmanaged mgr service... 2023-08-10T11:44:37.207 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:37 smithi073 ceph-mon[128869]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:44:37.207 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:37 smithi073 ceph-mon[128869]: Saving service mon spec with placement count:5 2023-08-10T11:44:37.207 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:37 smithi073 ceph-mon[128869]: from='mgr.14120 172.21.15.73:0/1146817848' entity='mgr.x' 2023-08-10T11:44:37.905 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-08-10T11:44:37.905 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.300+0000 7fdba9d0e700 1 Processor -- start 2023-08-10T11:44:37.905 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.300+0000 7fdba9d0e700 1 -- start start 2023-08-10T11:44:37.905 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.300+0000 7fdba9d0e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdba41066f0 0x7fdba4106b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:37.905 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.300+0000 7fdba9d0e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba41070e0 con 0x7fdba41066f0 2023-08-10T11:44:37.906 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.301+0000 7fdba37fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdba41066f0 0x7fdba4106b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:37.906 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.301+0000 7fdba37fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdba41066f0 0x7fdba4106b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57804/0 (socket says 172.21.15.73:57804) 2023-08-10T11:44:37.906 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.301+0000 7fdba37fe700 1 -- 172.21.15.73:0/1964050117 learned_addr learned my addr 172.21.15.73:0/1964050117 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:37.906 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.301+0000 7fdba37fe700 1 -- 172.21.15.73:0/1964050117 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba4105300 con 0x7fdba41066f0 2023-08-10T11:44:37.906 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.301+0000 7fdba37fe700 1 --2- 172.21.15.73:0/1964050117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdba41066f0 0x7fdba4106b10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdb980098a0 tx=0x7fdb98009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea44c7ecea33d3f2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:37.906 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.301+0000 7fdba27fc700 1 -- 172.21.15.73:0/1964050117 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb98004160 con 0x7fdba41066f0 2023-08-10T11:44:37.906 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.301+0000 7fdba27fc700 1 -- 172.21.15.73:0/1964050117 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdb980042c0 con 0x7fdba41066f0 2023-08-10T11:44:37.907 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.301+0000 7fdba27fc700 1 -- 172.21.15.73:0/1964050117 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb98011a00 con 0x7fdba41066f0 2023-08-10T11:44:37.907 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.302+0000 7fdba9d0e700 1 -- 172.21.15.73:0/1964050117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdba41066f0 msgr2=0x7fdba4106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:37.907 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.302+0000 7fdba9d0e700 1 --2- 172.21.15.73:0/1964050117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdba41066f0 0x7fdba4106b10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdb980098a0 tx=0x7fdb98009bb0 comp rx=0 tx=0).stop 2023-08-10T11:44:37.907 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.302+0000 7fdba9d0e700 1 -- 172.21.15.73:0/1964050117 shutdown_connections 2023-08-10T11:44:37.907 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.302+0000 7fdba9d0e700 1 --2- 172.21.15.73:0/1964050117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdba41066f0 0x7fdba4106b10 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdb980098a0 tx=0x7fdb98009bb0 comp rx=0 tx=0).stop 2023-08-10T11:44:37.907 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.302+0000 7fdba9d0e700 1 -- 172.21.15.73:0/1964050117 >> 172.21.15.73:0/1964050117 conn(0x7fdba40ffe10 msgr2=0x7fdba4102270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:37.907 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.302+0000 7fdba9d0e700 1 -- 172.21.15.73:0/1964050117 shutdown_connections 2023-08-10T11:44:37.907 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.302+0000 7fdba9d0e700 1 -- 172.21.15.73:0/1964050117 wait complete. 2023-08-10T11:44:37.908 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.302+0000 7fdba9d0e700 1 Processor -- start 2023-08-10T11:44:37.908 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.303+0000 7fdba9d0e700 1 -- start start 2023-08-10T11:44:37.908 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.303+0000 7fdba9d0e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdba419c370 0x7fdba419c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:37.908 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.303+0000 7fdba9d0e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba419ccd0 con 0x7fdba419c370 2023-08-10T11:44:37.908 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.303+0000 7fdba37fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdba419c370 0x7fdba419c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:37.908 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.303+0000 7fdba37fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdba419c370 0x7fdba419c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57806/0 (socket says 172.21.15.73:57806) 2023-08-10T11:44:37.908 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.303+0000 7fdba37fe700 1 -- 172.21.15.73:0/1995754866 learned_addr learned my addr 172.21.15.73:0/1995754866 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:37.909 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.303+0000 7fdba37fe700 1 -- 172.21.15.73:0/1995754866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb98009550 con 0x7fdba419c370 2023-08-10T11:44:37.909 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.303+0000 7fdba37fe700 1 --2- 172.21.15.73:0/1995754866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdba419c370 0x7fdba419c790 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009fb0 tx=0x7fdb98012fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:37.909 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.303+0000 7fdba0ff9700 1 -- 172.21.15.73:0/1995754866 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb980037d0 con 0x7fdba419c370 2023-08-10T11:44:37.909 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.304+0000 7fdba9d0e700 1 -- 172.21.15.73:0/1995754866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba419ced0 con 0x7fdba419c370 2023-08-10T11:44:37.909 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.304+0000 7fdba0ff9700 1 -- 172.21.15.73:0/1995754866 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdb9801f070 con 0x7fdba419c370 2023-08-10T11:44:37.909 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.304+0000 7fdba0ff9700 1 -- 172.21.15.73:0/1995754866 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb9801add0 con 0x7fdba419c370 2023-08-10T11:44:37.909 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.304+0000 7fdba9d0e700 1 -- 172.21.15.73:0/1995754866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba419fb20 con 0x7fdba419c370 2023-08-10T11:44:37.909 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.304+0000 7fdba0ff9700 1 -- 172.21.15.73:0/1995754866 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7fdb9801b440 con 0x7fdba419c370 2023-08-10T11:44:37.910 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.304+0000 7fdba0ff9700 1 --2- 172.21.15.73:0/1995754866 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fdb8c038660 0x7fdb8c03ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:37.910 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.304+0000 7fdba0ff9700 1 -- 172.21.15.73:0/1995754866 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fdb98021070 con 0x7fdba419c370 2023-08-10T11:44:37.910 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.305+0000 7fdba2ffd700 1 --2- 172.21.15.73:0/1995754866 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fdb8c038660 0x7fdb8c03ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:37.910 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.305+0000 7fdba9d0e700 1 -- 172.21.15.73:0/1995754866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba419d060 con 0x7fdba419c370 2023-08-10T11:44:37.910 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.305+0000 7fdba2ffd700 1 --2- 172.21.15.73:0/1995754866 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fdb8c038660 0x7fdb8c03ab20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdb94006fd0 tx=0x7fdb94006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:37.910 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.309+0000 7fdba0ff9700 1 -- 172.21.15.73:0/1995754866 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fdb98018920 con 0x7fdba419c370 2023-08-10T11:44:37.910 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.389+0000 7fdba0ff9700 1 -- 172.21.15.73:0/1995754866 <== mon.0 v2:172.21.15.73:3300/0 7 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb9801a440 con 0x7fdba419c370 2023-08-10T11:44:37.911 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.529+0000 7fdba9d0e700 1 -- 172.21.15.73:0/1995754866 --> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fdba4104290 con 0x7fdb8c038660 2023-08-10T11:44:37.911 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.533+0000 7fdba0ff9700 1 -- 172.21.15.73:0/1995754866 <== mgr.14120 v2:172.21.15.73:6800/16358451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fdba4104290 con 0x7fdb8c038660 2023-08-10T11:44:37.911 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.535+0000 7fdba9d0e700 1 -- 172.21.15.73:0/1995754866 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fdb8c038660 msgr2=0x7fdb8c03ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:37.911 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.535+0000 7fdba9d0e700 1 --2- 172.21.15.73:0/1995754866 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fdb8c038660 0x7fdb8c03ab20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdb94006fd0 tx=0x7fdb94006e40 comp rx=0 tx=0).stop 2023-08-10T11:44:37.911 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.536+0000 7fdba9d0e700 1 -- 172.21.15.73:0/1995754866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdba419c370 msgr2=0x7fdba419c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:37.911 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.536+0000 7fdba9d0e700 1 --2- 172.21.15.73:0/1995754866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdba419c370 0x7fdba419c790 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009fb0 tx=0x7fdb98012fb0 comp rx=0 tx=0).stop 2023-08-10T11:44:37.911 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.536+0000 7fdba9d0e700 1 -- 172.21.15.73:0/1995754866 shutdown_connections 2023-08-10T11:44:37.911 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.536+0000 7fdba9d0e700 1 --2- 172.21.15.73:0/1995754866 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fdb8c038660 0x7fdb8c03ab20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:37.912 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.536+0000 7fdba9d0e700 1 --2- 172.21.15.73:0/1995754866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdba419c370 0x7fdba419c790 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:37.912 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.536+0000 7fdba9d0e700 1 -- 172.21.15.73:0/1995754866 >> 172.21.15.73:0/1995754866 conn(0x7fdba40ffe10 msgr2=0x7fdba418eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:37.912 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.536+0000 7fdba9d0e700 1 -- 172.21.15.73:0/1995754866 shutdown_connections 2023-08-10T11:44:37.912 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:37.536+0000 7fdba9d0e700 1 -- 172.21.15.73:0/1995754866 wait complete. 2023-08-10T11:44:38.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:38 smithi073 ceph-mon[128869]: from='mgr.14120 172.21.15.73:0/1146817848' entity='mgr.x' 2023-08-10T11:44:38.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:38 smithi073 ceph-mon[128869]: from='mgr.14120 172.21.15.73:0/1146817848' entity='mgr.x' 2023-08-10T11:44:38.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:38 smithi073 ceph-mon[128869]: from='mgr.14120 172.21.15.73:0/1146817848' entity='mgr.x' 2023-08-10T11:44:39.052 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.403+0000 7f78d5ce4700 1 Processor -- start 2023-08-10T11:44:39.053 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.403+0000 7f78d5ce4700 1 -- start start 2023-08-10T11:44:39.053 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.403+0000 7f78d5ce4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78d01066f0 0x7f78d0106b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:39.053 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.403+0000 7f78d5ce4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d01070e0 con 0x7f78d01066f0 2023-08-10T11:44:39.053 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.403+0000 7f78cf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78d01066f0 0x7f78d0106b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:39.053 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.403+0000 7f78cf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78d01066f0 0x7f78d0106b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57810/0 (socket says 172.21.15.73:57810) 2023-08-10T11:44:39.053 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.403+0000 7f78cf7fe700 1 -- 172.21.15.73:0/2440600525 learned_addr learned my addr 172.21.15.73:0/2440600525 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:39.054 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.404+0000 7f78cf7fe700 1 -- 172.21.15.73:0/2440600525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d0105300 con 0x7f78d01066f0 2023-08-10T11:44:39.054 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.404+0000 7f78cf7fe700 1 --2- 172.21.15.73:0/2440600525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78d01066f0 0x7f78d0106b10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f78c00098a0 tx=0x7f78c0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a425d172cd1ed829 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:39.054 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.404+0000 7f78ce7fc700 1 -- 172.21.15.73:0/2440600525 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78c0004160 con 0x7f78d01066f0 2023-08-10T11:44:39.054 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.404+0000 7f78ce7fc700 1 -- 172.21.15.73:0/2440600525 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78c00042c0 con 0x7f78d01066f0 2023-08-10T11:44:39.054 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.404+0000 7f78ce7fc700 1 -- 172.21.15.73:0/2440600525 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78c00119b0 con 0x7f78d01066f0 2023-08-10T11:44:39.054 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.405+0000 7f78d5ce4700 1 -- 172.21.15.73:0/2440600525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78d01066f0 msgr2=0x7f78d0106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:39.055 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.405+0000 7f78d5ce4700 1 --2- 172.21.15.73:0/2440600525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78d01066f0 0x7f78d0106b10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f78c00098a0 tx=0x7f78c0009bb0 comp rx=0 tx=0).stop 2023-08-10T11:44:39.055 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.405+0000 7f78d5ce4700 1 -- 172.21.15.73:0/2440600525 shutdown_connections 2023-08-10T11:44:39.056 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.405+0000 7f78d5ce4700 1 --2- 172.21.15.73:0/2440600525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78d01066f0 0x7f78d0106b10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:39.056 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.405+0000 7f78d5ce4700 1 -- 172.21.15.73:0/2440600525 >> 172.21.15.73:0/2440600525 conn(0x7f78d00ffe10 msgr2=0x7f78d0102270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:39.056 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.405+0000 7f78d5ce4700 1 -- 172.21.15.73:0/2440600525 shutdown_connections 2023-08-10T11:44:39.056 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.405+0000 7f78d5ce4700 1 -- 172.21.15.73:0/2440600525 wait complete. 2023-08-10T11:44:39.056 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.406+0000 7f78d5ce4700 1 Processor -- start 2023-08-10T11:44:39.056 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.406+0000 7f78d5ce4700 1 -- start start 2023-08-10T11:44:39.057 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.406+0000 7f78d5ce4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78d01066f0 0x7f78d0199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:39.057 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.406+0000 7f78d5ce4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d019a4b0 con 0x7f78d01066f0 2023-08-10T11:44:39.057 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.406+0000 7f78cf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78d01066f0 0x7f78d0199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:39.057 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.406+0000 7f78cf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78d01066f0 0x7f78d0199f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57812/0 (socket says 172.21.15.73:57812) 2023-08-10T11:44:39.057 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.406+0000 7f78cf7fe700 1 -- 172.21.15.73:0/3352334056 learned_addr learned my addr 172.21.15.73:0/3352334056 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:39.057 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.406+0000 7f78cf7fe700 1 -- 172.21.15.73:0/3352334056 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c0009550 con 0x7f78d01066f0 2023-08-10T11:44:39.057 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.406+0000 7f78cf7fe700 1 --2- 172.21.15.73:0/3352334056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78d01066f0 0x7f78d0199f70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f78c0003e60 tx=0x7f78c0011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:39.058 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.407+0000 7f78ccff9700 1 -- 172.21.15.73:0/3352334056 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78c0003a60 con 0x7f78d01066f0 2023-08-10T11:44:39.058 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.407+0000 7f78ccff9700 1 -- 172.21.15.73:0/3352334056 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78c0003bc0 con 0x7f78d01066f0 2023-08-10T11:44:39.058 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.407+0000 7f78ccff9700 1 -- 172.21.15.73:0/3352334056 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78c00196c0 con 0x7f78d01066f0 2023-08-10T11:44:39.058 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.407+0000 7f78d5ce4700 1 -- 172.21.15.73:0/3352334056 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d019a6b0 con 0x7f78d01066f0 2023-08-10T11:44:39.058 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.407+0000 7f78d5ce4700 1 -- 172.21.15.73:0/3352334056 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d019aad0 con 0x7f78d01066f0 2023-08-10T11:44:39.058 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.408+0000 7f78ccff9700 1 -- 172.21.15.73:0/3352334056 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f78c0019880 con 0x7f78d01066f0 2023-08-10T11:44:39.058 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.408+0000 7f78d5ce4700 1 -- 172.21.15.73:0/3352334056 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d0061da0 con 0x7f78d01066f0 2023-08-10T11:44:39.058 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.408+0000 7f78ccff9700 1 --2- 172.21.15.73:0/3352334056 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f78b80387a0 0x7f78b803ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:39.059 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.408+0000 7f78ccff9700 1 -- 172.21.15.73:0/3352334056 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f78c004c8b0 con 0x7f78d01066f0 2023-08-10T11:44:39.059 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.408+0000 7f78ceffd700 1 --2- 172.21.15.73:0/3352334056 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f78b80387a0 0x7f78b803ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:39.059 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.408+0000 7f78ceffd700 1 --2- 172.21.15.73:0/3352334056 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f78b80387a0 0x7f78b803ac60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f78c4006fd0 tx=0x7f78c4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:39.059 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.413+0000 7f78ccff9700 1 -- 172.21.15.73:0/3352334056 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f78c0010c40 con 0x7f78d01066f0 2023-08-10T11:44:39.059 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.606+0000 7f78d5ce4700 1 -- 172.21.15.73:0/3352334056 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f78d019d510 con 0x7f78d01066f0 2023-08-10T11:44:39.060 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.609+0000 7f78ccff9700 1 -- 172.21.15.73:0/3352334056 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f78c002be60 con 0x7f78d01066f0 2023-08-10T11:44:39.060 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.611+0000 7f78d5ce4700 1 -- 172.21.15.73:0/3352334056 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f78b80387a0 msgr2=0x7f78b803ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:39.060 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.611+0000 7f78d5ce4700 1 --2- 172.21.15.73:0/3352334056 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f78b80387a0 0x7f78b803ac60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f78c4006fd0 tx=0x7f78c4006e40 comp rx=0 tx=0).stop 2023-08-10T11:44:39.060 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.611+0000 7f78d5ce4700 1 -- 172.21.15.73:0/3352334056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78d01066f0 msgr2=0x7f78d0199f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:39.060 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.611+0000 7f78d5ce4700 1 --2- 172.21.15.73:0/3352334056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78d01066f0 0x7f78d0199f70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f78c0003e60 tx=0x7f78c0011a30 comp rx=0 tx=0).stop 2023-08-10T11:44:39.060 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.612+0000 7f78d5ce4700 1 -- 172.21.15.73:0/3352334056 shutdown_connections 2023-08-10T11:44:39.060 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.612+0000 7f78d5ce4700 1 --2- 172.21.15.73:0/3352334056 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f78b80387a0 0x7f78b803ac60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:39.061 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.612+0000 7f78d5ce4700 1 --2- 172.21.15.73:0/3352334056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78d01066f0 0x7f78d0199f70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:39.061 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.612+0000 7f78d5ce4700 1 -- 172.21.15.73:0/3352334056 >> 172.21.15.73:0/3352334056 conn(0x7f78d00ffe10 msgr2=0x7f78d0104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:39.061 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.612+0000 7f78d5ce4700 1 -- 172.21.15.73:0/3352334056 shutdown_connections 2023-08-10T11:44:39.061 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:38.612+0000 7f78d5ce4700 1 -- 172.21.15.73:0/3352334056 wait complete. 2023-08-10T11:44:39.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:39 smithi073 ceph-mon[128869]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:44:39.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:39 smithi073 ceph-mon[128869]: Saving service mgr spec with placement count:2 2023-08-10T11:44:39.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:39 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3352334056' entity='client.admin' 2023-08-10T11:44:40.398 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.698+0000 7f42daf50700 1 Processor -- start 2023-08-10T11:44:40.398 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.698+0000 7f42daf50700 1 -- start start 2023-08-10T11:44:40.398 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.698+0000 7f42daf50700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42d4105100 0x7f42d4105520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:40.398 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.698+0000 7f42daf50700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d4105af0 con 0x7f42d4105100 2023-08-10T11:44:40.399 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.699+0000 7f42d8cec700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42d4105100 0x7f42d4105520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:40.399 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.699+0000 7f42d8cec700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42d4105100 0x7f42d4105520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57816/0 (socket says 172.21.15.73:57816) 2023-08-10T11:44:40.399 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.699+0000 7f42d8cec700 1 -- 172.21.15.73:0/699838583 learned_addr learned my addr 172.21.15.73:0/699838583 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:40.399 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.699+0000 7f42d8cec700 1 -- 172.21.15.73:0/699838583 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d4106300 con 0x7f42d4105100 2023-08-10T11:44:40.399 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.699+0000 7f42d8cec700 1 --2- 172.21.15.73:0/699838583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42d4105100 0x7f42d4105520 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00d180 tx=0x7f42cc00d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7019bb4b9249818e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:40.399 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.699+0000 7f42d37fe700 1 -- 172.21.15.73:0/699838583 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42cc010070 con 0x7f42d4105100 2023-08-10T11:44:40.399 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.699+0000 7f42d37fe700 1 -- 172.21.15.73:0/699838583 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42cc00de20 con 0x7f42d4105100 2023-08-10T11:44:40.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.699+0000 7f42d37fe700 1 -- 172.21.15.73:0/699838583 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42cc009a90 con 0x7f42d4105100 2023-08-10T11:44:40.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.700+0000 7f42daf50700 1 -- 172.21.15.73:0/699838583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42d4105100 msgr2=0x7f42d4105520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:40.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.700+0000 7f42daf50700 1 --2- 172.21.15.73:0/699838583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42d4105100 0x7f42d4105520 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00d180 tx=0x7f42cc00d490 comp rx=0 tx=0).stop 2023-08-10T11:44:40.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.700+0000 7f42daf50700 1 -- 172.21.15.73:0/699838583 shutdown_connections 2023-08-10T11:44:40.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.700+0000 7f42daf50700 1 --2- 172.21.15.73:0/699838583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42d4105100 0x7f42d4105520 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:40.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.700+0000 7f42daf50700 1 -- 172.21.15.73:0/699838583 >> 172.21.15.73:0/699838583 conn(0x7f42d4100680 msgr2=0x7f42d4102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:40.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.700+0000 7f42daf50700 1 -- 172.21.15.73:0/699838583 shutdown_connections 2023-08-10T11:44:40.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.700+0000 7f42daf50700 1 -- 172.21.15.73:0/699838583 wait complete. 2023-08-10T11:44:40.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.700+0000 7f42daf50700 1 Processor -- start 2023-08-10T11:44:40.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.700+0000 7f42daf50700 1 -- start start 2023-08-10T11:44:40.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.701+0000 7f42daf50700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42d4105100 0x7f42d4197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:40.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.701+0000 7f42daf50700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d4198260 con 0x7f42d4105100 2023-08-10T11:44:40.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.701+0000 7f42d8cec700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42d4105100 0x7f42d4197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:40.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.701+0000 7f42d8cec700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42d4105100 0x7f42d4197d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57818/0 (socket says 172.21.15.73:57818) 2023-08-10T11:44:40.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.701+0000 7f42d8cec700 1 -- 172.21.15.73:0/1461517159 learned_addr learned my addr 172.21.15.73:0/1461517159 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:40.402 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.701+0000 7f42d8cec700 1 -- 172.21.15.73:0/1461517159 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc00bd40 con 0x7f42d4105100 2023-08-10T11:44:40.402 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.701+0000 7f42d8cec700 1 --2- 172.21.15.73:0/1461517159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42d4105100 0x7f42d4197d20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0096e0 tx=0x7f42cc009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:40.402 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.701+0000 7f42d1ffb700 1 -- 172.21.15.73:0/1461517159 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42cc010040 con 0x7f42d4105100 2023-08-10T11:44:40.402 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.701+0000 7f42d1ffb700 1 -- 172.21.15.73:0/1461517159 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42cc0044c0 con 0x7f42d4105100 2023-08-10T11:44:40.402 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.701+0000 7f42daf50700 1 -- 172.21.15.73:0/1461517159 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d4198460 con 0x7f42d4105100 2023-08-10T11:44:40.402 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.701+0000 7f42d1ffb700 1 -- 172.21.15.73:0/1461517159 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42cc0148e0 con 0x7f42d4105100 2023-08-10T11:44:40.402 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.701+0000 7f42daf50700 1 -- 172.21.15.73:0/1461517159 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d41988e0 con 0x7f42d4105100 2023-08-10T11:44:40.402 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.702+0000 7f42d1ffb700 1 -- 172.21.15.73:0/1461517159 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f42cc014b60 con 0x7f42d4105100 2023-08-10T11:44:40.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.702+0000 7f42daf50700 1 -- 172.21.15.73:0/1461517159 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d4191990 con 0x7f42d4105100 2023-08-10T11:44:40.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.702+0000 7f42d1ffb700 1 --2- 172.21.15.73:0/1461517159 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f42c00386c0 0x7f42c003ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:40.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.703+0000 7f42d1ffb700 1 -- 172.21.15.73:0/1461517159 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f42cc04e920 con 0x7f42d4105100 2023-08-10T11:44:40.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.703+0000 7f42d3fff700 1 --2- 172.21.15.73:0/1461517159 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f42c00386c0 0x7f42c003ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:40.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.703+0000 7f42d3fff700 1 --2- 172.21.15.73:0/1461517159 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f42c00386c0 0x7f42c003ab80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f42bc006fd0 tx=0x7f42bc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:40.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.707+0000 7f42d1ffb700 1 -- 172.21.15.73:0/1461517159 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f42cc026e10 con 0x7f42d4105100 2023-08-10T11:44:40.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.911+0000 7f42daf50700 1 -- 172.21.15.73:0/1461517159 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f42d402cd90 con 0x7f42d4105100 2023-08-10T11:44:40.404 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.917+0000 7f42d1ffb700 1 -- 172.21.15.73:0/1461517159 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f42cc0220c0 con 0x7f42d4105100 2023-08-10T11:44:40.404 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.919+0000 7f42daf50700 1 -- 172.21.15.73:0/1461517159 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f42c00386c0 msgr2=0x7f42c003ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:40.404 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.919+0000 7f42daf50700 1 --2- 172.21.15.73:0/1461517159 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f42c00386c0 0x7f42c003ab80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f42bc006fd0 tx=0x7f42bc006e40 comp rx=0 tx=0).stop 2023-08-10T11:44:40.404 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.919+0000 7f42daf50700 1 -- 172.21.15.73:0/1461517159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42d4105100 msgr2=0x7f42d4197d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:40.404 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.919+0000 7f42daf50700 1 --2- 172.21.15.73:0/1461517159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42d4105100 0x7f42d4197d20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0096e0 tx=0x7f42cc009be0 comp rx=0 tx=0).stop 2023-08-10T11:44:40.404 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.919+0000 7f42daf50700 1 -- 172.21.15.73:0/1461517159 shutdown_connections 2023-08-10T11:44:40.404 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.919+0000 7f42daf50700 1 --2- 172.21.15.73:0/1461517159 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f42c00386c0 0x7f42c003ab80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:40.405 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.919+0000 7f42daf50700 1 --2- 172.21.15.73:0/1461517159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42d4105100 0x7f42d4197d20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:40.405 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.919+0000 7f42daf50700 1 -- 172.21.15.73:0/1461517159 >> 172.21.15.73:0/1461517159 conn(0x7f42d4100680 msgr2=0x7f42d418ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:40.405 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.919+0000 7f42daf50700 1 -- 172.21.15.73:0/1461517159 shutdown_connections 2023-08-10T11:44:40.405 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:39.919+0000 7f42daf50700 1 -- 172.21.15.73:0/1461517159 wait complete. 2023-08-10T11:44:40.405 INFO:teuthology.orchestra.run.smithi073.stdout:Enabling the dashboard module... 2023-08-10T11:44:41.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:40 smithi073 ceph-mon[128869]: from='mgr.14120 172.21.15.73:0/1146817848' entity='mgr.x' 2023-08-10T11:44:41.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:40 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1461517159' entity='client.admin' 2023-08-10T11:44:41.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:40 smithi073 ceph-mon[128869]: from='mgr.14120 172.21.15.73:0/1146817848' entity='mgr.x' 2023-08-10T11:44:41.839 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:41 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1537661400' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-08-10T11:44:42.131 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:41 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: ignoring --setuser ceph since I am not root 2023-08-10T11:44:42.131 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:41 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: ignoring --setgroup ceph since I am not root 2023-08-10T11:44:42.131 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:41 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:41.972+0000 7fc8d64d0200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-10T11:44:42.132 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:42 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:42.051+0000 7fc8d64d0200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-10T11:44:42.400 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:42 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:42.143+0000 7fc8d64d0200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-10T11:44:42.401 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:42 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:42.237+0000 7fc8d64d0200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-10T11:44:42.447 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.886+0000 7fb850b09700 1 Processor -- start 2023-08-10T11:44:42.448 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.886+0000 7fb850b09700 1 -- start start 2023-08-10T11:44:42.448 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.886+0000 7fb850b09700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb84c106ca0 0x7fb84c109090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:42.448 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.886+0000 7fb850b09700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c079e00 con 0x7fb84c106ca0 2023-08-10T11:44:42.448 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.887+0000 7fb84a59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb84c106ca0 0x7fb84c109090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:42.448 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.887+0000 7fb84a59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb84c106ca0 0x7fb84c109090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57822/0 (socket says 172.21.15.73:57822) 2023-08-10T11:44:42.448 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.887+0000 7fb84a59c700 1 -- 172.21.15.73:0/2871548892 learned_addr learned my addr 172.21.15.73:0/2871548892 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:42.449 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.887+0000 7fb84a59c700 1 -- 172.21.15.73:0/2871548892 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84c1095d0 con 0x7fb84c106ca0 2023-08-10T11:44:42.449 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.887+0000 7fb84a59c700 1 --2- 172.21.15.73:0/2871548892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb84c106ca0 0x7fb84c109090 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb83c0098a0 tx=0x7fb83c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd9b7bff61813 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:42.449 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.887+0000 7fb84959a700 1 -- 172.21.15.73:0/2871548892 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb83c004160 con 0x7fb84c106ca0 2023-08-10T11:44:42.449 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.887+0000 7fb84959a700 1 -- 172.21.15.73:0/2871548892 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb83c0042c0 con 0x7fb84c106ca0 2023-08-10T11:44:42.449 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.887+0000 7fb84959a700 1 -- 172.21.15.73:0/2871548892 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb83c0119b0 con 0x7fb84c106ca0 2023-08-10T11:44:42.449 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.888+0000 7fb850b09700 1 -- 172.21.15.73:0/2871548892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb84c106ca0 msgr2=0x7fb84c109090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:42.449 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.888+0000 7fb850b09700 1 --2- 172.21.15.73:0/2871548892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb84c106ca0 0x7fb84c109090 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb83c0098a0 tx=0x7fb83c009bb0 comp rx=0 tx=0).stop 2023-08-10T11:44:42.450 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.888+0000 7fb850b09700 1 -- 172.21.15.73:0/2871548892 shutdown_connections 2023-08-10T11:44:42.450 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.888+0000 7fb850b09700 1 --2- 172.21.15.73:0/2871548892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb84c106ca0 0x7fb84c109090 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:42.450 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.888+0000 7fb850b09700 1 -- 172.21.15.73:0/2871548892 >> 172.21.15.73:0/2871548892 conn(0x7fb84c1006b0 msgr2=0x7fb84c102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:42.450 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.888+0000 7fb850b09700 1 -- 172.21.15.73:0/2871548892 shutdown_connections 2023-08-10T11:44:42.450 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.888+0000 7fb850b09700 1 -- 172.21.15.73:0/2871548892 wait complete. 2023-08-10T11:44:42.450 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.889+0000 7fb850b09700 1 Processor -- start 2023-08-10T11:44:42.450 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.889+0000 7fb850b09700 1 -- start start 2023-08-10T11:44:42.451 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.889+0000 7fb850b09700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb84c106ca0 0x7fb84c106600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:42.451 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.889+0000 7fb850b09700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c106b40 con 0x7fb84c106ca0 2023-08-10T11:44:42.451 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.889+0000 7fb84a59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb84c106ca0 0x7fb84c106600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:42.451 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.889+0000 7fb84a59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb84c106ca0 0x7fb84c106600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57824/0 (socket says 172.21.15.73:57824) 2023-08-10T11:44:42.451 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.889+0000 7fb84a59c700 1 -- 172.21.15.73:0/1537661400 learned_addr learned my addr 172.21.15.73:0/1537661400 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:42.452 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.889+0000 7fb84a59c700 1 -- 172.21.15.73:0/1537661400 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c009550 con 0x7fb84c106ca0 2023-08-10T11:44:42.452 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.889+0000 7fb84a59c700 1 --2- 172.21.15.73:0/1537661400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb84c106ca0 0x7fb84c106600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb83c003f00 tx=0x7fb83c011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:42.452 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.890+0000 7fb83b7fe700 1 -- 172.21.15.73:0/1537661400 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb83c003b20 con 0x7fb84c106ca0 2023-08-10T11:44:42.452 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.890+0000 7fb850b09700 1 -- 172.21.15.73:0/1537661400 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb84c104c50 con 0x7fb84c106ca0 2023-08-10T11:44:42.452 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.890+0000 7fb850b09700 1 -- 172.21.15.73:0/1537661400 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84c105070 con 0x7fb84c106ca0 2023-08-10T11:44:42.452 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.890+0000 7fb83b7fe700 1 -- 172.21.15.73:0/1537661400 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb83c003c80 con 0x7fb84c106ca0 2023-08-10T11:44:42.452 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.890+0000 7fb83b7fe700 1 -- 172.21.15.73:0/1537661400 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb83c019770 con 0x7fb84c106ca0 2023-08-10T11:44:42.453 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.890+0000 7fb83b7fe700 1 -- 172.21.15.73:0/1537661400 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7fb83c019a80 con 0x7fb84c106ca0 2023-08-10T11:44:42.453 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.891+0000 7fb850b09700 1 -- 172.21.15.73:0/1537661400 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb82c005320 con 0x7fb84c106ca0 2023-08-10T11:44:42.453 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.891+0000 7fb83b7fe700 1 --2- 172.21.15.73:0/1537661400 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fb834038760 0x7fb83403ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:42.453 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.891+0000 7fb83b7fe700 1 -- 172.21.15.73:0/1537661400 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb83c04c8e0 con 0x7fb84c106ca0 2023-08-10T11:44:42.453 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.891+0000 7fb849d9b700 1 --2- 172.21.15.73:0/1537661400 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fb834038760 0x7fb83403ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:42.453 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.891+0000 7fb849d9b700 1 --2- 172.21.15.73:0/1537661400 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fb834038760 0x7fb83403ac20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb840006fd0 tx=0x7fb840006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:42.453 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:40.895+0000 7fb83b7fe700 1 -- 172.21.15.73:0/1537661400 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fb83c018db0 con 0x7fb84c106ca0 2023-08-10T11:44:42.454 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:41.151+0000 7fb850b09700 1 -- 172.21.15.73:0/1537661400 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fb82c0059f0 con 0x7fb84c106ca0 2023-08-10T11:44:42.454 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:41.793+0000 7fb83b7fe700 1 -- 172.21.15.73:0/1537661400 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 9) v1 ==== 45496+0+0 (secure 0 0 0) 0x7fb83c019d30 con 0x7fb84c106ca0 2023-08-10T11:44:42.454 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:41.795+0000 7fb83b7fe700 1 -- 172.21.15.73:0/1537661400 <== mon.0 v2:172.21.15.73:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fb83c023c00 con 0x7fb84c106ca0 2023-08-10T11:44:42.454 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:41.798+0000 7fb850b09700 1 -- 172.21.15.73:0/1537661400 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fb834038760 msgr2=0x7fb83403ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:42.454 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:41.798+0000 7fb850b09700 1 --2- 172.21.15.73:0/1537661400 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fb834038760 0x7fb83403ac20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb840006fd0 tx=0x7fb840006e40 comp rx=0 tx=0).stop 2023-08-10T11:44:42.454 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:41.799+0000 7fb850b09700 1 -- 172.21.15.73:0/1537661400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb84c106ca0 msgr2=0x7fb84c106600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:42.454 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:41.799+0000 7fb850b09700 1 --2- 172.21.15.73:0/1537661400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb84c106ca0 0x7fb84c106600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb83c003f00 tx=0x7fb83c011a30 comp rx=0 tx=0).stop 2023-08-10T11:44:42.454 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:41.799+0000 7fb850b09700 1 -- 172.21.15.73:0/1537661400 shutdown_connections 2023-08-10T11:44:42.455 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:41.799+0000 7fb850b09700 1 --2- 172.21.15.73:0/1537661400 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7fb834038760 0x7fb83403ac20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:42.455 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:41.799+0000 7fb850b09700 1 --2- 172.21.15.73:0/1537661400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb84c106ca0 0x7fb84c106600 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:42.455 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:41.799+0000 7fb850b09700 1 -- 172.21.15.73:0/1537661400 >> 172.21.15.73:0/1537661400 conn(0x7fb84c1006b0 msgr2=0x7fb84c101e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:42.455 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:41.799+0000 7fb850b09700 1 -- 172.21.15.73:0/1537661400 shutdown_connections 2023-08-10T11:44:42.455 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:41.799+0000 7fb850b09700 1 -- 172.21.15.73:0/1537661400 wait complete. 2023-08-10T11:44:42.662 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:42 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:42.409+0000 7fc8d64d0200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-10T11:44:42.963 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:42 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:42.736+0000 7fc8d64d0200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-10T11:44:42.963 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:42 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:42.826+0000 7fc8d64d0200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-10T11:44:42.963 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:42 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1537661400' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-08-10T11:44:42.964 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:42 smithi073 ceph-mon[128869]: mgrmap e9: x(active, since 15s) 2023-08-10T11:44:43.246 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:42 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:42.961+0000 7fc8d64d0200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-10T11:44:43.246 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:43 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:43.059+0000 7fc8d64d0200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-10T11:44:43.517 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:43 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:43.491+0000 7fc8d64d0200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-10T11:44:43.590 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2023-08-10T11:44:43.595 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-08-10T11:44:43.595 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "available": true, 2023-08-10T11:44:43.595 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-08-10T11:44:43.595 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-08-10T11:44:43.595 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2023-08-10T11:44:43.595 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.957+0000 7f7cd2cfc700 1 Processor -- start 2023-08-10T11:44:43.596 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.957+0000 7f7cd2cfc700 1 -- start start 2023-08-10T11:44:43.596 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.957+0000 7f7cd2cfc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ccc106cc0 0x7f7ccc1090b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:43.596 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.957+0000 7f7cd2cfc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc079de0 con 0x7f7ccc106cc0 2023-08-10T11:44:43.596 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.958+0000 7f7cd0a98700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ccc106cc0 0x7f7ccc1090b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:43.597 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.958+0000 7f7cd0a98700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ccc106cc0 0x7f7ccc1090b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57838/0 (socket says 172.21.15.73:57838) 2023-08-10T11:44:43.597 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.958+0000 7f7cd0a98700 1 -- 172.21.15.73:0/1475772174 learned_addr learned my addr 172.21.15.73:0/1475772174 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:43.597 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.958+0000 7f7cd0a98700 1 -- 172.21.15.73:0/1475772174 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ccc1095f0 con 0x7f7ccc106cc0 2023-08-10T11:44:43.597 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.958+0000 7f7cd0a98700 1 --2- 172.21.15.73:0/1475772174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ccc106cc0 0x7f7ccc1090b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00098a0 tx=0x7f7cc0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386966b6be081310 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:43.598 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.958+0000 7f7ccb7fe700 1 -- 172.21.15.73:0/1475772174 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc0004160 con 0x7f7ccc106cc0 2023-08-10T11:44:43.598 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.958+0000 7f7ccb7fe700 1 -- 172.21.15.73:0/1475772174 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7cc00042c0 con 0x7f7ccc106cc0 2023-08-10T11:44:43.598 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.958+0000 7f7ccb7fe700 1 -- 172.21.15.73:0/1475772174 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc00119b0 con 0x7f7ccc106cc0 2023-08-10T11:44:43.599 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.959+0000 7f7cd2cfc700 1 -- 172.21.15.73:0/1475772174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ccc106cc0 msgr2=0x7f7ccc1090b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:43.599 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.959+0000 7f7cd2cfc700 1 --2- 172.21.15.73:0/1475772174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ccc106cc0 0x7f7ccc1090b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00098a0 tx=0x7f7cc0009bb0 comp rx=0 tx=0).stop 2023-08-10T11:44:43.599 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.959+0000 7f7cd2cfc700 1 -- 172.21.15.73:0/1475772174 shutdown_connections 2023-08-10T11:44:43.599 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.959+0000 7f7cd2cfc700 1 --2- 172.21.15.73:0/1475772174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ccc106cc0 0x7f7ccc1090b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:43.600 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.959+0000 7f7cd2cfc700 1 -- 172.21.15.73:0/1475772174 >> 172.21.15.73:0/1475772174 conn(0x7f7ccc100670 msgr2=0x7f7ccc102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:43.600 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.959+0000 7f7cd2cfc700 1 -- 172.21.15.73:0/1475772174 shutdown_connections 2023-08-10T11:44:43.600 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.959+0000 7f7cd2cfc700 1 -- 172.21.15.73:0/1475772174 wait complete. 2023-08-10T11:44:43.600 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.960+0000 7f7cd2cfc700 1 Processor -- start 2023-08-10T11:44:43.601 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.960+0000 7f7cd2cfc700 1 -- start start 2023-08-10T11:44:43.601 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.960+0000 7f7cd2cfc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ccc106cc0 0x7f7ccc106620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:43.601 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.960+0000 7f7cd2cfc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc106b60 con 0x7f7ccc106cc0 2023-08-10T11:44:43.602 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.960+0000 7f7cd0a98700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ccc106cc0 0x7f7ccc106620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:43.602 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.960+0000 7f7cd0a98700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ccc106cc0 0x7f7ccc106620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57840/0 (socket says 172.21.15.73:57840) 2023-08-10T11:44:43.602 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.960+0000 7f7cd0a98700 1 -- 172.21.15.73:0/2622693304 learned_addr learned my addr 172.21.15.73:0/2622693304 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:43.602 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.961+0000 7f7cd0a98700 1 -- 172.21.15.73:0/2622693304 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc0009550 con 0x7f7ccc106cc0 2023-08-10T11:44:43.602 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.961+0000 7f7cd0a98700 1 --2- 172.21.15.73:0/2622693304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ccc106cc0 0x7f7ccc106620 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0006af0 tx=0x7f7cc0011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:43.602 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.961+0000 7f7cc9ffb700 1 -- 172.21.15.73:0/2622693304 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc0003a40 con 0x7f7ccc106cc0 2023-08-10T11:44:43.602 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.961+0000 7f7cc9ffb700 1 -- 172.21.15.73:0/2622693304 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7cc0003ba0 con 0x7f7ccc106cc0 2023-08-10T11:44:43.603 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.961+0000 7f7cd2cfc700 1 -- 172.21.15.73:0/2622693304 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ccc104c70 con 0x7f7ccc106cc0 2023-08-10T11:44:43.603 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.961+0000 7f7cc9ffb700 1 -- 172.21.15.73:0/2622693304 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cc00196c0 con 0x7f7ccc106cc0 2023-08-10T11:44:43.603 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.961+0000 7f7cd2cfc700 1 -- 172.21.15.73:0/2622693304 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ccc105090 con 0x7f7ccc106cc0 2023-08-10T11:44:43.603 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.962+0000 7f7cd2cfc700 1 -- 172.21.15.73:0/2622693304 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ccc061da0 con 0x7f7ccc106cc0 2023-08-10T11:44:43.603 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.962+0000 7f7cc9ffb700 1 -- 172.21.15.73:0/2622693304 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 9) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f7cc001aa80 con 0x7f7ccc106cc0 2023-08-10T11:44:43.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.963+0000 7f7cc9ffb700 1 --2- 172.21.15.73:0/2622693304 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f7cbc038760 0x7f7cbc03ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:43.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.963+0000 7f7cc9ffb700 1 -- 172.21.15.73:0/2622693304 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f7cc004c9a0 con 0x7f7ccc106cc0 2023-08-10T11:44:43.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.963+0000 7f7ccbfff700 1 -- 172.21.15.73:0/2622693304 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f7cbc038760 msgr2=0x7f7cbc03ac20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/16358451 2023-08-10T11:44:43.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.963+0000 7f7ccbfff700 1 --2- 172.21.15.73:0/2622693304 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f7cbc038760 0x7f7cbc03ac20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-10T11:44:43.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:42.967+0000 7f7cc9ffb700 1 -- 172.21.15.73:0/2622693304 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f7cc001a430 con 0x7f7ccc106cc0 2023-08-10T11:44:43.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:43.164+0000 7f7ccbfff700 1 -- 172.21.15.73:0/2622693304 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f7cbc038760 msgr2=0x7f7cbc03ac20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/16358451 2023-08-10T11:44:43.604 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:43.164+0000 7f7ccbfff700 1 --2- 172.21.15.73:0/2622693304 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f7cbc038760 0x7f7cbc03ac20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-10T11:44:43.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:43.213+0000 7f7cd2cfc700 1 -- 172.21.15.73:0/2622693304 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f7ccc105390 con 0x7f7ccc106cc0 2023-08-10T11:44:43.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:43.213+0000 7f7cc9ffb700 1 -- 172.21.15.73:0/2622693304 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f7cc0023390 con 0x7f7ccc106cc0 2023-08-10T11:44:43.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:43.216+0000 7f7cd2cfc700 1 -- 172.21.15.73:0/2622693304 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f7cbc038760 msgr2=0x7f7cbc03ac20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T11:44:43.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:43.216+0000 7f7cd2cfc700 1 --2- 172.21.15.73:0/2622693304 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f7cbc038760 0x7f7cbc03ac20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:43.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:43.216+0000 7f7cd2cfc700 1 -- 172.21.15.73:0/2622693304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ccc106cc0 msgr2=0x7f7ccc106620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:43.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:43.216+0000 7f7cd2cfc700 1 --2- 172.21.15.73:0/2622693304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ccc106cc0 0x7f7ccc106620 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0006af0 tx=0x7f7cc0011a10 comp rx=0 tx=0).stop 2023-08-10T11:44:43.605 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:43.216+0000 7f7cd2cfc700 1 -- 172.21.15.73:0/2622693304 shutdown_connections 2023-08-10T11:44:43.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:43.216+0000 7f7cd2cfc700 1 --2- 172.21.15.73:0/2622693304 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7f7cbc038760 0x7f7cbc03ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:43.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:43.216+0000 7f7cd2cfc700 1 --2- 172.21.15.73:0/2622693304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ccc106cc0 0x7f7ccc106620 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:43.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:43.216+0000 7f7cd2cfc700 1 -- 172.21.15.73:0/2622693304 >> 172.21.15.73:0/2622693304 conn(0x7f7ccc100670 msgr2=0x7f7ccc101dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:43.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:43.216+0000 7f7cd2cfc700 1 -- 172.21.15.73:0/2622693304 shutdown_connections 2023-08-10T11:44:43.606 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:43.216+0000 7f7cd2cfc700 1 -- 172.21.15.73:0/2622693304 wait complete. 2023-08-10T11:44:43.606 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for the mgr to restart... 2023-08-10T11:44:43.606 INFO:teuthology.orchestra.run.smithi073.stdout:Waiting for mgr epoch 9... 2023-08-10T11:44:43.812 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:43 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2622693304' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-08-10T11:44:44.517 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:44 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:44.079+0000 7fc8d64d0200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-10T11:44:44.518 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:44 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:44.250+0000 7fc8d64d0200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-10T11:44:45.267 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:45 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:45.009+0000 7fc8d64d0200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-10T11:44:45.268 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:45 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:45.101+0000 7fc8d64d0200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-10T11:44:45.550 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:45 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:45.274+0000 7fc8d64d0200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-10T11:44:45.922 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:45 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:45.550+0000 7fc8d64d0200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-10T11:44:45.922 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:45 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:45.775+0000 7fc8d64d0200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-10T11:44:46.183 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:45 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:45.921+0000 7fc8d64d0200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-10T11:44:46.517 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:46 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:46.182+0000 7fc8d64d0200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-10T11:44:47.194 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:46 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:46.874+0000 7fc8d64d0200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-10T11:44:47.194 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:47 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:47.003+0000 7fc8d64d0200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-10T11:44:47.517 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:47 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:47.193+0000 7fc8d64d0200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-10T11:44:47.517 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:47 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:47.306+0000 7fc8d64d0200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-10T11:44:48.017 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:47 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:47.523+0000 7fc8d64d0200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-10T11:44:48.768 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:44:48 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:44:48.387+0000 7fc8d64d0200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-10T11:44:48.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:48 smithi073 ceph-mon[128869]: Active manager daemon x restarted 2023-08-10T11:44:48.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:48 smithi073 ceph-mon[128869]: Activating manager daemon x 2023-08-10T11:44:48.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:48 smithi073 ceph-mon[128869]: osdmap e3: 0 total, 0 up, 0 in 2023-08-10T11:44:48.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:48 smithi073 ceph-mon[128869]: mgrmap e10: x(active, starting, since 0.00339193s) 2023-08-10T11:44:48.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:48 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T11:44:48.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:48 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-08-10T11:44:48.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:48 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-08-10T11:44:48.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:48 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-08-10T11:44:48.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:48 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-08-10T11:44:48.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:48 smithi073 ceph-mon[128869]: Manager daemon x is now available 2023-08-10T11:44:48.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:48 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:44:48.770 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:48 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:44:49.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:49 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-08-10T11:44:49.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:49 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-08-10T11:44:49.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:49 smithi073 ceph-mon[128869]: mgrmap e11: x(active, since 1.01485s) 2023-08-10T11:44:50.153 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout { 2023-08-10T11:44:50.153 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-08-10T11:44:50.153 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout "initialized": true 2023-08-10T11:44:50.154 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout } 2023-08-10T11:44:50.154 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.119+0000 7ff2fefc5700 1 Processor -- start 2023-08-10T11:44:50.154 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.119+0000 7ff2fefc5700 1 -- start start 2023-08-10T11:44:50.154 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.119+0000 7ff2fefc5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2f8106ca0 0x7ff2f8109090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:50.154 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.119+0000 7ff2fefc5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f8079e00 con 0x7ff2f8106ca0 2023-08-10T11:44:50.154 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.119+0000 7ff2fcd61700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2f8106ca0 0x7ff2f8109090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:50.154 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.119+0000 7ff2fcd61700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2f8106ca0 0x7ff2f8109090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57848/0 (socket says 172.21.15.73:57848) 2023-08-10T11:44:50.155 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.119+0000 7ff2fcd61700 1 -- 172.21.15.73:0/4292183656 learned_addr learned my addr 172.21.15.73:0/4292183656 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:50.155 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.119+0000 7ff2fcd61700 1 -- 172.21.15.73:0/4292183656 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f81095d0 con 0x7ff2f8106ca0 2023-08-10T11:44:50.155 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.120+0000 7ff2fcd61700 1 --2- 172.21.15.73:0/4292183656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2f8106ca0 0x7ff2f8109090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0098a0 tx=0x7ff2ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4848b36898d3a673 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:50.155 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.120+0000 7ff2f77fe700 1 -- 172.21.15.73:0/4292183656 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff2ec004160 con 0x7ff2f8106ca0 2023-08-10T11:44:50.155 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.120+0000 7ff2f77fe700 1 -- 172.21.15.73:0/4292183656 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff2ec0042c0 con 0x7ff2f8106ca0 2023-08-10T11:44:50.155 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.120+0000 7ff2f77fe700 1 -- 172.21.15.73:0/4292183656 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff2ec0119b0 con 0x7ff2f8106ca0 2023-08-10T11:44:50.155 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.120+0000 7ff2fefc5700 1 -- 172.21.15.73:0/4292183656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2f8106ca0 msgr2=0x7ff2f8109090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:50.155 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.121+0000 7ff2fefc5700 1 --2- 172.21.15.73:0/4292183656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2f8106ca0 0x7ff2f8109090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0098a0 tx=0x7ff2ec009bb0 comp rx=0 tx=0).stop 2023-08-10T11:44:50.156 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.121+0000 7ff2fefc5700 1 -- 172.21.15.73:0/4292183656 shutdown_connections 2023-08-10T11:44:50.156 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.121+0000 7ff2fefc5700 1 --2- 172.21.15.73:0/4292183656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2f8106ca0 0x7ff2f8109090 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:50.156 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.121+0000 7ff2fefc5700 1 -- 172.21.15.73:0/4292183656 >> 172.21.15.73:0/4292183656 conn(0x7ff2f8100670 msgr2=0x7ff2f8102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:50.156 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.121+0000 7ff2fefc5700 1 -- 172.21.15.73:0/4292183656 shutdown_connections 2023-08-10T11:44:50.156 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.121+0000 7ff2fefc5700 1 -- 172.21.15.73:0/4292183656 wait complete. 2023-08-10T11:44:50.156 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.121+0000 7ff2fefc5700 1 Processor -- start 2023-08-10T11:44:50.157 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.121+0000 7ff2fefc5700 1 -- start start 2023-08-10T11:44:50.157 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.121+0000 7ff2fefc5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2f8106ca0 0x7ff2f8106600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:50.157 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.121+0000 7ff2fefc5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f8106b40 con 0x7ff2f8106ca0 2023-08-10T11:44:50.157 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.122+0000 7ff2fcd61700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2f8106ca0 0x7ff2f8106600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:50.157 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.122+0000 7ff2fcd61700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2f8106ca0 0x7ff2f8106600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57850/0 (socket says 172.21.15.73:57850) 2023-08-10T11:44:50.157 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.122+0000 7ff2fcd61700 1 -- 172.21.15.73:0/2721491185 learned_addr learned my addr 172.21.15.73:0/2721491185 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:50.157 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.122+0000 7ff2fcd61700 1 -- 172.21.15.73:0/2721491185 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec009550 con 0x7ff2f8106ca0 2023-08-10T11:44:50.157 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.122+0000 7ff2fcd61700 1 --2- 172.21.15.73:0/2721491185 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2f8106ca0 0x7ff2f8106600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec006af0 tx=0x7ff2ec011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:50.158 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.122+0000 7ff2f5ffb700 1 -- 172.21.15.73:0/2721491185 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff2ec003a40 con 0x7ff2f8106ca0 2023-08-10T11:44:50.158 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.122+0000 7ff2f5ffb700 1 -- 172.21.15.73:0/2721491185 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff2ec003ba0 con 0x7ff2f8106ca0 2023-08-10T11:44:50.158 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.122+0000 7ff2fefc5700 1 -- 172.21.15.73:0/2721491185 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f8104c50 con 0x7ff2f8106ca0 2023-08-10T11:44:50.158 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.122+0000 7ff2f5ffb700 1 -- 172.21.15.73:0/2721491185 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff2ec0196c0 con 0x7ff2f8106ca0 2023-08-10T11:44:50.158 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.122+0000 7ff2fefc5700 1 -- 172.21.15.73:0/2721491185 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f8105070 con 0x7ff2f8106ca0 2023-08-10T11:44:50.158 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.123+0000 7ff2f5ffb700 1 -- 172.21.15.73:0/2721491185 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 9) v1 ==== 45496+0+0 (secure 0 0 0) 0x7ff2ec019980 con 0x7ff2f8106ca0 2023-08-10T11:44:50.159 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.123+0000 7ff2f5ffb700 1 --2- 172.21.15.73:0/2721491185 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7ff2e8038710 0x7ff2e803abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:50.159 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.123+0000 7ff2f5ffb700 1 -- 172.21.15.73:0/2721491185 --> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff2e803b2e0 con 0x7ff2e8038710 2023-08-10T11:44:50.159 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.124+0000 7ff2f5ffb700 1 -- 172.21.15.73:0/2721491185 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff2ec04ca00 con 0x7ff2f8106ca0 2023-08-10T11:44:50.159 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.124+0000 7ff2f7fff700 1 -- 172.21.15.73:0/2721491185 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7ff2e8038710 msgr2=0x7ff2e803abd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/16358451 2023-08-10T11:44:50.159 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.124+0000 7ff2f7fff700 1 --2- 172.21.15.73:0/2721491185 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7ff2e8038710 0x7ff2e803abd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-10T11:44:50.159 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.325+0000 7ff2f7fff700 1 -- 172.21.15.73:0/2721491185 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7ff2e8038710 msgr2=0x7ff2e803abd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/16358451 2023-08-10T11:44:50.159 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.325+0000 7ff2f7fff700 1 --2- 172.21.15.73:0/2721491185 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7ff2e8038710 0x7ff2e803abd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-10T11:44:50.160 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.726+0000 7ff2f7fff700 1 -- 172.21.15.73:0/2721491185 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7ff2e8038710 msgr2=0x7ff2e803abd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/16358451 2023-08-10T11:44:50.160 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:44.726+0000 7ff2f7fff700 1 --2- 172.21.15.73:0/2721491185 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7ff2e8038710 0x7ff2e803abd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-08-10T11:44:50.160 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:45.527+0000 7ff2f7fff700 1 -- 172.21.15.73:0/2721491185 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7ff2e8038710 msgr2=0x7ff2e803abd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/16358451 2023-08-10T11:44:50.160 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:45.528+0000 7ff2f7fff700 1 --2- 172.21.15.73:0/2721491185 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7ff2e8038710 0x7ff2e803abd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-08-10T11:44:50.160 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:47.129+0000 7ff2f7fff700 1 -- 172.21.15.73:0/2721491185 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7ff2e8038710 msgr2=0x7ff2e803abd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/16358451 2023-08-10T11:44:50.160 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:47.129+0000 7ff2f7fff700 1 --2- 172.21.15.73:0/2721491185 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7ff2e8038710 0x7ff2e803abd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-08-10T11:44:50.160 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:48.403+0000 7ff2f5ffb700 1 -- 172.21.15.73:0/2721491185 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mgrmap(e 10) v1 ==== 45263+0+0 (secure 0 0 0) 0x7ff2ec02dcd0 con 0x7ff2f8106ca0 2023-08-10T11:44:50.160 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:48.403+0000 7ff2f5ffb700 1 -- 172.21.15.73:0/2721491185 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7ff2e8038710 msgr2=0x7ff2e803abd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T11:44:50.161 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:48.403+0000 7ff2f5ffb700 1 --2- 172.21.15.73:0/2721491185 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7ff2e8038710 0x7ff2e803abd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:50.161 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:49.414+0000 7ff2f5ffb700 1 -- 172.21.15.73:0/2721491185 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 11) v1 ==== 45390+0+0 (secure 0 0 0) 0x7ff2ec02d430 con 0x7ff2f8106ca0 2023-08-10T11:44:50.161 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:49.414+0000 7ff2f5ffb700 1 --2- 172.21.15.73:0/2721491185 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff2e803bfb0 0x7ff2e803e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:50.161 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:49.414+0000 7ff2f5ffb700 1 -- 172.21.15.73:0/2721491185 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff2e803b2e0 con 0x7ff2e803bfb0 2023-08-10T11:44:50.161 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:49.414+0000 7ff2f7fff700 1 --2- 172.21.15.73:0/2721491185 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff2e803bfb0 0x7ff2e803e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:50.161 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:49.415+0000 7ff2f7fff700 1 --2- 172.21.15.73:0/2721491185 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff2e803bfb0 0x7ff2e803e3a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4003a10 tx=0x7ff2e40092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:50.161 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:49.415+0000 7ff2f5ffb700 1 -- 172.21.15.73:0/2721491185 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7ff2e803b2e0 con 0x7ff2e803bfb0 2023-08-10T11:44:50.162 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:49.422+0000 7ff2fefc5700 1 -- 172.21.15.73:0/2721491185 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7ff2f81061a0 con 0x7ff2e803bfb0 2023-08-10T11:44:50.162 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:49.422+0000 7ff2f5ffb700 1 -- 172.21.15.73:0/2721491185 <== mgr.14152 v2:172.21.15.73:6800/3797582815 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7ff2f81061a0 con 0x7ff2e803bfb0 2023-08-10T11:44:50.162 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:49.422+0000 7ff2fefc5700 1 -- 172.21.15.73:0/2721491185 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff2e803bfb0 msgr2=0x7ff2e803e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:50.162 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:49.422+0000 7ff2fefc5700 1 --2- 172.21.15.73:0/2721491185 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff2e803bfb0 0x7ff2e803e3a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4003a10 tx=0x7ff2e40092b0 comp rx=0 tx=0).stop 2023-08-10T11:44:50.162 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:49.422+0000 7ff2fefc5700 1 -- 172.21.15.73:0/2721491185 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2f8106ca0 msgr2=0x7ff2f8106600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:50.162 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:49.422+0000 7ff2fefc5700 1 --2- 172.21.15.73:0/2721491185 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2f8106ca0 0x7ff2f8106600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec006af0 tx=0x7ff2ec011a10 comp rx=0 tx=0).stop 2023-08-10T11:44:50.162 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:49.422+0000 7ff2fefc5700 1 -- 172.21.15.73:0/2721491185 shutdown_connections 2023-08-10T11:44:50.163 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:49.422+0000 7ff2fefc5700 1 --2- 172.21.15.73:0/2721491185 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff2e803bfb0 0x7ff2e803e3a0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:50.163 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:49.422+0000 7ff2fefc5700 1 --2- 172.21.15.73:0/2721491185 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2f8106ca0 0x7ff2f8106600 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:50.163 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:49.422+0000 7ff2fefc5700 1 --2- 172.21.15.73:0/2721491185 >> [v2:172.21.15.73:6800/16358451,v1:172.21.15.73:6801/16358451] conn(0x7ff2e8038710 0x7ff2e803abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:50.163 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:49.422+0000 7ff2fefc5700 1 -- 172.21.15.73:0/2721491185 >> 172.21.15.73:0/2721491185 conn(0x7ff2f8100670 msgr2=0x7ff2f8101dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:50.163 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:49.422+0000 7ff2fefc5700 1 -- 172.21.15.73:0/2721491185 shutdown_connections 2023-08-10T11:44:50.163 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:49.422+0000 7ff2fefc5700 1 -- 172.21.15.73:0/2721491185 wait complete. 2023-08-10T11:44:50.163 INFO:teuthology.orchestra.run.smithi073.stdout:mgr epoch 9 is available 2023-08-10T11:44:50.163 INFO:teuthology.orchestra.run.smithi073.stdout:Generating a dashboard self-signed certificate... 2023-08-10T11:44:50.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:50 smithi073 ceph-mon[128869]: [10/Aug/2023:11:44:48] ENGINE Bus STARTING 2023-08-10T11:44:50.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:50 smithi073 ceph-mon[128869]: [10/Aug/2023:11:44:48] ENGINE Serving on http://172.21.15.73:8765 2023-08-10T11:44:50.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:50 smithi073 ceph-mon[128869]: [10/Aug/2023:11:44:49] ENGINE Serving on https://172.21.15.73:7150 2023-08-10T11:44:50.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:50 smithi073 ceph-mon[128869]: [10/Aug/2023:11:44:49] ENGINE Bus STARTED 2023-08-10T11:44:50.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:50 smithi073 ceph-mon[128869]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-08-10T11:44:50.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:50 smithi073 ceph-mon[128869]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-08-10T11:44:50.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:50 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:44:51.398 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-08-10T11:44:51.399 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.641+0000 7f542480f700 1 Processor -- start 2023-08-10T11:44:51.399 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.641+0000 7f542480f700 1 -- start start 2023-08-10T11:44:51.399 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.641+0000 7f542480f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5420105610 0x7f5420105a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:51.399 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.641+0000 7f542480f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5420106000 con 0x7f5420105610 2023-08-10T11:44:51.399 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.642+0000 7f541e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5420105610 0x7f5420105a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:51.399 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.642+0000 7f541e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5420105610 0x7f5420105a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57906/0 (socket says 172.21.15.73:57906) 2023-08-10T11:44:51.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.642+0000 7f541e59c700 1 -- 172.21.15.73:0/2527150628 learned_addr learned my addr 172.21.15.73:0/2527150628 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:51.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.642+0000 7f541e59c700 1 -- 172.21.15.73:0/2527150628 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5420106330 con 0x7f5420105610 2023-08-10T11:44:51.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.642+0000 7f541e59c700 1 --2- 172.21.15.73:0/2527150628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5420105610 0x7f5420105a30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f54100098a0 tx=0x7f5410009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54622d9ca1e6826 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:51.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.642+0000 7f541d59a700 1 -- 172.21.15.73:0/2527150628 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5410004160 con 0x7f5420105610 2023-08-10T11:44:51.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.642+0000 7f541d59a700 1 -- 172.21.15.73:0/2527150628 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f54100042c0 con 0x7f5420105610 2023-08-10T11:44:51.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.642+0000 7f541d59a700 1 -- 172.21.15.73:0/2527150628 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54100119b0 con 0x7f5420105610 2023-08-10T11:44:51.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.643+0000 7f542480f700 1 -- 172.21.15.73:0/2527150628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5420105610 msgr2=0x7f5420105a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:51.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.643+0000 7f542480f700 1 --2- 172.21.15.73:0/2527150628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5420105610 0x7f5420105a30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f54100098a0 tx=0x7f5410009bb0 comp rx=0 tx=0).stop 2023-08-10T11:44:51.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.643+0000 7f542480f700 1 -- 172.21.15.73:0/2527150628 shutdown_connections 2023-08-10T11:44:51.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.643+0000 7f542480f700 1 --2- 172.21.15.73:0/2527150628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5420105610 0x7f5420105a30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:51.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.643+0000 7f542480f700 1 -- 172.21.15.73:0/2527150628 >> 172.21.15.73:0/2527150628 conn(0x7f54200ffe10 msgr2=0x7f5420102270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:51.402 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.644+0000 7f542480f700 1 -- 172.21.15.73:0/2527150628 shutdown_connections 2023-08-10T11:44:51.402 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.644+0000 7f542480f700 1 -- 172.21.15.73:0/2527150628 wait complete. 2023-08-10T11:44:51.402 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.644+0000 7f542480f700 1 Processor -- start 2023-08-10T11:44:51.402 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.644+0000 7f542480f700 1 -- start start 2023-08-10T11:44:51.402 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.645+0000 7f542480f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5420105610 0x7f5420104cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:51.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.645+0000 7f542480f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542019aa90 con 0x7f5420105610 2023-08-10T11:44:51.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.645+0000 7f541e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5420105610 0x7f5420104cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:51.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.645+0000 7f541e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5420105610 0x7f5420104cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57908/0 (socket says 172.21.15.73:57908) 2023-08-10T11:44:51.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.645+0000 7f541e59c700 1 -- 172.21.15.73:0/2515220319 learned_addr learned my addr 172.21.15.73:0/2515220319 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:51.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.645+0000 7f541e59c700 1 -- 172.21.15.73:0/2515220319 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5410009550 con 0x7f5420105610 2023-08-10T11:44:51.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.645+0000 7f541e59c700 1 --2- 172.21.15.73:0/2515220319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5420105610 0x7f5420104cf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5410003f00 tx=0x7f5410011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:51.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.645+0000 7f540f7fe700 1 -- 172.21.15.73:0/2515220319 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5410003b20 con 0x7f5420105610 2023-08-10T11:44:51.403 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.645+0000 7f542480f700 1 -- 172.21.15.73:0/2515220319 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f542019ac90 con 0x7f5420105610 2023-08-10T11:44:51.404 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.645+0000 7f540f7fe700 1 -- 172.21.15.73:0/2515220319 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5410003c80 con 0x7f5420105610 2023-08-10T11:44:51.404 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.645+0000 7f540f7fe700 1 -- 172.21.15.73:0/2515220319 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5410019770 con 0x7f5420105610 2023-08-10T11:44:51.404 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.645+0000 7f542480f700 1 -- 172.21.15.73:0/2515220319 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542019b0b0 con 0x7f5420105610 2023-08-10T11:44:51.404 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.646+0000 7f540f7fe700 1 -- 172.21.15.73:0/2515220319 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 11) v1 ==== 45390+0+0 (secure 0 0 0) 0x7f5410019a30 con 0x7f5420105610 2023-08-10T11:44:51.404 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.646+0000 7f542480f700 1 -- 172.21.15.73:0/2515220319 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5420192f40 con 0x7f5420105610 2023-08-10T11:44:51.404 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.647+0000 7f540f7fe700 1 --2- 172.21.15.73:0/2515220319 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5408038630 0x7f540803aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:51.404 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.647+0000 7f540f7fe700 1 -- 172.21.15.73:0/2515220319 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f541004c8f0 con 0x7f5420105610 2023-08-10T11:44:51.405 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.647+0000 7f541dd9b700 1 --2- 172.21.15.73:0/2515220319 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5408038630 0x7f540803aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:51.405 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.647+0000 7f541dd9b700 1 --2- 172.21.15.73:0/2515220319 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5408038630 0x7f540803aaf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5414006fd0 tx=0x7f5414006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:51.405 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.652+0000 7f540f7fe700 1 -- 172.21.15.73:0/2515220319 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f5410018db0 con 0x7f5420105610 2023-08-10T11:44:51.405 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.852+0000 7f542480f700 1 -- 172.21.15.73:0/2515220319 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f542002cda0 con 0x7f5408038630 2023-08-10T11:44:51.406 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.984+0000 7f540f7fe700 1 -- 172.21.15.73:0/2515220319 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f542002cda0 con 0x7f5408038630 2023-08-10T11:44:51.406 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.986+0000 7f542480f700 1 -- 172.21.15.73:0/2515220319 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5408038630 msgr2=0x7f540803aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:51.406 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.986+0000 7f542480f700 1 --2- 172.21.15.73:0/2515220319 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5408038630 0x7f540803aaf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5414006fd0 tx=0x7f5414006e40 comp rx=0 tx=0).stop 2023-08-10T11:44:51.406 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.986+0000 7f542480f700 1 -- 172.21.15.73:0/2515220319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5420105610 msgr2=0x7f5420104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:51.406 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.986+0000 7f542480f700 1 --2- 172.21.15.73:0/2515220319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5420105610 0x7f5420104cf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5410003f00 tx=0x7f5410011a30 comp rx=0 tx=0).stop 2023-08-10T11:44:51.406 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.986+0000 7f542480f700 1 -- 172.21.15.73:0/2515220319 shutdown_connections 2023-08-10T11:44:51.407 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.986+0000 7f542480f700 1 --2- 172.21.15.73:0/2515220319 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5408038630 0x7f540803aaf0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:51.407 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.986+0000 7f542480f700 1 --2- 172.21.15.73:0/2515220319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5420105610 0x7f5420104cf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:51.407 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.986+0000 7f542480f700 1 -- 172.21.15.73:0/2515220319 >> 172.21.15.73:0/2515220319 conn(0x7f54200ffe10 msgr2=0x7f54201015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:51.407 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.986+0000 7f542480f700 1 -- 172.21.15.73:0/2515220319 shutdown_connections 2023-08-10T11:44:51.407 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:50.986+0000 7f542480f700 1 -- 172.21.15.73:0/2515220319 wait complete. 2023-08-10T11:44:51.407 INFO:teuthology.orchestra.run.smithi073.stdout:Creating initial admin user... 2023-08-10T11:44:52.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:51 smithi073 ceph-mon[128869]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:44:52.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:51 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:44:52.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:51 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:44:52.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:51 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:44:52.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:51 smithi073 ceph-mon[128869]: mgrmap e12: x(active, since 2s) 2023-08-10T11:44:53.346 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$rudDJF1imKUM5SqYY2kR1OIYPzwryZi8WVeen7Bti..LC9XRRDF0q", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1691667892, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-08-10T11:44:53.346 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.178+0000 7f500653f700 1 Processor -- start 2023-08-10T11:44:53.346 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.179+0000 7f500653f700 1 -- start start 2023-08-10T11:44:53.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.179+0000 7f500653f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5000104ad0 0x7f5000104ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:53.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.179+0000 7f500653f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5000079dc0 con 0x7f5000104ad0 2023-08-10T11:44:53.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.179+0000 7f4ffffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5000104ad0 0x7f5000104ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:53.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.179+0000 7f4ffffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5000104ad0 0x7f5000104ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57912/0 (socket says 172.21.15.73:57912) 2023-08-10T11:44:53.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.179+0000 7f4ffffff700 1 -- 172.21.15.73:0/2273116485 learned_addr learned my addr 172.21.15.73:0/2273116485 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:53.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.179+0000 7f4ffffff700 1 -- 172.21.15.73:0/2273116485 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5000105430 con 0x7f5000104ad0 2023-08-10T11:44:53.347 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.179+0000 7f4ffffff700 1 --2- 172.21.15.73:0/2273116485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5000104ad0 0x7f5000104ef0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4ff40098a0 tx=0x7f4ff4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54fcdf01773798b5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:53.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.179+0000 7f4ffeffd700 1 -- 172.21.15.73:0/2273116485 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ff4004160 con 0x7f5000104ad0 2023-08-10T11:44:53.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.180+0000 7f4ffeffd700 1 -- 172.21.15.73:0/2273116485 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ff40042c0 con 0x7f5000104ad0 2023-08-10T11:44:53.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.180+0000 7f4ffeffd700 1 -- 172.21.15.73:0/2273116485 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ff40119b0 con 0x7f5000104ad0 2023-08-10T11:44:53.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.180+0000 7f500653f700 1 -- 172.21.15.73:0/2273116485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5000104ad0 msgr2=0x7f5000104ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:53.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.180+0000 7f500653f700 1 --2- 172.21.15.73:0/2273116485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5000104ad0 0x7f5000104ef0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4ff40098a0 tx=0x7f4ff4009bb0 comp rx=0 tx=0).stop 2023-08-10T11:44:53.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.180+0000 7f500653f700 1 -- 172.21.15.73:0/2273116485 shutdown_connections 2023-08-10T11:44:53.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.180+0000 7f500653f700 1 --2- 172.21.15.73:0/2273116485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5000104ad0 0x7f5000104ef0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:53.348 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.180+0000 7f500653f700 1 -- 172.21.15.73:0/2273116485 >> 172.21.15.73:0/2273116485 conn(0x7f5000100670 msgr2=0x7f5000102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:53.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.180+0000 7f500653f700 1 -- 172.21.15.73:0/2273116485 shutdown_connections 2023-08-10T11:44:53.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.180+0000 7f500653f700 1 -- 172.21.15.73:0/2273116485 wait complete. 2023-08-10T11:44:53.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.181+0000 7f500653f700 1 Processor -- start 2023-08-10T11:44:53.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.181+0000 7f500653f700 1 -- start start 2023-08-10T11:44:53.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.181+0000 7f500653f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5000104ad0 0x7f500019c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:53.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.181+0000 7f500653f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500019c6c0 con 0x7f5000104ad0 2023-08-10T11:44:53.349 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.181+0000 7f4ffffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5000104ad0 0x7f500019c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:53.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.181+0000 7f4ffffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5000104ad0 0x7f500019c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57914/0 (socket says 172.21.15.73:57914) 2023-08-10T11:44:53.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.181+0000 7f4ffffff700 1 -- 172.21.15.73:0/3797718424 learned_addr learned my addr 172.21.15.73:0/3797718424 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:53.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.181+0000 7f4ffffff700 1 -- 172.21.15.73:0/3797718424 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff4009550 con 0x7f5000104ad0 2023-08-10T11:44:53.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.181+0000 7f4ffffff700 1 --2- 172.21.15.73:0/3797718424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5000104ad0 0x7f500019c180 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4006af0 tx=0x7f4ff4011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:53.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.182+0000 7f4ffd7fa700 1 -- 172.21.15.73:0/3797718424 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ff4003a40 con 0x7f5000104ad0 2023-08-10T11:44:53.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.182+0000 7f500653f700 1 -- 172.21.15.73:0/3797718424 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500019c8c0 con 0x7f5000104ad0 2023-08-10T11:44:53.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.182+0000 7f4ffd7fa700 1 -- 172.21.15.73:0/3797718424 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ff4003ba0 con 0x7f5000104ad0 2023-08-10T11:44:53.350 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.182+0000 7f4ffd7fa700 1 -- 172.21.15.73:0/3797718424 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ff40196c0 con 0x7f5000104ad0 2023-08-10T11:44:53.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.182+0000 7f500653f700 1 -- 172.21.15.73:0/3797718424 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500019cce0 con 0x7f5000104ad0 2023-08-10T11:44:53.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.183+0000 7f4ffd7fa700 1 -- 172.21.15.73:0/3797718424 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 12) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f4ff401a430 con 0x7f5000104ad0 2023-08-10T11:44:53.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.183+0000 7f500653f700 1 -- 172.21.15.73:0/3797718424 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5000195a10 con 0x7f5000104ad0 2023-08-10T11:44:53.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.183+0000 7f4ffd7fa700 1 --2- 172.21.15.73:0/3797718424 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4fe8038760 0x7f4fe803ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:53.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.183+0000 7f4ffd7fa700 1 -- 172.21.15.73:0/3797718424 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4ff404cbc0 con 0x7f5000104ad0 2023-08-10T11:44:53.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.183+0000 7f4fff7fe700 1 --2- 172.21.15.73:0/3797718424 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4fe8038760 0x7f4fe803ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:53.351 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.184+0000 7f4fff7fe700 1 --2- 172.21.15.73:0/3797718424 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4fe8038760 0x7f4fe803ac20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0006fd0 tx=0x7f4ff0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:53.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.188+0000 7f4ffd7fa700 1 -- 172.21.15.73:0/3797718424 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f4ff401aa80 con 0x7f5000104ad0 2023-08-10T11:44:53.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.405+0000 7f500653f700 1 -- 172.21.15.73:0/3797718424 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f5000061bc0 con 0x7f4fe8038760 2023-08-10T11:44:53.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.632+0000 7f4ffd7fa700 1 -- 172.21.15.73:0/3797718424 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f5000061bc0 con 0x7f4fe8038760 2023-08-10T11:44:53.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.634+0000 7f500653f700 1 -- 172.21.15.73:0/3797718424 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4fe8038760 msgr2=0x7f4fe803ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:53.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.634+0000 7f500653f700 1 --2- 172.21.15.73:0/3797718424 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4fe8038760 0x7f4fe803ac20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0006fd0 tx=0x7f4ff0006e40 comp rx=0 tx=0).stop 2023-08-10T11:44:53.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.634+0000 7f500653f700 1 -- 172.21.15.73:0/3797718424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5000104ad0 msgr2=0x7f500019c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:53.352 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.634+0000 7f500653f700 1 --2- 172.21.15.73:0/3797718424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5000104ad0 0x7f500019c180 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4006af0 tx=0x7f4ff4011a10 comp rx=0 tx=0).stop 2023-08-10T11:44:53.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.634+0000 7f500653f700 1 -- 172.21.15.73:0/3797718424 shutdown_connections 2023-08-10T11:44:53.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.634+0000 7f500653f700 1 --2- 172.21.15.73:0/3797718424 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4fe8038760 0x7f4fe803ac20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:53.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.634+0000 7f500653f700 1 --2- 172.21.15.73:0/3797718424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5000104ad0 0x7f500019c180 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:53.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.634+0000 7f500653f700 1 -- 172.21.15.73:0/3797718424 >> 172.21.15.73:0/3797718424 conn(0x7f5000100670 msgr2=0x7f5000190690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:53.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.634+0000 7f500653f700 1 -- 172.21.15.73:0/3797718424 shutdown_connections 2023-08-10T11:44:53.353 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:52.634+0000 7f500653f700 1 -- 172.21.15.73:0/3797718424 wait complete. 2023-08-10T11:44:53.353 INFO:teuthology.orchestra.run.smithi073.stdout:Fetching dashboard port number... 2023-08-10T11:44:54.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:53 smithi073 ceph-mon[128869]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:44:54.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:44:54.389 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stdout 8443 2023-08-10T11:44:54.389 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.850+0000 7f9e36e8b700 1 Processor -- start 2023-08-10T11:44:54.389 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.850+0000 7f9e36e8b700 1 -- start start 2023-08-10T11:44:54.389 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.851+0000 7f9e36e8b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e301061f0 0x7f9e30106610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:54.390 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.851+0000 7f9e36e8b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e30106be0 con 0x7f9e301061f0 2023-08-10T11:44:54.390 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.851+0000 7f9e34c27700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e301061f0 0x7f9e30106610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:54.390 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.851+0000 7f9e34c27700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e301061f0 0x7f9e30106610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57922/0 (socket says 172.21.15.73:57922) 2023-08-10T11:44:54.390 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.851+0000 7f9e34c27700 1 -- 172.21.15.73:0/4002622183 learned_addr learned my addr 172.21.15.73:0/4002622183 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:54.390 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.851+0000 7f9e34c27700 1 -- 172.21.15.73:0/4002622183 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e301073f0 con 0x7f9e301061f0 2023-08-10T11:44:54.390 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.851+0000 7f9e34c27700 1 --2- 172.21.15.73:0/4002622183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e301061f0 0x7f9e30106610 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9e240098a0 tx=0x7f9e24009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f68fb6bcd01158ae server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:54.391 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.851+0000 7f9e2f7fe700 1 -- 172.21.15.73:0/4002622183 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e24004160 con 0x7f9e301061f0 2023-08-10T11:44:54.391 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.851+0000 7f9e2f7fe700 1 -- 172.21.15.73:0/4002622183 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9e240042c0 con 0x7f9e301061f0 2023-08-10T11:44:54.391 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.851+0000 7f9e2f7fe700 1 -- 172.21.15.73:0/4002622183 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e240119b0 con 0x7f9e301061f0 2023-08-10T11:44:54.391 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.852+0000 7f9e36e8b700 1 -- 172.21.15.73:0/4002622183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e301061f0 msgr2=0x7f9e30106610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:54.392 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.852+0000 7f9e36e8b700 1 --2- 172.21.15.73:0/4002622183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e301061f0 0x7f9e30106610 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9e240098a0 tx=0x7f9e24009bb0 comp rx=0 tx=0).stop 2023-08-10T11:44:54.392 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.852+0000 7f9e36e8b700 1 -- 172.21.15.73:0/4002622183 shutdown_connections 2023-08-10T11:44:54.392 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.852+0000 7f9e36e8b700 1 --2- 172.21.15.73:0/4002622183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e301061f0 0x7f9e30106610 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:54.393 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.852+0000 7f9e36e8b700 1 -- 172.21.15.73:0/4002622183 >> 172.21.15.73:0/4002622183 conn(0x7f9e30101770 msgr2=0x7f9e30103bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:54.393 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.852+0000 7f9e36e8b700 1 -- 172.21.15.73:0/4002622183 shutdown_connections 2023-08-10T11:44:54.393 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.852+0000 7f9e36e8b700 1 -- 172.21.15.73:0/4002622183 wait complete. 2023-08-10T11:44:54.394 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.852+0000 7f9e36e8b700 1 Processor -- start 2023-08-10T11:44:54.394 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.853+0000 7f9e36e8b700 1 -- start start 2023-08-10T11:44:54.394 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.853+0000 7f9e36e8b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e301061f0 0x7f9e30199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:54.395 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.853+0000 7f9e36e8b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3019a480 con 0x7f9e301061f0 2023-08-10T11:44:54.395 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.853+0000 7f9e34c27700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e301061f0 0x7f9e30199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:54.395 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.853+0000 7f9e34c27700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e301061f0 0x7f9e30199f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57924/0 (socket says 172.21.15.73:57924) 2023-08-10T11:44:54.395 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.853+0000 7f9e34c27700 1 -- 172.21.15.73:0/3110349159 learned_addr learned my addr 172.21.15.73:0/3110349159 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:54.396 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.853+0000 7f9e34c27700 1 -- 172.21.15.73:0/3110349159 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e24009550 con 0x7f9e301061f0 2023-08-10T11:44:54.396 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.853+0000 7f9e34c27700 1 --2- 172.21.15.73:0/3110349159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e301061f0 0x7f9e30199f40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9e24003e60 tx=0x7f9e24011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:54.396 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.853+0000 7f9e2dffb700 1 -- 172.21.15.73:0/3110349159 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e24003a60 con 0x7f9e301061f0 2023-08-10T11:44:54.397 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.853+0000 7f9e2dffb700 1 -- 172.21.15.73:0/3110349159 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9e24003bc0 con 0x7f9e301061f0 2023-08-10T11:44:54.397 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.853+0000 7f9e36e8b700 1 -- 172.21.15.73:0/3110349159 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e3019a680 con 0x7f9e301061f0 2023-08-10T11:44:54.397 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.853+0000 7f9e2dffb700 1 -- 172.21.15.73:0/3110349159 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e240196c0 con 0x7f9e301061f0 2023-08-10T11:44:54.397 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.854+0000 7f9e36e8b700 1 -- 172.21.15.73:0/3110349159 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3019aaa0 con 0x7f9e301061f0 2023-08-10T11:44:54.398 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.855+0000 7f9e2dffb700 1 -- 172.21.15.73:0/3110349159 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 12) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f9e24019930 con 0x7f9e301061f0 2023-08-10T11:44:54.398 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.855+0000 7f9e2dffb700 1 --2- 172.21.15.73:0/3110349159 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9e20038790 0x7f9e2003ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:54.398 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.855+0000 7f9e2dffb700 1 -- 172.21.15.73:0/3110349159 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9e2404cc00 con 0x7f9e301061f0 2023-08-10T11:44:54.398 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.855+0000 7f9e2ffff700 1 --2- 172.21.15.73:0/3110349159 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9e20038790 0x7f9e2003ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:54.398 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.855+0000 7f9e36e8b700 1 -- 172.21.15.73:0/3110349159 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e30061da0 con 0x7f9e301061f0 2023-08-10T11:44:54.399 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.855+0000 7f9e2ffff700 1 --2- 172.21.15.73:0/3110349159 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9e20038790 0x7f9e2003ac50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c006fd0 tx=0x7f9e1c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:54.399 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:53.860+0000 7f9e2dffb700 1 -- 172.21.15.73:0/3110349159 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f9e24019e60 con 0x7f9e301061f0 2023-08-10T11:44:54.399 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.046+0000 7f9e36e8b700 1 -- 172.21.15.73:0/3110349159 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f9e3019d540 con 0x7f9e301061f0 2023-08-10T11:44:54.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.047+0000 7f9e2dffb700 1 -- 172.21.15.73:0/3110349159 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f9e24010b70 con 0x7f9e301061f0 2023-08-10T11:44:54.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.049+0000 7f9e36e8b700 1 -- 172.21.15.73:0/3110349159 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9e20038790 msgr2=0x7f9e2003ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:54.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.049+0000 7f9e36e8b700 1 --2- 172.21.15.73:0/3110349159 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9e20038790 0x7f9e2003ac50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c006fd0 tx=0x7f9e1c006e40 comp rx=0 tx=0).stop 2023-08-10T11:44:54.400 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.049+0000 7f9e36e8b700 1 -- 172.21.15.73:0/3110349159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e301061f0 msgr2=0x7f9e30199f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:54.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.049+0000 7f9e36e8b700 1 --2- 172.21.15.73:0/3110349159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e301061f0 0x7f9e30199f40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9e24003e60 tx=0x7f9e24011a30 comp rx=0 tx=0).stop 2023-08-10T11:44:54.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.049+0000 7f9e36e8b700 1 -- 172.21.15.73:0/3110349159 shutdown_connections 2023-08-10T11:44:54.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.049+0000 7f9e36e8b700 1 --2- 172.21.15.73:0/3110349159 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9e20038790 0x7f9e2003ac50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:54.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.049+0000 7f9e36e8b700 1 --2- 172.21.15.73:0/3110349159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e301061f0 0x7f9e30199f40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:54.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.049+0000 7f9e36e8b700 1 -- 172.21.15.73:0/3110349159 >> 172.21.15.73:0/3110349159 conn(0x7f9e30101770 msgr2=0x7f9e30102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:54.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.049+0000 7f9e36e8b700 1 -- 172.21.15.73:0/3110349159 shutdown_connections 2023-08-10T11:44:54.401 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.049+0000 7f9e36e8b700 1 -- 172.21.15.73:0/3110349159 wait complete. 2023-08-10T11:44:54.402 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-08-10T11:44:54.402 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout disabled 2023-08-10T11:44:54.404 INFO:teuthology.orchestra.run.smithi073.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-08-10T11:44:54.404 INFO:teuthology.orchestra.run.smithi073.stdout:systemctl: stdout inactive 2023-08-10T11:44:54.404 INFO:teuthology.orchestra.run.smithi073.stdout:firewalld.service is not enabled 2023-08-10T11:44:54.404 INFO:teuthology.orchestra.run.smithi073.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-08-10T11:44:54.405 INFO:teuthology.orchestra.run.smithi073.stdout:Ceph Dashboard is now available at: 2023-08-10T11:44:54.406 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:44:54.406 INFO:teuthology.orchestra.run.smithi073.stdout: URL: https://smithi073.front.sepia.ceph.com:8443/ 2023-08-10T11:44:54.406 INFO:teuthology.orchestra.run.smithi073.stdout: User: admin 2023-08-10T11:44:54.406 INFO:teuthology.orchestra.run.smithi073.stdout: Password: wflgqe00r3 2023-08-10T11:44:54.406 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:44:54.407 INFO:teuthology.orchestra.run.smithi073.stdout:Saving cluster configuration to /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config directory 2023-08-10T11:44:54.407 INFO:teuthology.orchestra.run.smithi073.stdout:Enabling autotune for osd_memory_target 2023-08-10T11:44:54.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:54 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3110349159' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-08-10T11:44:55.454 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.874+0000 7ff45bd7c700 1 Processor -- start 2023-08-10T11:44:55.455 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.874+0000 7ff45bd7c700 1 -- start start 2023-08-10T11:44:55.455 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.874+0000 7ff45bd7c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff454104890 0x7ff454104cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:55.455 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.875+0000 7ff45bd7c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff454105280 con 0x7ff454104890 2023-08-10T11:44:55.456 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.875+0000 7ff459b18700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff454104890 0x7ff454104cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:55.456 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.875+0000 7ff459b18700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff454104890 0x7ff454104cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57928/0 (socket says 172.21.15.73:57928) 2023-08-10T11:44:55.456 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.875+0000 7ff459b18700 1 -- 172.21.15.73:0/885529544 learned_addr learned my addr 172.21.15.73:0/885529544 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:55.457 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.875+0000 7ff459b18700 1 -- 172.21.15.73:0/885529544 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff454105a90 con 0x7ff454104890 2023-08-10T11:44:55.457 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.875+0000 7ff459b18700 1 --2- 172.21.15.73:0/885529544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff454104890 0x7ff454104cb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff44400aa40 tx=0x7ff44400ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c0b6b6113405d84 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:55.457 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.875+0000 7ff458b16700 1 -- 172.21.15.73:0/885529544 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff444004160 con 0x7ff454104890 2023-08-10T11:44:55.457 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.875+0000 7ff458b16700 1 -- 172.21.15.73:0/885529544 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff44400cdb0 con 0x7ff454104890 2023-08-10T11:44:55.458 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.875+0000 7ff458b16700 1 -- 172.21.15.73:0/885529544 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff444003c30 con 0x7ff454104890 2023-08-10T11:44:55.458 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.876+0000 7ff45bd7c700 1 -- 172.21.15.73:0/885529544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff454104890 msgr2=0x7ff454104cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:55.458 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.876+0000 7ff45bd7c700 1 --2- 172.21.15.73:0/885529544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff454104890 0x7ff454104cb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff44400aa40 tx=0x7ff44400ad50 comp rx=0 tx=0).stop 2023-08-10T11:44:55.458 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.876+0000 7ff45bd7c700 1 -- 172.21.15.73:0/885529544 shutdown_connections 2023-08-10T11:44:55.458 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.876+0000 7ff45bd7c700 1 --2- 172.21.15.73:0/885529544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff454104890 0x7ff454104cb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:55.459 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.876+0000 7ff45bd7c700 1 -- 172.21.15.73:0/885529544 >> 172.21.15.73:0/885529544 conn(0x7ff4540ffe10 msgr2=0x7ff454102270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:55.459 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.876+0000 7ff45bd7c700 1 -- 172.21.15.73:0/885529544 shutdown_connections 2023-08-10T11:44:55.459 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.876+0000 7ff45bd7c700 1 -- 172.21.15.73:0/885529544 wait complete. 2023-08-10T11:44:55.459 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.877+0000 7ff45bd7c700 1 Processor -- start 2023-08-10T11:44:55.459 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.877+0000 7ff45bd7c700 1 -- start start 2023-08-10T11:44:55.459 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.877+0000 7ff45bd7c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff454104890 0x7ff454199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:55.459 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.877+0000 7ff45bd7c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45419a4b0 con 0x7ff454104890 2023-08-10T11:44:55.460 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.877+0000 7ff459b18700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff454104890 0x7ff454199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:55.460 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.877+0000 7ff459b18700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff454104890 0x7ff454199f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57930/0 (socket says 172.21.15.73:57930) 2023-08-10T11:44:55.460 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.877+0000 7ff459b18700 1 -- 172.21.15.73:0/1828126268 learned_addr learned my addr 172.21.15.73:0/1828126268 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:55.460 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.877+0000 7ff459b18700 1 -- 172.21.15.73:0/1828126268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44400a6f0 con 0x7ff454104890 2023-08-10T11:44:55.460 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.877+0000 7ff459b18700 1 --2- 172.21.15.73:0/1828126268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff454104890 0x7ff454199f70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff44400afd0 tx=0x7ff4440041d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:55.460 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.877+0000 7ff44affd700 1 -- 172.21.15.73:0/1828126268 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff444010520 con 0x7ff454104890 2023-08-10T11:44:55.461 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.877+0000 7ff44affd700 1 -- 172.21.15.73:0/1828126268 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff444010b40 con 0x7ff454104890 2023-08-10T11:44:55.461 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.877+0000 7ff45bd7c700 1 -- 172.21.15.73:0/1828126268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff45419a6b0 con 0x7ff454104890 2023-08-10T11:44:55.461 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.877+0000 7ff44affd700 1 -- 172.21.15.73:0/1828126268 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff444021a80 con 0x7ff454104890 2023-08-10T11:44:55.461 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.878+0000 7ff45bd7c700 1 -- 172.21.15.73:0/1828126268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45419aad0 con 0x7ff454104890 2023-08-10T11:44:55.461 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.878+0000 7ff44affd700 1 -- 172.21.15.73:0/1828126268 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7ff44402b440 con 0x7ff454104890 2023-08-10T11:44:55.461 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.878+0000 7ff44affd700 1 --2- 172.21.15.73:0/1828126268 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff440038800 0x7ff44003acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:55.461 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.878+0000 7ff44affd700 1 -- 172.21.15.73:0/1828126268 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff44404cbb0 con 0x7ff454104890 2023-08-10T11:44:55.462 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.879+0000 7ff45bd7c700 1 -- 172.21.15.73:0/1828126268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff454191640 con 0x7ff454104890 2023-08-10T11:44:55.462 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.879+0000 7ff459317700 1 --2- 172.21.15.73:0/1828126268 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff440038800 0x7ff44003acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:55.462 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.879+0000 7ff459317700 1 --2- 172.21.15.73:0/1828126268 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff440038800 0x7ff44003acc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff450006fd0 tx=0x7ff450006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:55.462 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:54.883+0000 7ff44affd700 1 -- 172.21.15.73:0/1828126268 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ff444026080 con 0x7ff454104890 2023-08-10T11:44:55.462 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.072+0000 7ff45bd7c700 1 -- 172.21.15.73:0/1828126268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7ff45402cbf0 con 0x7ff454104890 2023-08-10T11:44:55.462 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.072+0000 7ff44affd700 1 -- 172.21.15.73:0/1828126268 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7ff44404b0c0 con 0x7ff454104890 2023-08-10T11:44:55.463 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.074+0000 7ff45bd7c700 1 -- 172.21.15.73:0/1828126268 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff440038800 msgr2=0x7ff44003acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:55.463 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.074+0000 7ff45bd7c700 1 --2- 172.21.15.73:0/1828126268 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff440038800 0x7ff44003acc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff450006fd0 tx=0x7ff450006e40 comp rx=0 tx=0).stop 2023-08-10T11:44:55.463 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.074+0000 7ff45bd7c700 1 -- 172.21.15.73:0/1828126268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff454104890 msgr2=0x7ff454199f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:55.463 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.074+0000 7ff45bd7c700 1 --2- 172.21.15.73:0/1828126268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff454104890 0x7ff454199f70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff44400afd0 tx=0x7ff4440041d0 comp rx=0 tx=0).stop 2023-08-10T11:44:55.463 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.074+0000 7ff45bd7c700 1 -- 172.21.15.73:0/1828126268 shutdown_connections 2023-08-10T11:44:55.463 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.074+0000 7ff45bd7c700 1 --2- 172.21.15.73:0/1828126268 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff440038800 0x7ff44003acc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:55.463 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.074+0000 7ff45bd7c700 1 --2- 172.21.15.73:0/1828126268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff454104890 0x7ff454199f70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:55.464 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.074+0000 7ff45bd7c700 1 -- 172.21.15.73:0/1828126268 >> 172.21.15.73:0/1828126268 conn(0x7ff4540ffe10 msgr2=0x7ff45418c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:55.464 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.074+0000 7ff45bd7c700 1 -- 172.21.15.73:0/1828126268 shutdown_connections 2023-08-10T11:44:55.464 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.074+0000 7ff45bd7c700 1 -- 172.21.15.73:0/1828126268 wait complete. 2023-08-10T11:44:55.689 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:55 smithi073 ceph-mon[128869]: mgrmap e13: x(active, since 6s) 2023-08-10T11:44:56.697 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.931+0000 7f1703d55700 1 Processor -- start 2023-08-10T11:44:56.697 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.932+0000 7f1703d55700 1 -- start start 2023-08-10T11:44:56.697 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.932+0000 7f1703d55700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16fc1050f0 0x7f16fc105510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:56.697 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.932+0000 7f1703d55700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc105ae0 con 0x7f16fc1050f0 2023-08-10T11:44:56.697 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.932+0000 7f1701af1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16fc1050f0 0x7f16fc105510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:56.698 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.932+0000 7f1701af1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16fc1050f0 0x7f16fc105510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57934/0 (socket says 172.21.15.73:57934) 2023-08-10T11:44:56.698 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.932+0000 7f1701af1700 1 -- 172.21.15.73:0/3938701242 learned_addr learned my addr 172.21.15.73:0/3938701242 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:56.698 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.932+0000 7f1701af1700 1 -- 172.21.15.73:0/3938701242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16fc1062f0 con 0x7f16fc1050f0 2023-08-10T11:44:56.698 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.932+0000 7f1701af1700 1 --2- 172.21.15.73:0/3938701242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16fc1050f0 0x7f16fc105510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f16ec0098a0 tx=0x7f16ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c9c5b822819c58 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:56.698 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.933+0000 7f1700aef700 1 -- 172.21.15.73:0/3938701242 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f16ec004160 con 0x7f16fc1050f0 2023-08-10T11:44:56.698 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.933+0000 7f1700aef700 1 -- 172.21.15.73:0/3938701242 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16ec0042c0 con 0x7f16fc1050f0 2023-08-10T11:44:56.698 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.933+0000 7f1700aef700 1 -- 172.21.15.73:0/3938701242 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f16ec0119b0 con 0x7f16fc1050f0 2023-08-10T11:44:56.699 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.933+0000 7f1703d55700 1 -- 172.21.15.73:0/3938701242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16fc1050f0 msgr2=0x7f16fc105510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:56.699 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.933+0000 7f1703d55700 1 --2- 172.21.15.73:0/3938701242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16fc1050f0 0x7f16fc105510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f16ec0098a0 tx=0x7f16ec009bb0 comp rx=0 tx=0).stop 2023-08-10T11:44:56.699 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.933+0000 7f1703d55700 1 -- 172.21.15.73:0/3938701242 shutdown_connections 2023-08-10T11:44:56.699 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.933+0000 7f1703d55700 1 --2- 172.21.15.73:0/3938701242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16fc1050f0 0x7f16fc105510 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:56.699 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.933+0000 7f1703d55700 1 -- 172.21.15.73:0/3938701242 >> 172.21.15.73:0/3938701242 conn(0x7f16fc1006b0 msgr2=0x7f16fc102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:56.699 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.933+0000 7f1703d55700 1 -- 172.21.15.73:0/3938701242 shutdown_connections 2023-08-10T11:44:56.700 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.933+0000 7f1703d55700 1 -- 172.21.15.73:0/3938701242 wait complete. 2023-08-10T11:44:56.700 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.934+0000 7f1703d55700 1 Processor -- start 2023-08-10T11:44:56.700 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.934+0000 7f1703d55700 1 -- start start 2023-08-10T11:44:56.700 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.934+0000 7f1703d55700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16fc1050f0 0x7f16fc079b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:56.700 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.934+0000 7f1703d55700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc19cc30 con 0x7f16fc1050f0 2023-08-10T11:44:56.700 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.934+0000 7f1701af1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16fc1050f0 0x7f16fc079b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:56.700 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.934+0000 7f1701af1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16fc1050f0 0x7f16fc079b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57936/0 (socket says 172.21.15.73:57936) 2023-08-10T11:44:56.701 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.934+0000 7f1701af1700 1 -- 172.21.15.73:0/2080839189 learned_addr learned my addr 172.21.15.73:0/2080839189 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:56.701 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.934+0000 7f1701af1700 1 -- 172.21.15.73:0/2080839189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ec009550 con 0x7f16fc1050f0 2023-08-10T11:44:56.701 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.935+0000 7f1701af1700 1 --2- 172.21.15.73:0/2080839189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16fc1050f0 0x7f16fc079b20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f16ec006af0 tx=0x7f16ec011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:56.701 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.935+0000 7f16f2ffd700 1 -- 172.21.15.73:0/2080839189 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f16ec003a40 con 0x7f16fc1050f0 2023-08-10T11:44:56.701 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.935+0000 7f16f2ffd700 1 -- 172.21.15.73:0/2080839189 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16ec003ba0 con 0x7f16fc1050f0 2023-08-10T11:44:56.701 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.935+0000 7f1703d55700 1 -- 172.21.15.73:0/2080839189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16fc19cd70 con 0x7f16fc1050f0 2023-08-10T11:44:56.701 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.935+0000 7f16f2ffd700 1 -- 172.21.15.73:0/2080839189 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f16ec019690 con 0x7f16fc1050f0 2023-08-10T11:44:56.701 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.935+0000 7f1703d55700 1 -- 172.21.15.73:0/2080839189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16fc19d190 con 0x7f16fc1050f0 2023-08-10T11:44:56.702 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.936+0000 7f16f2ffd700 1 -- 172.21.15.73:0/2080839189 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f16ec019900 con 0x7f16fc1050f0 2023-08-10T11:44:56.702 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.936+0000 7f1703d55700 1 -- 172.21.15.73:0/2080839189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16fc109520 con 0x7f16fc1050f0 2023-08-10T11:44:56.702 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.936+0000 7f16f2ffd700 1 --2- 172.21.15.73:0/2080839189 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f16e8038800 0x7f16e803acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:56.702 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.936+0000 7f16f2ffd700 1 -- 172.21.15.73:0/2080839189 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f16ec04cd50 con 0x7f16fc1050f0 2023-08-10T11:44:56.702 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.936+0000 7f17012f0700 1 --2- 172.21.15.73:0/2080839189 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f16e8038800 0x7f16e803acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:56.702 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.936+0000 7f17012f0700 1 --2- 172.21.15.73:0/2080839189 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f16e8038800 0x7f16e803acc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f16f8006fd0 tx=0x7f16f8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:56.702 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:55.940+0000 7f16f2ffd700 1 -- 172.21.15.73:0/2080839189 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f16ec018760 con 0x7f16fc1050f0 2023-08-10T11:44:56.703 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:56.232+0000 7f1703d55700 1 -- 172.21.15.73:0/2080839189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f16fc1096e0 con 0x7f16fc1050f0 2023-08-10T11:44:56.703 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:56.234+0000 7f16f2ffd700 1 -- 172.21.15.73:0/2080839189 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f16ec018350 con 0x7f16fc1050f0 2023-08-10T11:44:56.703 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:56.236+0000 7f1703d55700 1 -- 172.21.15.73:0/2080839189 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f16e8038800 msgr2=0x7f16e803acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:56.703 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:56.236+0000 7f1703d55700 1 --2- 172.21.15.73:0/2080839189 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f16e8038800 0x7f16e803acc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f16f8006fd0 tx=0x7f16f8006e40 comp rx=0 tx=0).stop 2023-08-10T11:44:56.703 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:56.236+0000 7f1703d55700 1 -- 172.21.15.73:0/2080839189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16fc1050f0 msgr2=0x7f16fc079b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:56.704 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:56.236+0000 7f1703d55700 1 --2- 172.21.15.73:0/2080839189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16fc1050f0 0x7f16fc079b20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f16ec006af0 tx=0x7f16ec011a10 comp rx=0 tx=0).stop 2023-08-10T11:44:56.704 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:56.236+0000 7f1703d55700 1 -- 172.21.15.73:0/2080839189 shutdown_connections 2023-08-10T11:44:56.704 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:56.236+0000 7f1703d55700 1 --2- 172.21.15.73:0/2080839189 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f16e8038800 0x7f16e803acc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:56.704 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:56.236+0000 7f1703d55700 1 --2- 172.21.15.73:0/2080839189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16fc1050f0 0x7f16fc079b20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:56.704 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:56.236+0000 7f1703d55700 1 -- 172.21.15.73:0/2080839189 >> 172.21.15.73:0/2080839189 conn(0x7f16fc1006b0 msgr2=0x7f16fc101d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:56.704 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:56.236+0000 7f1703d55700 1 -- 172.21.15.73:0/2080839189 shutdown_connections 2023-08-10T11:44:56.705 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr 2023-08-10T11:44:56.236+0000 7f1703d55700 1 -- 172.21.15.73:0/2080839189 wait complete. 2023-08-10T11:44:56.705 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-08-10T11:44:56.705 INFO:teuthology.orchestra.run.smithi073.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-08-10T11:44:56.705 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:44:56.705 INFO:teuthology.orchestra.run.smithi073.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-08-10T11:44:56.705 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:44:56.705 INFO:teuthology.orchestra.run.smithi073.stdout:Or, if you are only running a single cluster on this host: 2023-08-10T11:44:56.705 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:44:56.706 INFO:teuthology.orchestra.run.smithi073.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-08-10T11:44:56.706 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:44:56.706 INFO:teuthology.orchestra.run.smithi073.stdout:Please consider enabling telemetry to help improve Ceph: 2023-08-10T11:44:56.706 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:44:56.706 INFO:teuthology.orchestra.run.smithi073.stdout: ceph telemetry on 2023-08-10T11:44:56.706 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:44:56.706 INFO:teuthology.orchestra.run.smithi073.stdout:For more information see: 2023-08-10T11:44:56.706 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:44:56.707 INFO:teuthology.orchestra.run.smithi073.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-08-10T11:44:56.707 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:44:56.707 INFO:teuthology.orchestra.run.smithi073.stdout:Bootstrap complete. 2023-08-10T11:44:56.730 INFO:tasks.cephadm:Fetching config... 2023-08-10T11:44:56.731 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-08-10T11:44:56.731 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-08-10T11:44:56.747 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-08-10T11:44:56.747 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-08-10T11:44:56.747 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-08-10T11:44:56.805 INFO:tasks.cephadm:Fetching mon keyring... 2023-08-10T11:44:56.805 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-08-10T11:44:56.805 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/keyring of=/dev/stdout 2023-08-10T11:44:56.872 INFO:tasks.cephadm:Fetching pub ssh key... 2023-08-10T11:44:56.872 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-08-10T11:44:56.873 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-08-10T11:44:56.929 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-08-10T11:44:56.930 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5Ts7CFlBXxmj7d7yM9982+hF3wyx44CXXEVft04+OZd7JptchKVCTjijzm013r/O7KC5/hmZ9ESnrrl5NoSPOsuojNuOTX/T68cKiGAz/d2971Fq2K82fR8tpWG/l9R4HbqofEAUugc09W0F6BTlXqZUjI+NsQyFV+to73OfLTzCdsyn5cXTw3iRM2NYQjYW/6zywwF/kpQoYV9YeKZoQl63UE78H9yL7n84MtqPUKwO6Z9m3POr8gW5MdYvWjhQRMcg38UuUsz6t0tPPf/QEKNr+2gv8re0RpI9l/1fhoYHywoZNz6uZhB5EjP7GMy4MYifm9RLiz8AZU4NoxrlKTxBedhDIJR7xWtHjb8ysS1McaW8z9wW07Jqu8ZH9HJME+OQ39nVaevrkU82Yj0CHhT/sq1QZiQRaf6iPuQxMBzIPI8Vd/f1XPlWkbqhPhFFftubzMCqaP/BoCxAiGGHsLyvZGzczsp+cGju3owjz9d9qqXbzb/qstE3tVJRhE6U= ceph-0e619a74-3773-11ee-9b37-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-08-10T11:44:57.006 INFO:teuthology.orchestra.run.smithi073.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5Ts7CFlBXxmj7d7yM9982+hF3wyx44CXXEVft04+OZd7JptchKVCTjijzm013r/O7KC5/hmZ9ESnrrl5NoSPOsuojNuOTX/T68cKiGAz/d2971Fq2K82fR8tpWG/l9R4HbqofEAUugc09W0F6BTlXqZUjI+NsQyFV+to73OfLTzCdsyn5cXTw3iRM2NYQjYW/6zywwF/kpQoYV9YeKZoQl63UE78H9yL7n84MtqPUKwO6Z9m3POr8gW5MdYvWjhQRMcg38UuUsz6t0tPPf/QEKNr+2gv8re0RpI9l/1fhoYHywoZNz6uZhB5EjP7GMy4MYifm9RLiz8AZU4NoxrlKTxBedhDIJR7xWtHjb8ysS1McaW8z9wW07Jqu8ZH9HJME+OQ39nVaevrkU82Yj0CHhT/sq1QZiQRaf6iPuQxMBzIPI8Vd/f1XPlWkbqhPhFFftubzMCqaP/BoCxAiGGHsLyvZGzczsp+cGju3owjz9d9qqXbzb/qstE3tVJRhE6U= ceph-0e619a74-3773-11ee-9b37-001a4aab830c 2023-08-10T11:44:57.017 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5Ts7CFlBXxmj7d7yM9982+hF3wyx44CXXEVft04+OZd7JptchKVCTjijzm013r/O7KC5/hmZ9ESnrrl5NoSPOsuojNuOTX/T68cKiGAz/d2971Fq2K82fR8tpWG/l9R4HbqofEAUugc09W0F6BTlXqZUjI+NsQyFV+to73OfLTzCdsyn5cXTw3iRM2NYQjYW/6zywwF/kpQoYV9YeKZoQl63UE78H9yL7n84MtqPUKwO6Z9m3POr8gW5MdYvWjhQRMcg38UuUsz6t0tPPf/QEKNr+2gv8re0RpI9l/1fhoYHywoZNz6uZhB5EjP7GMy4MYifm9RLiz8AZU4NoxrlKTxBedhDIJR7xWtHjb8ysS1McaW8z9wW07Jqu8ZH9HJME+OQ39nVaevrkU82Yj0CHhT/sq1QZiQRaf6iPuQxMBzIPI8Vd/f1XPlWkbqhPhFFftubzMCqaP/BoCxAiGGHsLyvZGzczsp+cGju3owjz9d9qqXbzb/qstE3tVJRhE6U= ceph-0e619a74-3773-11ee-9b37-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-08-10T11:44:57.062 INFO:teuthology.orchestra.run.smithi152.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5Ts7CFlBXxmj7d7yM9982+hF3wyx44CXXEVft04+OZd7JptchKVCTjijzm013r/O7KC5/hmZ9ESnrrl5NoSPOsuojNuOTX/T68cKiGAz/d2971Fq2K82fR8tpWG/l9R4HbqofEAUugc09W0F6BTlXqZUjI+NsQyFV+to73OfLTzCdsyn5cXTw3iRM2NYQjYW/6zywwF/kpQoYV9YeKZoQl63UE78H9yL7n84MtqPUKwO6Z9m3POr8gW5MdYvWjhQRMcg38UuUsz6t0tPPf/QEKNr+2gv8re0RpI9l/1fhoYHywoZNz6uZhB5EjP7GMy4MYifm9RLiz8AZU4NoxrlKTxBedhDIJR7xWtHjb8ysS1McaW8z9wW07Jqu8ZH9HJME+OQ39nVaevrkU82Yj0CHhT/sq1QZiQRaf6iPuQxMBzIPI8Vd/f1XPlWkbqhPhFFftubzMCqaP/BoCxAiGGHsLyvZGzczsp+cGju3owjz9d9qqXbzb/qstE3tVJRhE6U= ceph-0e619a74-3773-11ee-9b37-001a4aab830c 2023-08-10T11:44:57.074 DEBUG:teuthology.orchestra.run.smithi156:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5Ts7CFlBXxmj7d7yM9982+hF3wyx44CXXEVft04+OZd7JptchKVCTjijzm013r/O7KC5/hmZ9ESnrrl5NoSPOsuojNuOTX/T68cKiGAz/d2971Fq2K82fR8tpWG/l9R4HbqofEAUugc09W0F6BTlXqZUjI+NsQyFV+to73OfLTzCdsyn5cXTw3iRM2NYQjYW/6zywwF/kpQoYV9YeKZoQl63UE78H9yL7n84MtqPUKwO6Z9m3POr8gW5MdYvWjhQRMcg38UuUsz6t0tPPf/QEKNr+2gv8re0RpI9l/1fhoYHywoZNz6uZhB5EjP7GMy4MYifm9RLiz8AZU4NoxrlKTxBedhDIJR7xWtHjb8ysS1McaW8z9wW07Jqu8ZH9HJME+OQ39nVaevrkU82Yj0CHhT/sq1QZiQRaf6iPuQxMBzIPI8Vd/f1XPlWkbqhPhFFftubzMCqaP/BoCxAiGGHsLyvZGzczsp+cGju3owjz9d9qqXbzb/qstE3tVJRhE6U= ceph-0e619a74-3773-11ee-9b37-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-08-10T11:44:57.120 INFO:teuthology.orchestra.run.smithi156.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5Ts7CFlBXxmj7d7yM9982+hF3wyx44CXXEVft04+OZd7JptchKVCTjijzm013r/O7KC5/hmZ9ESnrrl5NoSPOsuojNuOTX/T68cKiGAz/d2971Fq2K82fR8tpWG/l9R4HbqofEAUugc09W0F6BTlXqZUjI+NsQyFV+to73OfLTzCdsyn5cXTw3iRM2NYQjYW/6zywwF/kpQoYV9YeKZoQl63UE78H9yL7n84MtqPUKwO6Z9m3POr8gW5MdYvWjhQRMcg38UuUsz6t0tPPf/QEKNr+2gv8re0RpI9l/1fhoYHywoZNz6uZhB5EjP7GMy4MYifm9RLiz8AZU4NoxrlKTxBedhDIJR7xWtHjb8ysS1McaW8z9wW07Jqu8ZH9HJME+OQ39nVaevrkU82Yj0CHhT/sq1QZiQRaf6iPuQxMBzIPI8Vd/f1XPlWkbqhPhFFftubzMCqaP/BoCxAiGGHsLyvZGzczsp+cGju3owjz9d9qqXbzb/qstE3tVJRhE6U= ceph-0e619a74-3773-11ee-9b37-001a4aab830c 2023-08-10T11:44:57.132 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-08-10T11:44:57.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:44:57 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2080839189' entity='client.admin' 2023-08-10T11:44:57.691 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:44:59.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.648+0000 7f4de42d8700 1 -- 172.21.15.73:0/2623184965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ddc0fe530 msgr2=0x7f4ddc0fe950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:59.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.648+0000 7f4de42d8700 1 --2- 172.21.15.73:0/2623184965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ddc0fe530 0x7f4ddc0fe950 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8009910 tx=0x7f4dd8009c20 comp rx=0 tx=0).stop 2023-08-10T11:44:59.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.648+0000 7f4de42d8700 1 -- 172.21.15.73:0/2623184965 shutdown_connections 2023-08-10T11:44:59.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.648+0000 7f4de42d8700 1 --2- 172.21.15.73:0/2623184965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ddc0fe530 0x7f4ddc0fe950 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:59.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.648+0000 7f4de42d8700 1 -- 172.21.15.73:0/2623184965 >> 172.21.15.73:0/2623184965 conn(0x7f4ddc0f9e70 msgr2=0x7f4ddc0fc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:59.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.648+0000 7f4de42d8700 1 -- 172.21.15.73:0/2623184965 shutdown_connections 2023-08-10T11:44:59.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.648+0000 7f4de42d8700 1 -- 172.21.15.73:0/2623184965 wait complete. 2023-08-10T11:44:59.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.649+0000 7f4de42d8700 1 Processor -- start 2023-08-10T11:44:59.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.649+0000 7f4de42d8700 1 -- start start 2023-08-10T11:44:59.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.649+0000 7f4de42d8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ddc0fe530 0x7f4ddc195390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:59.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.649+0000 7f4de42d8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc1958d0 con 0x7f4ddc0fe530 2023-08-10T11:44:59.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.649+0000 7f4de2074700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ddc0fe530 0x7f4ddc195390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:59.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.649+0000 7f4de2074700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ddc0fe530 0x7f4ddc195390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57942/0 (socket says 172.21.15.73:57942) 2023-08-10T11:44:59.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.649+0000 7f4de2074700 1 -- 172.21.15.73:0/2886934029 learned_addr learned my addr 172.21.15.73:0/2886934029 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:44:59.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.649+0000 7f4de2074700 1 -- 172.21.15.73:0/2886934029 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd80095f0 con 0x7f4ddc0fe530 2023-08-10T11:44:59.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.649+0000 7f4de2074700 1 --2- 172.21.15.73:0/2886934029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ddc0fe530 0x7f4ddc195390 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8004f40 tx=0x7f4dd80057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:59.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.649+0000 7f4dd37fe700 1 -- 172.21.15.73:0/2886934029 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dd801d070 con 0x7f4ddc0fe530 2023-08-10T11:44:59.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.649+0000 7f4dd37fe700 1 -- 172.21.15.73:0/2886934029 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4dd800bc10 con 0x7f4ddc0fe530 2023-08-10T11:44:59.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.649+0000 7f4dd37fe700 1 -- 172.21.15.73:0/2886934029 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dd8003a70 con 0x7f4ddc0fe530 2023-08-10T11:44:59.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.649+0000 7f4de42d8700 1 -- 172.21.15.73:0/2886934029 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ddc195ad0 con 0x7f4ddc0fe530 2023-08-10T11:44:59.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.650+0000 7f4de42d8700 1 -- 172.21.15.73:0/2886934029 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ddc195f70 con 0x7f4ddc0fe530 2023-08-10T11:44:59.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.650+0000 7f4dd37fe700 1 -- 172.21.15.73:0/2886934029 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f4dd8003ce0 con 0x7f4ddc0fe530 2023-08-10T11:44:59.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.650+0000 7f4de42d8700 1 -- 172.21.15.73:0/2886934029 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ddc18ed90 con 0x7f4ddc0fe530 2023-08-10T11:44:59.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.651+0000 7f4dd37fe700 1 --2- 172.21.15.73:0/2886934029 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4dc8038800 0x7f4dc803acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:44:59.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.651+0000 7f4dd37fe700 1 -- 172.21.15.73:0/2886934029 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4dd804c370 con 0x7f4ddc0fe530 2023-08-10T11:44:59.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.651+0000 7f4de1873700 1 --2- 172.21.15.73:0/2886934029 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4dc8038800 0x7f4dc803acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:44:59.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.651+0000 7f4de1873700 1 --2- 172.21.15.73:0/2886934029 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4dc8038800 0x7f4dc803acc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc006fd0 tx=0x7f4dcc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:44:59.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.656+0000 7f4dd37fe700 1 -- 172.21.15.73:0/2886934029 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f4dd800bd80 con 0x7f4ddc0fe530 2023-08-10T11:44:59.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.840+0000 7f4de42d8700 1 -- 172.21.15.73:0/2886934029 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f4ddc0ff060 con 0x7f4ddc0fe530 2023-08-10T11:44:59.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.844+0000 7f4dd37fe700 1 -- 172.21.15.73:0/2886934029 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f4ddc0ff060 con 0x7f4ddc0fe530 2023-08-10T11:44:59.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.846+0000 7f4de42d8700 1 -- 172.21.15.73:0/2886934029 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4dc8038800 msgr2=0x7f4dc803acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:59.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.846+0000 7f4de42d8700 1 --2- 172.21.15.73:0/2886934029 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4dc8038800 0x7f4dc803acc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc006fd0 tx=0x7f4dcc006e40 comp rx=0 tx=0).stop 2023-08-10T11:44:59.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.846+0000 7f4de42d8700 1 -- 172.21.15.73:0/2886934029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ddc0fe530 msgr2=0x7f4ddc195390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:44:59.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.846+0000 7f4de42d8700 1 --2- 172.21.15.73:0/2886934029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ddc0fe530 0x7f4ddc195390 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8004f40 tx=0x7f4dd80057c0 comp rx=0 tx=0).stop 2023-08-10T11:44:59.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.846+0000 7f4de42d8700 1 -- 172.21.15.73:0/2886934029 shutdown_connections 2023-08-10T11:44:59.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.846+0000 7f4de42d8700 1 --2- 172.21.15.73:0/2886934029 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4dc8038800 0x7f4dc803acc0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:59.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.846+0000 7f4de42d8700 1 --2- 172.21.15.73:0/2886934029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ddc0fe530 0x7f4ddc195390 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:44:59.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.846+0000 7f4de42d8700 1 -- 172.21.15.73:0/2886934029 >> 172.21.15.73:0/2886934029 conn(0x7f4ddc0f9e70 msgr2=0x7f4ddc0fac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:44:59.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.846+0000 7f4de42d8700 1 -- 172.21.15.73:0/2886934029 shutdown_connections 2023-08-10T11:44:59.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:44:59.846+0000 7f4de42d8700 1 -- 172.21.15.73:0/2886934029 wait complete. 2023-08-10T11:45:00.273 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-08-10T11:45:00.274 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-08-10T11:45:00.823 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:45:01.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:00 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:01.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:00 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:01.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:00 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi073", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:45:01.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:00 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:01.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:00 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:45:01.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:00 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:01.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:00 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2886934029' entity='client.admin' 2023-08-10T11:45:01.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:00 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:45:01.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:00 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:02.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.017+0000 7f20fe9cb700 1 -- 172.21.15.73:0/3810526551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20f8100d70 msgr2=0x7f20f8103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:02.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.017+0000 7f20fe9cb700 1 --2- 172.21.15.73:0/3810526551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20f8100d70 0x7f20f8103160 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f20ec009910 tx=0x7f20ec009c20 comp rx=0 tx=0).stop 2023-08-10T11:45:02.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.017+0000 7f20fe9cb700 1 -- 172.21.15.73:0/3810526551 shutdown_connections 2023-08-10T11:45:02.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.017+0000 7f20fe9cb700 1 --2- 172.21.15.73:0/3810526551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20f8100d70 0x7f20f8103160 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:02.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.017+0000 7f20fe9cb700 1 -- 172.21.15.73:0/3810526551 >> 172.21.15.73:0/3810526551 conn(0x7f20f80fa700 msgr2=0x7f20f80fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:45:02.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.017+0000 7f20fe9cb700 1 -- 172.21.15.73:0/3810526551 shutdown_connections 2023-08-10T11:45:02.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.017+0000 7f20fe9cb700 1 -- 172.21.15.73:0/3810526551 wait complete. 2023-08-10T11:45:02.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.017+0000 7f20fe9cb700 1 Processor -- start 2023-08-10T11:45:02.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.017+0000 7f20fe9cb700 1 -- start start 2023-08-10T11:45:02.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.018+0000 7f20fe9cb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20f8100d70 0x7f20f8195310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:02.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.018+0000 7f20fe9cb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f8195850 con 0x7f20f8100d70 2023-08-10T11:45:02.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.018+0000 7f20f7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20f8100d70 0x7f20f8195310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:02.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.018+0000 7f20f7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20f8100d70 0x7f20f8195310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57948/0 (socket says 172.21.15.73:57948) 2023-08-10T11:45:02.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.018+0000 7f20f7fff700 1 -- 172.21.15.73:0/1599940797 learned_addr learned my addr 172.21.15.73:0/1599940797 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:45:02.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.018+0000 7f20f7fff700 1 -- 172.21.15.73:0/1599940797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec0095f0 con 0x7f20f8100d70 2023-08-10T11:45:02.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.018+0000 7f20f7fff700 1 --2- 172.21.15.73:0/1599940797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20f8100d70 0x7f20f8195310 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f20ec004f40 tx=0x7f20ec0057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:45:02.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.018+0000 7f20f57fa700 1 -- 172.21.15.73:0/1599940797 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20ec01d070 con 0x7f20f8100d70 2023-08-10T11:45:02.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.018+0000 7f20fe9cb700 1 -- 172.21.15.73:0/1599940797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f8195a50 con 0x7f20f8100d70 2023-08-10T11:45:02.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.018+0000 7f20f57fa700 1 -- 172.21.15.73:0/1599940797 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f20ec0044e0 con 0x7f20f8100d70 2023-08-10T11:45:02.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.018+0000 7f20f57fa700 1 -- 172.21.15.73:0/1599940797 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20ec003a20 con 0x7f20f8100d70 2023-08-10T11:45:02.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.018+0000 7f20fe9cb700 1 -- 172.21.15.73:0/1599940797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f8195e90 con 0x7f20f8100d70 2023-08-10T11:45:02.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.019+0000 7f20f57fa700 1 -- 172.21.15.73:0/1599940797 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f20ec003ca0 con 0x7f20f8100d70 2023-08-10T11:45:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.019+0000 7f20fe9cb700 1 -- 172.21.15.73:0/1599940797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f818ed70 con 0x7f20f8100d70 2023-08-10T11:45:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.019+0000 7f20f57fa700 1 --2- 172.21.15.73:0/1599940797 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f20e00387b0 0x7f20e003ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.020+0000 7f20f57fa700 1 -- 172.21.15.73:0/1599940797 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f20ec04c9f0 con 0x7f20f8100d70 2023-08-10T11:45:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.020+0000 7f20f77fe700 1 --2- 172.21.15.73:0/1599940797 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f20e00387b0 0x7f20e003ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.020+0000 7f20f77fe700 1 --2- 172.21.15.73:0/1599940797 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f20e00387b0 0x7f20e003ac70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f20e8006fd0 tx=0x7f20e8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:45:02.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.024+0000 7f20f57fa700 1 -- 172.21.15.73:0/1599940797 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f20ec02a950 con 0x7f20f8100d70 2023-08-10T11:45:02.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.214+0000 7f20fe9cb700 1 -- 172.21.15.73:0/1599940797 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f20f8060c40 con 0x7f20e00387b0 2023-08-10T11:45:02.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.217+0000 7f20f57fa700 1 -- 172.21.15.73:0/1599940797 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f20f8060c40 con 0x7f20e00387b0 2023-08-10T11:45:02.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.219+0000 7f20fe9cb700 1 -- 172.21.15.73:0/1599940797 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f20e00387b0 msgr2=0x7f20e003ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:02.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.219+0000 7f20fe9cb700 1 --2- 172.21.15.73:0/1599940797 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f20e00387b0 0x7f20e003ac70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f20e8006fd0 tx=0x7f20e8006e40 comp rx=0 tx=0).stop 2023-08-10T11:45:02.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.219+0000 7f20fe9cb700 1 -- 172.21.15.73:0/1599940797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20f8100d70 msgr2=0x7f20f8195310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:02.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.219+0000 7f20fe9cb700 1 --2- 172.21.15.73:0/1599940797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20f8100d70 0x7f20f8195310 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f20ec004f40 tx=0x7f20ec0057c0 comp rx=0 tx=0).stop 2023-08-10T11:45:02.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.219+0000 7f20fe9cb700 1 -- 172.21.15.73:0/1599940797 shutdown_connections 2023-08-10T11:45:02.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.219+0000 7f20fe9cb700 1 --2- 172.21.15.73:0/1599940797 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f20e00387b0 0x7f20e003ac70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:02.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.219+0000 7f20fe9cb700 1 --2- 172.21.15.73:0/1599940797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20f8100d70 0x7f20f8195310 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:02.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.219+0000 7f20fe9cb700 1 -- 172.21.15.73:0/1599940797 >> 172.21.15.73:0/1599940797 conn(0x7f20f80fa700 msgr2=0x7f20f80fb440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:45:02.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.219+0000 7f20fe9cb700 1 -- 172.21.15.73:0/1599940797 shutdown_connections 2023-08-10T11:45:02.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:02.219+0000 7f20fe9cb700 1 -- 172.21.15.73:0/1599940797 wait complete. 2023-08-10T11:45:02.672 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi152 2023-08-10T11:45:02.672 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-08-10T11:45:02.673 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/etc/ceph/ceph.conf 2023-08-10T11:45:02.693 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-08-10T11:45:02.694 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-08-10T11:45:02.753 INFO:tasks.cephadm:Adding host smithi152 to orchestrator... 2023-08-10T11:45:02.753 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph orch host add smithi152 2023-08-10T11:45:03.315 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:45:03.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:03 smithi073 ceph-mon[128869]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:45:03.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:03 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:03.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:03 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:45:03.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:03 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:03.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:03 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:45:03.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:03 smithi073 ceph-mon[128869]: Updating smithi073:/etc/ceph/ceph.conf 2023-08-10T11:45:03.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:03 smithi073 ceph-mon[128869]: Updating smithi073:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T11:45:03.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:03 smithi073 ceph-mon[128869]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2023-08-10T11:45:03.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:03 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:03.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:03 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:03.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:03 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:04.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.646+0000 7f4fb7e5a700 1 -- 172.21.15.73:0/2581580253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4fb0105180 msgr2=0x7f4fb0105560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:04.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.646+0000 7f4fb7e5a700 1 --2- 172.21.15.73:0/2581580253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4fb0105180 0x7f4fb0105560 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0009910 tx=0x7f4fa0009c20 comp rx=0 tx=0).stop 2023-08-10T11:45:04.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.646+0000 7f4fb7e5a700 1 -- 172.21.15.73:0/2581580253 shutdown_connections 2023-08-10T11:45:04.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.646+0000 7f4fb7e5a700 1 --2- 172.21.15.73:0/2581580253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4fb0105180 0x7f4fb0105560 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:04.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.646+0000 7f4fb7e5a700 1 -- 172.21.15.73:0/2581580253 >> 172.21.15.73:0/2581580253 conn(0x7f4fb0074c70 msgr2=0x7f4fb0075080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:45:04.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.646+0000 7f4fb7e5a700 1 -- 172.21.15.73:0/2581580253 shutdown_connections 2023-08-10T11:45:04.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.646+0000 7f4fb7e5a700 1 -- 172.21.15.73:0/2581580253 wait complete. 2023-08-10T11:45:04.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.647+0000 7f4fb7e5a700 1 Processor -- start 2023-08-10T11:45:04.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.647+0000 7f4fb7e5a700 1 -- start start 2023-08-10T11:45:04.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.647+0000 7f4fb7e5a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4fb0105180 0x7f4fb01956b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:04.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.647+0000 7f4fb7e5a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb0195bf0 con 0x7f4fb0105180 2023-08-10T11:45:04.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.647+0000 7f4fb5bf6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4fb0105180 0x7f4fb01956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:04.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.647+0000 7f4fb5bf6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4fb0105180 0x7f4fb01956b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57954/0 (socket says 172.21.15.73:57954) 2023-08-10T11:45:04.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.647+0000 7f4fb5bf6700 1 -- 172.21.15.73:0/3759632362 learned_addr learned my addr 172.21.15.73:0/3759632362 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:45:04.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.647+0000 7f4fb5bf6700 1 -- 172.21.15.73:0/3759632362 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa00095f0 con 0x7f4fb0105180 2023-08-10T11:45:04.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.647+0000 7f4fb5bf6700 1 --2- 172.21.15.73:0/3759632362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4fb0105180 0x7f4fb01956b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0004f40 tx=0x7f4fa0005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:45:04.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.648+0000 7f4fa6ffd700 1 -- 172.21.15.73:0/3759632362 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4fa001d070 con 0x7f4fb0105180 2023-08-10T11:45:04.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.648+0000 7f4fb7e5a700 1 -- 172.21.15.73:0/3759632362 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb0195e50 con 0x7f4fb0105180 2023-08-10T11:45:04.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.648+0000 7f4fa6ffd700 1 -- 172.21.15.73:0/3759632362 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4fa0004370 con 0x7f4fb0105180 2023-08-10T11:45:04.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.648+0000 7f4fa6ffd700 1 -- 172.21.15.73:0/3759632362 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4fa0003970 con 0x7f4fb0105180 2023-08-10T11:45:04.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.648+0000 7f4fb7e5a700 1 -- 172.21.15.73:0/3759632362 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb01962d0 con 0x7f4fb0105180 2023-08-10T11:45:04.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.648+0000 7f4fa6ffd700 1 -- 172.21.15.73:0/3759632362 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f4fa0003c30 con 0x7f4fb0105180 2023-08-10T11:45:04.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.649+0000 7f4fa6ffd700 1 --2- 172.21.15.73:0/3759632362 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4f9c0387b0 0x7f4f9c03ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:04.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.649+0000 7f4fb7e5a700 1 -- 172.21.15.73:0/3759632362 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb0061da0 con 0x7f4fb0105180 2023-08-10T11:45:04.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.649+0000 7f4fa6ffd700 1 -- 172.21.15.73:0/3759632362 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4fa004c520 con 0x7f4fb0105180 2023-08-10T11:45:04.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.649+0000 7f4fb53f5700 1 --2- 172.21.15.73:0/3759632362 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4f9c0387b0 0x7f4f9c03ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:04.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.649+0000 7f4fb53f5700 1 --2- 172.21.15.73:0/3759632362 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4f9c0387b0 0x7f4f9c03ac70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4fac006fd0 tx=0x7f4fac006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:45:04.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.654+0000 7f4fa6ffd700 1 -- 172.21.15.73:0/3759632362 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f4fa0026070 con 0x7f4fb0105180 2023-08-10T11:45:04.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:04 smithi073 ceph-mon[128869]: Updating smithi073:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T11:45:04.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:04.844+0000 7f4fb7e5a700 1 -- 172.21.15.73:0/3759632362 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi152", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fb0104450 con 0x7f4f9c0387b0 2023-08-10T11:45:05.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:05 smithi073 ceph-mon[128869]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi152", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:45:06.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:06 smithi073 ceph-mon[128869]: Deploying cephadm binary to smithi152 2023-08-10T11:45:07.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:07.154+0000 7f4fa6ffd700 1 -- 172.21.15.73:0/3759632362 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f4fb0104450 con 0x7f4f9c0387b0 2023-08-10T11:45:07.155 INFO:teuthology.orchestra.run.smithi073.stdout:Added host 'smithi152' with addr '172.21.15.152' 2023-08-10T11:45:07.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:07.157+0000 7f4fb7e5a700 1 -- 172.21.15.73:0/3759632362 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4f9c0387b0 msgr2=0x7f4f9c03ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:07.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:07.157+0000 7f4fb7e5a700 1 --2- 172.21.15.73:0/3759632362 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4f9c0387b0 0x7f4f9c03ac70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4fac006fd0 tx=0x7f4fac006e40 comp rx=0 tx=0).stop 2023-08-10T11:45:07.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:07.157+0000 7f4fb7e5a700 1 -- 172.21.15.73:0/3759632362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4fb0105180 msgr2=0x7f4fb01956b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:07.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:07.157+0000 7f4fb7e5a700 1 --2- 172.21.15.73:0/3759632362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4fb0105180 0x7f4fb01956b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0004f40 tx=0x7f4fa0005020 comp rx=0 tx=0).stop 2023-08-10T11:45:07.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:07.157+0000 7f4fb7e5a700 1 -- 172.21.15.73:0/3759632362 shutdown_connections 2023-08-10T11:45:07.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:07.157+0000 7f4fb7e5a700 1 --2- 172.21.15.73:0/3759632362 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4f9c0387b0 0x7f4f9c03ac70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:07.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:07.157+0000 7f4fb7e5a700 1 --2- 172.21.15.73:0/3759632362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4fb0105180 0x7f4fb01956b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:07.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:07.157+0000 7f4fb7e5a700 1 -- 172.21.15.73:0/3759632362 >> 172.21.15.73:0/3759632362 conn(0x7f4fb0074c70 msgr2=0x7f4fb0102d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:45:07.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:07.157+0000 7f4fb7e5a700 1 -- 172.21.15.73:0/3759632362 shutdown_connections 2023-08-10T11:45:07.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:07.157+0000 7f4fb7e5a700 1 -- 172.21.15.73:0/3759632362 wait complete. 2023-08-10T11:45:07.577 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph orch host ls --format=json 2023-08-10T11:45:08.128 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:45:08.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:08 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:08.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:08 smithi073 ceph-mon[128869]: Added host smithi152 2023-08-10T11:45:08.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:08 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:45:08.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:08 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:09.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.404+0000 7f3658088700 1 -- 172.21.15.73:0/4090844207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3650100450 msgr2=0x7f3650100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:09.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.404+0000 7f3658088700 1 --2- 172.21.15.73:0/4090844207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3650100450 0x7f3650100830 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3640009910 tx=0x7f3640009c20 comp rx=0 tx=0).stop 2023-08-10T11:45:09.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.404+0000 7f3658088700 1 -- 172.21.15.73:0/4090844207 shutdown_connections 2023-08-10T11:45:09.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.404+0000 7f3658088700 1 --2- 172.21.15.73:0/4090844207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3650100450 0x7f3650100830 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:09.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.404+0000 7f3658088700 1 -- 172.21.15.73:0/4090844207 >> 172.21.15.73:0/4090844207 conn(0x7f36500fbd00 msgr2=0x7f36500fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:45:09.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.404+0000 7f3658088700 1 -- 172.21.15.73:0/4090844207 shutdown_connections 2023-08-10T11:45:09.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.404+0000 7f3658088700 1 -- 172.21.15.73:0/4090844207 wait complete. 2023-08-10T11:45:09.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.404+0000 7f3658088700 1 Processor -- start 2023-08-10T11:45:09.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.404+0000 7f3658088700 1 -- start start 2023-08-10T11:45:09.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.405+0000 7f3658088700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3650100450 0x7f36501956c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:09.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.405+0000 7f3658088700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3650195c00 con 0x7f3650100450 2023-08-10T11:45:09.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.405+0000 7f3655e24700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3650100450 0x7f36501956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:09.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.405+0000 7f3655e24700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3650100450 0x7f36501956c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57980/0 (socket says 172.21.15.73:57980) 2023-08-10T11:45:09.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.405+0000 7f3655e24700 1 -- 172.21.15.73:0/1746128050 learned_addr learned my addr 172.21.15.73:0/1746128050 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:45:09.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.405+0000 7f3655e24700 1 -- 172.21.15.73:0/1746128050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36400095f0 con 0x7f3650100450 2023-08-10T11:45:09.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.405+0000 7f3655e24700 1 --2- 172.21.15.73:0/1746128050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3650100450 0x7f36501956c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3640004f40 tx=0x7f3640005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:45:09.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.405+0000 7f3646ffd700 1 -- 172.21.15.73:0/1746128050 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f364001d070 con 0x7f3650100450 2023-08-10T11:45:09.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.405+0000 7f3646ffd700 1 -- 172.21.15.73:0/1746128050 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3640004370 con 0x7f3650100450 2023-08-10T11:45:09.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.405+0000 7f3646ffd700 1 -- 172.21.15.73:0/1746128050 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36400039b0 con 0x7f3650100450 2023-08-10T11:45:09.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.405+0000 7f3658088700 1 -- 172.21.15.73:0/1746128050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3650195e00 con 0x7f3650100450 2023-08-10T11:45:09.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.405+0000 7f3658088700 1 -- 172.21.15.73:0/1746128050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3650196220 con 0x7f3650100450 2023-08-10T11:45:09.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.406+0000 7f3646ffd700 1 -- 172.21.15.73:0/1746128050 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f3640003c70 con 0x7f3650100450 2023-08-10T11:45:09.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.406+0000 7f3658088700 1 -- 172.21.15.73:0/1746128050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3650061da0 con 0x7f3650100450 2023-08-10T11:45:09.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.406+0000 7f3646ffd700 1 --2- 172.21.15.73:0/1746128050 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f363c0387b0 0x7f363c03ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:09.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.406+0000 7f3646ffd700 1 -- 172.21.15.73:0/1746128050 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f364004c8a0 con 0x7f3650100450 2023-08-10T11:45:09.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.407+0000 7f3655623700 1 --2- 172.21.15.73:0/1746128050 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f363c0387b0 0x7f363c03ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:09.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.407+0000 7f3655623700 1 --2- 172.21.15.73:0/1746128050 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f363c0387b0 0x7f363c03ac70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f364c006fd0 tx=0x7f364c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:45:09.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.411+0000 7f3646ffd700 1 -- 172.21.15.73:0/1746128050 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f3640029360 con 0x7f3650100450 2023-08-10T11:45:09.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:09 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:09.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:09 smithi073 ceph-mon[128869]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:09.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.605+0000 7f3658088700 1 -- 172.21.15.73:0/1746128050 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3650108210 con 0x7f363c0387b0 2023-08-10T11:45:09.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.606+0000 7f3646ffd700 1 -- 172.21.15.73:0/1746128050 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f3650108210 con 0x7f363c0387b0 2023-08-10T11:45:09.608 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:45:09.608 INFO:teuthology.orchestra.run.smithi073.stdout:[{"addr": "172.21.15.73", "hostname": "smithi073", "labels": [], "status": ""}, {"addr": "172.21.15.152", "hostname": "smithi152", "labels": [], "status": ""}] 2023-08-10T11:45:09.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.608+0000 7f3658088700 1 -- 172.21.15.73:0/1746128050 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f363c0387b0 msgr2=0x7f363c03ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:09.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.608+0000 7f3658088700 1 --2- 172.21.15.73:0/1746128050 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f363c0387b0 0x7f363c03ac70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f364c006fd0 tx=0x7f364c006e40 comp rx=0 tx=0).stop 2023-08-10T11:45:09.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.608+0000 7f3658088700 1 -- 172.21.15.73:0/1746128050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3650100450 msgr2=0x7f36501956c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:09.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.608+0000 7f3658088700 1 --2- 172.21.15.73:0/1746128050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3650100450 0x7f36501956c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3640004f40 tx=0x7f3640005020 comp rx=0 tx=0).stop 2023-08-10T11:45:09.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.608+0000 7f3658088700 1 -- 172.21.15.73:0/1746128050 shutdown_connections 2023-08-10T11:45:09.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.608+0000 7f3658088700 1 --2- 172.21.15.73:0/1746128050 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f363c0387b0 0x7f363c03ac70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:09.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.608+0000 7f3658088700 1 --2- 172.21.15.73:0/1746128050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3650100450 0x7f36501956c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:09.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.608+0000 7f3658088700 1 -- 172.21.15.73:0/1746128050 >> 172.21.15.73:0/1746128050 conn(0x7f36500fbd00 msgr2=0x7f36501046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:45:09.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.609+0000 7f3658088700 1 -- 172.21.15.73:0/1746128050 shutdown_connections 2023-08-10T11:45:09.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:09.609+0000 7f3658088700 1 -- 172.21.15.73:0/1746128050 wait complete. 2023-08-10T11:45:10.071 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi156 2023-08-10T11:45:10.072 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-08-10T11:45:10.072 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/etc/ceph/ceph.conf 2023-08-10T11:45:10.093 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-08-10T11:45:10.094 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-08-10T11:45:10.153 INFO:tasks.cephadm:Adding host smithi156 to orchestrator... 2023-08-10T11:45:10.153 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph orch host add smithi156 2023-08-10T11:45:10.704 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:45:10.941 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:10 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:10.941 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:10 smithi073 ceph-mon[128869]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T11:45:11.798 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:11 smithi073 ceph-mon[128869]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:11.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.945+0000 7f0d5d1cb700 1 -- 172.21.15.73:0/1159920000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d58106290 msgr2=0x7f0d58106670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:11.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.945+0000 7f0d5d1cb700 1 --2- 172.21.15.73:0/1159920000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d58106290 0x7f0d58106670 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009910 tx=0x7f0d4c009c20 comp rx=0 tx=0).stop 2023-08-10T11:45:11.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.945+0000 7f0d5d1cb700 1 -- 172.21.15.73:0/1159920000 shutdown_connections 2023-08-10T11:45:11.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.945+0000 7f0d5d1cb700 1 --2- 172.21.15.73:0/1159920000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d58106290 0x7f0d58106670 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:11.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.945+0000 7f0d5d1cb700 1 -- 172.21.15.73:0/1159920000 >> 172.21.15.73:0/1159920000 conn(0x7f0d58074c70 msgr2=0x7f0d58075080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:45:11.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.945+0000 7f0d5d1cb700 1 -- 172.21.15.73:0/1159920000 shutdown_connections 2023-08-10T11:45:11.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.945+0000 7f0d5d1cb700 1 -- 172.21.15.73:0/1159920000 wait complete. 2023-08-10T11:45:11.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.945+0000 7f0d5d1cb700 1 Processor -- start 2023-08-10T11:45:11.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.946+0000 7f0d5d1cb700 1 -- start start 2023-08-10T11:45:11.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.946+0000 7f0d5d1cb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d58106290 0x7f0d58195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:11.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.946+0000 7f0d5d1cb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d58195bd0 con 0x7f0d58106290 2023-08-10T11:45:11.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.946+0000 7f0d56d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d58106290 0x7f0d58195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:11.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.946+0000 7f0d56d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d58106290 0x7f0d58195690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57986/0 (socket says 172.21.15.73:57986) 2023-08-10T11:45:11.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.946+0000 7f0d56d9d700 1 -- 172.21.15.73:0/3885339730 learned_addr learned my addr 172.21.15.73:0/3885339730 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:45:11.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.946+0000 7f0d56d9d700 1 -- 172.21.15.73:0/3885339730 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4c0095f0 con 0x7f0d58106290 2023-08-10T11:45:11.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.946+0000 7f0d56d9d700 1 --2- 172.21.15.73:0/3885339730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d58106290 0x7f0d58195690 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c004f40 tx=0x7f0d4c005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:45:11.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.946+0000 7f0d3ffff700 1 -- 172.21.15.73:0/3885339730 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d4c01d070 con 0x7f0d58106290 2023-08-10T11:45:11.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.947+0000 7f0d5d1cb700 1 -- 172.21.15.73:0/3885339730 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d58195e30 con 0x7f0d58106290 2023-08-10T11:45:11.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.947+0000 7f0d3ffff700 1 -- 172.21.15.73:0/3885339730 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d4c004370 con 0x7f0d58106290 2023-08-10T11:45:11.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.947+0000 7f0d3ffff700 1 -- 172.21.15.73:0/3885339730 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d4c003970 con 0x7f0d58106290 2023-08-10T11:45:11.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.947+0000 7f0d5d1cb700 1 -- 172.21.15.73:0/3885339730 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d581962b0 con 0x7f0d58106290 2023-08-10T11:45:11.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.947+0000 7f0d5d1cb700 1 -- 172.21.15.73:0/3885339730 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d58061da0 con 0x7f0d58106290 2023-08-10T11:45:11.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.948+0000 7f0d3ffff700 1 -- 172.21.15.73:0/3885339730 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f0d4c003be0 con 0x7f0d58106290 2023-08-10T11:45:11.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.948+0000 7f0d3ffff700 1 --2- 172.21.15.73:0/3885339730 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0d40038800 0x7f0d4003acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:11.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.948+0000 7f0d3ffff700 1 -- 172.21.15.73:0/3885339730 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0d4c04c9a0 con 0x7f0d58106290 2023-08-10T11:45:11.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.948+0000 7f0d5659c700 1 --2- 172.21.15.73:0/3885339730 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0d40038800 0x7f0d4003acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:11.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.948+0000 7f0d5659c700 1 --2- 172.21.15.73:0/3885339730 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0d40038800 0x7f0d4003acc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0d48006fd0 tx=0x7f0d48006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:45:11.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:11.952+0000 7f0d3ffff700 1 -- 172.21.15.73:0/3885339730 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0d4c00e5c0 con 0x7f0d58106290 2023-08-10T11:45:12.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:12.143+0000 7f0d5d1cb700 1 -- 172.21.15.73:0/3885339730 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi156", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d58105140 con 0x7f0d40038800 2023-08-10T11:45:13.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:13 smithi073 ceph-mon[128869]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi156", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:45:13.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:13 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:13.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:13 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:13.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:13 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:13.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:13 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:13.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:13 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi152", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:45:13.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:13 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:13.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:13 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:45:13.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:13 smithi073 ceph-mon[128869]: Updating smithi152:/etc/ceph/ceph.conf 2023-08-10T11:45:13.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:13 smithi073 ceph-mon[128869]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:13.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:13 smithi073 ceph-mon[128869]: Updating smithi152:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T11:45:13.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:13 smithi073 ceph-mon[128869]: Deploying cephadm binary to smithi156 2023-08-10T11:45:13.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:13 smithi073 ceph-mon[128869]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2023-08-10T11:45:14.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:14.411+0000 7f0d3ffff700 1 -- 172.21.15.73:0/3885339730 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f0d58105140 con 0x7f0d40038800 2023-08-10T11:45:14.413 INFO:teuthology.orchestra.run.smithi073.stdout:Added host 'smithi156' with addr '172.21.15.156' 2023-08-10T11:45:14.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:14.413+0000 7f0d5d1cb700 1 -- 172.21.15.73:0/3885339730 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0d40038800 msgr2=0x7f0d4003acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:14.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:14.413+0000 7f0d5d1cb700 1 --2- 172.21.15.73:0/3885339730 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0d40038800 0x7f0d4003acc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0d48006fd0 tx=0x7f0d48006e40 comp rx=0 tx=0).stop 2023-08-10T11:45:14.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:14.413+0000 7f0d5d1cb700 1 -- 172.21.15.73:0/3885339730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d58106290 msgr2=0x7f0d58195690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:14.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:14.413+0000 7f0d5d1cb700 1 --2- 172.21.15.73:0/3885339730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d58106290 0x7f0d58195690 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c004f40 tx=0x7f0d4c005020 comp rx=0 tx=0).stop 2023-08-10T11:45:14.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:14.413+0000 7f0d5d1cb700 1 -- 172.21.15.73:0/3885339730 shutdown_connections 2023-08-10T11:45:14.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:14.413+0000 7f0d5d1cb700 1 --2- 172.21.15.73:0/3885339730 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0d40038800 0x7f0d4003acc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:14.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:14.413+0000 7f0d5d1cb700 1 --2- 172.21.15.73:0/3885339730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d58106290 0x7f0d58195690 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:14.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:14.413+0000 7f0d5d1cb700 1 -- 172.21.15.73:0/3885339730 >> 172.21.15.73:0/3885339730 conn(0x7f0d58074c70 msgr2=0x7f0d580fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:45:14.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:14.413+0000 7f0d5d1cb700 1 -- 172.21.15.73:0/3885339730 shutdown_connections 2023-08-10T11:45:14.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:14.413+0000 7f0d5d1cb700 1 -- 172.21.15.73:0/3885339730 wait complete. 2023-08-10T11:45:14.868 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph orch host ls --format=json 2023-08-10T11:45:15.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:14 smithi073 ceph-mon[128869]: Updating smithi152:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T11:45:15.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:14 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:15.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:14 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:15.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:14 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:15.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:14 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:15.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:14 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:45:15.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:14 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:15.417 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:45:15.934 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:15 smithi073 ceph-mon[128869]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:15.934 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:15 smithi073 ceph-mon[128869]: Added host smithi156 2023-08-10T11:45:15.934 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:15 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:16.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.638+0000 7f1bdfce9700 1 -- 172.21.15.73:0/2529212222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bd8100450 msgr2=0x7f1bd8100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:16.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.638+0000 7f1bdfce9700 1 --2- 172.21.15.73:0/2529212222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bd8100450 0x7f1bd8100830 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009910 tx=0x7f1bc8009c20 comp rx=0 tx=0).stop 2023-08-10T11:45:16.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.638+0000 7f1bdfce9700 1 -- 172.21.15.73:0/2529212222 shutdown_connections 2023-08-10T11:45:16.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.638+0000 7f1bdfce9700 1 --2- 172.21.15.73:0/2529212222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bd8100450 0x7f1bd8100830 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:16.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.638+0000 7f1bdfce9700 1 -- 172.21.15.73:0/2529212222 >> 172.21.15.73:0/2529212222 conn(0x7f1bd80fbd00 msgr2=0x7f1bd80fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:45:16.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.638+0000 7f1bdfce9700 1 -- 172.21.15.73:0/2529212222 shutdown_connections 2023-08-10T11:45:16.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.638+0000 7f1bdfce9700 1 -- 172.21.15.73:0/2529212222 wait complete. 2023-08-10T11:45:16.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.639+0000 7f1bdfce9700 1 Processor -- start 2023-08-10T11:45:16.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.639+0000 7f1bdfce9700 1 -- start start 2023-08-10T11:45:16.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.639+0000 7f1bdfce9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bd8100450 0x7f1bd81956c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:16.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.639+0000 7f1bdfce9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd8195c00 con 0x7f1bd8100450 2023-08-10T11:45:16.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.639+0000 7f1bdda85700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bd8100450 0x7f1bd81956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:16.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.639+0000 7f1bdda85700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bd8100450 0x7f1bd81956c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58012/0 (socket says 172.21.15.73:58012) 2023-08-10T11:45:16.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.639+0000 7f1bdda85700 1 -- 172.21.15.73:0/757042725 learned_addr learned my addr 172.21.15.73:0/757042725 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:45:16.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.639+0000 7f1bdda85700 1 -- 172.21.15.73:0/757042725 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc80095f0 con 0x7f1bd8100450 2023-08-10T11:45:16.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.639+0000 7f1bdda85700 1 --2- 172.21.15.73:0/757042725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bd8100450 0x7f1bd81956c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8004f40 tx=0x7f1bc8005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:45:16.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.640+0000 7f1bceffd700 1 -- 172.21.15.73:0/757042725 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1bc801d070 con 0x7f1bd8100450 2023-08-10T11:45:16.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.640+0000 7f1bceffd700 1 -- 172.21.15.73:0/757042725 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1bc8004370 con 0x7f1bd8100450 2023-08-10T11:45:16.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.640+0000 7f1bdfce9700 1 -- 172.21.15.73:0/757042725 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd8195e00 con 0x7f1bd8100450 2023-08-10T11:45:16.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.640+0000 7f1bceffd700 1 -- 172.21.15.73:0/757042725 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1bc80039b0 con 0x7f1bd8100450 2023-08-10T11:45:16.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.640+0000 7f1bdfce9700 1 -- 172.21.15.73:0/757042725 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd8196220 con 0x7f1bd8100450 2023-08-10T11:45:16.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.640+0000 7f1bceffd700 1 -- 172.21.15.73:0/757042725 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f1bc8003c70 con 0x7f1bd8100450 2023-08-10T11:45:16.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.641+0000 7f1bceffd700 1 --2- 172.21.15.73:0/757042725 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f1bc40387b0 0x7f1bc403ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:16.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.641+0000 7f1bceffd700 1 -- 172.21.15.73:0/757042725 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1bc804c550 con 0x7f1bd8100450 2023-08-10T11:45:16.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.641+0000 7f1bdfce9700 1 -- 172.21.15.73:0/757042725 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd8061da0 con 0x7f1bd8100450 2023-08-10T11:45:16.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.641+0000 7f1bdd284700 1 --2- 172.21.15.73:0/757042725 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f1bc40387b0 0x7f1bc403ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:16.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.641+0000 7f1bdd284700 1 --2- 172.21.15.73:0/757042725 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f1bc40387b0 0x7f1bc403ac70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4006fd0 tx=0x7f1bd4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:45:16.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.645+0000 7f1bceffd700 1 -- 172.21.15.73:0/757042725 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f1bc8026020 con 0x7f1bd8100450 2023-08-10T11:45:16.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.835+0000 7f1bdfce9700 1 -- 172.21.15.73:0/757042725 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1bd8198fc0 con 0x7f1bc40387b0 2023-08-10T11:45:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.836+0000 7f1bceffd700 1 -- 172.21.15.73:0/757042725 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+240 (secure 0 0 0) 0x7f1bd8198fc0 con 0x7f1bc40387b0 2023-08-10T11:45:16.838 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:45:16.838 INFO:teuthology.orchestra.run.smithi073.stdout:[{"addr": "172.21.15.73", "hostname": "smithi073", "labels": [], "status": ""}, {"addr": "172.21.15.152", "hostname": "smithi152", "labels": [], "status": ""}, {"addr": "172.21.15.156", "hostname": "smithi156", "labels": [], "status": ""}] 2023-08-10T11:45:16.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.839+0000 7f1bdfce9700 1 -- 172.21.15.73:0/757042725 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f1bc40387b0 msgr2=0x7f1bc403ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:16.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.839+0000 7f1bdfce9700 1 --2- 172.21.15.73:0/757042725 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f1bc40387b0 0x7f1bc403ac70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4006fd0 tx=0x7f1bd4006e40 comp rx=0 tx=0).stop 2023-08-10T11:45:16.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.839+0000 7f1bdfce9700 1 -- 172.21.15.73:0/757042725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bd8100450 msgr2=0x7f1bd81956c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:16.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.839+0000 7f1bdfce9700 1 --2- 172.21.15.73:0/757042725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bd8100450 0x7f1bd81956c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8004f40 tx=0x7f1bc8005020 comp rx=0 tx=0).stop 2023-08-10T11:45:16.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.839+0000 7f1bdfce9700 1 -- 172.21.15.73:0/757042725 shutdown_connections 2023-08-10T11:45:16.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.839+0000 7f1bdfce9700 1 --2- 172.21.15.73:0/757042725 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f1bc40387b0 0x7f1bc403ac70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:16.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.839+0000 7f1bdfce9700 1 --2- 172.21.15.73:0/757042725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bd8100450 0x7f1bd81956c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:16.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.839+0000 7f1bdfce9700 1 -- 172.21.15.73:0/757042725 >> 172.21.15.73:0/757042725 conn(0x7f1bd80fbd00 msgr2=0x7f1bd81046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:45:16.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.839+0000 7f1bdfce9700 1 -- 172.21.15.73:0/757042725 shutdown_connections 2023-08-10T11:45:16.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:16.839+0000 7f1bdfce9700 1 -- 172.21.15.73:0/757042725 wait complete. 2023-08-10T11:45:17.272 INFO:tasks.cephadm:Setting crush tunables to default 2023-08-10T11:45:17.273 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph osd crush tunables default 2023-08-10T11:45:17.823 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:45:18.088 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:17 smithi073 ceph-mon[128869]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:18.088 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:17 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:18.088 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:17 smithi073 ceph-mon[128869]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T11:45:19.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.035+0000 7f90f2c35700 1 -- 172.21.15.73:0/2990255166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90ec105180 msgr2=0x7f90ec105560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:19.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.035+0000 7f90f2c35700 1 --2- 172.21.15.73:0/2990255166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90ec105180 0x7f90ec105560 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f90e0009910 tx=0x7f90e0009c20 comp rx=0 tx=0).stop 2023-08-10T11:45:19.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.035+0000 7f90f2c35700 1 -- 172.21.15.73:0/2990255166 shutdown_connections 2023-08-10T11:45:19.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.035+0000 7f90f2c35700 1 --2- 172.21.15.73:0/2990255166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90ec105180 0x7f90ec105560 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:19.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.035+0000 7f90f2c35700 1 -- 172.21.15.73:0/2990255166 >> 172.21.15.73:0/2990255166 conn(0x7f90ec074c70 msgr2=0x7f90ec075080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:45:19.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.035+0000 7f90f2c35700 1 -- 172.21.15.73:0/2990255166 shutdown_connections 2023-08-10T11:45:19.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.035+0000 7f90f2c35700 1 -- 172.21.15.73:0/2990255166 wait complete. 2023-08-10T11:45:19.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.036+0000 7f90f2c35700 1 Processor -- start 2023-08-10T11:45:19.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.036+0000 7f90f2c35700 1 -- start start 2023-08-10T11:45:19.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.036+0000 7f90f2c35700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90ec105180 0x7f90ec1964e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:19.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.036+0000 7f90f2c35700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec196a20 con 0x7f90ec105180 2023-08-10T11:45:19.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.036+0000 7f90f09d1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90ec105180 0x7f90ec1964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:19.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.036+0000 7f90f09d1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90ec105180 0x7f90ec1964e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58018/0 (socket says 172.21.15.73:58018) 2023-08-10T11:45:19.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.036+0000 7f90f09d1700 1 -- 172.21.15.73:0/3997659601 learned_addr learned my addr 172.21.15.73:0/3997659601 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:45:19.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.036+0000 7f90f09d1700 1 -- 172.21.15.73:0/3997659601 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e00095f0 con 0x7f90ec105180 2023-08-10T11:45:19.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.036+0000 7f90f09d1700 1 --2- 172.21.15.73:0/3997659601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90ec105180 0x7f90ec1964e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f90e0004f40 tx=0x7f90e0005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:45:19.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.036+0000 7f90e9ffb700 1 -- 172.21.15.73:0/3997659601 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90e001d070 con 0x7f90ec105180 2023-08-10T11:45:19.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.036+0000 7f90f2c35700 1 -- 172.21.15.73:0/3997659601 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ec196c80 con 0x7f90ec105180 2023-08-10T11:45:19.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.036+0000 7f90e9ffb700 1 -- 172.21.15.73:0/3997659601 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f90e0004370 con 0x7f90ec105180 2023-08-10T11:45:19.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.036+0000 7f90e9ffb700 1 -- 172.21.15.73:0/3997659601 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90e0003970 con 0x7f90ec105180 2023-08-10T11:45:19.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.037+0000 7f90f2c35700 1 -- 172.21.15.73:0/3997659601 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90ec197100 con 0x7f90ec105180 2023-08-10T11:45:19.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.037+0000 7f90e9ffb700 1 -- 172.21.15.73:0/3997659601 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f90e0003c30 con 0x7f90ec105180 2023-08-10T11:45:19.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.037+0000 7f90f2c35700 1 -- 172.21.15.73:0/3997659601 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90ec197340 con 0x7f90ec105180 2023-08-10T11:45:19.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.038+0000 7f90e9ffb700 1 --2- 172.21.15.73:0/3997659601 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f90dc0387b0 0x7f90dc03ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:19.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.038+0000 7f90e9ffb700 1 -- 172.21.15.73:0/3997659601 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f90e004c590 con 0x7f90ec105180 2023-08-10T11:45:19.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.038+0000 7f90ebfff700 1 --2- 172.21.15.73:0/3997659601 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f90dc0387b0 0x7f90dc03ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:19.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.038+0000 7f90ebfff700 1 --2- 172.21.15.73:0/3997659601 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f90dc0387b0 0x7f90dc03ac70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f90d8006fd0 tx=0x7f90d8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:45:19.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.042+0000 7f90e9ffb700 1 -- 172.21.15.73:0/3997659601 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f90e0029950 con 0x7f90ec105180 2023-08-10T11:45:19.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.234+0000 7f90f2c35700 1 -- 172.21.15.73:0/3997659601 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f90ec1044d0 con 0x7f90ec105180 2023-08-10T11:45:19.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.832+0000 7f90e9ffb700 1 -- 172.21.15.73:0/3997659601 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f90e0026020 con 0x7f90ec105180 2023-08-10T11:45:19.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.835+0000 7f90f2c35700 1 -- 172.21.15.73:0/3997659601 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f90dc0387b0 msgr2=0x7f90dc03ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.835+0000 7f90f2c35700 1 --2- 172.21.15.73:0/3997659601 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f90dc0387b0 0x7f90dc03ac70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f90d8006fd0 tx=0x7f90d8006e40 comp rx=0 tx=0).stop 2023-08-10T11:45:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.835+0000 7f90f2c35700 1 -- 172.21.15.73:0/3997659601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90ec105180 msgr2=0x7f90ec1964e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.835+0000 7f90f2c35700 1 --2- 172.21.15.73:0/3997659601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90ec105180 0x7f90ec1964e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f90e0004f40 tx=0x7f90e0005020 comp rx=0 tx=0).stop 2023-08-10T11:45:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.835+0000 7f90f2c35700 1 -- 172.21.15.73:0/3997659601 shutdown_connections 2023-08-10T11:45:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.835+0000 7f90f2c35700 1 --2- 172.21.15.73:0/3997659601 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f90dc0387b0 0x7f90dc03ac70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.835+0000 7f90f2c35700 1 --2- 172.21.15.73:0/3997659601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90ec105180 0x7f90ec1964e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.835+0000 7f90f2c35700 1 -- 172.21.15.73:0/3997659601 >> 172.21.15.73:0/3997659601 conn(0x7f90ec074c70 msgr2=0x7f90ec0fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:45:19.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.835+0000 7f90f2c35700 1 -- 172.21.15.73:0/3997659601 shutdown_connections 2023-08-10T11:45:19.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:19.835+0000 7f90f2c35700 1 -- 172.21.15.73:0/3997659601 wait complete. 2023-08-10T11:45:19.838 INFO:teuthology.orchestra.run.smithi073.stderr:adjusted tunables profile to default 2023-08-10T11:45:20.221 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:19 smithi073 ceph-mon[128869]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:20.221 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:19 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3997659601' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-08-10T11:45:20.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:19 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:20.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:19 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:20.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:19 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:20.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:19 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:20.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:19 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi156", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:45:20.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:19 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:20.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:19 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:45:20.279 INFO:tasks.cephadm:Adding mon.a on smithi073 2023-08-10T11:45:20.280 INFO:tasks.cephadm:Adding mon.b on smithi152 2023-08-10T11:45:20.280 INFO:tasks.cephadm:Adding mon.c on smithi156 2023-08-10T11:45:20.280 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph orch apply mon '3;smithi073:172.21.15.73=a;smithi152:172.21.15.152=b;smithi156:172.21.15.156=c' 2023-08-10T11:45:20.879 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T11:45:21.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:20 smithi073 ceph-mon[128869]: Updating smithi156:/etc/ceph/ceph.conf 2023-08-10T11:45:21.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:20 smithi073 ceph-mon[128869]: Updating smithi156:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T11:45:21.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:20 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3997659601' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-08-10T11:45:21.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:20 smithi073 ceph-mon[128869]: osdmap e4: 0 total, 0 up, 0 in 2023-08-10T11:45:21.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:20 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:21.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:20 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:21.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:20 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:22.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.187+0000 7f57de328700 1 -- 172.21.15.156:0/2097426106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57d8104870 msgr2=0x7f57d8104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:22.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.187+0000 7f57de328700 1 --2- 172.21.15.156:0/2097426106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57d8104870 0x7f57d8104c50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f57c800aa20 tx=0x7f57c800ad30 comp rx=0 tx=0).stop 2023-08-10T11:45:22.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.187+0000 7f57de328700 1 -- 172.21.15.156:0/2097426106 shutdown_connections 2023-08-10T11:45:22.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.187+0000 7f57de328700 1 --2- 172.21.15.156:0/2097426106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57d8104870 0x7f57d8104c50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:22.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.187+0000 7f57de328700 1 -- 172.21.15.156:0/2097426106 >> 172.21.15.156:0/2097426106 conn(0x7f57d80757d0 msgr2=0x7f57d8075be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:45:22.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.187+0000 7f57de328700 1 -- 172.21.15.156:0/2097426106 shutdown_connections 2023-08-10T11:45:22.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.187+0000 7f57de328700 1 -- 172.21.15.156:0/2097426106 wait complete. 2023-08-10T11:45:22.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.188+0000 7f57de328700 1 Processor -- start 2023-08-10T11:45:22.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.188+0000 7f57de328700 1 -- start start 2023-08-10T11:45:22.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.188+0000 7f57de328700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57d8104870 0x7f57d81956c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:22.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.188+0000 7f57de328700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d8195c00 con 0x7f57d8104870 2023-08-10T11:45:22.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.188+0000 7f57d7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57d8104870 0x7f57d81956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:22.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.188+0000 7f57d7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57d8104870 0x7f57d81956c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.156:46372/0 (socket says 172.21.15.156:46372) 2023-08-10T11:45:22.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.188+0000 7f57d7fff700 1 -- 172.21.15.156:0/151981678 learned_addr learned my addr 172.21.15.156:0/151981678 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-08-10T11:45:22.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.189+0000 7f57d7fff700 1 -- 172.21.15.156:0/151981678 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c800a700 con 0x7f57d8104870 2023-08-10T11:45:22.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.189+0000 7f57d7fff700 1 --2- 172.21.15.156:0/151981678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57d8104870 0x7f57d81956c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f57c800c6d0 tx=0x7f57c8004e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:45:22.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.189+0000 7f57d57fa700 1 -- 172.21.15.156:0/151981678 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57c801d070 con 0x7f57d8104870 2023-08-10T11:45:22.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.189+0000 7f57de328700 1 -- 172.21.15.156:0/151981678 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d8195e00 con 0x7f57d8104870 2023-08-10T11:45:22.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.189+0000 7f57d57fa700 1 -- 172.21.15.156:0/151981678 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f57c8016470 con 0x7f57d8104870 2023-08-10T11:45:22.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.189+0000 7f57d57fa700 1 -- 172.21.15.156:0/151981678 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57c800e5e0 con 0x7f57d8104870 2023-08-10T11:45:22.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.189+0000 7f57de328700 1 -- 172.21.15.156:0/151981678 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d8196280 con 0x7f57d8104870 2023-08-10T11:45:22.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.190+0000 7f57de328700 1 -- 172.21.15.156:0/151981678 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d8061da0 con 0x7f57d8104870 2023-08-10T11:45:22.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.190+0000 7f57d57fa700 1 -- 172.21.15.156:0/151981678 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f57c8005350 con 0x7f57d8104870 2023-08-10T11:45:22.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.190+0000 7f57d57fa700 1 --2- 172.21.15.156:0/151981678 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f57c40387b0 0x7f57c403ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:22.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.190+0000 7f57d57fa700 1 -- 172.21.15.156:0/151981678 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f57c8012070 con 0x7f57d8104870 2023-08-10T11:45:22.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.191+0000 7f57d77fe700 1 --2- 172.21.15.156:0/151981678 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f57c40387b0 0x7f57c403ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:22.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.191+0000 7f57d77fe700 1 --2- 172.21.15.156:0/151981678 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f57c40387b0 0x7f57c403ac70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f57c0006fd0 tx=0x7f57c0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:45:22.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.195+0000 7f57d57fa700 1 -- 172.21.15.156:0/151981678 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f57c8014370 con 0x7f57d8104870 2023-08-10T11:45:22.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:21 smithi073 ceph-mon[128869]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2023-08-10T11:45:22.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:21 smithi073 ceph-mon[128869]: Updating smithi156:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T11:45:22.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:21 smithi073 ceph-mon[128869]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:22.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.388+0000 7f57de328700 1 -- 172.21.15.156:0/151981678 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi073:172.21.15.73=a;smithi152:172.21.15.152=b;smithi156:172.21.15.156=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f57d80fdec0 con 0x7f57c40387b0 2023-08-10T11:45:22.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.395+0000 7f57d57fa700 1 -- 172.21.15.156:0/151981678 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f57d80fdec0 con 0x7f57c40387b0 2023-08-10T11:45:22.395 INFO:teuthology.orchestra.run.smithi156.stdout:Scheduled mon update... 2023-08-10T11:45:22.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.396+0000 7f57de328700 1 -- 172.21.15.156:0/151981678 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f57c40387b0 msgr2=0x7f57c403ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:22.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.396+0000 7f57de328700 1 --2- 172.21.15.156:0/151981678 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f57c40387b0 0x7f57c403ac70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f57c0006fd0 tx=0x7f57c0006e40 comp rx=0 tx=0).stop 2023-08-10T11:45:22.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.396+0000 7f57de328700 1 -- 172.21.15.156:0/151981678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57d8104870 msgr2=0x7f57d81956c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:22.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.396+0000 7f57de328700 1 --2- 172.21.15.156:0/151981678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57d8104870 0x7f57d81956c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f57c800c6d0 tx=0x7f57c8004e30 comp rx=0 tx=0).stop 2023-08-10T11:45:22.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.397+0000 7f57de328700 1 -- 172.21.15.156:0/151981678 shutdown_connections 2023-08-10T11:45:22.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.397+0000 7f57de328700 1 --2- 172.21.15.156:0/151981678 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f57c40387b0 0x7f57c403ac70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:22.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.397+0000 7f57de328700 1 --2- 172.21.15.156:0/151981678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57d8104870 0x7f57d81956c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:22.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.397+0000 7f57de328700 1 -- 172.21.15.156:0/151981678 >> 172.21.15.156:0/151981678 conn(0x7f57d80757d0 msgr2=0x7f57d80fd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:45:22.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.397+0000 7f57de328700 1 -- 172.21.15.156:0/151981678 shutdown_connections 2023-08-10T11:45:22.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:22.397+0000 7f57de328700 1 -- 172.21.15.156:0/151981678 wait complete. 2023-08-10T11:45:22.865 DEBUG:teuthology.orchestra.run.smithi152:mon.b> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@mon.b.service 2023-08-10T11:45:22.868 DEBUG:teuthology.orchestra.run.smithi156:mon.c> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@mon.c.service 2023-08-10T11:45:22.870 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-08-10T11:45:22.871 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph mon dump -f json 2023-08-10T11:45:22.899 INFO:journalctl@ceph.mon.c.smithi156.stdout:-- Logs begin at Thu 2023-08-10 11:15:12 UTC. -- 2023-08-10T11:45:22.904 INFO:journalctl@ceph.mon.b.smithi152.stdout:-- Logs begin at Thu 2023-08-10 11:15:14 UTC. -- 2023-08-10T11:45:23.748 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T11:45:23.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:23 smithi073 ceph-mon[128869]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi073:172.21.15.73=a;smithi152:172.21.15.152=b;smithi156:172.21.15.156=c", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:45:23.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:23 smithi073 ceph-mon[128869]: Saving service mon spec with placement smithi073:172.21.15.73=a;smithi152:172.21.15.152=b;smithi156:172.21.15.156=c;count:3 2023-08-10T11:45:23.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:23.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:23 smithi073 ceph-mon[128869]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:23.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:45:23.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:23.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:45:23.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:23.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T11:45:23.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:23.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:23 smithi073 ceph-mon[128869]: Deploying daemon mon.c on smithi156 2023-08-10T11:45:25.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:25 smithi073 ceph-mon[128869]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:25.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.813+0000 7f9c7b50f700 1 -- 172.21.15.156:0/1290032957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c74100450 msgr2=0x7f9c74100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:25.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.813+0000 7f9c7b50f700 1 --2- 172.21.15.156:0/1290032957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c74100450 0x7f9c74100830 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9c70009910 tx=0x7f9c70009c20 comp rx=0 tx=0).stop 2023-08-10T11:45:25.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.813+0000 7f9c7b50f700 1 -- 172.21.15.156:0/1290032957 shutdown_connections 2023-08-10T11:45:25.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.813+0000 7f9c7b50f700 1 --2- 172.21.15.156:0/1290032957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c74100450 0x7f9c74100830 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:25.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.813+0000 7f9c7b50f700 1 -- 172.21.15.156:0/1290032957 >> 172.21.15.156:0/1290032957 conn(0x7f9c740fbd00 msgr2=0x7f9c740fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:45:25.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.813+0000 7f9c7b50f700 1 -- 172.21.15.156:0/1290032957 shutdown_connections 2023-08-10T11:45:25.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.813+0000 7f9c7b50f700 1 -- 172.21.15.156:0/1290032957 wait complete. 2023-08-10T11:45:25.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.814+0000 7f9c7b50f700 1 Processor -- start 2023-08-10T11:45:25.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.814+0000 7f9c7b50f700 1 -- start start 2023-08-10T11:45:25.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.814+0000 7f9c7b50f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c74100450 0x7f9c741956c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:25.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.814+0000 7f9c7b50f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c74195c00 con 0x7f9c74100450 2023-08-10T11:45:25.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.814+0000 7f9c792ab700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c74100450 0x7f9c741956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:25.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.814+0000 7f9c792ab700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c74100450 0x7f9c741956c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.156:46378/0 (socket says 172.21.15.156:46378) 2023-08-10T11:45:25.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.814+0000 7f9c792ab700 1 -- 172.21.15.156:0/3875215643 learned_addr learned my addr 172.21.15.156:0/3875215643 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-08-10T11:45:25.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.815+0000 7f9c792ab700 1 -- 172.21.15.156:0/3875215643 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c700095f0 con 0x7f9c74100450 2023-08-10T11:45:25.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.815+0000 7f9c792ab700 1 --2- 172.21.15.156:0/3875215643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c74100450 0x7f9c741956c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9c70004f40 tx=0x7f9c70005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:45:25.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.815+0000 7f9c6a7fc700 1 -- 172.21.15.156:0/3875215643 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c7001d070 con 0x7f9c74100450 2023-08-10T11:45:25.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.815+0000 7f9c6a7fc700 1 -- 172.21.15.156:0/3875215643 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c70004370 con 0x7f9c74100450 2023-08-10T11:45:25.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.815+0000 7f9c7b50f700 1 -- 172.21.15.156:0/3875215643 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c74195e00 con 0x7f9c74100450 2023-08-10T11:45:25.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.815+0000 7f9c6a7fc700 1 -- 172.21.15.156:0/3875215643 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c700039b0 con 0x7f9c74100450 2023-08-10T11:45:25.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.815+0000 7f9c7b50f700 1 -- 172.21.15.156:0/3875215643 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c74196220 con 0x7f9c74100450 2023-08-10T11:45:25.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.816+0000 7f9c6a7fc700 1 -- 172.21.15.156:0/3875215643 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f9c70003c20 con 0x7f9c74100450 2023-08-10T11:45:25.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.816+0000 7f9c6a7fc700 1 --2- 172.21.15.156:0/3875215643 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9c60038800 0x7f9c6003acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:25.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.816+0000 7f9c7b50f700 1 -- 172.21.15.156:0/3875215643 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c74061da0 con 0x7f9c74100450 2023-08-10T11:45:25.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.817+0000 7f9c6a7fc700 1 -- 172.21.15.156:0/3875215643 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9c7004c750 con 0x7f9c74100450 2023-08-10T11:45:25.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.817+0000 7f9c78aaa700 1 --2- 172.21.15.156:0/3875215643 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9c60038800 0x7f9c6003acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:25.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.817+0000 7f9c78aaa700 1 --2- 172.21.15.156:0/3875215643 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9c60038800 0x7f9c6003acc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9c64006fd0 tx=0x7f9c64006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:45:25.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:25.822+0000 7f9c6a7fc700 1 -- 172.21.15.156:0/3875215643 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f9c70026070 con 0x7f9c74100450 2023-08-10T11:45:26.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:26.108+0000 7f9c7b50f700 1 -- 172.21.15.156:0/3875215643 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9c741081a0 con 0x7f9c74100450 2023-08-10T11:45:26.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:26.109+0000 7f9c6a7fc700 1 -- 172.21.15.156:0/3875215643 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+736 (secure 0 0 0) 0x7f9c7000f460 con 0x7f9c74100450 2023-08-10T11:45:26.112 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-08-10T11:45:26.112 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":1,"fsid":"0e619a74-3773-11ee-9b37-001a4aab830c","modified":"2023-08-10T11:43:51.690486Z","created":"2023-08-10T11:43:51.690486Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-08-10T11:45:26.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:26.111+0000 7f9c7b50f700 1 -- 172.21.15.156:0/3875215643 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9c60038800 msgr2=0x7f9c6003acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:26.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:26.111+0000 7f9c7b50f700 1 --2- 172.21.15.156:0/3875215643 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9c60038800 0x7f9c6003acc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9c64006fd0 tx=0x7f9c64006e40 comp rx=0 tx=0).stop 2023-08-10T11:45:26.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:26.111+0000 7f9c7b50f700 1 -- 172.21.15.156:0/3875215643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c74100450 msgr2=0x7f9c741956c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:26.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:26.111+0000 7f9c7b50f700 1 --2- 172.21.15.156:0/3875215643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c74100450 0x7f9c741956c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9c70004f40 tx=0x7f9c70005020 comp rx=0 tx=0).stop 2023-08-10T11:45:26.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:26.111+0000 7f9c7b50f700 1 -- 172.21.15.156:0/3875215643 shutdown_connections 2023-08-10T11:45:26.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:26.112+0000 7f9c7b50f700 1 --2- 172.21.15.156:0/3875215643 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9c60038800 0x7f9c6003acc0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:26.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:26.112+0000 7f9c7b50f700 1 --2- 172.21.15.156:0/3875215643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c74100450 0x7f9c741956c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:26.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:26.112+0000 7f9c7b50f700 1 -- 172.21.15.156:0/3875215643 >> 172.21.15.156:0/3875215643 conn(0x7f9c740fbd00 msgr2=0x7f9c741046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:45:26.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:26.112+0000 7f9c7b50f700 1 -- 172.21.15.156:0/3875215643 shutdown_connections 2023-08-10T11:45:26.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:26.112+0000 7f9c7b50f700 1 -- 172.21.15.156:0/3875215643 wait complete. 2023-08-10T11:45:26.115 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 1 2023-08-10T11:45:26.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:26 smithi156 ceph-mon[130574]: expand_channel_meta expanded map: {default=debug} 2023-08-10T11:45:26.710 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:26 smithi156 systemd[1]: Started Ceph mon.c for 0e619a74-3773-11ee-9b37-001a4aab830c. 2023-08-10T11:45:27.719 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-08-10T11:45:27.720 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph mon dump -f json 2023-08-10T11:45:28.285 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T11:45:31.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:31 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:45:31.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:31 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T11:45:31.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:31 smithi156 ceph-mon[130574]: mon.a calling monitor election 2023-08-10T11:45:31.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:31 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:45:31.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:31 smithi156 ceph-mon[130574]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:31.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:31 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:45:31.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:31 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:45:31.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:31 smithi156 ceph-mon[130574]: mon.c calling monitor election 2023-08-10T11:45:31.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:31 smithi156 ceph-mon[130574]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:31.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:31 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:45:31.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:31 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:45:31.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:31 smithi156 ceph-mon[130574]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:31.758 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:31 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:45:31.758 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:31 smithi156 ceph-mon[130574]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-08-10T11:45:31.758 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:31 smithi156 ceph-mon[130574]: monmap e2: 2 mons at {a=[v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0],c=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0]} removed_ranks: {} 2023-08-10T11:45:31.758 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:31 smithi156 ceph-mon[130574]: fsmap 2023-08-10T11:45:31.758 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:31 smithi156 ceph-mon[130574]: osdmap e4: 0 total, 0 up, 0 in 2023-08-10T11:45:31.758 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:31 smithi156 ceph-mon[130574]: mgrmap e13: x(active, since 42s) 2023-08-10T11:45:31.759 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:31 smithi156 ceph-mon[130574]: overall HEALTH_OK 2023-08-10T11:45:31.759 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:31 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:31.759 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:31 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:31.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:31 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:45:31.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:31 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T11:45:31.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:31 smithi073 ceph-mon[128869]: mon.a calling monitor election 2023-08-10T11:45:31.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:31 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:45:31.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:31 smithi073 ceph-mon[128869]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:31.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:31 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:45:31.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:31 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:45:31.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:31 smithi073 ceph-mon[128869]: mon.c calling monitor election 2023-08-10T11:45:31.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:31 smithi073 ceph-mon[128869]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:31.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:31 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:45:31.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:31 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:45:31.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:31 smithi073 ceph-mon[128869]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:31.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:31 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:45:31.770 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:31 smithi073 ceph-mon[128869]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-08-10T11:45:31.770 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:31 smithi073 ceph-mon[128869]: monmap e2: 2 mons at {a=[v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0],c=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0]} removed_ranks: {} 2023-08-10T11:45:31.770 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:31 smithi073 ceph-mon[128869]: fsmap 2023-08-10T11:45:31.770 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:31 smithi073 ceph-mon[128869]: osdmap e4: 0 total, 0 up, 0 in 2023-08-10T11:45:31.770 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:31 smithi073 ceph-mon[128869]: mgrmap e13: x(active, since 42s) 2023-08-10T11:45:31.770 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:31 smithi073 ceph-mon[128869]: overall HEALTH_OK 2023-08-10T11:45:31.770 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:31 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:31.770 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:31 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:32.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.581+0000 7efff752c700 1 -- 172.21.15.156:0/2753586047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effdc0035c0 msgr2=0x7effdc005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:32.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.581+0000 7efff752c700 1 --2- 172.21.15.156:0/2753586047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effdc0035c0 0x7effdc005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efff0100250 tx=0x7effe000feb0 comp rx=0 tx=0).stop 2023-08-10T11:45:32.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.581+0000 7efff752c700 1 -- 172.21.15.156:0/2753586047 shutdown_connections 2023-08-10T11:45:32.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.581+0000 7efff752c700 1 --2- 172.21.15.156:0/2753586047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effdc0035c0 0x7effdc005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:32.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.581+0000 7efff752c700 1 -- 172.21.15.156:0/2753586047 >> 172.21.15.156:0/2753586047 conn(0x7efff00fbe10 msgr2=0x7efff00fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:45:32.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.581+0000 7efff752c700 1 -- 172.21.15.156:0/2753586047 shutdown_connections 2023-08-10T11:45:32.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.581+0000 7efff752c700 1 -- 172.21.15.156:0/2753586047 wait complete. 2023-08-10T11:45:32.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.582+0000 7efff752c700 1 Processor -- start 2023-08-10T11:45:32.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.582+0000 7efff752c700 1 -- start start 2023-08-10T11:45:32.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.582+0000 7efff752c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effdc0035c0 0x7efff019b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:32.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.582+0000 7efff752c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efff019bb80 0x7efff01956c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:32.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.582+0000 7efff752c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff019c110 con 0x7effdc0035c0 2023-08-10T11:45:32.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.582+0000 7efff752c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff0195c00 con 0x7efff019bb80 2023-08-10T11:45:32.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.582+0000 7efff4ac7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efff019bb80 0x7efff01956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:32.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.582+0000 7efff4ac7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efff019bb80 0x7efff01956c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36642/0 (socket says 172.21.15.156:36642) 2023-08-10T11:45:32.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.582+0000 7efff4ac7700 1 -- 172.21.15.156:0/1410270556 learned_addr learned my addr 172.21.15.156:0/1410270556 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-08-10T11:45:32.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.583+0000 7efff4ac7700 1 -- 172.21.15.156:0/1410270556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efff019bb80 msgr2=0x7efff01956c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-08-10T11:45:32.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.583+0000 7efff4ac7700 1 -- 172.21.15.156:0/1410270556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efff019bb80 msgr2=0x7efff01956c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-08-10T11:45:32.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.583+0000 7efff4ac7700 1 --2- 172.21.15.156:0/1410270556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efff019bb80 0x7efff01956c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-10T11:45:32.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.583+0000 7efff52c8700 1 --2- 172.21.15.156:0/1410270556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effdc0035c0 0x7efff019b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:32.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.583+0000 7efff4ac7700 1 --2- 172.21.15.156:0/1410270556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efff019bb80 0x7efff01956c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-10T11:45:32.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.583+0000 7efff52c8700 1 -- 172.21.15.156:0/1410270556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efff019bb80 msgr2=0x7efff01956c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T11:45:32.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.583+0000 7efff52c8700 1 --2- 172.21.15.156:0/1410270556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efff019bb80 0x7efff01956c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:32.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.583+0000 7efff52c8700 1 -- 172.21.15.156:0/1410270556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe000f900 con 0x7effdc0035c0 2023-08-10T11:45:32.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.583+0000 7efff52c8700 1 --2- 172.21.15.156:0/1410270556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effdc0035c0 0x7efff019b640 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7effe000f800 tx=0x7effe00047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:45:32.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.584+0000 7effe67fc700 1 -- 172.21.15.156:0/1410270556 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7effe0013b00 con 0x7effdc0035c0 2023-08-10T11:45:32.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.584+0000 7efff752c700 1 -- 172.21.15.156:0/1410270556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff0195e20 con 0x7effdc0035c0 2023-08-10T11:45:32.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.584+0000 7effe67fc700 1 -- 172.21.15.156:0/1410270556 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7effe00044f0 con 0x7effdc0035c0 2023-08-10T11:45:32.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.584+0000 7effe67fc700 1 -- 172.21.15.156:0/1410270556 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7effe0003d00 con 0x7effdc0035c0 2023-08-10T11:45:32.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.584+0000 7efff752c700 1 -- 172.21.15.156:0/1410270556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff0196370 con 0x7effdc0035c0 2023-08-10T11:45:32.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.585+0000 7effe67fc700 1 -- 172.21.15.156:0/1410270556 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7effe0011470 con 0x7effdc0035c0 2023-08-10T11:45:32.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.585+0000 7effe67fc700 1 --2- 172.21.15.156:0/1410270556 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7effd40385f0 0x7effd403aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:32.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.585+0000 7effe67fc700 1 -- 172.21.15.156:0/1410270556 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7effe0013df0 con 0x7effdc0035c0 2023-08-10T11:45:32.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.585+0000 7efff752c700 1 -- 172.21.15.156:0/1410270556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff0061da0 con 0x7effdc0035c0 2023-08-10T11:45:32.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.585+0000 7efff4ac7700 1 --2- 172.21.15.156:0/1410270556 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7effd40385f0 0x7effd403aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:32.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.586+0000 7efff4ac7700 1 --2- 172.21.15.156:0/1410270556 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7effd40385f0 0x7effd403aab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7effec009180 tx=0x7effec008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:45:32.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.591+0000 7effe67fc700 1 -- 172.21.15.156:0/1410270556 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7effe00109c0 con 0x7effdc0035c0 2023-08-10T11:45:32.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:32 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:32.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:32 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T11:45:32.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:32 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:32.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:32 smithi156 ceph-mon[130574]: Deploying daemon mon.b on smithi152 2023-08-10T11:45:32.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:32 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:45:32.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:32 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:32.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:32 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T11:45:32.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:32 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:32.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:32 smithi073 ceph-mon[128869]: Deploying daemon mon.b on smithi152 2023-08-10T11:45:32.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:32 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:45:32.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.854+0000 7efff752c700 1 -- 172.21.15.156:0/1410270556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7efff0196cd0 con 0x7effdc0035c0 2023-08-10T11:45:32.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.855+0000 7effe67fc700 1 -- 172.21.15.156:0/1410270556 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1006 (secure 0 0 0) 0x7effe004c030 con 0x7effdc0035c0 2023-08-10T11:45:32.857 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-08-10T11:45:32.857 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":2,"fsid":"0e619a74-3773-11ee-9b37-001a4aab830c","modified":"2023-08-10T11:45:26.219885Z","created":"2023-08-10T11:43:51.690486Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:3300","nonce":0},{"type":"v1","addr":"172.21.15.156:6789","nonce":0}]},"addr":"172.21.15.156:6789/0","public_addr":"172.21.15.156:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-08-10T11:45:32.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.857+0000 7efff752c700 1 -- 172.21.15.156:0/1410270556 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7effd40385f0 msgr2=0x7effd403aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:32.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.857+0000 7efff752c700 1 --2- 172.21.15.156:0/1410270556 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7effd40385f0 0x7effd403aab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7effec009180 tx=0x7effec008040 comp rx=0 tx=0).stop 2023-08-10T11:45:32.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.857+0000 7efff752c700 1 -- 172.21.15.156:0/1410270556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effdc0035c0 msgr2=0x7efff019b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:32.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.857+0000 7efff752c700 1 --2- 172.21.15.156:0/1410270556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effdc0035c0 0x7efff019b640 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7effe000f800 tx=0x7effe00047a0 comp rx=0 tx=0).stop 2023-08-10T11:45:32.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.857+0000 7efff752c700 1 -- 172.21.15.156:0/1410270556 shutdown_connections 2023-08-10T11:45:32.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.857+0000 7efff752c700 1 --2- 172.21.15.156:0/1410270556 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7effd40385f0 0x7effd403aab0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:32.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.857+0000 7efff752c700 1 --2- 172.21.15.156:0/1410270556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effdc0035c0 0x7efff019b640 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:32.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.857+0000 7efff752c700 1 --2- 172.21.15.156:0/1410270556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efff019bb80 0x7efff01956c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:32.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.857+0000 7efff752c700 1 -- 172.21.15.156:0/1410270556 >> 172.21.15.156:0/1410270556 conn(0x7efff00fbe10 msgr2=0x7efff00fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:45:32.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.857+0000 7efff752c700 1 -- 172.21.15.156:0/1410270556 shutdown_connections 2023-08-10T11:45:32.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:32.857+0000 7efff752c700 1 -- 172.21.15.156:0/1410270556 wait complete. 2023-08-10T11:45:32.861 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 2 2023-08-10T11:45:33.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:33 smithi156 ceph-mon[130574]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:33.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:33 smithi156 ceph-mon[130574]: from='client.? 172.21.15.156:0/1410270556' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-08-10T11:45:33.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:33 smithi073 ceph-mon[128869]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:33.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:33 smithi073 ceph-mon[128869]: from='client.? 172.21.15.156:0/1410270556' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-08-10T11:45:34.207 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:33 smithi152 systemd[1]: Starting Ceph mon.b for 0e619a74-3773-11ee-9b37-001a4aab830c... 2023-08-10T11:45:34.235 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-08-10T11:45:34.236 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph mon dump -f json 2023-08-10T11:45:34.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 podman[130180]: 2023-08-10T11:45:34.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: set uid:gid to 167:167 (ceph:ceph) 2023-08-10T11:45:34.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: ceph version 18.0.0-5118-ga8bf445f (a8bf445f2d27d8e12e060dff0fd151d481b5290b) reef (dev), process ceph-mon, pid 7 2023-08-10T11:45:34.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: pidfile_write: ignore empty --pid-file 2023-08-10T11:45:34.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 bash[130180]: 7703f321492c43ecbdc1bb3b70929f3c80b05e01bfc8529e22ff4dda0b73fa1f 2023-08-10T11:45:34.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: load: jerasure load: lrc 2023-08-10T11:45:34.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: RocksDB version: 7.9.2 2023-08-10T11:45:34.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Git sha 0 2023-08-10T11:45:34.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Compile date 2023-08-03 13:43:35 2023-08-10T11:45:34.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: DB SUMMARY 2023-08-10T11:45:34.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: DB Session ID: S4OAKL7GT8CLSAMGKUQ5 2023-08-10T11:45:34.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: CURRENT file: CURRENT 2023-08-10T11:45:34.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: IDENTITY file: IDENTITY 2023-08-10T11:45:34.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-08-10T11:45:34.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-08-10T11:45:34.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-08-10T11:45:34.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.error_if_exists: 0 2023-08-10T11:45:34.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.create_if_missing: 0 2023-08-10T11:45:34.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.paranoid_checks: 1 2023-08-10T11:45:34.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.flush_verify_memtable_count: 1 2023-08-10T11:45:34.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-08-10T11:45:34.499 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-08-10T11:45:34.499 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.env: 0x557c27b3fc60 2023-08-10T11:45:34.499 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.fs: PosixFileSystem 2023-08-10T11:45:34.499 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.info_log: 0x557c294352c0 2023-08-10T11:45:34.499 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.max_file_opening_threads: 16 2023-08-10T11:45:34.499 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.statistics: (nil) 2023-08-10T11:45:34.499 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.use_fsync: 0 2023-08-10T11:45:34.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.max_log_file_size: 0 2023-08-10T11:45:34.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-08-10T11:45:34.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.log_file_time_to_roll: 0 2023-08-10T11:45:34.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.keep_log_file_num: 1000 2023-08-10T11:45:34.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.recycle_log_file_num: 0 2023-08-10T11:45:34.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.allow_fallocate: 1 2023-08-10T11:45:34.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.allow_mmap_reads: 0 2023-08-10T11:45:34.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.allow_mmap_writes: 0 2023-08-10T11:45:34.501 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.use_direct_reads: 0 2023-08-10T11:45:34.501 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-08-10T11:45:34.501 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.create_missing_column_families: 0 2023-08-10T11:45:34.501 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.db_log_dir: 2023-08-10T11:45:34.501 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.wal_dir: 2023-08-10T11:45:34.501 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.table_cache_numshardbits: 6 2023-08-10T11:45:34.501 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.WAL_ttl_seconds: 0 2023-08-10T11:45:34.501 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.WAL_size_limit_MB: 0 2023-08-10T11:45:34.502 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-08-10T11:45:34.502 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-08-10T11:45:34.502 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.is_fd_close_on_exec: 1 2023-08-10T11:45:34.502 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.advise_random_on_open: 1 2023-08-10T11:45:34.502 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.db_write_buffer_size: 0 2023-08-10T11:45:34.502 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.write_buffer_manager: 0x557c293563c0 2023-08-10T11:45:34.502 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-08-10T11:45:34.503 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-08-10T11:45:34.503 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.use_adaptive_mutex: 0 2023-08-10T11:45:34.503 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.rate_limiter: (nil) 2023-08-10T11:45:34.503 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-08-10T11:45:34.503 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.wal_recovery_mode: 2 2023-08-10T11:45:34.503 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.enable_thread_tracking: 0 2023-08-10T11:45:34.503 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.enable_pipelined_write: 0 2023-08-10T11:45:34.503 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.unordered_write: 0 2023-08-10T11:45:34.504 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-08-10T11:45:34.504 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-08-10T11:45:34.504 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-08-10T11:45:34.504 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-08-10T11:45:34.504 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.row_cache: None 2023-08-10T11:45:34.504 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.wal_filter: None 2023-08-10T11:45:34.504 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-08-10T11:45:34.504 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.allow_ingest_behind: 0 2023-08-10T11:45:34.505 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.two_write_queues: 0 2023-08-10T11:45:34.505 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.manual_wal_flush: 0 2023-08-10T11:45:34.505 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.wal_compression: 0 2023-08-10T11:45:34.505 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.atomic_flush: 0 2023-08-10T11:45:34.505 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-08-10T11:45:34.505 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.persist_stats_to_disk: 0 2023-08-10T11:45:34.505 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.write_dbid_to_manifest: 0 2023-08-10T11:45:34.506 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.log_readahead_size: 0 2023-08-10T11:45:34.506 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-08-10T11:45:34.506 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.best_efforts_recovery: 0 2023-08-10T11:45:34.506 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-08-10T11:45:34.506 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-08-10T11:45:34.507 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.allow_data_in_errors: 0 2023-08-10T11:45:34.508 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.db_host_id: __hostname__ 2023-08-10T11:45:34.508 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.enforce_single_del_contracts: true 2023-08-10T11:45:34.508 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.max_background_jobs: 2 2023-08-10T11:45:34.508 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.max_background_compactions: -1 2023-08-10T11:45:34.508 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.max_subcompactions: 1 2023-08-10T11:45:34.508 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-08-10T11:45:34.508 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-08-10T11:45:34.509 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.delayed_write_rate : 16777216 2023-08-10T11:45:34.509 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.max_total_wal_size: 0 2023-08-10T11:45:34.509 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-08-10T11:45:34.509 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.stats_dump_period_sec: 600 2023-08-10T11:45:34.509 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.stats_persist_period_sec: 600 2023-08-10T11:45:34.509 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-08-10T11:45:34.509 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.max_open_files: -1 2023-08-10T11:45:34.509 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.bytes_per_sync: 0 2023-08-10T11:45:34.510 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.wal_bytes_per_sync: 0 2023-08-10T11:45:34.510 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.strict_bytes_per_sync: 0 2023-08-10T11:45:34.510 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.compaction_readahead_size: 0 2023-08-10T11:45:34.510 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.max_background_flushes: -1 2023-08-10T11:45:34.510 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Compression algorithms supported: 2023-08-10T11:45:34.510 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-08-10T11:45:34.510 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: kZSTD supported: 0 2023-08-10T11:45:34.510 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: kXpressCompression supported: 0 2023-08-10T11:45:34.511 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: kLZ4HCCompression supported: 1 2023-08-10T11:45:34.511 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: kZlibCompression supported: 1 2023-08-10T11:45:34.511 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: kSnappyCompression supported: 1 2023-08-10T11:45:34.511 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: kLZ4Compression supported: 1 2023-08-10T11:45:34.511 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: kBZip2Compression supported: 0 2023-08-10T11:45:34.511 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Fast CRC32 supported: Supported on x86 2023-08-10T11:45:34.511 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: DMutex implementation: pthread_mutex_t 2023-08-10T11:45:34.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-08-10T11:45:34.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-08-10T11:45:34.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-08-10T11:45:34.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.merge_operator: 2023-08-10T11:45:34.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.compaction_filter: None 2023-08-10T11:45:34.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.compaction_filter_factory: None 2023-08-10T11:45:34.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.sst_partitioner_factory: None 2023-08-10T11:45:34.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.memtable_factory: SkipListFactory 2023-08-10T11:45:34.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.table_factory: BlockBasedTable 2023-08-10T11:45:34.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557c294353c0) 2023-08-10T11:45:34.513 INFO:journalctl@ceph.mon.b.smithi152.stdout: cache_index_and_filter_blocks: 1 2023-08-10T11:45:34.513 INFO:journalctl@ceph.mon.b.smithi152.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-08-10T11:45:34.513 INFO:journalctl@ceph.mon.b.smithi152.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-08-10T11:45:34.513 INFO:journalctl@ceph.mon.b.smithi152.stdout: pin_top_level_index_and_filter: 1 2023-08-10T11:45:34.513 INFO:journalctl@ceph.mon.b.smithi152.stdout: index_type: 0 2023-08-10T11:45:34.513 INFO:journalctl@ceph.mon.b.smithi152.stdout: data_block_index_type: 0 2023-08-10T11:45:34.514 INFO:journalctl@ceph.mon.b.smithi152.stdout: index_shortening: 1 2023-08-10T11:45:34.514 INFO:journalctl@ceph.mon.b.smithi152.stdout: data_block_hash_table_util_ratio: 0.750000 2023-08-10T11:45:34.514 INFO:journalctl@ceph.mon.b.smithi152.stdout: checksum: 4 2023-08-10T11:45:34.514 INFO:journalctl@ceph.mon.b.smithi152.stdout: no_block_cache: 0 2023-08-10T11:45:34.514 INFO:journalctl@ceph.mon.b.smithi152.stdout: block_cache: 0x557c293f51f0 2023-08-10T11:45:34.514 INFO:journalctl@ceph.mon.b.smithi152.stdout: block_cache_name: BinnedLRUCache 2023-08-10T11:45:34.514 INFO:journalctl@ceph.mon.b.smithi152.stdout: block_cache_options: 2023-08-10T11:45:34.514 INFO:journalctl@ceph.mon.b.smithi152.stdout: capacity : 536870912 2023-08-10T11:45:34.515 INFO:journalctl@ceph.mon.b.smithi152.stdout: num_shard_bits : 4 2023-08-10T11:45:34.515 INFO:journalctl@ceph.mon.b.smithi152.stdout: strict_capacity_limit : 0 2023-08-10T11:45:34.515 INFO:journalctl@ceph.mon.b.smithi152.stdout: high_pri_pool_ratio: 0.000 2023-08-10T11:45:34.515 INFO:journalctl@ceph.mon.b.smithi152.stdout: block_cache_compressed: (nil) 2023-08-10T11:45:34.515 INFO:journalctl@ceph.mon.b.smithi152.stdout: persistent_cache: (nil) 2023-08-10T11:45:34.515 INFO:journalctl@ceph.mon.b.smithi152.stdout: block_size: 4096 2023-08-10T11:45:34.515 INFO:journalctl@ceph.mon.b.smithi152.stdout: block_size_deviation: 10 2023-08-10T11:45:34.515 INFO:journalctl@ceph.mon.b.smithi152.stdout: block_restart_interval: 16 2023-08-10T11:45:34.516 INFO:journalctl@ceph.mon.b.smithi152.stdout: index_block_restart_interval: 1 2023-08-10T11:45:34.516 INFO:journalctl@ceph.mon.b.smithi152.stdout: metadata_block_size: 4096 2023-08-10T11:45:34.516 INFO:journalctl@ceph.mon.b.smithi152.stdout: partition_filters: 0 2023-08-10T11:45:34.516 INFO:journalctl@ceph.mon.b.smithi152.stdout: use_delta_encoding: 1 2023-08-10T11:45:34.516 INFO:journalctl@ceph.mon.b.smithi152.stdout: filter_policy: bloomfilter 2023-08-10T11:45:34.516 INFO:journalctl@ceph.mon.b.smithi152.stdout: whole_key_filtering: 1 2023-08-10T11:45:34.516 INFO:journalctl@ceph.mon.b.smithi152.stdout: verify_compression: 0 2023-08-10T11:45:34.517 INFO:journalctl@ceph.mon.b.smithi152.stdout: read_amp_bytes_per_bit: 0 2023-08-10T11:45:34.517 INFO:journalctl@ceph.mon.b.smithi152.stdout: format_version: 5 2023-08-10T11:45:34.517 INFO:journalctl@ceph.mon.b.smithi152.stdout: enable_index_compression: 1 2023-08-10T11:45:34.517 INFO:journalctl@ceph.mon.b.smithi152.stdout: block_align: 0 2023-08-10T11:45:34.517 INFO:journalctl@ceph.mon.b.smithi152.stdout: max_auto_readahead_size: 262144 2023-08-10T11:45:34.517 INFO:journalctl@ceph.mon.b.smithi152.stdout: prepopulate_block_cache: 0 2023-08-10T11:45:34.517 INFO:journalctl@ceph.mon.b.smithi152.stdout: initial_auto_readahead_size: 8192 2023-08-10T11:45:34.517 INFO:journalctl@ceph.mon.b.smithi152.stdout: num_file_reads_for_auto_readahead: 2 2023-08-10T11:45:34.518 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.write_buffer_size: 33554432 2023-08-10T11:45:34.518 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.max_write_buffer_number: 2 2023-08-10T11:45:34.518 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.compression: NoCompression 2023-08-10T11:45:34.518 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.bottommost_compression: Disabled 2023-08-10T11:45:34.518 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.prefix_extractor: nullptr 2023-08-10T11:45:34.518 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-08-10T11:45:34.518 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.num_levels: 7 2023-08-10T11:45:34.518 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-08-10T11:45:34.519 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-08-10T11:45:34.519 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-08-10T11:45:34.519 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-08-10T11:45:34.519 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-08-10T11:45:34.519 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-08-10T11:45:34.519 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-08-10T11:45:34.519 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-08-10T11:45:34.519 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-08-10T11:45:34.520 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-08-10T11:45:34.520 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-08-10T11:45:34.520 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-08-10T11:45:34.520 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.compression_opts.window_bits: -14 2023-08-10T11:45:34.520 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.compression_opts.level: 32767 2023-08-10T11:45:34.520 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.compression_opts.strategy: 0 2023-08-10T11:45:34.520 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-08-10T11:45:34.521 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-08-10T11:45:34.521 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-08-10T11:45:34.521 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-08-10T11:45:34.521 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.compression_opts.enabled: false 2023-08-10T11:45:34.521 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-08-10T11:45:34.521 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-08-10T11:45:34.521 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-08-10T11:45:34.521 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-08-10T11:45:34.522 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.target_file_size_base: 67108864 2023-08-10T11:45:34.522 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.target_file_size_multiplier: 1 2023-08-10T11:45:34.522 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-08-10T11:45:34.522 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-08-10T11:45:34.522 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-08-10T11:45:34.522 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-08-10T11:45:34.522 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-08-10T11:45:34.522 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-08-10T11:45:34.523 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-08-10T11:45:34.523 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-08-10T11:45:34.523 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-08-10T11:45:34.523 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-08-10T11:45:34.523 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-08-10T11:45:34.523 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-08-10T11:45:34.523 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-08-10T11:45:34.523 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.arena_block_size: 1048576 2023-08-10T11:45:34.524 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-08-10T11:45:34.524 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-08-10T11:45:34.524 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.disable_auto_compactions: 0 2023-08-10T11:45:34.524 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-08-10T11:45:34.524 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-08-10T11:45:34.524 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-08-10T11:45:34.524 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-08-10T11:45:34.524 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-08-10T11:45:34.525 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-08-10T11:45:34.525 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-08-10T11:45:34.525 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-08-10T11:45:34.525 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-08-10T11:45:34.525 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-08-10T11:45:34.525 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.table_properties_collectors: 2023-08-10T11:45:34.525 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.inplace_update_support: 0 2023-08-10T11:45:34.525 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.inplace_update_num_locks: 10000 2023-08-10T11:45:34.526 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-08-10T11:45:34.526 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-08-10T11:45:34.526 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.memtable_huge_page_size: 0 2023-08-10T11:45:34.526 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.bloom_locality: 0 2023-08-10T11:45:34.526 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.max_successive_merges: 0 2023-08-10T11:45:34.526 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.optimize_filters_for_hits: 0 2023-08-10T11:45:34.526 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.paranoid_file_checks: 0 2023-08-10T11:45:34.526 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.force_consistency_checks: 1 2023-08-10T11:45:34.527 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.report_bg_io_stats: 0 2023-08-10T11:45:34.527 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.ttl: 2592000 2023-08-10T11:45:34.527 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.periodic_compaction_seconds: 0 2023-08-10T11:45:34.527 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-08-10T11:45:34.527 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-08-10T11:45:34.527 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.enable_blob_files: false 2023-08-10T11:45:34.527 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.min_blob_size: 0 2023-08-10T11:45:34.527 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.blob_file_size: 268435456 2023-08-10T11:45:34.528 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.blob_compression_type: NoCompression 2023-08-10T11:45:34.528 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.enable_blob_garbage_collection: false 2023-08-10T11:45:34.528 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-08-10T11:45:34.528 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-08-10T11:45:34.528 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-08-10T11:45:34.528 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.blob_file_starting_level: 0 2023-08-10T11:45:34.528 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-08-10T11:45:34.529 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-08-10T11:45:34.529 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-08-10T11:45:34.529 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 6fb14989-5357-458b-812e-1b6b261696f2 2023-08-10T11:45:34.529 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: EVENT_LOG_v1 {"time_micros": 1691667934401230, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-08-10T11:45:34.529 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-08-10T11:45:34.529 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: EVENT_LOG_v1 {"time_micros": 1691667934401645, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1691667934, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "6fb14989-5357-458b-812e-1b6b261696f2", "db_session_id": "S4OAKL7GT8CLSAMGKUQ5", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-08-10T11:45:34.529 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: EVENT_LOG_v1 {"time_micros": 1691667934401711, "job": 1, "event": "recovery_finished"} 2023-08-10T11:45:34.530 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-08-10T11:45:34.530 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-08-10T11:45:34.530 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x557c2948e000 2023-08-10T11:45:34.530 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: DB pointer 0x557c2947a000 2023-08-10T11:45:34.530 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-08-10T11:45:34.530 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-08-10T11:45:34.530 INFO:journalctl@ceph.mon.b.smithi152.stdout: ** DB Stats ** 2023-08-10T11:45:34.530 INFO:journalctl@ceph.mon.b.smithi152.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-08-10T11:45:34.531 INFO:journalctl@ceph.mon.b.smithi152.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-08-10T11:45:34.531 INFO:journalctl@ceph.mon.b.smithi152.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-08-10T11:45:34.531 INFO:journalctl@ceph.mon.b.smithi152.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-08-10T11:45:34.531 INFO:journalctl@ceph.mon.b.smithi152.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-08-10T11:45:34.531 INFO:journalctl@ceph.mon.b.smithi152.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-08-10T11:45:34.531 INFO:journalctl@ceph.mon.b.smithi152.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-08-10T11:45:34.531 INFO:journalctl@ceph.mon.b.smithi152.stdout: 2023-08-10T11:45:34.531 INFO:journalctl@ceph.mon.b.smithi152.stdout: ** Compaction Stats [default] ** 2023-08-10T11:45:34.532 INFO:journalctl@ceph.mon.b.smithi152.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-08-10T11:45:34.532 INFO:journalctl@ceph.mon.b.smithi152.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-08-10T11:45:34.532 INFO:journalctl@ceph.mon.b.smithi152.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-08-10T11:45:34.532 INFO:journalctl@ceph.mon.b.smithi152.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-08-10T11:45:34.532 INFO:journalctl@ceph.mon.b.smithi152.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-08-10T11:45:34.532 INFO:journalctl@ceph.mon.b.smithi152.stdout: 2023-08-10T11:45:34.532 INFO:journalctl@ceph.mon.b.smithi152.stdout: ** Compaction Stats [default] ** 2023-08-10T11:45:34.532 INFO:journalctl@ceph.mon.b.smithi152.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-08-10T11:45:34.533 INFO:journalctl@ceph.mon.b.smithi152.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-08-10T11:45:34.533 INFO:journalctl@ceph.mon.b.smithi152.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-08-10T11:45:34.533 INFO:journalctl@ceph.mon.b.smithi152.stdout: 2023-08-10T11:45:34.533 INFO:journalctl@ceph.mon.b.smithi152.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-08-10T11:45:34.533 INFO:journalctl@ceph.mon.b.smithi152.stdout: 2023-08-10T11:45:34.533 INFO:journalctl@ceph.mon.b.smithi152.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-08-10T11:45:34.533 INFO:journalctl@ceph.mon.b.smithi152.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-08-10T11:45:34.534 INFO:journalctl@ceph.mon.b.smithi152.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-08-10T11:45:34.534 INFO:journalctl@ceph.mon.b.smithi152.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-08-10T11:45:34.534 INFO:journalctl@ceph.mon.b.smithi152.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-08-10T11:45:34.534 INFO:journalctl@ceph.mon.b.smithi152.stdout: AddFile(Keys): cumulative 0, interval 0 2023-08-10T11:45:34.534 INFO:journalctl@ceph.mon.b.smithi152.stdout: Cumulative compaction: 0.00 GB write, 0.68 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-08-10T11:45:34.534 INFO:journalctl@ceph.mon.b.smithi152.stdout: Interval compaction: 0.00 GB write, 0.68 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-08-10T11:45:34.534 INFO:journalctl@ceph.mon.b.smithi152.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-08-10T11:45:34.534 INFO:journalctl@ceph.mon.b.smithi152.stdout: Block cache BinnedLRUCache@0x557c293f51f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-08-10T11:45:34.535 INFO:journalctl@ceph.mon.b.smithi152.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-08-10T11:45:34.535 INFO:journalctl@ceph.mon.b.smithi152.stdout: 2023-08-10T11:45:34.535 INFO:journalctl@ceph.mon.b.smithi152.stdout: ** File Read Latency Histogram By Level [default] ** 2023-08-10T11:45:34.535 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-08-10T11:45:34.535 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: using public_addr v2:172.21.15.152:0/0 -> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2023-08-10T11:45:34.535 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: starting mon.b rank -1 at public addrs [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] at bind addrs [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 0e619a74-3773-11ee-9b37-001a4aab830c 2023-08-10T11:45:34.535 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: mon.b@-1(???) e0 preinit fsid 0e619a74-3773-11ee-9b37-001a4aab830c 2023-08-10T11:45:34.535 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: mon.b@-1(synchronizing).mds e1 new map 2023-08-10T11:45:34.536 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: mon.b@-1(synchronizing).mds e1 print_map 2023-08-10T11:45:34.536 INFO:journalctl@ceph.mon.b.smithi152.stdout: e1 2023-08-10T11:45:34.536 INFO:journalctl@ceph.mon.b.smithi152.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-08-10T11:45:34.536 INFO:journalctl@ceph.mon.b.smithi152.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-08-10T11:45:34.536 INFO:journalctl@ceph.mon.b.smithi152.stdout: legacy client fscid: -1 2023-08-10T11:45:34.536 INFO:journalctl@ceph.mon.b.smithi152.stdout: 2023-08-10T11:45:34.536 INFO:journalctl@ceph.mon.b.smithi152.stdout: No filesystems configured 2023-08-10T11:45:34.537 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-08-10T11:45:34.537 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-08-10T11:45:34.537 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-08-10T11:45:34.537 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-08-10T11:45:34.537 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-08-10T11:45:34.537 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-08-10T11:45:34.537 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-08-10T11:45:34.537 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-08-10T11:45:34.538 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-08-10T11:45:34.538 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-08-10T11:45:34.538 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:34.538 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: Added host smithi156 2023-08-10T11:45:34.538 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:34.538 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:34.538 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:34.538 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T11:45:34.539 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:34.539 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3997659601' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-08-10T11:45:34.539 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:34.539 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:34.539 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:34.539 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:34.539 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi156", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:45:34.539 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:34.540 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:45:34.540 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: Updating smithi156:/etc/ceph/ceph.conf 2023-08-10T11:45:34.540 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: Updating smithi156:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T11:45:34.540 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3997659601' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-08-10T11:45:34.540 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: osdmap e4: 0 total, 0 up, 0 in 2023-08-10T11:45:34.540 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:34.540 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:34.540 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:34.541 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2023-08-10T11:45:34.541 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: Updating smithi156:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T11:45:34.541 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:34.541 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi073:172.21.15.73=a;smithi152:172.21.15.152=b;smithi156:172.21.15.156=c", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:45:34.541 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: Saving service mon spec with placement smithi073:172.21.15.73=a;smithi152:172.21.15.152=b;smithi156:172.21.15.156=c;count:3 2023-08-10T11:45:34.541 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:34.541 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:34.542 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:45:34.542 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:34.542 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:45:34.542 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:34.542 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T11:45:34.542 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:34.542 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: Deploying daemon mon.c on smithi156 2023-08-10T11:45:34.542 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:34.543 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:45:34.543 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T11:45:34.543 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: mon.a calling monitor election 2023-08-10T11:45:34.543 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:45:34.543 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:34.543 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:45:34.543 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:45:34.543 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: mon.c calling monitor election 2023-08-10T11:45:34.544 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:34.544 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:45:34.544 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:45:34.544 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:34.544 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:45:34.544 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-08-10T11:45:34.544 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: monmap e2: 2 mons at {a=[v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0],c=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0]} removed_ranks: {} 2023-08-10T11:45:34.545 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: fsmap 2023-08-10T11:45:34.545 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: osdmap e4: 0 total, 0 up, 0 in 2023-08-10T11:45:34.545 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: mgrmap e13: x(active, since 42s) 2023-08-10T11:45:34.545 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: overall HEALTH_OK 2023-08-10T11:45:34.545 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:34.545 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:34.545 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:34.545 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T11:45:34.546 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:34.546 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: Deploying daemon mon.b on smithi152 2023-08-10T11:45:34.546 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:45:34.546 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:34.546 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: from='client.? 172.21.15.156:0/1410270556' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-08-10T11:45:34.546 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-08-10T11:45:34.546 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2023-08-10T11:45:34.546 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: expand_channel_meta expand map: {default=false} 2023-08-10T11:45:34.547 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: expand_channel_meta from 'false' to 'false' 2023-08-10T11:45:34.547 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: expand_channel_meta expanded map: {default=false} 2023-08-10T11:45:34.547 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: expand_channel_meta expand map: {default=info} 2023-08-10T11:45:34.547 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: expand_channel_meta from 'info' to 'info' 2023-08-10T11:45:34.547 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: expand_channel_meta expanded map: {default=info} 2023-08-10T11:45:34.547 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: expand_channel_meta expand map: {default=daemon} 2023-08-10T11:45:34.547 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: expand_channel_meta from 'daemon' to 'daemon' 2023-08-10T11:45:34.547 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: expand_channel_meta expanded map: {default=daemon} 2023-08-10T11:45:34.548 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: expand_channel_meta expand map: {default=debug} 2023-08-10T11:45:34.548 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: expand_channel_meta from 'debug' to 'debug' 2023-08-10T11:45:34.548 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 ceph-mon[130220]: expand_channel_meta expanded map: {default=debug} 2023-08-10T11:45:34.799 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T11:45:34.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:34 smithi152 systemd[1]: Started Ceph mon.b for 0e619a74-3773-11ee-9b37-001a4aab830c. 2023-08-10T11:45:39.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.706+0000 7fab105ef700 1 -- 172.21.15.156:0/502060059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab080ff480 msgr2=0x7faaf4007820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:39.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.706+0000 7fab105ef700 1 --2- 172.21.15.156:0/502060059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab080ff480 0x7faaf4007820 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faaf8005fa0 tx=0x7faaf800f4a0 comp rx=0 tx=0).stop 2023-08-10T11:45:39.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.706+0000 7fab105ef700 1 -- 172.21.15.156:0/502060059 shutdown_connections 2023-08-10T11:45:39.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.706+0000 7fab105ef700 1 --2- 172.21.15.156:0/502060059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab080ff480 0x7faaf4007820 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:39.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.706+0000 7fab105ef700 1 -- 172.21.15.156:0/502060059 >> 172.21.15.156:0/502060059 conn(0x7fab080fad30 msgr2=0x7fab080fd150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:45:39.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.706+0000 7fab105ef700 1 -- 172.21.15.156:0/502060059 shutdown_connections 2023-08-10T11:45:39.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.706+0000 7fab105ef700 1 -- 172.21.15.156:0/502060059 wait complete. 2023-08-10T11:45:39.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.707+0000 7fab105ef700 1 Processor -- start 2023-08-10T11:45:39.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.707+0000 7fab105ef700 1 -- start start 2023-08-10T11:45:39.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.707+0000 7fab105ef700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab080ff480 0x7fab081936d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:39.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.707+0000 7fab105ef700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab08193c10 0x7fab08196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:39.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.707+0000 7fab105ef700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab08197510 0x7fab08197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:39.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.707+0000 7fab105ef700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab081942f0 con 0x7fab080ff480 2023-08-10T11:45:39.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.707+0000 7fab105ef700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab081a0360 con 0x7fab08197510 2023-08-10T11:45:39.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.707+0000 7fab105ef700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab081a04a0 con 0x7fab08193c10 2023-08-10T11:45:39.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.707+0000 7fab0db8a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab08193c10 0x7fab08196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:39.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.707+0000 7fab0db8a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab08193c10 0x7fab08196fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36664/0 (socket says 172.21.15.156:36664) 2023-08-10T11:45:39.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.707+0000 7fab0db8a700 1 -- 172.21.15.156:0/3698925917 learned_addr learned my addr 172.21.15.156:0/3698925917 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-08-10T11:45:39.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.708+0000 7fab0e38b700 1 --2- 172.21.15.156:0/3698925917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab080ff480 0x7fab081936d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:39.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.708+0000 7fab0db8a700 1 -- 172.21.15.156:0/3698925917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab08193c10 msgr2=0x7fab08196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-08-10T11:45:39.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.708+0000 7fab0db8a700 1 -- 172.21.15.156:0/3698925917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab08193c10 msgr2=0x7fab08196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-08-10T11:45:39.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.708+0000 7fab0db8a700 1 --2- 172.21.15.156:0/3698925917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab08193c10 0x7fab08196fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-10T11:45:39.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.708+0000 7fab0db8a700 1 --2- 172.21.15.156:0/3698925917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab08193c10 0x7fab08196fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-10T11:45:39.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.708+0000 7fab0eb8c700 1 --2- 172.21.15.156:0/3698925917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab08197510 0x7fab08197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:39.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.708+0000 7fab0eb8c700 1 -- 172.21.15.156:0/3698925917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab08197510 msgr2=0x7fab08197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-08-10T11:45:39.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.708+0000 7fab0eb8c700 1 -- 172.21.15.156:0/3698925917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab08197510 msgr2=0x7fab08197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-08-10T11:45:39.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.708+0000 7fab0eb8c700 1 --2- 172.21.15.156:0/3698925917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab08197510 0x7fab08197990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-10T11:45:39.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.708+0000 7fab0eb8c700 1 --2- 172.21.15.156:0/3698925917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab08197510 0x7fab08197990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-10T11:45:39.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.708+0000 7fab0e38b700 1 -- 172.21.15.156:0/3698925917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab08193c10 msgr2=0x7fab08196fd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T11:45:39.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.708+0000 7fab0e38b700 1 --2- 172.21.15.156:0/3698925917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab08193c10 0x7fab08196fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:39.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.708+0000 7fab0e38b700 1 -- 172.21.15.156:0/3698925917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab08197510 msgr2=0x7fab08197990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T11:45:39.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.708+0000 7fab0e38b700 1 --2- 172.21.15.156:0/3698925917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab08197510 0x7fab08197990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:39.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.708+0000 7fab0e38b700 1 -- 172.21.15.156:0/3698925917 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf80149d0 con 0x7fab080ff480 2023-08-10T11:45:39.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.708+0000 7fab0e38b700 1 --2- 172.21.15.156:0/3698925917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab080ff480 0x7fab081936d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faaf801d000 tx=0x7faaf8005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:45:39.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.708+0000 7faaff7fe700 1 -- 172.21.15.156:0/3698925917 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf8019070 con 0x7fab080ff480 2023-08-10T11:45:39.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.708+0000 7fab105ef700 1 -- 172.21.15.156:0/3698925917 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab081a06f0 con 0x7fab080ff480 2023-08-10T11:45:39.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.708+0000 7faaff7fe700 1 -- 172.21.15.156:0/3698925917 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faaf801a040 con 0x7fab080ff480 2023-08-10T11:45:39.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.708+0000 7faaff7fe700 1 -- 172.21.15.156:0/3698925917 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf8003f90 con 0x7fab080ff480 2023-08-10T11:45:39.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.708+0000 7fab105ef700 1 -- 172.21.15.156:0/3698925917 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab081a0bf0 con 0x7fab080ff480 2023-08-10T11:45:39.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.710+0000 7faaff7fe700 1 -- 172.21.15.156:0/3698925917 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7faaf80040f0 con 0x7fab080ff480 2023-08-10T11:45:39.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.710+0000 7faaff7fe700 1 --2- 172.21.15.156:0/3698925917 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7faaec038c30 0x7faaec03b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:39.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.710+0000 7fab105ef700 1 -- 172.21.15.156:0/3698925917 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab08061da0 con 0x7fab080ff480 2023-08-10T11:45:39.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.710+0000 7faaff7fe700 1 -- 172.21.15.156:0/3698925917 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7faaf804dce0 con 0x7fab080ff480 2023-08-10T11:45:39.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.710+0000 7fab0db8a700 1 --2- 172.21.15.156:0/3698925917 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7faaec038c30 0x7faaec03b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:39.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.710+0000 7fab0db8a700 1 --2- 172.21.15.156:0/3698925917 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7faaec038c30 0x7faaec03b0f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fab04009180 tx=0x7fab04008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:45:39.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.715+0000 7faaff7fe700 1 -- 172.21.15.156:0/3698925917 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7faaf801e460 con 0x7fab080ff480 2023-08-10T11:45:39.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:39 smithi073 ceph-mon[128869]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:39.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:39 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T11:45:39.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:39 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:45:39.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:39 smithi073 ceph-mon[128869]: mon.c calling monitor election 2023-08-10T11:45:39.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:39 smithi073 ceph-mon[128869]: mon.a calling monitor election 2023-08-10T11:45:39.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:39 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:45:39.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:39 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:45:39.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:39 smithi073 ceph-mon[128869]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:39.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:39 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:45:39.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:39 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:45:39.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:39 smithi073 ceph-mon[128869]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:39.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:39 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:45:39.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:39 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:45:39.770 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:39 smithi073 ceph-mon[128869]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-08-10T11:45:39.770 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:39 smithi073 ceph-mon[128869]: monmap e3: 3 mons at {a=[v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0],b=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0],c=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0]} removed_ranks: {} 2023-08-10T11:45:39.770 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:39 smithi073 ceph-mon[128869]: fsmap 2023-08-10T11:45:39.770 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:39 smithi073 ceph-mon[128869]: osdmap e4: 0 total, 0 up, 0 in 2023-08-10T11:45:39.770 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:39 smithi073 ceph-mon[128869]: mgrmap e13: x(active, since 51s) 2023-08-10T11:45:39.770 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:39 smithi073 ceph-mon[128869]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-08-10T11:45:39.770 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:39 smithi073 ceph-mon[128869]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-08-10T11:45:39.771 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:39 smithi073 ceph-mon[128869]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-08-10T11:45:39.771 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:39 smithi073 ceph-mon[128869]: mon.b (rank 2) addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] is down (out of quorum) 2023-08-10T11:45:39.771 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:39 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:39.771 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:39 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:39.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.992+0000 7fab105ef700 1 -- 172.21.15.156:0/3698925917 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fab080008d0 con 0x7fab080ff480 2023-08-10T11:45:39.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.994+0000 7faaff7fe700 1 -- 172.21.15.156:0/3698925917 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1274 (secure 0 0 0) 0x7faaf8030bd0 con 0x7fab080ff480 2023-08-10T11:45:39.995 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-08-10T11:45:39.995 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":3,"fsid":"0e619a74-3773-11ee-9b37-001a4aab830c","modified":"2023-08-10T11:45:34.428879Z","created":"2023-08-10T11:43:51.690486Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:3300","nonce":0},{"type":"v1","addr":"172.21.15.156:6789","nonce":0}]},"addr":"172.21.15.156:6789/0","public_addr":"172.21.15.156:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-08-10T11:45:39.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.995+0000 7fab105ef700 1 -- 172.21.15.156:0/3698925917 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7faaec038c30 msgr2=0x7faaec03b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:39.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.995+0000 7fab105ef700 1 --2- 172.21.15.156:0/3698925917 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7faaec038c30 0x7faaec03b0f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fab04009180 tx=0x7fab04008040 comp rx=0 tx=0).stop 2023-08-10T11:45:39.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.995+0000 7fab105ef700 1 -- 172.21.15.156:0/3698925917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab080ff480 msgr2=0x7fab081936d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:39.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.995+0000 7fab105ef700 1 --2- 172.21.15.156:0/3698925917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab080ff480 0x7fab081936d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faaf801d000 tx=0x7faaf8005040 comp rx=0 tx=0).stop 2023-08-10T11:45:39.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.995+0000 7fab105ef700 1 -- 172.21.15.156:0/3698925917 shutdown_connections 2023-08-10T11:45:39.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.995+0000 7fab105ef700 1 --2- 172.21.15.156:0/3698925917 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7faaec038c30 0x7faaec03b0f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:39.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.995+0000 7fab105ef700 1 --2- 172.21.15.156:0/3698925917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab08197510 0x7fab08197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:39.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.995+0000 7fab105ef700 1 --2- 172.21.15.156:0/3698925917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab080ff480 0x7fab081936d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:39.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.995+0000 7fab105ef700 1 --2- 172.21.15.156:0/3698925917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab08193c10 0x7fab08196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:39.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.995+0000 7fab105ef700 1 -- 172.21.15.156:0/3698925917 >> 172.21.15.156:0/3698925917 conn(0x7fab080fad30 msgr2=0x7fab080fc380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:45:39.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.995+0000 7fab105ef700 1 -- 172.21.15.156:0/3698925917 shutdown_connections 2023-08-10T11:45:39.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:39.995+0000 7fab105ef700 1 -- 172.21.15.156:0/3698925917 wait complete. 2023-08-10T11:45:39.999 INFO:teuthology.orchestra.run.smithi156.stderr:dumped monmap epoch 3 2023-08-10T11:45:40.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:39 smithi156 ceph-mon[130574]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:40.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:39 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T11:45:40.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:39 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:45:40.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:39 smithi156 ceph-mon[130574]: mon.c calling monitor election 2023-08-10T11:45:40.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:39 smithi156 ceph-mon[130574]: mon.a calling monitor election 2023-08-10T11:45:40.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:39 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:45:40.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:39 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:45:40.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:39 smithi156 ceph-mon[130574]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:40.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:39 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:45:40.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:39 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:45:40.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:39 smithi156 ceph-mon[130574]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:40.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:39 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:45:40.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:39 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:45:40.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:39 smithi156 ceph-mon[130574]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-08-10T11:45:40.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:39 smithi156 ceph-mon[130574]: monmap e3: 3 mons at {a=[v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0],b=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0],c=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0]} removed_ranks: {} 2023-08-10T11:45:40.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:39 smithi156 ceph-mon[130574]: fsmap 2023-08-10T11:45:40.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:39 smithi156 ceph-mon[130574]: osdmap e4: 0 total, 0 up, 0 in 2023-08-10T11:45:40.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:39 smithi156 ceph-mon[130574]: mgrmap e13: x(active, since 51s) 2023-08-10T11:45:40.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:39 smithi156 ceph-mon[130574]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-08-10T11:45:40.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:39 smithi156 ceph-mon[130574]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-08-10T11:45:40.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:39 smithi156 ceph-mon[130574]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-08-10T11:45:40.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:39 smithi156 ceph-mon[130574]: mon.b (rank 2) addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] is down (out of quorum) 2023-08-10T11:45:40.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:39 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:40.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:39 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:40.468 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-08-10T11:45:40.468 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph config generate-minimal-conf 2023-08-10T11:45:40.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:40 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:40.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:40 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:40.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:40 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:45:40.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:40 smithi156 ceph-mon[130574]: from='client.? 172.21.15.156:0/3698925917' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-08-10T11:45:40.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:40 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:45:40.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:40 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:40.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:40 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:40.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:40 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:45:40.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:40 smithi073 ceph-mon[128869]: from='client.? 172.21.15.156:0/3698925917' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-08-10T11:45:40.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:40 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:45:41.035 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:45:41.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:41.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T11:45:41.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:45:41.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: mon.c calling monitor election 2023-08-10T11:45:41.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: mon.a calling monitor election 2023-08-10T11:45:41.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:45:41.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:45:41.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:41.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:45:41.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:45:41.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:41.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:45:41.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:45:41.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-08-10T11:45:41.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: monmap e3: 3 mons at {a=[v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0],b=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0],c=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0]} removed_ranks: {} 2023-08-10T11:45:41.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: fsmap 2023-08-10T11:45:41.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: osdmap e4: 0 total, 0 up, 0 in 2023-08-10T11:45:41.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: mgrmap e13: x(active, since 51s) 2023-08-10T11:45:41.748 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-08-10T11:45:41.748 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-08-10T11:45:41.748 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-08-10T11:45:41.748 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: mon.b (rank 2) addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] is down (out of quorum) 2023-08-10T11:45:41.748 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:41.748 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:41.748 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:41.749 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:41.749 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:45:41.749 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: from='client.? 172.21.15.156:0/3698925917' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-08-10T11:45:41.749 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:45:42.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.365+0000 7f36afad0700 1 -- 172.21.15.73:0/3623364990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36a8101440 msgr2=0x7f36a8101820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:42.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.365+0000 7f36afad0700 1 --2- 172.21.15.73:0/3623364990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36a8101440 0x7f36a8101820 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f36a4009910 tx=0x7f36a4009c20 comp rx=0 tx=0).stop 2023-08-10T11:45:42.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.365+0000 7f36afad0700 1 -- 172.21.15.73:0/3623364990 shutdown_connections 2023-08-10T11:45:42.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.365+0000 7f36afad0700 1 --2- 172.21.15.73:0/3623364990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36a8101440 0x7f36a8101820 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:42.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.365+0000 7f36afad0700 1 -- 172.21.15.73:0/3623364990 >> 172.21.15.73:0/3623364990 conn(0x7f36a80fabf0 msgr2=0x7f36a80fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:45:42.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.365+0000 7f36afad0700 1 -- 172.21.15.73:0/3623364990 shutdown_connections 2023-08-10T11:45:42.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.365+0000 7f36afad0700 1 -- 172.21.15.73:0/3623364990 wait complete. 2023-08-10T11:45:42.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.365+0000 7f36afad0700 1 Processor -- start 2023-08-10T11:45:42.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.365+0000 7f36afad0700 1 -- start start 2023-08-10T11:45:42.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.366+0000 7f36afad0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36a8101440 0x7f36a819b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:42.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.366+0000 7f36afad0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36a819bb90 0x7f36a81956d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:42.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.366+0000 7f36afad0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36a8195c10 0x7f36a8196090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:42.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.366+0000 7f36afad0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a819c200 con 0x7f36a8195c10 2023-08-10T11:45:42.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.366+0000 7f36afad0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a81a2470 con 0x7f36a819bb90 2023-08-10T11:45:42.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.366+0000 7f36afad0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a81a25e0 con 0x7f36a8101440 2023-08-10T11:45:42.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.366+0000 7f36ae06d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36a8195c10 0x7f36a8196090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:42.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.366+0000 7f36ae06d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36a8195c10 0x7f36a8196090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58028/0 (socket says 172.21.15.73:58028) 2023-08-10T11:45:42.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.366+0000 7f36ae06d700 1 -- 172.21.15.73:0/1308822978 learned_addr learned my addr 172.21.15.73:0/1308822978 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:45:42.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.366+0000 7f36ad06b700 1 --2- 172.21.15.73:0/1308822978 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36a819bb90 0x7f36a81956d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:42.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.366+0000 7f36ad86c700 1 --2- 172.21.15.73:0/1308822978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36a8101440 0x7f36a819b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:42.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.366+0000 7f36ae06d700 1 -- 172.21.15.73:0/1308822978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36a8101440 msgr2=0x7f36a819b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:42.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.366+0000 7f36ae06d700 1 --2- 172.21.15.73:0/1308822978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36a8101440 0x7f36a819b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:42.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.366+0000 7f36ae06d700 1 -- 172.21.15.73:0/1308822978 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36a819bb90 msgr2=0x7f36a81956d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:42.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.366+0000 7f36ae06d700 1 --2- 172.21.15.73:0/1308822978 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36a819bb90 0x7f36a81956d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:42.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.366+0000 7f36ae06d700 1 -- 172.21.15.73:0/1308822978 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a40095f0 con 0x7f36a8195c10 2023-08-10T11:45:42.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.366+0000 7f36ad86c700 1 --2- 172.21.15.73:0/1308822978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36a8101440 0x7f36a819b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:45:42.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.366+0000 7f36ae06d700 1 --2- 172.21.15.73:0/1308822978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36a8195c10 0x7f36a8196090 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f36a000ba50 tx=0x7f36a000bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:45:42.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.366+0000 7f369effd700 1 -- 172.21.15.73:0/1308822978 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a000c9b0 con 0x7f36a8195c10 2023-08-10T11:45:42.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.366+0000 7f369effd700 1 -- 172.21.15.73:0/1308822978 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36a0014440 con 0x7f36a8195c10 2023-08-10T11:45:42.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.366+0000 7f36afad0700 1 -- 172.21.15.73:0/1308822978 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a81a28c0 con 0x7f36a8195c10 2023-08-10T11:45:42.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.366+0000 7f369effd700 1 -- 172.21.15.73:0/1308822978 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a0007590 con 0x7f36a8195c10 2023-08-10T11:45:42.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.367+0000 7f36afad0700 1 -- 172.21.15.73:0/1308822978 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a81a2dc0 con 0x7f36a8195c10 2023-08-10T11:45:42.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.367+0000 7f369effd700 1 -- 172.21.15.73:0/1308822978 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f36a00077b0 con 0x7f36a8195c10 2023-08-10T11:45:42.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.367+0000 7f36afad0700 1 -- 172.21.15.73:0/1308822978 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a8107c70 con 0x7f36a8195c10 2023-08-10T11:45:42.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.367+0000 7f369effd700 1 --2- 172.21.15.73:0/1308822978 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3694038c80 0x7f369403b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:42.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.368+0000 7f369effd700 1 -- 172.21.15.73:0/1308822978 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f36a004ab80 con 0x7f36a8195c10 2023-08-10T11:45:42.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.368+0000 7f36ad86c700 1 --2- 172.21.15.73:0/1308822978 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3694038c80 0x7f369403b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:42.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.368+0000 7f36ad86c700 1 --2- 172.21.15.73:0/1308822978 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3694038c80 0x7f369403b140 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f36a4006010 tx=0x7f36a400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:45:42.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.372+0000 7f369effd700 1 -- 172.21.15.73:0/1308822978 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f36a0013b50 con 0x7f36a8195c10 2023-08-10T11:45:42.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: mon.b calling monitor election 2023-08-10T11:45:42.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: Updating smithi073:/etc/ceph/ceph.conf 2023-08-10T11:45:42.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: Updating smithi152:/etc/ceph/ceph.conf 2023-08-10T11:45:42.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: Updating smithi156:/etc/ceph/ceph.conf 2023-08-10T11:45:42.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: mon.b calling monitor election 2023-08-10T11:45:42.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: mon.c calling monitor election 2023-08-10T11:45:42.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: mon.a calling monitor election 2023-08-10T11:45:42.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-08-10T11:45:42.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: monmap e3: 3 mons at {a=[v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0],b=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0],c=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0]} removed_ranks: {} 2023-08-10T11:45:42.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: fsmap 2023-08-10T11:45:42.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: osdmap e4: 0 total, 0 up, 0 in 2023-08-10T11:45:42.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: mgrmap e13: x(active, since 53s) 2023-08-10T11:45:42.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-08-10T11:45:42.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: Cluster is now healthy 2023-08-10T11:45:42.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: overall HEALTH_OK 2023-08-10T11:45:42.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: Updating smithi156:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T11:45:42.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: Updating smithi073:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T11:45:42.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: Updating smithi152:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T11:45:42.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:42.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:42.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:42.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:42.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:42.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:42.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:42.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T11:45:42.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-08-10T11:45:42.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:42 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:42.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.569+0000 7f36afad0700 1 -- 172.21.15.73:0/1308822978 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f36a8061da0 con 0x7f36a8195c10 2023-08-10T11:45:42.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.569+0000 7f369effd700 1 -- 172.21.15.73:0/1308822978 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+275 (secure 0 0 0) 0x7f36a0019030 con 0x7f36a8195c10 2023-08-10T11:45:42.570 INFO:teuthology.orchestra.run.smithi073.stdout:# minimal ceph.conf for 0e619a74-3773-11ee-9b37-001a4aab830c 2023-08-10T11:45:42.570 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2023-08-10T11:45:42.570 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 0e619a74-3773-11ee-9b37-001a4aab830c 2023-08-10T11:45:42.571 INFO:teuthology.orchestra.run.smithi073.stdout: mon_host = [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-08-10T11:45:42.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.571+0000 7f36afad0700 1 -- 172.21.15.73:0/1308822978 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3694038c80 msgr2=0x7f369403b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:42.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.571+0000 7f36afad0700 1 --2- 172.21.15.73:0/1308822978 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3694038c80 0x7f369403b140 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f36a4006010 tx=0x7f36a400b540 comp rx=0 tx=0).stop 2023-08-10T11:45:42.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.571+0000 7f36afad0700 1 -- 172.21.15.73:0/1308822978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36a8195c10 msgr2=0x7f36a8196090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:42.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.571+0000 7f36afad0700 1 --2- 172.21.15.73:0/1308822978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36a8195c10 0x7f36a8196090 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f36a000ba50 tx=0x7f36a000bd60 comp rx=0 tx=0).stop 2023-08-10T11:45:42.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.571+0000 7f36afad0700 1 -- 172.21.15.73:0/1308822978 shutdown_connections 2023-08-10T11:45:42.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.571+0000 7f36afad0700 1 --2- 172.21.15.73:0/1308822978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36a8195c10 0x7f36a8196090 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:42.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.571+0000 7f36afad0700 1 --2- 172.21.15.73:0/1308822978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36a8101440 0x7f36a819b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:42.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.571+0000 7f36afad0700 1 --2- 172.21.15.73:0/1308822978 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3694038c80 0x7f369403b140 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:42.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.571+0000 7f36afad0700 1 --2- 172.21.15.73:0/1308822978 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36a819bb90 0x7f36a81956d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:42.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.572+0000 7f36afad0700 1 -- 172.21.15.73:0/1308822978 >> 172.21.15.73:0/1308822978 conn(0x7f36a80fabf0 msgr2=0x7f36a8104db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:45:42.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.572+0000 7f36afad0700 1 -- 172.21.15.73:0/1308822978 shutdown_connections 2023-08-10T11:45:42.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:42.572+0000 7f36afad0700 1 -- 172.21.15.73:0/1308822978 wait complete. 2023-08-10T11:45:42.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: mon.b calling monitor election 2023-08-10T11:45:42.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: Updating smithi073:/etc/ceph/ceph.conf 2023-08-10T11:45:42.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: Updating smithi152:/etc/ceph/ceph.conf 2023-08-10T11:45:42.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: Updating smithi156:/etc/ceph/ceph.conf 2023-08-10T11:45:42.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: mon.b calling monitor election 2023-08-10T11:45:42.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: mon.c calling monitor election 2023-08-10T11:45:42.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: mon.a calling monitor election 2023-08-10T11:45:42.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-08-10T11:45:42.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: monmap e3: 3 mons at {a=[v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0],b=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0],c=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0]} removed_ranks: {} 2023-08-10T11:45:42.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: fsmap 2023-08-10T11:45:42.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: osdmap e4: 0 total, 0 up, 0 in 2023-08-10T11:45:42.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: mgrmap e13: x(active, since 53s) 2023-08-10T11:45:42.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-08-10T11:45:42.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: Cluster is now healthy 2023-08-10T11:45:42.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: overall HEALTH_OK 2023-08-10T11:45:42.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: Updating smithi156:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T11:45:42.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: Updating smithi073:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T11:45:42.748 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: Updating smithi152:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T11:45:42.748 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:42.748 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:42.748 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:42.748 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:42.748 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:42.748 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:42.749 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:42.749 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T11:45:42.749 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-08-10T11:45:42.749 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:42 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:42.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: mon.b calling monitor election 2023-08-10T11:45:42.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: Updating smithi073:/etc/ceph/ceph.conf 2023-08-10T11:45:42.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: Updating smithi152:/etc/ceph/ceph.conf 2023-08-10T11:45:42.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: Updating smithi156:/etc/ceph/ceph.conf 2023-08-10T11:45:42.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: mon.b calling monitor election 2023-08-10T11:45:42.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: mon.c calling monitor election 2023-08-10T11:45:42.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: mon.a calling monitor election 2023-08-10T11:45:42.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-08-10T11:45:42.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: monmap e3: 3 mons at {a=[v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0],b=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0],c=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0]} removed_ranks: {} 2023-08-10T11:45:42.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: fsmap 2023-08-10T11:45:42.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: osdmap e4: 0 total, 0 up, 0 in 2023-08-10T11:45:42.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: mgrmap e13: x(active, since 53s) 2023-08-10T11:45:42.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-08-10T11:45:42.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: Cluster is now healthy 2023-08-10T11:45:42.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: overall HEALTH_OK 2023-08-10T11:45:42.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: Updating smithi156:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T11:45:42.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: Updating smithi073:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T11:45:42.758 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: Updating smithi152:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T11:45:42.758 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:42.758 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:42.758 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:42.758 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:42.758 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:42.758 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:42.759 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:42.759 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T11:45:42.759 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-08-10T11:45:42.759 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:42 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:43.484 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-08-10T11:45:43.484 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-08-10T11:45:43.485 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.conf 2023-08-10T11:45:43.514 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-08-10T11:45:43.514 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-08-10T11:45:43.581 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-08-10T11:45:43.581 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.conf 2023-08-10T11:45:43.607 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:43 smithi152 ceph-mon[130220]: Reconfiguring mon.a (unknown last config time)... 2023-08-10T11:45:43.607 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:43 smithi152 ceph-mon[130220]: Reconfiguring daemon mon.a on smithi073 2023-08-10T11:45:43.607 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:43 smithi152 ceph-mon[130220]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:43.608 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:43 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:45:43.608 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:43 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1308822978' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:43.611 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-08-10T11:45:43.612 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-08-10T11:45:43.681 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-08-10T11:45:43.681 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/ceph/ceph.conf 2023-08-10T11:45:43.712 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:43 smithi156 ceph-mon[130574]: Reconfiguring mon.a (unknown last config time)... 2023-08-10T11:45:43.713 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:43 smithi156 ceph-mon[130574]: Reconfiguring daemon mon.a on smithi073 2023-08-10T11:45:43.713 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:43 smithi156 ceph-mon[130574]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:43.713 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:43 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:45:43.713 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:43 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1308822978' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:43.717 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-08-10T11:45:43.717 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-08-10T11:45:43.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:43 smithi073 ceph-mon[128869]: Reconfiguring mon.a (unknown last config time)... 2023-08-10T11:45:43.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:43 smithi073 ceph-mon[128869]: Reconfiguring daemon mon.a on smithi073 2023-08-10T11:45:43.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:43 smithi073 ceph-mon[128869]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:43.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:43 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:45:43.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:43 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1308822978' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:43.788 INFO:tasks.cephadm:Adding mgr.x on smithi073 2023-08-10T11:45:43.788 INFO:tasks.cephadm:Adding mgr.y on smithi152 2023-08-10T11:45:43.788 INFO:tasks.cephadm:Adding mgr.z on smithi156 2023-08-10T11:45:43.789 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph orch apply mgr '3;smithi073=x;smithi152=y;smithi156=z' 2023-08-10T11:45:44.377 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T11:45:44.635 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:44 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:44.636 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:44 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:44.636 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:44 smithi152 ceph-mon[130220]: Reconfiguring mon.b (monmap changed)... 2023-08-10T11:45:44.636 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:44 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T11:45:44.636 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:44 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-08-10T11:45:44.636 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:44 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:44.637 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:44 smithi152 ceph-mon[130220]: Reconfiguring daemon mon.b on smithi152 2023-08-10T11:45:44.637 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:44 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:44.681 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:44 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:44.681 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:44 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:44.681 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:44 smithi156 ceph-mon[130574]: Reconfiguring mon.b (monmap changed)... 2023-08-10T11:45:44.682 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:44 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T11:45:44.682 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:44 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-08-10T11:45:44.682 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:44 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:44.682 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:44 smithi156 ceph-mon[130574]: Reconfiguring daemon mon.b on smithi152 2023-08-10T11:45:44.683 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:44 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:44.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:44 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:44.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:44 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:44.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:44 smithi073 ceph-mon[128869]: Reconfiguring mon.b (monmap changed)... 2023-08-10T11:45:44.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:44 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T11:45:44.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:44 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-08-10T11:45:44.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:44 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:44.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:44 smithi073 ceph-mon[128869]: Reconfiguring daemon mon.b on smithi152 2023-08-10T11:45:44.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:44 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:45.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.820+0000 7fc0ccc3a700 1 -- 172.21.15.156:0/715053945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0c80ff280 msgr2=0x7fc0c80ff6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:45.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.820+0000 7fc0ccc3a700 1 --2- 172.21.15.156:0/715053945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0c80ff280 0x7fc0c80ff6a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0009910 tx=0x7fc0b0009c20 comp rx=0 tx=0).stop 2023-08-10T11:45:45.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.820+0000 7fc0ccc3a700 1 -- 172.21.15.156:0/715053945 shutdown_connections 2023-08-10T11:45:45.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.821+0000 7fc0ccc3a700 1 --2- 172.21.15.156:0/715053945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0c80ff280 0x7fc0c80ff6a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:45.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.821+0000 7fc0ccc3a700 1 -- 172.21.15.156:0/715053945 >> 172.21.15.156:0/715053945 conn(0x7fc0c80fa840 msgr2=0x7fc0c80fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:45:45.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.821+0000 7fc0ccc3a700 1 -- 172.21.15.156:0/715053945 shutdown_connections 2023-08-10T11:45:45.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.821+0000 7fc0ccc3a700 1 -- 172.21.15.156:0/715053945 wait complete. 2023-08-10T11:45:45.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.821+0000 7fc0ccc3a700 1 Processor -- start 2023-08-10T11:45:45.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.821+0000 7fc0ccc3a700 1 -- start start 2023-08-10T11:45:45.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.821+0000 7fc0ccc3a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc0c80ff280 0x7fc0c80fc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:45.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.821+0000 7fc0ccc3a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0c80fade0 0x7fc0c80fb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:45.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.821+0000 7fc0ccc3a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0c80fb7a0 0x7fc0c819f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:45.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.821+0000 7fc0ccc3a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c819fb60 con 0x7fc0c80fb7a0 2023-08-10T11:45:45.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.821+0000 7fc0ccc3a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c819fca0 con 0x7fc0c80ff280 2023-08-10T11:45:45.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.821+0000 7fc0ccc3a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c819fde0 con 0x7fc0c80fade0 2023-08-10T11:45:45.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.822+0000 7fc0c5d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0c80fade0 0x7fc0c80fb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:45.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.822+0000 7fc0c5d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0c80fade0 0x7fc0c80fb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36674/0 (socket says 172.21.15.156:36674) 2023-08-10T11:45:45.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.822+0000 7fc0c5d9b700 1 -- 172.21.15.156:0/3646656305 learned_addr learned my addr 172.21.15.156:0/3646656305 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-08-10T11:45:45.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.822+0000 7fc0c6d9d700 1 --2- 172.21.15.156:0/3646656305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0c80fb7a0 0x7fc0c819f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:45.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.822+0000 7fc0c659c700 1 --2- 172.21.15.156:0/3646656305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc0c80ff280 0x7fc0c80fc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:45.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.822+0000 7fc0c5d9b700 1 -- 172.21.15.156:0/3646656305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc0c80ff280 msgr2=0x7fc0c80fc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:45.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.822+0000 7fc0c5d9b700 1 --2- 172.21.15.156:0/3646656305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc0c80ff280 0x7fc0c80fc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:45.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.822+0000 7fc0c5d9b700 1 -- 172.21.15.156:0/3646656305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0c80fb7a0 msgr2=0x7fc0c819f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:45.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.822+0000 7fc0c5d9b700 1 --2- 172.21.15.156:0/3646656305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0c80fb7a0 0x7fc0c819f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:45.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.822+0000 7fc0c5d9b700 1 -- 172.21.15.156:0/3646656305 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b00095f0 con 0x7fc0c80fade0 2023-08-10T11:45:45.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.822+0000 7fc0c5d9b700 1 --2- 172.21.15.156:0/3646656305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0c80fade0 0x7fc0c80fb260 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800b780 tx=0x7fc0b800ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:45:45.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.822+0000 7fc0bf7fe700 1 -- 172.21.15.156:0/3646656305 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8004230 con 0x7fc0c80fade0 2023-08-10T11:45:45.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.822+0000 7fc0bf7fe700 1 -- 172.21.15.156:0/3646656305 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc0b8004390 con 0x7fc0c80fade0 2023-08-10T11:45:45.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.822+0000 7fc0ccc3a700 1 -- 172.21.15.156:0/3646656305 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c81a00c0 con 0x7fc0c80fade0 2023-08-10T11:45:45.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.822+0000 7fc0bf7fe700 1 -- 172.21.15.156:0/3646656305 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8011ad0 con 0x7fc0c80fade0 2023-08-10T11:45:45.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.822+0000 7fc0ccc3a700 1 -- 172.21.15.156:0/3646656305 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c81a0640 con 0x7fc0c80fade0 2023-08-10T11:45:45.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.823+0000 7fc0bf7fe700 1 -- 172.21.15.156:0/3646656305 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7fc0b8011cf0 con 0x7fc0c80fade0 2023-08-10T11:45:45.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.823+0000 7fc0ccc3a700 1 -- 172.21.15.156:0/3646656305 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c818ed50 con 0x7fc0c80fade0 2023-08-10T11:45:45.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.823+0000 7fc0bf7fe700 1 --2- 172.21.15.156:0/3646656305 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc0b4038c30 0x7fc0b403b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:45.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.823+0000 7fc0bf7fe700 1 -- 172.21.15.156:0/3646656305 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc0b804ae00 con 0x7fc0c80fade0 2023-08-10T11:45:45.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.824+0000 7fc0c659c700 1 --2- 172.21.15.156:0/3646656305 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc0b4038c30 0x7fc0b403b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:45.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.824+0000 7fc0c659c700 1 --2- 172.21.15.156:0/3646656305 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc0b4038c30 0x7fc0b403b0f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0005130 tx=0x7fc0b000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:45:45.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:45.828+0000 7fc0bf7fe700 1 -- 172.21.15.156:0/3646656305 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fc0b804f070 con 0x7fc0c80fade0 2023-08-10T11:45:45.977 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:45 smithi156 ceph-mon[130574]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:45.978 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:45 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:45.978 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:45 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:45.978 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:45 smithi156 ceph-mon[130574]: Reconfiguring mon.c (monmap changed)... 2023-08-10T11:45:45.978 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:45 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T11:45:45.978 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:45 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-08-10T11:45:45.978 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:45 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:45.979 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:45 smithi156 ceph-mon[130574]: Reconfiguring daemon mon.c on smithi156 2023-08-10T11:45:45.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:45 smithi152 ceph-mon[130220]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:45.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:45 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:45.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:45 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:45.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:45 smithi152 ceph-mon[130220]: Reconfiguring mon.c (monmap changed)... 2023-08-10T11:45:45.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:45 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T11:45:45.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:45 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-08-10T11:45:45.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:45 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:45.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:45 smithi152 ceph-mon[130220]: Reconfiguring daemon mon.c on smithi156 2023-08-10T11:45:46.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:45 smithi073 ceph-mon[128869]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:46.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:45 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:46.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:45 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:46.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:45 smithi073 ceph-mon[128869]: Reconfiguring mon.c (monmap changed)... 2023-08-10T11:45:46.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:45 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T11:45:46.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:45 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-08-10T11:45:46.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:45 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:46.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:45 smithi073 ceph-mon[128869]: Reconfiguring daemon mon.c on smithi156 2023-08-10T11:45:46.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:46.030+0000 7fc0ccc3a700 1 -- 172.21.15.156:0/3646656305 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi073=x;smithi152=y;smithi156=z", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0c8060c40 con 0x7fc0b4038c30 2023-08-10T11:45:46.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:46.037+0000 7fc0bf7fe700 1 -- 172.21.15.156:0/3646656305 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fc0c8060c40 con 0x7fc0b4038c30 2023-08-10T11:45:46.039 INFO:teuthology.orchestra.run.smithi156.stdout:Scheduled mgr update... 2023-08-10T11:45:46.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:46.040+0000 7fc0ccc3a700 1 -- 172.21.15.156:0/3646656305 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc0b4038c30 msgr2=0x7fc0b403b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:46.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:46.040+0000 7fc0ccc3a700 1 --2- 172.21.15.156:0/3646656305 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc0b4038c30 0x7fc0b403b0f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0005130 tx=0x7fc0b000b540 comp rx=0 tx=0).stop 2023-08-10T11:45:46.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:46.040+0000 7fc0ccc3a700 1 -- 172.21.15.156:0/3646656305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0c80fade0 msgr2=0x7fc0c80fb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:46.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:46.040+0000 7fc0ccc3a700 1 --2- 172.21.15.156:0/3646656305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0c80fade0 0x7fc0c80fb260 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800b780 tx=0x7fc0b800ba90 comp rx=0 tx=0).stop 2023-08-10T11:45:46.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:46.040+0000 7fc0ccc3a700 1 -- 172.21.15.156:0/3646656305 shutdown_connections 2023-08-10T11:45:46.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:46.040+0000 7fc0ccc3a700 1 --2- 172.21.15.156:0/3646656305 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc0b4038c30 0x7fc0b403b0f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:46.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:46.040+0000 7fc0ccc3a700 1 --2- 172.21.15.156:0/3646656305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc0c80ff280 0x7fc0c80fc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:46.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:46.040+0000 7fc0ccc3a700 1 --2- 172.21.15.156:0/3646656305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0c80fb7a0 0x7fc0c819f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:46.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:46.040+0000 7fc0ccc3a700 1 --2- 172.21.15.156:0/3646656305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0c80fade0 0x7fc0c80fb260 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:46.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:46.040+0000 7fc0ccc3a700 1 -- 172.21.15.156:0/3646656305 >> 172.21.15.156:0/3646656305 conn(0x7fc0c80fa840 msgr2=0x7fc0c8068760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:45:46.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:46.040+0000 7fc0ccc3a700 1 -- 172.21.15.156:0/3646656305 shutdown_connections 2023-08-10T11:45:46.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:45:46.040+0000 7fc0ccc3a700 1 -- 172.21.15.156:0/3646656305 wait complete. 2023-08-10T11:45:46.593 DEBUG:teuthology.orchestra.run.smithi152:mgr.y> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@mgr.y.service 2023-08-10T11:45:46.596 DEBUG:teuthology.orchestra.run.smithi156:mgr.z> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@mgr.z.service 2023-08-10T11:45:46.598 INFO:tasks.cephadm:Deploying OSDs... 2023-08-10T11:45:46.598 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-08-10T11:45:46.598 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2023-08-10T11:45:46.619 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-10T11:45:46.628 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2023-08-10T11:45:46.629 INFO:journalctl@ceph.mgr.z.smithi156.stdout:-- Logs begin at Thu 2023-08-10 11:15:12 UTC. -- 2023-08-10T11:45:46.630 INFO:journalctl@ceph.mgr.y.smithi152.stdout:-- Logs begin at Thu 2023-08-10 11:15:14 UTC. -- 2023-08-10T11:45:46.679 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-10T11:45:46.679 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T11:45:46.679 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 383502 Links: 1 2023-08-10T11:45:46.680 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T11:45:46.680 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T11:45:46.680 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-08-10 11:44:58.910279031 +0000 2023-08-10T11:45:46.680 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-08-10 11:30:55.594737325 +0000 2023-08-10T11:45:46.680 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-08-10 11:30:55.594737325 +0000 2023-08-10T11:45:46.680 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2023-08-10T11:45:46.681 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-10T11:45:46.748 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-08-10T11:45:46.748 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-08-10T11:45:46.749 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000230332 s, 2.2 MB/s 2023-08-10T11:45:46.749 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-10T11:45:46.810 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2023-08-10T11:45:46.868 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-10T11:45:46.868 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T11:45:46.868 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 383540 Links: 1 2023-08-10T11:45:46.869 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T11:45:46.869 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T11:45:46.869 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-08-10 11:44:58.910279031 +0000 2023-08-10T11:45:46.869 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-08-10 11:30:56.105725125 +0000 2023-08-10T11:45:46.869 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-08-10 11:30:56.105725125 +0000 2023-08-10T11:45:46.869 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2023-08-10T11:45:46.870 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-10T11:45:46.935 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-08-10T11:45:46.936 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-08-10T11:45:46.936 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000260432 s, 2.0 MB/s 2023-08-10T11:45:46.937 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-10T11:45:46.996 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2023-08-10T11:45:47.054 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-10T11:45:47.054 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T11:45:47.054 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 386488 Links: 1 2023-08-10T11:45:47.054 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T11:45:47.054 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T11:45:47.055 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-08-10 11:44:58.910279031 +0000 2023-08-10T11:45:47.055 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-08-10 11:30:56.654712019 +0000 2023-08-10T11:45:47.055 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-08-10 11:30:56.654712019 +0000 2023-08-10T11:45:47.055 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2023-08-10T11:45:47.055 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-10T11:45:47.120 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-08-10T11:45:47.120 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-08-10T11:45:47.121 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000214885 s, 2.4 MB/s 2023-08-10T11:45:47.122 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-10T11:45:47.179 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2023-08-10T11:45:47.236 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-10T11:45:47.236 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T11:45:47.236 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 383615 Links: 1 2023-08-10T11:45:47.236 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T11:45:47.236 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T11:45:47.237 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-08-10 11:44:58.910279031 +0000 2023-08-10T11:45:47.237 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-08-10 11:30:57.171699676 +0000 2023-08-10T11:45:47.237 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-08-10 11:30:57.171699676 +0000 2023-08-10T11:45:47.237 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2023-08-10T11:45:47.237 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-10T11:45:47.299 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:47 smithi073 ceph-mon[128869]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi073=x;smithi152=y;smithi156=z", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:45:47.299 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:47 smithi073 ceph-mon[128869]: Saving service mgr spec with placement smithi073=x;smithi152=y;smithi156=z;count:3 2023-08-10T11:45:47.300 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:47.300 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:47.300 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:47.300 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:47 smithi073 ceph-mon[128869]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:47.300 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:45:47.300 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:47.300 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:45:47.300 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:47.301 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-08-10T11:45:47.301 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-08-10T11:45:47.301 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-08-10T11:45:47.301 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:47.301 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:47 smithi073 ceph-mon[128869]: Deploying daemon mgr.z on smithi156 2023-08-10T11:45:47.302 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-08-10T11:45:47.302 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-08-10T11:45:47.302 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000192921 s, 2.7 MB/s 2023-08-10T11:45:47.303 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-10T11:45:47.345 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:47 smithi156 ceph-mon[130574]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi073=x;smithi152=y;smithi156=z", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:45:47.345 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:47 smithi156 ceph-mon[130574]: Saving service mgr spec with placement smithi073=x;smithi152=y;smithi156=z;count:3 2023-08-10T11:45:47.345 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:47.346 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:47.346 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:47.346 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:47 smithi156 ceph-mon[130574]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:47.346 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:45:47.346 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:47.346 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:45:47.346 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:47.347 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-08-10T11:45:47.347 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-08-10T11:45:47.347 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-08-10T11:45:47.347 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:47.347 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:47 smithi156 ceph-mon[130574]: Deploying daemon mgr.z on smithi156 2023-08-10T11:45:47.360 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-08-10T11:45:47.361 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/scratch_devs of=/dev/stdout 2023-08-10T11:45:47.382 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-10T11:45:47.382 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_1 2023-08-10T11:45:47.442 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-10T11:45:47.443 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T11:45:47.443 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 386243 Links: 1 2023-08-10T11:45:47.443 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T11:45:47.443 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T11:45:47.443 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-08-10 11:45:33.865827001 +0000 2023-08-10T11:45:47.443 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-08-10 11:31:08.158651599 +0000 2023-08-10T11:45:47.444 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-08-10 11:31:08.158651599 +0000 2023-08-10T11:45:47.444 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2023-08-10T11:45:47.444 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-10T11:45:47.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:47 smithi152 ceph-mon[130220]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi073=x;smithi152=y;smithi156=z", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:45:47.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:47 smithi152 ceph-mon[130220]: Saving service mgr spec with placement smithi073=x;smithi152=y;smithi156=z;count:3 2023-08-10T11:45:47.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:47.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:47.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:47.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:47 smithi152 ceph-mon[130220]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:47.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:45:47.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:47.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:45:47.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:47.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-08-10T11:45:47.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-08-10T11:45:47.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-08-10T11:45:47.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:47.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:47 smithi152 ceph-mon[130220]: Deploying daemon mgr.z on smithi156 2023-08-10T11:45:47.511 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-08-10T11:45:47.511 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-08-10T11:45:47.511 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000254978 s, 2.0 MB/s 2023-08-10T11:45:47.512 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-10T11:45:47.572 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_2 2023-08-10T11:45:47.630 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-10T11:45:47.630 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T11:45:47.630 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 378836 Links: 1 2023-08-10T11:45:47.630 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T11:45:47.630 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T11:45:47.630 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-08-10 11:45:33.866826989 +0000 2023-08-10T11:45:47.631 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-08-10 11:31:08.674645443 +0000 2023-08-10T11:45:47.631 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-08-10 11:31:08.674645443 +0000 2023-08-10T11:45:47.631 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2023-08-10T11:45:47.631 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-10T11:45:47.696 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-08-10T11:45:47.696 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-08-10T11:45:47.696 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000250687 s, 2.0 MB/s 2023-08-10T11:45:47.697 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-10T11:45:47.755 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_3 2023-08-10T11:45:47.813 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-10T11:45:47.813 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T11:45:47.813 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 388150 Links: 1 2023-08-10T11:45:47.813 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T11:45:47.813 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T11:45:47.814 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-08-10 11:45:33.866826989 +0000 2023-08-10T11:45:47.814 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-08-10 11:31:09.187639323 +0000 2023-08-10T11:45:47.814 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-08-10 11:31:09.187639323 +0000 2023-08-10T11:45:47.814 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2023-08-10T11:45:47.814 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-10T11:45:47.878 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-08-10T11:45:47.878 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-08-10T11:45:47.878 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000218684 s, 2.3 MB/s 2023-08-10T11:45:47.879 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-10T11:45:47.937 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_4 2023-08-10T11:45:47.994 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-10T11:45:47.994 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T11:45:47.994 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 387153 Links: 1 2023-08-10T11:45:47.995 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T11:45:47.995 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T11:45:47.995 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-08-10 11:45:33.866826989 +0000 2023-08-10T11:45:47.995 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-08-10 11:31:09.678633466 +0000 2023-08-10T11:45:47.995 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-08-10 11:31:09.678633466 +0000 2023-08-10T11:45:47.995 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2023-08-10T11:45:47.995 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-10T11:45:48.059 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-08-10T11:45:48.060 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-08-10T11:45:48.060 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000173966 s, 2.9 MB/s 2023-08-10T11:45:48.061 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-10T11:45:48.118 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-08-10T11:45:48.118 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/scratch_devs of=/dev/stdout 2023-08-10T11:45:48.139 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-10T11:45:48.140 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_1 2023-08-10T11:45:48.198 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-10T11:45:48.198 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T11:45:48.199 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 383493 Links: 1 2023-08-10T11:45:48.199 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T11:45:48.199 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T11:45:48.199 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-08-10 11:45:48.009662337 +0000 2023-08-10T11:45:48.199 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-08-10 11:31:05.058593626 +0000 2023-08-10T11:45:48.200 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-08-10 11:31:05.058593626 +0000 2023-08-10T11:45:48.200 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2023-08-10T11:45:48.200 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-10T11:45:48.255 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:48 smithi156 systemd[1]: Starting Ceph mgr.z for 0e619a74-3773-11ee-9b37-001a4aab830c... 2023-08-10T11:45:48.266 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-08-10T11:45:48.267 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-08-10T11:45:48.267 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000116418 s, 4.4 MB/s 2023-08-10T11:45:48.268 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-10T11:45:48.326 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_2 2023-08-10T11:45:48.383 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-10T11:45:48.383 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T11:45:48.384 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 386818 Links: 1 2023-08-10T11:45:48.384 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T11:45:48.384 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T11:45:48.384 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-08-10 11:45:48.009662337 +0000 2023-08-10T11:45:48.384 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-08-10 11:31:05.566585996 +0000 2023-08-10T11:45:48.384 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-08-10 11:31:05.566585996 +0000 2023-08-10T11:45:48.384 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2023-08-10T11:45:48.385 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-10T11:45:48.449 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-08-10T11:45:48.449 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-08-10T11:45:48.449 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000114919 s, 4.5 MB/s 2023-08-10T11:45:48.450 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-10T11:45:48.507 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_3 2023-08-10T11:45:48.563 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-10T11:45:48.564 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T11:45:48.564 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 387163 Links: 1 2023-08-10T11:45:48.564 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T11:45:48.564 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T11:45:48.564 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-08-10 11:45:48.009662337 +0000 2023-08-10T11:45:48.564 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-08-10 11:31:06.070578425 +0000 2023-08-10T11:45:48.565 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-08-10 11:31:06.070578425 +0000 2023-08-10T11:45:48.565 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2023-08-10T11:45:48.565 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-10T11:45:48.627 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:48 smithi156 podman[132461]: 2023-08-10T11:45:48.629 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-08-10T11:45:48.629 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-08-10T11:45:48.629 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000106601 s, 4.8 MB/s 2023-08-10T11:45:48.630 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-10T11:45:48.687 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_4 2023-08-10T11:45:48.746 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-10T11:45:48.746 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T11:45:48.746 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 383609 Links: 1 2023-08-10T11:45:48.746 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T11:45:48.746 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T11:45:48.747 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-08-10 11:45:48.010662322 +0000 2023-08-10T11:45:48.747 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-08-10 11:31:06.618570193 +0000 2023-08-10T11:45:48.747 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-08-10 11:31:06.618570193 +0000 2023-08-10T11:45:48.747 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2023-08-10T11:45:48.747 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-10T11:45:48.815 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-08-10T11:45:48.815 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-08-10T11:45:48.815 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000118866 s, 4.3 MB/s 2023-08-10T11:45:48.816 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-10T11:45:48.874 INFO:tasks.cephadm:Deploying osd.0 on smithi073 with /dev/vg_nvme/lv_4... 2023-08-10T11:45:48.874 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-08-10T11:45:48.952 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:48 smithi156 ceph-mgr[132644]: -- 172.21.15.156:0/3415606383 <== mon.1 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563e6e40d1e0 con 0x563e6e3e2c00 2023-08-10T11:45:48.952 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:48 smithi156 bash[132461]: 8c7b2f1d2acea32a21d9b63a9c35976cf159a7b9a512551567157f307dfbf669 2023-08-10T11:45:48.952 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:48 smithi156 systemd[1]: Started Ceph mgr.z for 0e619a74-3773-11ee-9b37-001a4aab830c. 2023-08-10T11:45:48.953 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:48 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:45:48.767+0000 7f9563088200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-10T11:45:48.953 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:48 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:45:48.857+0000 7f9563088200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-10T11:45:48.953 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:48 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:45:48.950+0000 7f9563088200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-10T11:45:49.212 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:49 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:45:49.043+0000 7f9563088200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-10T11:45:49.436 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:45:49.505 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:49 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:45:49.211+0000 7f9563088200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-10T11:45:49.807 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:49 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:45:49.519+0000 7f9563088200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-10T11:45:49.808 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:49 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:45:49.608+0000 7f9563088200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-10T11:45:49.808 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:49 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:45:49.737+0000 7f9563088200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-10T11:45:49.995 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:49 smithi073 ceph-mon[128869]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:49.995 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:49 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:49.996 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:49 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:49.996 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:49 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:49.996 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:49 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-08-10T11:45:49.996 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:49 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-08-10T11:45:49.996 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:49 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-08-10T11:45:49.996 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:49 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:49.996 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:49 smithi073 ceph-mon[128869]: Deploying daemon mgr.y on smithi152 2023-08-10T11:45:50.077 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:49 smithi152 ceph-mon[130220]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:50.077 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:49 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:50.078 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:49 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:50.078 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:49 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:50.078 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:49 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-08-10T11:45:50.078 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:49 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-08-10T11:45:50.078 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:49 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-08-10T11:45:50.078 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:49 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:50.078 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:49 smithi152 ceph-mon[130220]: Deploying daemon mgr.y on smithi152 2023-08-10T11:45:50.253 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:49 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:45:49.832+0000 7f9563088200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-10T11:45:50.254 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:49 smithi156 ceph-mon[130574]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:50.254 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:49 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:50.254 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:49 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:50.254 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:49 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:50.254 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:49 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-08-10T11:45:50.254 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:49 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-08-10T11:45:50.254 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:49 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-08-10T11:45:50.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:49 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:50.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:49 smithi156 ceph-mon[130574]: Deploying daemon mgr.y on smithi152 2023-08-10T11:45:50.505 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:50 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:45:50.251+0000 7f9563088200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-10T11:45:50.684 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:50 smithi152 systemd[1]: Starting Ceph mgr.y for 0e619a74-3773-11ee-9b37-001a4aab830c... 2023-08-10T11:45:50.973 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:50 smithi152 podman[131652]: 2023-08-10T11:45:51.009 INFO:teuthology.orchestra.run.smithi073.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-08-10T11:45:51.009 INFO:teuthology.orchestra.run.smithi073.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-08-10T11:45:51.009 INFO:teuthology.orchestra.run.smithi073.stderr: stderr: 10+0 records in 2023-08-10T11:45:51.010 INFO:teuthology.orchestra.run.smithi073.stderr:10+0 records out 2023-08-10T11:45:51.010 INFO:teuthology.orchestra.run.smithi073.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111406 s, 941 MB/s 2023-08-10T11:45:51.010 INFO:teuthology.orchestra.run.smithi073.stderr:--> Zapping successful for: 2023-08-10T11:45:51.245 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:50 smithi152 ceph-mgr[131692]: -- 172.21.15.152:0/3200058608 <== mon.2 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555ca3b931e0 con 0x555ca3b68c00 2023-08-10T11:45:51.245 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:50 smithi152 bash[131652]: c62c688b1b3cb5dcca73744a23a32a9dc8e3e40ed3d67f85d2b46b9170289f13 2023-08-10T11:45:51.245 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:50 smithi152 systemd[1]: Started Ceph mgr.y for 0e619a74-3773-11ee-9b37-001a4aab830c. 2023-08-10T11:45:51.246 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:51 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:45:51.096+0000 7f78eb60f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-10T11:45:51.246 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:51 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:45:51.178+0000 7f78eb60f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-10T11:45:51.255 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:50 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:45:50.829+0000 7f9563088200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-10T11:45:51.255 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:51 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:45:51.001+0000 7f9563088200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-10T11:45:51.380 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi073:vg_nvme/lv_4 2023-08-10T11:45:51.554 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:51 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:45:51.273+0000 7f78eb60f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-10T11:45:51.554 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:51 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:45:51.372+0000 7f78eb60f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-10T11:45:51.554 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:51 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:45:51.552+0000 7f78eb60f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-10T11:45:51.931 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:45:52.085 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:51 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:45:51.812+0000 7f9563088200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-10T11:45:52.085 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:51 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:45:51.909+0000 7f9563088200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-10T11:45:52.085 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:51 smithi156 ceph-mon[130574]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:52.085 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:51 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:52.086 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:51 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:52.086 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:51 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:52.086 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:51 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:52.086 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:51 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:45:52.107 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:51 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:45:51.879+0000 7f78eb60f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-10T11:45:52.107 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:51 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:45:51.971+0000 7f78eb60f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-10T11:45:52.107 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:51 smithi152 ceph-mon[130220]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:52.107 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:51 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:52.108 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:51 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:52.108 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:51 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:52.108 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:51 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:52.108 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:51 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:45:52.109 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:51 smithi073 ceph-mon[128869]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:52.109 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:51 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:52.109 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:51 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:52.110 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:51 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:52.110 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:51 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:52.110 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:51 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:45:52.394 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:52 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:45:52.084+0000 7f9563088200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-10T11:45:52.495 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:52 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:45:52.106+0000 7f78eb60f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-10T11:45:52.495 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:52 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:45:52.207+0000 7f78eb60f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-10T11:45:52.755 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:52 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:45:52.393+0000 7f9563088200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-10T11:45:52.755 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:52 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:45:52.634+0000 7f9563088200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-10T11:45:52.995 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:52 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:45:52.665+0000 7f78eb60f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-10T11:45:53.051 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:52 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:45:52.785+0000 7f9563088200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-10T11:45:53.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.244+0000 7f8f6c0ff700 1 -- 172.21.15.73:0/1092115504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f641003d0 msgr2=0x7f8f64107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:53.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.244+0000 7f8f6c0ff700 1 --2- 172.21.15.73:0/1092115504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f641003d0 0x7f8f64107c90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8f540098f0 tx=0x7f8f54009c00 comp rx=0 tx=0).stop 2023-08-10T11:45:53.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.245+0000 7f8f6c0ff700 1 -- 172.21.15.73:0/1092115504 shutdown_connections 2023-08-10T11:45:53.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.245+0000 7f8f6c0ff700 1 --2- 172.21.15.73:0/1092115504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f641003d0 0x7f8f64107c90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:53.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.245+0000 7f8f6c0ff700 1 --2- 172.21.15.73:0/1092115504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f64100cf0 0x7f8f64101110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:53.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.245+0000 7f8f6c0ff700 1 --2- 172.21.15.73:0/1092115504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f640ffa30 0x7f8f640ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:53.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.245+0000 7f8f6c0ff700 1 -- 172.21.15.73:0/1092115504 >> 172.21.15.73:0/1092115504 conn(0x7f8f640fa480 msgr2=0x7f8f640fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:45:53.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.245+0000 7f8f6c0ff700 1 -- 172.21.15.73:0/1092115504 shutdown_connections 2023-08-10T11:45:53.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.245+0000 7f8f6c0ff700 1 -- 172.21.15.73:0/1092115504 wait complete. 2023-08-10T11:45:53.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.245+0000 7f8f6c0ff700 1 Processor -- start 2023-08-10T11:45:53.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.245+0000 7f8f6c0ff700 1 -- start start 2023-08-10T11:45:53.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.246+0000 7f8f6c0ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f640ffa30 0x7f8f64195370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:53.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.246+0000 7f8f6c0ff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f641003d0 0x7f8f641958b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:53.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.246+0000 7f8f6c0ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f64100cf0 0x7f8f6419c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:53.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.246+0000 7f8f6c0ff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6419cf00 con 0x7f8f641003d0 2023-08-10T11:45:53.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.246+0000 7f8f6c0ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6419d040 con 0x7f8f64100cf0 2023-08-10T11:45:53.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.246+0000 7f8f6c0ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6419d1d0 con 0x7f8f640ffa30 2023-08-10T11:45:53.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.246+0000 7f8f6969a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f641003d0 0x7f8f641958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:53.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.246+0000 7f8f6969a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f641003d0 0x7f8f641958b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58040/0 (socket says 172.21.15.73:58040) 2023-08-10T11:45:53.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.246+0000 7f8f6969a700 1 -- 172.21.15.73:0/1542017551 learned_addr learned my addr 172.21.15.73:0/1542017551 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:45:53.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.246+0000 7f8f69e9b700 1 --2- 172.21.15.73:0/1542017551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f640ffa30 0x7f8f64195370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:53.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.246+0000 7f8f6a69c700 1 --2- 172.21.15.73:0/1542017551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f64100cf0 0x7f8f6419c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:53.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.246+0000 7f8f6969a700 1 -- 172.21.15.73:0/1542017551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f640ffa30 msgr2=0x7f8f64195370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:53.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.246+0000 7f8f6969a700 1 --2- 172.21.15.73:0/1542017551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f640ffa30 0x7f8f64195370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:53.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.246+0000 7f8f6969a700 1 -- 172.21.15.73:0/1542017551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f64100cf0 msgr2=0x7f8f6419c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:45:53.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.246+0000 7f8f6969a700 1 --2- 172.21.15.73:0/1542017551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f64100cf0 0x7f8f6419c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:45:53.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.246+0000 7f8f6969a700 1 -- 172.21.15.73:0/1542017551 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f54009520 con 0x7f8f641003d0 2023-08-10T11:45:53.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.246+0000 7f8f6969a700 1 --2- 172.21.15.73:0/1542017551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f641003d0 0x7f8f641958b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800e9f0 tx=0x7f8f5800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:45:53.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.246+0000 7f8f62ffd700 1 -- 172.21.15.73:0/1542017551 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f58004a30 con 0x7f8f641003d0 2023-08-10T11:45:53.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.246+0000 7f8f62ffd700 1 -- 172.21.15.73:0/1542017551 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f580054e0 con 0x7f8f641003d0 2023-08-10T11:45:53.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.246+0000 7f8f6c0ff700 1 -- 172.21.15.73:0/1542017551 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6419d4b0 con 0x7f8f641003d0 2023-08-10T11:45:53.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.246+0000 7f8f62ffd700 1 -- 172.21.15.73:0/1542017551 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5800cc80 con 0x7f8f641003d0 2023-08-10T11:45:53.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.247+0000 7f8f6c0ff700 1 -- 172.21.15.73:0/1542017551 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6419d9b0 con 0x7f8f641003d0 2023-08-10T11:45:53.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.247+0000 7f8f62ffd700 1 -- 172.21.15.73:0/1542017551 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f8f58010430 con 0x7f8f641003d0 2023-08-10T11:45:53.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.247+0000 7f8f62ffd700 1 --2- 172.21.15.73:0/1542017551 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8f4c0389e0 0x7f8f4c03aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:45:53.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.247+0000 7f8f62ffd700 1 -- 172.21.15.73:0/1542017551 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8f58014070 con 0x7f8f641003d0 2023-08-10T11:45:53.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.248+0000 7f8f69e9b700 1 --2- 172.21.15.73:0/1542017551 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8f4c0389e0 0x7f8f4c03aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:45:53.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.248+0000 7f8f6c0ff700 1 -- 172.21.15.73:0/1542017551 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f64106dc0 con 0x7f8f641003d0 2023-08-10T11:45:53.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.248+0000 7f8f69e9b700 1 --2- 172.21.15.73:0/1542017551 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8f4c0389e0 0x7f8f4c03aea0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8f64068910 tx=0x7f8f5c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:45:53.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.252+0000 7f8f62ffd700 1 -- 172.21.15.73:0/1542017551 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8f5800cde0 con 0x7f8f641003d0 2023-08-10T11:45:53.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:53.460+0000 7f8f6c0ff700 1 -- 172.21.15.73:0/1542017551 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f64060bb0 con 0x7f8f4c0389e0 2023-08-10T11:45:53.505 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:53 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:45:53.051+0000 7f9563088200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-10T11:45:53.720 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:53 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:45:53.253+0000 7f78eb60f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-10T11:45:53.721 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:53 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:45:53.424+0000 7f78eb60f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-10T11:45:53.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:53 smithi152 ceph-mon[130220]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:53.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:53 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:53.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:53 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:53.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:53 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:53.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:53 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:53.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:53 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:53.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:53 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:45:53.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:53 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:53.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:53 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-08-10T11:45:53.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:53 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-08-10T11:45:53.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:53 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:53.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:53 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:53.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:53 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:45:53.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:53 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:45:53.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:53 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:54.005 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:53 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:45:53.762+0000 7f9563088200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-10T11:45:54.005 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:53 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:45:53.893+0000 7f9563088200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-10T11:45:54.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:53 smithi156 ceph-mon[130574]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:54.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:53 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:54.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:53 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:54.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:53 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:54.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:53 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:54.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:53 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:54.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:53 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:45:54.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:53 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:54.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:53 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-08-10T11:45:54.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:53 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-08-10T11:45:54.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:53 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:54.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:53 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:54.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:53 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:45:54.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:53 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:45:54.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:53 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:54.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:53 smithi073 ceph-mon[128869]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:54.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:54.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:54.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:54.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:54.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:54.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:45:54.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:54.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-08-10T11:45:54.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-08-10T11:45:54.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:54.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:54.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:45:54.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:45:54.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:54.421 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:54 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:45:54.086+0000 7f9563088200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-10T11:45:54.421 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:54 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:45:54.201+0000 7f9563088200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-10T11:45:54.460 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:54 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:45:54.194+0000 7f78eb60f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-10T11:45:54.460 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:54 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:45:54.287+0000 7f78eb60f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-10T11:45:54.722 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:54 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:45:54.420+0000 7f9563088200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-10T11:45:54.722 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:54 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:45:54.459+0000 7f78eb60f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-10T11:45:54.978 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:54 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:45:54.736+0000 7f78eb60f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-10T11:45:54.979 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:54 smithi152 ceph-mon[130220]: Reconfiguring mgr.x (unknown last config time)... 2023-08-10T11:45:54.979 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:54 smithi152 ceph-mon[130220]: Reconfiguring daemon mgr.x on smithi073 2023-08-10T11:45:54.979 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:54 smithi152 ceph-mon[130220]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:45:54.979 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:54 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:54.979 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:54 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:54.980 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:54 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:45:54.980 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:54 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:54.980 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:54 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:45:54.980 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:54 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:55.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:54 smithi156 ceph-mon[130574]: Reconfiguring mgr.x (unknown last config time)... 2023-08-10T11:45:55.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:54 smithi156 ceph-mon[130574]: Reconfiguring daemon mgr.x on smithi073 2023-08-10T11:45:55.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:54 smithi156 ceph-mon[130574]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:45:55.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:54 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:55.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:54 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:55.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:54 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:45:55.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:54 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:55.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:54 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:45:55.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:54 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:55.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:54 smithi073 ceph-mon[128869]: Reconfiguring mgr.x (unknown last config time)... 2023-08-10T11:45:55.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:54 smithi073 ceph-mon[128869]: Reconfiguring daemon mgr.x on smithi073 2023-08-10T11:45:55.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:54 smithi073 ceph-mon[128869]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:45:55.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:54 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:55.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:54 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:55.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:54 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:45:55.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:54 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:45:55.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:54 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:45:55.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:54 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:45:55.245 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:54 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:45:54.977+0000 7f78eb60f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-10T11:45:55.245 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:55 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:45:55.125+0000 7f78eb60f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-10T11:45:55.723 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:55 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:45:55.385+0000 7f78eb60f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-10T11:45:55.724 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:45:55 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:45:55.279+0000 7f9563088200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-10T11:45:55.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:55 smithi152 ceph-mon[130220]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:55.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:55 smithi152 ceph-mon[130220]: Standby manager daemon z started 2023-08-10T11:45:55.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:55 smithi152 ceph-mon[130220]: from='mgr.? 172.21.15.156:0/539686469' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-08-10T11:45:55.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:55 smithi152 ceph-mon[130220]: from='mgr.? 172.21.15.156:0/539686469' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-10T11:45:55.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:55 smithi152 ceph-mon[130220]: from='mgr.? 172.21.15.156:0/539686469' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-08-10T11:45:55.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:55 smithi152 ceph-mon[130220]: from='mgr.? 172.21.15.156:0/539686469' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-10T11:45:56.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:55 smithi156 ceph-mon[130574]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:56.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:55 smithi156 ceph-mon[130574]: Standby manager daemon z started 2023-08-10T11:45:56.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:55 smithi156 ceph-mon[130574]: from='mgr.? 172.21.15.156:0/539686469' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-08-10T11:45:56.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:55 smithi156 ceph-mon[130574]: from='mgr.? 172.21.15.156:0/539686469' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-10T11:45:56.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:55 smithi156 ceph-mon[130574]: from='mgr.? 172.21.15.156:0/539686469' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-08-10T11:45:56.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:55 smithi156 ceph-mon[130574]: from='mgr.? 172.21.15.156:0/539686469' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-10T11:45:56.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:55 smithi073 ceph-mon[128869]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:56.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:55 smithi073 ceph-mon[128869]: Standby manager daemon z started 2023-08-10T11:45:56.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:55 smithi073 ceph-mon[128869]: from='mgr.? 172.21.15.156:0/539686469' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-08-10T11:45:56.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:55 smithi073 ceph-mon[128869]: from='mgr.? 172.21.15.156:0/539686469' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-10T11:45:56.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:55 smithi073 ceph-mon[128869]: from='mgr.? 172.21.15.156:0/539686469' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-08-10T11:45:56.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:55 smithi073 ceph-mon[128869]: from='mgr.? 172.21.15.156:0/539686469' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-10T11:45:56.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:56.143+0000 7f8f62ffd700 1 -- 172.21.15.73:0/1542017551 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 14) v1 ==== 90599+0+0 (secure 0 0 0) 0x7f8f580107d0 con 0x7f8f641003d0 2023-08-10T11:45:56.421 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:56 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:45:56.095+0000 7f78eb60f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-10T11:45:56.421 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:56 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:45:56.227+0000 7f78eb60f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-10T11:45:56.743 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:56 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:45:56.420+0000 7f78eb60f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-10T11:45:56.743 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:56 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:45:56.533+0000 7f78eb60f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-10T11:45:56.995 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:56 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:45:56.750+0000 7f78eb60f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-10T11:45:56.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:56 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/2122944984' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3219ae18-cc4c-4712-b616-79f6949066e3"}]: dispatch 2023-08-10T11:45:56.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:56 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/2122944984' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3219ae18-cc4c-4712-b616-79f6949066e3"}]': finished 2023-08-10T11:45:56.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:56 smithi152 ceph-mon[130220]: osdmap e5: 1 total, 0 up, 1 in 2023-08-10T11:45:56.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:56 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T11:45:56.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:56 smithi152 ceph-mon[130220]: mgrmap e14: x(active, since 67s), standbys: z 2023-08-10T11:45:56.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:56 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-08-10T11:45:56.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:56 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3597465306' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:45:57.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:56 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/2122944984' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3219ae18-cc4c-4712-b616-79f6949066e3"}]: dispatch 2023-08-10T11:45:57.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:56 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/2122944984' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3219ae18-cc4c-4712-b616-79f6949066e3"}]': finished 2023-08-10T11:45:57.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:56 smithi156 ceph-mon[130574]: osdmap e5: 1 total, 0 up, 1 in 2023-08-10T11:45:57.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:56 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T11:45:57.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:56 smithi156 ceph-mon[130574]: mgrmap e14: x(active, since 67s), standbys: z 2023-08-10T11:45:57.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:56 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-08-10T11:45:57.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:56 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3597465306' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:45:57.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:56 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2122944984' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3219ae18-cc4c-4712-b616-79f6949066e3"}]: dispatch 2023-08-10T11:45:57.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:56 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2122944984' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3219ae18-cc4c-4712-b616-79f6949066e3"}]': finished 2023-08-10T11:45:57.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:56 smithi073 ceph-mon[128869]: osdmap e5: 1 total, 0 up, 1 in 2023-08-10T11:45:57.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:56 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T11:45:57.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:56 smithi073 ceph-mon[128869]: mgrmap e14: x(active, since 67s), standbys: z 2023-08-10T11:45:57.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:56 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-08-10T11:45:57.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:56 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3597465306' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:45:57.995 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:45:57 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:45:57.608+0000 7f78eb60f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-10T11:45:57.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:57 smithi152 ceph-mon[130220]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:57.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:57 smithi152 ceph-mon[130220]: Standby manager daemon y started 2023-08-10T11:45:57.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:57 smithi152 ceph-mon[130220]: from='mgr.? 172.21.15.152:0/1113273239' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-08-10T11:45:57.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:57 smithi152 ceph-mon[130220]: from='mgr.? 172.21.15.152:0/1113273239' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-10T11:45:57.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:57 smithi152 ceph-mon[130220]: from='mgr.? 172.21.15.152:0/1113273239' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-08-10T11:45:57.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:57 smithi152 ceph-mon[130220]: from='mgr.? 172.21.15.152:0/1113273239' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-10T11:45:58.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:57 smithi156 ceph-mon[130574]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:58.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:57 smithi156 ceph-mon[130574]: Standby manager daemon y started 2023-08-10T11:45:58.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:57 smithi156 ceph-mon[130574]: from='mgr.? 172.21.15.152:0/1113273239' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-08-10T11:45:58.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:57 smithi156 ceph-mon[130574]: from='mgr.? 172.21.15.152:0/1113273239' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-10T11:45:58.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:57 smithi156 ceph-mon[130574]: from='mgr.? 172.21.15.152:0/1113273239' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-08-10T11:45:58.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:57 smithi156 ceph-mon[130574]: from='mgr.? 172.21.15.152:0/1113273239' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-10T11:45:58.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:57 smithi073 ceph-mon[128869]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:58.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:57 smithi073 ceph-mon[128869]: Standby manager daemon y started 2023-08-10T11:45:58.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:57 smithi073 ceph-mon[128869]: from='mgr.? 172.21.15.152:0/1113273239' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-08-10T11:45:58.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:57 smithi073 ceph-mon[128869]: from='mgr.? 172.21.15.152:0/1113273239' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-10T11:45:58.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:57 smithi073 ceph-mon[128869]: from='mgr.? 172.21.15.152:0/1113273239' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-08-10T11:45:58.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:57 smithi073 ceph-mon[128869]: from='mgr.? 172.21.15.152:0/1113273239' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-10T11:45:58.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:45:58.150+0000 7f8f62ffd700 1 -- 172.21.15.73:0/1542017551 <== mon.0 v2:172.21.15.73:3300/0 8 ==== mgrmap(e 15) v1 ==== 135659+0+0 (secure 0 0 0) 0x7f8f5801dd20 con 0x7f8f641003d0 2023-08-10T11:45:59.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:59 smithi152 ceph-mon[130220]: mgrmap e15: x(active, since 69s), standbys: z, y 2023-08-10T11:45:59.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:59 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-08-10T11:45:59.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:45:59 smithi152 ceph-mon[130220]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:59.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:59 smithi156 ceph-mon[130574]: mgrmap e15: x(active, since 69s), standbys: z, y 2023-08-10T11:45:59.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:59 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-08-10T11:45:59.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:45:59 smithi156 ceph-mon[130574]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:45:59.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:59 smithi073 ceph-mon[128869]: mgrmap e15: x(active, since 69s), standbys: z, y 2023-08-10T11:45:59.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:59 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-08-10T11:45:59.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:45:59 smithi073 ceph-mon[128869]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:46:01.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:01 smithi152 ceph-mon[130220]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:46:01.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:01 smithi156 ceph-mon[130574]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:46:01.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:01 smithi073 ceph-mon[128869]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:46:03.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:03 smithi152 ceph-mon[130220]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:46:03.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:03 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-08-10T11:46:03.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:03 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:03.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:03 smithi152 ceph-mon[130220]: Deploying daemon osd.0 on smithi073 2023-08-10T11:46:03.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:03 smithi156 ceph-mon[130574]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:46:03.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:03 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-08-10T11:46:03.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:03 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:03.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:03 smithi156 ceph-mon[130574]: Deploying daemon osd.0 on smithi073 2023-08-10T11:46:03.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:03 smithi073 ceph-mon[128869]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:46:03.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:03 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-08-10T11:46:03.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:03 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:03.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:03 smithi073 ceph-mon[128869]: Deploying daemon osd.0 on smithi073 2023-08-10T11:46:05.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:05 smithi152 ceph-mon[130220]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:46:05.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:05 smithi156 ceph-mon[130574]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:46:05.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:05 smithi073 ceph-mon[128869]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:46:07.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:07 smithi152 ceph-mon[130220]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:46:07.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:07 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:07.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:07 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:07.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:07 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:46:07.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:07 smithi156 ceph-mon[130574]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:46:07.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:07 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:07.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:07 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:07.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:07 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:46:07.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:07 smithi073 ceph-mon[128869]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:46:07.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:07 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:07.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:07 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:07.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:07 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:46:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:09 smithi152 ceph-mon[130220]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:46:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:09 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:09 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:09 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:09.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:09 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:46:09.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:09 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:09.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:09 smithi156 ceph-mon[130574]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:46:09.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:09 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:09.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:09 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:09.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:09 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:09.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:09 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:46:09.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:09 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:09.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:09 smithi073 ceph-mon[128869]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:46:09.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:09 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:09.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:09 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:09.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:09 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:09.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:09 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:46:09.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:09 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:09.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:09.964+0000 7f8f62ffd700 1 -- 172.21.15.73:0/1542017551 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8f64060bb0 con 0x7f8f4c0389e0 2023-08-10T11:46:09.965 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 0 on host 'smithi073' 2023-08-10T11:46:09.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:09.966+0000 7f8f6c0ff700 1 -- 172.21.15.73:0/1542017551 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8f4c0389e0 msgr2=0x7f8f4c03aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:46:09.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:09.966+0000 7f8f6c0ff700 1 --2- 172.21.15.73:0/1542017551 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8f4c0389e0 0x7f8f4c03aea0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8f64068910 tx=0x7f8f5c00b040 comp rx=0 tx=0).stop 2023-08-10T11:46:09.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:09.966+0000 7f8f6c0ff700 1 -- 172.21.15.73:0/1542017551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f641003d0 msgr2=0x7f8f641958b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:46:09.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:09.966+0000 7f8f6c0ff700 1 --2- 172.21.15.73:0/1542017551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f641003d0 0x7f8f641958b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800e9f0 tx=0x7f8f5800ed00 comp rx=0 tx=0).stop 2023-08-10T11:46:09.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:09.966+0000 7f8f6c0ff700 1 -- 172.21.15.73:0/1542017551 shutdown_connections 2023-08-10T11:46:09.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:09.966+0000 7f8f6c0ff700 1 --2- 172.21.15.73:0/1542017551 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8f4c0389e0 0x7f8f4c03aea0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:46:09.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:09.966+0000 7f8f6c0ff700 1 --2- 172.21.15.73:0/1542017551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f64100cf0 0x7f8f6419c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:46:09.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:09.966+0000 7f8f6c0ff700 1 --2- 172.21.15.73:0/1542017551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f640ffa30 0x7f8f64195370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:46:09.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:09.966+0000 7f8f6c0ff700 1 --2- 172.21.15.73:0/1542017551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f641003d0 0x7f8f641958b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:46:09.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:09.966+0000 7f8f6c0ff700 1 -- 172.21.15.73:0/1542017551 >> 172.21.15.73:0/1542017551 conn(0x7f8f640fa480 msgr2=0x7f8f64103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:46:09.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:09.967+0000 7f8f6c0ff700 1 -- 172.21.15.73:0/1542017551 shutdown_connections 2023-08-10T11:46:09.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:09.967+0000 7f8f6c0ff700 1 -- 172.21.15.73:0/1542017551 wait complete. 2023-08-10T11:46:10.437 DEBUG:teuthology.orchestra.run.smithi073:osd.0> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@osd.0.service 2023-08-10T11:46:10.439 INFO:tasks.cephadm:Deploying osd.1 on smithi152 with /dev/vg_nvme/lv_4... 2023-08-10T11:46:10.439 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-08-10T11:46:10.467 INFO:journalctl@ceph.osd.0.smithi073.stdout:-- Logs begin at Thu 2023-08-10 11:15:25 UTC. -- 2023-08-10T11:46:10.986 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.b/config 2023-08-10T11:46:11.209 INFO:journalctl@ceph.osd.0.smithi073.stdout:Aug 10 11:46:11 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-0[141854]: 2023-08-10T11:46:11.039+0000 7f3c82cc5640 -1 osd.0 0 log_to_monitors true 2023-08-10T11:46:11.209 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:10 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:11.209 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:10 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:11.209 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:10 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:46:11.209 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:10 smithi073 ceph-mon[128869]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:46:11.213 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:10 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:11.213 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:10 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:11.213 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:10 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:46:11.213 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:10 smithi152 ceph-mon[130220]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:46:11.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:10 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:11.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:10 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:11.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:10 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:46:11.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:10 smithi156 ceph-mon[130574]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:46:12.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:11 smithi073 ceph-mon[128869]: from='osd.0 [v2:172.21.15.73:6802/2725694252,v1:172.21.15.73:6803/2725694252]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-08-10T11:46:12.194 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:11 smithi152 ceph-mon[130220]: from='osd.0 [v2:172.21.15.73:6802/2725694252,v1:172.21.15.73:6803/2725694252]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-08-10T11:46:12.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:11 smithi156 ceph-mon[130574]: from='osd.0 [v2:172.21.15.73:6802/2725694252,v1:172.21.15.73:6803/2725694252]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-08-10T11:46:12.615 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-08-10T11:46:12.615 INFO:teuthology.orchestra.run.smithi152.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-08-10T11:46:12.615 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10+0 records in 2023-08-10T11:46:12.616 INFO:teuthology.orchestra.run.smithi152.stderr:10+0 records out 2023-08-10T11:46:12.616 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112449 s, 932 MB/s 2023-08-10T11:46:12.616 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping successful for: 2023-08-10T11:46:13.041 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi152:vg_nvme/lv_4 2023-08-10T11:46:13.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:12 smithi152 ceph-mon[130220]: from='osd.0 [v2:172.21.15.73:6802/2725694252,v1:172.21.15.73:6803/2725694252]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-08-10T11:46:13.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:12 smithi152 ceph-mon[130220]: osdmap e6: 1 total, 0 up, 1 in 2023-08-10T11:46:13.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:12 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T11:46:13.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:12 smithi152 ceph-mon[130220]: from='osd.0 [v2:172.21.15.73:6802/2725694252,v1:172.21.15.73:6803/2725694252]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2023-08-10T11:46:13.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:12 smithi152 ceph-mon[130220]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:46:13.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:12 smithi152 ceph-mon[130220]: Detected new or changed devices on smithi073 2023-08-10T11:46:13.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:12 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:13.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:12 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:13.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:12 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:46:13.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:12 smithi152 ceph-mon[130220]: Adjusting osd_memory_target on smithi073 to 17168M 2023-08-10T11:46:13.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:12 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:13.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:12 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:13.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:12 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:46:13.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:12 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:13.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:12 smithi156 ceph-mon[130574]: from='osd.0 [v2:172.21.15.73:6802/2725694252,v1:172.21.15.73:6803/2725694252]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-08-10T11:46:13.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:12 smithi156 ceph-mon[130574]: osdmap e6: 1 total, 0 up, 1 in 2023-08-10T11:46:13.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:12 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T11:46:13.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:12 smithi156 ceph-mon[130574]: from='osd.0 [v2:172.21.15.73:6802/2725694252,v1:172.21.15.73:6803/2725694252]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2023-08-10T11:46:13.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:12 smithi156 ceph-mon[130574]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:46:13.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:12 smithi156 ceph-mon[130574]: Detected new or changed devices on smithi073 2023-08-10T11:46:13.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:12 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:13.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:12 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:13.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:12 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:46:13.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:12 smithi156 ceph-mon[130574]: Adjusting osd_memory_target on smithi073 to 17168M 2023-08-10T11:46:13.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:12 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:13.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:12 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:13.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:12 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:46:13.258 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:12 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:13.267 INFO:journalctl@ceph.osd.0.smithi073.stdout:Aug 10 11:46:12 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-0[141854]: 2023-08-10T11:46:12.941+0000 7f3c77b3c700 -1 osd.0 0 waiting for initial osdmap 2023-08-10T11:46:13.268 INFO:journalctl@ceph.osd.0.smithi073.stdout:Aug 10 11:46:12 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-0[141854]: 2023-08-10T11:46:12.944+0000 7f3c7212e700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T11:46:13.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:12 smithi073 ceph-mon[128869]: from='osd.0 [v2:172.21.15.73:6802/2725694252,v1:172.21.15.73:6803/2725694252]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-08-10T11:46:13.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:12 smithi073 ceph-mon[128869]: osdmap e6: 1 total, 0 up, 1 in 2023-08-10T11:46:13.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:12 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T11:46:13.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:12 smithi073 ceph-mon[128869]: from='osd.0 [v2:172.21.15.73:6802/2725694252,v1:172.21.15.73:6803/2725694252]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2023-08-10T11:46:13.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:12 smithi073 ceph-mon[128869]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T11:46:13.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:12 smithi073 ceph-mon[128869]: Detected new or changed devices on smithi073 2023-08-10T11:46:13.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:12 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:13.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:12 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:13.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:12 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:46:13.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:12 smithi073 ceph-mon[128869]: Adjusting osd_memory_target on smithi073 to 17168M 2023-08-10T11:46:13.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:12 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:13.270 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:12 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:13.270 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:12 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:46:13.270 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:12 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:13.591 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.b/config 2023-08-10T11:46:14.181 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:13 smithi152 ceph-mon[130220]: from='osd.0 [v2:172.21.15.73:6802/2725694252,v1:172.21.15.73:6803/2725694252]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2023-08-10T11:46:14.181 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:13 smithi152 ceph-mon[130220]: osdmap e7: 1 total, 0 up, 1 in 2023-08-10T11:46:14.181 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:13 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T11:46:14.182 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:13 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T11:46:14.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:13 smithi156 ceph-mon[130574]: from='osd.0 [v2:172.21.15.73:6802/2725694252,v1:172.21.15.73:6803/2725694252]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2023-08-10T11:46:14.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:13 smithi156 ceph-mon[130574]: osdmap e7: 1 total, 0 up, 1 in 2023-08-10T11:46:14.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:13 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T11:46:14.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:13 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T11:46:14.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:13 smithi073 ceph-mon[128869]: from='osd.0 [v2:172.21.15.73:6802/2725694252,v1:172.21.15.73:6803/2725694252]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2023-08-10T11:46:14.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:13 smithi073 ceph-mon[128869]: osdmap e7: 1 total, 0 up, 1 in 2023-08-10T11:46:14.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:13 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T11:46:14.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:13 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T11:46:14.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.910+0000 7f0d98a94700 1 -- 172.21.15.152:0/2329436104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d940ff700 msgr2=0x7f0d940ffb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:46:14.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.910+0000 7f0d98a94700 1 --2- 172.21.15.152:0/2329436104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d940ff700 0x7f0d940ffb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0d880099c0 tx=0x7f0d88009cd0 comp rx=0 tx=0).stop 2023-08-10T11:46:14.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.910+0000 7f0d98a94700 1 -- 172.21.15.152:0/2329436104 shutdown_connections 2023-08-10T11:46:14.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.910+0000 7f0d98a94700 1 --2- 172.21.15.152:0/2329436104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d940ff700 0x7f0d940ffb20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:46:14.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.910+0000 7f0d98a94700 1 --2- 172.21.15.152:0/2329436104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d941012a0 0x7f0d94107b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:46:14.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.910+0000 7f0d98a94700 1 --2- 172.21.15.152:0/2329436104 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d94100900 0x7f0d94100d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:46:14.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.910+0000 7f0d98a94700 1 -- 172.21.15.152:0/2329436104 >> 172.21.15.152:0/2329436104 conn(0x7f0d940fac80 msgr2=0x7f0d940fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:46:14.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.910+0000 7f0d98a94700 1 -- 172.21.15.152:0/2329436104 shutdown_connections 2023-08-10T11:46:14.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.910+0000 7f0d98a94700 1 -- 172.21.15.152:0/2329436104 wait complete. 2023-08-10T11:46:14.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.911+0000 7f0d98a94700 1 Processor -- start 2023-08-10T11:46:14.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.911+0000 7f0d98a94700 1 -- start start 2023-08-10T11:46:14.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.911+0000 7f0d98a94700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d940ff700 0x7f0d94195330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:46:14.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.911+0000 7f0d98a94700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d94100900 0x7f0d94195870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:46:14.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.911+0000 7f0d98a94700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d941012a0 0x7f0d9419c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:46:14.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.911+0000 7f0d98a94700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9419cec0 con 0x7f0d940ff700 2023-08-10T11:46:14.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.911+0000 7f0d98a94700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9419d000 con 0x7f0d941012a0 2023-08-10T11:46:14.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.911+0000 7f0d98a94700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9419d190 con 0x7f0d94100900 2023-08-10T11:46:14.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.911+0000 7f0d92d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d941012a0 0x7f0d9419c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:46:14.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.911+0000 7f0d92d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d941012a0 0x7f0d9419c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43858/0 (socket says 172.21.15.152:43858) 2023-08-10T11:46:14.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.911+0000 7f0d92d9d700 1 -- 172.21.15.152:0/2419947462 learned_addr learned my addr 172.21.15.152:0/2419947462 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-08-10T11:46:14.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.911+0000 7f0d91d9b700 1 --2- 172.21.15.152:0/2419947462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d94100900 0x7f0d94195870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:46:14.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.911+0000 7f0d9259c700 1 --2- 172.21.15.152:0/2419947462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d940ff700 0x7f0d94195330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:46:14.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.911+0000 7f0d92d9d700 1 -- 172.21.15.152:0/2419947462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d94100900 msgr2=0x7f0d94195870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:46:14.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.911+0000 7f0d92d9d700 1 --2- 172.21.15.152:0/2419947462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d94100900 0x7f0d94195870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:46:14.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.911+0000 7f0d92d9d700 1 -- 172.21.15.152:0/2419947462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d940ff700 msgr2=0x7f0d94195330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:46:14.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.911+0000 7f0d92d9d700 1 --2- 172.21.15.152:0/2419947462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d940ff700 0x7f0d94195330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:46:14.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.911+0000 7f0d92d9d700 1 -- 172.21.15.152:0/2419947462 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d880095f0 con 0x7f0d941012a0 2023-08-10T11:46:14.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.911+0000 7f0d9259c700 1 --2- 172.21.15.152:0/2419947462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d940ff700 0x7f0d94195330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:46:14.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.912+0000 7f0d92d9d700 1 --2- 172.21.15.152:0/2419947462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d941012a0 0x7f0d9419c8f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00ada0 tx=0x7f0d8c00c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:46:14.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.912+0000 7f0d837fe700 1 -- 172.21.15.152:0/2419947462 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c00f070 con 0x7f0d941012a0 2023-08-10T11:46:14.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.912+0000 7f0d837fe700 1 -- 172.21.15.152:0/2419947462 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d8c007b30 con 0x7f0d941012a0 2023-08-10T11:46:14.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.912+0000 7f0d837fe700 1 -- 172.21.15.152:0/2419947462 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c0053e0 con 0x7f0d941012a0 2023-08-10T11:46:14.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.912+0000 7f0d98a94700 1 -- 172.21.15.152:0/2419947462 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d9419d470 con 0x7f0d941012a0 2023-08-10T11:46:14.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.912+0000 7f0d98a94700 1 -- 172.21.15.152:0/2419947462 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d9419d920 con 0x7f0d941012a0 2023-08-10T11:46:14.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.913+0000 7f0d98a94700 1 -- 172.21.15.152:0/2419947462 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d94106ca0 con 0x7f0d941012a0 2023-08-10T11:46:14.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.914+0000 7f0d837fe700 1 -- 172.21.15.152:0/2419947462 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 15) v1 ==== 135659+0+0 (secure 0 0 0) 0x7f0d8c00c980 con 0x7f0d941012a0 2023-08-10T11:46:14.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.914+0000 7f0d837fe700 1 --2- 172.21.15.152:0/2419947462 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0d7c0a1140 0x7f0d7c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:46:14.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.915+0000 7f0d837fe700 1 -- 172.21.15.152:0/2419947462 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1767+0+0 (secure 0 0 0) 0x7f0d8c0ca9e0 con 0x7f0d941012a0 2023-08-10T11:46:14.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.915+0000 7f0d9259c700 1 --2- 172.21.15.152:0/2419947462 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0d7c0a1140 0x7f0d7c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:46:14.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.915+0000 7f0d9259c700 1 --2- 172.21.15.152:0/2419947462 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0d7c0a1140 0x7f0d7c0a3600 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800b580 tx=0x7f0d88005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:46:14.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:14.918+0000 7f0d837fe700 1 -- 172.21.15.152:0/2419947462 <== mon.2 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0d8c095c30 con 0x7f0d941012a0 2023-08-10T11:46:14.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:14 smithi152 ceph-mon[130220]: purged_snaps scrub starts 2023-08-10T11:46:14.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:14 smithi152 ceph-mon[130220]: purged_snaps scrub ok 2023-08-10T11:46:14.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:14 smithi152 ceph-mon[130220]: osd.0 [v2:172.21.15.73:6802/2725694252,v1:172.21.15.73:6803/2725694252] boot 2023-08-10T11:46:14.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:14 smithi152 ceph-mon[130220]: osdmap e8: 1 total, 1 up, 1 in 2023-08-10T11:46:14.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:14 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T11:46:14.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:14 smithi152 ceph-mon[130220]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:15.116 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:15.115+0000 7f0d98a94700 1 -- 172.21.15.152:0/2419947462 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d94060bb0 con 0x7f0d7c0a1140 2023-08-10T11:46:15.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:14 smithi156 ceph-mon[130574]: purged_snaps scrub starts 2023-08-10T11:46:15.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:14 smithi156 ceph-mon[130574]: purged_snaps scrub ok 2023-08-10T11:46:15.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:14 smithi156 ceph-mon[130574]: osd.0 [v2:172.21.15.73:6802/2725694252,v1:172.21.15.73:6803/2725694252] boot 2023-08-10T11:46:15.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:14 smithi156 ceph-mon[130574]: osdmap e8: 1 total, 1 up, 1 in 2023-08-10T11:46:15.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:14 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T11:46:15.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:14 smithi156 ceph-mon[130574]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:15.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:14 smithi073 ceph-mon[128869]: purged_snaps scrub starts 2023-08-10T11:46:15.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:14 smithi073 ceph-mon[128869]: purged_snaps scrub ok 2023-08-10T11:46:15.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:14 smithi073 ceph-mon[128869]: osd.0 [v2:172.21.15.73:6802/2725694252,v1:172.21.15.73:6803/2725694252] boot 2023-08-10T11:46:15.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:14 smithi073 ceph-mon[128869]: osdmap e8: 1 total, 1 up, 1 in 2023-08-10T11:46:15.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:14 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T11:46:15.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:14 smithi073 ceph-mon[128869]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:16.232 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:15 smithi152 ceph-mon[130220]: osdmap e9: 1 total, 1 up, 1 in 2023-08-10T11:46:16.232 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:15 smithi152 ceph-mon[130220]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:46:16.233 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:15 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:46:16.233 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:15 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:46:16.233 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:15 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:16.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:15 smithi156 ceph-mon[130574]: osdmap e9: 1 total, 1 up, 1 in 2023-08-10T11:46:16.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:15 smithi156 ceph-mon[130574]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:46:16.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:15 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:46:16.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:15 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:46:16.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:15 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:16.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:15 smithi073 ceph-mon[128869]: osdmap e9: 1 total, 1 up, 1 in 2023-08-10T11:46:16.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:15 smithi073 ceph-mon[128869]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:46:16.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:15 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:46:16.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:15 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:46:16.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:15 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:17.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:16 smithi152 ceph-mon[130220]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:17.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:16 smithi156 ceph-mon[130574]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:17.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:16 smithi073 ceph-mon[128869]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:18.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:17 smithi152 ceph-mon[130220]: from='client.? 172.21.15.152:0/1184959864' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbfe6cd9-b3d3-4b8d-8814-507a867f8c02"}]: dispatch 2023-08-10T11:46:18.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:17 smithi152 ceph-mon[130220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbfe6cd9-b3d3-4b8d-8814-507a867f8c02"}]: dispatch 2023-08-10T11:46:18.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:17 smithi152 ceph-mon[130220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bbfe6cd9-b3d3-4b8d-8814-507a867f8c02"}]': finished 2023-08-10T11:46:18.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:17 smithi152 ceph-mon[130220]: osdmap e10: 2 total, 1 up, 2 in 2023-08-10T11:46:18.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:17 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T11:46:18.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:17 smithi156 ceph-mon[130574]: from='client.? 172.21.15.152:0/1184959864' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbfe6cd9-b3d3-4b8d-8814-507a867f8c02"}]: dispatch 2023-08-10T11:46:18.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:17 smithi156 ceph-mon[130574]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbfe6cd9-b3d3-4b8d-8814-507a867f8c02"}]: dispatch 2023-08-10T11:46:18.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:17 smithi156 ceph-mon[130574]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bbfe6cd9-b3d3-4b8d-8814-507a867f8c02"}]': finished 2023-08-10T11:46:18.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:17 smithi156 ceph-mon[130574]: osdmap e10: 2 total, 1 up, 2 in 2023-08-10T11:46:18.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:17 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T11:46:18.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:17 smithi073 ceph-mon[128869]: from='client.? 172.21.15.152:0/1184959864' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbfe6cd9-b3d3-4b8d-8814-507a867f8c02"}]: dispatch 2023-08-10T11:46:18.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:17 smithi073 ceph-mon[128869]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbfe6cd9-b3d3-4b8d-8814-507a867f8c02"}]: dispatch 2023-08-10T11:46:18.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:17 smithi073 ceph-mon[128869]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bbfe6cd9-b3d3-4b8d-8814-507a867f8c02"}]': finished 2023-08-10T11:46:18.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:17 smithi073 ceph-mon[128869]: osdmap e10: 2 total, 1 up, 2 in 2023-08-10T11:46:18.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:17 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T11:46:19.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:18 smithi152 ceph-mon[130220]: from='client.? 172.21.15.152:0/3241939767' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:46:19.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:18 smithi152 ceph-mon[130220]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:19.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:18 smithi156 ceph-mon[130574]: from='client.? 172.21.15.152:0/3241939767' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:46:19.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:18 smithi156 ceph-mon[130574]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:19.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:18 smithi073 ceph-mon[128869]: from='client.? 172.21.15.152:0/3241939767' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:46:19.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:18 smithi073 ceph-mon[128869]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:21.696 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:21 smithi152 ceph-mon[130220]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:21.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:21 smithi156 ceph-mon[130574]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:21.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:21 smithi073 ceph-mon[128869]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:23.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:23 smithi152 ceph-mon[130220]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:23.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:23 smithi156 ceph-mon[130574]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:23.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:23 smithi073 ceph-mon[128869]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:24.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:24 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-08-10T11:46:24.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:24 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:24.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:24 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-08-10T11:46:24.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:24 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:24.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:24 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-08-10T11:46:24.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:24 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:25.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:25 smithi152 ceph-mon[130220]: Deploying daemon osd.1 on smithi152 2023-08-10T11:46:25.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:25 smithi152 ceph-mon[130220]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:25.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:25 smithi156 ceph-mon[130574]: Deploying daemon osd.1 on smithi152 2023-08-10T11:46:25.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:25 smithi156 ceph-mon[130574]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:25.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:25 smithi073 ceph-mon[128869]: Deploying daemon osd.1 on smithi152 2023-08-10T11:46:25.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:25 smithi073 ceph-mon[128869]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:27.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:27 smithi152 ceph-mon[130220]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:27.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:27 smithi156 ceph-mon[130574]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:27.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:27 smithi073 ceph-mon[128869]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:29.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:29 smithi152 ceph-mon[130220]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:29.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:29 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:29.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:29 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:29.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:29 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:46:29.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:29 smithi156 ceph-mon[130574]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:29.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:29 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:29.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:29 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:29.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:29 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:46:29.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:29 smithi073 ceph-mon[128869]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:29.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:29 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:29.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:29 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:29.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:29 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:46:31.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:31 smithi152 ceph-mon[130220]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:31.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:31 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:31.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:31 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:31.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:31 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:31.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:31 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:46:31.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:31 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:31.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:31 smithi156 ceph-mon[130574]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:31.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:31 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:31.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:31 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:31.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:31 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:31.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:31 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:46:31.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:31 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:31.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:31 smithi073 ceph-mon[128869]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:31.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:31 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:31.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:31 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:31.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:31 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:31.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:31 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:46:31.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:31 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:31.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:31.833+0000 7f0d837fe700 1 -- 172.21.15.152:0/2419947462 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0d94060bb0 con 0x7f0d7c0a1140 2023-08-10T11:46:31.835 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 1 on host 'smithi152' 2023-08-10T11:46:31.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:31.837+0000 7f0d98a94700 1 -- 172.21.15.152:0/2419947462 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0d7c0a1140 msgr2=0x7f0d7c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:46:31.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:31.837+0000 7f0d98a94700 1 --2- 172.21.15.152:0/2419947462 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0d7c0a1140 0x7f0d7c0a3600 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800b580 tx=0x7f0d88005fb0 comp rx=0 tx=0).stop 2023-08-10T11:46:31.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:31.837+0000 7f0d98a94700 1 -- 172.21.15.152:0/2419947462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d941012a0 msgr2=0x7f0d9419c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:46:31.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:31.837+0000 7f0d98a94700 1 --2- 172.21.15.152:0/2419947462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d941012a0 0x7f0d9419c8f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00ada0 tx=0x7f0d8c00c330 comp rx=0 tx=0).stop 2023-08-10T11:46:31.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:31.837+0000 7f0d98a94700 1 -- 172.21.15.152:0/2419947462 shutdown_connections 2023-08-10T11:46:31.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:31.837+0000 7f0d98a94700 1 --2- 172.21.15.152:0/2419947462 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0d7c0a1140 0x7f0d7c0a3600 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:46:31.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:31.837+0000 7f0d98a94700 1 --2- 172.21.15.152:0/2419947462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d941012a0 0x7f0d9419c8f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:46:31.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:31.837+0000 7f0d98a94700 1 --2- 172.21.15.152:0/2419947462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d940ff700 0x7f0d94195330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:46:31.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:31.837+0000 7f0d98a94700 1 --2- 172.21.15.152:0/2419947462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d94100900 0x7f0d94195870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:46:31.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:31.837+0000 7f0d98a94700 1 -- 172.21.15.152:0/2419947462 >> 172.21.15.152:0/2419947462 conn(0x7f0d940fac80 msgr2=0x7f0d94103de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:46:31.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:31.837+0000 7f0d98a94700 1 -- 172.21.15.152:0/2419947462 shutdown_connections 2023-08-10T11:46:31.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:46:31.837+0000 7f0d98a94700 1 -- 172.21.15.152:0/2419947462 wait complete. 2023-08-10T11:46:32.283 DEBUG:teuthology.orchestra.run.smithi152:osd.1> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@osd.1.service 2023-08-10T11:46:32.285 INFO:tasks.cephadm:Deploying osd.2 on smithi156 with /dev/vg_nvme/lv_4... 2023-08-10T11:46:32.286 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-08-10T11:46:32.315 INFO:journalctl@ceph.osd.1.smithi152.stdout:-- Logs begin at Thu 2023-08-10 11:15:14 UTC. -- 2023-08-10T11:46:32.845 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T11:46:33.054 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:32 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:33.054 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:32 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:33.054 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:32 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:46:33.055 INFO:journalctl@ceph.osd.1.smithi152.stdout:Aug 10 11:46:32 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-1[135266]: 2023-08-10T11:46:32.914+0000 7fab5879b640 -1 osd.1 0 log_to_monitors true 2023-08-10T11:46:33.085 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:32 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:33.085 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:32 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:33.085 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:32 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:46:33.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:32 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:33.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:32 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:33.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:32 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:46:33.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:33 smithi152 ceph-mon[130220]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:33.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:33 smithi152 ceph-mon[130220]: from='osd.1 [v2:172.21.15.152:6800/836829168,v1:172.21.15.152:6801/836829168]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-08-10T11:46:33.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:33 smithi152 ceph-mon[130220]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-08-10T11:46:34.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:33 smithi156 ceph-mon[130574]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:34.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:33 smithi156 ceph-mon[130574]: from='osd.1 [v2:172.21.15.152:6800/836829168,v1:172.21.15.152:6801/836829168]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-08-10T11:46:34.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:33 smithi156 ceph-mon[130574]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-08-10T11:46:34.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:33 smithi073 ceph-mon[128869]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:34.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:33 smithi073 ceph-mon[128869]: from='osd.1 [v2:172.21.15.152:6800/836829168,v1:172.21.15.152:6801/836829168]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-08-10T11:46:34.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:33 smithi073 ceph-mon[128869]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-08-10T11:46:34.427 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-08-10T11:46:34.428 INFO:teuthology.orchestra.run.smithi156.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-08-10T11:46:34.428 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10+0 records in 2023-08-10T11:46:34.428 INFO:teuthology.orchestra.run.smithi156.stderr:10+0 records out 2023-08-10T11:46:34.428 INFO:teuthology.orchestra.run.smithi156.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0122687 s, 855 MB/s 2023-08-10T11:46:34.428 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping successful for: 2023-08-10T11:46:34.900 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi156:vg_nvme/lv_4 2023-08-10T11:46:34.995 INFO:journalctl@ceph.osd.1.smithi152.stdout:Aug 10 11:46:34 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-1[135266]: 2023-08-10T11:46:34.811+0000 7fab4d612700 -1 osd.1 0 waiting for initial osdmap 2023-08-10T11:46:34.995 INFO:journalctl@ceph.osd.1.smithi152.stdout:Aug 10 11:46:34 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-1[135266]: 2023-08-10T11:46:34.815+0000 7fab46401700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T11:46:34.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:34 smithi152 ceph-mon[130220]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-08-10T11:46:34.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:34 smithi152 ceph-mon[130220]: osdmap e11: 2 total, 1 up, 2 in 2023-08-10T11:46:34.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T11:46:34.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:34 smithi152 ceph-mon[130220]: from='osd.1 [v2:172.21.15.152:6800/836829168,v1:172.21.15.152:6801/836829168]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-08-10T11:46:34.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:34 smithi152 ceph-mon[130220]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-08-10T11:46:34.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:34.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:34.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:46:34.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:34.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:34.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:46:34.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:35.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:34 smithi156 ceph-mon[130574]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-08-10T11:46:35.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:34 smithi156 ceph-mon[130574]: osdmap e11: 2 total, 1 up, 2 in 2023-08-10T11:46:35.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:34 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T11:46:35.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:34 smithi156 ceph-mon[130574]: from='osd.1 [v2:172.21.15.152:6800/836829168,v1:172.21.15.152:6801/836829168]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-08-10T11:46:35.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:34 smithi156 ceph-mon[130574]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-08-10T11:46:35.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:34 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:35.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:34 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:35.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:34 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:46:35.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:34 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:35.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:34 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:35.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:34 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:46:35.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:34 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:35.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:34 smithi073 ceph-mon[128869]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-08-10T11:46:35.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:34 smithi073 ceph-mon[128869]: osdmap e11: 2 total, 1 up, 2 in 2023-08-10T11:46:35.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:34 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T11:46:35.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:34 smithi073 ceph-mon[128869]: from='osd.1 [v2:172.21.15.152:6800/836829168,v1:172.21.15.152:6801/836829168]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-08-10T11:46:35.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:34 smithi073 ceph-mon[128869]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-08-10T11:46:35.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:34 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:35.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:34 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:35.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:34 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:46:35.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:34 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:35.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:34 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:35.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:34 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:46:35.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:34 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:35.450 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T11:46:35.978 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:35 smithi156 ceph-mon[130574]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:35.978 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:35 smithi156 ceph-mon[130574]: Detected new or changed devices on smithi152 2023-08-10T11:46:35.978 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:35 smithi156 ceph-mon[130574]: Adjusting osd_memory_target on smithi152 to 17168M 2023-08-10T11:46:35.978 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:35 smithi156 ceph-mon[130574]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-08-10T11:46:35.978 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:35 smithi156 ceph-mon[130574]: osdmap e12: 2 total, 1 up, 2 in 2023-08-10T11:46:35.978 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:35 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T11:46:35.979 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:35 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T11:46:36.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:35 smithi152 ceph-mon[130220]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:36.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:35 smithi152 ceph-mon[130220]: Detected new or changed devices on smithi152 2023-08-10T11:46:36.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:35 smithi152 ceph-mon[130220]: Adjusting osd_memory_target on smithi152 to 17168M 2023-08-10T11:46:36.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:35 smithi152 ceph-mon[130220]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-08-10T11:46:36.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:35 smithi152 ceph-mon[130220]: osdmap e12: 2 total, 1 up, 2 in 2023-08-10T11:46:36.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:35 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T11:46:36.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:35 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T11:46:36.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:35 smithi073 ceph-mon[128869]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:36.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:35 smithi073 ceph-mon[128869]: Detected new or changed devices on smithi152 2023-08-10T11:46:36.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:35 smithi073 ceph-mon[128869]: Adjusting osd_memory_target on smithi152 to 17168M 2023-08-10T11:46:36.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:35 smithi073 ceph-mon[128869]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-08-10T11:46:36.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:35 smithi073 ceph-mon[128869]: osdmap e12: 2 total, 1 up, 2 in 2023-08-10T11:46:36.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:35 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T11:46:36.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:35 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T11:46:36.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.773+0000 7fbc6b32e700 1 -- 172.21.15.156:0/2755404815 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc64100340 msgr2=0x7fbc64107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:46:36.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.773+0000 7fbc6b32e700 1 --2- 172.21.15.156:0/2755404815 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc64100340 0x7fbc64107c00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c00b0a0 tx=0x7fbc5c00b3b0 comp rx=0 tx=0).stop 2023-08-10T11:46:36.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.773+0000 7fbc6b32e700 1 -- 172.21.15.156:0/2755404815 shutdown_connections 2023-08-10T11:46:36.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.773+0000 7fbc6b32e700 1 --2- 172.21.15.156:0/2755404815 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc64100340 0x7fbc64107c00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:46:36.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.773+0000 7fbc6b32e700 1 --2- 172.21.15.156:0/2755404815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc64100c60 0x7fbc64101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:46:36.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.773+0000 7fbc6b32e700 1 --2- 172.21.15.156:0/2755404815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc640ff9a0 0x7fbc640ffe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:46:36.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.773+0000 7fbc6b32e700 1 -- 172.21.15.156:0/2755404815 >> 172.21.15.156:0/2755404815 conn(0x7fbc640fa3f0 msgr2=0x7fbc640fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:46:36.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.773+0000 7fbc6b32e700 1 -- 172.21.15.156:0/2755404815 shutdown_connections 2023-08-10T11:46:36.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.773+0000 7fbc6b32e700 1 -- 172.21.15.156:0/2755404815 wait complete. 2023-08-10T11:46:36.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.774+0000 7fbc6b32e700 1 Processor -- start 2023-08-10T11:46:36.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.774+0000 7fbc6b32e700 1 -- start start 2023-08-10T11:46:36.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.774+0000 7fbc6b32e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc640ff9a0 0x7fbc640ff3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:46:36.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.774+0000 7fbc6b32e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc64100340 0x7fbc6419b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:46:36.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.774+0000 7fbc6b32e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc64100c60 0x7fbc6419d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:46:36.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.774+0000 7fbc6b32e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6419e000 con 0x7fbc64100c60 2023-08-10T11:46:36.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.774+0000 7fbc6b32e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6419e170 con 0x7fbc64100340 2023-08-10T11:46:36.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.774+0000 7fbc6b32e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6419e330 con 0x7fbc640ff9a0 2023-08-10T11:46:36.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.774+0000 7fbc690ca700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc640ff9a0 0x7fbc640ff3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:46:36.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.774+0000 7fbc690ca700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc640ff9a0 0x7fbc640ff3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36704/0 (socket says 172.21.15.156:36704) 2023-08-10T11:46:36.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.774+0000 7fbc690ca700 1 -- 172.21.15.156:0/3566680899 learned_addr learned my addr 172.21.15.156:0/3566680899 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-08-10T11:46:36.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.774+0000 7fbc698cb700 1 --2- 172.21.15.156:0/3566680899 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc64100c60 0x7fbc6419d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:46:36.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.774+0000 7fbc688c9700 1 --2- 172.21.15.156:0/3566680899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc64100340 0x7fbc6419b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:46:36.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.774+0000 7fbc690ca700 1 -- 172.21.15.156:0/3566680899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc64100340 msgr2=0x7fbc6419b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:46:36.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.774+0000 7fbc690ca700 1 --2- 172.21.15.156:0/3566680899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc64100340 0x7fbc6419b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:46:36.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.774+0000 7fbc690ca700 1 -- 172.21.15.156:0/3566680899 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc64100c60 msgr2=0x7fbc6419d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:46:36.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.774+0000 7fbc690ca700 1 --2- 172.21.15.156:0/3566680899 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc64100c60 0x7fbc6419d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:46:36.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.774+0000 7fbc690ca700 1 -- 172.21.15.156:0/3566680899 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5c009d00 con 0x7fbc640ff9a0 2023-08-10T11:46:36.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.774+0000 7fbc688c9700 1 --2- 172.21.15.156:0/3566680899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc64100340 0x7fbc6419b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:46:36.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.775+0000 7fbc690ca700 1 --2- 172.21.15.156:0/3566680899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc640ff9a0 0x7fbc640ff3f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400c990 tx=0x7fbc5400cca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:46:36.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.775+0000 7fbc5a7fc700 1 -- 172.21.15.156:0/3566680899 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc54007b00 con 0x7fbc640ff9a0 2023-08-10T11:46:36.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.775+0000 7fbc5a7fc700 1 -- 172.21.15.156:0/3566680899 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbc54007c60 con 0x7fbc640ff9a0 2023-08-10T11:46:36.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.775+0000 7fbc5a7fc700 1 -- 172.21.15.156:0/3566680899 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc54018660 con 0x7fbc640ff9a0 2023-08-10T11:46:36.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.775+0000 7fbc6b32e700 1 -- 172.21.15.156:0/3566680899 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc6419e610 con 0x7fbc640ff9a0 2023-08-10T11:46:36.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.775+0000 7fbc6b32e700 1 -- 172.21.15.156:0/3566680899 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6419eb10 con 0x7fbc640ff9a0 2023-08-10T11:46:36.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.776+0000 7fbc6b32e700 1 -- 172.21.15.156:0/3566680899 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc64106c60 con 0x7fbc640ff9a0 2023-08-10T11:46:36.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.777+0000 7fbc5a7fc700 1 -- 172.21.15.156:0/3566680899 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 15) v1 ==== 135659+0+0 (secure 0 0 0) 0x7fbc5400f450 con 0x7fbc640ff9a0 2023-08-10T11:46:36.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.778+0000 7fbc5a7fc700 1 --2- 172.21.15.156:0/3566680899 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fbc500a1140 0x7fbc500a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:46:36.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.778+0000 7fbc5a7fc700 1 -- 172.21.15.156:0/3566680899 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2309+0+0 (secure 0 0 0) 0x7fbc540cb000 con 0x7fbc640ff9a0 2023-08-10T11:46:36.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.778+0000 7fbc688c9700 1 --2- 172.21.15.156:0/3566680899 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fbc500a1140 0x7fbc500a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:46:36.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.779+0000 7fbc688c9700 1 --2- 172.21.15.156:0/3566680899 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fbc500a1140 0x7fbc500a3600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbc60005950 tx=0x7fbc600058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:46:36.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.782+0000 7fbc5a7fc700 1 -- 172.21.15.156:0/3566680899 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fbc540960b0 con 0x7fbc640ff9a0 2023-08-10T11:46:36.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:36.974+0000 7fbc6b32e700 1 -- 172.21.15.156:0/3566680899 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc64060bb0 con 0x7fbc500a1140 2023-08-10T11:46:37.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:36 smithi152 ceph-mon[130220]: purged_snaps scrub starts 2023-08-10T11:46:37.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:36 smithi152 ceph-mon[130220]: purged_snaps scrub ok 2023-08-10T11:46:37.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:36 smithi152 ceph-mon[130220]: osd.1 [v2:172.21.15.152:6800/836829168,v1:172.21.15.152:6801/836829168] boot 2023-08-10T11:46:37.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:36 smithi152 ceph-mon[130220]: osdmap e13: 2 total, 2 up, 2 in 2023-08-10T11:46:37.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:36 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T11:46:37.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:36 smithi156 ceph-mon[130574]: purged_snaps scrub starts 2023-08-10T11:46:37.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:36 smithi156 ceph-mon[130574]: purged_snaps scrub ok 2023-08-10T11:46:37.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:36 smithi156 ceph-mon[130574]: osd.1 [v2:172.21.15.152:6800/836829168,v1:172.21.15.152:6801/836829168] boot 2023-08-10T11:46:37.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:36 smithi156 ceph-mon[130574]: osdmap e13: 2 total, 2 up, 2 in 2023-08-10T11:46:37.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:36 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T11:46:37.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:36 smithi073 ceph-mon[128869]: purged_snaps scrub starts 2023-08-10T11:46:37.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:36 smithi073 ceph-mon[128869]: purged_snaps scrub ok 2023-08-10T11:46:37.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:36 smithi073 ceph-mon[128869]: osd.1 [v2:172.21.15.152:6800/836829168,v1:172.21.15.152:6801/836829168] boot 2023-08-10T11:46:37.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:36 smithi073 ceph-mon[128869]: osdmap e13: 2 total, 2 up, 2 in 2023-08-10T11:46:37.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:36 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T11:46:38.160 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:37 smithi156 ceph-mon[130574]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:38.161 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:37 smithi156 ceph-mon[130574]: osdmap e14: 2 total, 2 up, 2 in 2023-08-10T11:46:38.161 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:37 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:46:38.161 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:37 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:46:38.161 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:37 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:38.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:37 smithi152 ceph-mon[130220]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:38.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:37 smithi152 ceph-mon[130220]: osdmap e14: 2 total, 2 up, 2 in 2023-08-10T11:46:38.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:37 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:46:38.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:37 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:46:38.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:37 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:38.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:37 smithi073 ceph-mon[128869]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T11:46:38.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:37 smithi073 ceph-mon[128869]: osdmap e14: 2 total, 2 up, 2 in 2023-08-10T11:46:38.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:37 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:46:38.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:37 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:46:38.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:37 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:39.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:38 smithi156 ceph-mon[130574]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:46:39.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:38 smithi152 ceph-mon[130220]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:46:39.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:38 smithi073 ceph-mon[128869]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:46:40.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:39 smithi152 ceph-mon[130220]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:40.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:39 smithi152 ceph-mon[130220]: from='client.? 172.21.15.156:0/229128805' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f57f5b2c-3208-45c0-beba-8501694b99c5"}]: dispatch 2023-08-10T11:46:40.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:39 smithi152 ceph-mon[130220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f57f5b2c-3208-45c0-beba-8501694b99c5"}]: dispatch 2023-08-10T11:46:40.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:39 smithi152 ceph-mon[130220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f57f5b2c-3208-45c0-beba-8501694b99c5"}]': finished 2023-08-10T11:46:40.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:39 smithi152 ceph-mon[130220]: osdmap e15: 3 total, 2 up, 3 in 2023-08-10T11:46:40.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:39 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T11:46:40.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:39 smithi156 ceph-mon[130574]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:40.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:39 smithi156 ceph-mon[130574]: from='client.? 172.21.15.156:0/229128805' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f57f5b2c-3208-45c0-beba-8501694b99c5"}]: dispatch 2023-08-10T11:46:40.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:39 smithi156 ceph-mon[130574]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f57f5b2c-3208-45c0-beba-8501694b99c5"}]: dispatch 2023-08-10T11:46:40.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:39 smithi156 ceph-mon[130574]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f57f5b2c-3208-45c0-beba-8501694b99c5"}]': finished 2023-08-10T11:46:40.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:39 smithi156 ceph-mon[130574]: osdmap e15: 3 total, 2 up, 3 in 2023-08-10T11:46:40.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:39 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T11:46:40.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:39 smithi073 ceph-mon[128869]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:40.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:39 smithi073 ceph-mon[128869]: from='client.? 172.21.15.156:0/229128805' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f57f5b2c-3208-45c0-beba-8501694b99c5"}]: dispatch 2023-08-10T11:46:40.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:39 smithi073 ceph-mon[128869]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f57f5b2c-3208-45c0-beba-8501694b99c5"}]: dispatch 2023-08-10T11:46:40.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:39 smithi073 ceph-mon[128869]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f57f5b2c-3208-45c0-beba-8501694b99c5"}]': finished 2023-08-10T11:46:40.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:39 smithi073 ceph-mon[128869]: osdmap e15: 3 total, 2 up, 3 in 2023-08-10T11:46:40.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:39 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T11:46:41.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:40 smithi152 ceph-mon[130220]: from='client.? 172.21.15.156:0/1807218513' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:46:41.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:40 smithi156 ceph-mon[130574]: from='client.? 172.21.15.156:0/1807218513' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:46:41.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:40 smithi073 ceph-mon[128869]: from='client.? 172.21.15.156:0/1807218513' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:46:42.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:41 smithi152 ceph-mon[130220]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:42.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:41 smithi156 ceph-mon[130574]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:42.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:41 smithi073 ceph-mon[128869]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:44.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:43 smithi152 ceph-mon[130220]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:44.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:43 smithi156 ceph-mon[130574]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:44.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:43 smithi073 ceph-mon[128869]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:46.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:45 smithi156 ceph-mon[130574]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:46.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:45 smithi152 ceph-mon[130220]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:46.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:45 smithi073 ceph-mon[128869]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:47.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:46 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-08-10T11:46:47.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:46 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:47.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:46 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-08-10T11:46:47.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:46 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:47.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:46 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-08-10T11:46:47.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:46 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:48.165 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:47 smithi156 ceph-mon[130574]: Deploying daemon osd.2 on smithi156 2023-08-10T11:46:48.165 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:47 smithi156 ceph-mon[130574]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:48.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:47 smithi152 ceph-mon[130220]: Deploying daemon osd.2 on smithi156 2023-08-10T11:46:48.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:47 smithi152 ceph-mon[130220]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:48.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:47 smithi073 ceph-mon[128869]: Deploying daemon osd.2 on smithi156 2023-08-10T11:46:48.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:47 smithi073 ceph-mon[128869]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:50.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:49 smithi152 ceph-mon[130220]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:50.258 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:49 smithi156 ceph-mon[130574]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:50.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:49 smithi073 ceph-mon[128869]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:52.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:51 smithi156 ceph-mon[130574]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:52.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:51 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:52.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:51 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:52.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:51 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:46:52.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:51 smithi152 ceph-mon[130220]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:52.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:51 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:52.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:51 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:52.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:51 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:46:52.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:51 smithi073 ceph-mon[128869]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:52.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:51 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:52.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:51 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:52.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:51 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:46:53.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:53.783+0000 7fbc5a7fc700 1 -- 172.21.15.156:0/3566680899 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fbc64060bb0 con 0x7fbc500a1140 2023-08-10T11:46:53.786 INFO:teuthology.orchestra.run.smithi156.stdout:Created osd(s) 2 on host 'smithi156' 2023-08-10T11:46:53.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:53.786+0000 7fbc6b32e700 1 -- 172.21.15.156:0/3566680899 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fbc500a1140 msgr2=0x7fbc500a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:46:53.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:53.786+0000 7fbc6b32e700 1 --2- 172.21.15.156:0/3566680899 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fbc500a1140 0x7fbc500a3600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbc60005950 tx=0x7fbc600058e0 comp rx=0 tx=0).stop 2023-08-10T11:46:53.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:53.786+0000 7fbc6b32e700 1 -- 172.21.15.156:0/3566680899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc640ff9a0 msgr2=0x7fbc640ff3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:46:53.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:53.786+0000 7fbc6b32e700 1 --2- 172.21.15.156:0/3566680899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc640ff9a0 0x7fbc640ff3f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400c990 tx=0x7fbc5400cca0 comp rx=0 tx=0).stop 2023-08-10T11:46:53.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:53.786+0000 7fbc6b32e700 1 -- 172.21.15.156:0/3566680899 shutdown_connections 2023-08-10T11:46:53.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:53.786+0000 7fbc6b32e700 1 --2- 172.21.15.156:0/3566680899 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc64100c60 0x7fbc6419d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:46:53.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:53.786+0000 7fbc6b32e700 1 --2- 172.21.15.156:0/3566680899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc640ff9a0 0x7fbc640ff3f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:46:53.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:53.786+0000 7fbc6b32e700 1 --2- 172.21.15.156:0/3566680899 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fbc500a1140 0x7fbc500a3600 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:46:53.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:53.786+0000 7fbc6b32e700 1 --2- 172.21.15.156:0/3566680899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc64100340 0x7fbc6419b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:46:53.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:53.786+0000 7fbc6b32e700 1 -- 172.21.15.156:0/3566680899 >> 172.21.15.156:0/3566680899 conn(0x7fbc640fa3f0 msgr2=0x7fbc64103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:46:53.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:53.786+0000 7fbc6b32e700 1 -- 172.21.15.156:0/3566680899 shutdown_connections 2023-08-10T11:46:53.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:46:53.786+0000 7fbc6b32e700 1 -- 172.21.15.156:0/3566680899 wait complete. 2023-08-10T11:46:54.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:53 smithi156 ceph-mon[130574]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:54.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:53 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:54.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:53 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:54.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:53 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:54.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:53 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:46:54.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:53 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:54.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:53 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:54.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:53 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:46:54.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:53 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:54.241 DEBUG:teuthology.orchestra.run.smithi156:osd.2> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@osd.2.service 2023-08-10T11:46:54.243 INFO:tasks.cephadm:Deploying osd.3 on smithi073 with /dev/vg_nvme/lv_3... 2023-08-10T11:46:54.243 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-08-10T11:46:54.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:53 smithi152 ceph-mon[130220]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:54.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:53 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:54.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:53 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:54.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:53 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:54.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:53 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:46:54.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:53 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:54.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:53 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:54.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:53 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:46:54.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:53 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:54.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:53 smithi073 ceph-mon[128869]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:54.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:54.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:54.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:54.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:46:54.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:54.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:54.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:46:54.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:54.272 INFO:journalctl@ceph.osd.2.smithi156.stdout:-- Logs begin at Thu 2023-08-10 11:15:12 UTC. -- 2023-08-10T11:46:54.791 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:46:55.158 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:54 smithi156 ceph-mon[130574]: from='osd.2 [v2:172.21.15.156:6800/1789212298,v1:172.21.15.156:6801/1789212298]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-08-10T11:46:55.159 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:54 smithi156 ceph-mon[130574]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-08-10T11:46:55.159 INFO:journalctl@ceph.osd.2.smithi156.stdout:Aug 10 11:46:54 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-2[136422]: 2023-08-10T11:46:54.804+0000 7f941556c640 -1 osd.2 0 log_to_monitors true 2023-08-10T11:46:55.219 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:54 smithi073 ceph-mon[128869]: from='osd.2 [v2:172.21.15.156:6800/1789212298,v1:172.21.15.156:6801/1789212298]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-08-10T11:46:55.219 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:54 smithi073 ceph-mon[128869]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-08-10T11:46:55.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:54 smithi152 ceph-mon[130220]: from='osd.2 [v2:172.21.15.156:6800/1789212298,v1:172.21.15.156:6801/1789212298]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-08-10T11:46:55.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:54 smithi152 ceph-mon[130220]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-08-10T11:46:56.209 INFO:journalctl@ceph.osd.2.smithi156.stdout:Aug 10 11:46:55 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-2[136422]: 2023-08-10T11:46:55.861+0000 7f940a3e3700 -1 osd.2 0 waiting for initial osdmap 2023-08-10T11:46:56.209 INFO:journalctl@ceph.osd.2.smithi156.stdout:Aug 10 11:46:55 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-2[136422]: 2023-08-10T11:46:55.865+0000 7f94061d8700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T11:46:56.210 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:55 smithi156 ceph-mon[130574]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:56.210 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:55 smithi156 ceph-mon[130574]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-08-10T11:46:56.210 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:55 smithi156 ceph-mon[130574]: osdmap e16: 3 total, 2 up, 3 in 2023-08-10T11:46:56.210 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:55 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T11:46:56.210 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:55 smithi156 ceph-mon[130574]: from='osd.2 [v2:172.21.15.156:6800/1789212298,v1:172.21.15.156:6801/1789212298]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-08-10T11:46:56.211 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:55 smithi156 ceph-mon[130574]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-08-10T11:46:56.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:55 smithi152 ceph-mon[130220]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:56.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:55 smithi152 ceph-mon[130220]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-08-10T11:46:56.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:55 smithi152 ceph-mon[130220]: osdmap e16: 3 total, 2 up, 3 in 2023-08-10T11:46:56.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:55 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T11:46:56.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:55 smithi152 ceph-mon[130220]: from='osd.2 [v2:172.21.15.156:6800/1789212298,v1:172.21.15.156:6801/1789212298]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-08-10T11:46:56.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:55 smithi152 ceph-mon[130220]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-08-10T11:46:56.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:55 smithi073 ceph-mon[128869]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:56.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:55 smithi073 ceph-mon[128869]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-08-10T11:46:56.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:55 smithi073 ceph-mon[128869]: osdmap e16: 3 total, 2 up, 3 in 2023-08-10T11:46:56.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:55 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T11:46:56.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:55 smithi073 ceph-mon[128869]: from='osd.2 [v2:172.21.15.156:6800/1789212298,v1:172.21.15.156:6801/1789212298]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-08-10T11:46:56.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:55 smithi073 ceph-mon[128869]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-08-10T11:46:56.378 INFO:teuthology.orchestra.run.smithi073.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-08-10T11:46:56.379 INFO:teuthology.orchestra.run.smithi073.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-08-10T11:46:56.379 INFO:teuthology.orchestra.run.smithi073.stderr: stderr: 10+0 records in 2023-08-10T11:46:56.379 INFO:teuthology.orchestra.run.smithi073.stderr:10+0 records out 2023-08-10T11:46:56.379 INFO:teuthology.orchestra.run.smithi073.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111246 s, 943 MB/s 2023-08-10T11:46:56.380 INFO:teuthology.orchestra.run.smithi073.stderr:--> Zapping successful for: 2023-08-10T11:46:56.943 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:56 smithi073 ceph-mon[128869]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-08-10T11:46:56.943 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:56 smithi073 ceph-mon[128869]: osdmap e17: 3 total, 2 up, 3 in 2023-08-10T11:46:56.943 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:56 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T11:46:56.943 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:56 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T11:46:56.944 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:56 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:56.944 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:56 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:56.944 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:56 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:46:56.944 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:56 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:56.944 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:56 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:56.944 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:56 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:46:56.944 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:56 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:56.945 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi073:vg_nvme/lv_3 2023-08-10T11:46:57.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:56 smithi152 ceph-mon[130220]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-08-10T11:46:57.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:56 smithi152 ceph-mon[130220]: osdmap e17: 3 total, 2 up, 3 in 2023-08-10T11:46:57.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:56 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T11:46:57.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:56 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T11:46:57.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:56 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:57.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:56 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:57.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:56 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:46:57.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:56 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:57.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:56 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:57.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:56 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:46:57.248 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:56 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:57.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:56 smithi156 ceph-mon[130574]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-08-10T11:46:57.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:56 smithi156 ceph-mon[130574]: osdmap e17: 3 total, 2 up, 3 in 2023-08-10T11:46:57.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:56 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T11:46:57.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:56 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T11:46:57.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:56 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:57.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:56 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:57.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:56 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:46:57.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:56 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:57.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:56 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:57.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:56 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:46:57.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:56 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:46:57.534 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:46:58.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:57 smithi073 ceph-mon[128869]: purged_snaps scrub starts 2023-08-10T11:46:58.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:57 smithi073 ceph-mon[128869]: purged_snaps scrub ok 2023-08-10T11:46:58.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:57 smithi073 ceph-mon[128869]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:58.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:57 smithi073 ceph-mon[128869]: Detected new or changed devices on smithi156 2023-08-10T11:46:58.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:57 smithi073 ceph-mon[128869]: Adjusting osd_memory_target on smithi156 to 17168M 2023-08-10T11:46:58.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:57 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T11:46:58.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:57 smithi073 ceph-mon[128869]: osd.2 [v2:172.21.15.156:6800/1789212298,v1:172.21.15.156:6801/1789212298] boot 2023-08-10T11:46:58.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:57 smithi073 ceph-mon[128869]: osdmap e18: 3 total, 3 up, 3 in 2023-08-10T11:46:58.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:57 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T11:46:58.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:57 smithi152 ceph-mon[130220]: purged_snaps scrub starts 2023-08-10T11:46:58.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:57 smithi152 ceph-mon[130220]: purged_snaps scrub ok 2023-08-10T11:46:58.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:57 smithi152 ceph-mon[130220]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:58.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:57 smithi152 ceph-mon[130220]: Detected new or changed devices on smithi156 2023-08-10T11:46:58.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:57 smithi152 ceph-mon[130220]: Adjusting osd_memory_target on smithi156 to 17168M 2023-08-10T11:46:58.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:57 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T11:46:58.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:57 smithi152 ceph-mon[130220]: osd.2 [v2:172.21.15.156:6800/1789212298,v1:172.21.15.156:6801/1789212298] boot 2023-08-10T11:46:58.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:57 smithi152 ceph-mon[130220]: osdmap e18: 3 total, 3 up, 3 in 2023-08-10T11:46:58.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:57 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T11:46:58.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:57 smithi156 ceph-mon[130574]: purged_snaps scrub starts 2023-08-10T11:46:58.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:57 smithi156 ceph-mon[130574]: purged_snaps scrub ok 2023-08-10T11:46:58.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:57 smithi156 ceph-mon[130574]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T11:46:58.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:57 smithi156 ceph-mon[130574]: Detected new or changed devices on smithi156 2023-08-10T11:46:58.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:57 smithi156 ceph-mon[130574]: Adjusting osd_memory_target on smithi156 to 17168M 2023-08-10T11:46:58.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:57 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T11:46:58.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:57 smithi156 ceph-mon[130574]: osd.2 [v2:172.21.15.156:6800/1789212298,v1:172.21.15.156:6801/1789212298] boot 2023-08-10T11:46:58.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:57 smithi156 ceph-mon[130574]: osdmap e18: 3 total, 3 up, 3 in 2023-08-10T11:46:58.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:57 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T11:46:58.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.751+0000 7f958b3e1700 1 -- 172.21.15.73:0/1213055920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9584101a00 msgr2=0x7f9584101e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:46:58.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.751+0000 7f958b3e1700 1 --2- 172.21.15.73:0/1213055920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9584101a00 0x7f9584101e60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f95800099c0 tx=0x7f9580009cd0 comp rx=0 tx=0).stop 2023-08-10T11:46:58.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.751+0000 7f958b3e1700 1 -- 172.21.15.73:0/1213055920 shutdown_connections 2023-08-10T11:46:58.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.751+0000 7f958b3e1700 1 --2- 172.21.15.73:0/1213055920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95841023a0 0x7f9584108c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:46:58.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.751+0000 7f958b3e1700 1 --2- 172.21.15.73:0/1213055920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9584100800 0x7f9584100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:46:58.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.751+0000 7f958b3e1700 1 --2- 172.21.15.73:0/1213055920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9584101a00 0x7f9584101e60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:46:58.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.751+0000 7f958b3e1700 1 -- 172.21.15.73:0/1213055920 >> 172.21.15.73:0/1213055920 conn(0x7f95840fbd60 msgr2=0x7f95840fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:46:58.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.751+0000 7f958b3e1700 1 -- 172.21.15.73:0/1213055920 shutdown_connections 2023-08-10T11:46:58.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.751+0000 7f958b3e1700 1 -- 172.21.15.73:0/1213055920 wait complete. 2023-08-10T11:46:58.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.752+0000 7f958b3e1700 1 Processor -- start 2023-08-10T11:46:58.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.752+0000 7f958b3e1700 1 -- start start 2023-08-10T11:46:58.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.752+0000 7f958b3e1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9584100800 0x7f9584196520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:46:58.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.752+0000 7f958b3e1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9584101a00 0x7f9584196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:46:58.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.752+0000 7f958b3e1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95841023a0 0x7f958419dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:46:58.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.752+0000 7f958b3e1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958419e0b0 con 0x7f9584101a00 2023-08-10T11:46:58.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.752+0000 7f958b3e1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958419e1f0 con 0x7f9584100800 2023-08-10T11:46:58.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.752+0000 7f958b3e1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958419e380 con 0x7f95841023a0 2023-08-10T11:46:58.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.752+0000 7f958897c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9584101a00 0x7f9584196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:46:58.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.752+0000 7f958897c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9584101a00 0x7f9584196a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58102/0 (socket says 172.21.15.73:58102) 2023-08-10T11:46:58.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.752+0000 7f958897c700 1 -- 172.21.15.73:0/4023950728 learned_addr learned my addr 172.21.15.73:0/4023950728 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:46:58.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.752+0000 7f958917d700 1 --2- 172.21.15.73:0/4023950728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9584100800 0x7f9584196520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:46:58.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.753+0000 7f958997e700 1 --2- 172.21.15.73:0/4023950728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95841023a0 0x7f958419dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:46:58.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.753+0000 7f958897c700 1 -- 172.21.15.73:0/4023950728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95841023a0 msgr2=0x7f958419dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:46:58.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.753+0000 7f958897c700 1 --2- 172.21.15.73:0/4023950728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95841023a0 0x7f958419dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:46:58.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.753+0000 7f958897c700 1 -- 172.21.15.73:0/4023950728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9584100800 msgr2=0x7f9584196520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:46:58.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.753+0000 7f958897c700 1 --2- 172.21.15.73:0/4023950728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9584100800 0x7f9584196520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:46:58.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.753+0000 7f958897c700 1 -- 172.21.15.73:0/4023950728 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95800095f0 con 0x7f9584101a00 2023-08-10T11:46:58.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.753+0000 7f958897c700 1 --2- 172.21.15.73:0/4023950728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9584101a00 0x7f9584196a60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9580005910 tx=0x7f9580005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:46:58.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.753+0000 7f957a7fc700 1 -- 172.21.15.73:0/4023950728 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958001d070 con 0x7f9584101a00 2023-08-10T11:46:58.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.753+0000 7f958b3e1700 1 -- 172.21.15.73:0/4023950728 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9584072a60 con 0x7f9584101a00 2023-08-10T11:46:58.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.753+0000 7f957a7fc700 1 -- 172.21.15.73:0/4023950728 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9580004010 con 0x7f9584101a00 2023-08-10T11:46:58.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.753+0000 7f958b3e1700 1 -- 172.21.15.73:0/4023950728 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9584072f50 con 0x7f9584101a00 2023-08-10T11:46:58.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.753+0000 7f957a7fc700 1 -- 172.21.15.73:0/4023950728 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9580022dd0 con 0x7f9584101a00 2023-08-10T11:46:58.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.754+0000 7f958b3e1700 1 -- 172.21.15.73:0/4023950728 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9584107ea0 con 0x7f9584101a00 2023-08-10T11:46:58.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.755+0000 7f957a7fc700 1 -- 172.21.15.73:0/4023950728 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 15) v1 ==== 135659+0+0 (secure 0 0 0) 0x7f9580022500 con 0x7f9584101a00 2023-08-10T11:46:58.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.756+0000 7f957a7fc700 1 --2- 172.21.15.73:0/4023950728 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f95700a1140 0x7f95700a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:46:58.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.756+0000 7f958917d700 1 --2- 172.21.15.73:0/4023950728 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f95700a1140 0x7f95700a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:46:58.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.756+0000 7f957a7fc700 1 -- 172.21.15.73:0/4023950728 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 2851+0+0 (secure 0 0 0) 0x7f95800cca50 con 0x7f9584101a00 2023-08-10T11:46:58.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.756+0000 7f958917d700 1 --2- 172.21.15.73:0/4023950728 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f95700a1140 0x7f95700a3600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9584101860 tx=0x7f957400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:46:58.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.759+0000 7f957a7fc700 1 -- 172.21.15.73:0/4023950728 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f95800977c0 con 0x7f9584101a00 2023-08-10T11:46:58.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:46:58.954+0000 7f958b3e1700 1 -- 172.21.15.73:0/4023950728 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f9584060bb0 con 0x7f95700a1140 2023-08-10T11:46:59.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:59 smithi152 ceph-mon[130220]: pgmap v73: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-10T11:46:59.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:59 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-08-10T11:46:59.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:59 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-08-10T11:46:59.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:59 smithi152 ceph-mon[130220]: osdmap e19: 3 total, 3 up, 3 in 2023-08-10T11:46:59.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:59 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-08-10T11:46:59.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:59 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:46:59.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:59 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:46:59.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:46:59 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:59.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:59 smithi156 ceph-mon[130574]: pgmap v73: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-10T11:46:59.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:59 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-08-10T11:46:59.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:59 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-08-10T11:46:59.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:59 smithi156 ceph-mon[130574]: osdmap e19: 3 total, 3 up, 3 in 2023-08-10T11:46:59.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:59 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-08-10T11:46:59.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:59 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:46:59.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:59 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:46:59.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:46:59 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:46:59.765 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:59 smithi073 ceph-mon[128869]: pgmap v73: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-10T11:46:59.765 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:59 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-08-10T11:46:59.766 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:59 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-08-10T11:46:59.766 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:59 smithi073 ceph-mon[128869]: osdmap e19: 3 total, 3 up, 3 in 2023-08-10T11:46:59.766 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:59 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-08-10T11:46:59.766 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:59 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:46:59.766 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:59 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:46:59.766 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:46:59 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:00.488 INFO:journalctl@ceph.osd.0.smithi073.stdout:Aug 10 11:47:00 smithi073 sudo[144973]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-08-10T11:47:00.488 INFO:journalctl@ceph.osd.0.smithi073.stdout:Aug 10 11:47:00 smithi073 sudo[144973]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-10T11:47:00.488 INFO:journalctl@ceph.osd.0.smithi073.stdout:Aug 10 11:47:00 smithi073 sudo[144973]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-10T11:47:00.488 INFO:journalctl@ceph.osd.0.smithi073.stdout:Aug 10 11:47:00 smithi073 sudo[144973]: pam_unix(sudo:session): session closed for user root 2023-08-10T11:47:00.768 INFO:journalctl@ceph.osd.0.smithi073.stdout:Aug 10 11:47:00 smithi073 sudo[145000]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-08-10T11:47:00.768 INFO:journalctl@ceph.osd.0.smithi073.stdout:Aug 10 11:47:00 smithi073 sudo[145000]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-10T11:47:00.769 INFO:journalctl@ceph.osd.0.smithi073.stdout:Aug 10 11:47:00 smithi073 sudo[145000]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-10T11:47:00.769 INFO:journalctl@ceph.osd.0.smithi073.stdout:Aug 10 11:47:00 smithi073 sudo[145000]: pam_unix(sudo:session): session closed for user root 2023-08-10T11:47:01.015 INFO:journalctl@ceph.osd.1.smithi152.stdout:Aug 10 11:47:00 smithi152 sudo[137575]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-08-10T11:47:01.015 INFO:journalctl@ceph.osd.1.smithi152.stdout:Aug 10 11:47:00 smithi152 sudo[137575]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-10T11:47:01.015 INFO:journalctl@ceph.osd.1.smithi152.stdout:Aug 10 11:47:00 smithi152 sudo[137575]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-10T11:47:01.015 INFO:journalctl@ceph.osd.1.smithi152.stdout:Aug 10 11:47:00 smithi152 sudo[137575]: pam_unix(sudo:session): session closed for user root 2023-08-10T11:47:01.016 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:00 smithi152 ceph-mon[130220]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:47:01.016 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:00 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-08-10T11:47:01.016 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:00 smithi152 ceph-mon[130220]: osdmap e20: 3 total, 3 up, 3 in 2023-08-10T11:47:01.016 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:00 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:01.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:00 smithi156 ceph-mon[130574]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:47:01.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:00 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-08-10T11:47:01.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:00 smithi156 ceph-mon[130574]: osdmap e20: 3 total, 3 up, 3 in 2023-08-10T11:47:01.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:00 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:01.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:00 smithi073 ceph-mon[128869]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:47:01.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:00 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-08-10T11:47:01.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:00 smithi073 ceph-mon[128869]: osdmap e20: 3 total, 3 up, 3 in 2023-08-10T11:47:01.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:00 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:01.495 INFO:journalctl@ceph.osd.1.smithi152.stdout:Aug 10 11:47:01 smithi152 sudo[137578]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-08-10T11:47:01.495 INFO:journalctl@ceph.osd.1.smithi152.stdout:Aug 10 11:47:01 smithi152 sudo[137578]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-10T11:47:01.495 INFO:journalctl@ceph.osd.1.smithi152.stdout:Aug 10 11:47:01 smithi152 sudo[137578]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-10T11:47:01.495 INFO:journalctl@ceph.osd.1.smithi152.stdout:Aug 10 11:47:01 smithi152 sudo[137578]: pam_unix(sudo:session): session closed for user root 2023-08-10T11:47:01.538 INFO:journalctl@ceph.osd.2.smithi156.stdout:Aug 10 11:47:01 smithi156 sudo[138679]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-08-10T11:47:01.538 INFO:journalctl@ceph.osd.2.smithi156.stdout:Aug 10 11:47:01 smithi156 sudo[138679]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-10T11:47:01.538 INFO:journalctl@ceph.osd.2.smithi156.stdout:Aug 10 11:47:01 smithi156 sudo[138679]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-10T11:47:01.539 INFO:journalctl@ceph.osd.2.smithi156.stdout:Aug 10 11:47:01 smithi156 sudo[138679]: pam_unix(sudo:session): session closed for user root 2023-08-10T11:47:02.005 INFO:journalctl@ceph.osd.2.smithi156.stdout:Aug 10 11:47:01 smithi156 sudo[138682]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-08-10T11:47:02.005 INFO:journalctl@ceph.osd.2.smithi156.stdout:Aug 10 11:47:01 smithi156 sudo[138682]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-10T11:47:02.006 INFO:journalctl@ceph.osd.2.smithi156.stdout:Aug 10 11:47:01 smithi156 sudo[138682]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-10T11:47:02.006 INFO:journalctl@ceph.osd.2.smithi156.stdout:Aug 10 11:47:01 smithi156 sudo[138682]: pam_unix(sudo:session): session closed for user root 2023-08-10T11:47:02.069 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:01 smithi073 sudo[145091]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-08-10T11:47:02.069 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:01 smithi073 sudo[145091]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-10T11:47:02.069 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:01 smithi073 sudo[145091]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-10T11:47:02.069 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:01 smithi073 sudo[145091]: pam_unix(sudo:session): session closed for user root 2023-08-10T11:47:02.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:47:02.084+0000 7f957a7fc700 1 -- 172.21.15.73:0/4023950728 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f9580097b90 con 0x7f9584101a00 2023-08-10T11:47:02.334 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:02 smithi156 ceph-mon[130574]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-10T11:47:02.335 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:02 smithi156 ceph-mon[130574]: osdmap e21: 3 total, 3 up, 3 in 2023-08-10T11:47:02.335 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:02 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:02.335 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:02 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/2524869547' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "18592408-3696-4ab8-ad41-c172b8409829"}]: dispatch 2023-08-10T11:47:02.335 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:02 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/2524869547' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "18592408-3696-4ab8-ad41-c172b8409829"}]': finished 2023-08-10T11:47:02.335 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:02 smithi156 ceph-mon[130574]: osdmap e22: 4 total, 3 up, 4 in 2023-08-10T11:47:02.335 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:02 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T11:47:02.335 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:02 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:02.336 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:02 smithi156 ceph-mon[130574]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-08-10T11:47:02.336 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:02 smithi156 sudo[138685]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-08-10T11:47:02.336 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:02 smithi156 sudo[138685]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-10T11:47:02.336 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:02 smithi156 sudo[138685]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-10T11:47:02.336 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:02 smithi156 sudo[138685]: pam_unix(sudo:session): session closed for user root 2023-08-10T11:47:02.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:02 smithi152 ceph-mon[130220]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-10T11:47:02.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:02 smithi152 ceph-mon[130220]: osdmap e21: 3 total, 3 up, 3 in 2023-08-10T11:47:02.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:02 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:02.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:02 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/2524869547' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "18592408-3696-4ab8-ad41-c172b8409829"}]: dispatch 2023-08-10T11:47:02.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:02 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/2524869547' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "18592408-3696-4ab8-ad41-c172b8409829"}]': finished 2023-08-10T11:47:02.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:02 smithi152 ceph-mon[130220]: osdmap e22: 4 total, 3 up, 4 in 2023-08-10T11:47:02.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:02 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T11:47:02.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:02 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:02.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:02 smithi152 ceph-mon[130220]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-08-10T11:47:02.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:02 smithi073 sudo[145094]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-08-10T11:47:02.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:02 smithi073 sudo[145094]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-10T11:47:02.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:02 smithi073 sudo[145094]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-10T11:47:02.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:02 smithi073 sudo[145094]: pam_unix(sudo:session): session closed for user root 2023-08-10T11:47:02.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:02 smithi073 ceph-mon[128869]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-10T11:47:02.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:02 smithi073 ceph-mon[128869]: osdmap e21: 3 total, 3 up, 3 in 2023-08-10T11:47:02.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:02 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:02.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:02 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2524869547' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "18592408-3696-4ab8-ad41-c172b8409829"}]: dispatch 2023-08-10T11:47:02.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:02 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2524869547' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "18592408-3696-4ab8-ad41-c172b8409829"}]': finished 2023-08-10T11:47:02.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:02 smithi073 ceph-mon[128869]: osdmap e22: 4 total, 3 up, 4 in 2023-08-10T11:47:02.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:02 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T11:47:02.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:02 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:02.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:02 smithi073 ceph-mon[128869]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-08-10T11:47:02.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:02 smithi156 sudo[138688]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-08-10T11:47:02.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:02 smithi156 sudo[138688]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-10T11:47:02.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:02 smithi156 sudo[138688]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-10T11:47:02.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:02 smithi156 sudo[138688]: pam_unix(sudo:session): session closed for user root 2023-08-10T11:47:03.065 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:02 smithi152 sudo[137581]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-08-10T11:47:03.065 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:02 smithi152 sudo[137581]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-10T11:47:03.065 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:02 smithi152 sudo[137581]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-10T11:47:03.065 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:02 smithi152 sudo[137581]: pam_unix(sudo:session): session closed for user root 2023-08-10T11:47:03.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:03 smithi152 sudo[137584]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-08-10T11:47:03.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:03 smithi152 sudo[137584]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-10T11:47:03.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:03 smithi152 sudo[137584]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-10T11:47:03.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:03 smithi152 sudo[137584]: pam_unix(sudo:session): session closed for user root 2023-08-10T11:47:03.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:03 smithi152 ceph-mon[130220]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-08-10T11:47:03.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:03 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T11:47:03.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:03 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:47:03.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:03 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:47:03.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:03 smithi152 ceph-mon[130220]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-08-10T11:47:03.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:03 smithi152 ceph-mon[130220]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-08-10T11:47:03.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:03 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T11:47:03.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:03 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:47:03.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:03 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:47:03.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:03 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3936902489' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:47:03.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:03 smithi152 ceph-mon[130220]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-08-10T11:47:03.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:03 smithi152 ceph-mon[130220]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-08-10T11:47:03.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:03 smithi152 ceph-mon[130220]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-08-10T11:47:03.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:03 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T11:47:03.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:03 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:47:03.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:03 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:47:03.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:03 smithi152 ceph-mon[130220]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-08-10T11:47:03.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:03 smithi156 ceph-mon[130574]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-08-10T11:47:03.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:03 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T11:47:03.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:03 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:47:03.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:03 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:47:03.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:03 smithi156 ceph-mon[130574]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-08-10T11:47:03.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:03 smithi156 ceph-mon[130574]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-08-10T11:47:03.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:03 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T11:47:03.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:03 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:47:03.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:03 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:47:03.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:03 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3936902489' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:47:03.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:03 smithi156 ceph-mon[130574]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-08-10T11:47:03.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:03 smithi156 ceph-mon[130574]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-08-10T11:47:03.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:03 smithi156 ceph-mon[130574]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-08-10T11:47:03.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:03 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T11:47:03.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:03 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:47:03.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:03 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:47:03.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:03 smithi156 ceph-mon[130574]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-08-10T11:47:03.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:03 smithi073 ceph-mon[128869]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-08-10T11:47:03.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:03 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T11:47:03.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:03 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:47:03.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:03 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:47:03.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:03 smithi073 ceph-mon[128869]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-08-10T11:47:03.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:03 smithi073 ceph-mon[128869]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-08-10T11:47:03.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:03 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T11:47:03.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:03 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:47:03.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:03 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:47:03.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:03 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3936902489' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:47:03.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:03 smithi073 ceph-mon[128869]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-08-10T11:47:03.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:03 smithi073 ceph-mon[128869]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-08-10T11:47:03.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:03 smithi073 ceph-mon[128869]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-08-10T11:47:03.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:03 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T11:47:03.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:03 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:47:03.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:03 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:47:03.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:03 smithi073 ceph-mon[128869]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-08-10T11:47:05.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:05 smithi152 ceph-mon[130220]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-08-10T11:47:05.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:05 smithi156 ceph-mon[130574]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-08-10T11:47:05.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:05 smithi073 ceph-mon[128869]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-08-10T11:47:07.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:07 smithi073 ceph-mon[128869]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-08-10T11:47:07.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:07 smithi152 ceph-mon[130220]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-08-10T11:47:07.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:07 smithi156 ceph-mon[130574]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-08-10T11:47:09.730 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:09 smithi073 ceph-mon[128869]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2023-08-10T11:47:09.730 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:09 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-08-10T11:47:09.730 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:09 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:09.730 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:09 smithi073 ceph-mon[128869]: Deploying daemon osd.3 on smithi073 2023-08-10T11:47:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:09 smithi152 ceph-mon[130220]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2023-08-10T11:47:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:09 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-08-10T11:47:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:09 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:09 smithi152 ceph-mon[130220]: Deploying daemon osd.3 on smithi073 2023-08-10T11:47:09.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:09 smithi156 ceph-mon[130574]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2023-08-10T11:47:09.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:09 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-08-10T11:47:09.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:09 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:09.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:09 smithi156 ceph-mon[130574]: Deploying daemon osd.3 on smithi073 2023-08-10T11:47:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:11 smithi152 ceph-mon[130220]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2023-08-10T11:47:11.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:11 smithi156 ceph-mon[130574]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2023-08-10T11:47:11.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:11 smithi073 ceph-mon[128869]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2023-08-10T11:47:13.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:13 smithi152 ceph-mon[130220]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-08-10T11:47:13.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:13 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:13.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:13 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:47:13.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:13 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:13.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:13 smithi156 ceph-mon[130574]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-08-10T11:47:13.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:13 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:13.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:13 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:47:13.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:13 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:13.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:13 smithi073 ceph-mon[128869]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-08-10T11:47:13.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:13 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:13.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:13 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:47:13.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:13 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:15.644 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:15 smithi073 ceph-mon[128869]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-08-10T11:47:15.644 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:15 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:15.645 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:15 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:15.645 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:15 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:15.645 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:15 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:47:15.645 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:15 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:15.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:47:15.703+0000 7f957a7fc700 1 -- 172.21.15.73:0/4023950728 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9584060bb0 con 0x7f95700a1140 2023-08-10T11:47:15.706 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 3 on host 'smithi073' 2023-08-10T11:47:15.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:47:15.706+0000 7f958b3e1700 1 -- 172.21.15.73:0/4023950728 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f95700a1140 msgr2=0x7f95700a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:47:15.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:47:15.706+0000 7f958b3e1700 1 --2- 172.21.15.73:0/4023950728 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f95700a1140 0x7f95700a3600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9584101860 tx=0x7f957400b410 comp rx=0 tx=0).stop 2023-08-10T11:47:15.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:47:15.706+0000 7f958b3e1700 1 -- 172.21.15.73:0/4023950728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9584101a00 msgr2=0x7f9584196a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:47:15.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:47:15.706+0000 7f958b3e1700 1 --2- 172.21.15.73:0/4023950728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9584101a00 0x7f9584196a60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9580005910 tx=0x7f9580005740 comp rx=0 tx=0).stop 2023-08-10T11:47:15.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:47:15.706+0000 7f958b3e1700 1 -- 172.21.15.73:0/4023950728 shutdown_connections 2023-08-10T11:47:15.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:47:15.706+0000 7f958b3e1700 1 --2- 172.21.15.73:0/4023950728 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f95700a1140 0x7f95700a3600 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:47:15.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:47:15.706+0000 7f958b3e1700 1 --2- 172.21.15.73:0/4023950728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9584100800 0x7f9584196520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:47:15.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:47:15.706+0000 7f958b3e1700 1 --2- 172.21.15.73:0/4023950728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95841023a0 0x7f958419dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:47:15.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:47:15.706+0000 7f958b3e1700 1 --2- 172.21.15.73:0/4023950728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9584101a00 0x7f9584196a60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:47:15.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:47:15.706+0000 7f958b3e1700 1 -- 172.21.15.73:0/4023950728 >> 172.21.15.73:0/4023950728 conn(0x7f95840fbd60 msgr2=0x7f9584104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:47:15.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:47:15.706+0000 7f958b3e1700 1 -- 172.21.15.73:0/4023950728 shutdown_connections 2023-08-10T11:47:15.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:47:15.706+0000 7f958b3e1700 1 -- 172.21.15.73:0/4023950728 wait complete. 2023-08-10T11:47:15.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:15 smithi152 ceph-mon[130220]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-08-10T11:47:15.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:15 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:15.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:15 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:15.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:15 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:15.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:15 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:47:15.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:15 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:15.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:15 smithi156 ceph-mon[130574]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-08-10T11:47:15.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:15 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:15.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:15 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:15.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:15 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:15.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:15 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:47:15.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:15 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:16.115 DEBUG:teuthology.orchestra.run.smithi073:osd.3> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@osd.3.service 2023-08-10T11:47:16.117 INFO:tasks.cephadm:Deploying osd.4 on smithi152 with /dev/vg_nvme/lv_3... 2023-08-10T11:47:16.118 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-08-10T11:47:16.148 INFO:journalctl@ceph.osd.3.smithi073.stdout:-- Logs begin at Thu 2023-08-10 11:15:25 UTC. -- 2023-08-10T11:47:16.680 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.b/config 2023-08-10T11:47:16.976 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:16 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:16.977 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:16 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:16.977 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:16 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:47:16.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:16 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:16.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:16 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:16.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:16 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:47:17.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:16 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:17.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:16 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:17.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:16 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:47:17.268 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 10 11:47:16 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-3[147340]: 2023-08-10T11:47:16.973+0000 7f64a48d0640 -1 osd.3 0 log_to_monitors true 2023-08-10T11:47:17.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:17 smithi152 ceph-mon[130220]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-08-10T11:47:17.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:17 smithi152 ceph-mon[130220]: from='osd.3 [v2:172.21.15.73:6810/3101572649,v1:172.21.15.73:6811/3101572649]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-08-10T11:47:17.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:17 smithi152 ceph-mon[130220]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-08-10T11:47:18.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:17 smithi156 ceph-mon[130574]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-08-10T11:47:18.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:17 smithi156 ceph-mon[130574]: from='osd.3 [v2:172.21.15.73:6810/3101572649,v1:172.21.15.73:6811/3101572649]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-08-10T11:47:18.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:17 smithi156 ceph-mon[130574]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-08-10T11:47:18.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:17 smithi073 ceph-mon[128869]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-08-10T11:47:18.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:17 smithi073 ceph-mon[128869]: from='osd.3 [v2:172.21.15.73:6810/3101572649,v1:172.21.15.73:6811/3101572649]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-08-10T11:47:18.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:17 smithi073 ceph-mon[128869]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-08-10T11:47:18.209 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-08-10T11:47:18.210 INFO:teuthology.orchestra.run.smithi152.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-08-10T11:47:18.210 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10+0 records in 2023-08-10T11:47:18.210 INFO:teuthology.orchestra.run.smithi152.stderr:10+0 records out 2023-08-10T11:47:18.210 INFO:teuthology.orchestra.run.smithi152.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112713 s, 930 MB/s 2023-08-10T11:47:18.210 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping successful for: 2023-08-10T11:47:18.634 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi152:vg_nvme/lv_3 2023-08-10T11:47:18.768 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 10 11:47:18 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-3[147340]: 2023-08-10T11:47:18.718+0000 7f6499747700 -1 osd.3 0 waiting for initial osdmap 2023-08-10T11:47:18.768 INFO:journalctl@ceph.osd.3.smithi073.stdout:Aug 10 11:47:18 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-3[147340]: 2023-08-10T11:47:18.723+0000 7f6491d35700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T11:47:18.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:18 smithi073 ceph-mon[128869]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-08-10T11:47:18.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:18 smithi073 ceph-mon[128869]: osdmap e23: 4 total, 3 up, 4 in 2023-08-10T11:47:18.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:18 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T11:47:18.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:18 smithi073 ceph-mon[128869]: from='osd.3 [v2:172.21.15.73:6810/3101572649,v1:172.21.15.73:6811/3101572649]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2023-08-10T11:47:18.770 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:18 smithi073 ceph-mon[128869]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2023-08-10T11:47:18.770 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:18 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:18.770 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:18 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:18.771 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:18 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:47:18.771 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:18 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:47:18.771 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:18 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:18.771 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:18 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:18.772 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:18 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:47:18.772 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:18 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:18.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:18 smithi152 ceph-mon[130220]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-08-10T11:47:18.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:18 smithi152 ceph-mon[130220]: osdmap e23: 4 total, 3 up, 4 in 2023-08-10T11:47:18.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:18 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T11:47:18.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:18 smithi152 ceph-mon[130220]: from='osd.3 [v2:172.21.15.73:6810/3101572649,v1:172.21.15.73:6811/3101572649]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2023-08-10T11:47:18.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:18 smithi152 ceph-mon[130220]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2023-08-10T11:47:18.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:18 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:18.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:18 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:18.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:18 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:47:18.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:18 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:47:18.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:18 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:18.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:18 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:18.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:18 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:47:18.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:18 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:19.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:18 smithi156 ceph-mon[130574]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-08-10T11:47:19.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:18 smithi156 ceph-mon[130574]: osdmap e23: 4 total, 3 up, 4 in 2023-08-10T11:47:19.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:18 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T11:47:19.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:18 smithi156 ceph-mon[130574]: from='osd.3 [v2:172.21.15.73:6810/3101572649,v1:172.21.15.73:6811/3101572649]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2023-08-10T11:47:19.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:18 smithi156 ceph-mon[130574]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2023-08-10T11:47:19.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:18 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:19.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:18 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:19.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:18 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:47:19.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:18 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:47:19.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:18 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:19.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:18 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:19.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:18 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:47:19.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:18 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:19.189 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.b/config 2023-08-10T11:47:19.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:19 smithi152 ceph-mon[130220]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-08-10T11:47:19.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:19 smithi152 ceph-mon[130220]: Detected new or changed devices on smithi073 2023-08-10T11:47:19.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:19 smithi152 ceph-mon[130220]: Adjusting osd_memory_target on smithi073 to 8584M 2023-08-10T11:47:19.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:19 smithi152 ceph-mon[130220]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2023-08-10T11:47:19.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:19 smithi152 ceph-mon[130220]: osdmap e24: 4 total, 3 up, 4 in 2023-08-10T11:47:19.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:19 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T11:47:19.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:19 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T11:47:20.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:19 smithi156 ceph-mon[130574]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-08-10T11:47:20.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:19 smithi156 ceph-mon[130574]: Detected new or changed devices on smithi073 2023-08-10T11:47:20.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:19 smithi156 ceph-mon[130574]: Adjusting osd_memory_target on smithi073 to 8584M 2023-08-10T11:47:20.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:19 smithi156 ceph-mon[130574]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2023-08-10T11:47:20.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:19 smithi156 ceph-mon[130574]: osdmap e24: 4 total, 3 up, 4 in 2023-08-10T11:47:20.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:19 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T11:47:20.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:19 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T11:47:20.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:19 smithi073 ceph-mon[128869]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-08-10T11:47:20.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:19 smithi073 ceph-mon[128869]: Detected new or changed devices on smithi073 2023-08-10T11:47:20.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:19 smithi073 ceph-mon[128869]: Adjusting osd_memory_target on smithi073 to 8584M 2023-08-10T11:47:20.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:19 smithi073 ceph-mon[128869]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2023-08-10T11:47:20.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:19 smithi073 ceph-mon[128869]: osdmap e24: 4 total, 3 up, 4 in 2023-08-10T11:47:20.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:19 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T11:47:20.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:19 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T11:47:20.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.436+0000 7fc63c410700 1 -- 172.21.15.152:0/3143363013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc634100930 msgr2=0x7fc634100d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:47:20.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.436+0000 7fc63c410700 1 --2- 172.21.15.152:0/3143363013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc634100930 0x7fc634100d90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc6300099c0 tx=0x7fc630009cd0 comp rx=0 tx=0).stop 2023-08-10T11:47:20.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.436+0000 7fc63c410700 1 -- 172.21.15.152:0/3143363013 shutdown_connections 2023-08-10T11:47:20.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.436+0000 7fc63c410700 1 --2- 172.21.15.152:0/3143363013 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6341012d0 0x7fc634107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:47:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.436+0000 7fc63c410700 1 --2- 172.21.15.152:0/3143363013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6340ff730 0x7fc6340ffb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:47:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.436+0000 7fc63c410700 1 --2- 172.21.15.152:0/3143363013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc634100930 0x7fc634100d90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:47:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.436+0000 7fc63c410700 1 -- 172.21.15.152:0/3143363013 >> 172.21.15.152:0/3143363013 conn(0x7fc6340facf0 msgr2=0x7fc6340fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:47:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.436+0000 7fc63c410700 1 -- 172.21.15.152:0/3143363013 shutdown_connections 2023-08-10T11:47:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.436+0000 7fc63c410700 1 -- 172.21.15.152:0/3143363013 wait complete. 2023-08-10T11:47:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.437+0000 7fc63c410700 1 Processor -- start 2023-08-10T11:47:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.437+0000 7fc63c410700 1 -- start start 2023-08-10T11:47:20.441 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.437+0000 7fc63c410700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6340ff730 0x7fc634196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:47:20.441 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.437+0000 7fc63c410700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc634100930 0x7fc6341969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:47:20.441 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.437+0000 7fc63c410700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6341012d0 0x7fc63419da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:47:20.441 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.437+0000 7fc63c410700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63419e000 con 0x7fc6340ff730 2023-08-10T11:47:20.441 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.437+0000 7fc63c410700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63419e140 con 0x7fc634100930 2023-08-10T11:47:20.441 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.437+0000 7fc63c410700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63419e2d0 con 0x7fc6341012d0 2023-08-10T11:47:20.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.437+0000 7fc6399ab700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc634100930 0x7fc6341969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:47:20.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.437+0000 7fc6399ab700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc634100930 0x7fc6341969b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43930/0 (socket says 172.21.15.152:43930) 2023-08-10T11:47:20.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.437+0000 7fc6399ab700 1 -- 172.21.15.152:0/2510350062 learned_addr learned my addr 172.21.15.152:0/2510350062 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-08-10T11:47:20.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.437+0000 7fc63a1ac700 1 --2- 172.21.15.152:0/2510350062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6340ff730 0x7fc634196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:47:20.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.437+0000 7fc63a9ad700 1 --2- 172.21.15.152:0/2510350062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6341012d0 0x7fc63419da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:47:20.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.437+0000 7fc6399ab700 1 -- 172.21.15.152:0/2510350062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6341012d0 msgr2=0x7fc63419da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:47:20.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.437+0000 7fc6399ab700 1 --2- 172.21.15.152:0/2510350062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6341012d0 0x7fc63419da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:47:20.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.437+0000 7fc6399ab700 1 -- 172.21.15.152:0/2510350062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6340ff730 msgr2=0x7fc634196470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:47:20.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.437+0000 7fc6399ab700 1 --2- 172.21.15.152:0/2510350062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6340ff730 0x7fc634196470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:47:20.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.437+0000 7fc6399ab700 1 -- 172.21.15.152:0/2510350062 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6300095f0 con 0x7fc634100930 2023-08-10T11:47:20.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.437+0000 7fc6399ab700 1 --2- 172.21.15.152:0/2510350062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc634100930 0x7fc6341969b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc6300036f0 tx=0x7fc630005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:47:20.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.438+0000 7fc62b7fe700 1 -- 172.21.15.152:0/2510350062 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63001d070 con 0x7fc634100930 2023-08-10T11:47:20.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.438+0000 7fc63c410700 1 -- 172.21.15.152:0/2510350062 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc634101db0 con 0x7fc634100930 2023-08-10T11:47:20.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.438+0000 7fc62b7fe700 1 -- 172.21.15.152:0/2510350062 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc630004010 con 0x7fc634100930 2023-08-10T11:47:20.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.438+0000 7fc63c410700 1 -- 172.21.15.152:0/2510350062 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6341022a0 con 0x7fc634100930 2023-08-10T11:47:20.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.438+0000 7fc62b7fe700 1 -- 172.21.15.152:0/2510350062 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630022dd0 con 0x7fc634100930 2023-08-10T11:47:20.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.439+0000 7fc63c410700 1 -- 172.21.15.152:0/2510350062 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc634107770 con 0x7fc634100930 2023-08-10T11:47:20.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.440+0000 7fc62b7fe700 1 -- 172.21.15.152:0/2510350062 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fc630022500 con 0x7fc634100930 2023-08-10T11:47:20.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.441+0000 7fc62b7fe700 1 --2- 172.21.15.152:0/2510350062 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc6200a1150 0x7fc6200a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:47:20.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.441+0000 7fc62b7fe700 1 -- 172.21.15.152:0/2510350062 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3702+0+0 (secure 0 0 0) 0x7fc6300ccdd0 con 0x7fc634100930 2023-08-10T11:47:20.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.441+0000 7fc63a1ac700 1 --2- 172.21.15.152:0/2510350062 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc6200a1150 0x7fc6200a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:47:20.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.442+0000 7fc63a1ac700 1 --2- 172.21.15.152:0/2510350062 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc6200a1150 0x7fc6200a3610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc634100790 tx=0x7fc62400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:47:20.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.444+0000 7fc62b7fe700 1 -- 172.21.15.152:0/2510350062 <== mon.2 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fc6300977b0 con 0x7fc634100930 2023-08-10T11:47:20.637 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:20.636+0000 7fc63c410700 1 -- 172.21.15.152:0/2510350062 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fc634060bb0 con 0x7fc6200a1150 2023-08-10T11:47:20.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:20 smithi152 ceph-mon[130220]: purged_snaps scrub starts 2023-08-10T11:47:20.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:20 smithi152 ceph-mon[130220]: purged_snaps scrub ok 2023-08-10T11:47:20.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:20 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T11:47:20.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:20 smithi152 ceph-mon[130220]: osd.3 [v2:172.21.15.73:6810/3101572649,v1:172.21.15.73:6811/3101572649] boot 2023-08-10T11:47:20.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:20 smithi152 ceph-mon[130220]: osdmap e25: 4 total, 4 up, 4 in 2023-08-10T11:47:20.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:20 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T11:47:20.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:20 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:47:20.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:20 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:47:20.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:20 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:21.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:20 smithi156 ceph-mon[130574]: purged_snaps scrub starts 2023-08-10T11:47:21.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:20 smithi156 ceph-mon[130574]: purged_snaps scrub ok 2023-08-10T11:47:21.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:20 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T11:47:21.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:20 smithi156 ceph-mon[130574]: osd.3 [v2:172.21.15.73:6810/3101572649,v1:172.21.15.73:6811/3101572649] boot 2023-08-10T11:47:21.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:20 smithi156 ceph-mon[130574]: osdmap e25: 4 total, 4 up, 4 in 2023-08-10T11:47:21.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:20 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T11:47:21.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:20 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:47:21.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:20 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:47:21.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:20 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:21.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:20 smithi073 ceph-mon[128869]: purged_snaps scrub starts 2023-08-10T11:47:21.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:20 smithi073 ceph-mon[128869]: purged_snaps scrub ok 2023-08-10T11:47:21.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:20 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T11:47:21.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:20 smithi073 ceph-mon[128869]: osd.3 [v2:172.21.15.73:6810/3101572649,v1:172.21.15.73:6811/3101572649] boot 2023-08-10T11:47:21.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:20 smithi073 ceph-mon[128869]: osdmap e25: 4 total, 4 up, 4 in 2023-08-10T11:47:21.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:20 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T11:47:21.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:20 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:47:21.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:20 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:47:21.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:20 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:21.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:21 smithi152 ceph-mon[130220]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-08-10T11:47:21.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:21 smithi152 ceph-mon[130220]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:47:21.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:21 smithi152 ceph-mon[130220]: osdmap e26: 4 total, 4 up, 4 in 2023-08-10T11:47:22.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:21 smithi156 ceph-mon[130574]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-08-10T11:47:22.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:21 smithi156 ceph-mon[130574]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:47:22.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:21 smithi156 ceph-mon[130574]: osdmap e26: 4 total, 4 up, 4 in 2023-08-10T11:47:22.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:21 smithi073 ceph-mon[128869]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-08-10T11:47:22.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:21 smithi073 ceph-mon[128869]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:47:22.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:21 smithi073 ceph-mon[128869]: osdmap e26: 4 total, 4 up, 4 in 2023-08-10T11:47:22.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:22 smithi152 ceph-mon[130220]: osdmap e27: 4 total, 4 up, 4 in 2023-08-10T11:47:23.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:22 smithi156 ceph-mon[130574]: osdmap e27: 4 total, 4 up, 4 in 2023-08-10T11:47:23.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:22 smithi073 ceph-mon[128869]: osdmap e27: 4 total, 4 up, 4 in 2023-08-10T11:47:24.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:23 smithi073 ceph-mon[128869]: pgmap v94: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2023-08-10T11:47:24.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:23 smithi073 ceph-mon[128869]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-08-10T11:47:24.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:23 smithi073 ceph-mon[128869]: osdmap e28: 4 total, 4 up, 4 in 2023-08-10T11:47:24.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:23 smithi073 ceph-mon[128869]: from='client.? 172.21.15.152:0/3293239641' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb3adb09-8807-42d9-8db9-1867c5fe02da"}]: dispatch 2023-08-10T11:47:24.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:23 smithi073 ceph-mon[128869]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb3adb09-8807-42d9-8db9-1867c5fe02da"}]: dispatch 2023-08-10T11:47:24.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:23 smithi073 ceph-mon[128869]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb3adb09-8807-42d9-8db9-1867c5fe02da"}]': finished 2023-08-10T11:47:24.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:23 smithi073 ceph-mon[128869]: osdmap e29: 5 total, 4 up, 5 in 2023-08-10T11:47:24.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T11:47:24.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:23 smithi073 ceph-mon[128869]: from='client.? 172.21.15.152:0/2442299440' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:47:24.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:23 smithi152 ceph-mon[130220]: pgmap v94: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2023-08-10T11:47:24.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:23 smithi152 ceph-mon[130220]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-08-10T11:47:24.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:23 smithi152 ceph-mon[130220]: osdmap e28: 4 total, 4 up, 4 in 2023-08-10T11:47:24.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:23 smithi152 ceph-mon[130220]: from='client.? 172.21.15.152:0/3293239641' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb3adb09-8807-42d9-8db9-1867c5fe02da"}]: dispatch 2023-08-10T11:47:24.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:23 smithi152 ceph-mon[130220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb3adb09-8807-42d9-8db9-1867c5fe02da"}]: dispatch 2023-08-10T11:47:24.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:23 smithi152 ceph-mon[130220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb3adb09-8807-42d9-8db9-1867c5fe02da"}]': finished 2023-08-10T11:47:24.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:23 smithi152 ceph-mon[130220]: osdmap e29: 5 total, 4 up, 5 in 2023-08-10T11:47:24.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:23 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T11:47:24.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:23 smithi152 ceph-mon[130220]: from='client.? 172.21.15.152:0/2442299440' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:47:24.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:23 smithi156 ceph-mon[130574]: pgmap v94: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2023-08-10T11:47:24.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:23 smithi156 ceph-mon[130574]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-08-10T11:47:24.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:23 smithi156 ceph-mon[130574]: osdmap e28: 4 total, 4 up, 4 in 2023-08-10T11:47:24.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:23 smithi156 ceph-mon[130574]: from='client.? 172.21.15.152:0/3293239641' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb3adb09-8807-42d9-8db9-1867c5fe02da"}]: dispatch 2023-08-10T11:47:24.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:23 smithi156 ceph-mon[130574]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb3adb09-8807-42d9-8db9-1867c5fe02da"}]: dispatch 2023-08-10T11:47:24.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:23 smithi156 ceph-mon[130574]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb3adb09-8807-42d9-8db9-1867c5fe02da"}]': finished 2023-08-10T11:47:24.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:23 smithi156 ceph-mon[130574]: osdmap e29: 5 total, 4 up, 5 in 2023-08-10T11:47:24.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:23 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T11:47:24.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:23 smithi156 ceph-mon[130574]: from='client.? 172.21.15.152:0/2442299440' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:47:26.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:25 smithi073 ceph-mon[128869]: pgmap v97: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2023-08-10T11:47:26.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:25 smithi152 ceph-mon[130220]: pgmap v97: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2023-08-10T11:47:26.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:25 smithi156 ceph-mon[130574]: pgmap v97: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2023-08-10T11:47:28.167 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:27 smithi152 ceph-mon[130220]: pgmap v98: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2023-08-10T11:47:28.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:27 smithi156 ceph-mon[130574]: pgmap v98: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2023-08-10T11:47:28.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:27 smithi073 ceph-mon[128869]: pgmap v98: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2023-08-10T11:47:29.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:29 smithi152 ceph-mon[130220]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2023-08-10T11:47:29.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:29 smithi152 ceph-mon[130220]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2023-08-10T11:47:29.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:29 smithi152 ceph-mon[130220]: Cluster is now healthy 2023-08-10T11:47:29.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:29 smithi156 ceph-mon[130574]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2023-08-10T11:47:29.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:29 smithi156 ceph-mon[130574]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2023-08-10T11:47:29.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:29 smithi156 ceph-mon[130574]: Cluster is now healthy 2023-08-10T11:47:29.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:29 smithi073 ceph-mon[128869]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2023-08-10T11:47:29.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:29 smithi073 ceph-mon[128869]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2023-08-10T11:47:29.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:29 smithi073 ceph-mon[128869]: Cluster is now healthy 2023-08-10T11:47:30.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:30 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-08-10T11:47:30.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:30 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:30.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:30 smithi152 ceph-mon[130220]: Deploying daemon osd.4 on smithi152 2023-08-10T11:47:30.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:30 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-08-10T11:47:30.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:30 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:30.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:30 smithi156 ceph-mon[130574]: Deploying daemon osd.4 on smithi152 2023-08-10T11:47:30.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:30 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-08-10T11:47:30.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:30 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:30.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:30 smithi073 ceph-mon[128869]: Deploying daemon osd.4 on smithi152 2023-08-10T11:47:31.622 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:31 smithi152 ceph-mon[130220]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-08-10T11:47:31.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:31 smithi156 ceph-mon[130574]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-08-10T11:47:31.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:31 smithi073 ceph-mon[128869]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-08-10T11:47:33.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:33 smithi152 ceph-mon[130220]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2023-08-10T11:47:33.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:33 smithi156 ceph-mon[130574]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2023-08-10T11:47:33.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:33 smithi073 ceph-mon[128869]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2023-08-10T11:47:35.319 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:35 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:35.319 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:35 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:47:35.320 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:35 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:35.320 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:35 smithi152 ceph-mon[130220]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-08-10T11:47:35.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:35 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:35.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:35 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:47:35.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:35 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:35.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:35 smithi156 ceph-mon[130574]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-08-10T11:47:35.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:35 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:35.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:35 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:47:35.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:35 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:35.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:35 smithi073 ceph-mon[128869]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-08-10T11:47:36.845 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 4 on host 'smithi152' 2023-08-10T11:47:36.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:36.844+0000 7fc62b7fe700 1 -- 172.21.15.152:0/2510350062 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc634060bb0 con 0x7fc6200a1150 2023-08-10T11:47:36.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:36.846+0000 7fc63c410700 1 -- 172.21.15.152:0/2510350062 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc6200a1150 msgr2=0x7fc6200a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:47:36.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:36.846+0000 7fc63c410700 1 --2- 172.21.15.152:0/2510350062 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc6200a1150 0x7fc6200a3610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc634100790 tx=0x7fc62400b410 comp rx=0 tx=0).stop 2023-08-10T11:47:36.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:36.846+0000 7fc63c410700 1 -- 172.21.15.152:0/2510350062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc634100930 msgr2=0x7fc6341969b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:47:36.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:36.846+0000 7fc63c410700 1 --2- 172.21.15.152:0/2510350062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc634100930 0x7fc6341969b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc6300036f0 tx=0x7fc630005740 comp rx=0 tx=0).stop 2023-08-10T11:47:36.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:36.846+0000 7fc63c410700 1 -- 172.21.15.152:0/2510350062 shutdown_connections 2023-08-10T11:47:36.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:36.846+0000 7fc63c410700 1 --2- 172.21.15.152:0/2510350062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6341012d0 0x7fc63419da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:47:36.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:36.846+0000 7fc63c410700 1 --2- 172.21.15.152:0/2510350062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6340ff730 0x7fc634196470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:47:36.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:36.846+0000 7fc63c410700 1 --2- 172.21.15.152:0/2510350062 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc6200a1150 0x7fc6200a3610 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:47:36.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:36.846+0000 7fc63c410700 1 --2- 172.21.15.152:0/2510350062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc634100930 0x7fc6341969b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:47:36.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:36.846+0000 7fc63c410700 1 -- 172.21.15.152:0/2510350062 >> 172.21.15.152:0/2510350062 conn(0x7fc6340facf0 msgr2=0x7fc6340fceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:47:36.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:36.846+0000 7fc63c410700 1 -- 172.21.15.152:0/2510350062 shutdown_connections 2023-08-10T11:47:36.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:47:36.846+0000 7fc63c410700 1 -- 172.21.15.152:0/2510350062 wait complete. 2023-08-10T11:47:37.269 DEBUG:teuthology.orchestra.run.smithi152:osd.4> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@osd.4.service 2023-08-10T11:47:37.272 INFO:tasks.cephadm:Deploying osd.5 on smithi156 with /dev/vg_nvme/lv_3... 2023-08-10T11:47:37.272 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-08-10T11:47:37.304 INFO:journalctl@ceph.osd.4.smithi152.stdout:-- Logs begin at Thu 2023-08-10 11:15:14 UTC. -- 2023-08-10T11:47:37.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:37 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:37.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:37 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:37.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:37 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:37.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:37 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:47:37.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:37 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:37.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:37 smithi152 ceph-mon[130220]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-08-10T11:47:37.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:37 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:37.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:37 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:37.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:37 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:47:37.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:37 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:37.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:37 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:37.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:37 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:37.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:37 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:47:37.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:37 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:37.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:37 smithi156 ceph-mon[130574]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-08-10T11:47:37.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:37 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:37.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:37 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:37.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:37 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:47:37.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:37 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:37.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:37 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:37.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:37 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:37.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:37 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:47:37.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:37 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:37.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:37 smithi073 ceph-mon[128869]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-08-10T11:47:37.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:37 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:37.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:37 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:37.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:37 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:47:37.834 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T11:47:38.404 INFO:journalctl@ceph.osd.4.smithi152.stdout:Aug 10 11:47:38 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-4[140799]: 2023-08-10T11:47:38.200+0000 7f3d995bd640 -1 osd.4 0 log_to_monitors true 2023-08-10T11:47:38.696 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:38 smithi156 ceph-mon[130574]: from='osd.4 [v2:172.21.15.152:6808/1451517889,v1:172.21.15.152:6809/1451517889]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-08-10T11:47:38.697 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:38 smithi156 ceph-mon[130574]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-08-10T11:47:38.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:38 smithi152 ceph-mon[130220]: from='osd.4 [v2:172.21.15.152:6808/1451517889,v1:172.21.15.152:6809/1451517889]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-08-10T11:47:38.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:38 smithi152 ceph-mon[130220]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-08-10T11:47:38.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:38 smithi073 ceph-mon[128869]: from='osd.4 [v2:172.21.15.152:6808/1451517889,v1:172.21.15.152:6809/1451517889]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-08-10T11:47:38.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:38 smithi073 ceph-mon[128869]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-08-10T11:47:39.561 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-08-10T11:47:39.561 INFO:teuthology.orchestra.run.smithi156.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-08-10T11:47:39.561 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10+0 records in 2023-08-10T11:47:39.561 INFO:teuthology.orchestra.run.smithi156.stderr:10+0 records out 2023-08-10T11:47:39.562 INFO:teuthology.orchestra.run.smithi156.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00844211 s, 1.2 GB/s 2023-08-10T11:47:39.562 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 2023-08-10T11:47:39.562 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping successful for: 2023-08-10T11:47:39.709 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:39 smithi156 ceph-mon[130574]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-08-10T11:47:39.710 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:39 smithi156 ceph-mon[130574]: osdmap e30: 5 total, 4 up, 5 in 2023-08-10T11:47:39.710 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:39 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T11:47:39.710 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:39 smithi156 ceph-mon[130574]: from='osd.4 [v2:172.21.15.152:6808/1451517889,v1:172.21.15.152:6809/1451517889]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-08-10T11:47:39.710 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:39 smithi156 ceph-mon[130574]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-08-10T11:47:39.710 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:39 smithi156 ceph-mon[130574]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-08-10T11:47:39.745 INFO:journalctl@ceph.osd.4.smithi152.stdout:Aug 10 11:47:39 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-4[140799]: 2023-08-10T11:47:39.423+0000 7f3d8e434700 -1 osd.4 0 waiting for initial osdmap 2023-08-10T11:47:39.745 INFO:journalctl@ceph.osd.4.smithi152.stdout:Aug 10 11:47:39 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-4[140799]: 2023-08-10T11:47:39.430+0000 7f3d88a26700 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T11:47:39.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:39 smithi152 ceph-mon[130220]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-08-10T11:47:39.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:39 smithi152 ceph-mon[130220]: osdmap e30: 5 total, 4 up, 5 in 2023-08-10T11:47:39.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:39 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T11:47:39.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:39 smithi152 ceph-mon[130220]: from='osd.4 [v2:172.21.15.152:6808/1451517889,v1:172.21.15.152:6809/1451517889]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-08-10T11:47:39.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:39 smithi152 ceph-mon[130220]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-08-10T11:47:39.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:39 smithi152 ceph-mon[130220]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-08-10T11:47:39.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:39 smithi073 ceph-mon[128869]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-08-10T11:47:39.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:39 smithi073 ceph-mon[128869]: osdmap e30: 5 total, 4 up, 5 in 2023-08-10T11:47:39.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:39 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T11:47:39.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:39 smithi073 ceph-mon[128869]: from='osd.4 [v2:172.21.15.152:6808/1451517889,v1:172.21.15.152:6809/1451517889]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-08-10T11:47:39.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:39 smithi073 ceph-mon[128869]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-08-10T11:47:39.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:39 smithi073 ceph-mon[128869]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-08-10T11:47:39.991 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi156:vg_nvme/lv_3 2023-08-10T11:47:40.542 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T11:47:40.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:40 smithi152 ceph-mon[130220]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-08-10T11:47:40.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:40 smithi152 ceph-mon[130220]: osdmap e31: 5 total, 4 up, 5 in 2023-08-10T11:47:40.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:40 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T11:47:40.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:40 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T11:47:40.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:40 smithi152 ceph-mon[130220]: Detected new or changed devices on smithi152 2023-08-10T11:47:40.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:40 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:40.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:40 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:40.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:40 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:47:40.748 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:40 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:47:40.748 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:40 smithi152 ceph-mon[130220]: Adjusting osd_memory_target on smithi152 to 8584M 2023-08-10T11:47:40.748 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:40 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:40.749 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:40 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:40.749 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:40 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:47:40.749 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:40 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:40.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:40 smithi156 ceph-mon[130574]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-08-10T11:47:40.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:40 smithi156 ceph-mon[130574]: osdmap e31: 5 total, 4 up, 5 in 2023-08-10T11:47:40.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:40 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T11:47:40.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:40 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T11:47:40.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:40 smithi156 ceph-mon[130574]: Detected new or changed devices on smithi152 2023-08-10T11:47:40.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:40 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:40.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:40 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:40.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:40 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:47:40.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:40 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:47:40.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:40 smithi156 ceph-mon[130574]: Adjusting osd_memory_target on smithi152 to 8584M 2023-08-10T11:47:40.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:40 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:40.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:40 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:40.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:40 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:47:40.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:40 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:40.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:40 smithi073 ceph-mon[128869]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-08-10T11:47:40.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:40 smithi073 ceph-mon[128869]: osdmap e31: 5 total, 4 up, 5 in 2023-08-10T11:47:40.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:40 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T11:47:40.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:40 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T11:47:40.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:40 smithi073 ceph-mon[128869]: Detected new or changed devices on smithi152 2023-08-10T11:47:40.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:40 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:40.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:40 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:40.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:40 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:47:40.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:40 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:47:40.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:40 smithi073 ceph-mon[128869]: Adjusting osd_memory_target on smithi152 to 8584M 2023-08-10T11:47:40.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:40 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:40.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:40 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:40.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:40 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:47:40.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:40 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:41.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:41 smithi152 ceph-mon[130220]: purged_snaps scrub starts 2023-08-10T11:47:41.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:41 smithi152 ceph-mon[130220]: purged_snaps scrub ok 2023-08-10T11:47:41.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T11:47:41.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:41 smithi152 ceph-mon[130220]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-08-10T11:47:41.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:41 smithi152 ceph-mon[130220]: osd.4 [v2:172.21.15.152:6808/1451517889,v1:172.21.15.152:6809/1451517889] boot 2023-08-10T11:47:41.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:41 smithi152 ceph-mon[130220]: osdmap e32: 5 total, 5 up, 5 in 2023-08-10T11:47:41.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T11:47:41.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:41 smithi156 ceph-mon[130574]: purged_snaps scrub starts 2023-08-10T11:47:41.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:41 smithi156 ceph-mon[130574]: purged_snaps scrub ok 2023-08-10T11:47:41.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:41 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T11:47:41.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:41 smithi156 ceph-mon[130574]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-08-10T11:47:41.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:41 smithi156 ceph-mon[130574]: osd.4 [v2:172.21.15.152:6808/1451517889,v1:172.21.15.152:6809/1451517889] boot 2023-08-10T11:47:41.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:41 smithi156 ceph-mon[130574]: osdmap e32: 5 total, 5 up, 5 in 2023-08-10T11:47:41.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:41 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T11:47:41.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:41 smithi073 ceph-mon[128869]: purged_snaps scrub starts 2023-08-10T11:47:41.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:41 smithi073 ceph-mon[128869]: purged_snaps scrub ok 2023-08-10T11:47:41.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:41 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T11:47:41.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:41 smithi073 ceph-mon[128869]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-08-10T11:47:41.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:41 smithi073 ceph-mon[128869]: osd.4 [v2:172.21.15.152:6808/1451517889,v1:172.21.15.152:6809/1451517889] boot 2023-08-10T11:47:41.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:41 smithi073 ceph-mon[128869]: osdmap e32: 5 total, 5 up, 5 in 2023-08-10T11:47:41.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:41 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T11:47:41.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.776+0000 7f91dc0aa700 1 -- 172.21.15.156:0/1216217086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91d41012a0 msgr2=0x7f91d4107b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:47:41.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.776+0000 7f91dc0aa700 1 --2- 172.21.15.156:0/1216217086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91d41012a0 0x7f91d4107b50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f91cc00b0a0 tx=0x7f91cc00b3b0 comp rx=0 tx=0).stop 2023-08-10T11:47:41.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.776+0000 7f91dc0aa700 1 -- 172.21.15.156:0/1216217086 shutdown_connections 2023-08-10T11:47:41.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.776+0000 7f91dc0aa700 1 --2- 172.21.15.156:0/1216217086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91d41012a0 0x7f91d4107b50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:47:41.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.776+0000 7f91dc0aa700 1 --2- 172.21.15.156:0/1216217086 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91d40ff700 0x7f91d40ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:47:41.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.776+0000 7f91dc0aa700 1 --2- 172.21.15.156:0/1216217086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91d4100900 0x7f91d4100d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:47:41.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.776+0000 7f91dc0aa700 1 -- 172.21.15.156:0/1216217086 >> 172.21.15.156:0/1216217086 conn(0x7f91d40fac80 msgr2=0x7f91d40fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:47:41.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.776+0000 7f91dc0aa700 1 -- 172.21.15.156:0/1216217086 shutdown_connections 2023-08-10T11:47:41.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.776+0000 7f91dc0aa700 1 -- 172.21.15.156:0/1216217086 wait complete. 2023-08-10T11:47:41.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.777+0000 7f91dc0aa700 1 Processor -- start 2023-08-10T11:47:41.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.777+0000 7f91dc0aa700 1 -- start start 2023-08-10T11:47:41.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.777+0000 7f91dc0aa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91d40ff700 0x7f91d4195490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:47:41.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.777+0000 7f91dc0aa700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91d4100900 0x7f91d41959d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:47:41.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.777+0000 7f91dc0aa700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91d41012a0 0x7f91d419ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:47:41.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.777+0000 7f91dc0aa700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d419d020 con 0x7f91d41012a0 2023-08-10T11:47:41.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.777+0000 7f91dc0aa700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d419d160 con 0x7f91d40ff700 2023-08-10T11:47:41.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.777+0000 7f91dc0aa700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d419d2f0 con 0x7f91d4100900 2023-08-10T11:47:41.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.777+0000 7f91d9645700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91d4100900 0x7f91d41959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:47:41.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.777+0000 7f91d9645700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91d4100900 0x7f91d41959d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36792/0 (socket says 172.21.15.156:36792) 2023-08-10T11:47:41.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.777+0000 7f91d9645700 1 -- 172.21.15.156:0/303351443 learned_addr learned my addr 172.21.15.156:0/303351443 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-08-10T11:47:41.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.777+0000 7f91d9e46700 1 --2- 172.21.15.156:0/303351443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91d40ff700 0x7f91d4195490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:47:41.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.777+0000 7f91da647700 1 --2- 172.21.15.156:0/303351443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91d41012a0 0x7f91d419ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:47:41.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.777+0000 7f91d9645700 1 -- 172.21.15.156:0/303351443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91d40ff700 msgr2=0x7f91d4195490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:47:41.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.777+0000 7f91d9645700 1 --2- 172.21.15.156:0/303351443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91d40ff700 0x7f91d4195490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:47:41.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.777+0000 7f91d9645700 1 -- 172.21.15.156:0/303351443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91d41012a0 msgr2=0x7f91d419ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:47:41.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.777+0000 7f91d9645700 1 --2- 172.21.15.156:0/303351443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91d41012a0 0x7f91d419ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:47:41.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.777+0000 7f91d9645700 1 -- 172.21.15.156:0/303351443 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91cc009d00 con 0x7f91d4100900 2023-08-10T11:47:41.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.777+0000 7f91d9e46700 1 --2- 172.21.15.156:0/303351443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91d40ff700 0x7f91d4195490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:47:41.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.778+0000 7f91da647700 1 --2- 172.21.15.156:0/303351443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91d41012a0 0x7f91d419ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:47:41.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.778+0000 7f91d9645700 1 --2- 172.21.15.156:0/303351443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91d4100900 0x7f91d41959d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f91d000c950 tx=0x7f91d000cd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:47:41.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.778+0000 7f91caffd700 1 -- 172.21.15.156:0/303351443 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0007ac0 con 0x7f91d4100900 2023-08-10T11:47:41.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.778+0000 7f91caffd700 1 -- 172.21.15.156:0/303351443 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91d0004cf0 con 0x7f91d4100900 2023-08-10T11:47:41.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.778+0000 7f91dc0aa700 1 -- 172.21.15.156:0/303351443 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d419d5d0 con 0x7f91d4100900 2023-08-10T11:47:41.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.778+0000 7f91caffd700 1 -- 172.21.15.156:0/303351443 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0005550 con 0x7f91d4100900 2023-08-10T11:47:41.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.778+0000 7f91dc0aa700 1 -- 172.21.15.156:0/303351443 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d419dad0 con 0x7f91d4100900 2023-08-10T11:47:41.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.779+0000 7f91dc0aa700 1 -- 172.21.15.156:0/303351443 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d410af10 con 0x7f91d4100900 2023-08-10T11:47:41.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.781+0000 7f91caffd700 1 -- 172.21.15.156:0/303351443 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f91d0004750 con 0x7f91d4100900 2023-08-10T11:47:41.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.781+0000 7f91caffd700 1 --2- 172.21.15.156:0/303351443 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f91c00a1150 0x7f91c00a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:47:41.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.781+0000 7f91caffd700 1 -- 172.21.15.156:0/303351443 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4101+0+0 (secure 0 0 0) 0x7f91d00cb850 con 0x7f91d4100900 2023-08-10T11:47:41.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.781+0000 7f91d9e46700 1 --2- 172.21.15.156:0/303351443 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f91c00a1150 0x7f91c00a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:47:41.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.782+0000 7f91d9e46700 1 --2- 172.21.15.156:0/303351443 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f91c00a1150 0x7f91c00a3610 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f91d4100760 tx=0x7f91c400b670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:47:41.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.785+0000 7f91caffd700 1 -- 172.21.15.156:0/303351443 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f91d0096010 con 0x7f91d4100900 2023-08-10T11:47:41.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:41.978+0000 7f91dc0aa700 1 -- 172.21.15.156:0/303351443 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f91d4060bb0 con 0x7f91c00a1150 2023-08-10T11:47:42.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:42 smithi152 ceph-mon[130220]: osdmap e33: 5 total, 5 up, 5 in 2023-08-10T11:47:42.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:42 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:47:42.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:42 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:47:42.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:42 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:42.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:42 smithi156 ceph-mon[130574]: osdmap e33: 5 total, 5 up, 5 in 2023-08-10T11:47:42.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:42 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:47:42.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:42 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:47:42.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:42 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:42.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:42 smithi073 ceph-mon[128869]: osdmap e33: 5 total, 5 up, 5 in 2023-08-10T11:47:42.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:42 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:47:42.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:42 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:47:42.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:42 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:43.714 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:43 smithi156 ceph-mon[130574]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:47:43.714 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:43 smithi156 ceph-mon[130574]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:47:43.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:43 smithi152 ceph-mon[130220]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:47:43.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:43 smithi152 ceph-mon[130220]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:47:43.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:43 smithi073 ceph-mon[128869]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:47:43.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:43 smithi073 ceph-mon[128869]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:47:44.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:44 smithi152 ceph-mon[130220]: from='client.? 172.21.15.156:0/1242544640' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af58a7bd-4e58-4639-95b2-4a76011b61dc"}]: dispatch 2023-08-10T11:47:44.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:44 smithi152 ceph-mon[130220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af58a7bd-4e58-4639-95b2-4a76011b61dc"}]: dispatch 2023-08-10T11:47:44.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:44 smithi152 ceph-mon[130220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "af58a7bd-4e58-4639-95b2-4a76011b61dc"}]': finished 2023-08-10T11:47:44.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:44 smithi152 ceph-mon[130220]: osdmap e34: 6 total, 5 up, 6 in 2023-08-10T11:47:44.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:44 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T11:47:44.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:44 smithi156 ceph-mon[130574]: from='client.? 172.21.15.156:0/1242544640' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af58a7bd-4e58-4639-95b2-4a76011b61dc"}]: dispatch 2023-08-10T11:47:44.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:44 smithi156 ceph-mon[130574]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af58a7bd-4e58-4639-95b2-4a76011b61dc"}]: dispatch 2023-08-10T11:47:44.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:44 smithi156 ceph-mon[130574]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "af58a7bd-4e58-4639-95b2-4a76011b61dc"}]': finished 2023-08-10T11:47:44.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:44 smithi156 ceph-mon[130574]: osdmap e34: 6 total, 5 up, 6 in 2023-08-10T11:47:44.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:44 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T11:47:44.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:44 smithi073 ceph-mon[128869]: from='client.? 172.21.15.156:0/1242544640' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af58a7bd-4e58-4639-95b2-4a76011b61dc"}]: dispatch 2023-08-10T11:47:44.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:44 smithi073 ceph-mon[128869]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af58a7bd-4e58-4639-95b2-4a76011b61dc"}]: dispatch 2023-08-10T11:47:44.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:44 smithi073 ceph-mon[128869]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "af58a7bd-4e58-4639-95b2-4a76011b61dc"}]': finished 2023-08-10T11:47:44.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:44 smithi073 ceph-mon[128869]: osdmap e34: 6 total, 5 up, 6 in 2023-08-10T11:47:44.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:44 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T11:47:45.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:45 smithi152 ceph-mon[130220]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:47:45.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:45 smithi152 ceph-mon[130220]: from='client.? 172.21.15.156:0/3213524219' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:47:45.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:45 smithi156 ceph-mon[130574]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:47:45.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:45 smithi156 ceph-mon[130574]: from='client.? 172.21.15.156:0/3213524219' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:47:45.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:45 smithi073 ceph-mon[128869]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:47:45.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:45 smithi073 ceph-mon[128869]: from='client.? 172.21.15.156:0/3213524219' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:47:47.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:47 smithi152 ceph-mon[130220]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:47:47.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:47 smithi156 ceph-mon[130574]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:47:47.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:47 smithi073 ceph-mon[128869]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:47:49.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:49 smithi152 ceph-mon[130220]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:47:49.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:49 smithi156 ceph-mon[130574]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:47:49.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:49 smithi073 ceph-mon[128869]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:47:51.726 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:51 smithi156 ceph-mon[130574]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:47:51.726 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:51 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-08-10T11:47:51.727 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:51 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:51.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:51 smithi152 ceph-mon[130220]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:47:51.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:51 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-08-10T11:47:51.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:51 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:51.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:51 smithi073 ceph-mon[128869]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:47:51.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:51 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-08-10T11:47:51.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:51 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:52.556 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:52 smithi156 ceph-mon[130574]: Deploying daemon osd.5 on smithi156 2023-08-10T11:47:52.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:52 smithi152 ceph-mon[130220]: Deploying daemon osd.5 on smithi156 2023-08-10T11:47:52.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:52 smithi073 ceph-mon[128869]: Deploying daemon osd.5 on smithi156 2023-08-10T11:47:53.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:53 smithi152 ceph-mon[130220]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:47:53.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:53 smithi156 ceph-mon[130574]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:47:53.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:53 smithi073 ceph-mon[128869]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:47:55.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:55 smithi156 ceph-mon[130574]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:47:55.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:55 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:55.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:55 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:55.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:55 smithi152 ceph-mon[130220]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:47:55.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:55 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:55.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:55 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:55.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:55 smithi073 ceph-mon[128869]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:47:55.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:55 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:55.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:55 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:56.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:56 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:47:56.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:56 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:47:56.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:56 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:47:57.704 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:57 smithi156 ceph-mon[130574]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:47:57.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:57 smithi152 ceph-mon[130220]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:47:57.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:57 smithi073 ceph-mon[128869]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:47:58.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:58.785+0000 7f91caffd700 1 -- 172.21.15.156:0/303351443 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f91d4060bb0 con 0x7f91c00a1150 2023-08-10T11:47:58.787 INFO:teuthology.orchestra.run.smithi156.stdout:Created osd(s) 5 on host 'smithi156' 2023-08-10T11:47:58.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:58.788+0000 7f91dc0aa700 1 -- 172.21.15.156:0/303351443 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f91c00a1150 msgr2=0x7f91c00a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:47:58.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:58.788+0000 7f91dc0aa700 1 --2- 172.21.15.156:0/303351443 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f91c00a1150 0x7f91c00a3610 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f91d4100760 tx=0x7f91c400b670 comp rx=0 tx=0).stop 2023-08-10T11:47:58.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:58.788+0000 7f91dc0aa700 1 -- 172.21.15.156:0/303351443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91d4100900 msgr2=0x7f91d41959d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:47:58.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:58.788+0000 7f91dc0aa700 1 --2- 172.21.15.156:0/303351443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91d4100900 0x7f91d41959d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f91d000c950 tx=0x7f91d000cd10 comp rx=0 tx=0).stop 2023-08-10T11:47:58.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:58.788+0000 7f91dc0aa700 1 -- 172.21.15.156:0/303351443 shutdown_connections 2023-08-10T11:47:58.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:58.788+0000 7f91dc0aa700 1 --2- 172.21.15.156:0/303351443 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f91c00a1150 0x7f91c00a3610 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:47:58.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:58.788+0000 7f91dc0aa700 1 --2- 172.21.15.156:0/303351443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91d40ff700 0x7f91d4195490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:47:58.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:58.788+0000 7f91dc0aa700 1 --2- 172.21.15.156:0/303351443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91d41012a0 0x7f91d419ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:47:58.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:58.788+0000 7f91dc0aa700 1 --2- 172.21.15.156:0/303351443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91d4100900 0x7f91d41959d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:47:58.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:58.788+0000 7f91dc0aa700 1 -- 172.21.15.156:0/303351443 >> 172.21.15.156:0/303351443 conn(0x7f91d40fac80 msgr2=0x7f91d40fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:47:58.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:58.788+0000 7f91dc0aa700 1 -- 172.21.15.156:0/303351443 shutdown_connections 2023-08-10T11:47:58.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:47:58.788+0000 7f91dc0aa700 1 -- 172.21.15.156:0/303351443 wait complete. 2023-08-10T11:47:59.234 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:59 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:59.234 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:59 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:59.234 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:59 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:59.234 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:59 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:47:59.235 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:59 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:59.235 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:59 smithi156 ceph-mon[130574]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:47:59.235 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:59 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:59.235 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:59 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:59.235 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:47:59 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:47:59.236 DEBUG:teuthology.orchestra.run.smithi156:osd.5> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@osd.5.service 2023-08-10T11:47:59.238 INFO:tasks.cephadm:Deploying osd.6 on smithi073 with /dev/vg_nvme/lv_2... 2023-08-10T11:47:59.238 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-08-10T11:47:59.279 INFO:journalctl@ceph.osd.5.smithi156.stdout:-- Logs begin at Thu 2023-08-10 11:15:12 UTC. -- 2023-08-10T11:47:59.283 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:59 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:59.283 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:59 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:59.284 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:59 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:59.284 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:59 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:47:59.284 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:59 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:59.284 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:59 smithi073 ceph-mon[128869]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:47:59.284 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:59 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:59.284 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:59 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:59.284 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:47:59 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:47:59.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:59 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:59.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:59 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:59.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:59 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:47:59.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:59 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:47:59.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:59 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:59.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:59 smithi152 ceph-mon[130220]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:47:59.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:59 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:59.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:59 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:47:59.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:47:59 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:47:59.505 INFO:journalctl@ceph.osd.5.smithi156.stdout:Aug 10 11:47:59 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-5[141940]: 2023-08-10T11:47:59.429+0000 7f8eeba3f640 -1 osd.5 0 log_to_monitors true 2023-08-10T11:47:59.812 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:48:00.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:00 smithi073 ceph-mon[128869]: from='osd.5 [v2:172.21.15.156:6808/3823368741,v1:172.21.15.156:6809/3823368741]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-08-10T11:48:00.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:00 smithi073 ceph-mon[128869]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-08-10T11:48:00.400 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:00 smithi156 ceph-mon[130574]: from='osd.5 [v2:172.21.15.156:6808/3823368741,v1:172.21.15.156:6809/3823368741]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-08-10T11:48:00.400 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:00 smithi156 ceph-mon[130574]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-08-10T11:48:00.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:00 smithi152 ceph-mon[130220]: from='osd.5 [v2:172.21.15.156:6808/3823368741,v1:172.21.15.156:6809/3823368741]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-08-10T11:48:00.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:00 smithi152 ceph-mon[130220]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-08-10T11:48:01.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:01 smithi073 ceph-mon[128869]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-08-10T11:48:01.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:01 smithi073 ceph-mon[128869]: osdmap e35: 6 total, 5 up, 6 in 2023-08-10T11:48:01.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:01 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T11:48:01.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:01 smithi073 ceph-mon[128869]: from='osd.5 [v2:172.21.15.156:6808/3823368741,v1:172.21.15.156:6809/3823368741]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-08-10T11:48:01.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:01 smithi073 ceph-mon[128869]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-08-10T11:48:01.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:01 smithi073 ceph-mon[128869]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:48:01.341 INFO:journalctl@ceph.osd.5.smithi156.stdout:Aug 10 11:48:01 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-5[141940]: 2023-08-10T11:48:01.066+0000 7f8ee08b6700 -1 osd.5 0 waiting for initial osdmap 2023-08-10T11:48:01.341 INFO:journalctl@ceph.osd.5.smithi156.stdout:Aug 10 11:48:01 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-5[141940]: 2023-08-10T11:48:01.073+0000 7f8edaea8700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T11:48:01.342 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:01 smithi156 ceph-mon[130574]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-08-10T11:48:01.342 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:01 smithi156 ceph-mon[130574]: osdmap e35: 6 total, 5 up, 6 in 2023-08-10T11:48:01.342 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:01 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T11:48:01.343 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:01 smithi156 ceph-mon[130574]: from='osd.5 [v2:172.21.15.156:6808/3823368741,v1:172.21.15.156:6809/3823368741]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-08-10T11:48:01.343 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:01 smithi156 ceph-mon[130574]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-08-10T11:48:01.343 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:01 smithi156 ceph-mon[130574]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:48:01.393 INFO:teuthology.orchestra.run.smithi073.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-08-10T11:48:01.393 INFO:teuthology.orchestra.run.smithi073.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-08-10T11:48:01.393 INFO:teuthology.orchestra.run.smithi073.stderr: stderr: 10+0 records in 2023-08-10T11:48:01.394 INFO:teuthology.orchestra.run.smithi073.stderr:10+0 records out 2023-08-10T11:48:01.394 INFO:teuthology.orchestra.run.smithi073.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011064 s, 948 MB/s 2023-08-10T11:48:01.394 INFO:teuthology.orchestra.run.smithi073.stderr:--> Zapping successful for: 2023-08-10T11:48:01.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:01 smithi152 ceph-mon[130220]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-08-10T11:48:01.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:01 smithi152 ceph-mon[130220]: osdmap e35: 6 total, 5 up, 6 in 2023-08-10T11:48:01.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:01 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T11:48:01.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:01 smithi152 ceph-mon[130220]: from='osd.5 [v2:172.21.15.156:6808/3823368741,v1:172.21.15.156:6809/3823368741]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-08-10T11:48:01.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:01 smithi152 ceph-mon[130220]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-08-10T11:48:01.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:01 smithi152 ceph-mon[130220]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-08-10T11:48:01.765 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi073:vg_nvme/lv_2 2023-08-10T11:48:02.327 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:48:02.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:02 smithi152 ceph-mon[130220]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-08-10T11:48:02.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:02 smithi152 ceph-mon[130220]: osdmap e36: 6 total, 5 up, 6 in 2023-08-10T11:48:02.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:02 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T11:48:02.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:02 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T11:48:02.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:02 smithi152 ceph-mon[130220]: Detected new or changed devices on smithi156 2023-08-10T11:48:02.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:02 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:02.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:02 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:02.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:02 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:48:02.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:02 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:48:02.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:02 smithi152 ceph-mon[130220]: Adjusting osd_memory_target on smithi156 to 8584M 2023-08-10T11:48:02.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:02 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:02.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:02 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:02.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:02 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:48:02.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:02 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:02.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:02 smithi156 ceph-mon[130574]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-08-10T11:48:02.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:02 smithi156 ceph-mon[130574]: osdmap e36: 6 total, 5 up, 6 in 2023-08-10T11:48:02.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:02 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T11:48:02.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:02 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T11:48:02.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:02 smithi156 ceph-mon[130574]: Detected new or changed devices on smithi156 2023-08-10T11:48:02.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:02 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:02.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:02 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:02.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:02 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:48:02.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:02 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:48:02.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:02 smithi156 ceph-mon[130574]: Adjusting osd_memory_target on smithi156 to 8584M 2023-08-10T11:48:02.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:02 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:02.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:02 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:02.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:02 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:48:02.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:02 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:02.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:02 smithi073 ceph-mon[128869]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-08-10T11:48:02.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:02 smithi073 ceph-mon[128869]: osdmap e36: 6 total, 5 up, 6 in 2023-08-10T11:48:02.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:02 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T11:48:02.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:02 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T11:48:02.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:02 smithi073 ceph-mon[128869]: Detected new or changed devices on smithi156 2023-08-10T11:48:02.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:02 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:02.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:02 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:02.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:02 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:48:02.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:02 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:48:02.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:02 smithi073 ceph-mon[128869]: Adjusting osd_memory_target on smithi156 to 8584M 2023-08-10T11:48:02.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:02 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:02.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:02 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:02.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:02 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:48:02.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:02 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:03.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:03 smithi073 ceph-mon[128869]: purged_snaps scrub starts 2023-08-10T11:48:03.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:03 smithi073 ceph-mon[128869]: purged_snaps scrub ok 2023-08-10T11:48:03.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:03 smithi073 ceph-mon[128869]: osd.5 [v2:172.21.15.156:6808/3823368741,v1:172.21.15.156:6809/3823368741] boot 2023-08-10T11:48:03.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:03 smithi073 ceph-mon[128869]: osdmap e37: 6 total, 6 up, 6 in 2023-08-10T11:48:03.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:03 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T11:48:03.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:03 smithi073 ceph-mon[128869]: pgmap v124: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-08-10T11:48:03.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:03 smithi152 ceph-mon[130220]: purged_snaps scrub starts 2023-08-10T11:48:03.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:03 smithi152 ceph-mon[130220]: purged_snaps scrub ok 2023-08-10T11:48:03.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:03 smithi152 ceph-mon[130220]: osd.5 [v2:172.21.15.156:6808/3823368741,v1:172.21.15.156:6809/3823368741] boot 2023-08-10T11:48:03.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:03 smithi152 ceph-mon[130220]: osdmap e37: 6 total, 6 up, 6 in 2023-08-10T11:48:03.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:03 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T11:48:03.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:03 smithi152 ceph-mon[130220]: pgmap v124: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-08-10T11:48:03.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:03 smithi156 ceph-mon[130574]: purged_snaps scrub starts 2023-08-10T11:48:03.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:03 smithi156 ceph-mon[130574]: purged_snaps scrub ok 2023-08-10T11:48:03.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:03 smithi156 ceph-mon[130574]: osd.5 [v2:172.21.15.156:6808/3823368741,v1:172.21.15.156:6809/3823368741] boot 2023-08-10T11:48:03.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:03 smithi156 ceph-mon[130574]: osdmap e37: 6 total, 6 up, 6 in 2023-08-10T11:48:03.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:03 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T11:48:03.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:03 smithi156 ceph-mon[130574]: pgmap v124: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-08-10T11:48:03.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.640+0000 7fecd05f2700 1 -- 172.21.15.73:0/4117088601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecc81012a0 msgr2=0x7fecc8107b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:48:03.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.640+0000 7fecd05f2700 1 --2- 172.21.15.73:0/4117088601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecc81012a0 0x7fecc8107b50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fecc000b0d0 tx=0x7fecc000b3e0 comp rx=0 tx=0).stop 2023-08-10T11:48:03.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.640+0000 7fecd05f2700 1 -- 172.21.15.73:0/4117088601 shutdown_connections 2023-08-10T11:48:03.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.640+0000 7fecd05f2700 1 --2- 172.21.15.73:0/4117088601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecc80ff700 0x7fecc80ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:48:03.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.640+0000 7fecd05f2700 1 --2- 172.21.15.73:0/4117088601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecc81012a0 0x7fecc8107b50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:48:03.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.640+0000 7fecd05f2700 1 --2- 172.21.15.73:0/4117088601 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecc8100900 0x7fecc8100d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:48:03.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.640+0000 7fecd05f2700 1 -- 172.21.15.73:0/4117088601 >> 172.21.15.73:0/4117088601 conn(0x7fecc80fac80 msgr2=0x7fecc80fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:48:03.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.640+0000 7fecd05f2700 1 -- 172.21.15.73:0/4117088601 shutdown_connections 2023-08-10T11:48:03.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.640+0000 7fecd05f2700 1 -- 172.21.15.73:0/4117088601 wait complete. 2023-08-10T11:48:03.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.641+0000 7fecd05f2700 1 Processor -- start 2023-08-10T11:48:03.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.641+0000 7fecd05f2700 1 -- start start 2023-08-10T11:48:03.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.641+0000 7fecd05f2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecc80ff700 0x7fecc8103640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:48:03.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.641+0000 7fecd05f2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecc8100900 0x7fecc8101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:48:03.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.641+0000 7fecd05f2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecc81012a0 0x7fecc8102220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:48:03.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.641+0000 7fecd05f2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc81029c0 con 0x7fecc8100900 2023-08-10T11:48:03.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.641+0000 7fecd05f2700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc8102b30 con 0x7fecc80ff700 2023-08-10T11:48:03.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.641+0000 7fecd05f2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc81a0570 con 0x7fecc81012a0 2023-08-10T11:48:03.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.641+0000 7feccdb8d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecc8100900 0x7fecc8101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:48:03.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.641+0000 7feccdb8d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecc8100900 0x7fecc8101ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58242/0 (socket says 172.21.15.73:58242) 2023-08-10T11:48:03.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.641+0000 7feccdb8d700 1 -- 172.21.15.73:0/1282665428 learned_addr learned my addr 172.21.15.73:0/1282665428 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:48:03.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.641+0000 7fecceb8f700 1 --2- 172.21.15.73:0/1282665428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecc81012a0 0x7fecc8102220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:48:03.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.641+0000 7feccdb8d700 1 -- 172.21.15.73:0/1282665428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecc81012a0 msgr2=0x7fecc8102220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:48:03.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.641+0000 7feccdb8d700 1 --2- 172.21.15.73:0/1282665428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecc81012a0 0x7fecc8102220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:48:03.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.641+0000 7fecce38e700 1 --2- 172.21.15.73:0/1282665428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecc80ff700 0x7fecc8103640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:48:03.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.641+0000 7feccdb8d700 1 -- 172.21.15.73:0/1282665428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecc80ff700 msgr2=0x7fecc8103640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:48:03.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.641+0000 7feccdb8d700 1 --2- 172.21.15.73:0/1282665428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecc80ff700 0x7fecc8103640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:48:03.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.641+0000 7feccdb8d700 1 -- 172.21.15.73:0/1282665428 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc0009d00 con 0x7fecc8100900 2023-08-10T11:48:03.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.641+0000 7fecce38e700 1 --2- 172.21.15.73:0/1282665428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecc80ff700 0x7fecc8103640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:48:03.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.642+0000 7feccdb8d700 1 --2- 172.21.15.73:0/1282665428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecc8100900 0x7fecc8101ce0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fecc400c9b0 tx=0x7fecc400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:48:03.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.642+0000 7fecbf7fe700 1 -- 172.21.15.73:0/1282665428 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4007b00 con 0x7fecc8100900 2023-08-10T11:48:03.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.642+0000 7fecbf7fe700 1 -- 172.21.15.73:0/1282665428 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fecc4007c60 con 0x7fecc8100900 2023-08-10T11:48:03.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.642+0000 7fecd05f2700 1 -- 172.21.15.73:0/1282665428 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecc81a0800 con 0x7fecc8100900 2023-08-10T11:48:03.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.642+0000 7fecbf7fe700 1 -- 172.21.15.73:0/1282665428 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4018660 con 0x7fecc8100900 2023-08-10T11:48:03.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.642+0000 7fecd05f2700 1 -- 172.21.15.73:0/1282665428 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc81a0d50 con 0x7fecc8100900 2023-08-10T11:48:03.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.643+0000 7fecd05f2700 1 -- 172.21.15.73:0/1282665428 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc810af10 con 0x7fecc8100900 2023-08-10T11:48:03.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.644+0000 7fecbf7fe700 1 -- 172.21.15.73:0/1282665428 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fecc4018880 con 0x7fecc8100900 2023-08-10T11:48:03.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.644+0000 7fecbf7fe700 1 --2- 172.21.15.73:0/1282665428 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fecb40a11d0 0x7fecb40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:48:03.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.644+0000 7fecce38e700 1 --2- 172.21.15.73:0/1282665428 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fecb40a11d0 0x7fecb40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:48:03.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.644+0000 7fecbf7fe700 1 -- 172.21.15.73:0/1282665428 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4562+0+0 (secure 0 0 0) 0x7fecc40cbaf0 con 0x7fecc8100900 2023-08-10T11:48:03.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.645+0000 7fecce38e700 1 --2- 172.21.15.73:0/1282665428 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fecb40a11d0 0x7fecb40a3690 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fecb8005fd0 tx=0x7fecb8005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:48:03.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.649+0000 7fecbf7fe700 1 -- 172.21.15.73:0/1282665428 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fecc4099b70 con 0x7fecc8100900 2023-08-10T11:48:03.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:03.842+0000 7fecd05f2700 1 -- 172.21.15.73:0/1282665428 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fecc8068980 con 0x7fecb40a11d0 2023-08-10T11:48:04.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:04 smithi152 ceph-mon[130220]: osdmap e38: 6 total, 6 up, 6 in 2023-08-10T11:48:04.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:04 smithi152 ceph-mon[130220]: from='client.14349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:48:04.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:04 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:48:04.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:04 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:48:04.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:04 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:04.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:04 smithi156 ceph-mon[130574]: osdmap e38: 6 total, 6 up, 6 in 2023-08-10T11:48:04.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:04 smithi156 ceph-mon[130574]: from='client.14349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:48:04.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:04 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:48:04.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:04 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:48:04.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:04 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:04.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:04 smithi073 ceph-mon[128869]: osdmap e38: 6 total, 6 up, 6 in 2023-08-10T11:48:04.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:04 smithi073 ceph-mon[128869]: from='client.14349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:48:04.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:04 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:48:04.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:04 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:48:04.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:04 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:05.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:05 smithi073 ceph-mon[128869]: osdmap e39: 6 total, 6 up, 6 in 2023-08-10T11:48:05.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:05 smithi073 ceph-mon[128869]: pgmap v127: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-08-10T11:48:05.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:05 smithi152 ceph-mon[130220]: osdmap e39: 6 total, 6 up, 6 in 2023-08-10T11:48:05.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:05 smithi152 ceph-mon[130220]: pgmap v127: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-08-10T11:48:05.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:05 smithi156 ceph-mon[130574]: osdmap e39: 6 total, 6 up, 6 in 2023-08-10T11:48:05.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:05 smithi156 ceph-mon[130574]: pgmap v127: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-08-10T11:48:06.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:06 smithi152 ceph-mon[130220]: osdmap e40: 6 total, 6 up, 6 in 2023-08-10T11:48:06.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:06 smithi156 ceph-mon[130574]: osdmap e40: 6 total, 6 up, 6 in 2023-08-10T11:48:06.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:06 smithi073 ceph-mon[128869]: osdmap e40: 6 total, 6 up, 6 in 2023-08-10T11:48:07.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:07 smithi152 ceph-mon[130220]: osdmap e41: 6 total, 6 up, 6 in 2023-08-10T11:48:07.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:07 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1997650003' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f6ae502d-4af9-4f6a-8636-b5b683dfdfd9"}]: dispatch 2023-08-10T11:48:07.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:07 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1997650003' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f6ae502d-4af9-4f6a-8636-b5b683dfdfd9"}]': finished 2023-08-10T11:48:07.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:07 smithi152 ceph-mon[130220]: osdmap e42: 7 total, 6 up, 7 in 2023-08-10T11:48:07.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:07 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T11:48:07.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:07 smithi152 ceph-mon[130220]: pgmap v131: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-08-10T11:48:07.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:07 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/304726020' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:48:07.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:07 smithi156 ceph-mon[130574]: osdmap e41: 6 total, 6 up, 6 in 2023-08-10T11:48:07.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:07 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1997650003' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f6ae502d-4af9-4f6a-8636-b5b683dfdfd9"}]: dispatch 2023-08-10T11:48:07.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:07 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1997650003' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f6ae502d-4af9-4f6a-8636-b5b683dfdfd9"}]': finished 2023-08-10T11:48:07.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:07 smithi156 ceph-mon[130574]: osdmap e42: 7 total, 6 up, 7 in 2023-08-10T11:48:07.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:07 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T11:48:07.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:07 smithi156 ceph-mon[130574]: pgmap v131: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-08-10T11:48:07.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:07 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/304726020' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:48:07.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:07 smithi073 ceph-mon[128869]: osdmap e41: 6 total, 6 up, 6 in 2023-08-10T11:48:07.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:07 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1997650003' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f6ae502d-4af9-4f6a-8636-b5b683dfdfd9"}]: dispatch 2023-08-10T11:48:07.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:07 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1997650003' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f6ae502d-4af9-4f6a-8636-b5b683dfdfd9"}]': finished 2023-08-10T11:48:07.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:07 smithi073 ceph-mon[128869]: osdmap e42: 7 total, 6 up, 7 in 2023-08-10T11:48:07.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:07 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T11:48:07.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:07 smithi073 ceph-mon[128869]: pgmap v131: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-08-10T11:48:07.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:07 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/304726020' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:48:09.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:09 smithi156 ceph-mon[130574]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 132 KiB/s, 0 objects/s recovering 2023-08-10T11:48:09.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:09 smithi073 ceph-mon[128869]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 132 KiB/s, 0 objects/s recovering 2023-08-10T11:48:09.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:09 smithi152 ceph-mon[130220]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 132 KiB/s, 0 objects/s recovering 2023-08-10T11:48:11.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:11 smithi156 ceph-mon[130574]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-08-10T11:48:11.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:11 smithi073 ceph-mon[128869]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-08-10T11:48:11.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:11 smithi152 ceph-mon[130220]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-08-10T11:48:13.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:13 smithi156 ceph-mon[130574]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2023-08-10T11:48:13.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:13 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-08-10T11:48:13.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:13 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:13.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:13 smithi073 ceph-mon[128869]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2023-08-10T11:48:13.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:13 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-08-10T11:48:13.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:13 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:13.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:13 smithi152 ceph-mon[130220]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2023-08-10T11:48:13.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:13 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-08-10T11:48:13.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:13 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:14.764 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:14 smithi073 ceph-mon[128869]: Deploying daemon osd.6 on smithi073 2023-08-10T11:48:14.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:14 smithi152 ceph-mon[130220]: Deploying daemon osd.6 on smithi073 2023-08-10T11:48:15.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:14 smithi156 ceph-mon[130574]: Deploying daemon osd.6 on smithi073 2023-08-10T11:48:15.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:15 smithi073 ceph-mon[128869]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-08-10T11:48:15.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:15 smithi152 ceph-mon[130220]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-08-10T11:48:16.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:15 smithi156 ceph-mon[130574]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-08-10T11:48:17.747 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:17 smithi073 ceph-mon[128869]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-08-10T11:48:17.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:17 smithi152 ceph-mon[130220]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-08-10T11:48:18.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:17 smithi156 ceph-mon[130574]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-08-10T11:48:18.989 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:18 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:18.990 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:18 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:18.990 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:18 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:48:19.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:18 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:19.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:18 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:19.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:18 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:48:19.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:18 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:19.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:18 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:19.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:18 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:48:20.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:19 smithi073 ceph-mon[128869]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-08-10T11:48:20.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:19 smithi152 ceph-mon[130220]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-08-10T11:48:20.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:19 smithi156 ceph-mon[130574]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-08-10T11:48:20.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:20.646+0000 7fecbf7fe700 1 -- 172.21.15.73:0/1282665428 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fecc8068980 con 0x7fecb40a11d0 2023-08-10T11:48:20.648 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 6 on host 'smithi073' 2023-08-10T11:48:20.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:20.648+0000 7fecd05f2700 1 -- 172.21.15.73:0/1282665428 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fecb40a11d0 msgr2=0x7fecb40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:48:20.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:20.648+0000 7fecd05f2700 1 --2- 172.21.15.73:0/1282665428 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fecb40a11d0 0x7fecb40a3690 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fecb8005fd0 tx=0x7fecb8005f00 comp rx=0 tx=0).stop 2023-08-10T11:48:20.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:20.648+0000 7fecd05f2700 1 -- 172.21.15.73:0/1282665428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecc8100900 msgr2=0x7fecc8101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:48:20.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:20.648+0000 7fecd05f2700 1 --2- 172.21.15.73:0/1282665428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecc8100900 0x7fecc8101ce0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fecc400c9b0 tx=0x7fecc400cd70 comp rx=0 tx=0).stop 2023-08-10T11:48:20.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:20.648+0000 7fecd05f2700 1 -- 172.21.15.73:0/1282665428 shutdown_connections 2023-08-10T11:48:20.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:20.648+0000 7fecd05f2700 1 --2- 172.21.15.73:0/1282665428 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fecb40a11d0 0x7fecb40a3690 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:48:20.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:20.648+0000 7fecd05f2700 1 --2- 172.21.15.73:0/1282665428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecc80ff700 0x7fecc8103640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:48:20.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:20.648+0000 7fecd05f2700 1 --2- 172.21.15.73:0/1282665428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecc81012a0 0x7fecc8102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:48:20.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:20.648+0000 7fecd05f2700 1 --2- 172.21.15.73:0/1282665428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecc8100900 0x7fecc8101ce0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:48:20.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:20.648+0000 7fecd05f2700 1 -- 172.21.15.73:0/1282665428 >> 172.21.15.73:0/1282665428 conn(0x7fecc80fac80 msgr2=0x7fecc8068270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:48:20.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:20.648+0000 7fecd05f2700 1 -- 172.21.15.73:0/1282665428 shutdown_connections 2023-08-10T11:48:20.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:48:20.648+0000 7fecd05f2700 1 -- 172.21.15.73:0/1282665428 wait complete. 2023-08-10T11:48:21.030 DEBUG:teuthology.orchestra.run.smithi073:osd.6> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@osd.6.service 2023-08-10T11:48:21.034 INFO:tasks.cephadm:Deploying osd.7 on smithi152 with /dev/vg_nvme/lv_2... 2023-08-10T11:48:21.034 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-08-10T11:48:21.067 INFO:journalctl@ceph.osd.6.smithi073.stdout:-- Logs begin at Thu 2023-08-10 11:15:25 UTC. -- 2023-08-10T11:48:21.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:21 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:21.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:21 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:21.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:21 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:21.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:21 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:48:21.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:21 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:21.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:21 smithi152 ceph-mon[130220]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-08-10T11:48:21.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:21 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:21.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:21 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:21.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:21 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:48:21.577 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:21 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:21.577 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:21 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:21.577 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:21 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:21.577 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:21 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:48:21.578 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:21 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:21.578 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:21 smithi073 ceph-mon[128869]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-08-10T11:48:21.578 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:21 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:21.578 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:21 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:21.578 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:21 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:48:21.609 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.b/config 2023-08-10T11:48:21.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:21 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:21.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:21 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:21.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:21 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:21.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:21 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:48:21.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:21 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:21.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:21 smithi156 ceph-mon[130574]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-08-10T11:48:21.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:21 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:21.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:21 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:21.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:21 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:48:22.017 INFO:journalctl@ceph.osd.6.smithi073.stdout:Aug 10 11:48:21 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-6[152822]: 2023-08-10T11:48:21.721+0000 7fc257240640 -1 osd.6 0 log_to_monitors true 2023-08-10T11:48:22.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:22 smithi152 ceph-mon[130220]: from='osd.6 [v2:172.21.15.73:6818/2533620458,v1:172.21.15.73:6819/2533620458]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-08-10T11:48:22.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:22 smithi156 ceph-mon[130574]: from='osd.6 [v2:172.21.15.73:6818/2533620458,v1:172.21.15.73:6819/2533620458]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-08-10T11:48:22.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:22 smithi073 ceph-mon[128869]: from='osd.6 [v2:172.21.15.73:6818/2533620458,v1:172.21.15.73:6819/2533620458]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-08-10T11:48:23.131 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-08-10T11:48:23.131 INFO:teuthology.orchestra.run.smithi152.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-08-10T11:48:23.132 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10+0 records in 2023-08-10T11:48:23.132 INFO:teuthology.orchestra.run.smithi152.stderr:10+0 records out 2023-08-10T11:48:23.132 INFO:teuthology.orchestra.run.smithi152.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112664 s, 931 MB/s 2023-08-10T11:48:23.132 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping successful for: 2023-08-10T11:48:23.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:23 smithi152 ceph-mon[130220]: from='osd.6 [v2:172.21.15.73:6818/2533620458,v1:172.21.15.73:6819/2533620458]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-08-10T11:48:23.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:23 smithi152 ceph-mon[130220]: osdmap e43: 7 total, 6 up, 7 in 2023-08-10T11:48:23.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:23 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T11:48:23.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:23 smithi152 ceph-mon[130220]: from='osd.6 [v2:172.21.15.73:6818/2533620458,v1:172.21.15.73:6819/2533620458]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2023-08-10T11:48:23.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:23 smithi152 ceph-mon[130220]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-08-10T11:48:23.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:23 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:23.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:23 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:23.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:23 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:48:23.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:23 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:48:23.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:23 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:48:23.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:23 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:23.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:23 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:23.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:23 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:48:23.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:23 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:23.518 INFO:journalctl@ceph.osd.6.smithi073.stdout:Aug 10 11:48:23 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-6[152822]: 2023-08-10T11:48:23.347+0000 7fc24c0b7700 -1 osd.6 0 waiting for initial osdmap 2023-08-10T11:48:23.518 INFO:journalctl@ceph.osd.6.smithi073.stdout:Aug 10 11:48:23 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-6[152822]: 2023-08-10T11:48:23.357+0000 7fc245ea8700 -1 osd.6 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T11:48:23.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:23 smithi073 ceph-mon[128869]: from='osd.6 [v2:172.21.15.73:6818/2533620458,v1:172.21.15.73:6819/2533620458]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-08-10T11:48:23.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:23 smithi073 ceph-mon[128869]: osdmap e43: 7 total, 6 up, 7 in 2023-08-10T11:48:23.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T11:48:23.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:23 smithi073 ceph-mon[128869]: from='osd.6 [v2:172.21.15.73:6818/2533620458,v1:172.21.15.73:6819/2533620458]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2023-08-10T11:48:23.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:23 smithi073 ceph-mon[128869]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-08-10T11:48:23.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:23.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:23.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:48:23.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:48:23.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:48:23.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:23.522 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:23.522 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:48:23.522 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:23.562 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi152:vg_nvme/lv_2 2023-08-10T11:48:23.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:23 smithi156 ceph-mon[130574]: from='osd.6 [v2:172.21.15.73:6818/2533620458,v1:172.21.15.73:6819/2533620458]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-08-10T11:48:23.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:23 smithi156 ceph-mon[130574]: osdmap e43: 7 total, 6 up, 7 in 2023-08-10T11:48:23.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:23 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T11:48:23.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:23 smithi156 ceph-mon[130574]: from='osd.6 [v2:172.21.15.73:6818/2533620458,v1:172.21.15.73:6819/2533620458]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2023-08-10T11:48:23.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:23 smithi156 ceph-mon[130574]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-08-10T11:48:23.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:23 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:23.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:23 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:23.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:23 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:48:23.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:23 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:48:23.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:23 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:48:23.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:23 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:23.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:23 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:23.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:23 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:48:23.758 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:23 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:24.114 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.b/config 2023-08-10T11:48:24.602 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:24 smithi152 ceph-mon[130220]: Detected new or changed devices on smithi073 2023-08-10T11:48:24.603 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:24 smithi152 ceph-mon[130220]: Adjusting osd_memory_target on smithi073 to 5722M 2023-08-10T11:48:24.603 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:24 smithi152 ceph-mon[130220]: from='osd.6 [v2:172.21.15.73:6818/2533620458,v1:172.21.15.73:6819/2533620458]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2023-08-10T11:48:24.603 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:24 smithi152 ceph-mon[130220]: osdmap e44: 7 total, 6 up, 7 in 2023-08-10T11:48:24.603 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:24 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T11:48:24.603 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:24 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T11:48:24.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:24 smithi156 ceph-mon[130574]: Detected new or changed devices on smithi073 2023-08-10T11:48:24.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:24 smithi156 ceph-mon[130574]: Adjusting osd_memory_target on smithi073 to 5722M 2023-08-10T11:48:24.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:24 smithi156 ceph-mon[130574]: from='osd.6 [v2:172.21.15.73:6818/2533620458,v1:172.21.15.73:6819/2533620458]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2023-08-10T11:48:24.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:24 smithi156 ceph-mon[130574]: osdmap e44: 7 total, 6 up, 7 in 2023-08-10T11:48:24.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:24 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T11:48:24.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:24 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T11:48:24.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:24 smithi073 ceph-mon[128869]: Detected new or changed devices on smithi073 2023-08-10T11:48:24.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:24 smithi073 ceph-mon[128869]: Adjusting osd_memory_target on smithi073 to 5722M 2023-08-10T11:48:24.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:24 smithi073 ceph-mon[128869]: from='osd.6 [v2:172.21.15.73:6818/2533620458,v1:172.21.15.73:6819/2533620458]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2023-08-10T11:48:24.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:24 smithi073 ceph-mon[128869]: osdmap e44: 7 total, 6 up, 7 in 2023-08-10T11:48:24.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:24 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T11:48:24.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:24 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T11:48:25.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.281+0000 7f39b0974700 1 -- 172.21.15.152:0/825890769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39ac1012a0 msgr2=0x7f39ac107b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:48:25.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.281+0000 7f39b0974700 1 --2- 172.21.15.152:0/825890769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39ac1012a0 0x7f39ac107b50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f39a400b0d0 tx=0x7f39a400b3e0 comp rx=0 tx=0).stop 2023-08-10T11:48:25.284 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.281+0000 7f39b0974700 1 -- 172.21.15.152:0/825890769 shutdown_connections 2023-08-10T11:48:25.284 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.281+0000 7f39b0974700 1 --2- 172.21.15.152:0/825890769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39ac1012a0 0x7f39ac107b50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:48:25.284 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.281+0000 7f39b0974700 1 --2- 172.21.15.152:0/825890769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39ac0ff700 0x7f39ac0ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:48:25.284 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.281+0000 7f39b0974700 1 --2- 172.21.15.152:0/825890769 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39ac100900 0x7f39ac100d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:48:25.284 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.281+0000 7f39b0974700 1 -- 172.21.15.152:0/825890769 >> 172.21.15.152:0/825890769 conn(0x7f39ac0fac80 msgr2=0x7f39ac0fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:48:25.284 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.281+0000 7f39b0974700 1 -- 172.21.15.152:0/825890769 shutdown_connections 2023-08-10T11:48:25.285 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.281+0000 7f39b0974700 1 -- 172.21.15.152:0/825890769 wait complete. 2023-08-10T11:48:25.285 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.282+0000 7f39b0974700 1 Processor -- start 2023-08-10T11:48:25.285 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.282+0000 7f39b0974700 1 -- start start 2023-08-10T11:48:25.285 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.282+0000 7f39b0974700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39ac0ff700 0x7f39ac068df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:48:25.285 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.282+0000 7f39b0974700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39ac100900 0x7f39ac19b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:48:25.285 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.282+0000 7f39b0974700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39ac1012a0 0x7f39ac19d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:48:25.285 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.282+0000 7f39b0974700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac19e0b0 con 0x7f39ac1012a0 2023-08-10T11:48:25.286 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.282+0000 7f39b0974700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac19e220 con 0x7f39ac0ff700 2023-08-10T11:48:25.286 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.282+0000 7f39b0974700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac19e3e0 con 0x7f39ac100900 2023-08-10T11:48:25.286 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.282+0000 7f39aa59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39ac0ff700 0x7f39ac068df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:48:25.286 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.282+0000 7f39aa59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39ac0ff700 0x7f39ac068df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44042/0 (socket says 172.21.15.152:44042) 2023-08-10T11:48:25.286 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.282+0000 7f39aa59c700 1 -- 172.21.15.152:0/2259357974 learned_addr learned my addr 172.21.15.152:0/2259357974 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-08-10T11:48:25.286 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.282+0000 7f39a9d9b700 1 --2- 172.21.15.152:0/2259357974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39ac100900 0x7f39ac19b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:48:25.286 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.282+0000 7f39aa59c700 1 -- 172.21.15.152:0/2259357974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39ac100900 msgr2=0x7f39ac19b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:48:25.286 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.282+0000 7f39aa59c700 1 --2- 172.21.15.152:0/2259357974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39ac100900 0x7f39ac19b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:48:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.282+0000 7f39aa59c700 1 -- 172.21.15.152:0/2259357974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39ac1012a0 msgr2=0x7f39ac19d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:48:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.282+0000 7f39aa59c700 1 --2- 172.21.15.152:0/2259357974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39ac1012a0 0x7f39ac19d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:48:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.282+0000 7f39aa59c700 1 -- 172.21.15.152:0/2259357974 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a4009d00 con 0x7f39ac0ff700 2023-08-10T11:48:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.282+0000 7f39aa59c700 1 --2- 172.21.15.152:0/2259357974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39ac0ff700 0x7f39ac068df0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f399c00e970 tx=0x7f399c00ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:48:25.288 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.283+0000 7f399b7fe700 1 -- 172.21.15.152:0/2259357974 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c009790 con 0x7f39ac0ff700 2023-08-10T11:48:25.288 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.283+0000 7f39b0974700 1 -- 172.21.15.152:0/2259357974 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39ac19e6c0 con 0x7f39ac0ff700 2023-08-10T11:48:25.288 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.283+0000 7f399b7fe700 1 -- 172.21.15.152:0/2259357974 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f399c00eec0 con 0x7f39ac0ff700 2023-08-10T11:48:25.288 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.283+0000 7f399b7fe700 1 -- 172.21.15.152:0/2259357974 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c003cf0 con 0x7f39ac0ff700 2023-08-10T11:48:25.289 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.283+0000 7f39b0974700 1 -- 172.21.15.152:0/2259357974 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39ac19ebc0 con 0x7f39ac0ff700 2023-08-10T11:48:25.289 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.284+0000 7f39b0974700 1 -- 172.21.15.152:0/2259357974 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39ac10af10 con 0x7f39ac0ff700 2023-08-10T11:48:25.289 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.285+0000 7f399b7fe700 1 -- 172.21.15.152:0/2259357974 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f399c00ccd0 con 0x7f39ac0ff700 2023-08-10T11:48:25.289 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.285+0000 7f399b7fe700 1 --2- 172.21.15.152:0/2259357974 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f39940a1150 0x7f39940a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:48:25.289 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.286+0000 7f399b7fe700 1 -- 172.21.15.152:0/2259357974 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4965+0+0 (secure 0 0 0) 0x7f399c014070 con 0x7f39ac0ff700 2023-08-10T11:48:25.289 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.286+0000 7f39a9d9b700 1 --2- 172.21.15.152:0/2259357974 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f39940a1150 0x7f39940a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:48:25.289 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.286+0000 7f39a9d9b700 1 --2- 172.21.15.152:0/2259357974 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f39940a1150 0x7f39940a3610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f39a0005950 tx=0x7f39a000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:48:25.290 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.289+0000 7f399b7fe700 1 -- 172.21.15.152:0/2259357974 <== mon.2 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f399c0963f0 con 0x7f39ac0ff700 2023-08-10T11:48:25.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:25.486+0000 7f39b0974700 1 -- 172.21.15.152:0/2259357974 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f39ac060bb0 con 0x7f39940a1150 2023-08-10T11:48:25.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:25 smithi152 ceph-mon[130220]: purged_snaps scrub starts 2023-08-10T11:48:25.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:25 smithi152 ceph-mon[130220]: purged_snaps scrub ok 2023-08-10T11:48:25.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:25 smithi152 ceph-mon[130220]: osd.6 [v2:172.21.15.73:6818/2533620458,v1:172.21.15.73:6819/2533620458] boot 2023-08-10T11:48:25.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:25 smithi152 ceph-mon[130220]: osdmap e45: 7 total, 7 up, 7 in 2023-08-10T11:48:25.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:25 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T11:48:25.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:25 smithi152 ceph-mon[130220]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-08-10T11:48:25.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:25 smithi156 ceph-mon[130574]: purged_snaps scrub starts 2023-08-10T11:48:25.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:25 smithi156 ceph-mon[130574]: purged_snaps scrub ok 2023-08-10T11:48:25.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:25 smithi156 ceph-mon[130574]: osd.6 [v2:172.21.15.73:6818/2533620458,v1:172.21.15.73:6819/2533620458] boot 2023-08-10T11:48:25.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:25 smithi156 ceph-mon[130574]: osdmap e45: 7 total, 7 up, 7 in 2023-08-10T11:48:25.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:25 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T11:48:25.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:25 smithi156 ceph-mon[130574]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-08-10T11:48:25.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:25 smithi073 ceph-mon[128869]: purged_snaps scrub starts 2023-08-10T11:48:25.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:25 smithi073 ceph-mon[128869]: purged_snaps scrub ok 2023-08-10T11:48:25.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:25 smithi073 ceph-mon[128869]: osd.6 [v2:172.21.15.73:6818/2533620458,v1:172.21.15.73:6819/2533620458] boot 2023-08-10T11:48:25.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:25 smithi073 ceph-mon[128869]: osdmap e45: 7 total, 7 up, 7 in 2023-08-10T11:48:25.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:25 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T11:48:25.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:25 smithi073 ceph-mon[128869]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-08-10T11:48:26.577 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:26 smithi152 ceph-mon[130220]: osdmap e46: 7 total, 7 up, 7 in 2023-08-10T11:48:26.577 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:26 smithi152 ceph-mon[130220]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:48:26.578 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:26 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:48:26.578 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:26 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:48:26.578 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:26 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:26.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:26 smithi156 ceph-mon[130574]: osdmap e46: 7 total, 7 up, 7 in 2023-08-10T11:48:26.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:26 smithi156 ceph-mon[130574]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:48:26.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:26 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:48:26.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:26 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:48:26.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:26 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:26.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:26 smithi073 ceph-mon[128869]: osdmap e46: 7 total, 7 up, 7 in 2023-08-10T11:48:26.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:26 smithi073 ceph-mon[128869]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:48:26.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:26 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:48:26.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:26 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:48:26.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:26 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:27.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:27 smithi152 ceph-mon[130220]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:27.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:27 smithi156 ceph-mon[130574]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:27.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:27 smithi073 ceph-mon[128869]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:28.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:28 smithi152 ceph-mon[130220]: from='client.? 172.21.15.152:0/3047571732' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "398fd334-5f6f-427c-95ae-3244fb466f77"}]: dispatch 2023-08-10T11:48:28.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:28 smithi152 ceph-mon[130220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "398fd334-5f6f-427c-95ae-3244fb466f77"}]: dispatch 2023-08-10T11:48:28.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:28 smithi152 ceph-mon[130220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "398fd334-5f6f-427c-95ae-3244fb466f77"}]': finished 2023-08-10T11:48:28.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:28 smithi152 ceph-mon[130220]: osdmap e47: 8 total, 7 up, 8 in 2023-08-10T11:48:28.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:28 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T11:48:28.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:28 smithi156 ceph-mon[130574]: from='client.? 172.21.15.152:0/3047571732' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "398fd334-5f6f-427c-95ae-3244fb466f77"}]: dispatch 2023-08-10T11:48:28.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:28 smithi156 ceph-mon[130574]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "398fd334-5f6f-427c-95ae-3244fb466f77"}]: dispatch 2023-08-10T11:48:28.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:28 smithi156 ceph-mon[130574]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "398fd334-5f6f-427c-95ae-3244fb466f77"}]': finished 2023-08-10T11:48:28.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:28 smithi156 ceph-mon[130574]: osdmap e47: 8 total, 7 up, 8 in 2023-08-10T11:48:28.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:28 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T11:48:28.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:28 smithi073 ceph-mon[128869]: from='client.? 172.21.15.152:0/3047571732' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "398fd334-5f6f-427c-95ae-3244fb466f77"}]: dispatch 2023-08-10T11:48:28.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:28 smithi073 ceph-mon[128869]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "398fd334-5f6f-427c-95ae-3244fb466f77"}]: dispatch 2023-08-10T11:48:28.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:28 smithi073 ceph-mon[128869]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "398fd334-5f6f-427c-95ae-3244fb466f77"}]': finished 2023-08-10T11:48:28.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:28 smithi073 ceph-mon[128869]: osdmap e47: 8 total, 7 up, 8 in 2023-08-10T11:48:28.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:28 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T11:48:29.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:29 smithi152 ceph-mon[130220]: from='client.? 172.21.15.152:0/3112196952' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:48:29.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:29 smithi152 ceph-mon[130220]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:29.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:29 smithi156 ceph-mon[130574]: from='client.? 172.21.15.152:0/3112196952' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:48:29.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:29 smithi156 ceph-mon[130574]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:29.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:29 smithi073 ceph-mon[128869]: from='client.? 172.21.15.152:0/3112196952' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:48:29.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:29 smithi073 ceph-mon[128869]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:31.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:31 smithi156 ceph-mon[130574]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:31.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:31 smithi073 ceph-mon[128869]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:31.893 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:31 smithi152 ceph-mon[130220]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:33.701 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:33 smithi152 ceph-mon[130220]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:33.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:33 smithi156 ceph-mon[130574]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:33.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:33 smithi073 ceph-mon[128869]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:34.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-08-10T11:48:34.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:34.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:34 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-08-10T11:48:34.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:34 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:35.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:34 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-08-10T11:48:35.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:34 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:35.663 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:35 smithi152 ceph-mon[130220]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:35.663 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:35 smithi152 ceph-mon[130220]: Deploying daemon osd.7 on smithi152 2023-08-10T11:48:35.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:35 smithi073 ceph-mon[128869]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:35.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:35 smithi073 ceph-mon[128869]: Deploying daemon osd.7 on smithi152 2023-08-10T11:48:36.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:35 smithi156 ceph-mon[130574]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:36.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:35 smithi156 ceph-mon[130574]: Deploying daemon osd.7 on smithi152 2023-08-10T11:48:37.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:37 smithi152 ceph-mon[130220]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:37.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:37 smithi073 ceph-mon[128869]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:38.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:37 smithi156 ceph-mon[130574]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:39.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:39 smithi152 ceph-mon[130220]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:39.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:39 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:39.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:39 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:48:39.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:39 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:39.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:39 smithi073 ceph-mon[128869]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:39.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:39 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:39.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:39 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:48:39.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:39 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:40.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:39 smithi156 ceph-mon[130574]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:40.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:39 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:40.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:39 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:48:40.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:39 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:41.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:41 smithi152 ceph-mon[130220]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:41.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:41.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:41.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:41.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:48:41.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:41.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:41 smithi073 ceph-mon[128869]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:41.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:41 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:41.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:41 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:41.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:41 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:41.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:41 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:48:41.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:41 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:41.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:41.793+0000 7f399b7fe700 1 -- 172.21.15.152:0/2259357974 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f39ac060bb0 con 0x7f39940a1150 2023-08-10T11:48:41.794 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 7 on host 'smithi152' 2023-08-10T11:48:41.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:41.795+0000 7f39b0974700 1 -- 172.21.15.152:0/2259357974 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f39940a1150 msgr2=0x7f39940a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:48:41.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:41.795+0000 7f39b0974700 1 --2- 172.21.15.152:0/2259357974 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f39940a1150 0x7f39940a3610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f39a0005950 tx=0x7f39a000b410 comp rx=0 tx=0).stop 2023-08-10T11:48:41.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:41.795+0000 7f39b0974700 1 -- 172.21.15.152:0/2259357974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39ac0ff700 msgr2=0x7f39ac068df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:48:41.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:41.795+0000 7f39b0974700 1 --2- 172.21.15.152:0/2259357974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39ac0ff700 0x7f39ac068df0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f399c00e970 tx=0x7f399c00ec80 comp rx=0 tx=0).stop 2023-08-10T11:48:41.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:41.795+0000 7f39b0974700 1 -- 172.21.15.152:0/2259357974 shutdown_connections 2023-08-10T11:48:41.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:41.795+0000 7f39b0974700 1 --2- 172.21.15.152:0/2259357974 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f39940a1150 0x7f39940a3610 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:48:41.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:41.796+0000 7f39b0974700 1 --2- 172.21.15.152:0/2259357974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39ac0ff700 0x7f39ac068df0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:48:41.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:41.796+0000 7f39b0974700 1 --2- 172.21.15.152:0/2259357974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39ac1012a0 0x7f39ac19d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:48:41.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:41.796+0000 7f39b0974700 1 --2- 172.21.15.152:0/2259357974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39ac100900 0x7f39ac19b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:48:41.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:41.796+0000 7f39b0974700 1 -- 172.21.15.152:0/2259357974 >> 172.21.15.152:0/2259357974 conn(0x7f39ac0fac80 msgr2=0x7f39ac0fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:48:41.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:41.796+0000 7f39b0974700 1 -- 172.21.15.152:0/2259357974 shutdown_connections 2023-08-10T11:48:41.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:48:41.796+0000 7f39b0974700 1 -- 172.21.15.152:0/2259357974 wait complete. 2023-08-10T11:48:42.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:41 smithi156 ceph-mon[130574]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:42.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:41 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:42.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:41 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:42.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:41 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:42.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:41 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:48:42.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:41 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:42.214 DEBUG:teuthology.orchestra.run.smithi152:osd.7> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@osd.7.service 2023-08-10T11:48:42.218 INFO:tasks.cephadm:Deploying osd.8 on smithi156 with /dev/vg_nvme/lv_2... 2023-08-10T11:48:42.218 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-08-10T11:48:42.253 INFO:journalctl@ceph.osd.7.smithi152.stdout:-- Logs begin at Thu 2023-08-10 11:15:14 UTC. -- 2023-08-10T11:48:42.782 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T11:48:42.949 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:42 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:42.949 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:42 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:42.949 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:42 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:48:43.012 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:42 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:43.012 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:42 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:43.013 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:42 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:48:43.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:42 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:43.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:42 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:43.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:42 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:48:43.245 INFO:journalctl@ceph.osd.7.smithi152.stdout:Aug 10 11:48:42 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-7[146257]: 2023-08-10T11:48:42.947+0000 7f864c4d5640 -1 osd.7 0 log_to_monitors true 2023-08-10T11:48:43.856 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:43 smithi156 ceph-mon[130574]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:43.856 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:43 smithi156 ceph-mon[130574]: from='osd.7 [v2:172.21.15.152:6816/4059538477,v1:172.21.15.152:6817/4059538477]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-08-10T11:48:43.856 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:43 smithi156 ceph-mon[130574]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-08-10T11:48:44.066 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:43 smithi152 ceph-mon[130220]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:44.067 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:43 smithi152 ceph-mon[130220]: from='osd.7 [v2:172.21.15.152:6816/4059538477,v1:172.21.15.152:6817/4059538477]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-08-10T11:48:44.067 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:43 smithi152 ceph-mon[130220]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-08-10T11:48:44.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:43 smithi073 ceph-mon[128869]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:44.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:43 smithi073 ceph-mon[128869]: from='osd.7 [v2:172.21.15.152:6816/4059538477,v1:172.21.15.152:6817/4059538477]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-08-10T11:48:44.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:43 smithi073 ceph-mon[128869]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-08-10T11:48:44.374 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-08-10T11:48:44.374 INFO:teuthology.orchestra.run.smithi156.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-08-10T11:48:44.375 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10+0 records in 2023-08-10T11:48:44.375 INFO:teuthology.orchestra.run.smithi156.stderr:10+0 records out 2023-08-10T11:48:44.375 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00817359 s, 1.3 GB/s 2023-08-10T11:48:44.375 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping successful for: 2023-08-10T11:48:44.824 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi156:vg_nvme/lv_2 2023-08-10T11:48:45.245 INFO:journalctl@ceph.osd.7.smithi152.stdout:Aug 10 11:48:44 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-7[146257]: 2023-08-10T11:48:44.789+0000 7f864134c700 -1 osd.7 0 waiting for initial osdmap 2023-08-10T11:48:45.245 INFO:journalctl@ceph.osd.7.smithi152.stdout:Aug 10 11:48:44 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-7[146257]: 2023-08-10T11:48:44.798+0000 7f863a13b700 -1 osd.7 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T11:48:45.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:44 smithi152 ceph-mon[130220]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-08-10T11:48:45.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:44 smithi152 ceph-mon[130220]: osdmap e48: 8 total, 7 up, 8 in 2023-08-10T11:48:45.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:44 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T11:48:45.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:44 smithi152 ceph-mon[130220]: from='osd.7 [v2:172.21.15.152:6816/4059538477,v1:172.21.15.152:6817/4059538477]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-08-10T11:48:45.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:44 smithi152 ceph-mon[130220]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-08-10T11:48:45.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:44 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:45.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:44 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:45.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:44 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:48:45.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:44 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:48:45.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:44 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:48:45.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:44 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:45.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:44 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:45.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:44 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:48:45.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:44 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:45.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:44 smithi156 ceph-mon[130574]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-08-10T11:48:45.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:44 smithi156 ceph-mon[130574]: osdmap e48: 8 total, 7 up, 8 in 2023-08-10T11:48:45.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:44 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T11:48:45.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:44 smithi156 ceph-mon[130574]: from='osd.7 [v2:172.21.15.152:6816/4059538477,v1:172.21.15.152:6817/4059538477]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-08-10T11:48:45.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:44 smithi156 ceph-mon[130574]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-08-10T11:48:45.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:44 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:45.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:44 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:45.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:44 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:48:45.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:44 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:48:45.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:44 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:48:45.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:44 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:45.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:44 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:45.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:44 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:48:45.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:44 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:45.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:44 smithi073 ceph-mon[128869]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-08-10T11:48:45.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:44 smithi073 ceph-mon[128869]: osdmap e48: 8 total, 7 up, 8 in 2023-08-10T11:48:45.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:44 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T11:48:45.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:44 smithi073 ceph-mon[128869]: from='osd.7 [v2:172.21.15.152:6816/4059538477,v1:172.21.15.152:6817/4059538477]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-08-10T11:48:45.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:44 smithi073 ceph-mon[128869]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-08-10T11:48:45.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:44 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:45.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:44 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:45.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:44 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:48:45.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:44 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:48:45.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:44 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:48:45.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:44 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:45.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:44 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:45.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:44 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:48:45.270 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:44 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:48:45.376 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T11:48:45.932 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:45 smithi156 ceph-mon[130574]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:45.932 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:45 smithi156 ceph-mon[130574]: Detected new or changed devices on smithi152 2023-08-10T11:48:45.932 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:45 smithi156 ceph-mon[130574]: Adjusting osd_memory_target on smithi152 to 5722M 2023-08-10T11:48:45.933 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:45 smithi156 ceph-mon[130574]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-08-10T11:48:45.933 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:45 smithi156 ceph-mon[130574]: osdmap e49: 8 total, 7 up, 8 in 2023-08-10T11:48:45.933 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:45 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T11:48:45.933 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:45 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T11:48:46.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:45 smithi152 ceph-mon[130220]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:46.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:45 smithi152 ceph-mon[130220]: Detected new or changed devices on smithi152 2023-08-10T11:48:46.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:45 smithi152 ceph-mon[130220]: Adjusting osd_memory_target on smithi152 to 5722M 2023-08-10T11:48:46.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:45 smithi152 ceph-mon[130220]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-08-10T11:48:46.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:45 smithi152 ceph-mon[130220]: osdmap e49: 8 total, 7 up, 8 in 2023-08-10T11:48:46.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:45 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T11:48:46.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:45 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T11:48:46.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:45 smithi073 ceph-mon[128869]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-08-10T11:48:46.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:45 smithi073 ceph-mon[128869]: Detected new or changed devices on smithi152 2023-08-10T11:48:46.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:45 smithi073 ceph-mon[128869]: Adjusting osd_memory_target on smithi152 to 5722M 2023-08-10T11:48:46.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:45 smithi073 ceph-mon[128869]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-08-10T11:48:46.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:45 smithi073 ceph-mon[128869]: osdmap e49: 8 total, 7 up, 8 in 2023-08-10T11:48:46.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:45 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T11:48:46.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:45 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T11:48:46.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.743+0000 7fb6edcec700 1 -- 172.21.15.156:0/3825167283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6e8100900 msgr2=0x7fb6e8100d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:48:46.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.743+0000 7fb6edcec700 1 --2- 172.21.15.156:0/3825167283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6e8100900 0x7fb6e8100d60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8009990 tx=0x7fb6d8009ca0 comp rx=0 tx=0).stop 2023-08-10T11:48:46.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.743+0000 7fb6edcec700 1 -- 172.21.15.156:0/3825167283 shutdown_connections 2023-08-10T11:48:46.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.743+0000 7fb6edcec700 1 --2- 172.21.15.156:0/3825167283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6e80ff700 0x7fb6e80ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:48:46.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.743+0000 7fb6edcec700 1 --2- 172.21.15.156:0/3825167283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6e81012a0 0x7fb6e8107b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:48:46.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.743+0000 7fb6edcec700 1 --2- 172.21.15.156:0/3825167283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6e8100900 0x7fb6e8100d60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:48:46.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.743+0000 7fb6edcec700 1 -- 172.21.15.156:0/3825167283 >> 172.21.15.156:0/3825167283 conn(0x7fb6e80fac80 msgr2=0x7fb6e80fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:48:46.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.743+0000 7fb6edcec700 1 -- 172.21.15.156:0/3825167283 shutdown_connections 2023-08-10T11:48:46.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.743+0000 7fb6edcec700 1 -- 172.21.15.156:0/3825167283 wait complete. 2023-08-10T11:48:46.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.744+0000 7fb6edcec700 1 Processor -- start 2023-08-10T11:48:46.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.744+0000 7fb6edcec700 1 -- start start 2023-08-10T11:48:46.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.744+0000 7fb6edcec700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6e80ff700 0x7fb6e8068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:48:46.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.744+0000 7fb6edcec700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6e8100900 0x7fb6e819b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:48:46.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.744+0000 7fb6edcec700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6e81012a0 0x7fb6e819d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:48:46.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.744+0000 7fb6edcec700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e819dfb0 con 0x7fb6e8100900 2023-08-10T11:48:46.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.744+0000 7fb6edcec700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e819e120 con 0x7fb6e80ff700 2023-08-10T11:48:46.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.744+0000 7fb6edcec700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e819e2e0 con 0x7fb6e81012a0 2023-08-10T11:48:46.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.744+0000 7fb6e7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6e81012a0 0x7fb6e819d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:48:46.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.744+0000 7fb6e7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6e81012a0 0x7fb6e819d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36908/0 (socket says 172.21.15.156:36908) 2023-08-10T11:48:46.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.744+0000 7fb6e7fff700 1 -- 172.21.15.156:0/593290188 learned_addr learned my addr 172.21.15.156:0/593290188 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-08-10T11:48:46.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.744+0000 7fb6e77fe700 1 --2- 172.21.15.156:0/593290188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6e80ff700 0x7fb6e8068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:48:46.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.744+0000 7fb6e6ffd700 1 --2- 172.21.15.156:0/593290188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6e8100900 0x7fb6e819b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:48:46.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.744+0000 7fb6e7fff700 1 -- 172.21.15.156:0/593290188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6e80ff700 msgr2=0x7fb6e8068db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:48:46.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.744+0000 7fb6e7fff700 1 --2- 172.21.15.156:0/593290188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6e80ff700 0x7fb6e8068db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:48:46.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.744+0000 7fb6e7fff700 1 -- 172.21.15.156:0/593290188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6e8100900 msgr2=0x7fb6e819b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:48:46.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.744+0000 7fb6e7fff700 1 --2- 172.21.15.156:0/593290188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6e8100900 0x7fb6e819b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:48:46.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.744+0000 7fb6e7fff700 1 -- 172.21.15.156:0/593290188 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d80095f0 con 0x7fb6e81012a0 2023-08-10T11:48:46.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.745+0000 7fb6e7fff700 1 --2- 172.21.15.156:0/593290188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6e81012a0 0x7fb6e819d810 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb6e000ada0 tx=0x7fb6e000c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:48:46.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.745+0000 7fb6e4ff9700 1 -- 172.21.15.156:0/593290188 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e000f070 con 0x7fb6e81012a0 2023-08-10T11:48:46.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.745+0000 7fb6e4ff9700 1 -- 172.21.15.156:0/593290188 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb6e0007b30 con 0x7fb6e81012a0 2023-08-10T11:48:46.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.745+0000 7fb6edcec700 1 -- 172.21.15.156:0/593290188 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e819e5c0 con 0x7fb6e81012a0 2023-08-10T11:48:46.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.745+0000 7fb6e4ff9700 1 -- 172.21.15.156:0/593290188 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e00053e0 con 0x7fb6e81012a0 2023-08-10T11:48:46.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.745+0000 7fb6edcec700 1 -- 172.21.15.156:0/593290188 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e819ea70 con 0x7fb6e81012a0 2023-08-10T11:48:46.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.746+0000 7fb6edcec700 1 -- 172.21.15.156:0/593290188 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6e8106d50 con 0x7fb6e81012a0 2023-08-10T11:48:46.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.747+0000 7fb6e4ff9700 1 -- 172.21.15.156:0/593290188 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fb6e000c980 con 0x7fb6e81012a0 2023-08-10T11:48:46.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.747+0000 7fb6e4ff9700 1 --2- 172.21.15.156:0/593290188 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb6d00a1150 0x7fb6d00a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:48:46.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.748+0000 7fb6e4ff9700 1 -- 172.21.15.156:0/593290188 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5430+0+0 (secure 0 0 0) 0x7fb6e00cba00 con 0x7fb6e81012a0 2023-08-10T11:48:46.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.748+0000 7fb6e77fe700 1 --2- 172.21.15.156:0/593290188 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb6d00a1150 0x7fb6d00a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:48:46.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.748+0000 7fb6e77fe700 1 --2- 172.21.15.156:0/593290188 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb6d00a1150 0x7fb6d00a3610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8100760 tx=0x7fb6dc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:48:46.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.751+0000 7fb6e4ff9700 1 -- 172.21.15.156:0/593290188 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fb6e0095d20 con 0x7fb6e81012a0 2023-08-10T11:48:46.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:48:46.947+0000 7fb6edcec700 1 -- 172.21.15.156:0/593290188 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6e8060bb0 con 0x7fb6d00a1150 2023-08-10T11:48:47.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:46 smithi152 ceph-mon[130220]: purged_snaps scrub starts 2023-08-10T11:48:47.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:46 smithi152 ceph-mon[130220]: purged_snaps scrub ok 2023-08-10T11:48:47.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:46 smithi152 ceph-mon[130220]: osd.7 [v2:172.21.15.152:6816/4059538477,v1:172.21.15.152:6817/4059538477] boot 2023-08-10T11:48:47.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:46 smithi152 ceph-mon[130220]: osdmap e50: 8 total, 8 up, 8 in 2023-08-10T11:48:47.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:46 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T11:48:47.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:46 smithi156 ceph-mon[130574]: purged_snaps scrub starts 2023-08-10T11:48:47.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:46 smithi156 ceph-mon[130574]: purged_snaps scrub ok 2023-08-10T11:48:47.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:46 smithi156 ceph-mon[130574]: osd.7 [v2:172.21.15.152:6816/4059538477,v1:172.21.15.152:6817/4059538477] boot 2023-08-10T11:48:47.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:46 smithi156 ceph-mon[130574]: osdmap e50: 8 total, 8 up, 8 in 2023-08-10T11:48:47.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:46 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T11:48:47.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:46 smithi073 ceph-mon[128869]: purged_snaps scrub starts 2023-08-10T11:48:47.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:46 smithi073 ceph-mon[128869]: purged_snaps scrub ok 2023-08-10T11:48:47.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:46 smithi073 ceph-mon[128869]: osd.7 [v2:172.21.15.152:6816/4059538477,v1:172.21.15.152:6817/4059538477] boot 2023-08-10T11:48:47.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:46 smithi073 ceph-mon[128869]: osdmap e50: 8 total, 8 up, 8 in 2023-08-10T11:48:47.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:46 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T11:48:48.131 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:47 smithi156 ceph-mon[130574]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:48:48.131 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:47 smithi156 ceph-mon[130574]: osdmap e51: 8 total, 8 up, 8 in 2023-08-10T11:48:48.131 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:48:48.131 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:48:48.132 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:48.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:47 smithi152 ceph-mon[130220]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:48:48.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:47 smithi152 ceph-mon[130220]: osdmap e51: 8 total, 8 up, 8 in 2023-08-10T11:48:48.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:48:48.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:48:48.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:48.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:47 smithi073 ceph-mon[128869]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:48:48.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:47 smithi073 ceph-mon[128869]: osdmap e51: 8 total, 8 up, 8 in 2023-08-10T11:48:48.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:48:48.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:48:48.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:49.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:48 smithi156 ceph-mon[130574]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:48:49.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:48 smithi156 ceph-mon[130574]: osdmap e52: 8 total, 8 up, 8 in 2023-08-10T11:48:49.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:48 smithi156 ceph-mon[130574]: osdmap e53: 8 total, 8 up, 8 in 2023-08-10T11:48:49.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:48 smithi152 ceph-mon[130220]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:48:49.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:48 smithi152 ceph-mon[130220]: osdmap e52: 8 total, 8 up, 8 in 2023-08-10T11:48:49.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:48 smithi152 ceph-mon[130220]: osdmap e53: 8 total, 8 up, 8 in 2023-08-10T11:48:49.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:48 smithi073 ceph-mon[128869]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:48:49.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:48 smithi073 ceph-mon[128869]: osdmap e52: 8 total, 8 up, 8 in 2023-08-10T11:48:49.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:48 smithi073 ceph-mon[128869]: osdmap e53: 8 total, 8 up, 8 in 2023-08-10T11:48:50.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:49 smithi152 ceph-mon[130220]: pgmap v162: 1 pgs: 1 remapped+peering; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:48:50.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:49 smithi152 ceph-mon[130220]: from='client.? 172.21.15.156:0/727028303' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "58f46e64-2624-4ad4-bb6a-225624153837"}]: dispatch 2023-08-10T11:48:50.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:49 smithi152 ceph-mon[130220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "58f46e64-2624-4ad4-bb6a-225624153837"}]: dispatch 2023-08-10T11:48:50.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:49 smithi152 ceph-mon[130220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "58f46e64-2624-4ad4-bb6a-225624153837"}]': finished 2023-08-10T11:48:50.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:49 smithi152 ceph-mon[130220]: osdmap e54: 9 total, 8 up, 9 in 2023-08-10T11:48:50.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:49 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T11:48:50.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:49 smithi156 ceph-mon[130574]: pgmap v162: 1 pgs: 1 remapped+peering; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:48:50.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:49 smithi156 ceph-mon[130574]: from='client.? 172.21.15.156:0/727028303' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "58f46e64-2624-4ad4-bb6a-225624153837"}]: dispatch 2023-08-10T11:48:50.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:49 smithi156 ceph-mon[130574]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "58f46e64-2624-4ad4-bb6a-225624153837"}]: dispatch 2023-08-10T11:48:50.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:49 smithi156 ceph-mon[130574]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "58f46e64-2624-4ad4-bb6a-225624153837"}]': finished 2023-08-10T11:48:50.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:49 smithi156 ceph-mon[130574]: osdmap e54: 9 total, 8 up, 9 in 2023-08-10T11:48:50.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:49 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T11:48:50.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:49 smithi073 ceph-mon[128869]: pgmap v162: 1 pgs: 1 remapped+peering; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:48:50.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:49 smithi073 ceph-mon[128869]: from='client.? 172.21.15.156:0/727028303' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "58f46e64-2624-4ad4-bb6a-225624153837"}]: dispatch 2023-08-10T11:48:50.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:49 smithi073 ceph-mon[128869]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "58f46e64-2624-4ad4-bb6a-225624153837"}]: dispatch 2023-08-10T11:48:50.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:49 smithi073 ceph-mon[128869]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "58f46e64-2624-4ad4-bb6a-225624153837"}]': finished 2023-08-10T11:48:50.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:49 smithi073 ceph-mon[128869]: osdmap e54: 9 total, 8 up, 9 in 2023-08-10T11:48:50.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:49 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T11:48:51.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:50 smithi152 ceph-mon[130220]: from='client.? 172.21.15.156:0/3927905877' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:48:51.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:50 smithi156 ceph-mon[130574]: from='client.? 172.21.15.156:0/3927905877' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:48:51.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:50 smithi073 ceph-mon[128869]: from='client.? 172.21.15.156:0/3927905877' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:48:52.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:51 smithi152 ceph-mon[130220]: pgmap v165: 1 pgs: 1 remapped+peering; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:48:52.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:51 smithi156 ceph-mon[130574]: pgmap v165: 1 pgs: 1 remapped+peering; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:48:52.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:51 smithi073 ceph-mon[128869]: pgmap v165: 1 pgs: 1 remapped+peering; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:48:54.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:53 smithi152 ceph-mon[130220]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:48:54.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:53 smithi156 ceph-mon[130574]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:48:54.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:53 smithi073 ceph-mon[128869]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:48:56.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:55 smithi156 ceph-mon[130574]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:48:56.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:55 smithi152 ceph-mon[130220]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:48:56.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:55 smithi073 ceph-mon[128869]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:48:57.113 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:56 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-08-10T11:48:57.114 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:56 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:57.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:56 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-08-10T11:48:57.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:56 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:57.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:56 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-08-10T11:48:57.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:56 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:48:58.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:57 smithi156 ceph-mon[130574]: Deploying daemon osd.8 on smithi156 2023-08-10T11:48:58.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:57 smithi156 ceph-mon[130574]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:48:58.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:57 smithi152 ceph-mon[130220]: Deploying daemon osd.8 on smithi156 2023-08-10T11:48:58.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:57 smithi152 ceph-mon[130220]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:48:58.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:57 smithi073 ceph-mon[128869]: Deploying daemon osd.8 on smithi156 2023-08-10T11:48:58.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:57 smithi073 ceph-mon[128869]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:49:00.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:48:59 smithi152 ceph-mon[130220]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:49:00.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:48:59 smithi156 ceph-mon[130574]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:49:00.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:48:59 smithi073 ceph-mon[128869]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:49:02.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:01 smithi152 ceph-mon[130220]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:49:02.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:01 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:02.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:01 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:02.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:01 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:49:02.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:01 smithi156 ceph-mon[130574]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:49:02.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:01 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:02.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:01 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:02.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:01 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:49:02.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:01 smithi073 ceph-mon[128869]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:49:02.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:01 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:02.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:01 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:02.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:01 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:49:04.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:03 smithi156 ceph-mon[130574]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:49:04.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:03 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:04.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:03 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:04.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:03 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:04.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:03 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:49:04.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:03 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:04.160 INFO:teuthology.orchestra.run.smithi156.stdout:Created osd(s) 8 on host 'smithi156' 2023-08-10T11:49:04.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:04.158+0000 7fb6e4ff9700 1 -- 172.21.15.156:0/593290188 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb6e8060bb0 con 0x7fb6d00a1150 2023-08-10T11:49:04.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:04.161+0000 7fb6edcec700 1 -- 172.21.15.156:0/593290188 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb6d00a1150 msgr2=0x7fb6d00a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:49:04.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:04.161+0000 7fb6edcec700 1 --2- 172.21.15.156:0/593290188 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb6d00a1150 0x7fb6d00a3610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8100760 tx=0x7fb6dc00b410 comp rx=0 tx=0).stop 2023-08-10T11:49:04.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:04.161+0000 7fb6edcec700 1 -- 172.21.15.156:0/593290188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6e81012a0 msgr2=0x7fb6e819d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:49:04.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:04.161+0000 7fb6edcec700 1 --2- 172.21.15.156:0/593290188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6e81012a0 0x7fb6e819d810 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb6e000ada0 tx=0x7fb6e000c330 comp rx=0 tx=0).stop 2023-08-10T11:49:04.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:04.161+0000 7fb6edcec700 1 -- 172.21.15.156:0/593290188 shutdown_connections 2023-08-10T11:49:04.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:04.161+0000 7fb6edcec700 1 --2- 172.21.15.156:0/593290188 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb6d00a1150 0x7fb6d00a3610 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:49:04.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:04.161+0000 7fb6edcec700 1 --2- 172.21.15.156:0/593290188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6e80ff700 0x7fb6e8068db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:49:04.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:04.161+0000 7fb6edcec700 1 --2- 172.21.15.156:0/593290188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6e81012a0 0x7fb6e819d810 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:49:04.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:04.161+0000 7fb6edcec700 1 --2- 172.21.15.156:0/593290188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6e8100900 0x7fb6e819b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:49:04.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:04.161+0000 7fb6edcec700 1 -- 172.21.15.156:0/593290188 >> 172.21.15.156:0/593290188 conn(0x7fb6e80fac80 msgr2=0x7fb6e8103e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:49:04.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:04.161+0000 7fb6edcec700 1 -- 172.21.15.156:0/593290188 shutdown_connections 2023-08-10T11:49:04.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:04.161+0000 7fb6edcec700 1 -- 172.21.15.156:0/593290188 wait complete. 2023-08-10T11:49:04.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:03 smithi152 ceph-mon[130220]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:49:04.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:03 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:04.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:03 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:04.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:03 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:04.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:03 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:49:04.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:03 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:04.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:03 smithi073 ceph-mon[128869]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:49:04.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:03 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:04.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:03 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:04.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:03 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:04.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:03 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:49:04.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:03 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:04.674 DEBUG:teuthology.orchestra.run.smithi156:osd.8> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@osd.8.service 2023-08-10T11:49:04.676 INFO:tasks.cephadm:Deploying osd.9 on smithi073 with /dev/vg_nvme/lv_1... 2023-08-10T11:49:04.677 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-08-10T11:49:04.705 INFO:journalctl@ceph.osd.8.smithi156.stdout:-- Logs begin at Thu 2023-08-10 11:15:12 UTC. -- 2023-08-10T11:49:05.005 INFO:journalctl@ceph.osd.8.smithi156.stdout:Aug 10 11:49:04 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-8[147495]: 2023-08-10T11:49:04.857+0000 7f1d106ab640 -1 osd.8 0 log_to_monitors true 2023-08-10T11:49:05.239 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:49:05.354 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:05 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:05.354 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:05 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:05.354 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:05 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:49:05.354 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:05 smithi156 ceph-mon[130574]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:49:05.355 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:05 smithi156 ceph-mon[130574]: from='osd.8 [v2:172.21.15.156:6816/96487555,v1:172.21.15.156:6817/96487555]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-08-10T11:49:05.355 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:05 smithi156 ceph-mon[130574]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-08-10T11:49:05.440 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:05 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:05.440 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:05 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:05.441 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:05 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:49:05.441 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:05 smithi073 ceph-mon[128869]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:49:05.441 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:05 smithi073 ceph-mon[128869]: from='osd.8 [v2:172.21.15.156:6816/96487555,v1:172.21.15.156:6817/96487555]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-08-10T11:49:05.441 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:05 smithi073 ceph-mon[128869]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-08-10T11:49:05.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:05 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:05.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:05 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:05.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:05 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:49:05.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:05 smithi152 ceph-mon[130220]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:49:05.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:05 smithi152 ceph-mon[130220]: from='osd.8 [v2:172.21.15.156:6816/96487555,v1:172.21.15.156:6817/96487555]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-08-10T11:49:05.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:05 smithi152 ceph-mon[130220]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-08-10T11:49:06.255 INFO:journalctl@ceph.osd.8.smithi156.stdout:Aug 10 11:49:06 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-8[147495]: 2023-08-10T11:49:06.119+0000 7f1d05522700 -1 osd.8 0 waiting for initial osdmap 2023-08-10T11:49:06.256 INFO:journalctl@ceph.osd.8.smithi156.stdout:Aug 10 11:49:06 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-8[147495]: 2023-08-10T11:49:06.138+0000 7f1cffb14700 -1 osd.8 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T11:49:06.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:06 smithi156 ceph-mon[130574]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-08-10T11:49:06.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:06 smithi156 ceph-mon[130574]: osdmap e55: 9 total, 8 up, 9 in 2023-08-10T11:49:06.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:06 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T11:49:06.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:06 smithi156 ceph-mon[130574]: from='osd.8 [v2:172.21.15.156:6816/96487555,v1:172.21.15.156:6817/96487555]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-08-10T11:49:06.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:06 smithi156 ceph-mon[130574]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-08-10T11:49:06.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:06 smithi152 ceph-mon[130220]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-08-10T11:49:06.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:06 smithi152 ceph-mon[130220]: osdmap e55: 9 total, 8 up, 9 in 2023-08-10T11:49:06.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:06 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T11:49:06.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:06 smithi152 ceph-mon[130220]: from='osd.8 [v2:172.21.15.156:6816/96487555,v1:172.21.15.156:6817/96487555]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-08-10T11:49:06.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:06 smithi152 ceph-mon[130220]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-08-10T11:49:06.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:06 smithi073 ceph-mon[128869]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-08-10T11:49:06.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:06 smithi073 ceph-mon[128869]: osdmap e55: 9 total, 8 up, 9 in 2023-08-10T11:49:06.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:06 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T11:49:06.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:06 smithi073 ceph-mon[128869]: from='osd.8 [v2:172.21.15.156:6816/96487555,v1:172.21.15.156:6817/96487555]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-08-10T11:49:06.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:06 smithi073 ceph-mon[128869]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-08-10T11:49:06.764 INFO:teuthology.orchestra.run.smithi073.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-08-10T11:49:06.764 INFO:teuthology.orchestra.run.smithi073.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-08-10T11:49:06.765 INFO:teuthology.orchestra.run.smithi073.stderr: stderr: 10+0 records in 2023-08-10T11:49:06.765 INFO:teuthology.orchestra.run.smithi073.stderr:10+0 records out 2023-08-10T11:49:06.765 INFO:teuthology.orchestra.run.smithi073.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111423 s, 941 MB/s 2023-08-10T11:49:06.765 INFO:teuthology.orchestra.run.smithi073.stderr:--> Zapping successful for: 2023-08-10T11:49:07.184 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi073:vg_nvme/lv_1 2023-08-10T11:49:07.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:07 smithi156 ceph-mon[130574]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-08-10T11:49:07.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:07 smithi156 ceph-mon[130574]: osdmap e56: 9 total, 8 up, 9 in 2023-08-10T11:49:07.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:07 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T11:49:07.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:07 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T11:49:07.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:07 smithi156 ceph-mon[130574]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:49:07.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:07 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:07.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:07 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:07.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:07 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:07.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:07 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:07.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:07 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:07.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:07 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:07.258 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:07 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:07.258 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:07 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:49:07.258 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:07 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:07.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:07 smithi152 ceph-mon[130220]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-08-10T11:49:07.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:07 smithi152 ceph-mon[130220]: osdmap e56: 9 total, 8 up, 9 in 2023-08-10T11:49:07.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:07 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T11:49:07.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:07 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T11:49:07.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:07 smithi152 ceph-mon[130220]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:49:07.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:07 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:07.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:07 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:07.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:07 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:07.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:07 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:07.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:07 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:07.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:07 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:07.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:07 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:07.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:07 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:49:07.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:07 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:07.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:07 smithi073 ceph-mon[128869]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-08-10T11:49:07.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:07 smithi073 ceph-mon[128869]: osdmap e56: 9 total, 8 up, 9 in 2023-08-10T11:49:07.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:07 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T11:49:07.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:07 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T11:49:07.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:07 smithi073 ceph-mon[128869]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-08-10T11:49:07.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:07 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:07.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:07 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:07.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:07 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:07.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:07 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:07.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:07 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:07.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:07 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:07.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:07 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:07.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:07 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:49:07.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:07 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:07.737 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:49:08.249 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:08 smithi073 ceph-mon[128869]: purged_snaps scrub starts 2023-08-10T11:49:08.249 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:08 smithi073 ceph-mon[128869]: purged_snaps scrub ok 2023-08-10T11:49:08.249 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:08 smithi073 ceph-mon[128869]: Detected new or changed devices on smithi156 2023-08-10T11:49:08.249 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:08 smithi073 ceph-mon[128869]: Adjusting osd_memory_target on smithi156 to 5722M 2023-08-10T11:49:08.250 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:08 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T11:49:08.250 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:08 smithi073 ceph-mon[128869]: osd.8 [v2:172.21.15.156:6816/96487555,v1:172.21.15.156:6817/96487555] boot 2023-08-10T11:49:08.250 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:08 smithi073 ceph-mon[128869]: osdmap e57: 9 total, 9 up, 9 in 2023-08-10T11:49:08.250 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:08 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T11:49:08.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:08 smithi152 ceph-mon[130220]: purged_snaps scrub starts 2023-08-10T11:49:08.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:08 smithi152 ceph-mon[130220]: purged_snaps scrub ok 2023-08-10T11:49:08.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:08 smithi152 ceph-mon[130220]: Detected new or changed devices on smithi156 2023-08-10T11:49:08.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:08 smithi152 ceph-mon[130220]: Adjusting osd_memory_target on smithi156 to 5722M 2023-08-10T11:49:08.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:08 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T11:49:08.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:08 smithi152 ceph-mon[130220]: osd.8 [v2:172.21.15.156:6816/96487555,v1:172.21.15.156:6817/96487555] boot 2023-08-10T11:49:08.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:08 smithi152 ceph-mon[130220]: osdmap e57: 9 total, 9 up, 9 in 2023-08-10T11:49:08.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:08 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T11:49:08.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:08 smithi156 ceph-mon[130574]: purged_snaps scrub starts 2023-08-10T11:49:08.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:08 smithi156 ceph-mon[130574]: purged_snaps scrub ok 2023-08-10T11:49:08.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:08 smithi156 ceph-mon[130574]: Detected new or changed devices on smithi156 2023-08-10T11:49:08.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:08 smithi156 ceph-mon[130574]: Adjusting osd_memory_target on smithi156 to 5722M 2023-08-10T11:49:08.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:08 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T11:49:08.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:08 smithi156 ceph-mon[130574]: osd.8 [v2:172.21.15.156:6816/96487555,v1:172.21.15.156:6817/96487555] boot 2023-08-10T11:49:08.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:08 smithi156 ceph-mon[130574]: osdmap e57: 9 total, 9 up, 9 in 2023-08-10T11:49:08.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:08 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T11:49:08.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.956+0000 7f352ab9e700 1 -- 172.21.15.73:0/1489062698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3524100930 msgr2=0x7f3524100d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:49:08.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.956+0000 7f352ab9e700 1 --2- 172.21.15.73:0/1489062698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3524100930 0x7f3524100d90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f35100099c0 tx=0x7f3510009cd0 comp rx=0 tx=0).stop 2023-08-10T11:49:08.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.957+0000 7f352ab9e700 1 -- 172.21.15.73:0/1489062698 shutdown_connections 2023-08-10T11:49:08.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.957+0000 7f352ab9e700 1 --2- 172.21.15.73:0/1489062698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35241012d0 0x7f3524107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:49:08.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.957+0000 7f352ab9e700 1 --2- 172.21.15.73:0/1489062698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35240ff730 0x7f35240ffb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:49:08.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.957+0000 7f352ab9e700 1 --2- 172.21.15.73:0/1489062698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3524100930 0x7f3524100d90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:49:08.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.957+0000 7f352ab9e700 1 -- 172.21.15.73:0/1489062698 >> 172.21.15.73:0/1489062698 conn(0x7f35240facf0 msgr2=0x7f35240fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:49:08.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.957+0000 7f352ab9e700 1 -- 172.21.15.73:0/1489062698 shutdown_connections 2023-08-10T11:49:08.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.957+0000 7f352ab9e700 1 -- 172.21.15.73:0/1489062698 wait complete. 2023-08-10T11:49:08.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.957+0000 7f352ab9e700 1 Processor -- start 2023-08-10T11:49:08.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.957+0000 7f352ab9e700 1 -- start start 2023-08-10T11:49:08.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.957+0000 7f352ab9e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35240ff730 0x7f35240696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:49:08.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.957+0000 7f352ab9e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3524100930 0x7f352419b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:49:08.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.957+0000 7f352ab9e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35241012d0 0x7f352419d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:49:08.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.957+0000 7f352ab9e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352419e030 con 0x7f3524100930 2023-08-10T11:49:08.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.957+0000 7f352ab9e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352419e1a0 con 0x7f35240ff730 2023-08-10T11:49:08.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.957+0000 7f352ab9e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352419e360 con 0x7f35241012d0 2023-08-10T11:49:08.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.957+0000 7f3523fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3524100930 0x7f352419b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:49:08.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.958+0000 7f3523fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3524100930 0x7f352419b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58382/0 (socket says 172.21.15.73:58382) 2023-08-10T11:49:08.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.958+0000 7f3523fff700 1 -- 172.21.15.73:0/337720852 learned_addr learned my addr 172.21.15.73:0/337720852 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:49:08.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.958+0000 7f352893a700 1 --2- 172.21.15.73:0/337720852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35240ff730 0x7f35240696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:49:08.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.958+0000 7f3523fff700 1 -- 172.21.15.73:0/337720852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35241012d0 msgr2=0x7f352419d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:49:08.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.958+0000 7f3523fff700 1 --2- 172.21.15.73:0/337720852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35241012d0 0x7f352419d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:49:08.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.958+0000 7f3523fff700 1 -- 172.21.15.73:0/337720852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35240ff730 msgr2=0x7f35240696b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:49:08.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.958+0000 7f3523fff700 1 --2- 172.21.15.73:0/337720852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35240ff730 0x7f35240696b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:49:08.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.958+0000 7f3523fff700 1 -- 172.21.15.73:0/337720852 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35100095f0 con 0x7f3524100930 2023-08-10T11:49:08.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.958+0000 7f352893a700 1 --2- 172.21.15.73:0/337720852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35240ff730 0x7f35240696b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:49:08.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.958+0000 7f3523fff700 1 --2- 172.21.15.73:0/337720852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3524100930 0x7f352419b250 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3510009990 tx=0x7f3510003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:49:08.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.958+0000 7f3521ffb700 1 -- 172.21.15.73:0/337720852 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351001d070 con 0x7f3524100930 2023-08-10T11:49:08.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.958+0000 7f352ab9e700 1 -- 172.21.15.73:0/337720852 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f352419e5e0 con 0x7f3524100930 2023-08-10T11:49:08.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.958+0000 7f3521ffb700 1 -- 172.21.15.73:0/337720852 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3510004640 con 0x7f3524100930 2023-08-10T11:49:08.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.958+0000 7f3521ffb700 1 -- 172.21.15.73:0/337720852 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351000f460 con 0x7f3524100930 2023-08-10T11:49:08.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.958+0000 7f352ab9e700 1 -- 172.21.15.73:0/337720852 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f352419ead0 con 0x7f3524100930 2023-08-10T11:49:08.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.959+0000 7f352ab9e700 1 -- 172.21.15.73:0/337720852 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f352410af40 con 0x7f3524100930 2023-08-10T11:49:08.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.960+0000 7f3521ffb700 1 -- 172.21.15.73:0/337720852 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f3510022470 con 0x7f3524100930 2023-08-10T11:49:08.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.961+0000 7f3521ffb700 1 --2- 172.21.15.73:0/337720852 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f35140a11d0 0x7f35140a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:49:08.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.961+0000 7f352893a700 1 --2- 172.21.15.73:0/337720852 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f35140a11d0 0x7f35140a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:49:08.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.961+0000 7f3521ffb700 1 -- 172.21.15.73:0/337720852 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5858+0+0 (secure 0 0 0) 0x7f35100cd700 con 0x7f3524100930 2023-08-10T11:49:08.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.961+0000 7f352893a700 1 --2- 172.21.15.73:0/337720852 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f35140a11d0 0x7f35140a3690 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3524100790 tx=0x7f3518005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:49:08.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:08.964+0000 7f3521ffb700 1 -- 172.21.15.73:0/337720852 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f35100977d0 con 0x7f3524100930 2023-08-10T11:49:09.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:09.159+0000 7f352ab9e700 1 -- 172.21.15.73:0/337720852 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f3524060bb0 con 0x7f35140a11d0 2023-08-10T11:49:09.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:09 smithi152 ceph-mon[130220]: osdmap e58: 9 total, 9 up, 9 in 2023-08-10T11:49:09.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:09 smithi152 ceph-mon[130220]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-08-10T11:49:09.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:09 smithi156 ceph-mon[130574]: osdmap e58: 9 total, 9 up, 9 in 2023-08-10T11:49:09.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:09 smithi156 ceph-mon[130574]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-08-10T11:49:09.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:09 smithi073 ceph-mon[128869]: osdmap e58: 9 total, 9 up, 9 in 2023-08-10T11:49:09.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:09 smithi073 ceph-mon[128869]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-08-10T11:49:10.240 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:10 smithi073 ceph-mon[128869]: osdmap e59: 9 total, 9 up, 9 in 2023-08-10T11:49:10.241 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:10 smithi073 ceph-mon[128869]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:49:10.241 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:10 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:49:10.241 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:10 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:49:10.241 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:10 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:10.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:10 smithi152 ceph-mon[130220]: osdmap e59: 9 total, 9 up, 9 in 2023-08-10T11:49:10.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:10 smithi152 ceph-mon[130220]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:49:10.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:10 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:49:10.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:10 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:49:10.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:10 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:10.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:10 smithi156 ceph-mon[130574]: osdmap e59: 9 total, 9 up, 9 in 2023-08-10T11:49:10.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:10 smithi156 ceph-mon[130574]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:49:10.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:10 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:49:10.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:10 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:49:10.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:10 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:11.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:11 smithi152 ceph-mon[130220]: osdmap e60: 9 total, 9 up, 9 in 2023-08-10T11:49:11.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:11 smithi152 ceph-mon[130220]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-08-10T11:49:11.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:11 smithi156 ceph-mon[130574]: osdmap e60: 9 total, 9 up, 9 in 2023-08-10T11:49:11.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:11 smithi156 ceph-mon[130574]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-08-10T11:49:11.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:11 smithi073 ceph-mon[128869]: osdmap e60: 9 total, 9 up, 9 in 2023-08-10T11:49:11.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:11 smithi073 ceph-mon[128869]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-08-10T11:49:12.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:12 smithi152 ceph-mon[130220]: osdmap e61: 9 total, 9 up, 9 in 2023-08-10T11:49:12.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:12 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3502920721' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9389dd5b-da2d-43b6-8bc0-bb1af13f72c8"}]: dispatch 2023-08-10T11:49:12.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:12 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3502920721' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9389dd5b-da2d-43b6-8bc0-bb1af13f72c8"}]': finished 2023-08-10T11:49:12.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:12 smithi152 ceph-mon[130220]: osdmap e62: 10 total, 9 up, 10 in 2023-08-10T11:49:12.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:12 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T11:49:12.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:12 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/580887196' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:49:12.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:12 smithi156 ceph-mon[130574]: osdmap e61: 9 total, 9 up, 9 in 2023-08-10T11:49:12.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:12 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3502920721' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9389dd5b-da2d-43b6-8bc0-bb1af13f72c8"}]: dispatch 2023-08-10T11:49:12.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:12 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3502920721' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9389dd5b-da2d-43b6-8bc0-bb1af13f72c8"}]': finished 2023-08-10T11:49:12.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:12 smithi156 ceph-mon[130574]: osdmap e62: 10 total, 9 up, 10 in 2023-08-10T11:49:12.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:12 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T11:49:12.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:12 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/580887196' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:49:12.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:12 smithi073 ceph-mon[128869]: osdmap e61: 9 total, 9 up, 9 in 2023-08-10T11:49:12.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:12 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3502920721' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9389dd5b-da2d-43b6-8bc0-bb1af13f72c8"}]: dispatch 2023-08-10T11:49:12.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:12 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3502920721' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9389dd5b-da2d-43b6-8bc0-bb1af13f72c8"}]': finished 2023-08-10T11:49:12.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:12 smithi073 ceph-mon[128869]: osdmap e62: 10 total, 9 up, 10 in 2023-08-10T11:49:12.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:12 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T11:49:12.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:12 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/580887196' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:49:13.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:13 smithi152 ceph-mon[130220]: pgmap v184: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-08-10T11:49:13.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:13 smithi156 ceph-mon[130574]: pgmap v184: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-08-10T11:49:13.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:13 smithi073 ceph-mon[128869]: pgmap v184: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-08-10T11:49:15.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:15 smithi152 ceph-mon[130220]: pgmap v185: 1 pgs: 1 peering; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 108 KiB/s, 0 objects/s recovering 2023-08-10T11:49:15.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:15 smithi156 ceph-mon[130574]: pgmap v185: 1 pgs: 1 peering; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 108 KiB/s, 0 objects/s recovering 2023-08-10T11:49:15.766 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:15 smithi073 ceph-mon[128869]: pgmap v185: 1 pgs: 1 peering; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 108 KiB/s, 0 objects/s recovering 2023-08-10T11:49:17.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:17 smithi152 ceph-mon[130220]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 91 KiB/s, 0 objects/s recovering 2023-08-10T11:49:17.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:17 smithi156 ceph-mon[130574]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 91 KiB/s, 0 objects/s recovering 2023-08-10T11:49:17.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:17 smithi073 ceph-mon[128869]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 91 KiB/s, 0 objects/s recovering 2023-08-10T11:49:18.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:18 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-08-10T11:49:18.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:18 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:18.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:18 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-08-10T11:49:18.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:18 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:18.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:18 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-08-10T11:49:18.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:18 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:19.740 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:19 smithi073 ceph-mon[128869]: Deploying daemon osd.9 on smithi073 2023-08-10T11:49:19.741 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:19 smithi073 ceph-mon[128869]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-08-10T11:49:19.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:19 smithi152 ceph-mon[130220]: Deploying daemon osd.9 on smithi073 2023-08-10T11:49:19.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:19 smithi152 ceph-mon[130220]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-08-10T11:49:19.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:19 smithi156 ceph-mon[130574]: Deploying daemon osd.9 on smithi073 2023-08-10T11:49:19.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:19 smithi156 ceph-mon[130574]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-08-10T11:49:21.737 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:21 smithi073 ceph-mon[128869]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-08-10T11:49:21.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:21 smithi152 ceph-mon[130220]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-08-10T11:49:21.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:21 smithi156 ceph-mon[130574]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-08-10T11:49:23.920 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:23 smithi073 ceph-mon[128869]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-08-10T11:49:23.920 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:23.920 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:23.921 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:49:23.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:23 smithi152 ceph-mon[130220]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-08-10T11:49:23.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:23 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:23.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:23 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:23.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:23 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:49:24.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:23 smithi156 ceph-mon[130574]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-08-10T11:49:24.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:23 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:24.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:23 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:24.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:23 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:49:25.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:25.659+0000 7f3521ffb700 1 -- 172.21.15.73:0/337720852 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3524060bb0 con 0x7f35140a11d0 2023-08-10T11:49:25.661 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 9 on host 'smithi073' 2023-08-10T11:49:25.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:25.662+0000 7f352ab9e700 1 -- 172.21.15.73:0/337720852 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f35140a11d0 msgr2=0x7f35140a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:49:25.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:25.662+0000 7f352ab9e700 1 --2- 172.21.15.73:0/337720852 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f35140a11d0 0x7f35140a3690 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3524100790 tx=0x7f3518005f90 comp rx=0 tx=0).stop 2023-08-10T11:49:25.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:25.662+0000 7f352ab9e700 1 -- 172.21.15.73:0/337720852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3524100930 msgr2=0x7f352419b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:49:25.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:25.662+0000 7f352ab9e700 1 --2- 172.21.15.73:0/337720852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3524100930 0x7f352419b250 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3510009990 tx=0x7f3510003ba0 comp rx=0 tx=0).stop 2023-08-10T11:49:25.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:25.662+0000 7f352ab9e700 1 -- 172.21.15.73:0/337720852 shutdown_connections 2023-08-10T11:49:25.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:25.662+0000 7f352ab9e700 1 --2- 172.21.15.73:0/337720852 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f35140a11d0 0x7f35140a3690 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:49:25.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:25.662+0000 7f352ab9e700 1 --2- 172.21.15.73:0/337720852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35240ff730 0x7f35240696b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:49:25.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:25.662+0000 7f352ab9e700 1 --2- 172.21.15.73:0/337720852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35241012d0 0x7f352419d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:49:25.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:25.662+0000 7f352ab9e700 1 --2- 172.21.15.73:0/337720852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3524100930 0x7f352419b250 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:49:25.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:25.662+0000 7f352ab9e700 1 -- 172.21.15.73:0/337720852 >> 172.21.15.73:0/337720852 conn(0x7f35240facf0 msgr2=0x7f35240fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:49:25.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:25.662+0000 7f352ab9e700 1 -- 172.21.15.73:0/337720852 shutdown_connections 2023-08-10T11:49:25.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:49:25.662+0000 7f352ab9e700 1 -- 172.21.15.73:0/337720852 wait complete. 2023-08-10T11:49:25.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:25 smithi073 ceph-mon[128869]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-08-10T11:49:25.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:25 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:25.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:25 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:25.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:25 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:25.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:25 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:49:25.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:25 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:25.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:25 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:25.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:25 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:25.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:25 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:49:25.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:25 smithi152 ceph-mon[130220]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-08-10T11:49:25.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:25 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:25.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:25 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:25.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:25 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:25.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:25 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:49:25.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:25 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:25.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:25 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:25.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:25 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:25.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:25 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:49:26.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:25 smithi156 ceph-mon[130574]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-08-10T11:49:26.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:25 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:26.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:25 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:26.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:25 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:26.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:25 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:49:26.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:25 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:26.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:25 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:26.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:25 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:26.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:25 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:49:26.013 DEBUG:teuthology.orchestra.run.smithi073:osd.9> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@osd.9.service 2023-08-10T11:49:26.015 INFO:tasks.cephadm:Deploying osd.10 on smithi152 with /dev/vg_nvme/lv_1... 2023-08-10T11:49:26.015 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-08-10T11:49:26.044 INFO:journalctl@ceph.osd.9.smithi073.stdout:-- Logs begin at Thu 2023-08-10 11:15:25 UTC. -- 2023-08-10T11:49:26.582 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.b/config 2023-08-10T11:49:26.838 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:26 smithi073 ceph-mon[128869]: from='osd.9 [v2:172.21.15.73:6826/2050124321,v1:172.21.15.73:6827/2050124321]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-08-10T11:49:26.838 INFO:journalctl@ceph.osd.9.smithi073.stdout:Aug 10 11:49:26 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-9[158250]: 2023-08-10T11:49:26.609+0000 7f85c3f1d640 -1 osd.9 0 log_to_monitors true 2023-08-10T11:49:26.972 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:26 smithi152 ceph-mon[130220]: from='osd.9 [v2:172.21.15.73:6826/2050124321,v1:172.21.15.73:6827/2050124321]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-08-10T11:49:27.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:26 smithi156 ceph-mon[130574]: from='osd.9 [v2:172.21.15.73:6826/2050124321,v1:172.21.15.73:6827/2050124321]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-08-10T11:49:27.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:27 smithi152 ceph-mon[130220]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-08-10T11:49:27.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:27 smithi152 ceph-mon[130220]: from='osd.9 [v2:172.21.15.73:6826/2050124321,v1:172.21.15.73:6827/2050124321]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-08-10T11:49:27.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:27 smithi152 ceph-mon[130220]: osdmap e63: 10 total, 9 up, 10 in 2023-08-10T11:49:27.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:27 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T11:49:27.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:27 smithi152 ceph-mon[130220]: from='osd.9 [v2:172.21.15.73:6826/2050124321,v1:172.21.15.73:6827/2050124321]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2023-08-10T11:49:28.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:27 smithi156 ceph-mon[130574]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-08-10T11:49:28.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:27 smithi156 ceph-mon[130574]: from='osd.9 [v2:172.21.15.73:6826/2050124321,v1:172.21.15.73:6827/2050124321]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-08-10T11:49:28.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:27 smithi156 ceph-mon[130574]: osdmap e63: 10 total, 9 up, 10 in 2023-08-10T11:49:28.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:27 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T11:49:28.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:27 smithi156 ceph-mon[130574]: from='osd.9 [v2:172.21.15.73:6826/2050124321,v1:172.21.15.73:6827/2050124321]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2023-08-10T11:49:28.017 INFO:journalctl@ceph.osd.9.smithi073.stdout:Aug 10 11:49:27 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-9[158250]: 2023-08-10T11:49:27.715+0000 7f85b8d94700 -1 osd.9 0 waiting for initial osdmap 2023-08-10T11:49:28.018 INFO:journalctl@ceph.osd.9.smithi073.stdout:Aug 10 11:49:27 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-9[158250]: 2023-08-10T11:49:27.728+0000 7f85b2384700 -1 osd.9 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T11:49:28.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:27 smithi073 ceph-mon[128869]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-08-10T11:49:28.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:27 smithi073 ceph-mon[128869]: from='osd.9 [v2:172.21.15.73:6826/2050124321,v1:172.21.15.73:6827/2050124321]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-08-10T11:49:28.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:27 smithi073 ceph-mon[128869]: osdmap e63: 10 total, 9 up, 10 in 2023-08-10T11:49:28.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:27 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T11:49:28.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:27 smithi073 ceph-mon[128869]: from='osd.9 [v2:172.21.15.73:6826/2050124321,v1:172.21.15.73:6827/2050124321]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]: dispatch 2023-08-10T11:49:28.079 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-08-10T11:49:28.079 INFO:teuthology.orchestra.run.smithi152.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-08-10T11:49:28.080 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10+0 records in 2023-08-10T11:49:28.080 INFO:teuthology.orchestra.run.smithi152.stderr:10+0 records out 2023-08-10T11:49:28.080 INFO:teuthology.orchestra.run.smithi152.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0141149 s, 743 MB/s 2023-08-10T11:49:28.080 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 2023-08-10T11:49:28.080 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping successful for: 2023-08-10T11:49:28.438 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi152:vg_nvme/lv_1 2023-08-10T11:49:28.993 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.b/config 2023-08-10T11:49:28.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:28 smithi152 ceph-mon[130220]: from='osd.9 [v2:172.21.15.73:6826/2050124321,v1:172.21.15.73:6827/2050124321]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2023-08-10T11:49:28.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:28 smithi152 ceph-mon[130220]: osdmap e64: 10 total, 9 up, 10 in 2023-08-10T11:49:28.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:28 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T11:49:28.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:28 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T11:49:28.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:28 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:28.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:28 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:28.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:28 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:28.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:28 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:28.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:28 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:28.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:28 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:28.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:28 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:28.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:28 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:28.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:28 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:49:28.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:28 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:29.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:28 smithi156 ceph-mon[130574]: from='osd.9 [v2:172.21.15.73:6826/2050124321,v1:172.21.15.73:6827/2050124321]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2023-08-10T11:49:29.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:28 smithi156 ceph-mon[130574]: osdmap e64: 10 total, 9 up, 10 in 2023-08-10T11:49:29.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:28 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T11:49:29.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:28 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T11:49:29.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:28 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:29.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:28 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:29.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:28 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:29.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:28 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:29.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:28 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:29.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:28 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:29.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:28 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:29.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:28 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:29.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:28 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:49:29.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:28 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:29.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:28 smithi073 ceph-mon[128869]: from='osd.9 [v2:172.21.15.73:6826/2050124321,v1:172.21.15.73:6827/2050124321]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2023-08-10T11:49:29.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:28 smithi073 ceph-mon[128869]: osdmap e64: 10 total, 9 up, 10 in 2023-08-10T11:49:29.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:28 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T11:49:29.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:28 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T11:49:29.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:28 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:29.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:28 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:29.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:28 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:29.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:28 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:29.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:28 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:29.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:28 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:29.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:28 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:29.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:28 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:29.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:28 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:49:29.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:28 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:29.983 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:29 smithi152 ceph-mon[130220]: purged_snaps scrub starts 2023-08-10T11:49:29.984 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:29 smithi152 ceph-mon[130220]: purged_snaps scrub ok 2023-08-10T11:49:29.984 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:29 smithi152 ceph-mon[130220]: Detected new or changed devices on smithi073 2023-08-10T11:49:29.984 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:29 smithi152 ceph-mon[130220]: Adjusting osd_memory_target on smithi073 to 4292M 2023-08-10T11:49:29.984 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:29 smithi152 ceph-mon[130220]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-08-10T11:49:29.984 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:29 smithi152 ceph-mon[130220]: osd.9 [v2:172.21.15.73:6826/2050124321,v1:172.21.15.73:6827/2050124321] boot 2023-08-10T11:49:29.985 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:29 smithi152 ceph-mon[130220]: osdmap e65: 10 total, 10 up, 10 in 2023-08-10T11:49:29.985 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:29 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T11:49:30.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:29 smithi156 ceph-mon[130574]: purged_snaps scrub starts 2023-08-10T11:49:30.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:29 smithi156 ceph-mon[130574]: purged_snaps scrub ok 2023-08-10T11:49:30.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:29 smithi156 ceph-mon[130574]: Detected new or changed devices on smithi073 2023-08-10T11:49:30.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:29 smithi156 ceph-mon[130574]: Adjusting osd_memory_target on smithi073 to 4292M 2023-08-10T11:49:30.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:29 smithi156 ceph-mon[130574]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-08-10T11:49:30.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:29 smithi156 ceph-mon[130574]: osd.9 [v2:172.21.15.73:6826/2050124321,v1:172.21.15.73:6827/2050124321] boot 2023-08-10T11:49:30.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:29 smithi156 ceph-mon[130574]: osdmap e65: 10 total, 10 up, 10 in 2023-08-10T11:49:30.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:29 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T11:49:30.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:29 smithi073 ceph-mon[128869]: purged_snaps scrub starts 2023-08-10T11:49:30.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:29 smithi073 ceph-mon[128869]: purged_snaps scrub ok 2023-08-10T11:49:30.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:29 smithi073 ceph-mon[128869]: Detected new or changed devices on smithi073 2023-08-10T11:49:30.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:29 smithi073 ceph-mon[128869]: Adjusting osd_memory_target on smithi073 to 4292M 2023-08-10T11:49:30.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:29 smithi073 ceph-mon[128869]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-08-10T11:49:30.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:29 smithi073 ceph-mon[128869]: osd.9 [v2:172.21.15.73:6826/2050124321,v1:172.21.15.73:6827/2050124321] boot 2023-08-10T11:49:30.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:29 smithi073 ceph-mon[128869]: osdmap e65: 10 total, 10 up, 10 in 2023-08-10T11:49:30.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:29 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T11:49:30.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.195+0000 7f9718f18700 1 -- 172.21.15.152:0/638564380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97141023c0 msgr2=0x7f9714108c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:49:30.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.195+0000 7f9718f18700 1 --2- 172.21.15.152:0/638564380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97141023c0 0x7f9714108c70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f970c00b0d0 tx=0x7f970c00b3e0 comp rx=0 tx=0).stop 2023-08-10T11:49:30.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.196+0000 7f9718f18700 1 -- 172.21.15.152:0/638564380 shutdown_connections 2023-08-10T11:49:30.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.196+0000 7f9718f18700 1 --2- 172.21.15.152:0/638564380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97141023c0 0x7f9714108c70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:49:30.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.196+0000 7f9718f18700 1 --2- 172.21.15.152:0/638564380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9714100820 0x7f9714100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:49:30.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.196+0000 7f9718f18700 1 --2- 172.21.15.152:0/638564380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9714101a20 0x7f9714101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:49:30.198 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.196+0000 7f9718f18700 1 -- 172.21.15.152:0/638564380 >> 172.21.15.152:0/638564380 conn(0x7f97140fbd80 msgr2=0x7f97140fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:49:30.198 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.196+0000 7f9718f18700 1 -- 172.21.15.152:0/638564380 shutdown_connections 2023-08-10T11:49:30.198 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.196+0000 7f9718f18700 1 -- 172.21.15.152:0/638564380 wait complete. 2023-08-10T11:49:30.199 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.196+0000 7f9718f18700 1 Processor -- start 2023-08-10T11:49:30.200 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.196+0000 7f9718f18700 1 -- start start 2023-08-10T11:49:30.200 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.197+0000 7f9718f18700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9714100820 0x7f97141965b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:49:30.200 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.197+0000 7f9718f18700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9714101a20 0x7f9714196af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:49:30.200 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.197+0000 7f9718f18700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97141023c0 0x7f971419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:49:30.200 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.197+0000 7f9718f18700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971419e140 con 0x7f97141023c0 2023-08-10T11:49:30.200 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.197+0000 7f9718f18700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971419e280 con 0x7f9714100820 2023-08-10T11:49:30.200 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.197+0000 7f9718f18700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971419e410 con 0x7f9714101a20 2023-08-10T11:49:30.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.197+0000 7f971259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9714100820 0x7f97141965b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:49:30.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.197+0000 7f971259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9714100820 0x7f97141965b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44180/0 (socket says 172.21.15.152:44180) 2023-08-10T11:49:30.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.197+0000 7f971259c700 1 -- 172.21.15.152:0/626471954 learned_addr learned my addr 172.21.15.152:0/626471954 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-08-10T11:49:30.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.197+0000 7f9711d9b700 1 --2- 172.21.15.152:0/626471954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9714101a20 0x7f9714196af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:49:30.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.197+0000 7f971259c700 1 -- 172.21.15.152:0/626471954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9714101a20 msgr2=0x7f9714196af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:49:30.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.197+0000 7f971259c700 1 --2- 172.21.15.152:0/626471954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9714101a20 0x7f9714196af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:49:30.202 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.197+0000 7f9712d9d700 1 --2- 172.21.15.152:0/626471954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97141023c0 0x7f971419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:49:30.202 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.197+0000 7f971259c700 1 -- 172.21.15.152:0/626471954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97141023c0 msgr2=0x7f971419db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:49:30.202 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.197+0000 7f971259c700 1 --2- 172.21.15.152:0/626471954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97141023c0 0x7f971419db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:49:30.202 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.197+0000 7f971259c700 1 -- 172.21.15.152:0/626471954 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970c009d00 con 0x7f9714100820 2023-08-10T11:49:30.202 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.197+0000 7f9712d9d700 1 --2- 172.21.15.152:0/626471954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97141023c0 0x7f971419db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:49:30.202 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.197+0000 7f971259c700 1 --2- 172.21.15.152:0/626471954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9714100820 0x7f97141965b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f970800c990 tx=0x7f970800cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:49:30.203 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.197+0000 7f97037fe700 1 -- 172.21.15.152:0/626471954 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9708007b00 con 0x7f9714100820 2023-08-10T11:49:30.203 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.197+0000 7f97037fe700 1 -- 172.21.15.152:0/626471954 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9708007c60 con 0x7f9714100820 2023-08-10T11:49:30.203 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.197+0000 7f9718f18700 1 -- 172.21.15.152:0/626471954 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971419e6f0 con 0x7f9714100820 2023-08-10T11:49:30.203 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.197+0000 7f97037fe700 1 -- 172.21.15.152:0/626471954 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9708018660 con 0x7f9714100820 2023-08-10T11:49:30.203 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.197+0000 7f9718f18700 1 -- 172.21.15.152:0/626471954 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971419ec70 con 0x7f9714100820 2023-08-10T11:49:30.203 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.198+0000 7f9718f18700 1 -- 172.21.15.152:0/626471954 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9714107cc0 con 0x7f9714100820 2023-08-10T11:49:30.204 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.199+0000 7f97037fe700 1 -- 172.21.15.152:0/626471954 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f970800f450 con 0x7f9714100820 2023-08-10T11:49:30.204 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.200+0000 7f97037fe700 1 --2- 172.21.15.152:0/626471954 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f96fc0a1150 0x7f96fc0a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:49:30.204 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.200+0000 7f97037fe700 1 -- 172.21.15.152:0/626471954 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f97080cc010 con 0x7f9714100820 2023-08-10T11:49:30.205 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.200+0000 7f9711d9b700 1 --2- 172.21.15.152:0/626471954 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f96fc0a1150 0x7f96fc0a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:49:30.205 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.201+0000 7f9711d9b700 1 --2- 172.21.15.152:0/626471954 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f96fc0a1150 0x7f96fc0a3610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9704009a10 tx=0x7f9704009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:49:30.205 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.204+0000 7f97037fe700 1 -- 172.21.15.152:0/626471954 <== mon.2 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f9708095f60 con 0x7f9714100820 2023-08-10T11:49:30.398 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:30.397+0000 7f9718f18700 1 -- 172.21.15.152:0/626471954 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9714060bb0 con 0x7f96fc0a1150 2023-08-10T11:49:31.467 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:31 smithi152 ceph-mon[130220]: osdmap e66: 10 total, 10 up, 10 in 2023-08-10T11:49:31.467 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:31 smithi152 ceph-mon[130220]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:49:31.467 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:31 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:49:31.467 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:31 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:49:31.467 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:31 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:31.467 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:31 smithi152 ceph-mon[130220]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:31.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:31 smithi156 ceph-mon[130574]: osdmap e66: 10 total, 10 up, 10 in 2023-08-10T11:49:31.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:31 smithi156 ceph-mon[130574]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:49:31.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:31 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:49:31.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:31 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:49:31.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:31 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:31.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:31 smithi156 ceph-mon[130574]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:31.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:31 smithi073 ceph-mon[128869]: osdmap e66: 10 total, 10 up, 10 in 2023-08-10T11:49:31.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:31 smithi073 ceph-mon[128869]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:49:31.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:31 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:49:31.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:31 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:49:31.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:31 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:31.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:31 smithi073 ceph-mon[128869]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:33.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:33 smithi073 ceph-mon[128869]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:33.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:33 smithi073 ceph-mon[128869]: from='client.? 172.21.15.152:0/3560311749' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "563c1e34-3acd-46ab-ba36-e9d87f635e3a"}]: dispatch 2023-08-10T11:49:33.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:33 smithi073 ceph-mon[128869]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "563c1e34-3acd-46ab-ba36-e9d87f635e3a"}]: dispatch 2023-08-10T11:49:33.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:33 smithi073 ceph-mon[128869]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "563c1e34-3acd-46ab-ba36-e9d87f635e3a"}]': finished 2023-08-10T11:49:33.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:33 smithi073 ceph-mon[128869]: osdmap e67: 11 total, 10 up, 11 in 2023-08-10T11:49:33.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:33 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T11:49:33.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:33 smithi073 ceph-mon[128869]: from='client.? 172.21.15.152:0/2346553562' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:49:33.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:33 smithi152 ceph-mon[130220]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:33.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:33 smithi152 ceph-mon[130220]: from='client.? 172.21.15.152:0/3560311749' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "563c1e34-3acd-46ab-ba36-e9d87f635e3a"}]: dispatch 2023-08-10T11:49:33.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:33 smithi152 ceph-mon[130220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "563c1e34-3acd-46ab-ba36-e9d87f635e3a"}]: dispatch 2023-08-10T11:49:33.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:33 smithi152 ceph-mon[130220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "563c1e34-3acd-46ab-ba36-e9d87f635e3a"}]': finished 2023-08-10T11:49:33.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:33 smithi152 ceph-mon[130220]: osdmap e67: 11 total, 10 up, 11 in 2023-08-10T11:49:33.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:33 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T11:49:33.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:33 smithi152 ceph-mon[130220]: from='client.? 172.21.15.152:0/2346553562' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:49:34.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:33 smithi156 ceph-mon[130574]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:34.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:33 smithi156 ceph-mon[130574]: from='client.? 172.21.15.152:0/3560311749' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "563c1e34-3acd-46ab-ba36-e9d87f635e3a"}]: dispatch 2023-08-10T11:49:34.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:33 smithi156 ceph-mon[130574]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "563c1e34-3acd-46ab-ba36-e9d87f635e3a"}]: dispatch 2023-08-10T11:49:34.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:33 smithi156 ceph-mon[130574]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "563c1e34-3acd-46ab-ba36-e9d87f635e3a"}]': finished 2023-08-10T11:49:34.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:33 smithi156 ceph-mon[130574]: osdmap e67: 11 total, 10 up, 11 in 2023-08-10T11:49:34.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:33 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T11:49:34.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:33 smithi156 ceph-mon[130574]: from='client.? 172.21.15.152:0/2346553562' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:49:35.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:35 smithi073 ceph-mon[128869]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:35.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:35 smithi152 ceph-mon[130220]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:36.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:35 smithi156 ceph-mon[130574]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:37.855 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:37 smithi152 ceph-mon[130220]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:38.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:37 smithi156 ceph-mon[130574]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:38.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:37 smithi073 ceph-mon[128869]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:39.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:39 smithi152 ceph-mon[130220]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:39.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:39 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-08-10T11:49:39.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:39 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:40.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:39 smithi156 ceph-mon[130574]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:40.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:39 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-08-10T11:49:40.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:39 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:40.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:39 smithi073 ceph-mon[128869]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:40.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:39 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-08-10T11:49:40.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:39 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:40.682 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:40 smithi152 ceph-mon[130220]: Deploying daemon osd.10 on smithi152 2023-08-10T11:49:41.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:40 smithi156 ceph-mon[130574]: Deploying daemon osd.10 on smithi152 2023-08-10T11:49:41.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:40 smithi073 ceph-mon[128869]: Deploying daemon osd.10 on smithi152 2023-08-10T11:49:41.628 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:41 smithi152 ceph-mon[130220]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:42.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:41 smithi156 ceph-mon[130574]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:42.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:41 smithi073 ceph-mon[128869]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:43.840 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:43 smithi152 ceph-mon[130220]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:44.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:43 smithi156 ceph-mon[130574]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:44.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:43 smithi073 ceph-mon[128869]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:45.057 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:44 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:45.057 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:44 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:45.057 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:44 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:49:45.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:44 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:45.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:44 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:45.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:44 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:49:45.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:44 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:45.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:44 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:45.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:44 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:49:46.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:45 smithi152 ceph-mon[130220]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:46.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:45 smithi156 ceph-mon[130574]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:46.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:45 smithi073 ceph-mon[128869]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:46.810 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 10 on host 'smithi152' 2023-08-10T11:49:46.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:46.808+0000 7f97037fe700 1 -- 172.21.15.152:0/626471954 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f9714060bb0 con 0x7f96fc0a1150 2023-08-10T11:49:46.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:46.811+0000 7f9718f18700 1 -- 172.21.15.152:0/626471954 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f96fc0a1150 msgr2=0x7f96fc0a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:49:46.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:46.811+0000 7f9718f18700 1 --2- 172.21.15.152:0/626471954 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f96fc0a1150 0x7f96fc0a3610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9704009a10 tx=0x7f9704009190 comp rx=0 tx=0).stop 2023-08-10T11:49:46.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:46.811+0000 7f9718f18700 1 -- 172.21.15.152:0/626471954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9714100820 msgr2=0x7f97141965b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:49:46.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:46.811+0000 7f9718f18700 1 --2- 172.21.15.152:0/626471954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9714100820 0x7f97141965b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f970800c990 tx=0x7f970800cca0 comp rx=0 tx=0).stop 2023-08-10T11:49:46.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:46.811+0000 7f9718f18700 1 -- 172.21.15.152:0/626471954 shutdown_connections 2023-08-10T11:49:46.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:46.811+0000 7f9718f18700 1 --2- 172.21.15.152:0/626471954 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f96fc0a1150 0x7f96fc0a3610 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:49:46.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:46.811+0000 7f9718f18700 1 --2- 172.21.15.152:0/626471954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9714100820 0x7f97141965b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:49:46.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:46.811+0000 7f9718f18700 1 --2- 172.21.15.152:0/626471954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97141023c0 0x7f971419db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:49:46.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:46.811+0000 7f9718f18700 1 --2- 172.21.15.152:0/626471954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9714101a20 0x7f9714196af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:49:46.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:46.811+0000 7f9718f18700 1 -- 172.21.15.152:0/626471954 >> 172.21.15.152:0/626471954 conn(0x7f97140fbd80 msgr2=0x7f9714104e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:49:46.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:46.812+0000 7f9718f18700 1 -- 172.21.15.152:0/626471954 shutdown_connections 2023-08-10T11:49:46.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-08-10T11:49:46.812+0000 7f9718f18700 1 -- 172.21.15.152:0/626471954 wait complete. 2023-08-10T11:49:47.274 DEBUG:teuthology.orchestra.run.smithi152:osd.10> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@osd.10.service 2023-08-10T11:49:47.276 INFO:tasks.cephadm:Deploying osd.11 on smithi156 with /dev/vg_nvme/lv_1... 2023-08-10T11:49:47.277 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-08-10T11:49:47.305 INFO:journalctl@ceph.osd.10.smithi152.stdout:-- Logs begin at Thu 2023-08-10 11:15:14 UTC. -- 2023-08-10T11:49:47.737 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:47.737 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:47.738 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:47.738 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:49:47.738 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:47.738 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:47 smithi152 ceph-mon[130220]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:47.738 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:47.738 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:47.738 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:49:47.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:47.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:47.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:47.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:49:47.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:47.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:47 smithi156 ceph-mon[130574]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:47.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:47.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:47.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:49:47.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:47.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:47.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:47.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:49:47.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:47.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:47 smithi073 ceph-mon[128869]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:47.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:47.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:47.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:49:47.843 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T11:49:47.995 INFO:journalctl@ceph.osd.10.smithi152.stdout:Aug 10 11:49:47 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-10[151826]: 2023-08-10T11:49:47.841+0000 7f2d782cc640 -1 osd.10 0 log_to_monitors true 2023-08-10T11:49:48.716 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:48 smithi152 ceph-mon[130220]: from='osd.10 [v2:172.21.15.152:6824/1513186350,v1:172.21.15.152:6825/1513186350]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-08-10T11:49:48.716 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:48 smithi152 ceph-mon[130220]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-08-10T11:49:48.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:48 smithi156 ceph-mon[130574]: from='osd.10 [v2:172.21.15.152:6824/1513186350,v1:172.21.15.152:6825/1513186350]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-08-10T11:49:48.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:48 smithi156 ceph-mon[130574]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-08-10T11:49:48.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:48 smithi073 ceph-mon[128869]: from='osd.10 [v2:172.21.15.152:6824/1513186350,v1:172.21.15.152:6825/1513186350]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-08-10T11:49:48.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:48 smithi073 ceph-mon[128869]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-08-10T11:49:49.482 INFO:journalctl@ceph.osd.10.smithi152.stdout:Aug 10 11:49:49 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-10[151826]: 2023-08-10T11:49:49.465+0000 7f2d6d143700 -1 osd.10 0 waiting for initial osdmap 2023-08-10T11:49:49.482 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:49 smithi152 ceph-mon[130220]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-08-10T11:49:49.482 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:49 smithi152 ceph-mon[130220]: osdmap e68: 11 total, 10 up, 11 in 2023-08-10T11:49:49.483 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:49 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T11:49:49.483 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:49 smithi152 ceph-mon[130220]: from='osd.10 [v2:172.21.15.152:6824/1513186350,v1:172.21.15.152:6825/1513186350]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-08-10T11:49:49.483 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:49 smithi152 ceph-mon[130220]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-08-10T11:49:49.483 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:49 smithi152 ceph-mon[130220]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:49.527 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-08-10T11:49:49.527 INFO:teuthology.orchestra.run.smithi156.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-08-10T11:49:49.527 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10+0 records in 2023-08-10T11:49:49.528 INFO:teuthology.orchestra.run.smithi156.stderr:10+0 records out 2023-08-10T11:49:49.528 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00804665 s, 1.3 GB/s 2023-08-10T11:49:49.528 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping successful for: 2023-08-10T11:49:49.745 INFO:journalctl@ceph.osd.10.smithi152.stdout:Aug 10 11:49:49 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-10[151826]: 2023-08-10T11:49:49.480+0000 7f2d67f36700 -1 osd.10 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T11:49:49.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:49 smithi156 ceph-mon[130574]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-08-10T11:49:49.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:49 smithi156 ceph-mon[130574]: osdmap e68: 11 total, 10 up, 11 in 2023-08-10T11:49:49.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:49 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T11:49:49.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:49 smithi156 ceph-mon[130574]: from='osd.10 [v2:172.21.15.152:6824/1513186350,v1:172.21.15.152:6825/1513186350]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-08-10T11:49:49.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:49 smithi156 ceph-mon[130574]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-08-10T11:49:49.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:49 smithi156 ceph-mon[130574]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:49.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:49 smithi073 ceph-mon[128869]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-08-10T11:49:49.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:49 smithi073 ceph-mon[128869]: osdmap e68: 11 total, 10 up, 11 in 2023-08-10T11:49:49.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:49 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T11:49:49.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:49 smithi073 ceph-mon[128869]: from='osd.10 [v2:172.21.15.152:6824/1513186350,v1:172.21.15.152:6825/1513186350]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-08-10T11:49:49.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:49 smithi073 ceph-mon[128869]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-08-10T11:49:49.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:49 smithi073 ceph-mon[128869]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:49.988 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi156:vg_nvme/lv_1 2023-08-10T11:49:50.539 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T11:49:50.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:50 smithi152 ceph-mon[130220]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-08-10T11:49:50.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:50 smithi152 ceph-mon[130220]: osdmap e69: 11 total, 10 up, 11 in 2023-08-10T11:49:50.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:50 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T11:49:50.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:50 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T11:49:50.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:50 smithi152 ceph-mon[130220]: Detected new or changed devices on smithi152 2023-08-10T11:49:50.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:50 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:50.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:50 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:50.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:50 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:50.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:50 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:50.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:50 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:50.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:50 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:50.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:50 smithi152 ceph-mon[130220]: Adjusting osd_memory_target on smithi152 to 4292M 2023-08-10T11:49:50.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:50 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:50.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:50 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:50.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:50 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:49:50.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:50 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:50.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:50 smithi152 ceph-mon[130220]: osd.10 [v2:172.21.15.152:6824/1513186350,v1:172.21.15.152:6825/1513186350] boot 2023-08-10T11:49:50.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:50 smithi152 ceph-mon[130220]: osdmap e70: 11 total, 11 up, 11 in 2023-08-10T11:49:50.748 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:50 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T11:49:50.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:50 smithi156 ceph-mon[130574]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-08-10T11:49:50.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:50 smithi156 ceph-mon[130574]: osdmap e69: 11 total, 10 up, 11 in 2023-08-10T11:49:50.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:50 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T11:49:50.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:50 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T11:49:50.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:50 smithi156 ceph-mon[130574]: Detected new or changed devices on smithi152 2023-08-10T11:49:50.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:50 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:50.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:50 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:50.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:50 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:50.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:50 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:50.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:50 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:50.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:50 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:50.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:50 smithi156 ceph-mon[130574]: Adjusting osd_memory_target on smithi152 to 4292M 2023-08-10T11:49:50.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:50 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:50.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:50 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:50.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:50 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:49:50.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:50 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:50.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:50 smithi156 ceph-mon[130574]: osd.10 [v2:172.21.15.152:6824/1513186350,v1:172.21.15.152:6825/1513186350] boot 2023-08-10T11:49:50.758 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:50 smithi156 ceph-mon[130574]: osdmap e70: 11 total, 11 up, 11 in 2023-08-10T11:49:50.758 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:50 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T11:49:50.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:50 smithi073 ceph-mon[128869]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-08-10T11:49:50.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:50 smithi073 ceph-mon[128869]: osdmap e69: 11 total, 10 up, 11 in 2023-08-10T11:49:50.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:50 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T11:49:50.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:50 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T11:49:50.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:50 smithi073 ceph-mon[128869]: Detected new or changed devices on smithi152 2023-08-10T11:49:50.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:50 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:50.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:50 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:50.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:50 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:50.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:50 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:50.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:50 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:50.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:50 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:49:50.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:50 smithi073 ceph-mon[128869]: Adjusting osd_memory_target on smithi152 to 4292M 2023-08-10T11:49:50.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:50 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:50.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:50 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:50.770 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:50 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:49:50.770 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:50 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:49:50.770 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:50 smithi073 ceph-mon[128869]: osd.10 [v2:172.21.15.152:6824/1513186350,v1:172.21.15.152:6825/1513186350] boot 2023-08-10T11:49:50.770 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:50 smithi073 ceph-mon[128869]: osdmap e70: 11 total, 11 up, 11 in 2023-08-10T11:49:50.770 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:50 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T11:49:51.693 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:51 smithi156 ceph-mon[130574]: purged_snaps scrub starts 2023-08-10T11:49:51.694 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:51 smithi156 ceph-mon[130574]: purged_snaps scrub ok 2023-08-10T11:49:51.694 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:51 smithi156 ceph-mon[130574]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:51.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:51 smithi152 ceph-mon[130220]: purged_snaps scrub starts 2023-08-10T11:49:51.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:51 smithi152 ceph-mon[130220]: purged_snaps scrub ok 2023-08-10T11:49:51.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:51 smithi152 ceph-mon[130220]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:51.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:51 smithi073 ceph-mon[128869]: purged_snaps scrub starts 2023-08-10T11:49:51.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:51 smithi073 ceph-mon[128869]: purged_snaps scrub ok 2023-08-10T11:49:51.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:51 smithi073 ceph-mon[128869]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-08-10T11:49:51.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.918+0000 7f79ef698700 1 -- 172.21.15.156:0/2722415650 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79e80ff700 msgr2=0x7f79e80ffb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:49:51.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.918+0000 7f79ef698700 1 --2- 172.21.15.156:0/2722415650 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79e80ff700 0x7f79e80ffb20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009990 tx=0x7f79d8009ca0 comp rx=0 tx=0).stop 2023-08-10T11:49:51.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.919+0000 7f79ef698700 1 -- 172.21.15.156:0/2722415650 shutdown_connections 2023-08-10T11:49:51.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.919+0000 7f79ef698700 1 --2- 172.21.15.156:0/2722415650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e81012a0 0x7f79e8107b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:49:51.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.919+0000 7f79ef698700 1 --2- 172.21.15.156:0/2722415650 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79e80ff700 0x7f79e80ffb20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:49:51.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.919+0000 7f79ef698700 1 --2- 172.21.15.156:0/2722415650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79e8100900 0x7f79e8100d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:49:51.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.919+0000 7f79ef698700 1 -- 172.21.15.156:0/2722415650 >> 172.21.15.156:0/2722415650 conn(0x7f79e80fac80 msgr2=0x7f79e80fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:49:51.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.919+0000 7f79ef698700 1 -- 172.21.15.156:0/2722415650 shutdown_connections 2023-08-10T11:49:51.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.919+0000 7f79ef698700 1 -- 172.21.15.156:0/2722415650 wait complete. 2023-08-10T11:49:51.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.919+0000 7f79ef698700 1 Processor -- start 2023-08-10T11:49:51.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.919+0000 7f79ef698700 1 -- start start 2023-08-10T11:49:51.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.919+0000 7f79ef698700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e80ff700 0x7f79e81953d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:49:51.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.919+0000 7f79ef698700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79e8100900 0x7f79e8195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:49:51.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.919+0000 7f79ef698700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79e81012a0 0x7f79e819c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:49:51.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.919+0000 7f79ef698700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e819cf60 con 0x7f79e80ff700 2023-08-10T11:49:51.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.919+0000 7f79ef698700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e819d0a0 con 0x7f79e81012a0 2023-08-10T11:49:51.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.919+0000 7f79ef698700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e819d230 con 0x7f79e8100900 2023-08-10T11:49:51.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.920+0000 7f79ecc33700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79e8100900 0x7f79e8195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:49:51.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.920+0000 7f79ecc33700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79e8100900 0x7f79e8195910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:37052/0 (socket says 172.21.15.156:37052) 2023-08-10T11:49:51.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.920+0000 7f79ecc33700 1 -- 172.21.15.156:0/2314586990 learned_addr learned my addr 172.21.15.156:0/2314586990 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-08-10T11:49:51.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.920+0000 7f79ed434700 1 --2- 172.21.15.156:0/2314586990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e80ff700 0x7f79e81953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:49:51.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.920+0000 7f79edc35700 1 --2- 172.21.15.156:0/2314586990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79e81012a0 0x7f79e819c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:49:51.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.920+0000 7f79ecc33700 1 -- 172.21.15.156:0/2314586990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79e81012a0 msgr2=0x7f79e819c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:49:51.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.920+0000 7f79ecc33700 1 --2- 172.21.15.156:0/2314586990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79e81012a0 0x7f79e819c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:49:51.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.920+0000 7f79ecc33700 1 -- 172.21.15.156:0/2314586990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e80ff700 msgr2=0x7f79e81953d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:49:51.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.920+0000 7f79ecc33700 1 --2- 172.21.15.156:0/2314586990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e80ff700 0x7f79e81953d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:49:51.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.920+0000 7f79ecc33700 1 -- 172.21.15.156:0/2314586990 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d80095f0 con 0x7f79e8100900 2023-08-10T11:49:51.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.920+0000 7f79ed434700 1 --2- 172.21.15.156:0/2314586990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e80ff700 0x7f79e81953d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:49:51.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.920+0000 7f79ecc33700 1 --2- 172.21.15.156:0/2314586990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79e8100900 0x7f79e8195910 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f79e4007b80 tx=0x7f79e4007f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:49:51.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.920+0000 7f79de7fc700 1 -- 172.21.15.156:0/2314586990 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4011070 con 0x7f79e8100900 2023-08-10T11:49:51.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.920+0000 7f79de7fc700 1 -- 172.21.15.156:0/2314586990 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f79e400c2e0 con 0x7f79e8100900 2023-08-10T11:49:51.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.920+0000 7f79ef698700 1 -- 172.21.15.156:0/2314586990 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e8068b20 con 0x7f79e8100900 2023-08-10T11:49:51.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.920+0000 7f79de7fc700 1 -- 172.21.15.156:0/2314586990 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e400e600 con 0x7f79e8100900 2023-08-10T11:49:51.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.920+0000 7f79ef698700 1 -- 172.21.15.156:0/2314586990 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e8069020 con 0x7f79e8100900 2023-08-10T11:49:51.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.921+0000 7f79ef698700 1 -- 172.21.15.156:0/2314586990 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e810af00 con 0x7f79e8100900 2023-08-10T11:49:51.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.922+0000 7f79de7fc700 1 -- 172.21.15.156:0/2314586990 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f79e4004750 con 0x7f79e8100900 2023-08-10T11:49:51.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.923+0000 7f79de7fc700 1 --2- 172.21.15.156:0/2314586990 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f79d40a1150 0x7f79d40a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:49:51.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.923+0000 7f79de7fc700 1 -- 172.21.15.156:0/2314586990 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6723+0+0 (secure 0 0 0) 0x7f79e40cdbe0 con 0x7f79e8100900 2023-08-10T11:49:51.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.923+0000 7f79ed434700 1 --2- 172.21.15.156:0/2314586990 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f79d40a1150 0x7f79d40a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:49:51.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.924+0000 7f79ed434700 1 --2- 172.21.15.156:0/2314586990 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f79d40a1150 0x7f79d40a3610 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f79d80036f0 tx=0x7f79d8003680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:49:51.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:51.926+0000 7f79de7fc700 1 -- 172.21.15.156:0/2314586990 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f79e40979f0 con 0x7f79e8100900 2023-08-10T11:49:52.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:49:52.122+0000 7f79ef698700 1 -- 172.21.15.156:0/2314586990 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f79e8069240 con 0x7f79d40a1150 2023-08-10T11:49:52.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:52 smithi152 ceph-mon[130220]: osdmap e71: 11 total, 11 up, 11 in 2023-08-10T11:49:52.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:52 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:49:52.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:52 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:49:52.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:52 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:52.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:52 smithi152 ceph-mon[130220]: osdmap e72: 11 total, 11 up, 11 in 2023-08-10T11:49:52.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:52 smithi156 ceph-mon[130574]: osdmap e71: 11 total, 11 up, 11 in 2023-08-10T11:49:52.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:52 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:49:52.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:52 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:49:52.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:52 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:52.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:52 smithi156 ceph-mon[130574]: osdmap e72: 11 total, 11 up, 11 in 2023-08-10T11:49:52.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:52 smithi073 ceph-mon[128869]: osdmap e71: 11 total, 11 up, 11 in 2023-08-10T11:49:52.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:52 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T11:49:52.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:52 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T11:49:52.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:52 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:49:52.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:52 smithi073 ceph-mon[128869]: osdmap e72: 11 total, 11 up, 11 in 2023-08-10T11:49:53.522 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:53 smithi156 ceph-mon[130574]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:49:53.523 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:53 smithi156 ceph-mon[130574]: pgmap v213: 1 pgs: 1 remapped+peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-10T11:49:53.523 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:53 smithi156 ceph-mon[130574]: osdmap e73: 11 total, 11 up, 11 in 2023-08-10T11:49:53.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:53 smithi152 ceph-mon[130220]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:49:53.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:53 smithi152 ceph-mon[130220]: pgmap v213: 1 pgs: 1 remapped+peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-10T11:49:53.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:53 smithi152 ceph-mon[130220]: osdmap e73: 11 total, 11 up, 11 in 2023-08-10T11:49:53.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:53 smithi073 ceph-mon[128869]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:49:53.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:53 smithi073 ceph-mon[128869]: pgmap v213: 1 pgs: 1 remapped+peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-10T11:49:53.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:53 smithi073 ceph-mon[128869]: osdmap e73: 11 total, 11 up, 11 in 2023-08-10T11:49:55.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:55 smithi152 ceph-mon[130220]: pgmap v216: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-08-10T11:49:55.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:55 smithi152 ceph-mon[130220]: osdmap e74: 11 total, 11 up, 11 in 2023-08-10T11:49:55.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:55 smithi152 ceph-mon[130220]: from='client.? 172.21.15.156:0/508168077' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1b55889-14fd-4cc9-bed7-43748086fb77"}]: dispatch 2023-08-10T11:49:55.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:55 smithi152 ceph-mon[130220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1b55889-14fd-4cc9-bed7-43748086fb77"}]: dispatch 2023-08-10T11:49:55.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:55 smithi152 ceph-mon[130220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1b55889-14fd-4cc9-bed7-43748086fb77"}]': finished 2023-08-10T11:49:55.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:55 smithi152 ceph-mon[130220]: osdmap e75: 12 total, 11 up, 12 in 2023-08-10T11:49:55.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:55 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T11:49:55.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:55 smithi152 ceph-mon[130220]: from='client.? 172.21.15.156:0/2190371654' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:49:55.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:55 smithi156 ceph-mon[130574]: pgmap v216: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-08-10T11:49:55.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:55 smithi156 ceph-mon[130574]: osdmap e74: 11 total, 11 up, 11 in 2023-08-10T11:49:55.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:55 smithi156 ceph-mon[130574]: from='client.? 172.21.15.156:0/508168077' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1b55889-14fd-4cc9-bed7-43748086fb77"}]: dispatch 2023-08-10T11:49:55.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:55 smithi156 ceph-mon[130574]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1b55889-14fd-4cc9-bed7-43748086fb77"}]: dispatch 2023-08-10T11:49:55.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:55 smithi156 ceph-mon[130574]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1b55889-14fd-4cc9-bed7-43748086fb77"}]': finished 2023-08-10T11:49:55.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:55 smithi156 ceph-mon[130574]: osdmap e75: 12 total, 11 up, 12 in 2023-08-10T11:49:55.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:55 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T11:49:55.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:55 smithi156 ceph-mon[130574]: from='client.? 172.21.15.156:0/2190371654' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:49:55.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:55 smithi073 ceph-mon[128869]: pgmap v216: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-08-10T11:49:55.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:55 smithi073 ceph-mon[128869]: osdmap e74: 11 total, 11 up, 11 in 2023-08-10T11:49:55.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:55 smithi073 ceph-mon[128869]: from='client.? 172.21.15.156:0/508168077' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1b55889-14fd-4cc9-bed7-43748086fb77"}]: dispatch 2023-08-10T11:49:55.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:55 smithi073 ceph-mon[128869]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1b55889-14fd-4cc9-bed7-43748086fb77"}]: dispatch 2023-08-10T11:49:55.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:55 smithi073 ceph-mon[128869]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1b55889-14fd-4cc9-bed7-43748086fb77"}]': finished 2023-08-10T11:49:55.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:55 smithi073 ceph-mon[128869]: osdmap e75: 12 total, 11 up, 12 in 2023-08-10T11:49:55.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:55 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T11:49:55.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:55 smithi073 ceph-mon[128869]: from='client.? 172.21.15.156:0/2190371654' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T11:49:57.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:57 smithi152 ceph-mon[130220]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-08-10T11:49:57.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:57 smithi156 ceph-mon[130574]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-08-10T11:49:57.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:57 smithi073 ceph-mon[128869]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-08-10T11:49:59.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:49:59 smithi156 ceph-mon[130574]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-08-10T11:49:59.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:49:59 smithi073 ceph-mon[128869]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-08-10T11:49:59.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:49:59 smithi152 ceph-mon[130220]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-08-10T11:50:00.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:00 smithi156 ceph-mon[130574]: overall HEALTH_OK 2023-08-10T11:50:00.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:00 smithi073 ceph-mon[128869]: overall HEALTH_OK 2023-08-10T11:50:00.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:00 smithi152 ceph-mon[130220]: overall HEALTH_OK 2023-08-10T11:50:01.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:01 smithi156 ceph-mon[130574]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-08-10T11:50:01.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:01 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-08-10T11:50:01.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:01 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:01.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:01 smithi073 ceph-mon[128869]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-08-10T11:50:01.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:01 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-08-10T11:50:01.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:01 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:01.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:01 smithi152 ceph-mon[130220]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-08-10T11:50:01.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:01 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-08-10T11:50:01.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:01 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:02.563 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:02 smithi156 ceph-mon[130574]: Deploying daemon osd.11 on smithi156 2023-08-10T11:50:02.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:02 smithi073 ceph-mon[128869]: Deploying daemon osd.11 on smithi156 2023-08-10T11:50:02.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:02 smithi152 ceph-mon[130220]: Deploying daemon osd.11 on smithi156 2023-08-10T11:50:03.685 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:03 smithi156 ceph-mon[130574]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-08-10T11:50:03.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:03 smithi073 ceph-mon[128869]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-08-10T11:50:03.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:03 smithi152 ceph-mon[130220]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-08-10T11:50:05.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:05 smithi073 ceph-mon[128869]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-08-10T11:50:05.834 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:05 smithi156 ceph-mon[130574]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-08-10T11:50:05.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:05 smithi152 ceph-mon[130220]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-08-10T11:50:07.252 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:07 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:07.252 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:07 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:50:07.252 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:07 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:07.253 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:07 smithi156 ceph-mon[130574]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2023-08-10T11:50:07.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:07 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:07.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:07 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:50:07.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:07 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:07.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:07 smithi152 ceph-mon[130220]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2023-08-10T11:50:07.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:07 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:07.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:07 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:50:07.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:07 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:07.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:07 smithi073 ceph-mon[128869]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2023-08-10T11:50:08.939 INFO:teuthology.orchestra.run.smithi156.stdout:Created osd(s) 11 on host 'smithi156' 2023-08-10T11:50:08.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:08.937+0000 7f79de7fc700 1 -- 172.21.15.156:0/2314586990 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f79e8069240 con 0x7f79d40a1150 2023-08-10T11:50:08.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:08.939+0000 7f79ef698700 1 -- 172.21.15.156:0/2314586990 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f79d40a1150 msgr2=0x7f79d40a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:08.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:08.939+0000 7f79ef698700 1 --2- 172.21.15.156:0/2314586990 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f79d40a1150 0x7f79d40a3610 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f79d80036f0 tx=0x7f79d8003680 comp rx=0 tx=0).stop 2023-08-10T11:50:08.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:08.939+0000 7f79ef698700 1 -- 172.21.15.156:0/2314586990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79e8100900 msgr2=0x7f79e8195910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:08.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:08.939+0000 7f79ef698700 1 --2- 172.21.15.156:0/2314586990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79e8100900 0x7f79e8195910 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f79e4007b80 tx=0x7f79e4007f40 comp rx=0 tx=0).stop 2023-08-10T11:50:08.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:08.940+0000 7f79ef698700 1 -- 172.21.15.156:0/2314586990 shutdown_connections 2023-08-10T11:50:08.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:08.940+0000 7f79ef698700 1 --2- 172.21.15.156:0/2314586990 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f79d40a1150 0x7f79d40a3610 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:08.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:08.940+0000 7f79ef698700 1 --2- 172.21.15.156:0/2314586990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79e81012a0 0x7f79e819c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:08.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:08.940+0000 7f79ef698700 1 --2- 172.21.15.156:0/2314586990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e80ff700 0x7f79e81953d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:08.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:08.940+0000 7f79ef698700 1 --2- 172.21.15.156:0/2314586990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79e8100900 0x7f79e8195910 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:08.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:08.940+0000 7f79ef698700 1 -- 172.21.15.156:0/2314586990 >> 172.21.15.156:0/2314586990 conn(0x7f79e80fac80 msgr2=0x7f79e8103e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:08.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:08.940+0000 7f79ef698700 1 -- 172.21.15.156:0/2314586990 shutdown_connections 2023-08-10T11:50:08.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:08.940+0000 7f79ef698700 1 -- 172.21.15.156:0/2314586990 wait complete. 2023-08-10T11:50:09.725 DEBUG:teuthology.orchestra.run.smithi156:osd.11> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@osd.11.service 2023-08-10T11:50:09.727 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-08-10T11:50:09.728 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph osd stat -f json 2023-08-10T11:50:09.762 INFO:journalctl@ceph.osd.11.smithi156.stdout:-- Logs begin at Thu 2023-08-10 11:15:12 UTC. -- 2023-08-10T11:50:10.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:09 smithi156 ceph-mon[130574]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-08-10T11:50:10.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:09 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:10.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:09 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:10.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:09 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:10.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:09 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:10.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:09 smithi073 ceph-mon[128869]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-08-10T11:50:10.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:09 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:10.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:09 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:10.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:09 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:10.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:09 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:10.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:09 smithi152 ceph-mon[130220]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-08-10T11:50:10.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:09 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:10.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:09 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:10.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:09 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:10.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:09 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:10.290 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:50:10.383 INFO:journalctl@ceph.osd.11.smithi156.stdout:Aug 10 11:50:10 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-11[152981]: 2023-08-10T11:50:10.033+0000 7fef6b6c4640 -1 osd.11 0 log_to_monitors true 2023-08-10T11:50:11.098 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:10 smithi073 ceph-mon[128869]: from='osd.11 [v2:172.21.15.156:6824/737904755,v1:172.21.15.156:6825/737904755]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-08-10T11:50:11.099 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:10 smithi073 ceph-mon[128869]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-08-10T11:50:11.117 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:10 smithi156 ceph-mon[130574]: from='osd.11 [v2:172.21.15.156:6824/737904755,v1:172.21.15.156:6825/737904755]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-08-10T11:50:11.117 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:10 smithi156 ceph-mon[130574]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-08-10T11:50:11.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:10 smithi152 ceph-mon[130220]: from='osd.11 [v2:172.21.15.156:6824/737904755,v1:172.21.15.156:6825/737904755]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-08-10T11:50:11.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:10 smithi152 ceph-mon[130220]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-08-10T11:50:11.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.481+0000 7f8fc18ef700 1 -- 172.21.15.73:0/1260029285 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fbc101300 msgr2=0x7f8fbc107bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:11.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.481+0000 7f8fc18ef700 1 --2- 172.21.15.73:0/1260029285 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fbc101300 0x7f8fbc107bb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400b0d0 tx=0x7f8fb400b3e0 comp rx=0 tx=0).stop 2023-08-10T11:50:11.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.481+0000 7f8fc18ef700 1 -- 172.21.15.73:0/1260029285 shutdown_connections 2023-08-10T11:50:11.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.481+0000 7f8fc18ef700 1 --2- 172.21.15.73:0/1260029285 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fbc101300 0x7f8fbc107bb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:11.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.481+0000 7f8fc18ef700 1 --2- 172.21.15.73:0/1260029285 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8fbc0ff760 0x7f8fbc0ffb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:11.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.481+0000 7f8fc18ef700 1 --2- 172.21.15.73:0/1260029285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fbc100960 0x7f8fbc100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:11.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.481+0000 7f8fc18ef700 1 -- 172.21.15.73:0/1260029285 >> 172.21.15.73:0/1260029285 conn(0x7f8fbc0fad00 msgr2=0x7f8fbc0fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:11.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.481+0000 7f8fc18ef700 1 -- 172.21.15.73:0/1260029285 shutdown_connections 2023-08-10T11:50:11.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.481+0000 7f8fc18ef700 1 -- 172.21.15.73:0/1260029285 wait complete. 2023-08-10T11:50:11.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.481+0000 7f8fc18ef700 1 Processor -- start 2023-08-10T11:50:11.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.482+0000 7f8fc18ef700 1 -- start start 2023-08-10T11:50:11.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.482+0000 7f8fc18ef700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fbc0ff760 0x7f8fbc069710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:11.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.482+0000 7f8fc18ef700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fbc100960 0x7f8fbc19b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:11.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.482+0000 7f8fc18ef700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8fbc101300 0x7f8fbc19db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:11.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.482+0000 7f8fc18ef700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fbc19e2c0 con 0x7f8fbc100960 2023-08-10T11:50:11.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.482+0000 7f8fc18ef700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fbc19e430 con 0x7f8fbc0ff760 2023-08-10T11:50:11.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.482+0000 7f8fc18ef700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fbc19e5f0 con 0x7f8fbc101300 2023-08-10T11:50:11.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.482+0000 7f8fba7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fbc100960 0x7f8fbc19b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:11.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.482+0000 7f8fba7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fbc100960 0x7f8fbc19b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58534/0 (socket says 172.21.15.73:58534) 2023-08-10T11:50:11.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.482+0000 7f8fba7fc700 1 -- 172.21.15.73:0/1145730883 learned_addr learned my addr 172.21.15.73:0/1145730883 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:11.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.482+0000 7f8fbb7fe700 1 --2- 172.21.15.73:0/1145730883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8fbc101300 0x7f8fbc19db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:11.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.482+0000 7f8fbaffd700 1 --2- 172.21.15.73:0/1145730883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fbc0ff760 0x7f8fbc069710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:11.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.482+0000 7f8fba7fc700 1 -- 172.21.15.73:0/1145730883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8fbc101300 msgr2=0x7f8fbc19db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:11.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.482+0000 7f8fba7fc700 1 --2- 172.21.15.73:0/1145730883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8fbc101300 0x7f8fbc19db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:11.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.482+0000 7f8fba7fc700 1 -- 172.21.15.73:0/1145730883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fbc0ff760 msgr2=0x7f8fbc069710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:11.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.482+0000 7f8fba7fc700 1 --2- 172.21.15.73:0/1145730883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fbc0ff760 0x7f8fbc069710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:11.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.482+0000 7f8fba7fc700 1 -- 172.21.15.73:0/1145730883 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb4009d00 con 0x7f8fbc100960 2023-08-10T11:50:11.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.482+0000 7f8fbb7fe700 1 --2- 172.21.15.73:0/1145730883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8fbc101300 0x7f8fbc19db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:50:11.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.482+0000 7f8fbaffd700 1 --2- 172.21.15.73:0/1145730883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fbc0ff760 0x7f8fbc069710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:50:11.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.482+0000 7f8fba7fc700 1 --2- 172.21.15.73:0/1145730883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fbc100960 0x7f8fbc19b4d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00b530 tx=0x7f8fac00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:11.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.482+0000 7f8fc08ed700 1 -- 172.21.15.73:0/1145730883 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac011830 con 0x7f8fbc100960 2023-08-10T11:50:11.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.482+0000 7f8fc08ed700 1 -- 172.21.15.73:0/1145730883 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8fac011e50 con 0x7f8fbc100960 2023-08-10T11:50:11.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.482+0000 7f8fc18ef700 1 -- 172.21.15.73:0/1145730883 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fbc19e8d0 con 0x7f8fbc100960 2023-08-10T11:50:11.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.482+0000 7f8fc08ed700 1 -- 172.21.15.73:0/1145730883 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac00f2e0 con 0x7f8fbc100960 2023-08-10T11:50:11.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.483+0000 7f8fc18ef700 1 -- 172.21.15.73:0/1145730883 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fbc19ee50 con 0x7f8fbc100960 2023-08-10T11:50:11.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.483+0000 7f8fc18ef700 1 -- 172.21.15.73:0/1145730883 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fbc106d60 con 0x7f8fbc100960 2023-08-10T11:50:11.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.484+0000 7f8fc08ed700 1 -- 172.21.15.73:0/1145730883 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f8fac010580 con 0x7f8fbc100960 2023-08-10T11:50:11.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.485+0000 7f8fc08ed700 1 --2- 172.21.15.73:0/1145730883 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8fa40a1150 0x7f8fa40a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:11.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.485+0000 7f8fbaffd700 1 --2- 172.21.15.73:0/1145730883 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8fa40a1150 0x7f8fa40a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:11.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.485+0000 7f8fc08ed700 1 -- 172.21.15.73:0/1145730883 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6831+0+0 (secure 0 0 0) 0x7f8fac0cc420 con 0x7f8fbc100960 2023-08-10T11:50:11.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.486+0000 7f8fbaffd700 1 --2- 172.21.15.73:0/1145730883 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8fa40a1150 0x7f8fa40a3610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc1007c0 tx=0x7f8fb0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:11.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.489+0000 7f8fc08ed700 1 -- 172.21.15.73:0/1145730883 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8fac096120 con 0x7f8fbc100960 2023-08-10T11:50:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.676+0000 7f8fc18ef700 1 -- 172.21.15.73:0/1145730883 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f8fbc02cb80 con 0x7f8fbc100960 2023-08-10T11:50:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.677+0000 7f8fc08ed700 1 -- 172.21.15.73:0/1145730883 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) v1 ==== 74+0+133 (secure 0 0 0) 0x7f8fac099740 con 0x7f8fbc100960 2023-08-10T11:50:11.679 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:50:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.678+0000 7f8fc18ef700 1 -- 172.21.15.73:0/1145730883 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8fa40a1150 msgr2=0x7f8fa40a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.678+0000 7f8fc18ef700 1 --2- 172.21.15.73:0/1145730883 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8fa40a1150 0x7f8fa40a3610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc1007c0 tx=0x7f8fb0008040 comp rx=0 tx=0).stop 2023-08-10T11:50:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.678+0000 7f8fc18ef700 1 -- 172.21.15.73:0/1145730883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fbc100960 msgr2=0x7f8fbc19b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:11.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.678+0000 7f8fc18ef700 1 --2- 172.21.15.73:0/1145730883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fbc100960 0x7f8fbc19b4d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00b530 tx=0x7f8fac00b8f0 comp rx=0 tx=0).stop 2023-08-10T11:50:11.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.679+0000 7f8fc18ef700 1 -- 172.21.15.73:0/1145730883 shutdown_connections 2023-08-10T11:50:11.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.679+0000 7f8fc18ef700 1 --2- 172.21.15.73:0/1145730883 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8fa40a1150 0x7f8fa40a3610 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:11.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.679+0000 7f8fc18ef700 1 --2- 172.21.15.73:0/1145730883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fbc0ff760 0x7f8fbc069710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:11.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.679+0000 7f8fc18ef700 1 --2- 172.21.15.73:0/1145730883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8fbc101300 0x7f8fbc19db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:11.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.679+0000 7f8fc18ef700 1 --2- 172.21.15.73:0/1145730883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fbc100960 0x7f8fbc19b4d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:11.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.679+0000 7f8fc18ef700 1 -- 172.21.15.73:0/1145730883 >> 172.21.15.73:0/1145730883 conn(0x7f8fbc0fad00 msgr2=0x7f8fbc103ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:11.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.679+0000 7f8fc18ef700 1 -- 172.21.15.73:0/1145730883 shutdown_connections 2023-08-10T11:50:11.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:11.679+0000 7f8fc18ef700 1 -- 172.21.15.73:0/1145730883 wait complete. 2023-08-10T11:50:11.936 INFO:journalctl@ceph.osd.11.smithi156.stdout:Aug 10 11:50:11 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-11[152981]: 2023-08-10T11:50:11.918+0000 7fef6053b700 -1 osd.11 0 waiting for initial osdmap 2023-08-10T11:50:11.937 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:11 smithi156 ceph-mon[130574]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-08-10T11:50:11.937 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:11 smithi156 ceph-mon[130574]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-08-10T11:50:11.937 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:11 smithi156 ceph-mon[130574]: osdmap e76: 12 total, 11 up, 12 in 2023-08-10T11:50:11.937 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:11 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T11:50:11.937 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:11 smithi156 ceph-mon[130574]: from='osd.11 [v2:172.21.15.156:6824/737904755,v1:172.21.15.156:6825/737904755]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-08-10T11:50:11.938 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:11 smithi156 ceph-mon[130574]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-08-10T11:50:11.938 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:11 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1145730883' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-08-10T11:50:12.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:11 smithi073 ceph-mon[128869]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-08-10T11:50:12.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:11 smithi073 ceph-mon[128869]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-08-10T11:50:12.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:11 smithi073 ceph-mon[128869]: osdmap e76: 12 total, 11 up, 12 in 2023-08-10T11:50:12.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:11 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T11:50:12.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:11 smithi073 ceph-mon[128869]: from='osd.11 [v2:172.21.15.156:6824/737904755,v1:172.21.15.156:6825/737904755]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-08-10T11:50:12.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:11 smithi073 ceph-mon[128869]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-08-10T11:50:12.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:11 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1145730883' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-08-10T11:50:12.044 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":76,"num_osds":12,"num_up_osds":11,"osd_up_since":1691668190,"num_in_osds":12,"osd_in_since":1691668194,"num_remapped_pgs":0} 2023-08-10T11:50:12.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:11 smithi152 ceph-mon[130220]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-08-10T11:50:12.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:11 smithi152 ceph-mon[130220]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-08-10T11:50:12.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:11 smithi152 ceph-mon[130220]: osdmap e76: 12 total, 11 up, 12 in 2023-08-10T11:50:12.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:11 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T11:50:12.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:11 smithi152 ceph-mon[130220]: from='osd.11 [v2:172.21.15.156:6824/737904755,v1:172.21.15.156:6825/737904755]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-08-10T11:50:12.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:11 smithi152 ceph-mon[130220]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-08-10T11:50:12.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:11 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1145730883' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-08-10T11:50:12.255 INFO:journalctl@ceph.osd.11.smithi156.stdout:Aug 10 11:50:11 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-osd-11[152981]: 2023-08-10T11:50:11.934+0000 7fef58b29700 -1 osd.11 77 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T11:50:13.045 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph osd stat -f json 2023-08-10T11:50:13.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:12 smithi152 ceph-mon[130220]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-08-10T11:50:13.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:12 smithi152 ceph-mon[130220]: osdmap e77: 12 total, 11 up, 12 in 2023-08-10T11:50:13.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:12 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T11:50:13.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:12 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T11:50:13.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:12 smithi152 ceph-mon[130220]: Detected new or changed devices on smithi156 2023-08-10T11:50:13.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:12 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:13.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:12 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:13.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:12 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:50:13.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:12 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:50:13.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:12 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:50:13.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:12 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:50:13.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:12 smithi152 ceph-mon[130220]: Adjusting osd_memory_target on smithi156 to 4292M 2023-08-10T11:50:13.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:12 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:13.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:12 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:13.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:12 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:50:13.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:12 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:13.248 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:12 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:50:13.248 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:12 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:13.248 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:12 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:50:13.248 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:12 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:13.248 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:12 smithi152 ceph-mon[130220]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-08-10T11:50:13.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:12 smithi156 ceph-mon[130574]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-08-10T11:50:13.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:12 smithi156 ceph-mon[130574]: osdmap e77: 12 total, 11 up, 12 in 2023-08-10T11:50:13.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:12 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T11:50:13.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:12 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T11:50:13.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:12 smithi156 ceph-mon[130574]: Detected new or changed devices on smithi156 2023-08-10T11:50:13.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:12 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:13.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:12 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:13.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:12 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:50:13.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:12 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:50:13.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:12 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:50:13.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:12 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:50:13.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:12 smithi156 ceph-mon[130574]: Adjusting osd_memory_target on smithi156 to 4292M 2023-08-10T11:50:13.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:12 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:13.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:12 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:13.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:12 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:50:13.258 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:12 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:13.258 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:12 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:50:13.258 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:12 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:13.258 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:12 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:50:13.258 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:12 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:13.258 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:12 smithi156 ceph-mon[130574]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-08-10T11:50:13.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:12 smithi073 ceph-mon[128869]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-08-10T11:50:13.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:12 smithi073 ceph-mon[128869]: osdmap e77: 12 total, 11 up, 12 in 2023-08-10T11:50:13.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:12 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T11:50:13.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:12 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T11:50:13.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:12 smithi073 ceph-mon[128869]: Detected new or changed devices on smithi156 2023-08-10T11:50:13.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:12 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:13.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:12 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:13.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:12 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:50:13.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:12 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:50:13.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:12 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:50:13.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:12 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:50:13.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:12 smithi073 ceph-mon[128869]: Adjusting osd_memory_target on smithi156 to 4292M 2023-08-10T11:50:13.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:12 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:13.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:12 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:13.270 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:12 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:50:13.270 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:12 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:13.270 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:12 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:50:13.270 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:12 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:13.270 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:12 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:50:13.270 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:12 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:13.270 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:12 smithi073 ceph-mon[128869]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-08-10T11:50:13.599 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:50:14.206 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:13 smithi073 ceph-mon[128869]: purged_snaps scrub starts 2023-08-10T11:50:14.206 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:13 smithi073 ceph-mon[128869]: purged_snaps scrub ok 2023-08-10T11:50:14.206 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:13 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T11:50:14.206 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:13 smithi073 ceph-mon[128869]: osd.11 [v2:172.21.15.156:6824/737904755,v1:172.21.15.156:6825/737904755] boot 2023-08-10T11:50:14.207 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:13 smithi073 ceph-mon[128869]: osdmap e78: 12 total, 12 up, 12 in 2023-08-10T11:50:14.207 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:13 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T11:50:14.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:13 smithi152 ceph-mon[130220]: purged_snaps scrub starts 2023-08-10T11:50:14.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:13 smithi152 ceph-mon[130220]: purged_snaps scrub ok 2023-08-10T11:50:14.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:13 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T11:50:14.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:13 smithi152 ceph-mon[130220]: osd.11 [v2:172.21.15.156:6824/737904755,v1:172.21.15.156:6825/737904755] boot 2023-08-10T11:50:14.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:13 smithi152 ceph-mon[130220]: osdmap e78: 12 total, 12 up, 12 in 2023-08-10T11:50:14.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:13 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T11:50:14.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:13 smithi156 ceph-mon[130574]: purged_snaps scrub starts 2023-08-10T11:50:14.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:13 smithi156 ceph-mon[130574]: purged_snaps scrub ok 2023-08-10T11:50:14.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:13 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T11:50:14.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:13 smithi156 ceph-mon[130574]: osd.11 [v2:172.21.15.156:6824/737904755,v1:172.21.15.156:6825/737904755] boot 2023-08-10T11:50:14.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:13 smithi156 ceph-mon[130574]: osdmap e78: 12 total, 12 up, 12 in 2023-08-10T11:50:14.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:13 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T11:50:15.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:14.998+0000 7f979f3fb700 1 -- 172.21.15.73:0/380487362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97981012a0 msgr2=0x7f9798107b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:15.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:14.998+0000 7f979f3fb700 1 --2- 172.21.15.73:0/380487362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97981012a0 0x7f9798107b50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f979000b0d0 tx=0x7f979000b3e0 comp rx=0 tx=0).stop 2023-08-10T11:50:15.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:14.998+0000 7f979f3fb700 1 -- 172.21.15.73:0/380487362 shutdown_connections 2023-08-10T11:50:15.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:14.998+0000 7f979f3fb700 1 --2- 172.21.15.73:0/380487362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97980ff700 0x7f97980ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:15.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:14.998+0000 7f979f3fb700 1 --2- 172.21.15.73:0/380487362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97981012a0 0x7f9798107b50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:15.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:14.998+0000 7f979f3fb700 1 --2- 172.21.15.73:0/380487362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9798100900 0x7f9798100d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:15.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:14.998+0000 7f979f3fb700 1 -- 172.21.15.73:0/380487362 >> 172.21.15.73:0/380487362 conn(0x7f97980fac80 msgr2=0x7f97980fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:15.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:14.998+0000 7f979f3fb700 1 -- 172.21.15.73:0/380487362 shutdown_connections 2023-08-10T11:50:15.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:14.998+0000 7f979f3fb700 1 -- 172.21.15.73:0/380487362 wait complete. 2023-08-10T11:50:15.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:14.999+0000 7f979f3fb700 1 Processor -- start 2023-08-10T11:50:15.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:14.999+0000 7f979f3fb700 1 -- start start 2023-08-10T11:50:15.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:14.999+0000 7f979f3fb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97980ff700 0x7f9798068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:15.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:14.999+0000 7f979f3fb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9798100900 0x7f979819b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:15.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:14.999+0000 7f979f3fb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97981012a0 0x7f979819d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:15.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:14.999+0000 7f979f3fb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979819e0d0 con 0x7f97981012a0 2023-08-10T11:50:15.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:14.999+0000 7f979f3fb700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979819e240 con 0x7f9798100900 2023-08-10T11:50:15.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:14.999+0000 7f979f3fb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979819e400 con 0x7f97980ff700 2023-08-10T11:50:15.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:14.999+0000 7f979d998700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97981012a0 0x7f979819d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:15.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:14.999+0000 7f979d998700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97981012a0 0x7f979819d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58552/0 (socket says 172.21.15.73:58552) 2023-08-10T11:50:15.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:14.999+0000 7f979d998700 1 -- 172.21.15.73:0/4245836379 learned_addr learned my addr 172.21.15.73:0/4245836379 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:15.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:14.999+0000 7f979d197700 1 --2- 172.21.15.73:0/4245836379 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97980ff700 0x7f9798068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:15.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:14.999+0000 7f979c996700 1 --2- 172.21.15.73:0/4245836379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9798100900 0x7f979819b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:15.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:14.999+0000 7f979d998700 1 -- 172.21.15.73:0/4245836379 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97980ff700 msgr2=0x7f9798068d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:15.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:14.999+0000 7f979d998700 1 --2- 172.21.15.73:0/4245836379 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97980ff700 0x7f9798068d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:15.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:14.999+0000 7f979d998700 1 -- 172.21.15.73:0/4245836379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9798100900 msgr2=0x7f979819b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:15.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.000+0000 7f979d998700 1 --2- 172.21.15.73:0/4245836379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9798100900 0x7f979819b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:15.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.000+0000 7f979d998700 1 -- 172.21.15.73:0/4245836379 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9790009d00 con 0x7f97981012a0 2023-08-10T11:50:15.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.000+0000 7f979d197700 1 --2- 172.21.15.73:0/4245836379 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97980ff700 0x7f9798068d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:50:15.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.000+0000 7f979d998700 1 --2- 172.21.15.73:0/4245836379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97981012a0 0x7f979819d930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9790007a00 tx=0x7f9790009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:15.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.000+0000 7f978e7fc700 1 -- 172.21.15.73:0/4245836379 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979000e040 con 0x7f97981012a0 2023-08-10T11:50:15.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.000+0000 7f978e7fc700 1 -- 172.21.15.73:0/4245836379 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9790003e10 con 0x7f97981012a0 2023-08-10T11:50:15.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.000+0000 7f979f3fb700 1 -- 172.21.15.73:0/4245836379 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979819e680 con 0x7f97981012a0 2023-08-10T11:50:15.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.000+0000 7f978e7fc700 1 -- 172.21.15.73:0/4245836379 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9790005610 con 0x7f97981012a0 2023-08-10T11:50:15.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.000+0000 7f979f3fb700 1 -- 172.21.15.73:0/4245836379 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979819ea90 con 0x7f97981012a0 2023-08-10T11:50:15.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.001+0000 7f979f3fb700 1 -- 172.21.15.73:0/4245836379 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f979810af80 con 0x7f97981012a0 2023-08-10T11:50:15.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.002+0000 7f978e7fc700 1 -- 172.21.15.73:0/4245836379 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f9790005770 con 0x7f97981012a0 2023-08-10T11:50:15.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.002+0000 7f978e7fc700 1 --2- 172.21.15.73:0/4245836379 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f97840a1150 0x7f97840a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:15.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.002+0000 7f979d197700 1 --2- 172.21.15.73:0/4245836379 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f97840a1150 0x7f97840a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:15.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.002+0000 7f978e7fc700 1 -- 172.21.15.73:0/4245836379 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f97900cdc20 con 0x7f97981012a0 2023-08-10T11:50:15.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.003+0000 7f979d197700 1 --2- 172.21.15.73:0/4245836379 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f97840a1150 0x7f97840a3610 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9788005950 tx=0x7f97880058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:15.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.007+0000 7f978e7fc700 1 -- 172.21.15.73:0/4245836379 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f97900978a0 con 0x7f97981012a0 2023-08-10T11:50:15.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.193+0000 7f979f3fb700 1 -- 172.21.15.73:0/4245836379 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f9798106600 con 0x7f97981012a0 2023-08-10T11:50:15.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.193+0000 7f978e7fc700 1 -- 172.21.15.73:0/4245836379 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v79) v1 ==== 74+0+133 (secure 0 0 0) 0x7f9790097030 con 0x7f97981012a0 2023-08-10T11:50:15.196 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:50:15.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.196+0000 7f979f3fb700 1 -- 172.21.15.73:0/4245836379 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f97840a1150 msgr2=0x7f97840a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:15.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.196+0000 7f979f3fb700 1 --2- 172.21.15.73:0/4245836379 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f97840a1150 0x7f97840a3610 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9788005950 tx=0x7f97880058e0 comp rx=0 tx=0).stop 2023-08-10T11:50:15.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.196+0000 7f979f3fb700 1 -- 172.21.15.73:0/4245836379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97981012a0 msgr2=0x7f979819d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:15.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.196+0000 7f979f3fb700 1 --2- 172.21.15.73:0/4245836379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97981012a0 0x7f979819d930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9790007a00 tx=0x7f9790009570 comp rx=0 tx=0).stop 2023-08-10T11:50:15.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.196+0000 7f979f3fb700 1 -- 172.21.15.73:0/4245836379 shutdown_connections 2023-08-10T11:50:15.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.196+0000 7f979f3fb700 1 --2- 172.21.15.73:0/4245836379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97981012a0 0x7f979819d930 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:15.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.196+0000 7f979f3fb700 1 --2- 172.21.15.73:0/4245836379 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97980ff700 0x7f9798068d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:15.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.196+0000 7f979f3fb700 1 --2- 172.21.15.73:0/4245836379 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f97840a1150 0x7f97840a3610 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:15.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.196+0000 7f979f3fb700 1 --2- 172.21.15.73:0/4245836379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9798100900 0x7f979819b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:15.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.196+0000 7f979f3fb700 1 -- 172.21.15.73:0/4245836379 >> 172.21.15.73:0/4245836379 conn(0x7f97980fac80 msgr2=0x7f97980fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:15.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.196+0000 7f979f3fb700 1 -- 172.21.15.73:0/4245836379 shutdown_connections 2023-08-10T11:50:15.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:15.196+0000 7f979f3fb700 1 -- 172.21.15.73:0/4245836379 wait complete. 2023-08-10T11:50:15.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:14 smithi073 ceph-mon[128869]: osdmap e79: 12 total, 12 up, 12 in 2023-08-10T11:50:15.222 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:14 smithi073 ceph-mon[128869]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:15.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:14 smithi152 ceph-mon[130220]: osdmap e79: 12 total, 12 up, 12 in 2023-08-10T11:50:15.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:14 smithi152 ceph-mon[130220]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:15.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:14 smithi156 ceph-mon[130574]: osdmap e79: 12 total, 12 up, 12 in 2023-08-10T11:50:15.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:14 smithi156 ceph-mon[130574]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:15.643 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":79,"num_osds":12,"num_up_osds":12,"osd_up_since":1691668212,"num_in_osds":12,"osd_in_since":1691668194,"num_remapped_pgs":0} 2023-08-10T11:50:15.644 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph osd dump --format=json 2023-08-10T11:50:16.196 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:50:16.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:15 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/4245836379' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-08-10T11:50:16.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:15 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/4245836379' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-08-10T11:50:16.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:15 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/4245836379' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-08-10T11:50:17.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:16 smithi073 ceph-mon[128869]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:17.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:16 smithi152 ceph-mon[130220]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:17.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:16 smithi156 ceph-mon[130574]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:17.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.510+0000 7fb1fac76700 1 -- 172.21.15.73:0/1834050256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1f4104580 msgr2=0x7fb1f4104960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:17.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.510+0000 7fb1fac76700 1 --2- 172.21.15.73:0/1834050256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1f4104580 0x7fb1f4104960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8009990 tx=0x7fb1e8009ca0 comp rx=0 tx=0).stop 2023-08-10T11:50:17.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.510+0000 7fb1fac76700 1 -- 172.21.15.73:0/1834050256 shutdown_connections 2023-08-10T11:50:17.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.510+0000 7fb1fac76700 1 --2- 172.21.15.73:0/1834050256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1f4100070 0x7fb1f410c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:17.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.510+0000 7fb1fac76700 1 --2- 172.21.15.73:0/1834050256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1f4104580 0x7fb1f4104960 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:17.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.510+0000 7fb1fac76700 1 --2- 172.21.15.73:0/1834050256 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb1f40ff6b0 0x7fb1f40ffb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:17.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.510+0000 7fb1fac76700 1 -- 172.21.15.73:0/1834050256 >> 172.21.15.73:0/1834050256 conn(0x7fb1f4076770 msgr2=0x7fb1f4076b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:17.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.510+0000 7fb1fac76700 1 -- 172.21.15.73:0/1834050256 shutdown_connections 2023-08-10T11:50:17.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.510+0000 7fb1fac76700 1 -- 172.21.15.73:0/1834050256 wait complete. 2023-08-10T11:50:17.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.511+0000 7fb1fac76700 1 Processor -- start 2023-08-10T11:50:17.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.511+0000 7fb1fac76700 1 -- start start 2023-08-10T11:50:17.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.511+0000 7fb1fac76700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb1f40ff6b0 0x7fb1f4195590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:17.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.511+0000 7fb1fac76700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1f4100070 0x7fb1f4195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:17.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.511+0000 7fb1fac76700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1f4104580 0x7fb1f4196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:17.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.511+0000 7fb1fac76700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f41a4dd0 con 0x7fb1f4104580 2023-08-10T11:50:17.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.511+0000 7fb1fac76700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f41a4f40 con 0x7fb1f4100070 2023-08-10T11:50:17.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.511+0000 7fb1fac76700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f41a5100 con 0x7fb1f40ff6b0 2023-08-10T11:50:17.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.511+0000 7fb1f9213700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1f4104580 0x7fb1f4196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:17.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.511+0000 7fb1f9213700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1f4104580 0x7fb1f4196010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58562/0 (socket says 172.21.15.73:58562) 2023-08-10T11:50:17.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.511+0000 7fb1f9213700 1 -- 172.21.15.73:0/2877514723 learned_addr learned my addr 172.21.15.73:0/2877514723 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:17.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.511+0000 7fb1f3fff700 1 --2- 172.21.15.73:0/2877514723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1f4100070 0x7fb1f4195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:17.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.511+0000 7fb1f8a12700 1 --2- 172.21.15.73:0/2877514723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb1f40ff6b0 0x7fb1f4195590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:17.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.511+0000 7fb1f9213700 1 -- 172.21.15.73:0/2877514723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb1f40ff6b0 msgr2=0x7fb1f4195590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:17.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.511+0000 7fb1f9213700 1 --2- 172.21.15.73:0/2877514723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb1f40ff6b0 0x7fb1f4195590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:17.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.511+0000 7fb1f9213700 1 -- 172.21.15.73:0/2877514723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1f4100070 msgr2=0x7fb1f4195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:17.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.511+0000 7fb1f9213700 1 --2- 172.21.15.73:0/2877514723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1f4100070 0x7fb1f4195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:17.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.511+0000 7fb1f9213700 1 -- 172.21.15.73:0/2877514723 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e80095f0 con 0x7fb1f4104580 2023-08-10T11:50:17.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.511+0000 7fb1f8a12700 1 --2- 172.21.15.73:0/2877514723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb1f40ff6b0 0x7fb1f4195590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:50:17.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.511+0000 7fb1f9213700 1 --2- 172.21.15.73:0/2877514723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1f4104580 0x7fb1f4196010 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec00b9e0 tx=0x7fb1ec00bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:17.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.512+0000 7fb1f1ffb700 1 -- 172.21.15.73:0/2877514723 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec00d8e0 con 0x7fb1f4104580 2023-08-10T11:50:17.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.512+0000 7fb1f1ffb700 1 -- 172.21.15.73:0/2877514723 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1ec015420 con 0x7fb1f4104580 2023-08-10T11:50:17.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.512+0000 7fb1fac76700 1 -- 172.21.15.73:0/2877514723 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f41a53e0 con 0x7fb1f4104580 2023-08-10T11:50:17.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.512+0000 7fb1f1ffb700 1 -- 172.21.15.73:0/2877514723 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec014630 con 0x7fb1f4104580 2023-08-10T11:50:17.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.512+0000 7fb1fac76700 1 -- 172.21.15.73:0/2877514723 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f41a58e0 con 0x7fb1f4104580 2023-08-10T11:50:17.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.513+0000 7fb1fac76700 1 -- 172.21.15.73:0/2877514723 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f404e470 con 0x7fb1f4104580 2023-08-10T11:50:17.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.514+0000 7fb1f1ffb700 1 -- 172.21.15.73:0/2877514723 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fb1ec015590 con 0x7fb1f4104580 2023-08-10T11:50:17.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.514+0000 7fb1f1ffb700 1 --2- 172.21.15.73:0/2877514723 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb1e40a1150 0x7fb1e40a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:17.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.514+0000 7fb1f8a12700 1 --2- 172.21.15.73:0/2877514723 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb1e40a1150 0x7fb1e40a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:17.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.514+0000 7fb1f1ffb700 1 -- 172.21.15.73:0/2877514723 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb1ec011070 con 0x7fb1f4104580 2023-08-10T11:50:17.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.515+0000 7fb1f8a12700 1 --2- 172.21.15.73:0/2877514723 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb1e40a1150 0x7fb1e40a3610 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800b5c0 tx=0x7fb1e8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:17.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.519+0000 7fb1f1ffb700 1 -- 172.21.15.73:0/2877514723 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fb1ec04e790 con 0x7fb1f4104580 2023-08-10T11:50:17.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.706+0000 7fb1fac76700 1 -- 172.21.15.73:0/2877514723 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1f41a5c60 con 0x7fb1f4104580 2023-08-10T11:50:17.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.707+0000 7fb1f1ffb700 1 -- 172.21.15.73:0/2877514723 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18408 (secure 0 0 0) 0x7fb1ec095940 con 0x7fb1f4104580 2023-08-10T11:50:17.708 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:50:17.709 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":79,"fsid":"0e619a74-3773-11ee-9b37-001a4aab830c","created":"2023-08-10T11:43:53.974768+0000","modified":"2023-08-10T11:50:13.920565+0000","last_up_change":"2023-08-10T11:50:12.914422+0000","last_in_change":"2023-08-10T11:49:54.624543+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T11:46:58.735153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3219ae18-cc4c-4712-b616-79f6949066e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6803","nonce":2725694252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6805","nonce":2725694252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6809","nonce":2725694252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6807","nonce":2725694252}]},"public_addr":"172.21.15.73:6803/2725694252","cluster_addr":"172.21.15.73:6805/2725694252","heartbeat_back_addr":"172.21.15.73:6809/2725694252","heartbeat_front_addr":"172.21.15.73:6807/2725694252","state":["exists","up"]},{"osd":1,"uuid":"bbfe6cd9-b3d3-4b8d-8814-507a867f8c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6801","nonce":836829168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6803","nonce":836829168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6807","nonce":836829168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6805","nonce":836829168}]},"public_addr":"172.21.15.152:6801/836829168","cluster_addr":"172.21.15.152:6803/836829168","heartbeat_back_addr":"172.21.15.152:6807/836829168","heartbeat_front_addr":"172.21.15.152:6805/836829168","state":["exists","up"]},{"osd":2,"uuid":"f57f5b2c-3208-45c0-beba-8501694b99c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6801","nonce":1789212298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6803","nonce":1789212298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6807","nonce":1789212298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6805","nonce":1789212298}]},"public_addr":"172.21.15.156:6801/1789212298","cluster_addr":"172.21.15.156:6803/1789212298","heartbeat_back_addr":"172.21.15.156:6807/1789212298","heartbeat_front_addr":"172.21.15.156:6805/1789212298","state":["exists","up"]},{"osd":3,"uuid":"18592408-3696-4ab8-ad41-c172b8409829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6811","nonce":3101572649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6813","nonce":3101572649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6817","nonce":3101572649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6815","nonce":3101572649}]},"public_addr":"172.21.15.73:6811/3101572649","cluster_addr":"172.21.15.73:6813/3101572649","heartbeat_back_addr":"172.21.15.73:6817/3101572649","heartbeat_front_addr":"172.21.15.73:6815/3101572649","state":["exists","up"]},{"osd":4,"uuid":"fb3adb09-8807-42d9-8db9-1867c5fe02da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6809","nonce":1451517889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6811","nonce":1451517889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6815","nonce":1451517889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6813","nonce":1451517889}]},"public_addr":"172.21.15.152:6809/1451517889","cluster_addr":"172.21.15.152:6811/1451517889","heartbeat_back_addr":"172.21.15.152:6815/1451517889","heartbeat_front_addr":"172.21.15.152:6813/1451517889","state":["exists","up"]},{"osd":5,"uuid":"af58a7bd-4e58-4639-95b2-4a76011b61dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6809","nonce":3823368741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6811","nonce":3823368741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6815","nonce":3823368741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6813","nonce":3823368741}]},"public_addr":"172.21.15.156:6809/3823368741","cluster_addr":"172.21.15.156:6811/3823368741","heartbeat_back_addr":"172.21.15.156:6815/3823368741","heartbeat_front_addr":"172.21.15.156:6813/3823368741","state":["exists","up"]},{"osd":6,"uuid":"f6ae502d-4af9-4f6a-8636-b5b683dfdfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6819","nonce":2533620458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6821","nonce":2533620458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6825","nonce":2533620458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6823","nonce":2533620458}]},"public_addr":"172.21.15.73:6819/2533620458","cluster_addr":"172.21.15.73:6821/2533620458","heartbeat_back_addr":"172.21.15.73:6825/2533620458","heartbeat_front_addr":"172.21.15.73:6823/2533620458","state":["exists","up"]},{"osd":7,"uuid":"398fd334-5f6f-427c-95ae-3244fb466f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6817","nonce":4059538477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6819","nonce":4059538477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6823","nonce":4059538477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6821","nonce":4059538477}]},"public_addr":"172.21.15.152:6817/4059538477","cluster_addr":"172.21.15.152:6819/4059538477","heartbeat_back_addr":"172.21.15.152:6823/4059538477","heartbeat_front_addr":"172.21.15.152:6821/4059538477","state":["exists","up"]},{"osd":8,"uuid":"58f46e64-2624-4ad4-bb6a-225624153837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6817","nonce":96487555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6819","nonce":96487555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6823","nonce":96487555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6821","nonce":96487555}]},"public_addr":"172.21.15.156:6817/96487555","cluster_addr":"172.21.15.156:6819/96487555","heartbeat_back_addr":"172.21.15.156:6823/96487555","heartbeat_front_addr":"172.21.15.156:6821/96487555","state":["exists","up"]},{"osd":9,"uuid":"9389dd5b-da2d-43b6-8bc0-bb1af13f72c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6827","nonce":2050124321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6829","nonce":2050124321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6833","nonce":2050124321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6831","nonce":2050124321}]},"public_addr":"172.21.15.73:6827/2050124321","cluster_addr":"172.21.15.73:6829/2050124321","heartbeat_back_addr":"172.21.15.73:6833/2050124321","heartbeat_front_addr":"172.21.15.73:6831/2050124321","state":["exists","up"]},{"osd":10,"uuid":"563c1e34-3acd-46ab-ba36-e9d87f635e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6825","nonce":1513186350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6827","nonce":1513186350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6831","nonce":1513186350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6829","nonce":1513186350}]},"public_addr":"172.21.15.152:6825/1513186350","cluster_addr":"172.21.15.152:6827/1513186350","heartbeat_back_addr":"172.21.15.152:6831/1513186350","heartbeat_front_addr":"172.21.15.152:6829/1513186350","state":["exists","up"]},{"osd":11,"uuid":"f1b55889-14fd-4cc9-bed7-43748086fb77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6825","nonce":737904755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6827","nonce":737904755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6831","nonce":737904755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6829","nonce":737904755}]},"public_addr":"172.21.15.156:6825/737904755","cluster_addr":"172.21.15.156:6827/737904755","heartbeat_back_addr":"172.21.15.156:6831/737904755","heartbeat_front_addr":"172.21.15.156:6829/737904755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:12.023797+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:33.872883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:55.856970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:18.013196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:39.202872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:00.393920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:22.743083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:43.921728+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:05.859488+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:27.618714+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:48.880286+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:50:11.055141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/2202785670":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6800/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:6800/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/1447381524":"2023-08-11T11:44:48.401660+0000","172.21.15.73:0/2545059698":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/4193457623":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2561039569":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2927950081":"2023-08-11T11:44:48.401660+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T11:50:17.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.709+0000 7fb1fac76700 1 -- 172.21.15.73:0/2877514723 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb1e40a1150 msgr2=0x7fb1e40a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:17.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.709+0000 7fb1fac76700 1 --2- 172.21.15.73:0/2877514723 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb1e40a1150 0x7fb1e40a3610 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800b5c0 tx=0x7fb1e8005fb0 comp rx=0 tx=0).stop 2023-08-10T11:50:17.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.709+0000 7fb1fac76700 1 -- 172.21.15.73:0/2877514723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1f4104580 msgr2=0x7fb1f4196010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:17.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.709+0000 7fb1fac76700 1 --2- 172.21.15.73:0/2877514723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1f4104580 0x7fb1f4196010 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec00b9e0 tx=0x7fb1ec00bcf0 comp rx=0 tx=0).stop 2023-08-10T11:50:17.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.709+0000 7fb1fac76700 1 -- 172.21.15.73:0/2877514723 shutdown_connections 2023-08-10T11:50:17.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.709+0000 7fb1fac76700 1 --2- 172.21.15.73:0/2877514723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1f4104580 0x7fb1f4196010 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:17.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.709+0000 7fb1fac76700 1 --2- 172.21.15.73:0/2877514723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb1f40ff6b0 0x7fb1f4195590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:17.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.709+0000 7fb1fac76700 1 --2- 172.21.15.73:0/2877514723 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb1e40a1150 0x7fb1e40a3610 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:17.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.709+0000 7fb1fac76700 1 --2- 172.21.15.73:0/2877514723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1f4100070 0x7fb1f4195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:17.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.709+0000 7fb1fac76700 1 -- 172.21.15.73:0/2877514723 >> 172.21.15.73:0/2877514723 conn(0x7fb1f4076770 msgr2=0x7fb1f40fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:17.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.710+0000 7fb1fac76700 1 -- 172.21.15.73:0/2877514723 shutdown_connections 2023-08-10T11:50:17.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:17.710+0000 7fb1fac76700 1 -- 172.21.15.73:0/2877514723 wait complete. 2023-08-10T11:50:18.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:17 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2877514723' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:50:18.150 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T11:46:58.735153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T11:50:18.151 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph osd pool get .mgr pg_num 2023-08-10T11:50:18.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:17 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/2877514723' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:50:18.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:17 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/2877514723' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:50:18.703 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:50:19.740 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:19 smithi073 ceph-mon[128869]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:19.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:19 smithi152 ceph-mon[130220]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:19.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:19 smithi156 ceph-mon[130574]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:19.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.948+0000 7fda90163700 1 -- 172.21.15.73:0/253874015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda880ff6b0 msgr2=0x7fda880ffb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:19.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.948+0000 7fda90163700 1 --2- 172.21.15.73:0/253874015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda880ff6b0 0x7fda880ffb30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fda78009990 tx=0x7fda78009ca0 comp rx=0 tx=0).stop 2023-08-10T11:50:19.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.948+0000 7fda90163700 1 -- 172.21.15.73:0/253874015 shutdown_connections 2023-08-10T11:50:19.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.948+0000 7fda90163700 1 --2- 172.21.15.73:0/253874015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda88100070 0x7fda8810c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:19.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.948+0000 7fda90163700 1 --2- 172.21.15.73:0/253874015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda88104580 0x7fda88104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:19.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.948+0000 7fda90163700 1 --2- 172.21.15.73:0/253874015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda880ff6b0 0x7fda880ffb30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:19.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.948+0000 7fda90163700 1 -- 172.21.15.73:0/253874015 >> 172.21.15.73:0/253874015 conn(0x7fda88076770 msgr2=0x7fda88076b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:19.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.948+0000 7fda90163700 1 -- 172.21.15.73:0/253874015 shutdown_connections 2023-08-10T11:50:19.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.948+0000 7fda90163700 1 -- 172.21.15.73:0/253874015 wait complete. 2023-08-10T11:50:19.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.949+0000 7fda90163700 1 Processor -- start 2023-08-10T11:50:19.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.949+0000 7fda90163700 1 -- start start 2023-08-10T11:50:19.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.949+0000 7fda90163700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda880ff6b0 0x7fda88197770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:19.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.949+0000 7fda90163700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda88100070 0x7fda88197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:19.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.949+0000 7fda90163700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda88104580 0x7fda881a27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:19.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.949+0000 7fda90163700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda881985c0 con 0x7fda88100070 2023-08-10T11:50:19.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.949+0000 7fda90163700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda881a2d30 con 0x7fda880ff6b0 2023-08-10T11:50:19.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.949+0000 7fda90163700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda881a2ea0 con 0x7fda88104580 2023-08-10T11:50:19.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.949+0000 7fda8d6fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda88100070 0x7fda88197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:19.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.949+0000 7fda8d6fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda88100070 0x7fda88197cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58572/0 (socket says 172.21.15.73:58572) 2023-08-10T11:50:19.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.949+0000 7fda8d6fe700 1 -- 172.21.15.73:0/2840148464 learned_addr learned my addr 172.21.15.73:0/2840148464 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:19.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.949+0000 7fda8deff700 1 --2- 172.21.15.73:0/2840148464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda880ff6b0 0x7fda88197770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:19.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.949+0000 7fda8d6fe700 1 -- 172.21.15.73:0/2840148464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda88104580 msgr2=0x7fda881a27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:19.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.949+0000 7fda8e700700 1 --2- 172.21.15.73:0/2840148464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda88104580 0x7fda881a27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:19.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.949+0000 7fda8d6fe700 1 --2- 172.21.15.73:0/2840148464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda88104580 0x7fda881a27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:19.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.949+0000 7fda8d6fe700 1 -- 172.21.15.73:0/2840148464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda880ff6b0 msgr2=0x7fda88197770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:19.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.949+0000 7fda8d6fe700 1 --2- 172.21.15.73:0/2840148464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda880ff6b0 0x7fda88197770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:19.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.949+0000 7fda8d6fe700 1 -- 172.21.15.73:0/2840148464 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda780095f0 con 0x7fda88100070 2023-08-10T11:50:19.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.950+0000 7fda8d6fe700 1 --2- 172.21.15.73:0/2840148464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda88100070 0x7fda88197cb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fda78000c00 tx=0x7fda7800f780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:19.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.950+0000 7fda7effd700 1 -- 172.21.15.73:0/2840148464 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7801d070 con 0x7fda88100070 2023-08-10T11:50:19.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.950+0000 7fda7effd700 1 -- 172.21.15.73:0/2840148464 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda7800fc30 con 0x7fda88100070 2023-08-10T11:50:19.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.950+0000 7fda90163700 1 -- 172.21.15.73:0/2840148464 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda881a3120 con 0x7fda88100070 2023-08-10T11:50:19.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.950+0000 7fda7effd700 1 -- 172.21.15.73:0/2840148464 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda780176e0 con 0x7fda88100070 2023-08-10T11:50:19.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.950+0000 7fda90163700 1 -- 172.21.15.73:0/2840148464 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda881a35c0 con 0x7fda88100070 2023-08-10T11:50:19.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.951+0000 7fda90163700 1 -- 172.21.15.73:0/2840148464 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda8804e470 con 0x7fda88100070 2023-08-10T11:50:19.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.952+0000 7fda7effd700 1 -- 172.21.15.73:0/2840148464 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fda78022470 con 0x7fda88100070 2023-08-10T11:50:19.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.953+0000 7fda7effd700 1 --2- 172.21.15.73:0/2840148464 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fda740a1150 0x7fda740a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:19.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.953+0000 7fda8deff700 1 --2- 172.21.15.73:0/2840148464 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fda740a1150 0x7fda740a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:19.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.953+0000 7fda7effd700 1 -- 172.21.15.73:0/2840148464 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fda780cdcf0 con 0x7fda88100070 2023-08-10T11:50:19.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.953+0000 7fda8deff700 1 --2- 172.21.15.73:0/2840148464 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fda740a1150 0x7fda740a3610 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fda84009a10 tx=0x7fda84009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:19.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:19.956+0000 7fda7effd700 1 -- 172.21.15.73:0/2840148464 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fda78097970 con 0x7fda88100070 2023-08-10T11:50:20.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:20.142+0000 7fda90163700 1 -- 172.21.15.73:0/2840148464 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fda88068820 con 0x7fda88100070 2023-08-10T11:50:20.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:20.142+0000 7fda7effd700 1 -- 172.21.15.73:0/2840148464 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7fda7809af90 con 0x7fda88100070 2023-08-10T11:50:20.144 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-08-10T11:50:20.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:20.144+0000 7fda90163700 1 -- 172.21.15.73:0/2840148464 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fda740a1150 msgr2=0x7fda740a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:20.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:20.144+0000 7fda90163700 1 --2- 172.21.15.73:0/2840148464 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fda740a1150 0x7fda740a3610 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fda84009a10 tx=0x7fda84009190 comp rx=0 tx=0).stop 2023-08-10T11:50:20.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:20.144+0000 7fda90163700 1 -- 172.21.15.73:0/2840148464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda88100070 msgr2=0x7fda88197cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:20.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:20.144+0000 7fda90163700 1 --2- 172.21.15.73:0/2840148464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda88100070 0x7fda88197cb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fda78000c00 tx=0x7fda7800f780 comp rx=0 tx=0).stop 2023-08-10T11:50:20.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:20.145+0000 7fda90163700 1 -- 172.21.15.73:0/2840148464 shutdown_connections 2023-08-10T11:50:20.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:20.145+0000 7fda90163700 1 --2- 172.21.15.73:0/2840148464 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fda740a1150 0x7fda740a3610 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:20.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:20.145+0000 7fda90163700 1 --2- 172.21.15.73:0/2840148464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda880ff6b0 0x7fda88197770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:20.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:20.145+0000 7fda90163700 1 --2- 172.21.15.73:0/2840148464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda88104580 0x7fda881a27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:20.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:20.145+0000 7fda90163700 1 --2- 172.21.15.73:0/2840148464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda88100070 0x7fda88197cb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:20.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:20.145+0000 7fda90163700 1 -- 172.21.15.73:0/2840148464 >> 172.21.15.73:0/2840148464 conn(0x7fda88076770 msgr2=0x7fda880fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:20.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:20.145+0000 7fda90163700 1 -- 172.21.15.73:0/2840148464 shutdown_connections 2023-08-10T11:50:20.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:20.145+0000 7fda90163700 1 -- 172.21.15.73:0/2840148464 wait complete. 2023-08-10T11:50:20.560 INFO:tasks.cephadm:Adding mds.a on smithi073 2023-08-10T11:50:20.561 INFO:tasks.cephadm:Adding mds.d on smithi073 2023-08-10T11:50:20.561 INFO:tasks.cephadm:Adding mds.g on smithi073 2023-08-10T11:50:20.561 INFO:tasks.cephadm:Adding mds.j on smithi073 2023-08-10T11:50:20.562 INFO:tasks.cephadm:Adding mds.b on smithi152 2023-08-10T11:50:20.562 INFO:tasks.cephadm:Adding mds.e on smithi152 2023-08-10T11:50:20.562 INFO:tasks.cephadm:Adding mds.h on smithi152 2023-08-10T11:50:20.562 INFO:tasks.cephadm:Adding mds.k on smithi152 2023-08-10T11:50:20.562 INFO:tasks.cephadm:Adding mds.c on smithi156 2023-08-10T11:50:20.563 INFO:tasks.cephadm:Adding mds.f on smithi156 2023-08-10T11:50:20.563 INFO:tasks.cephadm:Adding mds.i on smithi156 2023-08-10T11:50:20.563 INFO:tasks.cephadm:Adding mds.l on smithi156 2023-08-10T11:50:20.563 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph orch apply mds all '12;smithi073=a;smithi073=d;smithi073=g;smithi073=j;smithi152=b;smithi152=e;smithi152=h;smithi152=k;smithi156=c;smithi156=f;smithi156=i;smithi156=l' 2023-08-10T11:50:20.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:20 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/2840148464' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:50:20.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:20 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/2840148464' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:50:20.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:20 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2840148464' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:50:21.135 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T11:50:21.624 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:21 smithi156 ceph-mon[130574]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:21.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:21 smithi152 ceph-mon[130220]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:21.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:21 smithi073 ceph-mon[128869]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:22.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.403+0000 7fa2712ce700 1 -- 172.21.15.156:0/1572481745 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa26c101a00 msgr2=0x7fa26c101e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:22.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.403+0000 7fa2712ce700 1 --2- 172.21.15.156:0/1572481745 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa26c101a00 0x7fa26c101e60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa260009990 tx=0x7fa260009ca0 comp rx=0 tx=0).stop 2023-08-10T11:50:22.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.403+0000 7fa2712ce700 1 -- 172.21.15.156:0/1572481745 shutdown_connections 2023-08-10T11:50:22.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.403+0000 7fa2712ce700 1 --2- 172.21.15.156:0/1572481745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa26c100800 0x7fa26c100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:22.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.403+0000 7fa2712ce700 1 --2- 172.21.15.156:0/1572481745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa26c1023a0 0x7fa26c108c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:22.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.403+0000 7fa2712ce700 1 --2- 172.21.15.156:0/1572481745 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa26c101a00 0x7fa26c101e60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:22.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.403+0000 7fa2712ce700 1 -- 172.21.15.156:0/1572481745 >> 172.21.15.156:0/1572481745 conn(0x7fa26c0fbd60 msgr2=0x7fa26c0fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:22.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.403+0000 7fa2712ce700 1 -- 172.21.15.156:0/1572481745 shutdown_connections 2023-08-10T11:50:22.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.403+0000 7fa2712ce700 1 -- 172.21.15.156:0/1572481745 wait complete. 2023-08-10T11:50:22.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.404+0000 7fa2712ce700 1 Processor -- start 2023-08-10T11:50:22.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.405+0000 7fa2712ce700 1 -- start start 2023-08-10T11:50:22.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.405+0000 7fa2712ce700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa26c100800 0x7fa26c074510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:22.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.405+0000 7fa2712ce700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa26c101a00 0x7fa26c072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:22.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.405+0000 7fa2712ce700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa26c1023a0 0x7fa26c0730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:22.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.405+0000 7fa2712ce700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c073820 con 0x7fa26c100800 2023-08-10T11:50:22.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.405+0000 7fa2712ce700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c073990 con 0x7fa26c101a00 2023-08-10T11:50:22.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.405+0000 7fa2712ce700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c1a0520 con 0x7fa26c1023a0 2023-08-10T11:50:22.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.405+0000 7fa26b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa26c1023a0 0x7fa26c0730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:22.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.405+0000 7fa26b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa26c1023a0 0x7fa26c0730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:37182/0 (socket says 172.21.15.156:37182) 2023-08-10T11:50:22.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.405+0000 7fa26b7fe700 1 -- 172.21.15.156:0/2239613171 learned_addr learned my addr 172.21.15.156:0/2239613171 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-08-10T11:50:22.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.405+0000 7fa26affd700 1 --2- 172.21.15.156:0/2239613171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa26c100800 0x7fa26c074510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:22.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.405+0000 7fa26a7fc700 1 --2- 172.21.15.156:0/2239613171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa26c101a00 0x7fa26c072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:22.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.405+0000 7fa26b7fe700 1 -- 172.21.15.156:0/2239613171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa26c101a00 msgr2=0x7fa26c072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:22.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.405+0000 7fa26b7fe700 1 --2- 172.21.15.156:0/2239613171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa26c101a00 0x7fa26c072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:22.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.405+0000 7fa26b7fe700 1 -- 172.21.15.156:0/2239613171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa26c100800 msgr2=0x7fa26c074510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:22.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.405+0000 7fa26b7fe700 1 --2- 172.21.15.156:0/2239613171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa26c100800 0x7fa26c074510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:22.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.405+0000 7fa26b7fe700 1 -- 172.21.15.156:0/2239613171 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2600095f0 con 0x7fa26c1023a0 2023-08-10T11:50:22.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.405+0000 7fa26b7fe700 1 --2- 172.21.15.156:0/2239613171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa26c1023a0 0x7fa26c0730a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa264007ee0 tx=0x7fa26400d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:22.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.405+0000 7fa253fff700 1 -- 172.21.15.156:0/2239613171 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa264017070 con 0x7fa26c1023a0 2023-08-10T11:50:22.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.405+0000 7fa253fff700 1 -- 172.21.15.156:0/2239613171 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa26400f040 con 0x7fa26c1023a0 2023-08-10T11:50:22.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.405+0000 7fa2712ce700 1 -- 172.21.15.156:0/2239613171 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa26c1a0800 con 0x7fa26c1023a0 2023-08-10T11:50:22.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.406+0000 7fa253fff700 1 -- 172.21.15.156:0/2239613171 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa264005740 con 0x7fa26c1023a0 2023-08-10T11:50:22.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.406+0000 7fa2712ce700 1 -- 172.21.15.156:0/2239613171 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa26c1a0cb0 con 0x7fa26c1023a0 2023-08-10T11:50:22.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.406+0000 7fa2712ce700 1 -- 172.21.15.156:0/2239613171 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa26c107de0 con 0x7fa26c1023a0 2023-08-10T11:50:22.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.408+0000 7fa253fff700 1 -- 172.21.15.156:0/2239613171 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fa26400dc60 con 0x7fa26c1023a0 2023-08-10T11:50:22.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.408+0000 7fa253fff700 1 --2- 172.21.15.156:0/2239613171 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa2540a1150 0x7fa2540a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:22.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.409+0000 7fa253fff700 1 -- 172.21.15.156:0/2239613171 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa2640cc2c0 con 0x7fa26c1023a0 2023-08-10T11:50:22.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.409+0000 7fa26affd700 1 --2- 172.21.15.156:0/2239613171 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa2540a1150 0x7fa2540a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:22.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.409+0000 7fa26affd700 1 --2- 172.21.15.156:0/2239613171 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa2540a1150 0x7fa2540a3610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa26c101860 tx=0x7fa25c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:22.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.411+0000 7fa253fff700 1 -- 172.21.15.156:0/2239613171 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fa264095eb0 con 0x7fa26c1023a0 2023-08-10T11:50:22.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.608+0000 7fa2712ce700 1 -- 172.21.15.156:0/2239613171 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi073=a;smithi073=d;smithi073=g;smithi073=j;smithi152=b;smithi152=e;smithi152=h;smithi152=k;smithi156=c;smithi156=f;smithi156=i;smithi156=l", "target": ["mon-mgr", ""]}) v1 -- 0x7fa26c060e70 con 0x7fa2540a1150 2023-08-10T11:50:22.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.616+0000 7fa253fff700 1 -- 172.21.15.156:0/2239613171 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fa26c060e70 con 0x7fa2540a1150 2023-08-10T11:50:22.617 INFO:teuthology.orchestra.run.smithi156.stdout:Scheduled mds.all update... 2023-08-10T11:50:22.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.618+0000 7fa2712ce700 1 -- 172.21.15.156:0/2239613171 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa2540a1150 msgr2=0x7fa2540a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:22.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.618+0000 7fa2712ce700 1 --2- 172.21.15.156:0/2239613171 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa2540a1150 0x7fa2540a3610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa26c101860 tx=0x7fa25c00a380 comp rx=0 tx=0).stop 2023-08-10T11:50:22.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.618+0000 7fa2712ce700 1 -- 172.21.15.156:0/2239613171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa26c1023a0 msgr2=0x7fa26c0730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:22.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.618+0000 7fa2712ce700 1 --2- 172.21.15.156:0/2239613171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa26c1023a0 0x7fa26c0730a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa264007ee0 tx=0x7fa26400d3b0 comp rx=0 tx=0).stop 2023-08-10T11:50:22.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.618+0000 7fa2712ce700 1 -- 172.21.15.156:0/2239613171 shutdown_connections 2023-08-10T11:50:22.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.618+0000 7fa2712ce700 1 --2- 172.21.15.156:0/2239613171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa26c1023a0 0x7fa26c0730a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:22.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.618+0000 7fa2712ce700 1 --2- 172.21.15.156:0/2239613171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa26c100800 0x7fa26c074510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:22.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.618+0000 7fa2712ce700 1 --2- 172.21.15.156:0/2239613171 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa2540a1150 0x7fa2540a3610 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:22.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.618+0000 7fa2712ce700 1 --2- 172.21.15.156:0/2239613171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa26c101a00 0x7fa26c072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:22.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.618+0000 7fa2712ce700 1 -- 172.21.15.156:0/2239613171 >> 172.21.15.156:0/2239613171 conn(0x7fa26c0fbd60 msgr2=0x7fa26c104f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:22.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.618+0000 7fa2712ce700 1 -- 172.21.15.156:0/2239613171 shutdown_connections 2023-08-10T11:50:22.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-08-10T11:50:22.618+0000 7fa2712ce700 1 -- 172.21.15.156:0/2239613171 wait complete. 2023-08-10T11:50:23.083 DEBUG:teuthology.orchestra.run.smithi073:mds.a> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@mds.a.service 2023-08-10T11:50:23.086 DEBUG:teuthology.orchestra.run.smithi073:mds.d> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@mds.d.service 2023-08-10T11:50:23.123 INFO:journalctl@ceph.mds.a.smithi073.stdout:-- Logs begin at Thu 2023-08-10 11:15:25 UTC. -- 2023-08-10T11:50:23.124 DEBUG:teuthology.orchestra.run.smithi073:mds.g> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@mds.g.service 2023-08-10T11:50:23.153 INFO:journalctl@ceph.mds.d.smithi073.stdout:-- Logs begin at Thu 2023-08-10 11:15:25 UTC. -- 2023-08-10T11:50:23.154 DEBUG:teuthology.orchestra.run.smithi073:mds.j> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@mds.j.service 2023-08-10T11:50:23.181 INFO:journalctl@ceph.mds.g.smithi073.stdout:-- Logs begin at Thu 2023-08-10 11:15:25 UTC. -- 2023-08-10T11:50:23.182 DEBUG:teuthology.orchestra.run.smithi152:mds.b> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@mds.b.service 2023-08-10T11:50:23.185 DEBUG:teuthology.orchestra.run.smithi152:mds.e> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@mds.e.service 2023-08-10T11:50:23.208 INFO:journalctl@ceph.mds.j.smithi073.stdout:-- Logs begin at Thu 2023-08-10 11:15:25 UTC. -- 2023-08-10T11:50:23.222 INFO:journalctl@ceph.mds.b.smithi152.stdout:-- Logs begin at Thu 2023-08-10 11:15:14 UTC. -- 2023-08-10T11:50:23.223 DEBUG:teuthology.orchestra.run.smithi152:mds.h> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@mds.h.service 2023-08-10T11:50:23.253 INFO:journalctl@ceph.mds.e.smithi152.stdout:-- Logs begin at Thu 2023-08-10 11:15:14 UTC. -- 2023-08-10T11:50:23.254 DEBUG:teuthology.orchestra.run.smithi152:mds.k> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@mds.k.service 2023-08-10T11:50:23.281 INFO:journalctl@ceph.mds.h.smithi152.stdout:-- Logs begin at Thu 2023-08-10 11:15:14 UTC. -- 2023-08-10T11:50:23.282 DEBUG:teuthology.orchestra.run.smithi156:mds.c> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@mds.c.service 2023-08-10T11:50:23.284 DEBUG:teuthology.orchestra.run.smithi156:mds.f> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@mds.f.service 2023-08-10T11:50:23.308 INFO:journalctl@ceph.mds.k.smithi152.stdout:-- Logs begin at Thu 2023-08-10 11:15:14 UTC. -- 2023-08-10T11:50:23.313 INFO:journalctl@ceph.mds.c.smithi156.stdout:-- Logs begin at Thu 2023-08-10 11:15:12 UTC. -- 2023-08-10T11:50:23.314 DEBUG:teuthology.orchestra.run.smithi156:mds.i> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@mds.i.service 2023-08-10T11:50:23.340 INFO:journalctl@ceph.mds.f.smithi156.stdout:-- Logs begin at Thu 2023-08-10 11:15:12 UTC. -- 2023-08-10T11:50:23.341 DEBUG:teuthology.orchestra.run.smithi156:mds.l> sudo journalctl -f -n 0 -u ceph-0e619a74-3773-11ee-9b37-001a4aab830c@mds.l.service 2023-08-10T11:50:23.366 INFO:journalctl@ceph.mds.i.smithi156.stdout:-- Logs begin at Thu 2023-08-10 11:15:12 UTC. -- 2023-08-10T11:50:23.367 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-08-10T11:50:23.367 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T11:50:23.393 INFO:journalctl@ceph.mds.l.smithi156.stdout:-- Logs begin at Thu 2023-08-10 11:15:12 UTC. -- 2023-08-10T11:50:23.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.535+0000 7f9b97ec8700 1 -- 172.21.15.73:0/439016658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b900ff650 msgr2=0x7f9b900ffa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:23.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.535+0000 7f9b97ec8700 1 --2- 172.21.15.73:0/439016658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b900ff650 0x7f9b900ffa70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9b800099c0 tx=0x7f9b80009cd0 comp rx=0 tx=0).stop 2023-08-10T11:50:23.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.535+0000 7f9b97ec8700 1 -- 172.21.15.73:0/439016658 shutdown_connections 2023-08-10T11:50:23.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.535+0000 7f9b97ec8700 1 --2- 172.21.15.73:0/439016658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b901011e0 0x7f9b90107a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:23.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.535+0000 7f9b97ec8700 1 --2- 172.21.15.73:0/439016658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b900ff650 0x7f9b900ffa70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:23.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.535+0000 7f9b97ec8700 1 --2- 172.21.15.73:0/439016658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b90100840 0x7f9b90100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:23.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.535+0000 7f9b97ec8700 1 -- 172.21.15.73:0/439016658 >> 172.21.15.73:0/439016658 conn(0x7f9b900faba0 msgr2=0x7f9b900fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:23.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.535+0000 7f9b97ec8700 1 -- 172.21.15.73:0/439016658 shutdown_connections 2023-08-10T11:50:23.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.535+0000 7f9b97ec8700 1 -- 172.21.15.73:0/439016658 wait complete. 2023-08-10T11:50:23.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.536+0000 7f9b97ec8700 1 Processor -- start 2023-08-10T11:50:23.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.536+0000 7f9b97ec8700 1 -- start start 2023-08-10T11:50:23.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.536+0000 7f9b97ec8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b900ff650 0x7f9b90196440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:23.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.536+0000 7f9b97ec8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b90100840 0x7f9b90196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:23.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.536+0000 7f9b97ec8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b901011e0 0x7f9b9019d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:23.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.536+0000 7f9b97ec8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9019dfc0 con 0x7f9b901011e0 2023-08-10T11:50:23.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.536+0000 7f9b97ec8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9019e100 con 0x7f9b90100840 2023-08-10T11:50:23.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.536+0000 7f9b97ec8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9019e290 con 0x7f9b900ff650 2023-08-10T11:50:23.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.536+0000 7f9b96465700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b901011e0 0x7f9b9019d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:23.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.536+0000 7f9b96465700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b901011e0 0x7f9b9019d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58588/0 (socket says 172.21.15.73:58588) 2023-08-10T11:50:23.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.536+0000 7f9b96465700 1 -- 172.21.15.73:0/3305084927 learned_addr learned my addr 172.21.15.73:0/3305084927 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:23.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.536+0000 7f9b95c64700 1 --2- 172.21.15.73:0/3305084927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b900ff650 0x7f9b90196440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:23.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.536+0000 7f9b95463700 1 --2- 172.21.15.73:0/3305084927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b90100840 0x7f9b90196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:23.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.536+0000 7f9b96465700 1 -- 172.21.15.73:0/3305084927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b900ff650 msgr2=0x7f9b90196440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:23.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.536+0000 7f9b96465700 1 --2- 172.21.15.73:0/3305084927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b900ff650 0x7f9b90196440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:23.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.536+0000 7f9b96465700 1 -- 172.21.15.73:0/3305084927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b90100840 msgr2=0x7f9b90196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:23.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.536+0000 7f9b96465700 1 --2- 172.21.15.73:0/3305084927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b90100840 0x7f9b90196980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:23.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.536+0000 7f9b96465700 1 -- 172.21.15.73:0/3305084927 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b800095f0 con 0x7f9b901011e0 2023-08-10T11:50:23.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.537+0000 7f9b96465700 1 --2- 172.21.15.73:0/3305084927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b901011e0 0x7f9b9019d9f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9b8800ef30 tx=0x7f9b8800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:23.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.537+0000 7f9b86ffd700 1 -- 172.21.15.73:0/3305084927 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b88018070 con 0x7f9b901011e0 2023-08-10T11:50:23.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.537+0000 7f9b86ffd700 1 -- 172.21.15.73:0/3305084927 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b8800f040 con 0x7f9b901011e0 2023-08-10T11:50:23.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.537+0000 7f9b86ffd700 1 -- 172.21.15.73:0/3305084927 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8800cdb0 con 0x7f9b901011e0 2023-08-10T11:50:23.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.537+0000 7f9b97ec8700 1 -- 172.21.15.73:0/3305084927 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b9019e510 con 0x7f9b901011e0 2023-08-10T11:50:23.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.537+0000 7f9b97ec8700 1 -- 172.21.15.73:0/3305084927 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b9019e9d0 con 0x7f9b901011e0 2023-08-10T11:50:23.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.538+0000 7f9b97ec8700 1 -- 172.21.15.73:0/3305084927 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b9010ae70 con 0x7f9b901011e0 2023-08-10T11:50:23.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.539+0000 7f9b86ffd700 1 -- 172.21.15.73:0/3305084927 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f9b88003a00 con 0x7f9b901011e0 2023-08-10T11:50:23.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.539+0000 7f9b86ffd700 1 --2- 172.21.15.73:0/3305084927 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9b7c0a1220 0x7f9b7c0a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:23.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.539+0000 7f9b95c64700 1 --2- 172.21.15.73:0/3305084927 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9b7c0a1220 0x7f9b7c0a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:23.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.540+0000 7f9b86ffd700 1 -- 172.21.15.73:0/3305084927 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9b880cc9b0 con 0x7f9b901011e0 2023-08-10T11:50:23.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.540+0000 7f9b95c64700 1 --2- 172.21.15.73:0/3305084927 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9b7c0a1220 0x7f9b7c0a36e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009990 tx=0x7f9b80005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:23.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.543+0000 7f9b86ffd700 1 -- 172.21.15.73:0/3305084927 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f9b88096630 con 0x7f9b901011e0 2023-08-10T11:50:23.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.734+0000 7f9b97ec8700 1 -- 172.21.15.73:0/3305084927 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b9019f010 con 0x7f9b901011e0 2023-08-10T11:50:23.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.735+0000 7f9b86ffd700 1 -- 172.21.15.73:0/3305084927 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18408 (secure 0 0 0) 0x7f9b88099c50 con 0x7f9b901011e0 2023-08-10T11:50:23.736 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:50:23.736 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":79,"fsid":"0e619a74-3773-11ee-9b37-001a4aab830c","created":"2023-08-10T11:43:53.974768+0000","modified":"2023-08-10T11:50:13.920565+0000","last_up_change":"2023-08-10T11:50:12.914422+0000","last_in_change":"2023-08-10T11:49:54.624543+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T11:46:58.735153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3219ae18-cc4c-4712-b616-79f6949066e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6803","nonce":2725694252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6805","nonce":2725694252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6809","nonce":2725694252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6807","nonce":2725694252}]},"public_addr":"172.21.15.73:6803/2725694252","cluster_addr":"172.21.15.73:6805/2725694252","heartbeat_back_addr":"172.21.15.73:6809/2725694252","heartbeat_front_addr":"172.21.15.73:6807/2725694252","state":["exists","up"]},{"osd":1,"uuid":"bbfe6cd9-b3d3-4b8d-8814-507a867f8c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6801","nonce":836829168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6803","nonce":836829168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6807","nonce":836829168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6805","nonce":836829168}]},"public_addr":"172.21.15.152:6801/836829168","cluster_addr":"172.21.15.152:6803/836829168","heartbeat_back_addr":"172.21.15.152:6807/836829168","heartbeat_front_addr":"172.21.15.152:6805/836829168","state":["exists","up"]},{"osd":2,"uuid":"f57f5b2c-3208-45c0-beba-8501694b99c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6801","nonce":1789212298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6803","nonce":1789212298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6807","nonce":1789212298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6805","nonce":1789212298}]},"public_addr":"172.21.15.156:6801/1789212298","cluster_addr":"172.21.15.156:6803/1789212298","heartbeat_back_addr":"172.21.15.156:6807/1789212298","heartbeat_front_addr":"172.21.15.156:6805/1789212298","state":["exists","up"]},{"osd":3,"uuid":"18592408-3696-4ab8-ad41-c172b8409829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6811","nonce":3101572649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6813","nonce":3101572649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6817","nonce":3101572649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6815","nonce":3101572649}]},"public_addr":"172.21.15.73:6811/3101572649","cluster_addr":"172.21.15.73:6813/3101572649","heartbeat_back_addr":"172.21.15.73:6817/3101572649","heartbeat_front_addr":"172.21.15.73:6815/3101572649","state":["exists","up"]},{"osd":4,"uuid":"fb3adb09-8807-42d9-8db9-1867c5fe02da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6809","nonce":1451517889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6811","nonce":1451517889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6815","nonce":1451517889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6813","nonce":1451517889}]},"public_addr":"172.21.15.152:6809/1451517889","cluster_addr":"172.21.15.152:6811/1451517889","heartbeat_back_addr":"172.21.15.152:6815/1451517889","heartbeat_front_addr":"172.21.15.152:6813/1451517889","state":["exists","up"]},{"osd":5,"uuid":"af58a7bd-4e58-4639-95b2-4a76011b61dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6809","nonce":3823368741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6811","nonce":3823368741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6815","nonce":3823368741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6813","nonce":3823368741}]},"public_addr":"172.21.15.156:6809/3823368741","cluster_addr":"172.21.15.156:6811/3823368741","heartbeat_back_addr":"172.21.15.156:6815/3823368741","heartbeat_front_addr":"172.21.15.156:6813/3823368741","state":["exists","up"]},{"osd":6,"uuid":"f6ae502d-4af9-4f6a-8636-b5b683dfdfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6819","nonce":2533620458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6821","nonce":2533620458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6825","nonce":2533620458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6823","nonce":2533620458}]},"public_addr":"172.21.15.73:6819/2533620458","cluster_addr":"172.21.15.73:6821/2533620458","heartbeat_back_addr":"172.21.15.73:6825/2533620458","heartbeat_front_addr":"172.21.15.73:6823/2533620458","state":["exists","up"]},{"osd":7,"uuid":"398fd334-5f6f-427c-95ae-3244fb466f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6817","nonce":4059538477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6819","nonce":4059538477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6823","nonce":4059538477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6821","nonce":4059538477}]},"public_addr":"172.21.15.152:6817/4059538477","cluster_addr":"172.21.15.152:6819/4059538477","heartbeat_back_addr":"172.21.15.152:6823/4059538477","heartbeat_front_addr":"172.21.15.152:6821/4059538477","state":["exists","up"]},{"osd":8,"uuid":"58f46e64-2624-4ad4-bb6a-225624153837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6817","nonce":96487555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6819","nonce":96487555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6823","nonce":96487555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6821","nonce":96487555}]},"public_addr":"172.21.15.156:6817/96487555","cluster_addr":"172.21.15.156:6819/96487555","heartbeat_back_addr":"172.21.15.156:6823/96487555","heartbeat_front_addr":"172.21.15.156:6821/96487555","state":["exists","up"]},{"osd":9,"uuid":"9389dd5b-da2d-43b6-8bc0-bb1af13f72c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6827","nonce":2050124321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6829","nonce":2050124321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6833","nonce":2050124321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6831","nonce":2050124321}]},"public_addr":"172.21.15.73:6827/2050124321","cluster_addr":"172.21.15.73:6829/2050124321","heartbeat_back_addr":"172.21.15.73:6833/2050124321","heartbeat_front_addr":"172.21.15.73:6831/2050124321","state":["exists","up"]},{"osd":10,"uuid":"563c1e34-3acd-46ab-ba36-e9d87f635e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6825","nonce":1513186350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6827","nonce":1513186350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6831","nonce":1513186350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6829","nonce":1513186350}]},"public_addr":"172.21.15.152:6825/1513186350","cluster_addr":"172.21.15.152:6827/1513186350","heartbeat_back_addr":"172.21.15.152:6831/1513186350","heartbeat_front_addr":"172.21.15.152:6829/1513186350","state":["exists","up"]},{"osd":11,"uuid":"f1b55889-14fd-4cc9-bed7-43748086fb77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6825","nonce":737904755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6827","nonce":737904755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6831","nonce":737904755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6829","nonce":737904755}]},"public_addr":"172.21.15.156:6825/737904755","cluster_addr":"172.21.15.156:6827/737904755","heartbeat_back_addr":"172.21.15.156:6831/737904755","heartbeat_front_addr":"172.21.15.156:6829/737904755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:12.023797+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:33.872883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:55.856970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:18.013196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:39.202872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:00.393920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:22.743083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:43.921728+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:05.859488+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:27.618714+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:48.880286+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:50:11.055141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/2202785670":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6800/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:6800/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/1447381524":"2023-08-11T11:44:48.401660+0000","172.21.15.73:0/2545059698":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/4193457623":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2561039569":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2927950081":"2023-08-11T11:44:48.401660+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T11:50:23.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.737+0000 7f9b97ec8700 1 -- 172.21.15.73:0/3305084927 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9b7c0a1220 msgr2=0x7f9b7c0a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:23.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.737+0000 7f9b97ec8700 1 --2- 172.21.15.73:0/3305084927 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9b7c0a1220 0x7f9b7c0a36e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009990 tx=0x7f9b80005fb0 comp rx=0 tx=0).stop 2023-08-10T11:50:23.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.737+0000 7f9b97ec8700 1 -- 172.21.15.73:0/3305084927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b901011e0 msgr2=0x7f9b9019d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:23.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.737+0000 7f9b97ec8700 1 --2- 172.21.15.73:0/3305084927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b901011e0 0x7f9b9019d9f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9b8800ef30 tx=0x7f9b8800c3a0 comp rx=0 tx=0).stop 2023-08-10T11:50:23.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.737+0000 7f9b97ec8700 1 -- 172.21.15.73:0/3305084927 shutdown_connections 2023-08-10T11:50:23.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.737+0000 7f9b97ec8700 1 --2- 172.21.15.73:0/3305084927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b901011e0 0x7f9b9019d9f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:23.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.737+0000 7f9b97ec8700 1 --2- 172.21.15.73:0/3305084927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b900ff650 0x7f9b90196440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:23.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.737+0000 7f9b97ec8700 1 --2- 172.21.15.73:0/3305084927 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9b7c0a1220 0x7f9b7c0a36e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:23.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.737+0000 7f9b97ec8700 1 --2- 172.21.15.73:0/3305084927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b90100840 0x7f9b90196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:23.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.737+0000 7f9b97ec8700 1 -- 172.21.15.73:0/3305084927 >> 172.21.15.73:0/3305084927 conn(0x7f9b900faba0 msgr2=0x7f9b90067990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:23.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.737+0000 7f9b97ec8700 1 -- 172.21.15.73:0/3305084927 shutdown_connections 2023-08-10T11:50:23.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.737+0000 7f9b97ec8700 1 -- 172.21.15.73:0/3305084927 wait complete. 2023-08-10T11:50:23.749 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:23 smithi073 ceph-mon[128869]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:23.749 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:23 smithi073 ceph-mon[128869]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi073=a;smithi073=d;smithi073=g;smithi073=j;smithi152=b;smithi152=e;smithi152=h;smithi152=k;smithi156=c;smithi156=f;smithi156=i;smithi156=l", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:50:23.749 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:23 smithi073 ceph-mon[128869]: Saving service mds.all spec with placement smithi073=a;smithi073=d;smithi073=g;smithi073=j;smithi152=b;smithi152=e;smithi152=h;smithi152=k;smithi156=c;smithi156=f;smithi156=i;smithi156=l;count:12 2023-08-10T11:50:23.750 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:23.750 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:50:23.750 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:23.750 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:50:23.750 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:23.750 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:23.750 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:23.751 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:23 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:23.751 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:23 smithi073 ceph-mon[128869]: Deploying daemon mds.l on smithi156 2023-08-10T11:50:23.752 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T11:46:58.735153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T11:50:23.753 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T11:50:23.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.876+0000 7fbfb2bc5700 1 -- 172.21.15.73:0/2683557043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfac0fff60 msgr2=0x7fbfac1003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:23.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.876+0000 7fbfb2bc5700 1 --2- 172.21.15.73:0/2683557043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfac0fff60 0x7fbfac1003e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbf98009990 tx=0x7fbf98009ca0 comp rx=0 tx=0).stop 2023-08-10T11:50:23.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.876+0000 7fbfb2bc5700 1 -- 172.21.15.73:0/2683557043 shutdown_connections 2023-08-10T11:50:23.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.876+0000 7fbfb2bc5700 1 --2- 172.21.15.73:0/2683557043 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfac0fee10 0x7fbfac0ff230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:23.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.876+0000 7fbfb2bc5700 1 --2- 172.21.15.73:0/2683557043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfac100920 0x7fbfac107240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:23.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.876+0000 7fbfb2bc5700 1 --2- 172.21.15.73:0/2683557043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfac0fff60 0x7fbfac1003e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:23.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.876+0000 7fbfb2bc5700 1 -- 172.21.15.73:0/2683557043 >> 172.21.15.73:0/2683557043 conn(0x7fbfac0fa360 msgr2=0x7fbfac0fc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:23.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.876+0000 7fbfb2bc5700 1 -- 172.21.15.73:0/2683557043 shutdown_connections 2023-08-10T11:50:23.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.876+0000 7fbfb2bc5700 1 -- 172.21.15.73:0/2683557043 wait complete. 2023-08-10T11:50:23.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.876+0000 7fbfb2bc5700 1 Processor -- start 2023-08-10T11:50:23.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.877+0000 7fbfb2bc5700 1 -- start start 2023-08-10T11:50:23.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.877+0000 7fbfb2bc5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfac0fee10 0x7fbfac10ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:23.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.877+0000 7fbfb2bc5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfac0fff60 0x7fbfac19b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:23.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.877+0000 7fbfb2bc5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfac100920 0x7fbfac19d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:23.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.877+0000 7fbfb2bc5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac19df80 con 0x7fbfac0fee10 2023-08-10T11:50:23.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.877+0000 7fbfb2bc5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac19e0f0 con 0x7fbfac0fff60 2023-08-10T11:50:23.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.877+0000 7fbfb2bc5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac19e2b0 con 0x7fbfac100920 2023-08-10T11:50:23.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.877+0000 7fbfb0961700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfac0fee10 0x7fbfac10ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:23.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.877+0000 7fbfb0961700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfac0fee10 0x7fbfac10ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58598/0 (socket says 172.21.15.73:58598) 2023-08-10T11:50:23.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.877+0000 7fbfb0961700 1 -- 172.21.15.73:0/2179868749 learned_addr learned my addr 172.21.15.73:0/2179868749 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:23.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.877+0000 7fbfb1162700 1 --2- 172.21.15.73:0/2179868749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfac100920 0x7fbfac19d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:23.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.877+0000 7fbfabfff700 1 --2- 172.21.15.73:0/2179868749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfac0fff60 0x7fbfac19b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:23.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.877+0000 7fbfb0961700 1 -- 172.21.15.73:0/2179868749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfac100920 msgr2=0x7fbfac19d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:23.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.877+0000 7fbfb0961700 1 --2- 172.21.15.73:0/2179868749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfac100920 0x7fbfac19d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:23.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.877+0000 7fbfb0961700 1 -- 172.21.15.73:0/2179868749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfac0fff60 msgr2=0x7fbfac19b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:23.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.877+0000 7fbfb0961700 1 --2- 172.21.15.73:0/2179868749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfac0fff60 0x7fbfac19b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:23.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.877+0000 7fbfb0961700 1 -- 172.21.15.73:0/2179868749 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf980095f0 con 0x7fbfac0fee10 2023-08-10T11:50:23.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.877+0000 7fbfabfff700 1 --2- 172.21.15.73:0/2179868749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfac0fff60 0x7fbfac19b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:50:23.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.877+0000 7fbfb0961700 1 --2- 172.21.15.73:0/2179868749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfac0fee10 0x7fbfac10ba70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbfa000c920 tx=0x7fbfa000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:23.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.877+0000 7fbfa9ffb700 1 -- 172.21.15.73:0/2179868749 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0007b00 con 0x7fbfac0fee10 2023-08-10T11:50:23.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.877+0000 7fbfa9ffb700 1 -- 172.21.15.73:0/2179868749 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbfa000ce70 con 0x7fbfac0fee10 2023-08-10T11:50:23.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.877+0000 7fbfb2bc5700 1 -- 172.21.15.73:0/2179868749 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfac19e590 con 0x7fbfac0fee10 2023-08-10T11:50:23.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.877+0000 7fbfa9ffb700 1 -- 172.21.15.73:0/2179868749 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa00054e0 con 0x7fbfac0fee10 2023-08-10T11:50:23.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.878+0000 7fbfb2bc5700 1 -- 172.21.15.73:0/2179868749 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfac19eaa0 con 0x7fbfac0fee10 2023-08-10T11:50:23.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.879+0000 7fbfb2bc5700 1 -- 172.21.15.73:0/2179868749 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfac1059d0 con 0x7fbfac0fee10 2023-08-10T11:50:23.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.879+0000 7fbfa9ffb700 1 -- 172.21.15.73:0/2179868749 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fbfa0004750 con 0x7fbfac0fee10 2023-08-10T11:50:23.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.880+0000 7fbfa9ffb700 1 --2- 172.21.15.73:0/2179868749 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fbf9c0a1150 0x7fbf9c0a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:23.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.880+0000 7fbfabfff700 1 --2- 172.21.15.73:0/2179868749 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fbf9c0a1150 0x7fbf9c0a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:23.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.880+0000 7fbfa9ffb700 1 -- 172.21.15.73:0/2179868749 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fbfa00cbfd0 con 0x7fbfac0fee10 2023-08-10T11:50:23.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.880+0000 7fbfabfff700 1 --2- 172.21.15.73:0/2179868749 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fbf9c0a1150 0x7fbf9c0a3610 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbf98000c00 tx=0x7fbf98005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:23.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:23.884+0000 7fbfa9ffb700 1 -- 172.21.15.73:0/2179868749 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fbfa0095bc0 con 0x7fbfac0fee10 2023-08-10T11:50:23.959 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:23 smithi156 ceph-mon[130574]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:23.959 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:23 smithi156 ceph-mon[130574]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi073=a;smithi073=d;smithi073=g;smithi073=j;smithi152=b;smithi152=e;smithi152=h;smithi152=k;smithi156=c;smithi156=f;smithi156=i;smithi156=l", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:50:23.960 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:23 smithi156 ceph-mon[130574]: Saving service mds.all spec with placement smithi073=a;smithi073=d;smithi073=g;smithi073=j;smithi152=b;smithi152=e;smithi152=h;smithi152=k;smithi156=c;smithi156=f;smithi156=i;smithi156=l;count:12 2023-08-10T11:50:23.960 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:23 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:23.960 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:23 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:50:23.960 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:23 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:23.960 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:23 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:50:23.960 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:23 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:23.961 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:23 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:23.961 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:23 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:23.961 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:23 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:23.961 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:23 smithi156 ceph-mon[130574]: Deploying daemon mds.l on smithi156 2023-08-10T11:50:23.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:23 smithi152 ceph-mon[130220]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:23.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:23 smithi152 ceph-mon[130220]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi073=a;smithi073=d;smithi073=g;smithi073=j;smithi152=b;smithi152=e;smithi152=h;smithi152=k;smithi156=c;smithi156=f;smithi156=i;smithi156=l", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:50:23.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:23 smithi152 ceph-mon[130220]: Saving service mds.all spec with placement smithi073=a;smithi073=d;smithi073=g;smithi073=j;smithi152=b;smithi152=e;smithi152=h;smithi152=k;smithi156=c;smithi156=f;smithi156=i;smithi156=l;count:12 2023-08-10T11:50:23.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:23 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:23.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:23 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:50:23.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:23 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:23.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:23 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:50:23.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:23 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:23.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:23 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:23.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:23 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:23.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:23 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:23.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:23 smithi152 ceph-mon[130220]: Deploying daemon mds.l on smithi156 2023-08-10T11:50:24.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.073+0000 7fbfb2bc5700 1 -- 172.21.15.73:0/2179868749 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbfac02c970 con 0x7fbfac0fee10 2023-08-10T11:50:24.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.074+0000 7fbfa9ffb700 1 -- 172.21.15.73:0/2179868749 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbfa00991e0 con 0x7fbfac0fee10 2023-08-10T11:50:24.075 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-08-10T11:50:24.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.076+0000 7fbfb2bc5700 1 -- 172.21.15.73:0/2179868749 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fbf9c0a1150 msgr2=0x7fbf9c0a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:24.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.076+0000 7fbfb2bc5700 1 --2- 172.21.15.73:0/2179868749 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fbf9c0a1150 0x7fbf9c0a3610 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbf98000c00 tx=0x7fbf98005fb0 comp rx=0 tx=0).stop 2023-08-10T11:50:24.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.076+0000 7fbfb2bc5700 1 -- 172.21.15.73:0/2179868749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfac0fee10 msgr2=0x7fbfac10ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:24.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.076+0000 7fbfb2bc5700 1 --2- 172.21.15.73:0/2179868749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfac0fee10 0x7fbfac10ba70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbfa000c920 tx=0x7fbfa000cc30 comp rx=0 tx=0).stop 2023-08-10T11:50:24.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.076+0000 7fbfb2bc5700 1 -- 172.21.15.73:0/2179868749 shutdown_connections 2023-08-10T11:50:24.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.076+0000 7fbfb2bc5700 1 --2- 172.21.15.73:0/2179868749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfac100920 0x7fbfac19d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:24.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.076+0000 7fbfb2bc5700 1 --2- 172.21.15.73:0/2179868749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfac0fee10 0x7fbfac10ba70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:24.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.076+0000 7fbfb2bc5700 1 --2- 172.21.15.73:0/2179868749 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fbf9c0a1150 0x7fbf9c0a3610 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:24.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.076+0000 7fbfb2bc5700 1 --2- 172.21.15.73:0/2179868749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfac0fff60 0x7fbfac19b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:24.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.076+0000 7fbfb2bc5700 1 -- 172.21.15.73:0/2179868749 >> 172.21.15.73:0/2179868749 conn(0x7fbfac0fa360 msgr2=0x7fbfac0fbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:24.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.076+0000 7fbfb2bc5700 1 -- 172.21.15.73:0/2179868749 shutdown_connections 2023-08-10T11:50:24.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.076+0000 7fbfb2bc5700 1 -- 172.21.15.73:0/2179868749 wait complete. 2023-08-10T11:50:24.089 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T11:50:24.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.208+0000 7f0d63c8a700 1 -- 172.21.15.73:0/3244183258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d5c0ff650 msgr2=0x7f0d5c0ffa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:24.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.208+0000 7f0d63c8a700 1 --2- 172.21.15.73:0/3244183258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d5c0ff650 0x7f0d5c0ffa70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0d580099c0 tx=0x7f0d58009cd0 comp rx=0 tx=0).stop 2023-08-10T11:50:24.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.208+0000 7f0d63c8a700 1 -- 172.21.15.73:0/3244183258 shutdown_connections 2023-08-10T11:50:24.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.208+0000 7f0d63c8a700 1 --2- 172.21.15.73:0/3244183258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d5c1011e0 0x7f0d5c107a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:24.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.209+0000 7f0d63c8a700 1 --2- 172.21.15.73:0/3244183258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d5c0ff650 0x7f0d5c0ffa70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:24.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.209+0000 7f0d63c8a700 1 --2- 172.21.15.73:0/3244183258 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d5c100840 0x7f0d5c100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:24.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.209+0000 7f0d63c8a700 1 -- 172.21.15.73:0/3244183258 >> 172.21.15.73:0/3244183258 conn(0x7f0d5c0faba0 msgr2=0x7f0d5c0fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:24.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.209+0000 7f0d63c8a700 1 -- 172.21.15.73:0/3244183258 shutdown_connections 2023-08-10T11:50:24.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.209+0000 7f0d63c8a700 1 -- 172.21.15.73:0/3244183258 wait complete. 2023-08-10T11:50:24.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.209+0000 7f0d63c8a700 1 Processor -- start 2023-08-10T11:50:24.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.209+0000 7f0d63c8a700 1 -- start start 2023-08-10T11:50:24.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.209+0000 7f0d63c8a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d5c0ff650 0x7f0d5c1953d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:24.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.209+0000 7f0d63c8a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d5c100840 0x7f0d5c195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:24.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.209+0000 7f0d63c8a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d5c1011e0 0x7f0d5c19c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:24.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.209+0000 7f0d63c8a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c19cf50 con 0x7f0d5c100840 2023-08-10T11:50:24.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.209+0000 7f0d63c8a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c19d090 con 0x7f0d5c1011e0 2023-08-10T11:50:24.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.209+0000 7f0d63c8a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c19d220 con 0x7f0d5c0ff650 2023-08-10T11:50:24.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.209+0000 7f0d61225700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d5c100840 0x7f0d5c195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:24.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.209+0000 7f0d61225700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d5c100840 0x7f0d5c195910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58614/0 (socket says 172.21.15.73:58614) 2023-08-10T11:50:24.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.209+0000 7f0d61225700 1 -- 172.21.15.73:0/3503802875 learned_addr learned my addr 172.21.15.73:0/3503802875 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:24.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.209+0000 7f0d61a26700 1 --2- 172.21.15.73:0/3503802875 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d5c0ff650 0x7f0d5c1953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:24.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.210+0000 7f0d61225700 1 -- 172.21.15.73:0/3503802875 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d5c0ff650 msgr2=0x7f0d5c1953d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:24.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.210+0000 7f0d61225700 1 --2- 172.21.15.73:0/3503802875 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d5c0ff650 0x7f0d5c1953d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:24.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.210+0000 7f0d61225700 1 -- 172.21.15.73:0/3503802875 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d5c1011e0 msgr2=0x7f0d5c19c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:24.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.210+0000 7f0d61225700 1 --2- 172.21.15.73:0/3503802875 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d5c1011e0 0x7f0d5c19c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:24.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.210+0000 7f0d61225700 1 -- 172.21.15.73:0/3503802875 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d580095f0 con 0x7f0d5c100840 2023-08-10T11:50:24.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.210+0000 7f0d61225700 1 --2- 172.21.15.73:0/3503802875 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d5c100840 0x7f0d5c195910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00d950 tx=0x7f0d4c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:24.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.210+0000 7f0d52ffd700 1 -- 172.21.15.73:0/3503802875 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c009940 con 0x7f0d5c100840 2023-08-10T11:50:24.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.210+0000 7f0d63c8a700 1 -- 172.21.15.73:0/3503802875 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d5c19d500 con 0x7f0d5c100840 2023-08-10T11:50:24.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.210+0000 7f0d52ffd700 1 -- 172.21.15.73:0/3503802875 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d4c010460 con 0x7f0d5c100840 2023-08-10T11:50:24.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.210+0000 7f0d52ffd700 1 -- 172.21.15.73:0/3503802875 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c00f620 con 0x7f0d5c100840 2023-08-10T11:50:24.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.210+0000 7f0d63c8a700 1 -- 172.21.15.73:0/3503802875 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5c19da10 con 0x7f0d5c100840 2023-08-10T11:50:24.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.211+0000 7f0d63c8a700 1 -- 172.21.15.73:0/3503802875 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5c10af40 con 0x7f0d5c100840 2023-08-10T11:50:24.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.212+0000 7f0d52ffd700 1 -- 172.21.15.73:0/3503802875 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f0d4c0108d0 con 0x7f0d5c100840 2023-08-10T11:50:24.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.212+0000 7f0d52ffd700 1 --2- 172.21.15.73:0/3503802875 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0d480a11a0 0x7f0d480a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:24.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.213+0000 7f0d61a26700 1 --2- 172.21.15.73:0/3503802875 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0d480a11a0 0x7f0d480a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:24.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.213+0000 7f0d52ffd700 1 -- 172.21.15.73:0/3503802875 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f0d4c0cc3a0 con 0x7f0d5c100840 2023-08-10T11:50:24.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.213+0000 7f0d61a26700 1 --2- 172.21.15.73:0/3503802875 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0d480a11a0 0x7f0d480a3660 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800b580 tx=0x7f0d58009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:24.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.216+0000 7f0d52ffd700 1 -- 172.21.15.73:0/3503802875 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0d4c095ef0 con 0x7f0d5c100840 2023-08-10T11:50:24.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.448+0000 7f0d63c8a700 1 -- 172.21.15.73:0/3503802875 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d5c10b220 con 0x7f0d5c100840 2023-08-10T11:50:24.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.448+0000 7f0d52ffd700 1 -- 172.21.15.73:0/3503802875 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7f0d5c10b220 con 0x7f0d5c100840 2023-08-10T11:50:24.449 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:50:24.450 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-08-10T11:50:24.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.450+0000 7f0d63c8a700 1 -- 172.21.15.73:0/3503802875 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0d480a11a0 msgr2=0x7f0d480a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:24.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.450+0000 7f0d63c8a700 1 --2- 172.21.15.73:0/3503802875 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0d480a11a0 0x7f0d480a3660 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800b580 tx=0x7f0d58009f10 comp rx=0 tx=0).stop 2023-08-10T11:50:24.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.450+0000 7f0d63c8a700 1 -- 172.21.15.73:0/3503802875 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d5c100840 msgr2=0x7f0d5c195910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:24.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.450+0000 7f0d63c8a700 1 --2- 172.21.15.73:0/3503802875 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d5c100840 0x7f0d5c195910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00d950 tx=0x7f0d4c00dc60 comp rx=0 tx=0).stop 2023-08-10T11:50:24.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.450+0000 7f0d63c8a700 1 -- 172.21.15.73:0/3503802875 shutdown_connections 2023-08-10T11:50:24.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.450+0000 7f0d63c8a700 1 --2- 172.21.15.73:0/3503802875 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0d480a11a0 0x7f0d480a3660 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:24.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.450+0000 7f0d63c8a700 1 --2- 172.21.15.73:0/3503802875 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d5c1011e0 0x7f0d5c19c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:24.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.450+0000 7f0d63c8a700 1 --2- 172.21.15.73:0/3503802875 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d5c0ff650 0x7f0d5c1953d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:24.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.450+0000 7f0d63c8a700 1 --2- 172.21.15.73:0/3503802875 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d5c100840 0x7f0d5c195910 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:24.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.450+0000 7f0d63c8a700 1 -- 172.21.15.73:0/3503802875 >> 172.21.15.73:0/3503802875 conn(0x7f0d5c0faba0 msgr2=0x7f0d5c0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:24.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.450+0000 7f0d63c8a700 1 -- 172.21.15.73:0/3503802875 shutdown_connections 2023-08-10T11:50:24.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:24.450+0000 7f0d63c8a700 1 -- 172.21.15.73:0/3503802875 wait complete. 2023-08-10T11:50:24.454 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 1 2023-08-10T11:50:24.606 INFO:journalctl@ceph.mds.l.smithi156.stdout:Aug 10 11:50:24 smithi156 systemd[1]: Starting Ceph mds.l for 0e619a74-3773-11ee-9b37-001a4aab830c... 2023-08-10T11:50:24.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:24 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3305084927' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:50:24.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:24 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2179868749' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:50:24.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:24 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3503802875' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:24.886 INFO:journalctl@ceph.mds.l.smithi156.stdout:Aug 10 11:50:24 smithi156 podman[155789]: 2023-08-10T11:50:24.886 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:24 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3305084927' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:50:24.887 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:24 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/2179868749' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:50:24.887 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:24 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3503802875' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:24.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:24 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3305084927' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:50:24.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:24 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/2179868749' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:50:24.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:24 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3503802875' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:25.255 INFO:journalctl@ceph.mds.l.smithi156.stdout:Aug 10 11:50:24 smithi156 ceph-mds[155829]: -- 172.21.15.156:0/898293625 <== mon.1 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5581c7ccf1e0 con 0x5581c7ca5000 2023-08-10T11:50:25.256 INFO:journalctl@ceph.mds.l.smithi156.stdout:Aug 10 11:50:24 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-l[155805]: starting mds.l at 2023-08-10T11:50:25.256 INFO:journalctl@ceph.mds.l.smithi156.stdout:Aug 10 11:50:24 smithi156 bash[155789]: e6f48c61db4ddd9691665e786f16bf95c7409203197d7666cc898d8fb67139f2 2023-08-10T11:50:25.256 INFO:journalctl@ceph.mds.l.smithi156.stdout:Aug 10 11:50:24 smithi156 systemd[1]: Started Ceph mds.l for 0e619a74-3773-11ee-9b37-001a4aab830c. 2023-08-10T11:50:26.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:25 smithi152 ceph-mon[130220]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:26.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:25 smithi152 ceph-mon[130220]: mds.? [v2:172.21.15.156:6832/3028461815,v1:172.21.15.156:6833/3028461815] up:boot 2023-08-10T11:50:26.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:25 smithi152 ceph-mon[130220]: fsmap 1 up:standby 2023-08-10T11:50:26.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:25 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-08-10T11:50:26.211 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:25 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:26.212 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:25 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:26.212 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:25 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:26.212 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:25 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:26.212 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:25 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:26.212 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:25 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:26.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:25 smithi156 ceph-mon[130574]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:26.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:25 smithi156 ceph-mon[130574]: mds.? [v2:172.21.15.156:6832/3028461815,v1:172.21.15.156:6833/3028461815] up:boot 2023-08-10T11:50:26.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:25 smithi156 ceph-mon[130574]: fsmap 1 up:standby 2023-08-10T11:50:26.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:25 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-08-10T11:50:26.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:25 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:26.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:25 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:26.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:25 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:26.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:25 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:26.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:25 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:26.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:25 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:26.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:25 smithi073 ceph-mon[128869]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:26.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:25 smithi073 ceph-mon[128869]: mds.? [v2:172.21.15.156:6832/3028461815,v1:172.21.15.156:6833/3028461815] up:boot 2023-08-10T11:50:26.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:25 smithi073 ceph-mon[128869]: fsmap 1 up:standby 2023-08-10T11:50:26.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:25 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-08-10T11:50:26.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:25 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:26.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:25 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:26.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:25 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:26.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:25 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:26.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:25 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:26.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:25 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:26.464 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T11:50:26.495 INFO:journalctl@ceph.mds.k.smithi152.stdout:Aug 10 11:50:26 smithi152 systemd[1]: Starting Ceph mds.k for 0e619a74-3773-11ee-9b37-001a4aab830c... 2023-08-10T11:50:26.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.598+0000 7f4f03efa700 1 -- 172.21.15.73:0/1539879267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4efc100840 msgr2=0x7f4efc100ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:26.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.598+0000 7f4f03efa700 1 --2- 172.21.15.73:0/1539879267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4efc100840 0x7f4efc100ca0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4eec0099c0 tx=0x7f4eec009cd0 comp rx=0 tx=0).stop 2023-08-10T11:50:26.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.598+0000 7f4f03efa700 1 -- 172.21.15.73:0/1539879267 shutdown_connections 2023-08-10T11:50:26.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.598+0000 7f4f03efa700 1 --2- 172.21.15.73:0/1539879267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4efc0ff650 0x7f4efc0ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:26.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.598+0000 7f4f03efa700 1 --2- 172.21.15.73:0/1539879267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4efc1011e0 0x7f4efc107a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:26.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.598+0000 7f4f03efa700 1 --2- 172.21.15.73:0/1539879267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4efc100840 0x7f4efc100ca0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:26.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.598+0000 7f4f03efa700 1 -- 172.21.15.73:0/1539879267 >> 172.21.15.73:0/1539879267 conn(0x7f4efc0faba0 msgr2=0x7f4efc0fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:26.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.598+0000 7f4f03efa700 1 -- 172.21.15.73:0/1539879267 shutdown_connections 2023-08-10T11:50:26.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.598+0000 7f4f03efa700 1 -- 172.21.15.73:0/1539879267 wait complete. 2023-08-10T11:50:26.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.598+0000 7f4f03efa700 1 Processor -- start 2023-08-10T11:50:26.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.598+0000 7f4f03efa700 1 -- start start 2023-08-10T11:50:26.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.599+0000 7f4f03efa700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4efc0ff650 0x7f4efc195300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:26.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.599+0000 7f4f03efa700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4efc100840 0x7f4efc195840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:26.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.599+0000 7f4f03efa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4efc1011e0 0x7f4efc19c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:26.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.599+0000 7f4f03efa700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc19ce80 con 0x7f4efc0ff650 2023-08-10T11:50:26.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.599+0000 7f4f03efa700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc19cfc0 con 0x7f4efc1011e0 2023-08-10T11:50:26.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.599+0000 7f4f03efa700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc19d150 con 0x7f4efc100840 2023-08-10T11:50:26.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.599+0000 7f4f01c96700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4efc0ff650 0x7f4efc195300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:26.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.599+0000 7f4f01c96700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4efc0ff650 0x7f4efc195300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58626/0 (socket says 172.21.15.73:58626) 2023-08-10T11:50:26.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.599+0000 7f4f01c96700 1 -- 172.21.15.73:0/4214075122 learned_addr learned my addr 172.21.15.73:0/4214075122 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:26.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.599+0000 7f4f02497700 1 --2- 172.21.15.73:0/4214075122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4efc1011e0 0x7f4efc19c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:26.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.599+0000 7f4f01495700 1 --2- 172.21.15.73:0/4214075122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4efc100840 0x7f4efc195840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:26.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.599+0000 7f4f01c96700 1 -- 172.21.15.73:0/4214075122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4efc100840 msgr2=0x7f4efc195840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:26.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.599+0000 7f4f01c96700 1 --2- 172.21.15.73:0/4214075122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4efc100840 0x7f4efc195840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:26.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.599+0000 7f4f01c96700 1 -- 172.21.15.73:0/4214075122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4efc1011e0 msgr2=0x7f4efc19c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:26.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.599+0000 7f4f01c96700 1 --2- 172.21.15.73:0/4214075122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4efc1011e0 0x7f4efc19c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:26.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.599+0000 7f4f01c96700 1 -- 172.21.15.73:0/4214075122 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec0095f0 con 0x7f4efc0ff650 2023-08-10T11:50:26.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.599+0000 7f4f02497700 1 --2- 172.21.15.73:0/4214075122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4efc1011e0 0x7f4efc19c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:50:26.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.599+0000 7f4f01c96700 1 --2- 172.21.15.73:0/4214075122 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4efc0ff650 0x7f4efc195300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4ef800ea80 tx=0x7f4ef800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:26.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.599+0000 7f4ef2ffd700 1 -- 172.21.15.73:0/4214075122 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8013070 con 0x7f4efc0ff650 2023-08-10T11:50:26.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.599+0000 7f4ef2ffd700 1 -- 172.21.15.73:0/4214075122 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ef8004020 con 0x7f4efc0ff650 2023-08-10T11:50:26.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.599+0000 7f4f03efa700 1 -- 172.21.15.73:0/4214075122 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4efc067930 con 0x7f4efc0ff650 2023-08-10T11:50:26.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.599+0000 7f4ef2ffd700 1 -- 172.21.15.73:0/4214075122 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8003b70 con 0x7f4efc0ff650 2023-08-10T11:50:26.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.599+0000 7f4f03efa700 1 -- 172.21.15.73:0/4214075122 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4efc067e90 con 0x7f4efc0ff650 2023-08-10T11:50:26.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.600+0000 7f4f03efa700 1 -- 172.21.15.73:0/4214075122 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4efc10ae60 con 0x7f4efc0ff650 2023-08-10T11:50:26.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.601+0000 7f4ef2ffd700 1 -- 172.21.15.73:0/4214075122 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f4ef8004190 con 0x7f4efc0ff650 2023-08-10T11:50:26.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.602+0000 7f4ef2ffd700 1 --2- 172.21.15.73:0/4214075122 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4ee80a1220 0x7f4ee80a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:26.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.602+0000 7f4ef2ffd700 1 -- 172.21.15.73:0/4214075122 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f4ef80ce3c0 con 0x7f4efc0ff650 2023-08-10T11:50:26.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.602+0000 7f4f01495700 1 --2- 172.21.15.73:0/4214075122 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4ee80a1220 0x7f4ee80a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:26.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.602+0000 7f4f01495700 1 --2- 172.21.15.73:0/4214075122 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4ee80a1220 0x7f4ee80a36e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4eec00b580 tx=0x7f4eec01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:26.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.605+0000 7f4ef2ffd700 1 -- 172.21.15.73:0/4214075122 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f4ef8097fb0 con 0x7f4efc0ff650 2023-08-10T11:50:26.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.841+0000 7f4f03efa700 1 -- 172.21.15.73:0/4214075122 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4efc068780 con 0x7f4efc0ff650 2023-08-10T11:50:26.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.841+0000 7f4ef2ffd700 1 -- 172.21.15.73:0/4214075122 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1260 (secure 0 0 0) 0x7f4ef8003cd0 con 0x7f4efc0ff650 2023-08-10T11:50:26.842 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:50:26.842 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3028461815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3028461815},{"type":"v1","addr":"172.21.15.156:6833","nonce":3028461815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-08-10T11:50:26.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.843+0000 7f4f03efa700 1 -- 172.21.15.73:0/4214075122 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4ee80a1220 msgr2=0x7f4ee80a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:26.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.843+0000 7f4f03efa700 1 --2- 172.21.15.73:0/4214075122 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4ee80a1220 0x7f4ee80a36e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4eec00b580 tx=0x7f4eec01a040 comp rx=0 tx=0).stop 2023-08-10T11:50:26.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.843+0000 7f4f03efa700 1 -- 172.21.15.73:0/4214075122 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4efc0ff650 msgr2=0x7f4efc195300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:26.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.843+0000 7f4f03efa700 1 --2- 172.21.15.73:0/4214075122 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4efc0ff650 0x7f4efc195300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4ef800ea80 tx=0x7f4ef800ee40 comp rx=0 tx=0).stop 2023-08-10T11:50:26.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.843+0000 7f4f03efa700 1 -- 172.21.15.73:0/4214075122 shutdown_connections 2023-08-10T11:50:26.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.843+0000 7f4f03efa700 1 --2- 172.21.15.73:0/4214075122 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4ee80a1220 0x7f4ee80a36e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:26.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.843+0000 7f4f03efa700 1 --2- 172.21.15.73:0/4214075122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4efc1011e0 0x7f4efc19c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:26.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.843+0000 7f4f03efa700 1 --2- 172.21.15.73:0/4214075122 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4efc0ff650 0x7f4efc195300 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:26.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.843+0000 7f4f03efa700 1 --2- 172.21.15.73:0/4214075122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4efc100840 0x7f4efc195840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:26.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.843+0000 7f4f03efa700 1 -- 172.21.15.73:0/4214075122 >> 172.21.15.73:0/4214075122 conn(0x7f4efc0faba0 msgr2=0x7f4efc0fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:26.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.844+0000 7f4f03efa700 1 -- 172.21.15.73:0/4214075122 shutdown_connections 2023-08-10T11:50:26.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:26.844+0000 7f4f03efa700 1 -- 172.21.15.73:0/4214075122 wait complete. 2023-08-10T11:50:26.846 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 2 2023-08-10T11:50:26.999 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:26 smithi152 ceph-mon[130220]: Deploying daemon mds.k on smithi152 2023-08-10T11:50:27.000 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:26 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/4214075122' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:27.000 INFO:journalctl@ceph.mds.k.smithi152.stdout:Aug 10 11:50:26 smithi152 podman[154593]: 2023-08-10T11:50:27.000 INFO:journalctl@ceph.mds.k.smithi152.stdout:Aug 10 11:50:26 smithi152 ceph-mds[154634]: -- 172.21.15.152:0/3058073536 <== mon.2 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562129e411e0 con 0x562129e16c00 2023-08-10T11:50:27.000 INFO:journalctl@ceph.mds.k.smithi152.stdout:Aug 10 11:50:26 smithi152 bash[154593]: 17c81e507fbbfdbf9220ce1cf88b20274a7dbdbb0a77f03a92480982607c9146 2023-08-10T11:50:27.001 INFO:journalctl@ceph.mds.k.smithi152.stdout:Aug 10 11:50:26 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-k[154610]: starting mds.k at 2023-08-10T11:50:27.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:26 smithi156 ceph-mon[130574]: Deploying daemon mds.k on smithi152 2023-08-10T11:50:27.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:26 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/4214075122' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:27.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:26 smithi073 ceph-mon[128869]: Deploying daemon mds.k on smithi152 2023-08-10T11:50:27.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:26 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/4214075122' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:27.495 INFO:journalctl@ceph.mds.k.smithi152.stdout:Aug 10 11:50:27 smithi152 systemd[1]: Started Ceph mds.k for 0e619a74-3773-11ee-9b37-001a4aab830c. 2023-08-10T11:50:28.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:27 smithi073 ceph-mon[128869]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:28.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:27 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:28.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:27 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:28.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:27 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:28.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:27 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:28.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:27 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:28.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:27 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:28.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:27 smithi152 ceph-mon[130220]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:28.281 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:27 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:28.281 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:27 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:28.281 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:27 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:28.282 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:27 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:28.282 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:27 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:28.282 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:27 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:28.282 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:27 smithi156 ceph-mon[130574]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:28.283 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:27 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:28.283 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:27 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:28.283 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:27 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:28.283 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:27 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:28.283 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:27 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:28.283 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:27 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:28.767 INFO:journalctl@ceph.mds.j.smithi073.stdout:Aug 10 11:50:28 smithi073 systemd[1]: Starting Ceph mds.j for 0e619a74-3773-11ee-9b37-001a4aab830c... 2023-08-10T11:50:28.856 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T11:50:28.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.984+0000 7fb508e1f700 1 -- 172.21.15.73:0/3450917709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5040fede0 msgr2=0x7fb5040ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:28.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.984+0000 7fb508e1f700 1 --2- 172.21.15.73:0/3450917709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5040fede0 0x7fb5040ff200 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80099c0 tx=0x7fb4f8009cd0 comp rx=0 tx=0).stop 2023-08-10T11:50:28.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.984+0000 7fb508e1f700 1 -- 172.21.15.73:0/3450917709 shutdown_connections 2023-08-10T11:50:28.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.984+0000 7fb508e1f700 1 --2- 172.21.15.73:0/3450917709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb504100970 0x7fb504107220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:28.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.984+0000 7fb508e1f700 1 --2- 172.21.15.73:0/3450917709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5040fede0 0x7fb5040ff200 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:28.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.984+0000 7fb508e1f700 1 --2- 172.21.15.73:0/3450917709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5040fffd0 0x7fb504100430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:28.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.984+0000 7fb508e1f700 1 -- 172.21.15.73:0/3450917709 >> 172.21.15.73:0/3450917709 conn(0x7fb5040fa330 msgr2=0x7fb5040fc790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:28.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.984+0000 7fb508e1f700 1 -- 172.21.15.73:0/3450917709 shutdown_connections 2023-08-10T11:50:28.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.984+0000 7fb508e1f700 1 -- 172.21.15.73:0/3450917709 wait complete. 2023-08-10T11:50:28.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.985+0000 7fb508e1f700 1 Processor -- start 2023-08-10T11:50:28.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.985+0000 7fb508e1f700 1 -- start start 2023-08-10T11:50:28.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.986+0000 7fb508e1f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5040fede0 0x7fb504198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:28.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.986+0000 7fb508e1f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5040fffd0 0x7fb504198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:28.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.986+0000 7fb508e1f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb504100970 0x7fb50419fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:28.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.986+0000 7fb508e1f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5041a0180 con 0x7fb5040fffd0 2023-08-10T11:50:28.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.986+0000 7fb508e1f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5041a02c0 con 0x7fb5040fede0 2023-08-10T11:50:28.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.986+0000 7fb508e1f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5041a0450 con 0x7fb504100970 2023-08-10T11:50:28.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.986+0000 7fb501d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5040fffd0 0x7fb504198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:28.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.986+0000 7fb501d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5040fffd0 0x7fb504198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58640/0 (socket says 172.21.15.73:58640) 2023-08-10T11:50:28.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.986+0000 7fb501d9b700 1 -- 172.21.15.73:0/141373942 learned_addr learned my addr 172.21.15.73:0/141373942 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:28.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.986+0000 7fb50259c700 1 --2- 172.21.15.73:0/141373942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5040fede0 0x7fb504198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:28.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.986+0000 7fb502d9d700 1 --2- 172.21.15.73:0/141373942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb504100970 0x7fb50419fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:28.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.986+0000 7fb501d9b700 1 -- 172.21.15.73:0/141373942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb504100970 msgr2=0x7fb50419fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:28.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.986+0000 7fb501d9b700 1 --2- 172.21.15.73:0/141373942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb504100970 0x7fb50419fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:28.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.986+0000 7fb501d9b700 1 -- 172.21.15.73:0/141373942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5040fede0 msgr2=0x7fb504198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:28.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.986+0000 7fb501d9b700 1 --2- 172.21.15.73:0/141373942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5040fede0 0x7fb504198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:28.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.986+0000 7fb501d9b700 1 -- 172.21.15.73:0/141373942 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f80095f0 con 0x7fb5040fffd0 2023-08-10T11:50:28.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.986+0000 7fb501d9b700 1 --2- 172.21.15.73:0/141373942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5040fffd0 0x7fb504198b40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400d950 tx=0x7fb4f400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:28.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.986+0000 7fb4f37fe700 1 -- 172.21.15.73:0/141373942 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f400f890 con 0x7fb5040fffd0 2023-08-10T11:50:28.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.986+0000 7fb4f37fe700 1 -- 172.21.15.73:0/141373942 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4f4010460 con 0x7fb5040fffd0 2023-08-10T11:50:28.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.986+0000 7fb508e1f700 1 -- 172.21.15.73:0/141373942 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5041a0730 con 0x7fb5040fffd0 2023-08-10T11:50:28.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.986+0000 7fb4f37fe700 1 -- 172.21.15.73:0/141373942 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f400e610 con 0x7fb5040fffd0 2023-08-10T11:50:28.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.986+0000 7fb508e1f700 1 -- 172.21.15.73:0/141373942 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5041a0c40 con 0x7fb5040fffd0 2023-08-10T11:50:28.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.987+0000 7fb508e1f700 1 -- 172.21.15.73:0/141373942 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5041059b0 con 0x7fb5040fffd0 2023-08-10T11:50:28.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.988+0000 7fb4f37fe700 1 -- 172.21.15.73:0/141373942 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fb4f40108d0 con 0x7fb5040fffd0 2023-08-10T11:50:28.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.989+0000 7fb4f37fe700 1 --2- 172.21.15.73:0/141373942 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb4ec0a11a0 0x7fb4ec0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:28.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.989+0000 7fb50259c700 1 --2- 172.21.15.73:0/141373942 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb4ec0a11a0 0x7fb4ec0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:28.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.989+0000 7fb4f37fe700 1 -- 172.21.15.73:0/141373942 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb4f40cc250 con 0x7fb5040fffd0 2023-08-10T11:50:28.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.989+0000 7fb50259c700 1 --2- 172.21.15.73:0/141373942 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb4ec0a11a0 0x7fb4ec0a3660 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8009f50 tx=0x7fb4f800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:28.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:28.993+0000 7fb4f37fe700 1 -- 172.21.15.73:0/141373942 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fb4f4095e40 con 0x7fb5040fffd0 2023-08-10T11:50:29.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:29.239+0000 7fb508e1f700 1 -- 172.21.15.73:0/141373942 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb50402cb40 con 0x7fb5040fffd0 2023-08-10T11:50:29.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:29.240+0000 7fb4f37fe700 1 -- 172.21.15.73:0/141373942 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2020 (secure 0 0 0) 0x7fb4f4099460 con 0x7fb5040fffd0 2023-08-10T11:50:29.241 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:50:29.241 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3028461815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3028461815},{"type":"v1","addr":"172.21.15.156:6833","nonce":3028461815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/4148407154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4148407154},{"type":"v1","addr":"172.21.15.152:6833","nonce":4148407154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-08-10T11:50:29.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:29.242+0000 7fb508e1f700 1 -- 172.21.15.73:0/141373942 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb4ec0a11a0 msgr2=0x7fb4ec0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:29.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:29.242+0000 7fb508e1f700 1 --2- 172.21.15.73:0/141373942 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb4ec0a11a0 0x7fb4ec0a3660 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8009f50 tx=0x7fb4f800b540 comp rx=0 tx=0).stop 2023-08-10T11:50:29.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:29.242+0000 7fb508e1f700 1 -- 172.21.15.73:0/141373942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5040fffd0 msgr2=0x7fb504198b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:29.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:29.242+0000 7fb508e1f700 1 --2- 172.21.15.73:0/141373942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5040fffd0 0x7fb504198b40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400d950 tx=0x7fb4f400dc60 comp rx=0 tx=0).stop 2023-08-10T11:50:29.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:29.242+0000 7fb508e1f700 1 -- 172.21.15.73:0/141373942 shutdown_connections 2023-08-10T11:50:29.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:29.242+0000 7fb508e1f700 1 --2- 172.21.15.73:0/141373942 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb4ec0a11a0 0x7fb4ec0a3660 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:29.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:29.242+0000 7fb508e1f700 1 --2- 172.21.15.73:0/141373942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5040fede0 0x7fb504198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:29.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:29.242+0000 7fb508e1f700 1 --2- 172.21.15.73:0/141373942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb504100970 0x7fb50419fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:29.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:29.242+0000 7fb508e1f700 1 --2- 172.21.15.73:0/141373942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5040fffd0 0x7fb504198b40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:29.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:29.242+0000 7fb508e1f700 1 -- 172.21.15.73:0/141373942 >> 172.21.15.73:0/141373942 conn(0x7fb5040fa330 msgr2=0x7fb5040fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:29.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:29.242+0000 7fb508e1f700 1 -- 172.21.15.73:0/141373942 shutdown_connections 2023-08-10T11:50:29.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:29.242+0000 7fb508e1f700 1 -- 172.21.15.73:0/141373942 wait complete. 2023-08-10T11:50:29.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:28 smithi152 ceph-mon[130220]: Deploying daemon mds.j on smithi073 2023-08-10T11:50:29.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:28 smithi152 ceph-mon[130220]: mds.? [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] up:boot 2023-08-10T11:50:29.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:28 smithi152 ceph-mon[130220]: fsmap 2 up:standby 2023-08-10T11:50:29.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:28 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-08-10T11:50:29.246 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 3 2023-08-10T11:50:29.255 INFO:journalctl@ceph.mds.j.smithi073.stdout:Aug 10 11:50:28 smithi073 podman[162118]: 2023-08-10T11:50:29.255 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:28 smithi073 ceph-mon[128869]: Deploying daemon mds.j on smithi073 2023-08-10T11:50:29.255 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:28 smithi073 ceph-mon[128869]: mds.? [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] up:boot 2023-08-10T11:50:29.256 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:28 smithi073 ceph-mon[128869]: fsmap 2 up:standby 2023-08-10T11:50:29.256 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:28 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-08-10T11:50:29.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:28 smithi156 ceph-mon[130574]: Deploying daemon mds.j on smithi073 2023-08-10T11:50:29.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:28 smithi156 ceph-mon[130574]: mds.? [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] up:boot 2023-08-10T11:50:29.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:28 smithi156 ceph-mon[130574]: fsmap 2 up:standby 2023-08-10T11:50:29.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:28 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-08-10T11:50:29.517 INFO:journalctl@ceph.mds.j.smithi073.stdout:Aug 10 11:50:29 smithi073 ceph-mds[162201]: -- 172.21.15.73:0/1458308312 <== mon.0 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d0f52ef1e0 con 0x55d0f52c4800 2023-08-10T11:50:29.518 INFO:journalctl@ceph.mds.j.smithi073.stdout:Aug 10 11:50:29 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-j[162177]: starting mds.j at 2023-08-10T11:50:29.518 INFO:journalctl@ceph.mds.j.smithi073.stdout:Aug 10 11:50:29 smithi073 bash[162118]: 8193c1af06e293bd3f1b9dc0cc07b6c8b6fdfe9f4011f090d1a6fbb37b080838 2023-08-10T11:50:29.518 INFO:journalctl@ceph.mds.j.smithi073.stdout:Aug 10 11:50:29 smithi073 systemd[1]: Started Ceph mds.j for 0e619a74-3773-11ee-9b37-001a4aab830c. 2023-08-10T11:50:30.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:29 smithi152 ceph-mon[130220]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:30.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:29 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/141373942' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:30.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:29 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:30.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:29 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:30.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:29 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:30.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:29 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:30.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:29 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:30.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:29 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:30.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:29 smithi156 ceph-mon[130574]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:30.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:29 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/141373942' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:30.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:29 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:30.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:29 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:30.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:29 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:30.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:29 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:30.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:29 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:30.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:29 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:30.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:29 smithi073 ceph-mon[128869]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:30.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:29 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/141373942' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:30.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:29 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:30.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:29 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:30.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:29 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:30.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:29 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:30.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:29 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:30.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:29 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:31.007 INFO:journalctl@ceph.mds.d.smithi073.stdout:Aug 10 11:50:31 smithi073 systemd[1]: Starting Ceph mds.d for 0e619a74-3773-11ee-9b37-001a4aab830c... 2023-08-10T11:50:31.007 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:30 smithi073 ceph-mon[128869]: Deploying daemon mds.d on smithi073 2023-08-10T11:50:31.007 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:30 smithi073 ceph-mon[128869]: mds.? [v2:172.21.15.73:6834/1319360725,v1:172.21.15.73:6835/1319360725] up:boot 2023-08-10T11:50:31.007 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:30 smithi073 ceph-mon[128869]: fsmap 3 up:standby 2023-08-10T11:50:31.008 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:30 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-08-10T11:50:31.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:30 smithi152 ceph-mon[130220]: Deploying daemon mds.d on smithi073 2023-08-10T11:50:31.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:30 smithi152 ceph-mon[130220]: mds.? [v2:172.21.15.73:6834/1319360725,v1:172.21.15.73:6835/1319360725] up:boot 2023-08-10T11:50:31.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:30 smithi152 ceph-mon[130220]: fsmap 3 up:standby 2023-08-10T11:50:31.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:30 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-08-10T11:50:31.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:30 smithi156 ceph-mon[130574]: Deploying daemon mds.d on smithi073 2023-08-10T11:50:31.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:30 smithi156 ceph-mon[130574]: mds.? [v2:172.21.15.73:6834/1319360725,v1:172.21.15.73:6835/1319360725] up:boot 2023-08-10T11:50:31.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:30 smithi156 ceph-mon[130574]: fsmap 3 up:standby 2023-08-10T11:50:31.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:30 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-08-10T11:50:31.258 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T11:50:31.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.392+0000 7fb58b3b7700 1 -- 172.21.15.73:0/3178891632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb584100870 msgr2=0x7fb584100cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:31.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.392+0000 7fb58b3b7700 1 --2- 172.21.15.73:0/3178891632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb584100870 0x7fb584100cd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb5740099c0 tx=0x7fb574009cd0 comp rx=0 tx=0).stop 2023-08-10T11:50:31.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.392+0000 7fb58b3b7700 1 -- 172.21.15.73:0/3178891632 shutdown_connections 2023-08-10T11:50:31.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.392+0000 7fb58b3b7700 1 --2- 172.21.15.73:0/3178891632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5840ff680 0x7fb5840ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:31.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.392+0000 7fb58b3b7700 1 --2- 172.21.15.73:0/3178891632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb584101210 0x7fb584107ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:31.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.392+0000 7fb58b3b7700 1 --2- 172.21.15.73:0/3178891632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb584100870 0x7fb584100cd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:31.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.392+0000 7fb58b3b7700 1 -- 172.21.15.73:0/3178891632 >> 172.21.15.73:0/3178891632 conn(0x7fb5840fabf0 msgr2=0x7fb5840fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:31.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.392+0000 7fb58b3b7700 1 -- 172.21.15.73:0/3178891632 shutdown_connections 2023-08-10T11:50:31.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.392+0000 7fb58b3b7700 1 -- 172.21.15.73:0/3178891632 wait complete. 2023-08-10T11:50:31.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.392+0000 7fb58b3b7700 1 Processor -- start 2023-08-10T11:50:31.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.393+0000 7fb58b3b7700 1 -- start start 2023-08-10T11:50:31.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.393+0000 7fb58b3b7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5840ff680 0x7fb584069680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:31.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.393+0000 7fb58b3b7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb584100870 0x7fb58419b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:31.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.393+0000 7fb58b3b7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb584101210 0x7fb58419d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:31.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.393+0000 7fb58b3b7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58419df60 con 0x7fb5840ff680 2023-08-10T11:50:31.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.393+0000 7fb58b3b7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58419e0d0 con 0x7fb584101210 2023-08-10T11:50:31.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.393+0000 7fb58b3b7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58419e290 con 0x7fb584100870 2023-08-10T11:50:31.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.393+0000 7fb589153700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5840ff680 0x7fb584069680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:31.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.393+0000 7fb589153700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5840ff680 0x7fb584069680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58664/0 (socket says 172.21.15.73:58664) 2023-08-10T11:50:31.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.393+0000 7fb589153700 1 -- 172.21.15.73:0/1140781417 learned_addr learned my addr 172.21.15.73:0/1140781417 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:31.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.393+0000 7fb589954700 1 --2- 172.21.15.73:0/1140781417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb584101210 0x7fb58419d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:31.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.393+0000 7fb588952700 1 --2- 172.21.15.73:0/1140781417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb584100870 0x7fb58419b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:31.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.393+0000 7fb589153700 1 -- 172.21.15.73:0/1140781417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb584100870 msgr2=0x7fb58419b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:31.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.393+0000 7fb589153700 1 --2- 172.21.15.73:0/1140781417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb584100870 0x7fb58419b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:31.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.393+0000 7fb589153700 1 -- 172.21.15.73:0/1140781417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb584101210 msgr2=0x7fb58419d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:31.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.393+0000 7fb589153700 1 --2- 172.21.15.73:0/1140781417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb584101210 0x7fb58419d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:31.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.393+0000 7fb589153700 1 -- 172.21.15.73:0/1140781417 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5740095f0 con 0x7fb5840ff680 2023-08-10T11:50:31.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.393+0000 7fb589153700 1 --2- 172.21.15.73:0/1140781417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5840ff680 0x7fb584069680 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb58000c970 tx=0x7fb58000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:31.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.393+0000 7fb57a7fc700 1 -- 172.21.15.73:0/1140781417 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb580004220 con 0x7fb5840ff680 2023-08-10T11:50:31.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.393+0000 7fb57a7fc700 1 -- 172.21.15.73:0/1140781417 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb580004380 con 0x7fb5840ff680 2023-08-10T11:50:31.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.393+0000 7fb58b3b7700 1 -- 172.21.15.73:0/1140781417 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58419e570 con 0x7fb5840ff680 2023-08-10T11:50:31.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.393+0000 7fb57a7fc700 1 -- 172.21.15.73:0/1140781417 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb580003b50 con 0x7fb5840ff680 2023-08-10T11:50:31.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.394+0000 7fb58b3b7700 1 -- 172.21.15.73:0/1140781417 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58419eaa0 con 0x7fb5840ff680 2023-08-10T11:50:31.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.394+0000 7fb58b3b7700 1 -- 172.21.15.73:0/1140781417 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5841065b0 con 0x7fb5840ff680 2023-08-10T11:50:31.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.395+0000 7fb57a7fc700 1 -- 172.21.15.73:0/1140781417 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fb580003cd0 con 0x7fb5840ff680 2023-08-10T11:50:31.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.396+0000 7fb57a7fc700 1 --2- 172.21.15.73:0/1140781417 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb5700a1220 0x7fb5700a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:31.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.396+0000 7fb588952700 1 --2- 172.21.15.73:0/1140781417 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb5700a1220 0x7fb5700a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:31.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.396+0000 7fb57a7fc700 1 -- 172.21.15.73:0/1140781417 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb5800cc350 con 0x7fb5840ff680 2023-08-10T11:50:31.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.396+0000 7fb588952700 1 --2- 172.21.15.73:0/1140781417 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb5700a1220 0x7fb5700a36e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb574000c00 tx=0x7fb574009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:31.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.399+0000 7fb57a7fc700 1 -- 172.21.15.73:0/1140781417 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fb580095f20 con 0x7fb5840ff680 2023-08-10T11:50:31.517 INFO:journalctl@ceph.mds.d.smithi073.stdout:Aug 10 11:50:31 smithi073 podman[162503]: 2023-08-10T11:50:31.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.642+0000 7fb58b3b7700 1 -- 172.21.15.73:0/1140781417 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb58402c970 con 0x7fb5840ff680 2023-08-10T11:50:31.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.642+0000 7fb57a7fc700 1 -- 172.21.15.73:0/1140781417 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2777 (secure 0 0 0) 0x7fb58001daf0 con 0x7fb5840ff680 2023-08-10T11:50:31.644 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:50:31.644 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1319360725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1319360725},{"type":"v1","addr":"172.21.15.73:6835","nonce":1319360725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3028461815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3028461815},{"type":"v1","addr":"172.21.15.156:6833","nonce":3028461815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/4148407154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4148407154},{"type":"v1","addr":"172.21.15.152:6833","nonce":4148407154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-08-10T11:50:31.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.645+0000 7fb58b3b7700 1 -- 172.21.15.73:0/1140781417 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb5700a1220 msgr2=0x7fb5700a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:31.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.645+0000 7fb58b3b7700 1 --2- 172.21.15.73:0/1140781417 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb5700a1220 0x7fb5700a36e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb574000c00 tx=0x7fb574009f10 comp rx=0 tx=0).stop 2023-08-10T11:50:31.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.645+0000 7fb58b3b7700 1 -- 172.21.15.73:0/1140781417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5840ff680 msgr2=0x7fb584069680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:31.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.645+0000 7fb58b3b7700 1 --2- 172.21.15.73:0/1140781417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5840ff680 0x7fb584069680 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb58000c970 tx=0x7fb58000cc80 comp rx=0 tx=0).stop 2023-08-10T11:50:31.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.645+0000 7fb58b3b7700 1 -- 172.21.15.73:0/1140781417 shutdown_connections 2023-08-10T11:50:31.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.645+0000 7fb58b3b7700 1 --2- 172.21.15.73:0/1140781417 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb5700a1220 0x7fb5700a36e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:31.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.645+0000 7fb58b3b7700 1 --2- 172.21.15.73:0/1140781417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb584101210 0x7fb58419d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:31.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.645+0000 7fb58b3b7700 1 --2- 172.21.15.73:0/1140781417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5840ff680 0x7fb584069680 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:31.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.645+0000 7fb58b3b7700 1 --2- 172.21.15.73:0/1140781417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb584100870 0x7fb58419b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:31.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.645+0000 7fb58b3b7700 1 -- 172.21.15.73:0/1140781417 >> 172.21.15.73:0/1140781417 conn(0x7fb5840fabf0 msgr2=0x7fb5840fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:31.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.645+0000 7fb58b3b7700 1 -- 172.21.15.73:0/1140781417 shutdown_connections 2023-08-10T11:50:31.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:31.645+0000 7fb58b3b7700 1 -- 172.21.15.73:0/1140781417 wait complete. 2023-08-10T11:50:31.647 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 4 2023-08-10T11:50:31.909 INFO:journalctl@ceph.mds.d.smithi073.stdout:Aug 10 11:50:31 smithi073 ceph-mds[162586]: -- 172.21.15.73:0/2878346758 <== mon.0 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5592c88631e0 con 0x5592c8838800 2023-08-10T11:50:31.909 INFO:journalctl@ceph.mds.d.smithi073.stdout:Aug 10 11:50:31 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-d[162542]: starting mds.d at 2023-08-10T11:50:31.910 INFO:journalctl@ceph.mds.d.smithi073.stdout:Aug 10 11:50:31 smithi073 bash[162503]: d51aa060b9f1dbfa9abbea21973472a0610ac33e98f6e80f981f342dd7cd32cd 2023-08-10T11:50:31.910 INFO:journalctl@ceph.mds.d.smithi073.stdout:Aug 10 11:50:31 smithi073 systemd[1]: Started Ceph mds.d for 0e619a74-3773-11ee-9b37-001a4aab830c. 2023-08-10T11:50:32.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:31 smithi152 ceph-mon[130220]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:32.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:31 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1140781417' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:32.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:31 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:32.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:31 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:32.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:31 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:32.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:31 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:32.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:31 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:32.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:31 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:32.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:31 smithi156 ceph-mon[130574]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:32.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:31 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1140781417' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:32.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:31 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:32.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:31 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:32.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:31 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:32.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:31 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:32.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:31 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:32.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:31 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:32.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:31 smithi073 ceph-mon[128869]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:32.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:31 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1140781417' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:32.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:31 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:32.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:31 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:32.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:31 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:32.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:31 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:32.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:31 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:32.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:31 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:32.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:32 smithi152 ceph-mon[130220]: Deploying daemon mds.e on smithi152 2023-08-10T11:50:32.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:32 smithi152 ceph-mon[130220]: mds.? [v2:172.21.15.73:6836/431221951,v1:172.21.15.73:6837/431221951] up:boot 2023-08-10T11:50:32.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:32 smithi152 ceph-mon[130220]: fsmap 4 up:standby 2023-08-10T11:50:32.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:32 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-08-10T11:50:33.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:32 smithi156 ceph-mon[130574]: Deploying daemon mds.e on smithi152 2023-08-10T11:50:33.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:32 smithi156 ceph-mon[130574]: mds.? [v2:172.21.15.73:6836/431221951,v1:172.21.15.73:6837/431221951] up:boot 2023-08-10T11:50:33.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:32 smithi156 ceph-mon[130574]: fsmap 4 up:standby 2023-08-10T11:50:33.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:32 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-08-10T11:50:33.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:32 smithi073 ceph-mon[128869]: Deploying daemon mds.e on smithi152 2023-08-10T11:50:33.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:32 smithi073 ceph-mon[128869]: mds.? [v2:172.21.15.73:6836/431221951,v1:172.21.15.73:6837/431221951] up:boot 2023-08-10T11:50:33.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:32 smithi073 ceph-mon[128869]: fsmap 4 up:standby 2023-08-10T11:50:33.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:32 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-08-10T11:50:33.495 INFO:journalctl@ceph.mds.e.smithi152.stdout:Aug 10 11:50:33 smithi152 systemd[1]: Starting Ceph mds.e for 0e619a74-3773-11ee-9b37-001a4aab830c... 2023-08-10T11:50:33.659 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T11:50:33.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.793+0000 7f038df86700 1 -- 172.21.15.73:0/337021589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0388102460 msgr2=0x7f0388108d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:33.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.793+0000 7f038df86700 1 --2- 172.21.15.73:0/337021589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0388102460 0x7f0388108d10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f038000b0a0 tx=0x7f038000b3b0 comp rx=0 tx=0).stop 2023-08-10T11:50:33.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.793+0000 7f038df86700 1 -- 172.21.15.73:0/337021589 shutdown_connections 2023-08-10T11:50:33.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.793+0000 7f038df86700 1 --2- 172.21.15.73:0/337021589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0388102460 0x7f0388108d10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:33.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.793+0000 7f038df86700 1 --2- 172.21.15.73:0/337021589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f03880fea50 0x7f03880fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:33.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.793+0000 7f038df86700 1 --2- 172.21.15.73:0/337021589 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0388101ac0 0x7f0388101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:33.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.793+0000 7f038df86700 1 -- 172.21.15.73:0/337021589 >> 172.21.15.73:0/337021589 conn(0x7f03880fa340 msgr2=0x7f03880fc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:33.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.793+0000 7f038df86700 1 -- 172.21.15.73:0/337021589 shutdown_connections 2023-08-10T11:50:33.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.793+0000 7f038df86700 1 -- 172.21.15.73:0/337021589 wait complete. 2023-08-10T11:50:33.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.794+0000 7f038df86700 1 Processor -- start 2023-08-10T11:50:33.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.794+0000 7f038df86700 1 -- start start 2023-08-10T11:50:33.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.794+0000 7f038df86700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03880fea50 0x7f0388101430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:33.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.794+0000 7f038df86700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0388101ac0 0x7f03880ffa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:33.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.794+0000 7f038df86700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0388102460 0x7f03880fffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:33.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.794+0000 7f038df86700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0388100750 con 0x7f0388102460 2023-08-10T11:50:33.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.794+0000 7f038df86700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03881008c0 con 0x7f03880fea50 2023-08-10T11:50:33.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.794+0000 7f038df86700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03881a0590 con 0x7f0388101ac0 2023-08-10T11:50:33.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.794+0000 7f0387fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0388102460 0x7f03880fffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:33.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.794+0000 7f0387fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0388102460 0x7f03880fffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58694/0 (socket says 172.21.15.73:58694) 2023-08-10T11:50:33.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.794+0000 7f0387fff700 1 -- 172.21.15.73:0/1738162823 learned_addr learned my addr 172.21.15.73:0/1738162823 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:33.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.795+0000 7f03877fe700 1 --2- 172.21.15.73:0/1738162823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03880fea50 0x7f0388101430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:33.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.795+0000 7f0386ffd700 1 --2- 172.21.15.73:0/1738162823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0388101ac0 0x7f03880ffa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:33.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.795+0000 7f0387fff700 1 -- 172.21.15.73:0/1738162823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0388101ac0 msgr2=0x7f03880ffa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:33.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.795+0000 7f0387fff700 1 --2- 172.21.15.73:0/1738162823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0388101ac0 0x7f03880ffa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:33.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.795+0000 7f0387fff700 1 -- 172.21.15.73:0/1738162823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03880fea50 msgr2=0x7f0388101430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:33.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.795+0000 7f0387fff700 1 --2- 172.21.15.73:0/1738162823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03880fea50 0x7f0388101430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:33.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.795+0000 7f0387fff700 1 -- 172.21.15.73:0/1738162823 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0380009d00 con 0x7f0388102460 2023-08-10T11:50:33.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.795+0000 7f0386ffd700 1 --2- 172.21.15.73:0/1738162823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0388101ac0 0x7f03880ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:50:33.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.795+0000 7f03877fe700 1 --2- 172.21.15.73:0/1738162823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03880fea50 0x7f0388101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:50:33.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.795+0000 7f0387fff700 1 --2- 172.21.15.73:0/1738162823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0388102460 0x7f03880fffb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0380009fd0 tx=0x7f038000bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:33.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.795+0000 7f0384ff9700 1 -- 172.21.15.73:0/1738162823 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038000e040 con 0x7f0388102460 2023-08-10T11:50:33.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.795+0000 7f0384ff9700 1 -- 172.21.15.73:0/1738162823 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0380003e10 con 0x7f0388102460 2023-08-10T11:50:33.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.795+0000 7f038df86700 1 -- 172.21.15.73:0/1738162823 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03881a0810 con 0x7f0388102460 2023-08-10T11:50:33.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.795+0000 7f0384ff9700 1 -- 172.21.15.73:0/1738162823 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038001b7e0 con 0x7f0388102460 2023-08-10T11:50:33.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.795+0000 7f038df86700 1 -- 172.21.15.73:0/1738162823 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03881a0c30 con 0x7f0388102460 2023-08-10T11:50:33.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.796+0000 7f038df86700 1 -- 172.21.15.73:0/1738162823 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f038810bfc0 con 0x7f0388102460 2023-08-10T11:50:33.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.797+0000 7f0384ff9700 1 -- 172.21.15.73:0/1738162823 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f038001da30 con 0x7f0388102460 2023-08-10T11:50:33.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.798+0000 7f0384ff9700 1 --2- 172.21.15.73:0/1738162823 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f03740a1220 0x7f03740a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:33.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.798+0000 7f03877fe700 1 --2- 172.21.15.73:0/1738162823 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f03740a1220 0x7f03740a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:33.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.798+0000 7f0384ff9700 1 -- 172.21.15.73:0/1738162823 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f03800cde50 con 0x7f0388102460 2023-08-10T11:50:33.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.798+0000 7f03877fe700 1 --2- 172.21.15.73:0/1738162823 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f03740a1220 0x7f03740a36e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0378005950 tx=0x7f03780058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:33.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:33.801+0000 7f0384ff9700 1 -- 172.21.15.73:0/1738162823 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0380097a30 con 0x7f0388102460 2023-08-10T11:50:33.863 INFO:journalctl@ceph.mds.e.smithi152.stdout:Aug 10 11:50:33 smithi152 podman[154935]: 2023-08-10T11:50:33.863 INFO:journalctl@ceph.mds.e.smithi152.stdout:Aug 10 11:50:33 smithi152 bash[154935]: 4617e7bf52b9f694475cfa581cad805d802b6bbd2de82b14b26bc3049bb17e12 2023-08-10T11:50:33.863 INFO:journalctl@ceph.mds.e.smithi152.stdout:Aug 10 11:50:33 smithi152 ceph-mds[154975]: -- 172.21.15.152:0/1495855152 <== mon.2 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fcdea451e0 con 0x55fcdea1a800 2023-08-10T11:50:33.863 INFO:journalctl@ceph.mds.e.smithi152.stdout:Aug 10 11:50:33 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-e[154951]: starting mds.e at 2023-08-10T11:50:34.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:33 smithi073 ceph-mon[128869]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:34.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:33 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:34.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:34.045+0000 7f038df86700 1 -- 172.21.15.73:0/1738162823 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0388107720 con 0x7f0388102460 2023-08-10T11:50:34.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:34.045+0000 7f0384ff9700 1 -- 172.21.15.73:0/1738162823 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3531 (secure 0 0 0) 0x7f038009b050 con 0x7f0388102460 2023-08-10T11:50:34.046 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:50:34.046 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1319360725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1319360725},{"type":"v1","addr":"172.21.15.73:6835","nonce":1319360725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/431221951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":431221951},{"type":"v1","addr":"172.21.15.73:6837","nonce":431221951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3028461815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3028461815},{"type":"v1","addr":"172.21.15.156:6833","nonce":3028461815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/4148407154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4148407154},{"type":"v1","addr":"172.21.15.152:6833","nonce":4148407154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-08-10T11:50:34.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:34.047+0000 7f038df86700 1 -- 172.21.15.73:0/1738162823 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f03740a1220 msgr2=0x7f03740a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:34.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:34.047+0000 7f038df86700 1 --2- 172.21.15.73:0/1738162823 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f03740a1220 0x7f03740a36e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0378005950 tx=0x7f03780058e0 comp rx=0 tx=0).stop 2023-08-10T11:50:34.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:34.047+0000 7f038df86700 1 -- 172.21.15.73:0/1738162823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0388102460 msgr2=0x7f03880fffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:34.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:34.047+0000 7f038df86700 1 --2- 172.21.15.73:0/1738162823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0388102460 0x7f03880fffb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0380009fd0 tx=0x7f038000bd90 comp rx=0 tx=0).stop 2023-08-10T11:50:34.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:34.047+0000 7f038df86700 1 -- 172.21.15.73:0/1738162823 shutdown_connections 2023-08-10T11:50:34.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:34.048+0000 7f038df86700 1 --2- 172.21.15.73:0/1738162823 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f03740a1220 0x7f03740a36e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:34.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:34.048+0000 7f038df86700 1 --2- 172.21.15.73:0/1738162823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03880fea50 0x7f0388101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:34.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:34.048+0000 7f038df86700 1 --2- 172.21.15.73:0/1738162823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0388102460 0x7f03880fffb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:34.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:34.048+0000 7f038df86700 1 --2- 172.21.15.73:0/1738162823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0388101ac0 0x7f03880ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:34.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:34.048+0000 7f038df86700 1 -- 172.21.15.73:0/1738162823 >> 172.21.15.73:0/1738162823 conn(0x7f03880fa340 msgr2=0x7f03880fc520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:34.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:34.048+0000 7f038df86700 1 -- 172.21.15.73:0/1738162823 shutdown_connections 2023-08-10T11:50:34.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:34.048+0000 7f038df86700 1 -- 172.21.15.73:0/1738162823 wait complete. 2023-08-10T11:50:34.050 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2023-08-10T11:50:34.245 INFO:journalctl@ceph.mds.e.smithi152.stdout:Aug 10 11:50:33 smithi152 systemd[1]: Started Ceph mds.e for 0e619a74-3773-11ee-9b37-001a4aab830c. 2023-08-10T11:50:34.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:33 smithi152 ceph-mon[130220]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:34.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:33 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:34.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:33 smithi156 ceph-mon[130574]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:34.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:33 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:35.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:35.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:35.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:35.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:35.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:35.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:34 smithi152 ceph-mon[130220]: Deploying daemon mds.f on smithi156 2023-08-10T11:50:35.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:34 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1738162823' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:35.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:34 smithi152 ceph-mon[130220]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:35.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:34 smithi152 ceph-mon[130220]: mds.? [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] up:boot 2023-08-10T11:50:35.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:34 smithi152 ceph-mon[130220]: fsmap 5 up:standby 2023-08-10T11:50:35.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:34 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-08-10T11:50:35.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:34 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:35.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:34 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:35.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:34 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:35.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:34 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:35.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:34 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:35.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:34 smithi156 ceph-mon[130574]: Deploying daemon mds.f on smithi156 2023-08-10T11:50:35.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:34 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1738162823' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:35.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:34 smithi156 ceph-mon[130574]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:35.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:34 smithi156 ceph-mon[130574]: mds.? [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] up:boot 2023-08-10T11:50:35.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:34 smithi156 ceph-mon[130574]: fsmap 5 up:standby 2023-08-10T11:50:35.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:34 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-08-10T11:50:35.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:34 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:35.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:34 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:35.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:34 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:35.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:34 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:35.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:34 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:35.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:34 smithi073 ceph-mon[128869]: Deploying daemon mds.f on smithi156 2023-08-10T11:50:35.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:34 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1738162823' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:35.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:34 smithi073 ceph-mon[128869]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:35.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:34 smithi073 ceph-mon[128869]: mds.? [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] up:boot 2023-08-10T11:50:35.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:34 smithi073 ceph-mon[128869]: fsmap 5 up:standby 2023-08-10T11:50:35.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:34 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-08-10T11:50:35.913 INFO:journalctl@ceph.mds.f.smithi156.stdout:Aug 10 11:50:35 smithi156 systemd[1]: Starting Ceph mds.f for 0e619a74-3773-11ee-9b37-001a4aab830c... 2023-08-10T11:50:36.061 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T11:50:36.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.194+0000 7fb5fd094700 1 -- 172.21.15.73:0/2933276144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5f80ff6a0 msgr2=0x7fb5f80ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:36.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.194+0000 7fb5fd094700 1 --2- 172.21.15.73:0/2933276144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5f80ff6a0 0x7fb5f80ffac0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000b0d0 tx=0x7fb5f000b3e0 comp rx=0 tx=0).stop 2023-08-10T11:50:36.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.194+0000 7fb5fd094700 1 -- 172.21.15.73:0/2933276144 shutdown_connections 2023-08-10T11:50:36.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.194+0000 7fb5fd094700 1 --2- 172.21.15.73:0/2933276144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5f8101230 0x7fb5f8107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:36.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.194+0000 7fb5fd094700 1 --2- 172.21.15.73:0/2933276144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5f80ff6a0 0x7fb5f80ffac0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:36.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.194+0000 7fb5fd094700 1 --2- 172.21.15.73:0/2933276144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5f8100890 0x7fb5f8100cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:36.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.194+0000 7fb5fd094700 1 -- 172.21.15.73:0/2933276144 >> 172.21.15.73:0/2933276144 conn(0x7fb5f80fabf0 msgr2=0x7fb5f80fd050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:36.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.194+0000 7fb5fd094700 1 -- 172.21.15.73:0/2933276144 shutdown_connections 2023-08-10T11:50:36.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.194+0000 7fb5fd094700 1 -- 172.21.15.73:0/2933276144 wait complete. 2023-08-10T11:50:36.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.195+0000 7fb5fd094700 1 Processor -- start 2023-08-10T11:50:36.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.195+0000 7fb5fd094700 1 -- start start 2023-08-10T11:50:36.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.195+0000 7fb5fd094700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5f80ff6a0 0x7fb5f8069700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:36.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.195+0000 7fb5fd094700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5f8100890 0x7fb5f819b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:36.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.195+0000 7fb5fd094700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5f8101230 0x7fb5f819d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:36.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.195+0000 7fb5fd094700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f819e150 con 0x7fb5f8100890 2023-08-10T11:50:36.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.195+0000 7fb5fd094700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f819e2c0 con 0x7fb5f80ff6a0 2023-08-10T11:50:36.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.195+0000 7fb5fd094700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f819e480 con 0x7fb5f8101230 2023-08-10T11:50:36.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.196+0000 7fb5f659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5f8100890 0x7fb5f819b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:36.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.196+0000 7fb5f659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5f8100890 0x7fb5f819b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58706/0 (socket says 172.21.15.73:58706) 2023-08-10T11:50:36.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.196+0000 7fb5f659c700 1 -- 172.21.15.73:0/3928353405 learned_addr learned my addr 172.21.15.73:0/3928353405 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:36.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.196+0000 7fb5f759e700 1 --2- 172.21.15.73:0/3928353405 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5f8101230 0x7fb5f819d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:36.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.196+0000 7fb5f6d9d700 1 --2- 172.21.15.73:0/3928353405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5f80ff6a0 0x7fb5f8069700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:36.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.196+0000 7fb5f759e700 1 -- 172.21.15.73:0/3928353405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5f80ff6a0 msgr2=0x7fb5f8069700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:36.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.196+0000 7fb5f759e700 1 --2- 172.21.15.73:0/3928353405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5f80ff6a0 0x7fb5f8069700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:36.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.196+0000 7fb5f759e700 1 -- 172.21.15.73:0/3928353405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5f8100890 msgr2=0x7fb5f819b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:36.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.196+0000 7fb5f759e700 1 --2- 172.21.15.73:0/3928353405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5f8100890 0x7fb5f819b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:36.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.196+0000 7fb5f759e700 1 -- 172.21.15.73:0/3928353405 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f0009d00 con 0x7fb5f8101230 2023-08-10T11:50:36.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.196+0000 7fb5f659c700 1 --2- 172.21.15.73:0/3928353405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5f8100890 0x7fb5f819b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:50:36.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.196+0000 7fb5f759e700 1 --2- 172.21.15.73:0/3928353405 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5f8101230 0x7fb5f819d9b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb5e800d6a0 tx=0x7fb5e800d9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:36.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.196+0000 7fb5effff700 1 -- 172.21.15.73:0/3928353405 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8004220 con 0x7fb5f8101230 2023-08-10T11:50:36.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.196+0000 7fb5fd094700 1 -- 172.21.15.73:0/3928353405 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f819e760 con 0x7fb5f8101230 2023-08-10T11:50:36.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.196+0000 7fb5effff700 1 -- 172.21.15.73:0/3928353405 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb5e8004d60 con 0x7fb5f8101230 2023-08-10T11:50:36.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.196+0000 7fb5effff700 1 -- 172.21.15.73:0/3928353405 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e80036d0 con 0x7fb5f8101230 2023-08-10T11:50:36.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.196+0000 7fb5fd094700 1 -- 172.21.15.73:0/3928353405 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f819ec70 con 0x7fb5f8101230 2023-08-10T11:50:36.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.197+0000 7fb5fd094700 1 -- 172.21.15.73:0/3928353405 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f8106c40 con 0x7fb5f8101230 2023-08-10T11:50:36.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.198+0000 7fb5effff700 1 -- 172.21.15.73:0/3928353405 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fb5e80048a0 con 0x7fb5f8101230 2023-08-10T11:50:36.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.199+0000 7fb5effff700 1 --2- 172.21.15.73:0/3928353405 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb5e40a11a0 0x7fb5e40a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:36.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.199+0000 7fb5f6d9d700 1 --2- 172.21.15.73:0/3928353405 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb5e40a11a0 0x7fb5e40a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:36.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.199+0000 7fb5effff700 1 -- 172.21.15.73:0/3928353405 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb5e80cc330 con 0x7fb5f8101230 2023-08-10T11:50:36.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.199+0000 7fb5f6d9d700 1 --2- 172.21.15.73:0/3928353405 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb5e40a11a0 0x7fb5e40a3660 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0009fd0 tx=0x7fb5f000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:36.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.203+0000 7fb5effff700 1 -- 172.21.15.73:0/3928353405 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fb5e8095e80 con 0x7fb5f8101230 2023-08-10T11:50:36.204 INFO:journalctl@ceph.mds.f.smithi156.stdout:Aug 10 11:50:35 smithi156 podman[156128]: 2023-08-10T11:50:36.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.438+0000 7fb5fd094700 1 -- 172.21.15.73:0/3928353405 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5f802c970 con 0x7fb5f8101230 2023-08-10T11:50:36.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.439+0000 7fb5effff700 1 -- 172.21.15.73:0/3928353405 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5048 (secure 0 0 0) 0x7fb5e80b9030 con 0x7fb5f8101230 2023-08-10T11:50:36.440 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:50:36.440 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1319360725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1319360725},{"type":"v1","addr":"172.21.15.73:6835","nonce":1319360725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/431221951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":431221951},{"type":"v1","addr":"172.21.15.73:6837","nonce":431221951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3028461815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3028461815},{"type":"v1","addr":"172.21.15.156:6833","nonce":3028461815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/4148407154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4148407154},{"type":"v1","addr":"172.21.15.152:6833","nonce":4148407154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1791572604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1791572604},{"type":"v1","addr":"172.21.15.152:6835","nonce":1791572604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/904126790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":904126790},{"type":"v1","addr":"172.21.15.156:6835","nonce":904126790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[]} 2023-08-10T11:50:36.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.441+0000 7fb5fd094700 1 -- 172.21.15.73:0/3928353405 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb5e40a11a0 msgr2=0x7fb5e40a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:36.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.441+0000 7fb5fd094700 1 --2- 172.21.15.73:0/3928353405 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb5e40a11a0 0x7fb5e40a3660 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0009fd0 tx=0x7fb5f000b040 comp rx=0 tx=0).stop 2023-08-10T11:50:36.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.441+0000 7fb5fd094700 1 -- 172.21.15.73:0/3928353405 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5f8101230 msgr2=0x7fb5f819d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:36.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.441+0000 7fb5fd094700 1 --2- 172.21.15.73:0/3928353405 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5f8101230 0x7fb5f819d9b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb5e800d6a0 tx=0x7fb5e800d9b0 comp rx=0 tx=0).stop 2023-08-10T11:50:36.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.441+0000 7fb5fd094700 1 -- 172.21.15.73:0/3928353405 shutdown_connections 2023-08-10T11:50:36.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.441+0000 7fb5fd094700 1 --2- 172.21.15.73:0/3928353405 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb5e40a11a0 0x7fb5e40a3660 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:36.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.441+0000 7fb5fd094700 1 --2- 172.21.15.73:0/3928353405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5f80ff6a0 0x7fb5f8069700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:36.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.441+0000 7fb5fd094700 1 --2- 172.21.15.73:0/3928353405 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5f8101230 0x7fb5f819d9b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:36.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.441+0000 7fb5fd094700 1 --2- 172.21.15.73:0/3928353405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5f8100890 0x7fb5f819b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:36.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.441+0000 7fb5fd094700 1 -- 172.21.15.73:0/3928353405 >> 172.21.15.73:0/3928353405 conn(0x7fb5f80fabf0 msgr2=0x7fb5f8103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:36.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.441+0000 7fb5fd094700 1 -- 172.21.15.73:0/3928353405 shutdown_connections 2023-08-10T11:50:36.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:36.441+0000 7fb5fd094700 1 -- 172.21.15.73:0/3928353405 wait complete. 2023-08-10T11:50:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 7 2023-08-10T11:50:36.505 INFO:journalctl@ceph.mds.f.smithi156.stdout:Aug 10 11:50:36 smithi156 bash[156128]: c23a295ba7b3decf94136112cefbc4261314d754117a03997723cbe64db980ff 2023-08-10T11:50:36.506 INFO:journalctl@ceph.mds.f.smithi156.stdout:Aug 10 11:50:36 smithi156 systemd[1]: Started Ceph mds.f for 0e619a74-3773-11ee-9b37-001a4aab830c. 2023-08-10T11:50:36.506 INFO:journalctl@ceph.mds.f.smithi156.stdout:Aug 10 11:50:36 smithi156 ceph-mds[156168]: -- 172.21.15.156:0/380257437 <== mon.1 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a56fb771e0 con 0x55a56fb4cc00 2023-08-10T11:50:36.506 INFO:journalctl@ceph.mds.f.smithi156.stdout:Aug 10 11:50:36 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-f[156144]: starting mds.f at 2023-08-10T11:50:37.499 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:37 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:37.499 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:37 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:37.499 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:37 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:37.499 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:37 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:37.499 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:37 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:37.499 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:37 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:37.500 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:37 smithi156 ceph-mon[130574]: Deploying daemon mds.c on smithi156 2023-08-10T11:50:37.500 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:37 smithi156 ceph-mon[130574]: mds.? [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] up:boot 2023-08-10T11:50:37.500 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:37 smithi156 ceph-mon[130574]: fsmap 6 up:standby 2023-08-10T11:50:37.500 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:37 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-08-10T11:50:37.500 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:37 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3928353405' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:37.500 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:37 smithi156 ceph-mon[130574]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:37.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:37 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:37.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:37 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:37.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:37 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:37.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:37 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:37.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:37 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:37.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:37 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:37.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:37 smithi073 ceph-mon[128869]: Deploying daemon mds.c on smithi156 2023-08-10T11:50:37.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:37 smithi073 ceph-mon[128869]: mds.? [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] up:boot 2023-08-10T11:50:37.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:37 smithi073 ceph-mon[128869]: fsmap 6 up:standby 2023-08-10T11:50:37.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:37 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-08-10T11:50:37.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:37 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3928353405' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:37.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:37 smithi073 ceph-mon[128869]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:37.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:37 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:37.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:37 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:37.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:37 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:37.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:37 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:37.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:37 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:37.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:37 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:37.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:37 smithi152 ceph-mon[130220]: Deploying daemon mds.c on smithi156 2023-08-10T11:50:37.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:37 smithi152 ceph-mon[130220]: mds.? [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] up:boot 2023-08-10T11:50:37.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:37 smithi152 ceph-mon[130220]: fsmap 6 up:standby 2023-08-10T11:50:37.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:37 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-08-10T11:50:37.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:37 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3928353405' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:37.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:37 smithi152 ceph-mon[130220]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:38.172 INFO:journalctl@ceph.mds.c.smithi156.stdout:Aug 10 11:50:37 smithi156 systemd[1]: Starting Ceph mds.c for 0e619a74-3773-11ee-9b37-001a4aab830c... 2023-08-10T11:50:38.454 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T11:50:38.504 INFO:journalctl@ceph.mds.c.smithi156.stdout:Aug 10 11:50:38 smithi156 podman[156468]: 2023-08-10T11:50:38.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.590+0000 7fc316ca4700 1 -- 172.21.15.73:0/559099334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3101011e0 msgr2=0x7fc310107a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:38.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.590+0000 7fc316ca4700 1 --2- 172.21.15.73:0/559099334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3101011e0 0x7fc310107a90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc30800b0d0 tx=0x7fc30800b3e0 comp rx=0 tx=0).stop 2023-08-10T11:50:38.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.590+0000 7fc316ca4700 1 -- 172.21.15.73:0/559099334 shutdown_connections 2023-08-10T11:50:38.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.590+0000 7fc316ca4700 1 --2- 172.21.15.73:0/559099334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3101011e0 0x7fc310107a90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:38.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.590+0000 7fc316ca4700 1 --2- 172.21.15.73:0/559099334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3100ff650 0x7fc3100ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:38.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.590+0000 7fc316ca4700 1 --2- 172.21.15.73:0/559099334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc310100840 0x7fc310100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:38.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.590+0000 7fc316ca4700 1 -- 172.21.15.73:0/559099334 >> 172.21.15.73:0/559099334 conn(0x7fc3100faba0 msgr2=0x7fc3100fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:38.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.590+0000 7fc316ca4700 1 -- 172.21.15.73:0/559099334 shutdown_connections 2023-08-10T11:50:38.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.590+0000 7fc316ca4700 1 -- 172.21.15.73:0/559099334 wait complete. 2023-08-10T11:50:38.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.591+0000 7fc316ca4700 1 Processor -- start 2023-08-10T11:50:38.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.591+0000 7fc316ca4700 1 -- start start 2023-08-10T11:50:38.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.591+0000 7fc316ca4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3100ff650 0x7fc310068440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:38.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.591+0000 7fc316ca4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc310100840 0x7fc31019b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:38.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.591+0000 7fc316ca4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3101011e0 0x7fc31019d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:38.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.591+0000 7fc316ca4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31019e000 con 0x7fc3101011e0 2023-08-10T11:50:38.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.591+0000 7fc316ca4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31019e170 con 0x7fc3100ff650 2023-08-10T11:50:38.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.591+0000 7fc316ca4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31019e330 con 0x7fc310100840 2023-08-10T11:50:38.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.591+0000 7fc315241700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3101011e0 0x7fc31019d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:38.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.591+0000 7fc315241700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3101011e0 0x7fc31019d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58722/0 (socket says 172.21.15.73:58722) 2023-08-10T11:50:38.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.591+0000 7fc315241700 1 -- 172.21.15.73:0/3496257759 learned_addr learned my addr 172.21.15.73:0/3496257759 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:38.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.591+0000 7fc30ffff700 1 --2- 172.21.15.73:0/3496257759 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc310100840 0x7fc31019b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:38.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.591+0000 7fc314a40700 1 --2- 172.21.15.73:0/3496257759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3100ff650 0x7fc310068440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:38.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.592+0000 7fc315241700 1 -- 172.21.15.73:0/3496257759 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc310100840 msgr2=0x7fc31019b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:38.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.592+0000 7fc315241700 1 --2- 172.21.15.73:0/3496257759 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc310100840 0x7fc31019b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:38.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.592+0000 7fc315241700 1 -- 172.21.15.73:0/3496257759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3100ff650 msgr2=0x7fc310068440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:38.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.592+0000 7fc315241700 1 --2- 172.21.15.73:0/3496257759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3100ff650 0x7fc310068440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:38.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.592+0000 7fc315241700 1 -- 172.21.15.73:0/3496257759 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc308009d00 con 0x7fc3101011e0 2023-08-10T11:50:38.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.592+0000 7fc314a40700 1 --2- 172.21.15.73:0/3496257759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3100ff650 0x7fc310068440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:50:38.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.592+0000 7fc315241700 1 --2- 172.21.15.73:0/3496257759 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3101011e0 0x7fc31019d860 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc308008ec0 tx=0x7fc308008ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:38.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.592+0000 7fc30dffb700 1 -- 172.21.15.73:0/3496257759 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30800e040 con 0x7fc3101011e0 2023-08-10T11:50:38.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.592+0000 7fc30dffb700 1 -- 172.21.15.73:0/3496257759 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc30800be30 con 0x7fc3101011e0 2023-08-10T11:50:38.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.592+0000 7fc316ca4700 1 -- 172.21.15.73:0/3496257759 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31019e5b0 con 0x7fc3101011e0 2023-08-10T11:50:38.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.592+0000 7fc30dffb700 1 -- 172.21.15.73:0/3496257759 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30801b6c0 con 0x7fc3101011e0 2023-08-10T11:50:38.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.592+0000 7fc316ca4700 1 -- 172.21.15.73:0/3496257759 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31019e9d0 con 0x7fc3101011e0 2023-08-10T11:50:38.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.593+0000 7fc316ca4700 1 -- 172.21.15.73:0/3496257759 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc310106b90 con 0x7fc3101011e0 2023-08-10T11:50:38.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.594+0000 7fc30dffb700 1 -- 172.21.15.73:0/3496257759 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fc308024410 con 0x7fc3101011e0 2023-08-10T11:50:38.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.595+0000 7fc30dffb700 1 --2- 172.21.15.73:0/3496257759 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc3000a11a0 0x7fc3000a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:38.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.595+0000 7fc314a40700 1 --2- 172.21.15.73:0/3496257759 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc3000a11a0 0x7fc3000a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:38.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.595+0000 7fc314a40700 1 --2- 172.21.15.73:0/3496257759 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc3000a11a0 0x7fc3000a3660 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc3101006a0 tx=0x7fc304009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:38.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.596+0000 7fc30dffb700 1 -- 172.21.15.73:0/3496257759 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc3080055e0 con 0x7fc3101011e0 2023-08-10T11:50:38.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.600+0000 7fc30dffb700 1 -- 172.21.15.73:0/3496257759 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fc308097220 con 0x7fc3101011e0 2023-08-10T11:50:38.755 INFO:journalctl@ceph.mds.c.smithi156.stdout:Aug 10 11:50:38 smithi156 bash[156468]: 36d5ad46729ed92b4116dc9b25a621d37de3f18ba374f49e55a941017110af0a 2023-08-10T11:50:38.755 INFO:journalctl@ceph.mds.c.smithi156.stdout:Aug 10 11:50:38 smithi156 ceph-mds[156508]: -- 172.21.15.156:0/3502268402 <== mon.1 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55570cd071e0 con 0x55570ccdc800 2023-08-10T11:50:38.756 INFO:journalctl@ceph.mds.c.smithi156.stdout:Aug 10 11:50:38 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-c[156484]: starting mds.c at 2023-08-10T11:50:38.756 INFO:journalctl@ceph.mds.c.smithi156.stdout:Aug 10 11:50:38 smithi156 systemd[1]: Started Ceph mds.c for 0e619a74-3773-11ee-9b37-001a4aab830c. 2023-08-10T11:50:38.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.836+0000 7fc316ca4700 1 -- 172.21.15.73:0/3496257759 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc31002c970 con 0x7fc3101011e0 2023-08-10T11:50:38.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.836+0000 7fc30dffb700 1 -- 172.21.15.73:0/3496257759 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5048 (secure 0 0 0) 0x7fc30809a840 con 0x7fc3101011e0 2023-08-10T11:50:38.837 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:50:38.838 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1319360725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1319360725},{"type":"v1","addr":"172.21.15.73:6835","nonce":1319360725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/431221951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":431221951},{"type":"v1","addr":"172.21.15.73:6837","nonce":431221951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3028461815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3028461815},{"type":"v1","addr":"172.21.15.156:6833","nonce":3028461815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/4148407154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4148407154},{"type":"v1","addr":"172.21.15.152:6833","nonce":4148407154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1791572604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1791572604},{"type":"v1","addr":"172.21.15.152:6835","nonce":1791572604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/904126790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":904126790},{"type":"v1","addr":"172.21.15.156:6835","nonce":904126790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[]} 2023-08-10T11:50:38.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.838+0000 7fc316ca4700 1 -- 172.21.15.73:0/3496257759 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc3000a11a0 msgr2=0x7fc3000a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:38.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.838+0000 7fc316ca4700 1 --2- 172.21.15.73:0/3496257759 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc3000a11a0 0x7fc3000a3660 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc3101006a0 tx=0x7fc304009260 comp rx=0 tx=0).stop 2023-08-10T11:50:38.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.839+0000 7fc316ca4700 1 -- 172.21.15.73:0/3496257759 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3101011e0 msgr2=0x7fc31019d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:38.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.839+0000 7fc316ca4700 1 --2- 172.21.15.73:0/3496257759 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3101011e0 0x7fc31019d860 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc308008ec0 tx=0x7fc308008ef0 comp rx=0 tx=0).stop 2023-08-10T11:50:38.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.839+0000 7fc316ca4700 1 -- 172.21.15.73:0/3496257759 shutdown_connections 2023-08-10T11:50:38.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.839+0000 7fc316ca4700 1 --2- 172.21.15.73:0/3496257759 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc3000a11a0 0x7fc3000a3660 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:38.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.839+0000 7fc316ca4700 1 --2- 172.21.15.73:0/3496257759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3100ff650 0x7fc310068440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:38.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.839+0000 7fc316ca4700 1 --2- 172.21.15.73:0/3496257759 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3101011e0 0x7fc31019d860 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:38.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.839+0000 7fc316ca4700 1 --2- 172.21.15.73:0/3496257759 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc310100840 0x7fc31019b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:38.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.839+0000 7fc316ca4700 1 -- 172.21.15.73:0/3496257759 >> 172.21.15.73:0/3496257759 conn(0x7fc3100faba0 msgr2=0x7fc310103cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:38.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.839+0000 7fc316ca4700 1 -- 172.21.15.73:0/3496257759 shutdown_connections 2023-08-10T11:50:38.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:38.839+0000 7fc316ca4700 1 -- 172.21.15.73:0/3496257759 wait complete. 2023-08-10T11:50:38.841 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 7 2023-08-10T11:50:39.949 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:39 smithi152 ceph-mon[130220]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:39.949 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:39 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:39.949 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:39 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:39.949 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:39 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:39.949 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:39 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:39.950 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:39 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:39.950 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:39 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:39.950 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:39 smithi152 ceph-mon[130220]: Deploying daemon mds.h on smithi152 2023-08-10T11:50:39.950 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:39 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3496257759' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:39.950 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:39 smithi152 ceph-mon[130220]: mds.? [v2:172.21.15.156:6836/4284306352,v1:172.21.15.156:6837/4284306352] up:boot 2023-08-10T11:50:39.950 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:39 smithi152 ceph-mon[130220]: fsmap 7 up:standby 2023-08-10T11:50:39.950 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:39 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-08-10T11:50:40.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:39 smithi156 ceph-mon[130574]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:40.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:39 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:40.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:39 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:40.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:39 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:40.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:39 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:40.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:39 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:40.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:39 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:40.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:39 smithi156 ceph-mon[130574]: Deploying daemon mds.h on smithi152 2023-08-10T11:50:40.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:39 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3496257759' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:40.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:39 smithi156 ceph-mon[130574]: mds.? [v2:172.21.15.156:6836/4284306352,v1:172.21.15.156:6837/4284306352] up:boot 2023-08-10T11:50:40.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:39 smithi156 ceph-mon[130574]: fsmap 7 up:standby 2023-08-10T11:50:40.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:39 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-08-10T11:50:40.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:39 smithi073 ceph-mon[128869]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:40.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:39 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:40.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:39 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:40.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:39 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:40.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:39 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:40.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:39 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:40.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:39 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:40.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:39 smithi073 ceph-mon[128869]: Deploying daemon mds.h on smithi152 2023-08-10T11:50:40.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:39 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3496257759' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:40.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:39 smithi073 ceph-mon[128869]: mds.? [v2:172.21.15.156:6836/4284306352,v1:172.21.15.156:6837/4284306352] up:boot 2023-08-10T11:50:40.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:39 smithi073 ceph-mon[128869]: fsmap 7 up:standby 2023-08-10T11:50:40.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:39 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-08-10T11:50:40.245 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:50:40 smithi152 systemd[1]: Starting Ceph mds.h for 0e619a74-3773-11ee-9b37-001a4aab830c... 2023-08-10T11:50:40.745 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:50:40 smithi152 podman[155275]: 2023-08-10T11:50:40.852 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T11:50:40.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.983+0000 7f07f3d15700 1 -- 172.21.15.73:0/2564215922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07ec1008d0 msgr2=0x7f07ec100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:40.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.983+0000 7f07f3d15700 1 --2- 172.21.15.73:0/2564215922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07ec1008d0 0x7f07ec100d50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f07e8009990 tx=0x7f07e8009ca0 comp rx=0 tx=0).stop 2023-08-10T11:50:40.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.983+0000 7f07f3d15700 1 -- 172.21.15.73:0/2564215922 shutdown_connections 2023-08-10T11:50:40.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.983+0000 7f07f3d15700 1 --2- 172.21.15.73:0/2564215922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07ec0ffbc0 0x7f07ec0fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:40.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.983+0000 7f07f3d15700 1 --2- 172.21.15.73:0/2564215922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07ec101290 0x7f07ec107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:40.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.983+0000 7f07f3d15700 1 --2- 172.21.15.73:0/2564215922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07ec1008d0 0x7f07ec100d50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:40.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.983+0000 7f07f3d15700 1 -- 172.21.15.73:0/2564215922 >> 172.21.15.73:0/2564215922 conn(0x7f07ec0fa370 msgr2=0x7f07ec0fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:40.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.983+0000 7f07f3d15700 1 -- 172.21.15.73:0/2564215922 shutdown_connections 2023-08-10T11:50:40.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.983+0000 7f07f3d15700 1 -- 172.21.15.73:0/2564215922 wait complete. 2023-08-10T11:50:40.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.983+0000 7f07f3d15700 1 Processor -- start 2023-08-10T11:50:40.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.983+0000 7f07f3d15700 1 -- start start 2023-08-10T11:50:40.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.984+0000 7f07f3d15700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07ec0ffbc0 0x7f07ec0ff280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:40.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.984+0000 7f07f3d15700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07ec1008d0 0x7f07ec19b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:40.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.984+0000 7f07f3d15700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07ec101290 0x7f07ec19d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:40.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.984+0000 7f07f3d15700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec19df10 con 0x7f07ec1008d0 2023-08-10T11:50:40.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.984+0000 7f07f3d15700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec19e080 con 0x7f07ec101290 2023-08-10T11:50:40.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.984+0000 7f07f3d15700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec19e240 con 0x7f07ec0ffbc0 2023-08-10T11:50:40.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.984+0000 7f07f12b0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07ec1008d0 0x7f07ec19b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:40.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.984+0000 7f07f12b0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07ec1008d0 0x7f07ec19b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58734/0 (socket says 172.21.15.73:58734) 2023-08-10T11:50:40.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.984+0000 7f07f12b0700 1 -- 172.21.15.73:0/631224223 learned_addr learned my addr 172.21.15.73:0/631224223 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:40.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.984+0000 7f07f1ab1700 1 --2- 172.21.15.73:0/631224223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07ec0ffbc0 0x7f07ec0ff280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:40.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.984+0000 7f07f22b2700 1 --2- 172.21.15.73:0/631224223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07ec101290 0x7f07ec19d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:40.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.984+0000 7f07f12b0700 1 -- 172.21.15.73:0/631224223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07ec0ffbc0 msgr2=0x7f07ec0ff280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:40.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.984+0000 7f07f12b0700 1 --2- 172.21.15.73:0/631224223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07ec0ffbc0 0x7f07ec0ff280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:40.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.984+0000 7f07f12b0700 1 -- 172.21.15.73:0/631224223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07ec101290 msgr2=0x7f07ec19d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:40.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.984+0000 7f07f12b0700 1 --2- 172.21.15.73:0/631224223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07ec101290 0x7f07ec19d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:40.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.984+0000 7f07f12b0700 1 -- 172.21.15.73:0/631224223 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e80095f0 con 0x7f07ec1008d0 2023-08-10T11:50:40.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.984+0000 7f07f22b2700 1 --2- 172.21.15.73:0/631224223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07ec101290 0x7f07ec19d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:50:40.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.984+0000 7f07f12b0700 1 --2- 172.21.15.73:0/631224223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07ec1008d0 0x7f07ec19b130 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f07e8000c00 tx=0x7f07e80047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:40.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.984+0000 7f07e2ffd700 1 -- 172.21.15.73:0/631224223 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e801d070 con 0x7f07ec1008d0 2023-08-10T11:50:40.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.984+0000 7f07f3d15700 1 -- 172.21.15.73:0/631224223 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07ec19e4c0 con 0x7f07ec1008d0 2023-08-10T11:50:40.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.984+0000 7f07e2ffd700 1 -- 172.21.15.73:0/631224223 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f07e8022470 con 0x7f07ec1008d0 2023-08-10T11:50:40.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.984+0000 7f07e2ffd700 1 -- 172.21.15.73:0/631224223 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e8017650 con 0x7f07ec1008d0 2023-08-10T11:50:40.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.984+0000 7f07f3d15700 1 -- 172.21.15.73:0/631224223 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07ec19e8e0 con 0x7f07ec1008d0 2023-08-10T11:50:40.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.985+0000 7f07f3d15700 1 -- 172.21.15.73:0/631224223 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07ec106590 con 0x7f07ec1008d0 2023-08-10T11:50:40.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.986+0000 7f07e2ffd700 1 -- 172.21.15.73:0/631224223 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f07e80225e0 con 0x7f07ec1008d0 2023-08-10T11:50:40.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.987+0000 7f07e2ffd700 1 --2- 172.21.15.73:0/631224223 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f07d80a11a0 0x7f07d80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:40.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.987+0000 7f07f1ab1700 1 --2- 172.21.15.73:0/631224223 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f07d80a11a0 0x7f07d80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:40.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.988+0000 7f07e2ffd700 1 -- 172.21.15.73:0/631224223 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f07e80cdfa0 con 0x7f07ec1008d0 2023-08-10T11:50:40.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.988+0000 7f07f1ab1700 1 --2- 172.21.15.73:0/631224223 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f07d80a11a0 0x7f07d80a3660 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0686a0 tx=0x7f07dc007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:40.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:40.991+0000 7f07e2ffd700 1 -- 172.21.15.73:0/631224223 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f07e8097b80 con 0x7f07ec1008d0 2023-08-10T11:50:41.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:41.221+0000 7f07f3d15700 1 -- 172.21.15.73:0/631224223 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07ec02c970 con 0x7f07ec1008d0 2023-08-10T11:50:41.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:41.222+0000 7f07e2ffd700 1 -- 172.21.15.73:0/631224223 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5808 (secure 0 0 0) 0x7f07e809b1a0 con 0x7f07ec1008d0 2023-08-10T11:50:41.222 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:50:41.223 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1319360725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1319360725},{"type":"v1","addr":"172.21.15.73:6835","nonce":1319360725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/431221951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":431221951},{"type":"v1","addr":"172.21.15.73:6837","nonce":431221951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3028461815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3028461815},{"type":"v1","addr":"172.21.15.156:6833","nonce":3028461815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/4148407154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4148407154},{"type":"v1","addr":"172.21.15.152:6833","nonce":4148407154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1791572604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1791572604},{"type":"v1","addr":"172.21.15.152:6835","nonce":1791572604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/904126790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":904126790},{"type":"v1","addr":"172.21.15.156:6835","nonce":904126790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/4284306352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":4284306352},{"type":"v1","addr":"172.21.15.156:6837","nonce":4284306352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2023-08-10T11:50:41.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:41.224+0000 7f07f3d15700 1 -- 172.21.15.73:0/631224223 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f07d80a11a0 msgr2=0x7f07d80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:41.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:41.224+0000 7f07f3d15700 1 --2- 172.21.15.73:0/631224223 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f07d80a11a0 0x7f07d80a3660 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0686a0 tx=0x7f07dc007400 comp rx=0 tx=0).stop 2023-08-10T11:50:41.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:41.224+0000 7f07f3d15700 1 -- 172.21.15.73:0/631224223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07ec1008d0 msgr2=0x7f07ec19b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:41.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:41.224+0000 7f07f3d15700 1 --2- 172.21.15.73:0/631224223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07ec1008d0 0x7f07ec19b130 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f07e8000c00 tx=0x7f07e80047a0 comp rx=0 tx=0).stop 2023-08-10T11:50:41.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:41.224+0000 7f07f3d15700 1 -- 172.21.15.73:0/631224223 shutdown_connections 2023-08-10T11:50:41.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:41.224+0000 7f07f3d15700 1 --2- 172.21.15.73:0/631224223 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f07d80a11a0 0x7f07d80a3660 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:41.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:41.224+0000 7f07f3d15700 1 --2- 172.21.15.73:0/631224223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07ec101290 0x7f07ec19d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:41.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:41.224+0000 7f07f3d15700 1 --2- 172.21.15.73:0/631224223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07ec0ffbc0 0x7f07ec0ff280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:41.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:41.224+0000 7f07f3d15700 1 --2- 172.21.15.73:0/631224223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07ec1008d0 0x7f07ec19b130 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:41.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:41.224+0000 7f07f3d15700 1 -- 172.21.15.73:0/631224223 >> 172.21.15.73:0/631224223 conn(0x7f07ec0fa370 msgr2=0x7f07ec0fc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:41.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:41.224+0000 7f07f3d15700 1 -- 172.21.15.73:0/631224223 shutdown_connections 2023-08-10T11:50:41.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:41.224+0000 7f07f3d15700 1 -- 172.21.15.73:0/631224223 wait complete. 2023-08-10T11:50:41.228 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2023-08-10T11:50:41.245 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:50:40 smithi152 ceph-mds[155316]: -- 172.21.15.152:0/828545466 <== mon.2 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5561c6a191e0 con 0x5561c69ef000 2023-08-10T11:50:41.245 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:50:40 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: starting mds.h at 2023-08-10T11:50:41.246 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:50:40 smithi152 bash[155275]: e6f5768568c7dac3d1b09c7178272f62ad4363085c90ca443a20023181d8d0ba 2023-08-10T11:50:41.246 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:50:40 smithi152 systemd[1]: Started Ceph mds.h for 0e619a74-3773-11ee-9b37-001a4aab830c. 2023-08-10T11:50:42.081 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:41 smithi156 ceph-mon[130574]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:42.081 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:41 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:42.081 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:41 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:42.081 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:41 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:42.082 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:41 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:42.082 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:41 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:42.082 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:41 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:42.082 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:41 smithi156 ceph-mon[130574]: Deploying daemon mds.i on smithi156 2023-08-10T11:50:42.082 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:41 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/631224223' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:42.082 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:41 smithi156 ceph-mon[130574]: mds.? [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] up:boot 2023-08-10T11:50:42.082 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:41 smithi156 ceph-mon[130574]: fsmap 8 up:standby 2023-08-10T11:50:42.083 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:41 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-08-10T11:50:42.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:41 smithi152 ceph-mon[130220]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:42.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:42.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:42.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:42.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:42.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:42.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:42.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:41 smithi152 ceph-mon[130220]: Deploying daemon mds.i on smithi156 2023-08-10T11:50:42.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:41 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/631224223' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:42.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:41 smithi152 ceph-mon[130220]: mds.? [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] up:boot 2023-08-10T11:50:42.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:41 smithi152 ceph-mon[130220]: fsmap 8 up:standby 2023-08-10T11:50:42.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:41 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-08-10T11:50:42.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:41 smithi073 ceph-mon[128869]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:42.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:41 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:42.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:41 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:42.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:41 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:42.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:41 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:42.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:41 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:42.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:41 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:42.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:41 smithi073 ceph-mon[128869]: Deploying daemon mds.i on smithi156 2023-08-10T11:50:42.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:41 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/631224223' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:42.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:41 smithi073 ceph-mon[128869]: mds.? [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] up:boot 2023-08-10T11:50:42.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:41 smithi073 ceph-mon[128869]: fsmap 8 up:standby 2023-08-10T11:50:42.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:41 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-08-10T11:50:42.736 INFO:journalctl@ceph.mds.i.smithi156.stdout:Aug 10 11:50:42 smithi156 systemd[1]: Starting Ceph mds.i for 0e619a74-3773-11ee-9b37-001a4aab830c... 2023-08-10T11:50:43.005 INFO:journalctl@ceph.mds.i.smithi156.stdout:Aug 10 11:50:42 smithi156 podman[156810]: 2023-08-10T11:50:43.006 INFO:journalctl@ceph.mds.i.smithi156.stdout:Aug 10 11:50:42 smithi156 bash[156810]: a1f988e73aee970b71c8bef7b8539c249ba975951ed1629f0f07095e4009e026 2023-08-10T11:50:43.006 INFO:journalctl@ceph.mds.i.smithi156.stdout:Aug 10 11:50:42 smithi156 ceph-mds[156850]: -- 172.21.15.156:0/3815349948 <== mon.1 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562db70d31e0 con 0x562db70a9000 2023-08-10T11:50:43.006 INFO:journalctl@ceph.mds.i.smithi156.stdout:Aug 10 11:50:42 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-i[156826]: starting mds.i at 2023-08-10T11:50:43.237 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T11:50:43.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.364+0000 7fa31ea52700 1 -- 172.21.15.73:0/723841688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa318102310 msgr2=0x7fa318108bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:43.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.364+0000 7fa31ea52700 1 --2- 172.21.15.73:0/723841688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa318102310 0x7fa318108bc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa31000b0a0 tx=0x7fa31000b3b0 comp rx=0 tx=0).stop 2023-08-10T11:50:43.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.364+0000 7fa31ea52700 1 -- 172.21.15.73:0/723841688 shutdown_connections 2023-08-10T11:50:43.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.364+0000 7fa31ea52700 1 --2- 172.21.15.73:0/723841688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa318102310 0x7fa318108bc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:43.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.364+0000 7fa31ea52700 1 --2- 172.21.15.73:0/723841688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa318100780 0x7fa318100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:43.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.364+0000 7fa31ea52700 1 --2- 172.21.15.73:0/723841688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa318101970 0x7fa318101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:43.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.364+0000 7fa31ea52700 1 -- 172.21.15.73:0/723841688 >> 172.21.15.73:0/723841688 conn(0x7fa3180fbcb0 msgr2=0x7fa3180fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:43.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.364+0000 7fa31ea52700 1 -- 172.21.15.73:0/723841688 shutdown_connections 2023-08-10T11:50:43.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.364+0000 7fa31ea52700 1 -- 172.21.15.73:0/723841688 wait complete. 2023-08-10T11:50:43.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.365+0000 7fa31ea52700 1 Processor -- start 2023-08-10T11:50:43.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.365+0000 7fa31ea52700 1 -- start start 2023-08-10T11:50:43.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.365+0000 7fa31ea52700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa318100780 0x7fa318196490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:43.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.365+0000 7fa31ea52700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa318101970 0x7fa3181969d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:43.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.365+0000 7fa31ea52700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa318102310 0x7fa31819da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:43.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.365+0000 7fa31ea52700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31819e010 con 0x7fa318100780 2023-08-10T11:50:43.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.365+0000 7fa31ea52700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31819e150 con 0x7fa318101970 2023-08-10T11:50:43.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.365+0000 7fa31ea52700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31819e2e0 con 0x7fa318102310 2023-08-10T11:50:43.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.365+0000 7fa317fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa318100780 0x7fa318196490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:43.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.365+0000 7fa317fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa318100780 0x7fa318196490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58746/0 (socket says 172.21.15.73:58746) 2023-08-10T11:50:43.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.365+0000 7fa317fff700 1 -- 172.21.15.73:0/1267443696 learned_addr learned my addr 172.21.15.73:0/1267443696 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:43.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.365+0000 7fa31cfef700 1 --2- 172.21.15.73:0/1267443696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa318102310 0x7fa31819da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:43.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.365+0000 7fa3177fe700 1 --2- 172.21.15.73:0/1267443696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa318101970 0x7fa3181969d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:43.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.365+0000 7fa317fff700 1 -- 172.21.15.73:0/1267443696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa318102310 msgr2=0x7fa31819da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:43.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.365+0000 7fa317fff700 1 --2- 172.21.15.73:0/1267443696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa318102310 0x7fa31819da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:43.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.365+0000 7fa317fff700 1 -- 172.21.15.73:0/1267443696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa318101970 msgr2=0x7fa3181969d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:43.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.365+0000 7fa317fff700 1 --2- 172.21.15.73:0/1267443696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa318101970 0x7fa3181969d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:43.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.365+0000 7fa317fff700 1 -- 172.21.15.73:0/1267443696 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa310009d00 con 0x7fa318100780 2023-08-10T11:50:43.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.365+0000 7fa31cfef700 1 --2- 172.21.15.73:0/1267443696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa318102310 0x7fa31819da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:50:43.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.365+0000 7fa317fff700 1 --2- 172.21.15.73:0/1267443696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa318100780 0x7fa318196490 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa30800e970 tx=0x7fa30800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:43.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.366+0000 7fa3157fa700 1 -- 172.21.15.73:0/1267443696 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa308009790 con 0x7fa318100780 2023-08-10T11:50:43.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.366+0000 7fa3157fa700 1 -- 172.21.15.73:0/1267443696 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3080044e0 con 0x7fa318100780 2023-08-10T11:50:43.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.366+0000 7fa31ea52700 1 -- 172.21.15.73:0/1267443696 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa31819e5c0 con 0x7fa318100780 2023-08-10T11:50:43.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.366+0000 7fa3157fa700 1 -- 172.21.15.73:0/1267443696 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa308003e30 con 0x7fa318100780 2023-08-10T11:50:43.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.366+0000 7fa31ea52700 1 -- 172.21.15.73:0/1267443696 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa31819ead0 con 0x7fa318100780 2023-08-10T11:50:43.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.366+0000 7fa31ea52700 1 -- 172.21.15.73:0/1267443696 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa318107c30 con 0x7fa318100780 2023-08-10T11:50:43.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.368+0000 7fa3157fa700 1 -- 172.21.15.73:0/1267443696 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fa308004020 con 0x7fa318100780 2023-08-10T11:50:43.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.368+0000 7fa3157fa700 1 --2- 172.21.15.73:0/1267443696 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa3000a11a0 0x7fa3000a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:43.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.369+0000 7fa3177fe700 1 --2- 172.21.15.73:0/1267443696 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa3000a11a0 0x7fa3000a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:43.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.369+0000 7fa3157fa700 1 -- 172.21.15.73:0/1267443696 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa308014070 con 0x7fa318100780 2023-08-10T11:50:43.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.369+0000 7fa3177fe700 1 --2- 172.21.15.73:0/1267443696 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa3000a11a0 0x7fa3000a3660 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa30c005950 tx=0x7fa30c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:43.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.371+0000 7fa3157fa700 1 -- 172.21.15.73:0/1267443696 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fa308050790 con 0x7fa318100780 2023-08-10T11:50:43.505 INFO:journalctl@ceph.mds.i.smithi156.stdout:Aug 10 11:50:43 smithi156 systemd[1]: Started Ceph mds.i for 0e619a74-3773-11ee-9b37-001a4aab830c. 2023-08-10T11:50:43.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.623+0000 7fa31ea52700 1 -- 172.21.15.73:0/1267443696 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa31802cc20 con 0x7fa318100780 2023-08-10T11:50:43.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.623+0000 7fa3157fa700 1 -- 172.21.15.73:0/1267443696 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6562 (secure 0 0 0) 0x7fa308096550 con 0x7fa318100780 2023-08-10T11:50:43.625 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:50:43.626 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1319360725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1319360725},{"type":"v1","addr":"172.21.15.73:6835","nonce":1319360725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/431221951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":431221951},{"type":"v1","addr":"172.21.15.73:6837","nonce":431221951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3028461815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3028461815},{"type":"v1","addr":"172.21.15.156:6833","nonce":3028461815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/4148407154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4148407154},{"type":"v1","addr":"172.21.15.152:6833","nonce":4148407154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1791572604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1791572604},{"type":"v1","addr":"172.21.15.152:6835","nonce":1791572604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/904126790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":904126790},{"type":"v1","addr":"172.21.15.156:6835","nonce":904126790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/4284306352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":4284306352},{"type":"v1","addr":"172.21.15.156:6837","nonce":4284306352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/74214089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":74214089},{"type":"v1","addr":"172.21.15.152:6837","nonce":74214089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2023-08-10T11:50:43.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.625+0000 7fa31ea52700 1 -- 172.21.15.73:0/1267443696 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa3000a11a0 msgr2=0x7fa3000a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:43.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.625+0000 7fa31ea52700 1 --2- 172.21.15.73:0/1267443696 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa3000a11a0 0x7fa3000a3660 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa30c005950 tx=0x7fa30c0058e0 comp rx=0 tx=0).stop 2023-08-10T11:50:43.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.625+0000 7fa31ea52700 1 -- 172.21.15.73:0/1267443696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa318100780 msgr2=0x7fa318196490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:43.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.625+0000 7fa31ea52700 1 --2- 172.21.15.73:0/1267443696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa318100780 0x7fa318196490 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa30800e970 tx=0x7fa30800ed30 comp rx=0 tx=0).stop 2023-08-10T11:50:43.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.626+0000 7fa31ea52700 1 -- 172.21.15.73:0/1267443696 shutdown_connections 2023-08-10T11:50:43.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.626+0000 7fa31ea52700 1 --2- 172.21.15.73:0/1267443696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa318102310 0x7fa31819da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:43.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.626+0000 7fa31ea52700 1 --2- 172.21.15.73:0/1267443696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa318100780 0x7fa318196490 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:43.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.626+0000 7fa31ea52700 1 --2- 172.21.15.73:0/1267443696 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa3000a11a0 0x7fa3000a3660 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:43.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.626+0000 7fa31ea52700 1 --2- 172.21.15.73:0/1267443696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa318101970 0x7fa3181969d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:43.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.626+0000 7fa31ea52700 1 -- 172.21.15.73:0/1267443696 >> 172.21.15.73:0/1267443696 conn(0x7fa3180fbcb0 msgr2=0x7fa318104d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:43.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.626+0000 7fa31ea52700 1 -- 172.21.15.73:0/1267443696 shutdown_connections 2023-08-10T11:50:43.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:43.626+0000 7fa31ea52700 1 -- 172.21.15.73:0/1267443696 wait complete. 2023-08-10T11:50:43.629 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 9 2023-08-10T11:50:43.993 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:43 smithi073 ceph-mon[128869]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:43.993 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:43 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:43.993 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:43 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:43.993 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:43 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:43.993 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:43 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:43.994 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:43 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:43.994 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:43 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:43.994 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:43 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1267443696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:44.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:43 smithi152 ceph-mon[130220]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:44.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:43 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:44.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:43 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:44.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:43 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:44.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:43 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:44.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:43 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:44.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:43 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:44.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:43 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1267443696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:44.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:43 smithi156 ceph-mon[130574]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:44.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:43 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:44.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:43 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:44.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:43 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:44.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:43 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:44.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:43 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:44.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:43 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:44.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:43 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1267443696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:44.687 INFO:journalctl@ceph.mds.g.smithi073.stdout:Aug 10 11:50:44 smithi073 systemd[1]: Starting Ceph mds.g for 0e619a74-3773-11ee-9b37-001a4aab830c... 2023-08-10T11:50:44.998 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:44 smithi073 ceph-mon[128869]: Deploying daemon mds.g on smithi073 2023-08-10T11:50:44.998 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:44 smithi073 ceph-mon[128869]: mds.? [v2:172.21.15.156:6838/3361058731,v1:172.21.15.156:6839/3361058731] up:boot 2023-08-10T11:50:44.999 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:44 smithi073 ceph-mon[128869]: fsmap 9 up:standby 2023-08-10T11:50:44.999 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:44 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-08-10T11:50:45.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:44 smithi152 ceph-mon[130220]: Deploying daemon mds.g on smithi073 2023-08-10T11:50:45.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:44 smithi152 ceph-mon[130220]: mds.? [v2:172.21.15.156:6838/3361058731,v1:172.21.15.156:6839/3361058731] up:boot 2023-08-10T11:50:45.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:44 smithi152 ceph-mon[130220]: fsmap 9 up:standby 2023-08-10T11:50:45.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:44 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-08-10T11:50:45.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:44 smithi156 ceph-mon[130574]: Deploying daemon mds.g on smithi073 2023-08-10T11:50:45.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:44 smithi156 ceph-mon[130574]: mds.? [v2:172.21.15.156:6838/3361058731,v1:172.21.15.156:6839/3361058731] up:boot 2023-08-10T11:50:45.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:44 smithi156 ceph-mon[130574]: fsmap 9 up:standby 2023-08-10T11:50:45.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:44 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-08-10T11:50:45.267 INFO:journalctl@ceph.mds.g.smithi073.stdout:Aug 10 11:50:44 smithi073 podman[163119]: 2023-08-10T11:50:45.640 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T11:50:45.667 INFO:journalctl@ceph.mds.g.smithi073.stdout:Aug 10 11:50:45 smithi073 ceph-mds[163159]: -- 172.21.15.73:0/3660765051 <== mon.0 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560cebd271e0 con 0x560cebcfcc00 2023-08-10T11:50:45.667 INFO:journalctl@ceph.mds.g.smithi073.stdout:Aug 10 11:50:45 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-g[163135]: starting mds.g at 2023-08-10T11:50:45.668 INFO:journalctl@ceph.mds.g.smithi073.stdout:Aug 10 11:50:45 smithi073 bash[163119]: 83da60ed07fdb4dcaeb8bc274685488caa8c42b81ae0ab0aa57fcd3f3cfe6f5c 2023-08-10T11:50:45.668 INFO:journalctl@ceph.mds.g.smithi073.stdout:Aug 10 11:50:45 smithi073 systemd[1]: Started Ceph mds.g for 0e619a74-3773-11ee-9b37-001a4aab830c. 2023-08-10T11:50:45.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.765+0000 7f7e1e80b700 1 -- 172.21.15.73:0/2840403900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e181011e0 msgr2=0x7f7e18107a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:45.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.765+0000 7f7e1e80b700 1 --2- 172.21.15.73:0/2840403900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e181011e0 0x7f7e18107a90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7e1000b0d0 tx=0x7f7e1000b3e0 comp rx=0 tx=0).stop 2023-08-10T11:50:45.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.765+0000 7f7e1e80b700 1 -- 172.21.15.73:0/2840403900 shutdown_connections 2023-08-10T11:50:45.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.765+0000 7f7e1e80b700 1 --2- 172.21.15.73:0/2840403900 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e180ff650 0x7f7e180ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:45.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.765+0000 7f7e1e80b700 1 --2- 172.21.15.73:0/2840403900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e181011e0 0x7f7e18107a90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:45.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.765+0000 7f7e1e80b700 1 --2- 172.21.15.73:0/2840403900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e18100840 0x7f7e18100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:45.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.765+0000 7f7e1e80b700 1 -- 172.21.15.73:0/2840403900 >> 172.21.15.73:0/2840403900 conn(0x7f7e180faba0 msgr2=0x7f7e180fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:45.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.765+0000 7f7e1e80b700 1 -- 172.21.15.73:0/2840403900 shutdown_connections 2023-08-10T11:50:45.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.765+0000 7f7e1e80b700 1 -- 172.21.15.73:0/2840403900 wait complete. 2023-08-10T11:50:45.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.766+0000 7f7e1e80b700 1 Processor -- start 2023-08-10T11:50:45.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.766+0000 7f7e1e80b700 1 -- start start 2023-08-10T11:50:45.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.766+0000 7f7e1e80b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e180ff650 0x7f7e181035e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:45.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.766+0000 7f7e1e80b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e18100840 0x7f7e18101c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:45.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.766+0000 7f7e1e80b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e181011e0 0x7f7e18102160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:45.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.766+0000 7f7e1e80b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e18102900 con 0x7f7e18100840 2023-08-10T11:50:45.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.766+0000 7f7e1e80b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e18102a70 con 0x7f7e181011e0 2023-08-10T11:50:45.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.766+0000 7f7e1e80b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e181a0500 con 0x7f7e180ff650 2023-08-10T11:50:45.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.766+0000 7f7e0ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e18100840 0x7f7e18101c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:45.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.766+0000 7f7e0ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e18100840 0x7f7e18101c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58772/0 (socket says 172.21.15.73:58772) 2023-08-10T11:50:45.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.766+0000 7f7e0ffff700 1 -- 172.21.15.73:0/3103230758 learned_addr learned my addr 172.21.15.73:0/3103230758 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:45.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.766+0000 7f7e1cda8700 1 --2- 172.21.15.73:0/3103230758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e181011e0 0x7f7e18102160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:45.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.766+0000 7f7e17fff700 1 --2- 172.21.15.73:0/3103230758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e180ff650 0x7f7e181035e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:45.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.766+0000 7f7e0ffff700 1 -- 172.21.15.73:0/3103230758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e180ff650 msgr2=0x7f7e181035e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:45.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.766+0000 7f7e0ffff700 1 --2- 172.21.15.73:0/3103230758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e180ff650 0x7f7e181035e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:45.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.766+0000 7f7e0ffff700 1 -- 172.21.15.73:0/3103230758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e181011e0 msgr2=0x7f7e18102160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:45.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.766+0000 7f7e0ffff700 1 --2- 172.21.15.73:0/3103230758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e181011e0 0x7f7e18102160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:45.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.766+0000 7f7e0ffff700 1 -- 172.21.15.73:0/3103230758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e10009d00 con 0x7f7e18100840 2023-08-10T11:50:45.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.766+0000 7f7e17fff700 1 --2- 172.21.15.73:0/3103230758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e180ff650 0x7f7e181035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:50:45.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.767+0000 7f7e0ffff700 1 --2- 172.21.15.73:0/3103230758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e18100840 0x7f7e18101c20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000e9a0 tx=0x7f7e0000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:45.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.767+0000 7f7e15ffb700 1 -- 172.21.15.73:0/3103230758 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00009790 con 0x7f7e18100840 2023-08-10T11:50:45.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.767+0000 7f7e15ffb700 1 -- 172.21.15.73:0/3103230758 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e0000cbd0 con 0x7f7e18100840 2023-08-10T11:50:45.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.767+0000 7f7e1e80b700 1 -- 172.21.15.73:0/3103230758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e181a07e0 con 0x7f7e18100840 2023-08-10T11:50:45.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.767+0000 7f7e15ffb700 1 -- 172.21.15.73:0/3103230758 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00018680 con 0x7f7e18100840 2023-08-10T11:50:45.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.767+0000 7f7e1e80b700 1 -- 172.21.15.73:0/3103230758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e181a0d40 con 0x7f7e18100840 2023-08-10T11:50:45.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.768+0000 7f7e1e80b700 1 -- 172.21.15.73:0/3103230758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1810ae70 con 0x7f7e18100840 2023-08-10T11:50:45.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.769+0000 7f7e15ffb700 1 -- 172.21.15.73:0/3103230758 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f7e0000cd40 con 0x7f7e18100840 2023-08-10T11:50:45.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.769+0000 7f7e15ffb700 1 --2- 172.21.15.73:0/3103230758 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f7e040a1220 0x7f7e040a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:45.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.770+0000 7f7e17fff700 1 --2- 172.21.15.73:0/3103230758 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f7e040a1220 0x7f7e040a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:45.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.770+0000 7f7e15ffb700 1 -- 172.21.15.73:0/3103230758 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f7e00014070 con 0x7f7e18100840 2023-08-10T11:50:45.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.770+0000 7f7e17fff700 1 --2- 172.21.15.73:0/3103230758 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f7e040a1220 0x7f7e040a36e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7e08005fd0 tx=0x7f7e08005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:45.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:45.773+0000 7f7e15ffb700 1 -- 172.21.15.73:0/3103230758 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f7e000964f0 con 0x7f7e18100840 2023-08-10T11:50:46.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:45 smithi073 ceph-mon[128869]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:46.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:45 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:46.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:45 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:46.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:45 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:46.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:45 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:46.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:45 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:46.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:45 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:46.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:46.037+0000 7f7e1e80b700 1 -- 172.21.15.73:0/3103230758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e1810b030 con 0x7f7e18100840 2023-08-10T11:50:46.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:46.038+0000 7f7e15ffb700 1 -- 172.21.15.73:0/3103230758 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8082 (secure 0 0 0) 0x7f7e00099b10 con 0x7f7e18100840 2023-08-10T11:50:46.040 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:50:46.040 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1319360725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1319360725},{"type":"v1","addr":"172.21.15.73:6835","nonce":1319360725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/431221951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":431221951},{"type":"v1","addr":"172.21.15.73:6837","nonce":431221951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/1099539481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1099539481},{"type":"v1","addr":"172.21.15.73:6839","nonce":1099539481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3028461815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3028461815},{"type":"v1","addr":"172.21.15.156:6833","nonce":3028461815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/4148407154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4148407154},{"type":"v1","addr":"172.21.15.152:6833","nonce":4148407154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1791572604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1791572604},{"type":"v1","addr":"172.21.15.152:6835","nonce":1791572604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/904126790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":904126790},{"type":"v1","addr":"172.21.15.156:6835","nonce":904126790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/4284306352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":4284306352},{"type":"v1","addr":"172.21.15.156:6837","nonce":4284306352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24475,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6839/3361058731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":3361058731},{"type":"v1","addr":"172.21.15.156:6839","nonce":3361058731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/74214089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":74214089},{"type":"v1","addr":"172.21.15.152:6837","nonce":74214089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2023-08-10T11:50:46.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:46.040+0000 7f7e1e80b700 1 -- 172.21.15.73:0/3103230758 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f7e040a1220 msgr2=0x7f7e040a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:46.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:46.040+0000 7f7e1e80b700 1 --2- 172.21.15.73:0/3103230758 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f7e040a1220 0x7f7e040a36e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7e08005fd0 tx=0x7f7e08005f00 comp rx=0 tx=0).stop 2023-08-10T11:50:46.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:46.040+0000 7f7e1e80b700 1 -- 172.21.15.73:0/3103230758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e18100840 msgr2=0x7f7e18101c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:46.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:46.040+0000 7f7e1e80b700 1 --2- 172.21.15.73:0/3103230758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e18100840 0x7f7e18101c20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000e9a0 tx=0x7f7e0000ecb0 comp rx=0 tx=0).stop 2023-08-10T11:50:46.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:46.040+0000 7f7e1e80b700 1 -- 172.21.15.73:0/3103230758 shutdown_connections 2023-08-10T11:50:46.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:46.040+0000 7f7e1e80b700 1 --2- 172.21.15.73:0/3103230758 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f7e040a1220 0x7f7e040a36e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:46.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:46.040+0000 7f7e1e80b700 1 --2- 172.21.15.73:0/3103230758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e181011e0 0x7f7e18102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:46.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:46.040+0000 7f7e1e80b700 1 --2- 172.21.15.73:0/3103230758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e180ff650 0x7f7e181035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:46.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:46.040+0000 7f7e1e80b700 1 --2- 172.21.15.73:0/3103230758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e18100840 0x7f7e18101c20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:46.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:46.040+0000 7f7e1e80b700 1 -- 172.21.15.73:0/3103230758 >> 172.21.15.73:0/3103230758 conn(0x7f7e180faba0 msgr2=0x7f7e18067990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:46.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:46.040+0000 7f7e1e80b700 1 -- 172.21.15.73:0/3103230758 shutdown_connections 2023-08-10T11:50:46.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:46.040+0000 7f7e1e80b700 1 -- 172.21.15.73:0/3103230758 wait complete. 2023-08-10T11:50:46.044 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 11 2023-08-10T11:50:46.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:45 smithi152 ceph-mon[130220]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:46.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:45 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:46.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:45 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:46.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:45 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:46.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:45 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:46.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:45 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:46.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:45 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:46.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:45 smithi156 ceph-mon[130574]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:46.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:45 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:46.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:45 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:46.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:45 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:46.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:45 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:46.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:45 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:46.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:45 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:47.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:46 smithi073 ceph-mon[128869]: Deploying daemon mds.a on smithi073 2023-08-10T11:50:47.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:46 smithi073 ceph-mon[128869]: mds.? [v2:172.21.15.73:6838/1099539481,v1:172.21.15.73:6839/1099539481] up:boot 2023-08-10T11:50:47.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:46 smithi073 ceph-mon[128869]: fsmap 10 up:standby 2023-08-10T11:50:47.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:46 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-08-10T11:50:47.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:46 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3103230758' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:47.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:46 smithi152 ceph-mon[130220]: Deploying daemon mds.a on smithi073 2023-08-10T11:50:47.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:46 smithi152 ceph-mon[130220]: mds.? [v2:172.21.15.73:6838/1099539481,v1:172.21.15.73:6839/1099539481] up:boot 2023-08-10T11:50:47.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:46 smithi152 ceph-mon[130220]: fsmap 10 up:standby 2023-08-10T11:50:47.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:46 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-08-10T11:50:47.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:46 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3103230758' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:47.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:46 smithi156 ceph-mon[130574]: Deploying daemon mds.a on smithi073 2023-08-10T11:50:47.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:46 smithi156 ceph-mon[130574]: mds.? [v2:172.21.15.73:6838/1099539481,v1:172.21.15.73:6839/1099539481] up:boot 2023-08-10T11:50:47.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:46 smithi156 ceph-mon[130574]: fsmap 10 up:standby 2023-08-10T11:50:47.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:46 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-08-10T11:50:47.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:46 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3103230758' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:47.289 INFO:journalctl@ceph.mds.a.smithi073.stdout:Aug 10 11:50:47 smithi073 systemd[1]: Starting Ceph mds.a for 0e619a74-3773-11ee-9b37-001a4aab830c... 2023-08-10T11:50:47.540 INFO:journalctl@ceph.mds.a.smithi073.stdout:Aug 10 11:50:47 smithi073 podman[163502]: 2023-08-10T11:50:47.851 INFO:journalctl@ceph.mds.a.smithi073.stdout:Aug 10 11:50:47 smithi073 ceph-mds[163542]: -- 172.21.15.73:0/4181869571 <== mon.0 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b1a231f1e0 con 0x55b1a22f4c00 2023-08-10T11:50:47.852 INFO:journalctl@ceph.mds.a.smithi073.stdout:Aug 10 11:50:47 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-a[163518]: starting mds.a at 2023-08-10T11:50:47.852 INFO:journalctl@ceph.mds.a.smithi073.stdout:Aug 10 11:50:47 smithi073 bash[163502]: 687bbfe1b2d152f6b77663c96d518b654e8ac5bd08ddde26a750163a6133f7eb 2023-08-10T11:50:47.852 INFO:journalctl@ceph.mds.a.smithi073.stdout:Aug 10 11:50:47 smithi073 systemd[1]: Started Ceph mds.a for 0e619a74-3773-11ee-9b37-001a4aab830c. 2023-08-10T11:50:47.853 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:47 smithi073 ceph-mon[128869]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:47.853 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:47.853 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:47.853 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:47.853 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:47.853 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:47.854 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:47 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:48.055 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T11:50:48.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.181+0000 7fc032106700 1 -- 172.21.15.73:0/3478836078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc02c0ff670 msgr2=0x7fc02c0ffa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:48.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.181+0000 7fc032106700 1 --2- 172.21.15.73:0/3478836078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc02c0ff670 0x7fc02c0ffa90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc0140099c0 tx=0x7fc014009cd0 comp rx=0 tx=0).stop 2023-08-10T11:50:48.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.182+0000 7fc032106700 1 -- 172.21.15.73:0/3478836078 shutdown_connections 2023-08-10T11:50:48.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.182+0000 7fc032106700 1 --2- 172.21.15.73:0/3478836078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc02c101200 0x7fc02c107ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:48.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.182+0000 7fc032106700 1 --2- 172.21.15.73:0/3478836078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc02c0ff670 0x7fc02c0ffa90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:48.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.182+0000 7fc032106700 1 --2- 172.21.15.73:0/3478836078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc02c100860 0x7fc02c100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:48.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.182+0000 7fc032106700 1 -- 172.21.15.73:0/3478836078 >> 172.21.15.73:0/3478836078 conn(0x7fc02c0fabc0 msgr2=0x7fc02c0fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:48.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.182+0000 7fc032106700 1 -- 172.21.15.73:0/3478836078 shutdown_connections 2023-08-10T11:50:48.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.182+0000 7fc032106700 1 -- 172.21.15.73:0/3478836078 wait complete. 2023-08-10T11:50:48.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.182+0000 7fc032106700 1 Processor -- start 2023-08-10T11:50:48.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.183+0000 7fc032106700 1 -- start start 2023-08-10T11:50:48.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.183+0000 7fc032106700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc02c0ff670 0x7fc02c195320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:48.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.183+0000 7fc032106700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc02c100860 0x7fc02c195860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:48.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.183+0000 7fc032106700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc02c101200 0x7fc02c19c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:48.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.183+0000 7fc032106700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c19cea0 con 0x7fc02c100860 2023-08-10T11:50:48.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.183+0000 7fc032106700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c19cfe0 con 0x7fc02c101200 2023-08-10T11:50:48.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.183+0000 7fc032106700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c19d170 con 0x7fc02c0ff670 2023-08-10T11:50:48.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.183+0000 7fc02affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc02c100860 0x7fc02c195860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:48.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.183+0000 7fc02affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc02c100860 0x7fc02c195860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58800/0 (socket says 172.21.15.73:58800) 2023-08-10T11:50:48.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.183+0000 7fc02affd700 1 -- 172.21.15.73:0/578182487 learned_addr learned my addr 172.21.15.73:0/578182487 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:48.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.183+0000 7fc02b7fe700 1 --2- 172.21.15.73:0/578182487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc02c0ff670 0x7fc02c195320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:48.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.183+0000 7fc02bfff700 1 --2- 172.21.15.73:0/578182487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc02c101200 0x7fc02c19c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:48.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.183+0000 7fc02affd700 1 -- 172.21.15.73:0/578182487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc02c0ff670 msgr2=0x7fc02c195320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:48.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.183+0000 7fc02affd700 1 --2- 172.21.15.73:0/578182487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc02c0ff670 0x7fc02c195320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:48.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.183+0000 7fc02affd700 1 -- 172.21.15.73:0/578182487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc02c101200 msgr2=0x7fc02c19c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:48.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.183+0000 7fc02affd700 1 --2- 172.21.15.73:0/578182487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc02c101200 0x7fc02c19c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:48.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.183+0000 7fc02affd700 1 -- 172.21.15.73:0/578182487 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0140095f0 con 0x7fc02c100860 2023-08-10T11:50:48.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.183+0000 7fc02b7fe700 1 --2- 172.21.15.73:0/578182487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc02c0ff670 0x7fc02c195320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:50:48.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.183+0000 7fc02affd700 1 --2- 172.21.15.73:0/578182487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc02c100860 0x7fc02c195860 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00d950 tx=0x7fc01c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:48.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.184+0000 7fc028ff9700 1 -- 172.21.15.73:0/578182487 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c009b40 con 0x7fc02c100860 2023-08-10T11:50:48.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.184+0000 7fc028ff9700 1 -- 172.21.15.73:0/578182487 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc01c009ca0 con 0x7fc02c100860 2023-08-10T11:50:48.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.184+0000 7fc032106700 1 -- 172.21.15.73:0/578182487 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc02c19d450 con 0x7fc02c100860 2023-08-10T11:50:48.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.184+0000 7fc028ff9700 1 -- 172.21.15.73:0/578182487 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c00f620 con 0x7fc02c100860 2023-08-10T11:50:48.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.184+0000 7fc032106700 1 -- 172.21.15.73:0/578182487 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc02c19d960 con 0x7fc02c100860 2023-08-10T11:50:48.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.184+0000 7fc032106700 1 -- 172.21.15.73:0/578182487 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc02c10ae90 con 0x7fc02c100860 2023-08-10T11:50:48.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.185+0000 7fc028ff9700 1 -- 172.21.15.73:0/578182487 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fc01c010460 con 0x7fc02c100860 2023-08-10T11:50:48.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.186+0000 7fc028ff9700 1 --2- 172.21.15.73:0/578182487 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc0180a11a0 0x7fc0180a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:48.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.186+0000 7fc02b7fe700 1 --2- 172.21.15.73:0/578182487 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc0180a11a0 0x7fc0180a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:48.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.186+0000 7fc028ff9700 1 -- 172.21.15.73:0/578182487 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc01c0cc7f0 con 0x7fc02c100860 2023-08-10T11:50:48.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.186+0000 7fc02b7fe700 1 --2- 172.21.15.73:0/578182487 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc0180a11a0 0x7fc0180a3660 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc014009990 tx=0x7fc01401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:48.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.189+0000 7fc028ff9700 1 -- 172.21.15.73:0/578182487 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fc01c0963e0 con 0x7fc02c100860 2023-08-10T11:50:48.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:47 smithi152 ceph-mon[130220]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:48.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:48.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:48.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:48.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:48.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:48.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:47 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:48.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:47 smithi156 ceph-mon[130574]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:48.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:48.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:48.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:48.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T11:50:48.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T11:50:48.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:47 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:48.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.422+0000 7fc032106700 1 -- 172.21.15.73:0/578182487 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc02c106590 con 0x7fc02c100860 2023-08-10T11:50:48.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.423+0000 7fc028ff9700 1 -- 172.21.15.73:0/578182487 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+8840 (secure 0 0 0) 0x7fc01c099a00 con 0x7fc02c100860 2023-08-10T11:50:48.425 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:50:48.425 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1319360725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1319360725},{"type":"v1","addr":"172.21.15.73:6835","nonce":1319360725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/431221951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":431221951},{"type":"v1","addr":"172.21.15.73:6837","nonce":431221951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/1099539481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1099539481},{"type":"v1","addr":"172.21.15.73:6839","nonce":1099539481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/3067925859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":3067925859},{"type":"v1","addr":"172.21.15.73:6841","nonce":3067925859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3028461815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3028461815},{"type":"v1","addr":"172.21.15.156:6833","nonce":3028461815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/4148407154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4148407154},{"type":"v1","addr":"172.21.15.152:6833","nonce":4148407154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1791572604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1791572604},{"type":"v1","addr":"172.21.15.152:6835","nonce":1791572604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/904126790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":904126790},{"type":"v1","addr":"172.21.15.156:6835","nonce":904126790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/4284306352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":4284306352},{"type":"v1","addr":"172.21.15.156:6837","nonce":4284306352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24475,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6839/3361058731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":3361058731},{"type":"v1","addr":"172.21.15.156:6839","nonce":3361058731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/74214089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":74214089},{"type":"v1","addr":"172.21.15.152:6837","nonce":74214089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2023-08-10T11:50:48.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.425+0000 7fc032106700 1 -- 172.21.15.73:0/578182487 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc0180a11a0 msgr2=0x7fc0180a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:48.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.425+0000 7fc032106700 1 --2- 172.21.15.73:0/578182487 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc0180a11a0 0x7fc0180a3660 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc014009990 tx=0x7fc01401a040 comp rx=0 tx=0).stop 2023-08-10T11:50:48.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.425+0000 7fc032106700 1 -- 172.21.15.73:0/578182487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc02c100860 msgr2=0x7fc02c195860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:48.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.425+0000 7fc032106700 1 --2- 172.21.15.73:0/578182487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc02c100860 0x7fc02c195860 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00d950 tx=0x7fc01c00dd10 comp rx=0 tx=0).stop 2023-08-10T11:50:48.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.425+0000 7fc032106700 1 -- 172.21.15.73:0/578182487 shutdown_connections 2023-08-10T11:50:48.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.425+0000 7fc032106700 1 --2- 172.21.15.73:0/578182487 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc0180a11a0 0x7fc0180a3660 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:48.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.425+0000 7fc032106700 1 --2- 172.21.15.73:0/578182487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc02c101200 0x7fc02c19c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:48.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.425+0000 7fc032106700 1 --2- 172.21.15.73:0/578182487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc02c0ff670 0x7fc02c195320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:48.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.425+0000 7fc032106700 1 --2- 172.21.15.73:0/578182487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc02c100860 0x7fc02c195860 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:48.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.425+0000 7fc032106700 1 -- 172.21.15.73:0/578182487 >> 172.21.15.73:0/578182487 conn(0x7fc02c0fabc0 msgr2=0x7fc02c0fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:48.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.425+0000 7fc032106700 1 -- 172.21.15.73:0/578182487 shutdown_connections 2023-08-10T11:50:48.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:48.425+0000 7fc032106700 1 -- 172.21.15.73:0/578182487 wait complete. 2023-08-10T11:50:48.429 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 12 2023-08-10T11:50:48.896 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:48 smithi152 ceph-mon[130220]: Deploying daemon mds.b on smithi152 2023-08-10T11:50:48.897 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:48 smithi152 ceph-mon[130220]: mds.? [v2:172.21.15.73:6840/3067925859,v1:172.21.15.73:6841/3067925859] up:boot 2023-08-10T11:50:48.897 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:48 smithi152 ceph-mon[130220]: fsmap 11 up:standby 2023-08-10T11:50:48.897 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:48 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-08-10T11:50:48.897 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:48 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/578182487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:49.245 INFO:journalctl@ceph.mds.b.smithi152.stdout:Aug 10 11:50:49 smithi152 systemd[1]: Starting Ceph mds.b for 0e619a74-3773-11ee-9b37-001a4aab830c... 2023-08-10T11:50:49.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:48 smithi156 ceph-mon[130574]: Deploying daemon mds.b on smithi152 2023-08-10T11:50:49.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:48 smithi156 ceph-mon[130574]: mds.? [v2:172.21.15.73:6840/3067925859,v1:172.21.15.73:6841/3067925859] up:boot 2023-08-10T11:50:49.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:48 smithi156 ceph-mon[130574]: fsmap 11 up:standby 2023-08-10T11:50:49.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:48 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-08-10T11:50:49.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:48 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/578182487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:49.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:48 smithi073 ceph-mon[128869]: Deploying daemon mds.b on smithi152 2023-08-10T11:50:49.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:48 smithi073 ceph-mon[128869]: mds.? [v2:172.21.15.73:6840/3067925859,v1:172.21.15.73:6841/3067925859] up:boot 2023-08-10T11:50:49.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:48 smithi073 ceph-mon[128869]: fsmap 11 up:standby 2023-08-10T11:50:49.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:48 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-08-10T11:50:49.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:48 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/578182487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:49.682 INFO:journalctl@ceph.mds.b.smithi152.stdout:Aug 10 11:50:49 smithi152 podman[155616]: 2023-08-10T11:50:49.995 INFO:journalctl@ceph.mds.b.smithi152.stdout:Aug 10 11:50:49 smithi152 ceph-mds[155656]: -- 172.21.15.152:0/928983808 <== mon.2 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560dcc3291e0 con 0x560dcc2fec00 2023-08-10T11:50:49.995 INFO:journalctl@ceph.mds.b.smithi152.stdout:Aug 10 11:50:49 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-b[155632]: starting mds.b at 2023-08-10T11:50:49.995 INFO:journalctl@ceph.mds.b.smithi152.stdout:Aug 10 11:50:49 smithi152 bash[155616]: da46feb2056dda4feef34f8e09555165ce692d78c5fad87d919175f51e25e6de 2023-08-10T11:50:49.996 INFO:journalctl@ceph.mds.b.smithi152.stdout:Aug 10 11:50:49 smithi152 systemd[1]: Started Ceph mds.b for 0e619a74-3773-11ee-9b37-001a4aab830c. 2023-08-10T11:50:49.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:49 smithi152 ceph-mon[130220]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:49.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:49 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:49.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:49 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:49.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:49 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:49.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:49 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:49.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:49 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:50.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:49 smithi156 ceph-mon[130574]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:50.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:49 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:50.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:49 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:50.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:49 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:50.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:49 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:50.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:49 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:50.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:49 smithi073 ceph-mon[128869]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:50.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:49 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:50.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:49 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:50.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:49 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:50.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:49 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:50.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:49 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:50.439 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T11:50:50.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.567+0000 7f81616ae700 1 -- 172.21.15.73:0/1987729113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f815c1019f0 msgr2=0x7f815c101e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.567+0000 7f81616ae700 1 --2- 172.21.15.73:0/1987729113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f815c1019f0 0x7f815c101e50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f814c009990 tx=0x7f814c009ca0 comp rx=0 tx=0).stop 2023-08-10T11:50:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.567+0000 7f81616ae700 1 -- 172.21.15.73:0/1987729113 shutdown_connections 2023-08-10T11:50:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.567+0000 7f81616ae700 1 --2- 172.21.15.73:0/1987729113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f815c0fea20 0x7f815c0fee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.567+0000 7f81616ae700 1 --2- 172.21.15.73:0/1987729113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f815c102390 0x7f815c108c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.567+0000 7f81616ae700 1 --2- 172.21.15.73:0/1987729113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f815c1019f0 0x7f815c101e50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.567+0000 7f81616ae700 1 -- 172.21.15.73:0/1987729113 >> 172.21.15.73:0/1987729113 conn(0x7f815c0fa330 msgr2=0x7f815c0fc790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.567+0000 7f81616ae700 1 -- 172.21.15.73:0/1987729113 shutdown_connections 2023-08-10T11:50:50.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.567+0000 7f81616ae700 1 -- 172.21.15.73:0/1987729113 wait complete. 2023-08-10T11:50:50.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.568+0000 7f81616ae700 1 Processor -- start 2023-08-10T11:50:50.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.568+0000 7f81616ae700 1 -- start start 2023-08-10T11:50:50.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.568+0000 7f81616ae700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f815c0fea20 0x7f815c1963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:50.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.568+0000 7f81616ae700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f815c1019f0 0x7f815c196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:50.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.568+0000 7f81616ae700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f815c102390 0x7f815c19d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:50.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.568+0000 7f81616ae700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815c19df40 con 0x7f815c102390 2023-08-10T11:50:50.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.568+0000 7f81616ae700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815c19e080 con 0x7f815c0fea20 2023-08-10T11:50:50.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.568+0000 7f81616ae700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815c19e210 con 0x7f815c1019f0 2023-08-10T11:50:50.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.568+0000 7f815b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f815c102390 0x7f815c19d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:50.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.568+0000 7f815b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f815c102390 0x7f815c19d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58814/0 (socket says 172.21.15.73:58814) 2023-08-10T11:50:50.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.568+0000 7f815b7fe700 1 -- 172.21.15.73:0/3280025470 learned_addr learned my addr 172.21.15.73:0/3280025470 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:50.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.568+0000 7f815a7fc700 1 --2- 172.21.15.73:0/3280025470 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f815c1019f0 0x7f815c196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:50.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.569+0000 7f815affd700 1 --2- 172.21.15.73:0/3280025470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f815c0fea20 0x7f815c1963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:50.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.569+0000 7f815b7fe700 1 -- 172.21.15.73:0/3280025470 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f815c1019f0 msgr2=0x7f815c196900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:50.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.569+0000 7f815b7fe700 1 --2- 172.21.15.73:0/3280025470 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f815c1019f0 0x7f815c196900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:50.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.569+0000 7f815b7fe700 1 -- 172.21.15.73:0/3280025470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f815c0fea20 msgr2=0x7f815c1963c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:50.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.569+0000 7f815b7fe700 1 --2- 172.21.15.73:0/3280025470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f815c0fea20 0x7f815c1963c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:50.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.569+0000 7f815b7fe700 1 -- 172.21.15.73:0/3280025470 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814c0095f0 con 0x7f815c102390 2023-08-10T11:50:50.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.569+0000 7f815b7fe700 1 --2- 172.21.15.73:0/3280025470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f815c102390 0x7f815c19d970 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f815400ef30 tx=0x7f815400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:50.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.569+0000 7f8143fff700 1 -- 172.21.15.73:0/3280025470 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8154018070 con 0x7f815c102390 2023-08-10T11:50:50.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.569+0000 7f8143fff700 1 -- 172.21.15.73:0/3280025470 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f815400f040 con 0x7f815c102390 2023-08-10T11:50:50.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.569+0000 7f81616ae700 1 -- 172.21.15.73:0/3280025470 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f815c19e490 con 0x7f815c102390 2023-08-10T11:50:50.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.569+0000 7f8143fff700 1 -- 172.21.15.73:0/3280025470 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815400cdb0 con 0x7f815c102390 2023-08-10T11:50:50.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.569+0000 7f81616ae700 1 -- 172.21.15.73:0/3280025470 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f815c19e9a0 con 0x7f815c102390 2023-08-10T11:50:50.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.570+0000 7f81616ae700 1 -- 172.21.15.73:0/3280025470 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f815c107730 con 0x7f815c102390 2023-08-10T11:50:50.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.571+0000 7f8143fff700 1 -- 172.21.15.73:0/3280025470 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f8154003a00 con 0x7f815c102390 2023-08-10T11:50:50.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.572+0000 7f8143fff700 1 --2- 172.21.15.73:0/3280025470 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f81440a11a0 0x7f81440a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:50.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.572+0000 7f8143fff700 1 -- 172.21.15.73:0/3280025470 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f81540cc9c0 con 0x7f815c102390 2023-08-10T11:50:50.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.572+0000 7f815affd700 1 --2- 172.21.15.73:0/3280025470 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f81440a11a0 0x7f81440a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:50.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.572+0000 7f815affd700 1 --2- 172.21.15.73:0/3280025470 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f81440a11a0 0x7f81440a3660 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8150005fd0 tx=0x7f8150005dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:50.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.575+0000 7f8143fff700 1 -- 172.21.15.73:0/3280025470 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8154096640 con 0x7f815c102390 2023-08-10T11:50:50.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.847+0000 7f81616ae700 1 -- 172.21.15.73:0/3280025470 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f815c02c970 con 0x7f815c102390 2023-08-10T11:50:50.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.847+0000 7f8143fff700 1 -- 172.21.15.73:0/3280025470 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+9601 (secure 0 0 0) 0x7f8154099c60 con 0x7f815c102390 2023-08-10T11:50:50.849 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:50:50.850 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1319360725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1319360725},{"type":"v1","addr":"172.21.15.73:6835","nonce":1319360725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/431221951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":431221951},{"type":"v1","addr":"172.21.15.73:6837","nonce":431221951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/1099539481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1099539481},{"type":"v1","addr":"172.21.15.73:6839","nonce":1099539481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6841/3067925859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":3067925859},{"type":"v1","addr":"172.21.15.73:6841","nonce":3067925859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24397,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3028461815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3028461815},{"type":"v1","addr":"172.21.15.156:6833","nonce":3028461815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/4148407154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4148407154},{"type":"v1","addr":"172.21.15.152:6833","nonce":4148407154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/1791572604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1791572604},{"type":"v1","addr":"172.21.15.152:6835","nonce":1791572604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/904126790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":904126790},{"type":"v1","addr":"172.21.15.156:6835","nonce":904126790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/4284306352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":4284306352},{"type":"v1","addr":"172.21.15.156:6837","nonce":4284306352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24475,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6839/3361058731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":3361058731},{"type":"v1","addr":"172.21.15.156:6839","nonce":3361058731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/74214089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":74214089},{"type":"v1","addr":"172.21.15.152:6837","nonce":74214089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24503,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/3870202690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3870202690},{"type":"v1","addr":"172.21.15.152:6839","nonce":3870202690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[]} 2023-08-10T11:50:50.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.849+0000 7f81616ae700 1 -- 172.21.15.73:0/3280025470 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f81440a11a0 msgr2=0x7f81440a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:50.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.849+0000 7f81616ae700 1 --2- 172.21.15.73:0/3280025470 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f81440a11a0 0x7f81440a3660 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8150005fd0 tx=0x7f8150005dd0 comp rx=0 tx=0).stop 2023-08-10T11:50:50.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.849+0000 7f81616ae700 1 -- 172.21.15.73:0/3280025470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f815c102390 msgr2=0x7f815c19d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:50.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.849+0000 7f81616ae700 1 --2- 172.21.15.73:0/3280025470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f815c102390 0x7f815c19d970 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f815400ef30 tx=0x7f815400c3a0 comp rx=0 tx=0).stop 2023-08-10T11:50:50.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.849+0000 7f81616ae700 1 -- 172.21.15.73:0/3280025470 shutdown_connections 2023-08-10T11:50:50.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.849+0000 7f81616ae700 1 --2- 172.21.15.73:0/3280025470 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f81440a11a0 0x7f81440a3660 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:50.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.849+0000 7f81616ae700 1 --2- 172.21.15.73:0/3280025470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f815c0fea20 0x7f815c1963c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:50.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.849+0000 7f81616ae700 1 --2- 172.21.15.73:0/3280025470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f815c102390 0x7f815c19d970 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:50.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.849+0000 7f81616ae700 1 --2- 172.21.15.73:0/3280025470 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f815c1019f0 0x7f815c196900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:50.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.849+0000 7f81616ae700 1 -- 172.21.15.73:0/3280025470 >> 172.21.15.73:0/3280025470 conn(0x7f815c0fa330 msgr2=0x7f815c0fc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:50.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.849+0000 7f81616ae700 1 -- 172.21.15.73:0/3280025470 shutdown_connections 2023-08-10T11:50:50.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.850+0000 7f81616ae700 1 -- 172.21.15.73:0/3280025470 wait complete. 2023-08-10T11:50:50.853 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 13 2023-08-10T11:50:50.863 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T11:50:50.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.993+0000 7ffb54172700 1 -- 172.21.15.73:0/2024039062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb4c101210 msgr2=0x7ffb4c107ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:50.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.993+0000 7ffb54172700 1 --2- 172.21.15.73:0/2024039062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb4c101210 0x7ffb4c107ac0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffb4400b0d0 tx=0x7ffb4400b3e0 comp rx=0 tx=0).stop 2023-08-10T11:50:50.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.993+0000 7ffb54172700 1 -- 172.21.15.73:0/2024039062 shutdown_connections 2023-08-10T11:50:50.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.993+0000 7ffb54172700 1 --2- 172.21.15.73:0/2024039062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb4c101210 0x7ffb4c107ac0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:50.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.993+0000 7ffb54172700 1 --2- 172.21.15.73:0/2024039062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb4c0ff680 0x7ffb4c0ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:50.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.993+0000 7ffb54172700 1 --2- 172.21.15.73:0/2024039062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb4c100870 0x7ffb4c100cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:50.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.993+0000 7ffb54172700 1 -- 172.21.15.73:0/2024039062 >> 172.21.15.73:0/2024039062 conn(0x7ffb4c0fabd0 msgr2=0x7ffb4c0fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:50.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.993+0000 7ffb54172700 1 -- 172.21.15.73:0/2024039062 shutdown_connections 2023-08-10T11:50:50.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.993+0000 7ffb54172700 1 -- 172.21.15.73:0/2024039062 wait complete. 2023-08-10T11:50:50.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.993+0000 7ffb54172700 1 Processor -- start 2023-08-10T11:50:50.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.993+0000 7ffb54172700 1 -- start start 2023-08-10T11:50:50.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.994+0000 7ffb54172700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb4c0ff680 0x7ffb4c1964e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:50.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.994+0000 7ffb54172700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb4c100870 0x7ffb4c196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:50.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.994+0000 7ffb54172700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb4c101210 0x7ffb4c19da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:50.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.994+0000 7ffb54172700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c19e060 con 0x7ffb4c100870 2023-08-10T11:50:50.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.994+0000 7ffb54172700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c19e1a0 con 0x7ffb4c101210 2023-08-10T11:50:50.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.994+0000 7ffb54172700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c19e330 con 0x7ffb4c0ff680 2023-08-10T11:50:50.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.994+0000 7ffb5170d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb4c100870 0x7ffb4c196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:51.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.994+0000 7ffb51f0e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb4c0ff680 0x7ffb4c1964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:51.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.994+0000 7ffb5170d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb4c100870 0x7ffb4c196a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58826/0 (socket says 172.21.15.73:58826) 2023-08-10T11:50:51.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.994+0000 7ffb5170d700 1 -- 172.21.15.73:0/767570174 learned_addr learned my addr 172.21.15.73:0/767570174 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:51.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.994+0000 7ffb5270f700 1 --2- 172.21.15.73:0/767570174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb4c101210 0x7ffb4c19da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:51.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.994+0000 7ffb5170d700 1 -- 172.21.15.73:0/767570174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb4c0ff680 msgr2=0x7ffb4c1964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:51.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.994+0000 7ffb5170d700 1 --2- 172.21.15.73:0/767570174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb4c0ff680 0x7ffb4c1964e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:51.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.994+0000 7ffb5170d700 1 -- 172.21.15.73:0/767570174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb4c101210 msgr2=0x7ffb4c19da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:51.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.994+0000 7ffb5170d700 1 --2- 172.21.15.73:0/767570174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb4c101210 0x7ffb4c19da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:51.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.994+0000 7ffb5170d700 1 -- 172.21.15.73:0/767570174 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb44009d00 con 0x7ffb4c100870 2023-08-10T11:50:51.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.994+0000 7ffb5170d700 1 --2- 172.21.15.73:0/767570174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb4c100870 0x7ffb4c196a20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ffb4800d980 tx=0x7ffb4800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:51.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.994+0000 7ffb42ffd700 1 -- 172.21.15.73:0/767570174 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb48004220 con 0x7ffb4c100870 2023-08-10T11:50:51.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.994+0000 7ffb42ffd700 1 -- 172.21.15.73:0/767570174 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb48007640 con 0x7ffb4c100870 2023-08-10T11:50:51.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.994+0000 7ffb42ffd700 1 -- 172.21.15.73:0/767570174 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb48005690 con 0x7ffb4c100870 2023-08-10T11:50:51.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.994+0000 7ffb54172700 1 -- 172.21.15.73:0/767570174 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb4c19e610 con 0x7ffb4c100870 2023-08-10T11:50:51.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.994+0000 7ffb54172700 1 -- 172.21.15.73:0/767570174 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb4c19ead0 con 0x7ffb4c100870 2023-08-10T11:50:51.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.995+0000 7ffb54172700 1 -- 172.21.15.73:0/767570174 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb4c10aea0 con 0x7ffb4c100870 2023-08-10T11:50:51.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.996+0000 7ffb42ffd700 1 -- 172.21.15.73:0/767570174 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7ffb48004750 con 0x7ffb4c100870 2023-08-10T11:50:51.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.997+0000 7ffb42ffd700 1 --2- 172.21.15.73:0/767570174 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ffb380a11a0 0x7ffb380a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:51.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.997+0000 7ffb42ffd700 1 -- 172.21.15.73:0/767570174 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ffb480cc7f0 con 0x7ffb4c100870 2023-08-10T11:50:51.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.997+0000 7ffb51f0e700 1 --2- 172.21.15.73:0/767570174 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ffb380a11a0 0x7ffb380a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:51.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:50.997+0000 7ffb51f0e700 1 --2- 172.21.15.73:0/767570174 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ffb380a11a0 0x7ffb380a3660 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c1006d0 tx=0x7ffb3c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:51.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.000+0000 7ffb42ffd700 1 -- 172.21.15.73:0/767570174 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ffb48096340 con 0x7ffb4c100870 2023-08-10T11:50:51.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.198+0000 7ffb54172700 1 -- 172.21.15.73:0/767570174 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb4c19f110 con 0x7ffb4c100870 2023-08-10T11:50:51.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.199+0000 7ffb42ffd700 1 -- 172.21.15.73:0/767570174 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18408 (secure 0 0 0) 0x7ffb48099960 con 0x7ffb4c100870 2023-08-10T11:50:51.201 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:50:51.202 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":79,"fsid":"0e619a74-3773-11ee-9b37-001a4aab830c","created":"2023-08-10T11:43:53.974768+0000","modified":"2023-08-10T11:50:13.920565+0000","last_up_change":"2023-08-10T11:50:12.914422+0000","last_in_change":"2023-08-10T11:49:54.624543+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T11:46:58.735153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3219ae18-cc4c-4712-b616-79f6949066e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6803","nonce":2725694252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6805","nonce":2725694252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6809","nonce":2725694252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6807","nonce":2725694252}]},"public_addr":"172.21.15.73:6803/2725694252","cluster_addr":"172.21.15.73:6805/2725694252","heartbeat_back_addr":"172.21.15.73:6809/2725694252","heartbeat_front_addr":"172.21.15.73:6807/2725694252","state":["exists","up"]},{"osd":1,"uuid":"bbfe6cd9-b3d3-4b8d-8814-507a867f8c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6801","nonce":836829168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6803","nonce":836829168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6807","nonce":836829168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6805","nonce":836829168}]},"public_addr":"172.21.15.152:6801/836829168","cluster_addr":"172.21.15.152:6803/836829168","heartbeat_back_addr":"172.21.15.152:6807/836829168","heartbeat_front_addr":"172.21.15.152:6805/836829168","state":["exists","up"]},{"osd":2,"uuid":"f57f5b2c-3208-45c0-beba-8501694b99c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6801","nonce":1789212298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6803","nonce":1789212298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6807","nonce":1789212298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6805","nonce":1789212298}]},"public_addr":"172.21.15.156:6801/1789212298","cluster_addr":"172.21.15.156:6803/1789212298","heartbeat_back_addr":"172.21.15.156:6807/1789212298","heartbeat_front_addr":"172.21.15.156:6805/1789212298","state":["exists","up"]},{"osd":3,"uuid":"18592408-3696-4ab8-ad41-c172b8409829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6811","nonce":3101572649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6813","nonce":3101572649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6817","nonce":3101572649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6815","nonce":3101572649}]},"public_addr":"172.21.15.73:6811/3101572649","cluster_addr":"172.21.15.73:6813/3101572649","heartbeat_back_addr":"172.21.15.73:6817/3101572649","heartbeat_front_addr":"172.21.15.73:6815/3101572649","state":["exists","up"]},{"osd":4,"uuid":"fb3adb09-8807-42d9-8db9-1867c5fe02da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6809","nonce":1451517889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6811","nonce":1451517889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6815","nonce":1451517889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6813","nonce":1451517889}]},"public_addr":"172.21.15.152:6809/1451517889","cluster_addr":"172.21.15.152:6811/1451517889","heartbeat_back_addr":"172.21.15.152:6815/1451517889","heartbeat_front_addr":"172.21.15.152:6813/1451517889","state":["exists","up"]},{"osd":5,"uuid":"af58a7bd-4e58-4639-95b2-4a76011b61dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6809","nonce":3823368741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6811","nonce":3823368741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6815","nonce":3823368741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6813","nonce":3823368741}]},"public_addr":"172.21.15.156:6809/3823368741","cluster_addr":"172.21.15.156:6811/3823368741","heartbeat_back_addr":"172.21.15.156:6815/3823368741","heartbeat_front_addr":"172.21.15.156:6813/3823368741","state":["exists","up"]},{"osd":6,"uuid":"f6ae502d-4af9-4f6a-8636-b5b683dfdfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6819","nonce":2533620458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6821","nonce":2533620458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6825","nonce":2533620458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6823","nonce":2533620458}]},"public_addr":"172.21.15.73:6819/2533620458","cluster_addr":"172.21.15.73:6821/2533620458","heartbeat_back_addr":"172.21.15.73:6825/2533620458","heartbeat_front_addr":"172.21.15.73:6823/2533620458","state":["exists","up"]},{"osd":7,"uuid":"398fd334-5f6f-427c-95ae-3244fb466f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6817","nonce":4059538477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6819","nonce":4059538477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6823","nonce":4059538477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6821","nonce":4059538477}]},"public_addr":"172.21.15.152:6817/4059538477","cluster_addr":"172.21.15.152:6819/4059538477","heartbeat_back_addr":"172.21.15.152:6823/4059538477","heartbeat_front_addr":"172.21.15.152:6821/4059538477","state":["exists","up"]},{"osd":8,"uuid":"58f46e64-2624-4ad4-bb6a-225624153837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6817","nonce":96487555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6819","nonce":96487555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6823","nonce":96487555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6821","nonce":96487555}]},"public_addr":"172.21.15.156:6817/96487555","cluster_addr":"172.21.15.156:6819/96487555","heartbeat_back_addr":"172.21.15.156:6823/96487555","heartbeat_front_addr":"172.21.15.156:6821/96487555","state":["exists","up"]},{"osd":9,"uuid":"9389dd5b-da2d-43b6-8bc0-bb1af13f72c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6827","nonce":2050124321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6829","nonce":2050124321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6833","nonce":2050124321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6831","nonce":2050124321}]},"public_addr":"172.21.15.73:6827/2050124321","cluster_addr":"172.21.15.73:6829/2050124321","heartbeat_back_addr":"172.21.15.73:6833/2050124321","heartbeat_front_addr":"172.21.15.73:6831/2050124321","state":["exists","up"]},{"osd":10,"uuid":"563c1e34-3acd-46ab-ba36-e9d87f635e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6825","nonce":1513186350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6827","nonce":1513186350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6831","nonce":1513186350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6829","nonce":1513186350}]},"public_addr":"172.21.15.152:6825/1513186350","cluster_addr":"172.21.15.152:6827/1513186350","heartbeat_back_addr":"172.21.15.152:6831/1513186350","heartbeat_front_addr":"172.21.15.152:6829/1513186350","state":["exists","up"]},{"osd":11,"uuid":"f1b55889-14fd-4cc9-bed7-43748086fb77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6825","nonce":737904755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6827","nonce":737904755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6831","nonce":737904755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6829","nonce":737904755}]},"public_addr":"172.21.15.156:6825/737904755","cluster_addr":"172.21.15.156:6827/737904755","heartbeat_back_addr":"172.21.15.156:6831/737904755","heartbeat_front_addr":"172.21.15.156:6829/737904755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:12.023797+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:33.872883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:55.856970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:18.013196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:39.202872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:00.393920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:22.743083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:43.921728+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:05.859488+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:27.618714+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:48.880286+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:50:11.055141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/2202785670":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6800/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:6800/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/1447381524":"2023-08-11T11:44:48.401660+0000","172.21.15.73:0/2545059698":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/4193457623":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2561039569":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2927950081":"2023-08-11T11:44:48.401660+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T11:50:51.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.201+0000 7ffb54172700 1 -- 172.21.15.73:0/767570174 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ffb380a11a0 msgr2=0x7ffb380a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:51.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.202+0000 7ffb54172700 1 --2- 172.21.15.73:0/767570174 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ffb380a11a0 0x7ffb380a3660 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c1006d0 tx=0x7ffb3c00b410 comp rx=0 tx=0).stop 2023-08-10T11:50:51.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.202+0000 7ffb54172700 1 -- 172.21.15.73:0/767570174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb4c100870 msgr2=0x7ffb4c196a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:51.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.202+0000 7ffb54172700 1 --2- 172.21.15.73:0/767570174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb4c100870 0x7ffb4c196a20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ffb4800d980 tx=0x7ffb4800dc90 comp rx=0 tx=0).stop 2023-08-10T11:50:51.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.202+0000 7ffb54172700 1 -- 172.21.15.73:0/767570174 shutdown_connections 2023-08-10T11:50:51.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.202+0000 7ffb54172700 1 --2- 172.21.15.73:0/767570174 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ffb380a11a0 0x7ffb380a3660 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:51.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.202+0000 7ffb54172700 1 --2- 172.21.15.73:0/767570174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb4c101210 0x7ffb4c19da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:51.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.202+0000 7ffb54172700 1 --2- 172.21.15.73:0/767570174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb4c0ff680 0x7ffb4c1964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:51.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.202+0000 7ffb54172700 1 --2- 172.21.15.73:0/767570174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb4c100870 0x7ffb4c196a20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:51.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.202+0000 7ffb54172700 1 -- 172.21.15.73:0/767570174 >> 172.21.15.73:0/767570174 conn(0x7ffb4c0fabd0 msgr2=0x7ffb4c0688e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:51.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.202+0000 7ffb54172700 1 -- 172.21.15.73:0/767570174 shutdown_connections 2023-08-10T11:50:51.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.202+0000 7ffb54172700 1 -- 172.21.15.73:0/767570174 wait complete. 2023-08-10T11:50:51.215 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:50 smithi073 ceph-mon[128869]: mds.? [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] up:boot 2023-08-10T11:50:51.215 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:50 smithi073 ceph-mon[128869]: fsmap 12 up:standby 2023-08-10T11:50:51.215 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:50 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-08-10T11:50:51.215 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:50 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:50:51.215 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:50 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3280025470' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:51.217 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T11:46:58.735153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T11:50:51.217 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T11:50:51.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:50 smithi152 ceph-mon[130220]: mds.? [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] up:boot 2023-08-10T11:50:51.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:50 smithi152 ceph-mon[130220]: fsmap 12 up:standby 2023-08-10T11:50:51.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:50 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-08-10T11:50:51.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:50 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:50:51.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:50 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3280025470' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:51.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:50 smithi156 ceph-mon[130574]: mds.? [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] up:boot 2023-08-10T11:50:51.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:50 smithi156 ceph-mon[130574]: fsmap 12 up:standby 2023-08-10T11:50:51.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:50 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-08-10T11:50:51.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:50 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:50:51.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:50 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3280025470' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:50:51.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.346+0000 7f15fb0ac700 1 -- 172.21.15.73:0/1741730051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15f4100960 msgr2=0x7f15f4107210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:51.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.346+0000 7f15fb0ac700 1 --2- 172.21.15.73:0/1741730051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15f4100960 0x7f15f4107210 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f15ec00b0d0 tx=0x7f15ec00b3e0 comp rx=0 tx=0).stop 2023-08-10T11:50:51.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.346+0000 7f15fb0ac700 1 -- 172.21.15.73:0/1741730051 shutdown_connections 2023-08-10T11:50:51.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.346+0000 7f15fb0ac700 1 --2- 172.21.15.73:0/1741730051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15f4100960 0x7f15f4107210 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:51.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.346+0000 7f15fb0ac700 1 --2- 172.21.15.73:0/1741730051 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15f40fedd0 0x7f15f40ff1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:51.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.346+0000 7f15fb0ac700 1 --2- 172.21.15.73:0/1741730051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15f40fffc0 0x7f15f4100420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:51.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.346+0000 7f15fb0ac700 1 -- 172.21.15.73:0/1741730051 >> 172.21.15.73:0/1741730051 conn(0x7f15f40fa340 msgr2=0x7f15f40fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:51.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.346+0000 7f15fb0ac700 1 -- 172.21.15.73:0/1741730051 shutdown_connections 2023-08-10T11:50:51.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.346+0000 7f15fb0ac700 1 -- 172.21.15.73:0/1741730051 wait complete. 2023-08-10T11:50:51.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.347+0000 7f15fb0ac700 1 Processor -- start 2023-08-10T11:50:51.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.347+0000 7f15fb0ac700 1 -- start start 2023-08-10T11:50:51.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.347+0000 7f15fb0ac700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15f40fedd0 0x7f15f40fc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:51.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.347+0000 7f15fb0ac700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15f40fffc0 0x7f15f419b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:51.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.347+0000 7f15fb0ac700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15f4100960 0x7f15f419d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:51.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.347+0000 7f15fb0ac700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f419e0c0 con 0x7f15f40fffc0 2023-08-10T11:50:51.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.347+0000 7f15fb0ac700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f419e230 con 0x7f15f40fedd0 2023-08-10T11:50:51.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.347+0000 7f15fb0ac700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f419e3f0 con 0x7f15f4100960 2023-08-10T11:50:51.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.347+0000 7f15f3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15f40fffc0 0x7f15f419b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:51.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.347+0000 7f15f3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15f40fffc0 0x7f15f419b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58840/0 (socket says 172.21.15.73:58840) 2023-08-10T11:50:51.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.347+0000 7f15f3fff700 1 -- 172.21.15.73:0/61303842 learned_addr learned my addr 172.21.15.73:0/61303842 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:51.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.347+0000 7f15f8e48700 1 --2- 172.21.15.73:0/61303842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15f40fedd0 0x7f15f40fc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:51.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.347+0000 7f15f9649700 1 --2- 172.21.15.73:0/61303842 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15f4100960 0x7f15f419d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:51.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.347+0000 7f15f3fff700 1 -- 172.21.15.73:0/61303842 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15f4100960 msgr2=0x7f15f419d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:51.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.347+0000 7f15f3fff700 1 --2- 172.21.15.73:0/61303842 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15f4100960 0x7f15f419d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:51.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.347+0000 7f15f3fff700 1 -- 172.21.15.73:0/61303842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15f40fedd0 msgr2=0x7f15f40fc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:51.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.347+0000 7f15f3fff700 1 --2- 172.21.15.73:0/61303842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15f40fedd0 0x7f15f40fc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:51.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.347+0000 7f15f3fff700 1 -- 172.21.15.73:0/61303842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ec009d00 con 0x7f15f40fffc0 2023-08-10T11:50:51.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.347+0000 7f15f3fff700 1 --2- 172.21.15.73:0/61303842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15f40fffc0 0x7f15f419b290 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f15e000d950 tx=0x7f15e000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:51.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.347+0000 7f15f1ffb700 1 -- 172.21.15.73:0/61303842 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e000f890 con 0x7f15f40fffc0 2023-08-10T11:50:51.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.347+0000 7f15fb0ac700 1 -- 172.21.15.73:0/61303842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f419e6d0 con 0x7f15f40fffc0 2023-08-10T11:50:51.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.347+0000 7f15f1ffb700 1 -- 172.21.15.73:0/61303842 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15e0010460 con 0x7f15f40fffc0 2023-08-10T11:50:51.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.347+0000 7f15f1ffb700 1 -- 172.21.15.73:0/61303842 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e000e610 con 0x7f15f40fffc0 2023-08-10T11:50:51.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.348+0000 7f15fb0ac700 1 -- 172.21.15.73:0/61303842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f419ecb0 con 0x7f15f40fffc0 2023-08-10T11:50:51.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.349+0000 7f15fb0ac700 1 -- 172.21.15.73:0/61303842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f4106940 con 0x7f15f40fffc0 2023-08-10T11:50:51.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.350+0000 7f15f1ffb700 1 -- 172.21.15.73:0/61303842 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f15e00108d0 con 0x7f15f40fffc0 2023-08-10T11:50:51.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.350+0000 7f15f1ffb700 1 --2- 172.21.15.73:0/61303842 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f15e40a1150 0x7f15e40a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:51.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.350+0000 7f15f1ffb700 1 -- 172.21.15.73:0/61303842 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f15e00cc250 con 0x7f15f40fffc0 2023-08-10T11:50:51.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.350+0000 7f15f8e48700 1 --2- 172.21.15.73:0/61303842 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f15e40a1150 0x7f15e40a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:51.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.351+0000 7f15f8e48700 1 --2- 172.21.15.73:0/61303842 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f15e40a1150 0x7f15e40a3610 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f15f40ffe20 tx=0x7f15e8009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:51.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.354+0000 7f15f1ffb700 1 -- 172.21.15.73:0/61303842 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f15e0095e40 con 0x7f15f40fffc0 2023-08-10T11:50:51.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.558+0000 7f15fb0ac700 1 -- 172.21.15.73:0/61303842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f15f402cbc0 con 0x7f15f40fffc0 2023-08-10T11:50:51.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.559+0000 7f15f1ffb700 1 -- 172.21.15.73:0/61303842 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f15e0099460 con 0x7f15f40fffc0 2023-08-10T11:50:51.561 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-08-10T11:50:51.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.561+0000 7f15fb0ac700 1 -- 172.21.15.73:0/61303842 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f15e40a1150 msgr2=0x7f15e40a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:51.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.561+0000 7f15fb0ac700 1 --2- 172.21.15.73:0/61303842 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f15e40a1150 0x7f15e40a3610 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f15f40ffe20 tx=0x7f15e8009190 comp rx=0 tx=0).stop 2023-08-10T11:50:51.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.561+0000 7f15fb0ac700 1 -- 172.21.15.73:0/61303842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15f40fffc0 msgr2=0x7f15f419b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:51.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.561+0000 7f15fb0ac700 1 --2- 172.21.15.73:0/61303842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15f40fffc0 0x7f15f419b290 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f15e000d950 tx=0x7f15e000dc60 comp rx=0 tx=0).stop 2023-08-10T11:50:51.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.561+0000 7f15fb0ac700 1 -- 172.21.15.73:0/61303842 shutdown_connections 2023-08-10T11:50:51.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.562+0000 7f15fb0ac700 1 --2- 172.21.15.73:0/61303842 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f15e40a1150 0x7f15e40a3610 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:51.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.562+0000 7f15fb0ac700 1 --2- 172.21.15.73:0/61303842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15f40fedd0 0x7f15f40fc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:51.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.562+0000 7f15fb0ac700 1 --2- 172.21.15.73:0/61303842 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15f4100960 0x7f15f419d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:51.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.562+0000 7f15fb0ac700 1 --2- 172.21.15.73:0/61303842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15f40fffc0 0x7f15f419b290 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:51.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.562+0000 7f15fb0ac700 1 -- 172.21.15.73:0/61303842 >> 172.21.15.73:0/61303842 conn(0x7f15f40fa340 msgr2=0x7f15f4103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:51.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.562+0000 7f15fb0ac700 1 -- 172.21.15.73:0/61303842 shutdown_connections 2023-08-10T11:50:51.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.562+0000 7f15fb0ac700 1 -- 172.21.15.73:0/61303842 wait complete. 2023-08-10T11:50:51.576 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-10T11:50:51.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.700+0000 7fbbe7d2d700 1 -- 172.21.15.73:0/2969654489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbe01023b0 msgr2=0x7fbbe0108c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:51.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.700+0000 7fbbe7d2d700 1 --2- 172.21.15.73:0/2969654489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbe01023b0 0x7fbbe0108c60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbbd800b0a0 tx=0x7fbbd800b3b0 comp rx=0 tx=0).stop 2023-08-10T11:50:51.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.700+0000 7fbbe7d2d700 1 -- 172.21.15.73:0/2969654489 shutdown_connections 2023-08-10T11:50:51.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.700+0000 7fbbe7d2d700 1 --2- 172.21.15.73:0/2969654489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbbe00fea40 0x7fbbe00fee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:51.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.700+0000 7fbbe7d2d700 1 --2- 172.21.15.73:0/2969654489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbe01023b0 0x7fbbe0108c60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:51.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.700+0000 7fbbe7d2d700 1 --2- 172.21.15.73:0/2969654489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbbe0101a10 0x7fbbe0101e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:51.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.700+0000 7fbbe7d2d700 1 -- 172.21.15.73:0/2969654489 >> 172.21.15.73:0/2969654489 conn(0x7fbbe00fa3b0 msgr2=0x7fbbe00fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:51.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.700+0000 7fbbe7d2d700 1 -- 172.21.15.73:0/2969654489 shutdown_connections 2023-08-10T11:50:51.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.700+0000 7fbbe7d2d700 1 -- 172.21.15.73:0/2969654489 wait complete. 2023-08-10T11:50:51.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.701+0000 7fbbe7d2d700 1 Processor -- start 2023-08-10T11:50:51.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.701+0000 7fbbe7d2d700 1 -- start start 2023-08-10T11:50:51.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.701+0000 7fbbe7d2d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbbe00fea40 0x7fbbe01964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:51.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.701+0000 7fbbe7d2d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbbe0101a10 0x7fbbe01969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:51.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.701+0000 7fbbe7d2d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbe01023b0 0x7fbbe019da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:51.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.701+0000 7fbbe7d2d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe019e030 con 0x7fbbe01023b0 2023-08-10T11:50:51.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.701+0000 7fbbe7d2d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe019e170 con 0x7fbbe0101a10 2023-08-10T11:50:51.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.701+0000 7fbbe7d2d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe019e300 con 0x7fbbe00fea40 2023-08-10T11:50:51.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.701+0000 7fbbe62ca700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbe01023b0 0x7fbbe019da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:51.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.701+0000 7fbbe62ca700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbe01023b0 0x7fbbe019da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58854/0 (socket says 172.21.15.73:58854) 2023-08-10T11:50:51.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.701+0000 7fbbe62ca700 1 -- 172.21.15.73:0/1507438591 learned_addr learned my addr 172.21.15.73:0/1507438591 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:51.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.701+0000 7fbbe5ac9700 1 --2- 172.21.15.73:0/1507438591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbbe00fea40 0x7fbbe01964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:51.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.701+0000 7fbbe52c8700 1 --2- 172.21.15.73:0/1507438591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbbe0101a10 0x7fbbe01969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:51.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.701+0000 7fbbe62ca700 1 -- 172.21.15.73:0/1507438591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbbe00fea40 msgr2=0x7fbbe01964b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:51.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.702+0000 7fbbe62ca700 1 --2- 172.21.15.73:0/1507438591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbbe00fea40 0x7fbbe01964b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:51.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.702+0000 7fbbe62ca700 1 -- 172.21.15.73:0/1507438591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbbe0101a10 msgr2=0x7fbbe01969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:51.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.702+0000 7fbbe62ca700 1 --2- 172.21.15.73:0/1507438591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbbe0101a10 0x7fbbe01969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:51.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.702+0000 7fbbe62ca700 1 -- 172.21.15.73:0/1507438591 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd8009d00 con 0x7fbbe01023b0 2023-08-10T11:50:51.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.702+0000 7fbbe52c8700 1 --2- 172.21.15.73:0/1507438591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbbe0101a10 0x7fbbe01969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:50:51.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.702+0000 7fbbe62ca700 1 --2- 172.21.15.73:0/1507438591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbe01023b0 0x7fbbe019da60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80062a0 tx=0x7fbbd8004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:51.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.702+0000 7fbbd6ffd700 1 -- 172.21.15.73:0/1507438591 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd800e040 con 0x7fbbe01023b0 2023-08-10T11:50:51.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.702+0000 7fbbe7d2d700 1 -- 172.21.15.73:0/1507438591 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe019e580 con 0x7fbbe01023b0 2023-08-10T11:50:51.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.702+0000 7fbbd6ffd700 1 -- 172.21.15.73:0/1507438591 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbbd800cec0 con 0x7fbbe01023b0 2023-08-10T11:50:51.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.702+0000 7fbbd6ffd700 1 -- 172.21.15.73:0/1507438591 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd8004020 con 0x7fbbe01023b0 2023-08-10T11:50:51.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.702+0000 7fbbe7d2d700 1 -- 172.21.15.73:0/1507438591 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe019e9b0 con 0x7fbbe01023b0 2023-08-10T11:50:51.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.703+0000 7fbbe7d2d700 1 -- 172.21.15.73:0/1507438591 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe01076b0 con 0x7fbbe01023b0 2023-08-10T11:50:51.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.704+0000 7fbbd6ffd700 1 -- 172.21.15.73:0/1507438591 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fbbd801d690 con 0x7fbbe01023b0 2023-08-10T11:50:51.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.705+0000 7fbbd6ffd700 1 --2- 172.21.15.73:0/1507438591 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fbbcc0a11a0 0x7fbbcc0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:51.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.705+0000 7fbbe5ac9700 1 --2- 172.21.15.73:0/1507438591 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fbbcc0a11a0 0x7fbbcc0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:51.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.705+0000 7fbbd6ffd700 1 -- 172.21.15.73:0/1507438591 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fbbd80ce770 con 0x7fbbe01023b0 2023-08-10T11:50:51.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.705+0000 7fbbe5ac9700 1 --2- 172.21.15.73:0/1507438591 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fbbcc0a11a0 0x7fbbcc0a3660 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00689b0 tx=0x7fbbdc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:51.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.709+0000 7fbbd6ffd700 1 -- 172.21.15.73:0/1507438591 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fbbd80983f0 con 0x7fbbe01023b0 2023-08-10T11:50:51.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.909+0000 7fbbe7d2d700 1 -- 172.21.15.73:0/1507438591 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbbe002c970 con 0x7fbbe01023b0 2023-08-10T11:50:51.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.909+0000 7fbbd6ffd700 1 -- 172.21.15.73:0/1507438591 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) v1 ==== 84+0+65 (secure 0 0 0) 0x7fbbd809ba10 con 0x7fbbe01023b0 2023-08-10T11:50:51.911 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:50:51.912 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2023-08-10T11:50:51.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T11:50:51.912 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2023-08-10T11:50:51.912 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2023-08-10T11:50:51.912 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:50:51.912 INFO:teuthology.orchestra.run.smithi073.stdout:] 2023-08-10T11:50:51.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.911+0000 7fbbe7d2d700 1 -- 172.21.15.73:0/1507438591 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fbbcc0a11a0 msgr2=0x7fbbcc0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:51.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.911+0000 7fbbe7d2d700 1 --2- 172.21.15.73:0/1507438591 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fbbcc0a11a0 0x7fbbcc0a3660 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00689b0 tx=0x7fbbdc00b410 comp rx=0 tx=0).stop 2023-08-10T11:50:51.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.911+0000 7fbbe7d2d700 1 -- 172.21.15.73:0/1507438591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbe01023b0 msgr2=0x7fbbe019da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:51.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.911+0000 7fbbe7d2d700 1 --2- 172.21.15.73:0/1507438591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbe01023b0 0x7fbbe019da60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80062a0 tx=0x7fbbd8004d00 comp rx=0 tx=0).stop 2023-08-10T11:50:51.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.912+0000 7fbbe7d2d700 1 -- 172.21.15.73:0/1507438591 shutdown_connections 2023-08-10T11:50:51.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.912+0000 7fbbe7d2d700 1 --2- 172.21.15.73:0/1507438591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbe01023b0 0x7fbbe019da60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:51.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.912+0000 7fbbe7d2d700 1 --2- 172.21.15.73:0/1507438591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbbe00fea40 0x7fbbe01964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:51.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.912+0000 7fbbe7d2d700 1 --2- 172.21.15.73:0/1507438591 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fbbcc0a11a0 0x7fbbcc0a3660 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:51.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.912+0000 7fbbe7d2d700 1 --2- 172.21.15.73:0/1507438591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbbe0101a10 0x7fbbe01969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:51.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.912+0000 7fbbe7d2d700 1 -- 172.21.15.73:0/1507438591 >> 172.21.15.73:0/1507438591 conn(0x7fbbe00fa3b0 msgr2=0x7fbbe00fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:51.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.912+0000 7fbbe7d2d700 1 -- 172.21.15.73:0/1507438591 shutdown_connections 2023-08-10T11:50:51.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:51.912+0000 7fbbe7d2d700 1 -- 172.21.15.73:0/1507438591 wait complete. 2023-08-10T11:50:51.925 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-10T11:50:51.925 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-10T11:50:52.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.054+0000 7f11bb6cb700 1 -- 172.21.15.73:0/210289709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11b40ff660 msgr2=0x7f11b40ffa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:52.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.054+0000 7f11bb6cb700 1 --2- 172.21.15.73:0/210289709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11b40ff660 0x7f11b40ffa80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f11b00099c0 tx=0x7f11b0009cd0 comp rx=0 tx=0).stop 2023-08-10T11:50:52.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.054+0000 7f11bb6cb700 1 -- 172.21.15.73:0/210289709 shutdown_connections 2023-08-10T11:50:52.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.054+0000 7f11bb6cb700 1 --2- 172.21.15.73:0/210289709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11b41011f0 0x7f11b4107aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:52.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.054+0000 7f11bb6cb700 1 --2- 172.21.15.73:0/210289709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11b40ff660 0x7f11b40ffa80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:52.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.054+0000 7f11bb6cb700 1 --2- 172.21.15.73:0/210289709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11b4100850 0x7f11b4100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:52.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.054+0000 7f11bb6cb700 1 -- 172.21.15.73:0/210289709 >> 172.21.15.73:0/210289709 conn(0x7f11b40fabd0 msgr2=0x7f11b40fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:52.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.054+0000 7f11bb6cb700 1 -- 172.21.15.73:0/210289709 shutdown_connections 2023-08-10T11:50:52.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.054+0000 7f11bb6cb700 1 -- 172.21.15.73:0/210289709 wait complete. 2023-08-10T11:50:52.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.054+0000 7f11bb6cb700 1 Processor -- start 2023-08-10T11:50:52.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.054+0000 7f11bb6cb700 1 -- start start 2023-08-10T11:50:52.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.055+0000 7f11bb6cb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11b40ff660 0x7f11b40684a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:52.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.055+0000 7f11bb6cb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11b4100850 0x7f11b419b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:52.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.055+0000 7f11bb6cb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11b41011f0 0x7f11b419d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:52.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.055+0000 7f11bb6cb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b419df30 con 0x7f11b4100850 2023-08-10T11:50:52.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.055+0000 7f11bb6cb700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b419e0a0 con 0x7f11b40ff660 2023-08-10T11:50:52.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.055+0000 7f11bb6cb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b419e260 con 0x7f11b41011f0 2023-08-10T11:50:52.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.055+0000 7f11b8c66700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11b4100850 0x7f11b419b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:52.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.055+0000 7f11b8c66700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11b4100850 0x7f11b419b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58866/0 (socket says 172.21.15.73:58866) 2023-08-10T11:50:52.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.055+0000 7f11b8c66700 1 -- 172.21.15.73:0/3891313686 learned_addr learned my addr 172.21.15.73:0/3891313686 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:52.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.055+0000 7f11b9c68700 1 --2- 172.21.15.73:0/3891313686 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11b41011f0 0x7f11b419d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:52.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.055+0000 7f11b9467700 1 --2- 172.21.15.73:0/3891313686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11b40ff660 0x7f11b40684a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:52.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.055+0000 7f11b8c66700 1 -- 172.21.15.73:0/3891313686 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11b41011f0 msgr2=0x7f11b419d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:52.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.055+0000 7f11b8c66700 1 --2- 172.21.15.73:0/3891313686 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11b41011f0 0x7f11b419d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:52.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.055+0000 7f11b8c66700 1 -- 172.21.15.73:0/3891313686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11b40ff660 msgr2=0x7f11b40684a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:52.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.055+0000 7f11b8c66700 1 --2- 172.21.15.73:0/3891313686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11b40ff660 0x7f11b40684a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:52.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.055+0000 7f11b8c66700 1 -- 172.21.15.73:0/3891313686 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b00095f0 con 0x7f11b4100850 2023-08-10T11:50:52.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.055+0000 7f11b9467700 1 --2- 172.21.15.73:0/3891313686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11b40ff660 0x7f11b40684a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:50:52.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.055+0000 7f11b8c66700 1 --2- 172.21.15.73:0/3891313686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11b4100850 0x7f11b419b100 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f11a400d950 tx=0x7f11a400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:52.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.055+0000 7f11aa7fc700 1 -- 172.21.15.73:0/3891313686 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a4009940 con 0x7f11b4100850 2023-08-10T11:50:52.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.055+0000 7f11bb6cb700 1 -- 172.21.15.73:0/3891313686 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b419e540 con 0x7f11b4100850 2023-08-10T11:50:52.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.055+0000 7f11aa7fc700 1 -- 172.21.15.73:0/3891313686 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f11a4010460 con 0x7f11b4100850 2023-08-10T11:50:52.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.055+0000 7f11aa7fc700 1 -- 172.21.15.73:0/3891313686 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a400f620 con 0x7f11b4100850 2023-08-10T11:50:52.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.055+0000 7f11bb6cb700 1 -- 172.21.15.73:0/3891313686 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b419ea50 con 0x7f11b4100850 2023-08-10T11:50:52.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.056+0000 7f11bb6cb700 1 -- 172.21.15.73:0/3891313686 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b4106590 con 0x7f11b4100850 2023-08-10T11:50:52.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.057+0000 7f11aa7fc700 1 -- 172.21.15.73:0/3891313686 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f11a40108d0 con 0x7f11b4100850 2023-08-10T11:50:52.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.058+0000 7f11aa7fc700 1 --2- 172.21.15.73:0/3891313686 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f11a00a11d0 0x7f11a00a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:52.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.058+0000 7f11b9467700 1 --2- 172.21.15.73:0/3891313686 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f11a00a11d0 0x7f11a00a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:52.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.058+0000 7f11aa7fc700 1 -- 172.21.15.73:0/3891313686 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f11a40cc3a0 con 0x7f11b4100850 2023-08-10T11:50:52.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.058+0000 7f11b9467700 1 --2- 172.21.15.73:0/3891313686 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f11a00a11d0 0x7f11a00a3690 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f11b0006010 tx=0x7f11b0000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:52.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.061+0000 7f11aa7fc700 1 -- 172.21.15.73:0/3891313686 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f11a4095ef0 con 0x7f11b4100850 2023-08-10T11:50:52.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:51 smithi152 ceph-mon[130220]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:52.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:51 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/767570174' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:50:52.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:51 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/61303842' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:50:52.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:51 smithi156 ceph-mon[130574]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:52.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:51 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/767570174' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:50:52.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:51 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/61303842' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:50:52.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.260+0000 7f11bb6cb700 1 -- 172.21.15.73:0/3891313686 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f11b402cbc0 con 0x7f11b4100850 2023-08-10T11:50:52.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:51 smithi073 ceph-mon[128869]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:52.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:51 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/767570174' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:50:52.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:51 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/61303842' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:50:52.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.881+0000 7f11aa7fc700 1 -- 172.21.15.73:0/3891313686 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) v1 ==== 138+0+0 (secure 0 0 0) 0x7f11a4099510 con 0x7f11b4100850 2023-08-10T11:50:52.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.886+0000 7f11bb6cb700 1 -- 172.21.15.73:0/3891313686 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f11a00a11d0 msgr2=0x7f11a00a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:52.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.886+0000 7f11bb6cb700 1 --2- 172.21.15.73:0/3891313686 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f11a00a11d0 0x7f11a00a3690 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f11b0006010 tx=0x7f11b0000bc0 comp rx=0 tx=0).stop 2023-08-10T11:50:52.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.886+0000 7f11bb6cb700 1 -- 172.21.15.73:0/3891313686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11b4100850 msgr2=0x7f11b419b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:52.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.886+0000 7f11bb6cb700 1 --2- 172.21.15.73:0/3891313686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11b4100850 0x7f11b419b100 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f11a400d950 tx=0x7f11a400dc60 comp rx=0 tx=0).stop 2023-08-10T11:50:52.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.886+0000 7f11bb6cb700 1 -- 172.21.15.73:0/3891313686 shutdown_connections 2023-08-10T11:50:52.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.886+0000 7f11bb6cb700 1 --2- 172.21.15.73:0/3891313686 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f11a00a11d0 0x7f11a00a3690 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:52.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.886+0000 7f11bb6cb700 1 --2- 172.21.15.73:0/3891313686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11b40ff660 0x7f11b40684a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:52.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.886+0000 7f11bb6cb700 1 --2- 172.21.15.73:0/3891313686 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11b41011f0 0x7f11b419d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:52.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.886+0000 7f11bb6cb700 1 --2- 172.21.15.73:0/3891313686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11b4100850 0x7f11b419b100 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:52.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.886+0000 7f11bb6cb700 1 -- 172.21.15.73:0/3891313686 >> 172.21.15.73:0/3891313686 conn(0x7f11b40fabd0 msgr2=0x7f11b40fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:52.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.886+0000 7f11bb6cb700 1 -- 172.21.15.73:0/3891313686 shutdown_connections 2023-08-10T11:50:52.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:52.886+0000 7f11bb6cb700 1 -- 172.21.15.73:0/3891313686 wait complete. 2023-08-10T11:50:52.890 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2023-08-10T11:50:52.900 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-10T11:50:53.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.027+0000 7fd904941700 1 -- 172.21.15.73:0/3974423012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9000fedd0 msgr2=0x7fd9000ff1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:53.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.027+0000 7fd904941700 1 --2- 172.21.15.73:0/3974423012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9000fedd0 0x7fd9000ff1f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40099c0 tx=0x7fd8f4009cd0 comp rx=0 tx=0).stop 2023-08-10T11:50:53.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.027+0000 7fd904941700 1 -- 172.21.15.73:0/3974423012 shutdown_connections 2023-08-10T11:50:53.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.027+0000 7fd904941700 1 --2- 172.21.15.73:0/3974423012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd900100960 0x7fd900107210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:53.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.027+0000 7fd904941700 1 --2- 172.21.15.73:0/3974423012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9000fedd0 0x7fd9000ff1f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:53.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.027+0000 7fd904941700 1 --2- 172.21.15.73:0/3974423012 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9000fffc0 0x7fd900100420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:53.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.027+0000 7fd904941700 1 -- 172.21.15.73:0/3974423012 >> 172.21.15.73:0/3974423012 conn(0x7fd9000fa340 msgr2=0x7fd9000fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:53.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.027+0000 7fd904941700 1 -- 172.21.15.73:0/3974423012 shutdown_connections 2023-08-10T11:50:53.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.027+0000 7fd904941700 1 -- 172.21.15.73:0/3974423012 wait complete. 2023-08-10T11:50:53.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.028+0000 7fd904941700 1 Processor -- start 2023-08-10T11:50:53.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.028+0000 7fd904941700 1 -- start start 2023-08-10T11:50:53.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.028+0000 7fd904941700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9000fedd0 0x7fd9001941f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:53.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.028+0000 7fd904941700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9000fffc0 0x7fd900194730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:53.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.028+0000 7fd904941700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd900100960 0x7fd90019b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:53.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.028+0000 7fd904941700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90019bd70 con 0x7fd9000fffc0 2023-08-10T11:50:53.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.028+0000 7fd904941700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90019beb0 con 0x7fd9000fedd0 2023-08-10T11:50:53.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.028+0000 7fd904941700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90019c040 con 0x7fd900100960 2023-08-10T11:50:53.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.028+0000 7fd8fdd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9000fffc0 0x7fd900194730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:53.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.028+0000 7fd8fdd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9000fffc0 0x7fd900194730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58880/0 (socket says 172.21.15.73:58880) 2023-08-10T11:50:53.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.028+0000 7fd8fe59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9000fedd0 0x7fd9001941f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:53.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.028+0000 7fd8fdd9b700 1 -- 172.21.15.73:0/927561014 learned_addr learned my addr 172.21.15.73:0/927561014 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:53.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.028+0000 7fd8fed9d700 1 --2- 172.21.15.73:0/927561014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd900100960 0x7fd90019b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:53.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.029+0000 7fd8fdd9b700 1 -- 172.21.15.73:0/927561014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd900100960 msgr2=0x7fd90019b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:53.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.029+0000 7fd8fdd9b700 1 --2- 172.21.15.73:0/927561014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd900100960 0x7fd90019b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:53.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.029+0000 7fd8fdd9b700 1 -- 172.21.15.73:0/927561014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9000fedd0 msgr2=0x7fd9001941f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:53.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.029+0000 7fd8fdd9b700 1 --2- 172.21.15.73:0/927561014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9000fedd0 0x7fd9001941f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:53.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.029+0000 7fd8fdd9b700 1 -- 172.21.15.73:0/927561014 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f40095f0 con 0x7fd9000fffc0 2023-08-10T11:50:53.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.029+0000 7fd8fdd9b700 1 --2- 172.21.15.73:0/927561014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9000fffc0 0x7fd900194730 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd8f00077b0 tx=0x7fd8f0007ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:53.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.029+0000 7fd8ef7fe700 1 -- 172.21.15.73:0/927561014 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f000c300 con 0x7fd9000fffc0 2023-08-10T11:50:53.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.029+0000 7fd904941700 1 -- 172.21.15.73:0/927561014 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd90019c320 con 0x7fd9000fffc0 2023-08-10T11:50:53.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.029+0000 7fd8ef7fe700 1 -- 172.21.15.73:0/927561014 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd8f0005020 con 0x7fd9000fffc0 2023-08-10T11:50:53.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.029+0000 7fd8ef7fe700 1 -- 172.21.15.73:0/927561014 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0014710 con 0x7fd9000fffc0 2023-08-10T11:50:53.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.029+0000 7fd904941700 1 -- 172.21.15.73:0/927561014 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd90019c7e0 con 0x7fd9000fffc0 2023-08-10T11:50:53.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.030+0000 7fd904941700 1 -- 172.21.15.73:0/927561014 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd900105d00 con 0x7fd9000fffc0 2023-08-10T11:50:53.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.031+0000 7fd8ef7fe700 1 -- 172.21.15.73:0/927561014 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fd8f0005190 con 0x7fd9000fffc0 2023-08-10T11:50:53.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.031+0000 7fd8ef7fe700 1 --2- 172.21.15.73:0/927561014 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd8e80a1140 0x7fd8e80a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:53.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.032+0000 7fd8fe59c700 1 --2- 172.21.15.73:0/927561014 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd8e80a1140 0x7fd8e80a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:53.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.032+0000 7fd8ef7fe700 1 -- 172.21.15.73:0/927561014 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7497+0+0 (secure 0 0 0) 0x7fd8f00cbfd0 con 0x7fd9000fffc0 2023-08-10T11:50:53.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.032+0000 7fd8fe59c700 1 --2- 172.21.15.73:0/927561014 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd8e80a1140 0x7fd8e80a3600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4009990 tx=0x7fd8f4005c20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:53.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.035+0000 7fd8ef7fe700 1 -- 172.21.15.73:0/927561014 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fd8f0095ae0 con 0x7fd9000fffc0 2023-08-10T11:50:53.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.228+0000 7fd904941700 1 -- 172.21.15.73:0/927561014 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd90002c970 con 0x7fd9000fffc0 2023-08-10T11:50:53.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:52 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1507438591' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-08-10T11:50:53.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:52 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3891313686' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-08-10T11:50:53.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:52 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:53.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:52 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:53.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:52 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:53.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:52 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:53.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:52 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:53.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:52 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:53.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:52 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1507438591' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-08-10T11:50:53.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:52 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3891313686' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-08-10T11:50:53.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:52 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:53.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:52 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:53.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:52 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:53.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:52 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:53.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:52 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:53.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:52 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:53.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:52 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1507438591' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-08-10T11:50:53.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:52 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3891313686' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-08-10T11:50:53.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:52 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:53.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:52 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:53.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:52 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:53.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:52 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:53.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:52 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:53.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:52 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:53.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.887+0000 7fd8ef7fe700 1 -- 172.21.15.73:0/927561014 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v81) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd8f0099100 con 0x7fd9000fffc0 2023-08-10T11:50:53.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.892+0000 7fd904941700 1 -- 172.21.15.73:0/927561014 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd8e80a1140 msgr2=0x7fd8e80a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:53.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.893+0000 7fd904941700 1 --2- 172.21.15.73:0/927561014 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd8e80a1140 0x7fd8e80a3600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4009990 tx=0x7fd8f4005c20 comp rx=0 tx=0).stop 2023-08-10T11:50:53.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.893+0000 7fd904941700 1 -- 172.21.15.73:0/927561014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9000fffc0 msgr2=0x7fd900194730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:53.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.893+0000 7fd904941700 1 --2- 172.21.15.73:0/927561014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9000fffc0 0x7fd900194730 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd8f00077b0 tx=0x7fd8f0007ac0 comp rx=0 tx=0).stop 2023-08-10T11:50:53.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.893+0000 7fd904941700 1 -- 172.21.15.73:0/927561014 shutdown_connections 2023-08-10T11:50:53.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.893+0000 7fd904941700 1 --2- 172.21.15.73:0/927561014 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd8e80a1140 0x7fd8e80a3600 secure :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4009990 tx=0x7fd8f4005c20 comp rx=0 tx=0).stop 2023-08-10T11:50:53.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.893+0000 7fd904941700 1 --2- 172.21.15.73:0/927561014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9000fedd0 0x7fd9001941f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:53.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.893+0000 7fd904941700 1 --2- 172.21.15.73:0/927561014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd900100960 0x7fd90019b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:53.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.893+0000 7fd904941700 1 --2- 172.21.15.73:0/927561014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9000fffc0 0x7fd900194730 secure :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd8f00077b0 tx=0x7fd8f0007ac0 comp rx=0 tx=0).stop 2023-08-10T11:50:53.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.893+0000 7fd904941700 1 -- 172.21.15.73:0/927561014 >> 172.21.15.73:0/927561014 conn(0x7fd9000fa340 msgr2=0x7fd9000fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:53.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.895+0000 7fd904941700 1 -- 172.21.15.73:0/927561014 shutdown_connections 2023-08-10T11:50:53.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:53.895+0000 7fd904941700 1 -- 172.21.15.73:0/927561014 wait complete. 2023-08-10T11:50:53.910 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2023-08-10T11:50:53.923 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-10T11:50:54.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.046+0000 7f58f5a67700 1 -- 172.21.15.73:0/3517745459 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58f01011f0 msgr2=0x7f58f0107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:54.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.046+0000 7f58f5a67700 1 --2- 172.21.15.73:0/3517745459 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58f01011f0 0x7f58f0107aa0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f58e800b0d0 tx=0x7f58e800b3e0 comp rx=0 tx=0).stop 2023-08-10T11:50:54.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.046+0000 7f58f5a67700 1 -- 172.21.15.73:0/3517745459 shutdown_connections 2023-08-10T11:50:54.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.046+0000 7f58f5a67700 1 --2- 172.21.15.73:0/3517745459 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58f01011f0 0x7f58f0107aa0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:54.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.046+0000 7f58f5a67700 1 --2- 172.21.15.73:0/3517745459 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58f00ff660 0x7f58f00ffa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:54.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.046+0000 7f58f5a67700 1 --2- 172.21.15.73:0/3517745459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58f0100850 0x7f58f0100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:54.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.046+0000 7f58f5a67700 1 -- 172.21.15.73:0/3517745459 >> 172.21.15.73:0/3517745459 conn(0x7f58f00fabd0 msgr2=0x7f58f00fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:54.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.046+0000 7f58f5a67700 1 -- 172.21.15.73:0/3517745459 shutdown_connections 2023-08-10T11:50:54.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.046+0000 7f58f5a67700 1 -- 172.21.15.73:0/3517745459 wait complete. 2023-08-10T11:50:54.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.047+0000 7f58f5a67700 1 Processor -- start 2023-08-10T11:50:54.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.047+0000 7f58f5a67700 1 -- start start 2023-08-10T11:50:54.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.047+0000 7f58f5a67700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58f00ff660 0x7f58f0196580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:54.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.047+0000 7f58f5a67700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58f0100850 0x7f58f0196ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:54.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.047+0000 7f58f5a67700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58f01011f0 0x7f58f019db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:54.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.047+0000 7f58f5a67700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f019e100 con 0x7f58f00ff660 2023-08-10T11:50:54.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.047+0000 7f58f5a67700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f019e240 con 0x7f58f0100850 2023-08-10T11:50:54.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.047+0000 7f58f5a67700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f019e3d0 con 0x7f58f01011f0 2023-08-10T11:50:54.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.047+0000 7f58ef7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58f00ff660 0x7f58f0196580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:54.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.047+0000 7f58ef7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58f00ff660 0x7f58f0196580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58896/0 (socket says 172.21.15.73:58896) 2023-08-10T11:50:54.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.047+0000 7f58ef7fe700 1 -- 172.21.15.73:0/3513608613 learned_addr learned my addr 172.21.15.73:0/3513608613 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:54.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.047+0000 7f58effff700 1 --2- 172.21.15.73:0/3513608613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58f01011f0 0x7f58f019db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:54.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.048+0000 7f58eeffd700 1 --2- 172.21.15.73:0/3513608613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58f0100850 0x7f58f0196ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:54.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.048+0000 7f58ef7fe700 1 -- 172.21.15.73:0/3513608613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58f01011f0 msgr2=0x7f58f019db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:54.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.048+0000 7f58ef7fe700 1 --2- 172.21.15.73:0/3513608613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58f01011f0 0x7f58f019db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:54.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.048+0000 7f58ef7fe700 1 -- 172.21.15.73:0/3513608613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58f0100850 msgr2=0x7f58f0196ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:54.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.048+0000 7f58ef7fe700 1 --2- 172.21.15.73:0/3513608613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58f0100850 0x7f58f0196ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:54.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.048+0000 7f58ef7fe700 1 -- 172.21.15.73:0/3513608613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e8009d00 con 0x7f58f00ff660 2023-08-10T11:50:54.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.048+0000 7f58ef7fe700 1 --2- 172.21.15.73:0/3513608613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58f00ff660 0x7f58f0196580 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f58e000e970 tx=0x7f58e000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:54.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.048+0000 7f58ecff9700 1 -- 172.21.15.73:0/3513608613 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e0009790 con 0x7f58f00ff660 2023-08-10T11:50:54.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.048+0000 7f58ecff9700 1 -- 172.21.15.73:0/3513608613 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f58e000eec0 con 0x7f58f00ff660 2023-08-10T11:50:54.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.048+0000 7f58f5a67700 1 -- 172.21.15.73:0/3513608613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f019e6b0 con 0x7f58f00ff660 2023-08-10T11:50:54.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.048+0000 7f58ecff9700 1 -- 172.21.15.73:0/3513608613 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e0003cf0 con 0x7f58f00ff660 2023-08-10T11:50:54.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.048+0000 7f58f5a67700 1 -- 172.21.15.73:0/3513608613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f019ebc0 con 0x7f58f00ff660 2023-08-10T11:50:54.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.049+0000 7f58f5a67700 1 -- 172.21.15.73:0/3513608613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f0107730 con 0x7f58f00ff660 2023-08-10T11:50:54.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.051+0000 7f58ecff9700 1 -- 172.21.15.73:0/3513608613 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f58e000ccd0 con 0x7f58f00ff660 2023-08-10T11:50:54.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.051+0000 7f58ecff9700 1 --2- 172.21.15.73:0/3513608613 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f58d80a1150 0x7f58d80a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:54.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.052+0000 7f58eeffd700 1 --2- 172.21.15.73:0/3513608613 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f58d80a1150 0x7f58d80a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:54.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.052+0000 7f58ecff9700 1 -- 172.21.15.73:0/3513608613 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f58e0014070 con 0x7f58f00ff660 2023-08-10T11:50:54.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.052+0000 7f58eeffd700 1 --2- 172.21.15.73:0/3513608613 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f58d80a1150 0x7f58d80a3610 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f58e4005fd0 tx=0x7f58e4005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:54.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.059+0000 7f58ecff9700 1 -- 172.21.15.73:0/3513608613 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f58e00963f0 con 0x7f58f00ff660 2023-08-10T11:50:54.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:53 smithi152 ceph-mon[130220]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:54.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:53 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3891313686' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-08-10T11:50:54.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:53 smithi152 ceph-mon[130220]: osdmap e80: 12 total, 12 up, 12 in 2023-08-10T11:50:54.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:53 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/927561014' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-08-10T11:50:54.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:53 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:54.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:53 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:50:54.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:53 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:54.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:53 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:54.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:53 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:50:54.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:53 smithi156 ceph-mon[130574]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:54.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:53 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3891313686' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-08-10T11:50:54.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:53 smithi156 ceph-mon[130574]: osdmap e80: 12 total, 12 up, 12 in 2023-08-10T11:50:54.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:53 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/927561014' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-08-10T11:50:54.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:53 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:54.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:53 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:50:54.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:53 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:54.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:53 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:54.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:53 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:50:54.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:53 smithi073 ceph-mon[128869]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:54.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:53 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3891313686' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-08-10T11:50:54.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:53 smithi073 ceph-mon[128869]: osdmap e80: 12 total, 12 up, 12 in 2023-08-10T11:50:54.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:53 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/927561014' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-08-10T11:50:54.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:54.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:50:54.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:54.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:54.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:53 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:50:54.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.302+0000 7f58f5a67700 1 -- 172.21.15.73:0/3513608613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f58f002c970 con 0x7f58f00ff660 2023-08-10T11:50:54.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.905+0000 7f58ecff9700 1 -- 172.21.15.73:0/3513608613 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f58e0099a10 con 0x7f58f00ff660 2023-08-10T11:50:54.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.908+0000 7f58f5a67700 1 -- 172.21.15.73:0/3513608613 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f58d80a1150 msgr2=0x7f58d80a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:54.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.908+0000 7f58f5a67700 1 --2- 172.21.15.73:0/3513608613 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f58d80a1150 0x7f58d80a3610 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f58e4005fd0 tx=0x7f58e4005f60 comp rx=0 tx=0).stop 2023-08-10T11:50:54.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.908+0000 7f58f5a67700 1 -- 172.21.15.73:0/3513608613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58f00ff660 msgr2=0x7f58f0196580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:54.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.908+0000 7f58f5a67700 1 --2- 172.21.15.73:0/3513608613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58f00ff660 0x7f58f0196580 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f58e000e970 tx=0x7f58e000ec80 comp rx=0 tx=0).stop 2023-08-10T11:50:54.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.908+0000 7f58f5a67700 1 -- 172.21.15.73:0/3513608613 shutdown_connections 2023-08-10T11:50:54.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.908+0000 7f58f5a67700 1 --2- 172.21.15.73:0/3513608613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58f01011f0 0x7f58f019db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:54.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.908+0000 7f58f5a67700 1 --2- 172.21.15.73:0/3513608613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58f00ff660 0x7f58f0196580 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:54.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.908+0000 7f58f5a67700 1 --2- 172.21.15.73:0/3513608613 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f58d80a1150 0x7f58d80a3610 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:54.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.908+0000 7f58f5a67700 1 --2- 172.21.15.73:0/3513608613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58f0100850 0x7f58f0196ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:54.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.908+0000 7f58f5a67700 1 -- 172.21.15.73:0/3513608613 >> 172.21.15.73:0/3513608613 conn(0x7f58f00fabd0 msgr2=0x7f58f00fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:54.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.908+0000 7f58f5a67700 1 -- 172.21.15.73:0/3513608613 shutdown_connections 2023-08-10T11:50:54.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:54.908+0000 7f58f5a67700 1 -- 172.21.15.73:0/3513608613 wait complete. 2023-08-10T11:50:54.912 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 2 and data pool 3 2023-08-10T11:50:54.926 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T11:50:55.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.054+0000 7fdd8102f700 1 -- 172.21.15.73:0/3928760377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd7c100770 msgr2=0x7fdd7c100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:55.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.054+0000 7fdd8102f700 1 --2- 172.21.15.73:0/3928760377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd7c100770 0x7fdd7c100b90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdd700099c0 tx=0x7fdd70009cd0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.054+0000 7fdd8102f700 1 -- 172.21.15.73:0/3928760377 shutdown_connections 2023-08-10T11:50:55.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.054+0000 7fdd8102f700 1 --2- 172.21.15.73:0/3928760377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd7c102300 0x7fdd7c108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.054+0000 7fdd8102f700 1 --2- 172.21.15.73:0/3928760377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd7c100770 0x7fdd7c100b90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.054+0000 7fdd8102f700 1 --2- 172.21.15.73:0/3928760377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd7c101960 0x7fdd7c101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.054+0000 7fdd8102f700 1 -- 172.21.15.73:0/3928760377 >> 172.21.15.73:0/3928760377 conn(0x7fdd7c0fbcc0 msgr2=0x7fdd7c0fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:55.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.054+0000 7fdd8102f700 1 -- 172.21.15.73:0/3928760377 shutdown_connections 2023-08-10T11:50:55.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.054+0000 7fdd8102f700 1 -- 172.21.15.73:0/3928760377 wait complete. 2023-08-10T11:50:55.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.054+0000 7fdd8102f700 1 Processor -- start 2023-08-10T11:50:55.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.055+0000 7fdd8102f700 1 -- start start 2023-08-10T11:50:55.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.055+0000 7fdd8102f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd7c100770 0x7fdd7c1963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:55.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.055+0000 7fdd8102f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd7c101960 0x7fdd7c196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:55.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.055+0000 7fdd8102f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd7c102300 0x7fdd7c19d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:55.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.055+0000 7fdd8102f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7c19df60 con 0x7fdd7c102300 2023-08-10T11:50:55.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.055+0000 7fdd8102f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7c19e0a0 con 0x7fdd7c100770 2023-08-10T11:50:55.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.055+0000 7fdd8102f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7c19e230 con 0x7fdd7c101960 2023-08-10T11:50:55.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.055+0000 7fdd7ad9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd7c100770 0x7fdd7c1963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:55.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.055+0000 7fdd7b59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd7c102300 0x7fdd7c19d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:55.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.055+0000 7fdd7ad9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd7c100770 0x7fdd7c1963e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:45332/0 (socket says 172.21.15.73:45332) 2023-08-10T11:50:55.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.055+0000 7fdd7ad9d700 1 -- 172.21.15.73:0/431489509 learned_addr learned my addr 172.21.15.73:0/431489509 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:55.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.055+0000 7fdd7a59c700 1 --2- 172.21.15.73:0/431489509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd7c101960 0x7fdd7c196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:55.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.055+0000 7fdd7b59e700 1 -- 172.21.15.73:0/431489509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd7c101960 msgr2=0x7fdd7c196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:55.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.055+0000 7fdd7b59e700 1 --2- 172.21.15.73:0/431489509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd7c101960 0x7fdd7c196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.055+0000 7fdd7b59e700 1 -- 172.21.15.73:0/431489509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd7c100770 msgr2=0x7fdd7c1963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:55.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.055+0000 7fdd7b59e700 1 --2- 172.21.15.73:0/431489509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd7c100770 0x7fdd7c1963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.055+0000 7fdd7b59e700 1 -- 172.21.15.73:0/431489509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd700095f0 con 0x7fdd7c102300 2023-08-10T11:50:55.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.055+0000 7fdd7ad9d700 1 --2- 172.21.15.73:0/431489509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd7c100770 0x7fdd7c1963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:50:55.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.055+0000 7fdd7b59e700 1 --2- 172.21.15.73:0/431489509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd7c102300 0x7fdd7c19d990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdd74007f10 tx=0x7fdd7400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:55.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.056+0000 7fdd63fff700 1 -- 172.21.15.73:0/431489509 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd74004db0 con 0x7fdd7c102300 2023-08-10T11:50:55.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.056+0000 7fdd63fff700 1 -- 172.21.15.73:0/431489509 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd7400f040 con 0x7fdd7c102300 2023-08-10T11:50:55.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.056+0000 7fdd8102f700 1 -- 172.21.15.73:0/431489509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd7c19e510 con 0x7fdd7c102300 2023-08-10T11:50:55.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.056+0000 7fdd63fff700 1 -- 172.21.15.73:0/431489509 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd74005990 con 0x7fdd7c102300 2023-08-10T11:50:55.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.056+0000 7fdd8102f700 1 -- 172.21.15.73:0/431489509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd7c19e9d0 con 0x7fdd7c102300 2023-08-10T11:50:55.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.056+0000 7fdd8102f700 1 -- 172.21.15.73:0/431489509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd7c10bf80 con 0x7fdd7c102300 2023-08-10T11:50:55.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.058+0000 7fdd63fff700 1 -- 172.21.15.73:0/431489509 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fdd7400db20 con 0x7fdd7c102300 2023-08-10T11:50:55.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.058+0000 7fdd63fff700 1 --2- 172.21.15.73:0/431489509 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fdd640a11a0 0x7fdd640a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:55.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.058+0000 7fdd7ad9d700 1 --2- 172.21.15.73:0/431489509 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fdd640a11a0 0x7fdd640a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:55.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.058+0000 7fdd63fff700 1 -- 172.21.15.73:0/431489509 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fdd740cc830 con 0x7fdd7c102300 2023-08-10T11:50:55.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.058+0000 7fdd7ad9d700 1 --2- 172.21.15.73:0/431489509 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fdd640a11a0 0x7fdd640a3660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdd70005cd0 tx=0x7fdd70005bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:55.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.062+0000 7fdd63fff700 1 -- 172.21.15.73:0/431489509 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fdd740960d0 con 0x7fdd7c102300 2023-08-10T11:50:55.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:54 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/927561014' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-08-10T11:50:55.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:54 smithi152 ceph-mon[130220]: osdmap e81: 12 total, 12 up, 12 in 2023-08-10T11:50:55.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:54 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3513608613' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-08-10T11:50:55.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:54 smithi152 ceph-mon[130220]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-08-10T11:50:55.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:54 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/927561014' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-08-10T11:50:55.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:54 smithi156 ceph-mon[130574]: osdmap e81: 12 total, 12 up, 12 in 2023-08-10T11:50:55.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:54 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3513608613' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-08-10T11:50:55.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:54 smithi156 ceph-mon[130574]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-08-10T11:50:55.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:54 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/927561014' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-08-10T11:50:55.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:54 smithi073 ceph-mon[128869]: osdmap e81: 12 total, 12 up, 12 in 2023-08-10T11:50:55.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:54 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3513608613' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-08-10T11:50:55.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:54 smithi073 ceph-mon[128869]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-08-10T11:50:55.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.285+0000 7fdd8102f700 1 -- 172.21.15.73:0/431489509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd7c19f010 con 0x7fdd7c102300 2023-08-10T11:50:55.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.286+0000 7fdd63fff700 1 -- 172.21.15.73:0/431489509 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22118 (secure 0 0 0) 0x7fdd74023020 con 0x7fdd7c102300 2023-08-10T11:50:55.288 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:50:55.288 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":82,"fsid":"0e619a74-3773-11ee-9b37-001a4aab830c","created":"2023-08-10T11:43:53.974768+0000","modified":"2023-08-10T11:50:54.304079+0000","last_up_change":"2023-08-10T11:50:12.914422+0000","last_in_change":"2023-08-10T11:49:54.624543+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T11:46:58.735153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T11:50:52.517974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T11:50:53.465357+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3219ae18-cc4c-4712-b616-79f6949066e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6803","nonce":2725694252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6805","nonce":2725694252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6809","nonce":2725694252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6807","nonce":2725694252}]},"public_addr":"172.21.15.73:6803/2725694252","cluster_addr":"172.21.15.73:6805/2725694252","heartbeat_back_addr":"172.21.15.73:6809/2725694252","heartbeat_front_addr":"172.21.15.73:6807/2725694252","state":["exists","up"]},{"osd":1,"uuid":"bbfe6cd9-b3d3-4b8d-8814-507a867f8c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6801","nonce":836829168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6803","nonce":836829168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6807","nonce":836829168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6805","nonce":836829168}]},"public_addr":"172.21.15.152:6801/836829168","cluster_addr":"172.21.15.152:6803/836829168","heartbeat_back_addr":"172.21.15.152:6807/836829168","heartbeat_front_addr":"172.21.15.152:6805/836829168","state":["exists","up"]},{"osd":2,"uuid":"f57f5b2c-3208-45c0-beba-8501694b99c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6801","nonce":1789212298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6803","nonce":1789212298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6807","nonce":1789212298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6805","nonce":1789212298}]},"public_addr":"172.21.15.156:6801/1789212298","cluster_addr":"172.21.15.156:6803/1789212298","heartbeat_back_addr":"172.21.15.156:6807/1789212298","heartbeat_front_addr":"172.21.15.156:6805/1789212298","state":["exists","up"]},{"osd":3,"uuid":"18592408-3696-4ab8-ad41-c172b8409829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6811","nonce":3101572649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6813","nonce":3101572649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6817","nonce":3101572649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6815","nonce":3101572649}]},"public_addr":"172.21.15.73:6811/3101572649","cluster_addr":"172.21.15.73:6813/3101572649","heartbeat_back_addr":"172.21.15.73:6817/3101572649","heartbeat_front_addr":"172.21.15.73:6815/3101572649","state":["exists","up"]},{"osd":4,"uuid":"fb3adb09-8807-42d9-8db9-1867c5fe02da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6809","nonce":1451517889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6811","nonce":1451517889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6815","nonce":1451517889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6813","nonce":1451517889}]},"public_addr":"172.21.15.152:6809/1451517889","cluster_addr":"172.21.15.152:6811/1451517889","heartbeat_back_addr":"172.21.15.152:6815/1451517889","heartbeat_front_addr":"172.21.15.152:6813/1451517889","state":["exists","up"]},{"osd":5,"uuid":"af58a7bd-4e58-4639-95b2-4a76011b61dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6809","nonce":3823368741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6811","nonce":3823368741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6815","nonce":3823368741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6813","nonce":3823368741}]},"public_addr":"172.21.15.156:6809/3823368741","cluster_addr":"172.21.15.156:6811/3823368741","heartbeat_back_addr":"172.21.15.156:6815/3823368741","heartbeat_front_addr":"172.21.15.156:6813/3823368741","state":["exists","up"]},{"osd":6,"uuid":"f6ae502d-4af9-4f6a-8636-b5b683dfdfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6819","nonce":2533620458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6821","nonce":2533620458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6825","nonce":2533620458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6823","nonce":2533620458}]},"public_addr":"172.21.15.73:6819/2533620458","cluster_addr":"172.21.15.73:6821/2533620458","heartbeat_back_addr":"172.21.15.73:6825/2533620458","heartbeat_front_addr":"172.21.15.73:6823/2533620458","state":["exists","up"]},{"osd":7,"uuid":"398fd334-5f6f-427c-95ae-3244fb466f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6817","nonce":4059538477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6819","nonce":4059538477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6823","nonce":4059538477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6821","nonce":4059538477}]},"public_addr":"172.21.15.152:6817/4059538477","cluster_addr":"172.21.15.152:6819/4059538477","heartbeat_back_addr":"172.21.15.152:6823/4059538477","heartbeat_front_addr":"172.21.15.152:6821/4059538477","state":["exists","up"]},{"osd":8,"uuid":"58f46e64-2624-4ad4-bb6a-225624153837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6817","nonce":96487555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6819","nonce":96487555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6823","nonce":96487555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6821","nonce":96487555}]},"public_addr":"172.21.15.156:6817/96487555","cluster_addr":"172.21.15.156:6819/96487555","heartbeat_back_addr":"172.21.15.156:6823/96487555","heartbeat_front_addr":"172.21.15.156:6821/96487555","state":["exists","up"]},{"osd":9,"uuid":"9389dd5b-da2d-43b6-8bc0-bb1af13f72c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6827","nonce":2050124321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6829","nonce":2050124321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6833","nonce":2050124321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6831","nonce":2050124321}]},"public_addr":"172.21.15.73:6827/2050124321","cluster_addr":"172.21.15.73:6829/2050124321","heartbeat_back_addr":"172.21.15.73:6833/2050124321","heartbeat_front_addr":"172.21.15.73:6831/2050124321","state":["exists","up"]},{"osd":10,"uuid":"563c1e34-3acd-46ab-ba36-e9d87f635e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6825","nonce":1513186350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6827","nonce":1513186350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6831","nonce":1513186350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6829","nonce":1513186350}]},"public_addr":"172.21.15.152:6825/1513186350","cluster_addr":"172.21.15.152:6827/1513186350","heartbeat_back_addr":"172.21.15.152:6831/1513186350","heartbeat_front_addr":"172.21.15.152:6829/1513186350","state":["exists","up"]},{"osd":11,"uuid":"f1b55889-14fd-4cc9-bed7-43748086fb77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6825","nonce":737904755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6827","nonce":737904755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6831","nonce":737904755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6829","nonce":737904755}]},"public_addr":"172.21.15.156:6825/737904755","cluster_addr":"172.21.15.156:6827/737904755","heartbeat_back_addr":"172.21.15.156:6831/737904755","heartbeat_front_addr":"172.21.15.156:6829/737904755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:12.023797+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:33.872883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:55.856970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:18.013196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:39.202872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:00.393920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:22.743083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:43.921728+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:05.859488+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:27.618714+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:48.880286+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:50:11.055141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/2202785670":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6800/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:6800/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/1447381524":"2023-08-11T11:44:48.401660+0000","172.21.15.73:0/2545059698":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/4193457623":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2561039569":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2927950081":"2023-08-11T11:44:48.401660+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T11:50:55.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.288+0000 7fdd8102f700 1 -- 172.21.15.73:0/431489509 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fdd640a11a0 msgr2=0x7fdd640a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:55.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.288+0000 7fdd8102f700 1 --2- 172.21.15.73:0/431489509 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fdd640a11a0 0x7fdd640a3660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdd70005cd0 tx=0x7fdd70005bc0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.288+0000 7fdd8102f700 1 -- 172.21.15.73:0/431489509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd7c102300 msgr2=0x7fdd7c19d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:55.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.288+0000 7fdd8102f700 1 --2- 172.21.15.73:0/431489509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd7c102300 0x7fdd7c19d990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdd74007f10 tx=0x7fdd7400d3b0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.288+0000 7fdd8102f700 1 -- 172.21.15.73:0/431489509 shutdown_connections 2023-08-10T11:50:55.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.288+0000 7fdd8102f700 1 --2- 172.21.15.73:0/431489509 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fdd640a11a0 0x7fdd640a3660 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.288+0000 7fdd8102f700 1 --2- 172.21.15.73:0/431489509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd7c100770 0x7fdd7c1963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.288+0000 7fdd8102f700 1 --2- 172.21.15.73:0/431489509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd7c102300 0x7fdd7c19d990 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.288+0000 7fdd8102f700 1 --2- 172.21.15.73:0/431489509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd7c101960 0x7fdd7c196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.288+0000 7fdd8102f700 1 -- 172.21.15.73:0/431489509 >> 172.21.15.73:0/431489509 conn(0x7fdd7c0fbcc0 msgr2=0x7fdd7c0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:55.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.289+0000 7fdd8102f700 1 -- 172.21.15.73:0/431489509 shutdown_connections 2023-08-10T11:50:55.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.289+0000 7fdd8102f700 1 -- 172.21.15.73:0/431489509 wait complete. 2023-08-10T11:50:55.303 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T11:50:55.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.426+0000 7f4dbbfa4700 1 -- 172.21.15.73:0/1811851674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4db4100850 msgr2=0x7f4db4100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:55.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.426+0000 7f4dbbfa4700 1 --2- 172.21.15.73:0/1811851674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4db4100850 0x7f4db4100cb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4da40099c0 tx=0x7f4da4009cd0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.426+0000 7f4dbbfa4700 1 -- 172.21.15.73:0/1811851674 shutdown_connections 2023-08-10T11:50:55.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.426+0000 7f4dbbfa4700 1 --2- 172.21.15.73:0/1811851674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4db41011f0 0x7f4db4107aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.426+0000 7f4dbbfa4700 1 --2- 172.21.15.73:0/1811851674 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4db40ff660 0x7f4db40ffa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.426+0000 7f4dbbfa4700 1 --2- 172.21.15.73:0/1811851674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4db4100850 0x7f4db4100cb0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.426+0000 7f4dbbfa4700 1 -- 172.21.15.73:0/1811851674 >> 172.21.15.73:0/1811851674 conn(0x7f4db40fab90 msgr2=0x7f4db40fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:55.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.426+0000 7f4dbbfa4700 1 -- 172.21.15.73:0/1811851674 shutdown_connections 2023-08-10T11:50:55.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.427+0000 7f4dbbfa4700 1 -- 172.21.15.73:0/1811851674 wait complete. 2023-08-10T11:50:55.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.427+0000 7f4dbbfa4700 1 Processor -- start 2023-08-10T11:50:55.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.427+0000 7f4dbbfa4700 1 -- start start 2023-08-10T11:50:55.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.427+0000 7f4dbbfa4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4db40ff660 0x7f4db41952b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:55.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.427+0000 7f4dbbfa4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4db4100850 0x7f4db41957f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:55.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.427+0000 7f4dbbfa4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4db41011f0 0x7f4db419c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:55.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.427+0000 7f4dbbfa4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db419ce30 con 0x7f4db4100850 2023-08-10T11:50:55.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.427+0000 7f4dbbfa4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db419cf70 con 0x7f4db41011f0 2023-08-10T11:50:55.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.427+0000 7f4dbbfa4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db419d100 con 0x7f4db40ff660 2023-08-10T11:50:55.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.427+0000 7f4db953f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4db4100850 0x7f4db41957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:55.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.427+0000 7f4db953f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4db4100850 0x7f4db41957f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58930/0 (socket says 172.21.15.73:58930) 2023-08-10T11:50:55.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.427+0000 7f4db953f700 1 -- 172.21.15.73:0/695582414 learned_addr learned my addr 172.21.15.73:0/695582414 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:55.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.427+0000 7f4db9d40700 1 --2- 172.21.15.73:0/695582414 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4db40ff660 0x7f4db41952b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:55.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.427+0000 7f4dba541700 1 --2- 172.21.15.73:0/695582414 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4db41011f0 0x7f4db419c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:55.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.428+0000 7f4db953f700 1 -- 172.21.15.73:0/695582414 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4db40ff660 msgr2=0x7f4db41952b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:55.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.428+0000 7f4db953f700 1 --2- 172.21.15.73:0/695582414 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4db40ff660 0x7f4db41952b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.428+0000 7f4db953f700 1 -- 172.21.15.73:0/695582414 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4db41011f0 msgr2=0x7f4db419c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:55.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.428+0000 7f4db953f700 1 --2- 172.21.15.73:0/695582414 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4db41011f0 0x7f4db419c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.428+0000 7f4db953f700 1 -- 172.21.15.73:0/695582414 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da40095f0 con 0x7f4db4100850 2023-08-10T11:50:55.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.428+0000 7f4db9d40700 1 --2- 172.21.15.73:0/695582414 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4db40ff660 0x7f4db41952b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:50:55.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.428+0000 7f4db953f700 1 --2- 172.21.15.73:0/695582414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4db4100850 0x7f4db41957f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4da4009fd0 tx=0x7f4da4009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:55.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.428+0000 7f4daaffd700 1 -- 172.21.15.73:0/695582414 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da401f070 con 0x7f4db4100850 2023-08-10T11:50:55.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.428+0000 7f4dbbfa4700 1 -- 172.21.15.73:0/695582414 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db4068900 con 0x7f4db4100850 2023-08-10T11:50:55.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.428+0000 7f4daaffd700 1 -- 172.21.15.73:0/695582414 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4da4005030 con 0x7f4db4100850 2023-08-10T11:50:55.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.428+0000 7f4daaffd700 1 -- 172.21.15.73:0/695582414 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da4004a00 con 0x7f4db4100850 2023-08-10T11:50:55.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.428+0000 7f4dbbfa4700 1 -- 172.21.15.73:0/695582414 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db4068d50 con 0x7f4db4100850 2023-08-10T11:50:55.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.429+0000 7f4dbbfa4700 1 -- 172.21.15.73:0/695582414 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db410ae70 con 0x7f4db4100850 2023-08-10T11:50:55.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.431+0000 7f4daaffd700 1 -- 172.21.15.73:0/695582414 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f4da4023070 con 0x7f4db4100850 2023-08-10T11:50:55.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.432+0000 7f4daaffd700 1 --2- 172.21.15.73:0/695582414 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4da00a11a0 0x7f4da00a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:55.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.432+0000 7f4db9d40700 1 --2- 172.21.15.73:0/695582414 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4da00a11a0 0x7f4da00a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:55.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.432+0000 7f4daaffd700 1 -- 172.21.15.73:0/695582414 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4da40cf9e0 con 0x7f4db4100850 2023-08-10T11:50:55.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.432+0000 7f4db9d40700 1 --2- 172.21.15.73:0/695582414 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4da00a11a0 0x7f4da00a3660 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4db41006b0 tx=0x7f4db0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:55.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.435+0000 7f4daaffd700 1 -- 172.21.15.73:0/695582414 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f4da4099310 con 0x7f4db4100850 2023-08-10T11:50:55.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.641+0000 7f4dbbfa4700 1 -- 172.21.15.73:0/695582414 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4db4069880 con 0x7f4db4100850 2023-08-10T11:50:55.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.642+0000 7f4daaffd700 1 -- 172.21.15.73:0/695582414 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22118 (secure 0 0 0) 0x7f4da409c930 con 0x7f4db4100850 2023-08-10T11:50:55.644 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:50:55.645 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":82,"fsid":"0e619a74-3773-11ee-9b37-001a4aab830c","created":"2023-08-10T11:43:53.974768+0000","modified":"2023-08-10T11:50:54.304079+0000","last_up_change":"2023-08-10T11:50:12.914422+0000","last_in_change":"2023-08-10T11:49:54.624543+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T11:46:58.735153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T11:50:52.517974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T11:50:53.465357+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3219ae18-cc4c-4712-b616-79f6949066e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6803","nonce":2725694252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6805","nonce":2725694252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6809","nonce":2725694252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6807","nonce":2725694252}]},"public_addr":"172.21.15.73:6803/2725694252","cluster_addr":"172.21.15.73:6805/2725694252","heartbeat_back_addr":"172.21.15.73:6809/2725694252","heartbeat_front_addr":"172.21.15.73:6807/2725694252","state":["exists","up"]},{"osd":1,"uuid":"bbfe6cd9-b3d3-4b8d-8814-507a867f8c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6801","nonce":836829168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6803","nonce":836829168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6807","nonce":836829168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6805","nonce":836829168}]},"public_addr":"172.21.15.152:6801/836829168","cluster_addr":"172.21.15.152:6803/836829168","heartbeat_back_addr":"172.21.15.152:6807/836829168","heartbeat_front_addr":"172.21.15.152:6805/836829168","state":["exists","up"]},{"osd":2,"uuid":"f57f5b2c-3208-45c0-beba-8501694b99c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6801","nonce":1789212298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6803","nonce":1789212298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6807","nonce":1789212298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6805","nonce":1789212298}]},"public_addr":"172.21.15.156:6801/1789212298","cluster_addr":"172.21.15.156:6803/1789212298","heartbeat_back_addr":"172.21.15.156:6807/1789212298","heartbeat_front_addr":"172.21.15.156:6805/1789212298","state":["exists","up"]},{"osd":3,"uuid":"18592408-3696-4ab8-ad41-c172b8409829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6811","nonce":3101572649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6813","nonce":3101572649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6817","nonce":3101572649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6815","nonce":3101572649}]},"public_addr":"172.21.15.73:6811/3101572649","cluster_addr":"172.21.15.73:6813/3101572649","heartbeat_back_addr":"172.21.15.73:6817/3101572649","heartbeat_front_addr":"172.21.15.73:6815/3101572649","state":["exists","up"]},{"osd":4,"uuid":"fb3adb09-8807-42d9-8db9-1867c5fe02da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6809","nonce":1451517889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6811","nonce":1451517889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6815","nonce":1451517889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6813","nonce":1451517889}]},"public_addr":"172.21.15.152:6809/1451517889","cluster_addr":"172.21.15.152:6811/1451517889","heartbeat_back_addr":"172.21.15.152:6815/1451517889","heartbeat_front_addr":"172.21.15.152:6813/1451517889","state":["exists","up"]},{"osd":5,"uuid":"af58a7bd-4e58-4639-95b2-4a76011b61dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6809","nonce":3823368741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6811","nonce":3823368741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6815","nonce":3823368741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6813","nonce":3823368741}]},"public_addr":"172.21.15.156:6809/3823368741","cluster_addr":"172.21.15.156:6811/3823368741","heartbeat_back_addr":"172.21.15.156:6815/3823368741","heartbeat_front_addr":"172.21.15.156:6813/3823368741","state":["exists","up"]},{"osd":6,"uuid":"f6ae502d-4af9-4f6a-8636-b5b683dfdfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6819","nonce":2533620458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6821","nonce":2533620458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6825","nonce":2533620458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6823","nonce":2533620458}]},"public_addr":"172.21.15.73:6819/2533620458","cluster_addr":"172.21.15.73:6821/2533620458","heartbeat_back_addr":"172.21.15.73:6825/2533620458","heartbeat_front_addr":"172.21.15.73:6823/2533620458","state":["exists","up"]},{"osd":7,"uuid":"398fd334-5f6f-427c-95ae-3244fb466f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6817","nonce":4059538477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6819","nonce":4059538477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6823","nonce":4059538477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6821","nonce":4059538477}]},"public_addr":"172.21.15.152:6817/4059538477","cluster_addr":"172.21.15.152:6819/4059538477","heartbeat_back_addr":"172.21.15.152:6823/4059538477","heartbeat_front_addr":"172.21.15.152:6821/4059538477","state":["exists","up"]},{"osd":8,"uuid":"58f46e64-2624-4ad4-bb6a-225624153837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6817","nonce":96487555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6819","nonce":96487555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6823","nonce":96487555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6821","nonce":96487555}]},"public_addr":"172.21.15.156:6817/96487555","cluster_addr":"172.21.15.156:6819/96487555","heartbeat_back_addr":"172.21.15.156:6823/96487555","heartbeat_front_addr":"172.21.15.156:6821/96487555","state":["exists","up"]},{"osd":9,"uuid":"9389dd5b-da2d-43b6-8bc0-bb1af13f72c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6827","nonce":2050124321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6829","nonce":2050124321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6833","nonce":2050124321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6831","nonce":2050124321}]},"public_addr":"172.21.15.73:6827/2050124321","cluster_addr":"172.21.15.73:6829/2050124321","heartbeat_back_addr":"172.21.15.73:6833/2050124321","heartbeat_front_addr":"172.21.15.73:6831/2050124321","state":["exists","up"]},{"osd":10,"uuid":"563c1e34-3acd-46ab-ba36-e9d87f635e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6825","nonce":1513186350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6827","nonce":1513186350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6831","nonce":1513186350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6829","nonce":1513186350}]},"public_addr":"172.21.15.152:6825/1513186350","cluster_addr":"172.21.15.152:6827/1513186350","heartbeat_back_addr":"172.21.15.152:6831/1513186350","heartbeat_front_addr":"172.21.15.152:6829/1513186350","state":["exists","up"]},{"osd":11,"uuid":"f1b55889-14fd-4cc9-bed7-43748086fb77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6825","nonce":737904755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6827","nonce":737904755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6831","nonce":737904755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6829","nonce":737904755}]},"public_addr":"172.21.15.156:6825/737904755","cluster_addr":"172.21.15.156:6827/737904755","heartbeat_back_addr":"172.21.15.156:6831/737904755","heartbeat_front_addr":"172.21.15.156:6829/737904755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:12.023797+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:33.872883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:55.856970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:18.013196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:39.202872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:00.393920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:22.743083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:43.921728+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:05.859488+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:27.618714+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:48.880286+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:50:11.055141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/2202785670":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6800/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:6800/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/1447381524":"2023-08-11T11:44:48.401660+0000","172.21.15.73:0/2545059698":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/4193457623":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2561039569":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2927950081":"2023-08-11T11:44:48.401660+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T11:50:55.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.644+0000 7f4dbbfa4700 1 -- 172.21.15.73:0/695582414 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4da00a11a0 msgr2=0x7f4da00a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:55.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.644+0000 7f4dbbfa4700 1 --2- 172.21.15.73:0/695582414 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4da00a11a0 0x7f4da00a3660 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4db41006b0 tx=0x7f4db0009260 comp rx=0 tx=0).stop 2023-08-10T11:50:55.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.644+0000 7f4dbbfa4700 1 -- 172.21.15.73:0/695582414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4db4100850 msgr2=0x7f4db41957f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:55.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.644+0000 7f4dbbfa4700 1 --2- 172.21.15.73:0/695582414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4db4100850 0x7f4db41957f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4da4009fd0 tx=0x7f4da4009580 comp rx=0 tx=0).stop 2023-08-10T11:50:55.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.644+0000 7f4dbbfa4700 1 -- 172.21.15.73:0/695582414 shutdown_connections 2023-08-10T11:50:55.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.644+0000 7f4dbbfa4700 1 --2- 172.21.15.73:0/695582414 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4da00a11a0 0x7f4da00a3660 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.644+0000 7f4dbbfa4700 1 --2- 172.21.15.73:0/695582414 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4db41011f0 0x7f4db419c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.645+0000 7f4dbbfa4700 1 --2- 172.21.15.73:0/695582414 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4db40ff660 0x7f4db41952b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.645+0000 7f4dbbfa4700 1 --2- 172.21.15.73:0/695582414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4db4100850 0x7f4db41957f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.645+0000 7f4dbbfa4700 1 -- 172.21.15.73:0/695582414 >> 172.21.15.73:0/695582414 conn(0x7f4db40fab90 msgr2=0x7f4db40fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:55.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.645+0000 7f4dbbfa4700 1 -- 172.21.15.73:0/695582414 shutdown_connections 2023-08-10T11:50:55.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.645+0000 7f4dbbfa4700 1 -- 172.21.15.73:0/695582414 wait complete. 2023-08-10T11:50:55.659 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-10T11:50:55.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.788+0000 7f6bbbbae700 1 -- 172.21.15.73:0/1003572227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bb40ff8a0 msgr2=0x7f6bb40ffd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:55.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.788+0000 7f6bbbbae700 1 --2- 172.21.15.73:0/1003572227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bb40ff8a0 0x7f6bb40ffd20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8009990 tx=0x7f6ba8009ca0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.788+0000 7f6bbbbae700 1 -- 172.21.15.73:0/1003572227 shutdown_connections 2023-08-10T11:50:55.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.788+0000 7f6bbbbae700 1 --2- 172.21.15.73:0/1003572227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bb4100c50 0x7f6bb4101070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.788+0000 7f6bbbbae700 1 --2- 172.21.15.73:0/1003572227 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bb4100260 0x7f6bb4107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.788+0000 7f6bbbbae700 1 --2- 172.21.15.73:0/1003572227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bb40ff8a0 0x7f6bb40ffd20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.788+0000 7f6bbbbae700 1 -- 172.21.15.73:0/1003572227 >> 172.21.15.73:0/1003572227 conn(0x7f6bb40fa390 msgr2=0x7f6bb40fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:55.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.788+0000 7f6bbbbae700 1 -- 172.21.15.73:0/1003572227 shutdown_connections 2023-08-10T11:50:55.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.788+0000 7f6bbbbae700 1 -- 172.21.15.73:0/1003572227 wait complete. 2023-08-10T11:50:55.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.789+0000 7f6bbbbae700 1 Processor -- start 2023-08-10T11:50:55.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.789+0000 7f6bbbbae700 1 -- start start 2023-08-10T11:50:55.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.789+0000 7f6bbbbae700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bb40ff8a0 0x7f6bb40ff300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:55.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.789+0000 7f6bbbbae700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bb4100260 0x7f6bb419b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:55.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.789+0000 7f6bbbbae700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bb4100c50 0x7f6bb419d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:55.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.789+0000 7f6bbbbae700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb419ded0 con 0x7f6bb40ff8a0 2023-08-10T11:50:55.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.789+0000 7f6bbbbae700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb419e040 con 0x7f6bb4100260 2023-08-10T11:50:55.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.789+0000 7f6bbbbae700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb419e200 con 0x7f6bb4100c50 2023-08-10T11:50:55.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.789+0000 7f6bb994a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bb40ff8a0 0x7f6bb40ff300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:55.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.789+0000 7f6bb994a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bb40ff8a0 0x7f6bb40ff300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58942/0 (socket says 172.21.15.73:58942) 2023-08-10T11:50:55.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.789+0000 7f6bb994a700 1 -- 172.21.15.73:0/3568057102 learned_addr learned my addr 172.21.15.73:0/3568057102 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:55.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.789+0000 7f6bb9149700 1 --2- 172.21.15.73:0/3568057102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bb4100260 0x7f6bb419b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:55.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.789+0000 7f6bba14b700 1 --2- 172.21.15.73:0/3568057102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bb4100c50 0x7f6bb419d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:55.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.789+0000 7f6bb994a700 1 -- 172.21.15.73:0/3568057102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bb4100c50 msgr2=0x7f6bb419d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:55.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.789+0000 7f6bb994a700 1 --2- 172.21.15.73:0/3568057102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bb4100c50 0x7f6bb419d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.789+0000 7f6bb994a700 1 -- 172.21.15.73:0/3568057102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bb4100260 msgr2=0x7f6bb419b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:55.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.789+0000 7f6bb994a700 1 --2- 172.21.15.73:0/3568057102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bb4100260 0x7f6bb419b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:55.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.789+0000 7f6bb994a700 1 -- 172.21.15.73:0/3568057102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba80095f0 con 0x7f6bb40ff8a0 2023-08-10T11:50:55.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.789+0000 7f6bb994a700 1 --2- 172.21.15.73:0/3568057102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bb40ff8a0 0x7f6bb40ff300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4007e20 tx=0x7f6ba400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:55.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.789+0000 7f6bb2ffd700 1 -- 172.21.15.73:0/3568057102 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba400ad40 con 0x7f6bb40ff8a0 2023-08-10T11:50:55.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.790+0000 7f6bbbbae700 1 -- 172.21.15.73:0/3568057102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb419e4e0 con 0x7f6bb40ff8a0 2023-08-10T11:50:55.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.790+0000 7f6bb2ffd700 1 -- 172.21.15.73:0/3568057102 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ba40128e0 con 0x7f6bb40ff8a0 2023-08-10T11:50:55.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.790+0000 7f6bb2ffd700 1 -- 172.21.15.73:0/3568057102 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4011700 con 0x7f6bb40ff8a0 2023-08-10T11:50:55.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.790+0000 7f6bbbbae700 1 -- 172.21.15.73:0/3568057102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb419e9f0 con 0x7f6bb40ff8a0 2023-08-10T11:50:55.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.790+0000 7f6bbbbae700 1 -- 172.21.15.73:0/3568057102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb4106c10 con 0x7f6bb40ff8a0 2023-08-10T11:50:55.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.792+0000 7f6bb2ffd700 1 -- 172.21.15.73:0/3568057102 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f6ba4012a50 con 0x7f6bb40ff8a0 2023-08-10T11:50:55.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.792+0000 7f6bb2ffd700 1 --2- 172.21.15.73:0/3568057102 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f6b9c0a1150 0x7f6b9c0a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:55.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.792+0000 7f6bb9149700 1 --2- 172.21.15.73:0/3568057102 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f6b9c0a1150 0x7f6b9c0a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:55.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.792+0000 7f6bb2ffd700 1 -- 172.21.15.73:0/3568057102 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6ba40cccb0 con 0x7f6bb40ff8a0 2023-08-10T11:50:55.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.792+0000 7f6bb9149700 1 --2- 172.21.15.73:0/3568057102 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f6b9c0a1150 0x7f6b9c0a3610 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6ba800b2e0 tx=0x7f6ba8005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:55.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:55.796+0000 7f6bb2ffd700 1 -- 172.21.15.73:0/3568057102 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f6ba4096550 con 0x7f6bb40ff8a0 2023-08-10T11:50:56.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:55 smithi073 ceph-mon[128869]: pgmap v254: 97 pgs: 21 creating+peering, 1 active+clean, 75 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:56.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:55 smithi073 ceph-mon[128869]: osdmap e82: 12 total, 12 up, 12 in 2023-08-10T11:50:56.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:55 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3513608613' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-08-10T11:50:56.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:55 smithi073 ceph-mon[128869]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-08-10T11:50:56.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:55 smithi073 ceph-mon[128869]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-08-10T11:50:56.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:55 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/431489509' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:50:56.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:55 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/695582414' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:50:56.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:55 smithi073 ceph-mon[128869]: osdmap e83: 12 total, 12 up, 12 in 2023-08-10T11:50:56.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:56.042+0000 7f6bbbbae700 1 -- 172.21.15.73:0/3568057102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6bb402c970 con 0x7f6bb40ff8a0 2023-08-10T11:50:56.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:55 smithi152 ceph-mon[130220]: pgmap v254: 97 pgs: 21 creating+peering, 1 active+clean, 75 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:56.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:55 smithi152 ceph-mon[130220]: osdmap e82: 12 total, 12 up, 12 in 2023-08-10T11:50:56.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:55 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3513608613' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-08-10T11:50:56.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:55 smithi152 ceph-mon[130220]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-08-10T11:50:56.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:55 smithi152 ceph-mon[130220]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-08-10T11:50:56.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:55 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/431489509' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:50:56.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:55 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/695582414' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:50:56.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:55 smithi152 ceph-mon[130220]: osdmap e83: 12 total, 12 up, 12 in 2023-08-10T11:50:56.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:55 smithi156 ceph-mon[130574]: pgmap v254: 97 pgs: 21 creating+peering, 1 active+clean, 75 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:50:56.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:55 smithi156 ceph-mon[130574]: osdmap e82: 12 total, 12 up, 12 in 2023-08-10T11:50:56.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:55 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3513608613' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-08-10T11:50:56.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:55 smithi156 ceph-mon[130574]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-08-10T11:50:56.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:55 smithi156 ceph-mon[130574]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-08-10T11:50:56.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:55 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/431489509' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:50:56.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:55 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/695582414' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:50:56.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:55 smithi156 ceph-mon[130574]: osdmap e83: 12 total, 12 up, 12 in 2023-08-10T11:50:56.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:56.912+0000 7f6bb2ffd700 1 -- 172.21.15.73:0/3568057102 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6ba4099b70 con 0x7f6bb40ff8a0 2023-08-10T11:50:56.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:56.914+0000 7f6bbbbae700 1 -- 172.21.15.73:0/3568057102 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f6b9c0a1150 msgr2=0x7f6b9c0a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:56.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:56.914+0000 7f6bbbbae700 1 --2- 172.21.15.73:0/3568057102 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f6b9c0a1150 0x7f6b9c0a3610 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6ba800b2e0 tx=0x7f6ba8005960 comp rx=0 tx=0).stop 2023-08-10T11:50:56.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:56.914+0000 7f6bbbbae700 1 -- 172.21.15.73:0/3568057102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bb40ff8a0 msgr2=0x7f6bb40ff300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:56.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:56.914+0000 7f6bbbbae700 1 --2- 172.21.15.73:0/3568057102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bb40ff8a0 0x7f6bb40ff300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4007e20 tx=0x7f6ba400a340 comp rx=0 tx=0).stop 2023-08-10T11:50:56.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:56.915+0000 7f6bbbbae700 1 -- 172.21.15.73:0/3568057102 shutdown_connections 2023-08-10T11:50:56.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:56.915+0000 7f6bbbbae700 1 --2- 172.21.15.73:0/3568057102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bb4100c50 0x7f6bb419d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:56.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:56.915+0000 7f6bbbbae700 1 --2- 172.21.15.73:0/3568057102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6bb40ff8a0 0x7f6bb40ff300 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:56.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:56.915+0000 7f6bbbbae700 1 --2- 172.21.15.73:0/3568057102 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f6b9c0a1150 0x7f6b9c0a3610 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:56.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:56.915+0000 7f6bbbbae700 1 --2- 172.21.15.73:0/3568057102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6bb4100260 0x7f6bb419b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:56.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:56.915+0000 7f6bbbbae700 1 -- 172.21.15.73:0/3568057102 >> 172.21.15.73:0/3568057102 conn(0x7f6bb40fa390 msgr2=0x7f6bb4103d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:56.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:56.915+0000 7f6bbbbae700 1 -- 172.21.15.73:0/3568057102 shutdown_connections 2023-08-10T11:50:56.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:56.915+0000 7f6bbbbae700 1 -- 172.21.15.73:0/3568057102 wait complete. 2023-08-10T11:50:56.929 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2023-08-10T11:50:56.930 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2023-08-10T11:50:57.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.053+0000 7fe17f65a700 1 -- 172.21.15.73:0/1289904225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1781011f0 msgr2=0x7fe178107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:57.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.053+0000 7fe17f65a700 1 --2- 172.21.15.73:0/1289904225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1781011f0 0x7fe178107aa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe17000b0d0 tx=0x7fe17000b3e0 comp rx=0 tx=0).stop 2023-08-10T11:50:57.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.053+0000 7fe17f65a700 1 -- 172.21.15.73:0/1289904225 shutdown_connections 2023-08-10T11:50:57.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.053+0000 7fe17f65a700 1 --2- 172.21.15.73:0/1289904225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1780ff660 0x7fe1780ffa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:57.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.053+0000 7fe17f65a700 1 --2- 172.21.15.73:0/1289904225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1781011f0 0x7fe178107aa0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:57.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.053+0000 7fe17f65a700 1 --2- 172.21.15.73:0/1289904225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe178100850 0x7fe178100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:57.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.053+0000 7fe17f65a700 1 -- 172.21.15.73:0/1289904225 >> 172.21.15.73:0/1289904225 conn(0x7fe1780fabd0 msgr2=0x7fe1780fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:57.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.054+0000 7fe17f65a700 1 -- 172.21.15.73:0/1289904225 shutdown_connections 2023-08-10T11:50:57.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.054+0000 7fe17f65a700 1 -- 172.21.15.73:0/1289904225 wait complete. 2023-08-10T11:50:57.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.054+0000 7fe17f65a700 1 Processor -- start 2023-08-10T11:50:57.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.054+0000 7fe17f65a700 1 -- start start 2023-08-10T11:50:57.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.054+0000 7fe17f65a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1780ff660 0x7fe178068440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:57.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.054+0000 7fe17f65a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe178100850 0x7fe17819b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:57.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.054+0000 7fe17f65a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1781011f0 0x7fe17819d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:57.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.054+0000 7fe17f65a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17819e060 con 0x7fe1781011f0 2023-08-10T11:50:57.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.054+0000 7fe17f65a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17819e1d0 con 0x7fe178100850 2023-08-10T11:50:57.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.054+0000 7fe17f65a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17819e390 con 0x7fe1780ff660 2023-08-10T11:50:57.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.054+0000 7fe17dbf7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1781011f0 0x7fe17819d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:57.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.054+0000 7fe17dbf7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1781011f0 0x7fe17819d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58960/0 (socket says 172.21.15.73:58960) 2023-08-10T11:50:57.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.054+0000 7fe17dbf7700 1 -- 172.21.15.73:0/4194862623 learned_addr learned my addr 172.21.15.73:0/4194862623 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:57.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.055+0000 7fe17cbf5700 1 --2- 172.21.15.73:0/4194862623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe178100850 0x7fe17819b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:57.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.055+0000 7fe17d3f6700 1 --2- 172.21.15.73:0/4194862623 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1780ff660 0x7fe178068440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:57.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.055+0000 7fe17dbf7700 1 -- 172.21.15.73:0/4194862623 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1780ff660 msgr2=0x7fe178068440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:57.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.055+0000 7fe17dbf7700 1 --2- 172.21.15.73:0/4194862623 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1780ff660 0x7fe178068440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:57.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.055+0000 7fe17dbf7700 1 -- 172.21.15.73:0/4194862623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe178100850 msgr2=0x7fe17819b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:57.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.055+0000 7fe17dbf7700 1 --2- 172.21.15.73:0/4194862623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe178100850 0x7fe17819b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:57.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.055+0000 7fe17dbf7700 1 -- 172.21.15.73:0/4194862623 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe170009d00 con 0x7fe1781011f0 2023-08-10T11:50:57.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.055+0000 7fe17dbf7700 1 --2- 172.21.15.73:0/4194862623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1781011f0 0x7fe17819d8c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe170007a00 tx=0x7fe1700094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:57.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.055+0000 7fe16e7fc700 1 -- 172.21.15.73:0/4194862623 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17000e040 con 0x7fe1781011f0 2023-08-10T11:50:57.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.055+0000 7fe16e7fc700 1 -- 172.21.15.73:0/4194862623 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe170003e10 con 0x7fe1781011f0 2023-08-10T11:50:57.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.055+0000 7fe17f65a700 1 -- 172.21.15.73:0/4194862623 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17819e610 con 0x7fe1781011f0 2023-08-10T11:50:57.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.055+0000 7fe16e7fc700 1 -- 172.21.15.73:0/4194862623 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe170012a90 con 0x7fe1781011f0 2023-08-10T11:50:57.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.055+0000 7fe17f65a700 1 -- 172.21.15.73:0/4194862623 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17819ea30 con 0x7fe1781011f0 2023-08-10T11:50:57.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.056+0000 7fe17f65a700 1 -- 172.21.15.73:0/4194862623 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe178106530 con 0x7fe1781011f0 2023-08-10T11:50:57.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.057+0000 7fe16e7fc700 1 -- 172.21.15.73:0/4194862623 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fe1700056c0 con 0x7fe1781011f0 2023-08-10T11:50:57.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.057+0000 7fe16e7fc700 1 --2- 172.21.15.73:0/4194862623 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fe1640a11d0 0x7fe1640a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:57.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.058+0000 7fe17d3f6700 1 --2- 172.21.15.73:0/4194862623 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fe1640a11d0 0x7fe1640a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:57.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.058+0000 7fe16e7fc700 1 -- 172.21.15.73:0/4194862623 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe1700ce6c0 con 0x7fe1781011f0 2023-08-10T11:50:57.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.058+0000 7fe17d3f6700 1 --2- 172.21.15.73:0/4194862623 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fe1640a11d0 0x7fe1640a3690 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe174005950 tx=0x7fe1740058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:57.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.061+0000 7fe16e7fc700 1 -- 172.21.15.73:0/4194862623 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fe170097f50 con 0x7fe1781011f0 2023-08-10T11:50:57.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:56 smithi152 ceph-mon[130220]: mds.? [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] up:active 2023-08-10T11:50:57.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:56 smithi152 ceph-mon[130220]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-10T11:50:57.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:56 smithi152 ceph-mon[130220]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-10T11:50:57.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:56 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3568057102' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-08-10T11:50:57.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:56 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:57.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:56 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:57.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:56 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:57.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:56 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:57.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:56 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:57.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:56 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:57.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:56 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:57.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:56 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:50:57.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:56 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:57.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:56 smithi156 ceph-mon[130574]: mds.? [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] up:active 2023-08-10T11:50:57.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:56 smithi156 ceph-mon[130574]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-10T11:50:57.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:56 smithi156 ceph-mon[130574]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-10T11:50:57.258 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:56 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3568057102' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-08-10T11:50:57.258 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:56 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:57.258 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:56 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:57.258 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:56 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:57.258 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:56 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:57.259 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:56 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:57.259 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:56 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:57.259 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:56 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:57.259 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:56 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:50:57.259 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:56 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:57.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:56 smithi073 ceph-mon[128869]: mds.? [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] up:active 2023-08-10T11:50:57.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:56 smithi073 ceph-mon[128869]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-10T11:50:57.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:56 smithi073 ceph-mon[128869]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-10T11:50:57.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:56 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3568057102' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-08-10T11:50:57.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:56 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:57.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:56 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:57.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:56 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:57.270 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:56 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:57.270 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:56 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:57.270 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:56 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:57.270 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:56 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:50:57.270 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:56 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:50:57.270 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:56 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:50:57.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.292+0000 7fe17f65a700 1 -- 172.21.15.73:0/4194862623 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7fe17810b100 con 0x7fe1781011f0 2023-08-10T11:50:57.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.914+0000 7fe16e7fc700 1 -- 172.21.15.73:0/4194862623 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7fe17009b570 con 0x7fe1781011f0 2023-08-10T11:50:57.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.918+0000 7fe17f65a700 1 -- 172.21.15.73:0/4194862623 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fe1640a11d0 msgr2=0x7fe1640a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:57.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.918+0000 7fe17f65a700 1 --2- 172.21.15.73:0/4194862623 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fe1640a11d0 0x7fe1640a3690 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe174005950 tx=0x7fe1740058e0 comp rx=0 tx=0).stop 2023-08-10T11:50:57.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.918+0000 7fe17f65a700 1 -- 172.21.15.73:0/4194862623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1781011f0 msgr2=0x7fe17819d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:57.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.918+0000 7fe17f65a700 1 --2- 172.21.15.73:0/4194862623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1781011f0 0x7fe17819d8c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe170007a00 tx=0x7fe1700094c0 comp rx=0 tx=0).stop 2023-08-10T11:50:57.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.918+0000 7fe17f65a700 1 -- 172.21.15.73:0/4194862623 shutdown_connections 2023-08-10T11:50:57.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.918+0000 7fe17f65a700 1 --2- 172.21.15.73:0/4194862623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1781011f0 0x7fe17819d8c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:57.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.918+0000 7fe17f65a700 1 --2- 172.21.15.73:0/4194862623 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1780ff660 0x7fe178068440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:57.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.918+0000 7fe17f65a700 1 --2- 172.21.15.73:0/4194862623 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fe1640a11d0 0x7fe1640a3690 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:57.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.918+0000 7fe17f65a700 1 --2- 172.21.15.73:0/4194862623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe178100850 0x7fe17819b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:57.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.918+0000 7fe17f65a700 1 -- 172.21.15.73:0/4194862623 >> 172.21.15.73:0/4194862623 conn(0x7fe1780fabd0 msgr2=0x7fe1780fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:57.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.918+0000 7fe17f65a700 1 -- 172.21.15.73:0/4194862623 shutdown_connections 2023-08-10T11:50:57.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:57.918+0000 7fe17f65a700 1 -- 172.21.15.73:0/4194862623 wait complete. 2023-08-10T11:50:57.936 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-08-10T11:50:58.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.062+0000 7fcd63e85700 1 -- 172.21.15.73:0/2778133216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd5c0fe7a0 msgr2=0x7fcd5c0fec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:58.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.062+0000 7fcd63e85700 1 --2- 172.21.15.73:0/2778133216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd5c0fe7a0 0x7fcd5c0fec00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcd580099c0 tx=0x7fcd58009cd0 comp rx=0 tx=0).stop 2023-08-10T11:50:58.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.062+0000 7fcd63e85700 1 -- 172.21.15.73:0/2778133216 shutdown_connections 2023-08-10T11:50:58.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.062+0000 7fcd63e85700 1 --2- 172.21.15.73:0/2778133216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd5c101d30 0x7fcd5c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:58.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.062+0000 7fcd63e85700 1 --2- 172.21.15.73:0/2778133216 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd5c0ff140 0x7fcd5c108d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:58.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.062+0000 7fcd63e85700 1 --2- 172.21.15.73:0/2778133216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd5c0fe7a0 0x7fcd5c0fec00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:58.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.062+0000 7fcd63e85700 1 -- 172.21.15.73:0/2778133216 >> 172.21.15.73:0/2778133216 conn(0x7fcd5c0fa340 msgr2=0x7fcd5c0fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:58.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.062+0000 7fcd63e85700 1 -- 172.21.15.73:0/2778133216 shutdown_connections 2023-08-10T11:50:58.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.062+0000 7fcd63e85700 1 -- 172.21.15.73:0/2778133216 wait complete. 2023-08-10T11:50:58.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.062+0000 7fcd63e85700 1 Processor -- start 2023-08-10T11:50:58.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.062+0000 7fcd63e85700 1 -- start start 2023-08-10T11:50:58.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.063+0000 7fcd63e85700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd5c0fe7a0 0x7fcd5c196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:58.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.063+0000 7fcd63e85700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd5c0ff140 0x7fcd5c1969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:58.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.063+0000 7fcd63e85700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd5c101d30 0x7fcd5c19da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:58.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.063+0000 7fcd63e85700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c19e000 con 0x7fcd5c0ff140 2023-08-10T11:50:58.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.063+0000 7fcd63e85700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c19e140 con 0x7fcd5c101d30 2023-08-10T11:50:58.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.063+0000 7fcd63e85700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c19e2d0 con 0x7fcd5c0fe7a0 2023-08-10T11:50:58.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.063+0000 7fcd61420700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd5c0ff140 0x7fcd5c1969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:58.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.063+0000 7fcd61420700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd5c0ff140 0x7fcd5c1969c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58972/0 (socket says 172.21.15.73:58972) 2023-08-10T11:50:58.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.063+0000 7fcd61420700 1 -- 172.21.15.73:0/804581518 learned_addr learned my addr 172.21.15.73:0/804581518 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:58.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.063+0000 7fcd61c21700 1 --2- 172.21.15.73:0/804581518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd5c0fe7a0 0x7fcd5c196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:58.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.063+0000 7fcd62422700 1 --2- 172.21.15.73:0/804581518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd5c101d30 0x7fcd5c19da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:58.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.063+0000 7fcd61420700 1 -- 172.21.15.73:0/804581518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd5c0fe7a0 msgr2=0x7fcd5c196480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:58.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.063+0000 7fcd61420700 1 --2- 172.21.15.73:0/804581518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd5c0fe7a0 0x7fcd5c196480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:58.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.063+0000 7fcd61420700 1 -- 172.21.15.73:0/804581518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd5c101d30 msgr2=0x7fcd5c19da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:58.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.063+0000 7fcd61420700 1 --2- 172.21.15.73:0/804581518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd5c101d30 0x7fcd5c19da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:58.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.063+0000 7fcd61420700 1 -- 172.21.15.73:0/804581518 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd580095f0 con 0x7fcd5c0ff140 2023-08-10T11:50:58.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.063+0000 7fcd61420700 1 --2- 172.21.15.73:0/804581518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd5c0ff140 0x7fcd5c1969c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800c010 tx=0x7fcd58009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:58.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.063+0000 7fcd52ffd700 1 -- 172.21.15.73:0/804581518 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5801d070 con 0x7fcd5c0ff140 2023-08-10T11:50:58.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.063+0000 7fcd63e85700 1 -- 172.21.15.73:0/804581518 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5c19e550 con 0x7fcd5c0ff140 2023-08-10T11:50:58.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.063+0000 7fcd52ffd700 1 -- 172.21.15.73:0/804581518 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd58004110 con 0x7fcd5c0ff140 2023-08-10T11:50:58.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.063+0000 7fcd52ffd700 1 -- 172.21.15.73:0/804581518 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58005360 con 0x7fcd5c0ff140 2023-08-10T11:50:58.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.063+0000 7fcd63e85700 1 -- 172.21.15.73:0/804581518 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5c19e910 con 0x7fcd5c0ff140 2023-08-10T11:50:58.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.064+0000 7fcd63e85700 1 -- 172.21.15.73:0/804581518 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5c107880 con 0x7fcd5c0ff140 2023-08-10T11:50:58.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.065+0000 7fcd52ffd700 1 -- 172.21.15.73:0/804581518 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fcd58004a10 con 0x7fcd5c0ff140 2023-08-10T11:50:58.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.066+0000 7fcd52ffd700 1 --2- 172.21.15.73:0/804581518 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fcd480a1150 0x7fcd480a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:58.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.066+0000 7fcd61c21700 1 --2- 172.21.15.73:0/804581518 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fcd480a1150 0x7fcd480a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:58.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.066+0000 7fcd52ffd700 1 -- 172.21.15.73:0/804581518 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fcd580cd5d0 con 0x7fcd5c0ff140 2023-08-10T11:50:58.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.066+0000 7fcd61c21700 1 --2- 172.21.15.73:0/804581518 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fcd480a1150 0x7fcd480a3610 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c005950 tx=0x7fcd4c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:58.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.070+0000 7fcd52ffd700 1 -- 172.21.15.73:0/804581518 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fcd58096f00 con 0x7fcd5c0ff140 2023-08-10T11:50:58.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:57 smithi152 ceph-mon[130220]: pgmap v257: 97 pgs: 23 creating+peering, 46 active+clean, 28 unknown; 578 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 2 op/s 2023-08-10T11:50:58.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:57 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3568057102' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-08-10T11:50:58.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:57 smithi152 ceph-mon[130220]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-10T11:50:58.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:57 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/4194862623' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-08-10T11:50:58.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:57 smithi156 ceph-mon[130574]: pgmap v257: 97 pgs: 23 creating+peering, 46 active+clean, 28 unknown; 578 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 2 op/s 2023-08-10T11:50:58.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:57 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3568057102' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-08-10T11:50:58.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:57 smithi156 ceph-mon[130574]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-10T11:50:58.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:57 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/4194862623' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-08-10T11:50:58.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:57 smithi073 ceph-mon[128869]: pgmap v257: 97 pgs: 23 creating+peering, 46 active+clean, 28 unknown; 578 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 2 op/s 2023-08-10T11:50:58.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:57 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3568057102' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-08-10T11:50:58.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:57 smithi073 ceph-mon[128869]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-10T11:50:58.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:57 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/4194862623' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-08-10T11:50:58.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.302+0000 7fcd63e85700 1 -- 172.21.15.73:0/804581518 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fcd5c02c970 con 0x7fcd5c0ff140 2023-08-10T11:50:58.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.493+0000 7fcd52ffd700 1 -- 172.21.15.73:0/804581518 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7fcd580163a0 con 0x7fcd5c0ff140 2023-08-10T11:50:58.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.495+0000 7fcd63e85700 1 -- 172.21.15.73:0/804581518 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fcd480a1150 msgr2=0x7fcd480a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:58.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.495+0000 7fcd63e85700 1 --2- 172.21.15.73:0/804581518 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fcd480a1150 0x7fcd480a3610 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c005950 tx=0x7fcd4c0058e0 comp rx=0 tx=0).stop 2023-08-10T11:50:58.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.495+0000 7fcd63e85700 1 -- 172.21.15.73:0/804581518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd5c0ff140 msgr2=0x7fcd5c1969c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:58.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.495+0000 7fcd63e85700 1 --2- 172.21.15.73:0/804581518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd5c0ff140 0x7fcd5c1969c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800c010 tx=0x7fcd58009580 comp rx=0 tx=0).stop 2023-08-10T11:50:58.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.495+0000 7fcd63e85700 1 -- 172.21.15.73:0/804581518 shutdown_connections 2023-08-10T11:50:58.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.495+0000 7fcd63e85700 1 --2- 172.21.15.73:0/804581518 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fcd480a1150 0x7fcd480a3610 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:58.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.495+0000 7fcd63e85700 1 --2- 172.21.15.73:0/804581518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd5c101d30 0x7fcd5c19da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:58.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.495+0000 7fcd63e85700 1 --2- 172.21.15.73:0/804581518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd5c0fe7a0 0x7fcd5c196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:58.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.495+0000 7fcd63e85700 1 --2- 172.21.15.73:0/804581518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd5c0ff140 0x7fcd5c1969c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:58.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.495+0000 7fcd63e85700 1 -- 172.21.15.73:0/804581518 >> 172.21.15.73:0/804581518 conn(0x7fcd5c0fa340 msgr2=0x7fcd5c0fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:58.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.495+0000 7fcd63e85700 1 -- 172.21.15.73:0/804581518 shutdown_connections 2023-08-10T11:50:58.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.495+0000 7fcd63e85700 1 -- 172.21.15.73:0/804581518 wait complete. 2023-08-10T11:50:58.512 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-08-10T11:50:58.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.634+0000 7f275cdd3700 1 -- 172.21.15.73:0/295235164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27580ff8b0 msgr2=0x7f27580ffd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:58.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.634+0000 7f275cdd3700 1 --2- 172.21.15.73:0/295235164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27580ff8b0 0x7f27580ffd30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2748009990 tx=0x7f2748009ca0 comp rx=0 tx=0).stop 2023-08-10T11:50:58.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.634+0000 7f275cdd3700 1 -- 172.21.15.73:0/295235164 shutdown_connections 2023-08-10T11:50:58.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.634+0000 7f275cdd3700 1 --2- 172.21.15.73:0/295235164 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2758100270 0x7f2758107b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:58.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.634+0000 7f275cdd3700 1 --2- 172.21.15.73:0/295235164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2758100c60 0x7f2758101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:58.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.634+0000 7f275cdd3700 1 --2- 172.21.15.73:0/295235164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27580ff8b0 0x7f27580ffd30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:58.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.634+0000 7f275cdd3700 1 -- 172.21.15.73:0/295235164 >> 172.21.15.73:0/295235164 conn(0x7f27580fa340 msgr2=0x7f27580fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:58.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.634+0000 7f275cdd3700 1 -- 172.21.15.73:0/295235164 shutdown_connections 2023-08-10T11:50:58.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.634+0000 7f275cdd3700 1 -- 172.21.15.73:0/295235164 wait complete. 2023-08-10T11:50:58.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.635+0000 7f275cdd3700 1 Processor -- start 2023-08-10T11:50:58.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.635+0000 7f275cdd3700 1 -- start start 2023-08-10T11:50:58.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.635+0000 7f275cdd3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27580ff8b0 0x7f27580ff310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:58.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.635+0000 7f275cdd3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2758100270 0x7f275819d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:58.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.635+0000 7f275cdd3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2758100c60 0x7f275819fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:58.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.635+0000 7f275cdd3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27581a01d0 con 0x7f2758100c60 2023-08-10T11:50:58.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.635+0000 7f275cdd3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27581a0340 con 0x7f27580ff8b0 2023-08-10T11:50:58.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.635+0000 7f275cdd3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27581a0500 con 0x7f2758100270 2023-08-10T11:50:58.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.635+0000 7f2756d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2758100c60 0x7f275819fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:58.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.635+0000 7f2756d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2758100c60 0x7f275819fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58988/0 (socket says 172.21.15.73:58988) 2023-08-10T11:50:58.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.635+0000 7f2756d9d700 1 -- 172.21.15.73:0/3616129551 learned_addr learned my addr 172.21.15.73:0/3616129551 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:58.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.635+0000 7f275659c700 1 --2- 172.21.15.73:0/3616129551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27580ff8b0 0x7f27580ff310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:58.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.635+0000 7f2755d9b700 1 --2- 172.21.15.73:0/3616129551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2758100270 0x7f275819d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:58.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.635+0000 7f2756d9d700 1 -- 172.21.15.73:0/3616129551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2758100270 msgr2=0x7f275819d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:58.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.635+0000 7f2756d9d700 1 --2- 172.21.15.73:0/3616129551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2758100270 0x7f275819d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:58.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.635+0000 7f2756d9d700 1 -- 172.21.15.73:0/3616129551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27580ff8b0 msgr2=0x7f27580ff310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:58.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.635+0000 7f2756d9d700 1 --2- 172.21.15.73:0/3616129551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27580ff8b0 0x7f27580ff310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:58.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.635+0000 7f2756d9d700 1 -- 172.21.15.73:0/3616129551 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27480095f0 con 0x7f2758100c60 2023-08-10T11:50:58.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.635+0000 7f2755d9b700 1 --2- 172.21.15.73:0/3616129551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2758100270 0x7f275819d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:50:58.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.636+0000 7f2756d9d700 1 --2- 172.21.15.73:0/3616129551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2758100c60 0x7f275819fb20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2750007ee0 tx=0x7f275000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:58.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.636+0000 7f27477fe700 1 -- 172.21.15.73:0/3616129551 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275000ddd0 con 0x7f2758100c60 2023-08-10T11:50:58.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.636+0000 7f27477fe700 1 -- 172.21.15.73:0/3616129551 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f275000f040 con 0x7f2758100c60 2023-08-10T11:50:58.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.636+0000 7f27477fe700 1 -- 172.21.15.73:0/3616129551 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750015400 con 0x7f2758100c60 2023-08-10T11:50:58.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.636+0000 7f275cdd3700 1 -- 172.21.15.73:0/3616129551 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27581a07e0 con 0x7f2758100c60 2023-08-10T11:50:58.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.636+0000 7f275cdd3700 1 -- 172.21.15.73:0/3616129551 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27581a0ca0 con 0x7f2758100c60 2023-08-10T11:50:58.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.637+0000 7f275cdd3700 1 -- 172.21.15.73:0/3616129551 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2758106cb0 con 0x7f2758100c60 2023-08-10T11:50:58.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.638+0000 7f27477fe700 1 -- 172.21.15.73:0/3616129551 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f2750004020 con 0x7f2758100c60 2023-08-10T11:50:58.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.638+0000 7f27477fe700 1 --2- 172.21.15.73:0/3616129551 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f27400a1150 0x7f27400a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:58.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.638+0000 7f275659c700 1 --2- 172.21.15.73:0/3616129551 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f27400a1150 0x7f27400a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:58.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.638+0000 7f27477fe700 1 -- 172.21.15.73:0/3616129551 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f27500cc1d0 con 0x7f2758100c60 2023-08-10T11:50:58.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.639+0000 7f275659c700 1 --2- 172.21.15.73:0/3616129551 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f27400a1150 0x7f27400a3610 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f274c005950 tx=0x7f274c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:58.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.643+0000 7f27477fe700 1 -- 172.21.15.73:0/3616129551 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f275004e790 con 0x7f2758100c60 2023-08-10T11:50:58.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:58.878+0000 7f275cdd3700 1 -- 172.21.15.73:0/3616129551 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f275802c970 con 0x7f2758100c60 2023-08-10T11:50:59.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:58 smithi152 ceph-mon[130220]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-08-10T11:50:59.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:58 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/4194862623' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-08-10T11:50:59.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:58 smithi152 ceph-mon[130220]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-08-10T11:50:59.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:58 smithi152 ceph-mon[130220]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-10T11:50:59.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:58 smithi152 ceph-mon[130220]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2023-08-10T11:50:59.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:58 smithi152 ceph-mon[130220]: daemon mds.h is now active in filesystem cephfs as rank 1 2023-08-10T11:50:59.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:58 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/804581518' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-08-10T11:50:59.248 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:58 smithi152 ceph-mon[130220]: pgmap v258: 97 pgs: 17 creating+peering, 80 active+clean; 578 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 8 op/s 2023-08-10T11:50:59.248 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:58 smithi152 ceph-mon[130220]: mds.? [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] up:active 2023-08-10T11:50:59.248 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:58 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/804581518' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-08-10T11:50:59.249 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:58 smithi152 ceph-mon[130220]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-08-10T11:50:59.249 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:58 smithi152 ceph-mon[130220]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 2 up:standby-replay 8 up:standby 2023-08-10T11:50:59.249 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:58 smithi152 ceph-mon[130220]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:creating} 2 up:standby-replay 7 up:standby 2023-08-10T11:50:59.250 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:58 smithi152 ceph-mon[130220]: daemon mds.f is now active in filesystem cephfs as rank 2 2023-08-10T11:50:59.250 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:50:58 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3616129551' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-08-10T11:50:59.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:58 smithi156 ceph-mon[130574]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-08-10T11:50:59.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:58 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/4194862623' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-08-10T11:50:59.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:58 smithi156 ceph-mon[130574]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-08-10T11:50:59.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:58 smithi156 ceph-mon[130574]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-10T11:50:59.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:58 smithi156 ceph-mon[130574]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2023-08-10T11:50:59.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:58 smithi156 ceph-mon[130574]: daemon mds.h is now active in filesystem cephfs as rank 1 2023-08-10T11:50:59.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:58 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/804581518' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-08-10T11:50:59.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:58 smithi156 ceph-mon[130574]: pgmap v258: 97 pgs: 17 creating+peering, 80 active+clean; 578 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 8 op/s 2023-08-10T11:50:59.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:58 smithi156 ceph-mon[130574]: mds.? [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] up:active 2023-08-10T11:50:59.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:58 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/804581518' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-08-10T11:50:59.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:58 smithi156 ceph-mon[130574]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-08-10T11:50:59.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:58 smithi156 ceph-mon[130574]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 2 up:standby-replay 8 up:standby 2023-08-10T11:50:59.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:58 smithi156 ceph-mon[130574]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:creating} 2 up:standby-replay 7 up:standby 2023-08-10T11:50:59.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:58 smithi156 ceph-mon[130574]: daemon mds.f is now active in filesystem cephfs as rank 2 2023-08-10T11:50:59.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:50:58 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3616129551' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-08-10T11:50:59.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:58 smithi073 ceph-mon[128869]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-08-10T11:50:59.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:58 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/4194862623' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-08-10T11:50:59.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:58 smithi073 ceph-mon[128869]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-08-10T11:50:59.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:58 smithi073 ceph-mon[128869]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-10T11:50:59.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:58 smithi073 ceph-mon[128869]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2023-08-10T11:50:59.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:58 smithi073 ceph-mon[128869]: daemon mds.h is now active in filesystem cephfs as rank 1 2023-08-10T11:50:59.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:58 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/804581518' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-08-10T11:50:59.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:58 smithi073 ceph-mon[128869]: pgmap v258: 97 pgs: 17 creating+peering, 80 active+clean; 578 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 8 op/s 2023-08-10T11:50:59.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:58 smithi073 ceph-mon[128869]: mds.? [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] up:active 2023-08-10T11:50:59.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:58 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/804581518' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-08-10T11:50:59.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:58 smithi073 ceph-mon[128869]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-08-10T11:50:59.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:58 smithi073 ceph-mon[128869]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 2 up:standby-replay 8 up:standby 2023-08-10T11:50:59.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:58 smithi073 ceph-mon[128869]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:creating} 2 up:standby-replay 7 up:standby 2023-08-10T11:50:59.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:58 smithi073 ceph-mon[128869]: daemon mds.f is now active in filesystem cephfs as rank 2 2023-08-10T11:50:59.270 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:50:58 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3616129551' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-08-10T11:50:59.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.501+0000 7f27477fe700 1 -- 172.21.15.73:0/3616129551 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v22) v1 ==== 115+0+0 (secure 0 0 0) 0x7f2750095a70 con 0x7f2758100c60 2023-08-10T11:50:59.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.505+0000 7f275cdd3700 1 -- 172.21.15.73:0/3616129551 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f27400a1150 msgr2=0x7f27400a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:59.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.505+0000 7f275cdd3700 1 --2- 172.21.15.73:0/3616129551 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f27400a1150 0x7f27400a3610 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f274c005950 tx=0x7f274c0058e0 comp rx=0 tx=0).stop 2023-08-10T11:50:59.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.505+0000 7f275cdd3700 1 -- 172.21.15.73:0/3616129551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2758100c60 msgr2=0x7f275819fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:59.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.505+0000 7f275cdd3700 1 --2- 172.21.15.73:0/3616129551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2758100c60 0x7f275819fb20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2750007ee0 tx=0x7f275000d3b0 comp rx=0 tx=0).stop 2023-08-10T11:50:59.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.505+0000 7f275cdd3700 1 -- 172.21.15.73:0/3616129551 shutdown_connections 2023-08-10T11:50:59.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.505+0000 7f275cdd3700 1 --2- 172.21.15.73:0/3616129551 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f27400a1150 0x7f27400a3610 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:59.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.505+0000 7f275cdd3700 1 --2- 172.21.15.73:0/3616129551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27580ff8b0 0x7f27580ff310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:59.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.505+0000 7f275cdd3700 1 --2- 172.21.15.73:0/3616129551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2758100c60 0x7f275819fb20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:59.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.505+0000 7f275cdd3700 1 --2- 172.21.15.73:0/3616129551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2758100270 0x7f275819d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:59.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.505+0000 7f275cdd3700 1 -- 172.21.15.73:0/3616129551 >> 172.21.15.73:0/3616129551 conn(0x7f27580fa340 msgr2=0x7f2758103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:59.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.505+0000 7f275cdd3700 1 -- 172.21.15.73:0/3616129551 shutdown_connections 2023-08-10T11:50:59.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.505+0000 7f275cdd3700 1 -- 172.21.15.73:0/3616129551 wait complete. 2023-08-10T11:50:59.525 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2023-08-10T11:50:59.525 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-08-10T11:50:59.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.655+0000 7f4120fd6700 1 -- 172.21.15.73:0/359793913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f411c1019e0 msgr2=0x7f411c101e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:59.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.655+0000 7f4120fd6700 1 --2- 172.21.15.73:0/359793913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f411c1019e0 0x7f411c101e40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4110009990 tx=0x7f4110009ca0 comp rx=0 tx=0).stop 2023-08-10T11:50:59.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.655+0000 7f4120fd6700 1 -- 172.21.15.73:0/359793913 shutdown_connections 2023-08-10T11:50:59.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.655+0000 7f4120fd6700 1 --2- 172.21.15.73:0/359793913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f411c0fea10 0x7f411c0fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:59.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.655+0000 7f4120fd6700 1 --2- 172.21.15.73:0/359793913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f411c102380 0x7f411c108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:59.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.655+0000 7f4120fd6700 1 --2- 172.21.15.73:0/359793913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f411c1019e0 0x7f411c101e40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:59.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.655+0000 7f4120fd6700 1 -- 172.21.15.73:0/359793913 >> 172.21.15.73:0/359793913 conn(0x7f411c0fa340 msgr2=0x7f411c0fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:50:59.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.655+0000 7f4120fd6700 1 -- 172.21.15.73:0/359793913 shutdown_connections 2023-08-10T11:50:59.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.655+0000 7f4120fd6700 1 -- 172.21.15.73:0/359793913 wait complete. 2023-08-10T11:50:59.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.656+0000 7f4120fd6700 1 Processor -- start 2023-08-10T11:50:59.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.656+0000 7f4120fd6700 1 -- start start 2023-08-10T11:50:59.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.656+0000 7f4120fd6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f411c0fea10 0x7f411c101350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:59.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.656+0000 7f4120fd6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f411c1019e0 0x7f411c0ff990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:59.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.656+0000 7f4120fd6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f411c102380 0x7f411c0ffed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:59.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.656+0000 7f4120fd6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c100670 con 0x7f411c0fea10 2023-08-10T11:50:59.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.656+0000 7f4120fd6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c1007e0 con 0x7f411c102380 2023-08-10T11:50:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.656+0000 7f4120fd6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c1a0540 con 0x7f411c1019e0 2023-08-10T11:50:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.656+0000 7f411a59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f411c0fea10 0x7f411c101350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.656+0000 7f411a59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f411c0fea10 0x7f411c101350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58996/0 (socket says 172.21.15.73:58996) 2023-08-10T11:50:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.656+0000 7f411a59c700 1 -- 172.21.15.73:0/48414644 learned_addr learned my addr 172.21.15.73:0/48414644 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:50:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.657+0000 7f411ad9d700 1 --2- 172.21.15.73:0/48414644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f411c102380 0x7f411c0ffed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:59.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.657+0000 7f411a59c700 1 -- 172.21.15.73:0/48414644 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f411c1019e0 msgr2=0x7f411c0ff990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:59.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.657+0000 7f411a59c700 1 --2- 172.21.15.73:0/48414644 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f411c1019e0 0x7f411c0ff990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:59.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.657+0000 7f411a59c700 1 -- 172.21.15.73:0/48414644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f411c102380 msgr2=0x7f411c0ffed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:50:59.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.657+0000 7f411a59c700 1 --2- 172.21.15.73:0/48414644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f411c102380 0x7f411c0ffed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:50:59.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.657+0000 7f411a59c700 1 -- 172.21.15.73:0/48414644 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41100095f0 con 0x7f411c0fea10 2023-08-10T11:50:59.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.657+0000 7f411ad9d700 1 --2- 172.21.15.73:0/48414644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f411c102380 0x7f411c0ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:50:59.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.657+0000 7f411a59c700 1 --2- 172.21.15.73:0/48414644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f411c0fea10 0x7f411c101350 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f410c00c970 tx=0x7f410c00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:59.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.657+0000 7f410b7fe700 1 -- 172.21.15.73:0/48414644 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410c004220 con 0x7f411c0fea10 2023-08-10T11:50:59.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.657+0000 7f4120fd6700 1 -- 172.21.15.73:0/48414644 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f411c1a0820 con 0x7f411c0fea10 2023-08-10T11:50:59.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.657+0000 7f410b7fe700 1 -- 172.21.15.73:0/48414644 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f410c007d60 con 0x7f411c0fea10 2023-08-10T11:50:59.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.657+0000 7f410b7fe700 1 -- 172.21.15.73:0/48414644 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410c003d00 con 0x7f411c0fea10 2023-08-10T11:50:59.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.657+0000 7f4120fd6700 1 -- 172.21.15.73:0/48414644 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f411c1a0d80 con 0x7f411c0fea10 2023-08-10T11:50:59.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.658+0000 7f4120fd6700 1 -- 172.21.15.73:0/48414644 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f411c107dd0 con 0x7f411c0fea10 2023-08-10T11:50:59.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.659+0000 7f410b7fe700 1 -- 172.21.15.73:0/48414644 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f410c004380 con 0x7f411c0fea10 2023-08-10T11:50:59.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.660+0000 7f410b7fe700 1 --2- 172.21.15.73:0/48414644 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f41040a1150 0x7f41040a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:50:59.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.660+0000 7f4119d9b700 1 --2- 172.21.15.73:0/48414644 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f41040a1150 0x7f41040a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:50:59.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.660+0000 7f410b7fe700 1 -- 172.21.15.73:0/48414644 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f410c0cc7a0 con 0x7f411c0fea10 2023-08-10T11:50:59.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.660+0000 7f4119d9b700 1 --2- 172.21.15.73:0/48414644 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f41040a1150 0x7f41040a3610 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f41100095c0 tx=0x7f4110009530 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:50:59.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.663+0000 7f410b7fe700 1 -- 172.21.15.73:0/48414644 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f410c096040 con 0x7f411c0fea10 2023-08-10T11:50:59.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:50:59.883+0000 7f4120fd6700 1 -- 172.21.15.73:0/48414644 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f411c060bb0 con 0x7f41040a1150 2023-08-10T11:51:00.245 INFO:journalctl@ceph.mds.b.smithi152.stdout:Aug 10 11:50:59 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-b[155632]: 2023-08-10T11:50:59.869+0000 7fe10716b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-10T11:51:00.245 INFO:journalctl@ceph.mds.b.smithi152.stdout:Aug 10 11:50:59 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-b[155632]: 2023-08-10T11:50:59.869+0000 7fe10716b700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-08-10T11:51:00.246 INFO:journalctl@ceph.mds.b.smithi152.stdout:Aug 10 11:50:59 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-b[155632]: 2023-08-10T11:50:59.869+0000 7fe10716b700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2023-08-10T11:51:00.267 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:50:59 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:50:59.887+0000 7fc83931d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T11:51:00.267 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:50:59 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:50:59.887+0000 7fc83931d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T11:51:00.268 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:50:59 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:50:59.887+0000 7fc83931d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T11:51:00.268 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:50:59 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:50:59.887+0000 7fc83931d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T11:51:00.268 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:50:59 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:50:59.887+0000 7fc83931d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T11:51:00.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.550+0000 7f410b7fe700 1 -- 172.21.15.73:0/48414644 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f411c060bb0 con 0x7f41040a1150 2023-08-10T11:51:00.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.553+0000 7f4120fd6700 1 -- 172.21.15.73:0/48414644 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f41040a1150 msgr2=0x7f41040a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:00.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.553+0000 7f4120fd6700 1 --2- 172.21.15.73:0/48414644 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f41040a1150 0x7f41040a3610 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f41100095c0 tx=0x7f4110009530 comp rx=0 tx=0).stop 2023-08-10T11:51:00.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.553+0000 7f4120fd6700 1 -- 172.21.15.73:0/48414644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f411c0fea10 msgr2=0x7f411c101350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:00.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.553+0000 7f4120fd6700 1 --2- 172.21.15.73:0/48414644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f411c0fea10 0x7f411c101350 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f410c00c970 tx=0x7f410c00cd30 comp rx=0 tx=0).stop 2023-08-10T11:51:00.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.553+0000 7f4120fd6700 1 -- 172.21.15.73:0/48414644 shutdown_connections 2023-08-10T11:51:00.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.553+0000 7f4120fd6700 1 --2- 172.21.15.73:0/48414644 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f41040a1150 0x7f41040a3610 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:00.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.553+0000 7f4120fd6700 1 --2- 172.21.15.73:0/48414644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f411c102380 0x7f411c0ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:00.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.553+0000 7f4120fd6700 1 --2- 172.21.15.73:0/48414644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f411c0fea10 0x7f411c101350 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:00.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.553+0000 7f4120fd6700 1 --2- 172.21.15.73:0/48414644 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f411c1019e0 0x7f411c0ff990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:00.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.553+0000 7f4120fd6700 1 -- 172.21.15.73:0/48414644 >> 172.21.15.73:0/48414644 conn(0x7f411c0fa340 msgr2=0x7f411c104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:00.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.553+0000 7f4120fd6700 1 -- 172.21.15.73:0/48414644 shutdown_connections 2023-08-10T11:51:00.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.553+0000 7f4120fd6700 1 -- 172.21.15.73:0/48414644 wait complete. 2023-08-10T11:51:00.567 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-08-10T11:51:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.693+0000 7f66a05e5700 1 -- 172.21.15.73:0/320085283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6698103ba0 msgr2=0x7f6698105f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:00.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.693+0000 7f66a05e5700 1 --2- 172.21.15.73:0/320085283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6698103ba0 0x7f6698105f90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6688009990 tx=0x7f6688009ca0 comp rx=0 tx=0).stop 2023-08-10T11:51:00.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.694+0000 7f66a05e5700 1 -- 172.21.15.73:0/320085283 shutdown_connections 2023-08-10T11:51:00.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.694+0000 7f66a05e5700 1 --2- 172.21.15.73:0/320085283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66981064d0 0x7f66981088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:00.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.694+0000 7f66a05e5700 1 --2- 172.21.15.73:0/320085283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6698101270 0x7f6698103660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:00.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.694+0000 7f66a05e5700 1 --2- 172.21.15.73:0/320085283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6698103ba0 0x7f6698105f90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:00.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.694+0000 7f66a05e5700 1 -- 172.21.15.73:0/320085283 >> 172.21.15.73:0/320085283 conn(0x7f66980fac00 msgr2=0x7f66980fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:00.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.694+0000 7f66a05e5700 1 -- 172.21.15.73:0/320085283 shutdown_connections 2023-08-10T11:51:00.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.694+0000 7f66a05e5700 1 -- 172.21.15.73:0/320085283 wait complete. 2023-08-10T11:51:00.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.694+0000 7f66a05e5700 1 Processor -- start 2023-08-10T11:51:00.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.694+0000 7f66a05e5700 1 -- start start 2023-08-10T11:51:00.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.694+0000 7f66a05e5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6698101270 0x7f66981964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:00.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.694+0000 7f66a05e5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6698103ba0 0x7f66981969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.694+0000 7f66a05e5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66981064d0 0x7f669819da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.694+0000 7f66a05e5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669819e030 con 0x7f66981064d0 2023-08-10T11:51:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.694+0000 7f66a05e5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669819e170 con 0x7f6698103ba0 2023-08-10T11:51:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.694+0000 7f66a05e5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669819e300 con 0x7f6698101270 2023-08-10T11:51:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.694+0000 7f669eb82700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66981064d0 0x7f669819da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.694+0000 7f669eb82700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66981064d0 0x7f669819da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59032/0 (socket says 172.21.15.73:59032) 2023-08-10T11:51:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.694+0000 7f669eb82700 1 -- 172.21.15.73:0/1268423021 learned_addr learned my addr 172.21.15.73:0/1268423021 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.694+0000 7f669e381700 1 --2- 172.21.15.73:0/1268423021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6698101270 0x7f66981964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.695+0000 7f669db80700 1 --2- 172.21.15.73:0/1268423021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6698103ba0 0x7f66981969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.695+0000 7f669eb82700 1 -- 172.21.15.73:0/1268423021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6698101270 msgr2=0x7f66981964b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.695+0000 7f669eb82700 1 --2- 172.21.15.73:0/1268423021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6698101270 0x7f66981964b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.695+0000 7f669eb82700 1 -- 172.21.15.73:0/1268423021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6698103ba0 msgr2=0x7f66981969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.695+0000 7f669eb82700 1 --2- 172.21.15.73:0/1268423021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6698103ba0 0x7f66981969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.695+0000 7f669eb82700 1 -- 172.21.15.73:0/1268423021 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66880095f0 con 0x7f66981064d0 2023-08-10T11:51:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.695+0000 7f669db80700 1 --2- 172.21.15.73:0/1268423021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6698103ba0 0x7f66981969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:51:00.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.695+0000 7f669eb82700 1 --2- 172.21.15.73:0/1268423021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66981064d0 0x7f669819da60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f669000ada0 tx=0x7f669000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:00.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.695+0000 7f668f7fe700 1 -- 172.21.15.73:0/1268423021 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669000f070 con 0x7f66981064d0 2023-08-10T11:51:00.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.695+0000 7f668f7fe700 1 -- 172.21.15.73:0/1268423021 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6690007b30 con 0x7f66981064d0 2023-08-10T11:51:00.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.695+0000 7f66a05e5700 1 -- 172.21.15.73:0/1268423021 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669819e5e0 con 0x7f66981064d0 2023-08-10T11:51:00.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.695+0000 7f668f7fe700 1 -- 172.21.15.73:0/1268423021 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66900053e0 con 0x7f66981064d0 2023-08-10T11:51:00.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.695+0000 7f66a05e5700 1 -- 172.21.15.73:0/1268423021 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669819eaa0 con 0x7f66981064d0 2023-08-10T11:51:00.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.696+0000 7f66a05e5700 1 -- 172.21.15.73:0/1268423021 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66980fc780 con 0x7f66981064d0 2023-08-10T11:51:00.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.697+0000 7f668f7fe700 1 -- 172.21.15.73:0/1268423021 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f669000c980 con 0x7f66981064d0 2023-08-10T11:51:00.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.698+0000 7f668f7fe700 1 --2- 172.21.15.73:0/1268423021 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f66840a11d0 0x7f66840a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:00.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.698+0000 7f669e381700 1 --2- 172.21.15.73:0/1268423021 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f66840a11d0 0x7f66840a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:00.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.698+0000 7f668f7fe700 1 -- 172.21.15.73:0/1268423021 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f66900cbdf0 con 0x7f66981064d0 2023-08-10T11:51:00.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.698+0000 7f669e381700 1 --2- 172.21.15.73:0/1268423021 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f66840a11d0 0x7f66840a3690 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6694007c60 tx=0x7f66940073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:00.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.702+0000 7f668f7fe700 1 -- 172.21.15.73:0/1268423021 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f6690095680 con 0x7f66981064d0 2023-08-10T11:51:00.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:00 smithi156 ceph-mon[130574]: mds.? [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] up:active 2023-08-10T11:51:00.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:00 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3616129551' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-08-10T11:51:00.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:00 smithi156 ceph-mon[130574]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-08-10T11:51:00.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:00 smithi156 ceph-mon[130574]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2023-08-10T11:51:00.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:00 smithi156 ceph-mon[130574]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=f=up:active,3=e=up:creating} 2 up:standby-replay 6 up:standby 2023-08-10T11:51:00.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:00 smithi156 ceph-mon[130574]: daemon mds.e is now active in filesystem cephfs as rank 3 2023-08-10T11:51:00.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:00 smithi156 ceph-mon[130574]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:51:00.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:00 smithi073 ceph-mon[128869]: mds.? [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] up:active 2023-08-10T11:51:00.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:00 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3616129551' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-08-10T11:51:00.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:00 smithi073 ceph-mon[128869]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-08-10T11:51:00.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:00 smithi073 ceph-mon[128869]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2023-08-10T11:51:00.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:00 smithi073 ceph-mon[128869]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=f=up:active,3=e=up:creating} 2 up:standby-replay 6 up:standby 2023-08-10T11:51:00.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:00 smithi073 ceph-mon[128869]: daemon mds.e is now active in filesystem cephfs as rank 3 2023-08-10T11:51:00.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:00 smithi073 ceph-mon[128869]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:51:00.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.927+0000 7f66a05e5700 1 -- 172.21.15.73:0/1268423021 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f6698060bb0 con 0x7f66840a11d0 2023-08-10T11:51:00.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.931+0000 7f668f7fe700 1 -- 172.21.15.73:0/1268423021 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f6698060bb0 con 0x7f66840a11d0 2023-08-10T11:51:00.932 INFO:teuthology.orchestra.run.smithi073.stdout:/volumes/_nogroup/sv_0/557850dc-6203-4ecb-a53b-067f1aa092db 2023-08-10T11:51:00.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.933+0000 7f66a05e5700 1 -- 172.21.15.73:0/1268423021 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f66840a11d0 msgr2=0x7f66840a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:00.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.933+0000 7f66a05e5700 1 --2- 172.21.15.73:0/1268423021 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f66840a11d0 0x7f66840a3690 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6694007c60 tx=0x7f66940073d0 comp rx=0 tx=0).stop 2023-08-10T11:51:00.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.933+0000 7f66a05e5700 1 -- 172.21.15.73:0/1268423021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66981064d0 msgr2=0x7f669819da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:00.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.933+0000 7f66a05e5700 1 --2- 172.21.15.73:0/1268423021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66981064d0 0x7f669819da60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f669000ada0 tx=0x7f669000c330 comp rx=0 tx=0).stop 2023-08-10T11:51:00.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.933+0000 7f66a05e5700 1 -- 172.21.15.73:0/1268423021 shutdown_connections 2023-08-10T11:51:00.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.933+0000 7f66a05e5700 1 --2- 172.21.15.73:0/1268423021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66981064d0 0x7f669819da60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:00.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.933+0000 7f66a05e5700 1 --2- 172.21.15.73:0/1268423021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6698101270 0x7f66981964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:00.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.933+0000 7f66a05e5700 1 --2- 172.21.15.73:0/1268423021 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f66840a11d0 0x7f66840a3690 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:00.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.933+0000 7f66a05e5700 1 --2- 172.21.15.73:0/1268423021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6698103ba0 0x7f66981969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:00.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.933+0000 7f66a05e5700 1 -- 172.21.15.73:0/1268423021 >> 172.21.15.73:0/1268423021 conn(0x7f66980fac00 msgr2=0x7f6698101ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:00.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.933+0000 7f66a05e5700 1 -- 172.21.15.73:0/1268423021 shutdown_connections 2023-08-10T11:51:00.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:00.933+0000 7f66a05e5700 1 -- 172.21.15.73:0/1268423021 wait complete. 2023-08-10T11:51:00.946 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-08-10T11:51:00.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:00 smithi152 ceph-mon[130220]: mds.? [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] up:active 2023-08-10T11:51:00.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:00 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3616129551' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-08-10T11:51:00.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:00 smithi152 ceph-mon[130220]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-08-10T11:51:00.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:00 smithi152 ceph-mon[130220]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2023-08-10T11:51:00.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:00 smithi152 ceph-mon[130220]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=f=up:active,3=e=up:creating} 2 up:standby-replay 6 up:standby 2023-08-10T11:51:00.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:00 smithi152 ceph-mon[130220]: daemon mds.e is now active in filesystem cephfs as rank 3 2023-08-10T11:51:00.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:00 smithi152 ceph-mon[130220]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:51:01.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.069+0000 7f59c26a6700 1 -- 172.21.15.73:0/2697680452 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59bc100880 msgr2=0x7f59bc100ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:01.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.069+0000 7f59c26a6700 1 --2- 172.21.15.73:0/2697680452 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59bc100880 0x7f59bc100ce0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f59a40099c0 tx=0x7f59a4009cd0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.069+0000 7f59c26a6700 1 -- 172.21.15.73:0/2697680452 shutdown_connections 2023-08-10T11:51:01.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.069+0000 7f59c26a6700 1 --2- 172.21.15.73:0/2697680452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59bc0ff690 0x7f59bc0ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.069+0000 7f59c26a6700 1 --2- 172.21.15.73:0/2697680452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59bc101220 0x7f59bc107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.069+0000 7f59c26a6700 1 --2- 172.21.15.73:0/2697680452 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59bc100880 0x7f59bc100ce0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.069+0000 7f59c26a6700 1 -- 172.21.15.73:0/2697680452 >> 172.21.15.73:0/2697680452 conn(0x7f59bc0fac00 msgr2=0x7f59bc0fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:01.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.069+0000 7f59c26a6700 1 -- 172.21.15.73:0/2697680452 shutdown_connections 2023-08-10T11:51:01.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.069+0000 7f59c26a6700 1 -- 172.21.15.73:0/2697680452 wait complete. 2023-08-10T11:51:01.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.070+0000 7f59c26a6700 1 Processor -- start 2023-08-10T11:51:01.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.070+0000 7f59c26a6700 1 -- start start 2023-08-10T11:51:01.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.070+0000 7f59c26a6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59bc0ff690 0x7f59bc1953d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:01.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.070+0000 7f59c26a6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59bc100880 0x7f59bc195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:01.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.070+0000 7f59c26a6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59bc101220 0x7f59bc19c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:01.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.070+0000 7f59c26a6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc19cf50 con 0x7f59bc100880 2023-08-10T11:51:01.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.070+0000 7f59c26a6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc19d090 con 0x7f59bc0ff690 2023-08-10T11:51:01.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.070+0000 7f59c26a6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc19d220 con 0x7f59bc101220 2023-08-10T11:51:01.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.070+0000 7f59bb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59bc100880 0x7f59bc195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:01.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.070+0000 7f59bb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59bc100880 0x7f59bc195910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59044/0 (socket says 172.21.15.73:59044) 2023-08-10T11:51:01.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.070+0000 7f59bb7fe700 1 -- 172.21.15.73:0/2196913813 learned_addr learned my addr 172.21.15.73:0/2196913813 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:01.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.070+0000 7f59bbfff700 1 --2- 172.21.15.73:0/2196913813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59bc0ff690 0x7f59bc1953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:01.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.070+0000 7f59bb7fe700 1 -- 172.21.15.73:0/2196913813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59bc101220 msgr2=0x7f59bc19c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:01.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.070+0000 7f59bb7fe700 1 --2- 172.21.15.73:0/2196913813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59bc101220 0x7f59bc19c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.070+0000 7f59bb7fe700 1 -- 172.21.15.73:0/2196913813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59bc0ff690 msgr2=0x7f59bc1953d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:01.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.070+0000 7f59bb7fe700 1 --2- 172.21.15.73:0/2196913813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59bc0ff690 0x7f59bc1953d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.070+0000 7f59bb7fe700 1 -- 172.21.15.73:0/2196913813 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a40095f0 con 0x7f59bc100880 2023-08-10T11:51:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.070+0000 7f59bb7fe700 1 --2- 172.21.15.73:0/2196913813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59bc100880 0x7f59bc195910 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f59a4009990 tx=0x7f59a401a840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.071+0000 7f59b97fa700 1 -- 172.21.15.73:0/2196913813 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a401f070 con 0x7f59bc100880 2023-08-10T11:51:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.071+0000 7f59c26a6700 1 -- 172.21.15.73:0/2196913813 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59bc068a80 con 0x7f59bc100880 2023-08-10T11:51:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.071+0000 7f59b97fa700 1 -- 172.21.15.73:0/2196913813 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f59a4004640 con 0x7f59bc100880 2023-08-10T11:51:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.071+0000 7f59b97fa700 1 -- 172.21.15.73:0/2196913813 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a4004220 con 0x7f59bc100880 2023-08-10T11:51:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.071+0000 7f59c26a6700 1 -- 172.21.15.73:0/2196913813 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59bc068f30 con 0x7f59bc100880 2023-08-10T11:51:01.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.072+0000 7f59c26a6700 1 -- 172.21.15.73:0/2196913813 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59bc069920 con 0x7f59bc100880 2023-08-10T11:51:01.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.073+0000 7f59b97fa700 1 -- 172.21.15.73:0/2196913813 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f59a4023070 con 0x7f59bc100880 2023-08-10T11:51:01.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.073+0000 7f59b97fa700 1 --2- 172.21.15.73:0/2196913813 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f59a80a1150 0x7f59a80a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:01.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.074+0000 7f59bbfff700 1 --2- 172.21.15.73:0/2196913813 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f59a80a1150 0x7f59a80a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:01.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.074+0000 7f59b97fa700 1 -- 172.21.15.73:0/2196913813 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f59a40d0300 con 0x7f59bc100880 2023-08-10T11:51:01.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.074+0000 7f59bbfff700 1 --2- 172.21.15.73:0/2196913813 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f59a80a1150 0x7f59a80a3610 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f59bc1006e0 tx=0x7f59ac00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:01.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.077+0000 7f59b97fa700 1 -- 172.21.15.73:0/2196913813 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f59a4099c30 con 0x7f59bc100880 2023-08-10T11:51:01.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.298+0000 7f59c26a6700 1 -- 172.21.15.73:0/2196913813 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f59bc069150 con 0x7f59a80a1150 2023-08-10T11:51:01.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.324+0000 7f59b97fa700 1 -- 172.21.15.73:0/2196913813 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f59bc069150 con 0x7f59a80a1150 2023-08-10T11:51:01.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.326+0000 7f59c26a6700 1 -- 172.21.15.73:0/2196913813 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f59a80a1150 msgr2=0x7f59a80a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:01.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.326+0000 7f59c26a6700 1 --2- 172.21.15.73:0/2196913813 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f59a80a1150 0x7f59a80a3610 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f59bc1006e0 tx=0x7f59ac00a380 comp rx=0 tx=0).stop 2023-08-10T11:51:01.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.326+0000 7f59c26a6700 1 -- 172.21.15.73:0/2196913813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59bc100880 msgr2=0x7f59bc195910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:01.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.326+0000 7f59c26a6700 1 --2- 172.21.15.73:0/2196913813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59bc100880 0x7f59bc195910 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f59a4009990 tx=0x7f59a401a840 comp rx=0 tx=0).stop 2023-08-10T11:51:01.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.326+0000 7f59c26a6700 1 -- 172.21.15.73:0/2196913813 shutdown_connections 2023-08-10T11:51:01.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.326+0000 7f59c26a6700 1 --2- 172.21.15.73:0/2196913813 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f59a80a1150 0x7f59a80a3610 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.326+0000 7f59c26a6700 1 --2- 172.21.15.73:0/2196913813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59bc0ff690 0x7f59bc1953d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.326+0000 7f59c26a6700 1 --2- 172.21.15.73:0/2196913813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59bc101220 0x7f59bc19c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.326+0000 7f59c26a6700 1 --2- 172.21.15.73:0/2196913813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59bc100880 0x7f59bc195910 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.326+0000 7f59c26a6700 1 -- 172.21.15.73:0/2196913813 >> 172.21.15.73:0/2196913813 conn(0x7f59bc0fac00 msgr2=0x7f59bc103db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:01.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.326+0000 7f59c26a6700 1 -- 172.21.15.73:0/2196913813 shutdown_connections 2023-08-10T11:51:01.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.326+0000 7f59c26a6700 1 -- 172.21.15.73:0/2196913813 wait complete. 2023-08-10T11:51:01.338 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-08-10T11:51:01.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.461+0000 7f9f86c65700 1 -- 172.21.15.73:0/1282193969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f80101260 msgr2=0x7f9f80107b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:01.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.461+0000 7f9f86c65700 1 --2- 172.21.15.73:0/1282193969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f80101260 0x7f9f80107b10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9f7800b0d0 tx=0x7f9f7800b3e0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.462+0000 7f9f86c65700 1 -- 172.21.15.73:0/1282193969 shutdown_connections 2023-08-10T11:51:01.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.462+0000 7f9f86c65700 1 --2- 172.21.15.73:0/1282193969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f80101260 0x7f9f80107b10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.462+0000 7f9f86c65700 1 --2- 172.21.15.73:0/1282193969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f800ff6d0 0x7f9f800ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.462+0000 7f9f86c65700 1 --2- 172.21.15.73:0/1282193969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f801008c0 0x7f9f80100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.462+0000 7f9f86c65700 1 -- 172.21.15.73:0/1282193969 >> 172.21.15.73:0/1282193969 conn(0x7f9f800fac40 msgr2=0x7f9f800fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:01.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.462+0000 7f9f86c65700 1 -- 172.21.15.73:0/1282193969 shutdown_connections 2023-08-10T11:51:01.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.462+0000 7f9f86c65700 1 -- 172.21.15.73:0/1282193969 wait complete. 2023-08-10T11:51:01.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.462+0000 7f9f86c65700 1 Processor -- start 2023-08-10T11:51:01.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.462+0000 7f9f86c65700 1 -- start start 2023-08-10T11:51:01.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.463+0000 7f9f86c65700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f800ff6d0 0x7f9f80196580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:01.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.463+0000 7f9f86c65700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f801008c0 0x7f9f80196ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:01.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.463+0000 7f9f86c65700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f80101260 0x7f9f8019db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:01.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.463+0000 7f9f86c65700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8019e100 con 0x7f9f80101260 2023-08-10T11:51:01.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.463+0000 7f9f86c65700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8019e240 con 0x7f9f800ff6d0 2023-08-10T11:51:01.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.463+0000 7f9f86c65700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8019e3d0 con 0x7f9f801008c0 2023-08-10T11:51:01.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.463+0000 7f9f85202700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f80101260 0x7f9f8019db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:01.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.463+0000 7f9f85202700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f80101260 0x7f9f8019db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59062/0 (socket says 172.21.15.73:59062) 2023-08-10T11:51:01.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.463+0000 7f9f85202700 1 -- 172.21.15.73:0/3187507692 learned_addr learned my addr 172.21.15.73:0/3187507692 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:01.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.463+0000 7f9f7ffff700 1 --2- 172.21.15.73:0/3187507692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f801008c0 0x7f9f80196ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:01.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.463+0000 7f9f84a01700 1 --2- 172.21.15.73:0/3187507692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f800ff6d0 0x7f9f80196580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:01.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.463+0000 7f9f85202700 1 -- 172.21.15.73:0/3187507692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f801008c0 msgr2=0x7f9f80196ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:01.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.463+0000 7f9f85202700 1 --2- 172.21.15.73:0/3187507692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f801008c0 0x7f9f80196ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.463+0000 7f9f85202700 1 -- 172.21.15.73:0/3187507692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f800ff6d0 msgr2=0x7f9f80196580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:01.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.463+0000 7f9f85202700 1 --2- 172.21.15.73:0/3187507692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f800ff6d0 0x7f9f80196580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.463+0000 7f9f85202700 1 -- 172.21.15.73:0/3187507692 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f78009d00 con 0x7f9f80101260 2023-08-10T11:51:01.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.463+0000 7f9f85202700 1 --2- 172.21.15.73:0/3187507692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f80101260 0x7f9f8019db30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9f78007a00 tx=0x7f9f780094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:01.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.463+0000 7f9f7dffb700 1 -- 172.21.15.73:0/3187507692 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7800e040 con 0x7f9f80101260 2023-08-10T11:51:01.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.463+0000 7f9f7dffb700 1 -- 172.21.15.73:0/3187507692 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f78012dc0 con 0x7f9f80101260 2023-08-10T11:51:01.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.463+0000 7f9f86c65700 1 -- 172.21.15.73:0/3187507692 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f8019e650 con 0x7f9f80101260 2023-08-10T11:51:01.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.463+0000 7f9f7dffb700 1 -- 172.21.15.73:0/3187507692 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7801b450 con 0x7f9f80101260 2023-08-10T11:51:01.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.464+0000 7f9f86c65700 1 -- 172.21.15.73:0/3187507692 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8019ead0 con 0x7f9f80101260 2023-08-10T11:51:01.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.464+0000 7f9f86c65700 1 -- 172.21.15.73:0/3187507692 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f8010aed0 con 0x7f9f80101260 2023-08-10T11:51:01.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.465+0000 7f9f7dffb700 1 -- 172.21.15.73:0/3187507692 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f9f7801d610 con 0x7f9f80101260 2023-08-10T11:51:01.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.466+0000 7f9f7dffb700 1 --2- 172.21.15.73:0/3187507692 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9f700a1150 0x7f9f700a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:01.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.466+0000 7f9f84a01700 1 --2- 172.21.15.73:0/3187507692 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9f700a1150 0x7f9f700a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:01.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.466+0000 7f9f7dffb700 1 -- 172.21.15.73:0/3187507692 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9f780ce5f0 con 0x7f9f80101260 2023-08-10T11:51:01.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.466+0000 7f9f84a01700 1 --2- 172.21.15.73:0/3187507692 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9f700a1150 0x7f9f700a3610 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9f80100720 tx=0x7f9f7400b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:01.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.470+0000 7f9f7dffb700 1 -- 172.21.15.73:0/3187507692 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f9f78097f20 con 0x7f9f80101260 2023-08-10T11:51:01.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.699+0000 7f9f86c65700 1 -- 172.21.15.73:0/3187507692 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f800fbb40 con 0x7f9f700a1150 2023-08-10T11:51:01.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.702+0000 7f9f7dffb700 1 -- 172.21.15.73:0/3187507692 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f9f800fbb40 con 0x7f9f700a1150 2023-08-10T11:51:01.703 INFO:teuthology.orchestra.run.smithi073.stdout:/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8 2023-08-10T11:51:01.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.704+0000 7f9f86c65700 1 -- 172.21.15.73:0/3187507692 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9f700a1150 msgr2=0x7f9f700a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:01.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.704+0000 7f9f86c65700 1 --2- 172.21.15.73:0/3187507692 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9f700a1150 0x7f9f700a3610 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9f80100720 tx=0x7f9f7400b5b0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.704+0000 7f9f86c65700 1 -- 172.21.15.73:0/3187507692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f80101260 msgr2=0x7f9f8019db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.704+0000 7f9f86c65700 1 --2- 172.21.15.73:0/3187507692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f80101260 0x7f9f8019db30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9f78007a00 tx=0x7f9f780094f0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.705+0000 7f9f86c65700 1 -- 172.21.15.73:0/3187507692 shutdown_connections 2023-08-10T11:51:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.705+0000 7f9f86c65700 1 --2- 172.21.15.73:0/3187507692 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9f700a1150 0x7f9f700a3610 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.705+0000 7f9f86c65700 1 --2- 172.21.15.73:0/3187507692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f800ff6d0 0x7f9f80196580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.705+0000 7f9f86c65700 1 --2- 172.21.15.73:0/3187507692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f80101260 0x7f9f8019db30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.705+0000 7f9f86c65700 1 --2- 172.21.15.73:0/3187507692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f801008c0 0x7f9f80196ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.705+0000 7f9f86c65700 1 -- 172.21.15.73:0/3187507692 >> 172.21.15.73:0/3187507692 conn(0x7f9f800fac40 msgr2=0x7f9f800fb430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.705+0000 7f9f86c65700 1 -- 172.21.15.73:0/3187507692 shutdown_connections 2023-08-10T11:51:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.705+0000 7f9f86c65700 1 -- 172.21.15.73:0/3187507692 wait complete. 2023-08-10T11:51:01.716 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:01 smithi073 ceph-mon[128869]: pgmap v259: 97 pgs: 97 active+clean; 580 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2.9 KiB/s wr, 15 op/s 2023-08-10T11:51:01.717 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:01 smithi073 ceph-mon[128869]: mds.? [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] up:active 2023-08-10T11:51:01.717 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:01 smithi073 ceph-mon[128869]: daemon mds.k assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-08-10T11:51:01.717 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:01 smithi073 ceph-mon[128869]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-08-10T11:51:01.717 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:01 smithi073 ceph-mon[128869]: Cluster is now healthy 2023-08-10T11:51:01.717 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:01 smithi073 ceph-mon[128869]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=f=up:active,3=e=up:active} 2 up:standby-replay 6 up:standby 2023-08-10T11:51:01.718 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:01 smithi073 ceph-mon[128869]: fsmap cephfs:5 2 up:standby-replay 1 up:creating 5 up:standby 4 up:active 2023-08-10T11:51:01.718 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:01 smithi073 ceph-mon[128869]: daemon mds.k is now active in filesystem cephfs as rank 4 2023-08-10T11:51:01.719 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T11:51:01.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.838+0000 7fa67e4c0700 1 -- 172.21.15.73:0/725860945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6781011e0 msgr2=0x7fa678107a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:01.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.838+0000 7fa67e4c0700 1 --2- 172.21.15.73:0/725860945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6781011e0 0x7fa678107a90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa67000b0d0 tx=0x7fa67000b3e0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.838+0000 7fa67e4c0700 1 -- 172.21.15.73:0/725860945 shutdown_connections 2023-08-10T11:51:01.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.838+0000 7fa67e4c0700 1 --2- 172.21.15.73:0/725860945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6780ff650 0x7fa6780ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.838+0000 7fa67e4c0700 1 --2- 172.21.15.73:0/725860945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6781011e0 0x7fa678107a90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.838+0000 7fa67e4c0700 1 --2- 172.21.15.73:0/725860945 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa678100840 0x7fa678100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.838+0000 7fa67e4c0700 1 -- 172.21.15.73:0/725860945 >> 172.21.15.73:0/725860945 conn(0x7fa6780faba0 msgr2=0x7fa6780fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:01.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.838+0000 7fa67e4c0700 1 -- 172.21.15.73:0/725860945 shutdown_connections 2023-08-10T11:51:01.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.838+0000 7fa67e4c0700 1 -- 172.21.15.73:0/725860945 wait complete. 2023-08-10T11:51:01.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.839+0000 7fa67e4c0700 1 Processor -- start 2023-08-10T11:51:01.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.839+0000 7fa67e4c0700 1 -- start start 2023-08-10T11:51:01.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.839+0000 7fa67e4c0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6780ff650 0x7fa678195320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:01.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.839+0000 7fa67e4c0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa678100840 0x7fa678195860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:01.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.839+0000 7fa67e4c0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6781011e0 0x7fa67819c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:01.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.839+0000 7fa67e4c0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67819cea0 con 0x7fa6780ff650 2023-08-10T11:51:01.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.839+0000 7fa67e4c0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67819cfe0 con 0x7fa678100840 2023-08-10T11:51:01.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.839+0000 7fa67e4c0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67819d170 con 0x7fa6781011e0 2023-08-10T11:51:01.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.839+0000 7fa677fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6780ff650 0x7fa678195320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:01.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.839+0000 7fa677fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6780ff650 0x7fa678195320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59092/0 (socket says 172.21.15.73:59092) 2023-08-10T11:51:01.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.839+0000 7fa677fff700 1 -- 172.21.15.73:0/3515520464 learned_addr learned my addr 172.21.15.73:0/3515520464 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:01.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.839+0000 7fa6777fe700 1 --2- 172.21.15.73:0/3515520464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa678100840 0x7fa678195860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:01.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.839+0000 7fa677fff700 1 -- 172.21.15.73:0/3515520464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6781011e0 msgr2=0x7fa67819c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:01.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.839+0000 7fa67ca5d700 1 --2- 172.21.15.73:0/3515520464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6781011e0 0x7fa67819c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:01.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.840+0000 7fa677fff700 1 --2- 172.21.15.73:0/3515520464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6781011e0 0x7fa67819c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.840+0000 7fa677fff700 1 -- 172.21.15.73:0/3515520464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa678100840 msgr2=0x7fa678195860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:01.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.840+0000 7fa677fff700 1 --2- 172.21.15.73:0/3515520464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa678100840 0x7fa678195860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:01.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.840+0000 7fa677fff700 1 -- 172.21.15.73:0/3515520464 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa670009d00 con 0x7fa6780ff650 2023-08-10T11:51:01.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.840+0000 7fa6777fe700 1 --2- 172.21.15.73:0/3515520464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa678100840 0x7fa678195860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:51:01.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.840+0000 7fa67ca5d700 1 --2- 172.21.15.73:0/3515520464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6781011e0 0x7fa67819c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:01.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.840+0000 7fa677fff700 1 --2- 172.21.15.73:0/3515520464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6780ff650 0x7fa678195320 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa66800d980 tx=0x7fa66800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:01.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.840+0000 7fa6757fa700 1 -- 172.21.15.73:0/3515520464 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66800de60 con 0x7fa6780ff650 2023-08-10T11:51:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.840+0000 7fa6757fa700 1 -- 172.21.15.73:0/3515520464 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa6680044e0 con 0x7fa6780ff650 2023-08-10T11:51:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.840+0000 7fa67e4c0700 1 -- 172.21.15.73:0/3515520464 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa67819d450 con 0x7fa6780ff650 2023-08-10T11:51:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.840+0000 7fa6757fa700 1 -- 172.21.15.73:0/3515520464 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa668003be0 con 0x7fa6780ff650 2023-08-10T11:51:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.840+0000 7fa67e4c0700 1 -- 172.21.15.73:0/3515520464 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa67819d960 con 0x7fa6780ff650 2023-08-10T11:51:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.841+0000 7fa67e4c0700 1 -- 172.21.15.73:0/3515520464 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa678106410 con 0x7fa6780ff650 2023-08-10T11:51:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.842+0000 7fa6757fa700 1 -- 172.21.15.73:0/3515520464 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fa668009bb0 con 0x7fa6780ff650 2023-08-10T11:51:01.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.842+0000 7fa6757fa700 1 --2- 172.21.15.73:0/3515520464 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa6640a11a0 0x7fa6640a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:01.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.843+0000 7fa6777fe700 1 --2- 172.21.15.73:0/3515520464 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa6640a11a0 0x7fa6640a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:01.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.843+0000 7fa6757fa700 1 -- 172.21.15.73:0/3515520464 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa6680cc900 con 0x7fa6780ff650 2023-08-10T11:51:01.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.843+0000 7fa6777fe700 1 --2- 172.21.15.73:0/3515520464 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa6640a11a0 0x7fa6640a3660 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa660005fd0 tx=0x7fa660005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:01.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:01.846+0000 7fa6757fa700 1 -- 172.21.15.73:0/3515520464 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fa6680961a0 con 0x7fa6780ff650 2023-08-10T11:51:01.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:01 smithi152 ceph-mon[130220]: pgmap v259: 97 pgs: 97 active+clean; 580 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2.9 KiB/s wr, 15 op/s 2023-08-10T11:51:01.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:01 smithi152 ceph-mon[130220]: mds.? [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] up:active 2023-08-10T11:51:01.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:01 smithi152 ceph-mon[130220]: daemon mds.k assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-08-10T11:51:01.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:01 smithi152 ceph-mon[130220]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-08-10T11:51:01.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:01 smithi152 ceph-mon[130220]: Cluster is now healthy 2023-08-10T11:51:01.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:01 smithi152 ceph-mon[130220]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=f=up:active,3=e=up:active} 2 up:standby-replay 6 up:standby 2023-08-10T11:51:01.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:01 smithi152 ceph-mon[130220]: fsmap cephfs:5 2 up:standby-replay 1 up:creating 5 up:standby 4 up:active 2023-08-10T11:51:01.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:01 smithi152 ceph-mon[130220]: daemon mds.k is now active in filesystem cephfs as rank 4 2023-08-10T11:51:02.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:01 smithi156 ceph-mon[130574]: pgmap v259: 97 pgs: 97 active+clean; 580 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2.9 KiB/s wr, 15 op/s 2023-08-10T11:51:02.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:01 smithi156 ceph-mon[130574]: mds.? [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] up:active 2023-08-10T11:51:02.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:01 smithi156 ceph-mon[130574]: daemon mds.k assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-08-10T11:51:02.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:01 smithi156 ceph-mon[130574]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-08-10T11:51:02.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:01 smithi156 ceph-mon[130574]: Cluster is now healthy 2023-08-10T11:51:02.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:01 smithi156 ceph-mon[130574]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=f=up:active,3=e=up:active} 2 up:standby-replay 6 up:standby 2023-08-10T11:51:02.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:01 smithi156 ceph-mon[130574]: fsmap cephfs:5 2 up:standby-replay 1 up:creating 5 up:standby 4 up:active 2023-08-10T11:51:02.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:01 smithi156 ceph-mon[130574]: daemon mds.k is now active in filesystem cephfs as rank 4 2023-08-10T11:51:02.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.082+0000 7fa67e4c0700 1 -- 172.21.15.73:0/3515520464 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa67802c970 con 0x7fa6780ff650 2023-08-10T11:51:02.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.082+0000 7fa6757fa700 1 -- 172.21.15.73:0/3515520464 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10891 (secure 0 0 0) 0x7fa668009940 con 0x7fa6780ff650 2023-08-10T11:51:02.084 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:51:02.084 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1319360725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1319360725},{"type":"v1","addr":"172.21.15.73:6835","nonce":1319360725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/431221951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":431221951},{"type":"v1","addr":"172.21.15.73:6837","nonce":431221951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-10T11:50:54.304447+0000","modified":"2023-08-10T11:51:01.523452+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24503,"mds_1":24479,"mds_2":24451,"mds_3":24443,"mds_4":24419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6839/1099539481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1099539481},{"type":"v1","addr":"172.21.15.73:6839","nonce":1099539481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6841/3067925859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":3067925859},{"type":"v1","addr":"172.21.15.73:6841","nonce":3067925859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24397":{"gid":24397,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6833/3028461815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3028461815},{"type":"v1","addr":"172.21.15.156:6833","nonce":3028461815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24419":{"gid":24419,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6833/4148407154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4148407154},{"type":"v1","addr":"172.21.15.152:6833","nonce":4148407154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24443":{"gid":24443,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.152:6835/1791572604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1791572604},{"type":"v1","addr":"172.21.15.152:6835","nonce":1791572604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.156:6835/904126790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":904126790},{"type":"v1","addr":"172.21.15.156:6835","nonce":904126790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24457":{"gid":24457,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/4284306352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":4284306352},{"type":"v1","addr":"172.21.15.156:6837","nonce":4284306352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6839/3361058731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":3361058731},{"type":"v1","addr":"172.21.15.156:6839","nonce":3361058731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6837/74214089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":74214089},{"type":"v1","addr":"172.21.15.152:6837","nonce":74214089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6839/3870202690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3870202690},{"type":"v1","addr":"172.21.15.152:6839","nonce":3870202690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T11:51:02.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.084+0000 7fa67e4c0700 1 -- 172.21.15.73:0/3515520464 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa6640a11a0 msgr2=0x7fa6640a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:02.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.084+0000 7fa67e4c0700 1 --2- 172.21.15.73:0/3515520464 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa6640a11a0 0x7fa6640a3660 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa660005fd0 tx=0x7fa660005e30 comp rx=0 tx=0).stop 2023-08-10T11:51:02.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.084+0000 7fa67e4c0700 1 -- 172.21.15.73:0/3515520464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6780ff650 msgr2=0x7fa678195320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:02.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.084+0000 7fa67e4c0700 1 --2- 172.21.15.73:0/3515520464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6780ff650 0x7fa678195320 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa66800d980 tx=0x7fa66800dd40 comp rx=0 tx=0).stop 2023-08-10T11:51:02.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.085+0000 7fa67e4c0700 1 -- 172.21.15.73:0/3515520464 shutdown_connections 2023-08-10T11:51:02.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.085+0000 7fa67e4c0700 1 --2- 172.21.15.73:0/3515520464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6781011e0 0x7fa67819c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.085+0000 7fa67e4c0700 1 --2- 172.21.15.73:0/3515520464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6780ff650 0x7fa678195320 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.085+0000 7fa67e4c0700 1 --2- 172.21.15.73:0/3515520464 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa6640a11a0 0x7fa6640a3660 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.085+0000 7fa67e4c0700 1 --2- 172.21.15.73:0/3515520464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa678100840 0x7fa678195860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.085+0000 7fa67e4c0700 1 -- 172.21.15.73:0/3515520464 >> 172.21.15.73:0/3515520464 conn(0x7fa6780faba0 msgr2=0x7fa6780fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:02.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.085+0000 7fa67e4c0700 1 -- 172.21.15.73:0/3515520464 shutdown_connections 2023-08-10T11:51:02.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.085+0000 7fa67e4c0700 1 -- 172.21.15.73:0/3515520464 wait complete. 2023-08-10T11:51:02.089 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 27 2023-08-10T11:51:02.097 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T11:51:02.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.218+0000 7f3b6399a700 1 -- 172.21.15.73:0/1034436013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b5c0ff650 msgr2=0x7f3b5c0ffa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:02.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.218+0000 7f3b6399a700 1 --2- 172.21.15.73:0/1034436013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b5c0ff650 0x7f3b5c0ffa70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0099c0 tx=0x7f3b4c009cd0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.218+0000 7f3b6399a700 1 -- 172.21.15.73:0/1034436013 shutdown_connections 2023-08-10T11:51:02.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.218+0000 7f3b6399a700 1 --2- 172.21.15.73:0/1034436013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b5c1011e0 0x7f3b5c107a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.218+0000 7f3b6399a700 1 --2- 172.21.15.73:0/1034436013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b5c0ff650 0x7f3b5c0ffa70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.218+0000 7f3b6399a700 1 --2- 172.21.15.73:0/1034436013 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b5c100840 0x7f3b5c100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.218+0000 7f3b6399a700 1 -- 172.21.15.73:0/1034436013 >> 172.21.15.73:0/1034436013 conn(0x7f3b5c0faba0 msgr2=0x7f3b5c0fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:02.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.218+0000 7f3b6399a700 1 -- 172.21.15.73:0/1034436013 shutdown_connections 2023-08-10T11:51:02.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.218+0000 7f3b6399a700 1 -- 172.21.15.73:0/1034436013 wait complete. 2023-08-10T11:51:02.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.219+0000 7f3b6399a700 1 Processor -- start 2023-08-10T11:51:02.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.219+0000 7f3b6399a700 1 -- start start 2023-08-10T11:51:02.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.219+0000 7f3b6399a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b5c0ff650 0x7f3b5c068460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:02.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.219+0000 7f3b6399a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b5c100840 0x7f3b5c19b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:02.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.219+0000 7f3b6399a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b5c1011e0 0x7f3b5c19d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:02.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.219+0000 7f3b6399a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c19df70 con 0x7f3b5c1011e0 2023-08-10T11:51:02.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.219+0000 7f3b6399a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c19e0e0 con 0x7f3b5c0ff650 2023-08-10T11:51:02.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.219+0000 7f3b6399a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c19e2a0 con 0x7f3b5c100840 2023-08-10T11:51:02.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.219+0000 7f3b61f37700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b5c1011e0 0x7f3b5c19d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:02.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.219+0000 7f3b61f37700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b5c1011e0 0x7f3b5c19d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59110/0 (socket says 172.21.15.73:59110) 2023-08-10T11:51:02.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.219+0000 7f3b61f37700 1 -- 172.21.15.73:0/2298111141 learned_addr learned my addr 172.21.15.73:0/2298111141 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:02.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.219+0000 7f3b61736700 1 --2- 172.21.15.73:0/2298111141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b5c0ff650 0x7f3b5c068460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:02.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.219+0000 7f3b61f37700 1 -- 172.21.15.73:0/2298111141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b5c100840 msgr2=0x7f3b5c19b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:02.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.219+0000 7f3b60f35700 1 --2- 172.21.15.73:0/2298111141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b5c100840 0x7f3b5c19b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:02.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.219+0000 7f3b61f37700 1 --2- 172.21.15.73:0/2298111141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b5c100840 0x7f3b5c19b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.219+0000 7f3b61f37700 1 -- 172.21.15.73:0/2298111141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b5c0ff650 msgr2=0x7f3b5c068460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:02.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.219+0000 7f3b61f37700 1 --2- 172.21.15.73:0/2298111141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b5c0ff650 0x7f3b5c068460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.219+0000 7f3b61f37700 1 -- 172.21.15.73:0/2298111141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4c0095f0 con 0x7f3b5c1011e0 2023-08-10T11:51:02.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.219+0000 7f3b61736700 1 --2- 172.21.15.73:0/2298111141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b5c0ff650 0x7f3b5c068460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:51:02.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.219+0000 7f3b60f35700 1 --2- 172.21.15.73:0/2298111141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b5c100840 0x7f3b5c19b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:02.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.219+0000 7f3b61f37700 1 --2- 172.21.15.73:0/2298111141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b5c1011e0 0x7f3b5c19d7a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3b5400ef30 tx=0x7f3b5400c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:02.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.219+0000 7f3b527fc700 1 -- 172.21.15.73:0/2298111141 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b54018070 con 0x7f3b5c1011e0 2023-08-10T11:51:02.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.219+0000 7f3b527fc700 1 -- 172.21.15.73:0/2298111141 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b5400f040 con 0x7f3b5c1011e0 2023-08-10T11:51:02.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.220+0000 7f3b6399a700 1 -- 172.21.15.73:0/2298111141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b5c19e520 con 0x7f3b5c1011e0 2023-08-10T11:51:02.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.220+0000 7f3b527fc700 1 -- 172.21.15.73:0/2298111141 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b54003dc0 con 0x7f3b5c1011e0 2023-08-10T11:51:02.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.220+0000 7f3b6399a700 1 -- 172.21.15.73:0/2298111141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b5c19e9e0 con 0x7f3b5c1011e0 2023-08-10T11:51:02.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.220+0000 7f3b6399a700 1 -- 172.21.15.73:0/2298111141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b5c10ae70 con 0x7f3b5c1011e0 2023-08-10T11:51:02.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.222+0000 7f3b527fc700 1 -- 172.21.15.73:0/2298111141 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f3b5400caa0 con 0x7f3b5c1011e0 2023-08-10T11:51:02.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.222+0000 7f3b527fc700 1 --2- 172.21.15.73:0/2298111141 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3b480a11a0 0x7f3b480a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:02.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.222+0000 7f3b61736700 1 --2- 172.21.15.73:0/2298111141 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3b480a11a0 0x7f3b480a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:02.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.222+0000 7f3b527fc700 1 -- 172.21.15.73:0/2298111141 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3b540cce50 con 0x7f3b5c1011e0 2023-08-10T11:51:02.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.223+0000 7f3b61736700 1 --2- 172.21.15.73:0/2298111141 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3b480a11a0 0x7f3b480a3660 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c009990 tx=0x7f3b4c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:02.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.226+0000 7f3b527fc700 1 -- 172.21.15.73:0/2298111141 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f3b54096780 con 0x7f3b5c1011e0 2023-08-10T11:51:02.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.419+0000 7f3b6399a700 1 -- 172.21.15.73:0/2298111141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b5c106550 con 0x7f3b5c1011e0 2023-08-10T11:51:02.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.420+0000 7f3b527fc700 1 -- 172.21.15.73:0/2298111141 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22105 (secure 0 0 0) 0x7f3b54099da0 con 0x7f3b5c1011e0 2023-08-10T11:51:02.421 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:51:02.421 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":83,"fsid":"0e619a74-3773-11ee-9b37-001a4aab830c","created":"2023-08-10T11:43:53.974768+0000","modified":"2023-08-10T11:50:55.886848+0000","last_up_change":"2023-08-10T11:50:12.914422+0000","last_in_change":"2023-08-10T11:49:54.624543+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T11:46:58.735153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T11:50:52.517974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T11:50:53.465357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3219ae18-cc4c-4712-b616-79f6949066e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6803","nonce":2725694252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6805","nonce":2725694252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6809","nonce":2725694252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6807","nonce":2725694252}]},"public_addr":"172.21.15.73:6803/2725694252","cluster_addr":"172.21.15.73:6805/2725694252","heartbeat_back_addr":"172.21.15.73:6809/2725694252","heartbeat_front_addr":"172.21.15.73:6807/2725694252","state":["exists","up"]},{"osd":1,"uuid":"bbfe6cd9-b3d3-4b8d-8814-507a867f8c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6801","nonce":836829168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6803","nonce":836829168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6807","nonce":836829168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6805","nonce":836829168}]},"public_addr":"172.21.15.152:6801/836829168","cluster_addr":"172.21.15.152:6803/836829168","heartbeat_back_addr":"172.21.15.152:6807/836829168","heartbeat_front_addr":"172.21.15.152:6805/836829168","state":["exists","up"]},{"osd":2,"uuid":"f57f5b2c-3208-45c0-beba-8501694b99c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6801","nonce":1789212298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6803","nonce":1789212298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6807","nonce":1789212298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6805","nonce":1789212298}]},"public_addr":"172.21.15.156:6801/1789212298","cluster_addr":"172.21.15.156:6803/1789212298","heartbeat_back_addr":"172.21.15.156:6807/1789212298","heartbeat_front_addr":"172.21.15.156:6805/1789212298","state":["exists","up"]},{"osd":3,"uuid":"18592408-3696-4ab8-ad41-c172b8409829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6811","nonce":3101572649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6813","nonce":3101572649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6817","nonce":3101572649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6815","nonce":3101572649}]},"public_addr":"172.21.15.73:6811/3101572649","cluster_addr":"172.21.15.73:6813/3101572649","heartbeat_back_addr":"172.21.15.73:6817/3101572649","heartbeat_front_addr":"172.21.15.73:6815/3101572649","state":["exists","up"]},{"osd":4,"uuid":"fb3adb09-8807-42d9-8db9-1867c5fe02da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6809","nonce":1451517889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6811","nonce":1451517889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6815","nonce":1451517889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6813","nonce":1451517889}]},"public_addr":"172.21.15.152:6809/1451517889","cluster_addr":"172.21.15.152:6811/1451517889","heartbeat_back_addr":"172.21.15.152:6815/1451517889","heartbeat_front_addr":"172.21.15.152:6813/1451517889","state":["exists","up"]},{"osd":5,"uuid":"af58a7bd-4e58-4639-95b2-4a76011b61dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6809","nonce":3823368741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6811","nonce":3823368741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6815","nonce":3823368741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6813","nonce":3823368741}]},"public_addr":"172.21.15.156:6809/3823368741","cluster_addr":"172.21.15.156:6811/3823368741","heartbeat_back_addr":"172.21.15.156:6815/3823368741","heartbeat_front_addr":"172.21.15.156:6813/3823368741","state":["exists","up"]},{"osd":6,"uuid":"f6ae502d-4af9-4f6a-8636-b5b683dfdfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6819","nonce":2533620458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6821","nonce":2533620458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6825","nonce":2533620458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6823","nonce":2533620458}]},"public_addr":"172.21.15.73:6819/2533620458","cluster_addr":"172.21.15.73:6821/2533620458","heartbeat_back_addr":"172.21.15.73:6825/2533620458","heartbeat_front_addr":"172.21.15.73:6823/2533620458","state":["exists","up"]},{"osd":7,"uuid":"398fd334-5f6f-427c-95ae-3244fb466f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6817","nonce":4059538477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6819","nonce":4059538477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6823","nonce":4059538477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6821","nonce":4059538477}]},"public_addr":"172.21.15.152:6817/4059538477","cluster_addr":"172.21.15.152:6819/4059538477","heartbeat_back_addr":"172.21.15.152:6823/4059538477","heartbeat_front_addr":"172.21.15.152:6821/4059538477","state":["exists","up"]},{"osd":8,"uuid":"58f46e64-2624-4ad4-bb6a-225624153837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6817","nonce":96487555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6819","nonce":96487555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6823","nonce":96487555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6821","nonce":96487555}]},"public_addr":"172.21.15.156:6817/96487555","cluster_addr":"172.21.15.156:6819/96487555","heartbeat_back_addr":"172.21.15.156:6823/96487555","heartbeat_front_addr":"172.21.15.156:6821/96487555","state":["exists","up"]},{"osd":9,"uuid":"9389dd5b-da2d-43b6-8bc0-bb1af13f72c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6827","nonce":2050124321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6829","nonce":2050124321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6833","nonce":2050124321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6831","nonce":2050124321}]},"public_addr":"172.21.15.73:6827/2050124321","cluster_addr":"172.21.15.73:6829/2050124321","heartbeat_back_addr":"172.21.15.73:6833/2050124321","heartbeat_front_addr":"172.21.15.73:6831/2050124321","state":["exists","up"]},{"osd":10,"uuid":"563c1e34-3acd-46ab-ba36-e9d87f635e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6825","nonce":1513186350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6827","nonce":1513186350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6831","nonce":1513186350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6829","nonce":1513186350}]},"public_addr":"172.21.15.152:6825/1513186350","cluster_addr":"172.21.15.152:6827/1513186350","heartbeat_back_addr":"172.21.15.152:6831/1513186350","heartbeat_front_addr":"172.21.15.152:6829/1513186350","state":["exists","up"]},{"osd":11,"uuid":"f1b55889-14fd-4cc9-bed7-43748086fb77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6825","nonce":737904755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6827","nonce":737904755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6831","nonce":737904755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6829","nonce":737904755}]},"public_addr":"172.21.15.156:6825/737904755","cluster_addr":"172.21.15.156:6827/737904755","heartbeat_back_addr":"172.21.15.156:6831/737904755","heartbeat_front_addr":"172.21.15.156:6829/737904755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:12.023797+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:33.872883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:55.856970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:18.013196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:39.202872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:00.393920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:22.743083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:43.921728+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:05.859488+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:27.618714+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:48.880286+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:50:11.055141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/2202785670":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6800/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:6800/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/1447381524":"2023-08-11T11:44:48.401660+0000","172.21.15.73:0/2545059698":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/4193457623":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2561039569":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2927950081":"2023-08-11T11:44:48.401660+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T11:51:02.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.422+0000 7f3b6399a700 1 -- 172.21.15.73:0/2298111141 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3b480a11a0 msgr2=0x7f3b480a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:02.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.422+0000 7f3b6399a700 1 --2- 172.21.15.73:0/2298111141 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3b480a11a0 0x7f3b480a3660 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c009990 tx=0x7f3b4c01a040 comp rx=0 tx=0).stop 2023-08-10T11:51:02.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.422+0000 7f3b6399a700 1 -- 172.21.15.73:0/2298111141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b5c1011e0 msgr2=0x7f3b5c19d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:02.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.422+0000 7f3b6399a700 1 --2- 172.21.15.73:0/2298111141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b5c1011e0 0x7f3b5c19d7a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3b5400ef30 tx=0x7f3b5400c450 comp rx=0 tx=0).stop 2023-08-10T11:51:02.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.422+0000 7f3b6399a700 1 -- 172.21.15.73:0/2298111141 shutdown_connections 2023-08-10T11:51:02.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.422+0000 7f3b6399a700 1 --2- 172.21.15.73:0/2298111141 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3b480a11a0 0x7f3b480a3660 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.422+0000 7f3b6399a700 1 --2- 172.21.15.73:0/2298111141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b5c0ff650 0x7f3b5c068460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.422+0000 7f3b6399a700 1 --2- 172.21.15.73:0/2298111141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b5c1011e0 0x7f3b5c19d7a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.422+0000 7f3b6399a700 1 --2- 172.21.15.73:0/2298111141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b5c100840 0x7f3b5c19b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.423+0000 7f3b6399a700 1 -- 172.21.15.73:0/2298111141 >> 172.21.15.73:0/2298111141 conn(0x7f3b5c0faba0 msgr2=0x7f3b5c0fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:02.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.423+0000 7f3b6399a700 1 -- 172.21.15.73:0/2298111141 shutdown_connections 2023-08-10T11:51:02.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.423+0000 7f3b6399a700 1 -- 172.21.15.73:0/2298111141 wait complete. 2023-08-10T11:51:02.436 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-10T11:51:02.436 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T11:51:02.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.561+0000 7f378f37f700 1 -- 172.21.15.73:0/1629577399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37880fede0 msgr2=0x7f37880ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:02.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.561+0000 7f378f37f700 1 --2- 172.21.15.73:0/1629577399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37880fede0 0x7f37880ff200 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f37780099c0 tx=0x7f3778009cd0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.561+0000 7f378f37f700 1 -- 172.21.15.73:0/1629577399 shutdown_connections 2023-08-10T11:51:02.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.561+0000 7f378f37f700 1 --2- 172.21.15.73:0/1629577399 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3788100970 0x7f3788107220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.561+0000 7f378f37f700 1 --2- 172.21.15.73:0/1629577399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37880fede0 0x7f37880ff200 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.561+0000 7f378f37f700 1 --2- 172.21.15.73:0/1629577399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37880fffd0 0x7f3788100430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.561+0000 7f378f37f700 1 -- 172.21.15.73:0/1629577399 >> 172.21.15.73:0/1629577399 conn(0x7f37880fa330 msgr2=0x7f37880fc790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:02.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.561+0000 7f378f37f700 1 -- 172.21.15.73:0/1629577399 shutdown_connections 2023-08-10T11:51:02.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.561+0000 7f378f37f700 1 -- 172.21.15.73:0/1629577399 wait complete. 2023-08-10T11:51:02.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.562+0000 7f378f37f700 1 Processor -- start 2023-08-10T11:51:02.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.562+0000 7f378f37f700 1 -- start start 2023-08-10T11:51:02.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.562+0000 7f378f37f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37880fede0 0x7f37881953a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:02.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.562+0000 7f378f37f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37880fffd0 0x7f37881958e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:02.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.562+0000 7f378f37f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3788100970 0x7f378819c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:02.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.562+0000 7f378f37f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378819cf20 con 0x7f37880fede0 2023-08-10T11:51:02.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.562+0000 7f378f37f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378819d060 con 0x7f37880fffd0 2023-08-10T11:51:02.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.562+0000 7f378f37f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378819d1f0 con 0x7f3788100970 2023-08-10T11:51:02.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.562+0000 7f378d11b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37880fede0 0x7f37881953a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:02.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.562+0000 7f378d11b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37880fede0 0x7f37881953a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59120/0 (socket says 172.21.15.73:59120) 2023-08-10T11:51:02.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.562+0000 7f378d11b700 1 -- 172.21.15.73:0/2221925543 learned_addr learned my addr 172.21.15.73:0/2221925543 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:02.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.562+0000 7f378d91c700 1 --2- 172.21.15.73:0/2221925543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3788100970 0x7f378819c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:02.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.562+0000 7f378c91a700 1 --2- 172.21.15.73:0/2221925543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37880fffd0 0x7f37881958e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:02.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.562+0000 7f378d11b700 1 -- 172.21.15.73:0/2221925543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3788100970 msgr2=0x7f378819c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:02.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.562+0000 7f378d11b700 1 --2- 172.21.15.73:0/2221925543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3788100970 0x7f378819c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.562+0000 7f378d11b700 1 -- 172.21.15.73:0/2221925543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37880fffd0 msgr2=0x7f37881958e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:02.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.562+0000 7f378d11b700 1 --2- 172.21.15.73:0/2221925543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37880fffd0 0x7f37881958e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.562+0000 7f378d11b700 1 -- 172.21.15.73:0/2221925543 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37780095f0 con 0x7f37880fede0 2023-08-10T11:51:02.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.562+0000 7f378c91a700 1 --2- 172.21.15.73:0/2221925543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37880fffd0 0x7f37881958e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:51:02.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.563+0000 7f378d11b700 1 --2- 172.21.15.73:0/2221925543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37880fede0 0x7f37881953a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3778009990 tx=0x7f3778003af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:02.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.563+0000 7f377e7fc700 1 -- 172.21.15.73:0/2221925543 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377801d070 con 0x7f37880fede0 2023-08-10T11:51:02.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.563+0000 7f378f37f700 1 -- 172.21.15.73:0/2221925543 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f378819d470 con 0x7f37880fede0 2023-08-10T11:51:02.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.563+0000 7f377e7fc700 1 -- 172.21.15.73:0/2221925543 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3778004640 con 0x7f37880fede0 2023-08-10T11:51:02.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.563+0000 7f377e7fc700 1 -- 172.21.15.73:0/2221925543 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377800f460 con 0x7f37880fede0 2023-08-10T11:51:02.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.563+0000 7f378f37f700 1 -- 172.21.15.73:0/2221925543 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f378819d920 con 0x7f37880fede0 2023-08-10T11:51:02.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.564+0000 7f378f37f700 1 -- 172.21.15.73:0/2221925543 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37881059b0 con 0x7f37880fede0 2023-08-10T11:51:02.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.565+0000 7f377e7fc700 1 -- 172.21.15.73:0/2221925543 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f3778003fa0 con 0x7f37880fede0 2023-08-10T11:51:02.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.566+0000 7f377e7fc700 1 --2- 172.21.15.73:0/2221925543 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f37740a1220 0x7f37740a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:02.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.566+0000 7f378c91a700 1 --2- 172.21.15.73:0/2221925543 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f37740a1220 0x7f37740a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:02.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.566+0000 7f377e7fc700 1 -- 172.21.15.73:0/2221925543 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f37780cdd60 con 0x7f37880fede0 2023-08-10T11:51:02.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.566+0000 7f378c91a700 1 --2- 172.21.15.73:0/2221925543 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f37740a1220 0x7f37740a36e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f37840099d0 tx=0x7f3784008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:02.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.570+0000 7f377e7fc700 1 -- 172.21.15.73:0/2221925543 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f37780976a0 con 0x7f37880fede0 2023-08-10T11:51:02.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.754+0000 7f378f37f700 1 -- 172.21.15.73:0/2221925543 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3788060bb0 con 0x7f37740a1220 2023-08-10T11:51:02.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.764+0000 7f377e7fc700 1 -- 172.21.15.73:0/2221925543 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336442 (secure 0 0 0) 0x7f3788060bb0 con 0x7f37740a1220 2023-08-10T11:51:02.768 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:51:02.771 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:02 smithi073 ceph-mon[128869]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:51:02.771 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:02 smithi073 ceph-mon[128869]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:51:02.771 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:02 smithi073 ceph-mon[128869]: mds.? [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] up:active 2023-08-10T11:51:02.771 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:02 smithi073 ceph-mon[128869]: fsmap cephfs:5 2 up:standby-replay 5 up:standby 5 up:active 2023-08-10T11:51:02.771 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:02 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:51:02.772 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:02 smithi073 ceph-mon[128869]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:51:02.772 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:02 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3515520464' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:51:02.772 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:02 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2298111141' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:51:02.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.767+0000 7f378f37f700 1 -- 172.21.15.73:0/2221925543 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f37740a1220 msgr2=0x7f37740a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:02.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.767+0000 7f378f37f700 1 --2- 172.21.15.73:0/2221925543 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f37740a1220 0x7f37740a36e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f37840099d0 tx=0x7f3784008040 comp rx=0 tx=0).stop 2023-08-10T11:51:02.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.767+0000 7f378f37f700 1 -- 172.21.15.73:0/2221925543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37880fede0 msgr2=0x7f37881953a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:02.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.767+0000 7f378f37f700 1 --2- 172.21.15.73:0/2221925543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37880fede0 0x7f37881953a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3778009990 tx=0x7f3778003af0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.767+0000 7f378f37f700 1 -- 172.21.15.73:0/2221925543 shutdown_connections 2023-08-10T11:51:02.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.767+0000 7f378f37f700 1 --2- 172.21.15.73:0/2221925543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3788100970 0x7f378819c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.767+0000 7f378f37f700 1 --2- 172.21.15.73:0/2221925543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37880fede0 0x7f37881953a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.767+0000 7f378f37f700 1 --2- 172.21.15.73:0/2221925543 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f37740a1220 0x7f37740a36e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.767+0000 7f378f37f700 1 --2- 172.21.15.73:0/2221925543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37880fffd0 0x7f37881958e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.767+0000 7f378f37f700 1 -- 172.21.15.73:0/2221925543 >> 172.21.15.73:0/2221925543 conn(0x7f37880fa330 msgr2=0x7f37880fbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:02.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.767+0000 7f378f37f700 1 -- 172.21.15.73:0/2221925543 shutdown_connections 2023-08-10T11:51:02.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.767+0000 7f378f37f700 1 -- 172.21.15.73:0/2221925543 wait complete. 2023-08-10T11:51:02.774 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-08-10T11:51:02.780 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2023-08-10T11:51:02.477908+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596500,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":158,"num_read_kb":135,"num_write":333,"num_write_kb":2980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":283,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336692,"kb_used_data":12492,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124605132,"statfs":{"total":1151940427776,"available":1151595655168,"internally_reserved":0,"allocated":12791808,"data_stored":6952003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6132,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":152,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001914"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.145138+0000","last_change":"2023-08-10T11:50:54.902569+0000","last_active":"2023-08-10T11:50:56.145138+0000","last_peered":"2023-08-10T11:50:56.145138+0000","last_clean":"2023-08-10T11:50:56.145138+0000","last_became_active":"2023-08-10T11:50:54.902058+0000","last_became_peered":"2023-08-10T11:50:54.902058+0000","last_unstale":"2023-08-10T11:50:56.145138+0000","last_undegraded":"2023-08-10T11:50:56.145138+0000","last_fullsized":"2023-08-10T11:50:56.145138+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:21:13.051534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345827+0000","last_change":"2023-08-10T11:50:54.942908+0000","last_active":"2023-08-10T11:50:56.345827+0000","last_peered":"2023-08-10T11:50:56.345827+0000","last_clean":"2023-08-10T11:50:56.345827+0000","last_became_active":"2023-08-10T11:50:54.941765+0000","last_became_peered":"2023-08-10T11:50:54.941765+0000","last_unstale":"2023-08-10T11:50:56.345827+0000","last_undegraded":"2023-08-10T11:50:56.345827+0000","last_fullsized":"2023-08-10T11:50:56.345827+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:23:25.198276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345991+0000","last_change":"2023-08-10T11:50:54.940670+0000","last_active":"2023-08-10T11:50:56.345991+0000","last_peered":"2023-08-10T11:50:56.345991+0000","last_clean":"2023-08-10T11:50:56.345991+0000","last_became_active":"2023-08-10T11:50:54.939906+0000","last_became_peered":"2023-08-10T11:50:54.939906+0000","last_unstale":"2023-08-10T11:50:56.345991+0000","last_undegraded":"2023-08-10T11:50:56.345991+0000","last_fullsized":"2023-08-10T11:50:56.345991+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:49:22.795335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.135449+0000","last_change":"2023-08-10T11:50:54.910964+0000","last_active":"2023-08-10T11:50:56.135449+0000","last_peered":"2023-08-10T11:50:56.135449+0000","last_clean":"2023-08-10T11:50:56.135449+0000","last_became_active":"2023-08-10T11:50:54.910185+0000","last_became_peered":"2023-08-10T11:50:54.910185+0000","last_unstale":"2023-08-10T11:50:56.135449+0000","last_undegraded":"2023-08-10T11:50:56.135449+0000","last_fullsized":"2023-08-10T11:50:56.135449+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:23:05.579094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344998+0000","last_change":"2023-08-10T11:50:54.905354+0000","last_active":"2023-08-10T11:50:56.344998+0000","last_peered":"2023-08-10T11:50:56.344998+0000","last_clean":"2023-08-10T11:50:56.344998+0000","last_became_active":"2023-08-10T11:50:54.904982+0000","last_became_peered":"2023-08-10T11:50:54.904982+0000","last_unstale":"2023-08-10T11:50:56.344998+0000","last_undegraded":"2023-08-10T11:50:56.344998+0000","last_fullsized":"2023-08-10T11:50:56.344998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:29:30.470234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344628+0000","last_change":"2023-08-10T11:50:54.907024+0000","last_active":"2023-08-10T11:50:56.344628+0000","last_peered":"2023-08-10T11:50:56.344628+0000","last_clean":"2023-08-10T11:50:56.344628+0000","last_became_active":"2023-08-10T11:50:54.906590+0000","last_became_peered":"2023-08-10T11:50:54.906590+0000","last_unstale":"2023-08-10T11:50:56.344628+0000","last_undegraded":"2023-08-10T11:50:56.344628+0000","last_fullsized":"2023-08-10T11:50:56.344628+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:33:20.006347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473505+0000","last_change":"2023-08-10T11:50:54.904604+0000","last_active":"2023-08-10T11:50:56.473505+0000","last_peered":"2023-08-10T11:50:56.473505+0000","last_clean":"2023-08-10T11:50:56.473505+0000","last_became_active":"2023-08-10T11:50:54.904295+0000","last_became_peered":"2023-08-10T11:50:54.904295+0000","last_unstale":"2023-08-10T11:50:56.473505+0000","last_undegraded":"2023-08-10T11:50:56.473505+0000","last_fullsized":"2023-08-10T11:50:56.473505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:11:15.957227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344786+0000","last_change":"2023-08-10T11:50:54.963398+0000","last_active":"2023-08-10T11:50:56.344786+0000","last_peered":"2023-08-10T11:50:56.344786+0000","last_clean":"2023-08-10T11:50:56.344786+0000","last_became_active":"2023-08-10T11:50:54.963048+0000","last_became_peered":"2023-08-10T11:50:54.963048+0000","last_unstale":"2023-08-10T11:50:56.344786+0000","last_undegraded":"2023-08-10T11:50:56.344786+0000","last_fullsized":"2023-08-10T11:50:56.344786+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:05:56.018291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.892886+0000","last_change":"2023-08-10T11:50:54.913426+0000","last_active":"2023-08-10T11:50:55.892886+0000","last_peered":"2023-08-10T11:50:55.892886+0000","last_clean":"2023-08-10T11:50:55.892886+0000","last_became_active":"2023-08-10T11:50:54.913099+0000","last_became_peered":"2023-08-10T11:50:54.913099+0000","last_unstale":"2023-08-10T11:50:55.892886+0000","last_undegraded":"2023-08-10T11:50:55.892886+0000","last_fullsized":"2023-08-10T11:50:55.892886+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:43:10.881941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344828+0000","last_change":"2023-08-10T11:50:54.909259+0000","last_active":"2023-08-10T11:50:56.344828+0000","last_peered":"2023-08-10T11:50:56.344828+0000","last_clean":"2023-08-10T11:50:56.344828+0000","last_became_active":"2023-08-10T11:50:54.908898+0000","last_became_peered":"2023-08-10T11:50:54.908898+0000","last_unstale":"2023-08-10T11:50:56.344828+0000","last_undegraded":"2023-08-10T11:50:56.344828+0000","last_fullsized":"2023-08-10T11:50:56.344828+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:34:33.846938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473995+0000","last_change":"2023-08-10T11:50:54.906152+0000","last_active":"2023-08-10T11:50:56.473995+0000","last_peered":"2023-08-10T11:50:56.473995+0000","last_clean":"2023-08-10T11:50:56.473995+0000","last_became_active":"2023-08-10T11:50:54.905859+0000","last_became_peered":"2023-08-10T11:50:54.905859+0000","last_unstale":"2023-08-10T11:50:56.473995+0000","last_undegraded":"2023-08-10T11:50:56.473995+0000","last_fullsized":"2023-08-10T11:50:56.473995+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:58:19.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.135354+0000","last_change":"2023-08-10T11:50:54.911195+0000","last_active":"2023-08-10T11:50:56.135354+0000","last_peered":"2023-08-10T11:50:56.135354+0000","last_clean":"2023-08-10T11:50:56.135354+0000","last_became_active":"2023-08-10T11:50:54.910618+0000","last_became_peered":"2023-08-10T11:50:54.910618+0000","last_unstale":"2023-08-10T11:50:56.135354+0000","last_undegraded":"2023-08-10T11:50:56.135354+0000","last_fullsized":"2023-08-10T11:50:56.135354+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:09:17.323010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.346048+0000","last_change":"2023-08-10T11:50:54.908051+0000","last_active":"2023-08-10T11:50:56.346048+0000","last_peered":"2023-08-10T11:50:56.346048+0000","last_clean":"2023-08-10T11:50:56.346048+0000","last_became_active":"2023-08-10T11:50:54.907772+0000","last_became_peered":"2023-08-10T11:50:54.907772+0000","last_unstale":"2023-08-10T11:50:56.346048+0000","last_undegraded":"2023-08-10T11:50:56.346048+0000","last_fullsized":"2023-08-10T11:50:56.346048+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:37:48.360047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344774+0000","last_change":"2023-08-10T11:50:54.941327+0000","last_active":"2023-08-10T11:50:56.344774+0000","last_peered":"2023-08-10T11:50:56.344774+0000","last_clean":"2023-08-10T11:50:56.344774+0000","last_became_active":"2023-08-10T11:50:54.941020+0000","last_became_peered":"2023-08-10T11:50:54.941020+0000","last_unstale":"2023-08-10T11:50:56.344774+0000","last_undegraded":"2023-08-10T11:50:56.344774+0000","last_fullsized":"2023-08-10T11:50:56.344774+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:57:02.124392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345409+0000","last_change":"2023-08-10T11:50:54.940236+0000","last_active":"2023-08-10T11:50:56.345409+0000","last_peered":"2023-08-10T11:50:56.345409+0000","last_clean":"2023-08-10T11:50:56.345409+0000","last_became_active":"2023-08-10T11:50:54.939921+0000","last_became_peered":"2023-08-10T11:50:54.939921+0000","last_unstale":"2023-08-10T11:50:56.345409+0000","last_undegraded":"2023-08-10T11:50:56.345409+0000","last_fullsized":"2023-08-10T11:50:56.345409+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:16:17.977836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.892426+0000","last_change":"2023-08-10T11:50:54.903773+0000","last_active":"2023-08-10T11:50:55.892426+0000","last_peered":"2023-08-10T11:50:55.892426+0000","last_clean":"2023-08-10T11:50:55.892426+0000","last_became_active":"2023-08-10T11:50:54.903516+0000","last_became_peered":"2023-08-10T11:50:54.903516+0000","last_unstale":"2023-08-10T11:50:55.892426+0000","last_undegraded":"2023-08-10T11:50:55.892426+0000","last_fullsized":"2023-08-10T11:50:55.892426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:09:52.443125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.145193+0000","last_change":"2023-08-10T11:50:54.902364+0000","last_active":"2023-08-10T11:50:56.145193+0000","last_peered":"2023-08-10T11:50:56.145193+0000","last_clean":"2023-08-10T11:50:56.145193+0000","last_became_active":"2023-08-10T11:50:54.901673+0000","last_became_peered":"2023-08-10T11:50:54.901673+0000","last_unstale":"2023-08-10T11:50:56.145193+0000","last_undegraded":"2023-08-10T11:50:56.145193+0000","last_fullsized":"2023-08-10T11:50:56.145193+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:45:10.264196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890715+0000","last_change":"2023-08-10T11:50:54.911896+0000","last_active":"2023-08-10T11:50:55.890715+0000","last_peered":"2023-08-10T11:50:55.890715+0000","last_clean":"2023-08-10T11:50:55.890715+0000","last_became_active":"2023-08-10T11:50:54.911469+0000","last_became_peered":"2023-08-10T11:50:54.911469+0000","last_unstale":"2023-08-10T11:50:55.890715+0000","last_undegraded":"2023-08-10T11:50:55.890715+0000","last_fullsized":"2023-08-10T11:50:55.890715+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:35:08.075353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890571+0000","last_change":"2023-08-10T11:50:54.964030+0000","last_active":"2023-08-10T11:50:55.890571+0000","last_peered":"2023-08-10T11:50:55.890571+0000","last_clean":"2023-08-10T11:50:55.890571+0000","last_became_active":"2023-08-10T11:50:54.963744+0000","last_became_peered":"2023-08-10T11:50:54.963744+0000","last_unstale":"2023-08-10T11:50:55.890571+0000","last_undegraded":"2023-08-10T11:50:55.890571+0000","last_fullsized":"2023-08-10T11:50:55.890571+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:46.590044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'11","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:59.510929+0000","last_change":"2023-08-10T11:50:53.905439+0000","last_active":"2023-08-10T11:50:59.510929+0000","last_peered":"2023-08-10T11:50:59.510929+0000","last_clean":"2023-08-10T11:50:59.510929+0000","last_became_active":"2023-08-10T11:50:53.905172+0000","last_became_peered":"2023-08-10T11:50:53.905172+0000","last_unstale":"2023-08-10T11:50:59.510929+0000","last_undegraded":"2023-08-10T11:50:59.510929+0000","last_fullsized":"2023-08-10T11:50:59.510929+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:31:40.730660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345671+0000","last_change":"2023-08-10T11:50:54.961422+0000","last_active":"2023-08-10T11:50:56.345671+0000","last_peered":"2023-08-10T11:50:56.345671+0000","last_clean":"2023-08-10T11:50:56.345671+0000","last_became_active":"2023-08-10T11:50:54.960627+0000","last_became_peered":"2023-08-10T11:50:54.960627+0000","last_unstale":"2023-08-10T11:50:56.345671+0000","last_undegraded":"2023-08-10T11:50:56.345671+0000","last_fullsized":"2023-08-10T11:50:56.345671+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:10:30.642466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345880+0000","last_change":"2023-08-10T11:50:53.907291+0000","last_active":"2023-08-10T11:50:56.345880+0000","last_peered":"2023-08-10T11:50:56.345880+0000","last_clean":"2023-08-10T11:50:56.345880+0000","last_became_active":"2023-08-10T11:50:53.906997+0000","last_became_peered":"2023-08-10T11:50:53.906997+0000","last_unstale":"2023-08-10T11:50:56.345880+0000","last_undegraded":"2023-08-10T11:50:56.345880+0000","last_fullsized":"2023-08-10T11:50:56.345880+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:52:16.544854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344895+0000","last_change":"2023-08-10T11:50:54.940828+0000","last_active":"2023-08-10T11:50:56.344895+0000","last_peered":"2023-08-10T11:50:56.344895+0000","last_clean":"2023-08-10T11:50:56.344895+0000","last_became_active":"2023-08-10T11:50:54.940169+0000","last_became_peered":"2023-08-10T11:50:54.940169+0000","last_unstale":"2023-08-10T11:50:56.344895+0000","last_undegraded":"2023-08-10T11:50:56.344895+0000","last_fullsized":"2023-08-10T11:50:56.344895+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:45:59.866028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345167+0000","last_change":"2023-08-10T11:50:53.906366+0000","last_active":"2023-08-10T11:50:56.345167+0000","last_peered":"2023-08-10T11:50:56.345167+0000","last_clean":"2023-08-10T11:50:56.345167+0000","last_became_active":"2023-08-10T11:50:53.906057+0000","last_became_peered":"2023-08-10T11:50:53.906057+0000","last_unstale":"2023-08-10T11:50:56.345167+0000","last_undegraded":"2023-08-10T11:50:56.345167+0000","last_fullsized":"2023-08-10T11:50:56.345167+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:59:44.567315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.892532+0000","last_change":"2023-08-10T11:50:54.908534+0000","last_active":"2023-08-10T11:50:55.892532+0000","last_peered":"2023-08-10T11:50:55.892532+0000","last_clean":"2023-08-10T11:50:55.892532+0000","last_became_active":"2023-08-10T11:50:54.908244+0000","last_became_peered":"2023-08-10T11:50:54.908244+0000","last_unstale":"2023-08-10T11:50:55.892532+0000","last_undegraded":"2023-08-10T11:50:55.892532+0000","last_fullsized":"2023-08-10T11:50:55.892532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:55:51.466202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345089+0000","last_change":"2023-08-10T11:50:53.902325+0000","last_active":"2023-08-10T11:50:56.345089+0000","last_peered":"2023-08-10T11:50:56.345089+0000","last_clean":"2023-08-10T11:50:56.345089+0000","last_became_active":"2023-08-10T11:50:53.902020+0000","last_became_peered":"2023-08-10T11:50:53.902020+0000","last_unstale":"2023-08-10T11:50:56.345089+0000","last_undegraded":"2023-08-10T11:50:56.345089+0000","last_fullsized":"2023-08-10T11:50:56.345089+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:54.005452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345744+0000","last_change":"2023-08-10T11:50:54.910291+0000","last_active":"2023-08-10T11:50:56.345744+0000","last_peered":"2023-08-10T11:50:56.345744+0000","last_clean":"2023-08-10T11:50:56.345744+0000","last_became_active":"2023-08-10T11:50:54.909886+0000","last_became_peered":"2023-08-10T11:50:54.909886+0000","last_unstale":"2023-08-10T11:50:56.345744+0000","last_undegraded":"2023-08-10T11:50:56.345744+0000","last_fullsized":"2023-08-10T11:50:56.345744+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:32:04.741805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'5","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.505657+0000","last_change":"2023-08-10T11:50:53.904363+0000","last_active":"2023-08-10T11:51:00.505657+0000","last_peered":"2023-08-10T11:51:00.505657+0000","last_clean":"2023-08-10T11:51:00.505657+0000","last_became_active":"2023-08-10T11:50:53.904049+0000","last_became_peered":"2023-08-10T11:50:53.904049+0000","last_unstale":"2023-08-10T11:51:00.505657+0000","last_undegraded":"2023-08-10T11:51:00.505657+0000","last_fullsized":"2023-08-10T11:51:00.505657+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:49:25.423370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344983+0000","last_change":"2023-08-10T11:50:54.912189+0000","last_active":"2023-08-10T11:50:56.344983+0000","last_peered":"2023-08-10T11:50:56.344983+0000","last_clean":"2023-08-10T11:50:56.344983+0000","last_became_active":"2023-08-10T11:50:54.911884+0000","last_became_peered":"2023-08-10T11:50:54.911884+0000","last_unstale":"2023-08-10T11:50:56.344983+0000","last_undegraded":"2023-08-10T11:50:56.344983+0000","last_fullsized":"2023-08-10T11:50:56.344983+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:40:25.019116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:59.515415+0000","last_change":"2023-08-10T11:50:53.901161+0000","last_active":"2023-08-10T11:50:59.515415+0000","last_peered":"2023-08-10T11:50:59.515415+0000","last_clean":"2023-08-10T11:50:59.515415+0000","last_became_active":"2023-08-10T11:50:53.900806+0000","last_became_peered":"2023-08-10T11:50:53.900806+0000","last_unstale":"2023-08-10T11:50:59.515415+0000","last_undegraded":"2023-08-10T11:50:59.515415+0000","last_fullsized":"2023-08-10T11:50:59.515415+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:33:49.410246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345263+0000","last_change":"2023-08-10T11:50:54.905753+0000","last_active":"2023-08-10T11:50:56.345263+0000","last_peered":"2023-08-10T11:50:56.345263+0000","last_clean":"2023-08-10T11:50:56.345263+0000","last_became_active":"2023-08-10T11:50:54.905463+0000","last_became_peered":"2023-08-10T11:50:54.905463+0000","last_unstale":"2023-08-10T11:50:56.345263+0000","last_undegraded":"2023-08-10T11:50:56.345263+0000","last_fullsized":"2023-08-10T11:50:56.345263+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:40:18.150871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:58.508650+0000","last_change":"2023-08-10T11:50:53.895021+0000","last_active":"2023-08-10T11:50:58.508650+0000","last_peered":"2023-08-10T11:50:58.508650+0000","last_clean":"2023-08-10T11:50:58.508650+0000","last_became_active":"2023-08-10T11:50:53.894732+0000","last_became_peered":"2023-08-10T11:50:53.894732+0000","last_unstale":"2023-08-10T11:50:58.508650+0000","last_undegraded":"2023-08-10T11:50:58.508650+0000","last_fullsized":"2023-08-10T11:50:58.508650+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:33:34.799950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344648+0000","last_change":"2023-08-10T11:50:54.957771+0000","last_active":"2023-08-10T11:50:56.344648+0000","last_peered":"2023-08-10T11:50:56.344648+0000","last_clean":"2023-08-10T11:50:56.344648+0000","last_became_active":"2023-08-10T11:50:54.901503+0000","last_became_peered":"2023-08-10T11:50:54.901503+0000","last_unstale":"2023-08-10T11:50:56.344648+0000","last_undegraded":"2023-08-10T11:50:56.344648+0000","last_fullsized":"2023-08-10T11:50:56.344648+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:44:27.828963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.530556+0000","last_change":"2023-08-10T11:50:53.899939+0000","last_active":"2023-08-10T11:51:00.530556+0000","last_peered":"2023-08-10T11:51:00.530556+0000","last_clean":"2023-08-10T11:51:00.530556+0000","last_became_active":"2023-08-10T11:50:53.899648+0000","last_became_peered":"2023-08-10T11:50:53.899648+0000","last_unstale":"2023-08-10T11:51:00.530556+0000","last_undegraded":"2023-08-10T11:51:00.530556+0000","last_fullsized":"2023-08-10T11:51:00.530556+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:24:46.642939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890464+0000","last_change":"2023-08-10T11:50:54.959487+0000","last_active":"2023-08-10T11:50:55.890464+0000","last_peered":"2023-08-10T11:50:55.890464+0000","last_clean":"2023-08-10T11:50:55.890464+0000","last_became_active":"2023-08-10T11:50:54.959153+0000","last_became_peered":"2023-08-10T11:50:54.959153+0000","last_unstale":"2023-08-10T11:50:55.890464+0000","last_undegraded":"2023-08-10T11:50:55.890464+0000","last_fullsized":"2023-08-10T11:50:55.890464+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:38:55.933145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:59.503734+0000","last_change":"2023-08-10T11:50:53.898037+0000","last_active":"2023-08-10T11:50:59.503734+0000","last_peered":"2023-08-10T11:50:59.503734+0000","last_clean":"2023-08-10T11:50:59.503734+0000","last_became_active":"2023-08-10T11:50:53.897715+0000","last_became_peered":"2023-08-10T11:50:53.897715+0000","last_unstale":"2023-08-10T11:50:59.503734+0000","last_undegraded":"2023-08-10T11:50:59.503734+0000","last_fullsized":"2023-08-10T11:50:59.503734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:42:02.005233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.892809+0000","last_change":"2023-08-10T11:50:54.908337+0000","last_active":"2023-08-10T11:50:55.892809+0000","last_peered":"2023-08-10T11:50:55.892809+0000","last_clean":"2023-08-10T11:50:55.892809+0000","last_became_active":"2023-08-10T11:50:54.907990+0000","last_became_peered":"2023-08-10T11:50:54.907990+0000","last_unstale":"2023-08-10T11:50:55.892809+0000","last_undegraded":"2023-08-10T11:50:55.892809+0000","last_fullsized":"2023-08-10T11:50:55.892809+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:44:47.081301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.530242+0000","last_change":"2023-08-10T11:50:53.901498+0000","last_active":"2023-08-10T11:51:00.530242+0000","last_peered":"2023-08-10T11:51:00.530242+0000","last_clean":"2023-08-10T11:51:00.530242+0000","last_became_active":"2023-08-10T11:50:53.901146+0000","last_became_peered":"2023-08-10T11:50:53.901146+0000","last_unstale":"2023-08-10T11:51:00.530242+0000","last_undegraded":"2023-08-10T11:51:00.530242+0000","last_fullsized":"2023-08-10T11:51:00.530242+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:52:15.837576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345035+0000","last_change":"2023-08-10T11:50:54.901550+0000","last_active":"2023-08-10T11:50:56.345035+0000","last_peered":"2023-08-10T11:50:56.345035+0000","last_clean":"2023-08-10T11:50:56.345035+0000","last_became_active":"2023-08-10T11:50:54.901214+0000","last_became_peered":"2023-08-10T11:50:54.901214+0000","last_unstale":"2023-08-10T11:50:56.345035+0000","last_undegraded":"2023-08-10T11:50:56.345035+0000","last_fullsized":"2023-08-10T11:50:56.345035+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:11:47.883894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:58.501883+0000","last_change":"2023-08-10T11:50:53.901337+0000","last_active":"2023-08-10T11:50:58.501883+0000","last_peered":"2023-08-10T11:50:58.501883+0000","last_clean":"2023-08-10T11:50:58.501883+0000","last_became_active":"2023-08-10T11:50:53.901005+0000","last_became_peered":"2023-08-10T11:50:53.901005+0000","last_unstale":"2023-08-10T11:50:58.501883+0000","last_undegraded":"2023-08-10T11:50:58.501883+0000","last_fullsized":"2023-08-10T11:50:58.501883+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:11:24.161362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.892656+0000","last_change":"2023-08-10T11:50:54.905466+0000","last_active":"2023-08-10T11:50:55.892656+0000","last_peered":"2023-08-10T11:50:55.892656+0000","last_clean":"2023-08-10T11:50:55.892656+0000","last_became_active":"2023-08-10T11:50:54.905175+0000","last_became_peered":"2023-08-10T11:50:54.905175+0000","last_unstale":"2023-08-10T11:50:55.892656+0000","last_undegraded":"2023-08-10T11:50:55.892656+0000","last_fullsized":"2023-08-10T11:50:55.892656+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:49:14.630996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'9","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:59.505720+0000","last_change":"2023-08-10T11:50:53.894717+0000","last_active":"2023-08-10T11:50:59.505720+0000","last_peered":"2023-08-10T11:50:59.505720+0000","last_clean":"2023-08-10T11:50:59.505720+0000","last_became_active":"2023-08-10T11:50:53.894390+0000","last_became_peered":"2023-08-10T11:50:53.894390+0000","last_unstale":"2023-08-10T11:50:59.505720+0000","last_undegraded":"2023-08-10T11:50:59.505720+0000","last_fullsized":"2023-08-10T11:50:59.505720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:55:07.872465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1954,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344895+0000","last_change":"2023-08-10T11:50:54.908021+0000","last_active":"2023-08-10T11:50:56.344895+0000","last_peered":"2023-08-10T11:50:56.344895+0000","last_clean":"2023-08-10T11:50:56.344895+0000","last_became_active":"2023-08-10T11:50:54.907527+0000","last_became_peered":"2023-08-10T11:50:54.907527+0000","last_unstale":"2023-08-10T11:50:56.344895+0000","last_undegraded":"2023-08-10T11:50:56.344895+0000","last_fullsized":"2023-08-10T11:50:56.344895+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:31:57.299713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890510+0000","last_change":"2023-08-10T11:50:53.906448+0000","last_active":"2023-08-10T11:50:55.890510+0000","last_peered":"2023-08-10T11:50:55.890510+0000","last_clean":"2023-08-10T11:50:55.890510+0000","last_became_active":"2023-08-10T11:50:53.906157+0000","last_became_peered":"2023-08-10T11:50:53.906157+0000","last_unstale":"2023-08-10T11:50:55.890510+0000","last_undegraded":"2023-08-10T11:50:55.890510+0000","last_fullsized":"2023-08-10T11:50:55.890510+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:39.418056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345339+0000","last_change":"2023-08-10T11:50:54.906467+0000","last_active":"2023-08-10T11:50:56.345339+0000","last_peered":"2023-08-10T11:50:56.345339+0000","last_clean":"2023-08-10T11:50:56.345339+0000","last_became_active":"2023-08-10T11:50:54.901119+0000","last_became_peered":"2023-08-10T11:50:54.901119+0000","last_unstale":"2023-08-10T11:50:56.345339+0000","last_undegraded":"2023-08-10T11:50:56.345339+0000","last_fullsized":"2023-08-10T11:50:56.345339+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:16.266709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.530526+0000","last_change":"2023-08-10T11:50:53.906435+0000","last_active":"2023-08-10T11:51:00.530526+0000","last_peered":"2023-08-10T11:51:00.530526+0000","last_clean":"2023-08-10T11:51:00.530526+0000","last_became_active":"2023-08-10T11:50:53.905545+0000","last_became_peered":"2023-08-10T11:50:53.905545+0000","last_unstale":"2023-08-10T11:51:00.530526+0000","last_undegraded":"2023-08-10T11:51:00.530526+0000","last_fullsized":"2023-08-10T11:51:00.530526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:26:54.882060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473837+0000","last_change":"2023-08-10T11:50:54.903127+0000","last_active":"2023-08-10T11:50:56.473837+0000","last_peered":"2023-08-10T11:50:56.473837+0000","last_clean":"2023-08-10T11:50:56.473837+0000","last_became_active":"2023-08-10T11:50:54.902805+0000","last_became_peered":"2023-08-10T11:50:54.902805+0000","last_unstale":"2023-08-10T11:50:56.473837+0000","last_undegraded":"2023-08-10T11:50:56.473837+0000","last_fullsized":"2023-08-10T11:50:56.473837+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:58:40.949478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:59.511554+0000","last_change":"2023-08-10T11:50:53.898252+0000","last_active":"2023-08-10T11:50:59.511554+0000","last_peered":"2023-08-10T11:50:59.511554+0000","last_clean":"2023-08-10T11:50:59.511554+0000","last_became_active":"2023-08-10T11:50:53.897992+0000","last_became_peered":"2023-08-10T11:50:53.897992+0000","last_unstale":"2023-08-10T11:50:59.511554+0000","last_undegraded":"2023-08-10T11:50:59.511554+0000","last_fullsized":"2023-08-10T11:50:59.511554+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:34:51.658646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473681+0000","last_change":"2023-08-10T11:50:54.913297+0000","last_active":"2023-08-10T11:50:56.473681+0000","last_peered":"2023-08-10T11:50:56.473681+0000","last_clean":"2023-08-10T11:50:56.473681+0000","last_became_active":"2023-08-10T11:50:54.912997+0000","last_became_peered":"2023-08-10T11:50:54.912997+0000","last_unstale":"2023-08-10T11:50:56.473681+0000","last_undegraded":"2023-08-10T11:50:56.473681+0000","last_fullsized":"2023-08-10T11:50:56.473681+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:40:06.862890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'10","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:57.925515+0000","last_change":"2023-08-10T11:50:53.904095+0000","last_active":"2023-08-10T11:50:57.925515+0000","last_peered":"2023-08-10T11:50:57.925515+0000","last_clean":"2023-08-10T11:50:57.925515+0000","last_became_active":"2023-08-10T11:50:53.903712+0000","last_became_peered":"2023-08-10T11:50:53.903712+0000","last_unstale":"2023-08-10T11:50:57.925515+0000","last_undegraded":"2023-08-10T11:50:57.925515+0000","last_fullsized":"2023-08-10T11:50:57.925515+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:52:43.075450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345492+0000","last_change":"2023-08-10T11:50:54.904763+0000","last_active":"2023-08-10T11:50:56.345492+0000","last_peered":"2023-08-10T11:50:56.345492+0000","last_clean":"2023-08-10T11:50:56.345492+0000","last_became_active":"2023-08-10T11:50:54.904467+0000","last_became_peered":"2023-08-10T11:50:54.904467+0000","last_unstale":"2023-08-10T11:50:56.345492+0000","last_undegraded":"2023-08-10T11:50:56.345492+0000","last_fullsized":"2023-08-10T11:50:56.345492+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:18:23.751856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345391+0000","last_change":"2023-08-10T11:50:53.904605+0000","last_active":"2023-08-10T11:50:56.345391+0000","last_peered":"2023-08-10T11:50:56.345391+0000","last_clean":"2023-08-10T11:50:56.345391+0000","last_became_active":"2023-08-10T11:50:53.904236+0000","last_became_peered":"2023-08-10T11:50:53.904236+0000","last_unstale":"2023-08-10T11:50:56.345391+0000","last_undegraded":"2023-08-10T11:50:56.345391+0000","last_fullsized":"2023-08-10T11:50:56.345391+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:31:26.574828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.144909+0000","last_change":"2023-08-10T11:50:54.903881+0000","last_active":"2023-08-10T11:50:56.144909+0000","last_peered":"2023-08-10T11:50:56.144909+0000","last_clean":"2023-08-10T11:50:56.144909+0000","last_became_active":"2023-08-10T11:50:54.903563+0000","last_became_peered":"2023-08-10T11:50:54.903563+0000","last_unstale":"2023-08-10T11:50:56.144909+0000","last_undegraded":"2023-08-10T11:50:56.144909+0000","last_fullsized":"2023-08-10T11:50:56.144909+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:23:32.901460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890795+0000","last_change":"2023-08-10T11:50:53.905320+0000","last_active":"2023-08-10T11:50:55.890795+0000","last_peered":"2023-08-10T11:50:55.890795+0000","last_clean":"2023-08-10T11:50:55.890795+0000","last_became_active":"2023-08-10T11:50:53.905057+0000","last_became_peered":"2023-08-10T11:50:53.905057+0000","last_unstale":"2023-08-10T11:50:55.890795+0000","last_undegraded":"2023-08-10T11:50:55.890795+0000","last_fullsized":"2023-08-10T11:50:55.890795+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:10:35.476026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344880+0000","last_change":"2023-08-10T11:50:54.906531+0000","last_active":"2023-08-10T11:50:56.344880+0000","last_peered":"2023-08-10T11:50:56.344880+0000","last_clean":"2023-08-10T11:50:56.344880+0000","last_became_active":"2023-08-10T11:50:54.906239+0000","last_became_peered":"2023-08-10T11:50:54.906239+0000","last_unstale":"2023-08-10T11:50:56.344880+0000","last_undegraded":"2023-08-10T11:50:56.344880+0000","last_fullsized":"2023-08-10T11:50:56.344880+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:11:52.732611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.530611+0000","last_change":"2023-08-10T11:50:53.899835+0000","last_active":"2023-08-10T11:51:00.530611+0000","last_peered":"2023-08-10T11:51:00.530611+0000","last_clean":"2023-08-10T11:51:00.530611+0000","last_became_active":"2023-08-10T11:50:53.898318+0000","last_became_peered":"2023-08-10T11:50:53.898318+0000","last_unstale":"2023-08-10T11:51:00.530611+0000","last_undegraded":"2023-08-10T11:51:00.530611+0000","last_fullsized":"2023-08-10T11:51:00.530611+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:02:07.071804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344832+0000","last_change":"2023-08-10T11:50:54.905941+0000","last_active":"2023-08-10T11:50:56.344832+0000","last_peered":"2023-08-10T11:50:56.344832+0000","last_clean":"2023-08-10T11:50:56.344832+0000","last_became_active":"2023-08-10T11:50:54.905634+0000","last_became_peered":"2023-08-10T11:50:54.905634+0000","last_unstale":"2023-08-10T11:50:56.344832+0000","last_undegraded":"2023-08-10T11:50:56.344832+0000","last_fullsized":"2023-08-10T11:50:56.344832+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:53:51.516739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345241+0000","last_change":"2023-08-10T11:50:54.910544+0000","last_active":"2023-08-10T11:50:56.345241+0000","last_peered":"2023-08-10T11:50:56.345241+0000","last_clean":"2023-08-10T11:50:56.345241+0000","last_became_active":"2023-08-10T11:50:54.910210+0000","last_became_peered":"2023-08-10T11:50:54.910210+0000","last_unstale":"2023-08-10T11:50:56.345241+0000","last_undegraded":"2023-08-10T11:50:56.345241+0000","last_fullsized":"2023-08-10T11:50:56.345241+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:33:03.928843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:58.508554+0000","last_change":"2023-08-10T11:50:53.906293+0000","last_active":"2023-08-10T11:50:58.508554+0000","last_peered":"2023-08-10T11:50:58.508554+0000","last_clean":"2023-08-10T11:50:58.508554+0000","last_became_active":"2023-08-10T11:50:53.905998+0000","last_became_peered":"2023-08-10T11:50:53.905998+0000","last_unstale":"2023-08-10T11:50:58.508554+0000","last_undegraded":"2023-08-10T11:50:58.508554+0000","last_fullsized":"2023-08-10T11:50:58.508554+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:37.743171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345578+0000","last_change":"2023-08-10T11:50:54.960147+0000","last_active":"2023-08-10T11:50:56.345578+0000","last_peered":"2023-08-10T11:50:56.345578+0000","last_clean":"2023-08-10T11:50:56.345578+0000","last_became_active":"2023-08-10T11:50:54.959842+0000","last_became_peered":"2023-08-10T11:50:54.959842+0000","last_unstale":"2023-08-10T11:50:56.345578+0000","last_undegraded":"2023-08-10T11:50:56.345578+0000","last_fullsized":"2023-08-10T11:50:56.345578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:12:53.787027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:59.512665+0000","last_change":"2023-08-10T11:50:53.899292+0000","last_active":"2023-08-10T11:50:59.512665+0000","last_peered":"2023-08-10T11:50:59.512665+0000","last_clean":"2023-08-10T11:50:59.512665+0000","last_became_active":"2023-08-10T11:50:53.898917+0000","last_became_peered":"2023-08-10T11:50:53.898917+0000","last_unstale":"2023-08-10T11:50:59.512665+0000","last_undegraded":"2023-08-10T11:50:59.512665+0000","last_fullsized":"2023-08-10T11:50:59.512665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:40:42.574205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":341,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473528+0000","last_change":"2023-08-10T11:49:54.492617+0000","last_active":"2023-08-10T11:50:56.473528+0000","last_peered":"2023-08-10T11:50:56.473528+0000","last_clean":"2023-08-10T11:50:56.473528+0000","last_became_active":"2023-08-10T11:49:54.492146+0000","last_became_peered":"2023-08-10T11:49:54.492146+0000","last_unstale":"2023-08-10T11:50:56.473528+0000","last_undegraded":"2023-08-10T11:50:56.473528+0000","last_fullsized":"2023-08-10T11:50:56.473528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:46:58.862300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:46:58.862300+0000","last_clean_scrub_stamp":"2023-08-10T11:46:58.862300+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:03:46.098279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345147+0000","last_change":"2023-08-10T11:50:54.907704+0000","last_active":"2023-08-10T11:50:56.345147+0000","last_peered":"2023-08-10T11:50:56.345147+0000","last_clean":"2023-08-10T11:50:56.345147+0000","last_became_active":"2023-08-10T11:50:54.907409+0000","last_became_peered":"2023-08-10T11:50:54.907409+0000","last_unstale":"2023-08-10T11:50:56.345147+0000","last_undegraded":"2023-08-10T11:50:56.345147+0000","last_fullsized":"2023-08-10T11:50:56.345147+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:00:55.449902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:58.509272+0000","last_change":"2023-08-10T11:50:53.902548+0000","last_active":"2023-08-10T11:50:58.509272+0000","last_peered":"2023-08-10T11:50:58.509272+0000","last_clean":"2023-08-10T11:50:58.509272+0000","last_became_active":"2023-08-10T11:50:53.902021+0000","last_became_peered":"2023-08-10T11:50:53.902021+0000","last_unstale":"2023-08-10T11:50:58.509272+0000","last_undegraded":"2023-08-10T11:50:58.509272+0000","last_fullsized":"2023-08-10T11:50:58.509272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:49:47.207695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344913+0000","last_change":"2023-08-10T11:50:53.906326+0000","last_active":"2023-08-10T11:50:56.344913+0000","last_peered":"2023-08-10T11:50:56.344913+0000","last_clean":"2023-08-10T11:50:56.344913+0000","last_became_active":"2023-08-10T11:50:53.906017+0000","last_became_peered":"2023-08-10T11:50:53.906017+0000","last_unstale":"2023-08-10T11:50:56.344913+0000","last_undegraded":"2023-08-10T11:50:56.344913+0000","last_fullsized":"2023-08-10T11:50:56.344913+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:20:21.219007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344921+0000","last_change":"2023-08-10T11:50:54.906513+0000","last_active":"2023-08-10T11:50:56.344921+0000","last_peered":"2023-08-10T11:50:56.344921+0000","last_clean":"2023-08-10T11:50:56.344921+0000","last_became_active":"2023-08-10T11:50:54.901642+0000","last_became_peered":"2023-08-10T11:50:54.901642+0000","last_unstale":"2023-08-10T11:50:56.344921+0000","last_undegraded":"2023-08-10T11:50:56.344921+0000","last_fullsized":"2023-08-10T11:50:56.344921+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:37.030936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'7","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:59.513991+0000","last_change":"2023-08-10T11:50:53.908025+0000","last_active":"2023-08-10T11:50:59.513991+0000","last_peered":"2023-08-10T11:50:59.513991+0000","last_clean":"2023-08-10T11:50:59.513991+0000","last_became_active":"2023-08-10T11:50:53.907745+0000","last_became_peered":"2023-08-10T11:50:53.907745+0000","last_unstale":"2023-08-10T11:50:59.513991+0000","last_undegraded":"2023-08-10T11:50:59.513991+0000","last_fullsized":"2023-08-10T11:50:59.513991+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:08:55.888721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345237+0000","last_change":"2023-08-10T11:50:54.958653+0000","last_active":"2023-08-10T11:50:56.345237+0000","last_peered":"2023-08-10T11:50:56.345237+0000","last_clean":"2023-08-10T11:50:56.345237+0000","last_became_active":"2023-08-10T11:50:54.958281+0000","last_became_peered":"2023-08-10T11:50:54.958281+0000","last_unstale":"2023-08-10T11:50:56.345237+0000","last_undegraded":"2023-08-10T11:50:56.345237+0000","last_fullsized":"2023-08-10T11:50:56.345237+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:09:50.615524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.533525+0000","last_change":"2023-08-10T11:50:53.895770+0000","last_active":"2023-08-10T11:51:00.533525+0000","last_peered":"2023-08-10T11:51:00.533525+0000","last_clean":"2023-08-10T11:51:00.533525+0000","last_became_active":"2023-08-10T11:50:53.895433+0000","last_became_peered":"2023-08-10T11:50:53.895433+0000","last_unstale":"2023-08-10T11:51:00.533525+0000","last_undegraded":"2023-08-10T11:51:00.533525+0000","last_fullsized":"2023-08-10T11:51:00.533525+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:22:23.820523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345697+0000","last_change":"2023-08-10T11:50:54.957297+0000","last_active":"2023-08-10T11:50:56.345697+0000","last_peered":"2023-08-10T11:50:56.345697+0000","last_clean":"2023-08-10T11:50:56.345697+0000","last_became_active":"2023-08-10T11:50:54.956966+0000","last_became_peered":"2023-08-10T11:50:54.956966+0000","last_unstale":"2023-08-10T11:50:56.345697+0000","last_undegraded":"2023-08-10T11:50:56.345697+0000","last_fullsized":"2023-08-10T11:50:56.345697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:56:06.035708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:57.926624+0000","last_change":"2023-08-10T11:50:53.897792+0000","last_active":"2023-08-10T11:50:57.926624+0000","last_peered":"2023-08-10T11:50:57.926624+0000","last_clean":"2023-08-10T11:50:57.926624+0000","last_became_active":"2023-08-10T11:50:53.897489+0000","last_became_peered":"2023-08-10T11:50:53.897489+0000","last_unstale":"2023-08-10T11:50:57.926624+0000","last_undegraded":"2023-08-10T11:50:57.926624+0000","last_fullsized":"2023-08-10T11:50:57.926624+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:00.460709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344719+0000","last_change":"2023-08-10T11:50:54.908185+0000","last_active":"2023-08-10T11:50:56.344719+0000","last_peered":"2023-08-10T11:50:56.344719+0000","last_clean":"2023-08-10T11:50:56.344719+0000","last_became_active":"2023-08-10T11:50:54.907649+0000","last_became_peered":"2023-08-10T11:50:54.907649+0000","last_unstale":"2023-08-10T11:50:56.344719+0000","last_undegraded":"2023-08-10T11:50:56.344719+0000","last_fullsized":"2023-08-10T11:50:56.344719+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:33:01.523501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.530584+0000","last_change":"2023-08-10T11:50:53.908748+0000","last_active":"2023-08-10T11:51:00.530584+0000","last_peered":"2023-08-10T11:51:00.530584+0000","last_clean":"2023-08-10T11:51:00.530584+0000","last_became_active":"2023-08-10T11:50:53.908494+0000","last_became_peered":"2023-08-10T11:50:53.908494+0000","last_unstale":"2023-08-10T11:51:00.530584+0000","last_undegraded":"2023-08-10T11:51:00.530584+0000","last_fullsized":"2023-08-10T11:51:00.530584+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:14:25.414218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.144690+0000","last_change":"2023-08-10T11:50:54.903493+0000","last_active":"2023-08-10T11:50:56.144690+0000","last_peered":"2023-08-10T11:50:56.144690+0000","last_clean":"2023-08-10T11:50:56.144690+0000","last_became_active":"2023-08-10T11:50:54.903118+0000","last_became_peered":"2023-08-10T11:50:54.903118+0000","last_unstale":"2023-08-10T11:50:56.144690+0000","last_undegraded":"2023-08-10T11:50:56.144690+0000","last_fullsized":"2023-08-10T11:50:56.144690+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:41:27.663597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890567+0000","last_change":"2023-08-10T11:50:53.905075+0000","last_active":"2023-08-10T11:50:55.890567+0000","last_peered":"2023-08-10T11:50:55.890567+0000","last_clean":"2023-08-10T11:50:55.890567+0000","last_became_active":"2023-08-10T11:50:53.904769+0000","last_became_peered":"2023-08-10T11:50:53.904769+0000","last_unstale":"2023-08-10T11:50:55.890567+0000","last_undegraded":"2023-08-10T11:50:55.890567+0000","last_fullsized":"2023-08-10T11:50:55.890567+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:35:05.694028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345444+0000","last_change":"2023-08-10T11:50:54.963860+0000","last_active":"2023-08-10T11:50:56.345444+0000","last_peered":"2023-08-10T11:50:56.345444+0000","last_clean":"2023-08-10T11:50:56.345444+0000","last_became_active":"2023-08-10T11:50:54.963335+0000","last_became_peered":"2023-08-10T11:50:54.963335+0000","last_unstale":"2023-08-10T11:50:56.345444+0000","last_undegraded":"2023-08-10T11:50:56.345444+0000","last_fullsized":"2023-08-10T11:50:56.345444+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:49:24.482539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:57.926466+0000","last_change":"2023-08-10T11:50:53.899673+0000","last_active":"2023-08-10T11:50:57.926466+0000","last_peered":"2023-08-10T11:50:57.926466+0000","last_clean":"2023-08-10T11:50:57.926466+0000","last_became_active":"2023-08-10T11:50:53.898830+0000","last_became_peered":"2023-08-10T11:50:53.898830+0000","last_unstale":"2023-08-10T11:50:57.926466+0000","last_undegraded":"2023-08-10T11:50:57.926466+0000","last_fullsized":"2023-08-10T11:50:57.926466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:05:49.369504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473749+0000","last_change":"2023-08-10T11:50:54.900606+0000","last_active":"2023-08-10T11:50:56.473749+0000","last_peered":"2023-08-10T11:50:56.473749+0000","last_clean":"2023-08-10T11:50:56.473749+0000","last_became_active":"2023-08-10T11:50:54.900293+0000","last_became_peered":"2023-08-10T11:50:54.900293+0000","last_unstale":"2023-08-10T11:50:56.473749+0000","last_undegraded":"2023-08-10T11:50:56.473749+0000","last_fullsized":"2023-08-10T11:50:56.473749+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:02:51.178951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890574+0000","last_change":"2023-08-10T11:50:53.894526+0000","last_active":"2023-08-10T11:50:55.890574+0000","last_peered":"2023-08-10T11:50:55.890574+0000","last_clean":"2023-08-10T11:50:55.890574+0000","last_became_active":"2023-08-10T11:50:53.894211+0000","last_became_peered":"2023-08-10T11:50:53.894211+0000","last_unstale":"2023-08-10T11:50:55.890574+0000","last_undegraded":"2023-08-10T11:50:55.890574+0000","last_fullsized":"2023-08-10T11:50:55.890574+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:22:57.718753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.474091+0000","last_change":"2023-08-10T11:50:54.900511+0000","last_active":"2023-08-10T11:50:56.474091+0000","last_peered":"2023-08-10T11:50:56.474091+0000","last_clean":"2023-08-10T11:50:56.474091+0000","last_became_active":"2023-08-10T11:50:54.900200+0000","last_became_peered":"2023-08-10T11:50:54.900200+0000","last_unstale":"2023-08-10T11:50:56.474091+0000","last_undegraded":"2023-08-10T11:50:56.474091+0000","last_fullsized":"2023-08-10T11:50:56.474091+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:38:02.690516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:59.513492+0000","last_change":"2023-08-10T11:50:53.906235+0000","last_active":"2023-08-10T11:50:59.513492+0000","last_peered":"2023-08-10T11:50:59.513492+0000","last_clean":"2023-08-10T11:50:59.513492+0000","last_became_active":"2023-08-10T11:50:53.905630+0000","last_became_peered":"2023-08-10T11:50:53.905630+0000","last_unstale":"2023-08-10T11:50:59.513492+0000","last_undegraded":"2023-08-10T11:50:59.513492+0000","last_fullsized":"2023-08-10T11:50:59.513492+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:02:06.292606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473823+0000","last_change":"2023-08-10T11:50:54.907280+0000","last_active":"2023-08-10T11:50:56.473823+0000","last_peered":"2023-08-10T11:50:56.473823+0000","last_clean":"2023-08-10T11:50:56.473823+0000","last_became_active":"2023-08-10T11:50:54.906987+0000","last_became_peered":"2023-08-10T11:50:54.906987+0000","last_unstale":"2023-08-10T11:50:56.473823+0000","last_undegraded":"2023-08-10T11:50:56.473823+0000","last_fullsized":"2023-08-10T11:50:56.473823+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:18:49.513833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'3","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345058+0000","last_change":"2023-08-10T11:50:53.906537+0000","last_active":"2023-08-10T11:50:56.345058+0000","last_peered":"2023-08-10T11:50:56.345058+0000","last_clean":"2023-08-10T11:50:56.345058+0000","last_became_active":"2023-08-10T11:50:53.905975+0000","last_became_peered":"2023-08-10T11:50:53.905975+0000","last_unstale":"2023-08-10T11:50:56.345058+0000","last_undegraded":"2023-08-10T11:50:56.345058+0000","last_fullsized":"2023-08-10T11:50:56.345058+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:10:16.188995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473972+0000","last_change":"2023-08-10T11:50:54.905656+0000","last_active":"2023-08-10T11:50:56.473972+0000","last_peered":"2023-08-10T11:50:56.473972+0000","last_clean":"2023-08-10T11:50:56.473972+0000","last_became_active":"2023-08-10T11:50:54.905314+0000","last_became_peered":"2023-08-10T11:50:54.905314+0000","last_unstale":"2023-08-10T11:50:56.473972+0000","last_undegraded":"2023-08-10T11:50:56.473972+0000","last_fullsized":"2023-08-10T11:50:56.473972+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:15:27.734994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.144767+0000","last_change":"2023-08-10T11:50:54.911564+0000","last_active":"2023-08-10T11:50:56.144767+0000","last_peered":"2023-08-10T11:50:56.144767+0000","last_clean":"2023-08-10T11:50:56.144767+0000","last_became_active":"2023-08-10T11:50:54.910375+0000","last_became_peered":"2023-08-10T11:50:54.910375+0000","last_unstale":"2023-08-10T11:50:56.144767+0000","last_undegraded":"2023-08-10T11:50:56.144767+0000","last_fullsized":"2023-08-10T11:50:56.144767+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:19:14.914729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890590+0000","last_change":"2023-08-10T11:50:54.913247+0000","last_active":"2023-08-10T11:50:55.890590+0000","last_peered":"2023-08-10T11:50:55.890590+0000","last_clean":"2023-08-10T11:50:55.890590+0000","last_became_active":"2023-08-10T11:50:54.912941+0000","last_became_peered":"2023-08-10T11:50:54.912941+0000","last_unstale":"2023-08-10T11:50:55.890590+0000","last_undegraded":"2023-08-10T11:50:55.890590+0000","last_fullsized":"2023-08-10T11:50:55.890590+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:06:23.875486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890580+0000","last_change":"2023-08-10T11:50:54.959735+0000","last_active":"2023-08-10T11:50:55.890580+0000","last_peered":"2023-08-10T11:50:55.890580+0000","last_clean":"2023-08-10T11:50:55.890580+0000","last_became_active":"2023-08-10T11:50:54.959476+0000","last_became_peered":"2023-08-10T11:50:54.959476+0000","last_unstale":"2023-08-10T11:50:55.890580+0000","last_undegraded":"2023-08-10T11:50:55.890580+0000","last_fullsized":"2023-08-10T11:50:55.890580+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:56:57.761286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344964+0000","last_change":"2023-08-10T11:50:54.942753+0000","last_active":"2023-08-10T11:50:56.344964+0000","last_peered":"2023-08-10T11:50:56.344964+0000","last_clean":"2023-08-10T11:50:56.344964+0000","last_became_active":"2023-08-10T11:50:54.941715+0000","last_became_peered":"2023-08-10T11:50:54.941715+0000","last_unstale":"2023-08-10T11:50:56.344964+0000","last_undegraded":"2023-08-10T11:50:56.344964+0000","last_fullsized":"2023-08-10T11:50:56.344964+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:09:18.140936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345055+0000","last_change":"2023-08-10T11:50:54.898919+0000","last_active":"2023-08-10T11:50:56.345055+0000","last_peered":"2023-08-10T11:50:56.345055+0000","last_clean":"2023-08-10T11:50:56.345055+0000","last_became_active":"2023-08-10T11:50:54.898599+0000","last_became_peered":"2023-08-10T11:50:54.898599+0000","last_unstale":"2023-08-10T11:50:56.345055+0000","last_undegraded":"2023-08-10T11:50:56.345055+0000","last_fullsized":"2023-08-10T11:50:56.345055+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:48:49.804005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.145117+0000","last_change":"2023-08-10T11:50:54.911359+0000","last_active":"2023-08-10T11:50:56.145117+0000","last_peered":"2023-08-10T11:50:56.145117+0000","last_clean":"2023-08-10T11:50:56.145117+0000","last_became_active":"2023-08-10T11:50:54.911049+0000","last_became_peered":"2023-08-10T11:50:54.911049+0000","last_unstale":"2023-08-10T11:50:56.145117+0000","last_undegraded":"2023-08-10T11:50:56.145117+0000","last_fullsized":"2023-08-10T11:50:56.145117+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:09:44.046537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890718+0000","last_change":"2023-08-10T11:50:54.906811+0000","last_active":"2023-08-10T11:50:55.890718+0000","last_peered":"2023-08-10T11:50:55.890718+0000","last_clean":"2023-08-10T11:50:55.890718+0000","last_became_active":"2023-08-10T11:50:54.906456+0000","last_became_peered":"2023-08-10T11:50:54.906456+0000","last_unstale":"2023-08-10T11:50:55.890718+0000","last_undegraded":"2023-08-10T11:50:55.890718+0000","last_fullsized":"2023-08-10T11:50:55.890718+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:39:05.932046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345108+0000","last_change":"2023-08-10T11:50:54.957297+0000","last_active":"2023-08-10T11:50:56.345108+0000","last_peered":"2023-08-10T11:50:56.345108+0000","last_clean":"2023-08-10T11:50:56.345108+0000","last_became_active":"2023-08-10T11:50:54.956977+0000","last_became_peered":"2023-08-10T11:50:54.956977+0000","last_unstale":"2023-08-10T11:50:56.345108+0000","last_undegraded":"2023-08-10T11:50:56.345108+0000","last_fullsized":"2023-08-10T11:50:56.345108+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:45:21.997235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345139+0000","last_change":"2023-08-10T11:50:54.964300+0000","last_active":"2023-08-10T11:50:56.345139+0000","last_peered":"2023-08-10T11:50:56.345139+0000","last_clean":"2023-08-10T11:50:56.345139+0000","last_became_active":"2023-08-10T11:50:54.963876+0000","last_became_peered":"2023-08-10T11:50:54.963876+0000","last_unstale":"2023-08-10T11:50:56.345139+0000","last_undegraded":"2023-08-10T11:50:56.345139+0000","last_fullsized":"2023-08-10T11:50:56.345139+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:24:23.291049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344840+0000","last_change":"2023-08-10T11:50:54.958661+0000","last_active":"2023-08-10T11:50:56.344840+0000","last_peered":"2023-08-10T11:50:56.344840+0000","last_clean":"2023-08-10T11:50:56.344840+0000","last_became_active":"2023-08-10T11:50:54.958342+0000","last_became_peered":"2023-08-10T11:50:54.958342+0000","last_unstale":"2023-08-10T11:50:56.344840+0000","last_undegraded":"2023-08-10T11:50:56.344840+0000","last_fullsized":"2023-08-10T11:50:56.344840+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:04:39.541590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.892490+0000","last_change":"2023-08-10T11:50:54.902033+0000","last_active":"2023-08-10T11:50:55.892490+0000","last_peered":"2023-08-10T11:50:55.892490+0000","last_clean":"2023-08-10T11:50:55.892490+0000","last_became_active":"2023-08-10T11:50:54.901713+0000","last_became_peered":"2023-08-10T11:50:54.901713+0000","last_unstale":"2023-08-10T11:50:55.892490+0000","last_undegraded":"2023-08-10T11:50:55.892490+0000","last_fullsized":"2023-08-10T11:50:55.892490+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:19:46.017158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345900+0000","last_change":"2023-08-10T11:50:54.899377+0000","last_active":"2023-08-10T11:50:56.345900+0000","last_peered":"2023-08-10T11:50:56.345900+0000","last_clean":"2023-08-10T11:50:56.345900+0000","last_became_active":"2023-08-10T11:50:54.898657+0000","last_became_peered":"2023-08-10T11:50:54.898657+0000","last_unstale":"2023-08-10T11:50:56.345900+0000","last_undegraded":"2023-08-10T11:50:56.345900+0000","last_fullsized":"2023-08-10T11:50:56.345900+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:44:32.788127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.144836+0000","last_change":"2023-08-10T11:50:54.900304+0000","last_active":"2023-08-10T11:50:56.144836+0000","last_peered":"2023-08-10T11:50:56.144836+0000","last_clean":"2023-08-10T11:50:56.144836+0000","last_became_active":"2023-08-10T11:50:54.899978+0000","last_became_peered":"2023-08-10T11:50:54.899978+0000","last_unstale":"2023-08-10T11:50:56.144836+0000","last_undegraded":"2023-08-10T11:50:56.144836+0000","last_fullsized":"2023-08-10T11:50:56.144836+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:11:52.447215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6132,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":152,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":331776,"data_stored":53705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449100,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":897024,"data_stored":429425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]}]},{"osd":10,"up_from":70,"seq":300647710736,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28516,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716636,"statfs":{"total":95995035648,"available":95965835264,"internally_reserved":0,"allocated":1536000,"data_stored":1022488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":1,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.309},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.622}]},{"osd":3,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.443},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.41999999999999998}]},{"osd":4,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.379}]},{"osd":5,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":8,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.58999999999999997}]},{"osd":9,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.52300000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":9,"up_from":65,"seq":279172874261,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":429751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Aug 10 11:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Aug 10 11:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Aug 10 11:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.63100000000000001}]},{"osd":4,"last update":"Thu Aug 10 11:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Aug 10 11:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.78600000000000003}]},{"osd":6,"last update":"Thu Aug 10 11:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Aug 10 11:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.82499999999999996}]},{"osd":8,"last update":"Thu Aug 10 11:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.74099999999999999}]},{"osd":10,"last update":"Thu Aug 10 11:50:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.77500000000000002}]}]},{"osd":8,"up_from":57,"seq":244813135897,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":901120,"data_stored":429447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Aug 10 11:50:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.67600000000000005}]},{"osd":2,"last update":"Thu Aug 10 11:50:11 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Aug 10 11:50:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Aug 10 11:50:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Aug 10 11:50:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Aug 10 11:50:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Aug 10 11:50:11 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.72999999999999998}]},{"osd":9,"last update":"Thu Aug 10 11:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.745},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.83799999999999997}]},{"osd":10,"last update":"Thu Aug 10 11:50:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.80700000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]}]},{"osd":7,"up_from":50,"seq":214748364829,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1507328,"data_stored":1021306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.54500000000000004,"15min":0.53100000000000003},"min":{"1min":0.42099999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.51500000000000001,"15min":0.503},"min":{"1min":0.434,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.40899999999999997}]},{"osd":1,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.41699999999999998,"15min":0.40699999999999997},"min":{"1min":0.308,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.439,"15min":0.42699999999999999},"min":{"1min":0.307,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.42299999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77900000000000003,"5min":0.878,"15min":0.878},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59799999999999998,"15min":0.59099999999999997},"min":{"1min":0.45700000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82999999999999996,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.57499999999999996}]},{"osd":3,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.54300000000000004,"15min":0.53000000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.52600000000000002,"15min":0.51700000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.38600000000000001}]},{"osd":5,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.47599999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89400000000000002,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.64100000000000001,"15min":0.63200000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.62}]},{"osd":6,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.69699999999999995,"15min":0.68200000000000005},"min":{"1min":0.53900000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.502,"5min":0.497,"15min":0.497},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.46300000000000002}]},{"osd":8,"last update":"Thu Aug 10 11:50:10 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.63400000000000001}]},{"osd":9,"last update":"Thu Aug 10 11:50:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.753}]},{"osd":10,"last update":"Thu Aug 10 11:50:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.71799999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]}]},{"osd":6,"up_from":45,"seq":193273528354,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":428955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:32 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.36299999999999999,"15min":0.35499999999999998},"min":{"1min":0.29599999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.40000000000000002,"15min":0.39100000000000001},"min":{"1min":0.29199999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.314}]},{"osd":1,"last update":"Thu Aug 10 11:50:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.53900000000000003,"15min":0.52100000000000002},"min":{"1min":0.46200000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.54100000000000004,"15min":0.52900000000000003},"min":{"1min":0.42699999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Aug 10 11:50:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56399999999999995,"15min":0.56200000000000006},"min":{"1min":0.39500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.40799999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Aug 10 11:50:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.41399999999999998,"15min":0.40400000000000003},"min":{"1min":0.33900000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.47199999999999998,"15min":0.46400000000000002},"min":{"1min":0.308,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.28599999999999998}]},{"osd":4,"last update":"Thu Aug 10 11:50:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.43099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.379},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.59299999999999997,"15min":0.57999999999999996},"min":{"1min":0.44400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Aug 10 11:50:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.61599999999999999,"15min":0.60899999999999999},"min":{"1min":0.45000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.504},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.625,"15min":0.621},"min":{"1min":0.48399999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81599999999999995,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.495}]},{"osd":7,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65000000000000002,"15min":0.64400000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.65900000000000003,"15min":0.65100000000000002},"min":{"1min":0.53000000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.60299999999999998}]},{"osd":8,"last update":"Thu Aug 10 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.55600000000000005}]},{"osd":9,"last update":"Thu Aug 10 11:50:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.40799999999999997}]},{"osd":10,"last update":"Thu Aug 10 11:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.56699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":449476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52200000000000002,"15min":0.51100000000000001},"min":{"1min":0.378,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.52400000000000002,"15min":0.51400000000000001},"min":{"1min":0.376,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77800000000000002,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Aug 10 11:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.57899999999999996,"15min":0.57399999999999995},"min":{"1min":0.44600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.49099999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.79400000000000004}]},{"osd":3,"last update":"Thu Aug 10 11:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56100000000000005,"15min":0.54900000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53900000000000003,"15min":0.53700000000000003},"min":{"1min":0.376,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Aug 10 11:50:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.44,"15min":0.439},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.65400000000000003,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.47399999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.83699999999999997}]},{"osd":5,"last update":"Thu Aug 10 11:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.54300000000000004,"15min":0.53000000000000003},"min":{"1min":0.42099999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.754},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.56399999999999995,"15min":0.55000000000000004},"min":{"1min":0.42499999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Aug 10 11:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64400000000000002,"15min":0.64600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Aug 10 11:50:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.32100000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.92200000000000004,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.73299999999999998}]},{"osd":8,"last update":"Thu Aug 10 11:50:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.877}]},{"osd":9,"last update":"Thu Aug 10 11:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.85499999999999998}]},{"osd":10,"last update":"Thu Aug 10 11:50:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.82099999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738427,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":430321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 11:50:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.54400000000000004,"15min":0.504},"min":{"1min":0.51600000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.753},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.54600000000000004,"15min":0.52200000000000002},"min":{"1min":0.498,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73599999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Aug 10 11:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54000000000000004,"15min":0.52600000000000002},"min":{"1min":0.44700000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.76900000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.56499999999999995,"15min":0.54000000000000004},"min":{"1min":0.48299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Aug 10 11:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.34699999999999998,"15min":0.34100000000000003},"min":{"1min":0.26200000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.316},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.35599999999999998,"15min":0.34799999999999998},"min":{"1min":0.29299999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Aug 10 11:50:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.55100000000000005,"15min":0.52900000000000003},"min":{"1min":0.434,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.53400000000000003,"15min":0.52100000000000002},"min":{"1min":0.45200000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73099999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Aug 10 11:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42199999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72799999999999998,"5min":0.874,"15min":0.874},"last":0.5},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57199999999999995,"15min":0.56799999999999995},"min":{"1min":0.45400000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.70999999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Aug 10 11:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.49099999999999999,"15min":0.48599999999999999},"min":{"1min":0.29099999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.40999999999999998}]},{"osd":7,"last update":"Thu Aug 10 11:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.498,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.505}]},{"osd":8,"last update":"Thu Aug 10 11:50:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.52600000000000002}]},{"osd":9,"last update":"Thu Aug 10 11:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.56799999999999995}]},{"osd":10,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.625}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411379,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":909312,"data_stored":430441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52200000000000002,"15min":0.503},"min":{"1min":0.34599999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.53100000000000003,"15min":0.51300000000000001},"min":{"1min":0.44400000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.81100000000000005}]},{"osd":1,"last update":"Thu Aug 10 11:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.52900000000000003,"15min":0.51500000000000001},"min":{"1min":0.38100000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.65100000000000002,"15min":0.66800000000000004},"min":{"1min":0.46300000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.83199999999999996,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Aug 10 11:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.66500000000000004,"15min":0.69199999999999995},"min":{"1min":0.42099999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.78500000000000003,"5min":3.7519999999999998,"15min":3.7519999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.50900000000000001,"15min":0.49099999999999999},"min":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71499999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.65600000000000003,"15min":0.67600000000000005},"min":{"1min":0.45900000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.85199999999999998,"5min":3.6960000000000002,"15min":3.6960000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.58899999999999997,"15min":0.55300000000000005},"min":{"1min":0.44500000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.47699999999999998}]},{"osd":5,"last update":"Thu Aug 10 11:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47199999999999998,"15min":0.46899999999999997},"min":{"1min":0.35099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.60999999999999999,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.433,"15min":0.42899999999999999},"min":{"1min":0.32800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu Aug 10 11:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.56999999999999995,"15min":0.55900000000000005},"min":{"1min":0.40999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.65600000000000003,"15min":0.64600000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.73899999999999999,"15min":0.73799999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.503}]},{"osd":8,"last update":"Thu Aug 10 11:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.67200000000000004}]},{"osd":9,"last update":"Thu Aug 10 11:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.63},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.60399999999999998}]},{"osd":10,"last update":"Thu Aug 10 11:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.748}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]},{"osd":3,"up_from":25,"seq":107374182447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":429396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.23599999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.55700000000000005,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.36399999999999999,"15min":0.35799999999999998},"min":{"1min":0.253,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.52500000000000002,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.379}]},{"osd":1,"last update":"Thu Aug 10 11:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55400000000000005,"15min":0.55200000000000005},"min":{"1min":0.40300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.629}]},{"osd":2,"last update":"Thu Aug 10 11:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.57399999999999995,"15min":0.55300000000000005},"min":{"1min":0.378,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.57999999999999996,"15min":0.54800000000000004},"min":{"1min":0.44600000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Aug 10 11:50:48 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.432,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60499999999999998,"15min":0.59699999999999998},"min":{"1min":0.49299999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Aug 10 11:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57999999999999996,"15min":0.57099999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.63200000000000001,"15min":0.61199999999999999},"min":{"1min":0.435,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Aug 10 11:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.48299999999999998,"15min":0.46800000000000003},"min":{"1min":0.36399999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.47499999999999998,"15min":0.45900000000000002},"min":{"1min":0.33500000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.433}]},{"osd":7,"last update":"Thu Aug 10 11:50:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.52400000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.89800000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.755},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.59799999999999998}]},{"osd":8,"last update":"Thu Aug 10 11:50:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.67900000000000005}]},{"osd":9,"last update":"Thu Aug 10 11:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.53900000000000003}]},{"osd":10,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.71499999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]},{"osd":4,"up_from":32,"seq":137438953515,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":429495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54200000000000004,"15min":0.51400000000000001},"min":{"1min":0.39500000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79700000000000004,"5min":1.875,"15min":1.875},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.54300000000000004,"15min":0.51700000000000002},"min":{"1min":0.40899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Aug 10 11:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.41399999999999998,"15min":0.40300000000000002},"min":{"1min":0.29299999999999998,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.71599999999999997,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.41699999999999998,"15min":0.39800000000000002},"min":{"1min":0.311,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Aug 10 11:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Aug 10 11:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.57399999999999995,"15min":0.54300000000000004},"min":{"1min":0.51800000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84899999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.36899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81499999999999995,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.40699999999999997}]},{"osd":5,"last update":"Thu Aug 10 11:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.46899999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.59599999999999997,"15min":0.58499999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.495}]},{"osd":6,"last update":"Thu Aug 10 11:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67400000000000004,"15min":0.67300000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.91300000000000003,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.65300000000000002,"15min":0.65500000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81999999999999995,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.434}]},{"osd":7,"last update":"Thu Aug 10 11:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.56299999999999994,"15min":0.54300000000000004},"min":{"1min":0.41099999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.54000000000000004,"15min":0.52600000000000002},"min":{"1min":0.36699999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.371}]},{"osd":8,"last update":"Thu Aug 10 11:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.64700000000000002}]},{"osd":9,"last update":"Thu Aug 10 11:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.63100000000000001}]},{"osd":10,"last update":"Thu Aug 10 11:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.71799999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]}]},{"osd":5,"up_from":37,"seq":158913789990,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1527808,"data_stored":1021502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54800000000000004,"15min":0.54500000000000004},"min":{"1min":0.35799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.746}]},{"osd":1,"last update":"Thu Aug 10 11:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.52200000000000002,"15min":0.51500000000000001},"min":{"1min":0.42499999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.624},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.42899999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Aug 10 11:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.38700000000000001,"15min":0.379},"min":{"1min":0.28499999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.39800000000000002},"min":{"1min":0.311,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Aug 10 11:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.54900000000000004},"min":{"1min":0.38400000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54200000000000004,"15min":0.53800000000000003},"min":{"1min":0.40600000000000003,"5min":0.378,"15min":0.378},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.97699999999999998}]},{"osd":4,"last update":"Thu Aug 10 11:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.58999999999999997,"15min":0.58399999999999996},"min":{"1min":0.50800000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.58399999999999996,"15min":0.57699999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.45000000000000001}]},{"osd":6,"last update":"Thu Aug 10 11:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.46700000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.77100000000000002}]},{"osd":7,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64700000000000002,"15min":0.64500000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.81699999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.58099999999999996}]},{"osd":8,"last update":"Thu Aug 10 11:50:08 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.55300000000000005}]},{"osd":9,"last update":"Thu Aug 10 11:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":1.113},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.89100000000000001}]},{"osd":10,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":1.0880000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":37941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T11:51:02.789 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T11:51:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.942+0000 7f1c66eba700 1 -- 172.21.15.73:0/4217373205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c60101970 msgr2=0x7f1c60101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.942+0000 7f1c66eba700 1 --2- 172.21.15.73:0/4217373205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c60101970 0x7f1c60101dd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c0099c0 tx=0x7f1c4c009cd0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.942+0000 7f1c66eba700 1 -- 172.21.15.73:0/4217373205 shutdown_connections 2023-08-10T11:51:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.942+0000 7f1c66eba700 1 --2- 172.21.15.73:0/4217373205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c60102310 0x7f1c60108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.942+0000 7f1c66eba700 1 --2- 172.21.15.73:0/4217373205 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c60100780 0x7f1c60100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.942+0000 7f1c66eba700 1 --2- 172.21.15.73:0/4217373205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c60101970 0x7f1c60101dd0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.942+0000 7f1c66eba700 1 -- 172.21.15.73:0/4217373205 >> 172.21.15.73:0/4217373205 conn(0x7f1c600fbcb0 msgr2=0x7f1c600fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:02.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.942+0000 7f1c66eba700 1 -- 172.21.15.73:0/4217373205 shutdown_connections 2023-08-10T11:51:02.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.942+0000 7f1c66eba700 1 -- 172.21.15.73:0/4217373205 wait complete. 2023-08-10T11:51:02.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.942+0000 7f1c66eba700 1 Processor -- start 2023-08-10T11:51:02.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.943+0000 7f1c66eba700 1 -- start start 2023-08-10T11:51:02.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.943+0000 7f1c66eba700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c60100780 0x7f1c60196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:02.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.943+0000 7f1c66eba700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c60101970 0x7f1c601969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:02.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.943+0000 7f1c66eba700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c60102310 0x7f1c6019da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:02.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.943+0000 7f1c66eba700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6019e000 con 0x7f1c60101970 2023-08-10T11:51:02.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.943+0000 7f1c66eba700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6019e140 con 0x7f1c60102310 2023-08-10T11:51:02.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.943+0000 7f1c66eba700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6019e2d0 con 0x7f1c60100780 2023-08-10T11:51:02.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.943+0000 7f1c5ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c60101970 0x7f1c601969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:02.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.943+0000 7f1c5ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c60101970 0x7f1c601969c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59136/0 (socket says 172.21.15.73:59136) 2023-08-10T11:51:02.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.943+0000 7f1c5ffff700 1 -- 172.21.15.73:0/2514164685 learned_addr learned my addr 172.21.15.73:0/2514164685 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:02.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.943+0000 7f1c65457700 1 --2- 172.21.15.73:0/2514164685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c60102310 0x7f1c6019da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:02.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.943+0000 7f1c64c56700 1 --2- 172.21.15.73:0/2514164685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c60100780 0x7f1c60196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:02.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.943+0000 7f1c5ffff700 1 -- 172.21.15.73:0/2514164685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c60100780 msgr2=0x7f1c60196480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:02.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.943+0000 7f1c5ffff700 1 --2- 172.21.15.73:0/2514164685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c60100780 0x7f1c60196480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.943+0000 7f1c5ffff700 1 -- 172.21.15.73:0/2514164685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c60102310 msgr2=0x7f1c6019da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:02.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.943+0000 7f1c5ffff700 1 --2- 172.21.15.73:0/2514164685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c60102310 0x7f1c6019da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:02.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.943+0000 7f1c5ffff700 1 -- 172.21.15.73:0/2514164685 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4c0095f0 con 0x7f1c60101970 2023-08-10T11:51:02.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.943+0000 7f1c64c56700 1 --2- 172.21.15.73:0/2514164685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c60100780 0x7f1c60196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:51:02.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.943+0000 7f1c5ffff700 1 --2- 172.21.15.73:0/2514164685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c60101970 0x7f1c601969c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c009990 tx=0x7f1c4c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:02.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.943+0000 7f1c5dffb700 1 -- 172.21.15.73:0/2514164685 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c01d070 con 0x7f1c60101970 2023-08-10T11:51:02.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.943+0000 7f1c5dffb700 1 -- 172.21.15.73:0/2514164685 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c4c0054f0 con 0x7f1c60101970 2023-08-10T11:51:02.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.943+0000 7f1c66eba700 1 -- 172.21.15.73:0/2514164685 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6019e550 con 0x7f1c60101970 2023-08-10T11:51:02.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.943+0000 7f1c5dffb700 1 -- 172.21.15.73:0/2514164685 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c004bd0 con 0x7f1c60101970 2023-08-10T11:51:02.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.944+0000 7f1c66eba700 1 -- 172.21.15.73:0/2514164685 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c6019e970 con 0x7f1c60101970 2023-08-10T11:51:02.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.945+0000 7f1c66eba700 1 -- 172.21.15.73:0/2514164685 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c60107cc0 con 0x7f1c60101970 2023-08-10T11:51:02.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.946+0000 7f1c5dffb700 1 -- 172.21.15.73:0/2514164685 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f1c4c00fb80 con 0x7f1c60101970 2023-08-10T11:51:02.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.946+0000 7f1c5dffb700 1 --2- 172.21.15.73:0/2514164685 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f1c500a1220 0x7f1c500a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:02.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.946+0000 7f1c64c56700 1 --2- 172.21.15.73:0/2514164685 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f1c500a1220 0x7f1c500a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:02.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.946+0000 7f1c5dffb700 1 -- 172.21.15.73:0/2514164685 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f1c4c0cdc10 con 0x7f1c60101970 2023-08-10T11:51:02.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.947+0000 7f1c64c56700 1 --2- 172.21.15.73:0/2514164685 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f1c500a1220 0x7f1c500a36e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1c54005950 tx=0x7f1c540058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:02.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:02.950+0000 7f1c5dffb700 1 -- 172.21.15.73:0/2514164685 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f1c4c097440 con 0x7f1c60101970 2023-08-10T11:51:02.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:02 smithi152 ceph-mon[130220]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:51:02.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:02 smithi152 ceph-mon[130220]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:51:02.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:02 smithi152 ceph-mon[130220]: mds.? [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] up:active 2023-08-10T11:51:02.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:02 smithi152 ceph-mon[130220]: fsmap cephfs:5 2 up:standby-replay 5 up:standby 5 up:active 2023-08-10T11:51:02.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:02 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:51:02.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:02 smithi152 ceph-mon[130220]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:51:02.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:02 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3515520464' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:51:02.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:02 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/2298111141' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:51:03.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:02 smithi156 ceph-mon[130574]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:51:03.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:02 smithi156 ceph-mon[130574]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:51:03.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:02 smithi156 ceph-mon[130574]: mds.? [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] up:active 2023-08-10T11:51:03.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:02 smithi156 ceph-mon[130574]: fsmap cephfs:5 2 up:standby-replay 5 up:standby 5 up:active 2023-08-10T11:51:03.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:02 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:51:03.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:02 smithi156 ceph-mon[130574]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:51:03.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:02 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3515520464' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:51:03.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:02 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/2298111141' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:51:03.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:03.134+0000 7f1c66eba700 1 -- 172.21.15.73:0/2514164685 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1c60060bb0 con 0x7f1c500a1220 2023-08-10T11:51:03.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:03.144+0000 7f1c5dffb700 1 -- 172.21.15.73:0/2514164685 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336442 (secure 0 0 0) 0x7f1c60060bb0 con 0x7f1c500a1220 2023-08-10T11:51:03.148 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:51:03.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:03.147+0000 7f1c66eba700 1 -- 172.21.15.73:0/2514164685 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f1c500a1220 msgr2=0x7f1c500a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:03.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:03.147+0000 7f1c66eba700 1 --2- 172.21.15.73:0/2514164685 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f1c500a1220 0x7f1c500a36e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1c54005950 tx=0x7f1c540058e0 comp rx=0 tx=0).stop 2023-08-10T11:51:03.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:03.147+0000 7f1c66eba700 1 -- 172.21.15.73:0/2514164685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c60101970 msgr2=0x7f1c601969c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:03.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:03.147+0000 7f1c66eba700 1 --2- 172.21.15.73:0/2514164685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c60101970 0x7f1c601969c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c009990 tx=0x7f1c4c00f690 comp rx=0 tx=0).stop 2023-08-10T11:51:03.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:03.147+0000 7f1c66eba700 1 -- 172.21.15.73:0/2514164685 shutdown_connections 2023-08-10T11:51:03.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:03.147+0000 7f1c66eba700 1 --2- 172.21.15.73:0/2514164685 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f1c500a1220 0x7f1c500a36e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:03.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:03.147+0000 7f1c66eba700 1 --2- 172.21.15.73:0/2514164685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c60102310 0x7f1c6019da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:03.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:03.147+0000 7f1c66eba700 1 --2- 172.21.15.73:0/2514164685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c60100780 0x7f1c60196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:03.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:03.147+0000 7f1c66eba700 1 --2- 172.21.15.73:0/2514164685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c60101970 0x7f1c601969c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:03.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:03.147+0000 7f1c66eba700 1 -- 172.21.15.73:0/2514164685 >> 172.21.15.73:0/2514164685 conn(0x7f1c600fbcb0 msgr2=0x7f1c60104e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:03.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:03.147+0000 7f1c66eba700 1 -- 172.21.15.73:0/2514164685 shutdown_connections 2023-08-10T11:51:03.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:03.147+0000 7f1c66eba700 1 -- 172.21.15.73:0/2514164685 wait complete. 2023-08-10T11:51:03.152 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-08-10T11:51:03.160 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2023-08-10T11:51:02.477908+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596500,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":158,"num_read_kb":135,"num_write":333,"num_write_kb":2980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":283,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336692,"kb_used_data":12492,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124605132,"statfs":{"total":1151940427776,"available":1151595655168,"internally_reserved":0,"allocated":12791808,"data_stored":6952003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6132,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":152,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001914"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.145138+0000","last_change":"2023-08-10T11:50:54.902569+0000","last_active":"2023-08-10T11:50:56.145138+0000","last_peered":"2023-08-10T11:50:56.145138+0000","last_clean":"2023-08-10T11:50:56.145138+0000","last_became_active":"2023-08-10T11:50:54.902058+0000","last_became_peered":"2023-08-10T11:50:54.902058+0000","last_unstale":"2023-08-10T11:50:56.145138+0000","last_undegraded":"2023-08-10T11:50:56.145138+0000","last_fullsized":"2023-08-10T11:50:56.145138+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:21:13.051534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345827+0000","last_change":"2023-08-10T11:50:54.942908+0000","last_active":"2023-08-10T11:50:56.345827+0000","last_peered":"2023-08-10T11:50:56.345827+0000","last_clean":"2023-08-10T11:50:56.345827+0000","last_became_active":"2023-08-10T11:50:54.941765+0000","last_became_peered":"2023-08-10T11:50:54.941765+0000","last_unstale":"2023-08-10T11:50:56.345827+0000","last_undegraded":"2023-08-10T11:50:56.345827+0000","last_fullsized":"2023-08-10T11:50:56.345827+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:23:25.198276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345991+0000","last_change":"2023-08-10T11:50:54.940670+0000","last_active":"2023-08-10T11:50:56.345991+0000","last_peered":"2023-08-10T11:50:56.345991+0000","last_clean":"2023-08-10T11:50:56.345991+0000","last_became_active":"2023-08-10T11:50:54.939906+0000","last_became_peered":"2023-08-10T11:50:54.939906+0000","last_unstale":"2023-08-10T11:50:56.345991+0000","last_undegraded":"2023-08-10T11:50:56.345991+0000","last_fullsized":"2023-08-10T11:50:56.345991+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:49:22.795335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.135449+0000","last_change":"2023-08-10T11:50:54.910964+0000","last_active":"2023-08-10T11:50:56.135449+0000","last_peered":"2023-08-10T11:50:56.135449+0000","last_clean":"2023-08-10T11:50:56.135449+0000","last_became_active":"2023-08-10T11:50:54.910185+0000","last_became_peered":"2023-08-10T11:50:54.910185+0000","last_unstale":"2023-08-10T11:50:56.135449+0000","last_undegraded":"2023-08-10T11:50:56.135449+0000","last_fullsized":"2023-08-10T11:50:56.135449+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:23:05.579094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344998+0000","last_change":"2023-08-10T11:50:54.905354+0000","last_active":"2023-08-10T11:50:56.344998+0000","last_peered":"2023-08-10T11:50:56.344998+0000","last_clean":"2023-08-10T11:50:56.344998+0000","last_became_active":"2023-08-10T11:50:54.904982+0000","last_became_peered":"2023-08-10T11:50:54.904982+0000","last_unstale":"2023-08-10T11:50:56.344998+0000","last_undegraded":"2023-08-10T11:50:56.344998+0000","last_fullsized":"2023-08-10T11:50:56.344998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:29:30.470234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344628+0000","last_change":"2023-08-10T11:50:54.907024+0000","last_active":"2023-08-10T11:50:56.344628+0000","last_peered":"2023-08-10T11:50:56.344628+0000","last_clean":"2023-08-10T11:50:56.344628+0000","last_became_active":"2023-08-10T11:50:54.906590+0000","last_became_peered":"2023-08-10T11:50:54.906590+0000","last_unstale":"2023-08-10T11:50:56.344628+0000","last_undegraded":"2023-08-10T11:50:56.344628+0000","last_fullsized":"2023-08-10T11:50:56.344628+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:33:20.006347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473505+0000","last_change":"2023-08-10T11:50:54.904604+0000","last_active":"2023-08-10T11:50:56.473505+0000","last_peered":"2023-08-10T11:50:56.473505+0000","last_clean":"2023-08-10T11:50:56.473505+0000","last_became_active":"2023-08-10T11:50:54.904295+0000","last_became_peered":"2023-08-10T11:50:54.904295+0000","last_unstale":"2023-08-10T11:50:56.473505+0000","last_undegraded":"2023-08-10T11:50:56.473505+0000","last_fullsized":"2023-08-10T11:50:56.473505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:11:15.957227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344786+0000","last_change":"2023-08-10T11:50:54.963398+0000","last_active":"2023-08-10T11:50:56.344786+0000","last_peered":"2023-08-10T11:50:56.344786+0000","last_clean":"2023-08-10T11:50:56.344786+0000","last_became_active":"2023-08-10T11:50:54.963048+0000","last_became_peered":"2023-08-10T11:50:54.963048+0000","last_unstale":"2023-08-10T11:50:56.344786+0000","last_undegraded":"2023-08-10T11:50:56.344786+0000","last_fullsized":"2023-08-10T11:50:56.344786+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:05:56.018291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.892886+0000","last_change":"2023-08-10T11:50:54.913426+0000","last_active":"2023-08-10T11:50:55.892886+0000","last_peered":"2023-08-10T11:50:55.892886+0000","last_clean":"2023-08-10T11:50:55.892886+0000","last_became_active":"2023-08-10T11:50:54.913099+0000","last_became_peered":"2023-08-10T11:50:54.913099+0000","last_unstale":"2023-08-10T11:50:55.892886+0000","last_undegraded":"2023-08-10T11:50:55.892886+0000","last_fullsized":"2023-08-10T11:50:55.892886+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:43:10.881941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344828+0000","last_change":"2023-08-10T11:50:54.909259+0000","last_active":"2023-08-10T11:50:56.344828+0000","last_peered":"2023-08-10T11:50:56.344828+0000","last_clean":"2023-08-10T11:50:56.344828+0000","last_became_active":"2023-08-10T11:50:54.908898+0000","last_became_peered":"2023-08-10T11:50:54.908898+0000","last_unstale":"2023-08-10T11:50:56.344828+0000","last_undegraded":"2023-08-10T11:50:56.344828+0000","last_fullsized":"2023-08-10T11:50:56.344828+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:34:33.846938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473995+0000","last_change":"2023-08-10T11:50:54.906152+0000","last_active":"2023-08-10T11:50:56.473995+0000","last_peered":"2023-08-10T11:50:56.473995+0000","last_clean":"2023-08-10T11:50:56.473995+0000","last_became_active":"2023-08-10T11:50:54.905859+0000","last_became_peered":"2023-08-10T11:50:54.905859+0000","last_unstale":"2023-08-10T11:50:56.473995+0000","last_undegraded":"2023-08-10T11:50:56.473995+0000","last_fullsized":"2023-08-10T11:50:56.473995+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:58:19.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.135354+0000","last_change":"2023-08-10T11:50:54.911195+0000","last_active":"2023-08-10T11:50:56.135354+0000","last_peered":"2023-08-10T11:50:56.135354+0000","last_clean":"2023-08-10T11:50:56.135354+0000","last_became_active":"2023-08-10T11:50:54.910618+0000","last_became_peered":"2023-08-10T11:50:54.910618+0000","last_unstale":"2023-08-10T11:50:56.135354+0000","last_undegraded":"2023-08-10T11:50:56.135354+0000","last_fullsized":"2023-08-10T11:50:56.135354+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:09:17.323010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.346048+0000","last_change":"2023-08-10T11:50:54.908051+0000","last_active":"2023-08-10T11:50:56.346048+0000","last_peered":"2023-08-10T11:50:56.346048+0000","last_clean":"2023-08-10T11:50:56.346048+0000","last_became_active":"2023-08-10T11:50:54.907772+0000","last_became_peered":"2023-08-10T11:50:54.907772+0000","last_unstale":"2023-08-10T11:50:56.346048+0000","last_undegraded":"2023-08-10T11:50:56.346048+0000","last_fullsized":"2023-08-10T11:50:56.346048+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:37:48.360047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344774+0000","last_change":"2023-08-10T11:50:54.941327+0000","last_active":"2023-08-10T11:50:56.344774+0000","last_peered":"2023-08-10T11:50:56.344774+0000","last_clean":"2023-08-10T11:50:56.344774+0000","last_became_active":"2023-08-10T11:50:54.941020+0000","last_became_peered":"2023-08-10T11:50:54.941020+0000","last_unstale":"2023-08-10T11:50:56.344774+0000","last_undegraded":"2023-08-10T11:50:56.344774+0000","last_fullsized":"2023-08-10T11:50:56.344774+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:57:02.124392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345409+0000","last_change":"2023-08-10T11:50:54.940236+0000","last_active":"2023-08-10T11:50:56.345409+0000","last_peered":"2023-08-10T11:50:56.345409+0000","last_clean":"2023-08-10T11:50:56.345409+0000","last_became_active":"2023-08-10T11:50:54.939921+0000","last_became_peered":"2023-08-10T11:50:54.939921+0000","last_unstale":"2023-08-10T11:50:56.345409+0000","last_undegraded":"2023-08-10T11:50:56.345409+0000","last_fullsized":"2023-08-10T11:50:56.345409+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:16:17.977836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.892426+0000","last_change":"2023-08-10T11:50:54.903773+0000","last_active":"2023-08-10T11:50:55.892426+0000","last_peered":"2023-08-10T11:50:55.892426+0000","last_clean":"2023-08-10T11:50:55.892426+0000","last_became_active":"2023-08-10T11:50:54.903516+0000","last_became_peered":"2023-08-10T11:50:54.903516+0000","last_unstale":"2023-08-10T11:50:55.892426+0000","last_undegraded":"2023-08-10T11:50:55.892426+0000","last_fullsized":"2023-08-10T11:50:55.892426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:09:52.443125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.145193+0000","last_change":"2023-08-10T11:50:54.902364+0000","last_active":"2023-08-10T11:50:56.145193+0000","last_peered":"2023-08-10T11:50:56.145193+0000","last_clean":"2023-08-10T11:50:56.145193+0000","last_became_active":"2023-08-10T11:50:54.901673+0000","last_became_peered":"2023-08-10T11:50:54.901673+0000","last_unstale":"2023-08-10T11:50:56.145193+0000","last_undegraded":"2023-08-10T11:50:56.145193+0000","last_fullsized":"2023-08-10T11:50:56.145193+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:45:10.264196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890715+0000","last_change":"2023-08-10T11:50:54.911896+0000","last_active":"2023-08-10T11:50:55.890715+0000","last_peered":"2023-08-10T11:50:55.890715+0000","last_clean":"2023-08-10T11:50:55.890715+0000","last_became_active":"2023-08-10T11:50:54.911469+0000","last_became_peered":"2023-08-10T11:50:54.911469+0000","last_unstale":"2023-08-10T11:50:55.890715+0000","last_undegraded":"2023-08-10T11:50:55.890715+0000","last_fullsized":"2023-08-10T11:50:55.890715+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:35:08.075353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890571+0000","last_change":"2023-08-10T11:50:54.964030+0000","last_active":"2023-08-10T11:50:55.890571+0000","last_peered":"2023-08-10T11:50:55.890571+0000","last_clean":"2023-08-10T11:50:55.890571+0000","last_became_active":"2023-08-10T11:50:54.963744+0000","last_became_peered":"2023-08-10T11:50:54.963744+0000","last_unstale":"2023-08-10T11:50:55.890571+0000","last_undegraded":"2023-08-10T11:50:55.890571+0000","last_fullsized":"2023-08-10T11:50:55.890571+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:46.590044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'11","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:59.510929+0000","last_change":"2023-08-10T11:50:53.905439+0000","last_active":"2023-08-10T11:50:59.510929+0000","last_peered":"2023-08-10T11:50:59.510929+0000","last_clean":"2023-08-10T11:50:59.510929+0000","last_became_active":"2023-08-10T11:50:53.905172+0000","last_became_peered":"2023-08-10T11:50:53.905172+0000","last_unstale":"2023-08-10T11:50:59.510929+0000","last_undegraded":"2023-08-10T11:50:59.510929+0000","last_fullsized":"2023-08-10T11:50:59.510929+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:31:40.730660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345671+0000","last_change":"2023-08-10T11:50:54.961422+0000","last_active":"2023-08-10T11:50:56.345671+0000","last_peered":"2023-08-10T11:50:56.345671+0000","last_clean":"2023-08-10T11:50:56.345671+0000","last_became_active":"2023-08-10T11:50:54.960627+0000","last_became_peered":"2023-08-10T11:50:54.960627+0000","last_unstale":"2023-08-10T11:50:56.345671+0000","last_undegraded":"2023-08-10T11:50:56.345671+0000","last_fullsized":"2023-08-10T11:50:56.345671+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:10:30.642466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345880+0000","last_change":"2023-08-10T11:50:53.907291+0000","last_active":"2023-08-10T11:50:56.345880+0000","last_peered":"2023-08-10T11:50:56.345880+0000","last_clean":"2023-08-10T11:50:56.345880+0000","last_became_active":"2023-08-10T11:50:53.906997+0000","last_became_peered":"2023-08-10T11:50:53.906997+0000","last_unstale":"2023-08-10T11:50:56.345880+0000","last_undegraded":"2023-08-10T11:50:56.345880+0000","last_fullsized":"2023-08-10T11:50:56.345880+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:52:16.544854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344895+0000","last_change":"2023-08-10T11:50:54.940828+0000","last_active":"2023-08-10T11:50:56.344895+0000","last_peered":"2023-08-10T11:50:56.344895+0000","last_clean":"2023-08-10T11:50:56.344895+0000","last_became_active":"2023-08-10T11:50:54.940169+0000","last_became_peered":"2023-08-10T11:50:54.940169+0000","last_unstale":"2023-08-10T11:50:56.344895+0000","last_undegraded":"2023-08-10T11:50:56.344895+0000","last_fullsized":"2023-08-10T11:50:56.344895+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:45:59.866028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345167+0000","last_change":"2023-08-10T11:50:53.906366+0000","last_active":"2023-08-10T11:50:56.345167+0000","last_peered":"2023-08-10T11:50:56.345167+0000","last_clean":"2023-08-10T11:50:56.345167+0000","last_became_active":"2023-08-10T11:50:53.906057+0000","last_became_peered":"2023-08-10T11:50:53.906057+0000","last_unstale":"2023-08-10T11:50:56.345167+0000","last_undegraded":"2023-08-10T11:50:56.345167+0000","last_fullsized":"2023-08-10T11:50:56.345167+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:59:44.567315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.892532+0000","last_change":"2023-08-10T11:50:54.908534+0000","last_active":"2023-08-10T11:50:55.892532+0000","last_peered":"2023-08-10T11:50:55.892532+0000","last_clean":"2023-08-10T11:50:55.892532+0000","last_became_active":"2023-08-10T11:50:54.908244+0000","last_became_peered":"2023-08-10T11:50:54.908244+0000","last_unstale":"2023-08-10T11:50:55.892532+0000","last_undegraded":"2023-08-10T11:50:55.892532+0000","last_fullsized":"2023-08-10T11:50:55.892532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:55:51.466202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345089+0000","last_change":"2023-08-10T11:50:53.902325+0000","last_active":"2023-08-10T11:50:56.345089+0000","last_peered":"2023-08-10T11:50:56.345089+0000","last_clean":"2023-08-10T11:50:56.345089+0000","last_became_active":"2023-08-10T11:50:53.902020+0000","last_became_peered":"2023-08-10T11:50:53.902020+0000","last_unstale":"2023-08-10T11:50:56.345089+0000","last_undegraded":"2023-08-10T11:50:56.345089+0000","last_fullsized":"2023-08-10T11:50:56.345089+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:54.005452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345744+0000","last_change":"2023-08-10T11:50:54.910291+0000","last_active":"2023-08-10T11:50:56.345744+0000","last_peered":"2023-08-10T11:50:56.345744+0000","last_clean":"2023-08-10T11:50:56.345744+0000","last_became_active":"2023-08-10T11:50:54.909886+0000","last_became_peered":"2023-08-10T11:50:54.909886+0000","last_unstale":"2023-08-10T11:50:56.345744+0000","last_undegraded":"2023-08-10T11:50:56.345744+0000","last_fullsized":"2023-08-10T11:50:56.345744+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:32:04.741805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'5","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.505657+0000","last_change":"2023-08-10T11:50:53.904363+0000","last_active":"2023-08-10T11:51:00.505657+0000","last_peered":"2023-08-10T11:51:00.505657+0000","last_clean":"2023-08-10T11:51:00.505657+0000","last_became_active":"2023-08-10T11:50:53.904049+0000","last_became_peered":"2023-08-10T11:50:53.904049+0000","last_unstale":"2023-08-10T11:51:00.505657+0000","last_undegraded":"2023-08-10T11:51:00.505657+0000","last_fullsized":"2023-08-10T11:51:00.505657+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:49:25.423370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344983+0000","last_change":"2023-08-10T11:50:54.912189+0000","last_active":"2023-08-10T11:50:56.344983+0000","last_peered":"2023-08-10T11:50:56.344983+0000","last_clean":"2023-08-10T11:50:56.344983+0000","last_became_active":"2023-08-10T11:50:54.911884+0000","last_became_peered":"2023-08-10T11:50:54.911884+0000","last_unstale":"2023-08-10T11:50:56.344983+0000","last_undegraded":"2023-08-10T11:50:56.344983+0000","last_fullsized":"2023-08-10T11:50:56.344983+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:40:25.019116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:59.515415+0000","last_change":"2023-08-10T11:50:53.901161+0000","last_active":"2023-08-10T11:50:59.515415+0000","last_peered":"2023-08-10T11:50:59.515415+0000","last_clean":"2023-08-10T11:50:59.515415+0000","last_became_active":"2023-08-10T11:50:53.900806+0000","last_became_peered":"2023-08-10T11:50:53.900806+0000","last_unstale":"2023-08-10T11:50:59.515415+0000","last_undegraded":"2023-08-10T11:50:59.515415+0000","last_fullsized":"2023-08-10T11:50:59.515415+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:33:49.410246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345263+0000","last_change":"2023-08-10T11:50:54.905753+0000","last_active":"2023-08-10T11:50:56.345263+0000","last_peered":"2023-08-10T11:50:56.345263+0000","last_clean":"2023-08-10T11:50:56.345263+0000","last_became_active":"2023-08-10T11:50:54.905463+0000","last_became_peered":"2023-08-10T11:50:54.905463+0000","last_unstale":"2023-08-10T11:50:56.345263+0000","last_undegraded":"2023-08-10T11:50:56.345263+0000","last_fullsized":"2023-08-10T11:50:56.345263+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:40:18.150871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:58.508650+0000","last_change":"2023-08-10T11:50:53.895021+0000","last_active":"2023-08-10T11:50:58.508650+0000","last_peered":"2023-08-10T11:50:58.508650+0000","last_clean":"2023-08-10T11:50:58.508650+0000","last_became_active":"2023-08-10T11:50:53.894732+0000","last_became_peered":"2023-08-10T11:50:53.894732+0000","last_unstale":"2023-08-10T11:50:58.508650+0000","last_undegraded":"2023-08-10T11:50:58.508650+0000","last_fullsized":"2023-08-10T11:50:58.508650+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:33:34.799950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344648+0000","last_change":"2023-08-10T11:50:54.957771+0000","last_active":"2023-08-10T11:50:56.344648+0000","last_peered":"2023-08-10T11:50:56.344648+0000","last_clean":"2023-08-10T11:50:56.344648+0000","last_became_active":"2023-08-10T11:50:54.901503+0000","last_became_peered":"2023-08-10T11:50:54.901503+0000","last_unstale":"2023-08-10T11:50:56.344648+0000","last_undegraded":"2023-08-10T11:50:56.344648+0000","last_fullsized":"2023-08-10T11:50:56.344648+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:44:27.828963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.530556+0000","last_change":"2023-08-10T11:50:53.899939+0000","last_active":"2023-08-10T11:51:00.530556+0000","last_peered":"2023-08-10T11:51:00.530556+0000","last_clean":"2023-08-10T11:51:00.530556+0000","last_became_active":"2023-08-10T11:50:53.899648+0000","last_became_peered":"2023-08-10T11:50:53.899648+0000","last_unstale":"2023-08-10T11:51:00.530556+0000","last_undegraded":"2023-08-10T11:51:00.530556+0000","last_fullsized":"2023-08-10T11:51:00.530556+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:24:46.642939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890464+0000","last_change":"2023-08-10T11:50:54.959487+0000","last_active":"2023-08-10T11:50:55.890464+0000","last_peered":"2023-08-10T11:50:55.890464+0000","last_clean":"2023-08-10T11:50:55.890464+0000","last_became_active":"2023-08-10T11:50:54.959153+0000","last_became_peered":"2023-08-10T11:50:54.959153+0000","last_unstale":"2023-08-10T11:50:55.890464+0000","last_undegraded":"2023-08-10T11:50:55.890464+0000","last_fullsized":"2023-08-10T11:50:55.890464+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:38:55.933145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:59.503734+0000","last_change":"2023-08-10T11:50:53.898037+0000","last_active":"2023-08-10T11:50:59.503734+0000","last_peered":"2023-08-10T11:50:59.503734+0000","last_clean":"2023-08-10T11:50:59.503734+0000","last_became_active":"2023-08-10T11:50:53.897715+0000","last_became_peered":"2023-08-10T11:50:53.897715+0000","last_unstale":"2023-08-10T11:50:59.503734+0000","last_undegraded":"2023-08-10T11:50:59.503734+0000","last_fullsized":"2023-08-10T11:50:59.503734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:42:02.005233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.892809+0000","last_change":"2023-08-10T11:50:54.908337+0000","last_active":"2023-08-10T11:50:55.892809+0000","last_peered":"2023-08-10T11:50:55.892809+0000","last_clean":"2023-08-10T11:50:55.892809+0000","last_became_active":"2023-08-10T11:50:54.907990+0000","last_became_peered":"2023-08-10T11:50:54.907990+0000","last_unstale":"2023-08-10T11:50:55.892809+0000","last_undegraded":"2023-08-10T11:50:55.892809+0000","last_fullsized":"2023-08-10T11:50:55.892809+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:44:47.081301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.530242+0000","last_change":"2023-08-10T11:50:53.901498+0000","last_active":"2023-08-10T11:51:00.530242+0000","last_peered":"2023-08-10T11:51:00.530242+0000","last_clean":"2023-08-10T11:51:00.530242+0000","last_became_active":"2023-08-10T11:50:53.901146+0000","last_became_peered":"2023-08-10T11:50:53.901146+0000","last_unstale":"2023-08-10T11:51:00.530242+0000","last_undegraded":"2023-08-10T11:51:00.530242+0000","last_fullsized":"2023-08-10T11:51:00.530242+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:52:15.837576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345035+0000","last_change":"2023-08-10T11:50:54.901550+0000","last_active":"2023-08-10T11:50:56.345035+0000","last_peered":"2023-08-10T11:50:56.345035+0000","last_clean":"2023-08-10T11:50:56.345035+0000","last_became_active":"2023-08-10T11:50:54.901214+0000","last_became_peered":"2023-08-10T11:50:54.901214+0000","last_unstale":"2023-08-10T11:50:56.345035+0000","last_undegraded":"2023-08-10T11:50:56.345035+0000","last_fullsized":"2023-08-10T11:50:56.345035+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:11:47.883894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:58.501883+0000","last_change":"2023-08-10T11:50:53.901337+0000","last_active":"2023-08-10T11:50:58.501883+0000","last_peered":"2023-08-10T11:50:58.501883+0000","last_clean":"2023-08-10T11:50:58.501883+0000","last_became_active":"2023-08-10T11:50:53.901005+0000","last_became_peered":"2023-08-10T11:50:53.901005+0000","last_unstale":"2023-08-10T11:50:58.501883+0000","last_undegraded":"2023-08-10T11:50:58.501883+0000","last_fullsized":"2023-08-10T11:50:58.501883+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:11:24.161362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.892656+0000","last_change":"2023-08-10T11:50:54.905466+0000","last_active":"2023-08-10T11:50:55.892656+0000","last_peered":"2023-08-10T11:50:55.892656+0000","last_clean":"2023-08-10T11:50:55.892656+0000","last_became_active":"2023-08-10T11:50:54.905175+0000","last_became_peered":"2023-08-10T11:50:54.905175+0000","last_unstale":"2023-08-10T11:50:55.892656+0000","last_undegraded":"2023-08-10T11:50:55.892656+0000","last_fullsized":"2023-08-10T11:50:55.892656+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:49:14.630996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'9","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:59.505720+0000","last_change":"2023-08-10T11:50:53.894717+0000","last_active":"2023-08-10T11:50:59.505720+0000","last_peered":"2023-08-10T11:50:59.505720+0000","last_clean":"2023-08-10T11:50:59.505720+0000","last_became_active":"2023-08-10T11:50:53.894390+0000","last_became_peered":"2023-08-10T11:50:53.894390+0000","last_unstale":"2023-08-10T11:50:59.505720+0000","last_undegraded":"2023-08-10T11:50:59.505720+0000","last_fullsized":"2023-08-10T11:50:59.505720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:55:07.872465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1954,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344895+0000","last_change":"2023-08-10T11:50:54.908021+0000","last_active":"2023-08-10T11:50:56.344895+0000","last_peered":"2023-08-10T11:50:56.344895+0000","last_clean":"2023-08-10T11:50:56.344895+0000","last_became_active":"2023-08-10T11:50:54.907527+0000","last_became_peered":"2023-08-10T11:50:54.907527+0000","last_unstale":"2023-08-10T11:50:56.344895+0000","last_undegraded":"2023-08-10T11:50:56.344895+0000","last_fullsized":"2023-08-10T11:50:56.344895+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:31:57.299713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890510+0000","last_change":"2023-08-10T11:50:53.906448+0000","last_active":"2023-08-10T11:50:55.890510+0000","last_peered":"2023-08-10T11:50:55.890510+0000","last_clean":"2023-08-10T11:50:55.890510+0000","last_became_active":"2023-08-10T11:50:53.906157+0000","last_became_peered":"2023-08-10T11:50:53.906157+0000","last_unstale":"2023-08-10T11:50:55.890510+0000","last_undegraded":"2023-08-10T11:50:55.890510+0000","last_fullsized":"2023-08-10T11:50:55.890510+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:39.418056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345339+0000","last_change":"2023-08-10T11:50:54.906467+0000","last_active":"2023-08-10T11:50:56.345339+0000","last_peered":"2023-08-10T11:50:56.345339+0000","last_clean":"2023-08-10T11:50:56.345339+0000","last_became_active":"2023-08-10T11:50:54.901119+0000","last_became_peered":"2023-08-10T11:50:54.901119+0000","last_unstale":"2023-08-10T11:50:56.345339+0000","last_undegraded":"2023-08-10T11:50:56.345339+0000","last_fullsized":"2023-08-10T11:50:56.345339+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:16.266709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.530526+0000","last_change":"2023-08-10T11:50:53.906435+0000","last_active":"2023-08-10T11:51:00.530526+0000","last_peered":"2023-08-10T11:51:00.530526+0000","last_clean":"2023-08-10T11:51:00.530526+0000","last_became_active":"2023-08-10T11:50:53.905545+0000","last_became_peered":"2023-08-10T11:50:53.905545+0000","last_unstale":"2023-08-10T11:51:00.530526+0000","last_undegraded":"2023-08-10T11:51:00.530526+0000","last_fullsized":"2023-08-10T11:51:00.530526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:26:54.882060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473837+0000","last_change":"2023-08-10T11:50:54.903127+0000","last_active":"2023-08-10T11:50:56.473837+0000","last_peered":"2023-08-10T11:50:56.473837+0000","last_clean":"2023-08-10T11:50:56.473837+0000","last_became_active":"2023-08-10T11:50:54.902805+0000","last_became_peered":"2023-08-10T11:50:54.902805+0000","last_unstale":"2023-08-10T11:50:56.473837+0000","last_undegraded":"2023-08-10T11:50:56.473837+0000","last_fullsized":"2023-08-10T11:50:56.473837+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:58:40.949478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:59.511554+0000","last_change":"2023-08-10T11:50:53.898252+0000","last_active":"2023-08-10T11:50:59.511554+0000","last_peered":"2023-08-10T11:50:59.511554+0000","last_clean":"2023-08-10T11:50:59.511554+0000","last_became_active":"2023-08-10T11:50:53.897992+0000","last_became_peered":"2023-08-10T11:50:53.897992+0000","last_unstale":"2023-08-10T11:50:59.511554+0000","last_undegraded":"2023-08-10T11:50:59.511554+0000","last_fullsized":"2023-08-10T11:50:59.511554+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:34:51.658646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473681+0000","last_change":"2023-08-10T11:50:54.913297+0000","last_active":"2023-08-10T11:50:56.473681+0000","last_peered":"2023-08-10T11:50:56.473681+0000","last_clean":"2023-08-10T11:50:56.473681+0000","last_became_active":"2023-08-10T11:50:54.912997+0000","last_became_peered":"2023-08-10T11:50:54.912997+0000","last_unstale":"2023-08-10T11:50:56.473681+0000","last_undegraded":"2023-08-10T11:50:56.473681+0000","last_fullsized":"2023-08-10T11:50:56.473681+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:40:06.862890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'10","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:57.925515+0000","last_change":"2023-08-10T11:50:53.904095+0000","last_active":"2023-08-10T11:50:57.925515+0000","last_peered":"2023-08-10T11:50:57.925515+0000","last_clean":"2023-08-10T11:50:57.925515+0000","last_became_active":"2023-08-10T11:50:53.903712+0000","last_became_peered":"2023-08-10T11:50:53.903712+0000","last_unstale":"2023-08-10T11:50:57.925515+0000","last_undegraded":"2023-08-10T11:50:57.925515+0000","last_fullsized":"2023-08-10T11:50:57.925515+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:52:43.075450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345492+0000","last_change":"2023-08-10T11:50:54.904763+0000","last_active":"2023-08-10T11:50:56.345492+0000","last_peered":"2023-08-10T11:50:56.345492+0000","last_clean":"2023-08-10T11:50:56.345492+0000","last_became_active":"2023-08-10T11:50:54.904467+0000","last_became_peered":"2023-08-10T11:50:54.904467+0000","last_unstale":"2023-08-10T11:50:56.345492+0000","last_undegraded":"2023-08-10T11:50:56.345492+0000","last_fullsized":"2023-08-10T11:50:56.345492+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:18:23.751856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345391+0000","last_change":"2023-08-10T11:50:53.904605+0000","last_active":"2023-08-10T11:50:56.345391+0000","last_peered":"2023-08-10T11:50:56.345391+0000","last_clean":"2023-08-10T11:50:56.345391+0000","last_became_active":"2023-08-10T11:50:53.904236+0000","last_became_peered":"2023-08-10T11:50:53.904236+0000","last_unstale":"2023-08-10T11:50:56.345391+0000","last_undegraded":"2023-08-10T11:50:56.345391+0000","last_fullsized":"2023-08-10T11:50:56.345391+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:31:26.574828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.144909+0000","last_change":"2023-08-10T11:50:54.903881+0000","last_active":"2023-08-10T11:50:56.144909+0000","last_peered":"2023-08-10T11:50:56.144909+0000","last_clean":"2023-08-10T11:50:56.144909+0000","last_became_active":"2023-08-10T11:50:54.903563+0000","last_became_peered":"2023-08-10T11:50:54.903563+0000","last_unstale":"2023-08-10T11:50:56.144909+0000","last_undegraded":"2023-08-10T11:50:56.144909+0000","last_fullsized":"2023-08-10T11:50:56.144909+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:23:32.901460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890795+0000","last_change":"2023-08-10T11:50:53.905320+0000","last_active":"2023-08-10T11:50:55.890795+0000","last_peered":"2023-08-10T11:50:55.890795+0000","last_clean":"2023-08-10T11:50:55.890795+0000","last_became_active":"2023-08-10T11:50:53.905057+0000","last_became_peered":"2023-08-10T11:50:53.905057+0000","last_unstale":"2023-08-10T11:50:55.890795+0000","last_undegraded":"2023-08-10T11:50:55.890795+0000","last_fullsized":"2023-08-10T11:50:55.890795+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:10:35.476026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344880+0000","last_change":"2023-08-10T11:50:54.906531+0000","last_active":"2023-08-10T11:50:56.344880+0000","last_peered":"2023-08-10T11:50:56.344880+0000","last_clean":"2023-08-10T11:50:56.344880+0000","last_became_active":"2023-08-10T11:50:54.906239+0000","last_became_peered":"2023-08-10T11:50:54.906239+0000","last_unstale":"2023-08-10T11:50:56.344880+0000","last_undegraded":"2023-08-10T11:50:56.344880+0000","last_fullsized":"2023-08-10T11:50:56.344880+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:11:52.732611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.530611+0000","last_change":"2023-08-10T11:50:53.899835+0000","last_active":"2023-08-10T11:51:00.530611+0000","last_peered":"2023-08-10T11:51:00.530611+0000","last_clean":"2023-08-10T11:51:00.530611+0000","last_became_active":"2023-08-10T11:50:53.898318+0000","last_became_peered":"2023-08-10T11:50:53.898318+0000","last_unstale":"2023-08-10T11:51:00.530611+0000","last_undegraded":"2023-08-10T11:51:00.530611+0000","last_fullsized":"2023-08-10T11:51:00.530611+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:02:07.071804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344832+0000","last_change":"2023-08-10T11:50:54.905941+0000","last_active":"2023-08-10T11:50:56.344832+0000","last_peered":"2023-08-10T11:50:56.344832+0000","last_clean":"2023-08-10T11:50:56.344832+0000","last_became_active":"2023-08-10T11:50:54.905634+0000","last_became_peered":"2023-08-10T11:50:54.905634+0000","last_unstale":"2023-08-10T11:50:56.344832+0000","last_undegraded":"2023-08-10T11:50:56.344832+0000","last_fullsized":"2023-08-10T11:50:56.344832+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:53:51.516739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345241+0000","last_change":"2023-08-10T11:50:54.910544+0000","last_active":"2023-08-10T11:50:56.345241+0000","last_peered":"2023-08-10T11:50:56.345241+0000","last_clean":"2023-08-10T11:50:56.345241+0000","last_became_active":"2023-08-10T11:50:54.910210+0000","last_became_peered":"2023-08-10T11:50:54.910210+0000","last_unstale":"2023-08-10T11:50:56.345241+0000","last_undegraded":"2023-08-10T11:50:56.345241+0000","last_fullsized":"2023-08-10T11:50:56.345241+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:33:03.928843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:58.508554+0000","last_change":"2023-08-10T11:50:53.906293+0000","last_active":"2023-08-10T11:50:58.508554+0000","last_peered":"2023-08-10T11:50:58.508554+0000","last_clean":"2023-08-10T11:50:58.508554+0000","last_became_active":"2023-08-10T11:50:53.905998+0000","last_became_peered":"2023-08-10T11:50:53.905998+0000","last_unstale":"2023-08-10T11:50:58.508554+0000","last_undegraded":"2023-08-10T11:50:58.508554+0000","last_fullsized":"2023-08-10T11:50:58.508554+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:37.743171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345578+0000","last_change":"2023-08-10T11:50:54.960147+0000","last_active":"2023-08-10T11:50:56.345578+0000","last_peered":"2023-08-10T11:50:56.345578+0000","last_clean":"2023-08-10T11:50:56.345578+0000","last_became_active":"2023-08-10T11:50:54.959842+0000","last_became_peered":"2023-08-10T11:50:54.959842+0000","last_unstale":"2023-08-10T11:50:56.345578+0000","last_undegraded":"2023-08-10T11:50:56.345578+0000","last_fullsized":"2023-08-10T11:50:56.345578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:12:53.787027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:59.512665+0000","last_change":"2023-08-10T11:50:53.899292+0000","last_active":"2023-08-10T11:50:59.512665+0000","last_peered":"2023-08-10T11:50:59.512665+0000","last_clean":"2023-08-10T11:50:59.512665+0000","last_became_active":"2023-08-10T11:50:53.898917+0000","last_became_peered":"2023-08-10T11:50:53.898917+0000","last_unstale":"2023-08-10T11:50:59.512665+0000","last_undegraded":"2023-08-10T11:50:59.512665+0000","last_fullsized":"2023-08-10T11:50:59.512665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:40:42.574205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":341,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473528+0000","last_change":"2023-08-10T11:49:54.492617+0000","last_active":"2023-08-10T11:50:56.473528+0000","last_peered":"2023-08-10T11:50:56.473528+0000","last_clean":"2023-08-10T11:50:56.473528+0000","last_became_active":"2023-08-10T11:49:54.492146+0000","last_became_peered":"2023-08-10T11:49:54.492146+0000","last_unstale":"2023-08-10T11:50:56.473528+0000","last_undegraded":"2023-08-10T11:50:56.473528+0000","last_fullsized":"2023-08-10T11:50:56.473528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:46:58.862300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:46:58.862300+0000","last_clean_scrub_stamp":"2023-08-10T11:46:58.862300+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:03:46.098279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345147+0000","last_change":"2023-08-10T11:50:54.907704+0000","last_active":"2023-08-10T11:50:56.345147+0000","last_peered":"2023-08-10T11:50:56.345147+0000","last_clean":"2023-08-10T11:50:56.345147+0000","last_became_active":"2023-08-10T11:50:54.907409+0000","last_became_peered":"2023-08-10T11:50:54.907409+0000","last_unstale":"2023-08-10T11:50:56.345147+0000","last_undegraded":"2023-08-10T11:50:56.345147+0000","last_fullsized":"2023-08-10T11:50:56.345147+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:00:55.449902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:58.509272+0000","last_change":"2023-08-10T11:50:53.902548+0000","last_active":"2023-08-10T11:50:58.509272+0000","last_peered":"2023-08-10T11:50:58.509272+0000","last_clean":"2023-08-10T11:50:58.509272+0000","last_became_active":"2023-08-10T11:50:53.902021+0000","last_became_peered":"2023-08-10T11:50:53.902021+0000","last_unstale":"2023-08-10T11:50:58.509272+0000","last_undegraded":"2023-08-10T11:50:58.509272+0000","last_fullsized":"2023-08-10T11:50:58.509272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:49:47.207695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344913+0000","last_change":"2023-08-10T11:50:53.906326+0000","last_active":"2023-08-10T11:50:56.344913+0000","last_peered":"2023-08-10T11:50:56.344913+0000","last_clean":"2023-08-10T11:50:56.344913+0000","last_became_active":"2023-08-10T11:50:53.906017+0000","last_became_peered":"2023-08-10T11:50:53.906017+0000","last_unstale":"2023-08-10T11:50:56.344913+0000","last_undegraded":"2023-08-10T11:50:56.344913+0000","last_fullsized":"2023-08-10T11:50:56.344913+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:20:21.219007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344921+0000","last_change":"2023-08-10T11:50:54.906513+0000","last_active":"2023-08-10T11:50:56.344921+0000","last_peered":"2023-08-10T11:50:56.344921+0000","last_clean":"2023-08-10T11:50:56.344921+0000","last_became_active":"2023-08-10T11:50:54.901642+0000","last_became_peered":"2023-08-10T11:50:54.901642+0000","last_unstale":"2023-08-10T11:50:56.344921+0000","last_undegraded":"2023-08-10T11:50:56.344921+0000","last_fullsized":"2023-08-10T11:50:56.344921+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:37.030936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'7","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:59.513991+0000","last_change":"2023-08-10T11:50:53.908025+0000","last_active":"2023-08-10T11:50:59.513991+0000","last_peered":"2023-08-10T11:50:59.513991+0000","last_clean":"2023-08-10T11:50:59.513991+0000","last_became_active":"2023-08-10T11:50:53.907745+0000","last_became_peered":"2023-08-10T11:50:53.907745+0000","last_unstale":"2023-08-10T11:50:59.513991+0000","last_undegraded":"2023-08-10T11:50:59.513991+0000","last_fullsized":"2023-08-10T11:50:59.513991+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:08:55.888721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345237+0000","last_change":"2023-08-10T11:50:54.958653+0000","last_active":"2023-08-10T11:50:56.345237+0000","last_peered":"2023-08-10T11:50:56.345237+0000","last_clean":"2023-08-10T11:50:56.345237+0000","last_became_active":"2023-08-10T11:50:54.958281+0000","last_became_peered":"2023-08-10T11:50:54.958281+0000","last_unstale":"2023-08-10T11:50:56.345237+0000","last_undegraded":"2023-08-10T11:50:56.345237+0000","last_fullsized":"2023-08-10T11:50:56.345237+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:09:50.615524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.533525+0000","last_change":"2023-08-10T11:50:53.895770+0000","last_active":"2023-08-10T11:51:00.533525+0000","last_peered":"2023-08-10T11:51:00.533525+0000","last_clean":"2023-08-10T11:51:00.533525+0000","last_became_active":"2023-08-10T11:50:53.895433+0000","last_became_peered":"2023-08-10T11:50:53.895433+0000","last_unstale":"2023-08-10T11:51:00.533525+0000","last_undegraded":"2023-08-10T11:51:00.533525+0000","last_fullsized":"2023-08-10T11:51:00.533525+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:22:23.820523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345697+0000","last_change":"2023-08-10T11:50:54.957297+0000","last_active":"2023-08-10T11:50:56.345697+0000","last_peered":"2023-08-10T11:50:56.345697+0000","last_clean":"2023-08-10T11:50:56.345697+0000","last_became_active":"2023-08-10T11:50:54.956966+0000","last_became_peered":"2023-08-10T11:50:54.956966+0000","last_unstale":"2023-08-10T11:50:56.345697+0000","last_undegraded":"2023-08-10T11:50:56.345697+0000","last_fullsized":"2023-08-10T11:50:56.345697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:56:06.035708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:57.926624+0000","last_change":"2023-08-10T11:50:53.897792+0000","last_active":"2023-08-10T11:50:57.926624+0000","last_peered":"2023-08-10T11:50:57.926624+0000","last_clean":"2023-08-10T11:50:57.926624+0000","last_became_active":"2023-08-10T11:50:53.897489+0000","last_became_peered":"2023-08-10T11:50:53.897489+0000","last_unstale":"2023-08-10T11:50:57.926624+0000","last_undegraded":"2023-08-10T11:50:57.926624+0000","last_fullsized":"2023-08-10T11:50:57.926624+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:00.460709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344719+0000","last_change":"2023-08-10T11:50:54.908185+0000","last_active":"2023-08-10T11:50:56.344719+0000","last_peered":"2023-08-10T11:50:56.344719+0000","last_clean":"2023-08-10T11:50:56.344719+0000","last_became_active":"2023-08-10T11:50:54.907649+0000","last_became_peered":"2023-08-10T11:50:54.907649+0000","last_unstale":"2023-08-10T11:50:56.344719+0000","last_undegraded":"2023-08-10T11:50:56.344719+0000","last_fullsized":"2023-08-10T11:50:56.344719+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:33:01.523501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.530584+0000","last_change":"2023-08-10T11:50:53.908748+0000","last_active":"2023-08-10T11:51:00.530584+0000","last_peered":"2023-08-10T11:51:00.530584+0000","last_clean":"2023-08-10T11:51:00.530584+0000","last_became_active":"2023-08-10T11:50:53.908494+0000","last_became_peered":"2023-08-10T11:50:53.908494+0000","last_unstale":"2023-08-10T11:51:00.530584+0000","last_undegraded":"2023-08-10T11:51:00.530584+0000","last_fullsized":"2023-08-10T11:51:00.530584+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:14:25.414218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.144690+0000","last_change":"2023-08-10T11:50:54.903493+0000","last_active":"2023-08-10T11:50:56.144690+0000","last_peered":"2023-08-10T11:50:56.144690+0000","last_clean":"2023-08-10T11:50:56.144690+0000","last_became_active":"2023-08-10T11:50:54.903118+0000","last_became_peered":"2023-08-10T11:50:54.903118+0000","last_unstale":"2023-08-10T11:50:56.144690+0000","last_undegraded":"2023-08-10T11:50:56.144690+0000","last_fullsized":"2023-08-10T11:50:56.144690+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:41:27.663597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890567+0000","last_change":"2023-08-10T11:50:53.905075+0000","last_active":"2023-08-10T11:50:55.890567+0000","last_peered":"2023-08-10T11:50:55.890567+0000","last_clean":"2023-08-10T11:50:55.890567+0000","last_became_active":"2023-08-10T11:50:53.904769+0000","last_became_peered":"2023-08-10T11:50:53.904769+0000","last_unstale":"2023-08-10T11:50:55.890567+0000","last_undegraded":"2023-08-10T11:50:55.890567+0000","last_fullsized":"2023-08-10T11:50:55.890567+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:35:05.694028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345444+0000","last_change":"2023-08-10T11:50:54.963860+0000","last_active":"2023-08-10T11:50:56.345444+0000","last_peered":"2023-08-10T11:50:56.345444+0000","last_clean":"2023-08-10T11:50:56.345444+0000","last_became_active":"2023-08-10T11:50:54.963335+0000","last_became_peered":"2023-08-10T11:50:54.963335+0000","last_unstale":"2023-08-10T11:50:56.345444+0000","last_undegraded":"2023-08-10T11:50:56.345444+0000","last_fullsized":"2023-08-10T11:50:56.345444+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:49:24.482539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:57.926466+0000","last_change":"2023-08-10T11:50:53.899673+0000","last_active":"2023-08-10T11:50:57.926466+0000","last_peered":"2023-08-10T11:50:57.926466+0000","last_clean":"2023-08-10T11:50:57.926466+0000","last_became_active":"2023-08-10T11:50:53.898830+0000","last_became_peered":"2023-08-10T11:50:53.898830+0000","last_unstale":"2023-08-10T11:50:57.926466+0000","last_undegraded":"2023-08-10T11:50:57.926466+0000","last_fullsized":"2023-08-10T11:50:57.926466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:05:49.369504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473749+0000","last_change":"2023-08-10T11:50:54.900606+0000","last_active":"2023-08-10T11:50:56.473749+0000","last_peered":"2023-08-10T11:50:56.473749+0000","last_clean":"2023-08-10T11:50:56.473749+0000","last_became_active":"2023-08-10T11:50:54.900293+0000","last_became_peered":"2023-08-10T11:50:54.900293+0000","last_unstale":"2023-08-10T11:50:56.473749+0000","last_undegraded":"2023-08-10T11:50:56.473749+0000","last_fullsized":"2023-08-10T11:50:56.473749+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:02:51.178951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890574+0000","last_change":"2023-08-10T11:50:53.894526+0000","last_active":"2023-08-10T11:50:55.890574+0000","last_peered":"2023-08-10T11:50:55.890574+0000","last_clean":"2023-08-10T11:50:55.890574+0000","last_became_active":"2023-08-10T11:50:53.894211+0000","last_became_peered":"2023-08-10T11:50:53.894211+0000","last_unstale":"2023-08-10T11:50:55.890574+0000","last_undegraded":"2023-08-10T11:50:55.890574+0000","last_fullsized":"2023-08-10T11:50:55.890574+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:22:57.718753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.474091+0000","last_change":"2023-08-10T11:50:54.900511+0000","last_active":"2023-08-10T11:50:56.474091+0000","last_peered":"2023-08-10T11:50:56.474091+0000","last_clean":"2023-08-10T11:50:56.474091+0000","last_became_active":"2023-08-10T11:50:54.900200+0000","last_became_peered":"2023-08-10T11:50:54.900200+0000","last_unstale":"2023-08-10T11:50:56.474091+0000","last_undegraded":"2023-08-10T11:50:56.474091+0000","last_fullsized":"2023-08-10T11:50:56.474091+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:38:02.690516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:59.513492+0000","last_change":"2023-08-10T11:50:53.906235+0000","last_active":"2023-08-10T11:50:59.513492+0000","last_peered":"2023-08-10T11:50:59.513492+0000","last_clean":"2023-08-10T11:50:59.513492+0000","last_became_active":"2023-08-10T11:50:53.905630+0000","last_became_peered":"2023-08-10T11:50:53.905630+0000","last_unstale":"2023-08-10T11:50:59.513492+0000","last_undegraded":"2023-08-10T11:50:59.513492+0000","last_fullsized":"2023-08-10T11:50:59.513492+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:02:06.292606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473823+0000","last_change":"2023-08-10T11:50:54.907280+0000","last_active":"2023-08-10T11:50:56.473823+0000","last_peered":"2023-08-10T11:50:56.473823+0000","last_clean":"2023-08-10T11:50:56.473823+0000","last_became_active":"2023-08-10T11:50:54.906987+0000","last_became_peered":"2023-08-10T11:50:54.906987+0000","last_unstale":"2023-08-10T11:50:56.473823+0000","last_undegraded":"2023-08-10T11:50:56.473823+0000","last_fullsized":"2023-08-10T11:50:56.473823+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:18:49.513833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'3","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345058+0000","last_change":"2023-08-10T11:50:53.906537+0000","last_active":"2023-08-10T11:50:56.345058+0000","last_peered":"2023-08-10T11:50:56.345058+0000","last_clean":"2023-08-10T11:50:56.345058+0000","last_became_active":"2023-08-10T11:50:53.905975+0000","last_became_peered":"2023-08-10T11:50:53.905975+0000","last_unstale":"2023-08-10T11:50:56.345058+0000","last_undegraded":"2023-08-10T11:50:56.345058+0000","last_fullsized":"2023-08-10T11:50:56.345058+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:10:16.188995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473972+0000","last_change":"2023-08-10T11:50:54.905656+0000","last_active":"2023-08-10T11:50:56.473972+0000","last_peered":"2023-08-10T11:50:56.473972+0000","last_clean":"2023-08-10T11:50:56.473972+0000","last_became_active":"2023-08-10T11:50:54.905314+0000","last_became_peered":"2023-08-10T11:50:54.905314+0000","last_unstale":"2023-08-10T11:50:56.473972+0000","last_undegraded":"2023-08-10T11:50:56.473972+0000","last_fullsized":"2023-08-10T11:50:56.473972+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:15:27.734994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.144767+0000","last_change":"2023-08-10T11:50:54.911564+0000","last_active":"2023-08-10T11:50:56.144767+0000","last_peered":"2023-08-10T11:50:56.144767+0000","last_clean":"2023-08-10T11:50:56.144767+0000","last_became_active":"2023-08-10T11:50:54.910375+0000","last_became_peered":"2023-08-10T11:50:54.910375+0000","last_unstale":"2023-08-10T11:50:56.144767+0000","last_undegraded":"2023-08-10T11:50:56.144767+0000","last_fullsized":"2023-08-10T11:50:56.144767+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:19:14.914729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890590+0000","last_change":"2023-08-10T11:50:54.913247+0000","last_active":"2023-08-10T11:50:55.890590+0000","last_peered":"2023-08-10T11:50:55.890590+0000","last_clean":"2023-08-10T11:50:55.890590+0000","last_became_active":"2023-08-10T11:50:54.912941+0000","last_became_peered":"2023-08-10T11:50:54.912941+0000","last_unstale":"2023-08-10T11:50:55.890590+0000","last_undegraded":"2023-08-10T11:50:55.890590+0000","last_fullsized":"2023-08-10T11:50:55.890590+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:06:23.875486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890580+0000","last_change":"2023-08-10T11:50:54.959735+0000","last_active":"2023-08-10T11:50:55.890580+0000","last_peered":"2023-08-10T11:50:55.890580+0000","last_clean":"2023-08-10T11:50:55.890580+0000","last_became_active":"2023-08-10T11:50:54.959476+0000","last_became_peered":"2023-08-10T11:50:54.959476+0000","last_unstale":"2023-08-10T11:50:55.890580+0000","last_undegraded":"2023-08-10T11:50:55.890580+0000","last_fullsized":"2023-08-10T11:50:55.890580+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:56:57.761286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344964+0000","last_change":"2023-08-10T11:50:54.942753+0000","last_active":"2023-08-10T11:50:56.344964+0000","last_peered":"2023-08-10T11:50:56.344964+0000","last_clean":"2023-08-10T11:50:56.344964+0000","last_became_active":"2023-08-10T11:50:54.941715+0000","last_became_peered":"2023-08-10T11:50:54.941715+0000","last_unstale":"2023-08-10T11:50:56.344964+0000","last_undegraded":"2023-08-10T11:50:56.344964+0000","last_fullsized":"2023-08-10T11:50:56.344964+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:09:18.140936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345055+0000","last_change":"2023-08-10T11:50:54.898919+0000","last_active":"2023-08-10T11:50:56.345055+0000","last_peered":"2023-08-10T11:50:56.345055+0000","last_clean":"2023-08-10T11:50:56.345055+0000","last_became_active":"2023-08-10T11:50:54.898599+0000","last_became_peered":"2023-08-10T11:50:54.898599+0000","last_unstale":"2023-08-10T11:50:56.345055+0000","last_undegraded":"2023-08-10T11:50:56.345055+0000","last_fullsized":"2023-08-10T11:50:56.345055+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:48:49.804005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.145117+0000","last_change":"2023-08-10T11:50:54.911359+0000","last_active":"2023-08-10T11:50:56.145117+0000","last_peered":"2023-08-10T11:50:56.145117+0000","last_clean":"2023-08-10T11:50:56.145117+0000","last_became_active":"2023-08-10T11:50:54.911049+0000","last_became_peered":"2023-08-10T11:50:54.911049+0000","last_unstale":"2023-08-10T11:50:56.145117+0000","last_undegraded":"2023-08-10T11:50:56.145117+0000","last_fullsized":"2023-08-10T11:50:56.145117+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:09:44.046537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890718+0000","last_change":"2023-08-10T11:50:54.906811+0000","last_active":"2023-08-10T11:50:55.890718+0000","last_peered":"2023-08-10T11:50:55.890718+0000","last_clean":"2023-08-10T11:50:55.890718+0000","last_became_active":"2023-08-10T11:50:54.906456+0000","last_became_peered":"2023-08-10T11:50:54.906456+0000","last_unstale":"2023-08-10T11:50:55.890718+0000","last_undegraded":"2023-08-10T11:50:55.890718+0000","last_fullsized":"2023-08-10T11:50:55.890718+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:39:05.932046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345108+0000","last_change":"2023-08-10T11:50:54.957297+0000","last_active":"2023-08-10T11:50:56.345108+0000","last_peered":"2023-08-10T11:50:56.345108+0000","last_clean":"2023-08-10T11:50:56.345108+0000","last_became_active":"2023-08-10T11:50:54.956977+0000","last_became_peered":"2023-08-10T11:50:54.956977+0000","last_unstale":"2023-08-10T11:50:56.345108+0000","last_undegraded":"2023-08-10T11:50:56.345108+0000","last_fullsized":"2023-08-10T11:50:56.345108+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:45:21.997235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345139+0000","last_change":"2023-08-10T11:50:54.964300+0000","last_active":"2023-08-10T11:50:56.345139+0000","last_peered":"2023-08-10T11:50:56.345139+0000","last_clean":"2023-08-10T11:50:56.345139+0000","last_became_active":"2023-08-10T11:50:54.963876+0000","last_became_peered":"2023-08-10T11:50:54.963876+0000","last_unstale":"2023-08-10T11:50:56.345139+0000","last_undegraded":"2023-08-10T11:50:56.345139+0000","last_fullsized":"2023-08-10T11:50:56.345139+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:24:23.291049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344840+0000","last_change":"2023-08-10T11:50:54.958661+0000","last_active":"2023-08-10T11:50:56.344840+0000","last_peered":"2023-08-10T11:50:56.344840+0000","last_clean":"2023-08-10T11:50:56.344840+0000","last_became_active":"2023-08-10T11:50:54.958342+0000","last_became_peered":"2023-08-10T11:50:54.958342+0000","last_unstale":"2023-08-10T11:50:56.344840+0000","last_undegraded":"2023-08-10T11:50:56.344840+0000","last_fullsized":"2023-08-10T11:50:56.344840+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:04:39.541590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.892490+0000","last_change":"2023-08-10T11:50:54.902033+0000","last_active":"2023-08-10T11:50:55.892490+0000","last_peered":"2023-08-10T11:50:55.892490+0000","last_clean":"2023-08-10T11:50:55.892490+0000","last_became_active":"2023-08-10T11:50:54.901713+0000","last_became_peered":"2023-08-10T11:50:54.901713+0000","last_unstale":"2023-08-10T11:50:55.892490+0000","last_undegraded":"2023-08-10T11:50:55.892490+0000","last_fullsized":"2023-08-10T11:50:55.892490+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:19:46.017158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345900+0000","last_change":"2023-08-10T11:50:54.899377+0000","last_active":"2023-08-10T11:50:56.345900+0000","last_peered":"2023-08-10T11:50:56.345900+0000","last_clean":"2023-08-10T11:50:56.345900+0000","last_became_active":"2023-08-10T11:50:54.898657+0000","last_became_peered":"2023-08-10T11:50:54.898657+0000","last_unstale":"2023-08-10T11:50:56.345900+0000","last_undegraded":"2023-08-10T11:50:56.345900+0000","last_fullsized":"2023-08-10T11:50:56.345900+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:44:32.788127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.144836+0000","last_change":"2023-08-10T11:50:54.900304+0000","last_active":"2023-08-10T11:50:56.144836+0000","last_peered":"2023-08-10T11:50:56.144836+0000","last_clean":"2023-08-10T11:50:56.144836+0000","last_became_active":"2023-08-10T11:50:54.899978+0000","last_became_peered":"2023-08-10T11:50:54.899978+0000","last_unstale":"2023-08-10T11:50:56.144836+0000","last_undegraded":"2023-08-10T11:50:56.144836+0000","last_fullsized":"2023-08-10T11:50:56.144836+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:11:52.447215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6132,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":152,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":331776,"data_stored":53705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449100,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":897024,"data_stored":429425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]}]},{"osd":10,"up_from":70,"seq":300647710736,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28516,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716636,"statfs":{"total":95995035648,"available":95965835264,"internally_reserved":0,"allocated":1536000,"data_stored":1022488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":1,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.309},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.622}]},{"osd":3,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.443},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.41999999999999998}]},{"osd":4,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.379}]},{"osd":5,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":8,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.58999999999999997}]},{"osd":9,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.52300000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":9,"up_from":65,"seq":279172874261,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":429751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Aug 10 11:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Aug 10 11:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Aug 10 11:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.63100000000000001}]},{"osd":4,"last update":"Thu Aug 10 11:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Aug 10 11:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.78600000000000003}]},{"osd":6,"last update":"Thu Aug 10 11:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Aug 10 11:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.82499999999999996}]},{"osd":8,"last update":"Thu Aug 10 11:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.74099999999999999}]},{"osd":10,"last update":"Thu Aug 10 11:50:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.77500000000000002}]}]},{"osd":8,"up_from":57,"seq":244813135897,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":901120,"data_stored":429447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Aug 10 11:50:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.67600000000000005}]},{"osd":2,"last update":"Thu Aug 10 11:50:11 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Aug 10 11:50:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Aug 10 11:50:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Aug 10 11:50:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Aug 10 11:50:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Aug 10 11:50:11 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.72999999999999998}]},{"osd":9,"last update":"Thu Aug 10 11:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.745},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.83799999999999997}]},{"osd":10,"last update":"Thu Aug 10 11:50:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.80700000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]}]},{"osd":7,"up_from":50,"seq":214748364829,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1507328,"data_stored":1021306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.54500000000000004,"15min":0.53100000000000003},"min":{"1min":0.42099999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.51500000000000001,"15min":0.503},"min":{"1min":0.434,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.40899999999999997}]},{"osd":1,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.41699999999999998,"15min":0.40699999999999997},"min":{"1min":0.308,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.439,"15min":0.42699999999999999},"min":{"1min":0.307,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.42299999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77900000000000003,"5min":0.878,"15min":0.878},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59799999999999998,"15min":0.59099999999999997},"min":{"1min":0.45700000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82999999999999996,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.57499999999999996}]},{"osd":3,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.54300000000000004,"15min":0.53000000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.52600000000000002,"15min":0.51700000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.38600000000000001}]},{"osd":5,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.47599999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89400000000000002,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.64100000000000001,"15min":0.63200000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.62}]},{"osd":6,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.69699999999999995,"15min":0.68200000000000005},"min":{"1min":0.53900000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.502,"5min":0.497,"15min":0.497},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.46300000000000002}]},{"osd":8,"last update":"Thu Aug 10 11:50:10 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.63400000000000001}]},{"osd":9,"last update":"Thu Aug 10 11:50:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.753}]},{"osd":10,"last update":"Thu Aug 10 11:50:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.71799999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]}]},{"osd":6,"up_from":45,"seq":193273528354,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":428955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:32 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.36299999999999999,"15min":0.35499999999999998},"min":{"1min":0.29599999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.40000000000000002,"15min":0.39100000000000001},"min":{"1min":0.29199999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.314}]},{"osd":1,"last update":"Thu Aug 10 11:50:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.53900000000000003,"15min":0.52100000000000002},"min":{"1min":0.46200000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.54100000000000004,"15min":0.52900000000000003},"min":{"1min":0.42699999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Aug 10 11:50:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56399999999999995,"15min":0.56200000000000006},"min":{"1min":0.39500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.40799999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Aug 10 11:50:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.41399999999999998,"15min":0.40400000000000003},"min":{"1min":0.33900000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.47199999999999998,"15min":0.46400000000000002},"min":{"1min":0.308,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.28599999999999998}]},{"osd":4,"last update":"Thu Aug 10 11:50:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.43099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.379},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.59299999999999997,"15min":0.57999999999999996},"min":{"1min":0.44400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Aug 10 11:50:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.61599999999999999,"15min":0.60899999999999999},"min":{"1min":0.45000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.504},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.625,"15min":0.621},"min":{"1min":0.48399999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81599999999999995,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.495}]},{"osd":7,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65000000000000002,"15min":0.64400000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.65900000000000003,"15min":0.65100000000000002},"min":{"1min":0.53000000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.60299999999999998}]},{"osd":8,"last update":"Thu Aug 10 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.55600000000000005}]},{"osd":9,"last update":"Thu Aug 10 11:50:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.40799999999999997}]},{"osd":10,"last update":"Thu Aug 10 11:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.56699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":449476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52200000000000002,"15min":0.51100000000000001},"min":{"1min":0.378,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.52400000000000002,"15min":0.51400000000000001},"min":{"1min":0.376,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77800000000000002,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Aug 10 11:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.57899999999999996,"15min":0.57399999999999995},"min":{"1min":0.44600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.49099999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.79400000000000004}]},{"osd":3,"last update":"Thu Aug 10 11:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56100000000000005,"15min":0.54900000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53900000000000003,"15min":0.53700000000000003},"min":{"1min":0.376,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Aug 10 11:50:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.44,"15min":0.439},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.65400000000000003,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.47399999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.83699999999999997}]},{"osd":5,"last update":"Thu Aug 10 11:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.54300000000000004,"15min":0.53000000000000003},"min":{"1min":0.42099999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.754},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.56399999999999995,"15min":0.55000000000000004},"min":{"1min":0.42499999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Aug 10 11:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64400000000000002,"15min":0.64600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Aug 10 11:50:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.32100000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.92200000000000004,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.73299999999999998}]},{"osd":8,"last update":"Thu Aug 10 11:50:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.877}]},{"osd":9,"last update":"Thu Aug 10 11:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.85499999999999998}]},{"osd":10,"last update":"Thu Aug 10 11:50:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.82099999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738427,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":430321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 11:50:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.54400000000000004,"15min":0.504},"min":{"1min":0.51600000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.753},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.54600000000000004,"15min":0.52200000000000002},"min":{"1min":0.498,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73599999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Aug 10 11:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54000000000000004,"15min":0.52600000000000002},"min":{"1min":0.44700000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.76900000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.56499999999999995,"15min":0.54000000000000004},"min":{"1min":0.48299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Aug 10 11:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.34699999999999998,"15min":0.34100000000000003},"min":{"1min":0.26200000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.316},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.35599999999999998,"15min":0.34799999999999998},"min":{"1min":0.29299999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Aug 10 11:50:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.55100000000000005,"15min":0.52900000000000003},"min":{"1min":0.434,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.53400000000000003,"15min":0.52100000000000002},"min":{"1min":0.45200000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73099999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Aug 10 11:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42199999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72799999999999998,"5min":0.874,"15min":0.874},"last":0.5},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57199999999999995,"15min":0.56799999999999995},"min":{"1min":0.45400000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.70999999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Aug 10 11:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.49099999999999999,"15min":0.48599999999999999},"min":{"1min":0.29099999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.40999999999999998}]},{"osd":7,"last update":"Thu Aug 10 11:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.498,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.505}]},{"osd":8,"last update":"Thu Aug 10 11:50:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.52600000000000002}]},{"osd":9,"last update":"Thu Aug 10 11:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.56799999999999995}]},{"osd":10,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.625}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411379,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":909312,"data_stored":430441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52200000000000002,"15min":0.503},"min":{"1min":0.34599999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.53100000000000003,"15min":0.51300000000000001},"min":{"1min":0.44400000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.81100000000000005}]},{"osd":1,"last update":"Thu Aug 10 11:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.52900000000000003,"15min":0.51500000000000001},"min":{"1min":0.38100000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.65100000000000002,"15min":0.66800000000000004},"min":{"1min":0.46300000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.83199999999999996,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Aug 10 11:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.66500000000000004,"15min":0.69199999999999995},"min":{"1min":0.42099999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.78500000000000003,"5min":3.7519999999999998,"15min":3.7519999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.50900000000000001,"15min":0.49099999999999999},"min":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71499999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.65600000000000003,"15min":0.67600000000000005},"min":{"1min":0.45900000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.85199999999999998,"5min":3.6960000000000002,"15min":3.6960000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.58899999999999997,"15min":0.55300000000000005},"min":{"1min":0.44500000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.47699999999999998}]},{"osd":5,"last update":"Thu Aug 10 11:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47199999999999998,"15min":0.46899999999999997},"min":{"1min":0.35099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.60999999999999999,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.433,"15min":0.42899999999999999},"min":{"1min":0.32800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu Aug 10 11:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.56999999999999995,"15min":0.55900000000000005},"min":{"1min":0.40999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.65600000000000003,"15min":0.64600000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.73899999999999999,"15min":0.73799999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.503}]},{"osd":8,"last update":"Thu Aug 10 11:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.67200000000000004}]},{"osd":9,"last update":"Thu Aug 10 11:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.63},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.60399999999999998}]},{"osd":10,"last update":"Thu Aug 10 11:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.748}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]},{"osd":3,"up_from":25,"seq":107374182447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":429396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.23599999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.55700000000000005,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.36399999999999999,"15min":0.35799999999999998},"min":{"1min":0.253,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.52500000000000002,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.379}]},{"osd":1,"last update":"Thu Aug 10 11:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55400000000000005,"15min":0.55200000000000005},"min":{"1min":0.40300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.629}]},{"osd":2,"last update":"Thu Aug 10 11:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.57399999999999995,"15min":0.55300000000000005},"min":{"1min":0.378,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.57999999999999996,"15min":0.54800000000000004},"min":{"1min":0.44600000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Aug 10 11:50:48 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.432,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60499999999999998,"15min":0.59699999999999998},"min":{"1min":0.49299999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Aug 10 11:50:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57999999999999996,"15min":0.57099999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.63200000000000001,"15min":0.61199999999999999},"min":{"1min":0.435,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Aug 10 11:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.48299999999999998,"15min":0.46800000000000003},"min":{"1min":0.36399999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.47499999999999998,"15min":0.45900000000000002},"min":{"1min":0.33500000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.433}]},{"osd":7,"last update":"Thu Aug 10 11:50:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.52400000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.89800000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.755},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.59799999999999998}]},{"osd":8,"last update":"Thu Aug 10 11:50:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.67900000000000005}]},{"osd":9,"last update":"Thu Aug 10 11:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.53900000000000003}]},{"osd":10,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.71499999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]},{"osd":4,"up_from":32,"seq":137438953515,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":429495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54200000000000004,"15min":0.51400000000000001},"min":{"1min":0.39500000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79700000000000004,"5min":1.875,"15min":1.875},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.54300000000000004,"15min":0.51700000000000002},"min":{"1min":0.40899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Aug 10 11:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.41399999999999998,"15min":0.40300000000000002},"min":{"1min":0.29299999999999998,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.71599999999999997,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.41699999999999998,"15min":0.39800000000000002},"min":{"1min":0.311,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Aug 10 11:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Aug 10 11:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.57399999999999995,"15min":0.54300000000000004},"min":{"1min":0.51800000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84899999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.36899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81499999999999995,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.40699999999999997}]},{"osd":5,"last update":"Thu Aug 10 11:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.46899999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.59599999999999997,"15min":0.58499999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.495}]},{"osd":6,"last update":"Thu Aug 10 11:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67400000000000004,"15min":0.67300000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.91300000000000003,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.65300000000000002,"15min":0.65500000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81999999999999995,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.434}]},{"osd":7,"last update":"Thu Aug 10 11:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.56299999999999994,"15min":0.54300000000000004},"min":{"1min":0.41099999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.54000000000000004,"15min":0.52600000000000002},"min":{"1min":0.36699999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.371}]},{"osd":8,"last update":"Thu Aug 10 11:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.64700000000000002}]},{"osd":9,"last update":"Thu Aug 10 11:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.63100000000000001}]},{"osd":10,"last update":"Thu Aug 10 11:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.71799999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]}]},{"osd":5,"up_from":37,"seq":158913789990,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1527808,"data_stored":1021502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54800000000000004,"15min":0.54500000000000004},"min":{"1min":0.35799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.746}]},{"osd":1,"last update":"Thu Aug 10 11:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.52200000000000002,"15min":0.51500000000000001},"min":{"1min":0.42499999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.624},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.42899999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Aug 10 11:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.38700000000000001,"15min":0.379},"min":{"1min":0.28499999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.39800000000000002},"min":{"1min":0.311,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Aug 10 11:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.54900000000000004},"min":{"1min":0.38400000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54200000000000004,"15min":0.53800000000000003},"min":{"1min":0.40600000000000003,"5min":0.378,"15min":0.378},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.97699999999999998}]},{"osd":4,"last update":"Thu Aug 10 11:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.58999999999999997,"15min":0.58399999999999996},"min":{"1min":0.50800000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.58399999999999996,"15min":0.57699999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.45000000000000001}]},{"osd":6,"last update":"Thu Aug 10 11:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.46700000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.77100000000000002}]},{"osd":7,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64700000000000002,"15min":0.64500000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.81699999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.58099999999999996}]},{"osd":8,"last update":"Thu Aug 10 11:50:08 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.55300000000000005}]},{"osd":9,"last update":"Thu Aug 10 11:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":1.113},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.89100000000000001}]},{"osd":10,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":1.0880000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":37941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T11:51:03.169 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-10T11:51:03.170 INFO:tasks.cephadm:Setting up client nodes... 2023-08-10T11:51:03.170 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-08-10T11:51:03.745 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:03.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:03 smithi152 ceph-mon[130220]: pgmap v260: 97 pgs: 97 active+clean; 583 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 5.2 KiB/s wr, 21 op/s 2023-08-10T11:51:03.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:03 smithi152 ceph-mon[130220]: mgrmap e17: x(active, since 6m), standbys: z, y 2023-08-10T11:51:03.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:03 smithi152 ceph-mon[130220]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T11:51:04.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:03 smithi156 ceph-mon[130574]: pgmap v260: 97 pgs: 97 active+clean; 583 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 5.2 KiB/s wr, 21 op/s 2023-08-10T11:51:04.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:03 smithi156 ceph-mon[130574]: mgrmap e17: x(active, since 6m), standbys: z, y 2023-08-10T11:51:04.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:03 smithi156 ceph-mon[130574]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T11:51:04.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:03 smithi073 ceph-mon[128869]: pgmap v260: 97 pgs: 97 active+clean; 583 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 5.2 KiB/s wr, 21 op/s 2023-08-10T11:51:04.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:03 smithi073 ceph-mon[128869]: mgrmap e17: x(active, since 6m), standbys: z, y 2023-08-10T11:51:04.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:03 smithi073 ceph-mon[128869]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T11:51:04.593 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:04 smithi073 ceph-mon[128869]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T11:51:04.870 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:04 smithi152 ceph-mon[130220]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T11:51:05.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:04 smithi156 ceph-mon[130574]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T11:51:05.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.133+0000 7f8878b4f700 1 -- 172.21.15.73:0/2131259087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8874100dc0 msgr2=0x7f88741011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:05.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.133+0000 7f8878b4f700 1 --2- 172.21.15.73:0/2131259087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8874100dc0 0x7f88741011e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f885c009990 tx=0x7f885c009ca0 comp rx=0 tx=0).stop 2023-08-10T11:51:05.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.133+0000 7f8878b4f700 1 -- 172.21.15.73:0/2131259087 shutdown_connections 2023-08-10T11:51:05.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.133+0000 7f8878b4f700 1 --2- 172.21.15.73:0/2131259087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8874100350 0x7f8874107bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:05.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.133+0000 7f8878b4f700 1 --2- 172.21.15.73:0/2131259087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8874100dc0 0x7f88741011e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:05.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.133+0000 7f8878b4f700 1 --2- 172.21.15.73:0/2131259087 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88740ff990 0x7f88740ffe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:05.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.133+0000 7f8878b4f700 1 -- 172.21.15.73:0/2131259087 >> 172.21.15.73:0/2131259087 conn(0x7f88740fa440 msgr2=0x7f88740fc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:05.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.133+0000 7f8878b4f700 1 -- 172.21.15.73:0/2131259087 shutdown_connections 2023-08-10T11:51:05.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.133+0000 7f8878b4f700 1 -- 172.21.15.73:0/2131259087 wait complete. 2023-08-10T11:51:05.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.134+0000 7f8878b4f700 1 Processor -- start 2023-08-10T11:51:05.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.134+0000 7f8878b4f700 1 -- start start 2023-08-10T11:51:05.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.134+0000 7f8878b4f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88740ff990 0x7f8874103730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:05.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.134+0000 7f8878b4f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8874100350 0x7f8874101d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:05.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.134+0000 7f8878b4f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8874100dc0 0x7f88741022c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:05.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.134+0000 7f8878b4f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8874102a40 con 0x7f88740ff990 2023-08-10T11:51:05.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.134+0000 7f8878b4f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8874102bb0 con 0x7f8874100dc0 2023-08-10T11:51:05.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.134+0000 7f8878b4f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88741a05c0 con 0x7f8874100350 2023-08-10T11:51:05.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.134+0000 7f887259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88740ff990 0x7f8874103730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:05.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.134+0000 7f887259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88740ff990 0x7f8874103730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59148/0 (socket says 172.21.15.73:59148) 2023-08-10T11:51:05.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.134+0000 7f887259c700 1 -- 172.21.15.73:0/1722429649 learned_addr learned my addr 172.21.15.73:0/1722429649 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:05.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.135+0000 7f8871d9b700 1 --2- 172.21.15.73:0/1722429649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8874100350 0x7f8874101d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:05.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.135+0000 7f887259c700 1 -- 172.21.15.73:0/1722429649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8874100350 msgr2=0x7f8874101d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:05.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.135+0000 7f887259c700 1 --2- 172.21.15.73:0/1722429649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8874100350 0x7f8874101d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:05.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.135+0000 7f887259c700 1 -- 172.21.15.73:0/1722429649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8874100dc0 msgr2=0x7f88741022c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:05.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.135+0000 7f8872d9d700 1 --2- 172.21.15.73:0/1722429649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8874100dc0 0x7f88741022c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:05.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.135+0000 7f887259c700 1 --2- 172.21.15.73:0/1722429649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8874100dc0 0x7f88741022c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:05.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.135+0000 7f887259c700 1 -- 172.21.15.73:0/1722429649 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c0095f0 con 0x7f88740ff990 2023-08-10T11:51:05.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.135+0000 7f8872d9d700 1 --2- 172.21.15.73:0/1722429649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8874100dc0 0x7f88741022c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:05.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.135+0000 7f887259c700 1 --2- 172.21.15.73:0/1722429649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88740ff990 0x7f8874103730 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f885c005910 tx=0x7f885c00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:05.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.135+0000 7f886b7fe700 1 -- 172.21.15.73:0/1722429649 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c01d070 con 0x7f88740ff990 2023-08-10T11:51:05.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.135+0000 7f8878b4f700 1 -- 172.21.15.73:0/1722429649 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88741a0840 con 0x7f88740ff990 2023-08-10T11:51:05.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.135+0000 7f886b7fe700 1 -- 172.21.15.73:0/1722429649 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f885c00fc30 con 0x7f88740ff990 2023-08-10T11:51:05.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.135+0000 7f886b7fe700 1 -- 172.21.15.73:0/1722429649 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c017650 con 0x7f88740ff990 2023-08-10T11:51:05.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.135+0000 7f8878b4f700 1 -- 172.21.15.73:0/1722429649 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88741a0cb0 con 0x7f88740ff990 2023-08-10T11:51:05.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.137+0000 7f8878b4f700 1 -- 172.21.15.73:0/1722429649 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887410af90 con 0x7f88740ff990 2023-08-10T11:51:05.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.137+0000 7f886b7fe700 1 -- 172.21.15.73:0/1722429649 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f885c022470 con 0x7f88740ff990 2023-08-10T11:51:05.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.137+0000 7f886b7fe700 1 --2- 172.21.15.73:0/1722429649 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f88600a11e0 0x7f88600a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:05.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.138+0000 7f8871d9b700 1 --2- 172.21.15.73:0/1722429649 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f88600a11e0 0x7f88600a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:05.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.138+0000 7f886b7fe700 1 -- 172.21.15.73:0/1722429649 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f885c0cdd20 con 0x7f88740ff990 2023-08-10T11:51:05.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.138+0000 7f8871d9b700 1 --2- 172.21.15.73:0/1722429649 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f88600a11e0 0x7f88600a36a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8864005950 tx=0x7f88640058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:05.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.142+0000 7f886b7fe700 1 -- 172.21.15.73:0/1722429649 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f885c0975e0 con 0x7f88740ff990 2023-08-10T11:51:05.245 INFO:journalctl@ceph.mds.b.smithi152.stdout:Aug 10 11:51:04 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-b[155632]: 2023-08-10T11:51:04.869+0000 7fe10716b700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2023-08-10T11:51:05.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.403+0000 7f8878b4f700 1 -- 172.21.15.73:0/1722429649 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f887410b150 con 0x7f88740ff990 2023-08-10T11:51:05.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.407+0000 7f886b7fe700 1 -- 172.21.15.73:0/1722429649 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) v1 ==== 170+0+59 (secure 0 0 0) 0x7f885c09ac00 con 0x7f88740ff990 2023-08-10T11:51:05.408 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2023-08-10T11:51:05.408 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQApz9RkSHwYGBAAlT+Ec+oy9uEMij6UcjVupw== 2023-08-10T11:51:05.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.409+0000 7f8878b4f700 1 -- 172.21.15.73:0/1722429649 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f88600a11e0 msgr2=0x7f88600a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:05.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.409+0000 7f8878b4f700 1 --2- 172.21.15.73:0/1722429649 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f88600a11e0 0x7f88600a36a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8864005950 tx=0x7f88640058e0 comp rx=0 tx=0).stop 2023-08-10T11:51:05.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.409+0000 7f8878b4f700 1 -- 172.21.15.73:0/1722429649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88740ff990 msgr2=0x7f8874103730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:05.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.409+0000 7f8878b4f700 1 --2- 172.21.15.73:0/1722429649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88740ff990 0x7f8874103730 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f885c005910 tx=0x7f885c00f740 comp rx=0 tx=0).stop 2023-08-10T11:51:05.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.409+0000 7f8878b4f700 1 -- 172.21.15.73:0/1722429649 shutdown_connections 2023-08-10T11:51:05.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.409+0000 7f8878b4f700 1 --2- 172.21.15.73:0/1722429649 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f88600a11e0 0x7f88600a36a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:05.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.409+0000 7f8878b4f700 1 --2- 172.21.15.73:0/1722429649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8874100dc0 0x7f88741022c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:05.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.409+0000 7f8878b4f700 1 --2- 172.21.15.73:0/1722429649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88740ff990 0x7f8874103730 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:05.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.409+0000 7f8878b4f700 1 --2- 172.21.15.73:0/1722429649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8874100350 0x7f8874101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:05.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.409+0000 7f8878b4f700 1 -- 172.21.15.73:0/1722429649 >> 172.21.15.73:0/1722429649 conn(0x7f88740fa440 msgr2=0x7f88740fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:05.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.409+0000 7f8878b4f700 1 -- 172.21.15.73:0/1722429649 shutdown_connections 2023-08-10T11:51:05.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:05.409+0000 7f8878b4f700 1 -- 172.21.15.73:0/1722429649 wait complete. 2023-08-10T11:51:05.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:05 smithi073 ceph-mon[128869]: pgmap v261: 97 pgs: 97 active+clean; 585 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5.8 KiB/s wr, 24 op/s 2023-08-10T11:51:05.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:05 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1722429649' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-08-10T11:51:05.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:05 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1722429649' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-08-10T11:51:05.901 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-08-10T11:51:05.901 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-08-10T11:51:05.902 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-08-10T11:51:05.942 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-08-10T11:51:05.943 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-08-10T11:51:05.943 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph mgr dump --format=json 2023-08-10T11:51:05.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:05 smithi152 ceph-mon[130220]: pgmap v261: 97 pgs: 97 active+clean; 585 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5.8 KiB/s wr, 24 op/s 2023-08-10T11:51:05.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:05 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1722429649' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-08-10T11:51:05.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:05 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1722429649' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-08-10T11:51:06.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:05 smithi156 ceph-mon[130574]: pgmap v261: 97 pgs: 97 active+clean; 585 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5.8 KiB/s wr, 24 op/s 2023-08-10T11:51:06.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:05 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1722429649' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-08-10T11:51:06.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:05 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1722429649' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-08-10T11:51:06.529 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:07.645 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:07 smithi073 ceph-mon[128869]: pgmap v262: 97 pgs: 97 active+clean; 623 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 9.7 KiB/s wr, 27 op/s 2023-08-10T11:51:07.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.851+0000 7efd79585700 1 -- 172.21.15.73:0/962741241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd74103e40 msgr2=0x7efd74104220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:07.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.851+0000 7efd79585700 1 --2- 172.21.15.73:0/962741241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd74103e40 0x7efd74104220 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7efd68009990 tx=0x7efd68009ca0 comp rx=0 tx=0).stop 2023-08-10T11:51:07.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.851+0000 7efd79585700 1 -- 172.21.15.73:0/962741241 shutdown_connections 2023-08-10T11:51:07.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.851+0000 7efd79585700 1 --2- 172.21.15.73:0/962741241 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd740ffa50 0x7efd7410bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:07.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.851+0000 7efd79585700 1 --2- 172.21.15.73:0/962741241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd74103e40 0x7efd74104220 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:07.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.851+0000 7efd79585700 1 --2- 172.21.15.73:0/962741241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd740ff090 0x7efd740ff510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:07.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.851+0000 7efd79585700 1 -- 172.21.15.73:0/962741241 >> 172.21.15.73:0/962741241 conn(0x7efd74075bb0 msgr2=0x7efd74075fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:07.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.851+0000 7efd79585700 1 -- 172.21.15.73:0/962741241 shutdown_connections 2023-08-10T11:51:07.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.851+0000 7efd79585700 1 -- 172.21.15.73:0/962741241 wait complete. 2023-08-10T11:51:07.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.852+0000 7efd79585700 1 Processor -- start 2023-08-10T11:51:07.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.852+0000 7efd79585700 1 -- start start 2023-08-10T11:51:07.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.852+0000 7efd79585700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd740ff090 0x7efd741977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:07.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.852+0000 7efd79585700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd740ffa50 0x7efd74197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:07.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.852+0000 7efd79585700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd74103e40 0x7efd741a2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:07.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.852+0000 7efd79585700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd741a2d80 con 0x7efd740ff090 2023-08-10T11:51:07.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.852+0000 7efd79585700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd741a2ec0 con 0x7efd74103e40 2023-08-10T11:51:07.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.852+0000 7efd79585700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd741a3000 con 0x7efd740ffa50 2023-08-10T11:51:07.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.852+0000 7efd72ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd740ff090 0x7efd741977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:07.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.852+0000 7efd72ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd740ff090 0x7efd741977c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59160/0 (socket says 172.21.15.73:59160) 2023-08-10T11:51:07.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.852+0000 7efd72ffd700 1 -- 172.21.15.73:0/2972889042 learned_addr learned my addr 172.21.15.73:0/2972889042 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:07.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.853+0000 7efd727fc700 1 --2- 172.21.15.73:0/2972889042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd740ffa50 0x7efd74197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:07.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.853+0000 7efd737fe700 1 --2- 172.21.15.73:0/2972889042 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd74103e40 0x7efd741a2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:07.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.853+0000 7efd72ffd700 1 -- 172.21.15.73:0/2972889042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd740ffa50 msgr2=0x7efd74197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:07.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.853+0000 7efd72ffd700 1 --2- 172.21.15.73:0/2972889042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd740ffa50 0x7efd74197d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:07.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.853+0000 7efd72ffd700 1 -- 172.21.15.73:0/2972889042 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd74103e40 msgr2=0x7efd741a2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:07.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.853+0000 7efd72ffd700 1 --2- 172.21.15.73:0/2972889042 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd74103e40 0x7efd741a2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:07.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.853+0000 7efd72ffd700 1 -- 172.21.15.73:0/2972889042 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd680095f0 con 0x7efd740ff090 2023-08-10T11:51:07.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.853+0000 7efd727fc700 1 --2- 172.21.15.73:0/2972889042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd740ffa50 0x7efd74197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:51:07.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.853+0000 7efd737fe700 1 --2- 172.21.15.73:0/2972889042 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd74103e40 0x7efd741a2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:07.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.853+0000 7efd72ffd700 1 --2- 172.21.15.73:0/2972889042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd740ff090 0x7efd741977c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7efd680059d0 tx=0x7efd6800f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:07.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.853+0000 7efd5bfff700 1 -- 172.21.15.73:0/2972889042 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6801d070 con 0x7efd740ff090 2023-08-10T11:51:07.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.853+0000 7efd5bfff700 1 -- 172.21.15.73:0/2972889042 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd6800fbc0 con 0x7efd740ff090 2023-08-10T11:51:07.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.853+0000 7efd79585700 1 -- 172.21.15.73:0/2972889042 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd741a3200 con 0x7efd740ff090 2023-08-10T11:51:07.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.853+0000 7efd5bfff700 1 -- 172.21.15.73:0/2972889042 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd68017650 con 0x7efd740ff090 2023-08-10T11:51:07.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.853+0000 7efd79585700 1 -- 172.21.15.73:0/2972889042 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd741a36a0 con 0x7efd740ff090 2023-08-10T11:51:07.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.854+0000 7efd79585700 1 -- 172.21.15.73:0/2972889042 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd74107460 con 0x7efd740ff090 2023-08-10T11:51:07.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.855+0000 7efd5bfff700 1 -- 172.21.15.73:0/2972889042 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7efd68022470 con 0x7efd740ff090 2023-08-10T11:51:07.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.856+0000 7efd5bfff700 1 --2- 172.21.15.73:0/2972889042 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7efd5c0a11e0 0x7efd5c0a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:07.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.856+0000 7efd727fc700 1 --2- 172.21.15.73:0/2972889042 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7efd5c0a11e0 0x7efd5c0a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:07.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.856+0000 7efd5bfff700 1 -- 172.21.15.73:0/2972889042 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7efd680cdc30 con 0x7efd740ff090 2023-08-10T11:51:07.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.856+0000 7efd727fc700 1 --2- 172.21.15.73:0/2972889042 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7efd5c0a11e0 0x7efd5c0a36a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efd740fe7f0 tx=0x7efd6400b5f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:07.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:07.860+0000 7efd5bfff700 1 -- 172.21.15.73:0/2972889042 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7efd68097460 con 0x7efd740ff090 2023-08-10T11:51:07.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:07 smithi152 ceph-mon[130220]: pgmap v262: 97 pgs: 97 active+clean; 623 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 9.7 KiB/s wr, 27 op/s 2023-08-10T11:51:08.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:07 smithi156 ceph-mon[130574]: pgmap v262: 97 pgs: 97 active+clean; 623 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 9.7 KiB/s wr, 27 op/s 2023-08-10T11:51:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:08.100+0000 7efd79585700 1 -- 172.21.15.73:0/2972889042 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7efd740fe250 con 0x7efd740ff090 2023-08-10T11:51:08.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:08.104+0000 7efd5bfff700 1 -- 172.21.15.73:0/2972889042 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260125 (secure 0 0 0) 0x7efd6809aa80 con 0x7efd740ff090 2023-08-10T11:51:08.108 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:51:08.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:08.107+0000 7efd79585700 1 -- 172.21.15.73:0/2972889042 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7efd5c0a11e0 msgr2=0x7efd5c0a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:08.107+0000 7efd79585700 1 --2- 172.21.15.73:0/2972889042 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7efd5c0a11e0 0x7efd5c0a36a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efd740fe7f0 tx=0x7efd6400b5f0 comp rx=0 tx=0).stop 2023-08-10T11:51:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:08.107+0000 7efd79585700 1 -- 172.21.15.73:0/2972889042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd740ff090 msgr2=0x7efd741977c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:08.107+0000 7efd79585700 1 --2- 172.21.15.73:0/2972889042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd740ff090 0x7efd741977c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7efd680059d0 tx=0x7efd6800f710 comp rx=0 tx=0).stop 2023-08-10T11:51:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:08.107+0000 7efd79585700 1 -- 172.21.15.73:0/2972889042 shutdown_connections 2023-08-10T11:51:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:08.107+0000 7efd79585700 1 --2- 172.21.15.73:0/2972889042 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7efd5c0a11e0 0x7efd5c0a36a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:08.107+0000 7efd79585700 1 --2- 172.21.15.73:0/2972889042 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd74103e40 0x7efd741a2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:08.107+0000 7efd79585700 1 --2- 172.21.15.73:0/2972889042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd740ff090 0x7efd741977c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:08.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:08.107+0000 7efd79585700 1 --2- 172.21.15.73:0/2972889042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd740ffa50 0x7efd74197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:08.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:08.107+0000 7efd79585700 1 -- 172.21.15.73:0/2972889042 >> 172.21.15.73:0/2972889042 conn(0x7efd74075bb0 msgr2=0x7efd74103390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:08.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:08.107+0000 7efd79585700 1 -- 172.21.15.73:0/2972889042 shutdown_connections 2023-08-10T11:51:08.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:08.107+0000 7efd79585700 1 -- 172.21.15.73:0/2972889042 wait complete. 2023-08-10T11:51:08.572 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3797582815},{"type":"v1","addr":"172.21.15.73:6801","nonce":3797582815}]},"active_addr":"172.21.15.73:6801/3797582815","active_change":"2023-08-10T11:44:48.401821+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.73:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":978777874}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":3346699990}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":4199164995}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":2211661782}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":3673608933}]}]} 2023-08-10T11:51:08.580 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-08-10T11:51:08.580 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-08-10T11:51:08.580 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph osd dump --format=json 2023-08-10T11:51:08.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:08 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/2972889042' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-08-10T11:51:09.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:08 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/2972889042' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-08-10T11:51:09.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:08 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2972889042' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-08-10T11:51:09.143 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:09.713 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:09 smithi073 ceph-mon[128869]: pgmap v263: 97 pgs: 97 active+clean; 623 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 8.6 KiB/s wr, 25 op/s 2023-08-10T11:51:09.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:09 smithi152 ceph-mon[130220]: pgmap v263: 97 pgs: 97 active+clean; 623 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 8.6 KiB/s wr, 25 op/s 2023-08-10T11:51:10.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:09 smithi156 ceph-mon[130574]: pgmap v263: 97 pgs: 97 active+clean; 623 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 8.6 KiB/s wr, 25 op/s 2023-08-10T11:51:10.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.493+0000 7ffb8f14f700 1 -- 172.21.15.73:0/3359145569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb881007d0 msgr2=0x7ffb8810c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:10.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.493+0000 7ffb8f14f700 1 --2- 172.21.15.73:0/3359145569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb881007d0 0x7ffb8810c550 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ffb8000b0a0 tx=0x7ffb8000b3b0 comp rx=0 tx=0).stop 2023-08-10T11:51:10.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.493+0000 7ffb8f14f700 1 -- 172.21.15.73:0/3359145569 shutdown_connections 2023-08-10T11:51:10.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.493+0000 7ffb8f14f700 1 --2- 172.21.15.73:0/3359145569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb88105680 0x7ffb88105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:10.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.493+0000 7ffb8f14f700 1 --2- 172.21.15.73:0/3359145569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb881007d0 0x7ffb8810c550 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:10.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.493+0000 7ffb8f14f700 1 --2- 172.21.15.73:0/3359145569 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb880ffe10 0x7ffb88100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:10.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.493+0000 7ffb8f14f700 1 -- 172.21.15.73:0/3359145569 >> 172.21.15.73:0/3359145569 conn(0x7ffb88075be0 msgr2=0x7ffb880fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:10.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.493+0000 7ffb8f14f700 1 -- 172.21.15.73:0/3359145569 shutdown_connections 2023-08-10T11:51:10.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.493+0000 7ffb8f14f700 1 -- 172.21.15.73:0/3359145569 wait complete. 2023-08-10T11:51:10.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.494+0000 7ffb8f14f700 1 Processor -- start 2023-08-10T11:51:10.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.494+0000 7ffb8f14f700 1 -- start start 2023-08-10T11:51:10.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.494+0000 7ffb8f14f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb880ffe10 0x7ffb8819c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:10.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.494+0000 7ffb8f14f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb881007d0 0x7ffb8819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:10.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.494+0000 7ffb8f14f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb88105680 0x7ffb88196780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:10.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.494+0000 7ffb8f14f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb88196df0 con 0x7ffb88105680 2023-08-10T11:51:10.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.494+0000 7ffb8f14f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb88196f60 con 0x7ffb880ffe10 2023-08-10T11:51:10.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.494+0000 7ffb8f14f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb88197120 con 0x7ffb881007d0 2023-08-10T11:51:10.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.494+0000 7ffb8d6ec700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb88105680 0x7ffb88196780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:10.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.494+0000 7ffb8d6ec700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb88105680 0x7ffb88196780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59176/0 (socket says 172.21.15.73:59176) 2023-08-10T11:51:10.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.494+0000 7ffb8d6ec700 1 -- 172.21.15.73:0/1497756571 learned_addr learned my addr 172.21.15.73:0/1497756571 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:10.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.495+0000 7ffb87fff700 1 --2- 172.21.15.73:0/1497756571 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb881007d0 0x7ffb8819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:10.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.495+0000 7ffb8ceeb700 1 --2- 172.21.15.73:0/1497756571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb880ffe10 0x7ffb8819c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:10.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.495+0000 7ffb8d6ec700 1 -- 172.21.15.73:0/1497756571 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb881007d0 msgr2=0x7ffb8819cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:10.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.495+0000 7ffb8d6ec700 1 --2- 172.21.15.73:0/1497756571 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb881007d0 0x7ffb8819cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:10.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.495+0000 7ffb8d6ec700 1 -- 172.21.15.73:0/1497756571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb880ffe10 msgr2=0x7ffb8819c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:10.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.495+0000 7ffb8d6ec700 1 --2- 172.21.15.73:0/1497756571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb880ffe10 0x7ffb8819c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:10.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.495+0000 7ffb8d6ec700 1 -- 172.21.15.73:0/1497756571 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb80009d00 con 0x7ffb88105680 2023-08-10T11:51:10.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.495+0000 7ffb8ceeb700 1 --2- 172.21.15.73:0/1497756571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb880ffe10 0x7ffb8819c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:10.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.495+0000 7ffb8d6ec700 1 --2- 172.21.15.73:0/1497756571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb88105680 0x7ffb88196780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ffb8000b830 tx=0x7ffb80007a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:10.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.495+0000 7ffb85ffb700 1 -- 172.21.15.73:0/1497756571 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8000e040 con 0x7ffb88105680 2023-08-10T11:51:10.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.495+0000 7ffb8f14f700 1 -- 172.21.15.73:0/1497756571 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb881973a0 con 0x7ffb88105680 2023-08-10T11:51:10.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.495+0000 7ffb85ffb700 1 -- 172.21.15.73:0/1497756571 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb80004e10 con 0x7ffb88105680 2023-08-10T11:51:10.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.495+0000 7ffb85ffb700 1 -- 172.21.15.73:0/1497756571 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8001d480 con 0x7ffb88105680 2023-08-10T11:51:10.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.495+0000 7ffb8f14f700 1 -- 172.21.15.73:0/1497756571 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb881a36f0 con 0x7ffb88105680 2023-08-10T11:51:10.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.496+0000 7ffb8f14f700 1 -- 172.21.15.73:0/1497756571 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb8804e470 con 0x7ffb88105680 2023-08-10T11:51:10.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.497+0000 7ffb85ffb700 1 -- 172.21.15.73:0/1497756571 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7ffb80003a00 con 0x7ffb88105680 2023-08-10T11:51:10.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.498+0000 7ffb85ffb700 1 --2- 172.21.15.73:0/1497756571 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ffb780a11e0 0x7ffb780a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:10.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.498+0000 7ffb8ceeb700 1 --2- 172.21.15.73:0/1497756571 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ffb780a11e0 0x7ffb780a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:10.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.498+0000 7ffb85ffb700 1 -- 172.21.15.73:0/1497756571 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ffb800ce840 con 0x7ffb88105680 2023-08-10T11:51:10.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.498+0000 7ffb8ceeb700 1 --2- 172.21.15.73:0/1497756571 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ffb780a11e0 0x7ffb780a36a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c009b50 tx=0x7ffb7c009550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:10.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.501+0000 7ffb85ffb700 1 -- 172.21.15.73:0/1497756571 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ffb80097f70 con 0x7ffb88105680 2023-08-10T11:51:10.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.691+0000 7ffb8f14f700 1 -- 172.21.15.73:0/1497756571 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb881a3880 con 0x7ffb88105680 2023-08-10T11:51:10.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.692+0000 7ffb85ffb700 1 -- 172.21.15.73:0/1497756571 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22105 (secure 0 0 0) 0x7ffb8009b590 con 0x7ffb88105680 2023-08-10T11:51:10.693 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:51:10.694 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":83,"fsid":"0e619a74-3773-11ee-9b37-001a4aab830c","created":"2023-08-10T11:43:53.974768+0000","modified":"2023-08-10T11:50:55.886848+0000","last_up_change":"2023-08-10T11:50:12.914422+0000","last_in_change":"2023-08-10T11:49:54.624543+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T11:46:58.735153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T11:50:52.517974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T11:50:53.465357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3219ae18-cc4c-4712-b616-79f6949066e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6803","nonce":2725694252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6805","nonce":2725694252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6809","nonce":2725694252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6807","nonce":2725694252}]},"public_addr":"172.21.15.73:6803/2725694252","cluster_addr":"172.21.15.73:6805/2725694252","heartbeat_back_addr":"172.21.15.73:6809/2725694252","heartbeat_front_addr":"172.21.15.73:6807/2725694252","state":["exists","up"]},{"osd":1,"uuid":"bbfe6cd9-b3d3-4b8d-8814-507a867f8c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6801","nonce":836829168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6803","nonce":836829168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6807","nonce":836829168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6805","nonce":836829168}]},"public_addr":"172.21.15.152:6801/836829168","cluster_addr":"172.21.15.152:6803/836829168","heartbeat_back_addr":"172.21.15.152:6807/836829168","heartbeat_front_addr":"172.21.15.152:6805/836829168","state":["exists","up"]},{"osd":2,"uuid":"f57f5b2c-3208-45c0-beba-8501694b99c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6801","nonce":1789212298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6803","nonce":1789212298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6807","nonce":1789212298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6805","nonce":1789212298}]},"public_addr":"172.21.15.156:6801/1789212298","cluster_addr":"172.21.15.156:6803/1789212298","heartbeat_back_addr":"172.21.15.156:6807/1789212298","heartbeat_front_addr":"172.21.15.156:6805/1789212298","state":["exists","up"]},{"osd":3,"uuid":"18592408-3696-4ab8-ad41-c172b8409829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6811","nonce":3101572649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6813","nonce":3101572649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6817","nonce":3101572649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6815","nonce":3101572649}]},"public_addr":"172.21.15.73:6811/3101572649","cluster_addr":"172.21.15.73:6813/3101572649","heartbeat_back_addr":"172.21.15.73:6817/3101572649","heartbeat_front_addr":"172.21.15.73:6815/3101572649","state":["exists","up"]},{"osd":4,"uuid":"fb3adb09-8807-42d9-8db9-1867c5fe02da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6809","nonce":1451517889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6811","nonce":1451517889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6815","nonce":1451517889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6813","nonce":1451517889}]},"public_addr":"172.21.15.152:6809/1451517889","cluster_addr":"172.21.15.152:6811/1451517889","heartbeat_back_addr":"172.21.15.152:6815/1451517889","heartbeat_front_addr":"172.21.15.152:6813/1451517889","state":["exists","up"]},{"osd":5,"uuid":"af58a7bd-4e58-4639-95b2-4a76011b61dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6809","nonce":3823368741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6811","nonce":3823368741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6815","nonce":3823368741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6813","nonce":3823368741}]},"public_addr":"172.21.15.156:6809/3823368741","cluster_addr":"172.21.15.156:6811/3823368741","heartbeat_back_addr":"172.21.15.156:6815/3823368741","heartbeat_front_addr":"172.21.15.156:6813/3823368741","state":["exists","up"]},{"osd":6,"uuid":"f6ae502d-4af9-4f6a-8636-b5b683dfdfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6819","nonce":2533620458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6821","nonce":2533620458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6825","nonce":2533620458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6823","nonce":2533620458}]},"public_addr":"172.21.15.73:6819/2533620458","cluster_addr":"172.21.15.73:6821/2533620458","heartbeat_back_addr":"172.21.15.73:6825/2533620458","heartbeat_front_addr":"172.21.15.73:6823/2533620458","state":["exists","up"]},{"osd":7,"uuid":"398fd334-5f6f-427c-95ae-3244fb466f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6817","nonce":4059538477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6819","nonce":4059538477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6823","nonce":4059538477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6821","nonce":4059538477}]},"public_addr":"172.21.15.152:6817/4059538477","cluster_addr":"172.21.15.152:6819/4059538477","heartbeat_back_addr":"172.21.15.152:6823/4059538477","heartbeat_front_addr":"172.21.15.152:6821/4059538477","state":["exists","up"]},{"osd":8,"uuid":"58f46e64-2624-4ad4-bb6a-225624153837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6817","nonce":96487555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6819","nonce":96487555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6823","nonce":96487555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6821","nonce":96487555}]},"public_addr":"172.21.15.156:6817/96487555","cluster_addr":"172.21.15.156:6819/96487555","heartbeat_back_addr":"172.21.15.156:6823/96487555","heartbeat_front_addr":"172.21.15.156:6821/96487555","state":["exists","up"]},{"osd":9,"uuid":"9389dd5b-da2d-43b6-8bc0-bb1af13f72c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6827","nonce":2050124321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6829","nonce":2050124321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6833","nonce":2050124321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6831","nonce":2050124321}]},"public_addr":"172.21.15.73:6827/2050124321","cluster_addr":"172.21.15.73:6829/2050124321","heartbeat_back_addr":"172.21.15.73:6833/2050124321","heartbeat_front_addr":"172.21.15.73:6831/2050124321","state":["exists","up"]},{"osd":10,"uuid":"563c1e34-3acd-46ab-ba36-e9d87f635e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6825","nonce":1513186350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6827","nonce":1513186350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6831","nonce":1513186350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6829","nonce":1513186350}]},"public_addr":"172.21.15.152:6825/1513186350","cluster_addr":"172.21.15.152:6827/1513186350","heartbeat_back_addr":"172.21.15.152:6831/1513186350","heartbeat_front_addr":"172.21.15.152:6829/1513186350","state":["exists","up"]},{"osd":11,"uuid":"f1b55889-14fd-4cc9-bed7-43748086fb77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6825","nonce":737904755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6827","nonce":737904755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6831","nonce":737904755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6829","nonce":737904755}]},"public_addr":"172.21.15.156:6825/737904755","cluster_addr":"172.21.15.156:6827/737904755","heartbeat_back_addr":"172.21.15.156:6831/737904755","heartbeat_front_addr":"172.21.15.156:6829/737904755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:12.023797+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:33.872883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:55.856970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:18.013196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:39.202872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:00.393920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:22.743083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:43.921728+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:05.859488+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:27.618714+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:48.880286+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:50:11.055141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/2202785670":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6800/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:6800/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/1447381524":"2023-08-11T11:44:48.401660+0000","172.21.15.73:0/2545059698":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/4193457623":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2561039569":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2927950081":"2023-08-11T11:44:48.401660+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T11:51:10.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.694+0000 7ffb8f14f700 1 -- 172.21.15.73:0/1497756571 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ffb780a11e0 msgr2=0x7ffb780a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:10.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.694+0000 7ffb8f14f700 1 --2- 172.21.15.73:0/1497756571 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ffb780a11e0 0x7ffb780a36a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c009b50 tx=0x7ffb7c009550 comp rx=0 tx=0).stop 2023-08-10T11:51:10.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.694+0000 7ffb8f14f700 1 -- 172.21.15.73:0/1497756571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb88105680 msgr2=0x7ffb88196780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:10.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.694+0000 7ffb8f14f700 1 --2- 172.21.15.73:0/1497756571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb88105680 0x7ffb88196780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ffb8000b830 tx=0x7ffb80007a60 comp rx=0 tx=0).stop 2023-08-10T11:51:10.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.694+0000 7ffb8f14f700 1 -- 172.21.15.73:0/1497756571 shutdown_connections 2023-08-10T11:51:10.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.694+0000 7ffb8f14f700 1 --2- 172.21.15.73:0/1497756571 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ffb780a11e0 0x7ffb780a36a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:10.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.694+0000 7ffb8f14f700 1 --2- 172.21.15.73:0/1497756571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb880ffe10 0x7ffb8819c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:10.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.694+0000 7ffb8f14f700 1 --2- 172.21.15.73:0/1497756571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb88105680 0x7ffb88196780 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:10.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.694+0000 7ffb8f14f700 1 --2- 172.21.15.73:0/1497756571 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb881007d0 0x7ffb8819cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:10.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.694+0000 7ffb8f14f700 1 -- 172.21.15.73:0/1497756571 >> 172.21.15.73:0/1497756571 conn(0x7ffb88075be0 msgr2=0x7ffb88102bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:10.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.695+0000 7ffb8f14f700 1 -- 172.21.15.73:0/1497756571 shutdown_connections 2023-08-10T11:51:10.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:10.695+0000 7ffb8f14f700 1 -- 172.21.15.73:0/1497756571 wait complete. 2023-08-10T11:51:11.184 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-08-10T11:51:11.185 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph osd dump --format=json 2023-08-10T11:51:11.736 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:11.986 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:11 smithi073 ceph-mon[128869]: pgmap v264: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.7 KiB/s wr, 25 op/s 2023-08-10T11:51:11.987 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:11 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1497756571' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:51:11.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:11 smithi152 ceph-mon[130220]: pgmap v264: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.7 KiB/s wr, 25 op/s 2023-08-10T11:51:11.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:11 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1497756571' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:51:12.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:11 smithi156 ceph-mon[130574]: pgmap v264: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.7 KiB/s wr, 25 op/s 2023-08-10T11:51:12.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:11 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1497756571' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:51:13.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.089+0000 7f9624146700 1 -- 172.21.15.73:0/1224826672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f961c106780 msgr2=0x7f961c106b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:13.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.089+0000 7f9624146700 1 --2- 172.21.15.73:0/1224826672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f961c106780 0x7f961c106b60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9610009990 tx=0x7f9610009ca0 comp rx=0 tx=0).stop 2023-08-10T11:51:13.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.089+0000 7f9624146700 1 -- 172.21.15.73:0/1224826672 shutdown_connections 2023-08-10T11:51:13.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.089+0000 7f9624146700 1 --2- 172.21.15.73:0/1224826672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f961c101140 0x7f961c10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:13.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.089+0000 7f9624146700 1 --2- 172.21.15.73:0/1224826672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f961c106780 0x7f961c106b60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:13.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.089+0000 7f9624146700 1 --2- 172.21.15.73:0/1224826672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f961c100780 0x7f961c100c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:13.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.089+0000 7f9624146700 1 -- 172.21.15.73:0/1224826672 >> 172.21.15.73:0/1224826672 conn(0x7f961c0fc210 msgr2=0x7f961c0fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:13.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.089+0000 7f9624146700 1 -- 172.21.15.73:0/1224826672 shutdown_connections 2023-08-10T11:51:13.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.090+0000 7f9624146700 1 -- 172.21.15.73:0/1224826672 wait complete. 2023-08-10T11:51:13.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.090+0000 7f9624146700 1 Processor -- start 2023-08-10T11:51:13.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.090+0000 7f9624146700 1 -- start start 2023-08-10T11:51:13.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.090+0000 7f9624146700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f961c100780 0x7f961c19c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:13.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.090+0000 7f9624146700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f961c101140 0x7f961c19caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:13.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.090+0000 7f9624146700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f961c106780 0x7f961c196630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:13.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.090+0000 7f9624146700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961c196ca0 con 0x7f961c100780 2023-08-10T11:51:13.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.090+0000 7f9624146700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961c196e10 con 0x7f961c106780 2023-08-10T11:51:13.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.090+0000 7f9624146700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961c196fd0 con 0x7f961c101140 2023-08-10T11:51:13.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.090+0000 7f9621ee2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f961c100780 0x7f961c19c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:13.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.090+0000 7f9621ee2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f961c100780 0x7f961c19c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59186/0 (socket says 172.21.15.73:59186) 2023-08-10T11:51:13.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.090+0000 7f9621ee2700 1 -- 172.21.15.73:0/1279896724 learned_addr learned my addr 172.21.15.73:0/1279896724 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:13.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.091+0000 7f96216e1700 1 --2- 172.21.15.73:0/1279896724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f961c101140 0x7f961c19caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:13.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.091+0000 7f96226e3700 1 --2- 172.21.15.73:0/1279896724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f961c106780 0x7f961c196630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:13.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.091+0000 7f9621ee2700 1 -- 172.21.15.73:0/1279896724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f961c101140 msgr2=0x7f961c19caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:13.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.091+0000 7f9621ee2700 1 --2- 172.21.15.73:0/1279896724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f961c101140 0x7f961c19caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:13.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.091+0000 7f9621ee2700 1 -- 172.21.15.73:0/1279896724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f961c106780 msgr2=0x7f961c196630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:13.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.091+0000 7f9621ee2700 1 --2- 172.21.15.73:0/1279896724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f961c106780 0x7f961c196630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:13.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.091+0000 7f9621ee2700 1 -- 172.21.15.73:0/1279896724 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96100095f0 con 0x7f961c100780 2023-08-10T11:51:13.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.091+0000 7f96226e3700 1 --2- 172.21.15.73:0/1279896724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f961c106780 0x7f961c196630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:13.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.091+0000 7f9621ee2700 1 --2- 172.21.15.73:0/1279896724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f961c100780 0x7f961c19c5b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9610000c00 tx=0x7f961000f830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:13.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.091+0000 7f960effd700 1 -- 172.21.15.73:0/1279896724 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961001d070 con 0x7f961c100780 2023-08-10T11:51:13.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.091+0000 7f960effd700 1 -- 172.21.15.73:0/1279896724 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f961000fce0 con 0x7f961c100780 2023-08-10T11:51:13.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.091+0000 7f960effd700 1 -- 172.21.15.73:0/1279896724 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96100176e0 con 0x7f961c100780 2023-08-10T11:51:13.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.091+0000 7f9624146700 1 -- 172.21.15.73:0/1279896724 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961c197250 con 0x7f961c100780 2023-08-10T11:51:13.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.091+0000 7f9624146700 1 -- 172.21.15.73:0/1279896724 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961c1a35a0 con 0x7f961c100780 2023-08-10T11:51:13.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.092+0000 7f9624146700 1 -- 172.21.15.73:0/1279896724 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f961c04e470 con 0x7f961c100780 2023-08-10T11:51:13.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.093+0000 7f960effd700 1 -- 172.21.15.73:0/1279896724 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f9610022470 con 0x7f961c100780 2023-08-10T11:51:13.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.094+0000 7f960effd700 1 --2- 172.21.15.73:0/1279896724 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f96080a1260 0x7f96080a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:13.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.094+0000 7f96216e1700 1 --2- 172.21.15.73:0/1279896724 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f96080a1260 0x7f96080a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:13.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.094+0000 7f960effd700 1 -- 172.21.15.73:0/1279896724 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f96100cddb0 con 0x7f961c100780 2023-08-10T11:51:13.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.094+0000 7f96216e1700 1 --2- 172.21.15.73:0/1279896724 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f96080a1260 0x7f96080a3720 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9618005ea0 tx=0x7f9618005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:13.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.098+0000 7f960effd700 1 -- 172.21.15.73:0/1279896724 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f961005c790 con 0x7f961c100780 2023-08-10T11:51:13.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.285+0000 7f9624146700 1 -- 172.21.15.73:0/1279896724 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f961c197b40 con 0x7f961c100780 2023-08-10T11:51:13.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.286+0000 7f960effd700 1 -- 172.21.15.73:0/1279896724 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22105 (secure 0 0 0) 0x7f9610027090 con 0x7f961c100780 2023-08-10T11:51:13.288 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:51:13.288 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":83,"fsid":"0e619a74-3773-11ee-9b37-001a4aab830c","created":"2023-08-10T11:43:53.974768+0000","modified":"2023-08-10T11:50:55.886848+0000","last_up_change":"2023-08-10T11:50:12.914422+0000","last_in_change":"2023-08-10T11:49:54.624543+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T11:46:58.735153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T11:50:52.517974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T11:50:53.465357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3219ae18-cc4c-4712-b616-79f6949066e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6803","nonce":2725694252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6805","nonce":2725694252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6809","nonce":2725694252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6807","nonce":2725694252}]},"public_addr":"172.21.15.73:6803/2725694252","cluster_addr":"172.21.15.73:6805/2725694252","heartbeat_back_addr":"172.21.15.73:6809/2725694252","heartbeat_front_addr":"172.21.15.73:6807/2725694252","state":["exists","up"]},{"osd":1,"uuid":"bbfe6cd9-b3d3-4b8d-8814-507a867f8c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6801","nonce":836829168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6803","nonce":836829168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6807","nonce":836829168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6805","nonce":836829168}]},"public_addr":"172.21.15.152:6801/836829168","cluster_addr":"172.21.15.152:6803/836829168","heartbeat_back_addr":"172.21.15.152:6807/836829168","heartbeat_front_addr":"172.21.15.152:6805/836829168","state":["exists","up"]},{"osd":2,"uuid":"f57f5b2c-3208-45c0-beba-8501694b99c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6801","nonce":1789212298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6803","nonce":1789212298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6807","nonce":1789212298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6805","nonce":1789212298}]},"public_addr":"172.21.15.156:6801/1789212298","cluster_addr":"172.21.15.156:6803/1789212298","heartbeat_back_addr":"172.21.15.156:6807/1789212298","heartbeat_front_addr":"172.21.15.156:6805/1789212298","state":["exists","up"]},{"osd":3,"uuid":"18592408-3696-4ab8-ad41-c172b8409829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6811","nonce":3101572649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6813","nonce":3101572649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6817","nonce":3101572649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6815","nonce":3101572649}]},"public_addr":"172.21.15.73:6811/3101572649","cluster_addr":"172.21.15.73:6813/3101572649","heartbeat_back_addr":"172.21.15.73:6817/3101572649","heartbeat_front_addr":"172.21.15.73:6815/3101572649","state":["exists","up"]},{"osd":4,"uuid":"fb3adb09-8807-42d9-8db9-1867c5fe02da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6809","nonce":1451517889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6811","nonce":1451517889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6815","nonce":1451517889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6813","nonce":1451517889}]},"public_addr":"172.21.15.152:6809/1451517889","cluster_addr":"172.21.15.152:6811/1451517889","heartbeat_back_addr":"172.21.15.152:6815/1451517889","heartbeat_front_addr":"172.21.15.152:6813/1451517889","state":["exists","up"]},{"osd":5,"uuid":"af58a7bd-4e58-4639-95b2-4a76011b61dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6809","nonce":3823368741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6811","nonce":3823368741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6815","nonce":3823368741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6813","nonce":3823368741}]},"public_addr":"172.21.15.156:6809/3823368741","cluster_addr":"172.21.15.156:6811/3823368741","heartbeat_back_addr":"172.21.15.156:6815/3823368741","heartbeat_front_addr":"172.21.15.156:6813/3823368741","state":["exists","up"]},{"osd":6,"uuid":"f6ae502d-4af9-4f6a-8636-b5b683dfdfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6819","nonce":2533620458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6821","nonce":2533620458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6825","nonce":2533620458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6823","nonce":2533620458}]},"public_addr":"172.21.15.73:6819/2533620458","cluster_addr":"172.21.15.73:6821/2533620458","heartbeat_back_addr":"172.21.15.73:6825/2533620458","heartbeat_front_addr":"172.21.15.73:6823/2533620458","state":["exists","up"]},{"osd":7,"uuid":"398fd334-5f6f-427c-95ae-3244fb466f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6817","nonce":4059538477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6819","nonce":4059538477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6823","nonce":4059538477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6821","nonce":4059538477}]},"public_addr":"172.21.15.152:6817/4059538477","cluster_addr":"172.21.15.152:6819/4059538477","heartbeat_back_addr":"172.21.15.152:6823/4059538477","heartbeat_front_addr":"172.21.15.152:6821/4059538477","state":["exists","up"]},{"osd":8,"uuid":"58f46e64-2624-4ad4-bb6a-225624153837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6817","nonce":96487555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6819","nonce":96487555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6823","nonce":96487555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6821","nonce":96487555}]},"public_addr":"172.21.15.156:6817/96487555","cluster_addr":"172.21.15.156:6819/96487555","heartbeat_back_addr":"172.21.15.156:6823/96487555","heartbeat_front_addr":"172.21.15.156:6821/96487555","state":["exists","up"]},{"osd":9,"uuid":"9389dd5b-da2d-43b6-8bc0-bb1af13f72c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6827","nonce":2050124321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6829","nonce":2050124321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6833","nonce":2050124321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6831","nonce":2050124321}]},"public_addr":"172.21.15.73:6827/2050124321","cluster_addr":"172.21.15.73:6829/2050124321","heartbeat_back_addr":"172.21.15.73:6833/2050124321","heartbeat_front_addr":"172.21.15.73:6831/2050124321","state":["exists","up"]},{"osd":10,"uuid":"563c1e34-3acd-46ab-ba36-e9d87f635e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6825","nonce":1513186350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6827","nonce":1513186350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6831","nonce":1513186350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6829","nonce":1513186350}]},"public_addr":"172.21.15.152:6825/1513186350","cluster_addr":"172.21.15.152:6827/1513186350","heartbeat_back_addr":"172.21.15.152:6831/1513186350","heartbeat_front_addr":"172.21.15.152:6829/1513186350","state":["exists","up"]},{"osd":11,"uuid":"f1b55889-14fd-4cc9-bed7-43748086fb77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6825","nonce":737904755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6827","nonce":737904755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6831","nonce":737904755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6829","nonce":737904755}]},"public_addr":"172.21.15.156:6825/737904755","cluster_addr":"172.21.15.156:6827/737904755","heartbeat_back_addr":"172.21.15.156:6831/737904755","heartbeat_front_addr":"172.21.15.156:6829/737904755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:12.023797+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:33.872883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:55.856970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:18.013196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:39.202872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:00.393920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:22.743083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:43.921728+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:05.859488+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:27.618714+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:48.880286+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:50:11.055141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/2202785670":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6800/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:6800/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/1447381524":"2023-08-11T11:44:48.401660+0000","172.21.15.73:0/2545059698":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/4193457623":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2561039569":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2927950081":"2023-08-11T11:44:48.401660+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T11:51:13.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.288+0000 7f9624146700 1 -- 172.21.15.73:0/1279896724 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f96080a1260 msgr2=0x7f96080a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:13.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.288+0000 7f9624146700 1 --2- 172.21.15.73:0/1279896724 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f96080a1260 0x7f96080a3720 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9618005ea0 tx=0x7f9618005e30 comp rx=0 tx=0).stop 2023-08-10T11:51:13.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.288+0000 7f9624146700 1 -- 172.21.15.73:0/1279896724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f961c100780 msgr2=0x7f961c19c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:13.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.288+0000 7f9624146700 1 --2- 172.21.15.73:0/1279896724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f961c100780 0x7f961c19c5b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9610000c00 tx=0x7f961000f830 comp rx=0 tx=0).stop 2023-08-10T11:51:13.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.288+0000 7f9624146700 1 -- 172.21.15.73:0/1279896724 shutdown_connections 2023-08-10T11:51:13.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.288+0000 7f9624146700 1 --2- 172.21.15.73:0/1279896724 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f96080a1260 0x7f96080a3720 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:13.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.288+0000 7f9624146700 1 --2- 172.21.15.73:0/1279896724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f961c106780 0x7f961c196630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:13.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.288+0000 7f9624146700 1 --2- 172.21.15.73:0/1279896724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f961c100780 0x7f961c19c5b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:13.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.288+0000 7f9624146700 1 --2- 172.21.15.73:0/1279896724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f961c101140 0x7f961c19caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:13.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.288+0000 7f9624146700 1 -- 172.21.15.73:0/1279896724 >> 172.21.15.73:0/1279896724 conn(0x7f961c0fc210 msgr2=0x7f961c0fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:13.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.288+0000 7f9624146700 1 -- 172.21.15.73:0/1279896724 shutdown_connections 2023-08-10T11:51:13.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:13.289+0000 7f9624146700 1 -- 172.21.15.73:0/1279896724 wait complete. 2023-08-10T11:51:13.669 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:13 smithi073 ceph-mon[128869]: pgmap v265: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.3 KiB/s wr, 21 op/s 2023-08-10T11:51:13.669 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:13 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1279896724' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:51:13.692 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2023-08-10T11:51:13.693 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2023-08-10T11:51:13.693 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2023-08-10T11:51:13.694 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2023-08-10T11:51:13.694 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2023-08-10T11:51:13.695 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2023-08-10T11:51:13.695 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2023-08-10T11:51:13.696 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2023-08-10T11:51:13.696 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph tell osd.8 flush_pg_stats 2023-08-10T11:51:13.697 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph tell osd.9 flush_pg_stats 2023-08-10T11:51:13.697 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph tell osd.10 flush_pg_stats 2023-08-10T11:51:13.698 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph tell osd.11 flush_pg_stats 2023-08-10T11:51:13.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:13 smithi152 ceph-mon[130220]: pgmap v265: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.3 KiB/s wr, 21 op/s 2023-08-10T11:51:13.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:13 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1279896724' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:51:14.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:13 smithi156 ceph-mon[130574]: pgmap v265: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.3 KiB/s wr, 21 op/s 2023-08-10T11:51:14.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:13 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1279896724' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:51:14.781 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:15.106 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:15.710 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:15 smithi073 ceph-mon[128869]: pgmap v266: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.4 KiB/s wr, 16 op/s 2023-08-10T11:51:15.774 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:15.824 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:15.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:15 smithi152 ceph-mon[130220]: pgmap v266: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.4 KiB/s wr, 16 op/s 2023-08-10T11:51:16.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:15 smithi156 ceph-mon[130574]: pgmap v266: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.4 KiB/s wr, 16 op/s 2023-08-10T11:51:16.024 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:16.249 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:16.471 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:16.798 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:16.841 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:16.915 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:17.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.240+0000 7f3fa5914700 1 -- 172.21.15.73:0/1365665692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fa0101b60 msgr2=0x7f3fa010c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:17.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.240+0000 7f3fa5914700 1 --2- 172.21.15.73:0/1365665692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fa0101b60 0x7f3fa010c670 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800b0a0 tx=0x7f3f9800b3b0 comp rx=0 tx=0).stop 2023-08-10T11:51:17.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.240+0000 7f3fa5914700 1 -- 172.21.15.73:0/1365665692 shutdown_connections 2023-08-10T11:51:17.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.240+0000 7f3fa5914700 1 --2- 172.21.15.73:0/1365665692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fa0101b60 0x7f3fa010c670 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:17.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.240+0000 7f3fa5914700 1 --2- 172.21.15.73:0/1365665692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fa00ffa60 0x7f3fa00ffe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:17.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.240+0000 7f3fa5914700 1 --2- 172.21.15.73:0/1365665692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fa01011a0 0x7f3fa0101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:17.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.240+0000 7f3fa5914700 1 -- 172.21.15.73:0/1365665692 >> 172.21.15.73:0/1365665692 conn(0x7f3fa0076760 msgr2=0x7f3fa0076b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:17.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.240+0000 7f3fa5914700 1 -- 172.21.15.73:0/1365665692 shutdown_connections 2023-08-10T11:51:17.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.240+0000 7f3fa5914700 1 -- 172.21.15.73:0/1365665692 wait complete. 2023-08-10T11:51:17.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.241+0000 7f3fa5914700 1 Processor -- start 2023-08-10T11:51:17.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.241+0000 7f3fa5914700 1 -- start start 2023-08-10T11:51:17.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.241+0000 7f3fa5914700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fa00ffa60 0x7f3fa019b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:17.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.241+0000 7f3fa5914700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fa01011a0 0x7f3fa019bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:17.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.241+0000 7f3fa5914700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fa0101b60 0x7f3fa0195890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:17.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.241+0000 7f3fa5914700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa0195f00 con 0x7f3fa00ffa60 2023-08-10T11:51:17.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.241+0000 7f3fa5914700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa0196070 con 0x7f3fa01011a0 2023-08-10T11:51:17.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.241+0000 7f3fa5914700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa0196230 con 0x7f3fa0101b60 2023-08-10T11:51:17.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.241+0000 7f3f9effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fa00ffa60 0x7f3fa019b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:17.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.241+0000 7f3f9effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fa00ffa60 0x7f3fa019b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59200/0 (socket says 172.21.15.73:59200) 2023-08-10T11:51:17.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.241+0000 7f3f9effd700 1 -- 172.21.15.73:0/3657491867 learned_addr learned my addr 172.21.15.73:0/3657491867 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:17.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.241+0000 7f3f9e7fc700 1 --2- 172.21.15.73:0/3657491867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fa01011a0 0x7f3fa019bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:17.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.242+0000 7f3f9effd700 1 -- 172.21.15.73:0/3657491867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fa0101b60 msgr2=0x7f3fa0195890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:17.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.242+0000 7f3f9effd700 1 --2- 172.21.15.73:0/3657491867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fa0101b60 0x7f3fa0195890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:17.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.242+0000 7f3f9effd700 1 -- 172.21.15.73:0/3657491867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fa01011a0 msgr2=0x7f3fa019bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:17.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.242+0000 7f3f9effd700 1 --2- 172.21.15.73:0/3657491867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fa01011a0 0x7f3fa019bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:17.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.242+0000 7f3f9effd700 1 -- 172.21.15.73:0/3657491867 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f98009d00 con 0x7f3fa00ffa60 2023-08-10T11:51:17.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.242+0000 7f3f9effd700 1 --2- 172.21.15.73:0/3657491867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fa00ffa60 0x7f3fa019b810 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000d950 tx=0x7f3f9000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:17.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.242+0000 7f3fa4912700 1 -- 172.21.15.73:0/3657491867 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f90009b40 con 0x7f3fa00ffa60 2023-08-10T11:51:17.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.242+0000 7f3fa4912700 1 -- 172.21.15.73:0/3657491867 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f90009ca0 con 0x7f3fa00ffa60 2023-08-10T11:51:17.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.242+0000 7f3fa5914700 1 -- 172.21.15.73:0/3657491867 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa0196510 con 0x7f3fa00ffa60 2023-08-10T11:51:17.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.242+0000 7f3fa4912700 1 -- 172.21.15.73:0/3657491867 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9000f620 con 0x7f3fa00ffa60 2023-08-10T11:51:17.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.242+0000 7f3fa5914700 1 -- 172.21.15.73:0/3657491867 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa01a2800 con 0x7f3fa00ffa60 2023-08-10T11:51:17.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.243+0000 7f3fa5914700 1 -- 172.21.15.73:0/3657491867 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3fa004e470 con 0x7f3fa00ffa60 2023-08-10T11:51:17.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.244+0000 7f3fa4912700 1 -- 172.21.15.73:0/3657491867 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f3f90010460 con 0x7f3fa00ffa60 2023-08-10T11:51:17.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.244+0000 7f3fa4912700 1 --2- 172.21.15.73:0/3657491867 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3f880a11e0 0x7f3f880a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:17.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.244+0000 7f3f9e7fc700 1 --2- 172.21.15.73:0/3657491867 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3f880a11e0 0x7f3f880a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:17.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.245+0000 7f3fa4912700 1 -- 172.21.15.73:0/3657491867 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3f900ccdd0 con 0x7f3fa00ffa60 2023-08-10T11:51:17.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.245+0000 7f3fa4912700 1 --2- 172.21.15.73:0/3657491867 >> [v2:172.21.15.73:6810/3101572649,v1:172.21.15.73:6811/3101572649] conn(0x7f3f880aa9c0 0x7f3f880acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:17.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.245+0000 7f3fa4912700 1 -- 172.21.15.73:0/3657491867 --> [v2:172.21.15.73:6810/3101572649,v1:172.21.15.73:6811/3101572649] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3f880ad490 con 0x7f3f880aa9c0 2023-08-10T11:51:17.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.245+0000 7f3fa4912700 1 -- 172.21.15.73:0/3657491867 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f900cd270 con 0x7f3fa00ffa60 2023-08-10T11:51:17.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.245+0000 7f3f9f7fe700 1 --2- 172.21.15.73:0/3657491867 >> [v2:172.21.15.73:6810/3101572649,v1:172.21.15.73:6811/3101572649] conn(0x7f3f880aa9c0 0x7f3f880acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:17.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.245+0000 7f3f9e7fc700 1 --2- 172.21.15.73:0/3657491867 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3f880a11e0 0x7f3f880a36a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3f94006fd0 tx=0x7f3f94008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:17.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.245+0000 7f3f9f7fe700 1 --2- 172.21.15.73:0/3657491867 >> [v2:172.21.15.73:6810/3101572649,v1:172.21.15.73:6811/3101572649] conn(0x7f3f880aa9c0 0x7f3f880acde0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:17.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.246+0000 7f3fa4912700 1 -- 172.21.15.73:0/3657491867 <== osd.3 v2:172.21.15.73:6810/3101572649 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f3f880ad490 con 0x7f3f880aa9c0 2023-08-10T11:51:17.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.261+0000 7f3fa5914700 1 -- 172.21.15.73:0/3657491867 --> [v2:172.21.15.73:6810/3101572649,v1:172.21.15.73:6811/3101572649] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3fa0104c60 con 0x7f3f880aa9c0 2023-08-10T11:51:17.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.262+0000 7f3fa4912700 1 -- 172.21.15.73:0/3657491867 <== osd.3 v2:172.21.15.73:6810/3101572649 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f3fa0104c60 con 0x7f3f880aa9c0 2023-08-10T11:51:17.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.262+0000 7f3fa5914700 1 -- 172.21.15.73:0/3657491867 >> [v2:172.21.15.73:6810/3101572649,v1:172.21.15.73:6811/3101572649] conn(0x7f3f880aa9c0 msgr2=0x7f3f880acde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:17.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.262+0000 7f3fa5914700 1 --2- 172.21.15.73:0/3657491867 >> [v2:172.21.15.73:6810/3101572649,v1:172.21.15.73:6811/3101572649] conn(0x7f3f880aa9c0 0x7f3f880acde0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:17.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.262+0000 7f3fa5914700 1 -- 172.21.15.73:0/3657491867 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3f880a11e0 msgr2=0x7f3f880a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:17.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.262+0000 7f3fa5914700 1 --2- 172.21.15.73:0/3657491867 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3f880a11e0 0x7f3f880a36a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3f94006fd0 tx=0x7f3f94008040 comp rx=0 tx=0).stop 2023-08-10T11:51:17.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.262+0000 7f3fa5914700 1 -- 172.21.15.73:0/3657491867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fa00ffa60 msgr2=0x7f3fa019b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:17.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.262+0000 7f3fa5914700 1 --2- 172.21.15.73:0/3657491867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fa00ffa60 0x7f3fa019b810 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000d950 tx=0x7f3f9000dd10 comp rx=0 tx=0).stop 2023-08-10T11:51:17.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.262+0000 7f3f9f7fe700 1 -- 172.21.15.73:0/3657491867 reap_dead start 2023-08-10T11:51:17.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.262+0000 7f3fa5914700 1 -- 172.21.15.73:0/3657491867 shutdown_connections 2023-08-10T11:51:17.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.262+0000 7f3fa5914700 1 -- 172.21.15.73:0/3657491867 >> 172.21.15.73:0/3657491867 conn(0x7f3fa0076760 msgr2=0x7f3fa0104310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:17.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.262+0000 7f3fa5914700 1 -- 172.21.15.73:0/3657491867 shutdown_connections 2023-08-10T11:51:17.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:17.262+0000 7f3fa5914700 1 -- 172.21.15.73:0/3657491867 wait complete. 2023-08-10T11:51:17.844 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:17 smithi073 ceph-mon[128869]: pgmap v267: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.2 KiB/s wr, 14 op/s 2023-08-10T11:51:17.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:17 smithi152 ceph-mon[130220]: pgmap v267: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.2 KiB/s wr, 14 op/s 2023-08-10T11:51:18.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:17 smithi156 ceph-mon[130574]: pgmap v267: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.2 KiB/s wr, 14 op/s 2023-08-10T11:51:19.490 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:19.499 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:19.753 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:19 smithi073 ceph-mon[128869]: pgmap v268: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2023-08-10T11:51:19.957 INFO:teuthology.orchestra.run.smithi073.stdout:107374182451 2023-08-10T11:51:19.957 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.3 2023-08-10T11:51:19.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:19 smithi152 ceph-mon[130220]: pgmap v268: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2023-08-10T11:51:20.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:19 smithi156 ceph-mon[130574]: pgmap v268: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2023-08-10T11:51:21.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.408+0000 7fe94864d700 1 -- 172.21.15.73:0/2746286726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9400ff680 msgr2=0x7fe9400ffb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:21.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.408+0000 7fe94864d700 1 --2- 172.21.15.73:0/2746286726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9400ff680 0x7fe9400ffb00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe93c009990 tx=0x7fe93c009ca0 comp rx=0 tx=0).stop 2023-08-10T11:51:21.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.409+0000 7fe94864d700 1 -- 172.21.15.73:0/2746286726 shutdown_connections 2023-08-10T11:51:21.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.409+0000 7fe94864d700 1 --2- 172.21.15.73:0/2746286726 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe940100040 0x7fe94010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:21.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.409+0000 7fe94864d700 1 --2- 172.21.15.73:0/2746286726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe940104550 0x7fe940104930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:21.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.409+0000 7fe94864d700 1 --2- 172.21.15.73:0/2746286726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9400ff680 0x7fe9400ffb00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:21.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.409+0000 7fe94864d700 1 -- 172.21.15.73:0/2746286726 >> 172.21.15.73:0/2746286726 conn(0x7fe9400767c0 msgr2=0x7fe940076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:21.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.409+0000 7fe94864d700 1 -- 172.21.15.73:0/2746286726 shutdown_connections 2023-08-10T11:51:21.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.409+0000 7fe94864d700 1 -- 172.21.15.73:0/2746286726 wait complete. 2023-08-10T11:51:21.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.409+0000 7fe94864d700 1 Processor -- start 2023-08-10T11:51:21.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.409+0000 7fe94864d700 1 -- start start 2023-08-10T11:51:21.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.409+0000 7fe94864d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9400ff680 0x7fe94019c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:21.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.409+0000 7fe94864d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe940100040 0x7fe94019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:21.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.409+0000 7fe94864d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe940104550 0x7fe940196750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:21.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.409+0000 7fe94864d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe940196e00 con 0x7fe940100040 2023-08-10T11:51:21.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.409+0000 7fe94864d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe940196f70 con 0x7fe940104550 2023-08-10T11:51:21.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.409+0000 7fe94864d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe940197130 con 0x7fe9400ff680 2023-08-10T11:51:21.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.410+0000 7fe945be8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe940100040 0x7fe94019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:21.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.410+0000 7fe945be8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe940100040 0x7fe94019cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59216/0 (socket says 172.21.15.73:59216) 2023-08-10T11:51:21.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.410+0000 7fe945be8700 1 -- 172.21.15.73:0/3778549187 learned_addr learned my addr 172.21.15.73:0/3778549187 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:21.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.410+0000 7fe9463e9700 1 --2- 172.21.15.73:0/3778549187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9400ff680 0x7fe94019c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:21.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.410+0000 7fe946bea700 1 --2- 172.21.15.73:0/3778549187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe940104550 0x7fe940196750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:21.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.410+0000 7fe945be8700 1 -- 172.21.15.73:0/3778549187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9400ff680 msgr2=0x7fe94019c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:21.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.410+0000 7fe945be8700 1 --2- 172.21.15.73:0/3778549187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9400ff680 0x7fe94019c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:21.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.410+0000 7fe945be8700 1 -- 172.21.15.73:0/3778549187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe940104550 msgr2=0x7fe940196750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:21.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.410+0000 7fe945be8700 1 --2- 172.21.15.73:0/3778549187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe940104550 0x7fe940196750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:21.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.410+0000 7fe945be8700 1 -- 172.21.15.73:0/3778549187 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93c0095f0 con 0x7fe940100040 2023-08-10T11:51:21.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.410+0000 7fe946bea700 1 --2- 172.21.15.73:0/3778549187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe940104550 0x7fe940196750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:21.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.410+0000 7fe945be8700 1 --2- 172.21.15.73:0/3778549187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe940100040 0x7fe94019cbf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe93c0095c0 tx=0x7fe93c00f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:21.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.410+0000 7fe9377fe700 1 -- 172.21.15.73:0/3778549187 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c01d070 con 0x7fe940100040 2023-08-10T11:51:21.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.410+0000 7fe94864d700 1 -- 172.21.15.73:0/3778549187 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9401973b0 con 0x7fe940100040 2023-08-10T11:51:21.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.410+0000 7fe9377fe700 1 -- 172.21.15.73:0/3778549187 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe93c00fc00 con 0x7fe940100040 2023-08-10T11:51:21.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.410+0000 7fe9377fe700 1 -- 172.21.15.73:0/3778549187 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c017650 con 0x7fe940100040 2023-08-10T11:51:21.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.410+0000 7fe94864d700 1 -- 172.21.15.73:0/3778549187 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9401a36e0 con 0x7fe940100040 2023-08-10T11:51:21.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.411+0000 7fe94864d700 1 -- 172.21.15.73:0/3778549187 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe94010f910 con 0x7fe940100040 2023-08-10T11:51:21.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.412+0000 7fe9377fe700 1 -- 172.21.15.73:0/3778549187 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fe93c022470 con 0x7fe940100040 2023-08-10T11:51:21.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.413+0000 7fe9377fe700 1 --2- 172.21.15.73:0/3778549187 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fe92c0a11e0 0x7fe92c0a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:21.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.413+0000 7fe9463e9700 1 --2- 172.21.15.73:0/3778549187 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fe92c0a11e0 0x7fe92c0a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:21.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.413+0000 7fe9377fe700 1 -- 172.21.15.73:0/3778549187 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe93c0ce480 con 0x7fe940100040 2023-08-10T11:51:21.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.413+0000 7fe9377fe700 1 --2- 172.21.15.73:0/3778549187 >> [v2:172.21.15.73:6802/2725694252,v1:172.21.15.73:6803/2725694252] conn(0x7fe92c0aa9c0 0x7fe92c0acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:21.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.413+0000 7fe9377fe700 1 -- 172.21.15.73:0/3778549187 --> [v2:172.21.15.73:6802/2725694252,v1:172.21.15.73:6803/2725694252] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe92c0ad490 con 0x7fe92c0aa9c0 2023-08-10T11:51:21.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.413+0000 7fe9377fe700 1 -- 172.21.15.73:0/3778549187 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe93c0ce920 con 0x7fe940100040 2023-08-10T11:51:21.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.413+0000 7fe946bea700 1 --2- 172.21.15.73:0/3778549187 >> [v2:172.21.15.73:6802/2725694252,v1:172.21.15.73:6803/2725694252] conn(0x7fe92c0aa9c0 0x7fe92c0acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:21.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.413+0000 7fe9463e9700 1 --2- 172.21.15.73:0/3778549187 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fe92c0a11e0 0x7fe92c0a36a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe930005950 tx=0x7fe9300058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:21.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.414+0000 7fe946bea700 1 --2- 172.21.15.73:0/3778549187 >> [v2:172.21.15.73:6802/2725694252,v1:172.21.15.73:6803/2725694252] conn(0x7fe92c0aa9c0 0x7fe92c0acde0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:21.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.414+0000 7fe9377fe700 1 -- 172.21.15.73:0/3778549187 <== osd.0 v2:172.21.15.73:6802/2725694252 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fe92c0ad490 con 0x7fe92c0aa9c0 2023-08-10T11:51:21.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.430+0000 7fe94864d700 1 -- 172.21.15.73:0/3778549187 --> [v2:172.21.15.73:6802/2725694252,v1:172.21.15.73:6803/2725694252] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe94004e470 con 0x7fe92c0aa9c0 2023-08-10T11:51:21.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.430+0000 7fe9377fe700 1 -- 172.21.15.73:0/3778549187 <== osd.0 v2:172.21.15.73:6802/2725694252 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe94004e470 con 0x7fe92c0aa9c0 2023-08-10T11:51:21.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.430+0000 7fe94864d700 1 -- 172.21.15.73:0/3778549187 >> [v2:172.21.15.73:6802/2725694252,v1:172.21.15.73:6803/2725694252] conn(0x7fe92c0aa9c0 msgr2=0x7fe92c0acde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:21.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.430+0000 7fe94864d700 1 --2- 172.21.15.73:0/3778549187 >> [v2:172.21.15.73:6802/2725694252,v1:172.21.15.73:6803/2725694252] conn(0x7fe92c0aa9c0 0x7fe92c0acde0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:21.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.430+0000 7fe94864d700 1 -- 172.21.15.73:0/3778549187 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fe92c0a11e0 msgr2=0x7fe92c0a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:21.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.430+0000 7fe94864d700 1 --2- 172.21.15.73:0/3778549187 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fe92c0a11e0 0x7fe92c0a36a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe930005950 tx=0x7fe9300058e0 comp rx=0 tx=0).stop 2023-08-10T11:51:21.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.430+0000 7fe94864d700 1 -- 172.21.15.73:0/3778549187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe940100040 msgr2=0x7fe94019cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:21.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.430+0000 7fe94864d700 1 --2- 172.21.15.73:0/3778549187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe940100040 0x7fe94019cbf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe93c0095c0 tx=0x7fe93c00f710 comp rx=0 tx=0).stop 2023-08-10T11:51:21.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.430+0000 7fe946bea700 1 -- 172.21.15.73:0/3778549187 reap_dead start 2023-08-10T11:51:21.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.431+0000 7fe94864d700 1 -- 172.21.15.73:0/3778549187 shutdown_connections 2023-08-10T11:51:21.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.431+0000 7fe94864d700 1 -- 172.21.15.73:0/3778549187 >> 172.21.15.73:0/3778549187 conn(0x7fe9400767c0 msgr2=0x7fe9400683d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:21.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.431+0000 7fe94864d700 1 -- 172.21.15.73:0/3778549187 shutdown_connections 2023-08-10T11:51:21.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.431+0000 7fe94864d700 1 -- 172.21.15.73:0/3778549187 wait complete. 2023-08-10T11:51:21.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.611+0000 7fb44a99c700 1 -- 172.21.15.73:0/1144972593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb444104580 msgr2=0x7fb444104960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:21.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.611+0000 7fb44a99c700 1 --2- 172.21.15.73:0/1144972593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb444104580 0x7fb444104960 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb434009990 tx=0x7fb434009ca0 comp rx=0 tx=0).stop 2023-08-10T11:51:21.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.611+0000 7fb44a99c700 1 -- 172.21.15.73:0/1144972593 shutdown_connections 2023-08-10T11:51:21.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.611+0000 7fb44a99c700 1 --2- 172.21.15.73:0/1144972593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb444100070 0x7fb44410c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:21.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.611+0000 7fb44a99c700 1 --2- 172.21.15.73:0/1144972593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb444104580 0x7fb444104960 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:21.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.611+0000 7fb44a99c700 1 --2- 172.21.15.73:0/1144972593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4440ff6b0 0x7fb4440ffb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:21.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.611+0000 7fb44a99c700 1 -- 172.21.15.73:0/1144972593 >> 172.21.15.73:0/1144972593 conn(0x7fb444076770 msgr2=0x7fb444076b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:21.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.611+0000 7fb44a99c700 1 -- 172.21.15.73:0/1144972593 shutdown_connections 2023-08-10T11:51:21.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.611+0000 7fb44a99c700 1 -- 172.21.15.73:0/1144972593 wait complete. 2023-08-10T11:51:21.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.611+0000 7fb44a99c700 1 Processor -- start 2023-08-10T11:51:21.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.612+0000 7fb44a99c700 1 -- start start 2023-08-10T11:51:21.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.612+0000 7fb44a99c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4440ff6b0 0x7fb4441976d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:21.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.612+0000 7fb44a99c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb444100070 0x7fb444197c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:21.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.612+0000 7fb44a99c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb444104580 0x7fb4441a2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:21.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.612+0000 7fb44a99c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb444198520 con 0x7fb4440ff6b0 2023-08-10T11:51:21.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.612+0000 7fb44a99c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4441a2c90 con 0x7fb444104580 2023-08-10T11:51:21.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.612+0000 7fb44a99c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4441a2e00 con 0x7fb444100070 2023-08-10T11:51:21.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.612+0000 7fb443fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4440ff6b0 0x7fb4441976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:21.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.612+0000 7fb443fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4440ff6b0 0x7fb4441976d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59230/0 (socket says 172.21.15.73:59230) 2023-08-10T11:51:21.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.612+0000 7fb443fff700 1 -- 172.21.15.73:0/462521717 learned_addr learned my addr 172.21.15.73:0/462521717 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:21.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.612+0000 7fb4437fe700 1 --2- 172.21.15.73:0/462521717 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb444100070 0x7fb444197c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:21.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.612+0000 7fb443fff700 1 -- 172.21.15.73:0/462521717 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb444100070 msgr2=0x7fb444197c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:21.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.612+0000 7fb443fff700 1 --2- 172.21.15.73:0/462521717 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb444100070 0x7fb444197c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:21.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.612+0000 7fb443fff700 1 -- 172.21.15.73:0/462521717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb444104580 msgr2=0x7fb4441a2750 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-10T11:51:21.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.612+0000 7fb448f39700 1 --2- 172.21.15.73:0/462521717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb444104580 0x7fb4441a2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:21.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.612+0000 7fb443fff700 1 --2- 172.21.15.73:0/462521717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb444104580 0x7fb4441a2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:21.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.612+0000 7fb443fff700 1 -- 172.21.15.73:0/462521717 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4340095f0 con 0x7fb4440ff6b0 2023-08-10T11:51:21.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.612+0000 7fb443fff700 1 --2- 172.21.15.73:0/462521717 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4440ff6b0 0x7fb4441976d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb4340095c0 tx=0x7fb43400f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:21.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.613+0000 7fb4417fa700 1 -- 172.21.15.73:0/462521717 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43401d070 con 0x7fb4440ff6b0 2023-08-10T11:51:21.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.613+0000 7fb44a99c700 1 -- 172.21.15.73:0/462521717 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4441a3080 con 0x7fb4440ff6b0 2023-08-10T11:51:21.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.613+0000 7fb4417fa700 1 -- 172.21.15.73:0/462521717 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb43400fc00 con 0x7fb4440ff6b0 2023-08-10T11:51:21.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.613+0000 7fb4417fa700 1 -- 172.21.15.73:0/462521717 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb434017650 con 0x7fb4440ff6b0 2023-08-10T11:51:21.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.613+0000 7fb44a99c700 1 -- 172.21.15.73:0/462521717 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4441a3570 con 0x7fb4440ff6b0 2023-08-10T11:51:21.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.614+0000 7fb44a99c700 1 -- 172.21.15.73:0/462521717 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb44410f8f0 con 0x7fb4440ff6b0 2023-08-10T11:51:21.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.615+0000 7fb4417fa700 1 -- 172.21.15.73:0/462521717 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fb434022470 con 0x7fb4440ff6b0 2023-08-10T11:51:21.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.615+0000 7fb4417fa700 1 --2- 172.21.15.73:0/462521717 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb42c0a11e0 0x7fb42c0a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:21.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.615+0000 7fb4437fe700 1 --2- 172.21.15.73:0/462521717 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb42c0a11e0 0x7fb42c0a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:21.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.615+0000 7fb4417fa700 1 -- 172.21.15.73:0/462521717 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb4340ce490 con 0x7fb4440ff6b0 2023-08-10T11:51:21.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.615+0000 7fb4417fa700 1 --2- 172.21.15.73:0/462521717 >> [v2:172.21.15.152:6824/1513186350,v1:172.21.15.152:6825/1513186350] conn(0x7fb42c0aa9c0 0x7fb42c0acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:21.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.615+0000 7fb4417fa700 1 -- 172.21.15.73:0/462521717 --> [v2:172.21.15.152:6824/1513186350,v1:172.21.15.152:6825/1513186350] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb42c0ad490 con 0x7fb42c0aa9c0 2023-08-10T11:51:21.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.615+0000 7fb4417fa700 1 -- 172.21.15.73:0/462521717 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4340ce930 con 0x7fb4440ff6b0 2023-08-10T11:51:21.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.616+0000 7fb4437fe700 1 --2- 172.21.15.73:0/462521717 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb42c0a11e0 0x7fb42c0a36a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb438005950 tx=0x7fb4380058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:21.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.616+0000 7fb448f39700 1 --2- 172.21.15.73:0/462521717 >> [v2:172.21.15.152:6824/1513186350,v1:172.21.15.152:6825/1513186350] conn(0x7fb42c0aa9c0 0x7fb42c0acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:21.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.616+0000 7fb448f39700 1 --2- 172.21.15.73:0/462521717 >> [v2:172.21.15.152:6824/1513186350,v1:172.21.15.152:6825/1513186350] conn(0x7fb42c0aa9c0 0x7fb42c0acde0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:21.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.617+0000 7fb4417fa700 1 -- 172.21.15.73:0/462521717 <== osd.10 v2:172.21.15.152:6824/1513186350 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fb42c0ad490 con 0x7fb42c0aa9c0 2023-08-10T11:51:21.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.633+0000 7fb44a99c700 1 -- 172.21.15.73:0/462521717 --> [v2:172.21.15.152:6824/1513186350,v1:172.21.15.152:6825/1513186350] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb44404e470 con 0x7fb42c0aa9c0 2023-08-10T11:51:21.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.633+0000 7fb4417fa700 1 -- 172.21.15.73:0/462521717 <== osd.10 v2:172.21.15.152:6824/1513186350 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb44404e470 con 0x7fb42c0aa9c0 2023-08-10T11:51:21.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.634+0000 7fb44a99c700 1 -- 172.21.15.73:0/462521717 >> [v2:172.21.15.152:6824/1513186350,v1:172.21.15.152:6825/1513186350] conn(0x7fb42c0aa9c0 msgr2=0x7fb42c0acde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:21.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.634+0000 7fb44a99c700 1 --2- 172.21.15.73:0/462521717 >> [v2:172.21.15.152:6824/1513186350,v1:172.21.15.152:6825/1513186350] conn(0x7fb42c0aa9c0 0x7fb42c0acde0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:21.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.634+0000 7fb44a99c700 1 -- 172.21.15.73:0/462521717 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb42c0a11e0 msgr2=0x7fb42c0a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:21.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.634+0000 7fb44a99c700 1 --2- 172.21.15.73:0/462521717 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb42c0a11e0 0x7fb42c0a36a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb438005950 tx=0x7fb4380058e0 comp rx=0 tx=0).stop 2023-08-10T11:51:21.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.634+0000 7fb44a99c700 1 -- 172.21.15.73:0/462521717 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4440ff6b0 msgr2=0x7fb4441976d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:21.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.634+0000 7fb44a99c700 1 --2- 172.21.15.73:0/462521717 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4440ff6b0 0x7fb4441976d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb4340095c0 tx=0x7fb43400f710 comp rx=0 tx=0).stop 2023-08-10T11:51:21.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.634+0000 7fb448f39700 1 -- 172.21.15.73:0/462521717 reap_dead start 2023-08-10T11:51:21.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.634+0000 7fb44a99c700 1 -- 172.21.15.73:0/462521717 shutdown_connections 2023-08-10T11:51:21.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.634+0000 7fb44a99c700 1 -- 172.21.15.73:0/462521717 >> 172.21.15.73:0/462521717 conn(0x7fb444076770 msgr2=0x7fb4440fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:21.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.635+0000 7fb44a99c700 1 -- 172.21.15.73:0/462521717 shutdown_connections 2023-08-10T11:51:21.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:21.637+0000 7fb44a99c700 1 -- 172.21.15.73:0/462521717 wait complete. 2023-08-10T11:51:21.718 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:21 smithi073 ceph-mon[128869]: pgmap v269: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2023-08-10T11:51:21.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:21 smithi152 ceph-mon[130220]: pgmap v269: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2023-08-10T11:51:22.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:21 smithi156 ceph-mon[130574]: pgmap v269: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2023-08-10T11:51:22.499 INFO:teuthology.orchestra.run.smithi073.stdout:34359738432 2023-08-10T11:51:22.500 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.0 2023-08-10T11:51:22.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.588+0000 7f8af8bc3700 1 -- 172.21.15.73:0/3924357984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8af4068ef0 msgr2=0x7f8af40692d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:22.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.588+0000 7f8af8bc3700 1 --2- 172.21.15.73:0/3924357984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8af4068ef0 0x7f8af40692d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4009990 tx=0x7f8ae4009ca0 comp rx=0 tx=0).stop 2023-08-10T11:51:22.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.589+0000 7f8af8bc3700 1 -- 172.21.15.73:0/3924357984 shutdown_connections 2023-08-10T11:51:22.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.589+0000 7f8af8bc3700 1 --2- 172.21.15.73:0/3924357984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8af4102c80 0x7f8af410d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:22.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.589+0000 7f8af8bc3700 1 --2- 172.21.15.73:0/3924357984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8af4068ef0 0x7f8af40692d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:22.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.589+0000 7f8af8bc3700 1 --2- 172.21.15.73:0/3924357984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8af41022c0 0x7f8af4102740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:22.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.589+0000 7f8af8bc3700 1 -- 172.21.15.73:0/3924357984 >> 172.21.15.73:0/3924357984 conn(0x7f8af4076760 msgr2=0x7f8af4076b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:22.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.589+0000 7f8af8bc3700 1 -- 172.21.15.73:0/3924357984 shutdown_connections 2023-08-10T11:51:22.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.589+0000 7f8af8bc3700 1 -- 172.21.15.73:0/3924357984 wait complete. 2023-08-10T11:51:22.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.589+0000 7f8af8bc3700 1 Processor -- start 2023-08-10T11:51:22.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.589+0000 7f8af8bc3700 1 -- start start 2023-08-10T11:51:22.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.590+0000 7f8af8bc3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8af4068ef0 0x7f8af40ff720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:22.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.590+0000 7f8af8bc3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8af41022c0 0x7f8af40ffc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:22.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.590+0000 7f8af8bc3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8af4102c80 0x7f8af41001e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:22.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.590+0000 7f8af8bc3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af41a4d60 con 0x7f8af41022c0 2023-08-10T11:51:22.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.590+0000 7f8af8bc3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af41a4ed0 con 0x7f8af4102c80 2023-08-10T11:51:22.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.590+0000 7f8af8bc3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af41a5090 con 0x7f8af4068ef0 2023-08-10T11:51:22.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.590+0000 7f8af1d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8af41022c0 0x7f8af40ffc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:22.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.590+0000 7f8af1d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8af41022c0 0x7f8af40ffc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59248/0 (socket says 172.21.15.73:59248) 2023-08-10T11:51:22.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.590+0000 7f8af1d9b700 1 -- 172.21.15.73:0/1855701766 learned_addr learned my addr 172.21.15.73:0/1855701766 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:22.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.590+0000 7f8af259c700 1 --2- 172.21.15.73:0/1855701766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8af4068ef0 0x7f8af40ff720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:22.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.590+0000 7f8af2d9d700 1 --2- 172.21.15.73:0/1855701766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8af4102c80 0x7f8af41001e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:22.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.590+0000 7f8af1d9b700 1 -- 172.21.15.73:0/1855701766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8af4068ef0 msgr2=0x7f8af40ff720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:22.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.590+0000 7f8af1d9b700 1 --2- 172.21.15.73:0/1855701766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8af4068ef0 0x7f8af40ff720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:22.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.590+0000 7f8af1d9b700 1 -- 172.21.15.73:0/1855701766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8af4102c80 msgr2=0x7f8af41001e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:22.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.590+0000 7f8af1d9b700 1 --2- 172.21.15.73:0/1855701766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8af4102c80 0x7f8af41001e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:22.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.590+0000 7f8af1d9b700 1 -- 172.21.15.73:0/1855701766 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae40095f0 con 0x7f8af41022c0 2023-08-10T11:51:22.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.590+0000 7f8af2d9d700 1 --2- 172.21.15.73:0/1855701766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8af4102c80 0x7f8af41001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:22.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.590+0000 7f8af1d9b700 1 --2- 172.21.15.73:0/1855701766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8af41022c0 0x7f8af40ffc60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800d950 tx=0x7f8ae800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:22.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.591+0000 7f8ae37fe700 1 -- 172.21.15.73:0/1855701766 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8009940 con 0x7f8af41022c0 2023-08-10T11:51:22.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.591+0000 7f8af8bc3700 1 -- 172.21.15.73:0/1855701766 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af41a5370 con 0x7f8af41022c0 2023-08-10T11:51:22.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.591+0000 7f8ae37fe700 1 -- 172.21.15.73:0/1855701766 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ae8010460 con 0x7f8af41022c0 2023-08-10T11:51:22.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.591+0000 7f8ae37fe700 1 -- 172.21.15.73:0/1855701766 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae800f620 con 0x7f8af41022c0 2023-08-10T11:51:22.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.591+0000 7f8af8bc3700 1 -- 172.21.15.73:0/1855701766 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af41a5870 con 0x7f8af41022c0 2023-08-10T11:51:22.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.592+0000 7f8af8bc3700 1 -- 172.21.15.73:0/1855701766 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8af404e470 con 0x7f8af41022c0 2023-08-10T11:51:22.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.593+0000 7f8ae37fe700 1 -- 172.21.15.73:0/1855701766 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f8ae80108d0 con 0x7f8af41022c0 2023-08-10T11:51:22.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.594+0000 7f8ae37fe700 1 --2- 172.21.15.73:0/1855701766 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8adc0a11e0 0x7f8adc0a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:22.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.594+0000 7f8af259c700 1 --2- 172.21.15.73:0/1855701766 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8adc0a11e0 0x7f8adc0a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:22.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.594+0000 7f8ae37fe700 1 -- 172.21.15.73:0/1855701766 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8ae80ccc80 con 0x7f8af41022c0 2023-08-10T11:51:22.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.594+0000 7f8ae37fe700 1 --2- 172.21.15.73:0/1855701766 >> [v2:172.21.15.156:6808/3823368741,v1:172.21.15.156:6809/3823368741] conn(0x7f8adc0aa9c0 0x7f8adc0acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:22.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.594+0000 7f8ae37fe700 1 -- 172.21.15.73:0/1855701766 --> [v2:172.21.15.156:6808/3823368741,v1:172.21.15.156:6809/3823368741] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8adc0ad490 con 0x7f8adc0aa9c0 2023-08-10T11:51:22.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.594+0000 7f8ae37fe700 1 -- 172.21.15.73:0/1855701766 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ae80cd120 con 0x7f8af41022c0 2023-08-10T11:51:22.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.594+0000 7f8af2d9d700 1 --2- 172.21.15.73:0/1855701766 >> [v2:172.21.15.156:6808/3823368741,v1:172.21.15.156:6809/3823368741] conn(0x7f8adc0aa9c0 0x7f8adc0acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:22.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.594+0000 7f8af259c700 1 --2- 172.21.15.73:0/1855701766 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8adc0a11e0 0x7f8adc0a36a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400b5c0 tx=0x7f8ae4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:22.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.595+0000 7f8af2d9d700 1 --2- 172.21.15.73:0/1855701766 >> [v2:172.21.15.156:6808/3823368741,v1:172.21.15.156:6809/3823368741] conn(0x7f8adc0aa9c0 0x7f8adc0acde0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:22.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.596+0000 7f8ae37fe700 1 -- 172.21.15.73:0/1855701766 <== osd.5 v2:172.21.15.156:6808/3823368741 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f8adc0ad490 con 0x7f8adc0aa9c0 2023-08-10T11:51:22.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.630+0000 7f8af8bc3700 1 -- 172.21.15.73:0/1855701766 --> [v2:172.21.15.156:6808/3823368741,v1:172.21.15.156:6809/3823368741] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8af4110ac0 con 0x7f8adc0aa9c0 2023-08-10T11:51:22.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.630+0000 7f8ae37fe700 1 -- 172.21.15.73:0/1855701766 <== osd.5 v2:172.21.15.156:6808/3823368741 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8aec009d10 con 0x7f8adc0aa9c0 2023-08-10T11:51:22.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.631+0000 7f8af8bc3700 1 -- 172.21.15.73:0/1855701766 >> [v2:172.21.15.156:6808/3823368741,v1:172.21.15.156:6809/3823368741] conn(0x7f8adc0aa9c0 msgr2=0x7f8adc0acde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:22.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.631+0000 7f8af8bc3700 1 --2- 172.21.15.73:0/1855701766 >> [v2:172.21.15.156:6808/3823368741,v1:172.21.15.156:6809/3823368741] conn(0x7f8adc0aa9c0 0x7f8adc0acde0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:22.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.631+0000 7f8af8bc3700 1 -- 172.21.15.73:0/1855701766 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8adc0a11e0 msgr2=0x7f8adc0a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:22.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.631+0000 7f8af8bc3700 1 --2- 172.21.15.73:0/1855701766 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8adc0a11e0 0x7f8adc0a36a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400b5c0 tx=0x7f8ae4005fd0 comp rx=0 tx=0).stop 2023-08-10T11:51:22.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.631+0000 7f8af8bc3700 1 -- 172.21.15.73:0/1855701766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8af41022c0 msgr2=0x7f8af40ffc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:22.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.631+0000 7f8af8bc3700 1 --2- 172.21.15.73:0/1855701766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8af41022c0 0x7f8af40ffc60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800d950 tx=0x7f8ae800dc60 comp rx=0 tx=0).stop 2023-08-10T11:51:22.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.631+0000 7f8af2d9d700 1 -- 172.21.15.73:0/1855701766 reap_dead start 2023-08-10T11:51:22.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.631+0000 7f8af8bc3700 1 -- 172.21.15.73:0/1855701766 shutdown_connections 2023-08-10T11:51:22.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.631+0000 7f8af8bc3700 1 -- 172.21.15.73:0/1855701766 >> 172.21.15.73:0/1855701766 conn(0x7f8af4076760 msgr2=0x7f8af4105610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:22.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.631+0000 7f8af8bc3700 1 -- 172.21.15.73:0/1855701766 shutdown_connections 2023-08-10T11:51:22.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.631+0000 7f8af8bc3700 1 -- 172.21.15.73:0/1855701766 wait complete. 2023-08-10T11:51:22.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.657+0000 7fb2095b5700 1 -- 172.21.15.73:0/2826763166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb204100070 msgr2=0x7fb20410c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:22.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.657+0000 7fb2095b5700 1 --2- 172.21.15.73:0/2826763166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb204100070 0x7fb20410c510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc00d290 tx=0x7fb1fc00d5a0 comp rx=0 tx=0).stop 2023-08-10T11:51:22.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.657+0000 7fb2095b5700 1 -- 172.21.15.73:0/2826763166 shutdown_connections 2023-08-10T11:51:22.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.657+0000 7fb2095b5700 1 --2- 172.21.15.73:0/2826763166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb204104580 0x7fb204104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:22.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.657+0000 7fb2095b5700 1 --2- 172.21.15.73:0/2826763166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb204100070 0x7fb20410c510 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:22.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.657+0000 7fb2095b5700 1 --2- 172.21.15.73:0/2826763166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2040ff6b0 0x7fb2040ffb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:22.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.657+0000 7fb2095b5700 1 -- 172.21.15.73:0/2826763166 >> 172.21.15.73:0/2826763166 conn(0x7fb204076770 msgr2=0x7fb204076b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:22.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.657+0000 7fb2095b5700 1 -- 172.21.15.73:0/2826763166 shutdown_connections 2023-08-10T11:51:22.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.657+0000 7fb2095b5700 1 -- 172.21.15.73:0/2826763166 wait complete. 2023-08-10T11:51:22.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.657+0000 7fb2095b5700 1 Processor -- start 2023-08-10T11:51:22.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.658+0000 7fb2095b5700 1 -- start start 2023-08-10T11:51:22.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.658+0000 7fb2095b5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2040ff6b0 0x7fb204194780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:22.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.658+0000 7fb2095b5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb204100070 0x7fb204194cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:22.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.658+0000 7fb2095b5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb204104580 0x7fb204198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:22.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.658+0000 7fb2095b5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb204198610 con 0x7fb204100070 2023-08-10T11:51:22.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.658+0000 7fb2095b5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb204198780 con 0x7fb204104580 2023-08-10T11:51:22.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.658+0000 7fb2095b5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb204198940 con 0x7fb2040ff6b0 2023-08-10T11:51:22.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.658+0000 7fb2027fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb204100070 0x7fb204194cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:22.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.658+0000 7fb2027fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb204100070 0x7fb204194cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59264/0 (socket says 172.21.15.73:59264) 2023-08-10T11:51:22.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.658+0000 7fb2027fc700 1 -- 172.21.15.73:0/3275438572 learned_addr learned my addr 172.21.15.73:0/3275438572 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:22.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.658+0000 7fb202ffd700 1 --2- 172.21.15.73:0/3275438572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2040ff6b0 0x7fb204194780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:22.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.658+0000 7fb2037fe700 1 --2- 172.21.15.73:0/3275438572 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb204104580 0x7fb204198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:22.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.658+0000 7fb2027fc700 1 -- 172.21.15.73:0/3275438572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2040ff6b0 msgr2=0x7fb204194780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:22.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.658+0000 7fb2027fc700 1 --2- 172.21.15.73:0/3275438572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2040ff6b0 0x7fb204194780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:22.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.658+0000 7fb2027fc700 1 -- 172.21.15.73:0/3275438572 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb204104580 msgr2=0x7fb204198010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:22.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.658+0000 7fb2027fc700 1 --2- 172.21.15.73:0/3275438572 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb204104580 0x7fb204198010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:22.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.658+0000 7fb2027fc700 1 -- 172.21.15.73:0/3275438572 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc009c40 con 0x7fb204100070 2023-08-10T11:51:22.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.658+0000 7fb202ffd700 1 --2- 172.21.15.73:0/3275438572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2040ff6b0 0x7fb204194780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:51:22.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.658+0000 7fb2027fc700 1 --2- 172.21.15.73:0/3275438572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb204100070 0x7fb204194cc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb1f800e9c0 tx=0x7fb1f800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:22.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.659+0000 7fb1ebfff700 1 -- 172.21.15.73:0/3275438572 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8004a30 con 0x7fb204100070 2023-08-10T11:51:22.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.659+0000 7fb2095b5700 1 -- 172.21.15.73:0/3275438572 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb204198c20 con 0x7fb204100070 2023-08-10T11:51:22.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.659+0000 7fb1ebfff700 1 -- 172.21.15.73:0/3275438572 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1f800cc80 con 0x7fb204100070 2023-08-10T11:51:22.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.659+0000 7fb1ebfff700 1 -- 172.21.15.73:0/3275438572 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f80054e0 con 0x7fb204100070 2023-08-10T11:51:22.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.659+0000 7fb2095b5700 1 -- 172.21.15.73:0/3275438572 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2041a1570 con 0x7fb204100070 2023-08-10T11:51:22.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.660+0000 7fb2095b5700 1 -- 172.21.15.73:0/3275438572 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb20410e890 con 0x7fb204100070 2023-08-10T11:51:22.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.661+0000 7fb1ebfff700 1 -- 172.21.15.73:0/3275438572 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fb1f8004b90 con 0x7fb204100070 2023-08-10T11:51:22.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.661+0000 7fb1ebfff700 1 --2- 172.21.15.73:0/3275438572 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb1ec0a11e0 0x7fb1ec0a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:22.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.662+0000 7fb202ffd700 1 --2- 172.21.15.73:0/3275438572 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb1ec0a11e0 0x7fb1ec0a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:22.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.662+0000 7fb1ebfff700 1 -- 172.21.15.73:0/3275438572 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb1f8014070 con 0x7fb204100070 2023-08-10T11:51:22.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.662+0000 7fb1ebfff700 1 --2- 172.21.15.73:0/3275438572 >> [v2:172.21.15.156:6816/96487555,v1:172.21.15.156:6817/96487555] conn(0x7fb1ec0aa9c0 0x7fb1ec0acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:22.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.662+0000 7fb1ebfff700 1 -- 172.21.15.73:0/3275438572 --> [v2:172.21.15.156:6816/96487555,v1:172.21.15.156:6817/96487555] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb1ec0ad490 con 0x7fb1ec0aa9c0 2023-08-10T11:51:22.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.662+0000 7fb1ebfff700 1 -- 172.21.15.73:0/3275438572 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1f80cd120 con 0x7fb204100070 2023-08-10T11:51:22.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.662+0000 7fb202ffd700 1 --2- 172.21.15.73:0/3275438572 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb1ec0a11e0 0x7fb1ec0a36a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb1f400ffd0 tx=0x7fb1f4011040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:22.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.662+0000 7fb2037fe700 1 --2- 172.21.15.73:0/3275438572 >> [v2:172.21.15.156:6816/96487555,v1:172.21.15.156:6817/96487555] conn(0x7fb1ec0aa9c0 0x7fb1ec0acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:22.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.663+0000 7fb2037fe700 1 --2- 172.21.15.73:0/3275438572 >> [v2:172.21.15.156:6816/96487555,v1:172.21.15.156:6817/96487555] conn(0x7fb1ec0aa9c0 0x7fb1ec0acde0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:22.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.663+0000 7fb1ebfff700 1 -- 172.21.15.73:0/3275438572 <== osd.8 v2:172.21.15.156:6816/96487555 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fb1ec0ad490 con 0x7fb1ec0aa9c0 2023-08-10T11:51:22.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.679+0000 7fb2095b5700 1 -- 172.21.15.73:0/3275438572 --> [v2:172.21.15.156:6816/96487555,v1:172.21.15.156:6817/96487555] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb2040fde90 con 0x7fb1ec0aa9c0 2023-08-10T11:51:22.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.680+0000 7fb1ebfff700 1 -- 172.21.15.73:0/3275438572 <== osd.8 v2:172.21.15.156:6816/96487555 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb2040fde90 con 0x7fb1ec0aa9c0 2023-08-10T11:51:22.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.680+0000 7fb2095b5700 1 -- 172.21.15.73:0/3275438572 >> [v2:172.21.15.156:6816/96487555,v1:172.21.15.156:6817/96487555] conn(0x7fb1ec0aa9c0 msgr2=0x7fb1ec0acde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:22.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.680+0000 7fb2095b5700 1 --2- 172.21.15.73:0/3275438572 >> [v2:172.21.15.156:6816/96487555,v1:172.21.15.156:6817/96487555] conn(0x7fb1ec0aa9c0 0x7fb1ec0acde0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:22.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.681+0000 7fb2095b5700 1 -- 172.21.15.73:0/3275438572 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb1ec0a11e0 msgr2=0x7fb1ec0a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:22.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.681+0000 7fb2095b5700 1 --2- 172.21.15.73:0/3275438572 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb1ec0a11e0 0x7fb1ec0a36a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb1f400ffd0 tx=0x7fb1f4011040 comp rx=0 tx=0).stop 2023-08-10T11:51:22.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.681+0000 7fb2095b5700 1 -- 172.21.15.73:0/3275438572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb204100070 msgr2=0x7fb204194cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:22.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.681+0000 7fb2095b5700 1 --2- 172.21.15.73:0/3275438572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb204100070 0x7fb204194cc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb1f800e9c0 tx=0x7fb1f800ecd0 comp rx=0 tx=0).stop 2023-08-10T11:51:22.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.681+0000 7fb2037fe700 1 -- 172.21.15.73:0/3275438572 reap_dead start 2023-08-10T11:51:22.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.681+0000 7fb2095b5700 1 -- 172.21.15.73:0/3275438572 shutdown_connections 2023-08-10T11:51:22.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.681+0000 7fb2095b5700 1 -- 172.21.15.73:0/3275438572 >> 172.21.15.73:0/3275438572 conn(0x7fb204076770 msgr2=0x7fb2040fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:22.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.681+0000 7fb2095b5700 1 -- 172.21.15.73:0/3275438572 shutdown_connections 2023-08-10T11:51:22.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:22.681+0000 7fb2095b5700 1 -- 172.21.15.73:0/3275438572 wait complete. 2023-08-10T11:51:23.827 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:23 smithi073 ceph-mon[128869]: pgmap v270: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 426 B/s wr, 10 op/s 2023-08-10T11:51:23.878 INFO:teuthology.orchestra.run.smithi073.stdout:244813135902 2023-08-10T11:51:23.879 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.8 2023-08-10T11:51:23.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:23 smithi152 ceph-mon[130220]: pgmap v270: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 426 B/s wr, 10 op/s 2023-08-10T11:51:24.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:23 smithi156 ceph-mon[130574]: pgmap v270: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 426 B/s wr, 10 op/s 2023-08-10T11:51:24.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.428+0000 7f0d7808b700 1 -- 172.21.15.73:0/1065951293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d70104580 msgr2=0x7f0d70104960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:24.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.428+0000 7f0d7808b700 1 --2- 172.21.15.73:0/1065951293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d70104580 0x7f0d70104960 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c009990 tx=0x7f0d6c009ca0 comp rx=0 tx=0).stop 2023-08-10T11:51:24.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.428+0000 7f0d7808b700 1 -- 172.21.15.73:0/1065951293 shutdown_connections 2023-08-10T11:51:24.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.428+0000 7f0d7808b700 1 --2- 172.21.15.73:0/1065951293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d70100070 0x7f0d7010c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:24.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.428+0000 7f0d7808b700 1 --2- 172.21.15.73:0/1065951293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d70104580 0x7f0d70104960 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:24.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.428+0000 7f0d7808b700 1 --2- 172.21.15.73:0/1065951293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d700ff6b0 0x7f0d700ffb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:24.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.428+0000 7f0d7808b700 1 -- 172.21.15.73:0/1065951293 >> 172.21.15.73:0/1065951293 conn(0x7f0d70076770 msgr2=0x7f0d70076b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:24.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.428+0000 7f0d7808b700 1 -- 172.21.15.73:0/1065951293 shutdown_connections 2023-08-10T11:51:24.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.428+0000 7f0d7808b700 1 -- 172.21.15.73:0/1065951293 wait complete. 2023-08-10T11:51:24.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.429+0000 7f0d7808b700 1 Processor -- start 2023-08-10T11:51:24.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.429+0000 7f0d7808b700 1 -- start start 2023-08-10T11:51:24.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.429+0000 7f0d7808b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d700ff6b0 0x7f0d701976d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:24.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.429+0000 7f0d7808b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d70100070 0x7f0d70197c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:24.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.429+0000 7f0d7808b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d70104580 0x7f0d701a2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:24.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.429+0000 7f0d7808b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d70198520 con 0x7f0d70104580 2023-08-10T11:51:24.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.429+0000 7f0d7808b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d701a2c90 con 0x7f0d700ff6b0 2023-08-10T11:51:24.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.429+0000 7f0d7808b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d701a2e00 con 0x7f0d70100070 2023-08-10T11:51:24.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.429+0000 7f0d76628700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d70104580 0x7f0d701a2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:24.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.429+0000 7f0d75e27700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d700ff6b0 0x7f0d701976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:24.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.429+0000 7f0d76628700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d70104580 0x7f0d701a2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59280/0 (socket says 172.21.15.73:59280) 2023-08-10T11:51:24.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.429+0000 7f0d75e27700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d700ff6b0 0x7f0d701976d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:45694/0 (socket says 172.21.15.73:45694) 2023-08-10T11:51:24.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.429+0000 7f0d76628700 1 -- 172.21.15.73:0/3035362183 learned_addr learned my addr 172.21.15.73:0/3035362183 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:24.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.429+0000 7f0d75626700 1 --2- 172.21.15.73:0/3035362183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d70100070 0x7f0d70197c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:24.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.429+0000 7f0d76628700 1 -- 172.21.15.73:0/3035362183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d70100070 msgr2=0x7f0d70197c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:24.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.429+0000 7f0d76628700 1 --2- 172.21.15.73:0/3035362183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d70100070 0x7f0d70197c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:24.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.429+0000 7f0d76628700 1 -- 172.21.15.73:0/3035362183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d700ff6b0 msgr2=0x7f0d701976d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:24.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.429+0000 7f0d76628700 1 --2- 172.21.15.73:0/3035362183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d700ff6b0 0x7f0d701976d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:24.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.430+0000 7f0d76628700 1 -- 172.21.15.73:0/3035362183 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6c0095f0 con 0x7f0d70104580 2023-08-10T11:51:24.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.430+0000 7f0d76628700 1 --2- 172.21.15.73:0/3035362183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d70104580 0x7f0d701a2750 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800cca0 tx=0x7f0d6800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:24.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.430+0000 7f0d66ffd700 1 -- 172.21.15.73:0/3035362183 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6800aba0 con 0x7f0d70104580 2023-08-10T11:51:24.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.430+0000 7f0d66ffd700 1 -- 172.21.15.73:0/3035362183 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d6800ad00 con 0x7f0d70104580 2023-08-10T11:51:24.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.430+0000 7f0d66ffd700 1 -- 172.21.15.73:0/3035362183 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d680115e0 con 0x7f0d70104580 2023-08-10T11:51:24.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.430+0000 7f0d7808b700 1 -- 172.21.15.73:0/3035362183 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d701a30e0 con 0x7f0d70104580 2023-08-10T11:51:24.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.430+0000 7f0d7808b700 1 -- 172.21.15.73:0/3035362183 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d701a3590 con 0x7f0d70104580 2023-08-10T11:51:24.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.431+0000 7f0d7808b700 1 -- 172.21.15.73:0/3035362183 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0d7004e470 con 0x7f0d70104580 2023-08-10T11:51:24.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.433+0000 7f0d66ffd700 1 -- 172.21.15.73:0/3035362183 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f0d68012420 con 0x7f0d70104580 2023-08-10T11:51:24.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.433+0000 7f0d66ffd700 1 --2- 172.21.15.73:0/3035362183 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0d5c0a1260 0x7f0d5c0a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:24.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.433+0000 7f0d66ffd700 1 -- 172.21.15.73:0/3035362183 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0d680cd0d0 con 0x7f0d70104580 2023-08-10T11:51:24.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.433+0000 7f0d75e27700 1 --2- 172.21.15.73:0/3035362183 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0d5c0a1260 0x7f0d5c0a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:24.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.434+0000 7f0d66ffd700 1 --2- 172.21.15.73:0/3035362183 >> [v2:172.21.15.73:6826/2050124321,v1:172.21.15.73:6827/2050124321] conn(0x7f0d5c0aaa40 0x7f0d5c0ace60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:24.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.434+0000 7f0d66ffd700 1 -- 172.21.15.73:0/3035362183 --> [v2:172.21.15.73:6826/2050124321,v1:172.21.15.73:6827/2050124321] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d5c0ad510 con 0x7f0d5c0aaa40 2023-08-10T11:51:24.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.434+0000 7f0d66ffd700 1 -- 172.21.15.73:0/3035362183 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d680cd440 con 0x7f0d70104580 2023-08-10T11:51:24.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.434+0000 7f0d75626700 1 --2- 172.21.15.73:0/3035362183 >> [v2:172.21.15.73:6826/2050124321,v1:172.21.15.73:6827/2050124321] conn(0x7f0d5c0aaa40 0x7f0d5c0ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:24.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.434+0000 7f0d75e27700 1 --2- 172.21.15.73:0/3035362183 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0d5c0a1260 0x7f0d5c0a3720 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00b5c0 tx=0x7f0d6c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:24.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.434+0000 7f0d75626700 1 --2- 172.21.15.73:0/3035362183 >> [v2:172.21.15.73:6826/2050124321,v1:172.21.15.73:6827/2050124321] conn(0x7f0d5c0aaa40 0x7f0d5c0ace60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:24.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.435+0000 7f0d66ffd700 1 -- 172.21.15.73:0/3035362183 <== osd.9 v2:172.21.15.73:6826/2050124321 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f0d5c0ad510 con 0x7f0d5c0aaa40 2023-08-10T11:51:24.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.452+0000 7f0d7808b700 1 -- 172.21.15.73:0/3035362183 --> [v2:172.21.15.73:6826/2050124321,v1:172.21.15.73:6827/2050124321] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0d7010f980 con 0x7f0d5c0aaa40 2023-08-10T11:51:24.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.452+0000 7f0d66ffd700 1 -- 172.21.15.73:0/3035362183 <== osd.9 v2:172.21.15.73:6826/2050124321 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f0d600099e0 con 0x7f0d5c0aaa40 2023-08-10T11:51:24.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.453+0000 7f0d7808b700 1 -- 172.21.15.73:0/3035362183 >> [v2:172.21.15.73:6826/2050124321,v1:172.21.15.73:6827/2050124321] conn(0x7f0d5c0aaa40 msgr2=0x7f0d5c0ace60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:24.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.453+0000 7f0d7808b700 1 --2- 172.21.15.73:0/3035362183 >> [v2:172.21.15.73:6826/2050124321,v1:172.21.15.73:6827/2050124321] conn(0x7f0d5c0aaa40 0x7f0d5c0ace60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:24.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.453+0000 7f0d7808b700 1 -- 172.21.15.73:0/3035362183 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0d5c0a1260 msgr2=0x7f0d5c0a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:24.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.453+0000 7f0d7808b700 1 --2- 172.21.15.73:0/3035362183 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0d5c0a1260 0x7f0d5c0a3720 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00b5c0 tx=0x7f0d6c005fd0 comp rx=0 tx=0).stop 2023-08-10T11:51:24.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.453+0000 7f0d7808b700 1 -- 172.21.15.73:0/3035362183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d70104580 msgr2=0x7f0d701a2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:24.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.453+0000 7f0d7808b700 1 --2- 172.21.15.73:0/3035362183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d70104580 0x7f0d701a2750 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800cca0 tx=0x7f0d6800a060 comp rx=0 tx=0).stop 2023-08-10T11:51:24.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.453+0000 7f0d76628700 1 -- 172.21.15.73:0/3035362183 reap_dead start 2023-08-10T11:51:24.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.453+0000 7f0d7808b700 1 -- 172.21.15.73:0/3035362183 shutdown_connections 2023-08-10T11:51:24.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.453+0000 7f0d7808b700 1 -- 172.21.15.73:0/3035362183 >> 172.21.15.73:0/3035362183 conn(0x7f0d70076770 msgr2=0x7f0d700fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:24.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.453+0000 7f0d7808b700 1 -- 172.21.15.73:0/3035362183 shutdown_connections 2023-08-10T11:51:24.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.453+0000 7f0d7808b700 1 -- 172.21.15.73:0/3035362183 wait complete. 2023-08-10T11:51:24.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.534+0000 7ff1a3998700 1 -- 172.21.15.73:0/911170384 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff19c1011a0 msgr2=0x7ff19c101620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:24.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.534+0000 7ff1a3998700 1 --2- 172.21.15.73:0/911170384 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff19c1011a0 0x7ff19c101620 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff198009990 tx=0x7ff198009ca0 comp rx=0 tx=0).stop 2023-08-10T11:51:24.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.534+0000 7ff1a3998700 1 -- 172.21.15.73:0/911170384 shutdown_connections 2023-08-10T11:51:24.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.534+0000 7ff1a3998700 1 --2- 172.21.15.73:0/911170384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff19c0ffa60 0x7ff19c0ffe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:24.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.534+0000 7ff1a3998700 1 --2- 172.21.15.73:0/911170384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff19c101b60 0x7ff19c10c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:24.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.534+0000 7ff1a3998700 1 --2- 172.21.15.73:0/911170384 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff19c1011a0 0x7ff19c101620 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:24.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.534+0000 7ff1a3998700 1 -- 172.21.15.73:0/911170384 >> 172.21.15.73:0/911170384 conn(0x7ff19c076760 msgr2=0x7ff19c076b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:24.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.534+0000 7ff1a3998700 1 -- 172.21.15.73:0/911170384 shutdown_connections 2023-08-10T11:51:24.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.534+0000 7ff1a3998700 1 -- 172.21.15.73:0/911170384 wait complete. 2023-08-10T11:51:24.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.535+0000 7ff1a3998700 1 Processor -- start 2023-08-10T11:51:24.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.535+0000 7ff1a3998700 1 -- start start 2023-08-10T11:51:24.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.535+0000 7ff1a3998700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff19c0ffa60 0x7ff19c1978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:24.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.535+0000 7ff1a3998700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff19c1011a0 0x7ff19c197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:24.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.535+0000 7ff1a3998700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff19c101b60 0x7ff19c1a2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:24.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.535+0000 7ff1a3998700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c1986f0 con 0x7ff19c101b60 2023-08-10T11:51:24.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.535+0000 7ff1a3998700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c1a2e60 con 0x7ff19c0ffa60 2023-08-10T11:51:24.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.535+0000 7ff1a3998700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c1a2fd0 con 0x7ff19c1011a0 2023-08-10T11:51:24.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.535+0000 7ff1a1f35700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff19c101b60 0x7ff19c1a2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:24.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.535+0000 7ff1a1f35700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff19c101b60 0x7ff19c1a2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59296/0 (socket says 172.21.15.73:59296) 2023-08-10T11:51:24.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.535+0000 7ff1a1f35700 1 -- 172.21.15.73:0/2668919126 learned_addr learned my addr 172.21.15.73:0/2668919126 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:24.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.535+0000 7ff1a0f33700 1 --2- 172.21.15.73:0/2668919126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff19c1011a0 0x7ff19c197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:24.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.535+0000 7ff1a1734700 1 --2- 172.21.15.73:0/2668919126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff19c0ffa60 0x7ff19c1978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:24.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.535+0000 7ff1a1f35700 1 -- 172.21.15.73:0/2668919126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff19c1011a0 msgr2=0x7ff19c197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:24.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.535+0000 7ff1a1f35700 1 --2- 172.21.15.73:0/2668919126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff19c1011a0 0x7ff19c197de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:24.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.535+0000 7ff1a1f35700 1 -- 172.21.15.73:0/2668919126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff19c0ffa60 msgr2=0x7ff19c1978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:24.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.535+0000 7ff1a1f35700 1 --2- 172.21.15.73:0/2668919126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff19c0ffa60 0x7ff19c1978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:24.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.535+0000 7ff1a1f35700 1 -- 172.21.15.73:0/2668919126 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1980095f0 con 0x7ff19c101b60 2023-08-10T11:51:24.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.535+0000 7ff1a0f33700 1 --2- 172.21.15.73:0/2668919126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff19c1011a0 0x7ff19c197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:24.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.535+0000 7ff1a1734700 1 --2- 172.21.15.73:0/2668919126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff19c0ffa60 0x7ff19c1978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:24.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.535+0000 7ff1a1f35700 1 --2- 172.21.15.73:0/2668919126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff19c101b60 0x7ff19c1a2920 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff194007d70 tx=0x7ff19400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:24.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.536+0000 7ff1927fc700 1 -- 172.21.15.73:0/2668919126 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19400ad40 con 0x7ff19c101b60 2023-08-10T11:51:24.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.536+0000 7ff1a3998700 1 -- 172.21.15.73:0/2668919126 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff19c1a32b0 con 0x7ff19c101b60 2023-08-10T11:51:24.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.536+0000 7ff1927fc700 1 -- 172.21.15.73:0/2668919126 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff1940128e0 con 0x7ff19c101b60 2023-08-10T11:51:24.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.536+0000 7ff1927fc700 1 -- 172.21.15.73:0/2668919126 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff194011780 con 0x7ff19c101b60 2023-08-10T11:51:24.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.536+0000 7ff1a3998700 1 -- 172.21.15.73:0/2668919126 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19c1a37b0 con 0x7ff19c101b60 2023-08-10T11:51:24.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.537+0000 7ff1a3998700 1 -- 172.21.15.73:0/2668919126 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff19c10fa10 con 0x7ff19c101b60 2023-08-10T11:51:24.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.538+0000 7ff1927fc700 1 -- 172.21.15.73:0/2668919126 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7ff194012a50 con 0x7ff19c101b60 2023-08-10T11:51:24.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.538+0000 7ff1927fc700 1 --2- 172.21.15.73:0/2668919126 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff1880a11e0 0x7ff1880a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:24.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.539+0000 7ff1a1734700 1 --2- 172.21.15.73:0/2668919126 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff1880a11e0 0x7ff1880a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:24.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.539+0000 7ff1927fc700 1 -- 172.21.15.73:0/2668919126 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff1940cd090 con 0x7ff19c101b60 2023-08-10T11:51:24.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.539+0000 7ff1927fc700 1 --2- 172.21.15.73:0/2668919126 >> [v2:172.21.15.152:6800/836829168,v1:172.21.15.152:6801/836829168] conn(0x7ff1880aa9c0 0x7ff1880acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:24.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.539+0000 7ff1927fc700 1 -- 172.21.15.73:0/2668919126 --> [v2:172.21.15.152:6800/836829168,v1:172.21.15.152:6801/836829168] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff1880ad490 con 0x7ff1880aa9c0 2023-08-10T11:51:24.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.539+0000 7ff1927fc700 1 -- 172.21.15.73:0/2668919126 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1940cd530 con 0x7ff19c101b60 2023-08-10T11:51:24.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.539+0000 7ff1a1734700 1 --2- 172.21.15.73:0/2668919126 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff1880a11e0 0x7ff1880a36a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff18c007900 tx=0x7ff18c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:24.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.539+0000 7ff1a0f33700 1 --2- 172.21.15.73:0/2668919126 >> [v2:172.21.15.152:6800/836829168,v1:172.21.15.152:6801/836829168] conn(0x7ff1880aa9c0 0x7ff1880acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:24.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.539+0000 7ff1a0f33700 1 --2- 172.21.15.73:0/2668919126 >> [v2:172.21.15.152:6800/836829168,v1:172.21.15.152:6801/836829168] conn(0x7ff1880aa9c0 0x7ff1880acde0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:24.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.540+0000 7ff1927fc700 1 -- 172.21.15.73:0/2668919126 <== osd.1 v2:172.21.15.152:6800/836829168 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7ff1880ad490 con 0x7ff1880aa9c0 2023-08-10T11:51:24.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.556+0000 7ff1a3998700 1 -- 172.21.15.73:0/2668919126 --> [v2:172.21.15.152:6800/836829168,v1:172.21.15.152:6801/836829168] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff19c04e470 con 0x7ff1880aa9c0 2023-08-10T11:51:24.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.556+0000 7ff1927fc700 1 -- 172.21.15.73:0/2668919126 <== osd.1 v2:172.21.15.152:6800/836829168 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff19c04e470 con 0x7ff1880aa9c0 2023-08-10T11:51:24.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.557+0000 7ff1a3998700 1 -- 172.21.15.73:0/2668919126 >> [v2:172.21.15.152:6800/836829168,v1:172.21.15.152:6801/836829168] conn(0x7ff1880aa9c0 msgr2=0x7ff1880acde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:24.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.557+0000 7ff1a3998700 1 --2- 172.21.15.73:0/2668919126 >> [v2:172.21.15.152:6800/836829168,v1:172.21.15.152:6801/836829168] conn(0x7ff1880aa9c0 0x7ff1880acde0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:24.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.557+0000 7ff1a3998700 1 -- 172.21.15.73:0/2668919126 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff1880a11e0 msgr2=0x7ff1880a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:24.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.557+0000 7ff1a3998700 1 --2- 172.21.15.73:0/2668919126 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff1880a11e0 0x7ff1880a36a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff18c007900 tx=0x7ff18c008040 comp rx=0 tx=0).stop 2023-08-10T11:51:24.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.557+0000 7ff1a3998700 1 -- 172.21.15.73:0/2668919126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff19c101b60 msgr2=0x7ff19c1a2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:24.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.557+0000 7ff1a3998700 1 --2- 172.21.15.73:0/2668919126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff19c101b60 0x7ff19c1a2920 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff194007d70 tx=0x7ff19400a340 comp rx=0 tx=0).stop 2023-08-10T11:51:24.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.557+0000 7ff1a1f35700 1 -- 172.21.15.73:0/2668919126 reap_dead start 2023-08-10T11:51:24.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.557+0000 7ff1a3998700 1 -- 172.21.15.73:0/2668919126 shutdown_connections 2023-08-10T11:51:24.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.557+0000 7ff1a3998700 1 -- 172.21.15.73:0/2668919126 >> 172.21.15.73:0/2668919126 conn(0x7ff19c076760 msgr2=0x7ff19c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:24.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.557+0000 7ff1a3998700 1 -- 172.21.15.73:0/2668919126 shutdown_connections 2023-08-10T11:51:24.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:24.557+0000 7ff1a3998700 1 -- 172.21.15.73:0/2668919126 wait complete. 2023-08-10T11:51:25.266 INFO:teuthology.orchestra.run.smithi073.stdout:158913789995 2023-08-10T11:51:25.266 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.5 2023-08-10T11:51:25.408 INFO:teuthology.orchestra.run.smithi073.stdout:279172874266 2023-08-10T11:51:25.408 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.9 2023-08-10T11:51:25.510 INFO:teuthology.orchestra.run.smithi073.stdout:300647710741 2023-08-10T11:51:25.510 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.10 2023-08-10T11:51:25.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.622+0000 7f6a91d86700 1 -- 172.21.15.73:0/1944687093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a8c100070 msgr2=0x7f6a8c10c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:25.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.622+0000 7f6a91d86700 1 --2- 172.21.15.73:0/1944687093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a8c100070 0x7f6a8c10c510 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6a8400b0a0 tx=0x7f6a8400b3b0 comp rx=0 tx=0).stop 2023-08-10T11:51:25.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.622+0000 7f6a91d86700 1 -- 172.21.15.73:0/1944687093 shutdown_connections 2023-08-10T11:51:25.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.622+0000 7f6a91d86700 1 --2- 172.21.15.73:0/1944687093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a8c104580 0x7f6a8c104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:25.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.622+0000 7f6a91d86700 1 --2- 172.21.15.73:0/1944687093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a8c100070 0x7f6a8c10c510 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:25.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.623+0000 7f6a91d86700 1 --2- 172.21.15.73:0/1944687093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a8c0ff6b0 0x7f6a8c0ffb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:25.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.623+0000 7f6a91d86700 1 -- 172.21.15.73:0/1944687093 >> 172.21.15.73:0/1944687093 conn(0x7f6a8c076770 msgr2=0x7f6a8c076b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:25.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.623+0000 7f6a91d86700 1 -- 172.21.15.73:0/1944687093 shutdown_connections 2023-08-10T11:51:25.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.623+0000 7f6a91d86700 1 -- 172.21.15.73:0/1944687093 wait complete. 2023-08-10T11:51:25.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.623+0000 7f6a91d86700 1 Processor -- start 2023-08-10T11:51:25.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.623+0000 7f6a91d86700 1 -- start start 2023-08-10T11:51:25.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.623+0000 7f6a91d86700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a8c0ff6b0 0x7f6a8c196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:25.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.624+0000 7f6a91d86700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a8c100070 0x7f6a8c196e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:25.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.624+0000 7f6a91d86700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a8c104580 0x7f6a8c19b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:25.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.624+0000 7f6a91d86700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c19b900 con 0x7f6a8c0ff6b0 2023-08-10T11:51:25.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.624+0000 7f6a91d86700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c19ba70 con 0x7f6a8c100070 2023-08-10T11:51:25.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.624+0000 7f6a91d86700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c19bc30 con 0x7f6a8c104580 2023-08-10T11:51:25.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.624+0000 7f6a8b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a8c0ff6b0 0x7f6a8c196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:25.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.624+0000 7f6a8b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a8c0ff6b0 0x7f6a8c196950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59310/0 (socket says 172.21.15.73:59310) 2023-08-10T11:51:25.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.624+0000 7f6a8b7fe700 1 -- 172.21.15.73:0/2449651170 learned_addr learned my addr 172.21.15.73:0/2449651170 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:25.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.624+0000 7f6a8bfff700 1 --2- 172.21.15.73:0/2449651170 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a8c104580 0x7f6a8c19b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:25.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.624+0000 7f6a8affd700 1 --2- 172.21.15.73:0/2449651170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a8c100070 0x7f6a8c196e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:25.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.624+0000 7f6a8b7fe700 1 -- 172.21.15.73:0/2449651170 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a8c104580 msgr2=0x7f6a8c19b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:25.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.624+0000 7f6a8b7fe700 1 --2- 172.21.15.73:0/2449651170 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a8c104580 0x7f6a8c19b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:25.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.624+0000 7f6a8b7fe700 1 -- 172.21.15.73:0/2449651170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a8c100070 msgr2=0x7f6a8c196e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:25.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.624+0000 7f6a8b7fe700 1 --2- 172.21.15.73:0/2449651170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a8c100070 0x7f6a8c196e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:25.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.624+0000 7f6a8b7fe700 1 -- 172.21.15.73:0/2449651170 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a84009d00 con 0x7f6a8c0ff6b0 2023-08-10T11:51:25.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.624+0000 7f6a8affd700 1 --2- 172.21.15.73:0/2449651170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a8c100070 0x7f6a8c196e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:51:25.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.624+0000 7f6a8b7fe700 1 --2- 172.21.15.73:0/2449651170 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a8c0ff6b0 0x7f6a8c196950 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c00e9a0 tx=0x7f6a7c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:25.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.624+0000 7f6a88ff9700 1 -- 172.21.15.73:0/2449651170 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c009790 con 0x7f6a8c0ff6b0 2023-08-10T11:51:25.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.624+0000 7f6a88ff9700 1 -- 172.21.15.73:0/2449651170 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a7c00cbd0 con 0x7f6a8c0ff6b0 2023-08-10T11:51:25.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.624+0000 7f6a91d86700 1 -- 172.21.15.73:0/2449651170 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8c19bf10 con 0x7f6a8c0ff6b0 2023-08-10T11:51:25.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.624+0000 7f6a88ff9700 1 -- 172.21.15.73:0/2449651170 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c018680 con 0x7f6a8c0ff6b0 2023-08-10T11:51:25.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.624+0000 7f6a91d86700 1 -- 172.21.15.73:0/2449651170 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8c1a37b0 con 0x7f6a8c0ff6b0 2023-08-10T11:51:25.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.625+0000 7f6a91d86700 1 -- 172.21.15.73:0/2449651170 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6a8c04e470 con 0x7f6a8c0ff6b0 2023-08-10T11:51:25.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.627+0000 7f6a88ff9700 1 -- 172.21.15.73:0/2449651170 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f6a7c00cd40 con 0x7f6a8c0ff6b0 2023-08-10T11:51:25.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.628+0000 7f6a88ff9700 1 --2- 172.21.15.73:0/2449651170 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f6a740a1260 0x7f6a740a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:25.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.628+0000 7f6a8affd700 1 --2- 172.21.15.73:0/2449651170 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f6a740a1260 0x7f6a740a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:25.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.628+0000 7f6a88ff9700 1 -- 172.21.15.73:0/2449651170 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6a7c014070 con 0x7f6a8c0ff6b0 2023-08-10T11:51:25.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.628+0000 7f6a88ff9700 1 --2- 172.21.15.73:0/2449651170 >> [v2:172.21.15.73:6818/2533620458,v1:172.21.15.73:6819/2533620458] conn(0x7f6a740aaa40 0x7f6a740ace60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:25.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.628+0000 7f6a88ff9700 1 -- 172.21.15.73:0/2449651170 --> [v2:172.21.15.73:6818/2533620458,v1:172.21.15.73:6819/2533620458] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6a740ad510 con 0x7f6a740aaa40 2023-08-10T11:51:25.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.628+0000 7f6a88ff9700 1 -- 172.21.15.73:0/2449651170 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a7c0cd600 con 0x7f6a8c0ff6b0 2023-08-10T11:51:25.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.628+0000 7f6a8bfff700 1 --2- 172.21.15.73:0/2449651170 >> [v2:172.21.15.73:6818/2533620458,v1:172.21.15.73:6819/2533620458] conn(0x7f6a740aaa40 0x7f6a740ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:25.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.628+0000 7f6a8affd700 1 --2- 172.21.15.73:0/2449651170 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f6a740a1260 0x7f6a740a3720 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c197f70 tx=0x7f6a80009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:25.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.628+0000 7f6a8bfff700 1 --2- 172.21.15.73:0/2449651170 >> [v2:172.21.15.73:6818/2533620458,v1:172.21.15.73:6819/2533620458] conn(0x7f6a740aaa40 0x7f6a740ace60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:25.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.629+0000 7f6a88ff9700 1 -- 172.21.15.73:0/2449651170 <== osd.6 v2:172.21.15.73:6818/2533620458 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f6a740ad510 con 0x7f6a740aaa40 2023-08-10T11:51:25.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.645+0000 7f6a91d86700 1 -- 172.21.15.73:0/2449651170 --> [v2:172.21.15.73:6818/2533620458,v1:172.21.15.73:6819/2533620458] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6a8c10f930 con 0x7f6a740aaa40 2023-08-10T11:51:25.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.645+0000 7f6a88ff9700 1 -- 172.21.15.73:0/2449651170 <== osd.6 v2:172.21.15.73:6818/2533620458 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f6a84009b80 con 0x7f6a740aaa40 2023-08-10T11:51:25.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.646+0000 7f6a91d86700 1 -- 172.21.15.73:0/2449651170 >> [v2:172.21.15.73:6818/2533620458,v1:172.21.15.73:6819/2533620458] conn(0x7f6a740aaa40 msgr2=0x7f6a740ace60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:25.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.646+0000 7f6a91d86700 1 --2- 172.21.15.73:0/2449651170 >> [v2:172.21.15.73:6818/2533620458,v1:172.21.15.73:6819/2533620458] conn(0x7f6a740aaa40 0x7f6a740ace60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:25.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.646+0000 7f6a91d86700 1 -- 172.21.15.73:0/2449651170 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f6a740a1260 msgr2=0x7f6a740a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:25.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.646+0000 7f6a91d86700 1 --2- 172.21.15.73:0/2449651170 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f6a740a1260 0x7f6a740a3720 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c197f70 tx=0x7f6a80009260 comp rx=0 tx=0).stop 2023-08-10T11:51:25.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.646+0000 7f6a91d86700 1 -- 172.21.15.73:0/2449651170 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a8c0ff6b0 msgr2=0x7f6a8c196950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:25.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.646+0000 7f6a91d86700 1 --2- 172.21.15.73:0/2449651170 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a8c0ff6b0 0x7f6a8c196950 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c00e9a0 tx=0x7f6a7c00ed60 comp rx=0 tx=0).stop 2023-08-10T11:51:25.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.646+0000 7f6a8bfff700 1 -- 172.21.15.73:0/2449651170 reap_dead start 2023-08-10T11:51:25.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.647+0000 7f6a91d86700 1 -- 172.21.15.73:0/2449651170 shutdown_connections 2023-08-10T11:51:25.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.647+0000 7f6a91d86700 1 -- 172.21.15.73:0/2449651170 >> 172.21.15.73:0/2449651170 conn(0x7f6a8c076770 msgr2=0x7f6a8c0682d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:25.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.647+0000 7f6a91d86700 1 -- 172.21.15.73:0/2449651170 shutdown_connections 2023-08-10T11:51:25.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.647+0000 7f6a91d86700 1 -- 172.21.15.73:0/2449651170 wait complete. 2023-08-10T11:51:25.669 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:25 smithi073 ceph-mon[128869]: pgmap v271: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 10 op/s 2023-08-10T11:51:25.962 INFO:teuthology.orchestra.run.smithi073.stdout:55834574907 2023-08-10T11:51:25.962 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.1 2023-08-10T11:51:25.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.984+0000 7f47469e6700 1 -- 172.21.15.73:0/881172994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47401056b0 msgr2=0x7f4740105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:25.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.984+0000 7f47469e6700 1 --2- 172.21.15.73:0/881172994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47401056b0 0x7f4740105a90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4730009990 tx=0x7f4730009ca0 comp rx=0 tx=0).stop 2023-08-10T11:51:25.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.984+0000 7f47469e6700 1 -- 172.21.15.73:0/881172994 shutdown_connections 2023-08-10T11:51:25.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.984+0000 7f47469e6700 1 --2- 172.21.15.73:0/881172994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4740100730 0x7f474010c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:25.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.984+0000 7f47469e6700 1 --2- 172.21.15.73:0/881172994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47401056b0 0x7f4740105a90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:25.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.984+0000 7f47469e6700 1 --2- 172.21.15.73:0/881172994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47400ffd70 0x7f47401001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:25.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.984+0000 7f47469e6700 1 -- 172.21.15.73:0/881172994 >> 172.21.15.73:0/881172994 conn(0x7f4740075be0 msgr2=0x7f47400fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:25.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.985+0000 7f47469e6700 1 -- 172.21.15.73:0/881172994 shutdown_connections 2023-08-10T11:51:25.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.985+0000 7f47469e6700 1 -- 172.21.15.73:0/881172994 wait complete. 2023-08-10T11:51:25.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.986+0000 7f47469e6700 1 Processor -- start 2023-08-10T11:51:25.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.986+0000 7f47469e6700 1 -- start start 2023-08-10T11:51:25.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.986+0000 7f47469e6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47400ffd70 0x7f4740197620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:25.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.986+0000 7f47469e6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4740100730 0x7f4740197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:25.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.986+0000 7f47469e6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47401056b0 0x7f47401a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:25.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.986+0000 7f47469e6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47401984a0 con 0x7f47400ffd70 2023-08-10T11:51:25.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.986+0000 7f47469e6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47401a2be0 con 0x7f4740100730 2023-08-10T11:51:25.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.986+0000 7f47469e6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47401a2da0 con 0x7f47401056b0 2023-08-10T11:51:25.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.987+0000 7f473ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47400ffd70 0x7f4740197620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:25.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.987+0000 7f473ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47400ffd70 0x7f4740197620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59324/0 (socket says 172.21.15.73:59324) 2023-08-10T11:51:25.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.987+0000 7f473ffff700 1 -- 172.21.15.73:0/3188753070 learned_addr learned my addr 172.21.15.73:0/3188753070 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:25.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.987+0000 7f4744f83700 1 --2- 172.21.15.73:0/3188753070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47401056b0 0x7f47401a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:25.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.987+0000 7f473ffff700 1 -- 172.21.15.73:0/3188753070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47401056b0 msgr2=0x7f47401a26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:25.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.987+0000 7f473ffff700 1 --2- 172.21.15.73:0/3188753070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47401056b0 0x7f47401a26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:25.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.987+0000 7f473ffff700 1 -- 172.21.15.73:0/3188753070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4740100730 msgr2=0x7f4740197b60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T11:51:25.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.987+0000 7f473ffff700 1 --2- 172.21.15.73:0/3188753070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4740100730 0x7f4740197b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:25.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.987+0000 7f473ffff700 1 -- 172.21.15.73:0/3188753070 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47300095f0 con 0x7f47400ffd70 2023-08-10T11:51:25.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.988+0000 7f473ffff700 1 --2- 172.21.15.73:0/3188753070 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47400ffd70 0x7f4740197620 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f47300095c0 tx=0x7f473000f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:25.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.988+0000 7f473d7fa700 1 -- 172.21.15.73:0/3188753070 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473001d070 con 0x7f47400ffd70 2023-08-10T11:51:25.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.988+0000 7f473d7fa700 1 -- 172.21.15.73:0/3188753070 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f473000fb50 con 0x7f47400ffd70 2023-08-10T11:51:25.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.988+0000 7f47469e6700 1 -- 172.21.15.73:0/3188753070 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47401a3020 con 0x7f47400ffd70 2023-08-10T11:51:25.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.988+0000 7f473d7fa700 1 -- 172.21.15.73:0/3188753070 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47300173f0 con 0x7f47400ffd70 2023-08-10T11:51:25.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.988+0000 7f47469e6700 1 -- 172.21.15.73:0/3188753070 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47401a34c0 con 0x7f47400ffd70 2023-08-10T11:51:25.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.989+0000 7f47469e6700 1 -- 172.21.15.73:0/3188753070 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f474004e470 con 0x7f47400ffd70 2023-08-10T11:51:25.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.990+0000 7f473d7fa700 1 -- 172.21.15.73:0/3188753070 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f473000fcc0 con 0x7f47400ffd70 2023-08-10T11:51:25.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.991+0000 7f473d7fa700 1 --2- 172.21.15.73:0/3188753070 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f47280a11e0 0x7f47280a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:25.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.991+0000 7f473f7fe700 1 --2- 172.21.15.73:0/3188753070 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f47280a11e0 0x7f47280a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:25.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.991+0000 7f473d7fa700 1 -- 172.21.15.73:0/3188753070 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f47300cda00 con 0x7f47400ffd70 2023-08-10T11:51:25.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.991+0000 7f473d7fa700 1 --2- 172.21.15.73:0/3188753070 >> [v2:172.21.15.152:6816/4059538477,v1:172.21.15.152:6817/4059538477] conn(0x7f47280aa9c0 0x7f47280acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:25.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.991+0000 7f473d7fa700 1 -- 172.21.15.73:0/3188753070 --> [v2:172.21.15.152:6816/4059538477,v1:172.21.15.152:6817/4059538477] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f47280ad490 con 0x7f47280aa9c0 2023-08-10T11:51:25.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.991+0000 7f473d7fa700 1 -- 172.21.15.73:0/3188753070 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47300d22c0 con 0x7f47400ffd70 2023-08-10T11:51:25.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.991+0000 7f473f7fe700 1 --2- 172.21.15.73:0/3188753070 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f47280a11e0 0x7f47280a36a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f47400ff530 tx=0x7f4734005d30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:25.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.991+0000 7f4744f83700 1 --2- 172.21.15.73:0/3188753070 >> [v2:172.21.15.152:6816/4059538477,v1:172.21.15.152:6817/4059538477] conn(0x7f47280aa9c0 0x7f47280acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:25.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.992+0000 7f4744f83700 1 --2- 172.21.15.73:0/3188753070 >> [v2:172.21.15.152:6816/4059538477,v1:172.21.15.152:6817/4059538477] conn(0x7f47280aa9c0 0x7f47280acde0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:25.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:25.993+0000 7f473d7fa700 1 -- 172.21.15.73:0/3188753070 <== osd.7 v2:172.21.15.152:6816/4059538477 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f47280ad490 con 0x7f47280aa9c0 2023-08-10T11:51:25.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:25 smithi152 ceph-mon[130220]: pgmap v271: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 10 op/s 2023-08-10T11:51:26.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:25 smithi156 ceph-mon[130574]: pgmap v271: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 10 op/s 2023-08-10T11:51:26.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.012+0000 7f47469e6700 1 -- 172.21.15.73:0/3188753070 --> [v2:172.21.15.152:6816/4059538477,v1:172.21.15.152:6817/4059538477] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f474010f930 con 0x7f47280aa9c0 2023-08-10T11:51:26.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.013+0000 7f473d7fa700 1 -- 172.21.15.73:0/3188753070 <== osd.7 v2:172.21.15.152:6816/4059538477 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f473800f040 con 0x7f47280aa9c0 2023-08-10T11:51:26.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.013+0000 7f47469e6700 1 -- 172.21.15.73:0/3188753070 >> [v2:172.21.15.152:6816/4059538477,v1:172.21.15.152:6817/4059538477] conn(0x7f47280aa9c0 msgr2=0x7f47280acde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:26.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.013+0000 7f47469e6700 1 --2- 172.21.15.73:0/3188753070 >> [v2:172.21.15.152:6816/4059538477,v1:172.21.15.152:6817/4059538477] conn(0x7f47280aa9c0 0x7f47280acde0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:26.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.013+0000 7f47469e6700 1 -- 172.21.15.73:0/3188753070 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f47280a11e0 msgr2=0x7f47280a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:26.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.013+0000 7f47469e6700 1 --2- 172.21.15.73:0/3188753070 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f47280a11e0 0x7f47280a36a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f47400ff530 tx=0x7f4734005d30 comp rx=0 tx=0).stop 2023-08-10T11:51:26.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.013+0000 7f47469e6700 1 -- 172.21.15.73:0/3188753070 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47400ffd70 msgr2=0x7f4740197620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:26.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.013+0000 7f47469e6700 1 --2- 172.21.15.73:0/3188753070 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47400ffd70 0x7f4740197620 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f47300095c0 tx=0x7f473000f710 comp rx=0 tx=0).stop 2023-08-10T11:51:26.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.013+0000 7f4744f83700 1 -- 172.21.15.73:0/3188753070 reap_dead start 2023-08-10T11:51:26.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.014+0000 7f47469e6700 1 -- 172.21.15.73:0/3188753070 shutdown_connections 2023-08-10T11:51:26.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.014+0000 7f47469e6700 1 -- 172.21.15.73:0/3188753070 >> 172.21.15.73:0/3188753070 conn(0x7f4740075be0 msgr2=0x7f47400fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:26.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.014+0000 7f47469e6700 1 -- 172.21.15.73:0/3188753070 shutdown_connections 2023-08-10T11:51:26.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.014+0000 7f47469e6700 1 -- 172.21.15.73:0/3188753070 wait complete. 2023-08-10T11:51:26.858 INFO:teuthology.orchestra.run.smithi073.stdout:193273528360 2023-08-10T11:51:26.859 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.6 2023-08-10T11:51:26.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.939+0000 7fb2539a4700 1 -- 172.21.15.73:0/820528767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb24c0ffee0 msgr2=0x7fb24c10cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:26.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.939+0000 7fb2539a4700 1 --2- 172.21.15.73:0/820528767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb24c0ffee0 0x7fb24c10cba0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009990 tx=0x7fb23c009ca0 comp rx=0 tx=0).stop 2023-08-10T11:51:26.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.939+0000 7fb2539a4700 1 -- 172.21.15.73:0/820528767 shutdown_connections 2023-08-10T11:51:26.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.939+0000 7fb2539a4700 1 --2- 172.21.15.73:0/820528767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb24c0ff530 0x7fb24c0ff910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:26.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.939+0000 7fb2539a4700 1 --2- 172.21.15.73:0/820528767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb24c10d0e0 0x7fb24c10f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:26.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.939+0000 7fb2539a4700 1 --2- 172.21.15.73:0/820528767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb24c0ffee0 0x7fb24c10cba0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:26.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.939+0000 7fb2539a4700 1 -- 172.21.15.73:0/820528767 >> 172.21.15.73:0/820528767 conn(0x7fb24c0fb130 msgr2=0x7fb24c0fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:26.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.939+0000 7fb2539a4700 1 -- 172.21.15.73:0/820528767 shutdown_connections 2023-08-10T11:51:26.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.940+0000 7fb2539a4700 1 -- 172.21.15.73:0/820528767 wait complete. 2023-08-10T11:51:26.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.940+0000 7fb2539a4700 1 Processor -- start 2023-08-10T11:51:26.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.940+0000 7fb2539a4700 1 -- start start 2023-08-10T11:51:26.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.941+0000 7fb2539a4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb24c0ff530 0x7fb24c101810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:26.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.941+0000 7fb2539a4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb24c0ffee0 0x7fb24c101d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:26.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.941+0000 7fb2539a4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb24c10d0e0 0x7fb24c102290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:26.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.941+0000 7fb2539a4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c1a90f0 con 0x7fb24c10d0e0 2023-08-10T11:51:26.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.941+0000 7fb2539a4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c1a9260 con 0x7fb24c0ffee0 2023-08-10T11:51:26.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.941+0000 7fb2539a4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c1a9420 con 0x7fb24c0ff530 2023-08-10T11:51:26.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.941+0000 7fb251f41700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb24c10d0e0 0x7fb24c102290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:26.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.941+0000 7fb250f3f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb24c0ffee0 0x7fb24c101d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:26.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.941+0000 7fb250f3f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb24c0ffee0 0x7fb24c101d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:45754/0 (socket says 172.21.15.73:45754) 2023-08-10T11:51:26.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.941+0000 7fb250f3f700 1 -- 172.21.15.73:0/3824354500 learned_addr learned my addr 172.21.15.73:0/3824354500 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:26.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.941+0000 7fb251740700 1 --2- 172.21.15.73:0/3824354500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb24c0ff530 0x7fb24c101810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:26.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.941+0000 7fb251f41700 1 -- 172.21.15.73:0/3824354500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb24c0ff530 msgr2=0x7fb24c101810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:26.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.941+0000 7fb251f41700 1 --2- 172.21.15.73:0/3824354500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb24c0ff530 0x7fb24c101810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:26.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.941+0000 7fb251f41700 1 -- 172.21.15.73:0/3824354500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb24c0ffee0 msgr2=0x7fb24c101d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:26.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.941+0000 7fb251f41700 1 --2- 172.21.15.73:0/3824354500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb24c0ffee0 0x7fb24c101d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:26.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.941+0000 7fb251f41700 1 -- 172.21.15.73:0/3824354500 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c0095f0 con 0x7fb24c10d0e0 2023-08-10T11:51:26.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.941+0000 7fb251f41700 1 --2- 172.21.15.73:0/3824354500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb24c10d0e0 0x7fb24c102290 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb244007ee0 tx=0x7fb24400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:26.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.942+0000 7fb2427fc700 1 -- 172.21.15.73:0/3824354500 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb244004db0 con 0x7fb24c10d0e0 2023-08-10T11:51:26.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.942+0000 7fb2539a4700 1 -- 172.21.15.73:0/3824354500 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb24c1a9700 con 0x7fb24c10d0e0 2023-08-10T11:51:26.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.942+0000 7fb2427fc700 1 -- 172.21.15.73:0/3824354500 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb24400f040 con 0x7fb24c10d0e0 2023-08-10T11:51:26.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.942+0000 7fb2427fc700 1 -- 172.21.15.73:0/3824354500 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb244005900 con 0x7fb24c10d0e0 2023-08-10T11:51:26.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.942+0000 7fb2539a4700 1 -- 172.21.15.73:0/3824354500 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb24c1a9c00 con 0x7fb24c10d0e0 2023-08-10T11:51:26.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.943+0000 7fb2539a4700 1 -- 172.21.15.73:0/3824354500 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb24c068400 con 0x7fb24c10d0e0 2023-08-10T11:51:26.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.944+0000 7fb2427fc700 1 -- 172.21.15.73:0/3824354500 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fb24400db20 con 0x7fb24c10d0e0 2023-08-10T11:51:26.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.945+0000 7fb2427fc700 1 --2- 172.21.15.73:0/3824354500 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb2380a11e0 0x7fb2380a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:26.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.945+0000 7fb251740700 1 --2- 172.21.15.73:0/3824354500 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb2380a11e0 0x7fb2380a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:26.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.945+0000 7fb2427fc700 1 -- 172.21.15.73:0/3824354500 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb2440ccc90 con 0x7fb24c10d0e0 2023-08-10T11:51:26.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.945+0000 7fb2427fc700 1 --2- 172.21.15.73:0/3824354500 >> [v2:172.21.15.152:6808/1451517889,v1:172.21.15.152:6809/1451517889] conn(0x7fb2380aa9c0 0x7fb2380acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:26.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.945+0000 7fb2427fc700 1 -- 172.21.15.73:0/3824354500 --> [v2:172.21.15.152:6808/1451517889,v1:172.21.15.152:6809/1451517889] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb2380ad490 con 0x7fb2380aa9c0 2023-08-10T11:51:26.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.945+0000 7fb2427fc700 1 -- 172.21.15.73:0/3824354500 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2440cd130 con 0x7fb24c10d0e0 2023-08-10T11:51:26.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.945+0000 7fb251740700 1 --2- 172.21.15.73:0/3824354500 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb2380a11e0 0x7fb2380a36a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb248005950 tx=0x7fb24800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:26.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.945+0000 7fb250f3f700 1 --2- 172.21.15.73:0/3824354500 >> [v2:172.21.15.152:6808/1451517889,v1:172.21.15.152:6809/1451517889] conn(0x7fb2380aa9c0 0x7fb2380acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:26.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.946+0000 7fb250f3f700 1 --2- 172.21.15.73:0/3824354500 >> [v2:172.21.15.152:6808/1451517889,v1:172.21.15.152:6809/1451517889] conn(0x7fb2380aa9c0 0x7fb2380acde0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:26.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.951+0000 7fb2427fc700 1 -- 172.21.15.73:0/3824354500 <== osd.4 v2:172.21.15.152:6808/1451517889 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fb2380ad490 con 0x7fb2380aa9c0 2023-08-10T11:51:26.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.970+0000 7fb2539a4700 1 -- 172.21.15.73:0/3824354500 --> [v2:172.21.15.152:6808/1451517889,v1:172.21.15.152:6809/1451517889] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb24c112bd0 con 0x7fb2380aa9c0 2023-08-10T11:51:26.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.970+0000 7fb2427fc700 1 -- 172.21.15.73:0/3824354500 <== osd.4 v2:172.21.15.152:6808/1451517889 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb23c01e040 con 0x7fb2380aa9c0 2023-08-10T11:51:26.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.970+0000 7fb2539a4700 1 -- 172.21.15.73:0/3824354500 >> [v2:172.21.15.152:6808/1451517889,v1:172.21.15.152:6809/1451517889] conn(0x7fb2380aa9c0 msgr2=0x7fb2380acde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:26.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.970+0000 7fb2539a4700 1 --2- 172.21.15.73:0/3824354500 >> [v2:172.21.15.152:6808/1451517889,v1:172.21.15.152:6809/1451517889] conn(0x7fb2380aa9c0 0x7fb2380acde0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:26.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.971+0000 7fb2539a4700 1 -- 172.21.15.73:0/3824354500 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb2380a11e0 msgr2=0x7fb2380a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:26.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.971+0000 7fb2539a4700 1 --2- 172.21.15.73:0/3824354500 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb2380a11e0 0x7fb2380a36a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb248005950 tx=0x7fb24800a300 comp rx=0 tx=0).stop 2023-08-10T11:51:26.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.971+0000 7fb2539a4700 1 -- 172.21.15.73:0/3824354500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb24c10d0e0 msgr2=0x7fb24c102290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:26.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.971+0000 7fb2539a4700 1 --2- 172.21.15.73:0/3824354500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb24c10d0e0 0x7fb24c102290 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb244007ee0 tx=0x7fb24400d3b0 comp rx=0 tx=0).stop 2023-08-10T11:51:26.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.971+0000 7fb251f41700 1 -- 172.21.15.73:0/3824354500 reap_dead start 2023-08-10T11:51:26.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.971+0000 7fb2539a4700 1 -- 172.21.15.73:0/3824354500 shutdown_connections 2023-08-10T11:51:26.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.971+0000 7fb2539a4700 1 -- 172.21.15.73:0/3824354500 >> 172.21.15.73:0/3824354500 conn(0x7fb24c0fb130 msgr2=0x7fb24c10e430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:26.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.972+0000 7fb2539a4700 1 -- 172.21.15.73:0/3824354500 shutdown_connections 2023-08-10T11:51:26.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:26.972+0000 7fb2539a4700 1 -- 172.21.15.73:0/3824354500 wait complete. 2023-08-10T11:51:27.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.191+0000 7f711132e700 1 -- 172.21.15.73:0/3485599293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f710c106780 msgr2=0x7f710c106b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.191+0000 7f711132e700 1 --2- 172.21.15.73:0/3485599293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f710c106780 0x7f710c106b60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f70fc009990 tx=0x7f70fc009ca0 comp rx=0 tx=0).stop 2023-08-10T11:51:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.191+0000 7f711132e700 1 -- 172.21.15.73:0/3485599293 shutdown_connections 2023-08-10T11:51:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.191+0000 7f711132e700 1 --2- 172.21.15.73:0/3485599293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f710c0ff620 0x7f710c10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.191+0000 7f711132e700 1 --2- 172.21.15.73:0/3485599293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f710c106780 0x7f710c106b60 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.191+0000 7f711132e700 1 --2- 172.21.15.73:0/3485599293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f710c0fec60 0x7f710c0ff0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.191+0000 7f711132e700 1 -- 172.21.15.73:0/3485599293 >> 172.21.15.73:0/3485599293 conn(0x7f710c075be0 msgr2=0x7f710c0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:27.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.191+0000 7f711132e700 1 -- 172.21.15.73:0/3485599293 shutdown_connections 2023-08-10T11:51:27.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.191+0000 7f711132e700 1 -- 172.21.15.73:0/3485599293 wait complete. 2023-08-10T11:51:27.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.191+0000 7f711132e700 1 Processor -- start 2023-08-10T11:51:27.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.191+0000 7f711132e700 1 -- start start 2023-08-10T11:51:27.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.191+0000 7f711132e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f710c0fec60 0x7f710c196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:27.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.191+0000 7f711132e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f710c0ff620 0x7f710c196e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:27.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.192+0000 7f711132e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f710c106780 0x7f710c19b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:27.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.192+0000 7f711132e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c19b900 con 0x7f710c0fec60 2023-08-10T11:51:27.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.192+0000 7f711132e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c19ba70 con 0x7f710c0ff620 2023-08-10T11:51:27.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.192+0000 7f711132e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c19bc30 con 0x7f710c106780 2023-08-10T11:51:27.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.192+0000 7f710affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f710c0fec60 0x7f710c196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:27.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.192+0000 7f710affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f710c0fec60 0x7f710c196950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59352/0 (socket says 172.21.15.73:59352) 2023-08-10T11:51:27.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.192+0000 7f710affd700 1 -- 172.21.15.73:0/1567121497 learned_addr learned my addr 172.21.15.73:0/1567121497 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:27.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.192+0000 7f710b7fe700 1 --2- 172.21.15.73:0/1567121497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f710c106780 0x7f710c19b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:27.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.192+0000 7f710affd700 1 -- 172.21.15.73:0/1567121497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f710c106780 msgr2=0x7f710c19b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:27.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.192+0000 7f7103fff700 1 --2- 172.21.15.73:0/1567121497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f710c0ff620 0x7f710c196e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:27.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.192+0000 7f710affd700 1 --2- 172.21.15.73:0/1567121497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f710c106780 0x7f710c19b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:27.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.192+0000 7f710affd700 1 -- 172.21.15.73:0/1567121497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f710c0ff620 msgr2=0x7f710c196e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:27.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.192+0000 7f710affd700 1 --2- 172.21.15.73:0/1567121497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f710c0ff620 0x7f710c196e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:27.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.192+0000 7f710affd700 1 -- 172.21.15.73:0/1567121497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc0095f0 con 0x7f710c0fec60 2023-08-10T11:51:27.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.192+0000 7f710b7fe700 1 --2- 172.21.15.73:0/1567121497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f710c106780 0x7f710c19b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:51:27.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.192+0000 7f710affd700 1 --2- 172.21.15.73:0/1567121497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f710c0fec60 0x7f710c196950 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f70fc000c00 tx=0x7f70fc00f830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:27.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.192+0000 7f7108ff9700 1 -- 172.21.15.73:0/1567121497 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc01d070 con 0x7f710c0fec60 2023-08-10T11:51:27.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.192+0000 7f7108ff9700 1 -- 172.21.15.73:0/1567121497 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f70fc00fce0 con 0x7f710c0fec60 2023-08-10T11:51:27.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.192+0000 7f7108ff9700 1 -- 172.21.15.73:0/1567121497 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0176e0 con 0x7f710c0fec60 2023-08-10T11:51:27.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.192+0000 7f711132e700 1 -- 172.21.15.73:0/1567121497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f710c19beb0 con 0x7f710c0fec60 2023-08-10T11:51:27.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.192+0000 7f711132e700 1 -- 172.21.15.73:0/1567121497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710c19c180 con 0x7f710c0fec60 2023-08-10T11:51:27.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.193+0000 7f711132e700 1 -- 172.21.15.73:0/1567121497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f710c110ad0 con 0x7f710c0fec60 2023-08-10T11:51:27.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.194+0000 7f7108ff9700 1 -- 172.21.15.73:0/1567121497 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f70fc022470 con 0x7f710c0fec60 2023-08-10T11:51:27.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.195+0000 7f7108ff9700 1 --2- 172.21.15.73:0/1567121497 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f70f80a1260 0x7f70f80a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:27.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.195+0000 7f7103fff700 1 --2- 172.21.15.73:0/1567121497 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f70f80a1260 0x7f70f80a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:27.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.195+0000 7f7108ff9700 1 -- 172.21.15.73:0/1567121497 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f70fc0ce4b0 con 0x7f710c0fec60 2023-08-10T11:51:27.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.195+0000 7f7108ff9700 1 --2- 172.21.15.73:0/1567121497 >> [v2:172.21.15.156:6824/737904755,v1:172.21.15.156:6825/737904755] conn(0x7f70f80aaa40 0x7f70f80ace60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:27.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.195+0000 7f7108ff9700 1 -- 172.21.15.73:0/1567121497 --> [v2:172.21.15.156:6824/737904755,v1:172.21.15.156:6825/737904755] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f70f80ad510 con 0x7f70f80aaa40 2023-08-10T11:51:27.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.195+0000 7f7108ff9700 1 -- 172.21.15.73:0/1567121497 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70fc0ce950 con 0x7f710c0fec60 2023-08-10T11:51:27.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.195+0000 7f7103fff700 1 --2- 172.21.15.73:0/1567121497 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f70f80a1260 0x7f70f80a3720 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f70f4006fd0 tx=0x7f70f4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:27.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.195+0000 7f710b7fe700 1 --2- 172.21.15.73:0/1567121497 >> [v2:172.21.15.156:6824/737904755,v1:172.21.15.156:6825/737904755] conn(0x7f70f80aaa40 0x7f70f80ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:27.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.196+0000 7f710b7fe700 1 --2- 172.21.15.73:0/1567121497 >> [v2:172.21.15.156:6824/737904755,v1:172.21.15.156:6825/737904755] conn(0x7f70f80aaa40 0x7f70f80ace60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:27.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.197+0000 7f7108ff9700 1 -- 172.21.15.73:0/1567121497 <== osd.11 v2:172.21.15.156:6824/737904755 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f70f80ad510 con 0x7f70f80aaa40 2023-08-10T11:51:27.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.213+0000 7f711132e700 1 -- 172.21.15.73:0/1567121497 --> [v2:172.21.15.156:6824/737904755,v1:172.21.15.156:6825/737904755] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f710c04e470 con 0x7f70f80aaa40 2023-08-10T11:51:27.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.213+0000 7f7108ff9700 1 -- 172.21.15.73:0/1567121497 <== osd.11 v2:172.21.15.156:6824/737904755 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f710c04e470 con 0x7f70f80aaa40 2023-08-10T11:51:27.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.213+0000 7f711132e700 1 -- 172.21.15.73:0/1567121497 >> [v2:172.21.15.156:6824/737904755,v1:172.21.15.156:6825/737904755] conn(0x7f70f80aaa40 msgr2=0x7f70f80ace60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:27.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.213+0000 7f711132e700 1 --2- 172.21.15.73:0/1567121497 >> [v2:172.21.15.156:6824/737904755,v1:172.21.15.156:6825/737904755] conn(0x7f70f80aaa40 0x7f70f80ace60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:27.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.213+0000 7f711132e700 1 -- 172.21.15.73:0/1567121497 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f70f80a1260 msgr2=0x7f70f80a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:27.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.213+0000 7f711132e700 1 --2- 172.21.15.73:0/1567121497 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f70f80a1260 0x7f70f80a3720 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f70f4006fd0 tx=0x7f70f4008040 comp rx=0 tx=0).stop 2023-08-10T11:51:27.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.213+0000 7f711132e700 1 -- 172.21.15.73:0/1567121497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f710c0fec60 msgr2=0x7f710c196950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:27.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.213+0000 7f711132e700 1 --2- 172.21.15.73:0/1567121497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f710c0fec60 0x7f710c196950 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f70fc000c00 tx=0x7f70fc00f830 comp rx=0 tx=0).stop 2023-08-10T11:51:27.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.213+0000 7f710b7fe700 1 -- 172.21.15.73:0/1567121497 reap_dead start 2023-08-10T11:51:27.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.214+0000 7f711132e700 1 -- 172.21.15.73:0/1567121497 shutdown_connections 2023-08-10T11:51:27.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.214+0000 7f711132e700 1 -- 172.21.15.73:0/1567121497 >> 172.21.15.73:0/1567121497 conn(0x7f710c075be0 msgr2=0x7f710c0fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:27.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.214+0000 7f711132e700 1 -- 172.21.15.73:0/1567121497 shutdown_connections 2023-08-10T11:51:27.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:27.214+0000 7f711132e700 1 -- 172.21.15.73:0/1567121497 wait complete. 2023-08-10T11:51:27.244 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:27.903 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:27 smithi073 ceph-mon[128869]: pgmap v272: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 426 B/s wr, 12 op/s 2023-08-10T11:51:27.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:27 smithi152 ceph-mon[130220]: pgmap v272: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 426 B/s wr, 12 op/s 2023-08-10T11:51:28.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:27 smithi156 ceph-mon[130574]: pgmap v272: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 426 B/s wr, 12 op/s 2023-08-10T11:51:28.199 INFO:teuthology.orchestra.run.smithi073.stdout:335007449106 2023-08-10T11:51:28.200 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.11 2023-08-10T11:51:28.361 INFO:teuthology.orchestra.run.smithi073.stdout:214748364835 2023-08-10T11:51:28.362 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.7 2023-08-10T11:51:28.363 INFO:teuthology.orchestra.run.smithi073.stdout:137438953521 2023-08-10T11:51:28.363 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.4 2023-08-10T11:51:28.373 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:28.374 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:28.380 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:28.454 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:28.455 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:28.500 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:29.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.050+0000 7f3418651700 1 -- 172.21.15.73:0/292762581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34101051e0 msgr2=0x7f3410105660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:29.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.050+0000 7f3418651700 1 --2- 172.21.15.73:0/292762581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34101051e0 0x7f3410105660 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f34000099c0 tx=0x7f3400009cd0 comp rx=0 tx=0).stop 2023-08-10T11:51:29.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.050+0000 7f3418651700 1 -- 172.21.15.73:0/292762581 shutdown_connections 2023-08-10T11:51:29.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.050+0000 7f3418651700 1 --2- 172.21.15.73:0/292762581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3410068730 0x7f3410068b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:29.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.050+0000 7f3418651700 1 --2- 172.21.15.73:0/292762581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3410105ba0 0x7f341010d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:29.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.050+0000 7f3418651700 1 --2- 172.21.15.73:0/292762581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34101051e0 0x7f3410105660 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:29.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.050+0000 7f3418651700 1 -- 172.21.15.73:0/292762581 >> 172.21.15.73:0/292762581 conn(0x7f3410076770 msgr2=0x7f3410076b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:29.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.050+0000 7f3418651700 1 -- 172.21.15.73:0/292762581 shutdown_connections 2023-08-10T11:51:29.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.050+0000 7f3418651700 1 -- 172.21.15.73:0/292762581 wait complete. 2023-08-10T11:51:29.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.051+0000 7f3418651700 1 Processor -- start 2023-08-10T11:51:29.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.051+0000 7f3418651700 1 -- start start 2023-08-10T11:51:29.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.051+0000 7f3418651700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3410068730 0x7f34100ff720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:29.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.051+0000 7f3418651700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34101051e0 0x7f34100ffc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:29.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.051+0000 7f3418651700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3410105ba0 0x7f34101a4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:29.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.051+0000 7f3418651700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3410100550 con 0x7f3410068730 2023-08-10T11:51:29.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.051+0000 7f3418651700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34101a4fe0 con 0x7f34101051e0 2023-08-10T11:51:29.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.051+0000 7f3418651700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34101a5150 con 0x7f3410105ba0 2023-08-10T11:51:29.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.051+0000 7f34163ed700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3410068730 0x7f34100ff720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:29.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.051+0000 7f34163ed700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3410068730 0x7f34100ff720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59366/0 (socket says 172.21.15.73:59366) 2023-08-10T11:51:29.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.051+0000 7f34163ed700 1 -- 172.21.15.73:0/1789262413 learned_addr learned my addr 172.21.15.73:0/1789262413 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:29.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.051+0000 7f3415bec700 1 --2- 172.21.15.73:0/1789262413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34101051e0 0x7f34100ffc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:29.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.051+0000 7f3416bee700 1 --2- 172.21.15.73:0/1789262413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3410105ba0 0x7f34101a4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:29.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.051+0000 7f34163ed700 1 -- 172.21.15.73:0/1789262413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3410105ba0 msgr2=0x7f34101a4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:29.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.051+0000 7f34163ed700 1 --2- 172.21.15.73:0/1789262413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3410105ba0 0x7f34101a4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:29.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.051+0000 7f34163ed700 1 -- 172.21.15.73:0/1789262413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34101051e0 msgr2=0x7f34100ffc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:29.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.051+0000 7f34163ed700 1 --2- 172.21.15.73:0/1789262413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34101051e0 0x7f34100ffc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:29.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.051+0000 7f34163ed700 1 -- 172.21.15.73:0/1789262413 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34000095f0 con 0x7f3410068730 2023-08-10T11:51:29.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.051+0000 7f3416bee700 1 --2- 172.21.15.73:0/1789262413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3410105ba0 0x7f34101a4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:51:29.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.051+0000 7f34163ed700 1 --2- 172.21.15.73:0/1789262413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3410068730 0x7f34100ff720 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f340c00c920 tx=0x7f340c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:29.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.052+0000 7f34077fe700 1 -- 172.21.15.73:0/1789262413 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c007b00 con 0x7f3410068730 2023-08-10T11:51:29.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.052+0000 7f34077fe700 1 -- 172.21.15.73:0/1789262413 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f340c00ce70 con 0x7f3410068730 2023-08-10T11:51:29.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.052+0000 7f34077fe700 1 -- 172.21.15.73:0/1789262413 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c005460 con 0x7f3410068730 2023-08-10T11:51:29.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.052+0000 7f3418651700 1 -- 172.21.15.73:0/1789262413 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34101a53d0 con 0x7f3410068730 2023-08-10T11:51:29.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.052+0000 7f3418651700 1 -- 172.21.15.73:0/1789262413 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34101a5850 con 0x7f3410068730 2023-08-10T11:51:29.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.053+0000 7f34057fa700 1 -- 172.21.15.73:0/1789262413 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f34101109a0 con 0x7f3410068730 2023-08-10T11:51:29.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.054+0000 7f34077fe700 1 -- 172.21.15.73:0/1789262413 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f340c004750 con 0x7f3410068730 2023-08-10T11:51:29.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.054+0000 7f34077fe700 1 --2- 172.21.15.73:0/1789262413 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f33fc0a11e0 0x7f33fc0a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:29.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.055+0000 7f3415bec700 1 --2- 172.21.15.73:0/1789262413 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f33fc0a11e0 0x7f33fc0a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:29.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.055+0000 7f34077fe700 1 -- 172.21.15.73:0/1789262413 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f340c0cc9a0 con 0x7f3410068730 2023-08-10T11:51:29.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.055+0000 7f34077fe700 1 --2- 172.21.15.73:0/1789262413 >> [v2:172.21.15.156:6800/1789212298,v1:172.21.15.156:6801/1789212298] conn(0x7f33fc0aa9c0 0x7f33fc0acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:29.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.055+0000 7f34077fe700 1 -- 172.21.15.73:0/1789262413 --> [v2:172.21.15.156:6800/1789212298,v1:172.21.15.156:6801/1789212298] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f33fc0ad490 con 0x7f33fc0aa9c0 2023-08-10T11:51:29.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.055+0000 7f34077fe700 1 -- 172.21.15.73:0/1789262413 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f340c0cce40 con 0x7f3410068730 2023-08-10T11:51:29.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.055+0000 7f3415bec700 1 --2- 172.21.15.73:0/1789262413 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f33fc0a11e0 0x7f33fc0a36a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3400000c00 tx=0x7f3400005c00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:29.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.055+0000 7f3416bee700 1 --2- 172.21.15.73:0/1789262413 >> [v2:172.21.15.156:6800/1789212298,v1:172.21.15.156:6801/1789212298] conn(0x7f33fc0aa9c0 0x7f33fc0acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:29.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.055+0000 7f3416bee700 1 --2- 172.21.15.73:0/1789262413 >> [v2:172.21.15.156:6800/1789212298,v1:172.21.15.156:6801/1789212298] conn(0x7f33fc0aa9c0 0x7f33fc0acde0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:29.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.056+0000 7f34077fe700 1 -- 172.21.15.73:0/1789262413 <== osd.2 v2:172.21.15.156:6800/1789212298 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f33fc0ad490 con 0x7f33fc0aa9c0 2023-08-10T11:51:29.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.073+0000 7f34057fa700 1 -- 172.21.15.73:0/1789262413 --> [v2:172.21.15.156:6800/1789212298,v1:172.21.15.156:6801/1789212298] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f341004e470 con 0x7f33fc0aa9c0 2023-08-10T11:51:29.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.074+0000 7f34077fe700 1 -- 172.21.15.73:0/1789262413 <== osd.2 v2:172.21.15.156:6800/1789212298 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f341004e470 con 0x7f33fc0aa9c0 2023-08-10T11:51:29.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.074+0000 7f34057fa700 1 -- 172.21.15.73:0/1789262413 >> [v2:172.21.15.156:6800/1789212298,v1:172.21.15.156:6801/1789212298] conn(0x7f33fc0aa9c0 msgr2=0x7f33fc0acde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:29.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.074+0000 7f34057fa700 1 --2- 172.21.15.73:0/1789262413 >> [v2:172.21.15.156:6800/1789212298,v1:172.21.15.156:6801/1789212298] conn(0x7f33fc0aa9c0 0x7f33fc0acde0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:29.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.074+0000 7f34057fa700 1 -- 172.21.15.73:0/1789262413 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f33fc0a11e0 msgr2=0x7f33fc0a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:29.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.074+0000 7f34057fa700 1 --2- 172.21.15.73:0/1789262413 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f33fc0a11e0 0x7f33fc0a36a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3400000c00 tx=0x7f3400005c00 comp rx=0 tx=0).stop 2023-08-10T11:51:29.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.074+0000 7f34057fa700 1 -- 172.21.15.73:0/1789262413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3410068730 msgr2=0x7f34100ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:29.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.074+0000 7f34057fa700 1 --2- 172.21.15.73:0/1789262413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3410068730 0x7f34100ff720 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f340c00c920 tx=0x7f340c00cc30 comp rx=0 tx=0).stop 2023-08-10T11:51:29.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.074+0000 7f3416bee700 1 -- 172.21.15.73:0/1789262413 reap_dead start 2023-08-10T11:51:29.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.075+0000 7f34057fa700 1 -- 172.21.15.73:0/1789262413 shutdown_connections 2023-08-10T11:51:29.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.075+0000 7f34057fa700 1 -- 172.21.15.73:0/1789262413 >> 172.21.15.73:0/1789262413 conn(0x7f3410076770 msgr2=0x7f34100fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:29.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.075+0000 7f34057fa700 1 -- 172.21.15.73:0/1789262413 shutdown_connections 2023-08-10T11:51:29.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:29.075+0000 7f34057fa700 1 -- 172.21.15.73:0/1789262413 wait complete. 2023-08-10T11:51:29.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:29 smithi073 ceph-mon[128869]: pgmap v273: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 9 op/s 2023-08-10T11:51:29.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:29 smithi152 ceph-mon[130220]: pgmap v273: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 9 op/s 2023-08-10T11:51:30.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:29 smithi156 ceph-mon[130574]: pgmap v273: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 9 op/s 2023-08-10T11:51:31.494 INFO:teuthology.orchestra.run.smithi073.stdout:77309411386 2023-08-10T11:51:31.495 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.2 2023-08-10T11:51:31.532 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:31.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:31 smithi073 ceph-mon[128869]: pgmap v274: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 597 B/s wr, 11 op/s 2023-08-10T11:51:31.895 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:31.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:31 smithi152 ceph-mon[130220]: pgmap v274: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 597 B/s wr, 11 op/s 2023-08-10T11:51:32.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:31 smithi156 ceph-mon[130574]: pgmap v274: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 597 B/s wr, 11 op/s 2023-08-10T11:51:32.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.416+0000 7f3bc97bc700 1 -- 172.21.15.73:0/2648026688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bc4105b90 msgr2=0x7f3bc410d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:32.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.416+0000 7f3bc97bc700 1 --2- 172.21.15.73:0/2648026688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bc4105b90 0x7f3bc410d710 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc009990 tx=0x7f3bbc009ca0 comp rx=0 tx=0).stop 2023-08-10T11:51:32.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.416+0000 7f3bc97bc700 1 -- 172.21.15.73:0/2648026688 shutdown_connections 2023-08-10T11:51:32.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.416+0000 7f3bc97bc700 1 --2- 172.21.15.73:0/2648026688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bc4100c60 0x7f3bc4101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:32.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.416+0000 7f3bc97bc700 1 --2- 172.21.15.73:0/2648026688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bc4105b90 0x7f3bc410d710 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:32.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.416+0000 7f3bc97bc700 1 --2- 172.21.15.73:0/2648026688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3bc4101610 0x7f3bc4105460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:32.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.416+0000 7f3bc97bc700 1 -- 172.21.15.73:0/2648026688 >> 172.21.15.73:0/2648026688 conn(0x7f3bc4078740 msgr2=0x7f3bc4078b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:32.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.416+0000 7f3bc97bc700 1 -- 172.21.15.73:0/2648026688 shutdown_connections 2023-08-10T11:51:32.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.416+0000 7f3bc97bc700 1 -- 172.21.15.73:0/2648026688 wait complete. 2023-08-10T11:51:32.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.417+0000 7f3bc97bc700 1 Processor -- start 2023-08-10T11:51:32.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.417+0000 7f3bc97bc700 1 -- start start 2023-08-10T11:51:32.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.417+0000 7f3bc97bc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bc4100c60 0x7f3bc4196690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:32.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.417+0000 7f3bc97bc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bc4101610 0x7f3bc4196bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:32.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.417+0000 7f3bc97bc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3bc4105b90 0x7f3bc4199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:32.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.417+0000 7f3bc97bc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc419a590 con 0x7f3bc4100c60 2023-08-10T11:51:32.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.417+0000 7f3bc97bc700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc419a700 con 0x7f3bc4101610 2023-08-10T11:51:32.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.417+0000 7f3bc97bc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc419a8c0 con 0x7f3bc4105b90 2023-08-10T11:51:32.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.417+0000 7f3bc2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bc4100c60 0x7f3bc4196690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:32.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.417+0000 7f3bc2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bc4100c60 0x7f3bc4196690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59380/0 (socket says 172.21.15.73:59380) 2023-08-10T11:51:32.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.417+0000 7f3bc2ffd700 1 -- 172.21.15.73:0/978454085 learned_addr learned my addr 172.21.15.73:0/978454085 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:32.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.417+0000 7f3bc27fc700 1 --2- 172.21.15.73:0/978454085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bc4101610 0x7f3bc4196bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:32.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.417+0000 7f3bc37fe700 1 --2- 172.21.15.73:0/978454085 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3bc4105b90 0x7f3bc4199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:32.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.417+0000 7f3bc2ffd700 1 -- 172.21.15.73:0/978454085 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3bc4105b90 msgr2=0x7f3bc4199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:32.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.417+0000 7f3bc2ffd700 1 --2- 172.21.15.73:0/978454085 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3bc4105b90 0x7f3bc4199f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:32.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.417+0000 7f3bc2ffd700 1 -- 172.21.15.73:0/978454085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bc4101610 msgr2=0x7f3bc4196bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:32.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.417+0000 7f3bc2ffd700 1 --2- 172.21.15.73:0/978454085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bc4101610 0x7f3bc4196bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:32.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.417+0000 7f3bc2ffd700 1 -- 172.21.15.73:0/978454085 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc0095f0 con 0x7f3bc4100c60 2023-08-10T11:51:32.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.417+0000 7f3bc27fc700 1 --2- 172.21.15.73:0/978454085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bc4101610 0x7f3bc4196bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:51:32.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.418+0000 7f3bc2ffd700 1 --2- 172.21.15.73:0/978454085 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bc4100c60 0x7f3bc4196690 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4007e20 tx=0x7f3bb400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:32.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.418+0000 7f3bbbfff700 1 -- 172.21.15.73:0/978454085 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb400ae00 con 0x7f3bc4100c60 2023-08-10T11:51:32.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.418+0000 7f3bc97bc700 1 -- 172.21.15.73:0/978454085 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc419aba0 con 0x7f3bc4100c60 2023-08-10T11:51:32.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.418+0000 7f3bbbfff700 1 -- 172.21.15.73:0/978454085 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bb40128e0 con 0x7f3bc4100c60 2023-08-10T11:51:32.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.418+0000 7f3bbbfff700 1 -- 172.21.15.73:0/978454085 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb40117a0 con 0x7f3bc4100c60 2023-08-10T11:51:32.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.418+0000 7f3bc97bc700 1 -- 172.21.15.73:0/978454085 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc41a34f0 con 0x7f3bc4100c60 2023-08-10T11:51:32.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.419+0000 7f3bc97bc700 1 -- 172.21.15.73:0/978454085 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc404e470 con 0x7f3bc4100c60 2023-08-10T11:51:32.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.420+0000 7f3bbbfff700 1 -- 172.21.15.73:0/978454085 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f3bb4012a50 con 0x7f3bc4100c60 2023-08-10T11:51:32.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.420+0000 7f3bbbfff700 1 --2- 172.21.15.73:0/978454085 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3bb00a11e0 0x7f3bb00a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:32.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.421+0000 7f3bc27fc700 1 --2- 172.21.15.73:0/978454085 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3bb00a11e0 0x7f3bb00a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:32.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.421+0000 7f3bbbfff700 1 -- 172.21.15.73:0/978454085 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3bb40cc9d0 con 0x7f3bc4100c60 2023-08-10T11:51:32.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.421+0000 7f3bc27fc700 1 --2- 172.21.15.73:0/978454085 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3bb00a11e0 0x7f3bb00a36a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3bac005fd0 tx=0x7f3bac005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:32.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.425+0000 7f3bbbfff700 1 -- 172.21.15.73:0/978454085 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f3bb4096180 con 0x7f3bc4100c60 2023-08-10T11:51:32.644 INFO:teuthology.orchestra.run.smithi073.stdout:34359738434 2023-08-10T11:51:32.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.642+0000 7f3bc97bc700 1 -- 172.21.15.73:0/978454085 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3bc41a37f0 con 0x7f3bc4100c60 2023-08-10T11:51:32.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.642+0000 7f3bbbfff700 1 -- 172.21.15.73:0/978454085 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3bb40997a0 con 0x7f3bc4100c60 2023-08-10T11:51:32.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.644+0000 7f3bc97bc700 1 -- 172.21.15.73:0/978454085 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3bb00a11e0 msgr2=0x7f3bb00a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:32.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.644+0000 7f3bc97bc700 1 --2- 172.21.15.73:0/978454085 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3bb00a11e0 0x7f3bb00a36a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3bac005fd0 tx=0x7f3bac005e30 comp rx=0 tx=0).stop 2023-08-10T11:51:32.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.644+0000 7f3bc97bc700 1 -- 172.21.15.73:0/978454085 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bc4100c60 msgr2=0x7f3bc4196690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:32.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.644+0000 7f3bc97bc700 1 --2- 172.21.15.73:0/978454085 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bc4100c60 0x7f3bc4196690 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4007e20 tx=0x7f3bb400a340 comp rx=0 tx=0).stop 2023-08-10T11:51:32.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.644+0000 7f3bc97bc700 1 -- 172.21.15.73:0/978454085 shutdown_connections 2023-08-10T11:51:32.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.644+0000 7f3bc97bc700 1 --2- 172.21.15.73:0/978454085 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3bc4105b90 0x7f3bc4199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:32.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.644+0000 7f3bc97bc700 1 --2- 172.21.15.73:0/978454085 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bc4100c60 0x7f3bc4196690 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:32.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.644+0000 7f3bc97bc700 1 --2- 172.21.15.73:0/978454085 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3bb00a11e0 0x7f3bb00a36a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:32.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.644+0000 7f3bc97bc700 1 --2- 172.21.15.73:0/978454085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bc4101610 0x7f3bc4196bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:32.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.644+0000 7f3bc97bc700 1 -- 172.21.15.73:0/978454085 >> 172.21.15.73:0/978454085 conn(0x7f3bc4078740 msgr2=0x7f3bc40fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:32.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.644+0000 7f3bc97bc700 1 -- 172.21.15.73:0/978454085 shutdown_connections 2023-08-10T11:51:32.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.644+0000 7f3bc97bc700 1 -- 172.21.15.73:0/978454085 wait complete. 2023-08-10T11:51:32.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.833+0000 7f6d8b5c3700 1 -- 172.21.15.73:0/3856509294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d84104550 msgr2=0x7f6d84104930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.833+0000 7f6d8b5c3700 1 --2- 172.21.15.73:0/3856509294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d84104550 0x7f6d84104930 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6d80009990 tx=0x7f6d80009ca0 comp rx=0 tx=0).stop 2023-08-10T11:51:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.833+0000 7f6d8b5c3700 1 -- 172.21.15.73:0/3856509294 shutdown_connections 2023-08-10T11:51:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.833+0000 7f6d8b5c3700 1 --2- 172.21.15.73:0/3856509294 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d84100040 0x7f6d8410c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.833+0000 7f6d8b5c3700 1 --2- 172.21.15.73:0/3856509294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d84104550 0x7f6d84104930 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.833+0000 7f6d8b5c3700 1 --2- 172.21.15.73:0/3856509294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d840ff680 0x7f6d840ffb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.833+0000 7f6d8b5c3700 1 -- 172.21.15.73:0/3856509294 >> 172.21.15.73:0/3856509294 conn(0x7f6d840767c0 msgr2=0x7f6d84076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:32.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.833+0000 7f6d8b5c3700 1 -- 172.21.15.73:0/3856509294 shutdown_connections 2023-08-10T11:51:32.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.833+0000 7f6d8b5c3700 1 -- 172.21.15.73:0/3856509294 wait complete. 2023-08-10T11:51:32.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.834+0000 7f6d8b5c3700 1 Processor -- start 2023-08-10T11:51:32.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.834+0000 7f6d8b5c3700 1 -- start start 2023-08-10T11:51:32.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.834+0000 7f6d8b5c3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d840ff680 0x7f6d840fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:32.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.834+0000 7f6d8b5c3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d84100040 0x7f6d840fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:32.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.834+0000 7f6d8b5c3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d84104550 0x7f6d840fd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:32.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.834+0000 7f6d8b5c3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d841a4e00 con 0x7f6d84100040 2023-08-10T11:51:32.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.834+0000 7f6d8b5c3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d841a4f70 con 0x7f6d840ff680 2023-08-10T11:51:32.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.834+0000 7f6d8b5c3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d841a5130 con 0x7f6d84104550 2023-08-10T11:51:32.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.834+0000 7f6d88b5e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d84100040 0x7f6d840fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:32.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.834+0000 7f6d88b5e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d84100040 0x7f6d840fcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59396/0 (socket says 172.21.15.73:59396) 2023-08-10T11:51:32.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.834+0000 7f6d88b5e700 1 -- 172.21.15.73:0/803575835 learned_addr learned my addr 172.21.15.73:0/803575835 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:32.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.834+0000 7f6d8935f700 1 --2- 172.21.15.73:0/803575835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d840ff680 0x7f6d840fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:32.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.834+0000 7f6d89b60700 1 --2- 172.21.15.73:0/803575835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d84104550 0x7f6d840fd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:32.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.834+0000 7f6d88b5e700 1 -- 172.21.15.73:0/803575835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d84104550 msgr2=0x7f6d840fd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:32.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.834+0000 7f6d88b5e700 1 --2- 172.21.15.73:0/803575835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d84104550 0x7f6d840fd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:32.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.834+0000 7f6d88b5e700 1 -- 172.21.15.73:0/803575835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d840ff680 msgr2=0x7f6d840fc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:32.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.834+0000 7f6d88b5e700 1 --2- 172.21.15.73:0/803575835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d840ff680 0x7f6d840fc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:32.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.834+0000 7f6d88b5e700 1 -- 172.21.15.73:0/803575835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d800095f0 con 0x7f6d84100040 2023-08-10T11:51:32.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.834+0000 7f6d89b60700 1 --2- 172.21.15.73:0/803575835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d84104550 0x7f6d840fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:32.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.834+0000 7f6d8935f700 1 --2- 172.21.15.73:0/803575835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d840ff680 0x7f6d840fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:51:32.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.834+0000 7f6d88b5e700 1 --2- 172.21.15.73:0/803575835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d84100040 0x7f6d840fcbd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400d980 tx=0x7f6d7400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:32.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.834+0000 7f6d7a7fc700 1 -- 172.21.15.73:0/803575835 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d74009b40 con 0x7f6d84100040 2023-08-10T11:51:32.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.834+0000 7f6d7a7fc700 1 -- 172.21.15.73:0/803575835 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d7400de60 con 0x7f6d84100040 2023-08-10T11:51:32.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.835+0000 7f6d8b5c3700 1 -- 172.21.15.73:0/803575835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d841a5410 con 0x7f6d84100040 2023-08-10T11:51:32.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.835+0000 7f6d7a7fc700 1 -- 172.21.15.73:0/803575835 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d74005580 con 0x7f6d84100040 2023-08-10T11:51:32.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.835+0000 7f6d8b5c3700 1 -- 172.21.15.73:0/803575835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d841a58c0 con 0x7f6d84100040 2023-08-10T11:51:32.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.835+0000 7f6d8b5c3700 1 -- 172.21.15.73:0/803575835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d84108bb0 con 0x7f6d84100040 2023-08-10T11:51:32.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.837+0000 7f6d7a7fc700 1 -- 172.21.15.73:0/803575835 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f6d74004750 con 0x7f6d84100040 2023-08-10T11:51:32.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.837+0000 7f6d7a7fc700 1 --2- 172.21.15.73:0/803575835 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f6d700a11e0 0x7f6d700a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:32.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.837+0000 7f6d8935f700 1 --2- 172.21.15.73:0/803575835 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f6d700a11e0 0x7f6d700a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:32.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.837+0000 7f6d7a7fc700 1 -- 172.21.15.73:0/803575835 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6d740ccce0 con 0x7f6d84100040 2023-08-10T11:51:32.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.838+0000 7f6d8935f700 1 --2- 172.21.15.73:0/803575835 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f6d700a11e0 0x7f6d700a36a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6d80006010 tx=0x7f6d8000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:32.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:32.841+0000 7f6d7a7fc700 1 -- 172.21.15.73:0/803575835 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f6d74096480 con 0x7f6d84100040 2023-08-10T11:51:33.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.045+0000 7f6d8b5c3700 1 -- 172.21.15.73:0/803575835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f6d8404e470 con 0x7f6d84100040 2023-08-10T11:51:33.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.046+0000 7f6d7a7fc700 1 -- 172.21.15.73:0/803575835 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f6d74017070 con 0x7f6d84100040 2023-08-10T11:51:33.049 INFO:teuthology.orchestra.run.smithi073.stdout:300647710743 2023-08-10T11:51:33.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.048+0000 7f6d8b5c3700 1 -- 172.21.15.73:0/803575835 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f6d700a11e0 msgr2=0x7f6d700a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:33.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.048+0000 7f6d8b5c3700 1 --2- 172.21.15.73:0/803575835 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f6d700a11e0 0x7f6d700a36a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6d80006010 tx=0x7f6d8000b540 comp rx=0 tx=0).stop 2023-08-10T11:51:33.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.048+0000 7f6d8b5c3700 1 -- 172.21.15.73:0/803575835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d84100040 msgr2=0x7f6d840fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:33.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.048+0000 7f6d8b5c3700 1 --2- 172.21.15.73:0/803575835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d84100040 0x7f6d840fcbd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400d980 tx=0x7f6d7400dd40 comp rx=0 tx=0).stop 2023-08-10T11:51:33.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.048+0000 7f6d8b5c3700 1 -- 172.21.15.73:0/803575835 shutdown_connections 2023-08-10T11:51:33.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.048+0000 7f6d8b5c3700 1 --2- 172.21.15.73:0/803575835 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f6d700a11e0 0x7f6d700a36a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:33.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.048+0000 7f6d8b5c3700 1 --2- 172.21.15.73:0/803575835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d840ff680 0x7f6d840fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:33.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.048+0000 7f6d8b5c3700 1 --2- 172.21.15.73:0/803575835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d84104550 0x7f6d840fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:33.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.048+0000 7f6d8b5c3700 1 --2- 172.21.15.73:0/803575835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d84100040 0x7f6d840fcbd0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:33.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.048+0000 7f6d8b5c3700 1 -- 172.21.15.73:0/803575835 >> 172.21.15.73:0/803575835 conn(0x7f6d840767c0 msgr2=0x7f6d84068410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:33.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.048+0000 7f6d8b5c3700 1 -- 172.21.15.73:0/803575835 shutdown_connections 2023-08-10T11:51:33.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.048+0000 7f6d8b5c3700 1 -- 172.21.15.73:0/803575835 wait complete. 2023-08-10T11:51:33.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.468+0000 7fa2e9adc700 1 -- 172.21.15.73:0/4126984445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2e4104660 msgr2=0x7fa2e4104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:33.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.468+0000 7fa2e9adc700 1 --2- 172.21.15.73:0/4126984445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2e4104660 0x7fa2e4104a40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4009990 tx=0x7fa2d4009ca0 comp rx=0 tx=0).stop 2023-08-10T11:51:33.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.468+0000 7fa2e9adc700 1 -- 172.21.15.73:0/4126984445 shutdown_connections 2023-08-10T11:51:33.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.468+0000 7fa2e9adc700 1 --2- 172.21.15.73:0/4126984445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2e41002a0 0x7fa2e410c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:33.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.468+0000 7fa2e9adc700 1 --2- 172.21.15.73:0/4126984445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2e4104660 0x7fa2e4104a40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:33.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.468+0000 7fa2e9adc700 1 --2- 172.21.15.73:0/4126984445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2e40ff8e0 0x7fa2e40ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:33.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.468+0000 7fa2e9adc700 1 -- 172.21.15.73:0/4126984445 >> 172.21.15.73:0/4126984445 conn(0x7fa2e4076540 msgr2=0x7fa2e4076950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:33.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.468+0000 7fa2e9adc700 1 -- 172.21.15.73:0/4126984445 shutdown_connections 2023-08-10T11:51:33.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.468+0000 7fa2e9adc700 1 -- 172.21.15.73:0/4126984445 wait complete. 2023-08-10T11:51:33.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.469+0000 7fa2e9adc700 1 Processor -- start 2023-08-10T11:51:33.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.469+0000 7fa2e9adc700 1 -- start start 2023-08-10T11:51:33.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.469+0000 7fa2e9adc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2e40ff8e0 0x7fa2e419b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:33.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.469+0000 7fa2e9adc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2e41002a0 0x7fa2e419bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:33.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.469+0000 7fa2e9adc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2e4104660 0x7fa2e4195600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:33.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.469+0000 7fa2e9adc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e4195c60 con 0x7fa2e40ff8e0 2023-08-10T11:51:33.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.469+0000 7fa2e9adc700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e4195dd0 con 0x7fa2e41002a0 2023-08-10T11:51:33.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.469+0000 7fa2e9adc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e4195f90 con 0x7fa2e4104660 2023-08-10T11:51:33.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.469+0000 7fa2e37fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2e40ff8e0 0x7fa2e419b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:33.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.469+0000 7fa2e37fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2e40ff8e0 0x7fa2e419b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59406/0 (socket says 172.21.15.73:59406) 2023-08-10T11:51:33.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.469+0000 7fa2e37fe700 1 -- 172.21.15.73:0/2080649954 learned_addr learned my addr 172.21.15.73:0/2080649954 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:33.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.469+0000 7fa2e2ffd700 1 --2- 172.21.15.73:0/2080649954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2e41002a0 0x7fa2e419bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:33.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.469+0000 7fa2e3fff700 1 --2- 172.21.15.73:0/2080649954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2e4104660 0x7fa2e4195600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:33.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.469+0000 7fa2e37fe700 1 -- 172.21.15.73:0/2080649954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2e4104660 msgr2=0x7fa2e4195600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:33.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.469+0000 7fa2e37fe700 1 --2- 172.21.15.73:0/2080649954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2e4104660 0x7fa2e4195600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:33.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.469+0000 7fa2e37fe700 1 -- 172.21.15.73:0/2080649954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2e41002a0 msgr2=0x7fa2e419bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:33.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.469+0000 7fa2e37fe700 1 --2- 172.21.15.73:0/2080649954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2e41002a0 0x7fa2e419bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:33.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.469+0000 7fa2e37fe700 1 -- 172.21.15.73:0/2080649954 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d40095f0 con 0x7fa2e40ff8e0 2023-08-10T11:51:33.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.470+0000 7fa2e37fe700 1 --2- 172.21.15.73:0/2080649954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2e40ff8e0 0x7fa2e419b580 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40095c0 tx=0x7fa2d400f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:33.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.470+0000 7fa2e0ff9700 1 -- 172.21.15.73:0/2080649954 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d401d070 con 0x7fa2e40ff8e0 2023-08-10T11:51:33.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.470+0000 7fa2e9adc700 1 -- 172.21.15.73:0/2080649954 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e4196210 con 0x7fa2e40ff8e0 2023-08-10T11:51:33.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.470+0000 7fa2e0ff9700 1 -- 172.21.15.73:0/2080649954 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2d400fc00 con 0x7fa2e40ff8e0 2023-08-10T11:51:33.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.470+0000 7fa2e0ff9700 1 -- 172.21.15.73:0/2080649954 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d40173f0 con 0x7fa2e40ff8e0 2023-08-10T11:51:33.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.470+0000 7fa2e9adc700 1 -- 172.21.15.73:0/2080649954 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e4068dc0 con 0x7fa2e40ff8e0 2023-08-10T11:51:33.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.471+0000 7fa2e9adc700 1 -- 172.21.15.73:0/2080649954 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e404e470 con 0x7fa2e40ff8e0 2023-08-10T11:51:33.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.472+0000 7fa2e0ff9700 1 -- 172.21.15.73:0/2080649954 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fa2d4022470 con 0x7fa2e40ff8e0 2023-08-10T11:51:33.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.472+0000 7fa2e0ff9700 1 --2- 172.21.15.73:0/2080649954 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa2cc0a11e0 0x7fa2cc0a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:33.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.473+0000 7fa2e2ffd700 1 --2- 172.21.15.73:0/2080649954 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa2cc0a11e0 0x7fa2cc0a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:33.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.473+0000 7fa2e0ff9700 1 -- 172.21.15.73:0/2080649954 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa2d40cdb40 con 0x7fa2e40ff8e0 2023-08-10T11:51:33.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.473+0000 7fa2e2ffd700 1 --2- 172.21.15.73:0/2080649954 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa2cc0a11e0 0x7fa2cc0a36a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8005fd0 tx=0x7fa2d800a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:33.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.477+0000 7fa2e0ff9700 1 -- 172.21.15.73:0/2080649954 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fa2d4097490 con 0x7fa2e40ff8e0 2023-08-10T11:51:33.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.702+0000 7fa2e9adc700 1 -- 172.21.15.73:0/2080649954 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa2e40690a0 con 0x7fa2e40ff8e0 2023-08-10T11:51:33.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.702+0000 7fa2e0ff9700 1 -- 172.21.15.73:0/2080649954 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa2d4027090 con 0x7fa2e40ff8e0 2023-08-10T11:51:33.705 INFO:teuthology.orchestra.run.smithi073.stdout:158913789997 2023-08-10T11:51:33.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.704+0000 7fa2e9adc700 1 -- 172.21.15.73:0/2080649954 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa2cc0a11e0 msgr2=0x7fa2cc0a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:33.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.704+0000 7fa2e9adc700 1 --2- 172.21.15.73:0/2080649954 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa2cc0a11e0 0x7fa2cc0a36a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8005fd0 tx=0x7fa2d800a560 comp rx=0 tx=0).stop 2023-08-10T11:51:33.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.704+0000 7fa2e9adc700 1 -- 172.21.15.73:0/2080649954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2e40ff8e0 msgr2=0x7fa2e419b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:33.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.704+0000 7fa2e9adc700 1 --2- 172.21.15.73:0/2080649954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2e40ff8e0 0x7fa2e419b580 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40095c0 tx=0x7fa2d400f710 comp rx=0 tx=0).stop 2023-08-10T11:51:33.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.704+0000 7fa2e9adc700 1 -- 172.21.15.73:0/2080649954 shutdown_connections 2023-08-10T11:51:33.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.704+0000 7fa2e9adc700 1 --2- 172.21.15.73:0/2080649954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2e4104660 0x7fa2e4195600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:33.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.704+0000 7fa2e9adc700 1 --2- 172.21.15.73:0/2080649954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2e40ff8e0 0x7fa2e419b580 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:33.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.704+0000 7fa2e9adc700 1 --2- 172.21.15.73:0/2080649954 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa2cc0a11e0 0x7fa2cc0a36a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:33.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.704+0000 7fa2e9adc700 1 --2- 172.21.15.73:0/2080649954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2e41002a0 0x7fa2e419bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:33.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.704+0000 7fa2e9adc700 1 -- 172.21.15.73:0/2080649954 >> 172.21.15.73:0/2080649954 conn(0x7fa2e4076540 msgr2=0x7fa2e40fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:33.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.705+0000 7fa2e9adc700 1 -- 172.21.15.73:0/2080649954 shutdown_connections 2023-08-10T11:51:33.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:33.705+0000 7fa2e9adc700 1 -- 172.21.15.73:0/2080649954 wait complete. 2023-08-10T11:51:33.732 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:33 smithi073 ceph-mon[128869]: pgmap v275: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 9 op/s 2023-08-10T11:51:33.732 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:33 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/978454085' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-08-10T11:51:33.733 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:33 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/803575835' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-08-10T11:51:33.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:33 smithi152 ceph-mon[130220]: pgmap v275: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 9 op/s 2023-08-10T11:51:33.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:33 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/978454085' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-08-10T11:51:33.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:33 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/803575835' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-08-10T11:51:34.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:33 smithi156 ceph-mon[130574]: pgmap v275: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 9 op/s 2023-08-10T11:51:34.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:33 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/978454085' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-08-10T11:51:34.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:33 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/803575835' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-08-10T11:51:34.383 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738432 got 34359738434 for osd.0 2023-08-10T11:51:34.383 DEBUG:teuthology.parallel:result is None 2023-08-10T11:51:34.431 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710741 got 300647710743 for osd.10 2023-08-10T11:51:34.431 DEBUG:teuthology.parallel:result is None 2023-08-10T11:51:34.849 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:34 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2080649954' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-08-10T11:51:34.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:34 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/2080649954' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-08-10T11:51:35.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:34 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/2080649954' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-08-10T11:51:35.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.305+0000 7f31b0884700 1 -- 172.21.15.73:0/129109836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31ac068290 msgr2=0x7f31ac068710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:35.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.305+0000 7f31b0884700 1 --2- 172.21.15.73:0/129109836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31ac068290 0x7f31ac068710 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f31a400b0a0 tx=0x7f31a400b3b0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.305+0000 7f31b0884700 1 -- 172.21.15.73:0/129109836 shutdown_connections 2023-08-10T11:51:35.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.305+0000 7f31b0884700 1 --2- 172.21.15.73:0/129109836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31ac105730 0x7f31ac1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.305+0000 7f31b0884700 1 --2- 172.21.15.73:0/129109836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31ac068290 0x7f31ac068710 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.305+0000 7f31b0884700 1 --2- 172.21.15.73:0/129109836 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31ac103700 0x7f31ac103b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.305+0000 7f31b0884700 1 -- 172.21.15.73:0/129109836 >> 172.21.15.73:0/129109836 conn(0x7f31ac076770 msgr2=0x7f31ac076b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:35.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.305+0000 7f31b0884700 1 -- 172.21.15.73:0/129109836 shutdown_connections 2023-08-10T11:51:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.305+0000 7f31b0884700 1 -- 172.21.15.73:0/129109836 wait complete. 2023-08-10T11:51:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.306+0000 7f31b0884700 1 Processor -- start 2023-08-10T11:51:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.306+0000 7f31b0884700 1 -- start start 2023-08-10T11:51:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.306+0000 7f31b0884700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31ac068290 0x7f31ac19d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.306+0000 7f31b0884700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31ac103700 0x7f31ac19d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.306+0000 7f31b0884700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31ac105730 0x7f31ac1a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:35.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.306+0000 7f31b0884700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac1a2020 con 0x7f31ac105730 2023-08-10T11:51:35.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.306+0000 7f31b0884700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac1a2190 con 0x7f31ac068290 2023-08-10T11:51:35.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.306+0000 7f31b0884700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac1a2350 con 0x7f31ac103700 2023-08-10T11:51:35.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.306+0000 7f31aad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31ac105730 0x7f31ac1a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:35.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.306+0000 7f31aad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31ac105730 0x7f31ac1a1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59438/0 (socket says 172.21.15.73:59438) 2023-08-10T11:51:35.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.306+0000 7f31a9d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31ac103700 0x7f31ac19d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:35.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.306+0000 7f31aad9d700 1 -- 172.21.15.73:0/3641479375 learned_addr learned my addr 172.21.15.73:0/3641479375 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:35.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.306+0000 7f31aa59c700 1 --2- 172.21.15.73:0/3641479375 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31ac068290 0x7f31ac19d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:35.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.307+0000 7f31aad9d700 1 -- 172.21.15.73:0/3641479375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31ac103700 msgr2=0x7f31ac19d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:35.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.307+0000 7f31aad9d700 1 --2- 172.21.15.73:0/3641479375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31ac103700 0x7f31ac19d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.307+0000 7f31aad9d700 1 -- 172.21.15.73:0/3641479375 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31ac068290 msgr2=0x7f31ac19d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:35.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.307+0000 7f31aad9d700 1 --2- 172.21.15.73:0/3641479375 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31ac068290 0x7f31ac19d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.307+0000 7f31aad9d700 1 -- 172.21.15.73:0/3641479375 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a4009d00 con 0x7f31ac105730 2023-08-10T11:51:35.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.307+0000 7f31a9d9b700 1 --2- 172.21.15.73:0/3641479375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31ac103700 0x7f31ac19d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:51:35.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.307+0000 7f31aa59c700 1 --2- 172.21.15.73:0/3641479375 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31ac068290 0x7f31ac19d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:51:35.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.307+0000 7f31aad9d700 1 --2- 172.21.15.73:0/3641479375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31ac105730 0x7f31ac1a1a10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f31a4009fd0 tx=0x7f31a40094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:35.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.307+0000 7f319b7fe700 1 -- 172.21.15.73:0/3641479375 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a400e040 con 0x7f31ac105730 2023-08-10T11:51:35.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.307+0000 7f31b0884700 1 -- 172.21.15.73:0/3641479375 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31ac1a25d0 con 0x7f31ac105730 2023-08-10T11:51:35.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.307+0000 7f319b7fe700 1 -- 172.21.15.73:0/3641479375 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31a400be40 con 0x7f31ac105730 2023-08-10T11:51:35.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.307+0000 7f319b7fe700 1 -- 172.21.15.73:0/3641479375 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a401b6c0 con 0x7f31ac105730 2023-08-10T11:51:35.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.307+0000 7f31b0884700 1 -- 172.21.15.73:0/3641479375 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31ac1a9e90 con 0x7f31ac105730 2023-08-10T11:51:35.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.308+0000 7f31b0884700 1 -- 172.21.15.73:0/3641479375 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31ac04e470 con 0x7f31ac105730 2023-08-10T11:51:35.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.309+0000 7f319b7fe700 1 -- 172.21.15.73:0/3641479375 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f31a4004c50 con 0x7f31ac105730 2023-08-10T11:51:35.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.310+0000 7f319b7fe700 1 --2- 172.21.15.73:0/3641479375 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f31940a11e0 0x7f31940a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:35.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.310+0000 7f319b7fe700 1 -- 172.21.15.73:0/3641479375 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f31a40cd850 con 0x7f31ac105730 2023-08-10T11:51:35.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.310+0000 7f31aa59c700 1 --2- 172.21.15.73:0/3641479375 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f31940a11e0 0x7f31940a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:35.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.310+0000 7f31aa59c700 1 --2- 172.21.15.73:0/3641479375 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f31940a11e0 0x7f31940a36a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f319c009c90 tx=0x7f319c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:35.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.313+0000 7f319b7fe700 1 -- 172.21.15.73:0/3641479375 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f31a4097080 con 0x7f31ac105730 2023-08-10T11:51:35.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.519+0000 7f31b0884700 1 -- 172.21.15.73:0/3641479375 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f31ac1a2760 con 0x7f31ac105730 2023-08-10T11:51:35.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.519+0000 7f319b7fe700 1 -- 172.21.15.73:0/3641479375 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f31a4011390 con 0x7f31ac105730 2023-08-10T11:51:35.521 INFO:teuthology.orchestra.run.smithi073.stdout:107374182454 2023-08-10T11:51:35.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.521+0000 7f31b0884700 1 -- 172.21.15.73:0/3641479375 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f31940a11e0 msgr2=0x7f31940a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:35.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.521+0000 7f31b0884700 1 --2- 172.21.15.73:0/3641479375 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f31940a11e0 0x7f31940a36a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f319c009c90 tx=0x7f319c009260 comp rx=0 tx=0).stop 2023-08-10T11:51:35.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.521+0000 7f31b0884700 1 -- 172.21.15.73:0/3641479375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31ac105730 msgr2=0x7f31ac1a1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:35.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.521+0000 7f31b0884700 1 --2- 172.21.15.73:0/3641479375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31ac105730 0x7f31ac1a1a10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f31a4009fd0 tx=0x7f31a40094c0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.521+0000 7f31b0884700 1 -- 172.21.15.73:0/3641479375 shutdown_connections 2023-08-10T11:51:35.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.521+0000 7f31b0884700 1 --2- 172.21.15.73:0/3641479375 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f31940a11e0 0x7f31940a36a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.521+0000 7f31b0884700 1 --2- 172.21.15.73:0/3641479375 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31ac068290 0x7f31ac19d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.521+0000 7f31b0884700 1 --2- 172.21.15.73:0/3641479375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31ac105730 0x7f31ac1a1a10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.521+0000 7f31b0884700 1 --2- 172.21.15.73:0/3641479375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31ac103700 0x7f31ac19d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.521+0000 7f31b0884700 1 -- 172.21.15.73:0/3641479375 >> 172.21.15.73:0/3641479375 conn(0x7f31ac076770 msgr2=0x7f31ac0fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:35.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.521+0000 7f31b0884700 1 -- 172.21.15.73:0/3641479375 shutdown_connections 2023-08-10T11:51:35.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.521+0000 7f31b0884700 1 -- 172.21.15.73:0/3641479375 wait complete. 2023-08-10T11:51:35.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.239+0000 7f9ef3d6f700 1 -- 172.21.15.73:0/604985397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9eec100770 msgr2=0x7f9eec10c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:35.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.239+0000 7f9ef3d6f700 1 --2- 172.21.15.73:0/604985397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9eec100770 0x7f9eec10c550 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9ee400b0a0 tx=0x7f9ee400b3b0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.239+0000 7f9ef3d6f700 1 -- 172.21.15.73:0/604985397 shutdown_connections 2023-08-10T11:51:35.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.239+0000 7f9ef3d6f700 1 --2- 172.21.15.73:0/604985397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9eec100770 0x7f9eec10c550 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.239+0000 7f9ef3d6f700 1 --2- 172.21.15.73:0/604985397 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9eec105680 0x7f9eec105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.239+0000 7f9ef3d6f700 1 --2- 172.21.15.73:0/604985397 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9eec0ffdb0 0x7f9eec100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.239+0000 7f9ef3d6f700 1 -- 172.21.15.73:0/604985397 >> 172.21.15.73:0/604985397 conn(0x7f9eec075be0 msgr2=0x7f9eec0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:35.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.239+0000 7f9ef3d6f700 1 -- 172.21.15.73:0/604985397 shutdown_connections 2023-08-10T11:51:35.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.239+0000 7f9ef3d6f700 1 -- 172.21.15.73:0/604985397 wait complete. 2023-08-10T11:51:35.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.239+0000 7f9ef3d6f700 1 Processor -- start 2023-08-10T11:51:35.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.239+0000 7f9ef3d6f700 1 -- start start 2023-08-10T11:51:35.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.240+0000 7f9ef3d6f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9eec0ffdb0 0x7f9eec19c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:35.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.240+0000 7f9ef3d6f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9eec100770 0x7f9eec19cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:35.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.240+0000 7f9ef3d6f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9eec105680 0x7f9eec1966e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:35.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.240+0000 7f9ef3d6f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec196d90 con 0x7f9eec0ffdb0 2023-08-10T11:51:35.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.240+0000 7f9ef3d6f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec196f00 con 0x7f9eec100770 2023-08-10T11:51:35.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.240+0000 7f9ef3d6f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec1970c0 con 0x7f9eec105680 2023-08-10T11:51:35.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.240+0000 7f9ef1b0b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9eec0ffdb0 0x7f9eec19c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:35.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.240+0000 7f9ef1b0b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9eec0ffdb0 0x7f9eec19c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59420/0 (socket says 172.21.15.73:59420) 2023-08-10T11:51:35.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.240+0000 7f9ef1b0b700 1 -- 172.21.15.73:0/2818066437 learned_addr learned my addr 172.21.15.73:0/2818066437 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:35.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.240+0000 7f9ef130a700 1 --2- 172.21.15.73:0/2818066437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9eec100770 0x7f9eec19cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:35.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.240+0000 7f9ef230c700 1 --2- 172.21.15.73:0/2818066437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9eec105680 0x7f9eec1966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:35.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.240+0000 7f9ef1b0b700 1 -- 172.21.15.73:0/2818066437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9eec105680 msgr2=0x7f9eec1966e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:35.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.240+0000 7f9ef1b0b700 1 --2- 172.21.15.73:0/2818066437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9eec105680 0x7f9eec1966e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.240+0000 7f9ef1b0b700 1 -- 172.21.15.73:0/2818066437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9eec100770 msgr2=0x7f9eec19cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:35.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.240+0000 7f9ef1b0b700 1 --2- 172.21.15.73:0/2818066437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9eec100770 0x7f9eec19cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.240+0000 7f9ef1b0b700 1 -- 172.21.15.73:0/2818066437 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee4009d00 con 0x7f9eec0ffdb0 2023-08-10T11:51:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.240+0000 7f9ef1b0b700 1 --2- 172.21.15.73:0/2818066437 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9eec0ffdb0 0x7f9eec19c640 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800d950 tx=0x7f9ee800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.240+0000 7f9ee2ffd700 1 -- 172.21.15.73:0/2818066437 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee800f890 con 0x7f9eec0ffdb0 2023-08-10T11:51:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.241+0000 7f9ef3d6f700 1 -- 172.21.15.73:0/2818066437 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eec1973a0 con 0x7f9eec0ffdb0 2023-08-10T11:51:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.241+0000 7f9ee2ffd700 1 -- 172.21.15.73:0/2818066437 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ee8010460 con 0x7f9eec0ffdb0 2023-08-10T11:51:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.241+0000 7f9ef3d6f700 1 -- 172.21.15.73:0/2818066437 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eec1a3670 con 0x7f9eec0ffdb0 2023-08-10T11:51:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.241+0000 7f9ee2ffd700 1 -- 172.21.15.73:0/2818066437 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee801b650 con 0x7f9eec0ffdb0 2023-08-10T11:51:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.241+0000 7f9ef3d6f700 1 -- 172.21.15.73:0/2818066437 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eec04e470 con 0x7f9eec0ffdb0 2023-08-10T11:51:35.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.243+0000 7f9ee2ffd700 1 -- 172.21.15.73:0/2818066437 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f9ee80108d0 con 0x7f9eec0ffdb0 2023-08-10T11:51:35.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.243+0000 7f9ee2ffd700 1 --2- 172.21.15.73:0/2818066437 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9ed80a11e0 0x7f9ed80a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:35.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.243+0000 7f9ef130a700 1 --2- 172.21.15.73:0/2818066437 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9ed80a11e0 0x7f9ed80a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:35.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.243+0000 7f9ee2ffd700 1 -- 172.21.15.73:0/2818066437 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9ee80cc970 con 0x7f9eec0ffdb0 2023-08-10T11:51:35.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.244+0000 7f9ef130a700 1 --2- 172.21.15.73:0/2818066437 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9ed80a11e0 0x7f9ed80a36a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9eec197ed0 tx=0x7f9edc00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:35.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.250+0000 7f9ee2ffd700 1 -- 172.21.15.73:0/2818066437 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f9ee8096110 con 0x7f9eec0ffdb0 2023-08-10T11:51:35.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.449+0000 7f9ef3d6f700 1 -- 172.21.15.73:0/2818066437 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f9eec1a3930 con 0x7f9eec0ffdb0 2023-08-10T11:51:35.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.449+0000 7f9ee2ffd700 1 -- 172.21.15.73:0/2818066437 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9ee8020090 con 0x7f9eec0ffdb0 2023-08-10T11:51:35.610 INFO:teuthology.orchestra.run.smithi073.stdout:244813135905 2023-08-10T11:51:35.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.452+0000 7f9ef3d6f700 1 -- 172.21.15.73:0/2818066437 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9ed80a11e0 msgr2=0x7f9ed80a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:35.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.452+0000 7f9ef3d6f700 1 --2- 172.21.15.73:0/2818066437 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9ed80a11e0 0x7f9ed80a36a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9eec197ed0 tx=0x7f9edc00a380 comp rx=0 tx=0).stop 2023-08-10T11:51:35.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.452+0000 7f9ef3d6f700 1 -- 172.21.15.73:0/2818066437 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9eec0ffdb0 msgr2=0x7f9eec19c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:35.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.452+0000 7f9ef3d6f700 1 --2- 172.21.15.73:0/2818066437 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9eec0ffdb0 0x7f9eec19c640 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800d950 tx=0x7f9ee800dc60 comp rx=0 tx=0).stop 2023-08-10T11:51:35.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.452+0000 7f9ef3d6f700 1 -- 172.21.15.73:0/2818066437 shutdown_connections 2023-08-10T11:51:35.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.452+0000 7f9ef3d6f700 1 --2- 172.21.15.73:0/2818066437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9eec105680 0x7f9eec1966e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.452+0000 7f9ef3d6f700 1 --2- 172.21.15.73:0/2818066437 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9eec0ffdb0 0x7f9eec19c640 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.452+0000 7f9ef3d6f700 1 --2- 172.21.15.73:0/2818066437 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9ed80a11e0 0x7f9ed80a36a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.452+0000 7f9ef3d6f700 1 --2- 172.21.15.73:0/2818066437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9eec100770 0x7f9eec19cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.452+0000 7f9ef3d6f700 1 -- 172.21.15.73:0/2818066437 >> 172.21.15.73:0/2818066437 conn(0x7f9eec075be0 msgr2=0x7f9eec0feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:35.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.452+0000 7f9ef3d6f700 1 -- 172.21.15.73:0/2818066437 shutdown_connections 2023-08-10T11:51:35.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.452+0000 7f9ef3d6f700 1 -- 172.21.15.73:0/2818066437 wait complete. 2023-08-10T11:51:35.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:35 smithi073 ceph-mon[128869]: pgmap v276: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 8 op/s 2023-08-10T11:51:35.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:35 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2818066437' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-08-10T11:51:35.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:35 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3641479375' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-08-10T11:51:35.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.747+0000 7ff075cfe700 1 -- 172.21.15.73:0/3225211385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff070102c80 msgr2=0x7ff07010d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:35.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.747+0000 7ff075cfe700 1 --2- 172.21.15.73:0/3225211385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff070102c80 0x7ff07010d730 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff06800b0a0 tx=0x7ff06800b3b0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.747+0000 7ff075cfe700 1 -- 172.21.15.73:0/3225211385 shutdown_connections 2023-08-10T11:51:35.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.747+0000 7ff075cfe700 1 --2- 172.21.15.73:0/3225211385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff070102c80 0x7ff07010d730 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.747+0000 7ff075cfe700 1 --2- 172.21.15.73:0/3225211385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff070068ef0 0x7ff0700692d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.747+0000 7ff075cfe700 1 --2- 172.21.15.73:0/3225211385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0701022c0 0x7ff070102740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.747+0000 7ff075cfe700 1 -- 172.21.15.73:0/3225211385 >> 172.21.15.73:0/3225211385 conn(0x7ff070076760 msgr2=0x7ff070076b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:35.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.747+0000 7ff075cfe700 1 -- 172.21.15.73:0/3225211385 shutdown_connections 2023-08-10T11:51:35.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.747+0000 7ff075cfe700 1 -- 172.21.15.73:0/3225211385 wait complete. 2023-08-10T11:51:35.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.747+0000 7ff075cfe700 1 Processor -- start 2023-08-10T11:51:35.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.748+0000 7ff075cfe700 1 -- start start 2023-08-10T11:51:35.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.748+0000 7ff075cfe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff070068ef0 0x7ff07019c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.748+0000 7ff075cfe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0701022c0 0x7ff07019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.748+0000 7ff075cfe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff070102c80 0x7ff070196880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.748+0000 7ff075cfe700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff070197030 con 0x7ff070068ef0 2023-08-10T11:51:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.748+0000 7ff075cfe700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0701971a0 con 0x7ff0701022c0 2023-08-10T11:51:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.748+0000 7ff075cfe700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff070197360 con 0x7ff070102c80 2023-08-10T11:51:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.748+0000 7ff06f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff070068ef0 0x7ff07019c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.748+0000 7ff06f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff070068ef0 0x7ff07019c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59446/0 (socket says 172.21.15.73:59446) 2023-08-10T11:51:35.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.748+0000 7ff06f7fe700 1 -- 172.21.15.73:0/544131261 learned_addr learned my addr 172.21.15.73:0/544131261 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:35.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.748+0000 7ff06effd700 1 --2- 172.21.15.73:0/544131261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0701022c0 0x7ff07019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:35.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.748+0000 7ff06f7fe700 1 -- 172.21.15.73:0/544131261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff070102c80 msgr2=0x7ff070196880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:35.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.748+0000 7ff06f7fe700 1 --2- 172.21.15.73:0/544131261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff070102c80 0x7ff070196880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.748+0000 7ff06f7fe700 1 -- 172.21.15.73:0/544131261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0701022c0 msgr2=0x7ff07019cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:35.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.748+0000 7ff06f7fe700 1 --2- 172.21.15.73:0/544131261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0701022c0 0x7ff07019cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.748+0000 7ff06f7fe700 1 -- 172.21.15.73:0/544131261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff068009d00 con 0x7ff070068ef0 2023-08-10T11:51:35.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.748+0000 7ff06effd700 1 --2- 172.21.15.73:0/544131261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0701022c0 0x7ff07019cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:51:35.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.748+0000 7ff06f7fe700 1 --2- 172.21.15.73:0/544131261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff070068ef0 0x7ff07019c890 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff06400d980 tx=0x7ff06400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:35.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.748+0000 7ff06cff9700 1 -- 172.21.15.73:0/544131261 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06400bb60 con 0x7ff070068ef0 2023-08-10T11:51:35.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.749+0000 7ff075cfe700 1 -- 172.21.15.73:0/544131261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff070197640 con 0x7ff070068ef0 2023-08-10T11:51:35.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.749+0000 7ff06cff9700 1 -- 172.21.15.73:0/544131261 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff064007640 con 0x7ff070068ef0 2023-08-10T11:51:35.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.749+0000 7ff06cff9700 1 -- 172.21.15.73:0/544131261 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff064004e90 con 0x7ff070068ef0 2023-08-10T11:51:35.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.749+0000 7ff075cfe700 1 -- 172.21.15.73:0/544131261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0701a3860 con 0x7ff070068ef0 2023-08-10T11:51:35.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.750+0000 7ff075cfe700 1 -- 172.21.15.73:0/544131261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff07004e470 con 0x7ff070068ef0 2023-08-10T11:51:35.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.752+0000 7ff06cff9700 1 -- 172.21.15.73:0/544131261 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7ff06400bcc0 con 0x7ff070068ef0 2023-08-10T11:51:35.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.752+0000 7ff06cff9700 1 --2- 172.21.15.73:0/544131261 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff0580a11e0 0x7ff0580a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:35.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.752+0000 7ff06cff9700 1 -- 172.21.15.73:0/544131261 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff0640cc7b0 con 0x7ff070068ef0 2023-08-10T11:51:35.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.752+0000 7ff06effd700 1 --2- 172.21.15.73:0/544131261 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff0580a11e0 0x7ff0580a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:35.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.753+0000 7ff06effd700 1 --2- 172.21.15.73:0/544131261 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff0580a11e0 0x7ff0580a36a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff060005e10 tx=0x7ff060005d60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:35.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.756+0000 7ff06cff9700 1 -- 172.21.15.73:0/544131261 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ff0640999e0 con 0x7ff070068ef0 2023-08-10T11:51:35.924 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.952+0000 7ff075cfe700 1 -- 172.21.15.73:0/544131261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7ff0701a3b80 con 0x7ff070068ef0 2023-08-10T11:51:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.953+0000 7ff06cff9700 1 -- 172.21.15.73:0/544131261 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff064016020 con 0x7ff070068ef0 2023-08-10T11:51:35.955 INFO:teuthology.orchestra.run.smithi073.stdout:279172874268 2023-08-10T11:51:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.955+0000 7ff075cfe700 1 -- 172.21.15.73:0/544131261 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff0580a11e0 msgr2=0x7ff0580a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.955+0000 7ff075cfe700 1 --2- 172.21.15.73:0/544131261 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff0580a11e0 0x7ff0580a36a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff060005e10 tx=0x7ff060005d60 comp rx=0 tx=0).stop 2023-08-10T11:51:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.955+0000 7ff075cfe700 1 -- 172.21.15.73:0/544131261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff070068ef0 msgr2=0x7ff07019c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.955+0000 7ff075cfe700 1 --2- 172.21.15.73:0/544131261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff070068ef0 0x7ff07019c890 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff06400d980 tx=0x7ff06400dd40 comp rx=0 tx=0).stop 2023-08-10T11:51:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.955+0000 7ff075cfe700 1 -- 172.21.15.73:0/544131261 shutdown_connections 2023-08-10T11:51:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.955+0000 7ff075cfe700 1 --2- 172.21.15.73:0/544131261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff070102c80 0x7ff070196880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.955+0000 7ff075cfe700 1 --2- 172.21.15.73:0/544131261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff070068ef0 0x7ff07019c890 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.955+0000 7ff075cfe700 1 --2- 172.21.15.73:0/544131261 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff0580a11e0 0x7ff0580a36a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.955+0000 7ff075cfe700 1 --2- 172.21.15.73:0/544131261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0701022c0 0x7ff07019cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.955+0000 7ff075cfe700 1 -- 172.21.15.73:0/544131261 >> 172.21.15.73:0/544131261 conn(0x7ff070076760 msgr2=0x7ff0700fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.956+0000 7ff075cfe700 1 -- 172.21.15.73:0/544131261 shutdown_connections 2023-08-10T11:51:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:35.956+0000 7ff075cfe700 1 -- 172.21.15.73:0/544131261 wait complete. 2023-08-10T11:51:35.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:35 smithi152 ceph-mon[130220]: pgmap v276: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 8 op/s 2023-08-10T11:51:35.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:35 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/2818066437' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-08-10T11:51:35.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:35 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3641479375' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-08-10T11:51:36.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:35 smithi156 ceph-mon[130574]: pgmap v276: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 8 op/s 2023-08-10T11:51:36.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:35 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/2818066437' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-08-10T11:51:36.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:35 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3641479375' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-08-10T11:51:36.261 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789995 got 158913789997 for osd.5 2023-08-10T11:51:36.261 DEBUG:teuthology.parallel:result is None 2023-08-10T11:51:36.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:36 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/544131261' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-08-10T11:51:37.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:36 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/544131261' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-08-10T11:51:37.015 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:36 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/544131261' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-08-10T11:51:37.140 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182451 got 107374182454 for osd.3 2023-08-10T11:51:37.140 DEBUG:teuthology.parallel:result is None 2023-08-10T11:51:37.409 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874266 got 279172874268 for osd.9 2023-08-10T11:51:37.409 DEBUG:teuthology.parallel:result is None 2023-08-10T11:51:37.656 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:37 smithi073 ceph-mon[128869]: pgmap v277: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2023-08-10T11:51:37.657 INFO:tasks.cephadm.ceph_manager.ceph:need seq 244813135902 got 244813135905 for osd.8 2023-08-10T11:51:37.657 DEBUG:teuthology.parallel:result is None 2023-08-10T11:51:37.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.741+0000 7fc71b154700 1 -- 172.21.15.73:0/4197421204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7141051e0 msgr2=0x7fc714105660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:37.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.741+0000 7fc71b154700 1 --2- 172.21.15.73:0/4197421204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7141051e0 0x7fc714105660 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc7000099c0 tx=0x7fc700009cd0 comp rx=0 tx=0).stop 2023-08-10T11:51:37.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.742+0000 7fc71b154700 1 -- 172.21.15.73:0/4197421204 shutdown_connections 2023-08-10T11:51:37.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.742+0000 7fc71b154700 1 --2- 172.21.15.73:0/4197421204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc714105ba0 0x7fc71410d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:37.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.742+0000 7fc71b154700 1 --2- 172.21.15.73:0/4197421204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc714068730 0x7fc714068b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:37.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.742+0000 7fc71b154700 1 --2- 172.21.15.73:0/4197421204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7141051e0 0x7fc714105660 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:37.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.742+0000 7fc71b154700 1 -- 172.21.15.73:0/4197421204 >> 172.21.15.73:0/4197421204 conn(0x7fc714076770 msgr2=0x7fc714076b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:37.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.742+0000 7fc71b154700 1 -- 172.21.15.73:0/4197421204 shutdown_connections 2023-08-10T11:51:37.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.742+0000 7fc71b154700 1 -- 172.21.15.73:0/4197421204 wait complete. 2023-08-10T11:51:37.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.742+0000 7fc71b154700 1 Processor -- start 2023-08-10T11:51:37.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.742+0000 7fc71b154700 1 -- start start 2023-08-10T11:51:37.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.742+0000 7fc71b154700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc714068730 0x7fc71419c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:37.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.742+0000 7fc71b154700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7141051e0 0x7fc71419cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:37.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.742+0000 7fc71b154700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc714105ba0 0x7fc7141966d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:37.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.742+0000 7fc71b154700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc714196d40 con 0x7fc714068730 2023-08-10T11:51:37.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.742+0000 7fc71b154700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc714196eb0 con 0x7fc7141051e0 2023-08-10T11:51:37.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.742+0000 7fc71b154700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc714197070 con 0x7fc714105ba0 2023-08-10T11:51:37.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.743+0000 7fc718ef0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc714068730 0x7fc71419c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:37.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.743+0000 7fc718ef0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc714068730 0x7fc71419c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59460/0 (socket says 172.21.15.73:59460) 2023-08-10T11:51:37.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.743+0000 7fc718ef0700 1 -- 172.21.15.73:0/363827606 learned_addr learned my addr 172.21.15.73:0/363827606 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:37.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.743+0000 7fc713fff700 1 --2- 172.21.15.73:0/363827606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7141051e0 0x7fc71419cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:37.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.743+0000 7fc7196f1700 1 --2- 172.21.15.73:0/363827606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc714105ba0 0x7fc7141966d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:37.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.743+0000 7fc718ef0700 1 -- 172.21.15.73:0/363827606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc714105ba0 msgr2=0x7fc7141966d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:37.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.743+0000 7fc718ef0700 1 --2- 172.21.15.73:0/363827606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc714105ba0 0x7fc7141966d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:37.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.743+0000 7fc718ef0700 1 -- 172.21.15.73:0/363827606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7141051e0 msgr2=0x7fc71419cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:37.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.743+0000 7fc718ef0700 1 --2- 172.21.15.73:0/363827606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7141051e0 0x7fc71419cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:37.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.743+0000 7fc718ef0700 1 -- 172.21.15.73:0/363827606 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7000095f0 con 0x7fc714068730 2023-08-10T11:51:37.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.743+0000 7fc718ef0700 1 --2- 172.21.15.73:0/363827606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc714068730 0x7fc71419c650 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc70800d980 tx=0x7fc70800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:37.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.743+0000 7fc711ffb700 1 -- 172.21.15.73:0/363827606 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708004220 con 0x7fc714068730 2023-08-10T11:51:37.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.743+0000 7fc711ffb700 1 -- 172.21.15.73:0/363827606 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc708007640 con 0x7fc714068730 2023-08-10T11:51:37.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.743+0000 7fc71b154700 1 -- 172.21.15.73:0/363827606 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc714197350 con 0x7fc714068730 2023-08-10T11:51:37.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.743+0000 7fc711ffb700 1 -- 172.21.15.73:0/363827606 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708005690 con 0x7fc714068730 2023-08-10T11:51:37.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.744+0000 7fc71b154700 1 -- 172.21.15.73:0/363827606 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7141a3640 con 0x7fc714068730 2023-08-10T11:51:37.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.745+0000 7fc71b154700 1 -- 172.21.15.73:0/363827606 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc71404e470 con 0x7fc714068730 2023-08-10T11:51:37.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.746+0000 7fc711ffb700 1 -- 172.21.15.73:0/363827606 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fc708004750 con 0x7fc714068730 2023-08-10T11:51:37.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.746+0000 7fc711ffb700 1 --2- 172.21.15.73:0/363827606 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc7040a1260 0x7fc7040a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:37.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.746+0000 7fc713fff700 1 --2- 172.21.15.73:0/363827606 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc7040a1260 0x7fc7040a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:37.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.747+0000 7fc711ffb700 1 -- 172.21.15.73:0/363827606 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc7080cc640 con 0x7fc714068730 2023-08-10T11:51:37.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.747+0000 7fc713fff700 1 --2- 172.21.15.73:0/363827606 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc7040a1260 0x7fc7040a3720 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc700000c00 tx=0x7fc7000050e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:37.751 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:37.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.750+0000 7fc711ffb700 1 -- 172.21.15.73:0/363827606 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fc708095de0 con 0x7fc714068730 2023-08-10T11:51:37.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.863+0000 7f41c711e700 1 -- 172.21.15.73:0/3036937150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41c0102260 msgr2=0x7f41c010a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:37.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.863+0000 7f41c711e700 1 --2- 172.21.15.73:0/3036937150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41c0102260 0x7f41c010a750 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f41ac009990 tx=0x7f41ac009ca0 comp rx=0 tx=0).stop 2023-08-10T11:51:37.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.863+0000 7f41c711e700 1 -- 172.21.15.73:0/3036937150 shutdown_connections 2023-08-10T11:51:37.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.863+0000 7f41c711e700 1 --2- 172.21.15.73:0/3036937150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41c0101940 0x7f41c0101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:37.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.863+0000 7f41c711e700 1 --2- 172.21.15.73:0/3036937150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41c010ad70 0x7f41c010d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:37.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.863+0000 7f41c711e700 1 --2- 172.21.15.73:0/3036937150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41c0102260 0x7f41c010a750 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:37.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.863+0000 7f41c711e700 1 -- 172.21.15.73:0/3036937150 >> 172.21.15.73:0/3036937150 conn(0x7f41c00fb130 msgr2=0x7f41c00fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:37.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.863+0000 7f41c711e700 1 -- 172.21.15.73:0/3036937150 shutdown_connections 2023-08-10T11:51:37.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.863+0000 7f41c711e700 1 -- 172.21.15.73:0/3036937150 wait complete. 2023-08-10T11:51:37.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.864+0000 7f41c711e700 1 Processor -- start 2023-08-10T11:51:37.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.864+0000 7f41c711e700 1 -- start start 2023-08-10T11:51:37.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.864+0000 7f41c711e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41c0101940 0x7f41c00ff5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:37.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.864+0000 7f41c711e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41c0102260 0x7f41c00ffae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:37.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.864+0000 7f41c711e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41c010ad70 0x7f41c0100020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:37.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.864+0000 7f41c711e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c01a92b0 con 0x7f41c0102260 2023-08-10T11:51:37.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.864+0000 7f41c711e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c01a93f0 con 0x7f41c010ad70 2023-08-10T11:51:37.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.864+0000 7f41c711e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c01a9530 con 0x7f41c0101940 2023-08-10T11:51:37.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.864+0000 7f41bffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41c0102260 0x7f41c00ffae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:37.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.864+0000 7f41bffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41c0102260 0x7f41c00ffae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59474/0 (socket says 172.21.15.73:59474) 2023-08-10T11:51:37.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.864+0000 7f41bffff700 1 -- 172.21.15.73:0/1336015722 learned_addr learned my addr 172.21.15.73:0/1336015722 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:37.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.865+0000 7f41c4eba700 1 --2- 172.21.15.73:0/1336015722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41c0101940 0x7f41c00ff5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:37.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.865+0000 7f41c56bb700 1 --2- 172.21.15.73:0/1336015722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41c010ad70 0x7f41c0100020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:37.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.865+0000 7f41bffff700 1 -- 172.21.15.73:0/1336015722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41c0101940 msgr2=0x7f41c00ff5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:37.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.865+0000 7f41bffff700 1 --2- 172.21.15.73:0/1336015722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41c0101940 0x7f41c00ff5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:37.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.865+0000 7f41bffff700 1 -- 172.21.15.73:0/1336015722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41c010ad70 msgr2=0x7f41c0100020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:37.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.865+0000 7f41bffff700 1 --2- 172.21.15.73:0/1336015722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41c010ad70 0x7f41c0100020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:37.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.865+0000 7f41bffff700 1 -- 172.21.15.73:0/1336015722 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ac0095f0 con 0x7f41c0102260 2023-08-10T11:51:37.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.865+0000 7f41c4eba700 1 --2- 172.21.15.73:0/1336015722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41c0101940 0x7f41c00ff5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:51:37.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.865+0000 7f41bffff700 1 --2- 172.21.15.73:0/1336015722 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41c0102260 0x7f41c00ffae0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f41ac004770 tx=0x7f41ac009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:37.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.865+0000 7f41bdffb700 1 -- 172.21.15.73:0/1336015722 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac01d070 con 0x7f41c0102260 2023-08-10T11:51:37.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.865+0000 7f41bdffb700 1 -- 172.21.15.73:0/1336015722 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f41ac0054f0 con 0x7f41c0102260 2023-08-10T11:51:37.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.865+0000 7f41bdffb700 1 -- 172.21.15.73:0/1336015722 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac004c70 con 0x7f41c0102260 2023-08-10T11:51:37.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.865+0000 7f41c711e700 1 -- 172.21.15.73:0/1336015722 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c01a97b0 con 0x7f41c0102260 2023-08-10T11:51:37.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.866+0000 7f41c711e700 1 -- 172.21.15.73:0/1336015722 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c01a9bf0 con 0x7f41c0102260 2023-08-10T11:51:37.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.868+0000 7f41c711e700 1 -- 172.21.15.73:0/1336015722 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c004e470 con 0x7f41c0102260 2023-08-10T11:51:37.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.868+0000 7f41bdffb700 1 -- 172.21.15.73:0/1336015722 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f41ac00fbc0 con 0x7f41c0102260 2023-08-10T11:51:37.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.868+0000 7f41bdffb700 1 --2- 172.21.15.73:0/1336015722 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f41b00a1260 0x7f41b00a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:37.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.869+0000 7f41bdffb700 1 -- 172.21.15.73:0/1336015722 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f41ac0cdaa0 con 0x7f41c0102260 2023-08-10T11:51:37.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.869+0000 7f41c4eba700 1 --2- 172.21.15.73:0/1336015722 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f41b00a1260 0x7f41b00a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:37.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.869+0000 7f41c4eba700 1 --2- 172.21.15.73:0/1336015722 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f41b00a1260 0x7f41b00a3720 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f41b4005950 tx=0x7f41b40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:37.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.874+0000 7f41bdffb700 1 -- 172.21.15.73:0/1336015722 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f41ac05a790 con 0x7f41c0102260 2023-08-10T11:51:37.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.963+0000 7fc71b154700 1 -- 172.21.15.73:0/363827606 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc7141a3830 con 0x7fc714068730 2023-08-10T11:51:37.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.964+0000 7fc711ffb700 1 -- 172.21.15.73:0/363827606 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc708016090 con 0x7fc714068730 2023-08-10T11:51:37.966 INFO:teuthology.orchestra.run.smithi073.stdout:193273528362 2023-08-10T11:51:37.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.966+0000 7fc71b154700 1 -- 172.21.15.73:0/363827606 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc7040a1260 msgr2=0x7fc7040a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:37.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.966+0000 7fc71b154700 1 --2- 172.21.15.73:0/363827606 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc7040a1260 0x7fc7040a3720 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc700000c00 tx=0x7fc7000050e0 comp rx=0 tx=0).stop 2023-08-10T11:51:37.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.966+0000 7fc71b154700 1 -- 172.21.15.73:0/363827606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc714068730 msgr2=0x7fc71419c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:37.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.966+0000 7fc71b154700 1 --2- 172.21.15.73:0/363827606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc714068730 0x7fc71419c650 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc70800d980 tx=0x7fc70800dc90 comp rx=0 tx=0).stop 2023-08-10T11:51:37.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.966+0000 7fc71b154700 1 -- 172.21.15.73:0/363827606 shutdown_connections 2023-08-10T11:51:37.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.966+0000 7fc71b154700 1 --2- 172.21.15.73:0/363827606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc714105ba0 0x7fc7141966d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:37.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.966+0000 7fc71b154700 1 --2- 172.21.15.73:0/363827606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc714068730 0x7fc71419c650 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:37.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.966+0000 7fc71b154700 1 --2- 172.21.15.73:0/363827606 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc7040a1260 0x7fc7040a3720 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:37.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.966+0000 7fc71b154700 1 --2- 172.21.15.73:0/363827606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7141051e0 0x7fc71419cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:37.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.966+0000 7fc71b154700 1 -- 172.21.15.73:0/363827606 >> 172.21.15.73:0/363827606 conn(0x7fc714076770 msgr2=0x7fc7140fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:37.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.966+0000 7fc71b154700 1 -- 172.21.15.73:0/363827606 shutdown_connections 2023-08-10T11:51:37.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:37.966+0000 7fc71b154700 1 -- 172.21.15.73:0/363827606 wait complete. 2023-08-10T11:51:37.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:37 smithi152 ceph-mon[130220]: pgmap v277: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2023-08-10T11:51:38.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:37 smithi156 ceph-mon[130574]: pgmap v277: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2023-08-10T11:51:38.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.080+0000 7f41c711e700 1 -- 172.21.15.73:0/1336015722 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f41c01a9ed0 con 0x7f41c0102260 2023-08-10T11:51:38.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.081+0000 7f41bdffb700 1 -- 172.21.15.73:0/1336015722 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f41ac0972d0 con 0x7f41c0102260 2023-08-10T11:51:38.083 INFO:teuthology.orchestra.run.smithi073.stdout:55834574909 2023-08-10T11:51:38.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.085+0000 7f41c711e700 1 -- 172.21.15.73:0/1336015722 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f41b00a1260 msgr2=0x7f41b00a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:38.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.085+0000 7f41c711e700 1 --2- 172.21.15.73:0/1336015722 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f41b00a1260 0x7f41b00a3720 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f41b4005950 tx=0x7f41b40058e0 comp rx=0 tx=0).stop 2023-08-10T11:51:38.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.085+0000 7f41c711e700 1 -- 172.21.15.73:0/1336015722 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41c0102260 msgr2=0x7f41c00ffae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:38.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.085+0000 7f41c711e700 1 --2- 172.21.15.73:0/1336015722 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41c0102260 0x7f41c00ffae0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f41ac004770 tx=0x7f41ac009580 comp rx=0 tx=0).stop 2023-08-10T11:51:38.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.085+0000 7f41c711e700 1 -- 172.21.15.73:0/1336015722 shutdown_connections 2023-08-10T11:51:38.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.085+0000 7f41c711e700 1 --2- 172.21.15.73:0/1336015722 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f41b00a1260 0x7f41b00a3720 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:38.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.085+0000 7f41c711e700 1 --2- 172.21.15.73:0/1336015722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41c010ad70 0x7f41c0100020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:38.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.085+0000 7f41c711e700 1 --2- 172.21.15.73:0/1336015722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41c0101940 0x7f41c00ff5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:38.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.085+0000 7f41c711e700 1 --2- 172.21.15.73:0/1336015722 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41c0102260 0x7f41c00ffae0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:38.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.085+0000 7f41c711e700 1 -- 172.21.15.73:0/1336015722 >> 172.21.15.73:0/1336015722 conn(0x7f41c00fb130 msgr2=0x7f41c010cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:38.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.085+0000 7f41c711e700 1 -- 172.21.15.73:0/1336015722 shutdown_connections 2023-08-10T11:51:38.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.085+0000 7f41c711e700 1 -- 172.21.15.73:0/1336015722 wait complete. 2023-08-10T11:51:38.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.144+0000 7fe13c35d700 1 -- 172.21.15.73:0/97144786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe134106780 msgr2=0x7fe134106b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:38.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.144+0000 7fe13c35d700 1 --2- 172.21.15.73:0/97144786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe134106780 0x7fe134106b60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe130009990 tx=0x7fe130009ca0 comp rx=0 tx=0).stop 2023-08-10T11:51:38.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.144+0000 7fe13c35d700 1 -- 172.21.15.73:0/97144786 shutdown_connections 2023-08-10T11:51:38.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.144+0000 7fe13c35d700 1 --2- 172.21.15.73:0/97144786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe134101140 0x7fe13410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:38.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.144+0000 7fe13c35d700 1 --2- 172.21.15.73:0/97144786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe134106780 0x7fe134106b60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:38.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.144+0000 7fe13c35d700 1 --2- 172.21.15.73:0/97144786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe134100780 0x7fe134100c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:38.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.144+0000 7fe13c35d700 1 -- 172.21.15.73:0/97144786 >> 172.21.15.73:0/97144786 conn(0x7fe1340fc270 msgr2=0x7fe1340fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:38.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.144+0000 7fe13c35d700 1 -- 172.21.15.73:0/97144786 shutdown_connections 2023-08-10T11:51:38.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.144+0000 7fe13c35d700 1 -- 172.21.15.73:0/97144786 wait complete. 2023-08-10T11:51:38.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.144+0000 7fe13c35d700 1 Processor -- start 2023-08-10T11:51:38.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.144+0000 7fe13c35d700 1 -- start start 2023-08-10T11:51:38.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.145+0000 7fe13c35d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe134100780 0x7fe13419c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:38.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.145+0000 7fe13c35d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe134101140 0x7fe13419cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:38.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.145+0000 7fe13c35d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe134106780 0x7fe1341966f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:38.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.145+0000 7fe13c35d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe134196d60 con 0x7fe134100780 2023-08-10T11:51:38.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.145+0000 7fe13c35d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe134196ed0 con 0x7fe134106780 2023-08-10T11:51:38.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.145+0000 7fe13c35d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe134197090 con 0x7fe134101140 2023-08-10T11:51:38.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.145+0000 7fe13a0f9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe134100780 0x7fe13419c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:38.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.145+0000 7fe13a0f9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe134100780 0x7fe13419c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59484/0 (socket says 172.21.15.73:59484) 2023-08-10T11:51:38.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.145+0000 7fe13a0f9700 1 -- 172.21.15.73:0/1222975267 learned_addr learned my addr 172.21.15.73:0/1222975267 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:38.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.145+0000 7fe13a8fa700 1 --2- 172.21.15.73:0/1222975267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe134106780 0x7fe1341966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:38.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.145+0000 7fe1398f8700 1 --2- 172.21.15.73:0/1222975267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe134101140 0x7fe13419cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:38.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.145+0000 7fe13a0f9700 1 -- 172.21.15.73:0/1222975267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe134101140 msgr2=0x7fe13419cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:38.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.145+0000 7fe13a0f9700 1 --2- 172.21.15.73:0/1222975267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe134101140 0x7fe13419cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:38.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.145+0000 7fe13a0f9700 1 -- 172.21.15.73:0/1222975267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe134106780 msgr2=0x7fe1341966f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:38.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.145+0000 7fe13a0f9700 1 --2- 172.21.15.73:0/1222975267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe134106780 0x7fe1341966f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:38.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.145+0000 7fe13a0f9700 1 -- 172.21.15.73:0/1222975267 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1300095f0 con 0x7fe134100780 2023-08-10T11:51:38.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.145+0000 7fe13a8fa700 1 --2- 172.21.15.73:0/1222975267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe134106780 0x7fe1341966f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:51:38.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.145+0000 7fe1398f8700 1 --2- 172.21.15.73:0/1222975267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe134101140 0x7fe13419cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:51:38.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.145+0000 7fe13a0f9700 1 --2- 172.21.15.73:0/1222975267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe134100780 0x7fe13419c670 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe130005910 tx=0x7fe13000b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:38.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.145+0000 7fe12b7fe700 1 -- 172.21.15.73:0/1222975267 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13001d070 con 0x7fe134100780 2023-08-10T11:51:38.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.145+0000 7fe12b7fe700 1 -- 172.21.15.73:0/1222975267 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe13000fb80 con 0x7fe134100780 2023-08-10T11:51:38.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.145+0000 7fe13c35d700 1 -- 172.21.15.73:0/1222975267 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe134197310 con 0x7fe134100780 2023-08-10T11:51:38.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.145+0000 7fe12b7fe700 1 -- 172.21.15.73:0/1222975267 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe130017650 con 0x7fe134100780 2023-08-10T11:51:38.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.145+0000 7fe13c35d700 1 -- 172.21.15.73:0/1222975267 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1341a3660 con 0x7fe134100780 2023-08-10T11:51:38.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.146+0000 7fe13c35d700 1 -- 172.21.15.73:0/1222975267 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe13404e470 con 0x7fe134100780 2023-08-10T11:51:38.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.147+0000 7fe12b7fe700 1 -- 172.21.15.73:0/1222975267 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fe130022470 con 0x7fe134100780 2023-08-10T11:51:38.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.148+0000 7fe12b7fe700 1 --2- 172.21.15.73:0/1222975267 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fe1200a11e0 0x7fe1200a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:38.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.148+0000 7fe1398f8700 1 --2- 172.21.15.73:0/1222975267 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fe1200a11e0 0x7fe1200a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:38.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.148+0000 7fe12b7fe700 1 -- 172.21.15.73:0/1222975267 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe1300cdfd0 con 0x7fe134100780 2023-08-10T11:51:38.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.148+0000 7fe1398f8700 1 --2- 172.21.15.73:0/1222975267 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fe1200a11e0 0x7fe1200a36a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe134197b60 tx=0x7fe124005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:38.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.152+0000 7fe12b7fe700 1 -- 172.21.15.73:0/1222975267 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fe130097800 con 0x7fe134100780 2023-08-10T11:51:38.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.364+0000 7fe13c35d700 1 -- 172.21.15.73:0/1222975267 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7fe134197c00 con 0x7fe134100780 2023-08-10T11:51:38.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.365+0000 7fe12b7fe700 1 -- 172.21.15.73:0/1222975267 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7fe13009ae20 con 0x7fe134100780 2023-08-10T11:51:38.367 INFO:teuthology.orchestra.run.smithi073.stdout:335007449108 2023-08-10T11:51:38.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.367+0000 7fe13c35d700 1 -- 172.21.15.73:0/1222975267 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fe1200a11e0 msgr2=0x7fe1200a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:38.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.367+0000 7fe13c35d700 1 --2- 172.21.15.73:0/1222975267 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fe1200a11e0 0x7fe1200a36a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe134197b60 tx=0x7fe124005f50 comp rx=0 tx=0).stop 2023-08-10T11:51:38.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.367+0000 7fe13c35d700 1 -- 172.21.15.73:0/1222975267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe134100780 msgr2=0x7fe13419c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:38.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.367+0000 7fe13c35d700 1 --2- 172.21.15.73:0/1222975267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe134100780 0x7fe13419c670 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe130005910 tx=0x7fe13000b610 comp rx=0 tx=0).stop 2023-08-10T11:51:38.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.367+0000 7fe13c35d700 1 -- 172.21.15.73:0/1222975267 shutdown_connections 2023-08-10T11:51:38.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.367+0000 7fe13c35d700 1 --2- 172.21.15.73:0/1222975267 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fe1200a11e0 0x7fe1200a36a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:38.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.367+0000 7fe13c35d700 1 --2- 172.21.15.73:0/1222975267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe134106780 0x7fe1341966f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:38.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.367+0000 7fe13c35d700 1 --2- 172.21.15.73:0/1222975267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe134100780 0x7fe13419c670 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:38.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.367+0000 7fe13c35d700 1 --2- 172.21.15.73:0/1222975267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe134101140 0x7fe13419cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:38.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.367+0000 7fe13c35d700 1 -- 172.21.15.73:0/1222975267 >> 172.21.15.73:0/1222975267 conn(0x7fe1340fc270 msgr2=0x7fe1340fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:38.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.367+0000 7fe13c35d700 1 -- 172.21.15.73:0/1222975267 shutdown_connections 2023-08-10T11:51:38.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:38.367+0000 7fe13c35d700 1 -- 172.21.15.73:0/1222975267 wait complete. 2023-08-10T11:51:38.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:38 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/363827606' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-08-10T11:51:38.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:38 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1336015722' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-08-10T11:51:38.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:38 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1222975267' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-08-10T11:51:38.957 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574907 got 55834574909 for osd.1 2023-08-10T11:51:38.957 DEBUG:teuthology.parallel:result is None 2023-08-10T11:51:38.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:38 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/363827606' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-08-10T11:51:38.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:38 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1336015722' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-08-10T11:51:38.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:38 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1222975267' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-08-10T11:51:39.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:38 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/363827606' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-08-10T11:51:39.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:38 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1336015722' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-08-10T11:51:39.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:38 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1222975267' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-08-10T11:51:39.278 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:39.428 INFO:tasks.cephadm.ceph_manager.ceph:need seq 335007449106 got 335007449108 for osd.11 2023-08-10T11:51:39.429 DEBUG:teuthology.parallel:result is None 2023-08-10T11:51:39.741 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:39 smithi073 ceph-mon[128869]: pgmap v278: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2023-08-10T11:51:39.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.772+0000 7f4100882700 1 -- 172.21.15.73:0/1515932858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40fc104580 msgr2=0x7f40fc104960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:39.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.772+0000 7f4100882700 1 --2- 172.21.15.73:0/1515932858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40fc104580 0x7f40fc104960 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009990 tx=0x7f40f0009ca0 comp rx=0 tx=0).stop 2023-08-10T11:51:39.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.772+0000 7f4100882700 1 -- 172.21.15.73:0/1515932858 shutdown_connections 2023-08-10T11:51:39.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.772+0000 7f4100882700 1 --2- 172.21.15.73:0/1515932858 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f40fc100070 0x7f40fc10c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:39.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.772+0000 7f4100882700 1 --2- 172.21.15.73:0/1515932858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40fc104580 0x7f40fc104960 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:39.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.772+0000 7f4100882700 1 --2- 172.21.15.73:0/1515932858 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40fc0ff6b0 0x7f40fc0ffb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:39.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.772+0000 7f4100882700 1 -- 172.21.15.73:0/1515932858 >> 172.21.15.73:0/1515932858 conn(0x7f40fc076770 msgr2=0x7f40fc076b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:39.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.772+0000 7f4100882700 1 -- 172.21.15.73:0/1515932858 shutdown_connections 2023-08-10T11:51:39.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.772+0000 7f4100882700 1 -- 172.21.15.73:0/1515932858 wait complete. 2023-08-10T11:51:39.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.773+0000 7f4100882700 1 Processor -- start 2023-08-10T11:51:39.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.773+0000 7f4100882700 1 -- start start 2023-08-10T11:51:39.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.773+0000 7f4100882700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40fc0ff6b0 0x7f40fc1956d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:39.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.773+0000 7f4100882700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f40fc100070 0x7f40fc195c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:39.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.773+0000 7f4100882700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40fc104580 0x7f40fc198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:39.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.773+0000 7f4100882700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc1995d0 con 0x7f40fc104580 2023-08-10T11:51:39.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.773+0000 7f4100882700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc199740 con 0x7f40fc0ff6b0 2023-08-10T11:51:39.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.773+0000 7f4100882700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc199900 con 0x7f40fc100070 2023-08-10T11:51:39.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.773+0000 7f40fad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40fc104580 0x7f40fc198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:39.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.773+0000 7f40fad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40fc104580 0x7f40fc198fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59500/0 (socket says 172.21.15.73:59500) 2023-08-10T11:51:39.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.773+0000 7f40fad9d700 1 -- 172.21.15.73:0/1754710919 learned_addr learned my addr 172.21.15.73:0/1754710919 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:39.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.773+0000 7f40f9d9b700 1 --2- 172.21.15.73:0/1754710919 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f40fc100070 0x7f40fc195c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:39.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.774+0000 7f40fa59c700 1 --2- 172.21.15.73:0/1754710919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40fc0ff6b0 0x7f40fc1956d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:39.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.774+0000 7f40fad9d700 1 -- 172.21.15.73:0/1754710919 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f40fc100070 msgr2=0x7f40fc195c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:39.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.774+0000 7f40fad9d700 1 --2- 172.21.15.73:0/1754710919 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f40fc100070 0x7f40fc195c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:39.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.774+0000 7f40fad9d700 1 -- 172.21.15.73:0/1754710919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40fc0ff6b0 msgr2=0x7f40fc1956d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:39.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.774+0000 7f40fad9d700 1 --2- 172.21.15.73:0/1754710919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40fc0ff6b0 0x7f40fc1956d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:39.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.774+0000 7f40fad9d700 1 -- 172.21.15.73:0/1754710919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f00095f0 con 0x7f40fc104580 2023-08-10T11:51:39.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.774+0000 7f40fa59c700 1 --2- 172.21.15.73:0/1754710919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40fc0ff6b0 0x7f40fc1956d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:39.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.774+0000 7f40fad9d700 1 --2- 172.21.15.73:0/1754710919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40fc104580 0x7f40fc198fd0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f40f4007f10 tx=0x7f40f400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.774+0000 7f40eb7fe700 1 -- 172.21.15.73:0/1754710919 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f4017070 con 0x7f40fc104580 2023-08-10T11:51:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.774+0000 7f4100882700 1 -- 172.21.15.73:0/1754710919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40fc199be0 con 0x7f40fc104580 2023-08-10T11:51:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.774+0000 7f40eb7fe700 1 -- 172.21.15.73:0/1754710919 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f40f400f040 con 0x7f40fc104580 2023-08-10T11:51:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.774+0000 7f40eb7fe700 1 -- 172.21.15.73:0/1754710919 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f4005740 con 0x7f40fc104580 2023-08-10T11:51:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.774+0000 7f4100882700 1 -- 172.21.15.73:0/1754710919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40fc068400 con 0x7f40fc104580 2023-08-10T11:51:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.775+0000 7f4100882700 1 -- 172.21.15.73:0/1754710919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40fc04e470 con 0x7f40fc104580 2023-08-10T11:51:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.776+0000 7f40eb7fe700 1 -- 172.21.15.73:0/1754710919 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f40f400dc60 con 0x7f40fc104580 2023-08-10T11:51:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.776+0000 7f40eb7fe700 1 --2- 172.21.15.73:0/1754710919 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f40e40a11e0 0x7f40e40a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.777+0000 7f40fa59c700 1 --2- 172.21.15.73:0/1754710919 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f40e40a11e0 0x7f40e40a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:39.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.777+0000 7f40eb7fe700 1 -- 172.21.15.73:0/1754710919 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f40f40cbfb0 con 0x7f40fc104580 2023-08-10T11:51:39.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.777+0000 7f40fa59c700 1 --2- 172.21.15.73:0/1754710919 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f40e40a11e0 0x7f40e40a36a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f40f000b5c0 tx=0x7f40f0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:39.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.780+0000 7f40eb7fe700 1 -- 172.21.15.73:0/1754710919 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f40f4095750 con 0x7f40fc104580 2023-08-10T11:51:39.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.976+0000 7f4100882700 1 -- 172.21.15.73:0/1754710919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f40fc0686e0 con 0x7f40fc104580 2023-08-10T11:51:39.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.977+0000 7f40eb7fe700 1 -- 172.21.15.73:0/1754710919 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f40f4098d70 con 0x7f40fc104580 2023-08-10T11:51:39.979 INFO:teuthology.orchestra.run.smithi073.stdout:137438953523 2023-08-10T11:51:39.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.978+0000 7f4100882700 1 -- 172.21.15.73:0/1754710919 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f40e40a11e0 msgr2=0x7f40e40a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:39.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.978+0000 7f4100882700 1 --2- 172.21.15.73:0/1754710919 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f40e40a11e0 0x7f40e40a36a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f40f000b5c0 tx=0x7f40f0005fb0 comp rx=0 tx=0).stop 2023-08-10T11:51:39.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.979+0000 7f4100882700 1 -- 172.21.15.73:0/1754710919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40fc104580 msgr2=0x7f40fc198fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:39.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.979+0000 7f4100882700 1 --2- 172.21.15.73:0/1754710919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40fc104580 0x7f40fc198fd0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f40f4007f10 tx=0x7f40f400d3b0 comp rx=0 tx=0).stop 2023-08-10T11:51:39.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.979+0000 7f4100882700 1 -- 172.21.15.73:0/1754710919 shutdown_connections 2023-08-10T11:51:39.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.979+0000 7f4100882700 1 --2- 172.21.15.73:0/1754710919 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f40e40a11e0 0x7f40e40a36a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:39.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.979+0000 7f4100882700 1 --2- 172.21.15.73:0/1754710919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40fc0ff6b0 0x7f40fc1956d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:39.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.979+0000 7f4100882700 1 --2- 172.21.15.73:0/1754710919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40fc104580 0x7f40fc198fd0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:39.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.979+0000 7f4100882700 1 --2- 172.21.15.73:0/1754710919 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f40fc100070 0x7f40fc195c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:39.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.979+0000 7f4100882700 1 -- 172.21.15.73:0/1754710919 >> 172.21.15.73:0/1754710919 conn(0x7f40fc076770 msgr2=0x7f40fc0fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:39.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.979+0000 7f4100882700 1 -- 172.21.15.73:0/1754710919 shutdown_connections 2023-08-10T11:51:39.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:39.979+0000 7f4100882700 1 -- 172.21.15.73:0/1754710919 wait complete. 2023-08-10T11:51:39.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:39 smithi152 ceph-mon[130220]: pgmap v278: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2023-08-10T11:51:40.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:39 smithi156 ceph-mon[130574]: pgmap v278: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2023-08-10T11:51:40.960 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:40 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1754710919' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-08-10T11:51:40.981 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528360 got 193273528362 for osd.6 2023-08-10T11:51:40.981 DEBUG:teuthology.parallel:result is None 2023-08-10T11:51:40.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:40 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1754710919' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-08-10T11:51:41.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:40 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1754710919' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-08-10T11:51:41.301 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953521 got 137438953523 for osd.4 2023-08-10T11:51:41.302 DEBUG:teuthology.parallel:result is None 2023-08-10T11:51:41.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.429+0000 7f9f040cf700 1 -- 172.21.15.73:0/4099577770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9efc1007c0 msgr2=0x7f9efc100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:41.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.429+0000 7f9f040cf700 1 --2- 172.21.15.73:0/4099577770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9efc1007c0 0x7f9efc100c40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0009990 tx=0x7f9ef0009ca0 comp rx=0 tx=0).stop 2023-08-10T11:51:41.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.429+0000 7f9f040cf700 1 -- 172.21.15.73:0/4099577770 shutdown_connections 2023-08-10T11:51:41.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.429+0000 7f9f040cf700 1 --2- 172.21.15.73:0/4099577770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9efc1067c0 0x7f9efc106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:41.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.429+0000 7f9f040cf700 1 --2- 172.21.15.73:0/4099577770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9efc101180 0x7f9efc10d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:41.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.429+0000 7f9f040cf700 1 --2- 172.21.15.73:0/4099577770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9efc1007c0 0x7f9efc100c40 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:41.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.430+0000 7f9f040cf700 1 -- 172.21.15.73:0/4099577770 >> 172.21.15.73:0/4099577770 conn(0x7f9efc0fc2d0 msgr2=0x7f9efc0fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:41.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.430+0000 7f9f040cf700 1 -- 172.21.15.73:0/4099577770 shutdown_connections 2023-08-10T11:51:41.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.430+0000 7f9f040cf700 1 -- 172.21.15.73:0/4099577770 wait complete. 2023-08-10T11:51:41.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.430+0000 7f9f040cf700 1 Processor -- start 2023-08-10T11:51:41.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.430+0000 7f9f040cf700 1 -- start start 2023-08-10T11:51:41.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.430+0000 7f9f040cf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9efc1007c0 0x7f9efc19c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:41.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.430+0000 7f9f040cf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9efc101180 0x7f9efc19cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:41.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.430+0000 7f9f040cf700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9efc1067c0 0x7f9efc1966c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:41.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.430+0000 7f9f040cf700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc196d30 con 0x7f9efc101180 2023-08-10T11:51:41.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.430+0000 7f9f040cf700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc196ea0 con 0x7f9efc1067c0 2023-08-10T11:51:41.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.430+0000 7f9f040cf700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc197060 con 0x7f9efc1007c0 2023-08-10T11:51:41.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.430+0000 7f9f0166a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9efc101180 0x7f9efc19cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:41.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.431+0000 7f9f0166a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9efc101180 0x7f9efc19cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59512/0 (socket says 172.21.15.73:59512) 2023-08-10T11:51:41.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.431+0000 7f9f0166a700 1 -- 172.21.15.73:0/1020502629 learned_addr learned my addr 172.21.15.73:0/1020502629 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:41.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.431+0000 7f9f01e6b700 1 --2- 172.21.15.73:0/1020502629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9efc1007c0 0x7f9efc19c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:41.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.431+0000 7f9f0166a700 1 -- 172.21.15.73:0/1020502629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9efc1007c0 msgr2=0x7f9efc19c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:41.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.431+0000 7f9f0166a700 1 --2- 172.21.15.73:0/1020502629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9efc1007c0 0x7f9efc19c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:41.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.431+0000 7f9f0166a700 1 -- 172.21.15.73:0/1020502629 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9efc1067c0 msgr2=0x7f9efc1966c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:41.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.431+0000 7f9f0166a700 1 --2- 172.21.15.73:0/1020502629 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9efc1067c0 0x7f9efc1966c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:41.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.431+0000 7f9f0166a700 1 -- 172.21.15.73:0/1020502629 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef00095f0 con 0x7f9efc101180 2023-08-10T11:51:41.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.431+0000 7f9f0166a700 1 --2- 172.21.15.73:0/1020502629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9efc101180 0x7f9efc19cb80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0005910 tx=0x7f9ef000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:41.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.431+0000 7f9efaffd700 1 -- 172.21.15.73:0/1020502629 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef001d070 con 0x7f9efc101180 2023-08-10T11:51:41.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.431+0000 7f9f040cf700 1 -- 172.21.15.73:0/1020502629 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9efc1972e0 con 0x7f9efc101180 2023-08-10T11:51:41.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.431+0000 7f9efaffd700 1 -- 172.21.15.73:0/1020502629 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ef000fbb0 con 0x7f9efc101180 2023-08-10T11:51:41.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.431+0000 7f9efaffd700 1 -- 172.21.15.73:0/1020502629 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0017650 con 0x7f9efc101180 2023-08-10T11:51:41.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.431+0000 7f9f040cf700 1 -- 172.21.15.73:0/1020502629 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9efc0729a0 con 0x7f9efc101180 2023-08-10T11:51:41.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.432+0000 7f9f040cf700 1 -- 172.21.15.73:0/1020502629 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9efc04e470 con 0x7f9efc101180 2023-08-10T11:51:41.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.433+0000 7f9efaffd700 1 -- 172.21.15.73:0/1020502629 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f9ef000fd20 con 0x7f9efc101180 2023-08-10T11:51:41.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.434+0000 7f9efaffd700 1 --2- 172.21.15.73:0/1020502629 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9ee40a1260 0x7f9ee40a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:41.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.434+0000 7f9f01e6b700 1 --2- 172.21.15.73:0/1020502629 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9ee40a1260 0x7f9ee40a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:41.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.434+0000 7f9efaffd700 1 -- 172.21.15.73:0/1020502629 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9ef00cdfa0 con 0x7f9efc101180 2023-08-10T11:51:41.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.434+0000 7f9f01e6b700 1 --2- 172.21.15.73:0/1020502629 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9ee40a1260 0x7f9ee40a3720 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9eec007fd0 tx=0x7f9eec00c040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:41.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.438+0000 7f9efaffd700 1 -- 172.21.15.73:0/1020502629 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f9ef00978f0 con 0x7f9efc101180 2023-08-10T11:51:41.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.636+0000 7f9f040cf700 1 -- 172.21.15.73:0/1020502629 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9efc072bc0 con 0x7f9efc101180 2023-08-10T11:51:41.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.636+0000 7f9efaffd700 1 -- 172.21.15.73:0/1020502629 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9ef009af10 con 0x7f9efc101180 2023-08-10T11:51:41.637 INFO:teuthology.orchestra.run.smithi073.stdout:214748364837 2023-08-10T11:51:41.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.638+0000 7f9f040cf700 1 -- 172.21.15.73:0/1020502629 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9ee40a1260 msgr2=0x7f9ee40a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:41.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.638+0000 7f9f040cf700 1 --2- 172.21.15.73:0/1020502629 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9ee40a1260 0x7f9ee40a3720 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9eec007fd0 tx=0x7f9eec00c040 comp rx=0 tx=0).stop 2023-08-10T11:51:41.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.638+0000 7f9f040cf700 1 -- 172.21.15.73:0/1020502629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9efc101180 msgr2=0x7f9efc19cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:41.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.638+0000 7f9f040cf700 1 --2- 172.21.15.73:0/1020502629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9efc101180 0x7f9efc19cb80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0005910 tx=0x7f9ef000f690 comp rx=0 tx=0).stop 2023-08-10T11:51:41.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.638+0000 7f9f040cf700 1 -- 172.21.15.73:0/1020502629 shutdown_connections 2023-08-10T11:51:41.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.638+0000 7f9f040cf700 1 --2- 172.21.15.73:0/1020502629 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9ee40a1260 0x7f9ee40a3720 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:41.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.638+0000 7f9f040cf700 1 --2- 172.21.15.73:0/1020502629 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9efc1067c0 0x7f9efc1966c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:41.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.638+0000 7f9f040cf700 1 --2- 172.21.15.73:0/1020502629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9efc1007c0 0x7f9efc19c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:41.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.638+0000 7f9f040cf700 1 --2- 172.21.15.73:0/1020502629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9efc101180 0x7f9efc19cb80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:41.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.638+0000 7f9f040cf700 1 -- 172.21.15.73:0/1020502629 >> 172.21.15.73:0/1020502629 conn(0x7f9efc0fc2d0 msgr2=0x7f9efc0fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:41.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.639+0000 7f9f040cf700 1 -- 172.21.15.73:0/1020502629 shutdown_connections 2023-08-10T11:51:41.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.639+0000 7f9f040cf700 1 -- 172.21.15.73:0/1020502629 wait complete. 2023-08-10T11:51:41.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.799+0000 7f9c1cd38700 1 -- 172.21.15.73:0/3409084404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c18100040 msgr2=0x7f9c1810c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:41.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.799+0000 7f9c1cd38700 1 --2- 172.21.15.73:0/3409084404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c18100040 0x7f9c1810c4e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000b0a0 tx=0x7f9c1000b3b0 comp rx=0 tx=0).stop 2023-08-10T11:51:41.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.800+0000 7f9c1cd38700 1 -- 172.21.15.73:0/3409084404 shutdown_connections 2023-08-10T11:51:41.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.800+0000 7f9c1cd38700 1 --2- 172.21.15.73:0/3409084404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c18104550 0x7f9c18104930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:41.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.800+0000 7f9c1cd38700 1 --2- 172.21.15.73:0/3409084404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c18100040 0x7f9c1810c4e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:41.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.800+0000 7f9c1cd38700 1 --2- 172.21.15.73:0/3409084404 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c180ff680 0x7f9c180ffb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:41.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.800+0000 7f9c1cd38700 1 -- 172.21.15.73:0/3409084404 >> 172.21.15.73:0/3409084404 conn(0x7f9c180767c0 msgr2=0x7f9c18076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:41.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.801+0000 7f9c1cd38700 1 -- 172.21.15.73:0/3409084404 shutdown_connections 2023-08-10T11:51:41.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.801+0000 7f9c1cd38700 1 -- 172.21.15.73:0/3409084404 wait complete. 2023-08-10T11:51:41.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.802+0000 7f9c1cd38700 1 Processor -- start 2023-08-10T11:51:41.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.802+0000 7f9c1cd38700 1 -- start start 2023-08-10T11:51:41.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.802+0000 7f9c1cd38700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c180ff680 0x7f9c1819e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:41.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.802+0000 7f9c1cd38700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c18100040 0x7f9c1819ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:41.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.802+0000 7f9c1cd38700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c18104550 0x7f9c18198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:41.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.802+0000 7f9c1cd38700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c18198f90 con 0x7f9c180ff680 2023-08-10T11:51:41.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.802+0000 7f9c1cd38700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c18199100 con 0x7f9c18100040 2023-08-10T11:51:41.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.802+0000 7f9c1cd38700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c181992c0 con 0x7f9c18104550 2023-08-10T11:51:41.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.802+0000 7f9c1659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c180ff680 0x7f9c1819e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:41.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.802+0000 7f9c1659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c180ff680 0x7f9c1819e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59524/0 (socket says 172.21.15.73:59524) 2023-08-10T11:51:41.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.802+0000 7f9c1659c700 1 -- 172.21.15.73:0/349662482 learned_addr learned my addr 172.21.15.73:0/349662482 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:41.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.802+0000 7f9c15d9b700 1 --2- 172.21.15.73:0/349662482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c18100040 0x7f9c1819ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:41.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.803+0000 7f9c16d9d700 1 --2- 172.21.15.73:0/349662482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c18104550 0x7f9c18198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:41.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.803+0000 7f9c1659c700 1 -- 172.21.15.73:0/349662482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c18104550 msgr2=0x7f9c18198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:41.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.803+0000 7f9c1659c700 1 --2- 172.21.15.73:0/349662482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c18104550 0x7f9c18198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:41.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.803+0000 7f9c1659c700 1 -- 172.21.15.73:0/349662482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c18100040 msgr2=0x7f9c1819ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:41.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.803+0000 7f9c1659c700 1 --2- 172.21.15.73:0/349662482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c18100040 0x7f9c1819ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:41.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.803+0000 7f9c1659c700 1 -- 172.21.15.73:0/349662482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c10009d00 con 0x7f9c180ff680 2023-08-10T11:51:41.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.803+0000 7f9c16d9d700 1 --2- 172.21.15.73:0/349662482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c18104550 0x7f9c18198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:41.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.803+0000 7f9c1659c700 1 --2- 172.21.15.73:0/349662482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c180ff680 0x7f9c1819e8a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c00d950 tx=0x7f9c0c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:41.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.803+0000 7f9c077fe700 1 -- 172.21.15.73:0/349662482 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c009940 con 0x7f9c180ff680 2023-08-10T11:51:41.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.803+0000 7f9c077fe700 1 -- 172.21.15.73:0/349662482 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c0c010460 con 0x7f9c180ff680 2023-08-10T11:51:41.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.803+0000 7f9c1cd38700 1 -- 172.21.15.73:0/349662482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c181995a0 con 0x7f9c180ff680 2023-08-10T11:51:41.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.803+0000 7f9c077fe700 1 -- 172.21.15.73:0/349662482 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c00f620 con 0x7f9c180ff680 2023-08-10T11:51:41.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.803+0000 7f9c1cd38700 1 -- 172.21.15.73:0/349662482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c181a5890 con 0x7f9c180ff680 2023-08-10T11:51:41.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.804+0000 7f9c1cd38700 1 -- 172.21.15.73:0/349662482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c1804e470 con 0x7f9c180ff680 2023-08-10T11:51:41.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.805+0000 7f9c077fe700 1 -- 172.21.15.73:0/349662482 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f9c0c0108d0 con 0x7f9c180ff680 2023-08-10T11:51:41.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.805+0000 7f9c077fe700 1 --2- 172.21.15.73:0/349662482 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9c000a11c0 0x7f9c000a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:41.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.805+0000 7f9c15d9b700 1 --2- 172.21.15.73:0/349662482 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9c000a11c0 0x7f9c000a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:41.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.805+0000 7f9c077fe700 1 -- 172.21.15.73:0/349662482 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9c0c0cc710 con 0x7f9c180ff680 2023-08-10T11:51:41.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.806+0000 7f9c15d9b700 1 --2- 172.21.15.73:0/349662482 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9c000a11c0 0x7f9c000a3680 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9c18077080 tx=0x7f9c08009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:41.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.810+0000 7f9c077fe700 1 -- 172.21.15.73:0/349662482 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f9c0c095eb0 con 0x7f9c180ff680 2023-08-10T11:51:41.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:41 smithi152 ceph-mon[130220]: pgmap v279: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 10 op/s 2023-08-10T11:51:42.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.999+0000 7f9c1cd38700 1 -- 172.21.15.73:0/349662482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9c181a5c50 con 0x7f9c180ff680 2023-08-10T11:51:42.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:41.999+0000 7f9c077fe700 1 -- 172.21.15.73:0/349662482 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9c0c0994d0 con 0x7f9c180ff680 2023-08-10T11:51:42.000 INFO:teuthology.orchestra.run.smithi073.stdout:77309411388 2023-08-10T11:51:42.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:42.002+0000 7f9c1cd38700 1 -- 172.21.15.73:0/349662482 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9c000a11c0 msgr2=0x7f9c000a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:42.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:42.002+0000 7f9c1cd38700 1 --2- 172.21.15.73:0/349662482 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9c000a11c0 0x7f9c000a3680 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9c18077080 tx=0x7f9c08009260 comp rx=0 tx=0).stop 2023-08-10T11:51:42.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:42.002+0000 7f9c1cd38700 1 -- 172.21.15.73:0/349662482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c180ff680 msgr2=0x7f9c1819e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:42.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:42.002+0000 7f9c1cd38700 1 --2- 172.21.15.73:0/349662482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c180ff680 0x7f9c1819e8a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c00d950 tx=0x7f9c0c00dc60 comp rx=0 tx=0).stop 2023-08-10T11:51:42.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:42.002+0000 7f9c1cd38700 1 -- 172.21.15.73:0/349662482 shutdown_connections 2023-08-10T11:51:42.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:42.002+0000 7f9c1cd38700 1 --2- 172.21.15.73:0/349662482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c18104550 0x7f9c18198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:42.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:42.002+0000 7f9c1cd38700 1 --2- 172.21.15.73:0/349662482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c180ff680 0x7f9c1819e8a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:42.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:42.002+0000 7f9c1cd38700 1 --2- 172.21.15.73:0/349662482 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f9c000a11c0 0x7f9c000a3680 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:42.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:42.002+0000 7f9c1cd38700 1 --2- 172.21.15.73:0/349662482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c18100040 0x7f9c1819ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:42.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:42.002+0000 7f9c1cd38700 1 -- 172.21.15.73:0/349662482 >> 172.21.15.73:0/349662482 conn(0x7f9c180767c0 msgr2=0x7f9c1810b750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:42.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:42.002+0000 7f9c1cd38700 1 -- 172.21.15.73:0/349662482 shutdown_connections 2023-08-10T11:51:42.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:42.002+0000 7f9c1cd38700 1 -- 172.21.15.73:0/349662482 wait complete. 2023-08-10T11:51:42.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:41 smithi156 ceph-mon[130574]: pgmap v279: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 10 op/s 2023-08-10T11:51:42.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:41 smithi073 ceph-mon[128869]: pgmap v279: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 10 op/s 2023-08-10T11:51:42.144 INFO:tasks.cephadm.ceph_manager.ceph:need seq 214748364835 got 214748364837 for osd.7 2023-08-10T11:51:42.144 DEBUG:teuthology.parallel:result is None 2023-08-10T11:51:42.491 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411386 got 77309411388 for osd.2 2023-08-10T11:51:42.491 DEBUG:teuthology.parallel:result is None 2023-08-10T11:51:42.491 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-08-10T11:51:42.492 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph pg dump --format=json 2023-08-10T11:51:42.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:42 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1020502629' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-08-10T11:51:42.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:42 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/349662482' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-08-10T11:51:42.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:42 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1020502629' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-08-10T11:51:42.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:42 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/349662482' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-08-10T11:51:43.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:42 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1020502629' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-08-10T11:51:43.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:42 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/349662482' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-08-10T11:51:43.049 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:43.826 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:43 smithi073 ceph-mon[128869]: pgmap v280: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2023-08-10T11:51:43.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:43 smithi152 ceph-mon[130220]: pgmap v280: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2023-08-10T11:51:44.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:43 smithi156 ceph-mon[130574]: pgmap v280: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2023-08-10T11:51:44.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.276+0000 7fdd01337700 1 -- 172.21.15.73:0/4084302388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcfc1011a0 msgr2=0x7fdcfc101620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:44.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.276+0000 7fdd01337700 1 --2- 172.21.15.73:0/4084302388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcfc1011a0 0x7fdcfc101620 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdcec009990 tx=0x7fdcec009ca0 comp rx=0 tx=0).stop 2023-08-10T11:51:44.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.276+0000 7fdd01337700 1 -- 172.21.15.73:0/4084302388 shutdown_connections 2023-08-10T11:51:44.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.276+0000 7fdd01337700 1 --2- 172.21.15.73:0/4084302388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcfc101b60 0x7fdcfc10c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:44.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.276+0000 7fdd01337700 1 --2- 172.21.15.73:0/4084302388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcfc0ffa60 0x7fdcfc0ffe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:44.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.276+0000 7fdd01337700 1 --2- 172.21.15.73:0/4084302388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcfc1011a0 0x7fdcfc101620 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:44.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.276+0000 7fdd01337700 1 -- 172.21.15.73:0/4084302388 >> 172.21.15.73:0/4084302388 conn(0x7fdcfc076760 msgr2=0x7fdcfc076b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:44.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.276+0000 7fdd01337700 1 -- 172.21.15.73:0/4084302388 shutdown_connections 2023-08-10T11:51:44.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.276+0000 7fdd01337700 1 -- 172.21.15.73:0/4084302388 wait complete. 2023-08-10T11:51:44.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.276+0000 7fdd01337700 1 Processor -- start 2023-08-10T11:51:44.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.277+0000 7fdd01337700 1 -- start start 2023-08-10T11:51:44.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.277+0000 7fdd01337700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcfc0ffa60 0x7fdcfc19c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:44.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.277+0000 7fdd01337700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcfc1011a0 0x7fdcfc19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:44.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.277+0000 7fdd01337700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcfc101b60 0x7fdcfc1967c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:44.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.277+0000 7fdd01337700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc196e30 con 0x7fdcfc0ffa60 2023-08-10T11:51:44.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.277+0000 7fdd01337700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc196fa0 con 0x7fdcfc1011a0 2023-08-10T11:51:44.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.277+0000 7fdd01337700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc197160 con 0x7fdcfc101b60 2023-08-10T11:51:44.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.277+0000 7fdcfaffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcfc0ffa60 0x7fdcfc19c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:44.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.277+0000 7fdcfaffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcfc0ffa60 0x7fdcfc19c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59536/0 (socket says 172.21.15.73:59536) 2023-08-10T11:51:44.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.277+0000 7fdcfaffd700 1 -- 172.21.15.73:0/1044557289 learned_addr learned my addr 172.21.15.73:0/1044557289 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:44.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.277+0000 7fdcfb7fe700 1 --2- 172.21.15.73:0/1044557289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcfc101b60 0x7fdcfc1967c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:44.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.277+0000 7fdcfa7fc700 1 --2- 172.21.15.73:0/1044557289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcfc1011a0 0x7fdcfc19cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:44.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.277+0000 7fdcfaffd700 1 -- 172.21.15.73:0/1044557289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcfc101b60 msgr2=0x7fdcfc1967c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:44.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.277+0000 7fdcfaffd700 1 --2- 172.21.15.73:0/1044557289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcfc101b60 0x7fdcfc1967c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:44.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.277+0000 7fdcfaffd700 1 -- 172.21.15.73:0/1044557289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcfc1011a0 msgr2=0x7fdcfc19cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:44.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.277+0000 7fdcfaffd700 1 --2- 172.21.15.73:0/1044557289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcfc1011a0 0x7fdcfc19cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:44.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.277+0000 7fdcfaffd700 1 -- 172.21.15.73:0/1044557289 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcec0095f0 con 0x7fdcfc0ffa60 2023-08-10T11:51:44.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.277+0000 7fdcfaffd700 1 --2- 172.21.15.73:0/1044557289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcfc0ffa60 0x7fdcfc19c6f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000c9b0 tx=0x7fdcf000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:44.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.278+0000 7fdce3fff700 1 -- 172.21.15.73:0/1044557289 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0007b00 con 0x7fdcfc0ffa60 2023-08-10T11:51:44.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.278+0000 7fdce3fff700 1 -- 172.21.15.73:0/1044557289 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdcf0007c60 con 0x7fdcfc0ffa60 2023-08-10T11:51:44.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.278+0000 7fdd01337700 1 -- 172.21.15.73:0/1044557289 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcfc197440 con 0x7fdcfc0ffa60 2023-08-10T11:51:44.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.278+0000 7fdce3fff700 1 -- 172.21.15.73:0/1044557289 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0018660 con 0x7fdcfc0ffa60 2023-08-10T11:51:44.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.278+0000 7fdd01337700 1 -- 172.21.15.73:0/1044557289 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcfc1a36e0 con 0x7fdcfc0ffa60 2023-08-10T11:51:44.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.279+0000 7fdd01337700 1 -- 172.21.15.73:0/1044557289 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcfc04e470 con 0x7fdcfc0ffa60 2023-08-10T11:51:44.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.280+0000 7fdce3fff700 1 -- 172.21.15.73:0/1044557289 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fdcf000f450 con 0x7fdcfc0ffa60 2023-08-10T11:51:44.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.280+0000 7fdce3fff700 1 --2- 172.21.15.73:0/1044557289 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fdce40a11e0 0x7fdce40a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:44.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.281+0000 7fdcfa7fc700 1 --2- 172.21.15.73:0/1044557289 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fdce40a11e0 0x7fdce40a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:44.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.281+0000 7fdce3fff700 1 -- 172.21.15.73:0/1044557289 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fdcf00cc8e0 con 0x7fdcfc0ffa60 2023-08-10T11:51:44.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.281+0000 7fdcfa7fc700 1 --2- 172.21.15.73:0/1044557289 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fdce40a11e0 0x7fdce40a36a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdcec006010 tx=0x7fdcec00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:44.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.285+0000 7fdce3fff700 1 -- 172.21.15.73:0/1044557289 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fdcf0096080 con 0x7fdcfc0ffa60 2023-08-10T11:51:44.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.469+0000 7fdd01337700 1 -- 172.21.15.73:0/1044557289 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdcfc104310 con 0x7fdce40a11e0 2023-08-10T11:51:44.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.479+0000 7fdce3fff700 1 -- 172.21.15.73:0/1044557289 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+340881 (secure 0 0 0) 0x7fdcfc104310 con 0x7fdce40a11e0 2023-08-10T11:51:44.483 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:51:44.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.482+0000 7fdd01337700 1 -- 172.21.15.73:0/1044557289 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fdce40a11e0 msgr2=0x7fdce40a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:44.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.482+0000 7fdd01337700 1 --2- 172.21.15.73:0/1044557289 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fdce40a11e0 0x7fdce40a36a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdcec006010 tx=0x7fdcec00b540 comp rx=0 tx=0).stop 2023-08-10T11:51:44.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.482+0000 7fdd01337700 1 -- 172.21.15.73:0/1044557289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcfc0ffa60 msgr2=0x7fdcfc19c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:44.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.482+0000 7fdd01337700 1 --2- 172.21.15.73:0/1044557289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcfc0ffa60 0x7fdcfc19c6f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000c9b0 tx=0x7fdcf000ccc0 comp rx=0 tx=0).stop 2023-08-10T11:51:44.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.482+0000 7fdd01337700 1 -- 172.21.15.73:0/1044557289 shutdown_connections 2023-08-10T11:51:44.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.482+0000 7fdd01337700 1 --2- 172.21.15.73:0/1044557289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcfc101b60 0x7fdcfc1967c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:44.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.482+0000 7fdd01337700 1 --2- 172.21.15.73:0/1044557289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcfc0ffa60 0x7fdcfc19c6f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:44.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.482+0000 7fdd01337700 1 --2- 172.21.15.73:0/1044557289 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fdce40a11e0 0x7fdce40a36a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:44.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.482+0000 7fdd01337700 1 --2- 172.21.15.73:0/1044557289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcfc1011a0 0x7fdcfc19cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:44.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.482+0000 7fdd01337700 1 -- 172.21.15.73:0/1044557289 >> 172.21.15.73:0/1044557289 conn(0x7fdcfc076760 msgr2=0x7fdcfc0fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:44.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.482+0000 7fdd01337700 1 -- 172.21.15.73:0/1044557289 shutdown_connections 2023-08-10T11:51:44.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:44.482+0000 7fdd01337700 1 -- 172.21.15.73:0/1044557289 wait complete. 2023-08-10T11:51:44.487 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-08-10T11:51:45.005 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":280,"stamp":"2023-08-10T11:51:42.490504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653475,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":578,"num_read_kb":408,"num_write":412,"num_write_kb":3064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":340,"ondisk_log_size":340,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336944,"kb_used_data":12752,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124604880,"statfs":{"total":1151940427776,"available":1151595397120,"internally_reserved":0,"allocated":13058048,"data_stored":7105333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":52,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003050"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.145138+0000","last_change":"2023-08-10T11:50:54.902569+0000","last_active":"2023-08-10T11:50:56.145138+0000","last_peered":"2023-08-10T11:50:56.145138+0000","last_clean":"2023-08-10T11:50:56.145138+0000","last_became_active":"2023-08-10T11:50:54.902058+0000","last_became_peered":"2023-08-10T11:50:54.902058+0000","last_unstale":"2023-08-10T11:50:56.145138+0000","last_undegraded":"2023-08-10T11:50:56.145138+0000","last_fullsized":"2023-08-10T11:50:56.145138+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:21:13.051534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345827+0000","last_change":"2023-08-10T11:50:54.942908+0000","last_active":"2023-08-10T11:50:56.345827+0000","last_peered":"2023-08-10T11:50:56.345827+0000","last_clean":"2023-08-10T11:50:56.345827+0000","last_became_active":"2023-08-10T11:50:54.941765+0000","last_became_peered":"2023-08-10T11:50:54.941765+0000","last_unstale":"2023-08-10T11:50:56.345827+0000","last_undegraded":"2023-08-10T11:50:56.345827+0000","last_fullsized":"2023-08-10T11:50:56.345827+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:23:25.198276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345991+0000","last_change":"2023-08-10T11:50:54.940670+0000","last_active":"2023-08-10T11:50:56.345991+0000","last_peered":"2023-08-10T11:50:56.345991+0000","last_clean":"2023-08-10T11:50:56.345991+0000","last_became_active":"2023-08-10T11:50:54.939906+0000","last_became_peered":"2023-08-10T11:50:54.939906+0000","last_unstale":"2023-08-10T11:50:56.345991+0000","last_undegraded":"2023-08-10T11:50:56.345991+0000","last_fullsized":"2023-08-10T11:50:56.345991+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:49:22.795335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.135449+0000","last_change":"2023-08-10T11:50:54.910964+0000","last_active":"2023-08-10T11:50:56.135449+0000","last_peered":"2023-08-10T11:50:56.135449+0000","last_clean":"2023-08-10T11:50:56.135449+0000","last_became_active":"2023-08-10T11:50:54.910185+0000","last_became_peered":"2023-08-10T11:50:54.910185+0000","last_unstale":"2023-08-10T11:50:56.135449+0000","last_undegraded":"2023-08-10T11:50:56.135449+0000","last_fullsized":"2023-08-10T11:50:56.135449+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:23:05.579094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344998+0000","last_change":"2023-08-10T11:50:54.905354+0000","last_active":"2023-08-10T11:50:56.344998+0000","last_peered":"2023-08-10T11:50:56.344998+0000","last_clean":"2023-08-10T11:50:56.344998+0000","last_became_active":"2023-08-10T11:50:54.904982+0000","last_became_peered":"2023-08-10T11:50:54.904982+0000","last_unstale":"2023-08-10T11:50:56.344998+0000","last_undegraded":"2023-08-10T11:50:56.344998+0000","last_fullsized":"2023-08-10T11:50:56.344998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:29:30.470234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344628+0000","last_change":"2023-08-10T11:50:54.907024+0000","last_active":"2023-08-10T11:50:56.344628+0000","last_peered":"2023-08-10T11:50:56.344628+0000","last_clean":"2023-08-10T11:50:56.344628+0000","last_became_active":"2023-08-10T11:50:54.906590+0000","last_became_peered":"2023-08-10T11:50:54.906590+0000","last_unstale":"2023-08-10T11:50:56.344628+0000","last_undegraded":"2023-08-10T11:50:56.344628+0000","last_fullsized":"2023-08-10T11:50:56.344628+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:33:20.006347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473505+0000","last_change":"2023-08-10T11:50:54.904604+0000","last_active":"2023-08-10T11:50:56.473505+0000","last_peered":"2023-08-10T11:50:56.473505+0000","last_clean":"2023-08-10T11:50:56.473505+0000","last_became_active":"2023-08-10T11:50:54.904295+0000","last_became_peered":"2023-08-10T11:50:54.904295+0000","last_unstale":"2023-08-10T11:50:56.473505+0000","last_undegraded":"2023-08-10T11:50:56.473505+0000","last_fullsized":"2023-08-10T11:50:56.473505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:11:15.957227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344786+0000","last_change":"2023-08-10T11:50:54.963398+0000","last_active":"2023-08-10T11:50:56.344786+0000","last_peered":"2023-08-10T11:50:56.344786+0000","last_clean":"2023-08-10T11:50:56.344786+0000","last_became_active":"2023-08-10T11:50:54.963048+0000","last_became_peered":"2023-08-10T11:50:54.963048+0000","last_unstale":"2023-08-10T11:50:56.344786+0000","last_undegraded":"2023-08-10T11:50:56.344786+0000","last_fullsized":"2023-08-10T11:50:56.344786+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:05:56.018291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.892886+0000","last_change":"2023-08-10T11:50:54.913426+0000","last_active":"2023-08-10T11:50:55.892886+0000","last_peered":"2023-08-10T11:50:55.892886+0000","last_clean":"2023-08-10T11:50:55.892886+0000","last_became_active":"2023-08-10T11:50:54.913099+0000","last_became_peered":"2023-08-10T11:50:54.913099+0000","last_unstale":"2023-08-10T11:50:55.892886+0000","last_undegraded":"2023-08-10T11:50:55.892886+0000","last_fullsized":"2023-08-10T11:50:55.892886+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:43:10.881941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344828+0000","last_change":"2023-08-10T11:50:54.909259+0000","last_active":"2023-08-10T11:50:56.344828+0000","last_peered":"2023-08-10T11:50:56.344828+0000","last_clean":"2023-08-10T11:50:56.344828+0000","last_became_active":"2023-08-10T11:50:54.908898+0000","last_became_peered":"2023-08-10T11:50:54.908898+0000","last_unstale":"2023-08-10T11:50:56.344828+0000","last_undegraded":"2023-08-10T11:50:56.344828+0000","last_fullsized":"2023-08-10T11:50:56.344828+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:34:33.846938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473995+0000","last_change":"2023-08-10T11:50:54.906152+0000","last_active":"2023-08-10T11:50:56.473995+0000","last_peered":"2023-08-10T11:50:56.473995+0000","last_clean":"2023-08-10T11:50:56.473995+0000","last_became_active":"2023-08-10T11:50:54.905859+0000","last_became_peered":"2023-08-10T11:50:54.905859+0000","last_unstale":"2023-08-10T11:50:56.473995+0000","last_undegraded":"2023-08-10T11:50:56.473995+0000","last_fullsized":"2023-08-10T11:50:56.473995+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:58:19.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.135354+0000","last_change":"2023-08-10T11:50:54.911195+0000","last_active":"2023-08-10T11:50:56.135354+0000","last_peered":"2023-08-10T11:50:56.135354+0000","last_clean":"2023-08-10T11:50:56.135354+0000","last_became_active":"2023-08-10T11:50:54.910618+0000","last_became_peered":"2023-08-10T11:50:54.910618+0000","last_unstale":"2023-08-10T11:50:56.135354+0000","last_undegraded":"2023-08-10T11:50:56.135354+0000","last_fullsized":"2023-08-10T11:50:56.135354+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:09:17.323010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.346048+0000","last_change":"2023-08-10T11:50:54.908051+0000","last_active":"2023-08-10T11:50:56.346048+0000","last_peered":"2023-08-10T11:50:56.346048+0000","last_clean":"2023-08-10T11:50:56.346048+0000","last_became_active":"2023-08-10T11:50:54.907772+0000","last_became_peered":"2023-08-10T11:50:54.907772+0000","last_unstale":"2023-08-10T11:50:56.346048+0000","last_undegraded":"2023-08-10T11:50:56.346048+0000","last_fullsized":"2023-08-10T11:50:56.346048+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:37:48.360047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344774+0000","last_change":"2023-08-10T11:50:54.941327+0000","last_active":"2023-08-10T11:50:56.344774+0000","last_peered":"2023-08-10T11:50:56.344774+0000","last_clean":"2023-08-10T11:50:56.344774+0000","last_became_active":"2023-08-10T11:50:54.941020+0000","last_became_peered":"2023-08-10T11:50:54.941020+0000","last_unstale":"2023-08-10T11:50:56.344774+0000","last_undegraded":"2023-08-10T11:50:56.344774+0000","last_fullsized":"2023-08-10T11:50:56.344774+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:57:02.124392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345409+0000","last_change":"2023-08-10T11:50:54.940236+0000","last_active":"2023-08-10T11:50:56.345409+0000","last_peered":"2023-08-10T11:50:56.345409+0000","last_clean":"2023-08-10T11:50:56.345409+0000","last_became_active":"2023-08-10T11:50:54.939921+0000","last_became_peered":"2023-08-10T11:50:54.939921+0000","last_unstale":"2023-08-10T11:50:56.345409+0000","last_undegraded":"2023-08-10T11:50:56.345409+0000","last_fullsized":"2023-08-10T11:50:56.345409+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:16:17.977836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.892426+0000","last_change":"2023-08-10T11:50:54.903773+0000","last_active":"2023-08-10T11:50:55.892426+0000","last_peered":"2023-08-10T11:50:55.892426+0000","last_clean":"2023-08-10T11:50:55.892426+0000","last_became_active":"2023-08-10T11:50:54.903516+0000","last_became_peered":"2023-08-10T11:50:54.903516+0000","last_unstale":"2023-08-10T11:50:55.892426+0000","last_undegraded":"2023-08-10T11:50:55.892426+0000","last_fullsized":"2023-08-10T11:50:55.892426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:09:52.443125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.145193+0000","last_change":"2023-08-10T11:50:54.902364+0000","last_active":"2023-08-10T11:50:56.145193+0000","last_peered":"2023-08-10T11:50:56.145193+0000","last_clean":"2023-08-10T11:50:56.145193+0000","last_became_active":"2023-08-10T11:50:54.901673+0000","last_became_peered":"2023-08-10T11:50:54.901673+0000","last_unstale":"2023-08-10T11:50:56.145193+0000","last_undegraded":"2023-08-10T11:50:56.145193+0000","last_fullsized":"2023-08-10T11:50:56.145193+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:45:10.264196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890715+0000","last_change":"2023-08-10T11:50:54.911896+0000","last_active":"2023-08-10T11:50:55.890715+0000","last_peered":"2023-08-10T11:50:55.890715+0000","last_clean":"2023-08-10T11:50:55.890715+0000","last_became_active":"2023-08-10T11:50:54.911469+0000","last_became_peered":"2023-08-10T11:50:54.911469+0000","last_unstale":"2023-08-10T11:50:55.890715+0000","last_undegraded":"2023-08-10T11:50:55.890715+0000","last_fullsized":"2023-08-10T11:50:55.890715+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:35:08.075353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890571+0000","last_change":"2023-08-10T11:50:54.964030+0000","last_active":"2023-08-10T11:50:55.890571+0000","last_peered":"2023-08-10T11:50:55.890571+0000","last_clean":"2023-08-10T11:50:55.890571+0000","last_became_active":"2023-08-10T11:50:54.963744+0000","last_became_peered":"2023-08-10T11:50:54.963744+0000","last_unstale":"2023-08-10T11:50:55.890571+0000","last_undegraded":"2023-08-10T11:50:55.890571+0000","last_fullsized":"2023-08-10T11:50:55.890571+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:46.590044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":67,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:38.581830+0000","last_change":"2023-08-10T11:50:53.905439+0000","last_active":"2023-08-10T11:51:38.581830+0000","last_peered":"2023-08-10T11:51:38.581830+0000","last_clean":"2023-08-10T11:51:38.581830+0000","last_became_active":"2023-08-10T11:50:53.905172+0000","last_became_peered":"2023-08-10T11:50:53.905172+0000","last_unstale":"2023-08-10T11:51:38.581830+0000","last_undegraded":"2023-08-10T11:51:38.581830+0000","last_fullsized":"2023-08-10T11:51:38.581830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:31:40.730660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345671+0000","last_change":"2023-08-10T11:50:54.961422+0000","last_active":"2023-08-10T11:50:56.345671+0000","last_peered":"2023-08-10T11:50:56.345671+0000","last_clean":"2023-08-10T11:50:56.345671+0000","last_became_active":"2023-08-10T11:50:54.960627+0000","last_became_peered":"2023-08-10T11:50:54.960627+0000","last_unstale":"2023-08-10T11:50:56.345671+0000","last_undegraded":"2023-08-10T11:50:56.345671+0000","last_fullsized":"2023-08-10T11:50:56.345671+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:10:30.642466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345880+0000","last_change":"2023-08-10T11:50:53.907291+0000","last_active":"2023-08-10T11:50:56.345880+0000","last_peered":"2023-08-10T11:50:56.345880+0000","last_clean":"2023-08-10T11:50:56.345880+0000","last_became_active":"2023-08-10T11:50:53.906997+0000","last_became_peered":"2023-08-10T11:50:53.906997+0000","last_unstale":"2023-08-10T11:50:56.345880+0000","last_undegraded":"2023-08-10T11:50:56.345880+0000","last_fullsized":"2023-08-10T11:50:56.345880+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:52:16.544854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344895+0000","last_change":"2023-08-10T11:50:54.940828+0000","last_active":"2023-08-10T11:50:56.344895+0000","last_peered":"2023-08-10T11:50:56.344895+0000","last_clean":"2023-08-10T11:50:56.344895+0000","last_became_active":"2023-08-10T11:50:54.940169+0000","last_became_peered":"2023-08-10T11:50:54.940169+0000","last_unstale":"2023-08-10T11:50:56.344895+0000","last_undegraded":"2023-08-10T11:50:56.344895+0000","last_fullsized":"2023-08-10T11:50:56.344895+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:45:59.866028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:01.530148+0000","last_change":"2023-08-10T11:50:53.906366+0000","last_active":"2023-08-10T11:51:01.530148+0000","last_peered":"2023-08-10T11:51:01.530148+0000","last_clean":"2023-08-10T11:51:01.530148+0000","last_became_active":"2023-08-10T11:50:53.906057+0000","last_became_peered":"2023-08-10T11:50:53.906057+0000","last_unstale":"2023-08-10T11:51:01.530148+0000","last_undegraded":"2023-08-10T11:51:01.530148+0000","last_fullsized":"2023-08-10T11:51:01.530148+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:59:44.567315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.892532+0000","last_change":"2023-08-10T11:50:54.908534+0000","last_active":"2023-08-10T11:50:55.892532+0000","last_peered":"2023-08-10T11:50:55.892532+0000","last_clean":"2023-08-10T11:50:55.892532+0000","last_became_active":"2023-08-10T11:50:54.908244+0000","last_became_peered":"2023-08-10T11:50:54.908244+0000","last_unstale":"2023-08-10T11:50:55.892532+0000","last_undegraded":"2023-08-10T11:50:55.892532+0000","last_fullsized":"2023-08-10T11:50:55.892532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:55:51.466202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.531779+0000","last_change":"2023-08-10T11:50:53.902325+0000","last_active":"2023-08-10T11:51:00.531779+0000","last_peered":"2023-08-10T11:51:00.531779+0000","last_clean":"2023-08-10T11:51:00.531779+0000","last_became_active":"2023-08-10T11:50:53.902020+0000","last_became_peered":"2023-08-10T11:50:53.902020+0000","last_unstale":"2023-08-10T11:51:00.531779+0000","last_undegraded":"2023-08-10T11:51:00.531779+0000","last_fullsized":"2023-08-10T11:51:00.531779+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:54.005452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345744+0000","last_change":"2023-08-10T11:50:54.910291+0000","last_active":"2023-08-10T11:50:56.345744+0000","last_peered":"2023-08-10T11:50:56.345744+0000","last_clean":"2023-08-10T11:50:56.345744+0000","last_became_active":"2023-08-10T11:50:54.909886+0000","last_became_peered":"2023-08-10T11:50:54.909886+0000","last_unstale":"2023-08-10T11:50:56.345744+0000","last_undegraded":"2023-08-10T11:50:56.345744+0000","last_fullsized":"2023-08-10T11:50:56.345744+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:32:04.741805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'5","reported_seq":65,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:40.569704+0000","last_change":"2023-08-10T11:50:53.904363+0000","last_active":"2023-08-10T11:51:40.569704+0000","last_peered":"2023-08-10T11:51:40.569704+0000","last_clean":"2023-08-10T11:51:40.569704+0000","last_became_active":"2023-08-10T11:50:53.904049+0000","last_became_peered":"2023-08-10T11:50:53.904049+0000","last_unstale":"2023-08-10T11:51:40.569704+0000","last_undegraded":"2023-08-10T11:51:40.569704+0000","last_fullsized":"2023-08-10T11:51:40.569704+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:49:25.423370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344983+0000","last_change":"2023-08-10T11:50:54.912189+0000","last_active":"2023-08-10T11:50:56.344983+0000","last_peered":"2023-08-10T11:50:56.344983+0000","last_clean":"2023-08-10T11:50:56.344983+0000","last_became_active":"2023-08-10T11:50:54.911884+0000","last_became_peered":"2023-08-10T11:50:54.911884+0000","last_unstale":"2023-08-10T11:50:56.344983+0000","last_undegraded":"2023-08-10T11:50:56.344983+0000","last_fullsized":"2023-08-10T11:50:56.344983+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:40:25.019116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:59.515415+0000","last_change":"2023-08-10T11:50:53.901161+0000","last_active":"2023-08-10T11:50:59.515415+0000","last_peered":"2023-08-10T11:50:59.515415+0000","last_clean":"2023-08-10T11:50:59.515415+0000","last_became_active":"2023-08-10T11:50:53.900806+0000","last_became_peered":"2023-08-10T11:50:53.900806+0000","last_unstale":"2023-08-10T11:50:59.515415+0000","last_undegraded":"2023-08-10T11:50:59.515415+0000","last_fullsized":"2023-08-10T11:50:59.515415+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:33:49.410246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345263+0000","last_change":"2023-08-10T11:50:54.905753+0000","last_active":"2023-08-10T11:50:56.345263+0000","last_peered":"2023-08-10T11:50:56.345263+0000","last_clean":"2023-08-10T11:50:56.345263+0000","last_became_active":"2023-08-10T11:50:54.905463+0000","last_became_peered":"2023-08-10T11:50:54.905463+0000","last_unstale":"2023-08-10T11:50:56.345263+0000","last_undegraded":"2023-08-10T11:50:56.345263+0000","last_fullsized":"2023-08-10T11:50:56.345263+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:40:18.150871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:58.508858+0000","last_change":"2023-08-10T11:50:53.895021+0000","last_active":"2023-08-10T11:50:58.508858+0000","last_peered":"2023-08-10T11:50:58.508858+0000","last_clean":"2023-08-10T11:50:58.508858+0000","last_became_active":"2023-08-10T11:50:53.894732+0000","last_became_peered":"2023-08-10T11:50:53.894732+0000","last_unstale":"2023-08-10T11:50:58.508858+0000","last_undegraded":"2023-08-10T11:50:58.508858+0000","last_fullsized":"2023-08-10T11:50:58.508858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:33:34.799950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344648+0000","last_change":"2023-08-10T11:50:54.957771+0000","last_active":"2023-08-10T11:50:56.344648+0000","last_peered":"2023-08-10T11:50:56.344648+0000","last_clean":"2023-08-10T11:50:56.344648+0000","last_became_active":"2023-08-10T11:50:54.901503+0000","last_became_peered":"2023-08-10T11:50:54.901503+0000","last_unstale":"2023-08-10T11:50:56.344648+0000","last_undegraded":"2023-08-10T11:50:56.344648+0000","last_fullsized":"2023-08-10T11:50:56.344648+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:44:27.828963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.530556+0000","last_change":"2023-08-10T11:50:53.899939+0000","last_active":"2023-08-10T11:51:00.530556+0000","last_peered":"2023-08-10T11:51:00.530556+0000","last_clean":"2023-08-10T11:51:00.530556+0000","last_became_active":"2023-08-10T11:50:53.899648+0000","last_became_peered":"2023-08-10T11:50:53.899648+0000","last_unstale":"2023-08-10T11:51:00.530556+0000","last_undegraded":"2023-08-10T11:51:00.530556+0000","last_fullsized":"2023-08-10T11:51:00.530556+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:24:46.642939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890464+0000","last_change":"2023-08-10T11:50:54.959487+0000","last_active":"2023-08-10T11:50:55.890464+0000","last_peered":"2023-08-10T11:50:55.890464+0000","last_clean":"2023-08-10T11:50:55.890464+0000","last_became_active":"2023-08-10T11:50:54.959153+0000","last_became_peered":"2023-08-10T11:50:54.959153+0000","last_unstale":"2023-08-10T11:50:55.890464+0000","last_undegraded":"2023-08-10T11:50:55.890464+0000","last_fullsized":"2023-08-10T11:50:55.890464+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:38:55.933145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":99,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:39.567360+0000","last_change":"2023-08-10T11:50:53.898037+0000","last_active":"2023-08-10T11:51:39.567360+0000","last_peered":"2023-08-10T11:51:39.567360+0000","last_clean":"2023-08-10T11:51:39.567360+0000","last_became_active":"2023-08-10T11:50:53.897715+0000","last_became_peered":"2023-08-10T11:50:53.897715+0000","last_unstale":"2023-08-10T11:51:39.567360+0000","last_undegraded":"2023-08-10T11:51:39.567360+0000","last_fullsized":"2023-08-10T11:51:39.567360+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:42:02.005233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":81,"num_read_kb":81,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.892809+0000","last_change":"2023-08-10T11:50:54.908337+0000","last_active":"2023-08-10T11:50:55.892809+0000","last_peered":"2023-08-10T11:50:55.892809+0000","last_clean":"2023-08-10T11:50:55.892809+0000","last_became_active":"2023-08-10T11:50:54.907990+0000","last_became_peered":"2023-08-10T11:50:54.907990+0000","last_unstale":"2023-08-10T11:50:55.892809+0000","last_undegraded":"2023-08-10T11:50:55.892809+0000","last_fullsized":"2023-08-10T11:50:55.892809+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:44:47.081301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.530242+0000","last_change":"2023-08-10T11:50:53.901498+0000","last_active":"2023-08-10T11:51:00.530242+0000","last_peered":"2023-08-10T11:51:00.530242+0000","last_clean":"2023-08-10T11:51:00.530242+0000","last_became_active":"2023-08-10T11:50:53.901146+0000","last_became_peered":"2023-08-10T11:50:53.901146+0000","last_unstale":"2023-08-10T11:51:00.530242+0000","last_undegraded":"2023-08-10T11:51:00.530242+0000","last_fullsized":"2023-08-10T11:51:00.530242+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:52:15.837576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345035+0000","last_change":"2023-08-10T11:50:54.901550+0000","last_active":"2023-08-10T11:50:56.345035+0000","last_peered":"2023-08-10T11:50:56.345035+0000","last_clean":"2023-08-10T11:50:56.345035+0000","last_became_active":"2023-08-10T11:50:54.901214+0000","last_became_peered":"2023-08-10T11:50:54.901214+0000","last_unstale":"2023-08-10T11:50:56.345035+0000","last_undegraded":"2023-08-10T11:50:56.345035+0000","last_fullsized":"2023-08-10T11:50:56.345035+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:11:47.883894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:58.501883+0000","last_change":"2023-08-10T11:50:53.901337+0000","last_active":"2023-08-10T11:50:58.501883+0000","last_peered":"2023-08-10T11:50:58.501883+0000","last_clean":"2023-08-10T11:50:58.501883+0000","last_became_active":"2023-08-10T11:50:53.901005+0000","last_became_peered":"2023-08-10T11:50:53.901005+0000","last_unstale":"2023-08-10T11:50:58.501883+0000","last_undegraded":"2023-08-10T11:50:58.501883+0000","last_fullsized":"2023-08-10T11:50:58.501883+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:11:24.161362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.892656+0000","last_change":"2023-08-10T11:50:54.905466+0000","last_active":"2023-08-10T11:50:55.892656+0000","last_peered":"2023-08-10T11:50:55.892656+0000","last_clean":"2023-08-10T11:50:55.892656+0000","last_became_active":"2023-08-10T11:50:54.905175+0000","last_became_peered":"2023-08-10T11:50:54.905175+0000","last_unstale":"2023-08-10T11:50:55.892656+0000","last_undegraded":"2023-08-10T11:50:55.892656+0000","last_fullsized":"2023-08-10T11:50:55.892656+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:49:14.630996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'29","reported_seq":135,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:39.570885+0000","last_change":"2023-08-10T11:50:53.894717+0000","last_active":"2023-08-10T11:51:39.570885+0000","last_peered":"2023-08-10T11:51:39.570885+0000","last_clean":"2023-08-10T11:51:39.570885+0000","last_became_active":"2023-08-10T11:50:53.894390+0000","last_became_peered":"2023-08-10T11:50:53.894390+0000","last_unstale":"2023-08-10T11:51:39.570885+0000","last_undegraded":"2023-08-10T11:51:39.570885+0000","last_fullsized":"2023-08-10T11:51:39.570885+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:55:07.872465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56241,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":92,"num_read_kb":100,"num_write":31,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344895+0000","last_change":"2023-08-10T11:50:54.908021+0000","last_active":"2023-08-10T11:50:56.344895+0000","last_peered":"2023-08-10T11:50:56.344895+0000","last_clean":"2023-08-10T11:50:56.344895+0000","last_became_active":"2023-08-10T11:50:54.907527+0000","last_became_peered":"2023-08-10T11:50:54.907527+0000","last_unstale":"2023-08-10T11:50:56.344895+0000","last_undegraded":"2023-08-10T11:50:56.344895+0000","last_fullsized":"2023-08-10T11:50:56.344895+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:31:57.299713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.531851+0000","last_change":"2023-08-10T11:50:53.906448+0000","last_active":"2023-08-10T11:51:00.531851+0000","last_peered":"2023-08-10T11:51:00.531851+0000","last_clean":"2023-08-10T11:51:00.531851+0000","last_became_active":"2023-08-10T11:50:53.906157+0000","last_became_peered":"2023-08-10T11:50:53.906157+0000","last_unstale":"2023-08-10T11:51:00.531851+0000","last_undegraded":"2023-08-10T11:51:00.531851+0000","last_fullsized":"2023-08-10T11:51:00.531851+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:39.418056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345339+0000","last_change":"2023-08-10T11:50:54.906467+0000","last_active":"2023-08-10T11:50:56.345339+0000","last_peered":"2023-08-10T11:50:56.345339+0000","last_clean":"2023-08-10T11:50:56.345339+0000","last_became_active":"2023-08-10T11:50:54.901119+0000","last_became_peered":"2023-08-10T11:50:54.901119+0000","last_unstale":"2023-08-10T11:50:56.345339+0000","last_undegraded":"2023-08-10T11:50:56.345339+0000","last_fullsized":"2023-08-10T11:50:56.345339+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:16.266709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.530526+0000","last_change":"2023-08-10T11:50:53.906435+0000","last_active":"2023-08-10T11:51:00.530526+0000","last_peered":"2023-08-10T11:51:00.530526+0000","last_clean":"2023-08-10T11:51:00.530526+0000","last_became_active":"2023-08-10T11:50:53.905545+0000","last_became_peered":"2023-08-10T11:50:53.905545+0000","last_unstale":"2023-08-10T11:51:00.530526+0000","last_undegraded":"2023-08-10T11:51:00.530526+0000","last_fullsized":"2023-08-10T11:51:00.530526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:26:54.882060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473837+0000","last_change":"2023-08-10T11:50:54.903127+0000","last_active":"2023-08-10T11:50:56.473837+0000","last_peered":"2023-08-10T11:50:56.473837+0000","last_clean":"2023-08-10T11:50:56.473837+0000","last_became_active":"2023-08-10T11:50:54.902805+0000","last_became_peered":"2023-08-10T11:50:54.902805+0000","last_unstale":"2023-08-10T11:50:56.473837+0000","last_undegraded":"2023-08-10T11:50:56.473837+0000","last_fullsized":"2023-08-10T11:50:56.473837+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:58:40.949478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":61,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:39.591775+0000","last_change":"2023-08-10T11:50:53.898252+0000","last_active":"2023-08-10T11:51:39.591775+0000","last_peered":"2023-08-10T11:51:39.591775+0000","last_clean":"2023-08-10T11:51:39.591775+0000","last_became_active":"2023-08-10T11:50:53.897992+0000","last_became_peered":"2023-08-10T11:50:53.897992+0000","last_unstale":"2023-08-10T11:51:39.591775+0000","last_undegraded":"2023-08-10T11:51:39.591775+0000","last_fullsized":"2023-08-10T11:51:39.591775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:34:51.658646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473681+0000","last_change":"2023-08-10T11:50:54.913297+0000","last_active":"2023-08-10T11:50:56.473681+0000","last_peered":"2023-08-10T11:50:56.473681+0000","last_clean":"2023-08-10T11:50:56.473681+0000","last_became_active":"2023-08-10T11:50:54.912997+0000","last_became_peered":"2023-08-10T11:50:54.912997+0000","last_unstale":"2023-08-10T11:50:56.473681+0000","last_undegraded":"2023-08-10T11:50:56.473681+0000","last_fullsized":"2023-08-10T11:50:56.473681+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:40:06.862890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.529664+0000","last_change":"2023-08-10T11:50:53.904095+0000","last_active":"2023-08-10T11:51:00.529664+0000","last_peered":"2023-08-10T11:51:00.529664+0000","last_clean":"2023-08-10T11:51:00.529664+0000","last_became_active":"2023-08-10T11:50:53.903712+0000","last_became_peered":"2023-08-10T11:50:53.903712+0000","last_unstale":"2023-08-10T11:51:00.529664+0000","last_undegraded":"2023-08-10T11:51:00.529664+0000","last_fullsized":"2023-08-10T11:51:00.529664+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:52:43.075450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345492+0000","last_change":"2023-08-10T11:50:54.904763+0000","last_active":"2023-08-10T11:50:56.345492+0000","last_peered":"2023-08-10T11:50:56.345492+0000","last_clean":"2023-08-10T11:50:56.345492+0000","last_became_active":"2023-08-10T11:50:54.904467+0000","last_became_peered":"2023-08-10T11:50:54.904467+0000","last_unstale":"2023-08-10T11:50:56.345492+0000","last_undegraded":"2023-08-10T11:50:56.345492+0000","last_fullsized":"2023-08-10T11:50:56.345492+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:18:23.751856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:58.499250+0000","last_change":"2023-08-10T11:50:53.904605+0000","last_active":"2023-08-10T11:50:58.499250+0000","last_peered":"2023-08-10T11:50:58.499250+0000","last_clean":"2023-08-10T11:50:58.499250+0000","last_became_active":"2023-08-10T11:50:53.904236+0000","last_became_peered":"2023-08-10T11:50:53.904236+0000","last_unstale":"2023-08-10T11:50:58.499250+0000","last_undegraded":"2023-08-10T11:50:58.499250+0000","last_fullsized":"2023-08-10T11:50:58.499250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:31:26.574828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.144909+0000","last_change":"2023-08-10T11:50:54.903881+0000","last_active":"2023-08-10T11:50:56.144909+0000","last_peered":"2023-08-10T11:50:56.144909+0000","last_clean":"2023-08-10T11:50:56.144909+0000","last_became_active":"2023-08-10T11:50:54.903563+0000","last_became_peered":"2023-08-10T11:50:54.903563+0000","last_unstale":"2023-08-10T11:50:56.144909+0000","last_undegraded":"2023-08-10T11:50:56.144909+0000","last_fullsized":"2023-08-10T11:50:56.144909+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:23:32.901460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890795+0000","last_change":"2023-08-10T11:50:53.905320+0000","last_active":"2023-08-10T11:50:55.890795+0000","last_peered":"2023-08-10T11:50:55.890795+0000","last_clean":"2023-08-10T11:50:55.890795+0000","last_became_active":"2023-08-10T11:50:53.905057+0000","last_became_peered":"2023-08-10T11:50:53.905057+0000","last_unstale":"2023-08-10T11:50:55.890795+0000","last_undegraded":"2023-08-10T11:50:55.890795+0000","last_fullsized":"2023-08-10T11:50:55.890795+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:10:35.476026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344914+0000","last_change":"2023-08-10T11:50:54.906531+0000","last_active":"2023-08-10T11:50:56.344914+0000","last_peered":"2023-08-10T11:50:56.344914+0000","last_clean":"2023-08-10T11:50:56.344914+0000","last_became_active":"2023-08-10T11:50:54.906239+0000","last_became_peered":"2023-08-10T11:50:54.906239+0000","last_unstale":"2023-08-10T11:50:56.344914+0000","last_undegraded":"2023-08-10T11:50:56.344914+0000","last_fullsized":"2023-08-10T11:50:56.344914+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:11:52.732611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":60,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:39.583742+0000","last_change":"2023-08-10T11:50:53.899835+0000","last_active":"2023-08-10T11:51:39.583742+0000","last_peered":"2023-08-10T11:51:39.583742+0000","last_clean":"2023-08-10T11:51:39.583742+0000","last_became_active":"2023-08-10T11:50:53.898318+0000","last_became_peered":"2023-08-10T11:50:53.898318+0000","last_unstale":"2023-08-10T11:51:39.583742+0000","last_undegraded":"2023-08-10T11:51:39.583742+0000","last_fullsized":"2023-08-10T11:51:39.583742+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:02:07.071804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344832+0000","last_change":"2023-08-10T11:50:54.905941+0000","last_active":"2023-08-10T11:50:56.344832+0000","last_peered":"2023-08-10T11:50:56.344832+0000","last_clean":"2023-08-10T11:50:56.344832+0000","last_became_active":"2023-08-10T11:50:54.905634+0000","last_became_peered":"2023-08-10T11:50:54.905634+0000","last_unstale":"2023-08-10T11:50:56.344832+0000","last_undegraded":"2023-08-10T11:50:56.344832+0000","last_fullsized":"2023-08-10T11:50:56.344832+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:53:51.516739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345241+0000","last_change":"2023-08-10T11:50:54.910544+0000","last_active":"2023-08-10T11:50:56.345241+0000","last_peered":"2023-08-10T11:50:56.345241+0000","last_clean":"2023-08-10T11:50:56.345241+0000","last_became_active":"2023-08-10T11:50:54.910210+0000","last_became_peered":"2023-08-10T11:50:54.910210+0000","last_unstale":"2023-08-10T11:50:56.345241+0000","last_undegraded":"2023-08-10T11:50:56.345241+0000","last_fullsized":"2023-08-10T11:50:56.345241+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:33:03.928843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":59,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:38.588961+0000","last_change":"2023-08-10T11:50:53.906293+0000","last_active":"2023-08-10T11:51:38.588961+0000","last_peered":"2023-08-10T11:51:38.588961+0000","last_clean":"2023-08-10T11:51:38.588961+0000","last_became_active":"2023-08-10T11:50:53.905998+0000","last_became_peered":"2023-08-10T11:50:53.905998+0000","last_unstale":"2023-08-10T11:51:38.588961+0000","last_undegraded":"2023-08-10T11:51:38.588961+0000","last_fullsized":"2023-08-10T11:51:38.588961+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:37.743171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345578+0000","last_change":"2023-08-10T11:50:54.960147+0000","last_active":"2023-08-10T11:50:56.345578+0000","last_peered":"2023-08-10T11:50:56.345578+0000","last_clean":"2023-08-10T11:50:56.345578+0000","last_became_active":"2023-08-10T11:50:54.959842+0000","last_became_peered":"2023-08-10T11:50:54.959842+0000","last_unstale":"2023-08-10T11:50:56.345578+0000","last_undegraded":"2023-08-10T11:50:56.345578+0000","last_fullsized":"2023-08-10T11:50:56.345578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:12:53.787027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:01.530264+0000","last_change":"2023-08-10T11:50:53.899292+0000","last_active":"2023-08-10T11:51:01.530264+0000","last_peered":"2023-08-10T11:51:01.530264+0000","last_clean":"2023-08-10T11:51:01.530264+0000","last_became_active":"2023-08-10T11:50:53.898917+0000","last_became_peered":"2023-08-10T11:50:53.898917+0000","last_unstale":"2023-08-10T11:51:01.530264+0000","last_undegraded":"2023-08-10T11:51:01.530264+0000","last_fullsized":"2023-08-10T11:51:01.530264+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:40:42.574205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":341,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473528+0000","last_change":"2023-08-10T11:49:54.492617+0000","last_active":"2023-08-10T11:50:56.473528+0000","last_peered":"2023-08-10T11:50:56.473528+0000","last_clean":"2023-08-10T11:50:56.473528+0000","last_became_active":"2023-08-10T11:49:54.492146+0000","last_became_peered":"2023-08-10T11:49:54.492146+0000","last_unstale":"2023-08-10T11:50:56.473528+0000","last_undegraded":"2023-08-10T11:50:56.473528+0000","last_fullsized":"2023-08-10T11:50:56.473528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:46:58.862300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:46:58.862300+0000","last_clean_scrub_stamp":"2023-08-10T11:46:58.862300+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:03:46.098279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345147+0000","last_change":"2023-08-10T11:50:54.907704+0000","last_active":"2023-08-10T11:50:56.345147+0000","last_peered":"2023-08-10T11:50:56.345147+0000","last_clean":"2023-08-10T11:50:56.345147+0000","last_became_active":"2023-08-10T11:50:54.907409+0000","last_became_peered":"2023-08-10T11:50:54.907409+0000","last_unstale":"2023-08-10T11:50:56.345147+0000","last_undegraded":"2023-08-10T11:50:56.345147+0000","last_fullsized":"2023-08-10T11:50:56.345147+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:00:55.449902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:58.509272+0000","last_change":"2023-08-10T11:50:53.902548+0000","last_active":"2023-08-10T11:50:58.509272+0000","last_peered":"2023-08-10T11:50:58.509272+0000","last_clean":"2023-08-10T11:50:58.509272+0000","last_became_active":"2023-08-10T11:50:53.902021+0000","last_became_peered":"2023-08-10T11:50:53.902021+0000","last_unstale":"2023-08-10T11:50:58.509272+0000","last_undegraded":"2023-08-10T11:50:58.509272+0000","last_fullsized":"2023-08-10T11:50:58.509272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:49:47.207695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:59.514695+0000","last_change":"2023-08-10T11:50:53.906326+0000","last_active":"2023-08-10T11:50:59.514695+0000","last_peered":"2023-08-10T11:50:59.514695+0000","last_clean":"2023-08-10T11:50:59.514695+0000","last_became_active":"2023-08-10T11:50:53.906017+0000","last_became_peered":"2023-08-10T11:50:53.906017+0000","last_unstale":"2023-08-10T11:50:59.514695+0000","last_undegraded":"2023-08-10T11:50:59.514695+0000","last_fullsized":"2023-08-10T11:50:59.514695+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:20:21.219007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344921+0000","last_change":"2023-08-10T11:50:54.906513+0000","last_active":"2023-08-10T11:50:56.344921+0000","last_peered":"2023-08-10T11:50:56.344921+0000","last_clean":"2023-08-10T11:50:56.344921+0000","last_became_active":"2023-08-10T11:50:54.901642+0000","last_became_peered":"2023-08-10T11:50:54.901642+0000","last_unstale":"2023-08-10T11:50:56.344921+0000","last_undegraded":"2023-08-10T11:50:56.344921+0000","last_fullsized":"2023-08-10T11:50:56.344921+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:37.030936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'9","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:04.689050+0000","last_change":"2023-08-10T11:50:53.908025+0000","last_active":"2023-08-10T11:51:04.689050+0000","last_peered":"2023-08-10T11:51:04.689050+0000","last_clean":"2023-08-10T11:51:04.689050+0000","last_became_active":"2023-08-10T11:50:53.907745+0000","last_became_peered":"2023-08-10T11:50:53.907745+0000","last_unstale":"2023-08-10T11:51:04.689050+0000","last_undegraded":"2023-08-10T11:51:04.689050+0000","last_fullsized":"2023-08-10T11:51:04.689050+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:08:55.888721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345237+0000","last_change":"2023-08-10T11:50:54.958653+0000","last_active":"2023-08-10T11:50:56.345237+0000","last_peered":"2023-08-10T11:50:56.345237+0000","last_clean":"2023-08-10T11:50:56.345237+0000","last_became_active":"2023-08-10T11:50:54.958281+0000","last_became_peered":"2023-08-10T11:50:54.958281+0000","last_unstale":"2023-08-10T11:50:56.345237+0000","last_undegraded":"2023-08-10T11:50:56.345237+0000","last_fullsized":"2023-08-10T11:50:56.345237+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:09:50.615524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.533762+0000","last_change":"2023-08-10T11:50:53.895770+0000","last_active":"2023-08-10T11:51:00.533762+0000","last_peered":"2023-08-10T11:51:00.533762+0000","last_clean":"2023-08-10T11:51:00.533762+0000","last_became_active":"2023-08-10T11:50:53.895433+0000","last_became_peered":"2023-08-10T11:50:53.895433+0000","last_unstale":"2023-08-10T11:51:00.533762+0000","last_undegraded":"2023-08-10T11:51:00.533762+0000","last_fullsized":"2023-08-10T11:51:00.533762+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:22:23.820523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345697+0000","last_change":"2023-08-10T11:50:54.957297+0000","last_active":"2023-08-10T11:50:56.345697+0000","last_peered":"2023-08-10T11:50:56.345697+0000","last_clean":"2023-08-10T11:50:56.345697+0000","last_became_active":"2023-08-10T11:50:54.956966+0000","last_became_peered":"2023-08-10T11:50:54.956966+0000","last_unstale":"2023-08-10T11:50:56.345697+0000","last_undegraded":"2023-08-10T11:50:56.345697+0000","last_fullsized":"2023-08-10T11:50:56.345697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:56:06.035708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:57.926624+0000","last_change":"2023-08-10T11:50:53.897792+0000","last_active":"2023-08-10T11:50:57.926624+0000","last_peered":"2023-08-10T11:50:57.926624+0000","last_clean":"2023-08-10T11:50:57.926624+0000","last_became_active":"2023-08-10T11:50:53.897489+0000","last_became_peered":"2023-08-10T11:50:53.897489+0000","last_unstale":"2023-08-10T11:50:57.926624+0000","last_undegraded":"2023-08-10T11:50:57.926624+0000","last_fullsized":"2023-08-10T11:50:57.926624+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:00.460709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344719+0000","last_change":"2023-08-10T11:50:54.908185+0000","last_active":"2023-08-10T11:50:56.344719+0000","last_peered":"2023-08-10T11:50:56.344719+0000","last_clean":"2023-08-10T11:50:56.344719+0000","last_became_active":"2023-08-10T11:50:54.907649+0000","last_became_peered":"2023-08-10T11:50:54.907649+0000","last_unstale":"2023-08-10T11:50:56.344719+0000","last_undegraded":"2023-08-10T11:50:56.344719+0000","last_fullsized":"2023-08-10T11:50:56.344719+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:33:01.523501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.530584+0000","last_change":"2023-08-10T11:50:53.908748+0000","last_active":"2023-08-10T11:51:00.530584+0000","last_peered":"2023-08-10T11:51:00.530584+0000","last_clean":"2023-08-10T11:51:00.530584+0000","last_became_active":"2023-08-10T11:50:53.908494+0000","last_became_peered":"2023-08-10T11:50:53.908494+0000","last_unstale":"2023-08-10T11:51:00.530584+0000","last_undegraded":"2023-08-10T11:51:00.530584+0000","last_fullsized":"2023-08-10T11:51:00.530584+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:14:25.414218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.144690+0000","last_change":"2023-08-10T11:50:54.903493+0000","last_active":"2023-08-10T11:50:56.144690+0000","last_peered":"2023-08-10T11:50:56.144690+0000","last_clean":"2023-08-10T11:50:56.144690+0000","last_became_active":"2023-08-10T11:50:54.903118+0000","last_became_peered":"2023-08-10T11:50:54.903118+0000","last_unstale":"2023-08-10T11:50:56.144690+0000","last_undegraded":"2023-08-10T11:50:56.144690+0000","last_fullsized":"2023-08-10T11:50:56.144690+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:41:27.663597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.769273+0000","last_change":"2023-08-10T11:50:53.905075+0000","last_active":"2023-08-10T11:51:00.769273+0000","last_peered":"2023-08-10T11:51:00.769273+0000","last_clean":"2023-08-10T11:51:00.769273+0000","last_became_active":"2023-08-10T11:50:53.904769+0000","last_became_peered":"2023-08-10T11:50:53.904769+0000","last_unstale":"2023-08-10T11:51:00.769273+0000","last_undegraded":"2023-08-10T11:51:00.769273+0000","last_fullsized":"2023-08-10T11:51:00.769273+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:35:05.694028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345444+0000","last_change":"2023-08-10T11:50:54.963860+0000","last_active":"2023-08-10T11:50:56.345444+0000","last_peered":"2023-08-10T11:50:56.345444+0000","last_clean":"2023-08-10T11:50:56.345444+0000","last_became_active":"2023-08-10T11:50:54.963335+0000","last_became_peered":"2023-08-10T11:50:54.963335+0000","last_unstale":"2023-08-10T11:50:56.345444+0000","last_undegraded":"2023-08-10T11:50:56.345444+0000","last_fullsized":"2023-08-10T11:50:56.345444+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:49:24.482539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:57.926745+0000","last_change":"2023-08-10T11:50:53.899673+0000","last_active":"2023-08-10T11:50:57.926745+0000","last_peered":"2023-08-10T11:50:57.926745+0000","last_clean":"2023-08-10T11:50:57.926745+0000","last_became_active":"2023-08-10T11:50:53.898830+0000","last_became_peered":"2023-08-10T11:50:53.898830+0000","last_unstale":"2023-08-10T11:50:57.926745+0000","last_undegraded":"2023-08-10T11:50:57.926745+0000","last_fullsized":"2023-08-10T11:50:57.926745+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:05:49.369504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473749+0000","last_change":"2023-08-10T11:50:54.900606+0000","last_active":"2023-08-10T11:50:56.473749+0000","last_peered":"2023-08-10T11:50:56.473749+0000","last_clean":"2023-08-10T11:50:56.473749+0000","last_became_active":"2023-08-10T11:50:54.900293+0000","last_became_peered":"2023-08-10T11:50:54.900293+0000","last_unstale":"2023-08-10T11:50:56.473749+0000","last_undegraded":"2023-08-10T11:50:56.473749+0000","last_fullsized":"2023-08-10T11:50:56.473749+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:02:51.178951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'6","reported_seq":59,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:36.580367+0000","last_change":"2023-08-10T11:50:53.894526+0000","last_active":"2023-08-10T11:51:36.580367+0000","last_peered":"2023-08-10T11:51:36.580367+0000","last_clean":"2023-08-10T11:51:36.580367+0000","last_became_active":"2023-08-10T11:50:53.894211+0000","last_became_peered":"2023-08-10T11:50:53.894211+0000","last_unstale":"2023-08-10T11:51:36.580367+0000","last_undegraded":"2023-08-10T11:51:36.580367+0000","last_fullsized":"2023-08-10T11:51:36.580367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:22:57.718753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1512,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.474091+0000","last_change":"2023-08-10T11:50:54.900511+0000","last_active":"2023-08-10T11:50:56.474091+0000","last_peered":"2023-08-10T11:50:56.474091+0000","last_clean":"2023-08-10T11:50:56.474091+0000","last_became_active":"2023-08-10T11:50:54.900200+0000","last_became_peered":"2023-08-10T11:50:54.900200+0000","last_unstale":"2023-08-10T11:50:56.474091+0000","last_undegraded":"2023-08-10T11:50:56.474091+0000","last_fullsized":"2023-08-10T11:50:56.474091+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:38:02.690516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:59.513492+0000","last_change":"2023-08-10T11:50:53.906235+0000","last_active":"2023-08-10T11:50:59.513492+0000","last_peered":"2023-08-10T11:50:59.513492+0000","last_clean":"2023-08-10T11:50:59.513492+0000","last_became_active":"2023-08-10T11:50:53.905630+0000","last_became_peered":"2023-08-10T11:50:53.905630+0000","last_unstale":"2023-08-10T11:50:59.513492+0000","last_undegraded":"2023-08-10T11:50:59.513492+0000","last_fullsized":"2023-08-10T11:50:59.513492+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:02:06.292606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473871+0000","last_change":"2023-08-10T11:50:54.907280+0000","last_active":"2023-08-10T11:50:56.473871+0000","last_peered":"2023-08-10T11:50:56.473871+0000","last_clean":"2023-08-10T11:50:56.473871+0000","last_became_active":"2023-08-10T11:50:54.906987+0000","last_became_peered":"2023-08-10T11:50:54.906987+0000","last_unstale":"2023-08-10T11:50:56.473871+0000","last_undegraded":"2023-08-10T11:50:56.473871+0000","last_fullsized":"2023-08-10T11:50:56.473871+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:18:49.513833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.530122+0000","last_change":"2023-08-10T11:50:53.906537+0000","last_active":"2023-08-10T11:51:00.530122+0000","last_peered":"2023-08-10T11:51:00.530122+0000","last_clean":"2023-08-10T11:51:00.530122+0000","last_became_active":"2023-08-10T11:50:53.905975+0000","last_became_peered":"2023-08-10T11:50:53.905975+0000","last_unstale":"2023-08-10T11:51:00.530122+0000","last_undegraded":"2023-08-10T11:51:00.530122+0000","last_fullsized":"2023-08-10T11:51:00.530122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:10:16.188995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473972+0000","last_change":"2023-08-10T11:50:54.905656+0000","last_active":"2023-08-10T11:50:56.473972+0000","last_peered":"2023-08-10T11:50:56.473972+0000","last_clean":"2023-08-10T11:50:56.473972+0000","last_became_active":"2023-08-10T11:50:54.905314+0000","last_became_peered":"2023-08-10T11:50:54.905314+0000","last_unstale":"2023-08-10T11:50:56.473972+0000","last_undegraded":"2023-08-10T11:50:56.473972+0000","last_fullsized":"2023-08-10T11:50:56.473972+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:15:27.734994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.144767+0000","last_change":"2023-08-10T11:50:54.911564+0000","last_active":"2023-08-10T11:50:56.144767+0000","last_peered":"2023-08-10T11:50:56.144767+0000","last_clean":"2023-08-10T11:50:56.144767+0000","last_became_active":"2023-08-10T11:50:54.910375+0000","last_became_peered":"2023-08-10T11:50:54.910375+0000","last_unstale":"2023-08-10T11:50:56.144767+0000","last_undegraded":"2023-08-10T11:50:56.144767+0000","last_fullsized":"2023-08-10T11:50:56.144767+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:19:14.914729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890590+0000","last_change":"2023-08-10T11:50:54.913247+0000","last_active":"2023-08-10T11:50:55.890590+0000","last_peered":"2023-08-10T11:50:55.890590+0000","last_clean":"2023-08-10T11:50:55.890590+0000","last_became_active":"2023-08-10T11:50:54.912941+0000","last_became_peered":"2023-08-10T11:50:54.912941+0000","last_unstale":"2023-08-10T11:50:55.890590+0000","last_undegraded":"2023-08-10T11:50:55.890590+0000","last_fullsized":"2023-08-10T11:50:55.890590+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:06:23.875486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890580+0000","last_change":"2023-08-10T11:50:54.959735+0000","last_active":"2023-08-10T11:50:55.890580+0000","last_peered":"2023-08-10T11:50:55.890580+0000","last_clean":"2023-08-10T11:50:55.890580+0000","last_became_active":"2023-08-10T11:50:54.959476+0000","last_became_peered":"2023-08-10T11:50:54.959476+0000","last_unstale":"2023-08-10T11:50:55.890580+0000","last_undegraded":"2023-08-10T11:50:55.890580+0000","last_fullsized":"2023-08-10T11:50:55.890580+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:56:57.761286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344964+0000","last_change":"2023-08-10T11:50:54.942753+0000","last_active":"2023-08-10T11:50:56.344964+0000","last_peered":"2023-08-10T11:50:56.344964+0000","last_clean":"2023-08-10T11:50:56.344964+0000","last_became_active":"2023-08-10T11:50:54.941715+0000","last_became_peered":"2023-08-10T11:50:54.941715+0000","last_unstale":"2023-08-10T11:50:56.344964+0000","last_undegraded":"2023-08-10T11:50:56.344964+0000","last_fullsized":"2023-08-10T11:50:56.344964+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:09:18.140936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345055+0000","last_change":"2023-08-10T11:50:54.898919+0000","last_active":"2023-08-10T11:50:56.345055+0000","last_peered":"2023-08-10T11:50:56.345055+0000","last_clean":"2023-08-10T11:50:56.345055+0000","last_became_active":"2023-08-10T11:50:54.898599+0000","last_became_peered":"2023-08-10T11:50:54.898599+0000","last_unstale":"2023-08-10T11:50:56.345055+0000","last_undegraded":"2023-08-10T11:50:56.345055+0000","last_fullsized":"2023-08-10T11:50:56.345055+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:48:49.804005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.145117+0000","last_change":"2023-08-10T11:50:54.911359+0000","last_active":"2023-08-10T11:50:56.145117+0000","last_peered":"2023-08-10T11:50:56.145117+0000","last_clean":"2023-08-10T11:50:56.145117+0000","last_became_active":"2023-08-10T11:50:54.911049+0000","last_became_peered":"2023-08-10T11:50:54.911049+0000","last_unstale":"2023-08-10T11:50:56.145117+0000","last_undegraded":"2023-08-10T11:50:56.145117+0000","last_fullsized":"2023-08-10T11:50:56.145117+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:09:44.046537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890718+0000","last_change":"2023-08-10T11:50:54.906811+0000","last_active":"2023-08-10T11:50:55.890718+0000","last_peered":"2023-08-10T11:50:55.890718+0000","last_clean":"2023-08-10T11:50:55.890718+0000","last_became_active":"2023-08-10T11:50:54.906456+0000","last_became_peered":"2023-08-10T11:50:54.906456+0000","last_unstale":"2023-08-10T11:50:55.890718+0000","last_undegraded":"2023-08-10T11:50:55.890718+0000","last_fullsized":"2023-08-10T11:50:55.890718+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:39:05.932046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345108+0000","last_change":"2023-08-10T11:50:54.957297+0000","last_active":"2023-08-10T11:50:56.345108+0000","last_peered":"2023-08-10T11:50:56.345108+0000","last_clean":"2023-08-10T11:50:56.345108+0000","last_became_active":"2023-08-10T11:50:54.956977+0000","last_became_peered":"2023-08-10T11:50:54.956977+0000","last_unstale":"2023-08-10T11:50:56.345108+0000","last_undegraded":"2023-08-10T11:50:56.345108+0000","last_fullsized":"2023-08-10T11:50:56.345108+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:45:21.997235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345139+0000","last_change":"2023-08-10T11:50:54.964300+0000","last_active":"2023-08-10T11:50:56.345139+0000","last_peered":"2023-08-10T11:50:56.345139+0000","last_clean":"2023-08-10T11:50:56.345139+0000","last_became_active":"2023-08-10T11:50:54.963876+0000","last_became_peered":"2023-08-10T11:50:54.963876+0000","last_unstale":"2023-08-10T11:50:56.345139+0000","last_undegraded":"2023-08-10T11:50:56.345139+0000","last_fullsized":"2023-08-10T11:50:56.345139+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:24:23.291049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344840+0000","last_change":"2023-08-10T11:50:54.958661+0000","last_active":"2023-08-10T11:50:56.344840+0000","last_peered":"2023-08-10T11:50:56.344840+0000","last_clean":"2023-08-10T11:50:56.344840+0000","last_became_active":"2023-08-10T11:50:54.958342+0000","last_became_peered":"2023-08-10T11:50:54.958342+0000","last_unstale":"2023-08-10T11:50:56.344840+0000","last_undegraded":"2023-08-10T11:50:56.344840+0000","last_fullsized":"2023-08-10T11:50:56.344840+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:04:39.541590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.892490+0000","last_change":"2023-08-10T11:50:54.902033+0000","last_active":"2023-08-10T11:50:55.892490+0000","last_peered":"2023-08-10T11:50:55.892490+0000","last_clean":"2023-08-10T11:50:55.892490+0000","last_became_active":"2023-08-10T11:50:54.901713+0000","last_became_peered":"2023-08-10T11:50:54.901713+0000","last_unstale":"2023-08-10T11:50:55.892490+0000","last_undegraded":"2023-08-10T11:50:55.892490+0000","last_fullsized":"2023-08-10T11:50:55.892490+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:19:46.017158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345900+0000","last_change":"2023-08-10T11:50:54.899377+0000","last_active":"2023-08-10T11:50:56.345900+0000","last_peered":"2023-08-10T11:50:56.345900+0000","last_clean":"2023-08-10T11:50:56.345900+0000","last_became_active":"2023-08-10T11:50:54.898657+0000","last_became_peered":"2023-08-10T11:50:54.898657+0000","last_unstale":"2023-08-10T11:50:56.345900+0000","last_undegraded":"2023-08-10T11:50:56.345900+0000","last_fullsized":"2023-08-10T11:50:56.345900+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:44:32.788127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.144836+0000","last_change":"2023-08-10T11:50:54.900304+0000","last_active":"2023-08-10T11:50:56.144836+0000","last_peered":"2023-08-10T11:50:56.144836+0000","last_clean":"2023-08-10T11:50:56.144836+0000","last_became_active":"2023-08-10T11:50:54.899978+0000","last_became_peered":"2023-08-10T11:50:54.899978+0000","last_unstale":"2023-08-10T11:50:56.144836+0000","last_undegraded":"2023-08-10T11:50:56.144836+0000","last_fullsized":"2023-08-10T11:50:56.144836+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:11:52.447215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62861,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":442,"num_read_kb":289,"num_write":229,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":188583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449109,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":430377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Aug 10 11:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Aug 10 11:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Aug 10 11:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.63200000000000001}]},{"osd":5,"last update":"Thu Aug 10 11:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Aug 10 11:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Aug 10 11:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.752},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.73899999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":9,"last update":"Thu Aug 10 11:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.82999999999999996}]},{"osd":10,"last update":"Thu Aug 10 11:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.77000000000000002}]}]},{"osd":10,"up_from":70,"seq":300647710745,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28576,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716576,"statfs":{"total":95995035648,"available":95965773824,"internally_reserved":0,"allocated":1597440,"data_stored":1076932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.495},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.84999999999999998}]},{"osd":3,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.63200000000000001}]},{"osd":5,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.80000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":8,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.73399999999999999}]},{"osd":9,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.878},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.70099999999999996}]},{"osd":11,"last update":"Thu Aug 10 11:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.91200000000000003}]}]},{"osd":9,"up_from":65,"seq":279172874270,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":429965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.39400000000000002,"15min":0.39800000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.41199999999999998,"15min":0.42199999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.499,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.58299999999999996,"15min":0.59199999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.66000000000000003,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.59899999999999998,"15min":0.60999999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70599999999999996,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.63600000000000001}]},{"osd":2,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.61599999999999999,"15min":0.628},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.68300000000000005,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.61599999999999999,"15min":0.628},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73799999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.44500000000000001,"15min":0.45400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.55700000000000005,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.433},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50600000000000001,"15min":0.50900000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.63500000000000001,"15min":0.65200000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.66300000000000003,"5min":0.87,"15min":0.87},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.64000000000000001,"15min":0.65400000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80900000000000005,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.64700000000000002}]},{"osd":5,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.622,"15min":0.622},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.68899999999999995,"15min":0.70199999999999996},"min":{"1min":0.42599999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78600000000000003,"5min":1.032,"15min":1.032},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.61899999999999999,"15min":0.629},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.01,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63700000000000001,"15min":0.64300000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65800000000000003,"15min":0.66600000000000004},"min":{"1min":0.44600000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81299999999999994,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.71799999999999997,"15min":0.73499999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.84899999999999998,"5min":1.133,"15min":1.133},"last":0.622}]},{"osd":8,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.72399999999999998,"15min":0.73999999999999999},"min":{"1min":0.45800000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80900000000000005,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.95199999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.57099999999999995}]},{"osd":10,"last update":"Thu Aug 10 11:50:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.67400000000000004}]}]},{"osd":8,"up_from":57,"seq":244813135906,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":430343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.433,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.41199999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Aug 10 11:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.61899999999999999,"15min":0.60999999999999999},"min":{"1min":0.501,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.84399999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.627},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.629,"15min":0.625},"min":{"1min":0.46600000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89300000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.77800000000000002}]},{"osd":2,"last update":"Thu Aug 10 11:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.437,"15min":0.43099999999999999},"min":{"1min":0.33900000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.47099999999999997,"15min":0.46500000000000002},"min":{"1min":0.315,"5min":0.248,"15min":0.248},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.72499999999999998}]},{"osd":3,"last update":"Thu Aug 10 11:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.45300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.80200000000000005}]},{"osd":4,"last update":"Thu Aug 10 11:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.60499999999999998,"15min":0.59499999999999997},"min":{"1min":0.52000000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.63900000000000001,"15min":0.626},"min":{"1min":0.49199999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.877}]},{"osd":5,"last update":"Thu Aug 10 11:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58299999999999996,"15min":0.58199999999999996},"min":{"1min":0.35099999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.56100000000000005,"15min":0.55300000000000005},"min":{"1min":0.39100000000000001,"5min":0.371,"15min":0.371},"max":{"1min":1,"5min":1,"15min":1},"last":0.85299999999999998}]},{"osd":6,"last update":"Thu Aug 10 11:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73799999999999999,"15min":0.73899999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.98399999999999999}]},{"osd":7,"last update":"Thu Aug 10 11:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.77000000000000002,"15min":0.76500000000000001},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":1.121},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.71799999999999997,"15min":0.71199999999999997},"min":{"1min":0.60599999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":1.133}]},{"osd":9,"last update":"Thu Aug 10 11:51:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72499999999999998,"15min":0.71999999999999997},"min":{"1min":0.58299999999999996,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78200000000000003,"15min":0.77600000000000002},"min":{"1min":0.54500000000000004,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":1.081}]},{"osd":10,"last update":"Thu Aug 10 11:50:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":1.0469999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]}]},{"osd":7,"up_from":50,"seq":214748364838,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1519616,"data_stored":1022059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.54500000000000004,"15min":0.53100000000000003},"min":{"1min":0.42099999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.51500000000000001,"15min":0.503},"min":{"1min":0.434,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.40899999999999997}]},{"osd":1,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.41699999999999998,"15min":0.40699999999999997},"min":{"1min":0.308,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.439,"15min":0.42699999999999999},"min":{"1min":0.307,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.42299999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77900000000000003,"5min":0.878,"15min":0.878},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59799999999999998,"15min":0.59099999999999997},"min":{"1min":0.45700000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82999999999999996,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.60299999999999998}]},{"osd":3,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.54300000000000004,"15min":0.53000000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.52600000000000002,"15min":0.51700000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.44600000000000001}]},{"osd":5,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.47599999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89400000000000002,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.64100000000000001,"15min":0.63200000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.69699999999999995,"15min":0.68200000000000005},"min":{"1min":0.53900000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.502,"5min":0.497,"15min":0.497},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.62}]},{"osd":8,"last update":"Thu Aug 10 11:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.752,"15min":0.751},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.96199999999999997,"5min":1.002,"15min":1.002},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.748,"15min":0.752},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.91300000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.78100000000000003}]},{"osd":9,"last update":"Thu Aug 10 11:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76100000000000001,"15min":0.75900000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.82299999999999995,"15min":0.82499999999999996},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.0449999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.76300000000000001}]},{"osd":10,"last update":"Thu Aug 10 11:50:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.69699999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]}]},{"osd":6,"up_from":45,"seq":193273528363,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":429640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.46700000000000003,"15min":0.38900000000000001},"min":{"1min":0.27500000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":8.9930000000000003,"5min":8.9930000000000003,"15min":8.9930000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":1.03,"5min":0.52900000000000003,"15min":0.434},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":12.326000000000001,"5min":12.326000000000001,"15min":12.326000000000001},"last":0.32600000000000001}]},{"osd":1,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":0.66600000000000004,"15min":0.56399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":11.275,"5min":11.275,"15min":11.275},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.56899999999999995,"15min":0.53800000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.6909999999999998,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":0.69499999999999995,"15min":0.60599999999999998},"min":{"1min":0.40000000000000002,"5min":0.38,"15min":0.38},"max":{"1min":12.244,"5min":12.244,"15min":12.244},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.1619999999999999,"5min":0.68400000000000005,"15min":0.60799999999999998},"min":{"1min":0.443,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":11.195,"5min":11.195,"15min":11.195},"last":0.83399999999999996}]},{"osd":3,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.54300000000000004,"15min":0.44700000000000001},"min":{"1min":0.29799999999999999,"5min":0.254,"15min":0.254},"max":{"1min":11.439,"5min":11.439,"15min":11.439},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.48599999999999999,"15min":0.46800000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":0.70099999999999996,"15min":0.60499999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":12.272,"5min":12.272,"15min":12.272},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.216,"5min":0.72099999999999997,"15min":0.623},"min":{"1min":0.45300000000000001,"5min":0.433,"15min":0.433},"max":{"1min":11.35,"5min":11.35,"15min":11.35},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.63600000000000001,"15min":0.61599999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":0.626},{"interface":"front","average":{"1min":1.2250000000000001,"5min":0.746,"15min":0.66200000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":12.177,"5min":12.177,"15min":12.177},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65000000000000002,"15min":0.64400000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.65900000000000003,"15min":0.65100000000000002},"min":{"1min":0.53000000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.60399999999999998}]},{"osd":8,"last update":"Thu Aug 10 11:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.67500000000000004,"15min":0.68400000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.69699999999999995,"15min":0.70799999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.876,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.55100000000000005}]},{"osd":9,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":0.77900000000000003,"15min":0.71599999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":12.300000000000001,"5min":12.300000000000001,"15min":12.300000000000001},"last":0.498},{"interface":"front","average":{"1min":1.1539999999999999,"5min":0.78500000000000003,"15min":0.72299999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":11.411,"5min":11.411,"15min":11.411},"last":0.50800000000000001}]},{"osd":10,"last update":"Thu Aug 10 11:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.77900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":486788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52200000000000002,"15min":0.51100000000000001},"min":{"1min":0.378,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.52400000000000002,"15min":0.51400000000000001},"min":{"1min":0.376,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77800000000000002,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Aug 10 11:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.60999999999999999,"15min":0.58399999999999996},"min":{"1min":0.5,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.58699999999999997,"15min":0.56399999999999995},"min":{"1min":0.57299999999999995,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Aug 10 11:51:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.55200000000000005},"min":{"1min":0.37,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79500000000000004,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.41099999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.56599999999999995}]},{"osd":4,"last update":"Thu Aug 10 11:50:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.44,"15min":0.439},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.65400000000000003,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.47399999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Aug 10 11:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.57399999999999995,"15min":0.54000000000000004},"min":{"1min":0.48899999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.877,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.58899999999999997,"15min":0.55900000000000005},"min":{"1min":0.41699999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.96499999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.84299999999999997}]},{"osd":6,"last update":"Thu Aug 10 11:51:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65400000000000003,"15min":0.64900000000000002},"min":{"1min":0.42699999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90900000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58499999999999996,"15min":0.58799999999999997},"min":{"1min":0.38,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78200000000000003,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Aug 10 11:50:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.32100000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.92200000000000004,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.77300000000000002}]},{"osd":8,"last update":"Thu Aug 10 11:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.46600000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88100000000000001,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.70199999999999996,"15min":0.69499999999999995},"min":{"1min":0.47899999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.85899999999999999}]},{"osd":9,"last update":"Thu Aug 10 11:51:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.73999999999999999,"15min":0.73099999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97299999999999998,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.67000000000000004},"min":{"1min":0.51500000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85499999999999998,"5min":1.026,"15min":1.026},"last":0.877}]},{"osd":10,"last update":"Thu Aug 10 11:50:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.78800000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738436,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":431363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 11:50:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.54400000000000004,"15min":0.504},"min":{"1min":0.51600000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.54600000000000004,"15min":0.52200000000000002},"min":{"1min":0.498,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73599999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Aug 10 11:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54000000000000004,"15min":0.52600000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73299999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.499},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56599999999999995,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.76700000000000002,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Aug 10 11:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.34699999999999998,"15min":0.34100000000000003},"min":{"1min":0.26200000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.317},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.35599999999999998,"15min":0.34799999999999998},"min":{"1min":0.29299999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Aug 10 11:50:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.55100000000000005,"15min":0.52900000000000003},"min":{"1min":0.434,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.374},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.53400000000000003,"15min":0.52100000000000002},"min":{"1min":0.45200000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73099999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.40100000000000002}]},{"osd":5,"last update":"Thu Aug 10 11:51:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.754,"5min":0.874,"15min":0.874},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.501,"5min":0.55900000000000005,"15min":0.56299999999999994},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71899999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Aug 10 11:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.77700000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.66100000000000003,"5min":0.872,"15min":0.872},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Aug 10 11:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.498,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.505}]},{"osd":8,"last update":"Thu Aug 10 11:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.69799999999999995,"15min":0.71499999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.67900000000000005,"15min":0.69299999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.58099999999999996}]},{"osd":9,"last update":"Thu Aug 10 11:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.59999999999999998,"15min":0.61399999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67900000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.69499999999999995,"15min":0.72099999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79100000000000004,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.54200000000000004}]},{"osd":10,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.63},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.61699999999999999}]},{"osd":11,"last update":"Thu Aug 10 11:51:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.52200000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411388,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":487350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:51:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53700000000000003,"15min":0.50800000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.85299999999999998,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53700000000000003,"15min":0.51500000000000001},"min":{"1min":0.33400000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81100000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Aug 10 11:51:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54400000000000004,"15min":0.52000000000000002},"min":{"1min":0.36799999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.48699999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90600000000000003,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.70399999999999996}]},{"osd":3,"last update":"Thu Aug 10 11:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.64300000000000002,"15min":0.68500000000000005},"min":{"1min":0.433,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86699999999999999,"5min":3.7519999999999998,"15min":3.7519999999999998},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52000000000000002,"15min":0.495},"min":{"1min":0.36699999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74399999999999999,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.65600000000000003,"15min":0.67600000000000005},"min":{"1min":0.45900000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.85199999999999998,"5min":3.6960000000000002,"15min":3.6960000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.58899999999999997,"15min":0.55300000000000005},"min":{"1min":0.44500000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.56399999999999995}]},{"osd":5,"last update":"Thu Aug 10 11:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47399999999999998,"15min":0.46999999999999997},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.439,"15min":0.43099999999999999},"min":{"1min":0.32900000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.64800000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.42999999999999999}]},{"osd":6,"last update":"Thu Aug 10 11:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58199999999999996,"15min":0.56299999999999994},"min":{"1min":0.46300000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85999999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66200000000000003,"15min":0.64800000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.91300000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.73899999999999999,"15min":0.73799999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.503}]},{"osd":8,"last update":"Thu Aug 10 11:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.36599999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.41199999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.79600000000000004}]},{"osd":9,"last update":"Thu Aug 10 11:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.82999999999999996,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.70499999999999996,"15min":0.70699999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.82899999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.59999999999999998}]},{"osd":10,"last update":"Thu Aug 10 11:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.74199999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":3,"up_from":25,"seq":107374182456,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":429519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:51:23 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36099999999999999,"15min":0.35999999999999999},"min":{"1min":0.27100000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.36799999999999999,"15min":0.35899999999999999},"min":{"1min":0.25800000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.61099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Aug 10 11:51:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.374,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82199999999999995,"5min":0.875,"15min":0.875},"last":2.2629999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.55500000000000005},"min":{"1min":0.42699999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Aug 10 11:51:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.57199999999999995,"15min":0.55200000000000005},"min":{"1min":0.38,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72099999999999997,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":2.4049999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.58299999999999996,"15min":0.54900000000000004},"min":{"1min":0.38500000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73899999999999999,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Aug 10 11:50:48 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.432,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60499999999999998,"15min":0.59699999999999998},"min":{"1min":0.49299999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Aug 10 11:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58099999999999996,"15min":0.57099999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63100000000000001,"15min":0.61099999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0349999999999999,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":0.70299999999999996}]},{"osd":6,"last update":"Thu Aug 10 11:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.48099999999999998,"15min":0.46700000000000003},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.69699999999999995,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.371},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48299999999999998,"15min":0.46100000000000002},"min":{"1min":0.35499999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":2.3580000000000001}]},{"osd":7,"last update":"Thu Aug 10 11:50:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.52400000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.89800000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":2.3860000000000001}]},{"osd":8,"last update":"Thu Aug 10 11:50:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.67900000000000005}]},{"osd":9,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.627,"15min":0.64500000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83999999999999997,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":2.294},{"interface":"front","average":{"1min":0.505,"5min":0.621,"15min":0.64100000000000001},"min":{"1min":0.38100000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.85699999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.49299999999999999}]},{"osd":10,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":2.323},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.64800000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.375}]}]},{"osd":4,"up_from":32,"seq":137438953524,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":429495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54200000000000004,"15min":0.51400000000000001},"min":{"1min":0.39500000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79700000000000004,"5min":1.875,"15min":1.875},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.54300000000000004,"15min":0.51700000000000002},"min":{"1min":0.40899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Aug 10 11:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.41399999999999998,"15min":0.40300000000000002},"min":{"1min":0.29299999999999998,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.71599999999999997,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.41699999999999998,"15min":0.39800000000000002},"min":{"1min":0.311,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Aug 10 11:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Aug 10 11:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.57399999999999995,"15min":0.54300000000000004},"min":{"1min":0.51800000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84899999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.36899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81499999999999995,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.76000000000000001}]},{"osd":5,"last update":"Thu Aug 10 11:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60999999999999999,"15min":0.59599999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82499999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.621,"15min":0.59299999999999997},"min":{"1min":0.495,"5min":0.374,"15min":0.374},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67100000000000004,"15min":0.67200000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92000000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83099999999999996,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.79400000000000004}]},{"osd":7,"last update":"Thu Aug 10 11:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.56299999999999994,"15min":0.54300000000000004},"min":{"1min":0.41099999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.54000000000000004,"15min":0.52600000000000002},"min":{"1min":0.36699999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.63200000000000001}]},{"osd":8,"last update":"Thu Aug 10 11:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.70799999999999996,"15min":0.70299999999999996},"min":{"1min":0.52300000000000002,"5min":0.441,"15min":0.441},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.60399999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.77600000000000002}]},{"osd":9,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.68500000000000005}]},{"osd":10,"last update":"Thu Aug 10 11:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.74299999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]}]},{"osd":5,"up_from":37,"seq":158913789999,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1527808,"data_stored":1021502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70599999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.746,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.51200000000000001}]},{"osd":1,"last update":"Thu Aug 10 11:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.53300000000000003,"15min":0.51900000000000002},"min":{"1min":0.38200000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73999999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.55900000000000005,"15min":0.54100000000000004},"min":{"1min":0.42899999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Aug 10 11:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.40000000000000002,"15min":0.38400000000000001},"min":{"1min":0.30399999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61299999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.41399999999999998,"15min":0.40200000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.65500000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Aug 10 11:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.34300000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.443},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38100000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Aug 10 11:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59999999999999998,"15min":0.58799999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80000000000000004,"5min":1.109,"15min":1.109},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.39100000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76600000000000001,"5min":1.002,"15min":1.002},"last":0.625}]},{"osd":6,"last update":"Thu Aug 10 11:51:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.60799999999999998,"15min":0.58199999999999996},"min":{"1min":0.46700000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.64700000000000002,"15min":0.63900000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90200000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.53800000000000003}]},{"osd":7,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64700000000000002,"15min":0.64500000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.81699999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.58999999999999997}]},{"osd":8,"last update":"Thu Aug 10 11:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63100000000000001,"15min":0.627},"min":{"1min":0.42099999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.60699999999999998,"15min":0.60299999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.57999999999999996}]},{"osd":9,"last update":"Thu Aug 10 11:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.73599999999999999,"15min":0.69999999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":5.2999999999999998,"5min":5.2999999999999998,"15min":5.2999999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.73599999999999999,"15min":0.72899999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.69699999999999995}]},{"osd":10,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.68500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":57945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":57929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T11:51:45.013 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph pg dump --format=json 2023-08-10T11:51:45.565 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:45.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:45 smithi152 ceph-mon[130220]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T11:51:45.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:45 smithi152 ceph-mon[130220]: pgmap v281: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-08-10T11:51:46.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:45 smithi156 ceph-mon[130574]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T11:51:46.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:45 smithi156 ceph-mon[130574]: pgmap v281: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-08-10T11:51:46.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:45 smithi073 ceph-mon[128869]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T11:51:46.013 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:45 smithi073 ceph-mon[128869]: pgmap v281: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-08-10T11:51:46.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.954+0000 7f67931f1700 1 -- 172.21.15.73:0/2581589368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678c104580 msgr2=0x7f678c104960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:46.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.954+0000 7f67931f1700 1 --2- 172.21.15.73:0/2581589368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678c104580 0x7f678c104960 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6780009990 tx=0x7f6780009ca0 comp rx=0 tx=0).stop 2023-08-10T11:51:46.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.954+0000 7f67931f1700 1 -- 172.21.15.73:0/2581589368 shutdown_connections 2023-08-10T11:51:46.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.954+0000 7f67931f1700 1 --2- 172.21.15.73:0/2581589368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f678c100070 0x7f678c10c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:46.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.954+0000 7f67931f1700 1 --2- 172.21.15.73:0/2581589368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678c104580 0x7f678c104960 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:46.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.954+0000 7f67931f1700 1 --2- 172.21.15.73:0/2581589368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f678c0ff6b0 0x7f678c0ffb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:46.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.954+0000 7f67931f1700 1 -- 172.21.15.73:0/2581589368 >> 172.21.15.73:0/2581589368 conn(0x7f678c076770 msgr2=0x7f678c076b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:46.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.954+0000 7f67931f1700 1 -- 172.21.15.73:0/2581589368 shutdown_connections 2023-08-10T11:51:46.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.954+0000 7f67931f1700 1 -- 172.21.15.73:0/2581589368 wait complete. 2023-08-10T11:51:46.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.955+0000 7f67931f1700 1 Processor -- start 2023-08-10T11:51:46.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.955+0000 7f67931f1700 1 -- start start 2023-08-10T11:51:46.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.955+0000 7f67931f1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678c0ff6b0 0x7f678c1977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:46.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.955+0000 7f67931f1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f678c100070 0x7f678c197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:46.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.955+0000 7f67931f1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f678c104580 0x7f678c1a2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:46.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.955+0000 7f67931f1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c1a2db0 con 0x7f678c0ff6b0 2023-08-10T11:51:46.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.955+0000 7f67931f1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c1a2ef0 con 0x7f678c104580 2023-08-10T11:51:46.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.955+0000 7f67931f1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c1a3030 con 0x7f678c100070 2023-08-10T11:51:46.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.955+0000 7f6790f8d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678c0ff6b0 0x7f678c1977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:46.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.955+0000 7f6790f8d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678c0ff6b0 0x7f678c1977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59550/0 (socket says 172.21.15.73:59550) 2023-08-10T11:51:46.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.955+0000 7f6790f8d700 1 -- 172.21.15.73:0/2492135269 learned_addr learned my addr 172.21.15.73:0/2492135269 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:46.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.955+0000 7f678bfff700 1 --2- 172.21.15.73:0/2492135269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f678c100070 0x7f678c197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:46.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.955+0000 7f679178e700 1 --2- 172.21.15.73:0/2492135269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f678c104580 0x7f678c1a2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:46.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.955+0000 7f6790f8d700 1 -- 172.21.15.73:0/2492135269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f678c100070 msgr2=0x7f678c197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:46.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.955+0000 7f6790f8d700 1 --2- 172.21.15.73:0/2492135269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f678c100070 0x7f678c197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:46.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.955+0000 7f6790f8d700 1 -- 172.21.15.73:0/2492135269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f678c104580 msgr2=0x7f678c1a2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:46.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.955+0000 7f6790f8d700 1 --2- 172.21.15.73:0/2492135269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f678c104580 0x7f678c1a2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:46.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.955+0000 7f6790f8d700 1 -- 172.21.15.73:0/2492135269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67800095f0 con 0x7f678c0ff6b0 2023-08-10T11:51:46.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.956+0000 7f679178e700 1 --2- 172.21.15.73:0/2492135269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f678c104580 0x7f678c1a2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:46.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.956+0000 7f6790f8d700 1 --2- 172.21.15.73:0/2492135269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678c0ff6b0 0x7f678c1977f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6780000c00 tx=0x7f678000f830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:46.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.956+0000 7f6789ffb700 1 -- 172.21.15.73:0/2492135269 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678001d070 con 0x7f678c0ff6b0 2023-08-10T11:51:46.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.956+0000 7f6789ffb700 1 -- 172.21.15.73:0/2492135269 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f678000fce0 con 0x7f678c0ff6b0 2023-08-10T11:51:46.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.956+0000 7f67931f1700 1 -- 172.21.15.73:0/2492135269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f678c1a3230 con 0x7f678c0ff6b0 2023-08-10T11:51:46.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.956+0000 7f6789ffb700 1 -- 172.21.15.73:0/2492135269 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6780017770 con 0x7f678c0ff6b0 2023-08-10T11:51:46.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.956+0000 7f67931f1700 1 -- 172.21.15.73:0/2492135269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678c1a36f0 con 0x7f678c0ff6b0 2023-08-10T11:51:46.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.957+0000 7f67931f1700 1 -- 172.21.15.73:0/2492135269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f678c04e470 con 0x7f678c0ff6b0 2023-08-10T11:51:46.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.958+0000 7f6789ffb700 1 -- 172.21.15.73:0/2492135269 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f67800178d0 con 0x7f678c0ff6b0 2023-08-10T11:51:46.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.959+0000 7f6789ffb700 1 --2- 172.21.15.73:0/2492135269 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f677c0a1260 0x7f677c0a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:46.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.959+0000 7f678bfff700 1 --2- 172.21.15.73:0/2492135269 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f677c0a1260 0x7f677c0a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:46.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.959+0000 7f6789ffb700 1 -- 172.21.15.73:0/2492135269 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f67800ce150 con 0x7f678c0ff6b0 2023-08-10T11:51:46.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.959+0000 7f678bfff700 1 --2- 172.21.15.73:0/2492135269 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f677c0a1260 0x7f677c0a3720 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6778006fd0 tx=0x7f6778008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:46.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:46.963+0000 7f6789ffb700 1 -- 172.21.15.73:0/2492135269 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f6780097980 con 0x7f678c0ff6b0 2023-08-10T11:51:47.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:47.147+0000 7f67931f1700 1 -- 172.21.15.73:0/2492135269 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f678c0fdc30 con 0x7f677c0a1260 2023-08-10T11:51:47.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:47.157+0000 7f6789ffb700 1 -- 172.21.15.73:0/2492135269 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+341000 (secure 0 0 0) 0x7f678c0fdc30 con 0x7f677c0a1260 2023-08-10T11:51:47.160 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:51:47.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:47.160+0000 7f67931f1700 1 -- 172.21.15.73:0/2492135269 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f677c0a1260 msgr2=0x7f677c0a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:47.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:47.160+0000 7f67931f1700 1 --2- 172.21.15.73:0/2492135269 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f677c0a1260 0x7f677c0a3720 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6778006fd0 tx=0x7f6778008040 comp rx=0 tx=0).stop 2023-08-10T11:51:47.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:47.160+0000 7f67931f1700 1 -- 172.21.15.73:0/2492135269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678c0ff6b0 msgr2=0x7f678c1977f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:47.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:47.160+0000 7f67931f1700 1 --2- 172.21.15.73:0/2492135269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678c0ff6b0 0x7f678c1977f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6780000c00 tx=0x7f678000f830 comp rx=0 tx=0).stop 2023-08-10T11:51:47.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:47.160+0000 7f67931f1700 1 -- 172.21.15.73:0/2492135269 shutdown_connections 2023-08-10T11:51:47.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:47.160+0000 7f67931f1700 1 --2- 172.21.15.73:0/2492135269 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f677c0a1260 0x7f677c0a3720 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:47.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:47.160+0000 7f67931f1700 1 --2- 172.21.15.73:0/2492135269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f678c104580 0x7f678c1a2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:47.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:47.160+0000 7f67931f1700 1 --2- 172.21.15.73:0/2492135269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678c0ff6b0 0x7f678c1977f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:47.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:47.160+0000 7f67931f1700 1 --2- 172.21.15.73:0/2492135269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f678c100070 0x7f678c197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:47.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:47.160+0000 7f67931f1700 1 -- 172.21.15.73:0/2492135269 >> 172.21.15.73:0/2492135269 conn(0x7f678c076770 msgr2=0x7f678c0fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:47.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:47.160+0000 7f67931f1700 1 -- 172.21.15.73:0/2492135269 shutdown_connections 2023-08-10T11:51:47.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:47.160+0000 7f67931f1700 1 -- 172.21.15.73:0/2492135269 wait complete. 2023-08-10T11:51:47.164 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-08-10T11:51:47.619 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":282,"stamp":"2023-08-10T11:51:46.491558+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653475,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":623,"num_read_kb":433,"num_write":412,"num_write_kb":3064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":340,"ondisk_log_size":340,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336944,"kb_used_data":12752,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124604880,"statfs":{"total":1151940427776,"available":1151595397120,"internally_reserved":0,"allocated":13058048,"data_stored":7105333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":77,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003151"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.145138+0000","last_change":"2023-08-10T11:50:54.902569+0000","last_active":"2023-08-10T11:50:56.145138+0000","last_peered":"2023-08-10T11:50:56.145138+0000","last_clean":"2023-08-10T11:50:56.145138+0000","last_became_active":"2023-08-10T11:50:54.902058+0000","last_became_peered":"2023-08-10T11:50:54.902058+0000","last_unstale":"2023-08-10T11:50:56.145138+0000","last_undegraded":"2023-08-10T11:50:56.145138+0000","last_fullsized":"2023-08-10T11:50:56.145138+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:21:13.051534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345827+0000","last_change":"2023-08-10T11:50:54.942908+0000","last_active":"2023-08-10T11:50:56.345827+0000","last_peered":"2023-08-10T11:50:56.345827+0000","last_clean":"2023-08-10T11:50:56.345827+0000","last_became_active":"2023-08-10T11:50:54.941765+0000","last_became_peered":"2023-08-10T11:50:54.941765+0000","last_unstale":"2023-08-10T11:50:56.345827+0000","last_undegraded":"2023-08-10T11:50:56.345827+0000","last_fullsized":"2023-08-10T11:50:56.345827+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:23:25.198276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345991+0000","last_change":"2023-08-10T11:50:54.940670+0000","last_active":"2023-08-10T11:50:56.345991+0000","last_peered":"2023-08-10T11:50:56.345991+0000","last_clean":"2023-08-10T11:50:56.345991+0000","last_became_active":"2023-08-10T11:50:54.939906+0000","last_became_peered":"2023-08-10T11:50:54.939906+0000","last_unstale":"2023-08-10T11:50:56.345991+0000","last_undegraded":"2023-08-10T11:50:56.345991+0000","last_fullsized":"2023-08-10T11:50:56.345991+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:49:22.795335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.135449+0000","last_change":"2023-08-10T11:50:54.910964+0000","last_active":"2023-08-10T11:50:56.135449+0000","last_peered":"2023-08-10T11:50:56.135449+0000","last_clean":"2023-08-10T11:50:56.135449+0000","last_became_active":"2023-08-10T11:50:54.910185+0000","last_became_peered":"2023-08-10T11:50:54.910185+0000","last_unstale":"2023-08-10T11:50:56.135449+0000","last_undegraded":"2023-08-10T11:50:56.135449+0000","last_fullsized":"2023-08-10T11:50:56.135449+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:23:05.579094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344998+0000","last_change":"2023-08-10T11:50:54.905354+0000","last_active":"2023-08-10T11:50:56.344998+0000","last_peered":"2023-08-10T11:50:56.344998+0000","last_clean":"2023-08-10T11:50:56.344998+0000","last_became_active":"2023-08-10T11:50:54.904982+0000","last_became_peered":"2023-08-10T11:50:54.904982+0000","last_unstale":"2023-08-10T11:50:56.344998+0000","last_undegraded":"2023-08-10T11:50:56.344998+0000","last_fullsized":"2023-08-10T11:50:56.344998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:29:30.470234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344628+0000","last_change":"2023-08-10T11:50:54.907024+0000","last_active":"2023-08-10T11:50:56.344628+0000","last_peered":"2023-08-10T11:50:56.344628+0000","last_clean":"2023-08-10T11:50:56.344628+0000","last_became_active":"2023-08-10T11:50:54.906590+0000","last_became_peered":"2023-08-10T11:50:54.906590+0000","last_unstale":"2023-08-10T11:50:56.344628+0000","last_undegraded":"2023-08-10T11:50:56.344628+0000","last_fullsized":"2023-08-10T11:50:56.344628+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:33:20.006347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473505+0000","last_change":"2023-08-10T11:50:54.904604+0000","last_active":"2023-08-10T11:50:56.473505+0000","last_peered":"2023-08-10T11:50:56.473505+0000","last_clean":"2023-08-10T11:50:56.473505+0000","last_became_active":"2023-08-10T11:50:54.904295+0000","last_became_peered":"2023-08-10T11:50:54.904295+0000","last_unstale":"2023-08-10T11:50:56.473505+0000","last_undegraded":"2023-08-10T11:50:56.473505+0000","last_fullsized":"2023-08-10T11:50:56.473505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:11:15.957227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344786+0000","last_change":"2023-08-10T11:50:54.963398+0000","last_active":"2023-08-10T11:50:56.344786+0000","last_peered":"2023-08-10T11:50:56.344786+0000","last_clean":"2023-08-10T11:50:56.344786+0000","last_became_active":"2023-08-10T11:50:54.963048+0000","last_became_peered":"2023-08-10T11:50:54.963048+0000","last_unstale":"2023-08-10T11:50:56.344786+0000","last_undegraded":"2023-08-10T11:50:56.344786+0000","last_fullsized":"2023-08-10T11:50:56.344786+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:05:56.018291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.892886+0000","last_change":"2023-08-10T11:50:54.913426+0000","last_active":"2023-08-10T11:50:55.892886+0000","last_peered":"2023-08-10T11:50:55.892886+0000","last_clean":"2023-08-10T11:50:55.892886+0000","last_became_active":"2023-08-10T11:50:54.913099+0000","last_became_peered":"2023-08-10T11:50:54.913099+0000","last_unstale":"2023-08-10T11:50:55.892886+0000","last_undegraded":"2023-08-10T11:50:55.892886+0000","last_fullsized":"2023-08-10T11:50:55.892886+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:43:10.881941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344828+0000","last_change":"2023-08-10T11:50:54.909259+0000","last_active":"2023-08-10T11:50:56.344828+0000","last_peered":"2023-08-10T11:50:56.344828+0000","last_clean":"2023-08-10T11:50:56.344828+0000","last_became_active":"2023-08-10T11:50:54.908898+0000","last_became_peered":"2023-08-10T11:50:54.908898+0000","last_unstale":"2023-08-10T11:50:56.344828+0000","last_undegraded":"2023-08-10T11:50:56.344828+0000","last_fullsized":"2023-08-10T11:50:56.344828+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:34:33.846938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473995+0000","last_change":"2023-08-10T11:50:54.906152+0000","last_active":"2023-08-10T11:50:56.473995+0000","last_peered":"2023-08-10T11:50:56.473995+0000","last_clean":"2023-08-10T11:50:56.473995+0000","last_became_active":"2023-08-10T11:50:54.905859+0000","last_became_peered":"2023-08-10T11:50:54.905859+0000","last_unstale":"2023-08-10T11:50:56.473995+0000","last_undegraded":"2023-08-10T11:50:56.473995+0000","last_fullsized":"2023-08-10T11:50:56.473995+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:58:19.059881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.135354+0000","last_change":"2023-08-10T11:50:54.911195+0000","last_active":"2023-08-10T11:50:56.135354+0000","last_peered":"2023-08-10T11:50:56.135354+0000","last_clean":"2023-08-10T11:50:56.135354+0000","last_became_active":"2023-08-10T11:50:54.910618+0000","last_became_peered":"2023-08-10T11:50:54.910618+0000","last_unstale":"2023-08-10T11:50:56.135354+0000","last_undegraded":"2023-08-10T11:50:56.135354+0000","last_fullsized":"2023-08-10T11:50:56.135354+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:09:17.323010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.346048+0000","last_change":"2023-08-10T11:50:54.908051+0000","last_active":"2023-08-10T11:50:56.346048+0000","last_peered":"2023-08-10T11:50:56.346048+0000","last_clean":"2023-08-10T11:50:56.346048+0000","last_became_active":"2023-08-10T11:50:54.907772+0000","last_became_peered":"2023-08-10T11:50:54.907772+0000","last_unstale":"2023-08-10T11:50:56.346048+0000","last_undegraded":"2023-08-10T11:50:56.346048+0000","last_fullsized":"2023-08-10T11:50:56.346048+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:37:48.360047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344774+0000","last_change":"2023-08-10T11:50:54.941327+0000","last_active":"2023-08-10T11:50:56.344774+0000","last_peered":"2023-08-10T11:50:56.344774+0000","last_clean":"2023-08-10T11:50:56.344774+0000","last_became_active":"2023-08-10T11:50:54.941020+0000","last_became_peered":"2023-08-10T11:50:54.941020+0000","last_unstale":"2023-08-10T11:50:56.344774+0000","last_undegraded":"2023-08-10T11:50:56.344774+0000","last_fullsized":"2023-08-10T11:50:56.344774+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:57:02.124392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345409+0000","last_change":"2023-08-10T11:50:54.940236+0000","last_active":"2023-08-10T11:50:56.345409+0000","last_peered":"2023-08-10T11:50:56.345409+0000","last_clean":"2023-08-10T11:50:56.345409+0000","last_became_active":"2023-08-10T11:50:54.939921+0000","last_became_peered":"2023-08-10T11:50:54.939921+0000","last_unstale":"2023-08-10T11:50:56.345409+0000","last_undegraded":"2023-08-10T11:50:56.345409+0000","last_fullsized":"2023-08-10T11:50:56.345409+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:16:17.977836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.892426+0000","last_change":"2023-08-10T11:50:54.903773+0000","last_active":"2023-08-10T11:50:55.892426+0000","last_peered":"2023-08-10T11:50:55.892426+0000","last_clean":"2023-08-10T11:50:55.892426+0000","last_became_active":"2023-08-10T11:50:54.903516+0000","last_became_peered":"2023-08-10T11:50:54.903516+0000","last_unstale":"2023-08-10T11:50:55.892426+0000","last_undegraded":"2023-08-10T11:50:55.892426+0000","last_fullsized":"2023-08-10T11:50:55.892426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:09:52.443125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.145193+0000","last_change":"2023-08-10T11:50:54.902364+0000","last_active":"2023-08-10T11:50:56.145193+0000","last_peered":"2023-08-10T11:50:56.145193+0000","last_clean":"2023-08-10T11:50:56.145193+0000","last_became_active":"2023-08-10T11:50:54.901673+0000","last_became_peered":"2023-08-10T11:50:54.901673+0000","last_unstale":"2023-08-10T11:50:56.145193+0000","last_undegraded":"2023-08-10T11:50:56.145193+0000","last_fullsized":"2023-08-10T11:50:56.145193+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:45:10.264196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890715+0000","last_change":"2023-08-10T11:50:54.911896+0000","last_active":"2023-08-10T11:50:55.890715+0000","last_peered":"2023-08-10T11:50:55.890715+0000","last_clean":"2023-08-10T11:50:55.890715+0000","last_became_active":"2023-08-10T11:50:54.911469+0000","last_became_peered":"2023-08-10T11:50:54.911469+0000","last_unstale":"2023-08-10T11:50:55.890715+0000","last_undegraded":"2023-08-10T11:50:55.890715+0000","last_fullsized":"2023-08-10T11:50:55.890715+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:35:08.075353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890571+0000","last_change":"2023-08-10T11:50:54.964030+0000","last_active":"2023-08-10T11:50:55.890571+0000","last_peered":"2023-08-10T11:50:55.890571+0000","last_clean":"2023-08-10T11:50:55.890571+0000","last_became_active":"2023-08-10T11:50:54.963744+0000","last_became_peered":"2023-08-10T11:50:54.963744+0000","last_unstale":"2023-08-10T11:50:55.890571+0000","last_undegraded":"2023-08-10T11:50:55.890571+0000","last_fullsized":"2023-08-10T11:50:55.890571+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:46.590044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":72,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:43.588876+0000","last_change":"2023-08-10T11:50:53.905439+0000","last_active":"2023-08-10T11:51:43.588876+0000","last_peered":"2023-08-10T11:51:43.588876+0000","last_clean":"2023-08-10T11:51:43.588876+0000","last_became_active":"2023-08-10T11:50:53.905172+0000","last_became_peered":"2023-08-10T11:50:53.905172+0000","last_unstale":"2023-08-10T11:51:43.588876+0000","last_undegraded":"2023-08-10T11:51:43.588876+0000","last_fullsized":"2023-08-10T11:51:43.588876+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:31:40.730660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345671+0000","last_change":"2023-08-10T11:50:54.961422+0000","last_active":"2023-08-10T11:50:56.345671+0000","last_peered":"2023-08-10T11:50:56.345671+0000","last_clean":"2023-08-10T11:50:56.345671+0000","last_became_active":"2023-08-10T11:50:54.960627+0000","last_became_peered":"2023-08-10T11:50:54.960627+0000","last_unstale":"2023-08-10T11:50:56.345671+0000","last_undegraded":"2023-08-10T11:50:56.345671+0000","last_fullsized":"2023-08-10T11:50:56.345671+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:10:30.642466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345880+0000","last_change":"2023-08-10T11:50:53.907291+0000","last_active":"2023-08-10T11:50:56.345880+0000","last_peered":"2023-08-10T11:50:56.345880+0000","last_clean":"2023-08-10T11:50:56.345880+0000","last_became_active":"2023-08-10T11:50:53.906997+0000","last_became_peered":"2023-08-10T11:50:53.906997+0000","last_unstale":"2023-08-10T11:50:56.345880+0000","last_undegraded":"2023-08-10T11:50:56.345880+0000","last_fullsized":"2023-08-10T11:50:56.345880+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:52:16.544854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344895+0000","last_change":"2023-08-10T11:50:54.940828+0000","last_active":"2023-08-10T11:50:56.344895+0000","last_peered":"2023-08-10T11:50:56.344895+0000","last_clean":"2023-08-10T11:50:56.344895+0000","last_became_active":"2023-08-10T11:50:54.940169+0000","last_became_peered":"2023-08-10T11:50:54.940169+0000","last_unstale":"2023-08-10T11:50:56.344895+0000","last_undegraded":"2023-08-10T11:50:56.344895+0000","last_fullsized":"2023-08-10T11:50:56.344895+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:45:59.866028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:01.530148+0000","last_change":"2023-08-10T11:50:53.906366+0000","last_active":"2023-08-10T11:51:01.530148+0000","last_peered":"2023-08-10T11:51:01.530148+0000","last_clean":"2023-08-10T11:51:01.530148+0000","last_became_active":"2023-08-10T11:50:53.906057+0000","last_became_peered":"2023-08-10T11:50:53.906057+0000","last_unstale":"2023-08-10T11:51:01.530148+0000","last_undegraded":"2023-08-10T11:51:01.530148+0000","last_fullsized":"2023-08-10T11:51:01.530148+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:59:44.567315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.892532+0000","last_change":"2023-08-10T11:50:54.908534+0000","last_active":"2023-08-10T11:50:55.892532+0000","last_peered":"2023-08-10T11:50:55.892532+0000","last_clean":"2023-08-10T11:50:55.892532+0000","last_became_active":"2023-08-10T11:50:54.908244+0000","last_became_peered":"2023-08-10T11:50:54.908244+0000","last_unstale":"2023-08-10T11:50:55.892532+0000","last_undegraded":"2023-08-10T11:50:55.892532+0000","last_fullsized":"2023-08-10T11:50:55.892532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:55:51.466202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.531779+0000","last_change":"2023-08-10T11:50:53.902325+0000","last_active":"2023-08-10T11:51:00.531779+0000","last_peered":"2023-08-10T11:51:00.531779+0000","last_clean":"2023-08-10T11:51:00.531779+0000","last_became_active":"2023-08-10T11:50:53.902020+0000","last_became_peered":"2023-08-10T11:50:53.902020+0000","last_unstale":"2023-08-10T11:51:00.531779+0000","last_undegraded":"2023-08-10T11:51:00.531779+0000","last_fullsized":"2023-08-10T11:51:00.531779+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:54.005452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345744+0000","last_change":"2023-08-10T11:50:54.910291+0000","last_active":"2023-08-10T11:50:56.345744+0000","last_peered":"2023-08-10T11:50:56.345744+0000","last_clean":"2023-08-10T11:50:56.345744+0000","last_became_active":"2023-08-10T11:50:54.909886+0000","last_became_peered":"2023-08-10T11:50:54.909886+0000","last_unstale":"2023-08-10T11:50:56.345744+0000","last_undegraded":"2023-08-10T11:50:56.345744+0000","last_fullsized":"2023-08-10T11:50:56.345744+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:32:04.741805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'5","reported_seq":65,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:40.569704+0000","last_change":"2023-08-10T11:50:53.904363+0000","last_active":"2023-08-10T11:51:40.569704+0000","last_peered":"2023-08-10T11:51:40.569704+0000","last_clean":"2023-08-10T11:51:40.569704+0000","last_became_active":"2023-08-10T11:50:53.904049+0000","last_became_peered":"2023-08-10T11:50:53.904049+0000","last_unstale":"2023-08-10T11:51:40.569704+0000","last_undegraded":"2023-08-10T11:51:40.569704+0000","last_fullsized":"2023-08-10T11:51:40.569704+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:49:25.423370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344983+0000","last_change":"2023-08-10T11:50:54.912189+0000","last_active":"2023-08-10T11:50:56.344983+0000","last_peered":"2023-08-10T11:50:56.344983+0000","last_clean":"2023-08-10T11:50:56.344983+0000","last_became_active":"2023-08-10T11:50:54.911884+0000","last_became_peered":"2023-08-10T11:50:54.911884+0000","last_unstale":"2023-08-10T11:50:56.344983+0000","last_undegraded":"2023-08-10T11:50:56.344983+0000","last_fullsized":"2023-08-10T11:50:56.344983+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:40:25.019116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:59.515415+0000","last_change":"2023-08-10T11:50:53.901161+0000","last_active":"2023-08-10T11:50:59.515415+0000","last_peered":"2023-08-10T11:50:59.515415+0000","last_clean":"2023-08-10T11:50:59.515415+0000","last_became_active":"2023-08-10T11:50:53.900806+0000","last_became_peered":"2023-08-10T11:50:53.900806+0000","last_unstale":"2023-08-10T11:50:59.515415+0000","last_undegraded":"2023-08-10T11:50:59.515415+0000","last_fullsized":"2023-08-10T11:50:59.515415+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:33:49.410246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345263+0000","last_change":"2023-08-10T11:50:54.905753+0000","last_active":"2023-08-10T11:50:56.345263+0000","last_peered":"2023-08-10T11:50:56.345263+0000","last_clean":"2023-08-10T11:50:56.345263+0000","last_became_active":"2023-08-10T11:50:54.905463+0000","last_became_peered":"2023-08-10T11:50:54.905463+0000","last_unstale":"2023-08-10T11:50:56.345263+0000","last_undegraded":"2023-08-10T11:50:56.345263+0000","last_fullsized":"2023-08-10T11:50:56.345263+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:40:18.150871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:58.508858+0000","last_change":"2023-08-10T11:50:53.895021+0000","last_active":"2023-08-10T11:50:58.508858+0000","last_peered":"2023-08-10T11:50:58.508858+0000","last_clean":"2023-08-10T11:50:58.508858+0000","last_became_active":"2023-08-10T11:50:53.894732+0000","last_became_peered":"2023-08-10T11:50:53.894732+0000","last_unstale":"2023-08-10T11:50:58.508858+0000","last_undegraded":"2023-08-10T11:50:58.508858+0000","last_fullsized":"2023-08-10T11:50:58.508858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:33:34.799950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344648+0000","last_change":"2023-08-10T11:50:54.957771+0000","last_active":"2023-08-10T11:50:56.344648+0000","last_peered":"2023-08-10T11:50:56.344648+0000","last_clean":"2023-08-10T11:50:56.344648+0000","last_became_active":"2023-08-10T11:50:54.901503+0000","last_became_peered":"2023-08-10T11:50:54.901503+0000","last_unstale":"2023-08-10T11:50:56.344648+0000","last_undegraded":"2023-08-10T11:50:56.344648+0000","last_fullsized":"2023-08-10T11:50:56.344648+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:44:27.828963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.530556+0000","last_change":"2023-08-10T11:50:53.899939+0000","last_active":"2023-08-10T11:51:00.530556+0000","last_peered":"2023-08-10T11:51:00.530556+0000","last_clean":"2023-08-10T11:51:00.530556+0000","last_became_active":"2023-08-10T11:50:53.899648+0000","last_became_peered":"2023-08-10T11:50:53.899648+0000","last_unstale":"2023-08-10T11:51:00.530556+0000","last_undegraded":"2023-08-10T11:51:00.530556+0000","last_fullsized":"2023-08-10T11:51:00.530556+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:24:46.642939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890464+0000","last_change":"2023-08-10T11:50:54.959487+0000","last_active":"2023-08-10T11:50:55.890464+0000","last_peered":"2023-08-10T11:50:55.890464+0000","last_clean":"2023-08-10T11:50:55.890464+0000","last_became_active":"2023-08-10T11:50:54.959153+0000","last_became_peered":"2023-08-10T11:50:54.959153+0000","last_unstale":"2023-08-10T11:50:55.890464+0000","last_undegraded":"2023-08-10T11:50:55.890464+0000","last_fullsized":"2023-08-10T11:50:55.890464+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:38:55.933145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":109,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:44.575805+0000","last_change":"2023-08-10T11:50:53.898037+0000","last_active":"2023-08-10T11:51:44.575805+0000","last_peered":"2023-08-10T11:51:44.575805+0000","last_clean":"2023-08-10T11:51:44.575805+0000","last_became_active":"2023-08-10T11:50:53.897715+0000","last_became_peered":"2023-08-10T11:50:53.897715+0000","last_unstale":"2023-08-10T11:51:44.575805+0000","last_undegraded":"2023-08-10T11:51:44.575805+0000","last_fullsized":"2023-08-10T11:51:44.575805+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:42:02.005233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":91,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.892809+0000","last_change":"2023-08-10T11:50:54.908337+0000","last_active":"2023-08-10T11:50:55.892809+0000","last_peered":"2023-08-10T11:50:55.892809+0000","last_clean":"2023-08-10T11:50:55.892809+0000","last_became_active":"2023-08-10T11:50:54.907990+0000","last_became_peered":"2023-08-10T11:50:54.907990+0000","last_unstale":"2023-08-10T11:50:55.892809+0000","last_undegraded":"2023-08-10T11:50:55.892809+0000","last_fullsized":"2023-08-10T11:50:55.892809+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:44:47.081301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.530242+0000","last_change":"2023-08-10T11:50:53.901498+0000","last_active":"2023-08-10T11:51:00.530242+0000","last_peered":"2023-08-10T11:51:00.530242+0000","last_clean":"2023-08-10T11:51:00.530242+0000","last_became_active":"2023-08-10T11:50:53.901146+0000","last_became_peered":"2023-08-10T11:50:53.901146+0000","last_unstale":"2023-08-10T11:51:00.530242+0000","last_undegraded":"2023-08-10T11:51:00.530242+0000","last_fullsized":"2023-08-10T11:51:00.530242+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:52:15.837576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345035+0000","last_change":"2023-08-10T11:50:54.901550+0000","last_active":"2023-08-10T11:50:56.345035+0000","last_peered":"2023-08-10T11:50:56.345035+0000","last_clean":"2023-08-10T11:50:56.345035+0000","last_became_active":"2023-08-10T11:50:54.901214+0000","last_became_peered":"2023-08-10T11:50:54.901214+0000","last_unstale":"2023-08-10T11:50:56.345035+0000","last_undegraded":"2023-08-10T11:50:56.345035+0000","last_fullsized":"2023-08-10T11:50:56.345035+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:11:47.883894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:58.501883+0000","last_change":"2023-08-10T11:50:53.901337+0000","last_active":"2023-08-10T11:50:58.501883+0000","last_peered":"2023-08-10T11:50:58.501883+0000","last_clean":"2023-08-10T11:50:58.501883+0000","last_became_active":"2023-08-10T11:50:53.901005+0000","last_became_peered":"2023-08-10T11:50:53.901005+0000","last_unstale":"2023-08-10T11:50:58.501883+0000","last_undegraded":"2023-08-10T11:50:58.501883+0000","last_fullsized":"2023-08-10T11:50:58.501883+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:11:24.161362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.892656+0000","last_change":"2023-08-10T11:50:54.905466+0000","last_active":"2023-08-10T11:50:55.892656+0000","last_peered":"2023-08-10T11:50:55.892656+0000","last_clean":"2023-08-10T11:50:55.892656+0000","last_became_active":"2023-08-10T11:50:54.905175+0000","last_became_peered":"2023-08-10T11:50:54.905175+0000","last_unstale":"2023-08-10T11:50:55.892656+0000","last_undegraded":"2023-08-10T11:50:55.892656+0000","last_fullsized":"2023-08-10T11:50:55.892656+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:49:14.630996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'29","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:44.577611+0000","last_change":"2023-08-10T11:50:53.894717+0000","last_active":"2023-08-10T11:51:44.577611+0000","last_peered":"2023-08-10T11:51:44.577611+0000","last_clean":"2023-08-10T11:51:44.577611+0000","last_became_active":"2023-08-10T11:50:53.894390+0000","last_became_peered":"2023-08-10T11:50:53.894390+0000","last_unstale":"2023-08-10T11:51:44.577611+0000","last_undegraded":"2023-08-10T11:51:44.577611+0000","last_fullsized":"2023-08-10T11:51:44.577611+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:55:07.872465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56241,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":102,"num_read_kb":105,"num_write":31,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344895+0000","last_change":"2023-08-10T11:50:54.908021+0000","last_active":"2023-08-10T11:50:56.344895+0000","last_peered":"2023-08-10T11:50:56.344895+0000","last_clean":"2023-08-10T11:50:56.344895+0000","last_became_active":"2023-08-10T11:50:54.907527+0000","last_became_peered":"2023-08-10T11:50:54.907527+0000","last_unstale":"2023-08-10T11:50:56.344895+0000","last_undegraded":"2023-08-10T11:50:56.344895+0000","last_fullsized":"2023-08-10T11:50:56.344895+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:31:57.299713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.531851+0000","last_change":"2023-08-10T11:50:53.906448+0000","last_active":"2023-08-10T11:51:00.531851+0000","last_peered":"2023-08-10T11:51:00.531851+0000","last_clean":"2023-08-10T11:51:00.531851+0000","last_became_active":"2023-08-10T11:50:53.906157+0000","last_became_peered":"2023-08-10T11:50:53.906157+0000","last_unstale":"2023-08-10T11:51:00.531851+0000","last_undegraded":"2023-08-10T11:51:00.531851+0000","last_fullsized":"2023-08-10T11:51:00.531851+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:39.418056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345339+0000","last_change":"2023-08-10T11:50:54.906467+0000","last_active":"2023-08-10T11:50:56.345339+0000","last_peered":"2023-08-10T11:50:56.345339+0000","last_clean":"2023-08-10T11:50:56.345339+0000","last_became_active":"2023-08-10T11:50:54.901119+0000","last_became_peered":"2023-08-10T11:50:54.901119+0000","last_unstale":"2023-08-10T11:50:56.345339+0000","last_undegraded":"2023-08-10T11:50:56.345339+0000","last_fullsized":"2023-08-10T11:50:56.345339+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:16.266709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.530526+0000","last_change":"2023-08-10T11:50:53.906435+0000","last_active":"2023-08-10T11:51:00.530526+0000","last_peered":"2023-08-10T11:51:00.530526+0000","last_clean":"2023-08-10T11:51:00.530526+0000","last_became_active":"2023-08-10T11:50:53.905545+0000","last_became_peered":"2023-08-10T11:50:53.905545+0000","last_unstale":"2023-08-10T11:51:00.530526+0000","last_undegraded":"2023-08-10T11:51:00.530526+0000","last_fullsized":"2023-08-10T11:51:00.530526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:26:54.882060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473837+0000","last_change":"2023-08-10T11:50:54.903127+0000","last_active":"2023-08-10T11:50:56.473837+0000","last_peered":"2023-08-10T11:50:56.473837+0000","last_clean":"2023-08-10T11:50:56.473837+0000","last_became_active":"2023-08-10T11:50:54.902805+0000","last_became_peered":"2023-08-10T11:50:54.902805+0000","last_unstale":"2023-08-10T11:50:56.473837+0000","last_undegraded":"2023-08-10T11:50:56.473837+0000","last_fullsized":"2023-08-10T11:50:56.473837+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:58:40.949478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":66,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:44.600932+0000","last_change":"2023-08-10T11:50:53.898252+0000","last_active":"2023-08-10T11:51:44.600932+0000","last_peered":"2023-08-10T11:51:44.600932+0000","last_clean":"2023-08-10T11:51:44.600932+0000","last_became_active":"2023-08-10T11:50:53.897992+0000","last_became_peered":"2023-08-10T11:50:53.897992+0000","last_unstale":"2023-08-10T11:51:44.600932+0000","last_undegraded":"2023-08-10T11:51:44.600932+0000","last_fullsized":"2023-08-10T11:51:44.600932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:34:51.658646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":48,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473681+0000","last_change":"2023-08-10T11:50:54.913297+0000","last_active":"2023-08-10T11:50:56.473681+0000","last_peered":"2023-08-10T11:50:56.473681+0000","last_clean":"2023-08-10T11:50:56.473681+0000","last_became_active":"2023-08-10T11:50:54.912997+0000","last_became_peered":"2023-08-10T11:50:54.912997+0000","last_unstale":"2023-08-10T11:50:56.473681+0000","last_undegraded":"2023-08-10T11:50:56.473681+0000","last_fullsized":"2023-08-10T11:50:56.473681+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:40:06.862890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.529664+0000","last_change":"2023-08-10T11:50:53.904095+0000","last_active":"2023-08-10T11:51:00.529664+0000","last_peered":"2023-08-10T11:51:00.529664+0000","last_clean":"2023-08-10T11:51:00.529664+0000","last_became_active":"2023-08-10T11:50:53.903712+0000","last_became_peered":"2023-08-10T11:50:53.903712+0000","last_unstale":"2023-08-10T11:51:00.529664+0000","last_undegraded":"2023-08-10T11:51:00.529664+0000","last_fullsized":"2023-08-10T11:51:00.529664+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:52:43.075450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345492+0000","last_change":"2023-08-10T11:50:54.904763+0000","last_active":"2023-08-10T11:50:56.345492+0000","last_peered":"2023-08-10T11:50:56.345492+0000","last_clean":"2023-08-10T11:50:56.345492+0000","last_became_active":"2023-08-10T11:50:54.904467+0000","last_became_peered":"2023-08-10T11:50:54.904467+0000","last_unstale":"2023-08-10T11:50:56.345492+0000","last_undegraded":"2023-08-10T11:50:56.345492+0000","last_fullsized":"2023-08-10T11:50:56.345492+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:18:23.751856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:58.499250+0000","last_change":"2023-08-10T11:50:53.904605+0000","last_active":"2023-08-10T11:50:58.499250+0000","last_peered":"2023-08-10T11:50:58.499250+0000","last_clean":"2023-08-10T11:50:58.499250+0000","last_became_active":"2023-08-10T11:50:53.904236+0000","last_became_peered":"2023-08-10T11:50:53.904236+0000","last_unstale":"2023-08-10T11:50:58.499250+0000","last_undegraded":"2023-08-10T11:50:58.499250+0000","last_fullsized":"2023-08-10T11:50:58.499250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:31:26.574828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.144909+0000","last_change":"2023-08-10T11:50:54.903881+0000","last_active":"2023-08-10T11:50:56.144909+0000","last_peered":"2023-08-10T11:50:56.144909+0000","last_clean":"2023-08-10T11:50:56.144909+0000","last_became_active":"2023-08-10T11:50:54.903563+0000","last_became_peered":"2023-08-10T11:50:54.903563+0000","last_unstale":"2023-08-10T11:50:56.144909+0000","last_undegraded":"2023-08-10T11:50:56.144909+0000","last_fullsized":"2023-08-10T11:50:56.144909+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:23:32.901460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890795+0000","last_change":"2023-08-10T11:50:53.905320+0000","last_active":"2023-08-10T11:50:55.890795+0000","last_peered":"2023-08-10T11:50:55.890795+0000","last_clean":"2023-08-10T11:50:55.890795+0000","last_became_active":"2023-08-10T11:50:53.905057+0000","last_became_peered":"2023-08-10T11:50:53.905057+0000","last_unstale":"2023-08-10T11:50:55.890795+0000","last_undegraded":"2023-08-10T11:50:55.890795+0000","last_fullsized":"2023-08-10T11:50:55.890795+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:10:35.476026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344914+0000","last_change":"2023-08-10T11:50:54.906531+0000","last_active":"2023-08-10T11:50:56.344914+0000","last_peered":"2023-08-10T11:50:56.344914+0000","last_clean":"2023-08-10T11:50:56.344914+0000","last_became_active":"2023-08-10T11:50:54.906239+0000","last_became_peered":"2023-08-10T11:50:54.906239+0000","last_unstale":"2023-08-10T11:50:56.344914+0000","last_undegraded":"2023-08-10T11:50:56.344914+0000","last_fullsized":"2023-08-10T11:50:56.344914+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:11:52.732611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":65,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:44.591183+0000","last_change":"2023-08-10T11:50:53.899835+0000","last_active":"2023-08-10T11:51:44.591183+0000","last_peered":"2023-08-10T11:51:44.591183+0000","last_clean":"2023-08-10T11:51:44.591183+0000","last_became_active":"2023-08-10T11:50:53.898318+0000","last_became_peered":"2023-08-10T11:50:53.898318+0000","last_unstale":"2023-08-10T11:51:44.591183+0000","last_undegraded":"2023-08-10T11:51:44.591183+0000","last_fullsized":"2023-08-10T11:51:44.591183+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:02:07.071804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344832+0000","last_change":"2023-08-10T11:50:54.905941+0000","last_active":"2023-08-10T11:50:56.344832+0000","last_peered":"2023-08-10T11:50:56.344832+0000","last_clean":"2023-08-10T11:50:56.344832+0000","last_became_active":"2023-08-10T11:50:54.905634+0000","last_became_peered":"2023-08-10T11:50:54.905634+0000","last_unstale":"2023-08-10T11:50:56.344832+0000","last_undegraded":"2023-08-10T11:50:56.344832+0000","last_fullsized":"2023-08-10T11:50:56.344832+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:53:51.516739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345241+0000","last_change":"2023-08-10T11:50:54.910544+0000","last_active":"2023-08-10T11:50:56.345241+0000","last_peered":"2023-08-10T11:50:56.345241+0000","last_clean":"2023-08-10T11:50:56.345241+0000","last_became_active":"2023-08-10T11:50:54.910210+0000","last_became_peered":"2023-08-10T11:50:54.910210+0000","last_unstale":"2023-08-10T11:50:56.345241+0000","last_undegraded":"2023-08-10T11:50:56.345241+0000","last_fullsized":"2023-08-10T11:50:56.345241+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:33:03.928843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":64,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:43.597875+0000","last_change":"2023-08-10T11:50:53.906293+0000","last_active":"2023-08-10T11:51:43.597875+0000","last_peered":"2023-08-10T11:51:43.597875+0000","last_clean":"2023-08-10T11:51:43.597875+0000","last_became_active":"2023-08-10T11:50:53.905998+0000","last_became_peered":"2023-08-10T11:50:53.905998+0000","last_unstale":"2023-08-10T11:51:43.597875+0000","last_undegraded":"2023-08-10T11:51:43.597875+0000","last_fullsized":"2023-08-10T11:51:43.597875+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:37.743171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345578+0000","last_change":"2023-08-10T11:50:54.960147+0000","last_active":"2023-08-10T11:50:56.345578+0000","last_peered":"2023-08-10T11:50:56.345578+0000","last_clean":"2023-08-10T11:50:56.345578+0000","last_became_active":"2023-08-10T11:50:54.959842+0000","last_became_peered":"2023-08-10T11:50:54.959842+0000","last_unstale":"2023-08-10T11:50:56.345578+0000","last_undegraded":"2023-08-10T11:50:56.345578+0000","last_fullsized":"2023-08-10T11:50:56.345578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:12:53.787027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:01.530264+0000","last_change":"2023-08-10T11:50:53.899292+0000","last_active":"2023-08-10T11:51:01.530264+0000","last_peered":"2023-08-10T11:51:01.530264+0000","last_clean":"2023-08-10T11:51:01.530264+0000","last_became_active":"2023-08-10T11:50:53.898917+0000","last_became_peered":"2023-08-10T11:50:53.898917+0000","last_unstale":"2023-08-10T11:51:01.530264+0000","last_undegraded":"2023-08-10T11:51:01.530264+0000","last_fullsized":"2023-08-10T11:51:01.530264+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:40:42.574205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":341,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473528+0000","last_change":"2023-08-10T11:49:54.492617+0000","last_active":"2023-08-10T11:50:56.473528+0000","last_peered":"2023-08-10T11:50:56.473528+0000","last_clean":"2023-08-10T11:50:56.473528+0000","last_became_active":"2023-08-10T11:49:54.492146+0000","last_became_peered":"2023-08-10T11:49:54.492146+0000","last_unstale":"2023-08-10T11:50:56.473528+0000","last_undegraded":"2023-08-10T11:50:56.473528+0000","last_fullsized":"2023-08-10T11:50:56.473528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:46:58.862300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:46:58.862300+0000","last_clean_scrub_stamp":"2023-08-10T11:46:58.862300+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:03:46.098279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345147+0000","last_change":"2023-08-10T11:50:54.907704+0000","last_active":"2023-08-10T11:50:56.345147+0000","last_peered":"2023-08-10T11:50:56.345147+0000","last_clean":"2023-08-10T11:50:56.345147+0000","last_became_active":"2023-08-10T11:50:54.907409+0000","last_became_peered":"2023-08-10T11:50:54.907409+0000","last_unstale":"2023-08-10T11:50:56.345147+0000","last_undegraded":"2023-08-10T11:50:56.345147+0000","last_fullsized":"2023-08-10T11:50:56.345147+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:00:55.449902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:58.509272+0000","last_change":"2023-08-10T11:50:53.902548+0000","last_active":"2023-08-10T11:50:58.509272+0000","last_peered":"2023-08-10T11:50:58.509272+0000","last_clean":"2023-08-10T11:50:58.509272+0000","last_became_active":"2023-08-10T11:50:53.902021+0000","last_became_peered":"2023-08-10T11:50:53.902021+0000","last_unstale":"2023-08-10T11:50:58.509272+0000","last_undegraded":"2023-08-10T11:50:58.509272+0000","last_fullsized":"2023-08-10T11:50:58.509272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:49:47.207695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:59.514695+0000","last_change":"2023-08-10T11:50:53.906326+0000","last_active":"2023-08-10T11:50:59.514695+0000","last_peered":"2023-08-10T11:50:59.514695+0000","last_clean":"2023-08-10T11:50:59.514695+0000","last_became_active":"2023-08-10T11:50:53.906017+0000","last_became_peered":"2023-08-10T11:50:53.906017+0000","last_unstale":"2023-08-10T11:50:59.514695+0000","last_undegraded":"2023-08-10T11:50:59.514695+0000","last_fullsized":"2023-08-10T11:50:59.514695+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:20:21.219007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344921+0000","last_change":"2023-08-10T11:50:54.906513+0000","last_active":"2023-08-10T11:50:56.344921+0000","last_peered":"2023-08-10T11:50:56.344921+0000","last_clean":"2023-08-10T11:50:56.344921+0000","last_became_active":"2023-08-10T11:50:54.901642+0000","last_became_peered":"2023-08-10T11:50:54.901642+0000","last_unstale":"2023-08-10T11:50:56.344921+0000","last_undegraded":"2023-08-10T11:50:56.344921+0000","last_fullsized":"2023-08-10T11:50:56.344921+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:37.030936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'9","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:04.689050+0000","last_change":"2023-08-10T11:50:53.908025+0000","last_active":"2023-08-10T11:51:04.689050+0000","last_peered":"2023-08-10T11:51:04.689050+0000","last_clean":"2023-08-10T11:51:04.689050+0000","last_became_active":"2023-08-10T11:50:53.907745+0000","last_became_peered":"2023-08-10T11:50:53.907745+0000","last_unstale":"2023-08-10T11:51:04.689050+0000","last_undegraded":"2023-08-10T11:51:04.689050+0000","last_fullsized":"2023-08-10T11:51:04.689050+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:08:55.888721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345237+0000","last_change":"2023-08-10T11:50:54.958653+0000","last_active":"2023-08-10T11:50:56.345237+0000","last_peered":"2023-08-10T11:50:56.345237+0000","last_clean":"2023-08-10T11:50:56.345237+0000","last_became_active":"2023-08-10T11:50:54.958281+0000","last_became_peered":"2023-08-10T11:50:54.958281+0000","last_unstale":"2023-08-10T11:50:56.345237+0000","last_undegraded":"2023-08-10T11:50:56.345237+0000","last_fullsized":"2023-08-10T11:50:56.345237+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:09:50.615524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.533762+0000","last_change":"2023-08-10T11:50:53.895770+0000","last_active":"2023-08-10T11:51:00.533762+0000","last_peered":"2023-08-10T11:51:00.533762+0000","last_clean":"2023-08-10T11:51:00.533762+0000","last_became_active":"2023-08-10T11:50:53.895433+0000","last_became_peered":"2023-08-10T11:50:53.895433+0000","last_unstale":"2023-08-10T11:51:00.533762+0000","last_undegraded":"2023-08-10T11:51:00.533762+0000","last_fullsized":"2023-08-10T11:51:00.533762+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:22:23.820523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345697+0000","last_change":"2023-08-10T11:50:54.957297+0000","last_active":"2023-08-10T11:50:56.345697+0000","last_peered":"2023-08-10T11:50:56.345697+0000","last_clean":"2023-08-10T11:50:56.345697+0000","last_became_active":"2023-08-10T11:50:54.956966+0000","last_became_peered":"2023-08-10T11:50:54.956966+0000","last_unstale":"2023-08-10T11:50:56.345697+0000","last_undegraded":"2023-08-10T11:50:56.345697+0000","last_fullsized":"2023-08-10T11:50:56.345697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:56:06.035708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:57.926624+0000","last_change":"2023-08-10T11:50:53.897792+0000","last_active":"2023-08-10T11:50:57.926624+0000","last_peered":"2023-08-10T11:50:57.926624+0000","last_clean":"2023-08-10T11:50:57.926624+0000","last_became_active":"2023-08-10T11:50:53.897489+0000","last_became_peered":"2023-08-10T11:50:53.897489+0000","last_unstale":"2023-08-10T11:50:57.926624+0000","last_undegraded":"2023-08-10T11:50:57.926624+0000","last_fullsized":"2023-08-10T11:50:57.926624+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:00.460709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344719+0000","last_change":"2023-08-10T11:50:54.908185+0000","last_active":"2023-08-10T11:50:56.344719+0000","last_peered":"2023-08-10T11:50:56.344719+0000","last_clean":"2023-08-10T11:50:56.344719+0000","last_became_active":"2023-08-10T11:50:54.907649+0000","last_became_peered":"2023-08-10T11:50:54.907649+0000","last_unstale":"2023-08-10T11:50:56.344719+0000","last_undegraded":"2023-08-10T11:50:56.344719+0000","last_fullsized":"2023-08-10T11:50:56.344719+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:33:01.523501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.530584+0000","last_change":"2023-08-10T11:50:53.908748+0000","last_active":"2023-08-10T11:51:00.530584+0000","last_peered":"2023-08-10T11:51:00.530584+0000","last_clean":"2023-08-10T11:51:00.530584+0000","last_became_active":"2023-08-10T11:50:53.908494+0000","last_became_peered":"2023-08-10T11:50:53.908494+0000","last_unstale":"2023-08-10T11:51:00.530584+0000","last_undegraded":"2023-08-10T11:51:00.530584+0000","last_fullsized":"2023-08-10T11:51:00.530584+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:14:25.414218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.144690+0000","last_change":"2023-08-10T11:50:54.903493+0000","last_active":"2023-08-10T11:50:56.144690+0000","last_peered":"2023-08-10T11:50:56.144690+0000","last_clean":"2023-08-10T11:50:56.144690+0000","last_became_active":"2023-08-10T11:50:54.903118+0000","last_became_peered":"2023-08-10T11:50:54.903118+0000","last_unstale":"2023-08-10T11:50:56.144690+0000","last_undegraded":"2023-08-10T11:50:56.144690+0000","last_fullsized":"2023-08-10T11:50:56.144690+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:41:27.663597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.769273+0000","last_change":"2023-08-10T11:50:53.905075+0000","last_active":"2023-08-10T11:51:00.769273+0000","last_peered":"2023-08-10T11:51:00.769273+0000","last_clean":"2023-08-10T11:51:00.769273+0000","last_became_active":"2023-08-10T11:50:53.904769+0000","last_became_peered":"2023-08-10T11:50:53.904769+0000","last_unstale":"2023-08-10T11:51:00.769273+0000","last_undegraded":"2023-08-10T11:51:00.769273+0000","last_fullsized":"2023-08-10T11:51:00.769273+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:35:05.694028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345444+0000","last_change":"2023-08-10T11:50:54.963860+0000","last_active":"2023-08-10T11:50:56.345444+0000","last_peered":"2023-08-10T11:50:56.345444+0000","last_clean":"2023-08-10T11:50:56.345444+0000","last_became_active":"2023-08-10T11:50:54.963335+0000","last_became_peered":"2023-08-10T11:50:54.963335+0000","last_unstale":"2023-08-10T11:50:56.345444+0000","last_undegraded":"2023-08-10T11:50:56.345444+0000","last_fullsized":"2023-08-10T11:50:56.345444+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:49:24.482539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:57.926745+0000","last_change":"2023-08-10T11:50:53.899673+0000","last_active":"2023-08-10T11:50:57.926745+0000","last_peered":"2023-08-10T11:50:57.926745+0000","last_clean":"2023-08-10T11:50:57.926745+0000","last_became_active":"2023-08-10T11:50:53.898830+0000","last_became_peered":"2023-08-10T11:50:53.898830+0000","last_unstale":"2023-08-10T11:50:57.926745+0000","last_undegraded":"2023-08-10T11:50:57.926745+0000","last_fullsized":"2023-08-10T11:50:57.926745+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:05:49.369504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473749+0000","last_change":"2023-08-10T11:50:54.900606+0000","last_active":"2023-08-10T11:50:56.473749+0000","last_peered":"2023-08-10T11:50:56.473749+0000","last_clean":"2023-08-10T11:50:56.473749+0000","last_became_active":"2023-08-10T11:50:54.900293+0000","last_became_peered":"2023-08-10T11:50:54.900293+0000","last_unstale":"2023-08-10T11:50:56.473749+0000","last_undegraded":"2023-08-10T11:50:56.473749+0000","last_fullsized":"2023-08-10T11:50:56.473749+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:02:51.178951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'6","reported_seq":64,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:41.587212+0000","last_change":"2023-08-10T11:50:53.894526+0000","last_active":"2023-08-10T11:51:41.587212+0000","last_peered":"2023-08-10T11:51:41.587212+0000","last_clean":"2023-08-10T11:51:41.587212+0000","last_became_active":"2023-08-10T11:50:53.894211+0000","last_became_peered":"2023-08-10T11:50:53.894211+0000","last_unstale":"2023-08-10T11:51:41.587212+0000","last_undegraded":"2023-08-10T11:51:41.587212+0000","last_fullsized":"2023-08-10T11:51:41.587212+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:22:57.718753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1512,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.474091+0000","last_change":"2023-08-10T11:50:54.900511+0000","last_active":"2023-08-10T11:50:56.474091+0000","last_peered":"2023-08-10T11:50:56.474091+0000","last_clean":"2023-08-10T11:50:56.474091+0000","last_became_active":"2023-08-10T11:50:54.900200+0000","last_became_peered":"2023-08-10T11:50:54.900200+0000","last_unstale":"2023-08-10T11:50:56.474091+0000","last_undegraded":"2023-08-10T11:50:56.474091+0000","last_fullsized":"2023-08-10T11:50:56.474091+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:38:02.690516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:59.513492+0000","last_change":"2023-08-10T11:50:53.906235+0000","last_active":"2023-08-10T11:50:59.513492+0000","last_peered":"2023-08-10T11:50:59.513492+0000","last_clean":"2023-08-10T11:50:59.513492+0000","last_became_active":"2023-08-10T11:50:53.905630+0000","last_became_peered":"2023-08-10T11:50:53.905630+0000","last_unstale":"2023-08-10T11:50:59.513492+0000","last_undegraded":"2023-08-10T11:50:59.513492+0000","last_fullsized":"2023-08-10T11:50:59.513492+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:02:06.292606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473871+0000","last_change":"2023-08-10T11:50:54.907280+0000","last_active":"2023-08-10T11:50:56.473871+0000","last_peered":"2023-08-10T11:50:56.473871+0000","last_clean":"2023-08-10T11:50:56.473871+0000","last_became_active":"2023-08-10T11:50:54.906987+0000","last_became_peered":"2023-08-10T11:50:54.906987+0000","last_unstale":"2023-08-10T11:50:56.473871+0000","last_undegraded":"2023-08-10T11:50:56.473871+0000","last_fullsized":"2023-08-10T11:50:56.473871+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:18:49.513833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:51:00.530122+0000","last_change":"2023-08-10T11:50:53.906537+0000","last_active":"2023-08-10T11:51:00.530122+0000","last_peered":"2023-08-10T11:51:00.530122+0000","last_clean":"2023-08-10T11:51:00.530122+0000","last_became_active":"2023-08-10T11:50:53.905975+0000","last_became_peered":"2023-08-10T11:50:53.905975+0000","last_unstale":"2023-08-10T11:51:00.530122+0000","last_undegraded":"2023-08-10T11:51:00.530122+0000","last_fullsized":"2023-08-10T11:51:00.530122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:10:16.188995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.473972+0000","last_change":"2023-08-10T11:50:54.905656+0000","last_active":"2023-08-10T11:50:56.473972+0000","last_peered":"2023-08-10T11:50:56.473972+0000","last_clean":"2023-08-10T11:50:56.473972+0000","last_became_active":"2023-08-10T11:50:54.905314+0000","last_became_peered":"2023-08-10T11:50:54.905314+0000","last_unstale":"2023-08-10T11:50:56.473972+0000","last_undegraded":"2023-08-10T11:50:56.473972+0000","last_fullsized":"2023-08-10T11:50:56.473972+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:15:27.734994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.144767+0000","last_change":"2023-08-10T11:50:54.911564+0000","last_active":"2023-08-10T11:50:56.144767+0000","last_peered":"2023-08-10T11:50:56.144767+0000","last_clean":"2023-08-10T11:50:56.144767+0000","last_became_active":"2023-08-10T11:50:54.910375+0000","last_became_peered":"2023-08-10T11:50:54.910375+0000","last_unstale":"2023-08-10T11:50:56.144767+0000","last_undegraded":"2023-08-10T11:50:56.144767+0000","last_fullsized":"2023-08-10T11:50:56.144767+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:19:14.914729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890590+0000","last_change":"2023-08-10T11:50:54.913247+0000","last_active":"2023-08-10T11:50:55.890590+0000","last_peered":"2023-08-10T11:50:55.890590+0000","last_clean":"2023-08-10T11:50:55.890590+0000","last_became_active":"2023-08-10T11:50:54.912941+0000","last_became_peered":"2023-08-10T11:50:54.912941+0000","last_unstale":"2023-08-10T11:50:55.890590+0000","last_undegraded":"2023-08-10T11:50:55.890590+0000","last_fullsized":"2023-08-10T11:50:55.890590+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:06:23.875486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890580+0000","last_change":"2023-08-10T11:50:54.959735+0000","last_active":"2023-08-10T11:50:55.890580+0000","last_peered":"2023-08-10T11:50:55.890580+0000","last_clean":"2023-08-10T11:50:55.890580+0000","last_became_active":"2023-08-10T11:50:54.959476+0000","last_became_peered":"2023-08-10T11:50:54.959476+0000","last_unstale":"2023-08-10T11:50:55.890580+0000","last_undegraded":"2023-08-10T11:50:55.890580+0000","last_fullsized":"2023-08-10T11:50:55.890580+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:56:57.761286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344964+0000","last_change":"2023-08-10T11:50:54.942753+0000","last_active":"2023-08-10T11:50:56.344964+0000","last_peered":"2023-08-10T11:50:56.344964+0000","last_clean":"2023-08-10T11:50:56.344964+0000","last_became_active":"2023-08-10T11:50:54.941715+0000","last_became_peered":"2023-08-10T11:50:54.941715+0000","last_unstale":"2023-08-10T11:50:56.344964+0000","last_undegraded":"2023-08-10T11:50:56.344964+0000","last_fullsized":"2023-08-10T11:50:56.344964+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:09:18.140936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345055+0000","last_change":"2023-08-10T11:50:54.898919+0000","last_active":"2023-08-10T11:50:56.345055+0000","last_peered":"2023-08-10T11:50:56.345055+0000","last_clean":"2023-08-10T11:50:56.345055+0000","last_became_active":"2023-08-10T11:50:54.898599+0000","last_became_peered":"2023-08-10T11:50:54.898599+0000","last_unstale":"2023-08-10T11:50:56.345055+0000","last_undegraded":"2023-08-10T11:50:56.345055+0000","last_fullsized":"2023-08-10T11:50:56.345055+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:48:49.804005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.145117+0000","last_change":"2023-08-10T11:50:54.911359+0000","last_active":"2023-08-10T11:50:56.145117+0000","last_peered":"2023-08-10T11:50:56.145117+0000","last_clean":"2023-08-10T11:50:56.145117+0000","last_became_active":"2023-08-10T11:50:54.911049+0000","last_became_peered":"2023-08-10T11:50:54.911049+0000","last_unstale":"2023-08-10T11:50:56.145117+0000","last_undegraded":"2023-08-10T11:50:56.145117+0000","last_fullsized":"2023-08-10T11:50:56.145117+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:09:44.046537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.890718+0000","last_change":"2023-08-10T11:50:54.906811+0000","last_active":"2023-08-10T11:50:55.890718+0000","last_peered":"2023-08-10T11:50:55.890718+0000","last_clean":"2023-08-10T11:50:55.890718+0000","last_became_active":"2023-08-10T11:50:54.906456+0000","last_became_peered":"2023-08-10T11:50:54.906456+0000","last_unstale":"2023-08-10T11:50:55.890718+0000","last_undegraded":"2023-08-10T11:50:55.890718+0000","last_fullsized":"2023-08-10T11:50:55.890718+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:39:05.932046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345108+0000","last_change":"2023-08-10T11:50:54.957297+0000","last_active":"2023-08-10T11:50:56.345108+0000","last_peered":"2023-08-10T11:50:56.345108+0000","last_clean":"2023-08-10T11:50:56.345108+0000","last_became_active":"2023-08-10T11:50:54.956977+0000","last_became_peered":"2023-08-10T11:50:54.956977+0000","last_unstale":"2023-08-10T11:50:56.345108+0000","last_undegraded":"2023-08-10T11:50:56.345108+0000","last_fullsized":"2023-08-10T11:50:56.345108+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:45:21.997235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345139+0000","last_change":"2023-08-10T11:50:54.964300+0000","last_active":"2023-08-10T11:50:56.345139+0000","last_peered":"2023-08-10T11:50:56.345139+0000","last_clean":"2023-08-10T11:50:56.345139+0000","last_became_active":"2023-08-10T11:50:54.963876+0000","last_became_peered":"2023-08-10T11:50:54.963876+0000","last_unstale":"2023-08-10T11:50:56.345139+0000","last_undegraded":"2023-08-10T11:50:56.345139+0000","last_fullsized":"2023-08-10T11:50:56.345139+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:24:23.291049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.344840+0000","last_change":"2023-08-10T11:50:54.958661+0000","last_active":"2023-08-10T11:50:56.344840+0000","last_peered":"2023-08-10T11:50:56.344840+0000","last_clean":"2023-08-10T11:50:56.344840+0000","last_became_active":"2023-08-10T11:50:54.958342+0000","last_became_peered":"2023-08-10T11:50:54.958342+0000","last_unstale":"2023-08-10T11:50:56.344840+0000","last_undegraded":"2023-08-10T11:50:56.344840+0000","last_fullsized":"2023-08-10T11:50:56.344840+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:04:39.541590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:55.892490+0000","last_change":"2023-08-10T11:50:54.902033+0000","last_active":"2023-08-10T11:50:55.892490+0000","last_peered":"2023-08-10T11:50:55.892490+0000","last_clean":"2023-08-10T11:50:55.892490+0000","last_became_active":"2023-08-10T11:50:54.901713+0000","last_became_peered":"2023-08-10T11:50:54.901713+0000","last_unstale":"2023-08-10T11:50:55.892490+0000","last_undegraded":"2023-08-10T11:50:55.892490+0000","last_fullsized":"2023-08-10T11:50:55.892490+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:19:46.017158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.345900+0000","last_change":"2023-08-10T11:50:54.899377+0000","last_active":"2023-08-10T11:50:56.345900+0000","last_peered":"2023-08-10T11:50:56.345900+0000","last_clean":"2023-08-10T11:50:56.345900+0000","last_became_active":"2023-08-10T11:50:54.898657+0000","last_became_peered":"2023-08-10T11:50:54.898657+0000","last_unstale":"2023-08-10T11:50:56.345900+0000","last_undegraded":"2023-08-10T11:50:56.345900+0000","last_fullsized":"2023-08-10T11:50:56.345900+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:44:32.788127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-08-10T11:50:56.144836+0000","last_change":"2023-08-10T11:50:54.900304+0000","last_active":"2023-08-10T11:50:56.144836+0000","last_peered":"2023-08-10T11:50:56.144836+0000","last_clean":"2023-08-10T11:50:56.144836+0000","last_became_active":"2023-08-10T11:50:54.899978+0000","last_became_peered":"2023-08-10T11:50:54.899978+0000","last_unstale":"2023-08-10T11:50:56.144836+0000","last_undegraded":"2023-08-10T11:50:56.144836+0000","last_fullsized":"2023-08-10T11:50:56.144836+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:11:52.447215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62861,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":487,"num_read_kb":314,"num_write":229,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":188583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449110,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":430377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.442}]},{"osd":1,"last update":"Thu Aug 10 11:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.90600000000000003}]},{"osd":2,"last update":"Thu Aug 10 11:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.53300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Aug 10 11:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.85199999999999998}]},{"osd":5,"last update":"Thu Aug 10 11:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Aug 10 11:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Aug 10 11:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.72699999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":9,"last update":"Thu Aug 10 11:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.83199999999999996}]},{"osd":10,"last update":"Thu Aug 10 11:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.873}]}]},{"osd":10,"up_from":70,"seq":300647710746,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28576,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716576,"statfs":{"total":95995035648,"available":95965773824,"internally_reserved":0,"allocated":1597440,"data_stored":1076932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":1,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.5},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.72299999999999998}]},{"osd":3,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.622},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.63800000000000001}]},{"osd":4,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.76300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":8,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.82799999999999996}]},{"osd":9,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.85299999999999998}]},{"osd":11,"last update":"Thu Aug 10 11:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.90000000000000002}]}]},{"osd":9,"up_from":65,"seq":279172874271,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":429965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.39400000000000002,"15min":0.39800000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.41199999999999998,"15min":0.42199999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.499,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.32400000000000001}]},{"osd":1,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.58299999999999996,"15min":0.59199999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.66000000000000003,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.59899999999999998,"15min":0.60999999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70599999999999996,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.66300000000000003}]},{"osd":2,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.61599999999999999,"15min":0.628},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.68300000000000005,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.61599999999999999,"15min":0.628},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73799999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.44500000000000001,"15min":0.45400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.55700000000000005,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50600000000000001,"15min":0.50900000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.63500000000000001,"15min":0.65200000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.66300000000000003,"5min":0.87,"15min":0.87},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.64000000000000001,"15min":0.65400000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80900000000000005,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.622,"15min":0.622},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.68899999999999995,"15min":0.70199999999999996},"min":{"1min":0.42599999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78600000000000003,"5min":1.032,"15min":1.032},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.61899999999999999,"15min":0.629},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.01,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63700000000000001,"15min":0.64300000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.46300000000000002}]},{"osd":7,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65800000000000003,"15min":0.66600000000000004},"min":{"1min":0.44600000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81299999999999994,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.71799999999999997,"15min":0.73499999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.84899999999999998,"5min":1.133,"15min":1.133},"last":0.64900000000000002}]},{"osd":8,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.72399999999999998,"15min":0.73999999999999999},"min":{"1min":0.45800000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80900000000000005,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.95199999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.55600000000000005}]},{"osd":10,"last update":"Thu Aug 10 11:50:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.63400000000000001}]}]},{"osd":8,"up_from":57,"seq":244813135907,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":430343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.433,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.41199999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.79600000000000004}]},{"osd":1,"last update":"Thu Aug 10 11:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.61899999999999999,"15min":0.60999999999999999},"min":{"1min":0.501,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.84399999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.629,"15min":0.625},"min":{"1min":0.46600000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89300000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.97999999999999998}]},{"osd":2,"last update":"Thu Aug 10 11:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.437,"15min":0.43099999999999999},"min":{"1min":0.33900000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.47099999999999997,"15min":0.46500000000000002},"min":{"1min":0.315,"5min":0.248,"15min":0.248},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.88400000000000001}]},{"osd":3,"last update":"Thu Aug 10 11:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.45300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.70099999999999996}]},{"osd":4,"last update":"Thu Aug 10 11:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.60499999999999998,"15min":0.59499999999999997},"min":{"1min":0.52000000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.63900000000000001,"15min":0.626},"min":{"1min":0.49199999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.81100000000000005}]},{"osd":5,"last update":"Thu Aug 10 11:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58299999999999996,"15min":0.58199999999999996},"min":{"1min":0.35099999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.56100000000000005,"15min":0.55300000000000005},"min":{"1min":0.39100000000000001,"5min":0.371,"15min":0.371},"max":{"1min":1,"5min":1,"15min":1},"last":0.85099999999999998}]},{"osd":6,"last update":"Thu Aug 10 11:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.754},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73799999999999999,"15min":0.73899999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.93999999999999995}]},{"osd":7,"last update":"Thu Aug 10 11:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.77000000000000002,"15min":0.76500000000000001},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.71799999999999997,"15min":0.71199999999999997},"min":{"1min":0.60599999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.96799999999999997}]},{"osd":9,"last update":"Thu Aug 10 11:51:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72499999999999998,"15min":0.71999999999999997},"min":{"1min":0.58299999999999996,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78200000000000003,"15min":0.77600000000000002},"min":{"1min":0.54500000000000004,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":1.077}]},{"osd":10,"last update":"Thu Aug 10 11:50:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":1.02},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.95699999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]}]},{"osd":7,"up_from":50,"seq":214748364839,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1519616,"data_stored":1022059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.54500000000000004,"15min":0.53100000000000003},"min":{"1min":0.42099999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.51500000000000001,"15min":0.503},"min":{"1min":0.434,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.40899999999999997}]},{"osd":1,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.41699999999999998,"15min":0.40699999999999997},"min":{"1min":0.308,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.439,"15min":0.42699999999999999},"min":{"1min":0.307,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.59399999999999997}]},{"osd":2,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.42299999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77900000000000003,"5min":0.878,"15min":0.878},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59799999999999998,"15min":0.59099999999999997},"min":{"1min":0.45700000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82999999999999996,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.54300000000000004,"15min":0.53000000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.67900000000000005}]},{"osd":4,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.52600000000000002,"15min":0.51700000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.47599999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89400000000000002,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.64100000000000001,"15min":0.63200000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.63800000000000001}]},{"osd":6,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.69699999999999995,"15min":0.68200000000000005},"min":{"1min":0.53900000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.502,"5min":0.497,"15min":0.497},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.65500000000000003}]},{"osd":8,"last update":"Thu Aug 10 11:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.752,"15min":0.751},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.96199999999999997,"5min":1.002,"15min":1.002},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.748,"15min":0.752},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.91300000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.61899999999999999}]},{"osd":9,"last update":"Thu Aug 10 11:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76100000000000001,"15min":0.75900000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.749},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.82299999999999995,"15min":0.82499999999999996},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.0449999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.77800000000000002}]},{"osd":10,"last update":"Thu Aug 10 11:50:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.77100000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]}]},{"osd":6,"up_from":45,"seq":193273528364,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":429640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.46700000000000003,"15min":0.38900000000000001},"min":{"1min":0.27500000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":8.9930000000000003,"5min":8.9930000000000003,"15min":8.9930000000000003},"last":0.307},{"interface":"front","average":{"1min":1.03,"5min":0.52900000000000003,"15min":0.434},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":12.326000000000001,"5min":12.326000000000001,"15min":12.326000000000001},"last":0.39800000000000002}]},{"osd":1,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":0.66600000000000004,"15min":0.56399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":11.275,"5min":11.275,"15min":11.275},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.56899999999999995,"15min":0.53800000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.6909999999999998,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":0.69499999999999995,"15min":0.60599999999999998},"min":{"1min":0.40000000000000002,"5min":0.38,"15min":0.38},"max":{"1min":12.244,"5min":12.244,"15min":12.244},"last":0.58199999999999996},{"interface":"front","average":{"1min":1.1619999999999999,"5min":0.68400000000000005,"15min":0.60799999999999998},"min":{"1min":0.443,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":11.195,"5min":11.195,"15min":11.195},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.54300000000000004,"15min":0.44700000000000001},"min":{"1min":0.29799999999999999,"5min":0.254,"15min":0.254},"max":{"1min":11.439,"5min":11.439,"15min":11.439},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.48599999999999999,"15min":0.46800000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.43099999999999999}]},{"osd":4,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":0.70099999999999996,"15min":0.60499999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":12.272,"5min":12.272,"15min":12.272},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.216,"5min":0.72099999999999997,"15min":0.623},"min":{"1min":0.45300000000000001,"5min":0.433,"15min":0.433},"max":{"1min":11.35,"5min":11.35,"15min":11.35},"last":0.41899999999999998}]},{"osd":5,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.63600000000000001,"15min":0.61599999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.2250000000000001,"5min":0.746,"15min":0.66200000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":12.177,"5min":12.177,"15min":12.177},"last":0.66100000000000003}]},{"osd":7,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65000000000000002,"15min":0.64400000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.65900000000000003,"15min":0.65100000000000002},"min":{"1min":0.53000000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.49399999999999999}]},{"osd":8,"last update":"Thu Aug 10 11:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.67500000000000004,"15min":0.68400000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.69699999999999995,"15min":0.70799999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.876,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.71499999999999997}]},{"osd":9,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":0.77900000000000003,"15min":0.71599999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":12.300000000000001,"5min":12.300000000000001,"15min":12.300000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":0.78500000000000003,"15min":0.72299999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":11.411,"5min":11.411,"15min":11.411},"last":0.47399999999999998}]},{"osd":10,"last update":"Thu Aug 10 11:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.63300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":486788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52200000000000002,"15min":0.51100000000000001},"min":{"1min":0.378,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.52400000000000002,"15min":0.51400000000000001},"min":{"1min":0.376,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77800000000000002,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Aug 10 11:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.60999999999999999,"15min":0.58399999999999996},"min":{"1min":0.5,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.58699999999999997,"15min":0.56399999999999995},"min":{"1min":0.57299999999999995,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Aug 10 11:51:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.55200000000000005},"min":{"1min":0.37,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79500000000000004,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.41099999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.56599999999999995}]},{"osd":4,"last update":"Thu Aug 10 11:50:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.44,"15min":0.439},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.65400000000000003,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.47399999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Aug 10 11:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.57399999999999995,"15min":0.54000000000000004},"min":{"1min":0.48899999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.877,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.58899999999999997,"15min":0.55900000000000005},"min":{"1min":0.41699999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.96499999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.84299999999999997}]},{"osd":6,"last update":"Thu Aug 10 11:51:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65400000000000003,"15min":0.64900000000000002},"min":{"1min":0.42699999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90900000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58499999999999996,"15min":0.58799999999999997},"min":{"1min":0.38,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78200000000000003,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Aug 10 11:50:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.32100000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.92200000000000004,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.77300000000000002}]},{"osd":8,"last update":"Thu Aug 10 11:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.46600000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88100000000000001,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.70199999999999996,"15min":0.69499999999999995},"min":{"1min":0.47899999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.85899999999999999}]},{"osd":9,"last update":"Thu Aug 10 11:51:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.73999999999999999,"15min":0.73099999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97299999999999998,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.67000000000000004},"min":{"1min":0.51500000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85499999999999998,"5min":1.026,"15min":1.026},"last":0.877}]},{"osd":10,"last update":"Thu Aug 10 11:50:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.78800000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":431363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 11:50:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.54400000000000004,"15min":0.504},"min":{"1min":0.51600000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.54600000000000004,"15min":0.52200000000000002},"min":{"1min":0.498,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73599999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Aug 10 11:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54000000000000004,"15min":0.52600000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73299999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56599999999999995,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.76700000000000002,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu Aug 10 11:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.34699999999999998,"15min":0.34100000000000003},"min":{"1min":0.26200000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.35599999999999998,"15min":0.34799999999999998},"min":{"1min":0.29299999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.30199999999999999}]},{"osd":4,"last update":"Thu Aug 10 11:50:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.55100000000000005,"15min":0.52900000000000003},"min":{"1min":0.434,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.53400000000000003,"15min":0.52100000000000002},"min":{"1min":0.45200000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73099999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.505}]},{"osd":5,"last update":"Thu Aug 10 11:51:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.754,"5min":0.874,"15min":0.874},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.55900000000000005,"15min":0.56299999999999994},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71899999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.47599999999999998}]},{"osd":6,"last update":"Thu Aug 10 11:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.77700000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.66100000000000003,"5min":0.872,"15min":0.872},"last":0.42899999999999999}]},{"osd":7,"last update":"Thu Aug 10 11:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.498,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.505}]},{"osd":8,"last update":"Thu Aug 10 11:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.69799999999999995,"15min":0.71499999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.67900000000000005,"15min":0.69299999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.54900000000000004}]},{"osd":9,"last update":"Thu Aug 10 11:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.59999999999999998,"15min":0.61399999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67900000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.69499999999999995,"15min":0.72099999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79100000000000004,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.496}]},{"osd":10,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.57799999999999996}]},{"osd":11,"last update":"Thu Aug 10 11:51:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.53600000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":487350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:51:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53700000000000003,"15min":0.50800000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.85299999999999998,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53700000000000003,"15min":0.51500000000000001},"min":{"1min":0.33400000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81100000000000005,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Aug 10 11:51:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54400000000000004,"15min":0.52000000000000002},"min":{"1min":0.36799999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64600000000000002,"15min":0.66600000000000004},"min":{"1min":0.48699999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90600000000000003,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.68600000000000005}]},{"osd":3,"last update":"Thu Aug 10 11:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.64300000000000002,"15min":0.68500000000000005},"min":{"1min":0.433,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86699999999999999,"5min":3.7519999999999998,"15min":3.7519999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52000000000000002,"15min":0.495},"min":{"1min":0.36699999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74399999999999999,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.442}]},{"osd":4,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.65600000000000003,"15min":0.67600000000000005},"min":{"1min":0.45900000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.85199999999999998,"5min":3.6960000000000002,"15min":3.6960000000000002},"last":0.622},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.58899999999999997,"15min":0.55300000000000005},"min":{"1min":0.44500000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Aug 10 11:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47399999999999998,"15min":0.46999999999999997},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.439,"15min":0.43099999999999999},"min":{"1min":0.32900000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.64800000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.33800000000000002}]},{"osd":6,"last update":"Thu Aug 10 11:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58199999999999996,"15min":0.56299999999999994},"min":{"1min":0.46300000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85999999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66200000000000003,"15min":0.64800000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.91300000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.73899999999999999,"15min":0.73799999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.503}]},{"osd":8,"last update":"Thu Aug 10 11:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.36599999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.41199999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.42199999999999999}]},{"osd":9,"last update":"Thu Aug 10 11:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.82999999999999996,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.70499999999999996,"15min":0.70699999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.82899999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.66400000000000003}]},{"osd":10,"last update":"Thu Aug 10 11:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.65200000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]}]},{"osd":3,"up_from":25,"seq":107374182457,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":429519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:51:23 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36099999999999999,"15min":0.35999999999999999},"min":{"1min":0.27100000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.36799999999999999,"15min":0.35899999999999999},"min":{"1min":0.25800000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.61099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.28699999999999998}]},{"osd":1,"last update":"Thu Aug 10 11:51:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.374,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82199999999999995,"5min":0.875,"15min":0.875},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.55500000000000005},"min":{"1min":0.42699999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Aug 10 11:51:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.57199999999999995,"15min":0.55200000000000005},"min":{"1min":0.38,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72099999999999997,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.58299999999999996,"15min":0.54900000000000004},"min":{"1min":0.38500000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73899999999999999,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Aug 10 11:50:48 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.432,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60499999999999998,"15min":0.59699999999999998},"min":{"1min":0.49299999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.46500000000000002}]},{"osd":5,"last update":"Thu Aug 10 11:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58099999999999996,"15min":0.57099999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.433},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63100000000000001,"15min":0.61099999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0349999999999999,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":0.41899999999999998}]},{"osd":6,"last update":"Thu Aug 10 11:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.48099999999999998,"15min":0.46700000000000003},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.69699999999999995,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48299999999999998,"15min":0.46100000000000002},"min":{"1min":0.35499999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.45100000000000001}]},{"osd":7,"last update":"Thu Aug 10 11:50:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.52400000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.89800000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.503},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.56000000000000005}]},{"osd":8,"last update":"Thu Aug 10 11:50:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.67900000000000005}]},{"osd":9,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.627,"15min":0.64500000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83999999999999997,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.621,"15min":0.64100000000000001},"min":{"1min":0.38100000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.85699999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.34100000000000003}]},{"osd":10,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.57299999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":4,"up_from":32,"seq":137438953525,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":429495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54200000000000004,"15min":0.51400000000000001},"min":{"1min":0.39500000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79700000000000004,"5min":1.875,"15min":1.875},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.54300000000000004,"15min":0.51700000000000002},"min":{"1min":0.40899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Aug 10 11:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41999999999999998,"15min":0.40500000000000003},"min":{"1min":0.26300000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.57299999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.42899999999999999,"15min":0.40200000000000002},"min":{"1min":0.30199999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.57499999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Aug 10 11:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.59499999999999997,"15min":0.57899999999999996},"min":{"1min":0.47899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59299999999999997,"15min":0.57799999999999996},"min":{"1min":0.46700000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75800000000000001,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu Aug 10 11:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59199999999999997,"15min":0.54900000000000004},"min":{"1min":0.40400000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76800000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56599999999999995,"15min":0.55400000000000005},"min":{"1min":0.40699999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76000000000000001,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Aug 10 11:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60999999999999999,"15min":0.59599999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82499999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.622},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.621,"15min":0.59299999999999997},"min":{"1min":0.495,"5min":0.374,"15min":0.374},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67100000000000004,"15min":0.67200000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92000000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.875},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83099999999999996,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.80200000000000005}]},{"osd":7,"last update":"Thu Aug 10 11:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.56299999999999994,"15min":0.54300000000000004},"min":{"1min":0.41099999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.54000000000000004,"15min":0.52600000000000002},"min":{"1min":0.36699999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.73699999999999999}]},{"osd":8,"last update":"Thu Aug 10 11:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.70799999999999996,"15min":0.70299999999999996},"min":{"1min":0.52300000000000002,"5min":0.441,"15min":0.441},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.60399999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.90500000000000003}]},{"osd":9,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.81699999999999995}]},{"osd":10,"last update":"Thu Aug 10 11:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.93600000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]}]},{"osd":5,"up_from":37,"seq":158913789999,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1527808,"data_stored":1021502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70599999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.746,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.51200000000000001}]},{"osd":1,"last update":"Thu Aug 10 11:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.53300000000000003,"15min":0.51900000000000002},"min":{"1min":0.38200000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73999999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.55900000000000005,"15min":0.54100000000000004},"min":{"1min":0.42899999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Aug 10 11:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.40000000000000002,"15min":0.38400000000000001},"min":{"1min":0.30399999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61299999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.41399999999999998,"15min":0.40200000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.65500000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Aug 10 11:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.34300000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.443},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38100000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Aug 10 11:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59999999999999998,"15min":0.58799999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80000000000000004,"5min":1.109,"15min":1.109},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.39100000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76600000000000001,"5min":1.002,"15min":1.002},"last":0.625}]},{"osd":6,"last update":"Thu Aug 10 11:51:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.60799999999999998,"15min":0.58199999999999996},"min":{"1min":0.46700000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.64700000000000002,"15min":0.63900000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90200000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.53800000000000003}]},{"osd":7,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64700000000000002,"15min":0.64500000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.81699999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.58999999999999997}]},{"osd":8,"last update":"Thu Aug 10 11:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63100000000000001,"15min":0.627},"min":{"1min":0.42099999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.60699999999999998,"15min":0.60299999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.57999999999999996}]},{"osd":9,"last update":"Thu Aug 10 11:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.73599999999999999,"15min":0.69999999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":5.2999999999999998,"5min":5.2999999999999998,"15min":5.2999999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.73599999999999999,"15min":0.72899999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.69699999999999995}]},{"osd":10,"last update":"Thu Aug 10 11:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.68500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":57945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":57929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T11:51:47.627 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-08-10T11:51:47.628 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-08-10T11:51:47.628 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-08-10T11:51:47.628 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph health --format=json 2023-08-10T11:51:47.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:47 smithi152 ceph-mon[130220]: pgmap v282: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 11 op/s 2023-08-10T11:51:48.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:47 smithi156 ceph-mon[130574]: pgmap v282: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 11 op/s 2023-08-10T11:51:48.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:47 smithi073 ceph-mon[128869]: pgmap v282: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 11 op/s 2023-08-10T11:51:48.182 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:48.733 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:48 smithi073 ceph-mon[128869]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T11:51:48.733 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:48 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2023-08-10T11:51:48.733 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:48 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2023-08-10T11:51:48.733 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:48 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2023-08-10T11:51:48.733 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:48 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2023-08-10T11:51:48.734 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:48 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2023-08-10T11:51:48.734 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:48 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]: dispatch 2023-08-10T11:51:48.734 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:48 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2023-08-10T11:51:48.734 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:48 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2023-08-10T11:51:48.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:48 smithi152 ceph-mon[130220]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T11:51:48.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:48 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2023-08-10T11:51:48.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:48 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2023-08-10T11:51:48.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:48 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2023-08-10T11:51:48.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:48 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2023-08-10T11:51:48.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:48 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2023-08-10T11:51:48.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:48 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]: dispatch 2023-08-10T11:51:48.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:48 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2023-08-10T11:51:48.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:48 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2023-08-10T11:51:49.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:48 smithi156 ceph-mon[130574]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T11:51:49.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:48 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2023-08-10T11:51:49.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:48 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2023-08-10T11:51:49.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:48 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2023-08-10T11:51:49.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:48 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2023-08-10T11:51:49.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:48 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2023-08-10T11:51:49.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:48 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]: dispatch 2023-08-10T11:51:49.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:48 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2023-08-10T11:51:49.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:48 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2023-08-10T11:51:49.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.498+0000 7f66a4b12700 1 -- 172.21.15.73:0/1212177935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66a00ff6b0 msgr2=0x7f66a00ffb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:49.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.498+0000 7f66a4b12700 1 --2- 172.21.15.73:0/1212177935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66a00ff6b0 0x7f66a00ffb30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6690009990 tx=0x7f6690009ca0 comp rx=0 tx=0).stop 2023-08-10T11:51:49.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.498+0000 7f66a4b12700 1 -- 172.21.15.73:0/1212177935 shutdown_connections 2023-08-10T11:51:49.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.498+0000 7f66a4b12700 1 --2- 172.21.15.73:0/1212177935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66a0104580 0x7f66a0104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:49.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.498+0000 7f66a4b12700 1 --2- 172.21.15.73:0/1212177935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66a0100070 0x7f66a010c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:49.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.498+0000 7f66a4b12700 1 --2- 172.21.15.73:0/1212177935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66a00ff6b0 0x7f66a00ffb30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:49.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.498+0000 7f66a4b12700 1 -- 172.21.15.73:0/1212177935 >> 172.21.15.73:0/1212177935 conn(0x7f66a0076770 msgr2=0x7f66a0076b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:49.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.498+0000 7f66a4b12700 1 -- 172.21.15.73:0/1212177935 shutdown_connections 2023-08-10T11:51:49.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.498+0000 7f66a4b12700 1 -- 172.21.15.73:0/1212177935 wait complete. 2023-08-10T11:51:49.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.499+0000 7f66a4b12700 1 Processor -- start 2023-08-10T11:51:49.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.499+0000 7f66a4b12700 1 -- start start 2023-08-10T11:51:49.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.499+0000 7f66a4b12700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66a00ff6b0 0x7f66a0195570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:49.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.499+0000 7f66a4b12700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66a0100070 0x7f66a0195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:49.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.499+0000 7f66a4b12700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66a0104580 0x7f66a0195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:49.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.499+0000 7f66a4b12700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a01a4db0 con 0x7f66a00ff6b0 2023-08-10T11:51:49.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.499+0000 7f66a4b12700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a01a4f20 con 0x7f66a0104580 2023-08-10T11:51:49.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.499+0000 7f66a4b12700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a01a50e0 con 0x7f66a0100070 2023-08-10T11:51:49.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.499+0000 7f669e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66a00ff6b0 0x7f66a0195570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:49.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.499+0000 7f669e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66a00ff6b0 0x7f66a0195570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59570/0 (socket says 172.21.15.73:59570) 2023-08-10T11:51:49.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.499+0000 7f669e59c700 1 -- 172.21.15.73:0/1812793576 learned_addr learned my addr 172.21.15.73:0/1812793576 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:49.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.500+0000 7f669dd9b700 1 --2- 172.21.15.73:0/1812793576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66a0100070 0x7f66a0195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:49.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.500+0000 7f669e59c700 1 -- 172.21.15.73:0/1812793576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66a0100070 msgr2=0x7f66a0195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:49.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.500+0000 7f669e59c700 1 --2- 172.21.15.73:0/1812793576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66a0100070 0x7f66a0195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:49.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.500+0000 7f669ed9d700 1 --2- 172.21.15.73:0/1812793576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66a0104580 0x7f66a0195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:49.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.500+0000 7f669e59c700 1 -- 172.21.15.73:0/1812793576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66a0104580 msgr2=0x7f66a0195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:49.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.500+0000 7f669e59c700 1 --2- 172.21.15.73:0/1812793576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66a0104580 0x7f66a0195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:49.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.500+0000 7f669e59c700 1 -- 172.21.15.73:0/1812793576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66900095f0 con 0x7f66a00ff6b0 2023-08-10T11:51:49.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.500+0000 7f669e59c700 1 --2- 172.21.15.73:0/1812793576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66a00ff6b0 0x7f66a0195570 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f668800b530 tx=0x7f668800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:49.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.500+0000 7f66977fe700 1 -- 172.21.15.73:0/1812793576 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6688011830 con 0x7f66a00ff6b0 2023-08-10T11:51:49.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.500+0000 7f66977fe700 1 -- 172.21.15.73:0/1812793576 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6688011e50 con 0x7f66a00ff6b0 2023-08-10T11:51:49.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.500+0000 7f66a4b12700 1 -- 172.21.15.73:0/1812793576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a01a53c0 con 0x7f66a00ff6b0 2023-08-10T11:51:49.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.500+0000 7f66977fe700 1 -- 172.21.15.73:0/1812793576 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668800f2e0 con 0x7f66a00ff6b0 2023-08-10T11:51:49.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.500+0000 7f66a4b12700 1 -- 172.21.15.73:0/1812793576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a01a58c0 con 0x7f66a00ff6b0 2023-08-10T11:51:49.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.501+0000 7f66a4b12700 1 -- 172.21.15.73:0/1812793576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a004e470 con 0x7f66a00ff6b0 2023-08-10T11:51:49.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.502+0000 7f66977fe700 1 -- 172.21.15.73:0/1812793576 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f6688010580 con 0x7f66a00ff6b0 2023-08-10T11:51:49.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.503+0000 7f66977fe700 1 --2- 172.21.15.73:0/1812793576 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f668c0a11e0 0x7f668c0a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:49.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.503+0000 7f669dd9b700 1 --2- 172.21.15.73:0/1812793576 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f668c0a11e0 0x7f668c0a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:49.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.503+0000 7f66977fe700 1 -- 172.21.15.73:0/1812793576 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f66880cca40 con 0x7f66a00ff6b0 2023-08-10T11:51:49.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.503+0000 7f669dd9b700 1 --2- 172.21.15.73:0/1812793576 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f668c0a11e0 0x7f668c0a36a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6690006010 tx=0x7f66900036a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:49.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.506+0000 7f66977fe700 1 -- 172.21.15.73:0/1812793576 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f6688096150 con 0x7f66a00ff6b0 2023-08-10T11:51:49.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.741+0000 7f66a4b12700 1 -- 172.21.15.73:0/1812793576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f66a0068820 con 0x7f66a00ff6b0 2023-08-10T11:51:49.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.741+0000 7f66977fe700 1 -- 172.21.15.73:0/1812793576 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f6688099770 con 0x7f66a00ff6b0 2023-08-10T11:51:49.742 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:51:49.742 INFO:teuthology.orchestra.run.smithi073.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-08-10T11:51:49.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.743+0000 7f66a4b12700 1 -- 172.21.15.73:0/1812793576 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f668c0a11e0 msgr2=0x7f668c0a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:49.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.743+0000 7f66a4b12700 1 --2- 172.21.15.73:0/1812793576 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f668c0a11e0 0x7f668c0a36a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6690006010 tx=0x7f66900036a0 comp rx=0 tx=0).stop 2023-08-10T11:51:49.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.743+0000 7f66a4b12700 1 -- 172.21.15.73:0/1812793576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66a00ff6b0 msgr2=0x7f66a0195570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:49.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.743+0000 7f66a4b12700 1 --2- 172.21.15.73:0/1812793576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66a00ff6b0 0x7f66a0195570 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f668800b530 tx=0x7f668800b8f0 comp rx=0 tx=0).stop 2023-08-10T11:51:49.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.743+0000 7f66a4b12700 1 -- 172.21.15.73:0/1812793576 shutdown_connections 2023-08-10T11:51:49.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.743+0000 7f66a4b12700 1 --2- 172.21.15.73:0/1812793576 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f668c0a11e0 0x7f668c0a36a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:49.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.743+0000 7f66a4b12700 1 --2- 172.21.15.73:0/1812793576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66a0104580 0x7f66a0195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:49.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.743+0000 7f66a4b12700 1 --2- 172.21.15.73:0/1812793576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66a00ff6b0 0x7f66a0195570 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:49.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.743+0000 7f66a4b12700 1 --2- 172.21.15.73:0/1812793576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66a0100070 0x7f66a0195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:49.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.743+0000 7f66a4b12700 1 -- 172.21.15.73:0/1812793576 >> 172.21.15.73:0/1812793576 conn(0x7f66a0076770 msgr2=0x7f66a00fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:49.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.743+0000 7f66a4b12700 1 -- 172.21.15.73:0/1812793576 shutdown_connections 2023-08-10T11:51:49.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:49.743+0000 7f66a4b12700 1 -- 172.21.15.73:0/1812793576 wait complete. 2023-08-10T11:51:49.900 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:49 smithi073 ceph-mon[128869]: pgmap v283: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T11:51:49.900 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:49 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2023-08-10T11:51:49.900 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:49 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2023-08-10T11:51:49.900 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:49 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2023-08-10T11:51:49.900 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:49 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2023-08-10T11:51:49.901 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:49 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2023-08-10T11:51:49.901 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:49 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]': finished 2023-08-10T11:51:49.901 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:49 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2023-08-10T11:51:49.901 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:49 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2023-08-10T11:51:49.901 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:49 smithi073 ceph-mon[128869]: osdmap e84: 12 total, 12 up, 12 in 2023-08-10T11:51:49.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:49 smithi152 ceph-mon[130220]: pgmap v283: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T11:51:49.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:49 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2023-08-10T11:51:49.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:49 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2023-08-10T11:51:49.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:49 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2023-08-10T11:51:49.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:49 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2023-08-10T11:51:49.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:49 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2023-08-10T11:51:49.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:49 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]': finished 2023-08-10T11:51:49.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:49 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2023-08-10T11:51:49.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:49 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2023-08-10T11:51:49.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:49 smithi152 ceph-mon[130220]: osdmap e84: 12 total, 12 up, 12 in 2023-08-10T11:51:50.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:49 smithi156 ceph-mon[130574]: pgmap v283: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T11:51:50.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:49 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2023-08-10T11:51:50.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:49 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2023-08-10T11:51:50.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:49 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2023-08-10T11:51:50.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:49 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2023-08-10T11:51:50.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:49 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2023-08-10T11:51:50.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:49 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]': finished 2023-08-10T11:51:50.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:49 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2023-08-10T11:51:50.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:49 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2023-08-10T11:51:50.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:49 smithi156 ceph-mon[130574]: osdmap e84: 12 total, 12 up, 12 in 2023-08-10T11:51:50.223 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-08-10T11:51:50.223 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T11:51:50.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.348+0000 7f5e7dc8d700 1 -- 172.21.15.73:0/2793307262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e780ff690 msgr2=0x7f5e780ffab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:50.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.348+0000 7f5e7dc8d700 1 --2- 172.21.15.73:0/2793307262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e780ff690 0x7f5e780ffab0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5e680099c0 tx=0x7f5e68009cd0 comp rx=0 tx=0).stop 2023-08-10T11:51:50.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.348+0000 7f5e7dc8d700 1 -- 172.21.15.73:0/2793307262 shutdown_connections 2023-08-10T11:51:50.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.348+0000 7f5e7dc8d700 1 --2- 172.21.15.73:0/2793307262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e78101220 0x7f5e78107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:50.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.348+0000 7f5e7dc8d700 1 --2- 172.21.15.73:0/2793307262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e780ff690 0x7f5e780ffab0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:50.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.348+0000 7f5e7dc8d700 1 --2- 172.21.15.73:0/2793307262 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e78100880 0x7f5e78100ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:50.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.348+0000 7f5e7dc8d700 1 -- 172.21.15.73:0/2793307262 >> 172.21.15.73:0/2793307262 conn(0x7f5e780fac00 msgr2=0x7f5e780fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:50.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.348+0000 7f5e7dc8d700 1 -- 172.21.15.73:0/2793307262 shutdown_connections 2023-08-10T11:51:50.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.348+0000 7f5e7dc8d700 1 -- 172.21.15.73:0/2793307262 wait complete. 2023-08-10T11:51:50.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.349+0000 7f5e7dc8d700 1 Processor -- start 2023-08-10T11:51:50.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.349+0000 7f5e7dc8d700 1 -- start start 2023-08-10T11:51:50.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.350+0000 7f5e7dc8d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e780ff690 0x7f5e78069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:50.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.350+0000 7f5e7dc8d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e78100880 0x7f5e7819b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:50.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.350+0000 7f5e7dc8d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e78101220 0x7f5e7819d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:50.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.350+0000 7f5e7dc8d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7819dfb0 con 0x7f5e780ff690 2023-08-10T11:51:50.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.350+0000 7f5e7dc8d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7819e120 con 0x7f5e78101220 2023-08-10T11:51:50.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.350+0000 7f5e7dc8d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7819e2e0 con 0x7f5e78100880 2023-08-10T11:51:50.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.350+0000 7f5e777fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e780ff690 0x7f5e78069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:50.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.350+0000 7f5e777fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e780ff690 0x7f5e78069470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59584/0 (socket says 172.21.15.73:59584) 2023-08-10T11:51:50.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.350+0000 7f5e777fe700 1 -- 172.21.15.73:0/867580913 learned_addr learned my addr 172.21.15.73:0/867580913 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:50.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.350+0000 7f5e76ffd700 1 --2- 172.21.15.73:0/867580913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e78100880 0x7f5e7819b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:50.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.350+0000 7f5e77fff700 1 --2- 172.21.15.73:0/867580913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e78101220 0x7f5e7819d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:50.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.350+0000 7f5e777fe700 1 -- 172.21.15.73:0/867580913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e78100880 msgr2=0x7f5e7819b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:50.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.350+0000 7f5e777fe700 1 --2- 172.21.15.73:0/867580913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e78100880 0x7f5e7819b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:50.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.350+0000 7f5e777fe700 1 -- 172.21.15.73:0/867580913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e78101220 msgr2=0x7f5e7819d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:50.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.350+0000 7f5e777fe700 1 --2- 172.21.15.73:0/867580913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e78101220 0x7f5e7819d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:50.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.350+0000 7f5e777fe700 1 -- 172.21.15.73:0/867580913 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e680095f0 con 0x7f5e780ff690 2023-08-10T11:51:50.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.350+0000 7f5e777fe700 1 --2- 172.21.15.73:0/867580913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e780ff690 0x7f5e78069470 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5e680036f0 tx=0x7f5e68009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:50.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.350+0000 7f5e74ff9700 1 -- 172.21.15.73:0/867580913 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6801d070 con 0x7f5e780ff690 2023-08-10T11:51:50.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.350+0000 7f5e74ff9700 1 -- 172.21.15.73:0/867580913 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e68004010 con 0x7f5e780ff690 2023-08-10T11:51:50.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.350+0000 7f5e74ff9700 1 -- 172.21.15.73:0/867580913 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6800fe70 con 0x7f5e780ff690 2023-08-10T11:51:50.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.350+0000 7f5e7dc8d700 1 -- 172.21.15.73:0/867580913 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e7819e560 con 0x7f5e780ff690 2023-08-10T11:51:50.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.351+0000 7f5e7dc8d700 1 -- 172.21.15.73:0/867580913 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e7819e980 con 0x7f5e780ff690 2023-08-10T11:51:50.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.351+0000 7f5e7dc8d700 1 -- 172.21.15.73:0/867580913 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e78106be0 con 0x7f5e780ff690 2023-08-10T11:51:50.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.353+0000 7f5e74ff9700 1 -- 172.21.15.73:0/867580913 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f5e6800f560 con 0x7f5e780ff690 2023-08-10T11:51:50.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.353+0000 7f5e74ff9700 1 --2- 172.21.15.73:0/867580913 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5e640a12a0 0x7f5e640a3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:50.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.354+0000 7f5e76ffd700 1 --2- 172.21.15.73:0/867580913 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5e640a12a0 0x7f5e640a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:50.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.354+0000 7f5e74ff9700 1 -- 172.21.15.73:0/867580913 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5e680cddd0 con 0x7f5e780ff690 2023-08-10T11:51:50.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.354+0000 7f5e76ffd700 1 --2- 172.21.15.73:0/867580913 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5e640a12a0 0x7f5e640a3760 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5e60005950 tx=0x7f5e6000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:50.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.357+0000 7f5e74ff9700 1 -- 172.21.15.73:0/867580913 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f5e68097460 con 0x7f5e780ff690 2023-08-10T11:51:50.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.547+0000 7f5e7dc8d700 1 -- 172.21.15.73:0/867580913 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e7802cbc0 con 0x7f5e780ff690 2023-08-10T11:51:50.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.549+0000 7f5e74ff9700 1 -- 172.21.15.73:0/867580913 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22482 (secure 0 0 0) 0x7f5e6809aa80 con 0x7f5e780ff690 2023-08-10T11:51:50.550 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:51:50.550 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":85,"fsid":"0e619a74-3773-11ee-9b37-001a4aab830c","created":"2023-08-10T11:43:53.974768+0000","modified":"2023-08-10T11:51:49.637159+0000","last_up_change":"2023-08-10T11:50:12.914422+0000","last_in_change":"2023-08-10T11:49:54.624543+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T11:46:58.735153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T11:50:52.517974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T11:50:53.465357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3219ae18-cc4c-4712-b616-79f6949066e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6803","nonce":2725694252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6805","nonce":2725694252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6809","nonce":2725694252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6807","nonce":2725694252}]},"public_addr":"172.21.15.73:6803/2725694252","cluster_addr":"172.21.15.73:6805/2725694252","heartbeat_back_addr":"172.21.15.73:6809/2725694252","heartbeat_front_addr":"172.21.15.73:6807/2725694252","state":["exists","up"]},{"osd":1,"uuid":"bbfe6cd9-b3d3-4b8d-8814-507a867f8c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6801","nonce":836829168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6803","nonce":836829168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6807","nonce":836829168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6805","nonce":836829168}]},"public_addr":"172.21.15.152:6801/836829168","cluster_addr":"172.21.15.152:6803/836829168","heartbeat_back_addr":"172.21.15.152:6807/836829168","heartbeat_front_addr":"172.21.15.152:6805/836829168","state":["exists","up"]},{"osd":2,"uuid":"f57f5b2c-3208-45c0-beba-8501694b99c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6801","nonce":1789212298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6803","nonce":1789212298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6807","nonce":1789212298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6805","nonce":1789212298}]},"public_addr":"172.21.15.156:6801/1789212298","cluster_addr":"172.21.15.156:6803/1789212298","heartbeat_back_addr":"172.21.15.156:6807/1789212298","heartbeat_front_addr":"172.21.15.156:6805/1789212298","state":["exists","up"]},{"osd":3,"uuid":"18592408-3696-4ab8-ad41-c172b8409829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6811","nonce":3101572649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6813","nonce":3101572649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6817","nonce":3101572649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6815","nonce":3101572649}]},"public_addr":"172.21.15.73:6811/3101572649","cluster_addr":"172.21.15.73:6813/3101572649","heartbeat_back_addr":"172.21.15.73:6817/3101572649","heartbeat_front_addr":"172.21.15.73:6815/3101572649","state":["exists","up"]},{"osd":4,"uuid":"fb3adb09-8807-42d9-8db9-1867c5fe02da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6809","nonce":1451517889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6811","nonce":1451517889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6815","nonce":1451517889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6813","nonce":1451517889}]},"public_addr":"172.21.15.152:6809/1451517889","cluster_addr":"172.21.15.152:6811/1451517889","heartbeat_back_addr":"172.21.15.152:6815/1451517889","heartbeat_front_addr":"172.21.15.152:6813/1451517889","state":["exists","up"]},{"osd":5,"uuid":"af58a7bd-4e58-4639-95b2-4a76011b61dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6809","nonce":3823368741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6811","nonce":3823368741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6815","nonce":3823368741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6813","nonce":3823368741}]},"public_addr":"172.21.15.156:6809/3823368741","cluster_addr":"172.21.15.156:6811/3823368741","heartbeat_back_addr":"172.21.15.156:6815/3823368741","heartbeat_front_addr":"172.21.15.156:6813/3823368741","state":["exists","up"]},{"osd":6,"uuid":"f6ae502d-4af9-4f6a-8636-b5b683dfdfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6819","nonce":2533620458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6821","nonce":2533620458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6825","nonce":2533620458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6823","nonce":2533620458}]},"public_addr":"172.21.15.73:6819/2533620458","cluster_addr":"172.21.15.73:6821/2533620458","heartbeat_back_addr":"172.21.15.73:6825/2533620458","heartbeat_front_addr":"172.21.15.73:6823/2533620458","state":["exists","up"]},{"osd":7,"uuid":"398fd334-5f6f-427c-95ae-3244fb466f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6817","nonce":4059538477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6819","nonce":4059538477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6823","nonce":4059538477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6821","nonce":4059538477}]},"public_addr":"172.21.15.152:6817/4059538477","cluster_addr":"172.21.15.152:6819/4059538477","heartbeat_back_addr":"172.21.15.152:6823/4059538477","heartbeat_front_addr":"172.21.15.152:6821/4059538477","state":["exists","up"]},{"osd":8,"uuid":"58f46e64-2624-4ad4-bb6a-225624153837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6817","nonce":96487555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6819","nonce":96487555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6823","nonce":96487555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6821","nonce":96487555}]},"public_addr":"172.21.15.156:6817/96487555","cluster_addr":"172.21.15.156:6819/96487555","heartbeat_back_addr":"172.21.15.156:6823/96487555","heartbeat_front_addr":"172.21.15.156:6821/96487555","state":["exists","up"]},{"osd":9,"uuid":"9389dd5b-da2d-43b6-8bc0-bb1af13f72c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6827","nonce":2050124321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6829","nonce":2050124321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6833","nonce":2050124321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6831","nonce":2050124321}]},"public_addr":"172.21.15.73:6827/2050124321","cluster_addr":"172.21.15.73:6829/2050124321","heartbeat_back_addr":"172.21.15.73:6833/2050124321","heartbeat_front_addr":"172.21.15.73:6831/2050124321","state":["exists","up"]},{"osd":10,"uuid":"563c1e34-3acd-46ab-ba36-e9d87f635e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6825","nonce":1513186350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6827","nonce":1513186350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6831","nonce":1513186350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6829","nonce":1513186350}]},"public_addr":"172.21.15.152:6825/1513186350","cluster_addr":"172.21.15.152:6827/1513186350","heartbeat_back_addr":"172.21.15.152:6831/1513186350","heartbeat_front_addr":"172.21.15.152:6829/1513186350","state":["exists","up"]},{"osd":11,"uuid":"f1b55889-14fd-4cc9-bed7-43748086fb77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6825","nonce":737904755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6827","nonce":737904755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6831","nonce":737904755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6829","nonce":737904755}]},"public_addr":"172.21.15.156:6825/737904755","cluster_addr":"172.21.15.156:6827/737904755","heartbeat_back_addr":"172.21.15.156:6831/737904755","heartbeat_front_addr":"172.21.15.156:6829/737904755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:12.023797+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:33.872883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:55.856970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:18.013196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:39.202872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:00.393920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:22.743083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:43.921728+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:05.859488+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:27.618714+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:48.880286+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:50:11.055141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/2202785670":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6800/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:6800/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/1447381524":"2023-08-11T11:44:48.401660+0000","172.21.15.73:0/2545059698":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/4193457623":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2561039569":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2927950081":"2023-08-11T11:44:48.401660+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T11:51:50.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.551+0000 7f5e7dc8d700 1 -- 172.21.15.73:0/867580913 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5e640a12a0 msgr2=0x7f5e640a3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:50.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.551+0000 7f5e7dc8d700 1 --2- 172.21.15.73:0/867580913 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5e640a12a0 0x7f5e640a3760 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5e60005950 tx=0x7f5e6000b410 comp rx=0 tx=0).stop 2023-08-10T11:51:50.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.551+0000 7f5e7dc8d700 1 -- 172.21.15.73:0/867580913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e780ff690 msgr2=0x7f5e78069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:50.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.551+0000 7f5e7dc8d700 1 --2- 172.21.15.73:0/867580913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e780ff690 0x7f5e78069470 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5e680036f0 tx=0x7f5e68009580 comp rx=0 tx=0).stop 2023-08-10T11:51:50.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.551+0000 7f5e7dc8d700 1 -- 172.21.15.73:0/867580913 shutdown_connections 2023-08-10T11:51:50.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.551+0000 7f5e7dc8d700 1 --2- 172.21.15.73:0/867580913 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5e640a12a0 0x7f5e640a3760 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:50.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.551+0000 7f5e7dc8d700 1 --2- 172.21.15.73:0/867580913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e78101220 0x7f5e7819d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:50.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.551+0000 7f5e7dc8d700 1 --2- 172.21.15.73:0/867580913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e780ff690 0x7f5e78069470 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:50.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.551+0000 7f5e7dc8d700 1 --2- 172.21.15.73:0/867580913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e78100880 0x7f5e7819b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:50.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.551+0000 7f5e7dc8d700 1 -- 172.21.15.73:0/867580913 >> 172.21.15.73:0/867580913 conn(0x7f5e780fac00 msgr2=0x7f5e78103d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:50.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.551+0000 7f5e7dc8d700 1 -- 172.21.15.73:0/867580913 shutdown_connections 2023-08-10T11:51:50.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.551+0000 7f5e7dc8d700 1 -- 172.21.15.73:0/867580913 wait complete. 2023-08-10T11:51:50.564 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T11:46:58.735153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T11:50:52.517974+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T11:50:53.465357+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T11:51:50.565 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T11:51:50.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.691+0000 7fc18efd4700 1 -- 172.21.15.73:0/2358212827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1881011f0 msgr2=0x7fc188107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:50.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.691+0000 7fc18efd4700 1 --2- 172.21.15.73:0/2358212827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1881011f0 0x7fc188107aa0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc18000b0d0 tx=0x7fc18000b3e0 comp rx=0 tx=0).stop 2023-08-10T11:51:50.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.691+0000 7fc18efd4700 1 -- 172.21.15.73:0/2358212827 shutdown_connections 2023-08-10T11:51:50.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.691+0000 7fc18efd4700 1 --2- 172.21.15.73:0/2358212827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1880ff660 0x7fc1880ffa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:50.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.691+0000 7fc18efd4700 1 --2- 172.21.15.73:0/2358212827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1881011f0 0x7fc188107aa0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:50.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.691+0000 7fc18efd4700 1 --2- 172.21.15.73:0/2358212827 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc188100850 0x7fc188100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:50.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.691+0000 7fc18efd4700 1 -- 172.21.15.73:0/2358212827 >> 172.21.15.73:0/2358212827 conn(0x7fc1880fabd0 msgr2=0x7fc1880fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:50.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.691+0000 7fc18efd4700 1 -- 172.21.15.73:0/2358212827 shutdown_connections 2023-08-10T11:51:50.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.691+0000 7fc18efd4700 1 -- 172.21.15.73:0/2358212827 wait complete. 2023-08-10T11:51:50.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.691+0000 7fc18efd4700 1 Processor -- start 2023-08-10T11:51:50.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.692+0000 7fc18efd4700 1 -- start start 2023-08-10T11:51:50.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.692+0000 7fc18efd4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1880ff660 0x7fc188195470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:50.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.692+0000 7fc18efd4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc188100850 0x7fc1881959b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:50.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.692+0000 7fc18efd4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1881011f0 0x7fc18819ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:50.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.692+0000 7fc18efd4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18819cff0 con 0x7fc188100850 2023-08-10T11:51:50.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.692+0000 7fc18efd4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18819d130 con 0x7fc1880ff660 2023-08-10T11:51:50.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.692+0000 7fc18efd4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18819d2c0 con 0x7fc1881011f0 2023-08-10T11:51:50.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.692+0000 7fc187fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc188100850 0x7fc1881959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:50.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.692+0000 7fc187fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc188100850 0x7fc1881959b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59600/0 (socket says 172.21.15.73:59600) 2023-08-10T11:51:50.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.692+0000 7fc187fff700 1 -- 172.21.15.73:0/1943370866 learned_addr learned my addr 172.21.15.73:0/1943370866 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:50.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.692+0000 7fc18cd70700 1 --2- 172.21.15.73:0/1943370866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1880ff660 0x7fc188195470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:50.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.692+0000 7fc18d571700 1 --2- 172.21.15.73:0/1943370866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1881011f0 0x7fc18819ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:50.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.692+0000 7fc187fff700 1 -- 172.21.15.73:0/1943370866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1881011f0 msgr2=0x7fc18819ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:50.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.692+0000 7fc187fff700 1 --2- 172.21.15.73:0/1943370866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1881011f0 0x7fc18819ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:50.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.692+0000 7fc187fff700 1 -- 172.21.15.73:0/1943370866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1880ff660 msgr2=0x7fc188195470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:50.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.692+0000 7fc187fff700 1 --2- 172.21.15.73:0/1943370866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1880ff660 0x7fc188195470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:50.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.692+0000 7fc187fff700 1 -- 172.21.15.73:0/1943370866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc180009d00 con 0x7fc188100850 2023-08-10T11:51:50.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.692+0000 7fc18d571700 1 --2- 172.21.15.73:0/1943370866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1881011f0 0x7fc18819ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:50.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.692+0000 7fc187fff700 1 --2- 172.21.15.73:0/1943370866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc188100850 0x7fc1881959b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc17400c920 tx=0x7fc17400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:50.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.692+0000 7fc185ffb700 1 -- 172.21.15.73:0/1943370866 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc174007b00 con 0x7fc188100850 2023-08-10T11:51:50.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.692+0000 7fc185ffb700 1 -- 172.21.15.73:0/1943370866 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc174004cf0 con 0x7fc188100850 2023-08-10T11:51:50.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.692+0000 7fc18efd4700 1 -- 172.21.15.73:0/1943370866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc18819d5a0 con 0x7fc188100850 2023-08-10T11:51:50.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.692+0000 7fc185ffb700 1 -- 172.21.15.73:0/1943370866 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc174005610 con 0x7fc188100850 2023-08-10T11:51:50.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.693+0000 7fc18efd4700 1 -- 172.21.15.73:0/1943370866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc18819db00 con 0x7fc188100850 2023-08-10T11:51:50.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.694+0000 7fc18efd4700 1 -- 172.21.15.73:0/1943370866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1881065b0 con 0x7fc188100850 2023-08-10T11:51:50.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.694+0000 7fc185ffb700 1 -- 172.21.15.73:0/1943370866 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fc174004750 con 0x7fc188100850 2023-08-10T11:51:50.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.695+0000 7fc185ffb700 1 --2- 172.21.15.73:0/1943370866 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc1780a12e0 0x7fc1780a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:50.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.695+0000 7fc18cd70700 1 --2- 172.21.15.73:0/1943370866 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc1780a12e0 0x7fc1780a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:50.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.695+0000 7fc185ffb700 1 -- 172.21.15.73:0/1943370866 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc1740cca20 con 0x7fc188100850 2023-08-10T11:51:50.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.695+0000 7fc18cd70700 1 --2- 172.21.15.73:0/1943370866 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc1780a12e0 0x7fc1780a37a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc17c005950 tx=0x7fc17c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:50.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.699+0000 7fc185ffb700 1 -- 172.21.15.73:0/1943370866 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fc174095fc0 con 0x7fc188100850 2023-08-10T11:51:50.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.890+0000 7fc18efd4700 1 -- 172.21.15.73:0/1943370866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc18802c970 con 0x7fc188100850 2023-08-10T11:51:50.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.890+0000 7fc185ffb700 1 -- 172.21.15.73:0/1943370866 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc18802c970 con 0x7fc188100850 2023-08-10T11:51:50.891 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-08-10T11:51:50.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.892+0000 7fc18efd4700 1 -- 172.21.15.73:0/1943370866 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc1780a12e0 msgr2=0x7fc1780a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:50.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.892+0000 7fc18efd4700 1 --2- 172.21.15.73:0/1943370866 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc1780a12e0 0x7fc1780a37a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc17c005950 tx=0x7fc17c0058e0 comp rx=0 tx=0).stop 2023-08-10T11:51:50.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.892+0000 7fc18efd4700 1 -- 172.21.15.73:0/1943370866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc188100850 msgr2=0x7fc1881959b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:50.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.892+0000 7fc18efd4700 1 --2- 172.21.15.73:0/1943370866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc188100850 0x7fc1881959b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc17400c920 tx=0x7fc17400cce0 comp rx=0 tx=0).stop 2023-08-10T11:51:50.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.892+0000 7fc18efd4700 1 -- 172.21.15.73:0/1943370866 shutdown_connections 2023-08-10T11:51:50.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.892+0000 7fc18efd4700 1 --2- 172.21.15.73:0/1943370866 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc1780a12e0 0x7fc1780a37a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:50.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.892+0000 7fc18efd4700 1 --2- 172.21.15.73:0/1943370866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1880ff660 0x7fc188195470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:50.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.892+0000 7fc18efd4700 1 --2- 172.21.15.73:0/1943370866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1881011f0 0x7fc18819ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:50.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.892+0000 7fc18efd4700 1 --2- 172.21.15.73:0/1943370866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc188100850 0x7fc1881959b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:50.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.892+0000 7fc18efd4700 1 -- 172.21.15.73:0/1943370866 >> 172.21.15.73:0/1943370866 conn(0x7fc1880fabd0 msgr2=0x7fc1880fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:50.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.892+0000 7fc18efd4700 1 -- 172.21.15.73:0/1943370866 shutdown_connections 2023-08-10T11:51:50.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:50.892+0000 7fc18efd4700 1 -- 172.21.15.73:0/1943370866 wait complete. 2023-08-10T11:51:50.904 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:50 smithi073 ceph-mon[128869]: osdmap e85: 12 total, 12 up, 12 in 2023-08-10T11:51:50.904 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:50 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1812793576' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-08-10T11:51:50.904 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:50 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/867580913' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:51:50.905 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T11:51:50.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:50 smithi152 ceph-mon[130220]: osdmap e85: 12 total, 12 up, 12 in 2023-08-10T11:51:50.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:50 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1812793576' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-08-10T11:51:50.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:50 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/867580913' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:51:51.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:50 smithi156 ceph-mon[130574]: osdmap e85: 12 total, 12 up, 12 in 2023-08-10T11:51:51.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:50 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1812793576' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-08-10T11:51:51.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:50 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/867580913' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:51:51.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.030+0000 7fa3591fc700 1 -- 172.21.15.73:0/1958370480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa354100760 msgr2=0x7fa354100b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:51.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.030+0000 7fa3591fc700 1 --2- 172.21.15.73:0/1958370480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa354100760 0x7fa354100b80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa33c0099c0 tx=0x7fa33c009cd0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.030+0000 7fa3591fc700 1 -- 172.21.15.73:0/1958370480 shutdown_connections 2023-08-10T11:51:51.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.030+0000 7fa3591fc700 1 --2- 172.21.15.73:0/1958370480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3541022f0 0x7fa354108ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.030+0000 7fa3591fc700 1 --2- 172.21.15.73:0/1958370480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa354100760 0x7fa354100b80 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.030+0000 7fa3591fc700 1 --2- 172.21.15.73:0/1958370480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa354101950 0x7fa354101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.030+0000 7fa3591fc700 1 -- 172.21.15.73:0/1958370480 >> 172.21.15.73:0/1958370480 conn(0x7fa3540fbcf0 msgr2=0x7fa3540fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:51.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.030+0000 7fa3591fc700 1 -- 172.21.15.73:0/1958370480 shutdown_connections 2023-08-10T11:51:51.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.030+0000 7fa3591fc700 1 -- 172.21.15.73:0/1958370480 wait complete. 2023-08-10T11:51:51.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.031+0000 7fa3591fc700 1 Processor -- start 2023-08-10T11:51:51.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.031+0000 7fa3591fc700 1 -- start start 2023-08-10T11:51:51.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.031+0000 7fa3591fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa354100760 0x7fa3541964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:51.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.031+0000 7fa3591fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa354101950 0x7fa3541969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:51.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.031+0000 7fa3591fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3541022f0 0x7fa35419da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:51.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.031+0000 7fa3591fc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35419e020 con 0x7fa3541022f0 2023-08-10T11:51:51.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.031+0000 7fa3591fc700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35419e160 con 0x7fa354100760 2023-08-10T11:51:51.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.031+0000 7fa3591fc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35419e2f0 con 0x7fa354101950 2023-08-10T11:51:51.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.031+0000 7fa35359e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3541022f0 0x7fa35419da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:51.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.031+0000 7fa35359e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3541022f0 0x7fa35419da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59616/0 (socket says 172.21.15.73:59616) 2023-08-10T11:51:51.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.031+0000 7fa35359e700 1 -- 172.21.15.73:0/2113145273 learned_addr learned my addr 172.21.15.73:0/2113145273 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:51.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.031+0000 7fa352d9d700 1 --2- 172.21.15.73:0/2113145273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa354100760 0x7fa3541964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:51.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.031+0000 7fa35259c700 1 --2- 172.21.15.73:0/2113145273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa354101950 0x7fa3541969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:51.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.031+0000 7fa35359e700 1 -- 172.21.15.73:0/2113145273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa354101950 msgr2=0x7fa3541969e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:51.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.031+0000 7fa35359e700 1 --2- 172.21.15.73:0/2113145273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa354101950 0x7fa3541969e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.031+0000 7fa35359e700 1 -- 172.21.15.73:0/2113145273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa354100760 msgr2=0x7fa3541964a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:51.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.031+0000 7fa35359e700 1 --2- 172.21.15.73:0/2113145273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa354100760 0x7fa3541964a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.031+0000 7fa35359e700 1 -- 172.21.15.73:0/2113145273 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33c0095f0 con 0x7fa3541022f0 2023-08-10T11:51:51.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.031+0000 7fa352d9d700 1 --2- 172.21.15.73:0/2113145273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa354100760 0x7fa3541964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:51.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.031+0000 7fa35359e700 1 --2- 172.21.15.73:0/2113145273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3541022f0 0x7fa35419da50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa34c00ada0 tx=0x7fa34c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:51.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.032+0000 7fa34bfff700 1 -- 172.21.15.73:0/2113145273 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c00f070 con 0x7fa3541022f0 2023-08-10T11:51:51.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.032+0000 7fa3591fc700 1 -- 172.21.15.73:0/2113145273 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa35419e5d0 con 0x7fa3541022f0 2023-08-10T11:51:51.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.032+0000 7fa34bfff700 1 -- 172.21.15.73:0/2113145273 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa34c007b30 con 0x7fa3541022f0 2023-08-10T11:51:51.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.032+0000 7fa34bfff700 1 -- 172.21.15.73:0/2113145273 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c005440 con 0x7fa3541022f0 2023-08-10T11:51:51.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.032+0000 7fa3591fc700 1 -- 172.21.15.73:0/2113145273 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa35419ea90 con 0x7fa3541022f0 2023-08-10T11:51:51.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.033+0000 7fa3591fc700 1 -- 172.21.15.73:0/2113145273 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa354107d50 con 0x7fa3541022f0 2023-08-10T11:51:51.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.034+0000 7fa34bfff700 1 -- 172.21.15.73:0/2113145273 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fa34c004ad0 con 0x7fa3541022f0 2023-08-10T11:51:51.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.035+0000 7fa34bfff700 1 --2- 172.21.15.73:0/2113145273 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa3400a11e0 0x7fa3400a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:51.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.035+0000 7fa34bfff700 1 -- 172.21.15.73:0/2113145273 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa34c0cc730 con 0x7fa3541022f0 2023-08-10T11:51:51.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.035+0000 7fa352d9d700 1 --2- 172.21.15.73:0/2113145273 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa3400a11e0 0x7fa3400a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:51.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.035+0000 7fa352d9d700 1 --2- 172.21.15.73:0/2113145273 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa3400a11e0 0x7fa3400a36a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa33c0098e0 tx=0x7fa33c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:51.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.038+0000 7fa34bfff700 1 -- 172.21.15.73:0/2113145273 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fa34c095dc0 con 0x7fa3541022f0 2023-08-10T11:51:51.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.228+0000 7fa3591fc700 1 -- 172.21.15.73:0/2113145273 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa35402cdf0 con 0x7fa3541022f0 2023-08-10T11:51:51.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.228+0000 7fa34bfff700 1 -- 172.21.15.73:0/2113145273 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa35402cdf0 con 0x7fa3541022f0 2023-08-10T11:51:51.229 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-08-10T11:51:51.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.230+0000 7fa3591fc700 1 -- 172.21.15.73:0/2113145273 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa3400a11e0 msgr2=0x7fa3400a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:51.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.230+0000 7fa3591fc700 1 --2- 172.21.15.73:0/2113145273 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa3400a11e0 0x7fa3400a36a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa33c0098e0 tx=0x7fa33c000bc0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.230+0000 7fa3591fc700 1 -- 172.21.15.73:0/2113145273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3541022f0 msgr2=0x7fa35419da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:51.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.230+0000 7fa3591fc700 1 --2- 172.21.15.73:0/2113145273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3541022f0 0x7fa35419da50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa34c00ada0 tx=0x7fa34c00c330 comp rx=0 tx=0).stop 2023-08-10T11:51:51.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.230+0000 7fa3591fc700 1 -- 172.21.15.73:0/2113145273 shutdown_connections 2023-08-10T11:51:51.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.230+0000 7fa3591fc700 1 --2- 172.21.15.73:0/2113145273 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa3400a11e0 0x7fa3400a36a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.230+0000 7fa3591fc700 1 --2- 172.21.15.73:0/2113145273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa354100760 0x7fa3541964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.230+0000 7fa3591fc700 1 --2- 172.21.15.73:0/2113145273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3541022f0 0x7fa35419da50 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.230+0000 7fa3591fc700 1 --2- 172.21.15.73:0/2113145273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa354101950 0x7fa3541969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.230+0000 7fa3591fc700 1 -- 172.21.15.73:0/2113145273 >> 172.21.15.73:0/2113145273 conn(0x7fa3540fbcf0 msgr2=0x7fa354104e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:51.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.230+0000 7fa3591fc700 1 -- 172.21.15.73:0/2113145273 shutdown_connections 2023-08-10T11:51:51.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.230+0000 7fa3591fc700 1 -- 172.21.15.73:0/2113145273 wait complete. 2023-08-10T11:51:51.243 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T11:51:51.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.366+0000 7f5c46ec0700 1 -- 172.21.15.73:0/734363530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c400fea10 msgr2=0x7f5c400fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:51.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.366+0000 7f5c46ec0700 1 --2- 172.21.15.73:0/734363530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c400fea10 0x7f5c400fee30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5c34009990 tx=0x7f5c34009ca0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.366+0000 7f5c46ec0700 1 -- 172.21.15.73:0/734363530 shutdown_connections 2023-08-10T11:51:51.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.366+0000 7f5c46ec0700 1 --2- 172.21.15.73:0/734363530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c40102380 0x7f5c40108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.366+0000 7f5c46ec0700 1 --2- 172.21.15.73:0/734363530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c400fea10 0x7f5c400fee30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.366+0000 7f5c46ec0700 1 --2- 172.21.15.73:0/734363530 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c401019e0 0x7f5c40101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.366+0000 7f5c46ec0700 1 -- 172.21.15.73:0/734363530 >> 172.21.15.73:0/734363530 conn(0x7f5c400fa340 msgr2=0x7f5c400fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:51.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.367+0000 7f5c46ec0700 1 -- 172.21.15.73:0/734363530 shutdown_connections 2023-08-10T11:51:51.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.367+0000 7f5c46ec0700 1 -- 172.21.15.73:0/734363530 wait complete. 2023-08-10T11:51:51.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.367+0000 7f5c46ec0700 1 Processor -- start 2023-08-10T11:51:51.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.367+0000 7f5c46ec0700 1 -- start start 2023-08-10T11:51:51.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.367+0000 7f5c46ec0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c400fea10 0x7f5c40196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:51.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.367+0000 7f5c46ec0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c401019e0 0x7f5c40196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:51.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.367+0000 7f5c46ec0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c40102380 0x7f5c4019da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:51.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.367+0000 7f5c46ec0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4019dfd0 con 0x7f5c400fea10 2023-08-10T11:51:51.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.367+0000 7f5c46ec0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4019e110 con 0x7f5c40102380 2023-08-10T11:51:51.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.367+0000 7f5c46ec0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4019e2a0 con 0x7f5c401019e0 2023-08-10T11:51:51.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.367+0000 7f5c44c5c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c400fea10 0x7f5c40196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:51.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.367+0000 7f5c44c5c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c400fea10 0x7f5c40196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59624/0 (socket says 172.21.15.73:59624) 2023-08-10T11:51:51.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.367+0000 7f5c44c5c700 1 -- 172.21.15.73:0/1870593040 learned_addr learned my addr 172.21.15.73:0/1870593040 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:51.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.367+0000 7f5c4545d700 1 --2- 172.21.15.73:0/1870593040 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c40102380 0x7f5c4019da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:51.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.368+0000 7f5c3ffff700 1 --2- 172.21.15.73:0/1870593040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c401019e0 0x7f5c40196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:51.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.368+0000 7f5c44c5c700 1 -- 172.21.15.73:0/1870593040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c401019e0 msgr2=0x7f5c40196990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:51.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.368+0000 7f5c44c5c700 1 --2- 172.21.15.73:0/1870593040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c401019e0 0x7f5c40196990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.368+0000 7f5c44c5c700 1 -- 172.21.15.73:0/1870593040 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c40102380 msgr2=0x7f5c4019da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:51.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.368+0000 7f5c44c5c700 1 --2- 172.21.15.73:0/1870593040 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c40102380 0x7f5c4019da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.368+0000 7f5c44c5c700 1 -- 172.21.15.73:0/1870593040 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c340095f0 con 0x7f5c400fea10 2023-08-10T11:51:51.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.368+0000 7f5c3ffff700 1 --2- 172.21.15.73:0/1870593040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c401019e0 0x7f5c40196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:51.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.368+0000 7f5c44c5c700 1 --2- 172.21.15.73:0/1870593040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c400fea10 0x7f5c40196450 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5c340095c0 tx=0x7f5c3400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:51.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.368+0000 7f5c3dffb700 1 -- 172.21.15.73:0/1870593040 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3401d070 con 0x7f5c400fea10 2023-08-10T11:51:51.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.368+0000 7f5c3dffb700 1 -- 172.21.15.73:0/1870593040 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5c34004cf0 con 0x7f5c400fea10 2023-08-10T11:51:51.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.368+0000 7f5c46ec0700 1 -- 172.21.15.73:0/1870593040 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4019e520 con 0x7f5c400fea10 2023-08-10T11:51:51.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.368+0000 7f5c3dffb700 1 -- 172.21.15.73:0/1870593040 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c34005520 con 0x7f5c400fea10 2023-08-10T11:51:51.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.368+0000 7f5c46ec0700 1 -- 172.21.15.73:0/1870593040 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c4019e8e0 con 0x7f5c400fea10 2023-08-10T11:51:51.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.369+0000 7f5c46ec0700 1 -- 172.21.15.73:0/1870593040 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c40107720 con 0x7f5c400fea10 2023-08-10T11:51:51.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.370+0000 7f5c3dffb700 1 -- 172.21.15.73:0/1870593040 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f5c34004830 con 0x7f5c400fea10 2023-08-10T11:51:51.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.370+0000 7f5c3dffb700 1 --2- 172.21.15.73:0/1870593040 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5c300a11e0 0x7f5c300a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:51.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.371+0000 7f5c3ffff700 1 --2- 172.21.15.73:0/1870593040 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5c300a11e0 0x7f5c300a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:51.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.371+0000 7f5c3dffb700 1 -- 172.21.15.73:0/1870593040 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5c340cdda0 con 0x7f5c400fea10 2023-08-10T11:51:51.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.371+0000 7f5c3ffff700 1 --2- 172.21.15.73:0/1870593040 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5c300a11e0 0x7f5c300a36a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c005fd0 tx=0x7f5c2c005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:51.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.375+0000 7f5c3dffb700 1 -- 172.21.15.73:0/1870593040 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f5c3405b790 con 0x7f5c400fea10 2023-08-10T11:51:51.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.565+0000 7f5c46ec0700 1 -- 172.21.15.73:0/1870593040 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5c4002c970 con 0x7f5c400fea10 2023-08-10T11:51:51.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.565+0000 7f5c3dffb700 1 -- 172.21.15.73:0/1870593040 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5c340973d0 con 0x7f5c400fea10 2023-08-10T11:51:51.566 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-08-10T11:51:51.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.567+0000 7f5c46ec0700 1 -- 172.21.15.73:0/1870593040 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5c300a11e0 msgr2=0x7f5c300a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:51.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.567+0000 7f5c46ec0700 1 --2- 172.21.15.73:0/1870593040 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5c300a11e0 0x7f5c300a36a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c005fd0 tx=0x7f5c2c005ee0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.567+0000 7f5c46ec0700 1 -- 172.21.15.73:0/1870593040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c400fea10 msgr2=0x7f5c40196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:51.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.567+0000 7f5c46ec0700 1 --2- 172.21.15.73:0/1870593040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c400fea10 0x7f5c40196450 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5c340095c0 tx=0x7f5c3400f690 comp rx=0 tx=0).stop 2023-08-10T11:51:51.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.567+0000 7f5c46ec0700 1 -- 172.21.15.73:0/1870593040 shutdown_connections 2023-08-10T11:51:51.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.567+0000 7f5c46ec0700 1 --2- 172.21.15.73:0/1870593040 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5c300a11e0 0x7f5c300a36a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.567+0000 7f5c46ec0700 1 --2- 172.21.15.73:0/1870593040 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c40102380 0x7f5c4019da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.567+0000 7f5c46ec0700 1 --2- 172.21.15.73:0/1870593040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c400fea10 0x7f5c40196450 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.567+0000 7f5c46ec0700 1 --2- 172.21.15.73:0/1870593040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c401019e0 0x7f5c40196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.567+0000 7f5c46ec0700 1 -- 172.21.15.73:0/1870593040 >> 172.21.15.73:0/1870593040 conn(0x7f5c400fa340 msgr2=0x7f5c400fc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:51.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.567+0000 7f5c46ec0700 1 -- 172.21.15.73:0/1870593040 shutdown_connections 2023-08-10T11:51:51.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.567+0000 7f5c46ec0700 1 -- 172.21.15.73:0/1870593040 wait complete. 2023-08-10T11:51:51.580 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T11:51:51.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.702+0000 7fa24e4bc700 1 -- 172.21.15.73:0/3159159482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2481011e0 msgr2=0x7fa248107a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:51.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.702+0000 7fa24e4bc700 1 --2- 172.21.15.73:0/3159159482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2481011e0 0x7fa248107a90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa24000b0d0 tx=0x7fa24000b3e0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.702+0000 7fa24e4bc700 1 -- 172.21.15.73:0/3159159482 shutdown_connections 2023-08-10T11:51:51.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.702+0000 7fa24e4bc700 1 --2- 172.21.15.73:0/3159159482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2481011e0 0x7fa248107a90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.702+0000 7fa24e4bc700 1 --2- 172.21.15.73:0/3159159482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2480ff650 0x7fa2480ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.702+0000 7fa24e4bc700 1 --2- 172.21.15.73:0/3159159482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa248100840 0x7fa248100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.702+0000 7fa24e4bc700 1 -- 172.21.15.73:0/3159159482 >> 172.21.15.73:0/3159159482 conn(0x7fa2480faba0 msgr2=0x7fa2480fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:51.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.702+0000 7fa24e4bc700 1 -- 172.21.15.73:0/3159159482 shutdown_connections 2023-08-10T11:51:51.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.702+0000 7fa24e4bc700 1 -- 172.21.15.73:0/3159159482 wait complete. 2023-08-10T11:51:51.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.703+0000 7fa24e4bc700 1 Processor -- start 2023-08-10T11:51:51.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.703+0000 7fa24e4bc700 1 -- start start 2023-08-10T11:51:51.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.703+0000 7fa24e4bc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2480ff650 0x7fa248195470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:51.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.703+0000 7fa24e4bc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa248100840 0x7fa2481959b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:51.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.703+0000 7fa24e4bc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2481011e0 0x7fa24819ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:51.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.703+0000 7fa24e4bc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24819cff0 con 0x7fa2481011e0 2023-08-10T11:51:51.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.703+0000 7fa24e4bc700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24819d130 con 0x7fa2480ff650 2023-08-10T11:51:51.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.703+0000 7fa24e4bc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24819d2c0 con 0x7fa248100840 2023-08-10T11:51:51.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.703+0000 7fa24ca59700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2481011e0 0x7fa24819ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:51.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.703+0000 7fa24ca59700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2481011e0 0x7fa24819ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59642/0 (socket says 172.21.15.73:59642) 2023-08-10T11:51:51.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.704+0000 7fa24ca59700 1 -- 172.21.15.73:0/370267241 learned_addr learned my addr 172.21.15.73:0/370267241 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:51.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.704+0000 7fa247fff700 1 --2- 172.21.15.73:0/370267241 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2480ff650 0x7fa248195470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:51.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.704+0000 7fa2477fe700 1 --2- 172.21.15.73:0/370267241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa248100840 0x7fa2481959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:51.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.704+0000 7fa24ca59700 1 -- 172.21.15.73:0/370267241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa248100840 msgr2=0x7fa2481959b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:51.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.704+0000 7fa24ca59700 1 --2- 172.21.15.73:0/370267241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa248100840 0x7fa2481959b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.704+0000 7fa24ca59700 1 -- 172.21.15.73:0/370267241 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2480ff650 msgr2=0x7fa248195470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:51.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.704+0000 7fa24ca59700 1 --2- 172.21.15.73:0/370267241 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2480ff650 0x7fa248195470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.704+0000 7fa24ca59700 1 -- 172.21.15.73:0/370267241 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa240009d00 con 0x7fa2481011e0 2023-08-10T11:51:51.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.704+0000 7fa24ca59700 1 --2- 172.21.15.73:0/370267241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2481011e0 0x7fa24819ca20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa240007a00 tx=0x7fa240009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:51.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.704+0000 7fa2457fa700 1 -- 172.21.15.73:0/370267241 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24000e040 con 0x7fa2481011e0 2023-08-10T11:51:51.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.704+0000 7fa2457fa700 1 -- 172.21.15.73:0/370267241 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa240003e10 con 0x7fa2481011e0 2023-08-10T11:51:51.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.704+0000 7fa24e4bc700 1 -- 172.21.15.73:0/370267241 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2480678d0 con 0x7fa2481011e0 2023-08-10T11:51:51.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.704+0000 7fa2457fa700 1 -- 172.21.15.73:0/370267241 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa240005610 con 0x7fa2481011e0 2023-08-10T11:51:51.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.704+0000 7fa24e4bc700 1 -- 172.21.15.73:0/370267241 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa248067d80 con 0x7fa2481011e0 2023-08-10T11:51:51.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.705+0000 7fa24e4bc700 1 -- 172.21.15.73:0/370267241 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa248068770 con 0x7fa2481011e0 2023-08-10T11:51:51.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.706+0000 7fa2457fa700 1 -- 172.21.15.73:0/370267241 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fa240005770 con 0x7fa2481011e0 2023-08-10T11:51:51.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.707+0000 7fa2457fa700 1 --2- 172.21.15.73:0/370267241 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa2300a1220 0x7fa2300a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:51.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.707+0000 7fa2457fa700 1 -- 172.21.15.73:0/370267241 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa24001e070 con 0x7fa2481011e0 2023-08-10T11:51:51.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.707+0000 7fa247fff700 1 --2- 172.21.15.73:0/370267241 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa2300a1220 0x7fa2300a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:51.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.707+0000 7fa247fff700 1 --2- 172.21.15.73:0/370267241 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa2300a1220 0x7fa2300a36e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa2481006a0 tx=0x7fa23800b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:51.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.710+0000 7fa2457fa700 1 -- 172.21.15.73:0/370267241 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fa240099740 con 0x7fa2481011e0 2023-08-10T11:51:51.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.944+0000 7fa24e4bc700 1 -- 172.21.15.73:0/370267241 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa248106580 con 0x7fa2481011e0 2023-08-10T11:51:51.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.945+0000 7fa2457fa700 1 -- 172.21.15.73:0/370267241 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10891 (secure 0 0 0) 0x7fa24009cd60 con 0x7fa2481011e0 2023-08-10T11:51:51.946 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:51:51.946 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1319360725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1319360725},{"type":"v1","addr":"172.21.15.73:6835","nonce":1319360725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/431221951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":431221951},{"type":"v1","addr":"172.21.15.73:6837","nonce":431221951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-10T11:50:54.304447+0000","modified":"2023-08-10T11:51:01.523452+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24503,"mds_1":24479,"mds_2":24451,"mds_3":24443,"mds_4":24419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6839/1099539481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1099539481},{"type":"v1","addr":"172.21.15.73:6839","nonce":1099539481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6841/3067925859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":3067925859},{"type":"v1","addr":"172.21.15.73:6841","nonce":3067925859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24397":{"gid":24397,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6833/3028461815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3028461815},{"type":"v1","addr":"172.21.15.156:6833","nonce":3028461815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24419":{"gid":24419,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6833/4148407154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4148407154},{"type":"v1","addr":"172.21.15.152:6833","nonce":4148407154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24443":{"gid":24443,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.152:6835/1791572604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1791572604},{"type":"v1","addr":"172.21.15.152:6835","nonce":1791572604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.156:6835/904126790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":904126790},{"type":"v1","addr":"172.21.15.156:6835","nonce":904126790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24457":{"gid":24457,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/4284306352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":4284306352},{"type":"v1","addr":"172.21.15.156:6837","nonce":4284306352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6839/3361058731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":3361058731},{"type":"v1","addr":"172.21.15.156:6839","nonce":3361058731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6837/74214089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":74214089},{"type":"v1","addr":"172.21.15.152:6837","nonce":74214089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6839/3870202690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3870202690},{"type":"v1","addr":"172.21.15.152:6839","nonce":3870202690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T11:51:51.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.947+0000 7fa24e4bc700 1 -- 172.21.15.73:0/370267241 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa2300a1220 msgr2=0x7fa2300a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:51.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.947+0000 7fa24e4bc700 1 --2- 172.21.15.73:0/370267241 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa2300a1220 0x7fa2300a36e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa2481006a0 tx=0x7fa23800b5b0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.947+0000 7fa24e4bc700 1 -- 172.21.15.73:0/370267241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2481011e0 msgr2=0x7fa24819ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:51.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.947+0000 7fa24e4bc700 1 --2- 172.21.15.73:0/370267241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2481011e0 0x7fa24819ca20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa240007a00 tx=0x7fa240009570 comp rx=0 tx=0).stop 2023-08-10T11:51:51.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.947+0000 7fa24e4bc700 1 -- 172.21.15.73:0/370267241 shutdown_connections 2023-08-10T11:51:51.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.947+0000 7fa24e4bc700 1 --2- 172.21.15.73:0/370267241 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa2300a1220 0x7fa2300a36e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.947+0000 7fa24e4bc700 1 --2- 172.21.15.73:0/370267241 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2480ff650 0x7fa248195470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.947+0000 7fa24e4bc700 1 --2- 172.21.15.73:0/370267241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2481011e0 0x7fa24819ca20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.947+0000 7fa24e4bc700 1 --2- 172.21.15.73:0/370267241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa248100840 0x7fa2481959b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:51.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.947+0000 7fa24e4bc700 1 -- 172.21.15.73:0/370267241 >> 172.21.15.73:0/370267241 conn(0x7fa2480faba0 msgr2=0x7fa248103ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:51.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.947+0000 7fa24e4bc700 1 -- 172.21.15.73:0/370267241 shutdown_connections 2023-08-10T11:51:51.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:51.947+0000 7fa24e4bc700 1 -- 172.21.15.73:0/370267241 wait complete. 2023-08-10T11:51:51.950 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 27 2023-08-10T11:51:51.960 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:51 smithi073 ceph-mon[128869]: pgmap v286: 97 pgs: 1 activating+degraded, 2 activating, 94 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s; 6/306 objects degraded (1.961%) 2023-08-10T11:51:51.960 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:51 smithi073 ceph-mon[128869]: Health check failed: Degraded data redundancy: 6/306 objects degraded (1.961%), 1 pg degraded (PG_DEGRADED) 2023-08-10T11:51:51.960 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:51 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1943370866' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:51:51.960 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:51 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2113145273' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:51:51.961 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:51 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1870593040' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:51:51.962 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T11:51:51.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:51 smithi152 ceph-mon[130220]: pgmap v286: 97 pgs: 1 activating+degraded, 2 activating, 94 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s; 6/306 objects degraded (1.961%) 2023-08-10T11:51:51.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:51 smithi152 ceph-mon[130220]: Health check failed: Degraded data redundancy: 6/306 objects degraded (1.961%), 1 pg degraded (PG_DEGRADED) 2023-08-10T11:51:51.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:51 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1943370866' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:51:51.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:51 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/2113145273' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:51:51.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:51 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1870593040' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:51:52.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:51 smithi156 ceph-mon[130574]: pgmap v286: 97 pgs: 1 activating+degraded, 2 activating, 94 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s; 6/306 objects degraded (1.961%) 2023-08-10T11:51:52.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:51 smithi156 ceph-mon[130574]: Health check failed: Degraded data redundancy: 6/306 objects degraded (1.961%), 1 pg degraded (PG_DEGRADED) 2023-08-10T11:51:52.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:51 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1943370866' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:51:52.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:51 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/2113145273' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:51:52.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:51 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1870593040' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:51:52.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.082+0000 7f50cd78d700 1 -- 172.21.15.73:0/2235070112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50c80ff660 msgr2=0x7f50c80ffa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:52.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.082+0000 7f50cd78d700 1 --2- 172.21.15.73:0/2235070112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50c80ff660 0x7f50c80ffa80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f50b80099c0 tx=0x7f50b8009cd0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.082+0000 7f50cd78d700 1 -- 172.21.15.73:0/2235070112 shutdown_connections 2023-08-10T11:51:52.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.082+0000 7f50cd78d700 1 --2- 172.21.15.73:0/2235070112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50c81011f0 0x7f50c8107aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.082+0000 7f50cd78d700 1 --2- 172.21.15.73:0/2235070112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50c80ff660 0x7f50c80ffa80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.082+0000 7f50cd78d700 1 --2- 172.21.15.73:0/2235070112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50c8100850 0x7f50c8100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.082+0000 7f50cd78d700 1 -- 172.21.15.73:0/2235070112 >> 172.21.15.73:0/2235070112 conn(0x7f50c80fabd0 msgr2=0x7f50c80fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:52.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.082+0000 7f50cd78d700 1 -- 172.21.15.73:0/2235070112 shutdown_connections 2023-08-10T11:51:52.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.082+0000 7f50cd78d700 1 -- 172.21.15.73:0/2235070112 wait complete. 2023-08-10T11:51:52.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.083+0000 7f50cd78d700 1 Processor -- start 2023-08-10T11:51:52.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.083+0000 7f50cd78d700 1 -- start start 2023-08-10T11:51:52.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.083+0000 7f50cd78d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50c80ff660 0x7f50c81035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:52.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.083+0000 7f50cd78d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50c8100850 0x7f50c8101c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:52.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.083+0000 7f50cd78d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50c81011f0 0x7f50c8102170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:52.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.083+0000 7f50cd78d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c8102910 con 0x7f50c80ff660 2023-08-10T11:51:52.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.083+0000 7f50cd78d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c8102a80 con 0x7f50c81011f0 2023-08-10T11:51:52.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.083+0000 7f50cd78d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c81a04d0 con 0x7f50c8100850 2023-08-10T11:51:52.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.083+0000 7f50c6ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50c80ff660 0x7f50c81035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:52.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.083+0000 7f50c6ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50c80ff660 0x7f50c81035f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59654/0 (socket says 172.21.15.73:59654) 2023-08-10T11:51:52.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.083+0000 7f50c6ffd700 1 -- 172.21.15.73:0/1181536451 learned_addr learned my addr 172.21.15.73:0/1181536451 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:52.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.083+0000 7f50c67fc700 1 --2- 172.21.15.73:0/1181536451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50c8100850 0x7f50c8101c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:52.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.083+0000 7f50c77fe700 1 --2- 172.21.15.73:0/1181536451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50c81011f0 0x7f50c8102170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:52.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.083+0000 7f50c6ffd700 1 -- 172.21.15.73:0/1181536451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50c8100850 msgr2=0x7f50c8101c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:52.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.083+0000 7f50c6ffd700 1 --2- 172.21.15.73:0/1181536451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50c8100850 0x7f50c8101c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.083+0000 7f50c6ffd700 1 -- 172.21.15.73:0/1181536451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50c81011f0 msgr2=0x7f50c8102170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:52.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.083+0000 7f50c6ffd700 1 --2- 172.21.15.73:0/1181536451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50c81011f0 0x7f50c8102170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.083+0000 7f50c6ffd700 1 -- 172.21.15.73:0/1181536451 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b80095f0 con 0x7f50c80ff660 2023-08-10T11:51:52.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.083+0000 7f50c77fe700 1 --2- 172.21.15.73:0/1181536451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50c81011f0 0x7f50c8102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:52.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.084+0000 7f50c6ffd700 1 --2- 172.21.15.73:0/1181536451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50c80ff660 0x7f50c81035f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f50b80036f0 tx=0x7f50b8009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:52.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.084+0000 7f50bffff700 1 -- 172.21.15.73:0/1181536451 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b801d070 con 0x7f50c80ff660 2023-08-10T11:51:52.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.084+0000 7f50cd78d700 1 -- 172.21.15.73:0/1181536451 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c81a0750 con 0x7f50c80ff660 2023-08-10T11:51:52.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.084+0000 7f50bffff700 1 -- 172.21.15.73:0/1181536451 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50b8004010 con 0x7f50c80ff660 2023-08-10T11:51:52.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.084+0000 7f50bffff700 1 -- 172.21.15.73:0/1181536451 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b800fe70 con 0x7f50c80ff660 2023-08-10T11:51:52.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.084+0000 7f50cd78d700 1 -- 172.21.15.73:0/1181536451 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c81a0b80 con 0x7f50c80ff660 2023-08-10T11:51:52.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.085+0000 7f50cd78d700 1 -- 172.21.15.73:0/1181536451 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c810aed0 con 0x7f50c80ff660 2023-08-10T11:51:52.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.086+0000 7f50bffff700 1 -- 172.21.15.73:0/1181536451 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f50b800f560 con 0x7f50c80ff660 2023-08-10T11:51:52.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.086+0000 7f50bffff700 1 --2- 172.21.15.73:0/1181536451 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f50b40a1220 0x7f50b40a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:52.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.086+0000 7f50c67fc700 1 --2- 172.21.15.73:0/1181536451 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f50b40a1220 0x7f50b40a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:52.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.086+0000 7f50bffff700 1 -- 172.21.15.73:0/1181536451 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f50b80cddc0 con 0x7f50c80ff660 2023-08-10T11:51:52.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.087+0000 7f50c67fc700 1 --2- 172.21.15.73:0/1181536451 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f50b40a1220 0x7f50b40a36e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f50b000ac50 tx=0x7f50b000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:52.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.090+0000 7f50bffff700 1 -- 172.21.15.73:0/1181536451 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f50b8097450 con 0x7f50c80ff660 2023-08-10T11:51:52.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.278+0000 7f50cd78d700 1 -- 172.21.15.73:0/1181536451 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50c81a11c0 con 0x7f50c80ff660 2023-08-10T11:51:52.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.279+0000 7f50bffff700 1 -- 172.21.15.73:0/1181536451 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22482 (secure 0 0 0) 0x7f50b809aa70 con 0x7f50c80ff660 2023-08-10T11:51:52.281 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:51:52.281 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":85,"fsid":"0e619a74-3773-11ee-9b37-001a4aab830c","created":"2023-08-10T11:43:53.974768+0000","modified":"2023-08-10T11:51:49.637159+0000","last_up_change":"2023-08-10T11:50:12.914422+0000","last_in_change":"2023-08-10T11:49:54.624543+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T11:46:58.735153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T11:50:52.517974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T11:50:53.465357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3219ae18-cc4c-4712-b616-79f6949066e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6803","nonce":2725694252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6805","nonce":2725694252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6809","nonce":2725694252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6807","nonce":2725694252}]},"public_addr":"172.21.15.73:6803/2725694252","cluster_addr":"172.21.15.73:6805/2725694252","heartbeat_back_addr":"172.21.15.73:6809/2725694252","heartbeat_front_addr":"172.21.15.73:6807/2725694252","state":["exists","up"]},{"osd":1,"uuid":"bbfe6cd9-b3d3-4b8d-8814-507a867f8c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6801","nonce":836829168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6803","nonce":836829168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6807","nonce":836829168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6805","nonce":836829168}]},"public_addr":"172.21.15.152:6801/836829168","cluster_addr":"172.21.15.152:6803/836829168","heartbeat_back_addr":"172.21.15.152:6807/836829168","heartbeat_front_addr":"172.21.15.152:6805/836829168","state":["exists","up"]},{"osd":2,"uuid":"f57f5b2c-3208-45c0-beba-8501694b99c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6801","nonce":1789212298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6803","nonce":1789212298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6807","nonce":1789212298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6805","nonce":1789212298}]},"public_addr":"172.21.15.156:6801/1789212298","cluster_addr":"172.21.15.156:6803/1789212298","heartbeat_back_addr":"172.21.15.156:6807/1789212298","heartbeat_front_addr":"172.21.15.156:6805/1789212298","state":["exists","up"]},{"osd":3,"uuid":"18592408-3696-4ab8-ad41-c172b8409829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6811","nonce":3101572649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6813","nonce":3101572649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6817","nonce":3101572649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6815","nonce":3101572649}]},"public_addr":"172.21.15.73:6811/3101572649","cluster_addr":"172.21.15.73:6813/3101572649","heartbeat_back_addr":"172.21.15.73:6817/3101572649","heartbeat_front_addr":"172.21.15.73:6815/3101572649","state":["exists","up"]},{"osd":4,"uuid":"fb3adb09-8807-42d9-8db9-1867c5fe02da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6809","nonce":1451517889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6811","nonce":1451517889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6815","nonce":1451517889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6813","nonce":1451517889}]},"public_addr":"172.21.15.152:6809/1451517889","cluster_addr":"172.21.15.152:6811/1451517889","heartbeat_back_addr":"172.21.15.152:6815/1451517889","heartbeat_front_addr":"172.21.15.152:6813/1451517889","state":["exists","up"]},{"osd":5,"uuid":"af58a7bd-4e58-4639-95b2-4a76011b61dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6809","nonce":3823368741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6811","nonce":3823368741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6815","nonce":3823368741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6813","nonce":3823368741}]},"public_addr":"172.21.15.156:6809/3823368741","cluster_addr":"172.21.15.156:6811/3823368741","heartbeat_back_addr":"172.21.15.156:6815/3823368741","heartbeat_front_addr":"172.21.15.156:6813/3823368741","state":["exists","up"]},{"osd":6,"uuid":"f6ae502d-4af9-4f6a-8636-b5b683dfdfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6819","nonce":2533620458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6821","nonce":2533620458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6825","nonce":2533620458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6823","nonce":2533620458}]},"public_addr":"172.21.15.73:6819/2533620458","cluster_addr":"172.21.15.73:6821/2533620458","heartbeat_back_addr":"172.21.15.73:6825/2533620458","heartbeat_front_addr":"172.21.15.73:6823/2533620458","state":["exists","up"]},{"osd":7,"uuid":"398fd334-5f6f-427c-95ae-3244fb466f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6817","nonce":4059538477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6819","nonce":4059538477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6823","nonce":4059538477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6821","nonce":4059538477}]},"public_addr":"172.21.15.152:6817/4059538477","cluster_addr":"172.21.15.152:6819/4059538477","heartbeat_back_addr":"172.21.15.152:6823/4059538477","heartbeat_front_addr":"172.21.15.152:6821/4059538477","state":["exists","up"]},{"osd":8,"uuid":"58f46e64-2624-4ad4-bb6a-225624153837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6817","nonce":96487555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6819","nonce":96487555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6823","nonce":96487555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6821","nonce":96487555}]},"public_addr":"172.21.15.156:6817/96487555","cluster_addr":"172.21.15.156:6819/96487555","heartbeat_back_addr":"172.21.15.156:6823/96487555","heartbeat_front_addr":"172.21.15.156:6821/96487555","state":["exists","up"]},{"osd":9,"uuid":"9389dd5b-da2d-43b6-8bc0-bb1af13f72c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6827","nonce":2050124321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6829","nonce":2050124321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6833","nonce":2050124321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6831","nonce":2050124321}]},"public_addr":"172.21.15.73:6827/2050124321","cluster_addr":"172.21.15.73:6829/2050124321","heartbeat_back_addr":"172.21.15.73:6833/2050124321","heartbeat_front_addr":"172.21.15.73:6831/2050124321","state":["exists","up"]},{"osd":10,"uuid":"563c1e34-3acd-46ab-ba36-e9d87f635e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6825","nonce":1513186350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6827","nonce":1513186350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6831","nonce":1513186350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6829","nonce":1513186350}]},"public_addr":"172.21.15.152:6825/1513186350","cluster_addr":"172.21.15.152:6827/1513186350","heartbeat_back_addr":"172.21.15.152:6831/1513186350","heartbeat_front_addr":"172.21.15.152:6829/1513186350","state":["exists","up"]},{"osd":11,"uuid":"f1b55889-14fd-4cc9-bed7-43748086fb77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6825","nonce":737904755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6827","nonce":737904755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6831","nonce":737904755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6829","nonce":737904755}]},"public_addr":"172.21.15.156:6825/737904755","cluster_addr":"172.21.15.156:6827/737904755","heartbeat_back_addr":"172.21.15.156:6831/737904755","heartbeat_front_addr":"172.21.15.156:6829/737904755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:12.023797+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:33.872883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:55.856970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:18.013196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:39.202872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:00.393920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:22.743083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:43.921728+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:05.859488+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:27.618714+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:48.880286+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:50:11.055141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/2202785670":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6800/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:6800/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/1447381524":"2023-08-11T11:44:48.401660+0000","172.21.15.73:0/2545059698":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/4193457623":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2561039569":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2927950081":"2023-08-11T11:44:48.401660+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T11:51:52.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.282+0000 7f50cd78d700 1 -- 172.21.15.73:0/1181536451 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f50b40a1220 msgr2=0x7f50b40a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:52.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.282+0000 7f50cd78d700 1 --2- 172.21.15.73:0/1181536451 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f50b40a1220 0x7f50b40a36e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f50b000ac50 tx=0x7f50b000a380 comp rx=0 tx=0).stop 2023-08-10T11:51:52.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.282+0000 7f50cd78d700 1 -- 172.21.15.73:0/1181536451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50c80ff660 msgr2=0x7f50c81035f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:52.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.282+0000 7f50cd78d700 1 --2- 172.21.15.73:0/1181536451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50c80ff660 0x7f50c81035f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f50b80036f0 tx=0x7f50b8009580 comp rx=0 tx=0).stop 2023-08-10T11:51:52.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.282+0000 7f50cd78d700 1 -- 172.21.15.73:0/1181536451 shutdown_connections 2023-08-10T11:51:52.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.282+0000 7f50cd78d700 1 --2- 172.21.15.73:0/1181536451 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f50b40a1220 0x7f50b40a36e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.282+0000 7f50cd78d700 1 --2- 172.21.15.73:0/1181536451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50c81011f0 0x7f50c8102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.282+0000 7f50cd78d700 1 --2- 172.21.15.73:0/1181536451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50c80ff660 0x7f50c81035f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.282+0000 7f50cd78d700 1 --2- 172.21.15.73:0/1181536451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50c8100850 0x7f50c8101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.282+0000 7f50cd78d700 1 -- 172.21.15.73:0/1181536451 >> 172.21.15.73:0/1181536451 conn(0x7f50c80fabd0 msgr2=0x7f50c8068bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:52.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.282+0000 7f50cd78d700 1 -- 172.21.15.73:0/1181536451 shutdown_connections 2023-08-10T11:51:52.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.282+0000 7f50cd78d700 1 -- 172.21.15.73:0/1181536451 wait complete. 2023-08-10T11:51:52.295 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T11:46:58.735153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T11:50:52.517974+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T11:50:53.465357+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T11:51:52.296 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T11:51:52.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.419+0000 7f1f28204700 1 -- 172.21.15.73:0/2310622940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f20101220 msgr2=0x7f1f20107ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:52.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.419+0000 7f1f28204700 1 --2- 172.21.15.73:0/2310622940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f20101220 0x7f1f20107ad0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800b0d0 tx=0x7f1f1800b3e0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.419+0000 7f1f28204700 1 -- 172.21.15.73:0/2310622940 shutdown_connections 2023-08-10T11:51:52.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.419+0000 7f1f28204700 1 --2- 172.21.15.73:0/2310622940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f200ff690 0x7f1f200ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.419+0000 7f1f28204700 1 --2- 172.21.15.73:0/2310622940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f20101220 0x7f1f20107ad0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.419+0000 7f1f28204700 1 --2- 172.21.15.73:0/2310622940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f20100880 0x7f1f20100ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.419+0000 7f1f28204700 1 -- 172.21.15.73:0/2310622940 >> 172.21.15.73:0/2310622940 conn(0x7f1f200fac00 msgr2=0x7f1f200fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:52.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.419+0000 7f1f28204700 1 -- 172.21.15.73:0/2310622940 shutdown_connections 2023-08-10T11:51:52.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.419+0000 7f1f28204700 1 -- 172.21.15.73:0/2310622940 wait complete. 2023-08-10T11:51:52.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.420+0000 7f1f28204700 1 Processor -- start 2023-08-10T11:51:52.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.420+0000 7f1f28204700 1 -- start start 2023-08-10T11:51:52.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.420+0000 7f1f28204700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f200ff690 0x7f1f20195440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:52.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.420+0000 7f1f28204700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f20100880 0x7f1f20195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:52.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.420+0000 7f1f28204700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f20101220 0x7f1f2019c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:52.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.420+0000 7f1f28204700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2019cfc0 con 0x7f1f200ff690 2023-08-10T11:51:52.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.420+0000 7f1f28204700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2019d100 con 0x7f1f20100880 2023-08-10T11:51:52.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.420+0000 7f1f28204700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2019d290 con 0x7f1f20101220 2023-08-10T11:51:52.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.420+0000 7f1f25fa0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f200ff690 0x7f1f20195440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:52.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.420+0000 7f1f25fa0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f200ff690 0x7f1f20195440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59666/0 (socket says 172.21.15.73:59666) 2023-08-10T11:51:52.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.420+0000 7f1f25fa0700 1 -- 172.21.15.73:0/3159937188 learned_addr learned my addr 172.21.15.73:0/3159937188 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:52.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.420+0000 7f1f2579f700 1 --2- 172.21.15.73:0/3159937188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f20100880 0x7f1f20195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:52.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.420+0000 7f1f267a1700 1 --2- 172.21.15.73:0/3159937188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f20101220 0x7f1f2019c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:52.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.420+0000 7f1f25fa0700 1 -- 172.21.15.73:0/3159937188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f20101220 msgr2=0x7f1f2019c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:52.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.420+0000 7f1f25fa0700 1 --2- 172.21.15.73:0/3159937188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f20101220 0x7f1f2019c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.420+0000 7f1f25fa0700 1 -- 172.21.15.73:0/3159937188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f20100880 msgr2=0x7f1f20195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:52.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.420+0000 7f1f25fa0700 1 --2- 172.21.15.73:0/3159937188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f20100880 0x7f1f20195980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.420+0000 7f1f25fa0700 1 -- 172.21.15.73:0/3159937188 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f18009d00 con 0x7f1f200ff690 2023-08-10T11:51:52.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.420+0000 7f1f25fa0700 1 --2- 172.21.15.73:0/3159937188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f200ff690 0x7f1f20195440 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1f1000d980 tx=0x7f1f1000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:52.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.420+0000 7f1f16ffd700 1 -- 172.21.15.73:0/3159937188 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f10004020 con 0x7f1f200ff690 2023-08-10T11:51:52.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.420+0000 7f1f16ffd700 1 -- 172.21.15.73:0/3159937188 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1f1000f690 con 0x7f1f200ff690 2023-08-10T11:51:52.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.421+0000 7f1f28204700 1 -- 172.21.15.73:0/3159937188 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f2019d570 con 0x7f1f200ff690 2023-08-10T11:51:52.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.421+0000 7f1f16ffd700 1 -- 172.21.15.73:0/3159937188 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f10003a60 con 0x7f1f200ff690 2023-08-10T11:51:52.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.421+0000 7f1f28204700 1 -- 172.21.15.73:0/3159937188 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f2019da80 con 0x7f1f200ff690 2023-08-10T11:51:52.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.421+0000 7f1f28204700 1 -- 172.21.15.73:0/3159937188 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f201065c0 con 0x7f1f200ff690 2023-08-10T11:51:52.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.422+0000 7f1f16ffd700 1 -- 172.21.15.73:0/3159937188 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f1f1000fb00 con 0x7f1f200ff690 2023-08-10T11:51:52.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.423+0000 7f1f16ffd700 1 --2- 172.21.15.73:0/3159937188 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f1f0c0a11e0 0x7f1f0c0a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:52.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.423+0000 7f1f16ffd700 1 -- 172.21.15.73:0/3159937188 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1f100cc9c0 con 0x7f1f200ff690 2023-08-10T11:51:52.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.423+0000 7f1f2579f700 1 --2- 172.21.15.73:0/3159937188 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f1f0c0a11e0 0x7f1f0c0a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:52.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.423+0000 7f1f2579f700 1 --2- 172.21.15.73:0/3159937188 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f1f0c0a11e0 0x7f1f0c0a36a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c005950 tx=0x7f1f1c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:52.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.426+0000 7f1f16ffd700 1 -- 172.21.15.73:0/3159937188 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f1f10095fc0 con 0x7f1f200ff690 2023-08-10T11:51:52.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.614+0000 7f1f28204700 1 -- 172.21.15.73:0/3159937188 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1f2002cc20 con 0x7f1f200ff690 2023-08-10T11:51:52.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.615+0000 7f1f16ffd700 1 -- 172.21.15.73:0/3159937188 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1f100995e0 con 0x7f1f200ff690 2023-08-10T11:51:52.616 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-08-10T11:51:52.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.617+0000 7f1f28204700 1 -- 172.21.15.73:0/3159937188 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f1f0c0a11e0 msgr2=0x7f1f0c0a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:52.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.617+0000 7f1f28204700 1 --2- 172.21.15.73:0/3159937188 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f1f0c0a11e0 0x7f1f0c0a36a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c005950 tx=0x7f1f1c00b410 comp rx=0 tx=0).stop 2023-08-10T11:51:52.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.617+0000 7f1f28204700 1 -- 172.21.15.73:0/3159937188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f200ff690 msgr2=0x7f1f20195440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:52.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.617+0000 7f1f28204700 1 --2- 172.21.15.73:0/3159937188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f200ff690 0x7f1f20195440 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1f1000d980 tx=0x7f1f1000dc90 comp rx=0 tx=0).stop 2023-08-10T11:51:52.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.617+0000 7f1f28204700 1 -- 172.21.15.73:0/3159937188 shutdown_connections 2023-08-10T11:51:52.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.617+0000 7f1f28204700 1 --2- 172.21.15.73:0/3159937188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f20101220 0x7f1f2019c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.617+0000 7f1f28204700 1 --2- 172.21.15.73:0/3159937188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f200ff690 0x7f1f20195440 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.617+0000 7f1f28204700 1 --2- 172.21.15.73:0/3159937188 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f1f0c0a11e0 0x7f1f0c0a36a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.617+0000 7f1f28204700 1 --2- 172.21.15.73:0/3159937188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f20100880 0x7f1f20195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.617+0000 7f1f28204700 1 -- 172.21.15.73:0/3159937188 >> 172.21.15.73:0/3159937188 conn(0x7f1f200fac00 msgr2=0x7f1f200fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:52.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.617+0000 7f1f28204700 1 -- 172.21.15.73:0/3159937188 shutdown_connections 2023-08-10T11:51:52.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.617+0000 7f1f28204700 1 -- 172.21.15.73:0/3159937188 wait complete. 2023-08-10T11:51:52.630 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T11:51:52.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.754+0000 7f89a4869700 1 -- 172.21.15.73:0/864368953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a00ff660 msgr2=0x7f89a00ffa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:52.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.754+0000 7f89a4869700 1 --2- 172.21.15.73:0/864368953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a00ff660 0x7f89a00ffa80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f89940099c0 tx=0x7f8994009cd0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.754+0000 7f89a4869700 1 -- 172.21.15.73:0/864368953 shutdown_connections 2023-08-10T11:51:52.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.754+0000 7f89a4869700 1 --2- 172.21.15.73:0/864368953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89a01011f0 0x7f89a0107aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.754+0000 7f89a4869700 1 --2- 172.21.15.73:0/864368953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a00ff660 0x7f89a00ffa80 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.754+0000 7f89a4869700 1 --2- 172.21.15.73:0/864368953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89a0100850 0x7f89a0100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.754+0000 7f89a4869700 1 -- 172.21.15.73:0/864368953 >> 172.21.15.73:0/864368953 conn(0x7f89a00fabd0 msgr2=0x7f89a00fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:52.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.754+0000 7f89a4869700 1 -- 172.21.15.73:0/864368953 shutdown_connections 2023-08-10T11:51:52.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.754+0000 7f89a4869700 1 -- 172.21.15.73:0/864368953 wait complete. 2023-08-10T11:51:52.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.755+0000 7f89a4869700 1 Processor -- start 2023-08-10T11:51:52.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.755+0000 7f89a4869700 1 -- start start 2023-08-10T11:51:52.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.755+0000 7f89a4869700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a00ff660 0x7f89a01963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:52.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.755+0000 7f89a4869700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89a0100850 0x7f89a0196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:52.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.755+0000 7f89a4869700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89a01011f0 0x7f89a019d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:52.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.755+0000 7f89a4869700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a019df60 con 0x7f89a00ff660 2023-08-10T11:51:52.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.755+0000 7f89a4869700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a019e0a0 con 0x7f89a01011f0 2023-08-10T11:51:52.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.755+0000 7f89a4869700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a019e230 con 0x7f89a0100850 2023-08-10T11:51:52.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.755+0000 7f899e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a00ff660 0x7f89a01963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:52.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.755+0000 7f899e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a00ff660 0x7f89a01963e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59680/0 (socket says 172.21.15.73:59680) 2023-08-10T11:51:52.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.755+0000 7f899e59c700 1 -- 172.21.15.73:0/1392587367 learned_addr learned my addr 172.21.15.73:0/1392587367 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:52.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.755+0000 7f899dd9b700 1 --2- 172.21.15.73:0/1392587367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89a0100850 0x7f89a0196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:52.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.755+0000 7f899ed9d700 1 --2- 172.21.15.73:0/1392587367 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89a01011f0 0x7f89a019d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:52.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.755+0000 7f899e59c700 1 -- 172.21.15.73:0/1392587367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89a0100850 msgr2=0x7f89a0196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:52.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.755+0000 7f899e59c700 1 --2- 172.21.15.73:0/1392587367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89a0100850 0x7f89a0196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.755+0000 7f899e59c700 1 -- 172.21.15.73:0/1392587367 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89a01011f0 msgr2=0x7f89a019d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:52.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.755+0000 7f899e59c700 1 --2- 172.21.15.73:0/1392587367 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89a01011f0 0x7f89a019d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.755+0000 7f899e59c700 1 -- 172.21.15.73:0/1392587367 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89940095f0 con 0x7f89a00ff660 2023-08-10T11:51:52.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.755+0000 7f899e59c700 1 --2- 172.21.15.73:0/1392587367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a00ff660 0x7f89a01963e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8994009fd0 tx=0x7f899400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:52.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.755+0000 7f898f7fe700 1 -- 172.21.15.73:0/1392587367 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899401d070 con 0x7f89a00ff660 2023-08-10T11:51:52.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.756+0000 7f89a4869700 1 -- 172.21.15.73:0/1392587367 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a019e4b0 con 0x7f89a00ff660 2023-08-10T11:51:52.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.756+0000 7f898f7fe700 1 -- 172.21.15.73:0/1392587367 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f89940054f0 con 0x7f89a00ff660 2023-08-10T11:51:52.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.756+0000 7f898f7fe700 1 -- 172.21.15.73:0/1392587367 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8994004bd0 con 0x7f89a00ff660 2023-08-10T11:51:52.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.756+0000 7f89a4869700 1 -- 172.21.15.73:0/1392587367 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a019e930 con 0x7f89a00ff660 2023-08-10T11:51:52.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.757+0000 7f89a4869700 1 -- 172.21.15.73:0/1392587367 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a0106590 con 0x7f89a00ff660 2023-08-10T11:51:52.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.757+0000 7f898f7fe700 1 -- 172.21.15.73:0/1392587367 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f899400fb80 con 0x7f89a00ff660 2023-08-10T11:51:52.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.758+0000 7f898f7fe700 1 --2- 172.21.15.73:0/1392587367 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f89880a1260 0x7f89880a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:52.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.758+0000 7f899dd9b700 1 --2- 172.21.15.73:0/1392587367 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f89880a1260 0x7f89880a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:52.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.758+0000 7f898f7fe700 1 -- 172.21.15.73:0/1392587367 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f89940cd950 con 0x7f89a00ff660 2023-08-10T11:51:52.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.758+0000 7f899dd9b700 1 --2- 172.21.15.73:0/1392587367 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f89880a1260 0x7f89880a3720 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f899000ac50 tx=0x7f899000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:52.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.762+0000 7f898f7fe700 1 -- 172.21.15.73:0/1392587367 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8994096f80 con 0x7f89a00ff660 2023-08-10T11:51:52.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.951+0000 7f89a4869700 1 -- 172.21.15.73:0/1392587367 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f89a002cb20 con 0x7f89a00ff660 2023-08-10T11:51:52.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.951+0000 7f898f7fe700 1 -- 172.21.15.73:0/1392587367 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7f899409a5a0 con 0x7f89a00ff660 2023-08-10T11:51:52.953 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-08-10T11:51:52.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.954+0000 7f89a4869700 1 -- 172.21.15.73:0/1392587367 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f89880a1260 msgr2=0x7f89880a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:52.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.954+0000 7f89a4869700 1 --2- 172.21.15.73:0/1392587367 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f89880a1260 0x7f89880a3720 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f899000ac50 tx=0x7f899000a380 comp rx=0 tx=0).stop 2023-08-10T11:51:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.954+0000 7f89a4869700 1 -- 172.21.15.73:0/1392587367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a00ff660 msgr2=0x7f89a01963e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.954+0000 7f89a4869700 1 --2- 172.21.15.73:0/1392587367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a00ff660 0x7f89a01963e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8994009fd0 tx=0x7f899400f690 comp rx=0 tx=0).stop 2023-08-10T11:51:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.954+0000 7f89a4869700 1 -- 172.21.15.73:0/1392587367 shutdown_connections 2023-08-10T11:51:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.954+0000 7f89a4869700 1 --2- 172.21.15.73:0/1392587367 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f89880a1260 0x7f89880a3720 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.954+0000 7f89a4869700 1 --2- 172.21.15.73:0/1392587367 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89a01011f0 0x7f89a019d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.954+0000 7f89a4869700 1 --2- 172.21.15.73:0/1392587367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a00ff660 0x7f89a01963e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.954+0000 7f89a4869700 1 --2- 172.21.15.73:0/1392587367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89a0100850 0x7f89a0196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.954+0000 7f89a4869700 1 -- 172.21.15.73:0/1392587367 >> 172.21.15.73:0/1392587367 conn(0x7f89a00fabd0 msgr2=0x7f89a00fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:52.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.954+0000 7f89a4869700 1 -- 172.21.15.73:0/1392587367 shutdown_connections 2023-08-10T11:51:52.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:52.954+0000 7f89a4869700 1 -- 172.21.15.73:0/1392587367 wait complete. 2023-08-10T11:51:52.965 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:52 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/370267241' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:51:52.965 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:52 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1181536451' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:51:52.966 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:52 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3159937188' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:51:52.966 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T11:51:52.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:52 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/370267241' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:51:52.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:52 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1181536451' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:51:52.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:52 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3159937188' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:51:53.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:52 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/370267241' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:51:53.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:52 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1181536451' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:51:53.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:52 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3159937188' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:51:53.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.089+0000 7ff7d7d61700 1 -- 172.21.15.73:0/4233025586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7d01019e0 msgr2=0x7ff7d0101e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:53.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.089+0000 7ff7d7d61700 1 --2- 172.21.15.73:0/4233025586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7d01019e0 0x7ff7d0101e40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0009990 tx=0x7ff7c0009ca0 comp rx=0 tx=0).stop 2023-08-10T11:51:53.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.090+0000 7ff7d7d61700 1 -- 172.21.15.73:0/4233025586 shutdown_connections 2023-08-10T11:51:53.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.090+0000 7ff7d7d61700 1 --2- 172.21.15.73:0/4233025586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7d0102380 0x7ff7d0108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:53.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.090+0000 7ff7d7d61700 1 --2- 172.21.15.73:0/4233025586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7d00fea10 0x7ff7d00fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:53.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.090+0000 7ff7d7d61700 1 --2- 172.21.15.73:0/4233025586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7d01019e0 0x7ff7d0101e40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:53.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.090+0000 7ff7d7d61700 1 -- 172.21.15.73:0/4233025586 >> 172.21.15.73:0/4233025586 conn(0x7ff7d00fa340 msgr2=0x7ff7d00fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:53.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.090+0000 7ff7d7d61700 1 -- 172.21.15.73:0/4233025586 shutdown_connections 2023-08-10T11:51:53.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.090+0000 7ff7d7d61700 1 -- 172.21.15.73:0/4233025586 wait complete. 2023-08-10T11:51:53.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.090+0000 7ff7d7d61700 1 Processor -- start 2023-08-10T11:51:53.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.090+0000 7ff7d7d61700 1 -- start start 2023-08-10T11:51:53.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.090+0000 7ff7d7d61700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7d00fea10 0x7ff7d0101350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:53.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.090+0000 7ff7d7d61700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7d01019e0 0x7ff7d00ff990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:53.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.090+0000 7ff7d7d61700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7d0102380 0x7ff7d00ffed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:53.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.090+0000 7ff7d7d61700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d0100670 con 0x7ff7d01019e0 2023-08-10T11:51:53.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.090+0000 7ff7d7d61700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d01007e0 con 0x7ff7d0102380 2023-08-10T11:51:53.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.090+0000 7ff7d7d61700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d01a0540 con 0x7ff7d00fea10 2023-08-10T11:51:53.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.090+0000 7ff7d52fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7d01019e0 0x7ff7d00ff990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:53.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.091+0000 7ff7d52fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7d01019e0 0x7ff7d00ff990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59696/0 (socket says 172.21.15.73:59696) 2023-08-10T11:51:53.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.091+0000 7ff7d52fc700 1 -- 172.21.15.73:0/3607051365 learned_addr learned my addr 172.21.15.73:0/3607051365 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:53.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.091+0000 7ff7d62fe700 1 --2- 172.21.15.73:0/3607051365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7d0102380 0x7ff7d00ffed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:53.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.091+0000 7ff7d5afd700 1 --2- 172.21.15.73:0/3607051365 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7d00fea10 0x7ff7d0101350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:53.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.091+0000 7ff7d52fc700 1 -- 172.21.15.73:0/3607051365 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7d00fea10 msgr2=0x7ff7d0101350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:53.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.091+0000 7ff7d52fc700 1 --2- 172.21.15.73:0/3607051365 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7d00fea10 0x7ff7d0101350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:53.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.091+0000 7ff7d52fc700 1 -- 172.21.15.73:0/3607051365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7d0102380 msgr2=0x7ff7d00ffed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:53.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.091+0000 7ff7d52fc700 1 --2- 172.21.15.73:0/3607051365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7d0102380 0x7ff7d00ffed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:53.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.091+0000 7ff7d52fc700 1 -- 172.21.15.73:0/3607051365 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c00095f0 con 0x7ff7d01019e0 2023-08-10T11:51:53.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.091+0000 7ff7d5afd700 1 --2- 172.21.15.73:0/3607051365 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7d00fea10 0x7ff7d0101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:53.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.091+0000 7ff7d62fe700 1 --2- 172.21.15.73:0/3607051365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7d0102380 0x7ff7d00ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:51:53.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.091+0000 7ff7d52fc700 1 --2- 172.21.15.73:0/3607051365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7d01019e0 0x7ff7d00ff990 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0005910 tx=0x7ff7c000f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:53.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.091+0000 7ff7c6ffd700 1 -- 172.21.15.73:0/3607051365 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c001d070 con 0x7ff7d01019e0 2023-08-10T11:51:53.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.091+0000 7ff7c6ffd700 1 -- 172.21.15.73:0/3607051365 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7c000fc30 con 0x7ff7d01019e0 2023-08-10T11:51:53.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.091+0000 7ff7d7d61700 1 -- 172.21.15.73:0/3607051365 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d01a07c0 con 0x7ff7d01019e0 2023-08-10T11:51:53.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.091+0000 7ff7c6ffd700 1 -- 172.21.15.73:0/3607051365 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0017650 con 0x7ff7d01019e0 2023-08-10T11:51:53.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.091+0000 7ff7d7d61700 1 -- 172.21.15.73:0/3607051365 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d01a0be0 con 0x7ff7d01019e0 2023-08-10T11:51:53.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.092+0000 7ff7d7d61700 1 -- 172.21.15.73:0/3607051365 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d01077d0 con 0x7ff7d01019e0 2023-08-10T11:51:53.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.093+0000 7ff7c6ffd700 1 -- 172.21.15.73:0/3607051365 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7ff7c0022470 con 0x7ff7d01019e0 2023-08-10T11:51:53.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.094+0000 7ff7c6ffd700 1 --2- 172.21.15.73:0/3607051365 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff7bc0a11e0 0x7ff7bc0a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:53.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.094+0000 7ff7d5afd700 1 --2- 172.21.15.73:0/3607051365 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff7bc0a11e0 0x7ff7bc0a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:53.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.094+0000 7ff7c6ffd700 1 -- 172.21.15.73:0/3607051365 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff7c00ce320 con 0x7ff7d01019e0 2023-08-10T11:51:53.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.094+0000 7ff7d5afd700 1 --2- 172.21.15.73:0/3607051365 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff7bc0a11e0 0x7ff7bc0a36a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc005fd0 tx=0x7ff7cc005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:53.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.097+0000 7ff7c6ffd700 1 -- 172.21.15.73:0/3607051365 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ff7c0097a40 con 0x7ff7d01019e0 2023-08-10T11:51:53.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.288+0000 7ff7d7d61700 1 -- 172.21.15.73:0/3607051365 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff7d002ce00 con 0x7ff7d01019e0 2023-08-10T11:51:53.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.288+0000 7ff7c6ffd700 1 -- 172.21.15.73:0/3607051365 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff7c009b060 con 0x7ff7d01019e0 2023-08-10T11:51:53.289 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-08-10T11:51:53.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.291+0000 7ff7d7d61700 1 -- 172.21.15.73:0/3607051365 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff7bc0a11e0 msgr2=0x7ff7bc0a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:53.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.291+0000 7ff7d7d61700 1 --2- 172.21.15.73:0/3607051365 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff7bc0a11e0 0x7ff7bc0a36a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc005fd0 tx=0x7ff7cc005f00 comp rx=0 tx=0).stop 2023-08-10T11:51:53.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.291+0000 7ff7d7d61700 1 -- 172.21.15.73:0/3607051365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7d01019e0 msgr2=0x7ff7d00ff990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:53.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.291+0000 7ff7d7d61700 1 --2- 172.21.15.73:0/3607051365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7d01019e0 0x7ff7d00ff990 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0005910 tx=0x7ff7c000f740 comp rx=0 tx=0).stop 2023-08-10T11:51:53.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.291+0000 7ff7d7d61700 1 -- 172.21.15.73:0/3607051365 shutdown_connections 2023-08-10T11:51:53.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.291+0000 7ff7d7d61700 1 --2- 172.21.15.73:0/3607051365 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ff7bc0a11e0 0x7ff7bc0a36a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:53.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.291+0000 7ff7d7d61700 1 --2- 172.21.15.73:0/3607051365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7d0102380 0x7ff7d00ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:53.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.291+0000 7ff7d7d61700 1 --2- 172.21.15.73:0/3607051365 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7d00fea10 0x7ff7d0101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:53.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.291+0000 7ff7d7d61700 1 --2- 172.21.15.73:0/3607051365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7d01019e0 0x7ff7d00ff990 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:53.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.291+0000 7ff7d7d61700 1 -- 172.21.15.73:0/3607051365 >> 172.21.15.73:0/3607051365 conn(0x7ff7d00fa340 msgr2=0x7ff7d00fc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:53.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.291+0000 7ff7d7d61700 1 -- 172.21.15.73:0/3607051365 shutdown_connections 2023-08-10T11:51:53.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.291+0000 7ff7d7d61700 1 -- 172.21.15.73:0/3607051365 wait complete. 2023-08-10T11:51:53.303 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T11:51:53.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.425+0000 7fe417f2d700 1 -- 172.21.15.73:0/2937228088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4100fea20 msgr2=0x7fe4100fee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:53.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.425+0000 7fe417f2d700 1 --2- 172.21.15.73:0/2937228088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4100fea20 0x7fe4100fee40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe40c009990 tx=0x7fe40c009ca0 comp rx=0 tx=0).stop 2023-08-10T11:51:53.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.425+0000 7fe417f2d700 1 -- 172.21.15.73:0/2937228088 shutdown_connections 2023-08-10T11:51:53.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.425+0000 7fe417f2d700 1 --2- 172.21.15.73:0/2937228088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe410100140 0x7fe4101009c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:53.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.425+0000 7fe417f2d700 1 --2- 172.21.15.73:0/2937228088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4100fea20 0x7fe4100fee40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:53.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.425+0000 7fe417f2d700 1 --2- 172.21.15.73:0/2937228088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4100ff780 0x7fe4100ffc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:53.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.425+0000 7fe417f2d700 1 -- 172.21.15.73:0/2937228088 >> 172.21.15.73:0/2937228088 conn(0x7fe4100fa330 msgr2=0x7fe4100fc790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:53.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.425+0000 7fe417f2d700 1 -- 172.21.15.73:0/2937228088 shutdown_connections 2023-08-10T11:51:53.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.425+0000 7fe417f2d700 1 -- 172.21.15.73:0/2937228088 wait complete. 2023-08-10T11:51:53.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.425+0000 7fe417f2d700 1 Processor -- start 2023-08-10T11:51:53.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.425+0000 7fe417f2d700 1 -- start start 2023-08-10T11:51:53.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.425+0000 7fe417f2d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4100fea20 0x7fe4101985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:53.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.425+0000 7fe417f2d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4100ff780 0x7fe410198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:53.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.425+0000 7fe417f2d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe410100140 0x7fe41019fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:53.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.425+0000 7fe417f2d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4101a0120 con 0x7fe410100140 2023-08-10T11:51:53.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.425+0000 7fe417f2d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4101a0260 con 0x7fe4100ff780 2023-08-10T11:51:53.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.425+0000 7fe417f2d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4101a03f0 con 0x7fe4100fea20 2023-08-10T11:51:53.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.426+0000 7fe4164ca700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe410100140 0x7fe41019fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:53.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.426+0000 7fe4164ca700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe410100140 0x7fe41019fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59712/0 (socket says 172.21.15.73:59712) 2023-08-10T11:51:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.426+0000 7fe4164ca700 1 -- 172.21.15.73:0/2657485659 learned_addr learned my addr 172.21.15.73:0/2657485659 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.426+0000 7fe415cc9700 1 --2- 172.21.15.73:0/2657485659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4100fea20 0x7fe4101985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.426+0000 7fe4164ca700 1 -- 172.21.15.73:0/2657485659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4100fea20 msgr2=0x7fe4101985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.426+0000 7fe4164ca700 1 --2- 172.21.15.73:0/2657485659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4100fea20 0x7fe4101985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.426+0000 7fe4164ca700 1 -- 172.21.15.73:0/2657485659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4100ff780 msgr2=0x7fe410198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:53.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.426+0000 7fe4164ca700 1 --2- 172.21.15.73:0/2657485659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4100ff780 0x7fe410198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:53.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.426+0000 7fe4164ca700 1 -- 172.21.15.73:0/2657485659 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40c0095f0 con 0x7fe410100140 2023-08-10T11:51:53.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.426+0000 7fe4164ca700 1 --2- 172.21.15.73:0/2657485659 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe410100140 0x7fe41019fb50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe40800ada0 tx=0x7fe40800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.426+0000 7fe406ffd700 1 -- 172.21.15.73:0/2657485659 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40800f070 con 0x7fe410100140 2023-08-10T11:51:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.426+0000 7fe417f2d700 1 -- 172.21.15.73:0/2657485659 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4101a06d0 con 0x7fe410100140 2023-08-10T11:51:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.426+0000 7fe406ffd700 1 -- 172.21.15.73:0/2657485659 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe408007b30 con 0x7fe410100140 2023-08-10T11:51:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.426+0000 7fe406ffd700 1 -- 172.21.15.73:0/2657485659 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4080053e0 con 0x7fe410100140 2023-08-10T11:51:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.426+0000 7fe417f2d700 1 -- 172.21.15.73:0/2657485659 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4101a0c30 con 0x7fe410100140 2023-08-10T11:51:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.427+0000 7fe417f2d700 1 -- 172.21.15.73:0/2657485659 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41010a5c0 con 0x7fe410100140 2023-08-10T11:51:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.428+0000 7fe406ffd700 1 -- 172.21.15.73:0/2657485659 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fe40800c980 con 0x7fe410100140 2023-08-10T11:51:53.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.429+0000 7fe406ffd700 1 --2- 172.21.15.73:0/2657485659 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fe3fc0a1220 0x7fe3fc0a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:53.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.429+0000 7fe406ffd700 1 -- 172.21.15.73:0/2657485659 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe4080cbf90 con 0x7fe410100140 2023-08-10T11:51:53.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.429+0000 7fe415cc9700 1 --2- 172.21.15.73:0/2657485659 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fe3fc0a1220 0x7fe3fc0a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:53.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.429+0000 7fe415cc9700 1 --2- 172.21.15.73:0/2657485659 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fe3fc0a1220 0x7fe3fc0a36e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe40c00b5c0 tx=0x7fe40c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:53.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.433+0000 7fe406ffd700 1 -- 172.21.15.73:0/2657485659 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fe4080956c0 con 0x7fe410100140 2023-08-10T11:51:53.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.668+0000 7fe417f2d700 1 -- 172.21.15.73:0/2657485659 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe41002cb70 con 0x7fe410100140 2023-08-10T11:51:53.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.669+0000 7fe406ffd700 1 -- 172.21.15.73:0/2657485659 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10891 (secure 0 0 0) 0x7fe408098ce0 con 0x7fe410100140 2023-08-10T11:51:53.670 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:51:53.670 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1319360725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1319360725},{"type":"v1","addr":"172.21.15.73:6835","nonce":1319360725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/431221951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":431221951},{"type":"v1","addr":"172.21.15.73:6837","nonce":431221951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-10T11:50:54.304447+0000","modified":"2023-08-10T11:51:01.523452+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24503,"mds_1":24479,"mds_2":24451,"mds_3":24443,"mds_4":24419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6839/1099539481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1099539481},{"type":"v1","addr":"172.21.15.73:6839","nonce":1099539481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6841/3067925859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":3067925859},{"type":"v1","addr":"172.21.15.73:6841","nonce":3067925859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24397":{"gid":24397,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6833/3028461815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3028461815},{"type":"v1","addr":"172.21.15.156:6833","nonce":3028461815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24419":{"gid":24419,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6833/4148407154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4148407154},{"type":"v1","addr":"172.21.15.152:6833","nonce":4148407154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24443":{"gid":24443,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.152:6835/1791572604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1791572604},{"type":"v1","addr":"172.21.15.152:6835","nonce":1791572604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.156:6835/904126790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":904126790},{"type":"v1","addr":"172.21.15.156:6835","nonce":904126790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24457":{"gid":24457,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/4284306352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":4284306352},{"type":"v1","addr":"172.21.15.156:6837","nonce":4284306352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6839/3361058731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":3361058731},{"type":"v1","addr":"172.21.15.156:6839","nonce":3361058731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6837/74214089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":74214089},{"type":"v1","addr":"172.21.15.152:6837","nonce":74214089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6839/3870202690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3870202690},{"type":"v1","addr":"172.21.15.152:6839","nonce":3870202690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T11:51:53.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.671+0000 7fe417f2d700 1 -- 172.21.15.73:0/2657485659 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fe3fc0a1220 msgr2=0x7fe3fc0a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:53.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.671+0000 7fe417f2d700 1 --2- 172.21.15.73:0/2657485659 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fe3fc0a1220 0x7fe3fc0a36e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe40c00b5c0 tx=0x7fe40c005fd0 comp rx=0 tx=0).stop 2023-08-10T11:51:53.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.671+0000 7fe417f2d700 1 -- 172.21.15.73:0/2657485659 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe410100140 msgr2=0x7fe41019fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:53.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.671+0000 7fe417f2d700 1 --2- 172.21.15.73:0/2657485659 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe410100140 0x7fe41019fb50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe40800ada0 tx=0x7fe40800c330 comp rx=0 tx=0).stop 2023-08-10T11:51:53.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.671+0000 7fe417f2d700 1 -- 172.21.15.73:0/2657485659 shutdown_connections 2023-08-10T11:51:53.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.671+0000 7fe417f2d700 1 --2- 172.21.15.73:0/2657485659 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe410100140 0x7fe41019fb50 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:53.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.671+0000 7fe417f2d700 1 --2- 172.21.15.73:0/2657485659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4100fea20 0x7fe4101985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:53.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.671+0000 7fe417f2d700 1 --2- 172.21.15.73:0/2657485659 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fe3fc0a1220 0x7fe3fc0a36e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:53.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.671+0000 7fe417f2d700 1 --2- 172.21.15.73:0/2657485659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4100ff780 0x7fe410198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:53.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.671+0000 7fe417f2d700 1 -- 172.21.15.73:0/2657485659 >> 172.21.15.73:0/2657485659 conn(0x7fe4100fa330 msgr2=0x7fe4100fbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:53.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.671+0000 7fe417f2d700 1 -- 172.21.15.73:0/2657485659 shutdown_connections 2023-08-10T11:51:53.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.671+0000 7fe417f2d700 1 -- 172.21.15.73:0/2657485659 wait complete. 2023-08-10T11:51:53.674 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 27 2023-08-10T11:51:53.684 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T11:51:53.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.805+0000 7f0f1f36b700 1 -- 172.21.15.73:0/2678691036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f181011e0 msgr2=0x7f0f18107a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:53.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.805+0000 7f0f1f36b700 1 --2- 172.21.15.73:0/2678691036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f181011e0 0x7f0f18107a90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000b0d0 tx=0x7f0f1000b3e0 comp rx=0 tx=0).stop 2023-08-10T11:51:53.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.805+0000 7f0f1f36b700 1 -- 172.21.15.73:0/2678691036 shutdown_connections 2023-08-10T11:51:53.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.805+0000 7f0f1f36b700 1 --2- 172.21.15.73:0/2678691036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f180ff650 0x7f0f180ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:53.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.805+0000 7f0f1f36b700 1 --2- 172.21.15.73:0/2678691036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f181011e0 0x7f0f18107a90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:53.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.805+0000 7f0f1f36b700 1 --2- 172.21.15.73:0/2678691036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f18100840 0x7f0f18100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:53.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.805+0000 7f0f1f36b700 1 -- 172.21.15.73:0/2678691036 >> 172.21.15.73:0/2678691036 conn(0x7f0f180faba0 msgr2=0x7f0f180fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:53.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.805+0000 7f0f1f36b700 1 -- 172.21.15.73:0/2678691036 shutdown_connections 2023-08-10T11:51:53.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.805+0000 7f0f1f36b700 1 -- 172.21.15.73:0/2678691036 wait complete. 2023-08-10T11:51:53.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.805+0000 7f0f1f36b700 1 Processor -- start 2023-08-10T11:51:53.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.805+0000 7f0f1f36b700 1 -- start start 2023-08-10T11:51:53.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.805+0000 7f0f1f36b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f180ff650 0x7f0f181953e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:53.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.805+0000 7f0f1f36b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f18100840 0x7f0f18195920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:53.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.805+0000 7f0f1f36b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f181011e0 0x7f0f1819c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:53.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.805+0000 7f0f1f36b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1819cf60 con 0x7f0f181011e0 2023-08-10T11:51:53.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.805+0000 7f0f1f36b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1819d0a0 con 0x7f0f180ff650 2023-08-10T11:51:53.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.805+0000 7f0f1f36b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1819d230 con 0x7f0f18100840 2023-08-10T11:51:53.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.806+0000 7f0f1d908700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f181011e0 0x7f0f1819c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:53.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.806+0000 7f0f1d908700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f181011e0 0x7f0f1819c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59726/0 (socket says 172.21.15.73:59726) 2023-08-10T11:51:53.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.806+0000 7f0f1d908700 1 -- 172.21.15.73:0/2286913435 learned_addr learned my addr 172.21.15.73:0/2286913435 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:53.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.806+0000 7f0f1c906700 1 --2- 172.21.15.73:0/2286913435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f18100840 0x7f0f18195920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:53.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.806+0000 7f0f1d908700 1 -- 172.21.15.73:0/2286913435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f18100840 msgr2=0x7f0f18195920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:53.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.806+0000 7f0f1d107700 1 --2- 172.21.15.73:0/2286913435 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f180ff650 0x7f0f181953e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:53.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.806+0000 7f0f1d908700 1 --2- 172.21.15.73:0/2286913435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f18100840 0x7f0f18195920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:53.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.806+0000 7f0f1d908700 1 -- 172.21.15.73:0/2286913435 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f180ff650 msgr2=0x7f0f181953e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:53.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.806+0000 7f0f1d908700 1 --2- 172.21.15.73:0/2286913435 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f180ff650 0x7f0f181953e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:53.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.806+0000 7f0f1d908700 1 -- 172.21.15.73:0/2286913435 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f10009d00 con 0x7f0f181011e0 2023-08-10T11:51:53.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.806+0000 7f0f1d908700 1 --2- 172.21.15.73:0/2286913435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f181011e0 0x7f0f1819c990 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0f10007a00 tx=0x7f0f10009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:53.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.806+0000 7f0f0e7fc700 1 -- 172.21.15.73:0/2286913435 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1000e040 con 0x7f0f181011e0 2023-08-10T11:51:53.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.806+0000 7f0f0e7fc700 1 -- 172.21.15.73:0/2286913435 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f10003e10 con 0x7f0f181011e0 2023-08-10T11:51:53.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.806+0000 7f0f1f36b700 1 -- 172.21.15.73:0/2286913435 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f1819d4b0 con 0x7f0f181011e0 2023-08-10T11:51:53.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.806+0000 7f0f0e7fc700 1 -- 172.21.15.73:0/2286913435 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f10005750 con 0x7f0f181011e0 2023-08-10T11:51:53.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.806+0000 7f0f1f36b700 1 -- 172.21.15.73:0/2286913435 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f1819d8d0 con 0x7f0f181011e0 2023-08-10T11:51:53.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.807+0000 7f0f1f36b700 1 -- 172.21.15.73:0/2286913435 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f18106b70 con 0x7f0f181011e0 2023-08-10T11:51:53.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.808+0000 7f0f0e7fc700 1 -- 172.21.15.73:0/2286913435 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f0f10012cb0 con 0x7f0f181011e0 2023-08-10T11:51:53.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.808+0000 7f0f0e7fc700 1 --2- 172.21.15.73:0/2286913435 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0f040a1220 0x7f0f040a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:53.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.809+0000 7f0f1d107700 1 --2- 172.21.15.73:0/2286913435 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0f040a1220 0x7f0f040a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:53.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.809+0000 7f0f0e7fc700 1 -- 172.21.15.73:0/2286913435 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0f100ceb50 con 0x7f0f181011e0 2023-08-10T11:51:53.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.809+0000 7f0f1d107700 1 --2- 172.21.15.73:0/2286913435 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0f040a1220 0x7f0f040a36e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0f181006a0 tx=0x7f0f14005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:53.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:53.812+0000 7f0f0e7fc700 1 -- 172.21.15.73:0/2286913435 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0f100981e0 con 0x7f0f181011e0 2023-08-10T11:51:53.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:53 smithi152 ceph-mon[130220]: pgmap v287: 97 pgs: 1 activating+degraded, 2 activating, 94 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s; 6/306 objects degraded (1.961%); 0 B/s, 0 objects/s recovering 2023-08-10T11:51:53.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:53 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1392587367' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:51:53.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:53 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3607051365' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:51:54.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.003+0000 7f0f1f36b700 1 -- 172.21.15.73:0/2286913435 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f1802cb40 con 0x7f0f181011e0 2023-08-10T11:51:54.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.004+0000 7f0f0e7fc700 1 -- 172.21.15.73:0/2286913435 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22482 (secure 0 0 0) 0x7f0f1009b800 con 0x7f0f181011e0 2023-08-10T11:51:54.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:53 smithi156 ceph-mon[130574]: pgmap v287: 97 pgs: 1 activating+degraded, 2 activating, 94 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s; 6/306 objects degraded (1.961%); 0 B/s, 0 objects/s recovering 2023-08-10T11:51:54.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:53 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1392587367' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:51:54.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:53 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3607051365' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:51:54.006 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:51:54.006 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":85,"fsid":"0e619a74-3773-11ee-9b37-001a4aab830c","created":"2023-08-10T11:43:53.974768+0000","modified":"2023-08-10T11:51:49.637159+0000","last_up_change":"2023-08-10T11:50:12.914422+0000","last_in_change":"2023-08-10T11:49:54.624543+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T11:46:58.735153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T11:50:52.517974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T11:50:53.465357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3219ae18-cc4c-4712-b616-79f6949066e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6803","nonce":2725694252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6805","nonce":2725694252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6809","nonce":2725694252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6807","nonce":2725694252}]},"public_addr":"172.21.15.73:6803/2725694252","cluster_addr":"172.21.15.73:6805/2725694252","heartbeat_back_addr":"172.21.15.73:6809/2725694252","heartbeat_front_addr":"172.21.15.73:6807/2725694252","state":["exists","up"]},{"osd":1,"uuid":"bbfe6cd9-b3d3-4b8d-8814-507a867f8c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6801","nonce":836829168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6803","nonce":836829168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6807","nonce":836829168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6805","nonce":836829168}]},"public_addr":"172.21.15.152:6801/836829168","cluster_addr":"172.21.15.152:6803/836829168","heartbeat_back_addr":"172.21.15.152:6807/836829168","heartbeat_front_addr":"172.21.15.152:6805/836829168","state":["exists","up"]},{"osd":2,"uuid":"f57f5b2c-3208-45c0-beba-8501694b99c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6801","nonce":1789212298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6803","nonce":1789212298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6807","nonce":1789212298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6805","nonce":1789212298}]},"public_addr":"172.21.15.156:6801/1789212298","cluster_addr":"172.21.15.156:6803/1789212298","heartbeat_back_addr":"172.21.15.156:6807/1789212298","heartbeat_front_addr":"172.21.15.156:6805/1789212298","state":["exists","up"]},{"osd":3,"uuid":"18592408-3696-4ab8-ad41-c172b8409829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6811","nonce":3101572649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6813","nonce":3101572649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6817","nonce":3101572649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6815","nonce":3101572649}]},"public_addr":"172.21.15.73:6811/3101572649","cluster_addr":"172.21.15.73:6813/3101572649","heartbeat_back_addr":"172.21.15.73:6817/3101572649","heartbeat_front_addr":"172.21.15.73:6815/3101572649","state":["exists","up"]},{"osd":4,"uuid":"fb3adb09-8807-42d9-8db9-1867c5fe02da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6809","nonce":1451517889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6811","nonce":1451517889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6815","nonce":1451517889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6813","nonce":1451517889}]},"public_addr":"172.21.15.152:6809/1451517889","cluster_addr":"172.21.15.152:6811/1451517889","heartbeat_back_addr":"172.21.15.152:6815/1451517889","heartbeat_front_addr":"172.21.15.152:6813/1451517889","state":["exists","up"]},{"osd":5,"uuid":"af58a7bd-4e58-4639-95b2-4a76011b61dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6809","nonce":3823368741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6811","nonce":3823368741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6815","nonce":3823368741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6813","nonce":3823368741}]},"public_addr":"172.21.15.156:6809/3823368741","cluster_addr":"172.21.15.156:6811/3823368741","heartbeat_back_addr":"172.21.15.156:6815/3823368741","heartbeat_front_addr":"172.21.15.156:6813/3823368741","state":["exists","up"]},{"osd":6,"uuid":"f6ae502d-4af9-4f6a-8636-b5b683dfdfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6819","nonce":2533620458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6821","nonce":2533620458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6825","nonce":2533620458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6823","nonce":2533620458}]},"public_addr":"172.21.15.73:6819/2533620458","cluster_addr":"172.21.15.73:6821/2533620458","heartbeat_back_addr":"172.21.15.73:6825/2533620458","heartbeat_front_addr":"172.21.15.73:6823/2533620458","state":["exists","up"]},{"osd":7,"uuid":"398fd334-5f6f-427c-95ae-3244fb466f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6817","nonce":4059538477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6819","nonce":4059538477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6823","nonce":4059538477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6821","nonce":4059538477}]},"public_addr":"172.21.15.152:6817/4059538477","cluster_addr":"172.21.15.152:6819/4059538477","heartbeat_back_addr":"172.21.15.152:6823/4059538477","heartbeat_front_addr":"172.21.15.152:6821/4059538477","state":["exists","up"]},{"osd":8,"uuid":"58f46e64-2624-4ad4-bb6a-225624153837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6817","nonce":96487555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6819","nonce":96487555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6823","nonce":96487555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6821","nonce":96487555}]},"public_addr":"172.21.15.156:6817/96487555","cluster_addr":"172.21.15.156:6819/96487555","heartbeat_back_addr":"172.21.15.156:6823/96487555","heartbeat_front_addr":"172.21.15.156:6821/96487555","state":["exists","up"]},{"osd":9,"uuid":"9389dd5b-da2d-43b6-8bc0-bb1af13f72c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6827","nonce":2050124321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6829","nonce":2050124321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6833","nonce":2050124321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6831","nonce":2050124321}]},"public_addr":"172.21.15.73:6827/2050124321","cluster_addr":"172.21.15.73:6829/2050124321","heartbeat_back_addr":"172.21.15.73:6833/2050124321","heartbeat_front_addr":"172.21.15.73:6831/2050124321","state":["exists","up"]},{"osd":10,"uuid":"563c1e34-3acd-46ab-ba36-e9d87f635e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6825","nonce":1513186350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6827","nonce":1513186350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6831","nonce":1513186350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6829","nonce":1513186350}]},"public_addr":"172.21.15.152:6825/1513186350","cluster_addr":"172.21.15.152:6827/1513186350","heartbeat_back_addr":"172.21.15.152:6831/1513186350","heartbeat_front_addr":"172.21.15.152:6829/1513186350","state":["exists","up"]},{"osd":11,"uuid":"f1b55889-14fd-4cc9-bed7-43748086fb77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6825","nonce":737904755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6827","nonce":737904755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6831","nonce":737904755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6829","nonce":737904755}]},"public_addr":"172.21.15.156:6825/737904755","cluster_addr":"172.21.15.156:6827/737904755","heartbeat_back_addr":"172.21.15.156:6831/737904755","heartbeat_front_addr":"172.21.15.156:6829/737904755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:12.023797+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:33.872883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:55.856970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:18.013196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:39.202872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:00.393920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:22.743083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:43.921728+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:05.859488+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:27.618714+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:48.880286+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:50:11.055141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/2202785670":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6800/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:6800/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/1447381524":"2023-08-11T11:44:48.401660+0000","172.21.15.73:0/2545059698":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/4193457623":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2561039569":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2927950081":"2023-08-11T11:44:48.401660+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T11:51:54.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.006+0000 7f0f1f36b700 1 -- 172.21.15.73:0/2286913435 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0f040a1220 msgr2=0x7f0f040a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.006+0000 7f0f1f36b700 1 --2- 172.21.15.73:0/2286913435 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0f040a1220 0x7f0f040a36e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0f181006a0 tx=0x7f0f14005cf0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.006+0000 7f0f1f36b700 1 -- 172.21.15.73:0/2286913435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f181011e0 msgr2=0x7f0f1819c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.006+0000 7f0f1f36b700 1 --2- 172.21.15.73:0/2286913435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f181011e0 0x7f0f1819c990 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0f10007a00 tx=0x7f0f10009570 comp rx=0 tx=0).stop 2023-08-10T11:51:54.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.006+0000 7f0f1f36b700 1 -- 172.21.15.73:0/2286913435 shutdown_connections 2023-08-10T11:51:54.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.006+0000 7f0f1f36b700 1 --2- 172.21.15.73:0/2286913435 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0f040a1220 0x7f0f040a36e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.006+0000 7f0f1f36b700 1 --2- 172.21.15.73:0/2286913435 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f180ff650 0x7f0f181953e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.006+0000 7f0f1f36b700 1 --2- 172.21.15.73:0/2286913435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f181011e0 0x7f0f1819c990 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.006+0000 7f0f1f36b700 1 --2- 172.21.15.73:0/2286913435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f18100840 0x7f0f18195920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.006+0000 7f0f1f36b700 1 -- 172.21.15.73:0/2286913435 >> 172.21.15.73:0/2286913435 conn(0x7f0f180faba0 msgr2=0x7f0f18103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:54.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.007+0000 7f0f1f36b700 1 -- 172.21.15.73:0/2286913435 shutdown_connections 2023-08-10T11:51:54.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.007+0000 7f0f1f36b700 1 -- 172.21.15.73:0/2286913435 wait complete. 2023-08-10T11:51:54.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:53 smithi073 ceph-mon[128869]: pgmap v287: 97 pgs: 1 activating+degraded, 2 activating, 94 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s; 6/306 objects degraded (1.961%); 0 B/s, 0 objects/s recovering 2023-08-10T11:51:54.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:53 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1392587367' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:51:54.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:53 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3607051365' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:51:54.020 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T11:51:54.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.140+0000 7f5c3f888700 1 -- 172.21.15.73:0/3601821075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c38100840 msgr2=0x7f5c38100ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.140+0000 7f5c3f888700 1 --2- 172.21.15.73:0/3601821075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c38100840 0x7f5c38100ca0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5c340099c0 tx=0x7f5c34009cd0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.140+0000 7f5c3f888700 1 -- 172.21.15.73:0/3601821075 shutdown_connections 2023-08-10T11:51:54.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.140+0000 7f5c3f888700 1 --2- 172.21.15.73:0/3601821075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c381011e0 0x7f5c38107a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.140+0000 7f5c3f888700 1 --2- 172.21.15.73:0/3601821075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c380ff650 0x7f5c380ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.140+0000 7f5c3f888700 1 --2- 172.21.15.73:0/3601821075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c38100840 0x7f5c38100ca0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.140+0000 7f5c3f888700 1 -- 172.21.15.73:0/3601821075 >> 172.21.15.73:0/3601821075 conn(0x7f5c380faba0 msgr2=0x7f5c380fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:54.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.140+0000 7f5c3f888700 1 -- 172.21.15.73:0/3601821075 shutdown_connections 2023-08-10T11:51:54.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.140+0000 7f5c3f888700 1 -- 172.21.15.73:0/3601821075 wait complete. 2023-08-10T11:51:54.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.140+0000 7f5c3f888700 1 Processor -- start 2023-08-10T11:51:54.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.140+0000 7f5c3f888700 1 -- start start 2023-08-10T11:51:54.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.140+0000 7f5c3f888700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c380ff650 0x7f5c38068460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.140+0000 7f5c3f888700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c38100840 0x7f5c3819b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.140+0000 7f5c3f888700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c381011e0 0x7f5c3819d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.140+0000 7f5c3f888700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3819df40 con 0x7f5c38100840 2023-08-10T11:51:54.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.141+0000 7f5c3f888700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3819e0b0 con 0x7f5c381011e0 2023-08-10T11:51:54.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.141+0000 7f5c3f888700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3819e270 con 0x7f5c380ff650 2023-08-10T11:51:54.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.141+0000 7f5c3ce23700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c38100840 0x7f5c3819b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.141+0000 7f5c3ce23700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c38100840 0x7f5c3819b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59738/0 (socket says 172.21.15.73:59738) 2023-08-10T11:51:54.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.141+0000 7f5c3ce23700 1 -- 172.21.15.73:0/1282949633 learned_addr learned my addr 172.21.15.73:0/1282949633 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:54.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.141+0000 7f5c3d624700 1 --2- 172.21.15.73:0/1282949633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c380ff650 0x7f5c38068460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.141+0000 7f5c3ce23700 1 -- 172.21.15.73:0/1282949633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c380ff650 msgr2=0x7f5c38068460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.141+0000 7f5c3ce23700 1 --2- 172.21.15.73:0/1282949633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c380ff650 0x7f5c38068460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.141+0000 7f5c3de25700 1 --2- 172.21.15.73:0/1282949633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c381011e0 0x7f5c3819d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.141+0000 7f5c3ce23700 1 -- 172.21.15.73:0/1282949633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c381011e0 msgr2=0x7f5c3819d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.141+0000 7f5c3ce23700 1 --2- 172.21.15.73:0/1282949633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c381011e0 0x7f5c3819d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.141+0000 7f5c3ce23700 1 -- 172.21.15.73:0/1282949633 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c340095f0 con 0x7f5c38100840 2023-08-10T11:51:54.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.141+0000 7f5c3d624700 1 --2- 172.21.15.73:0/1282949633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c380ff650 0x7f5c38068460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:54.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.141+0000 7f5c3de25700 1 --2- 172.21.15.73:0/1282949633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c381011e0 0x7f5c3819d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:54.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.141+0000 7f5c3ce23700 1 --2- 172.21.15.73:0/1282949633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c38100840 0x7f5c3819b120 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5c34009990 tx=0x7f5c34003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:54.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.141+0000 7f5c2e7fc700 1 -- 172.21.15.73:0/1282949633 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3401d070 con 0x7f5c38100840 2023-08-10T11:51:54.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.141+0000 7f5c2e7fc700 1 -- 172.21.15.73:0/1282949633 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5c34004640 con 0x7f5c38100840 2023-08-10T11:51:54.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.141+0000 7f5c3f888700 1 -- 172.21.15.73:0/1282949633 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c3819e4f0 con 0x7f5c38100840 2023-08-10T11:51:54.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.141+0000 7f5c2e7fc700 1 -- 172.21.15.73:0/1282949633 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3400f460 con 0x7f5c38100840 2023-08-10T11:51:54.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.141+0000 7f5c3f888700 1 -- 172.21.15.73:0/1282949633 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c3819e9f0 con 0x7f5c38100840 2023-08-10T11:51:54.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.142+0000 7f5c3f888700 1 -- 172.21.15.73:0/1282949633 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c3810ae60 con 0x7f5c38100840 2023-08-10T11:51:54.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.144+0000 7f5c2e7fc700 1 -- 172.21.15.73:0/1282949633 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f5c34022470 con 0x7f5c38100840 2023-08-10T11:51:54.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.144+0000 7f5c2e7fc700 1 --2- 172.21.15.73:0/1282949633 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5c240a12a0 0x7f5c240a3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.145+0000 7f5c3d624700 1 --2- 172.21.15.73:0/1282949633 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5c240a12a0 0x7f5c240a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.145+0000 7f5c2e7fc700 1 -- 172.21.15.73:0/1282949633 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5c340ce420 con 0x7f5c38100840 2023-08-10T11:51:54.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.145+0000 7f5c3d624700 1 --2- 172.21.15.73:0/1282949633 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5c240a12a0 0x7f5c240a3760 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5c28005fd0 tx=0x7f5c28005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:54.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.148+0000 7f5c2e7fc700 1 -- 172.21.15.73:0/1282949633 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f5c34097a50 con 0x7f5c38100840 2023-08-10T11:51:54.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.377+0000 7f5c3f888700 1 -- 172.21.15.73:0/1282949633 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c38106580 con 0x7f5c38100840 2023-08-10T11:51:54.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.378+0000 7f5c2e7fc700 1 -- 172.21.15.73:0/1282949633 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10891 (secure 0 0 0) 0x7f5c3409b070 con 0x7f5c38100840 2023-08-10T11:51:54.378 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:51:54.379 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1319360725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1319360725},{"type":"v1","addr":"172.21.15.73:6835","nonce":1319360725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/431221951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":431221951},{"type":"v1","addr":"172.21.15.73:6837","nonce":431221951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-10T11:50:54.304447+0000","modified":"2023-08-10T11:51:01.523452+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24503,"mds_1":24479,"mds_2":24451,"mds_3":24443,"mds_4":24419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6839/1099539481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1099539481},{"type":"v1","addr":"172.21.15.73:6839","nonce":1099539481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6841/3067925859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":3067925859},{"type":"v1","addr":"172.21.15.73:6841","nonce":3067925859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24397":{"gid":24397,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6833/3028461815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3028461815},{"type":"v1","addr":"172.21.15.156:6833","nonce":3028461815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24419":{"gid":24419,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6833/4148407154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4148407154},{"type":"v1","addr":"172.21.15.152:6833","nonce":4148407154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24443":{"gid":24443,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.152:6835/1791572604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1791572604},{"type":"v1","addr":"172.21.15.152:6835","nonce":1791572604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.156:6835/904126790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":904126790},{"type":"v1","addr":"172.21.15.156:6835","nonce":904126790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24457":{"gid":24457,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/4284306352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":4284306352},{"type":"v1","addr":"172.21.15.156:6837","nonce":4284306352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6839/3361058731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":3361058731},{"type":"v1","addr":"172.21.15.156:6839","nonce":3361058731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6837/74214089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":74214089},{"type":"v1","addr":"172.21.15.152:6837","nonce":74214089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6839/3870202690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3870202690},{"type":"v1","addr":"172.21.15.152:6839","nonce":3870202690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T11:51:54.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.380+0000 7f5c3f888700 1 -- 172.21.15.73:0/1282949633 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5c240a12a0 msgr2=0x7f5c240a3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.380+0000 7f5c3f888700 1 --2- 172.21.15.73:0/1282949633 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5c240a12a0 0x7f5c240a3760 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5c28005fd0 tx=0x7f5c28005dc0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.380+0000 7f5c3f888700 1 -- 172.21.15.73:0/1282949633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c38100840 msgr2=0x7f5c3819b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.380+0000 7f5c3f888700 1 --2- 172.21.15.73:0/1282949633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c38100840 0x7f5c3819b120 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5c34009990 tx=0x7f5c34003ba0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.380+0000 7f5c3f888700 1 -- 172.21.15.73:0/1282949633 shutdown_connections 2023-08-10T11:51:54.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.380+0000 7f5c3f888700 1 --2- 172.21.15.73:0/1282949633 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5c240a12a0 0x7f5c240a3760 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.380+0000 7f5c3f888700 1 --2- 172.21.15.73:0/1282949633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c381011e0 0x7f5c3819d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.380+0000 7f5c3f888700 1 --2- 172.21.15.73:0/1282949633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c380ff650 0x7f5c38068460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.380+0000 7f5c3f888700 1 --2- 172.21.15.73:0/1282949633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c38100840 0x7f5c3819b120 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.380+0000 7f5c3f888700 1 -- 172.21.15.73:0/1282949633 >> 172.21.15.73:0/1282949633 conn(0x7f5c380faba0 msgr2=0x7f5c380fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:54.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.380+0000 7f5c3f888700 1 -- 172.21.15.73:0/1282949633 shutdown_connections 2023-08-10T11:51:54.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.380+0000 7f5c3f888700 1 -- 172.21.15.73:0/1282949633 wait complete. 2023-08-10T11:51:54.382 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 27 2023-08-10T11:51:54.393 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-08-10T11:50:54.304447+0000', 'modified': '2023-08-10T11:51:01.523452+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24503, 'mds_1': 24479, 'mds_2': 24451, 'mds_3': 24443, 'mds_4': 24419}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14613': {'gid': 14613, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.73:6839/1099539481', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6838', 'nonce': 1099539481}, {'type': 'v1', 'addr': '172.21.15.73:6839', 'nonce': 1099539481}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_14625': {'gid': 14625, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.73:6841/3067925859', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6840', 'nonce': 3067925859}, {'type': 'v1', 'addr': '172.21.15.73:6841', 'nonce': 3067925859}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24397': {'gid': 24397, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.156:6833/3028461815', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6832', 'nonce': 3028461815}, {'type': 'v1', 'addr': '172.21.15.156:6833', 'nonce': 3028461815}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24419': {'gid': 24419, 'name': 'k', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.152:6833/4148407154', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6832', 'nonce': 4148407154}, {'type': 'v1', 'addr': '172.21.15.152:6833', 'nonce': 4148407154}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24443': {'gid': 24443, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.152:6835/1791572604', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6834', 'nonce': 1791572604}, {'type': 'v1', 'addr': '172.21.15.152:6835', 'nonce': 1791572604}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24451': {'gid': 24451, 'name': 'f', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.156:6835/904126790', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6834', 'nonce': 904126790}, {'type': 'v1', 'addr': '172.21.15.156:6835', 'nonce': 904126790}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24457': {'gid': 24457, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.156:6837/4284306352', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6836', 'nonce': 4284306352}, {'type': 'v1', 'addr': '172.21.15.156:6837', 'nonce': 4284306352}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24475': {'gid': 24475, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.156:6839/3361058731', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6838', 'nonce': 3361058731}, {'type': 'v1', 'addr': '172.21.15.156:6839', 'nonce': 3361058731}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24479': {'gid': 24479, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.152:6837/74214089', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6836', 'nonce': 74214089}, {'type': 'v1', 'addr': '172.21.15.152:6837', 'nonce': 74214089}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24503': {'gid': 24503, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.152:6839/3870202690', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6838', 'nonce': 3870202690}, {'type': 'v1', 'addr': '172.21.15.152:6839', 'nonce': 3870202690}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-10T11:51:54.393 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-08-10T11:51:54.393 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.k status 2023-08-10T11:51:54.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.515+0000 7f8a3bde9700 1 -- 172.21.15.73:0/525536345 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a34100850 msgr2=0x7f8a34100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.515+0000 7f8a3bde9700 1 --2- 172.21.15.73:0/525536345 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a34100850 0x7f8a34100cb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8a300099c0 tx=0x7f8a30009cd0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.515+0000 7f8a3bde9700 1 -- 172.21.15.73:0/525536345 shutdown_connections 2023-08-10T11:51:54.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.515+0000 7f8a3bde9700 1 --2- 172.21.15.73:0/525536345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a340ff660 0x7f8a340ffa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.515+0000 7f8a3bde9700 1 --2- 172.21.15.73:0/525536345 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a341011f0 0x7f8a34107aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.515+0000 7f8a3bde9700 1 --2- 172.21.15.73:0/525536345 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a34100850 0x7f8a34100cb0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.515+0000 7f8a3bde9700 1 -- 172.21.15.73:0/525536345 >> 172.21.15.73:0/525536345 conn(0x7f8a340fabd0 msgr2=0x7f8a340fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:54.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.515+0000 7f8a3bde9700 1 -- 172.21.15.73:0/525536345 shutdown_connections 2023-08-10T11:51:54.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.515+0000 7f8a3bde9700 1 -- 172.21.15.73:0/525536345 wait complete. 2023-08-10T11:51:54.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.515+0000 7f8a3bde9700 1 Processor -- start 2023-08-10T11:51:54.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.515+0000 7f8a3bde9700 1 -- start start 2023-08-10T11:51:54.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.515+0000 7f8a3bde9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a340ff660 0x7f8a34068460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.515+0000 7f8a3bde9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a34100850 0x7f8a3419b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.515+0000 7f8a3bde9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a341011f0 0x7f8a3419d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.515+0000 7f8a3bde9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3419e000 con 0x7f8a34100850 2023-08-10T11:51:54.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.515+0000 7f8a3bde9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3419e170 con 0x7f8a341011f0 2023-08-10T11:51:54.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.515+0000 7f8a3bde9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3419e330 con 0x7f8a340ff660 2023-08-10T11:51:54.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.516+0000 7f8a39384700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a34100850 0x7f8a3419b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.516+0000 7f8a39384700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a34100850 0x7f8a3419b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59752/0 (socket says 172.21.15.73:59752) 2023-08-10T11:51:54.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.516+0000 7f8a39384700 1 -- 172.21.15.73:0/47479093 learned_addr learned my addr 172.21.15.73:0/47479093 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:54.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.516+0000 7f8a39b85700 1 --2- 172.21.15.73:0/47479093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a340ff660 0x7f8a34068460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.516+0000 7f8a3a386700 1 --2- 172.21.15.73:0/47479093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a341011f0 0x7f8a3419d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.516+0000 7f8a39384700 1 -- 172.21.15.73:0/47479093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a340ff660 msgr2=0x7f8a34068460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.516+0000 7f8a39384700 1 --2- 172.21.15.73:0/47479093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a340ff660 0x7f8a34068460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.516+0000 7f8a39384700 1 -- 172.21.15.73:0/47479093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a341011f0 msgr2=0x7f8a3419d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.516+0000 7f8a39384700 1 --2- 172.21.15.73:0/47479093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a341011f0 0x7f8a3419d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.516+0000 7f8a39384700 1 -- 172.21.15.73:0/47479093 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a300095f0 con 0x7f8a34100850 2023-08-10T11:51:54.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.516+0000 7f8a39384700 1 --2- 172.21.15.73:0/47479093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a34100850 0x7f8a3419b1e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000c010 tx=0x7f8a30004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:54.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.516+0000 7f8a2affd700 1 -- 172.21.15.73:0/47479093 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3001d070 con 0x7f8a34100850 2023-08-10T11:51:54.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.516+0000 7f8a2affd700 1 -- 172.21.15.73:0/47479093 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a300041d0 con 0x7f8a34100850 2023-08-10T11:51:54.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.516+0000 7f8a3bde9700 1 -- 172.21.15.73:0/47479093 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3419e5b0 con 0x7f8a34100850 2023-08-10T11:51:54.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.516+0000 7f8a2affd700 1 -- 172.21.15.73:0/47479093 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a30005390 con 0x7f8a34100850 2023-08-10T11:51:54.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.516+0000 7f8a3bde9700 1 -- 172.21.15.73:0/47479093 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3419e9d0 con 0x7f8a34100850 2023-08-10T11:51:54.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.519+0000 7f8a2affd700 1 -- 172.21.15.73:0/47479093 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f8a30004aa0 con 0x7f8a34100850 2023-08-10T11:51:54.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.520+0000 7f8a2affd700 1 --2- 172.21.15.73:0/47479093 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8a200a11e0 0x7f8a200a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.520+0000 7f8a39b85700 1 --2- 172.21.15.73:0/47479093 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8a200a11e0 0x7f8a200a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.520+0000 7f8a2affd700 1 -- 172.21.15.73:0/47479093 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8a300cdbf0 con 0x7f8a34100850 2023-08-10T11:51:54.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.520+0000 7f8a47f82b80 1 Processor -- start 2023-08-10T11:51:54.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.520+0000 7f8a39b85700 1 --2- 172.21.15.73:0/47479093 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8a200a11e0 0x7f8a200a36a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8a341006b0 tx=0x7f8a2400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:54.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.520+0000 7f8a47f82b80 1 -- start start 2023-08-10T11:51:54.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.521+0000 7f8a47f82b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561336e064f0 0x561336e06910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.521+0000 7f8a47f82b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561336e06e50 0x561336e07380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.521+0000 7f8a47f82b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e07910 0x561336e07da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.521+0000 7f8a47f82b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561336d81d70 con 0x561336e07910 2023-08-10T11:51:54.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.521+0000 7f8a47f82b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561336d5e540 con 0x561336e06e50 2023-08-10T11:51:54.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.521+0000 7f8a47f82b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561336d5be60 con 0x561336e064f0 2023-08-10T11:51:54.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.521+0000 7f8a3a386700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e07910 0x561336e07da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.521+0000 7f8a3a386700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e07910 0x561336e07da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59762/0 (socket says 172.21.15.73:59762) 2023-08-10T11:51:54.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.521+0000 7f8a3a386700 1 -- 172.21.15.73:0/3448398118 learned_addr learned my addr 172.21.15.73:0/3448398118 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:54.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.521+0000 7f8a39b85700 1 --2- 172.21.15.73:0/3448398118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561336e064f0 0x561336e06910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.521+0000 7f8a39384700 1 --2- 172.21.15.73:0/3448398118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561336e06e50 0x561336e07380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.521+0000 7f8a3a386700 1 -- 172.21.15.73:0/3448398118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561336e064f0 msgr2=0x561336e06910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:54.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.521+0000 7f8a3a386700 1 --2- 172.21.15.73:0/3448398118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561336e064f0 0x561336e06910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.521+0000 7f8a3a386700 1 -- 172.21.15.73:0/3448398118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561336e06e50 msgr2=0x561336e07380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:54.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.521+0000 7f8a3a386700 1 --2- 172.21.15.73:0/3448398118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561336e06e50 0x561336e07380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.521+0000 7f8a3a386700 1 -- 172.21.15.73:0/3448398118 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561336bd85e0 con 0x561336e07910 2023-08-10T11:51:54.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.521+0000 7f8a3a386700 1 --2- 172.21.15.73:0/3448398118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e07910 0x561336e07da0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00a730 tx=0x7f8a2c0078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1ad93b46efc166 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:54.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.521+0000 7f8a1ffff700 1 -- 172.21.15.73:0/3448398118 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c018070 con 0x561336e07910 2023-08-10T11:51:54.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.521+0000 7f8a1ffff700 1 -- 172.21.15.73:0/3448398118 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a2c010040 con 0x561336e07910 2023-08-10T11:51:54.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.521+0000 7f8a1ffff700 1 -- 172.21.15.73:0/3448398118 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c00f050 con 0x561336e07910 2023-08-10T11:51:54.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.522+0000 7f8a47f82b80 1 -- 172.21.15.73:0/3448398118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e07910 msgr2=0x561336e07da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.522+0000 7f8a47f82b80 1 --2- 172.21.15.73:0/3448398118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e07910 0x561336e07da0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00a730 tx=0x7f8a2c0078d0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.522+0000 7f8a47f82b80 1 -- 172.21.15.73:0/3448398118 shutdown_connections 2023-08-10T11:51:54.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.522+0000 7f8a47f82b80 1 --2- 172.21.15.73:0/3448398118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e07910 0x561336e07da0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.522+0000 7f8a47f82b80 1 --2- 172.21.15.73:0/3448398118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561336e064f0 0x561336e06910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.522+0000 7f8a47f82b80 1 --2- 172.21.15.73:0/3448398118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561336e06e50 0x561336e07380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.522+0000 7f8a47f82b80 1 -- 172.21.15.73:0/3448398118 >> 172.21.15.73:0/3448398118 conn(0x561336d63c80 msgr2=0x561336e01280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:54.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.522+0000 7f8a47f82b80 1 -- 172.21.15.73:0/3448398118 shutdown_connections 2023-08-10T11:51:54.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.522+0000 7f8a47f82b80 1 -- 172.21.15.73:0/3448398118 wait complete. 2023-08-10T11:51:54.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.522+0000 7f8a47f82b80 1 -- start start 2023-08-10T11:51:54.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.522+0000 7f8a47f82b80 1 Processor -- start 2023-08-10T11:51:54.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.523+0000 7f8a47f82b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561336e064f0 0x561336e0fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.523+0000 7f8a47f82b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e06e50 0x561336e10420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.523+0000 7f8a47f82b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561336e07910 0x561336e17460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.523+0000 7f8a47f82b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561336d57750 con 0x561336e06e50 2023-08-10T11:51:54.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.523+0000 7f8a47f82b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561336cf6a70 con 0x561336e07910 2023-08-10T11:51:54.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.523+0000 7f8a47f82b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561336cf6770 con 0x561336e064f0 2023-08-10T11:51:54.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.523+0000 7f8a47f82b80 10 client.0 _ll_register_callbacks cb 0x561336cf4630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:51:54.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.523+0000 7f8a39384700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e06e50 0x561336e10420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.523+0000 7f8a39384700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e06e50 0x561336e10420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59766/0 (socket says 172.21.15.73:59766) 2023-08-10T11:51:54.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.523+0000 7f8a39384700 1 -- 172.21.15.73:0/970840829 learned_addr learned my addr 172.21.15.73:0/970840829 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:54.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.523+0000 7f8a3a386700 1 --2- 172.21.15.73:0/970840829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561336e07910 0x561336e17460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.523+0000 7f8a39b85700 1 --2- 172.21.15.73:0/970840829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561336e064f0 0x561336e0fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.523+0000 7f8a39384700 1 -- 172.21.15.73:0/970840829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561336e064f0 msgr2=0x561336e0fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:54.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.523+0000 7f8a39384700 1 --2- 172.21.15.73:0/970840829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561336e064f0 0x561336e0fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.523+0000 7f8a39384700 1 -- 172.21.15.73:0/970840829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561336e07910 msgr2=0x561336e17460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:54.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.523+0000 7f8a39384700 1 --2- 172.21.15.73:0/970840829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561336e07910 0x561336e17460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.523+0000 7f8a39384700 1 -- 172.21.15.73:0/970840829 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2c00a410 con 0x561336e06e50 2023-08-10T11:51:54.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.523+0000 7f8a3a386700 1 --2- 172.21.15.73:0/970840829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561336e07910 0x561336e17460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:51:54.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.523+0000 7f8a39b85700 1 --2- 172.21.15.73:0/970840829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561336e064f0 0x561336e0fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:54.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.523+0000 7f8a39384700 1 --2- 172.21.15.73:0/970840829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e06e50 0x561336e10420 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8a30097950 tx=0x7f8a3009b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1afbae2316dcde18 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:54.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.523+0000 7f8a1d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:51:54.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.524+0000 7f8a1d7fa700 1 -- 172.21.15.73:0/970840829 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a300a32a0 con 0x561336e06e50 2023-08-10T11:51:54.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.524+0000 7f8a1d7fa700 1 -- 172.21.15.73:0/970840829 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8a300054f0 con 0x561336e06e50 2023-08-10T11:51:54.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.524+0000 7f8a47f82b80 1 -- 172.21.15.73:0/970840829 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561336df9420 con 0x561336e06e50 2023-08-10T11:51:54.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.524+0000 7f8a1d7fa700 1 -- 172.21.15.73:0/970840829 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a300056b0 con 0x561336e06e50 2023-08-10T11:51:54.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.524+0000 7f8a47f82b80 10 client.15033 fetch_fsmap learned FSMap version 27 2023-08-10T11:51:54.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.524+0000 7f8a47f82b80 1 -- 172.21.15.73:0/970840829 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561336b84d90 con 0x561336e06e50 2023-08-10T11:51:54.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.524+0000 7f8a1d7fa700 1 -- 172.21.15.73:0/970840829 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561336df9420 con 0x561336e06e50 2023-08-10T11:51:54.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.524+0000 7f8a1d7fa700 1 -- 172.21.15.73:0/970840829 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8a300cbc60 con 0x561336e06e50 2023-08-10T11:51:54.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.524+0000 7f8a47f82b80 10 client.15033 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:51:54.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.524+0000 7f8a47f82b80 10 client.15033 resolve_mds: resolved name 'k' to daemon mds.k 2023-08-10T11:51:54.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.524+0000 7f8a47f82b80 20 client.15033 populate_metadata read hostname 'smithi073' 2023-08-10T11:51:54.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.524+0000 7f8a47f82b80 1 --2- 172.21.15.73:0/970840829 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x561336e1acf0 0x561336e1a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.524+0000 7f8a47f82b80 4 client.15033 mds_command: new command op to 24419 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:51:54.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.524+0000 7f8a47f82b80 1 -- 172.21.15.73:0/970840829 --> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561336dd5980 con 0x561336e1acf0 2023-08-10T11:51:54.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.524+0000 7f8a39b85700 1 --2- 172.21.15.73:0/970840829 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x561336e1acf0 0x561336e1a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.525+0000 7f8a1d7fa700 10 client.15033 ms_handle_connect on v2:172.21.15.152:6832/4148407154 2023-08-10T11:51:54.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.525+0000 7f8a39b85700 1 --2- 172.21.15.73:0/970840829 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x561336e1acf0 0x561336e1a390 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=da1842757508c6aa server_cookie=de3d1dfd8406d83a in_seq=0 out_seq=0 2023-08-10T11:51:54.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.526+0000 7f8a1d7fa700 1 -- 172.21.15.73:0/970840829 <== mds.4 v2:172.21.15.152:6832/4148407154 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x561336dd5980 con 0x561336e1acf0 2023-08-10T11:51:54.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.526+0000 7f8a1d7fa700 10 client.15033 handle_command_reply: tid=0 2023-08-10T11:51:54.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.526+0000 7f8a47f82b80 1 client.15033 shutdown 2023-08-10T11:51:54.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.526+0000 7f8a47f82b80 1 -- 172.21.15.73:0/970840829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e06e50 msgr2=0x561336e10420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.526+0000 7f8a47f82b80 1 --2- 172.21.15.73:0/970840829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e06e50 0x561336e10420 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8a30097950 tx=0x7f8a3009b420 comp rx=0 tx=0).stop 2023-08-10T11:51:54.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.526+0000 7f8a47f82b80 1 -- 172.21.15.73:0/970840829 shutdown_connections 2023-08-10T11:51:54.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.526+0000 7f8a47f82b80 1 --2- 172.21.15.73:0/970840829 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x561336e1acf0 0x561336e1a390 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.526+0000 7f8a47f82b80 1 --2- 172.21.15.73:0/970840829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561336e07910 0x561336e17460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.526+0000 7f8a1d7fa700 0 client.15033 ms_handle_reset on v2:172.21.15.152:6832/4148407154 2023-08-10T11:51:54.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.526+0000 7f8a47f82b80 1 --2- 172.21.15.73:0/970840829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561336e064f0 0x561336e0fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.526+0000 7f8a47f82b80 1 --2- 172.21.15.73:0/970840829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e06e50 0x561336e10420 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.526+0000 7f8a47f82b80 1 -- 172.21.15.73:0/970840829 >> 172.21.15.73:0/970840829 conn(0x561336d63c80 msgr2=0x561336e00960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:54.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.526+0000 7f8a47f82b80 1 -- 172.21.15.73:0/970840829 shutdown_connections 2023-08-10T11:51:54.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.526+0000 7f8a47f82b80 1 -- 172.21.15.73:0/970840829 wait complete. 2023-08-10T11:51:54.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.526+0000 7f8a47f82b80 20 client.15033 trim_cache size 0 max 16384 2023-08-10T11:51:54.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.543+0000 7f8a47f82b80 1 Processor -- start 2023-08-10T11:51:54.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.543+0000 7f8a47f82b80 1 -- start start 2023-08-10T11:51:54.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.544+0000 7f8a47f82b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561336e064f0 0x561336e0a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.544+0000 7f8a47f82b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561336e06e50 0x561336e0acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.544+0000 7f8a47f82b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e07910 0x561336e17420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.544+0000 7f8a47f82b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561336bda8d0 con 0x561336e07910 2023-08-10T11:51:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.544+0000 7f8a47f82b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561336e07230 con 0x561336e06e50 2023-08-10T11:51:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.544+0000 7f8a47f82b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561336e10d80 con 0x561336e064f0 2023-08-10T11:51:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.544+0000 7f8a3a386700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e07910 0x561336e17420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.544+0000 7f8a3a386700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e07910 0x561336e17420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59776/0 (socket says 172.21.15.73:59776) 2023-08-10T11:51:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.544+0000 7f8a3a386700 1 -- 172.21.15.73:0/1853291758 learned_addr learned my addr 172.21.15.73:0/1853291758 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.544+0000 7f8a39b85700 1 --2- 172.21.15.73:0/1853291758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561336e064f0 0x561336e0a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.544+0000 7f8a3a386700 1 -- 172.21.15.73:0/1853291758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561336e064f0 msgr2=0x561336e0a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.544+0000 7f8a3a386700 1 --2- 172.21.15.73:0/1853291758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561336e064f0 0x561336e0a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.544+0000 7f8a3a386700 1 -- 172.21.15.73:0/1853291758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561336e06e50 msgr2=0x561336e0acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.544+0000 7f8a3a386700 1 --2- 172.21.15.73:0/1853291758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561336e06e50 0x561336e0acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.544+0000 7f8a3a386700 1 -- 172.21.15.73:0/1853291758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561336dfd650 con 0x561336e07910 2023-08-10T11:51:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.544+0000 7f8a3a386700 1 --2- 172.21.15.73:0/1853291758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e07910 0x561336e17420 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00a700 tx=0x7f8a2c00a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7368396db18560c6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:54.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.544+0000 7f8a28ff9700 1 -- 172.21.15.73:0/1853291758 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c018030 con 0x561336e07910 2023-08-10T11:51:54.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.544+0000 7f8a28ff9700 1 -- 172.21.15.73:0/1853291758 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a2c019040 con 0x561336e07910 2023-08-10T11:51:54.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.544+0000 7f8a28ff9700 1 -- 172.21.15.73:0/1853291758 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c004390 con 0x561336e07910 2023-08-10T11:51:54.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.545+0000 7f8a47f82b80 1 -- 172.21.15.73:0/1853291758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e07910 msgr2=0x561336e17420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.545+0000 7f8a47f82b80 1 --2- 172.21.15.73:0/1853291758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e07910 0x561336e17420 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00a700 tx=0x7f8a2c00a2e0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.545+0000 7f8a47f82b80 1 -- 172.21.15.73:0/1853291758 shutdown_connections 2023-08-10T11:51:54.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.545+0000 7f8a47f82b80 1 --2- 172.21.15.73:0/1853291758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e07910 0x561336e17420 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.545+0000 7f8a47f82b80 1 --2- 172.21.15.73:0/1853291758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561336e064f0 0x561336e0a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.545+0000 7f8a47f82b80 1 --2- 172.21.15.73:0/1853291758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561336e06e50 0x561336e0acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.545+0000 7f8a47f82b80 1 -- 172.21.15.73:0/1853291758 >> 172.21.15.73:0/1853291758 conn(0x561336d63c80 msgr2=0x561336e1a390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:54.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.545+0000 7f8a47f82b80 1 -- 172.21.15.73:0/1853291758 shutdown_connections 2023-08-10T11:51:54.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.545+0000 7f8a47f82b80 1 -- 172.21.15.73:0/1853291758 wait complete. 2023-08-10T11:51:54.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.545+0000 7f8a47f82b80 1 -- start start 2023-08-10T11:51:54.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.545+0000 7f8a47f82b80 1 Processor -- start 2023-08-10T11:51:54.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.546+0000 7f8a47f82b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561336e064f0 0x561336e12750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.546+0000 7f8a47f82b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e06e50 0x561336e12c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.546+0000 7f8a47f82b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561336e07910 0x561336e15cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.546+0000 7f8a47f82b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561336e161f0 con 0x561336e06e50 2023-08-10T11:51:54.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.546+0000 7f8a47f82b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561336e16360 con 0x561336e07910 2023-08-10T11:51:54.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.546+0000 7f8a47f82b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561336e16520 con 0x561336e064f0 2023-08-10T11:51:54.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.546+0000 7f8a47f82b80 10 client.0 _ll_register_callbacks cb 0x561336cf4630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:51:54.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.546+0000 7f8a39384700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e06e50 0x561336e12c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.546+0000 7f8a39384700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e06e50 0x561336e12c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59780/0 (socket says 172.21.15.73:59780) 2023-08-10T11:51:54.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.546+0000 7f8a39384700 1 -- 172.21.15.73:0/1413417018 learned_addr learned my addr 172.21.15.73:0/1413417018 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:54.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.546+0000 7f8a39b85700 1 --2- 172.21.15.73:0/1413417018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561336e064f0 0x561336e12750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.546+0000 7f8a3a386700 1 --2- 172.21.15.73:0/1413417018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561336e07910 0x561336e15cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.546+0000 7f8a39384700 1 -- 172.21.15.73:0/1413417018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561336e064f0 msgr2=0x561336e12750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:54.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.546+0000 7f8a39384700 1 --2- 172.21.15.73:0/1413417018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561336e064f0 0x561336e12750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.546+0000 7f8a39384700 1 -- 172.21.15.73:0/1413417018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561336e07910 msgr2=0x561336e15cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:54.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.546+0000 7f8a39384700 1 --2- 172.21.15.73:0/1413417018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561336e07910 0x561336e15cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.546+0000 7f8a39384700 1 -- 172.21.15.73:0/1413417018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561336bd85e0 con 0x561336e06e50 2023-08-10T11:51:54.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.546+0000 7f8a39384700 1 --2- 172.21.15.73:0/1413417018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e06e50 0x561336e12c90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8a30000c00 tx=0x7f8a3009ab30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ab341f772aec72 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:54.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.546+0000 7f8a1d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:51:54.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.546+0000 7f8a1d7fa700 1 -- 172.21.15.73:0/1413417018 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a300a3010 con 0x561336e06e50 2023-08-10T11:51:54.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.546+0000 7f8a1d7fa700 1 -- 172.21.15.73:0/1413417018 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8a300cbd70 con 0x561336e06e50 2023-08-10T11:51:54.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.546+0000 7f8a47f82b80 1 -- 172.21.15.73:0/1413417018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a2c010040 con 0x561336e06e50 2023-08-10T11:51:54.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.546+0000 7f8a1d7fa700 1 -- 172.21.15.73:0/1413417018 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a300ca020 con 0x561336e06e50 2023-08-10T11:51:54.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.546+0000 7f8a47f82b80 10 client.15039 fetch_fsmap learned FSMap version 27 2023-08-10T11:51:54.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.546+0000 7f8a47f82b80 1 -- 172.21.15.73:0/1413417018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561336b6dc10 con 0x561336e06e50 2023-08-10T11:51:54.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.547+0000 7f8a1d7fa700 1 -- 172.21.15.73:0/1413417018 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a2c010040 con 0x561336e06e50 2023-08-10T11:51:54.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.547+0000 7f8a1d7fa700 1 -- 172.21.15.73:0/1413417018 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8a300054f0 con 0x561336e06e50 2023-08-10T11:51:54.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.547+0000 7f8a47f82b80 10 client.15039 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:51:54.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.547+0000 7f8a47f82b80 10 client.15039 resolve_mds: resolved name 'k' to daemon mds.k 2023-08-10T11:51:54.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.547+0000 7f8a47f82b80 20 client.15039 populate_metadata read hostname 'smithi073' 2023-08-10T11:51:54.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.547+0000 7f8a47f82b80 1 --2- 172.21.15.73:0/1413417018 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x561336e1acf0 0x561336e70980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.547+0000 7f8a47f82b80 4 client.15039 mds_command: new command op to 24419 tid=0[{"prefix": "status"}] 2023-08-10T11:51:54.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.547+0000 7f8a47f82b80 1 -- 172.21.15.73:0/1413417018 --> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561336d50730 con 0x561336e1acf0 2023-08-10T11:51:54.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.547+0000 7f8a39b85700 1 --2- 172.21.15.73:0/1413417018 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x561336e1acf0 0x561336e70980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.547+0000 7f8a1d7fa700 10 client.15039 ms_handle_connect on v2:172.21.15.152:6832/4148407154 2023-08-10T11:51:54.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.547+0000 7f8a39b85700 1 --2- 172.21.15.73:0/1413417018 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x561336e1acf0 0x561336e70980 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=70303d251d3d5704 server_cookie=fdae5c158d89b6b6 in_seq=0 out_seq=0 2023-08-10T11:51:54.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.548+0000 7f8a1d7fa700 1 -- 172.21.15.73:0/1413417018 <== mds.4 v2:172.21.15.152:6832/4148407154 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x561336d50730 con 0x561336e1acf0 2023-08-10T11:51:54.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.548+0000 7f8a1d7fa700 10 client.15039 handle_command_reply: tid=0 2023-08-10T11:51:54.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.548+0000 7f8a47f82b80 1 client.15039 shutdown 2023-08-10T11:51:54.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.548+0000 7f8a47f82b80 1 -- 172.21.15.73:0/1413417018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e06e50 msgr2=0x561336e12c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.548+0000 7f8a47f82b80 1 --2- 172.21.15.73:0/1413417018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e06e50 0x561336e12c90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8a30000c00 tx=0x7f8a3009ab30 comp rx=0 tx=0).stop 2023-08-10T11:51:54.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.548+0000 7f8a47f82b80 1 -- 172.21.15.73:0/1413417018 shutdown_connections 2023-08-10T11:51:54.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.548+0000 7f8a47f82b80 1 --2- 172.21.15.73:0/1413417018 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x561336e1acf0 0x561336e70980 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.548+0000 7f8a47f82b80 1 --2- 172.21.15.73:0/1413417018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561336e07910 0x561336e15cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.548+0000 7f8a1d7fa700 0 client.15039 ms_handle_reset on v2:172.21.15.152:6832/4148407154 2023-08-10T11:51:54.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.548+0000 7f8a47f82b80 1 --2- 172.21.15.73:0/1413417018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561336e064f0 0x561336e12750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.548+0000 7f8a47f82b80 1 --2- 172.21.15.73:0/1413417018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561336e06e50 0x561336e12c90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.548+0000 7f8a47f82b80 1 -- 172.21.15.73:0/1413417018 >> 172.21.15.73:0/1413417018 conn(0x561336d63c80 msgr2=0x561336e0a780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:54.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.548+0000 7f8a47f82b80 1 -- 172.21.15.73:0/1413417018 shutdown_connections 2023-08-10T11:51:54.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.548+0000 7f8a47f82b80 1 -- 172.21.15.73:0/1413417018 wait complete. 2023-08-10T11:51:54.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.548+0000 7f8a47f82b80 20 client.15039 trim_cache size 0 max 16384 2023-08-10T11:51:54.560 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:51:54.560 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "0e619a74-3773-11ee-9b37-001a4aab830c", 2023-08-10T11:51:54.560 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 4, 2023-08-10T11:51:54.560 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 24419, 2023-08-10T11:51:54.560 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2023-08-10T11:51:54.560 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2023-08-10T11:51:54.561 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2023-08-10T11:51:54.561 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 54.027443298999998, 2023-08-10T11:51:54.561 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 27, 2023-08-10T11:51:54.561 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 85, 2023-08-10T11:51:54.561 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 83, 2023-08-10T11:51:54.561 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 87.547657586 2023-08-10T11:51:54.561 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:51:54.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.548+0000 7f8a3bde9700 1 -- 172.21.15.73:0/47479093 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8a200a11e0 msgr2=0x7f8a200a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.548+0000 7f8a3bde9700 1 --2- 172.21.15.73:0/47479093 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8a200a11e0 0x7f8a200a36a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8a341006b0 tx=0x7f8a2400a380 comp rx=0 tx=0).stop 2023-08-10T11:51:54.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.548+0000 7f8a3bde9700 1 -- 172.21.15.73:0/47479093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a34100850 msgr2=0x7f8a3419b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.548+0000 7f8a3bde9700 1 --2- 172.21.15.73:0/47479093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a34100850 0x7f8a3419b1e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000c010 tx=0x7f8a30004730 comp rx=0 tx=0).stop 2023-08-10T11:51:54.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.548+0000 7f8a3bde9700 1 -- 172.21.15.73:0/47479093 shutdown_connections 2023-08-10T11:51:54.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.548+0000 7f8a3bde9700 1 --2- 172.21.15.73:0/47479093 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8a200a11e0 0x7f8a200a36a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.548+0000 7f8a3bde9700 1 --2- 172.21.15.73:0/47479093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a341011f0 0x7f8a3419d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.548+0000 7f8a3bde9700 1 --2- 172.21.15.73:0/47479093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a340ff660 0x7f8a34068460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.548+0000 7f8a3bde9700 1 --2- 172.21.15.73:0/47479093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a34100850 0x7f8a3419b1e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.548+0000 7f8a3bde9700 1 -- 172.21.15.73:0/47479093 >> 172.21.15.73:0/47479093 conn(0x7f8a340fabd0 msgr2=0x7f8a340fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:54.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.549+0000 7f8a3bde9700 1 -- 172.21.15.73:0/47479093 shutdown_connections 2023-08-10T11:51:54.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.549+0000 7f8a3bde9700 1 -- 172.21.15.73:0/47479093 wait complete. 2023-08-10T11:51:54.564 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-08-10T11:51:54.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.686+0000 7f78d6ec4700 1 -- 172.21.15.73:0/314274611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78d00fffc0 msgr2=0x7f78d0100420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.686+0000 7f78d6ec4700 1 --2- 172.21.15.73:0/314274611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78d00fffc0 0x7f78d0100420 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f78bc00aad0 tx=0x7f78bc00ade0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.686+0000 7f78d6ec4700 1 -- 172.21.15.73:0/314274611 shutdown_connections 2023-08-10T11:51:54.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.687+0000 7f78d6ec4700 1 --2- 172.21.15.73:0/314274611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78d0100960 0x7f78d0107210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.687+0000 7f78d6ec4700 1 --2- 172.21.15.73:0/314274611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78d00fedd0 0x7f78d00ff1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.687+0000 7f78d6ec4700 1 --2- 172.21.15.73:0/314274611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78d00fffc0 0x7f78d0100420 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.687+0000 7f78d6ec4700 1 -- 172.21.15.73:0/314274611 >> 172.21.15.73:0/314274611 conn(0x7f78d00fa340 msgr2=0x7f78d00fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:54.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.687+0000 7f78d6ec4700 1 -- 172.21.15.73:0/314274611 shutdown_connections 2023-08-10T11:51:54.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.687+0000 7f78d6ec4700 1 -- 172.21.15.73:0/314274611 wait complete. 2023-08-10T11:51:54.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.687+0000 7f78d6ec4700 1 Processor -- start 2023-08-10T11:51:54.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.687+0000 7f78d6ec4700 1 -- start start 2023-08-10T11:51:54.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.687+0000 7f78d6ec4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78d00fedd0 0x7f78d0196520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.687+0000 7f78d6ec4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78d00fffc0 0x7f78d0196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.687+0000 7f78d6ec4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78d0100960 0x7f78d019dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.687+0000 7f78d6ec4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d019e0a0 con 0x7f78d00fffc0 2023-08-10T11:51:54.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.687+0000 7f78d6ec4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d019e1e0 con 0x7f78d0100960 2023-08-10T11:51:54.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.687+0000 7f78d6ec4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d019e370 con 0x7f78d00fedd0 2023-08-10T11:51:54.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.687+0000 7f78cffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78d00fffc0 0x7f78d0196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.687+0000 7f78cffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78d00fffc0 0x7f78d0196a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59794/0 (socket says 172.21.15.73:59794) 2023-08-10T11:51:54.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.687+0000 7f78cffff700 1 -- 172.21.15.73:0/2413555213 learned_addr learned my addr 172.21.15.73:0/2413555213 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:54.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.687+0000 7f78d4c60700 1 --2- 172.21.15.73:0/2413555213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78d00fedd0 0x7f78d0196520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.688+0000 7f78d5461700 1 --2- 172.21.15.73:0/2413555213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78d0100960 0x7f78d019dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.688+0000 7f78cffff700 1 -- 172.21.15.73:0/2413555213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78d00fedd0 msgr2=0x7f78d0196520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.688+0000 7f78cffff700 1 --2- 172.21.15.73:0/2413555213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78d00fedd0 0x7f78d0196520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.688+0000 7f78cffff700 1 -- 172.21.15.73:0/2413555213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78d0100960 msgr2=0x7f78d019dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.688+0000 7f78cffff700 1 --2- 172.21.15.73:0/2413555213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78d0100960 0x7f78d019dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.688+0000 7f78cffff700 1 -- 172.21.15.73:0/2413555213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78bc00a700 con 0x7f78d00fffc0 2023-08-10T11:51:54.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.688+0000 7f78d5461700 1 --2- 172.21.15.73:0/2413555213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78d0100960 0x7f78d019dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:54.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.688+0000 7f78cffff700 1 --2- 172.21.15.73:0/2413555213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78d00fffc0 0x7f78d0196a60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f78bc00a9f0 tx=0x7f78bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:54.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.688+0000 7f78cdffb700 1 -- 172.21.15.73:0/2413555213 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc004000 con 0x7f78d00fffc0 2023-08-10T11:51:54.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.688+0000 7f78cdffb700 1 -- 172.21.15.73:0/2413555213 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78bc004160 con 0x7f78d00fffc0 2023-08-10T11:51:54.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.688+0000 7f78d6ec4700 1 -- 172.21.15.73:0/2413555213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d019e5f0 con 0x7f78d00fffc0 2023-08-10T11:51:54.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.688+0000 7f78cdffb700 1 -- 172.21.15.73:0/2413555213 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc016680 con 0x7f78d00fffc0 2023-08-10T11:51:54.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.688+0000 7f78d6ec4700 1 -- 172.21.15.73:0/2413555213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d019ea10 con 0x7f78d00fffc0 2023-08-10T11:51:54.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.690+0000 7f78cdffb700 1 -- 172.21.15.73:0/2413555213 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f78bc00e450 con 0x7f78d00fffc0 2023-08-10T11:51:54.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.691+0000 7f78cdffb700 1 --2- 172.21.15.73:0/2413555213 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f78c00a11e0 0x7f78c00a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.691+0000 7f78d4c60700 1 --2- 172.21.15.73:0/2413555213 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f78c00a11e0 0x7f78c00a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.691+0000 7f78cdffb700 1 -- 172.21.15.73:0/2413555213 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f78bc012070 con 0x7f78d00fffc0 2023-08-10T11:51:54.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.691+0000 7f78d4c60700 1 --2- 172.21.15.73:0/2413555213 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f78c00a11e0 0x7f78c00a36a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f78d00ffe20 tx=0x7f78c400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:54.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.692+0000 7f78e305db80 1 Processor -- start 2023-08-10T11:51:54.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.692+0000 7f78e305db80 1 -- start start 2023-08-10T11:51:54.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.692+0000 7f78e305db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56111aa214f0 0x56111aa21910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.692+0000 7f78e305db80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa21e50 0x56111aa22380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.692+0000 7f78e305db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56111aa22910 0x56111aa22da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.692+0000 7f78e305db80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56111a99cd70 con 0x56111aa21e50 2023-08-10T11:51:54.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.692+0000 7f78e305db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56111a979540 con 0x56111aa214f0 2023-08-10T11:51:54.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.692+0000 7f78e305db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56111a976e60 con 0x56111aa22910 2023-08-10T11:51:54.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.692+0000 7f78cffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa21e50 0x56111aa22380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.692+0000 7f78cffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa21e50 0x56111aa22380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59804/0 (socket says 172.21.15.73:59804) 2023-08-10T11:51:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.692+0000 7f78cffff700 1 -- 172.21.15.73:0/2460172737 learned_addr learned my addr 172.21.15.73:0/2460172737 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.693+0000 7f78d4c60700 1 --2- 172.21.15.73:0/2460172737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56111aa214f0 0x56111aa21910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.693+0000 7f78d5461700 1 --2- 172.21.15.73:0/2460172737 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56111aa22910 0x56111aa22da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.693+0000 7f78cffff700 1 -- 172.21.15.73:0/2460172737 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56111aa22910 msgr2=0x56111aa22da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.693+0000 7f78cffff700 1 --2- 172.21.15.73:0/2460172737 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56111aa22910 0x56111aa22da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.693+0000 7f78cffff700 1 -- 172.21.15.73:0/2460172737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56111aa214f0 msgr2=0x56111aa21910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:54.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.693+0000 7f78cffff700 1 --2- 172.21.15.73:0/2460172737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56111aa214f0 0x56111aa21910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.693+0000 7f78cffff700 1 -- 172.21.15.73:0/2460172737 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56111a7f35e0 con 0x56111aa21e50 2023-08-10T11:51:54.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.693+0000 7f78d4c60700 1 --2- 172.21.15.73:0/2460172737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56111aa214f0 0x56111aa21910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:54.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.693+0000 7f78d5461700 1 --2- 172.21.15.73:0/2460172737 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56111aa22910 0x56111aa22da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:54.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.693+0000 7f78cffff700 1 --2- 172.21.15.73:0/2460172737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa21e50 0x56111aa22380 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f78bc098710 tx=0x7f78bc09b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29675f81ddec610 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:54.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.693+0000 7f78baffd700 1 -- 172.21.15.73:0/2460172737 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc0042d0 con 0x56111aa21e50 2023-08-10T11:51:54.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.693+0000 7f78baffd700 1 -- 172.21.15.73:0/2460172737 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78bc09bca0 con 0x56111aa21e50 2023-08-10T11:51:54.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.693+0000 7f78baffd700 1 -- 172.21.15.73:0/2460172737 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc09b3f0 con 0x56111aa21e50 2023-08-10T11:51:54.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.694+0000 7f78e305db80 1 -- 172.21.15.73:0/2460172737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa21e50 msgr2=0x56111aa22380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.694+0000 7f78e305db80 1 --2- 172.21.15.73:0/2460172737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa21e50 0x56111aa22380 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f78bc098710 tx=0x7f78bc09b860 comp rx=0 tx=0).stop 2023-08-10T11:51:54.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.694+0000 7f78e305db80 1 -- 172.21.15.73:0/2460172737 shutdown_connections 2023-08-10T11:51:54.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.694+0000 7f78e305db80 1 --2- 172.21.15.73:0/2460172737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56111aa214f0 0x56111aa21910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.694+0000 7f78e305db80 1 --2- 172.21.15.73:0/2460172737 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56111aa22910 0x56111aa22da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.694+0000 7f78e305db80 1 --2- 172.21.15.73:0/2460172737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa21e50 0x56111aa22380 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.694+0000 7f78e305db80 1 -- 172.21.15.73:0/2460172737 >> 172.21.15.73:0/2460172737 conn(0x56111a97ec80 msgr2=0x56111aa1c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:54.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.694+0000 7f78e305db80 1 -- 172.21.15.73:0/2460172737 shutdown_connections 2023-08-10T11:51:54.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.694+0000 7f78e305db80 1 -- 172.21.15.73:0/2460172737 wait complete. 2023-08-10T11:51:54.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.694+0000 7f78e305db80 1 -- start start 2023-08-10T11:51:54.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.694+0000 7f78e305db80 1 Processor -- start 2023-08-10T11:51:54.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.694+0000 7f78e305db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56111aa214f0 0x56111aa2ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.694+0000 7f78e305db80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa21e50 0x56111aa2b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.694+0000 7f78e305db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56111aa22910 0x56111aa322b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.694+0000 7f78e305db80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56111a972750 con 0x56111aa21e50 2023-08-10T11:51:54.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.694+0000 7f78e305db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56111a911a70 con 0x56111aa22910 2023-08-10T11:51:54.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.694+0000 7f78e305db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56111a911770 con 0x56111aa214f0 2023-08-10T11:51:54.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.694+0000 7f78e305db80 10 client.0 _ll_register_callbacks cb 0x56111a90f630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:51:54.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.695+0000 7f78cffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa21e50 0x56111aa2b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.695+0000 7f78d4c60700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56111aa214f0 0x56111aa2ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.695+0000 7f78cffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa21e50 0x56111aa2b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59808/0 (socket says 172.21.15.73:59808) 2023-08-10T11:51:54.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.695+0000 7f78cffff700 1 -- 172.21.15.73:0/563160214 learned_addr learned my addr 172.21.15.73:0/563160214 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:54.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.695+0000 7f78d5461700 1 --2- 172.21.15.73:0/563160214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56111aa22910 0x56111aa322b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.695+0000 7f78d4c60700 1 -- 172.21.15.73:0/563160214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56111aa22910 msgr2=0x56111aa322b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:54.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.695+0000 7f78d4c60700 1 --2- 172.21.15.73:0/563160214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56111aa22910 0x56111aa322b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.695+0000 7f78d4c60700 1 -- 172.21.15.73:0/563160214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa21e50 msgr2=0x56111aa2b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:54.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.695+0000 7f78d4c60700 1 --2- 172.21.15.73:0/563160214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa21e50 0x56111aa2b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.695+0000 7f78d4c60700 1 -- 172.21.15.73:0/563160214 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d019ea10 con 0x56111aa214f0 2023-08-10T11:51:54.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.695+0000 7f78cffff700 1 --2- 172.21.15.73:0/563160214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa21e50 0x56111aa2b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:51:54.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.695+0000 7f78d4c60700 1 --2- 172.21.15.73:0/563160214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56111aa214f0 0x56111aa2ad30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f78c4010a40 tx=0x7f78c40047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94eb885812dcd5bc server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:54.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.695+0000 7f78affff700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T11:51:54.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.695+0000 7f78affff700 1 -- 172.21.15.73:0/563160214 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c4027670 con 0x56111aa214f0 2023-08-10T11:51:54.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.695+0000 7f78e305db80 1 -- 172.21.15.73:0/563160214 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56111aa14420 con 0x56111aa214f0 2023-08-10T11:51:54.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.695+0000 7f78affff700 1 -- 172.21.15.73:0/563160214 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f78c4017070 con 0x56111aa214f0 2023-08-10T11:51:54.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.696+0000 7f78affff700 1 -- 172.21.15.73:0/563160214 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78c40277d0 con 0x56111aa214f0 2023-08-10T11:51:54.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.696+0000 7f78e305db80 10 client.24775 fetch_fsmap learned FSMap version 27 2023-08-10T11:51:54.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.696+0000 7f78e305db80 1 -- 172.21.15.73:0/563160214 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56111a79fd90 con 0x56111aa214f0 2023-08-10T11:51:54.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.696+0000 7f78affff700 1 -- 172.21.15.73:0/563160214 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56111aa14420 con 0x56111aa214f0 2023-08-10T11:51:54.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.696+0000 7f78affff700 1 -- 172.21.15.73:0/563160214 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f78c4030070 con 0x56111aa214f0 2023-08-10T11:51:54.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.696+0000 7f78e305db80 10 client.24775 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:51:54.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.696+0000 7f78e305db80 10 client.24775 resolve_mds: resolved name 'e' to daemon mds.e 2023-08-10T11:51:54.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.696+0000 7f78e305db80 20 client.24775 populate_metadata read hostname 'smithi073' 2023-08-10T11:51:54.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.696+0000 7f78e305db80 1 --2- 172.21.15.73:0/563160214 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x56111aa35f80 0x56111aa35380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.696+0000 7f78e305db80 4 client.24775 mds_command: new command op to 24443 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:51:54.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.696+0000 7f78e305db80 1 -- 172.21.15.73:0/563160214 --> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56111a9f0980 con 0x56111aa35f80 2023-08-10T11:51:54.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.696+0000 7f78cffff700 1 --2- 172.21.15.73:0/563160214 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x56111aa35f80 0x56111aa35380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.697+0000 7f78affff700 10 client.24775 ms_handle_connect on v2:172.21.15.152:6834/1791572604 2023-08-10T11:51:54.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.697+0000 7f78cffff700 1 --2- 172.21.15.73:0/563160214 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x56111aa35f80 0x56111aa35380 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a1073ef741534ac3 server_cookie=b9ae4cafdda30687 in_seq=0 out_seq=0 2023-08-10T11:51:54.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.697+0000 7f78affff700 1 -- 172.21.15.73:0/563160214 <== mds.3 v2:172.21.15.152:6834/1791572604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x56111a9f0980 con 0x56111aa35f80 2023-08-10T11:51:54.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.697+0000 7f78affff700 10 client.24775 handle_command_reply: tid=0 2023-08-10T11:51:54.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.697+0000 7f78e305db80 1 client.24775 shutdown 2023-08-10T11:51:54.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.697+0000 7f78e305db80 1 -- 172.21.15.73:0/563160214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56111aa214f0 msgr2=0x56111aa2ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.697+0000 7f78e305db80 1 --2- 172.21.15.73:0/563160214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56111aa214f0 0x56111aa2ad30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f78c4010a40 tx=0x7f78c40047c0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.697+0000 7f78e305db80 1 -- 172.21.15.73:0/563160214 shutdown_connections 2023-08-10T11:51:54.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.697+0000 7f78e305db80 1 --2- 172.21.15.73:0/563160214 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x56111aa35f80 0x56111aa35380 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.698+0000 7f78e305db80 1 --2- 172.21.15.73:0/563160214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56111aa22910 0x56111aa322b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.698+0000 7f78e305db80 1 --2- 172.21.15.73:0/563160214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56111aa214f0 0x56111aa2ad30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.698+0000 7f78affff700 0 client.24775 ms_handle_reset on v2:172.21.15.152:6834/1791572604 2023-08-10T11:51:54.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.698+0000 7f78e305db80 1 --2- 172.21.15.73:0/563160214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa21e50 0x56111aa2b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.698+0000 7f78e305db80 1 -- 172.21.15.73:0/563160214 >> 172.21.15.73:0/563160214 conn(0x56111a97ec80 msgr2=0x56111aa1b960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:54.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.698+0000 7f78e305db80 1 -- 172.21.15.73:0/563160214 shutdown_connections 2023-08-10T11:51:54.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.698+0000 7f78e305db80 1 -- 172.21.15.73:0/563160214 wait complete. 2023-08-10T11:51:54.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.698+0000 7f78e305db80 20 client.24775 trim_cache size 0 max 16384 2023-08-10T11:51:54.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.715+0000 7f78e305db80 1 Processor -- start 2023-08-10T11:51:54.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.715+0000 7f78e305db80 1 -- start start 2023-08-10T11:51:54.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.715+0000 7f78e305db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56111aa214f0 0x56111aa29a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.715+0000 7f78e305db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56111aa21e50 0x56111aa32270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.715+0000 7f78e305db80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa22910 0x56111aa35380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.715+0000 7f78e305db80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56111a7f58d0 con 0x56111aa22910 2023-08-10T11:51:54.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.715+0000 7f78e305db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56111aa296b0 con 0x56111aa21e50 2023-08-10T11:51:54.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.715+0000 7f78e305db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56111aa16cc0 con 0x56111aa214f0 2023-08-10T11:51:54.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.715+0000 7f78d5461700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa22910 0x56111aa35380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.715+0000 7f78d5461700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa22910 0x56111aa35380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59818/0 (socket says 172.21.15.73:59818) 2023-08-10T11:51:54.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.715+0000 7f78d5461700 1 -- 172.21.15.73:0/935622587 learned_addr learned my addr 172.21.15.73:0/935622587 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:54.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.716+0000 7f78cffff700 1 --2- 172.21.15.73:0/935622587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56111aa21e50 0x56111aa32270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.716+0000 7f78d4c60700 1 --2- 172.21.15.73:0/935622587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56111aa214f0 0x56111aa29a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.716+0000 7f78d5461700 1 -- 172.21.15.73:0/935622587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56111aa214f0 msgr2=0x56111aa29a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:54.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.716+0000 7f78d5461700 1 --2- 172.21.15.73:0/935622587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56111aa214f0 0x56111aa29a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.716+0000 7f78d5461700 1 -- 172.21.15.73:0/935622587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56111aa21e50 msgr2=0x56111aa32270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:54.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.716+0000 7f78d5461700 1 --2- 172.21.15.73:0/935622587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56111aa21e50 0x56111aa32270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.716+0000 7f78d5461700 1 -- 172.21.15.73:0/935622587 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56111a788c10 con 0x56111aa22910 2023-08-10T11:51:54.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.716+0000 7f78cffff700 1 --2- 172.21.15.73:0/935622587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56111aa21e50 0x56111aa32270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:51:54.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.716+0000 7f78d5461700 1 --2- 172.21.15.73:0/935622587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa22910 0x56111aa35380 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f78c8007e90 tx=0x7f78c80086d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2eb365954ed623 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:54.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.716+0000 7f78bb7fe700 1 -- 172.21.15.73:0/935622587 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c8014680 con 0x56111aa22910 2023-08-10T11:51:54.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.716+0000 7f78bb7fe700 1 -- 172.21.15.73:0/935622587 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78c800e040 con 0x56111aa22910 2023-08-10T11:51:54.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.716+0000 7f78bb7fe700 1 -- 172.21.15.73:0/935622587 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c8013b60 con 0x56111aa22910 2023-08-10T11:51:54.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.717+0000 7f78e305db80 1 -- 172.21.15.73:0/935622587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa22910 msgr2=0x56111aa35380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.717+0000 7f78e305db80 1 --2- 172.21.15.73:0/935622587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa22910 0x56111aa35380 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f78c8007e90 tx=0x7f78c80086d0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.717+0000 7f78e305db80 1 -- 172.21.15.73:0/935622587 shutdown_connections 2023-08-10T11:51:54.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.717+0000 7f78e305db80 1 --2- 172.21.15.73:0/935622587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa22910 0x56111aa35380 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.717+0000 7f78e305db80 1 --2- 172.21.15.73:0/935622587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56111aa214f0 0x56111aa29a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.717+0000 7f78e305db80 1 --2- 172.21.15.73:0/935622587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56111aa21e50 0x56111aa32270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.717+0000 7f78e305db80 1 -- 172.21.15.73:0/935622587 >> 172.21.15.73:0/935622587 conn(0x56111a97ec80 msgr2=0x56111aa1c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:54.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.717+0000 7f78e305db80 1 -- 172.21.15.73:0/935622587 shutdown_connections 2023-08-10T11:51:54.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.717+0000 7f78e305db80 1 -- 172.21.15.73:0/935622587 wait complete. 2023-08-10T11:51:54.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.717+0000 7f78e305db80 1 -- start start 2023-08-10T11:51:54.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.717+0000 7f78e305db80 1 Processor -- start 2023-08-10T11:51:54.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.717+0000 7f78e305db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56111aa214f0 0x56111aa2ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.717+0000 7f78e305db80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa21e50 0x56111aa2d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.717+0000 7f78e305db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56111aa22910 0x56111aa89c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.717+0000 7f78e305db80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56111aa32420 con 0x56111aa21e50 2023-08-10T11:51:54.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.717+0000 7f78e305db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56111aa32590 con 0x56111aa22910 2023-08-10T11:51:54.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.717+0000 7f78e305db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56111aa32750 con 0x56111aa214f0 2023-08-10T11:51:54.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.717+0000 7f78e305db80 10 client.0 _ll_register_callbacks cb 0x56111a90f630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:51:54.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.717+0000 7f78cffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa21e50 0x56111aa2d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.717+0000 7f78cffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa21e50 0x56111aa2d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59822/0 (socket says 172.21.15.73:59822) 2023-08-10T11:51:54.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.717+0000 7f78cffff700 1 -- 172.21.15.73:0/1700538319 learned_addr learned my addr 172.21.15.73:0/1700538319 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:54.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.718+0000 7f78d4c60700 1 --2- 172.21.15.73:0/1700538319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56111aa214f0 0x56111aa2ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.718+0000 7f78cffff700 1 -- 172.21.15.73:0/1700538319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56111aa214f0 msgr2=0x56111aa2ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:54.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.718+0000 7f78cffff700 1 --2- 172.21.15.73:0/1700538319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56111aa214f0 0x56111aa2ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.718+0000 7f78d5461700 1 --2- 172.21.15.73:0/1700538319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56111aa22910 0x56111aa89c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.718+0000 7f78cffff700 1 -- 172.21.15.73:0/1700538319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56111aa22910 msgr2=0x56111aa89c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:54.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.718+0000 7f78cffff700 1 --2- 172.21.15.73:0/1700538319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56111aa22910 0x56111aa89c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.718+0000 7f78cffff700 1 -- 172.21.15.73:0/1700538319 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c8007ac0 con 0x56111aa21e50 2023-08-10T11:51:54.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.718+0000 7f78cffff700 1 --2- 172.21.15.73:0/1700538319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa21e50 0x56111aa2d3f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f78bc09bc30 tx=0x7f78bc00ade0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f27716550c7aa server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:54.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.718+0000 7f78affff700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:51:54.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.718+0000 7f78affff700 1 -- 172.21.15.73:0/1700538319 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc0a3bd0 con 0x56111aa21e50 2023-08-10T11:51:54.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.718+0000 7f78affff700 1 -- 172.21.15.73:0/1700538319 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f78bc0a3d30 con 0x56111aa21e50 2023-08-10T11:51:54.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.718+0000 7f78e305db80 1 -- 172.21.15.73:0/1700538319 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f78bc09bca0 con 0x56111aa21e50 2023-08-10T11:51:54.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.718+0000 7f78affff700 1 -- 172.21.15.73:0/1700538319 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78bc00e700 con 0x56111aa21e50 2023-08-10T11:51:54.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.718+0000 7f78e305db80 10 client.15057 fetch_fsmap learned FSMap version 27 2023-08-10T11:51:54.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.718+0000 7f78e305db80 1 -- 172.21.15.73:0/1700538319 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56111a7c6200 con 0x56111aa21e50 2023-08-10T11:51:54.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.718+0000 7f78affff700 1 -- 172.21.15.73:0/1700538319 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78bc09bca0 con 0x56111aa21e50 2023-08-10T11:51:54.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.718+0000 7f78affff700 1 -- 172.21.15.73:0/1700538319 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f78bc09ac00 con 0x56111aa21e50 2023-08-10T11:51:54.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.718+0000 7f78e305db80 10 client.15057 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:51:54.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.719+0000 7f78e305db80 10 client.15057 resolve_mds: resolved name 'e' to daemon mds.e 2023-08-10T11:51:54.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.719+0000 7f78e305db80 20 client.15057 populate_metadata read hostname 'smithi073' 2023-08-10T11:51:54.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.719+0000 7f78e305db80 1 --2- 172.21.15.73:0/1700538319 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x56111aa8e910 0x56111aa8b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.719+0000 7f78e305db80 4 client.15057 mds_command: new command op to 24443 tid=0[{"prefix": "status"}] 2023-08-10T11:51:54.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.719+0000 7f78e305db80 1 -- 172.21.15.73:0/1700538319 --> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56111a96b730 con 0x56111aa8e910 2023-08-10T11:51:54.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.719+0000 7f78d4c60700 1 --2- 172.21.15.73:0/1700538319 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x56111aa8e910 0x56111aa8b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.719+0000 7f78affff700 10 client.15057 ms_handle_connect on v2:172.21.15.152:6834/1791572604 2023-08-10T11:51:54.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.719+0000 7f78d4c60700 1 --2- 172.21.15.73:0/1700538319 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x56111aa8e910 0x56111aa8b220 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7532e7a76d436d61 server_cookie=21412009f038c4a7 in_seq=0 out_seq=0 2023-08-10T11:51:54.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.719+0000 7f78affff700 1 -- 172.21.15.73:0/1700538319 <== mds.3 v2:172.21.15.152:6834/1791572604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x56111a96b730 con 0x56111aa8e910 2023-08-10T11:51:54.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.719+0000 7f78affff700 10 client.15057 handle_command_reply: tid=0 2023-08-10T11:51:54.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.719+0000 7f78e305db80 1 client.15057 shutdown 2023-08-10T11:51:54.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.719+0000 7f78e305db80 1 -- 172.21.15.73:0/1700538319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa21e50 msgr2=0x56111aa2d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.719+0000 7f78e305db80 1 --2- 172.21.15.73:0/1700538319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa21e50 0x56111aa2d3f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f78bc09bc30 tx=0x7f78bc00ade0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.720+0000 7f78e305db80 1 -- 172.21.15.73:0/1700538319 shutdown_connections 2023-08-10T11:51:54.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.720+0000 7f78e305db80 1 --2- 172.21.15.73:0/1700538319 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x56111aa8e910 0x56111aa8b220 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.720+0000 7f78e305db80 1 --2- 172.21.15.73:0/1700538319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56111aa22910 0x56111aa89c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.720+0000 7f78affff700 0 client.15057 ms_handle_reset on v2:172.21.15.152:6834/1791572604 2023-08-10T11:51:54.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.720+0000 7f78e305db80 1 --2- 172.21.15.73:0/1700538319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56111aa214f0 0x56111aa2ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.720+0000 7f78e305db80 1 --2- 172.21.15.73:0/1700538319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56111aa21e50 0x56111aa2d3f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.720+0000 7f78e305db80 1 -- 172.21.15.73:0/1700538319 >> 172.21.15.73:0/1700538319 conn(0x56111a97ec80 msgr2=0x56111aa35380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:54.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.720+0000 7f78e305db80 1 -- 172.21.15.73:0/1700538319 shutdown_connections 2023-08-10T11:51:54.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.720+0000 7f78e305db80 1 -- 172.21.15.73:0/1700538319 wait complete. 2023-08-10T11:51:54.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.720+0000 7f78e305db80 20 client.15057 trim_cache size 0 max 16384 2023-08-10T11:51:54.731 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:51:54.731 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "0e619a74-3773-11ee-9b37-001a4aab830c", 2023-08-10T11:51:54.732 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 3, 2023-08-10T11:51:54.732 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 24443, 2023-08-10T11:51:54.732 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2023-08-10T11:51:54.732 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2023-08-10T11:51:54.732 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2023-08-10T11:51:54.732 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 55.216378118000002, 2023-08-10T11:51:54.732 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 27, 2023-08-10T11:51:54.733 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 85, 2023-08-10T11:51:54.733 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 83, 2023-08-10T11:51:54.733 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 80.941048223999999 2023-08-10T11:51:54.733 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:51:54.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.720+0000 7f78d6ec4700 1 -- 172.21.15.73:0/2413555213 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f78c00a11e0 msgr2=0x7f78c00a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.720+0000 7f78d6ec4700 1 --2- 172.21.15.73:0/2413555213 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f78c00a11e0 0x7f78c00a36a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f78d00ffe20 tx=0x7f78c400b410 comp rx=0 tx=0).stop 2023-08-10T11:51:54.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.720+0000 7f78d6ec4700 1 -- 172.21.15.73:0/2413555213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78d00fffc0 msgr2=0x7f78d0196a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.720+0000 7f78d6ec4700 1 --2- 172.21.15.73:0/2413555213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78d00fffc0 0x7f78d0196a60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f78bc00a9f0 tx=0x7f78bc004750 comp rx=0 tx=0).stop 2023-08-10T11:51:54.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.720+0000 7f78d6ec4700 1 -- 172.21.15.73:0/2413555213 shutdown_connections 2023-08-10T11:51:54.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.720+0000 7f78d6ec4700 1 --2- 172.21.15.73:0/2413555213 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f78c00a11e0 0x7f78c00a36a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.720+0000 7f78d6ec4700 1 --2- 172.21.15.73:0/2413555213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78d0100960 0x7f78d019dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.720+0000 7f78d6ec4700 1 --2- 172.21.15.73:0/2413555213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78d00fedd0 0x7f78d0196520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.720+0000 7f78d6ec4700 1 --2- 172.21.15.73:0/2413555213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78d00fffc0 0x7f78d0196a60 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.720+0000 7f78d6ec4700 1 -- 172.21.15.73:0/2413555213 >> 172.21.15.73:0/2413555213 conn(0x7f78d00fa340 msgr2=0x7f78d00fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:54.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.720+0000 7f78d6ec4700 1 -- 172.21.15.73:0/2413555213 shutdown_connections 2023-08-10T11:51:54.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.720+0000 7f78d6ec4700 1 -- 172.21.15.73:0/2413555213 wait complete. 2023-08-10T11:51:54.736 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-08-10T11:51:54.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.857+0000 7f610ae29700 1 -- 172.21.15.73:0/2625476880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61041011f0 msgr2=0x7f6104107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.857+0000 7f610ae29700 1 --2- 172.21.15.73:0/2625476880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61041011f0 0x7f6104107aa0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f60fc00b0d0 tx=0x7f60fc00b3e0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.857+0000 7f610ae29700 1 -- 172.21.15.73:0/2625476880 shutdown_connections 2023-08-10T11:51:54.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.857+0000 7f610ae29700 1 --2- 172.21.15.73:0/2625476880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61041011f0 0x7f6104107aa0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.857+0000 7f610ae29700 1 --2- 172.21.15.73:0/2625476880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61040ff660 0x7f61040ffa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.857+0000 7f610ae29700 1 --2- 172.21.15.73:0/2625476880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6104100850 0x7f6104100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.857+0000 7f610ae29700 1 -- 172.21.15.73:0/2625476880 >> 172.21.15.73:0/2625476880 conn(0x7f61040fabd0 msgr2=0x7f61040fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:54.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.857+0000 7f610ae29700 1 -- 172.21.15.73:0/2625476880 shutdown_connections 2023-08-10T11:51:54.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.857+0000 7f610ae29700 1 -- 172.21.15.73:0/2625476880 wait complete. 2023-08-10T11:51:54.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.858+0000 7f610ae29700 1 Processor -- start 2023-08-10T11:51:54.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.858+0000 7f610ae29700 1 -- start start 2023-08-10T11:51:54.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.858+0000 7f610ae29700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61040ff660 0x7f6104068460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.858+0000 7f610ae29700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6104100850 0x7f610419b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.858+0000 7f610ae29700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61041011f0 0x7f610419d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.858+0000 7f610ae29700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610419e040 con 0x7f61041011f0 2023-08-10T11:51:54.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.858+0000 7f610ae29700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610419e1b0 con 0x7f61040ff660 2023-08-10T11:51:54.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.858+0000 7f610ae29700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610419e370 con 0x7f6104100850 2023-08-10T11:51:54.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.858+0000 7f61093c6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61041011f0 0x7f610419d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.858+0000 7f61093c6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61041011f0 0x7f610419d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59838/0 (socket says 172.21.15.73:59838) 2023-08-10T11:51:54.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.858+0000 7f61093c6700 1 -- 172.21.15.73:0/2827806357 learned_addr learned my addr 172.21.15.73:0/2827806357 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:54.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.858+0000 7f6108bc5700 1 --2- 172.21.15.73:0/2827806357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61040ff660 0x7f6104068460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.858+0000 7f61093c6700 1 -- 172.21.15.73:0/2827806357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6104100850 msgr2=0x7f610419b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.858+0000 7f61093c6700 1 --2- 172.21.15.73:0/2827806357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6104100850 0x7f610419b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.858+0000 7f61093c6700 1 -- 172.21.15.73:0/2827806357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61040ff660 msgr2=0x7f6104068460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.858+0000 7f61093c6700 1 --2- 172.21.15.73:0/2827806357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61040ff660 0x7f6104068460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.858+0000 7f61093c6700 1 -- 172.21.15.73:0/2827806357 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60fc009d00 con 0x7f61041011f0 2023-08-10T11:51:54.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.858+0000 7f6108bc5700 1 --2- 172.21.15.73:0/2827806357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61040ff660 0x7f6104068460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:51:54.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.859+0000 7f61093c6700 1 --2- 172.21.15.73:0/2827806357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61041011f0 0x7f610419d870 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f60fc007a00 tx=0x7f60fc0094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:54.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.859+0000 7f6101ffb700 1 -- 172.21.15.73:0/2827806357 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc00e040 con 0x7f61041011f0 2023-08-10T11:51:54.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.859+0000 7f610ae29700 1 -- 172.21.15.73:0/2827806357 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f610419e5f0 con 0x7f61041011f0 2023-08-10T11:51:54.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.859+0000 7f6101ffb700 1 -- 172.21.15.73:0/2827806357 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f60fc012dc0 con 0x7f61041011f0 2023-08-10T11:51:54.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.859+0000 7f6101ffb700 1 -- 172.21.15.73:0/2827806357 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc01b450 con 0x7f61041011f0 2023-08-10T11:51:54.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.859+0000 7f610ae29700 1 -- 172.21.15.73:0/2827806357 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f610419eac0 con 0x7f61041011f0 2023-08-10T11:51:54.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.861+0000 7f6101ffb700 1 -- 172.21.15.73:0/2827806357 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f60fc01d610 con 0x7f61041011f0 2023-08-10T11:51:54.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.862+0000 7f6101ffb700 1 --2- 172.21.15.73:0/2827806357 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f60f40a11e0 0x7f60f40a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.862+0000 7f6101ffb700 1 -- 172.21.15.73:0/2827806357 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f60fc0ce920 con 0x7f61041011f0 2023-08-10T11:51:54.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.862+0000 7f6108bc5700 1 --2- 172.21.15.73:0/2827806357 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f60f40a11e0 0x7f60f40a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.862+0000 7f6108bc5700 1 --2- 172.21.15.73:0/2827806357 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f60f40a11e0 0x7f60f40a36a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f60f8005950 tx=0x7f60f80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:54.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.863+0000 7f6116fc2b80 1 Processor -- start 2023-08-10T11:51:54.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.863+0000 7f6116fc2b80 1 -- start start 2023-08-10T11:51:54.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.863+0000 7f6116fc2b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fd4f0 0x55a7319fd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.863+0000 7f6116fc2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a7319fde50 0x55a7319fe380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.863+0000 7f6116fc2b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7319fe910 0x55a7319feda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.863+0000 7f6116fc2b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a731978d70 con 0x55a7319fd4f0 2023-08-10T11:51:54.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.863+0000 7f6116fc2b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a731955540 con 0x55a7319fe910 2023-08-10T11:51:54.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.863+0000 7f6116fc2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a731952e60 con 0x55a7319fde50 2023-08-10T11:51:54.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.863+0000 7f6108bc5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fd4f0 0x55a7319fd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.863+0000 7f6108bc5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fd4f0 0x55a7319fd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59842/0 (socket says 172.21.15.73:59842) 2023-08-10T11:51:54.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.863+0000 7f6108bc5700 1 -- 172.21.15.73:0/671997307 learned_addr learned my addr 172.21.15.73:0/671997307 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:54.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.863+0000 7f61093c6700 1 --2- 172.21.15.73:0/671997307 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7319fe910 0x55a7319feda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.863+0000 7f6103fff700 1 --2- 172.21.15.73:0/671997307 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a7319fde50 0x55a7319fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.863+0000 7f6108bc5700 1 -- 172.21.15.73:0/671997307 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a7319fde50 msgr2=0x55a7319fe380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:54.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.863+0000 7f6108bc5700 1 --2- 172.21.15.73:0/671997307 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a7319fde50 0x55a7319fe380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.863+0000 7f6108bc5700 1 -- 172.21.15.73:0/671997307 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7319fe910 msgr2=0x55a7319feda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:54.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.863+0000 7f6108bc5700 1 --2- 172.21.15.73:0/671997307 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7319fe910 0x55a7319feda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.863+0000 7f6108bc5700 1 -- 172.21.15.73:0/671997307 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7317cf5e0 con 0x55a7319fd4f0 2023-08-10T11:51:54.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.863+0000 7f6103fff700 1 --2- 172.21.15.73:0/671997307 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a7319fde50 0x55a7319fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:54.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.863+0000 7f6108bc5700 1 --2- 172.21.15.73:0/671997307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fd4f0 0x55a7319fd910 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f60f800ff00 tx=0x7f60f8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3f1fd6a18c53ee server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:54.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.863+0000 7f60eeffd700 1 -- 172.21.15.73:0/671997307 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f8011bb0 con 0x55a7319fd4f0 2023-08-10T11:51:54.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.864+0000 7f60eeffd700 1 -- 172.21.15.73:0/671997307 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f60f8011d10 con 0x55a7319fd4f0 2023-08-10T11:51:54.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.864+0000 7f60eeffd700 1 -- 172.21.15.73:0/671997307 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f801d610 con 0x55a7319fd4f0 2023-08-10T11:51:54.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.864+0000 7f6116fc2b80 1 -- 172.21.15.73:0/671997307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fd4f0 msgr2=0x55a7319fd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.864+0000 7f6116fc2b80 1 --2- 172.21.15.73:0/671997307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fd4f0 0x55a7319fd910 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f60f800ff00 tx=0x7f60f8012000 comp rx=0 tx=0).stop 2023-08-10T11:51:54.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.864+0000 7f6116fc2b80 1 -- 172.21.15.73:0/671997307 shutdown_connections 2023-08-10T11:51:54.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.864+0000 7f6116fc2b80 1 --2- 172.21.15.73:0/671997307 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7319fe910 0x55a7319feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.864+0000 7f6116fc2b80 1 --2- 172.21.15.73:0/671997307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fd4f0 0x55a7319fd910 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.864+0000 7f6116fc2b80 1 --2- 172.21.15.73:0/671997307 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a7319fde50 0x55a7319fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.864+0000 7f6116fc2b80 1 -- 172.21.15.73:0/671997307 >> 172.21.15.73:0/671997307 conn(0x55a73195ac80 msgr2=0x55a7319f8280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:54.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.864+0000 7f6116fc2b80 1 -- 172.21.15.73:0/671997307 shutdown_connections 2023-08-10T11:51:54.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.864+0000 7f6116fc2b80 1 -- 172.21.15.73:0/671997307 wait complete. 2023-08-10T11:51:54.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.865+0000 7f6116fc2b80 1 -- start start 2023-08-10T11:51:54.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.865+0000 7f6116fc2b80 1 Processor -- start 2023-08-10T11:51:54.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.865+0000 7f6116fc2b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fd4f0 0x55a731a06f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.865+0000 7f6116fc2b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7319fde50 0x55a731a074d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.865+0000 7f6116fc2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a7319fe910 0x55a731a0e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.865+0000 7f6116fc2b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a73194e750 con 0x55a7319fd4f0 2023-08-10T11:51:54.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.865+0000 7f6116fc2b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7318eda70 con 0x55a7319fde50 2023-08-10T11:51:54.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.865+0000 7f6116fc2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7318ed770 con 0x55a7319fe910 2023-08-10T11:51:54.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.865+0000 7f6116fc2b80 10 client.0 _ll_register_callbacks cb 0x55a7318eb630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:51:54.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.865+0000 7f6108bc5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fd4f0 0x55a731a06f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.865+0000 7f6108bc5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fd4f0 0x55a731a06f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59848/0 (socket says 172.21.15.73:59848) 2023-08-10T11:51:54.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.865+0000 7f6108bc5700 1 -- 172.21.15.73:0/2343882094 learned_addr learned my addr 172.21.15.73:0/2343882094 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:54.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.865+0000 7f6103fff700 1 --2- 172.21.15.73:0/2343882094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7319fde50 0x55a731a074d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.865+0000 7f61093c6700 1 --2- 172.21.15.73:0/2343882094 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a7319fe910 0x55a731a0e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.865+0000 7f6108bc5700 1 -- 172.21.15.73:0/2343882094 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a7319fe910 msgr2=0x55a731a0e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:54.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.865+0000 7f6108bc5700 1 --2- 172.21.15.73:0/2343882094 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a7319fe910 0x55a731a0e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.865+0000 7f6108bc5700 1 -- 172.21.15.73:0/2343882094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7319fde50 msgr2=0x55a731a074d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:54.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.865+0000 7f6108bc5700 1 --2- 172.21.15.73:0/2343882094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7319fde50 0x55a731a074d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.865+0000 7f6108bc5700 1 -- 172.21.15.73:0/2343882094 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f800fbb0 con 0x55a7319fd4f0 2023-08-10T11:51:54.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.865+0000 7f61093c6700 1 --2- 172.21.15.73:0/2343882094 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a7319fe910 0x55a731a0e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:54.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.866+0000 7f6108bc5700 1 --2- 172.21.15.73:0/2343882094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fd4f0 0x55a731a06f90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f60f801e680 tx=0x7f60f801e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9079e5a523c2306f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:54.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.866+0000 7f60e3fff700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:51:54.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.866+0000 7f60e3fff700 1 -- 172.21.15.73:0/2343882094 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f802d070 con 0x55a7319fd4f0 2023-08-10T11:51:54.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.866+0000 7f60e3fff700 1 -- 172.21.15.73:0/2343882094 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f60f800bdd0 con 0x55a7319fd4f0 2023-08-10T11:51:54.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.866+0000 7f6116fc2b80 1 -- 172.21.15.73:0/2343882094 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a7319f0420 con 0x55a7319fd4f0 2023-08-10T11:51:54.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.866+0000 7f60e3fff700 1 -- 172.21.15.73:0/2343882094 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60f8011bb0 con 0x55a7319fd4f0 2023-08-10T11:51:54.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.866+0000 7f6116fc2b80 10 client.15069 fetch_fsmap learned FSMap version 27 2023-08-10T11:51:54.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.866+0000 7f6116fc2b80 1 -- 172.21.15.73:0/2343882094 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a73177bd90 con 0x55a7319fd4f0 2023-08-10T11:51:54.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.866+0000 7f60e3fff700 1 -- 172.21.15.73:0/2343882094 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a7319f0420 con 0x55a7319fd4f0 2023-08-10T11:51:54.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.866+0000 7f60e3fff700 1 -- 172.21.15.73:0/2343882094 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f60f8003aa0 con 0x55a7319fd4f0 2023-08-10T11:51:54.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.866+0000 7f6116fc2b80 10 client.15069 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:51:54.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.866+0000 7f6116fc2b80 10 client.15069 resolve_mds: resolved name 'f' to daemon mds.f 2023-08-10T11:51:54.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.866+0000 7f6116fc2b80 20 client.15069 populate_metadata read hostname 'smithi073' 2023-08-10T11:51:54.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.866+0000 7f6116fc2b80 1 --2- 172.21.15.73:0/2343882094 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55a731a12170 0x55a731a11520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.866+0000 7f6116fc2b80 4 client.15069 mds_command: new command op to 24451 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:51:54.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.866+0000 7f6116fc2b80 1 -- 172.21.15.73:0/2343882094 --> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a7319cc980 con 0x55a731a12170 2023-08-10T11:51:54.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.867+0000 7f6103fff700 1 --2- 172.21.15.73:0/2343882094 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55a731a12170 0x55a731a11520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.867+0000 7f60e3fff700 10 client.15069 ms_handle_connect on v2:172.21.15.156:6834/904126790 2023-08-10T11:51:54.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.867+0000 7f6103fff700 1 --2- 172.21.15.73:0/2343882094 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55a731a12170 0x55a731a11520 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ef3e6b2218e1255e server_cookie=63e11fcb925a0205 in_seq=0 out_seq=0 2023-08-10T11:51:54.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.868+0000 7f60e3fff700 1 -- 172.21.15.73:0/2343882094 <== mds.2 v2:172.21.15.156:6834/904126790 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55a7319cc980 con 0x55a731a12170 2023-08-10T11:51:54.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.868+0000 7f60e3fff700 10 client.15069 handle_command_reply: tid=0 2023-08-10T11:51:54.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.868+0000 7f6116fc2b80 1 client.15069 shutdown 2023-08-10T11:51:54.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.868+0000 7f6116fc2b80 1 -- 172.21.15.73:0/2343882094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fd4f0 msgr2=0x55a731a06f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.868+0000 7f6116fc2b80 1 --2- 172.21.15.73:0/2343882094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fd4f0 0x55a731a06f90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f60f801e680 tx=0x7f60f801e6b0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.868+0000 7f6116fc2b80 1 -- 172.21.15.73:0/2343882094 shutdown_connections 2023-08-10T11:51:54.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.868+0000 7f6116fc2b80 1 --2- 172.21.15.73:0/2343882094 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55a731a12170 0x55a731a11520 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.868+0000 7f6116fc2b80 1 --2- 172.21.15.73:0/2343882094 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a7319fe910 0x55a731a0e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.868+0000 7f60e3fff700 0 client.15069 ms_handle_reset on v2:172.21.15.156:6834/904126790 2023-08-10T11:51:54.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.868+0000 7f6116fc2b80 1 --2- 172.21.15.73:0/2343882094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fd4f0 0x55a731a06f90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.868+0000 7f6116fc2b80 1 --2- 172.21.15.73:0/2343882094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7319fde50 0x55a731a074d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.868+0000 7f6116fc2b80 1 -- 172.21.15.73:0/2343882094 >> 172.21.15.73:0/2343882094 conn(0x55a73195ac80 msgr2=0x55a7319f7960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:54.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.868+0000 7f6116fc2b80 1 -- 172.21.15.73:0/2343882094 shutdown_connections 2023-08-10T11:51:54.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.868+0000 7f6116fc2b80 1 -- 172.21.15.73:0/2343882094 wait complete. 2023-08-10T11:51:54.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.868+0000 7f6116fc2b80 20 client.15069 trim_cache size 0 max 16384 2023-08-10T11:51:54.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.885+0000 7f6116fc2b80 1 Processor -- start 2023-08-10T11:51:54.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.885+0000 7f6116fc2b80 1 -- start start 2023-08-10T11:51:54.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.886+0000 7f6116fc2b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7319fd4f0 0x55a731a017c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.886+0000 7f6116fc2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a7319fde50 0x55a731a0e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.886+0000 7f6116fc2b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fe910 0x55a731a01d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.886+0000 7f6116fc2b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7317d18d0 con 0x55a7319fe910 2023-08-10T11:51:54.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.886+0000 7f6116fc2b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7319cc980 con 0x55a7319fd4f0 2023-08-10T11:51:54.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.886+0000 7f6116fc2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a73191c790 con 0x55a7319fde50 2023-08-10T11:51:54.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.886+0000 7f61093c6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fe910 0x55a731a01d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.886+0000 7f61093c6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fe910 0x55a731a01d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59860/0 (socket says 172.21.15.73:59860) 2023-08-10T11:51:54.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.886+0000 7f61093c6700 1 -- 172.21.15.73:0/3199663289 learned_addr learned my addr 172.21.15.73:0/3199663289 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:54.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.886+0000 7f6103fff700 1 --2- 172.21.15.73:0/3199663289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a7319fde50 0x55a731a0e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.886+0000 7f6108bc5700 1 --2- 172.21.15.73:0/3199663289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7319fd4f0 0x55a731a017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.886+0000 7f61093c6700 1 -- 172.21.15.73:0/3199663289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a7319fde50 msgr2=0x55a731a0e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:54.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.886+0000 7f61093c6700 1 --2- 172.21.15.73:0/3199663289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a7319fde50 0x55a731a0e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.886+0000 7f61093c6700 1 -- 172.21.15.73:0/3199663289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7319fd4f0 msgr2=0x55a731a017c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:54.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.886+0000 7f61093c6700 1 --2- 172.21.15.73:0/3199663289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7319fd4f0 0x55a731a017c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.886+0000 7f61093c6700 1 -- 172.21.15.73:0/3199663289 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a731764c10 con 0x55a7319fe910 2023-08-10T11:51:54.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.886+0000 7f61093c6700 1 --2- 172.21.15.73:0/3199663289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fe910 0x55a731a01d00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f60fc0cc2b0 tx=0x7f60fc0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4716a4fea2fb3c95 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:54.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.886+0000 7f60ef7fe700 1 -- 172.21.15.73:0/3199663289 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc09fea0 con 0x55a7319fe910 2023-08-10T11:51:54.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.886+0000 7f60ef7fe700 1 -- 172.21.15.73:0/3199663289 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f60fc09bc10 con 0x55a7319fe910 2023-08-10T11:51:54.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.886+0000 7f60ef7fe700 1 -- 172.21.15.73:0/3199663289 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc0b4380 con 0x55a7319fe910 2023-08-10T11:51:54.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.887+0000 7f6116fc2b80 1 -- 172.21.15.73:0/3199663289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fe910 msgr2=0x55a731a01d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.887+0000 7f6116fc2b80 1 --2- 172.21.15.73:0/3199663289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fe910 0x55a731a01d00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f60fc0cc2b0 tx=0x7f60fc0099e0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.887+0000 7f6116fc2b80 1 -- 172.21.15.73:0/3199663289 shutdown_connections 2023-08-10T11:51:54.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.887+0000 7f6116fc2b80 1 --2- 172.21.15.73:0/3199663289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7319fd4f0 0x55a731a017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.887+0000 7f6116fc2b80 1 --2- 172.21.15.73:0/3199663289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fe910 0x55a731a01d00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.887+0000 7f6116fc2b80 1 --2- 172.21.15.73:0/3199663289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a7319fde50 0x55a731a0e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.887+0000 7f6116fc2b80 1 -- 172.21.15.73:0/3199663289 >> 172.21.15.73:0/3199663289 conn(0x55a73195ac80 msgr2=0x55a731a11520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:54.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.887+0000 7f6116fc2b80 1 -- 172.21.15.73:0/3199663289 shutdown_connections 2023-08-10T11:51:54.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.887+0000 7f6116fc2b80 1 -- 172.21.15.73:0/3199663289 wait complete. 2023-08-10T11:51:54.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.887+0000 7f6116fc2b80 1 -- start start 2023-08-10T11:51:54.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.887+0000 7f6116fc2b80 1 Processor -- start 2023-08-10T11:51:54.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.888+0000 7f6116fc2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a7319fd4f0 0x55a731a09380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.888+0000 7f6116fc2b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7319fde50 0x55a731a098c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.888+0000 7f6116fc2b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fe910 0x55a731a65db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.888+0000 7f6116fc2b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a731a09fa0 con 0x55a7319fe910 2023-08-10T11:51:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.888+0000 7f6116fc2b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a731a662f0 con 0x55a7319fde50 2023-08-10T11:51:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.888+0000 7f6116fc2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a731a66430 con 0x55a7319fd4f0 2023-08-10T11:51:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.888+0000 7f6116fc2b80 10 client.0 _ll_register_callbacks cb 0x55a7318eb630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:51:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.888+0000 7f61093c6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fe910 0x55a731a65db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.888+0000 7f61093c6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fe910 0x55a731a65db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59866/0 (socket says 172.21.15.73:59866) 2023-08-10T11:51:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.888+0000 7f61093c6700 1 -- 172.21.15.73:0/1861509226 learned_addr learned my addr 172.21.15.73:0/1861509226 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.888+0000 7f6103fff700 1 --2- 172.21.15.73:0/1861509226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7319fde50 0x55a731a098c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.888+0000 7f6108bc5700 1 --2- 172.21.15.73:0/1861509226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a7319fd4f0 0x55a731a09380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.888+0000 7f61093c6700 1 -- 172.21.15.73:0/1861509226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a7319fd4f0 msgr2=0x55a731a09380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.888+0000 7f61093c6700 1 --2- 172.21.15.73:0/1861509226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a7319fd4f0 0x55a731a09380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.888+0000 7f61093c6700 1 -- 172.21.15.73:0/1861509226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7319fde50 msgr2=0x55a731a098c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:54.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.888+0000 7f61093c6700 1 --2- 172.21.15.73:0/1861509226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7319fde50 0x55a731a098c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.888+0000 7f61093c6700 1 -- 172.21.15.73:0/1861509226 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f610419eac0 con 0x55a7319fe910 2023-08-10T11:51:54.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.888+0000 7f61093c6700 1 --2- 172.21.15.73:0/1861509226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fe910 0x55a731a65db0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f60fc01f000 tx=0x7f60fc01da10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc71806dcdbea97 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:54.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.888+0000 7f60e3fff700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:51:54.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.888+0000 7f60e3fff700 1 -- 172.21.15.73:0/1861509226 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc09fea0 con 0x55a7319fe910 2023-08-10T11:51:54.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.888+0000 7f60e3fff700 1 -- 172.21.15.73:0/1861509226 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f60fc0a3fd0 con 0x55a7319fe910 2023-08-10T11:51:54.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.888+0000 7f6116fc2b80 1 -- 172.21.15.73:0/1861509226 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f60f8011d10 con 0x55a7319fe910 2023-08-10T11:51:54.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.888+0000 7f60e3fff700 1 -- 172.21.15.73:0/1861509226 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60fc09fc40 con 0x55a7319fe910 2023-08-10T11:51:54.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.888+0000 7f6116fc2b80 10 client.15075 fetch_fsmap learned FSMap version 27 2023-08-10T11:51:54.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.888+0000 7f6116fc2b80 1 -- 172.21.15.73:0/1861509226 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a7317a2200 con 0x55a7319fe910 2023-08-10T11:51:54.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.888+0000 7f60e3fff700 1 -- 172.21.15.73:0/1861509226 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f60fc07e020 con 0x55a7319fe910 2023-08-10T11:51:54.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.889+0000 7f60e3fff700 1 -- 172.21.15.73:0/1861509226 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f60fc07ab30 con 0x55a7319fe910 2023-08-10T11:51:54.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.889+0000 7f6116fc2b80 10 client.15075 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:51:54.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.889+0000 7f6116fc2b80 10 client.15075 resolve_mds: resolved name 'f' to daemon mds.f 2023-08-10T11:51:54.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.889+0000 7f6116fc2b80 20 client.15075 populate_metadata read hostname 'smithi073' 2023-08-10T11:51:54.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.889+0000 7f6116fc2b80 1 --2- 172.21.15.73:0/1861509226 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55a731a12170 0x55a731a677a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:54.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.889+0000 7f6116fc2b80 4 client.15075 mds_command: new command op to 24451 tid=0[{"prefix": "status"}] 2023-08-10T11:51:54.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.889+0000 7f6116fc2b80 1 -- 172.21.15.73:0/1861509226 --> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a731947730 con 0x55a731a12170 2023-08-10T11:51:54.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.889+0000 7f6108bc5700 1 --2- 172.21.15.73:0/1861509226 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55a731a12170 0x55a731a677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:54.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.889+0000 7f60e3fff700 10 client.15075 ms_handle_connect on v2:172.21.15.156:6834/904126790 2023-08-10T11:51:54.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.889+0000 7f6108bc5700 1 --2- 172.21.15.73:0/1861509226 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55a731a12170 0x55a731a677a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=13f0d63a016197 server_cookie=32ec8832c2122f47 in_seq=0 out_seq=0 2023-08-10T11:51:54.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.889+0000 7f60e3fff700 1 -- 172.21.15.73:0/1861509226 <== mds.2 v2:172.21.15.156:6834/904126790 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55a731947730 con 0x55a731a12170 2023-08-10T11:51:54.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.889+0000 7f60e3fff700 10 client.15075 handle_command_reply: tid=0 2023-08-10T11:51:54.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.889+0000 7f6116fc2b80 1 client.15075 shutdown 2023-08-10T11:51:54.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.890+0000 7f6116fc2b80 1 -- 172.21.15.73:0/1861509226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fe910 msgr2=0x55a731a65db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.890+0000 7f6116fc2b80 1 --2- 172.21.15.73:0/1861509226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fe910 0x55a731a65db0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f60fc01f000 tx=0x7f60fc01da10 comp rx=0 tx=0).stop 2023-08-10T11:51:54.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.890+0000 7f6116fc2b80 1 -- 172.21.15.73:0/1861509226 shutdown_connections 2023-08-10T11:51:54.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.890+0000 7f6116fc2b80 1 --2- 172.21.15.73:0/1861509226 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55a731a12170 0x55a731a677a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.890+0000 7f6116fc2b80 1 --2- 172.21.15.73:0/1861509226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7319fe910 0x55a731a65db0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.890+0000 7f6116fc2b80 1 --2- 172.21.15.73:0/1861509226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a7319fd4f0 0x55a731a09380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.890+0000 7f60e3fff700 0 client.15075 ms_handle_reset on v2:172.21.15.156:6834/904126790 2023-08-10T11:51:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.890+0000 7f6116fc2b80 1 --2- 172.21.15.73:0/1861509226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a7319fde50 0x55a731a098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.890+0000 7f6116fc2b80 1 -- 172.21.15.73:0/1861509226 >> 172.21.15.73:0/1861509226 conn(0x55a73195ac80 msgr2=0x55a731a11520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.890+0000 7f6116fc2b80 1 -- 172.21.15.73:0/1861509226 shutdown_connections 2023-08-10T11:51:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.890+0000 7f6116fc2b80 1 -- 172.21.15.73:0/1861509226 wait complete. 2023-08-10T11:51:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.890+0000 7f6116fc2b80 20 client.15075 trim_cache size 0 max 16384 2023-08-10T11:51:54.927 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:51:54.927 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "0e619a74-3773-11ee-9b37-001a4aab830c", 2023-08-10T11:51:54.927 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 2, 2023-08-10T11:51:54.927 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 24451, 2023-08-10T11:51:54.927 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2023-08-10T11:51:54.928 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2023-08-10T11:51:54.928 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2023-08-10T11:51:54.928 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 56.392172717999998, 2023-08-10T11:51:54.928 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 27, 2023-08-10T11:51:54.928 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 85, 2023-08-10T11:51:54.928 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 83, 2023-08-10T11:51:54.929 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 78.673681690999999 2023-08-10T11:51:54.929 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:51:54.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.890+0000 7f610ae29700 1 -- 172.21.15.73:0/2827806357 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f60f40a11e0 msgr2=0x7f60f40a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.890+0000 7f610ae29700 1 --2- 172.21.15.73:0/2827806357 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f60f40a11e0 0x7f60f40a36a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f60f8005950 tx=0x7f60f80058e0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.890+0000 7f610ae29700 1 -- 172.21.15.73:0/2827806357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61041011f0 msgr2=0x7f610419d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:54.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.890+0000 7f610ae29700 1 --2- 172.21.15.73:0/2827806357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61041011f0 0x7f610419d870 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f60fc007a00 tx=0x7f60fc0094f0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.890+0000 7f610ae29700 1 -- 172.21.15.73:0/2827806357 shutdown_connections 2023-08-10T11:51:54.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.890+0000 7f610ae29700 1 --2- 172.21.15.73:0/2827806357 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f60f40a11e0 0x7f60f40a36a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.890+0000 7f610ae29700 1 --2- 172.21.15.73:0/2827806357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61040ff660 0x7f6104068460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.890+0000 7f610ae29700 1 --2- 172.21.15.73:0/2827806357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61041011f0 0x7f610419d870 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.890+0000 7f610ae29700 1 --2- 172.21.15.73:0/2827806357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6104100850 0x7f610419b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:54.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.890+0000 7f610ae29700 1 -- 172.21.15.73:0/2827806357 >> 172.21.15.73:0/2827806357 conn(0x7f61040fabd0 msgr2=0x7f61040fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:54.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.890+0000 7f610ae29700 1 -- 172.21.15.73:0/2827806357 shutdown_connections 2023-08-10T11:51:54.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:54.890+0000 7f610ae29700 1 -- 172.21.15.73:0/2827806357 wait complete. 2023-08-10T11:51:54.934 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-08-10T11:51:54.957 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:54 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2657485659' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:51:54.957 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:54 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2286913435' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:51:54.958 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:54 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1282949633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:51:54.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:54 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/2657485659' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:51:54.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:54 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/2286913435' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:51:54.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:54 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1282949633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:51:55.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:54 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/2657485659' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:51:55.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:54 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/2286913435' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:51:55.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:54 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1282949633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:51:55.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.056+0000 7fce6a245700 1 -- 172.21.15.73:0/821288854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce641008c0 msgr2=0x7fce64100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:55.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.056+0000 7fce6a245700 1 --2- 172.21.15.73:0/821288854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce641008c0 0x7fce64100d20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fce540099c0 tx=0x7fce54009cd0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.056+0000 7fce6a245700 1 -- 172.21.15.73:0/821288854 shutdown_connections 2023-08-10T11:51:55.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.056+0000 7fce6a245700 1 --2- 172.21.15.73:0/821288854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce64101260 0x7fce64107b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.056+0000 7fce6a245700 1 --2- 172.21.15.73:0/821288854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce640ff6d0 0x7fce640ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.056+0000 7fce6a245700 1 --2- 172.21.15.73:0/821288854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce641008c0 0x7fce64100d20 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.056+0000 7fce6a245700 1 -- 172.21.15.73:0/821288854 >> 172.21.15.73:0/821288854 conn(0x7fce640fac40 msgr2=0x7fce640fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:55.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.056+0000 7fce6a245700 1 -- 172.21.15.73:0/821288854 shutdown_connections 2023-08-10T11:51:55.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.056+0000 7fce6a245700 1 -- 172.21.15.73:0/821288854 wait complete. 2023-08-10T11:51:55.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.056+0000 7fce6a245700 1 Processor -- start 2023-08-10T11:51:55.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.057+0000 7fce6a245700 1 -- start start 2023-08-10T11:51:55.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.057+0000 7fce6a245700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce640ff6d0 0x7fce641964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.057+0000 7fce6a245700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce641008c0 0x7fce641969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.057+0000 7fce6a245700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce64101260 0x7fce6419da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.057+0000 7fce6a245700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6419e020 con 0x7fce641008c0 2023-08-10T11:51:55.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.057+0000 7fce6a245700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6419e160 con 0x7fce64101260 2023-08-10T11:51:55.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.057+0000 7fce6a245700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6419e2f0 con 0x7fce640ff6d0 2023-08-10T11:51:55.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.057+0000 7fce62ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce641008c0 0x7fce641969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.057+0000 7fce62ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce641008c0 0x7fce641969e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59878/0 (socket says 172.21.15.73:59878) 2023-08-10T11:51:55.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.057+0000 7fce62ffd700 1 -- 172.21.15.73:0/829474755 learned_addr learned my addr 172.21.15.73:0/829474755 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:55.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.057+0000 7fce637fe700 1 --2- 172.21.15.73:0/829474755 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce640ff6d0 0x7fce641964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.057+0000 7fce63fff700 1 --2- 172.21.15.73:0/829474755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce64101260 0x7fce6419da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.057+0000 7fce62ffd700 1 -- 172.21.15.73:0/829474755 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce640ff6d0 msgr2=0x7fce641964a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:55.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.057+0000 7fce62ffd700 1 --2- 172.21.15.73:0/829474755 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce640ff6d0 0x7fce641964a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.057+0000 7fce62ffd700 1 -- 172.21.15.73:0/829474755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce64101260 msgr2=0x7fce6419da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:55.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.057+0000 7fce62ffd700 1 --2- 172.21.15.73:0/829474755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce64101260 0x7fce6419da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.057+0000 7fce62ffd700 1 -- 172.21.15.73:0/829474755 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce540095f0 con 0x7fce641008c0 2023-08-10T11:51:55.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.057+0000 7fce63fff700 1 --2- 172.21.15.73:0/829474755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce64101260 0x7fce6419da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:51:55.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.057+0000 7fce62ffd700 1 --2- 172.21.15.73:0/829474755 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce641008c0 0x7fce641969e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fce54009990 tx=0x7fce5400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:55.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.057+0000 7fce60ff9700 1 -- 172.21.15.73:0/829474755 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5401d070 con 0x7fce641008c0 2023-08-10T11:51:55.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.057+0000 7fce60ff9700 1 -- 172.21.15.73:0/829474755 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fce540054f0 con 0x7fce641008c0 2023-08-10T11:51:55.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.057+0000 7fce6a245700 1 -- 172.21.15.73:0/829474755 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce6419e570 con 0x7fce641008c0 2023-08-10T11:51:55.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.057+0000 7fce60ff9700 1 -- 172.21.15.73:0/829474755 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce54004bd0 con 0x7fce641008c0 2023-08-10T11:51:55.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.057+0000 7fce6a245700 1 -- 172.21.15.73:0/829474755 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce6419e990 con 0x7fce641008c0 2023-08-10T11:51:55.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.060+0000 7fce60ff9700 1 -- 172.21.15.73:0/829474755 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fce5400fb80 con 0x7fce641008c0 2023-08-10T11:51:55.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.060+0000 7fce60ff9700 1 --2- 172.21.15.73:0/829474755 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fce500a11e0 0x7fce500a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.060+0000 7fce637fe700 1 --2- 172.21.15.73:0/829474755 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fce500a11e0 0x7fce500a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.060+0000 7fce60ff9700 1 -- 172.21.15.73:0/829474755 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fce540cd920 con 0x7fce641008c0 2023-08-10T11:51:55.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.061+0000 7fce637fe700 1 --2- 172.21.15.73:0/829474755 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fce500a11e0 0x7fce500a36a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fce64100720 tx=0x7fce4c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:55.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.061+0000 7fce763deb80 1 Processor -- start 2023-08-10T11:51:55.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.061+0000 7fce763deb80 1 -- start start 2023-08-10T11:51:55.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.061+0000 7fce763deb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558670dbd4f0 0x558670dbd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.061+0000 7fce763deb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbde50 0x558670dbe380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.061+0000 7fce763deb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558670dbe910 0x558670dbeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.061+0000 7fce763deb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558670d38d70 con 0x558670dbde50 2023-08-10T11:51:55.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.061+0000 7fce763deb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x558670d15540 con 0x558670dbd4f0 2023-08-10T11:51:55.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.061+0000 7fce763deb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558670d12e60 con 0x558670dbe910 2023-08-10T11:51:55.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.061+0000 7fce62ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbde50 0x558670dbe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.061+0000 7fce62ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbde50 0x558670dbe380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59886/0 (socket says 172.21.15.73:59886) 2023-08-10T11:51:55.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.061+0000 7fce62ffd700 1 -- 172.21.15.73:0/1719013494 learned_addr learned my addr 172.21.15.73:0/1719013494 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:55.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.061+0000 7fce637fe700 1 --2- 172.21.15.73:0/1719013494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558670dbd4f0 0x558670dbd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.061+0000 7fce63fff700 1 --2- 172.21.15.73:0/1719013494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558670dbe910 0x558670dbeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.061+0000 7fce62ffd700 1 -- 172.21.15.73:0/1719013494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558670dbe910 msgr2=0x558670dbeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:55.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.061+0000 7fce62ffd700 1 --2- 172.21.15.73:0/1719013494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558670dbe910 0x558670dbeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.061+0000 7fce62ffd700 1 -- 172.21.15.73:0/1719013494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558670dbd4f0 msgr2=0x558670dbd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:55.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.061+0000 7fce62ffd700 1 --2- 172.21.15.73:0/1719013494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558670dbd4f0 0x558670dbd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.062+0000 7fce62ffd700 1 -- 172.21.15.73:0/1719013494 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558670b8f5e0 con 0x558670dbde50 2023-08-10T11:51:55.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.062+0000 7fce62ffd700 1 --2- 172.21.15.73:0/1719013494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbde50 0x558670dbe380 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fce5409a970 tx=0x7fce54005660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25da863bc3dbe9d3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:55.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.062+0000 7fce59ffb700 1 -- 172.21.15.73:0/1719013494 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5409e070 con 0x558670dbde50 2023-08-10T11:51:55.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.062+0000 7fce59ffb700 1 -- 172.21.15.73:0/1719013494 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fce5409eca0 con 0x558670dbde50 2023-08-10T11:51:55.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.062+0000 7fce59ffb700 1 -- 172.21.15.73:0/1719013494 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce540a2e00 con 0x558670dbde50 2023-08-10T11:51:55.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.062+0000 7fce763deb80 1 -- 172.21.15.73:0/1719013494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbde50 msgr2=0x558670dbe380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:55.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.062+0000 7fce763deb80 1 --2- 172.21.15.73:0/1719013494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbde50 0x558670dbe380 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fce5409a970 tx=0x7fce54005660 comp rx=0 tx=0).stop 2023-08-10T11:51:55.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.062+0000 7fce763deb80 1 -- 172.21.15.73:0/1719013494 shutdown_connections 2023-08-10T11:51:55.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.062+0000 7fce763deb80 1 --2- 172.21.15.73:0/1719013494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558670dbd4f0 0x558670dbd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.062+0000 7fce763deb80 1 --2- 172.21.15.73:0/1719013494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558670dbe910 0x558670dbeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.062+0000 7fce763deb80 1 --2- 172.21.15.73:0/1719013494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbde50 0x558670dbe380 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.062+0000 7fce763deb80 1 -- 172.21.15.73:0/1719013494 >> 172.21.15.73:0/1719013494 conn(0x558670d1ac80 msgr2=0x558670db8280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:55.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.062+0000 7fce763deb80 1 -- 172.21.15.73:0/1719013494 shutdown_connections 2023-08-10T11:51:55.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.063+0000 7fce763deb80 1 -- 172.21.15.73:0/1719013494 wait complete. 2023-08-10T11:51:55.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.063+0000 7fce763deb80 1 -- start start 2023-08-10T11:51:55.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.063+0000 7fce763deb80 1 Processor -- start 2023-08-10T11:51:55.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.063+0000 7fce763deb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558670dbd4f0 0x558670dcb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.063+0000 7fce763deb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558670dbde50 0x558670dcb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.063+0000 7fce763deb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbe910 0x558670dd25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.063+0000 7fce763deb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558670d0e750 con 0x558670dbe910 2023-08-10T11:51:55.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.063+0000 7fce763deb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x558670cada70 con 0x558670dbde50 2023-08-10T11:51:55.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.063+0000 7fce763deb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558670cad770 con 0x558670dbd4f0 2023-08-10T11:51:55.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.063+0000 7fce763deb80 10 client.0 _ll_register_callbacks cb 0x558670cab630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:51:55.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.063+0000 7fce63fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbe910 0x558670dd25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.063+0000 7fce63fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbe910 0x558670dd25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59894/0 (socket says 172.21.15.73:59894) 2023-08-10T11:51:55.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.063+0000 7fce63fff700 1 -- 172.21.15.73:0/3178853846 learned_addr learned my addr 172.21.15.73:0/3178853846 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:55.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.064+0000 7fce62ffd700 1 --2- 172.21.15.73:0/3178853846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558670dbde50 0x558670dcb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.064+0000 7fce637fe700 1 --2- 172.21.15.73:0/3178853846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558670dbd4f0 0x558670dcb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.064+0000 7fce63fff700 1 -- 172.21.15.73:0/3178853846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558670dbd4f0 msgr2=0x558670dcb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:55.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.064+0000 7fce63fff700 1 --2- 172.21.15.73:0/3178853846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558670dbd4f0 0x558670dcb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.064+0000 7fce63fff700 1 -- 172.21.15.73:0/3178853846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558670dbde50 msgr2=0x558670dcb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:55.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.064+0000 7fce63fff700 1 --2- 172.21.15.73:0/3178853846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558670dbde50 0x558670dcb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.064+0000 7fce63fff700 1 -- 172.21.15.73:0/3178853846 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce6419e990 con 0x558670dbe910 2023-08-10T11:51:55.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.064+0000 7fce63fff700 1 --2- 172.21.15.73:0/3178853846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbe910 0x558670dd25e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fce5c007870 tx=0x7fce5c007b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4840d0a20d80858a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:55.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.064+0000 7fce42ffd700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:51:55.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.064+0000 7fce42ffd700 1 -- 172.21.15.73:0/3178853846 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c015610 con 0x558670dbe910 2023-08-10T11:51:55.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.064+0000 7fce42ffd700 1 -- 172.21.15.73:0/3178853846 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fce5c015770 con 0x558670dbe910 2023-08-10T11:51:55.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.064+0000 7fce763deb80 1 -- 172.21.15.73:0/3178853846 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558670db0420 con 0x558670dbe910 2023-08-10T11:51:55.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.064+0000 7fce42ffd700 1 -- 172.21.15.73:0/3178853846 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce5c015930 con 0x558670dbe910 2023-08-10T11:51:55.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.064+0000 7fce763deb80 10 client.15087 fetch_fsmap learned FSMap version 27 2023-08-10T11:51:55.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.064+0000 7fce763deb80 1 -- 172.21.15.73:0/3178853846 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x558670b3bd90 con 0x558670dbe910 2023-08-10T11:51:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.064+0000 7fce42ffd700 1 -- 172.21.15.73:0/3178853846 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558670db0420 con 0x558670dbe910 2023-08-10T11:51:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.064+0000 7fce42ffd700 1 -- 172.21.15.73:0/3178853846 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fce5c020ca0 con 0x558670dbe910 2023-08-10T11:51:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.064+0000 7fce763deb80 10 client.15087 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:51:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.065+0000 7fce763deb80 10 client.15087 resolve_mds: resolved name 'h' to daemon mds.h 2023-08-10T11:51:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.065+0000 7fce763deb80 20 client.15087 populate_metadata read hostname 'smithi073' 2023-08-10T11:51:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.065+0000 7fce763deb80 1 --2- 172.21.15.73:0/3178853846 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x558670dd6390 0x558670dd5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.065+0000 7fce763deb80 4 client.15087 mds_command: new command op to 24479 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:51:55.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.065+0000 7fce763deb80 1 -- 172.21.15.73:0/3178853846 --> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558670d8c980 con 0x558670dd6390 2023-08-10T11:51:55.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.065+0000 7fce637fe700 1 --2- 172.21.15.73:0/3178853846 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x558670dd6390 0x558670dd5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.065+0000 7fce637fe700 1 --2- 172.21.15.73:0/3178853846 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x558670dd6390 0x558670dd5740 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=afa8e9c2b674db18 server_cookie=471ebe66ca52ccad in_seq=0 out_seq=0 2023-08-10T11:51:55.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.065+0000 7fce42ffd700 10 client.15087 ms_handle_connect on v2:172.21.15.152:6836/74214089 2023-08-10T11:51:55.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.066+0000 7fce42ffd700 1 -- 172.21.15.73:0/3178853846 <== mds.1 v2:172.21.15.152:6836/74214089 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x558670d8c980 con 0x558670dd6390 2023-08-10T11:51:55.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.066+0000 7fce42ffd700 10 client.15087 handle_command_reply: tid=0 2023-08-10T11:51:55.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.066+0000 7fce763deb80 1 client.15087 shutdown 2023-08-10T11:51:55.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.066+0000 7fce763deb80 1 -- 172.21.15.73:0/3178853846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbe910 msgr2=0x558670dd25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:55.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.066+0000 7fce763deb80 1 --2- 172.21.15.73:0/3178853846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbe910 0x558670dd25e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fce5c007870 tx=0x7fce5c007b80 comp rx=0 tx=0).stop 2023-08-10T11:51:55.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.066+0000 7fce763deb80 1 -- 172.21.15.73:0/3178853846 shutdown_connections 2023-08-10T11:51:55.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.066+0000 7fce763deb80 1 --2- 172.21.15.73:0/3178853846 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x558670dd6390 0x558670dd5740 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.066+0000 7fce763deb80 1 --2- 172.21.15.73:0/3178853846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbe910 0x558670dd25e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.066+0000 7fce763deb80 1 --2- 172.21.15.73:0/3178853846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558670dbd4f0 0x558670dcb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.066+0000 7fce42ffd700 0 client.15087 ms_handle_reset on v2:172.21.15.152:6836/74214089 2023-08-10T11:51:55.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.066+0000 7fce763deb80 1 --2- 172.21.15.73:0/3178853846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558670dbde50 0x558670dcb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.066+0000 7fce763deb80 1 -- 172.21.15.73:0/3178853846 >> 172.21.15.73:0/3178853846 conn(0x558670d1ac80 msgr2=0x558670db7960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:55.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.066+0000 7fce763deb80 1 -- 172.21.15.73:0/3178853846 shutdown_connections 2023-08-10T11:51:55.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.066+0000 7fce763deb80 1 -- 172.21.15.73:0/3178853846 wait complete. 2023-08-10T11:51:55.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.066+0000 7fce763deb80 20 client.15087 trim_cache size 0 max 16384 2023-08-10T11:51:55.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.084+0000 7fce763deb80 1 Processor -- start 2023-08-10T11:51:55.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.084+0000 7fce763deb80 1 -- start start 2023-08-10T11:51:55.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.084+0000 7fce763deb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558670dbd4f0 0x558670db9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.084+0000 7fce763deb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558670dbde50 0x558670ddf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.084+0000 7fce763deb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbe910 0x558670db81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.084+0000 7fce763deb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558670b918d0 con 0x558670dbe910 2023-08-10T11:51:55.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.084+0000 7fce763deb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x558670db2aa0 con 0x558670dbde50 2023-08-10T11:51:55.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.084+0000 7fce763deb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558670d8c9b0 con 0x558670dbd4f0 2023-08-10T11:51:55.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.084+0000 7fce63fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbe910 0x558670db81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.084+0000 7fce63fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbe910 0x558670db81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59902/0 (socket says 172.21.15.73:59902) 2023-08-10T11:51:55.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.084+0000 7fce63fff700 1 -- 172.21.15.73:0/3211195113 learned_addr learned my addr 172.21.15.73:0/3211195113 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:55.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.084+0000 7fce62ffd700 1 --2- 172.21.15.73:0/3211195113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558670dbde50 0x558670ddf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.084+0000 7fce637fe700 1 --2- 172.21.15.73:0/3211195113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558670dbd4f0 0x558670db9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.084+0000 7fce63fff700 1 -- 172.21.15.73:0/3211195113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558670dbd4f0 msgr2=0x558670db9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:55.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.084+0000 7fce63fff700 1 --2- 172.21.15.73:0/3211195113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558670dbd4f0 0x558670db9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.084+0000 7fce63fff700 1 -- 172.21.15.73:0/3211195113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558670dbde50 msgr2=0x558670ddf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:55.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.084+0000 7fce63fff700 1 --2- 172.21.15.73:0/3211195113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558670dbde50 0x558670ddf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.084+0000 7fce63fff700 1 -- 172.21.15.73:0/3211195113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558670b24c10 con 0x558670dbe910 2023-08-10T11:51:55.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.084+0000 7fce62ffd700 1 --2- 172.21.15.73:0/3211195113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558670dbde50 0x558670ddf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:51:55.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.084+0000 7fce63fff700 1 --2- 172.21.15.73:0/3211195113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbe910 0x558670db81f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fce5c01d3f0 tx=0x7fce5c0090b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f8b44692278d7d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:55.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.084+0000 7fce5a7fc700 1 -- 172.21.15.73:0/3211195113 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c020d60 con 0x558670dbe910 2023-08-10T11:51:55.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.085+0000 7fce5a7fc700 1 -- 172.21.15.73:0/3211195113 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fce5c020420 con 0x558670dbe910 2023-08-10T11:51:55.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.085+0000 7fce5a7fc700 1 -- 172.21.15.73:0/3211195113 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c015940 con 0x558670dbe910 2023-08-10T11:51:55.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.085+0000 7fce763deb80 1 -- 172.21.15.73:0/3211195113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbe910 msgr2=0x558670db81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:55.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.085+0000 7fce763deb80 1 --2- 172.21.15.73:0/3211195113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbe910 0x558670db81f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fce5c01d3f0 tx=0x7fce5c0090b0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.085+0000 7fce763deb80 1 -- 172.21.15.73:0/3211195113 shutdown_connections 2023-08-10T11:51:55.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.085+0000 7fce763deb80 1 --2- 172.21.15.73:0/3211195113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbe910 0x558670db81f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.085+0000 7fce763deb80 1 --2- 172.21.15.73:0/3211195113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558670dbd4f0 0x558670db9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.085+0000 7fce763deb80 1 --2- 172.21.15.73:0/3211195113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558670dbde50 0x558670ddf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.085+0000 7fce763deb80 1 -- 172.21.15.73:0/3211195113 >> 172.21.15.73:0/3211195113 conn(0x558670d1ac80 msgr2=0x558670dc9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:55.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.085+0000 7fce763deb80 1 -- 172.21.15.73:0/3211195113 shutdown_connections 2023-08-10T11:51:55.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.085+0000 7fce763deb80 1 -- 172.21.15.73:0/3211195113 wait complete. 2023-08-10T11:51:55.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.085+0000 7fce763deb80 1 -- start start 2023-08-10T11:51:55.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.086+0000 7fce763deb80 1 Processor -- start 2023-08-10T11:51:55.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.086+0000 7fce763deb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558670dbd4f0 0x558670dd9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.086+0000 7fce763deb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558670dbde50 0x558670ddef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.086+0000 7fce763deb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbe910 0x558670dd9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.086+0000 7fce763deb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558670dda5a0 con 0x558670dbe910 2023-08-10T11:51:55.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.086+0000 7fce763deb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x558670e29ff0 con 0x558670dbde50 2023-08-10T11:51:55.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.086+0000 7fce763deb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558670e2a130 con 0x558670dbd4f0 2023-08-10T11:51:55.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.086+0000 7fce763deb80 10 client.0 _ll_register_callbacks cb 0x558670cab630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:51:55.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.086+0000 7fce63fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbe910 0x558670dd9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.086+0000 7fce63fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbe910 0x558670dd9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59908/0 (socket says 172.21.15.73:59908) 2023-08-10T11:51:55.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.086+0000 7fce63fff700 1 -- 172.21.15.73:0/1503762284 learned_addr learned my addr 172.21.15.73:0/1503762284 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:55.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.086+0000 7fce62ffd700 1 --2- 172.21.15.73:0/1503762284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558670dbde50 0x558670ddef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.086+0000 7fce637fe700 1 --2- 172.21.15.73:0/1503762284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558670dbd4f0 0x558670dd9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.086+0000 7fce63fff700 1 -- 172.21.15.73:0/1503762284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558670dbd4f0 msgr2=0x558670dd9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:55.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.086+0000 7fce63fff700 1 --2- 172.21.15.73:0/1503762284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558670dbd4f0 0x558670dd9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.086+0000 7fce63fff700 1 -- 172.21.15.73:0/1503762284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558670dbde50 msgr2=0x558670ddef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:55.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.086+0000 7fce63fff700 1 --2- 172.21.15.73:0/1503762284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558670dbde50 0x558670ddef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.086+0000 7fce63fff700 1 -- 172.21.15.73:0/1503762284 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558670b3bd90 con 0x558670dbe910 2023-08-10T11:51:55.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.086+0000 7fce63fff700 1 --2- 172.21.15.73:0/1503762284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbe910 0x558670dd9f50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fce5c020f50 tx=0x7fce5c004e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b6342ddd5eaa492 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:55.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.086+0000 7fce42ffd700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:51:55.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.086+0000 7fce42ffd700 1 -- 172.21.15.73:0/1503762284 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c020960 con 0x558670dbe910 2023-08-10T11:51:55.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.086+0000 7fce42ffd700 1 -- 172.21.15.73:0/1503762284 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fce5c020ac0 con 0x558670dbe910 2023-08-10T11:51:55.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.086+0000 7fce763deb80 1 -- 172.21.15.73:0/1503762284 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fce5409eca0 con 0x558670dbe910 2023-08-10T11:51:55.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.087+0000 7fce42ffd700 1 -- 172.21.15.73:0/1503762284 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce5c015680 con 0x558670dbe910 2023-08-10T11:51:55.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.087+0000 7fce763deb80 10 client.15093 fetch_fsmap learned FSMap version 27 2023-08-10T11:51:55.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.087+0000 7fce763deb80 1 -- 172.21.15.73:0/1503762284 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x558670b62200 con 0x558670dbe910 2023-08-10T11:51:55.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.087+0000 7fce42ffd700 1 -- 172.21.15.73:0/1503762284 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fce5409eca0 con 0x558670dbe910 2023-08-10T11:51:55.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.087+0000 7fce42ffd700 1 -- 172.21.15.73:0/1503762284 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fce5c030070 con 0x558670dbe910 2023-08-10T11:51:55.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.087+0000 7fce763deb80 10 client.15093 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:51:55.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.087+0000 7fce763deb80 10 client.15093 resolve_mds: resolved name 'h' to daemon mds.h 2023-08-10T11:51:55.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.087+0000 7fce763deb80 20 client.15093 populate_metadata read hostname 'smithi073' 2023-08-10T11:51:55.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.087+0000 7fce763deb80 1 --2- 172.21.15.73:0/1503762284 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x558670e2e9d0 0x558670e2b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.087+0000 7fce763deb80 4 client.15093 mds_command: new command op to 24479 tid=0[{"prefix": "status"}] 2023-08-10T11:51:55.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.087+0000 7fce763deb80 1 -- 172.21.15.73:0/1503762284 --> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558670d07730 con 0x558670e2e9d0 2023-08-10T11:51:55.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.087+0000 7fce637fe700 1 --2- 172.21.15.73:0/1503762284 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x558670e2e9d0 0x558670e2b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.088+0000 7fce42ffd700 10 client.15093 ms_handle_connect on v2:172.21.15.152:6836/74214089 2023-08-10T11:51:55.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.088+0000 7fce637fe700 1 --2- 172.21.15.73:0/1503762284 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x558670e2e9d0 0x558670e2b3a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=74dfc747cbab32f1 server_cookie=f36e3959c5396dda in_seq=0 out_seq=0 2023-08-10T11:51:55.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.088+0000 7fce42ffd700 1 -- 172.21.15.73:0/1503762284 <== mds.1 v2:172.21.15.152:6836/74214089 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x558670d07730 con 0x558670e2e9d0 2023-08-10T11:51:55.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.088+0000 7fce42ffd700 10 client.15093 handle_command_reply: tid=0 2023-08-10T11:51:55.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.088+0000 7fce763deb80 1 client.15093 shutdown 2023-08-10T11:51:55.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.088+0000 7fce763deb80 1 -- 172.21.15.73:0/1503762284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbe910 msgr2=0x558670dd9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:55.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.088+0000 7fce763deb80 1 --2- 172.21.15.73:0/1503762284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbe910 0x558670dd9f50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fce5c020f50 tx=0x7fce5c004e00 comp rx=0 tx=0).stop 2023-08-10T11:51:55.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.088+0000 7fce763deb80 1 -- 172.21.15.73:0/1503762284 shutdown_connections 2023-08-10T11:51:55.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.088+0000 7fce763deb80 1 --2- 172.21.15.73:0/1503762284 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x558670e2e9d0 0x558670e2b3a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.088+0000 7fce763deb80 1 --2- 172.21.15.73:0/1503762284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558670dbe910 0x558670dd9f50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.088+0000 7fce763deb80 1 --2- 172.21.15.73:0/1503762284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558670dbd4f0 0x558670dd9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.088+0000 7fce42ffd700 0 client.15093 ms_handle_reset on v2:172.21.15.152:6836/74214089 2023-08-10T11:51:55.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.088+0000 7fce763deb80 1 --2- 172.21.15.73:0/1503762284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558670dbde50 0x558670ddef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.088+0000 7fce763deb80 1 -- 172.21.15.73:0/1503762284 >> 172.21.15.73:0/1503762284 conn(0x558670d1ac80 msgr2=0x558670db81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:55.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.088+0000 7fce763deb80 1 -- 172.21.15.73:0/1503762284 shutdown_connections 2023-08-10T11:51:55.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.088+0000 7fce763deb80 1 -- 172.21.15.73:0/1503762284 wait complete. 2023-08-10T11:51:55.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.088+0000 7fce763deb80 20 client.15093 trim_cache size 0 max 16384 2023-08-10T11:51:55.100 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:51:55.100 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "0e619a74-3773-11ee-9b37-001a4aab830c", 2023-08-10T11:51:55.100 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 1, 2023-08-10T11:51:55.100 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 24479, 2023-08-10T11:51:55.100 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2023-08-10T11:51:55.100 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2023-08-10T11:51:55.101 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2023-08-10T11:51:55.101 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 57.170275205999999, 2023-08-10T11:51:55.101 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 27, 2023-08-10T11:51:55.101 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 85, 2023-08-10T11:51:55.101 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 83, 2023-08-10T11:51:55.101 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 74.323748648999995 2023-08-10T11:51:55.101 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:51:55.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.089+0000 7fce6a245700 1 -- 172.21.15.73:0/829474755 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fce500a11e0 msgr2=0x7fce500a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:55.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.089+0000 7fce6a245700 1 --2- 172.21.15.73:0/829474755 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fce500a11e0 0x7fce500a36a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fce64100720 tx=0x7fce4c009260 comp rx=0 tx=0).stop 2023-08-10T11:51:55.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.089+0000 7fce6a245700 1 -- 172.21.15.73:0/829474755 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce641008c0 msgr2=0x7fce641969e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:55.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.089+0000 7fce6a245700 1 --2- 172.21.15.73:0/829474755 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce641008c0 0x7fce641969e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fce54009990 tx=0x7fce5400f690 comp rx=0 tx=0).stop 2023-08-10T11:51:55.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.089+0000 7fce6a245700 1 -- 172.21.15.73:0/829474755 shutdown_connections 2023-08-10T11:51:55.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.089+0000 7fce6a245700 1 --2- 172.21.15.73:0/829474755 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fce500a11e0 0x7fce500a36a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.089+0000 7fce6a245700 1 --2- 172.21.15.73:0/829474755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce64101260 0x7fce6419da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.089+0000 7fce6a245700 1 --2- 172.21.15.73:0/829474755 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce640ff6d0 0x7fce641964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.089+0000 7fce6a245700 1 --2- 172.21.15.73:0/829474755 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce641008c0 0x7fce641969e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.089+0000 7fce6a245700 1 -- 172.21.15.73:0/829474755 >> 172.21.15.73:0/829474755 conn(0x7fce640fac40 msgr2=0x7fce64103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:55.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.089+0000 7fce6a245700 1 -- 172.21.15.73:0/829474755 shutdown_connections 2023-08-10T11:51:55.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.089+0000 7fce6a245700 1 -- 172.21.15.73:0/829474755 wait complete. 2023-08-10T11:51:55.104 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-10T11:51:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.264+0000 7f01adde2700 1 -- 172.21.15.73:0/1687092533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01a8103b10 msgr2=0x7f01a8105f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.264+0000 7f01adde2700 1 --2- 172.21.15.73:0/1687092533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01a8103b10 0x7f01a8105f00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0198009990 tx=0x7f0198009ca0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.264+0000 7f01adde2700 1 -- 172.21.15.73:0/1687092533 shutdown_connections 2023-08-10T11:51:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.264+0000 7f01adde2700 1 --2- 172.21.15.73:0/1687092533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01a8106440 0x7f01a81088b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.264+0000 7f01adde2700 1 --2- 172.21.15.73:0/1687092533 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01a81011e0 0x7f01a81035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.264+0000 7f01adde2700 1 --2- 172.21.15.73:0/1687092533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01a8103b10 0x7f01a8105f00 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.264+0000 7f01adde2700 1 -- 172.21.15.73:0/1687092533 >> 172.21.15.73:0/1687092533 conn(0x7f01a80fabd0 msgr2=0x7f01a80fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:55.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.264+0000 7f01adde2700 1 -- 172.21.15.73:0/1687092533 shutdown_connections 2023-08-10T11:51:55.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.264+0000 7f01adde2700 1 -- 172.21.15.73:0/1687092533 wait complete. 2023-08-10T11:51:55.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.265+0000 7f01adde2700 1 Processor -- start 2023-08-10T11:51:55.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.265+0000 7f01adde2700 1 -- start start 2023-08-10T11:51:55.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.265+0000 7f01adde2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01a81011e0 0x7f01a81963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.265+0000 7f01adde2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01a8103b10 0x7f01a8196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.265+0000 7f01adde2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01a8106440 0x7f01a819d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.265+0000 7f01adde2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a819df60 con 0x7f01a8103b10 2023-08-10T11:51:55.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.265+0000 7f01adde2700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a819e0a0 con 0x7f01a8106440 2023-08-10T11:51:55.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.265+0000 7f01adde2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a819e230 con 0x7f01a81011e0 2023-08-10T11:51:55.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.265+0000 7f01a6ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01a8103b10 0x7f01a8196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.265+0000 7f01a6ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01a8103b10 0x7f01a8196920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59920/0 (socket says 172.21.15.73:59920) 2023-08-10T11:51:55.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.265+0000 7f01a6ffd700 1 -- 172.21.15.73:0/3610054174 learned_addr learned my addr 172.21.15.73:0/3610054174 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:55.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.265+0000 7f01a7fff700 1 --2- 172.21.15.73:0/3610054174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01a8106440 0x7f01a819d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.265+0000 7f01a77fe700 1 --2- 172.21.15.73:0/3610054174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01a81011e0 0x7f01a81963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.265+0000 7f01a6ffd700 1 -- 172.21.15.73:0/3610054174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01a81011e0 msgr2=0x7f01a81963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:55.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.265+0000 7f01a6ffd700 1 --2- 172.21.15.73:0/3610054174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01a81011e0 0x7f01a81963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.265+0000 7f01a6ffd700 1 -- 172.21.15.73:0/3610054174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01a8106440 msgr2=0x7f01a819d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:55.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.265+0000 7f01a6ffd700 1 --2- 172.21.15.73:0/3610054174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01a8106440 0x7f01a819d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.265+0000 7f01a6ffd700 1 -- 172.21.15.73:0/3610054174 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01980095f0 con 0x7f01a8103b10 2023-08-10T11:51:55.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.265+0000 7f01a77fe700 1 --2- 172.21.15.73:0/3610054174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01a81011e0 0x7f01a81963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:55.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.266+0000 7f01a6ffd700 1 --2- 172.21.15.73:0/3610054174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01a8103b10 0x7f01a8196920 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0198000c00 tx=0x7f019800f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:55.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.266+0000 7f01a4ff9700 1 -- 172.21.15.73:0/3610054174 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019801d070 con 0x7f01a8103b10 2023-08-10T11:51:55.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.266+0000 7f01a4ff9700 1 -- 172.21.15.73:0/3610054174 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f019800fb50 con 0x7f01a8103b10 2023-08-10T11:51:55.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.266+0000 7f01adde2700 1 -- 172.21.15.73:0/3610054174 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a819e4b0 con 0x7f01a8103b10 2023-08-10T11:51:55.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.266+0000 7f01a4ff9700 1 -- 172.21.15.73:0/3610054174 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0198017650 con 0x7f01a8103b10 2023-08-10T11:51:55.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.266+0000 7f01adde2700 1 -- 172.21.15.73:0/3610054174 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a819e960 con 0x7f01a8103b10 2023-08-10T11:51:55.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.268+0000 7f01a4ff9700 1 -- 172.21.15.73:0/3610054174 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f019800fcc0 con 0x7f01a8103b10 2023-08-10T11:51:55.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.268+0000 7f01a4ff9700 1 --2- 172.21.15.73:0/3610054174 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f01940a11e0 0x7f01940a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.268+0000 7f01a77fe700 1 --2- 172.21.15.73:0/3610054174 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f01940a11e0 0x7f01940a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.268+0000 7f01a4ff9700 1 -- 172.21.15.73:0/3610054174 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f01980cdde0 con 0x7f01a8103b10 2023-08-10T11:51:55.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.269+0000 7f01a77fe700 1 --2- 172.21.15.73:0/3610054174 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f01940a11e0 0x7f01940a36a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0190005fd0 tx=0x7f0190005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:55.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.269+0000 7f01b9f7bb80 1 Processor -- start 2023-08-10T11:51:55.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.269+0000 7f01b9f7bb80 1 -- start start 2023-08-10T11:51:55.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.270+0000 7f01b9f7bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e0b5bd94f0 0x55e0b5bd9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.270+0000 7f01b9f7bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0b5bd9e50 0x55e0b5bda380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.270+0000 7f01b9f7bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bda910 0x55e0b5bdada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.270+0000 7f01b9f7bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5b54d70 con 0x55e0b5bda910 2023-08-10T11:51:55.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.270+0000 7f01b9f7bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5b31540 con 0x55e0b5bd94f0 2023-08-10T11:51:55.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.270+0000 7f01b9f7bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5b2ee60 con 0x55e0b5bd9e50 2023-08-10T11:51:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.270+0000 7f01a7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bda910 0x55e0b5bdada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.270+0000 7f01a7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bda910 0x55e0b5bdada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59930/0 (socket says 172.21.15.73:59930) 2023-08-10T11:51:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.270+0000 7f01a7fff700 1 -- 172.21.15.73:0/1319827675 learned_addr learned my addr 172.21.15.73:0/1319827675 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.270+0000 7f01a6ffd700 1 --2- 172.21.15.73:0/1319827675 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0b5bd9e50 0x55e0b5bda380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.270+0000 7f01a77fe700 1 --2- 172.21.15.73:0/1319827675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e0b5bd94f0 0x55e0b5bd9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.270+0000 7f01a7fff700 1 -- 172.21.15.73:0/1319827675 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0b5bd9e50 msgr2=0x55e0b5bda380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.270+0000 7f01a7fff700 1 --2- 172.21.15.73:0/1319827675 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0b5bd9e50 0x55e0b5bda380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.270+0000 7f01a7fff700 1 -- 172.21.15.73:0/1319827675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e0b5bd94f0 msgr2=0x55e0b5bd9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:55.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.270+0000 7f01a7fff700 1 --2- 172.21.15.73:0/1319827675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e0b5bd94f0 0x55e0b5bd9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.270+0000 7f01a7fff700 1 -- 172.21.15.73:0/1319827675 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0b59ab5e0 con 0x55e0b5bda910 2023-08-10T11:51:55.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.270+0000 7f01a77fe700 1 --2- 172.21.15.73:0/1319827675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e0b5bd94f0 0x55e0b5bd9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:51:55.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.270+0000 7f01a7fff700 1 --2- 172.21.15.73:0/1319827675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bda910 0x55e0b5bdada0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f01a000f5a0 tx=0x7f01a000f8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339d673b775401f1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:55.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.270+0000 7f019dffb700 1 -- 172.21.15.73:0/1319827675 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0004bb0 con 0x55e0b5bda910 2023-08-10T11:51:55.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.270+0000 7f019dffb700 1 -- 172.21.15.73:0/1319827675 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01a0004d10 con 0x55e0b5bda910 2023-08-10T11:51:55.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.270+0000 7f019dffb700 1 -- 172.21.15.73:0/1319827675 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0005150 con 0x55e0b5bda910 2023-08-10T11:51:55.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.271+0000 7f01b9f7bb80 1 -- 172.21.15.73:0/1319827675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bda910 msgr2=0x55e0b5bdada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:55.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.271+0000 7f01b9f7bb80 1 --2- 172.21.15.73:0/1319827675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bda910 0x55e0b5bdada0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f01a000f5a0 tx=0x7f01a000f8b0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.271+0000 7f01b9f7bb80 1 -- 172.21.15.73:0/1319827675 shutdown_connections 2023-08-10T11:51:55.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.271+0000 7f01b9f7bb80 1 --2- 172.21.15.73:0/1319827675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e0b5bd94f0 0x55e0b5bd9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.271+0000 7f01b9f7bb80 1 --2- 172.21.15.73:0/1319827675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bda910 0x55e0b5bdada0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.271+0000 7f01b9f7bb80 1 --2- 172.21.15.73:0/1319827675 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0b5bd9e50 0x55e0b5bda380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.271+0000 7f01b9f7bb80 1 -- 172.21.15.73:0/1319827675 >> 172.21.15.73:0/1319827675 conn(0x55e0b5b36c80 msgr2=0x55e0b5bd4280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:55.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.271+0000 7f01b9f7bb80 1 -- 172.21.15.73:0/1319827675 shutdown_connections 2023-08-10T11:51:55.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.271+0000 7f01b9f7bb80 1 -- 172.21.15.73:0/1319827675 wait complete. 2023-08-10T11:51:55.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.271+0000 7f01b9f7bb80 1 -- start start 2023-08-10T11:51:55.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.271+0000 7f01b9f7bb80 1 Processor -- start 2023-08-10T11:51:55.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.272+0000 7f01b9f7bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bd94f0 0x55e0b5be2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.272+0000 7f01b9f7bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0b5bd9e50 0x55e0b5be3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.272+0000 7f01b9f7bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e0b5bda910 0x55e0b5bea4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.272+0000 7f01b9f7bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5b2a750 con 0x55e0b5bd94f0 2023-08-10T11:51:55.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.272+0000 7f01b9f7bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5ac9a70 con 0x55e0b5bda910 2023-08-10T11:51:55.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.272+0000 7f01b9f7bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5ac9770 con 0x55e0b5bd9e50 2023-08-10T11:51:55.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.272+0000 7f01b9f7bb80 10 client.0 _ll_register_callbacks cb 0x55e0b5ac7630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:51:55.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.272+0000 7f01a77fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bd94f0 0x55e0b5be2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.272+0000 7f01a77fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bd94f0 0x55e0b5be2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59932/0 (socket says 172.21.15.73:59932) 2023-08-10T11:51:55.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.272+0000 7f01a77fe700 1 -- 172.21.15.73:0/3838471154 learned_addr learned my addr 172.21.15.73:0/3838471154 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:55.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.272+0000 7f01a7fff700 1 --2- 172.21.15.73:0/3838471154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e0b5bda910 0x55e0b5bea4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.272+0000 7f01a6ffd700 1 --2- 172.21.15.73:0/3838471154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0b5bd9e50 0x55e0b5be3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.272+0000 7f01a77fe700 1 -- 172.21.15.73:0/3838471154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0b5bd9e50 msgr2=0x55e0b5be3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:55.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.272+0000 7f01a77fe700 1 --2- 172.21.15.73:0/3838471154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0b5bd9e50 0x55e0b5be3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.272+0000 7f01a77fe700 1 -- 172.21.15.73:0/3838471154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e0b5bda910 msgr2=0x55e0b5bea4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:55.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.272+0000 7f01a77fe700 1 --2- 172.21.15.73:0/3838471154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e0b5bda910 0x55e0b5bea4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.272+0000 7f01a77fe700 1 -- 172.21.15.73:0/3838471154 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a000f1d0 con 0x55e0b5bd94f0 2023-08-10T11:51:55.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.272+0000 7f01a6ffd700 1 --2- 172.21.15.73:0/3838471154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0b5bd9e50 0x55e0b5be3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:51:55.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.272+0000 7f01a7fff700 1 --2- 172.21.15.73:0/3838471154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e0b5bda910 0x55e0b5bea4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:51:55.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.272+0000 7f01a77fe700 1 --2- 172.21.15.73:0/3838471154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bd94f0 0x55e0b5be2f20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0190011720 tx=0x7f01900047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823b269969dbc45a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:55.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.272+0000 7f0186ffd700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:51:55.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.272+0000 7f0186ffd700 1 -- 172.21.15.73:0/3838471154 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0190004a30 con 0x55e0b5bd94f0 2023-08-10T11:51:55.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.272+0000 7f0186ffd700 1 -- 172.21.15.73:0/3838471154 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0190004b90 con 0x55e0b5bd94f0 2023-08-10T11:51:55.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.272+0000 7f01b9f7bb80 1 -- 172.21.15.73:0/3838471154 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0b5bcc420 con 0x55e0b5bd94f0 2023-08-10T11:51:55.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.273+0000 7f0186ffd700 1 -- 172.21.15.73:0/3838471154 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0190004d50 con 0x55e0b5bd94f0 2023-08-10T11:51:55.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.273+0000 7f01b9f7bb80 10 client.15105 fetch_fsmap learned FSMap version 27 2023-08-10T11:51:55.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.273+0000 7f01b9f7bb80 1 -- 172.21.15.73:0/3838471154 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55e0b5957d90 con 0x55e0b5bd94f0 2023-08-10T11:51:55.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.273+0000 7f0186ffd700 1 -- 172.21.15.73:0/3838471154 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e0b5bcc420 con 0x55e0b5bd94f0 2023-08-10T11:51:55.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.273+0000 7f0186ffd700 1 -- 172.21.15.73:0/3838471154 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f01900109f0 con 0x55e0b5bd94f0 2023-08-10T11:51:55.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.273+0000 7f01b9f7bb80 10 client.15105 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:51:55.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.273+0000 7f01b9f7bb80 10 client.15105 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-10T11:51:55.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.273+0000 7f01b9f7bb80 20 client.15105 populate_metadata read hostname 'smithi073' 2023-08-10T11:51:55.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.273+0000 7f01b9f7bb80 1 --2- 172.21.15.73:0/3838471154 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e0b5bee140 0x55e0b5bed520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.273+0000 7f01b9f7bb80 4 client.15105 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:51:55.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.273+0000 7f01b9f7bb80 1 -- 172.21.15.73:0/3838471154 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0b5ba8980 con 0x55e0b5bee140 2023-08-10T11:51:55.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.273+0000 7f01a6ffd700 1 --2- 172.21.15.73:0/3838471154 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e0b5bee140 0x55e0b5bed520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.274+0000 7f0186ffd700 10 client.15105 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:51:55.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.274+0000 7f01a6ffd700 1 --2- 172.21.15.73:0/3838471154 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e0b5bee140 0x55e0b5bed520 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aad013bf5a437042 server_cookie=4669fe3717baefb9 in_seq=0 out_seq=0 2023-08-10T11:51:55.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.274+0000 7f0186ffd700 1 -- 172.21.15.73:0/3838471154 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55e0b5ba8980 con 0x55e0b5bee140 2023-08-10T11:51:55.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.274+0000 7f0186ffd700 10 client.15105 handle_command_reply: tid=0 2023-08-10T11:51:55.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.274+0000 7f01b9f7bb80 1 client.15105 shutdown 2023-08-10T11:51:55.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.274+0000 7f01b9f7bb80 1 -- 172.21.15.73:0/3838471154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bd94f0 msgr2=0x55e0b5be2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:55.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.274+0000 7f01b9f7bb80 1 --2- 172.21.15.73:0/3838471154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bd94f0 0x55e0b5be2f20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0190011720 tx=0x7f01900047c0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.274+0000 7f01b9f7bb80 1 -- 172.21.15.73:0/3838471154 shutdown_connections 2023-08-10T11:51:55.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.274+0000 7f01b9f7bb80 1 --2- 172.21.15.73:0/3838471154 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e0b5bee140 0x55e0b5bed520 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.274+0000 7f01b9f7bb80 1 --2- 172.21.15.73:0/3838471154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e0b5bda910 0x55e0b5bea4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.274+0000 7f01b9f7bb80 1 --2- 172.21.15.73:0/3838471154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bd94f0 0x55e0b5be2f20 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.274+0000 7f0186ffd700 0 client.15105 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:51:55.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.274+0000 7f01b9f7bb80 1 --2- 172.21.15.73:0/3838471154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0b5bd9e50 0x55e0b5be3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.274+0000 7f01b9f7bb80 1 -- 172.21.15.73:0/3838471154 >> 172.21.15.73:0/3838471154 conn(0x55e0b5b36c80 msgr2=0x55e0b5bd3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:55.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.275+0000 7f01b9f7bb80 1 -- 172.21.15.73:0/3838471154 shutdown_connections 2023-08-10T11:51:55.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.275+0000 7f01b9f7bb80 1 -- 172.21.15.73:0/3838471154 wait complete. 2023-08-10T11:51:55.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.275+0000 7f01b9f7bb80 20 client.15105 trim_cache size 0 max 16384 2023-08-10T11:51:55.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.292+0000 7f01b9f7bb80 1 Processor -- start 2023-08-10T11:51:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.292+0000 7f01b9f7bb80 1 -- start start 2023-08-10T11:51:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.292+0000 7f01b9f7bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e0b5bd94f0 0x55e0b5bdd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.292+0000 7f01b9f7bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0b5bd9e50 0x55e0b5bddc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.292+0000 7f01b9f7bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bda910 0x55e0b5bea460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.292+0000 7f01b9f7bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b59ad8d0 con 0x55e0b5bda910 2023-08-10T11:51:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.292+0000 7f01b9f7bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5bd0f80 con 0x55e0b5bd94f0 2023-08-10T11:51:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.292+0000 7f01b9f7bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5bcea30 con 0x55e0b5bd9e50 2023-08-10T11:51:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.292+0000 7f01a7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bda910 0x55e0b5bea460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.292+0000 7f01a7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bda910 0x55e0b5bea460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59944/0 (socket says 172.21.15.73:59944) 2023-08-10T11:51:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.292+0000 7f01a7fff700 1 -- 172.21.15.73:0/2071947744 learned_addr learned my addr 172.21.15.73:0/2071947744 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.293+0000 7f01a6ffd700 1 --2- 172.21.15.73:0/2071947744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0b5bd9e50 0x55e0b5bddc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.293+0000 7f01a77fe700 1 --2- 172.21.15.73:0/2071947744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e0b5bd94f0 0x55e0b5bdd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.293+0000 7f01a7fff700 1 -- 172.21.15.73:0/2071947744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0b5bd9e50 msgr2=0x55e0b5bddc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.293+0000 7f01a7fff700 1 --2- 172.21.15.73:0/2071947744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0b5bd9e50 0x55e0b5bddc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.293+0000 7f01a7fff700 1 -- 172.21.15.73:0/2071947744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e0b5bd94f0 msgr2=0x55e0b5bdd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.293+0000 7f01a7fff700 1 --2- 172.21.15.73:0/2071947744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e0b5bd94f0 0x55e0b5bdd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.293+0000 7f01a7fff700 1 -- 172.21.15.73:0/2071947744 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0b5940c10 con 0x55e0b5bda910 2023-08-10T11:51:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.293+0000 7f01a7fff700 1 --2- 172.21.15.73:0/2071947744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bda910 0x55e0b5bea460 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55e0b5bd56c0 tx=0x7f01a0007710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19a5e6b54f41789 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.293+0000 7f019e7fc700 1 -- 172.21.15.73:0/2071947744 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0014470 con 0x55e0b5bda910 2023-08-10T11:51:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.293+0000 7f019e7fc700 1 -- 172.21.15.73:0/2071947744 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01a0014a90 con 0x55e0b5bda910 2023-08-10T11:51:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.293+0000 7f019e7fc700 1 -- 172.21.15.73:0/2071947744 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a001dab0 con 0x55e0b5bda910 2023-08-10T11:51:55.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.293+0000 7f01b9f7bb80 1 -- 172.21.15.73:0/2071947744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bda910 msgr2=0x55e0b5bea460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:55.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.293+0000 7f01b9f7bb80 1 --2- 172.21.15.73:0/2071947744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bda910 0x55e0b5bea460 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55e0b5bd56c0 tx=0x7f01a0007710 comp rx=0 tx=0).stop 2023-08-10T11:51:55.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.294+0000 7f01b9f7bb80 1 -- 172.21.15.73:0/2071947744 shutdown_connections 2023-08-10T11:51:55.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.294+0000 7f01b9f7bb80 1 --2- 172.21.15.73:0/2071947744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e0b5bd94f0 0x55e0b5bdd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.294+0000 7f01b9f7bb80 1 --2- 172.21.15.73:0/2071947744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bda910 0x55e0b5bea460 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.294+0000 7f01b9f7bb80 1 --2- 172.21.15.73:0/2071947744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0b5bd9e50 0x55e0b5bddc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.294+0000 7f01b9f7bb80 1 -- 172.21.15.73:0/2071947744 >> 172.21.15.73:0/2071947744 conn(0x55e0b5b36c80 msgr2=0x55e0b5bed520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:55.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.294+0000 7f01b9f7bb80 1 -- 172.21.15.73:0/2071947744 shutdown_connections 2023-08-10T11:51:55.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.294+0000 7f01b9f7bb80 1 -- 172.21.15.73:0/2071947744 wait complete. 2023-08-10T11:51:55.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.294+0000 7f01b9f7bb80 1 -- start start 2023-08-10T11:51:55.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.294+0000 7f01b9f7bb80 1 Processor -- start 2023-08-10T11:51:55.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.294+0000 7f01b9f7bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0b5bd94f0 0x55e0b5be5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.294+0000 7f01b9f7bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bd9e50 0x55e0b5be5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.294+0000 7f01b9f7bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e0b5bda910 0x55e0b5be8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.294+0000 7f01b9f7bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5be93e0 con 0x55e0b5bd9e50 2023-08-10T11:51:55.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.295+0000 7f01b9f7bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5be9550 con 0x55e0b5bda910 2023-08-10T11:51:55.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.295+0000 7f01b9f7bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5be9710 con 0x55e0b5bd94f0 2023-08-10T11:51:55.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.295+0000 7f01b9f7bb80 10 client.0 _ll_register_callbacks cb 0x55e0b5ac7630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:51:55.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.295+0000 7f01a6ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bd9e50 0x55e0b5be5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.295+0000 7f01a6ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bd9e50 0x55e0b5be5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59948/0 (socket says 172.21.15.73:59948) 2023-08-10T11:51:55.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.295+0000 7f01a6ffd700 1 -- 172.21.15.73:0/258426046 learned_addr learned my addr 172.21.15.73:0/258426046 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:55.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.295+0000 7f01a77fe700 1 --2- 172.21.15.73:0/258426046 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0b5bd94f0 0x55e0b5be5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.295+0000 7f01a7fff700 1 --2- 172.21.15.73:0/258426046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e0b5bda910 0x55e0b5be8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.295+0000 7f01a6ffd700 1 -- 172.21.15.73:0/258426046 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0b5bd94f0 msgr2=0x55e0b5be5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:55.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.295+0000 7f01a6ffd700 1 --2- 172.21.15.73:0/258426046 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0b5bd94f0 0x55e0b5be5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.295+0000 7f01a6ffd700 1 -- 172.21.15.73:0/258426046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e0b5bda910 msgr2=0x55e0b5be8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:51:55.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.295+0000 7f01a6ffd700 1 --2- 172.21.15.73:0/258426046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e0b5bda910 0x55e0b5be8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.295+0000 7f01a6ffd700 1 -- 172.21.15.73:0/258426046 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e0b59ab5e0 con 0x55e0b5bd9e50 2023-08-10T11:51:55.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.295+0000 7f01a6ffd700 1 --2- 172.21.15.73:0/258426046 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bd9e50 0x55e0b5be5e80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f01980cb7d0 tx=0x7f019801a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=615f95c20f453c34 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:55.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.295+0000 7f0186ffd700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:51:55.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.295+0000 7f0186ffd700 1 -- 172.21.15.73:0/258426046 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019809a820 con 0x55e0b5bd9e50 2023-08-10T11:51:55.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.295+0000 7f0186ffd700 1 -- 172.21.15.73:0/258426046 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f01980b3070 con 0x55e0b5bd9e50 2023-08-10T11:51:55.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.295+0000 7f01b9f7bb80 1 -- 172.21.15.73:0/258426046 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f01a0004d10 con 0x55e0b5bd9e50 2023-08-10T11:51:55.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.295+0000 7f0186ffd700 1 -- 172.21.15.73:0/258426046 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01980b9030 con 0x55e0b5bd9e50 2023-08-10T11:51:55.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.295+0000 7f01b9f7bb80 10 client.15111 fetch_fsmap learned FSMap version 27 2023-08-10T11:51:55.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.295+0000 7f01b9f7bb80 1 -- 172.21.15.73:0/258426046 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55e0b597e200 con 0x55e0b5bd9e50 2023-08-10T11:51:55.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.296+0000 7f0186ffd700 1 -- 172.21.15.73:0/258426046 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01a0004d10 con 0x55e0b5bd9e50 2023-08-10T11:51:55.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.296+0000 7f0186ffd700 1 -- 172.21.15.73:0/258426046 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f01980b9350 con 0x55e0b5bd9e50 2023-08-10T11:51:55.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.296+0000 7f01b9f7bb80 10 client.15111 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:51:55.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.296+0000 7f01b9f7bb80 10 client.15111 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-10T11:51:55.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.296+0000 7f01b9f7bb80 20 client.15111 populate_metadata read hostname 'smithi073' 2023-08-10T11:51:55.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.296+0000 7f01b9f7bb80 1 --2- 172.21.15.73:0/258426046 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e0b5c473e0 0x55e0b5c43dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:55.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.296+0000 7f01b9f7bb80 4 client.15111 mds_command: new command op to 24503 tid=0[{"prefix": "status"}] 2023-08-10T11:51:55.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.296+0000 7f01b9f7bb80 1 -- 172.21.15.73:0/258426046 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e0b5b23730 con 0x55e0b5c473e0 2023-08-10T11:51:55.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.296+0000 7f01a77fe700 1 --2- 172.21.15.73:0/258426046 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e0b5c473e0 0x55e0b5c43dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:55.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.296+0000 7f0186ffd700 10 client.15111 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:51:55.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.296+0000 7f01a77fe700 1 --2- 172.21.15.73:0/258426046 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e0b5c473e0 0x55e0b5c43dd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf46590ec9eb3cba server_cookie=f69a5393c164b3df in_seq=0 out_seq=0 2023-08-10T11:51:55.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.296+0000 7f0186ffd700 1 -- 172.21.15.73:0/258426046 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55e0b5b23730 con 0x55e0b5c473e0 2023-08-10T11:51:55.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.296+0000 7f0186ffd700 10 client.15111 handle_command_reply: tid=0 2023-08-10T11:51:55.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.296+0000 7f01b9f7bb80 1 client.15111 shutdown 2023-08-10T11:51:55.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.297+0000 7f01b9f7bb80 1 -- 172.21.15.73:0/258426046 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bd9e50 msgr2=0x55e0b5be5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:55.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.297+0000 7f01b9f7bb80 1 --2- 172.21.15.73:0/258426046 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bd9e50 0x55e0b5be5e80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f01980cb7d0 tx=0x7f019801a040 comp rx=0 tx=0).stop 2023-08-10T11:51:55.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.297+0000 7f01b9f7bb80 1 -- 172.21.15.73:0/258426046 shutdown_connections 2023-08-10T11:51:55.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.297+0000 7f01b9f7bb80 1 --2- 172.21.15.73:0/258426046 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e0b5c473e0 0x55e0b5c43dd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.297+0000 7f01b9f7bb80 1 --2- 172.21.15.73:0/258426046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e0b5bda910 0x55e0b5be8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.297+0000 7f01b9f7bb80 1 --2- 172.21.15.73:0/258426046 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0b5bd94f0 0x55e0b5be5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.297+0000 7f0186ffd700 0 client.15111 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:51:55.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.297+0000 7f01b9f7bb80 1 --2- 172.21.15.73:0/258426046 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0b5bd9e50 0x55e0b5be5e80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.297+0000 7f01b9f7bb80 1 -- 172.21.15.73:0/258426046 >> 172.21.15.73:0/258426046 conn(0x55e0b5b36c80 msgr2=0x55e0b5bed520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:55.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.297+0000 7f01b9f7bb80 1 -- 172.21.15.73:0/258426046 shutdown_connections 2023-08-10T11:51:55.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.297+0000 7f01b9f7bb80 1 -- 172.21.15.73:0/258426046 wait complete. 2023-08-10T11:51:55.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.297+0000 7f01b9f7bb80 20 client.15111 trim_cache size 0 max 16384 2023-08-10T11:51:55.308 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:51:55.308 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "0e619a74-3773-11ee-9b37-001a4aab830c", 2023-08-10T11:51:55.308 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2023-08-10T11:51:55.308 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 24503, 2023-08-10T11:51:55.309 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2023-08-10T11:51:55.309 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2023-08-10T11:51:55.309 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2023-08-10T11:51:55.309 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 60.392185703000003, 2023-08-10T11:51:55.309 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 27, 2023-08-10T11:51:55.309 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 85, 2023-08-10T11:51:55.309 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 83, 2023-08-10T11:51:55.309 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 65.612470375000001 2023-08-10T11:51:55.310 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:51:55.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.297+0000 7f01adde2700 1 -- 172.21.15.73:0/3610054174 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f01940a11e0 msgr2=0x7f01940a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:55.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.297+0000 7f01adde2700 1 --2- 172.21.15.73:0/3610054174 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f01940a11e0 0x7f01940a36a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0190005fd0 tx=0x7f0190005ee0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.297+0000 7f01adde2700 1 -- 172.21.15.73:0/3610054174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01a8103b10 msgr2=0x7f01a8196920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:55.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.297+0000 7f01adde2700 1 --2- 172.21.15.73:0/3610054174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01a8103b10 0x7f01a8196920 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0198000c00 tx=0x7f019800f710 comp rx=0 tx=0).stop 2023-08-10T11:51:55.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.297+0000 7f01adde2700 1 -- 172.21.15.73:0/3610054174 shutdown_connections 2023-08-10T11:51:55.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.297+0000 7f01adde2700 1 --2- 172.21.15.73:0/3610054174 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f01940a11e0 0x7f01940a36a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.297+0000 7f01adde2700 1 --2- 172.21.15.73:0/3610054174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01a8106440 0x7f01a819d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.297+0000 7f01adde2700 1 --2- 172.21.15.73:0/3610054174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01a81011e0 0x7f01a81963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.297+0000 7f01adde2700 1 --2- 172.21.15.73:0/3610054174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01a8103b10 0x7f01a8196920 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:55.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.297+0000 7f01adde2700 1 -- 172.21.15.73:0/3610054174 >> 172.21.15.73:0/3610054174 conn(0x7f01a80fabd0 msgr2=0x7f01a8101e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:55.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.297+0000 7f01adde2700 1 -- 172.21.15.73:0/3610054174 shutdown_connections 2023-08-10T11:51:55.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:55.297+0000 7f01adde2700 1 -- 172.21.15.73:0/3610054174 wait complete. 2023-08-10T11:51:55.313 INFO:tasks.cephadm:Setup complete, yielding 2023-08-10T11:51:55.313 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-08-10T11:51:55.324 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi073.front.sepia.ceph.com 2023-08-10T11:51:55.325 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- bash -c 'ceph orch status' 2023-08-10T11:51:55.874 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:55.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:55 smithi152 ceph-mon[130220]: pgmap v288: 97 pgs: 1 activating+degraded, 2 activating, 94 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 6 op/s; 6/306 objects degraded (1.961%); 0 B/s, 0 objects/s recovering 2023-08-10T11:51:56.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:55 smithi156 ceph-mon[130574]: pgmap v288: 97 pgs: 1 activating+degraded, 2 activating, 94 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 6 op/s; 6/306 objects degraded (1.961%); 0 B/s, 0 objects/s recovering 2023-08-10T11:51:56.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:55 smithi073 ceph-mon[128869]: pgmap v288: 97 pgs: 1 activating+degraded, 2 activating, 94 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 6 op/s; 6/306 objects degraded (1.961%); 0 B/s, 0 objects/s recovering 2023-08-10T11:51:56.878 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:56 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:51:56.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:56 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:51:57.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:56 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:51:57.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.444+0000 7f5ba43ab700 1 -- 172.21.15.73:0/571661716 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b9c0ff700 msgr2=0x7f5b9c0ffb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:57.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.444+0000 7f5ba43ab700 1 --2- 172.21.15.73:0/571661716 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b9c0ff700 0x7f5b9c0ffb20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c0099c0 tx=0x7f5b8c009cd0 comp rx=0 tx=0).stop 2023-08-10T11:51:57.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.444+0000 7f5ba43ab700 1 -- 172.21.15.73:0/571661716 shutdown_connections 2023-08-10T11:51:57.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.444+0000 7f5ba43ab700 1 --2- 172.21.15.73:0/571661716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b9c1012a0 0x7f5b9c107b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:57.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.444+0000 7f5ba43ab700 1 --2- 172.21.15.73:0/571661716 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b9c0ff700 0x7f5b9c0ffb20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:57.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.444+0000 7f5ba43ab700 1 --2- 172.21.15.73:0/571661716 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b9c100900 0x7f5b9c100d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:57.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.444+0000 7f5ba43ab700 1 -- 172.21.15.73:0/571661716 >> 172.21.15.73:0/571661716 conn(0x7f5b9c0fac80 msgr2=0x7f5b9c0fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:57.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.444+0000 7f5ba43ab700 1 -- 172.21.15.73:0/571661716 shutdown_connections 2023-08-10T11:51:57.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.444+0000 7f5ba43ab700 1 -- 172.21.15.73:0/571661716 wait complete. 2023-08-10T11:51:57.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.445+0000 7f5ba43ab700 1 Processor -- start 2023-08-10T11:51:57.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.445+0000 7f5ba43ab700 1 -- start start 2023-08-10T11:51:57.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.445+0000 7f5ba43ab700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b9c0ff700 0x7f5b9c1986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:57.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.445+0000 7f5ba43ab700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b9c100900 0x7f5b9c198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:57.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.445+0000 7f5ba43ab700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b9c1012a0 0x7f5b9c19fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:57.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.445+0000 7f5ba43ab700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c1a0240 con 0x7f5b9c1012a0 2023-08-10T11:51:57.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.445+0000 7f5ba43ab700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c1a0380 con 0x7f5b9c100900 2023-08-10T11:51:57.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.445+0000 7f5ba43ab700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c1a0510 con 0x7f5b9c0ff700 2023-08-10T11:51:57.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.446+0000 7f5ba2948700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b9c1012a0 0x7f5b9c19fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:57.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.446+0000 7f5ba2948700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b9c1012a0 0x7f5b9c19fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59964/0 (socket says 172.21.15.73:59964) 2023-08-10T11:51:57.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.446+0000 7f5ba2948700 1 -- 172.21.15.73:0/2085242348 learned_addr learned my addr 172.21.15.73:0/2085242348 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:51:57.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.446+0000 7f5ba1946700 1 --2- 172.21.15.73:0/2085242348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b9c100900 0x7f5b9c198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:57.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.446+0000 7f5ba2147700 1 --2- 172.21.15.73:0/2085242348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b9c0ff700 0x7f5b9c1986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:57.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.446+0000 7f5ba2948700 1 -- 172.21.15.73:0/2085242348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b9c0ff700 msgr2=0x7f5b9c1986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:57.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.446+0000 7f5ba2948700 1 --2- 172.21.15.73:0/2085242348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b9c0ff700 0x7f5b9c1986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:57.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.446+0000 7f5ba2948700 1 -- 172.21.15.73:0/2085242348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b9c100900 msgr2=0x7f5b9c198bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:57.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.446+0000 7f5ba2948700 1 --2- 172.21.15.73:0/2085242348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b9c100900 0x7f5b9c198bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:57.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.446+0000 7f5ba2948700 1 -- 172.21.15.73:0/2085242348 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8c0095f0 con 0x7f5b9c1012a0 2023-08-10T11:51:57.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.446+0000 7f5ba2147700 1 --2- 172.21.15.73:0/2085242348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b9c0ff700 0x7f5b9c1986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:51:57.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.446+0000 7f5ba2948700 1 --2- 172.21.15.73:0/2085242348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b9c1012a0 0x7f5b9c19fc70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5b94007f10 tx=0x7f5b9400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:57.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.446+0000 7f5b937fe700 1 -- 172.21.15.73:0/2085242348 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94017070 con 0x7f5b9c1012a0 2023-08-10T11:51:57.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.446+0000 7f5b937fe700 1 -- 172.21.15.73:0/2085242348 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b9400f040 con 0x7f5b9c1012a0 2023-08-10T11:51:57.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.446+0000 7f5ba43ab700 1 -- 172.21.15.73:0/2085242348 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b9c1a07f0 con 0x7f5b9c1012a0 2023-08-10T11:51:57.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.446+0000 7f5b937fe700 1 -- 172.21.15.73:0/2085242348 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94005740 con 0x7f5b9c1012a0 2023-08-10T11:51:57.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.446+0000 7f5ba43ab700 1 -- 172.21.15.73:0/2085242348 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b9c1a0ca0 con 0x7f5b9c1012a0 2023-08-10T11:51:57.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.447+0000 7f5ba43ab700 1 -- 172.21.15.73:0/2085242348 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b9c10af00 con 0x7f5b9c1012a0 2023-08-10T11:51:57.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.448+0000 7f5b937fe700 1 -- 172.21.15.73:0/2085242348 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f5b940058a0 con 0x7f5b9c1012a0 2023-08-10T11:51:57.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.449+0000 7f5b937fe700 1 --2- 172.21.15.73:0/2085242348 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5b880a11e0 0x7f5b880a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:51:57.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.449+0000 7f5ba2147700 1 --2- 172.21.15.73:0/2085242348 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5b880a11e0 0x7f5b880a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:51:57.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.449+0000 7f5b937fe700 1 -- 172.21.15.73:0/2085242348 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5b940cc0d0 con 0x7f5b9c1012a0 2023-08-10T11:51:57.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.449+0000 7f5ba2147700 1 --2- 172.21.15.73:0/2085242348 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5b880a11e0 0x7f5b880a36a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c009990 tx=0x7f5b8c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:51:57.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.453+0000 7f5b937fe700 1 -- 172.21.15.73:0/2085242348 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f5b940956d0 con 0x7f5b9c1012a0 2023-08-10T11:51:57.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.675+0000 7f5ba43ab700 1 -- 172.21.15.73:0/2085242348 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b9c068a00 con 0x7f5b880a11e0 2023-08-10T11:51:57.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.676+0000 7f5b937fe700 1 -- 172.21.15.73:0/2085242348 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f5b9c068a00 con 0x7f5b880a11e0 2023-08-10T11:51:57.677 INFO:teuthology.orchestra.run.smithi073.stdout:Backend: cephadm 2023-08-10T11:51:57.677 INFO:teuthology.orchestra.run.smithi073.stdout:Available: Yes 2023-08-10T11:51:57.677 INFO:teuthology.orchestra.run.smithi073.stdout:Paused: No 2023-08-10T11:51:57.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.678+0000 7f5ba43ab700 1 -- 172.21.15.73:0/2085242348 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5b880a11e0 msgr2=0x7f5b880a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:57.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.678+0000 7f5ba43ab700 1 --2- 172.21.15.73:0/2085242348 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5b880a11e0 0x7f5b880a36a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c009990 tx=0x7f5b8c01a040 comp rx=0 tx=0).stop 2023-08-10T11:51:57.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.678+0000 7f5ba43ab700 1 -- 172.21.15.73:0/2085242348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b9c1012a0 msgr2=0x7f5b9c19fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:51:57.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.678+0000 7f5ba43ab700 1 --2- 172.21.15.73:0/2085242348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b9c1012a0 0x7f5b9c19fc70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5b94007f10 tx=0x7f5b9400d3b0 comp rx=0 tx=0).stop 2023-08-10T11:51:57.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.678+0000 7f5ba43ab700 1 -- 172.21.15.73:0/2085242348 shutdown_connections 2023-08-10T11:51:57.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.678+0000 7f5ba43ab700 1 --2- 172.21.15.73:0/2085242348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b9c1012a0 0x7f5b9c19fc70 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:57.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.678+0000 7f5ba43ab700 1 --2- 172.21.15.73:0/2085242348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b9c0ff700 0x7f5b9c1986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:57.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.678+0000 7f5ba43ab700 1 --2- 172.21.15.73:0/2085242348 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f5b880a11e0 0x7f5b880a36a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:57.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.678+0000 7f5ba43ab700 1 --2- 172.21.15.73:0/2085242348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b9c100900 0x7f5b9c198bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:51:57.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.679+0000 7f5ba43ab700 1 -- 172.21.15.73:0/2085242348 >> 172.21.15.73:0/2085242348 conn(0x7f5b9c0fac80 msgr2=0x7f5b9c0682f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:51:57.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.679+0000 7f5ba43ab700 1 -- 172.21.15.73:0/2085242348 shutdown_connections 2023-08-10T11:51:57.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:51:57.679+0000 7f5ba43ab700 1 -- 172.21.15.73:0/2085242348 wait complete. 2023-08-10T11:51:57.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:57 smithi152 ceph-mon[130220]: pgmap v289: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s; 83 B/s, 0 objects/s recovering 2023-08-10T11:51:57.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:57 smithi152 ceph-mon[130220]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/306 objects degraded (1.961%), 1 pg degraded) 2023-08-10T11:51:57.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:57 smithi152 ceph-mon[130220]: Cluster is now healthy 2023-08-10T11:51:58.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:57 smithi156 ceph-mon[130574]: pgmap v289: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s; 83 B/s, 0 objects/s recovering 2023-08-10T11:51:58.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:57 smithi156 ceph-mon[130574]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/306 objects degraded (1.961%), 1 pg degraded) 2023-08-10T11:51:58.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:57 smithi156 ceph-mon[130574]: Cluster is now healthy 2023-08-10T11:51:58.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:57 smithi073 ceph-mon[128869]: pgmap v289: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s; 83 B/s, 0 objects/s recovering 2023-08-10T11:51:58.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:57 smithi073 ceph-mon[128869]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/306 objects degraded (1.961%), 1 pg degraded) 2023-08-10T11:51:58.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:57 smithi073 ceph-mon[128869]: Cluster is now healthy 2023-08-10T11:51:58.223 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- bash -c 'ceph orch ps' 2023-08-10T11:51:58.781 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:51:58.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:58 smithi152 ceph-mon[130220]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:51:59.005 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:58 smithi073 ceph-mon[128869]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:51:59.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:58 smithi156 ceph-mon[130574]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:51:59.872 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:59 smithi073 ceph-mon[128869]: pgmap v290: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s; 68 B/s, 0 objects/s recovering 2023-08-10T11:51:59.872 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:59 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:51:59.872 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:59 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:51:59.872 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:59 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:51:59.872 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:51:59 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:51:59.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:59 smithi152 ceph-mon[130220]: pgmap v290: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s; 68 B/s, 0 objects/s recovering 2023-08-10T11:51:59.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:59 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:51:59.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:59 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:51:59.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:59 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:51:59.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:51:59 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:52:00.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:59 smithi156 ceph-mon[130574]: pgmap v290: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s; 68 B/s, 0 objects/s recovering 2023-08-10T11:52:00.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:59 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:52:00.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:59 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:52:00.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:59 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:52:00.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:51:59 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:52:00.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.110+0000 7f7c686f4700 1 -- 172.21.15.73:0/3911614568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c601012a0 msgr2=0x7f7c60107b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:00.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.110+0000 7f7c686f4700 1 --2- 172.21.15.73:0/3911614568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c601012a0 0x7f7c60107b50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800b0d0 tx=0x7f7c5800b3e0 comp rx=0 tx=0).stop 2023-08-10T11:52:00.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.110+0000 7f7c686f4700 1 -- 172.21.15.73:0/3911614568 shutdown_connections 2023-08-10T11:52:00.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.110+0000 7f7c686f4700 1 --2- 172.21.15.73:0/3911614568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c600ff700 0x7f7c600ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:00.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.110+0000 7f7c686f4700 1 --2- 172.21.15.73:0/3911614568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c601012a0 0x7f7c60107b50 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:00.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.110+0000 7f7c686f4700 1 --2- 172.21.15.73:0/3911614568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c60100900 0x7f7c60100d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:00.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.110+0000 7f7c686f4700 1 -- 172.21.15.73:0/3911614568 >> 172.21.15.73:0/3911614568 conn(0x7f7c600fac80 msgr2=0x7f7c600fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:00.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.110+0000 7f7c686f4700 1 -- 172.21.15.73:0/3911614568 shutdown_connections 2023-08-10T11:52:00.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.110+0000 7f7c686f4700 1 -- 172.21.15.73:0/3911614568 wait complete. 2023-08-10T11:52:00.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.111+0000 7f7c686f4700 1 Processor -- start 2023-08-10T11:52:00.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.111+0000 7f7c686f4700 1 -- start start 2023-08-10T11:52:00.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.111+0000 7f7c686f4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c600ff700 0x7f7c601953e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:00.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.111+0000 7f7c686f4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c60100900 0x7f7c60195920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:00.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.111+0000 7f7c686f4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c601012a0 0x7f7c6019c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:00.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.111+0000 7f7c686f4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6019cf70 con 0x7f7c60100900 2023-08-10T11:52:00.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.111+0000 7f7c686f4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6019d0b0 con 0x7f7c600ff700 2023-08-10T11:52:00.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.111+0000 7f7c686f4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6019d240 con 0x7f7c601012a0 2023-08-10T11:52:00.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.111+0000 7f7c65c8f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c60100900 0x7f7c60195920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:00.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.111+0000 7f7c65c8f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c60100900 0x7f7c60195920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59972/0 (socket says 172.21.15.73:59972) 2023-08-10T11:52:00.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.111+0000 7f7c65c8f700 1 -- 172.21.15.73:0/1336477594 learned_addr learned my addr 172.21.15.73:0/1336477594 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:00.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.111+0000 7f7c66490700 1 --2- 172.21.15.73:0/1336477594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c600ff700 0x7f7c601953e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:00.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.111+0000 7f7c66c91700 1 --2- 172.21.15.73:0/1336477594 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c601012a0 0x7f7c6019c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:00.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.111+0000 7f7c65c8f700 1 -- 172.21.15.73:0/1336477594 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c601012a0 msgr2=0x7f7c6019c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:00.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.111+0000 7f7c65c8f700 1 --2- 172.21.15.73:0/1336477594 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c601012a0 0x7f7c6019c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:00.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.111+0000 7f7c65c8f700 1 -- 172.21.15.73:0/1336477594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c600ff700 msgr2=0x7f7c601953e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:00.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.111+0000 7f7c65c8f700 1 --2- 172.21.15.73:0/1336477594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c600ff700 0x7f7c601953e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:00.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.111+0000 7f7c65c8f700 1 -- 172.21.15.73:0/1336477594 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c58009d00 con 0x7f7c60100900 2023-08-10T11:52:00.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.111+0000 7f7c65c8f700 1 --2- 172.21.15.73:0/1336477594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c60100900 0x7f7c60195920 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00d9b0 tx=0x7f7c5c00dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:00.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.112+0000 7f7c577fe700 1 -- 172.21.15.73:0/1336477594 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c00bb60 con 0x7f7c60100900 2023-08-10T11:52:00.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.112+0000 7f7c686f4700 1 -- 172.21.15.73:0/1336477594 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6019d520 con 0x7f7c60100900 2023-08-10T11:52:00.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.112+0000 7f7c577fe700 1 -- 172.21.15.73:0/1336477594 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c5c007e80 con 0x7f7c60100900 2023-08-10T11:52:00.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.112+0000 7f7c577fe700 1 -- 172.21.15.73:0/1336477594 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c004dd0 con 0x7f7c60100900 2023-08-10T11:52:00.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.112+0000 7f7c686f4700 1 -- 172.21.15.73:0/1336477594 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6019da70 con 0x7f7c60100900 2023-08-10T11:52:00.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.113+0000 7f7c686f4700 1 -- 172.21.15.73:0/1336477594 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6010af10 con 0x7f7c60100900 2023-08-10T11:52:00.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.114+0000 7f7c577fe700 1 -- 172.21.15.73:0/1336477594 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f7c5c004020 con 0x7f7c60100900 2023-08-10T11:52:00.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.114+0000 7f7c577fe700 1 --2- 172.21.15.73:0/1336477594 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f7c4c0a11e0 0x7f7c4c0a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:00.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.114+0000 7f7c66490700 1 --2- 172.21.15.73:0/1336477594 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f7c4c0a11e0 0x7f7c4c0a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:00.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.114+0000 7f7c577fe700 1 -- 172.21.15.73:0/1336477594 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7c5c0cc9a0 con 0x7f7c60100900 2023-08-10T11:52:00.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.115+0000 7f7c66490700 1 --2- 172.21.15.73:0/1336477594 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f7c4c0a11e0 0x7f7c4c0a36a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7c50005fd0 tx=0x7f7c50005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:00.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.119+0000 7f7c577fe700 1 -- 172.21.15.73:0/1336477594 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f7c5c095fa0 con 0x7f7c60100900 2023-08-10T11:52:00.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.333+0000 7f7c686f4700 1 -- 172.21.15.73:0/1336477594 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c60060bb0 con 0x7f7c4c0a11e0 2023-08-10T11:52:00.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.346+0000 7f7c577fe700 1 -- 172.21.15.73:0/1336477594 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7f7c60060bb0 con 0x7f7c4c0a11e0 2023-08-10T11:52:00.346 INFO:teuthology.orchestra.run.smithi073.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-08-10T11:52:00.347 INFO:teuthology.orchestra.run.smithi073.stdout:mds.a smithi073 running (73s) - 72s 17.0M - 18.0.0-5118-ga8bf445f 97af32c09d74 687bbfe1b2d1 2023-08-10T11:52:00.347 INFO:teuthology.orchestra.run.smithi073.stdout:mds.b smithi152 running (71s) - 70s 29.8M - 18.0.0-5118-ga8bf445f 97af32c09d74 da46feb2056d 2023-08-10T11:52:00.347 INFO:teuthology.orchestra.run.smithi073.stdout:mds.c smithi156 running (82s) - 81s 17.4M - 18.0.0-5118-ga8bf445f 97af32c09d74 36d5ad46729e 2023-08-10T11:52:00.347 INFO:teuthology.orchestra.run.smithi073.stdout:mds.d smithi073 running (89s) - 88s 14.9M - 18.0.0-5118-ga8bf445f 97af32c09d74 d51aa060b9f1 2023-08-10T11:52:00.347 INFO:teuthology.orchestra.run.smithi073.stdout:mds.e smithi152 running (86s) - 86s 19.5M - 18.0.0-5118-ga8bf445f 97af32c09d74 4617e7bf52b9 2023-08-10T11:52:00.347 INFO:teuthology.orchestra.run.smithi073.stdout:mds.f smithi156 running (84s) - 84s 19.7M - 18.0.0-5118-ga8bf445f 97af32c09d74 c23a295ba7b3 2023-08-10T11:52:00.347 INFO:teuthology.orchestra.run.smithi073.stdout:mds.g smithi073 running (75s) - 74s 17.0M - 18.0.0-5118-ga8bf445f 97af32c09d74 83da60ed07fd 2023-08-10T11:52:00.347 INFO:teuthology.orchestra.run.smithi073.stdout:mds.h smithi152 running (79s) - 79s 22.2M - 18.0.0-5118-ga8bf445f 97af32c09d74 e6f5768568c7 2023-08-10T11:52:00.348 INFO:teuthology.orchestra.run.smithi073.stdout:mds.i smithi156 running (77s) - 77s 20.8M - 18.0.0-5118-ga8bf445f 97af32c09d74 a1f988e73aee 2023-08-10T11:52:00.348 INFO:teuthology.orchestra.run.smithi073.stdout:mds.j smithi073 running (91s) - 90s 14.2M - 18.0.0-5118-ga8bf445f 97af32c09d74 8193c1af06e2 2023-08-10T11:52:00.348 INFO:teuthology.orchestra.run.smithi073.stdout:mds.k smithi152 running (93s) - 93s 19.1M - 18.0.0-5118-ga8bf445f 97af32c09d74 17c81e507fbb 2023-08-10T11:52:00.348 INFO:teuthology.orchestra.run.smithi073.stdout:mds.l smithi156 running (95s) - 95s 19.4M - 18.0.0-5118-ga8bf445f 97af32c09d74 e6f48c61db4d 2023-08-10T11:52:00.348 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.x smithi073 *:9283,8765 running (8m) - 8m 518M - 18.0.0-5118-ga8bf445f 97af32c09d74 da36eba39ca7 2023-08-10T11:52:00.348 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.y smithi152 *:8443,8765 running (6m) - 6m 447M - 18.0.0-5118-ga8bf445f 97af32c09d74 c62c688b1b3c 2023-08-10T11:52:00.348 INFO:teuthology.orchestra.run.smithi073.stdout:mgr.z smithi156 *:8443,8765 running (6m) - 6m 449M - 18.0.0-5118-ga8bf445f 97af32c09d74 8c7b2f1d2ace 2023-08-10T11:52:00.349 INFO:teuthology.orchestra.run.smithi073.stdout:mon.a smithi073 running (8m) - 8m 94.0M 2048M 18.0.0-5118-ga8bf445f 97af32c09d74 ab60269aff98 2023-08-10T11:52:00.349 INFO:teuthology.orchestra.run.smithi073.stdout:mon.b smithi152 running (6m) - 6m 61.9M 2048M 18.0.0-5118-ga8bf445f 97af32c09d74 7703f321492c 2023-08-10T11:52:00.349 INFO:teuthology.orchestra.run.smithi073.stdout:mon.c smithi156 running (6m) - 6m 64.0M 2048M 18.0.0-5118-ga8bf445f 97af32c09d74 10d9f2d1b2d9 2023-08-10T11:52:00.349 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 smithi073 running (5m) - 5m 64.1M 4292M 18.0.0-5118-ga8bf445f 97af32c09d74 5ad00bc0b0e7 2023-08-10T11:52:00.349 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 smithi152 running (5m) - 5m 70.2M 4292M 18.0.0-5118-ga8bf445f 97af32c09d74 63104bbb3447 2023-08-10T11:52:00.349 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 smithi156 running (5m) - 5m 67.2M 4292M 18.0.0-5118-ga8bf445f 97af32c09d74 47403fbbd28f 2023-08-10T11:52:00.349 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 smithi073 running (4m) - 4m 60.6M 4292M 18.0.0-5118-ga8bf445f 97af32c09d74 7f692ded42c2 2023-08-10T11:52:00.349 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 smithi152 running (4m) - 4m 59.0M 4292M 18.0.0-5118-ga8bf445f 97af32c09d74 9197e2d7d2c4 2023-08-10T11:52:00.350 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 smithi156 running (4m) - 4m 62.4M 4292M 18.0.0-5118-ga8bf445f 97af32c09d74 04a54ede729d 2023-08-10T11:52:00.350 INFO:teuthology.orchestra.run.smithi073.stdout:osd.6 smithi073 running (3m) - 3m 60.4M 4292M 18.0.0-5118-ga8bf445f 97af32c09d74 6b3a6d3b0c37 2023-08-10T11:52:00.350 INFO:teuthology.orchestra.run.smithi073.stdout:osd.7 smithi152 running (3m) - 3m 61.1M 4292M 18.0.0-5118-ga8bf445f 97af32c09d74 a6b0cfdb6346 2023-08-10T11:52:00.350 INFO:teuthology.orchestra.run.smithi073.stdout:osd.8 smithi156 running (2m) - 2m 58.9M 4292M 18.0.0-5118-ga8bf445f 97af32c09d74 ac08cab08396 2023-08-10T11:52:00.350 INFO:teuthology.orchestra.run.smithi073.stdout:osd.9 smithi073 running (2m) - 2m 58.4M 4292M 18.0.0-5118-ga8bf445f 97af32c09d74 6dba54499561 2023-08-10T11:52:00.350 INFO:teuthology.orchestra.run.smithi073.stdout:osd.10 smithi152 running (2m) - 2m 60.2M 4292M 18.0.0-5118-ga8bf445f 97af32c09d74 e8e9ae3486d8 2023-08-10T11:52:00.350 INFO:teuthology.orchestra.run.smithi073.stdout:osd.11 smithi156 running (114s) - 114s 52.0M 4292M 18.0.0-5118-ga8bf445f 97af32c09d74 8baad2d60770 2023-08-10T11:52:00.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.348+0000 7f7c686f4700 1 -- 172.21.15.73:0/1336477594 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f7c4c0a11e0 msgr2=0x7f7c4c0a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:00.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.348+0000 7f7c686f4700 1 --2- 172.21.15.73:0/1336477594 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f7c4c0a11e0 0x7f7c4c0a36a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7c50005fd0 tx=0x7f7c50005e50 comp rx=0 tx=0).stop 2023-08-10T11:52:00.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.348+0000 7f7c686f4700 1 -- 172.21.15.73:0/1336477594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c60100900 msgr2=0x7f7c60195920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:00.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.348+0000 7f7c686f4700 1 --2- 172.21.15.73:0/1336477594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c60100900 0x7f7c60195920 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00d9b0 tx=0x7f7c5c00dd70 comp rx=0 tx=0).stop 2023-08-10T11:52:00.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.348+0000 7f7c686f4700 1 -- 172.21.15.73:0/1336477594 shutdown_connections 2023-08-10T11:52:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.348+0000 7f7c686f4700 1 --2- 172.21.15.73:0/1336477594 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f7c4c0a11e0 0x7f7c4c0a36a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.348+0000 7f7c686f4700 1 --2- 172.21.15.73:0/1336477594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c600ff700 0x7f7c601953e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.348+0000 7f7c686f4700 1 --2- 172.21.15.73:0/1336477594 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c601012a0 0x7f7c6019c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.348+0000 7f7c686f4700 1 --2- 172.21.15.73:0/1336477594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c60100900 0x7f7c60195920 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.348+0000 7f7c686f4700 1 -- 172.21.15.73:0/1336477594 >> 172.21.15.73:0/1336477594 conn(0x7f7c600fac80 msgr2=0x7f7c600fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.348+0000 7f7c686f4700 1 -- 172.21.15.73:0/1336477594 shutdown_connections 2023-08-10T11:52:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:00.348+0000 7f7c686f4700 1 -- 172.21.15.73:0/1336477594 wait complete. 2023-08-10T11:52:00.838 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- bash -c 'ceph orch ls' 2023-08-10T11:52:01.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:00 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:52:01.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:00 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:52:01.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:00 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:52:01.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:00 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:52:01.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:00 smithi152 ceph-mon[130220]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:52:01.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:00 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:52:01.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:00 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:52:01.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:00 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:52:01.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:00 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:52:01.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:00 smithi156 ceph-mon[130574]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:52:01.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:00 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:52:01.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:00 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:52:01.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:00 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:52:01.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:00 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:52:01.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:00 smithi073 ceph-mon[128869]: from='mgr.14152 172.21.15.73:0/70661837' entity='mgr.x' 2023-08-10T11:52:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:52:01.939 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:01 smithi073 ceph-mon[128869]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:52:01.940 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:01 smithi073 ceph-mon[128869]: pgmap v291: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 61 B/s, 0 objects/s recovering 2023-08-10T11:52:02.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:01 smithi152 ceph-mon[130220]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:52:02.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:01 smithi152 ceph-mon[130220]: pgmap v291: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 61 B/s, 0 objects/s recovering 2023-08-10T11:52:02.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:01 smithi156 ceph-mon[130574]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:52:02.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:01 smithi156 ceph-mon[130574]: pgmap v291: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 61 B/s, 0 objects/s recovering 2023-08-10T11:52:02.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.732+0000 7f88d8534700 1 -- 172.21.15.73:0/1424928696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88d0100830 msgr2=0x7f88d0100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:02.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.732+0000 7f88d8534700 1 --2- 172.21.15.73:0/1424928696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88d0100830 0x7f88d0100c50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0099c0 tx=0x7f88cc009cd0 comp rx=0 tx=0).stop 2023-08-10T11:52:02.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.733+0000 7f88d8534700 1 -- 172.21.15.73:0/1424928696 shutdown_connections 2023-08-10T11:52:02.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.733+0000 7f88d8534700 1 --2- 172.21.15.73:0/1424928696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88d01023d0 0x7f88d0108c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:02.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.733+0000 7f88d8534700 1 --2- 172.21.15.73:0/1424928696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88d0100830 0x7f88d0100c50 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:02.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.733+0000 7f88d8534700 1 --2- 172.21.15.73:0/1424928696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88d0101a30 0x7f88d0101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:02.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.733+0000 7f88d8534700 1 -- 172.21.15.73:0/1424928696 >> 172.21.15.73:0/1424928696 conn(0x7f88d00fbdf0 msgr2=0x7f88d00fe210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:02.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.733+0000 7f88d8534700 1 -- 172.21.15.73:0/1424928696 shutdown_connections 2023-08-10T11:52:02.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.733+0000 7f88d8534700 1 -- 172.21.15.73:0/1424928696 wait complete. 2023-08-10T11:52:02.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.733+0000 7f88d8534700 1 Processor -- start 2023-08-10T11:52:02.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.733+0000 7f88d8534700 1 -- start start 2023-08-10T11:52:02.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.733+0000 7f88d8534700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88d0100830 0x7f88d0074510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:02.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.733+0000 7f88d8534700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88d0101a30 0x7f88d0072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:02.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.733+0000 7f88d8534700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88d01023d0 0x7f88d00730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:02.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.733+0000 7f88d8534700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d0073820 con 0x7f88d0100830 2023-08-10T11:52:02.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.733+0000 7f88d8534700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d0073990 con 0x7f88d01023d0 2023-08-10T11:52:02.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.733+0000 7f88d8534700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d01a05e0 con 0x7f88d0101a30 2023-08-10T11:52:02.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.733+0000 7f88d62d0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88d0100830 0x7f88d0074510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:02.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.734+0000 7f88d62d0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88d0100830 0x7f88d0074510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59982/0 (socket says 172.21.15.73:59982) 2023-08-10T11:52:02.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.734+0000 7f88d62d0700 1 -- 172.21.15.73:0/2007506175 learned_addr learned my addr 172.21.15.73:0/2007506175 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:02.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.734+0000 7f88d5acf700 1 --2- 172.21.15.73:0/2007506175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88d0101a30 0x7f88d0072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:02.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.734+0000 7f88d6ad1700 1 --2- 172.21.15.73:0/2007506175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88d01023d0 0x7f88d00730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:02.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.734+0000 7f88d62d0700 1 -- 172.21.15.73:0/2007506175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88d0101a30 msgr2=0x7f88d0072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:02.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.734+0000 7f88d62d0700 1 --2- 172.21.15.73:0/2007506175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88d0101a30 0x7f88d0072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:02.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.734+0000 7f88d62d0700 1 -- 172.21.15.73:0/2007506175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88d01023d0 msgr2=0x7f88d00730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:02.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.734+0000 7f88d62d0700 1 --2- 172.21.15.73:0/2007506175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88d01023d0 0x7f88d00730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:02.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.734+0000 7f88d62d0700 1 -- 172.21.15.73:0/2007506175 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88cc0095f0 con 0x7f88d0100830 2023-08-10T11:52:02.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.734+0000 7f88d6ad1700 1 --2- 172.21.15.73:0/2007506175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88d01023d0 0x7f88d00730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:52:02.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.734+0000 7f88d62d0700 1 --2- 172.21.15.73:0/2007506175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88d0100830 0x7f88d0074510 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f88cc009990 tx=0x7f88cc003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:02.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.734+0000 7f88c77fe700 1 -- 172.21.15.73:0/2007506175 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc01d070 con 0x7f88d0100830 2023-08-10T11:52:02.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.734+0000 7f88d8534700 1 -- 172.21.15.73:0/2007506175 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d01a0860 con 0x7f88d0100830 2023-08-10T11:52:02.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.734+0000 7f88c77fe700 1 -- 172.21.15.73:0/2007506175 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f88cc004640 con 0x7f88d0100830 2023-08-10T11:52:02.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.734+0000 7f88c77fe700 1 -- 172.21.15.73:0/2007506175 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc00f460 con 0x7f88d0100830 2023-08-10T11:52:02.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.734+0000 7f88d8534700 1 -- 172.21.15.73:0/2007506175 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d01a0d00 con 0x7f88d0100830 2023-08-10T11:52:02.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.735+0000 7f88d8534700 1 -- 172.21.15.73:0/2007506175 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d0107e20 con 0x7f88d0100830 2023-08-10T11:52:02.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.736+0000 7f88c77fe700 1 -- 172.21.15.73:0/2007506175 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f88cc004050 con 0x7f88d0100830 2023-08-10T11:52:02.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.737+0000 7f88c77fe700 1 --2- 172.21.15.73:0/2007506175 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f88bc0a11e0 0x7f88bc0a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:02.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.737+0000 7f88c77fe700 1 -- 172.21.15.73:0/2007506175 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f88cc0cdfa0 con 0x7f88d0100830 2023-08-10T11:52:02.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.737+0000 7f88d5acf700 1 --2- 172.21.15.73:0/2007506175 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f88bc0a11e0 0x7f88bc0a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:02.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.737+0000 7f88d5acf700 1 --2- 172.21.15.73:0/2007506175 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f88bc0a11e0 0x7f88bc0a36a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f88c0005fd0 tx=0x7f88c000a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:02.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.741+0000 7f88c77fe700 1 -- 172.21.15.73:0/2007506175 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f88cc097630 con 0x7f88d0100830 2023-08-10T11:52:02.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.934+0000 7f88d8534700 1 -- 172.21.15.73:0/2007506175 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f88d0060bb0 con 0x7f88bc0a11e0 2023-08-10T11:52:02.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.939+0000 7f88c77fe700 1 -- 172.21.15.73:0/2007506175 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+985 (secure 0 0 0) 0x7f88d0060bb0 con 0x7f88bc0a11e0 2023-08-10T11:52:02.939 INFO:teuthology.orchestra.run.smithi073.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-08-10T11:52:02.940 INFO:teuthology.orchestra.run.smithi073.stdout:mds.all 12/12 - 100s smithi073=a;smithi073=d;smithi073=g;smithi073=j;smithi152=b;smithi152=e;smithi152=h;smithi152=k;smithi156=c;smithi156=f;smithi156=i;smithi156=l;count:12 2023-08-10T11:52:02.940 INFO:teuthology.orchestra.run.smithi073.stdout:mgr 3/3 - 6m smithi073=x;smithi152=y;smithi156=z;count:3 2023-08-10T11:52:02.940 INFO:teuthology.orchestra.run.smithi073.stdout:mon 3/3 - 6m smithi073:172.21.15.73=a;smithi152:172.21.15.152=b;smithi156:172.21.15.156=c;count:3 2023-08-10T11:52:02.940 INFO:teuthology.orchestra.run.smithi073.stdout:osd 12 - - 2023-08-10T11:52:02.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.941+0000 7f88d8534700 1 -- 172.21.15.73:0/2007506175 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f88bc0a11e0 msgr2=0x7f88bc0a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:02.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.941+0000 7f88d8534700 1 --2- 172.21.15.73:0/2007506175 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f88bc0a11e0 0x7f88bc0a36a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f88c0005fd0 tx=0x7f88c000a560 comp rx=0 tx=0).stop 2023-08-10T11:52:02.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.941+0000 7f88d8534700 1 -- 172.21.15.73:0/2007506175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88d0100830 msgr2=0x7f88d0074510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:02.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.941+0000 7f88d8534700 1 --2- 172.21.15.73:0/2007506175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88d0100830 0x7f88d0074510 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f88cc009990 tx=0x7f88cc003ba0 comp rx=0 tx=0).stop 2023-08-10T11:52:02.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.941+0000 7f88d8534700 1 -- 172.21.15.73:0/2007506175 shutdown_connections 2023-08-10T11:52:02.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.941+0000 7f88d8534700 1 --2- 172.21.15.73:0/2007506175 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f88bc0a11e0 0x7f88bc0a36a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.941+0000 7f88d8534700 1 --2- 172.21.15.73:0/2007506175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88d01023d0 0x7f88d00730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.941+0000 7f88d8534700 1 --2- 172.21.15.73:0/2007506175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88d0100830 0x7f88d0074510 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.941+0000 7f88d8534700 1 --2- 172.21.15.73:0/2007506175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88d0101a30 0x7f88d0072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.941+0000 7f88d8534700 1 -- 172.21.15.73:0/2007506175 >> 172.21.15.73:0/2007506175 conn(0x7f88d00fbdf0 msgr2=0x7f88d0104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.941+0000 7f88d8534700 1 -- 172.21.15.73:0/2007506175 shutdown_connections 2023-08-10T11:52:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:02.941+0000 7f88d8534700 1 -- 172.21.15.73:0/2007506175 wait complete. 2023-08-10T11:52:03.341 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- bash -c 'ceph orch host ls' 2023-08-10T11:52:03.895 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:52:04.128 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:03 smithi073 ceph-mon[128869]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 55 B/s, 0 objects/s recovering 2023-08-10T11:52:04.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:03 smithi152 ceph-mon[130220]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 55 B/s, 0 objects/s recovering 2023-08-10T11:52:04.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:03 smithi156 ceph-mon[130574]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 55 B/s, 0 objects/s recovering 2023-08-10T11:52:05.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.219+0000 7f2d1b203700 1 -- 172.21.15.73:0/3313337382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d14100900 msgr2=0x7f2d14100d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:05.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.219+0000 7f2d1b203700 1 --2- 172.21.15.73:0/3313337382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d14100900 0x7f2d14100d60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2d000099c0 tx=0x7f2d00009cd0 comp rx=0 tx=0).stop 2023-08-10T11:52:05.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.219+0000 7f2d1b203700 1 -- 172.21.15.73:0/3313337382 shutdown_connections 2023-08-10T11:52:05.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.219+0000 7f2d1b203700 1 --2- 172.21.15.73:0/3313337382 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d141012a0 0x7f2d14107b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:05.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.219+0000 7f2d1b203700 1 --2- 172.21.15.73:0/3313337382 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d140ff700 0x7f2d140ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:05.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.219+0000 7f2d1b203700 1 --2- 172.21.15.73:0/3313337382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d14100900 0x7f2d14100d60 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:05.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.219+0000 7f2d1b203700 1 -- 172.21.15.73:0/3313337382 >> 172.21.15.73:0/3313337382 conn(0x7f2d140fac80 msgr2=0x7f2d140fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:05.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.219+0000 7f2d1b203700 1 -- 172.21.15.73:0/3313337382 shutdown_connections 2023-08-10T11:52:05.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.219+0000 7f2d1b203700 1 -- 172.21.15.73:0/3313337382 wait complete. 2023-08-10T11:52:05.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.220+0000 7f2d1b203700 1 Processor -- start 2023-08-10T11:52:05.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.220+0000 7f2d1b203700 1 -- start start 2023-08-10T11:52:05.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.220+0000 7f2d1b203700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d140ff700 0x7f2d14195370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:05.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.221+0000 7f2d1b203700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d14100900 0x7f2d141958b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:05.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.221+0000 7f2d1b203700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d141012a0 0x7f2d1419c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:05.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.221+0000 7f2d1b203700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1419cf00 con 0x7f2d140ff700 2023-08-10T11:52:05.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.221+0000 7f2d1b203700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1419d040 con 0x7f2d141012a0 2023-08-10T11:52:05.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.221+0000 7f2d1b203700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1419d1d0 con 0x7f2d14100900 2023-08-10T11:52:05.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.221+0000 7f2d18f9f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d140ff700 0x7f2d14195370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:05.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.221+0000 7f2d18f9f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d140ff700 0x7f2d14195370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59994/0 (socket says 172.21.15.73:59994) 2023-08-10T11:52:05.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.221+0000 7f2d18f9f700 1 -- 172.21.15.73:0/1196308921 learned_addr learned my addr 172.21.15.73:0/1196308921 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:05.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.221+0000 7f2d13fff700 1 --2- 172.21.15.73:0/1196308921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d14100900 0x7f2d141958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:05.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.221+0000 7f2d18f9f700 1 -- 172.21.15.73:0/1196308921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d14100900 msgr2=0x7f2d141958b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:05.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.221+0000 7f2d18f9f700 1 --2- 172.21.15.73:0/1196308921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d14100900 0x7f2d141958b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:05.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.221+0000 7f2d18f9f700 1 -- 172.21.15.73:0/1196308921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d141012a0 msgr2=0x7f2d1419c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:05.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.221+0000 7f2d18f9f700 1 --2- 172.21.15.73:0/1196308921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d141012a0 0x7f2d1419c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:05.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.221+0000 7f2d18f9f700 1 -- 172.21.15.73:0/1196308921 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d000095f0 con 0x7f2d140ff700 2023-08-10T11:52:05.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.221+0000 7f2d18f9f700 1 --2- 172.21.15.73:0/1196308921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d140ff700 0x7f2d14195370 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2d0800d9b0 tx=0x7f2d0800dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:05.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.221+0000 7f2d11ffb700 1 -- 172.21.15.73:0/1196308921 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0800be80 con 0x7f2d140ff700 2023-08-10T11:52:05.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.221+0000 7f2d11ffb700 1 -- 172.21.15.73:0/1196308921 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d080044e0 con 0x7f2d140ff700 2023-08-10T11:52:05.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.221+0000 7f2d1b203700 1 -- 172.21.15.73:0/1196308921 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1419d4b0 con 0x7f2d140ff700 2023-08-10T11:52:05.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.221+0000 7f2d11ffb700 1 -- 172.21.15.73:0/1196308921 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08003b40 con 0x7f2d140ff700 2023-08-10T11:52:05.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.221+0000 7f2d1b203700 1 -- 172.21.15.73:0/1196308921 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1419da00 con 0x7f2d140ff700 2023-08-10T11:52:05.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.222+0000 7f2d1b203700 1 -- 172.21.15.73:0/1196308921 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d14106ca0 con 0x7f2d140ff700 2023-08-10T11:52:05.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.223+0000 7f2d11ffb700 1 -- 172.21.15.73:0/1196308921 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f2d08009940 con 0x7f2d140ff700 2023-08-10T11:52:05.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.224+0000 7f2d11ffb700 1 --2- 172.21.15.73:0/1196308921 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f2d040a12e0 0x7f2d040a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:05.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.224+0000 7f2d13fff700 1 --2- 172.21.15.73:0/1196308921 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f2d040a12e0 0x7f2d040a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:05.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.224+0000 7f2d11ffb700 1 -- 172.21.15.73:0/1196308921 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2d080cc830 con 0x7f2d140ff700 2023-08-10T11:52:05.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.224+0000 7f2d13fff700 1 --2- 172.21.15.73:0/1196308921 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f2d040a12e0 0x7f2d040a37a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2d00000c00 tx=0x7f2d00005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:05.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.228+0000 7f2d11ffb700 1 -- 172.21.15.73:0/1196308921 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f2d08095dd0 con 0x7f2d140ff700 2023-08-10T11:52:05.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:04 smithi152 ceph-mon[130220]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:52:05.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:04 smithi156 ceph-mon[130574]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:52:05.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:04 smithi073 ceph-mon[128869]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:52:05.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.422+0000 7f2d1b203700 1 -- 172.21.15.73:0/1196308921 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d14060bb0 con 0x7f2d040a12e0 2023-08-10T11:52:05.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.424+0000 7f2d11ffb700 1 -- 172.21.15.73:0/1196308921 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f2d14060bb0 con 0x7f2d040a12e0 2023-08-10T11:52:05.424 INFO:teuthology.orchestra.run.smithi073.stdout:HOST ADDR LABELS STATUS 2023-08-10T11:52:05.424 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073 172.21.15.73 2023-08-10T11:52:05.425 INFO:teuthology.orchestra.run.smithi073.stdout:smithi152 172.21.15.152 2023-08-10T11:52:05.425 INFO:teuthology.orchestra.run.smithi073.stdout:smithi156 172.21.15.156 2023-08-10T11:52:05.425 INFO:teuthology.orchestra.run.smithi073.stdout:3 hosts in cluster 2023-08-10T11:52:05.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.426+0000 7f2d1b203700 1 -- 172.21.15.73:0/1196308921 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f2d040a12e0 msgr2=0x7f2d040a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:05.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.426+0000 7f2d1b203700 1 --2- 172.21.15.73:0/1196308921 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f2d040a12e0 0x7f2d040a37a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2d00000c00 tx=0x7f2d00005fb0 comp rx=0 tx=0).stop 2023-08-10T11:52:05.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.426+0000 7f2d1b203700 1 -- 172.21.15.73:0/1196308921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d140ff700 msgr2=0x7f2d14195370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:05.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.426+0000 7f2d1b203700 1 --2- 172.21.15.73:0/1196308921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d140ff700 0x7f2d14195370 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2d0800d9b0 tx=0x7f2d0800dd70 comp rx=0 tx=0).stop 2023-08-10T11:52:05.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.426+0000 7f2d1b203700 1 -- 172.21.15.73:0/1196308921 shutdown_connections 2023-08-10T11:52:05.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.426+0000 7f2d1b203700 1 --2- 172.21.15.73:0/1196308921 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f2d040a12e0 0x7f2d040a37a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:05.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.426+0000 7f2d1b203700 1 --2- 172.21.15.73:0/1196308921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d141012a0 0x7f2d1419c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:05.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.426+0000 7f2d1b203700 1 --2- 172.21.15.73:0/1196308921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d140ff700 0x7f2d14195370 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:05.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.426+0000 7f2d1b203700 1 --2- 172.21.15.73:0/1196308921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d14100900 0x7f2d141958b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:05.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.426+0000 7f2d1b203700 1 -- 172.21.15.73:0/1196308921 >> 172.21.15.73:0/1196308921 conn(0x7f2d140fac80 msgr2=0x7f2d14103de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:05.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.426+0000 7f2d1b203700 1 -- 172.21.15.73:0/1196308921 shutdown_connections 2023-08-10T11:52:05.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:05.426+0000 7f2d1b203700 1 -- 172.21.15.73:0/1196308921 wait complete. 2023-08-10T11:52:05.852 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- bash -c 'ceph orch device ls' 2023-08-10T11:52:06.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:05 smithi152 ceph-mon[130220]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 55 B/s, 0 objects/s recovering 2023-08-10T11:52:06.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:05 smithi156 ceph-mon[130574]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 55 B/s, 0 objects/s recovering 2023-08-10T11:52:06.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:05 smithi073 ceph-mon[128869]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 55 B/s, 0 objects/s recovering 2023-08-10T11:52:06.403 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:52:07.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:06 smithi073 ceph-mon[128869]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:52:07.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:06 smithi152 ceph-mon[130220]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:52:07.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:06 smithi156 ceph-mon[130574]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:52:08.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.093+0000 7f3f2783f700 1 -- 172.21.15.73:0/2051059914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f201012a0 msgr2=0x7f3f20107b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:08.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.093+0000 7f3f2783f700 1 --2- 172.21.15.73:0/2051059914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f201012a0 0x7f3f20107b50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800b0d0 tx=0x7f3f1800b3e0 comp rx=0 tx=0).stop 2023-08-10T11:52:08.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.094+0000 7f3f2783f700 1 -- 172.21.15.73:0/2051059914 shutdown_connections 2023-08-10T11:52:08.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.094+0000 7f3f2783f700 1 --2- 172.21.15.73:0/2051059914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f201012a0 0x7f3f20107b50 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.094+0000 7f3f2783f700 1 --2- 172.21.15.73:0/2051059914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f200ff700 0x7f3f200ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.094+0000 7f3f2783f700 1 --2- 172.21.15.73:0/2051059914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f20100900 0x7f3f20100d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.094+0000 7f3f2783f700 1 -- 172.21.15.73:0/2051059914 >> 172.21.15.73:0/2051059914 conn(0x7f3f200fac80 msgr2=0x7f3f200fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.094+0000 7f3f2783f700 1 -- 172.21.15.73:0/2051059914 shutdown_connections 2023-08-10T11:52:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.094+0000 7f3f2783f700 1 -- 172.21.15.73:0/2051059914 wait complete. 2023-08-10T11:52:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.094+0000 7f3f2783f700 1 Processor -- start 2023-08-10T11:52:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.094+0000 7f3f2783f700 1 -- start start 2023-08-10T11:52:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.095+0000 7f3f2783f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f200ff700 0x7f3f20069680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.095+0000 7f3f2783f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f20100900 0x7f3f2019b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.095+0000 7f3f2783f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f201012a0 0x7f3f2019d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.095+0000 7f3f2783f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2019e0a0 con 0x7f3f200ff700 2023-08-10T11:52:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.095+0000 7f3f2783f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2019e210 con 0x7f3f201012a0 2023-08-10T11:52:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.095+0000 7f3f2783f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2019e3d0 con 0x7f3f20100900 2023-08-10T11:52:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.095+0000 7f3f255db700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f200ff700 0x7f3f20069680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.095+0000 7f3f255db700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f200ff700 0x7f3f20069680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60004/0 (socket says 172.21.15.73:60004) 2023-08-10T11:52:08.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.095+0000 7f3f255db700 1 -- 172.21.15.73:0/3539217336 learned_addr learned my addr 172.21.15.73:0/3539217336 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:08.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.095+0000 7f3f24dda700 1 --2- 172.21.15.73:0/3539217336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f20100900 0x7f3f2019b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:08.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.095+0000 7f3f25ddc700 1 --2- 172.21.15.73:0/3539217336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f201012a0 0x7f3f2019d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:08.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.095+0000 7f3f255db700 1 -- 172.21.15.73:0/3539217336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f20100900 msgr2=0x7f3f2019b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:08.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.095+0000 7f3f255db700 1 --2- 172.21.15.73:0/3539217336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f20100900 0x7f3f2019b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:08.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.095+0000 7f3f255db700 1 -- 172.21.15.73:0/3539217336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f201012a0 msgr2=0x7f3f2019d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:08.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.095+0000 7f3f255db700 1 --2- 172.21.15.73:0/3539217336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f201012a0 0x7f3f2019d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.095+0000 7f3f255db700 1 -- 172.21.15.73:0/3539217336 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f18009d00 con 0x7f3f200ff700 2023-08-10T11:52:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.095+0000 7f3f25ddc700 1 --2- 172.21.15.73:0/3539217336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f201012a0 0x7f3f2019d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:52:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.095+0000 7f3f255db700 1 --2- 172.21.15.73:0/3539217336 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f200ff700 0x7f3f20069680 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000c990 tx=0x7f3f1000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.095+0000 7f3f167fc700 1 -- 172.21.15.73:0/3539217336 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f10007b00 con 0x7f3f200ff700 2023-08-10T11:52:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.095+0000 7f3f167fc700 1 -- 172.21.15.73:0/3539217336 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f10007c60 con 0x7f3f200ff700 2023-08-10T11:52:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.095+0000 7f3f2783f700 1 -- 172.21.15.73:0/3539217336 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f2019e6b0 con 0x7f3f200ff700 2023-08-10T11:52:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.095+0000 7f3f167fc700 1 -- 172.21.15.73:0/3539217336 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f10018660 con 0x7f3f200ff700 2023-08-10T11:52:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.095+0000 7f3f2783f700 1 -- 172.21.15.73:0/3539217336 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f2019ec30 con 0x7f3f200ff700 2023-08-10T11:52:08.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.096+0000 7f3f2783f700 1 -- 172.21.15.73:0/3539217336 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f20106bb0 con 0x7f3f200ff700 2023-08-10T11:52:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.097+0000 7f3f167fc700 1 -- 172.21.15.73:0/3539217336 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f3f1000f450 con 0x7f3f200ff700 2023-08-10T11:52:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.098+0000 7f3f167fc700 1 --2- 172.21.15.73:0/3539217336 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3f0c0a11e0 0x7f3f0c0a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.098+0000 7f3f167fc700 1 -- 172.21.15.73:0/3539217336 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3f100ccab0 con 0x7f3f200ff700 2023-08-10T11:52:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.098+0000 7f3f24dda700 1 --2- 172.21.15.73:0/3539217336 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3f0c0a11e0 0x7f3f0c0a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.098+0000 7f3f24dda700 1 --2- 172.21.15.73:0/3539217336 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3f0c0a11e0 0x7f3f0c0a36a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c009a10 tx=0x7f3f1c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.101+0000 7f3f167fc700 1 -- 172.21.15.73:0/3539217336 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f3f10096140 con 0x7f3f200ff700 2023-08-10T11:52:08.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:07 smithi152 ceph-mon[130220]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 55 B/s, 0 objects/s recovering 2023-08-10T11:52:08.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:07 smithi156 ceph-mon[130574]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 55 B/s, 0 objects/s recovering 2023-08-10T11:52:08.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:07 smithi073 ceph-mon[128869]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 55 B/s, 0 objects/s recovering 2023-08-10T11:52:08.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.295+0000 7f3f2783f700 1 -- 172.21.15.73:0/3539217336 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f20060bb0 con 0x7f3f0c0a11e0 2023-08-10T11:52:08.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.296+0000 7f3f167fc700 1 -- 172.21.15.73:0/3539217336 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+492 (secure 0 0 0) 0x7f3f20060bb0 con 0x7f3f0c0a11e0 2023-08-10T11:52:08.298 INFO:teuthology.orchestra.run.smithi073.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-08-10T11:52:08.298 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040115400BGN 372G No 2m ago LVM detected, locked 2023-08-10T11:52:08.298 INFO:teuthology.orchestra.run.smithi073.stdout:smithi152 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JT400BGN 372G No 2m ago LVM detected, locked 2023-08-10T11:52:08.299 INFO:teuthology.orchestra.run.smithi073.stdout:smithi156 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB74760040480DGN 447G No 116s ago LVM detected, locked 2023-08-10T11:52:08.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.298+0000 7f3f2783f700 1 -- 172.21.15.73:0/3539217336 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3f0c0a11e0 msgr2=0x7f3f0c0a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:08.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.298+0000 7f3f2783f700 1 --2- 172.21.15.73:0/3539217336 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3f0c0a11e0 0x7f3f0c0a36a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c009a10 tx=0x7f3f1c009190 comp rx=0 tx=0).stop 2023-08-10T11:52:08.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.298+0000 7f3f2783f700 1 -- 172.21.15.73:0/3539217336 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f200ff700 msgr2=0x7f3f20069680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:08.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.298+0000 7f3f2783f700 1 --2- 172.21.15.73:0/3539217336 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f200ff700 0x7f3f20069680 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000c990 tx=0x7f3f1000cca0 comp rx=0 tx=0).stop 2023-08-10T11:52:08.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.298+0000 7f3f2783f700 1 -- 172.21.15.73:0/3539217336 shutdown_connections 2023-08-10T11:52:08.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.298+0000 7f3f2783f700 1 --2- 172.21.15.73:0/3539217336 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3f0c0a11e0 0x7f3f0c0a36a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:08.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.298+0000 7f3f2783f700 1 --2- 172.21.15.73:0/3539217336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f201012a0 0x7f3f2019d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:08.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.298+0000 7f3f2783f700 1 --2- 172.21.15.73:0/3539217336 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f200ff700 0x7f3f20069680 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:08.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.298+0000 7f3f2783f700 1 --2- 172.21.15.73:0/3539217336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f20100900 0x7f3f2019b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:08.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.298+0000 7f3f2783f700 1 -- 172.21.15.73:0/3539217336 >> 172.21.15.73:0/3539217336 conn(0x7f3f200fac80 msgr2=0x7f3f20103cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:08.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.299+0000 7f3f2783f700 1 -- 172.21.15.73:0/3539217336 shutdown_connections 2023-08-10T11:52:08.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:08.299+0000 7f3f2783f700 1 -- 172.21.15.73:0/3539217336 wait complete. 2023-08-10T11:52:08.864 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-08-10T11:52:08.874 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi073.front.sepia.ceph.com 2023-08-10T11:52:08.874 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- bash -c 'ceph fs dump' 2023-08-10T11:52:09.429 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:52:10.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:09 smithi073 ceph-mon[128869]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:52:10.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:09 smithi073 ceph-mon[128869]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T11:52:10.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:09 smithi152 ceph-mon[130220]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:52:10.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:09 smithi152 ceph-mon[130220]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T11:52:10.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:09 smithi156 ceph-mon[130574]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:52:10.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:09 smithi156 ceph-mon[130574]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T11:52:10.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.838+0000 7f3b1c1f5700 1 -- 172.21.15.73:0/139211903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b14102440 msgr2=0x7f3b14108cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:10.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.838+0000 7f3b1c1f5700 1 --2- 172.21.15.73:0/139211903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b14102440 0x7f3b14108cf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00b0a0 tx=0x7f3b0c00b3b0 comp rx=0 tx=0).stop 2023-08-10T11:52:10.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.838+0000 7f3b1c1f5700 1 -- 172.21.15.73:0/139211903 shutdown_connections 2023-08-10T11:52:10.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.838+0000 7f3b1c1f5700 1 --2- 172.21.15.73:0/139211903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b14102440 0x7f3b14108cf0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:10.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.839+0000 7f3b1c1f5700 1 --2- 172.21.15.73:0/139211903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b140feac0 0x7f3b140feee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:10.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.839+0000 7f3b1c1f5700 1 --2- 172.21.15.73:0/139211903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b14101aa0 0x7f3b14101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:10.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.839+0000 7f3b1c1f5700 1 -- 172.21.15.73:0/139211903 >> 172.21.15.73:0/139211903 conn(0x7f3b140fa420 msgr2=0x7f3b140fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:10.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.839+0000 7f3b1c1f5700 1 -- 172.21.15.73:0/139211903 shutdown_connections 2023-08-10T11:52:10.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.839+0000 7f3b1c1f5700 1 -- 172.21.15.73:0/139211903 wait complete. 2023-08-10T11:52:10.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.839+0000 7f3b1c1f5700 1 Processor -- start 2023-08-10T11:52:10.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.839+0000 7f3b1c1f5700 1 -- start start 2023-08-10T11:52:10.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.839+0000 7f3b1c1f5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b140feac0 0x7f3b14196560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:10.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.839+0000 7f3b1c1f5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b14101aa0 0x7f3b14196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:10.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.839+0000 7f3b1c1f5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b14102440 0x7f3b1419db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:10.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.839+0000 7f3b1c1f5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1419e0f0 con 0x7f3b140feac0 2023-08-10T11:52:10.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.839+0000 7f3b1c1f5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1419e230 con 0x7f3b14101aa0 2023-08-10T11:52:10.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.839+0000 7f3b1c1f5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1419e3c0 con 0x7f3b14102440 2023-08-10T11:52:10.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.839+0000 7f3b19f91700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b140feac0 0x7f3b14196560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:10.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.840+0000 7f3b19f91700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b140feac0 0x7f3b14196560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60016/0 (socket says 172.21.15.73:60016) 2023-08-10T11:52:10.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.840+0000 7f3b19f91700 1 -- 172.21.15.73:0/137639518 learned_addr learned my addr 172.21.15.73:0/137639518 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:10.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.840+0000 7f3b1a792700 1 --2- 172.21.15.73:0/137639518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b14102440 0x7f3b1419db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:10.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.840+0000 7f3b19790700 1 --2- 172.21.15.73:0/137639518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b14101aa0 0x7f3b14196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:10.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.840+0000 7f3b19f91700 1 -- 172.21.15.73:0/137639518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b14102440 msgr2=0x7f3b1419db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:10.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.840+0000 7f3b19f91700 1 --2- 172.21.15.73:0/137639518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b14102440 0x7f3b1419db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:10.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.840+0000 7f3b19f91700 1 -- 172.21.15.73:0/137639518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b14101aa0 msgr2=0x7f3b14196aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:10.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.840+0000 7f3b19f91700 1 --2- 172.21.15.73:0/137639518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b14101aa0 0x7f3b14196aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:10.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.840+0000 7f3b19f91700 1 -- 172.21.15.73:0/137639518 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0c009d00 con 0x7f3b140feac0 2023-08-10T11:52:10.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.840+0000 7f3b19790700 1 --2- 172.21.15.73:0/137639518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b14101aa0 0x7f3b14196aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:52:10.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.840+0000 7f3b19f91700 1 --2- 172.21.15.73:0/137639518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b140feac0 0x7f3b14196560 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400c9c0 tx=0x7f3b0400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:10.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.840+0000 7f3b0affd700 1 -- 172.21.15.73:0/137639518 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04007ac0 con 0x7f3b140feac0 2023-08-10T11:52:10.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.840+0000 7f3b0affd700 1 -- 172.21.15.73:0/137639518 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b04007c20 con 0x7f3b140feac0 2023-08-10T11:52:10.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.840+0000 7f3b1c1f5700 1 -- 172.21.15.73:0/137639518 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b1419e6a0 con 0x7f3b140feac0 2023-08-10T11:52:10.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.840+0000 7f3b0affd700 1 -- 172.21.15.73:0/137639518 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04018660 con 0x7f3b140feac0 2023-08-10T11:52:10.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.840+0000 7f3b1c1f5700 1 -- 172.21.15.73:0/137639518 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b1419ec70 con 0x7f3b140feac0 2023-08-10T11:52:10.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.841+0000 7f3b1c1f5700 1 -- 172.21.15.73:0/137639518 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b14107da0 con 0x7f3b140feac0 2023-08-10T11:52:10.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.842+0000 7f3b0affd700 1 -- 172.21.15.73:0/137639518 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f3b0400f450 con 0x7f3b140feac0 2023-08-10T11:52:10.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.843+0000 7f3b0affd700 1 --2- 172.21.15.73:0/137639518 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3b000a1260 0x7f3b000a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:10.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.843+0000 7f3b19790700 1 --2- 172.21.15.73:0/137639518 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3b000a1260 0x7f3b000a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:10.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.843+0000 7f3b0affd700 1 -- 172.21.15.73:0/137639518 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3b040cc960 con 0x7f3b140feac0 2023-08-10T11:52:10.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.843+0000 7f3b19790700 1 --2- 172.21.15.73:0/137639518 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3b000a1260 0x7f3b000a3720 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3b10007900 tx=0x7f3b10008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:10.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:10.847+0000 7f3b0affd700 1 -- 172.21.15.73:0/137639518 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f3b04095f60 con 0x7f3b140feac0 2023-08-10T11:52:11.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:11.076+0000 7f3b1c1f5700 1 -- 172.21.15.73:0/137639518 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3b1402cbd0 con 0x7f3b140feac0 2023-08-10T11:52:11.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:11.076+0000 7f3b0affd700 1 -- 172.21.15.73:0/137639518 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+2926 (secure 0 0 0) 0x7f3b04099580 con 0x7f3b140feac0 2023-08-10T11:52:11.078 INFO:teuthology.orchestra.run.smithi073.stdout:e27 2023-08-10T11:52:11.078 INFO:teuthology.orchestra.run.smithi073.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-08-10T11:52:11.078 INFO:teuthology.orchestra.run.smithi073.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-08-10T11:52:11.078 INFO:teuthology.orchestra.run.smithi073.stdout:legacy client fscid: 1 2023-08-10T11:52:11.079 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:52:11.079 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 'cephfs' (1) 2023-08-10T11:52:11.079 INFO:teuthology.orchestra.run.smithi073.stdout:fs_name cephfs 2023-08-10T11:52:11.079 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 27 2023-08-10T11:52:11.079 INFO:teuthology.orchestra.run.smithi073.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-08-10T11:52:11.079 INFO:teuthology.orchestra.run.smithi073.stdout:created 2023-08-10T11:50:54.304447+0000 2023-08-10T11:52:11.079 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2023-08-10T11:51:01.523452+0000 2023-08-10T11:52:11.080 INFO:teuthology.orchestra.run.smithi073.stdout:tableserver 0 2023-08-10T11:52:11.080 INFO:teuthology.orchestra.run.smithi073.stdout:root 0 2023-08-10T11:52:11.080 INFO:teuthology.orchestra.run.smithi073.stdout:session_timeout 300 2023-08-10T11:52:11.080 INFO:teuthology.orchestra.run.smithi073.stdout:session_autoclose 300 2023-08-10T11:52:11.080 INFO:teuthology.orchestra.run.smithi073.stdout:max_file_size 1099511627776 2023-08-10T11:52:11.080 INFO:teuthology.orchestra.run.smithi073.stdout:max_xattr_size 65536 2023-08-10T11:52:11.081 INFO:teuthology.orchestra.run.smithi073.stdout:required_client_features {} 2023-08-10T11:52:11.081 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure 0 2023-08-10T11:52:11.081 INFO:teuthology.orchestra.run.smithi073.stdout:last_failure_osd_epoch 0 2023-08-10T11:52:11.081 INFO:teuthology.orchestra.run.smithi073.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-08-10T11:52:11.081 INFO:teuthology.orchestra.run.smithi073.stdout:max_mds 5 2023-08-10T11:52:11.081 INFO:teuthology.orchestra.run.smithi073.stdout:in 0,1,2,3,4 2023-08-10T11:52:11.081 INFO:teuthology.orchestra.run.smithi073.stdout:up {0=24503,1=24479,2=24451,3=24443,4=24419} 2023-08-10T11:52:11.082 INFO:teuthology.orchestra.run.smithi073.stdout:failed 2023-08-10T11:52:11.082 INFO:teuthology.orchestra.run.smithi073.stdout:damaged 2023-08-10T11:52:11.082 INFO:teuthology.orchestra.run.smithi073.stdout:stopped 2023-08-10T11:52:11.082 INFO:teuthology.orchestra.run.smithi073.stdout:data_pools [3] 2023-08-10T11:52:11.082 INFO:teuthology.orchestra.run.smithi073.stdout:metadata_pool 2 2023-08-10T11:52:11.083 INFO:teuthology.orchestra.run.smithi073.stdout:inline_data disabled 2023-08-10T11:52:11.083 INFO:teuthology.orchestra.run.smithi073.stdout:balancer 2023-08-10T11:52:11.083 INFO:teuthology.orchestra.run.smithi073.stdout:bal_rank_mask -1 2023-08-10T11:52:11.083 INFO:teuthology.orchestra.run.smithi073.stdout:standby_count_wanted 0 2023-08-10T11:52:11.083 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b{0:24503} state up:active seq 3 addr [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] compat {c=[1],r=[1],i=[7ff]}] 2023-08-10T11:52:11.083 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.i{0:24475} state up:standby-replay seq 1 addr [v2:172.21.15.156:6838/3361058731,v1:172.21.15.156:6839/3361058731] compat {c=[1],r=[1],i=[7ff]}] 2023-08-10T11:52:11.083 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.h{1:24479} state up:active seq 6 addr [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] compat {c=[1],r=[1],i=[7ff]}] 2023-08-10T11:52:11.084 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c{1:24457} state up:standby-replay seq 1 addr [v2:172.21.15.156:6836/4284306352,v1:172.21.15.156:6837/4284306352] compat {c=[1],r=[1],i=[7ff]}] 2023-08-10T11:52:11.084 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.f{2:24451} state up:active seq 7 addr [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] compat {c=[1],r=[1],i=[7ff]}] 2023-08-10T11:52:11.084 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.l{2:24397} state up:standby-replay seq 1 addr [v2:172.21.15.156:6832/3028461815,v1:172.21.15.156:6833/3028461815] compat {c=[1],r=[1],i=[7ff]}] 2023-08-10T11:52:11.084 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.e{3:24443} state up:active seq 8 addr [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] compat {c=[1],r=[1],i=[7ff]}] 2023-08-10T11:52:11.084 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a{3:14625} state up:standby-replay seq 1 addr [v2:172.21.15.73:6840/3067925859,v1:172.21.15.73:6841/3067925859] compat {c=[1],r=[1],i=[7ff]}] 2023-08-10T11:52:11.084 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.k{4:24419} state up:active seq 10 addr [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] compat {c=[1],r=[1],i=[7ff]}] 2023-08-10T11:52:11.084 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.g{4:14613} state up:standby-replay seq 1 addr [v2:172.21.15.73:6838/1099539481,v1:172.21.15.73:6839/1099539481] compat {c=[1],r=[1],i=[7ff]}] 2023-08-10T11:52:11.084 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:52:11.085 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:52:11.085 INFO:teuthology.orchestra.run.smithi073.stdout:Standby daemons: 2023-08-10T11:52:11.085 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:52:11.085 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.j{-1:14547} state up:standby seq 1 addr [v2:172.21.15.73:6834/1319360725,v1:172.21.15.73:6835/1319360725] compat {c=[1],r=[1],i=[7ff]}] 2023-08-10T11:52:11.085 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d{-1:14559} state up:standby seq 1 addr [v2:172.21.15.73:6836/431221951,v1:172.21.15.73:6837/431221951] compat {c=[1],r=[1],i=[7ff]}] 2023-08-10T11:52:11.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:11.078+0000 7f3b1c1f5700 1 -- 172.21.15.73:0/137639518 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3b000a1260 msgr2=0x7f3b000a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:11.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:11.078+0000 7f3b1c1f5700 1 --2- 172.21.15.73:0/137639518 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3b000a1260 0x7f3b000a3720 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3b10007900 tx=0x7f3b10008040 comp rx=0 tx=0).stop 2023-08-10T11:52:11.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:11.078+0000 7f3b1c1f5700 1 -- 172.21.15.73:0/137639518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b140feac0 msgr2=0x7f3b14196560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:11.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:11.078+0000 7f3b1c1f5700 1 --2- 172.21.15.73:0/137639518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b140feac0 0x7f3b14196560 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400c9c0 tx=0x7f3b0400ccd0 comp rx=0 tx=0).stop 2023-08-10T11:52:11.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:11.078+0000 7f3b1c1f5700 1 -- 172.21.15.73:0/137639518 shutdown_connections 2023-08-10T11:52:11.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:11.078+0000 7f3b1c1f5700 1 --2- 172.21.15.73:0/137639518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b14102440 0x7f3b1419db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:11.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:11.078+0000 7f3b1c1f5700 1 --2- 172.21.15.73:0/137639518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b140feac0 0x7f3b14196560 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:11.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:11.078+0000 7f3b1c1f5700 1 --2- 172.21.15.73:0/137639518 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3b000a1260 0x7f3b000a3720 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:11.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:11.078+0000 7f3b1c1f5700 1 --2- 172.21.15.73:0/137639518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b14101aa0 0x7f3b14196aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:11.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:11.078+0000 7f3b1c1f5700 1 -- 172.21.15.73:0/137639518 >> 172.21.15.73:0/137639518 conn(0x7f3b140fa420 msgr2=0x7f3b14104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:11.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:11.078+0000 7f3b1c1f5700 1 -- 172.21.15.73:0/137639518 shutdown_connections 2023-08-10T11:52:11.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:11.078+0000 7f3b1c1f5700 1 -- 172.21.15.73:0/137639518 wait complete. 2023-08-10T11:52:11.088 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 27 2023-08-10T11:52:11.583 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- bash -c 'ceph osd dump' 2023-08-10T11:52:12.137 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:52:12.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:11 smithi152 ceph-mon[130220]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-08-10T11:52:12.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:11 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/137639518' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-08-10T11:52:12.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:11 smithi156 ceph-mon[130574]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-08-10T11:52:12.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:11 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/137639518' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-08-10T11:52:12.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:11 smithi073 ceph-mon[128869]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-08-10T11:52:12.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:11 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/137639518' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-08-10T11:52:13.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.447+0000 7fd74ec4f700 1 -- 172.21.15.73:0/1980147590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7481023d0 msgr2=0x7fd748108c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:13.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.447+0000 7fd74ec4f700 1 --2- 172.21.15.73:0/1980147590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7481023d0 0x7fd748108c80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd74000b0d0 tx=0x7fd74000b3e0 comp rx=0 tx=0).stop 2023-08-10T11:52:13.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.448+0000 7fd74ec4f700 1 -- 172.21.15.73:0/1980147590 shutdown_connections 2023-08-10T11:52:13.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.448+0000 7fd74ec4f700 1 --2- 172.21.15.73:0/1980147590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd748100830 0x7fd748100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:13.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.448+0000 7fd74ec4f700 1 --2- 172.21.15.73:0/1980147590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7481023d0 0x7fd748108c80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:13.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.448+0000 7fd74ec4f700 1 --2- 172.21.15.73:0/1980147590 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd748101a30 0x7fd748101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:13.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.448+0000 7fd74ec4f700 1 -- 172.21.15.73:0/1980147590 >> 172.21.15.73:0/1980147590 conn(0x7fd7480fbdf0 msgr2=0x7fd7480fe210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:13.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.448+0000 7fd74ec4f700 1 -- 172.21.15.73:0/1980147590 shutdown_connections 2023-08-10T11:52:13.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.448+0000 7fd74ec4f700 1 -- 172.21.15.73:0/1980147590 wait complete. 2023-08-10T11:52:13.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.448+0000 7fd74ec4f700 1 Processor -- start 2023-08-10T11:52:13.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.448+0000 7fd74ec4f700 1 -- start start 2023-08-10T11:52:13.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.448+0000 7fd74ec4f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd748100830 0x7fd748196740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:13.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.448+0000 7fd74ec4f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd748101a30 0x7fd748196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:13.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.448+0000 7fd74ec4f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7481023d0 0x7fd74819dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:13.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.448+0000 7fd74ec4f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74819e2d0 con 0x7fd7481023d0 2023-08-10T11:52:13.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.448+0000 7fd74ec4f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74819e410 con 0x7fd748100830 2023-08-10T11:52:13.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.448+0000 7fd74ec4f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74819e5a0 con 0x7fd748101a30 2023-08-10T11:52:13.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.449+0000 7fd74d1ec700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7481023d0 0x7fd74819dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:13.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.449+0000 7fd74c9eb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd748100830 0x7fd748196740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:13.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.449+0000 7fd74d1ec700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7481023d0 0x7fd74819dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60034/0 (socket says 172.21.15.73:60034) 2023-08-10T11:52:13.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.449+0000 7fd74d1ec700 1 -- 172.21.15.73:0/1960221718 learned_addr learned my addr 172.21.15.73:0/1960221718 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:13.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.449+0000 7fd747fff700 1 --2- 172.21.15.73:0/1960221718 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd748101a30 0x7fd748196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:13.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.449+0000 7fd74d1ec700 1 -- 172.21.15.73:0/1960221718 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd748101a30 msgr2=0x7fd748196c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:13.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.449+0000 7fd74d1ec700 1 --2- 172.21.15.73:0/1960221718 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd748101a30 0x7fd748196c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:13.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.449+0000 7fd74d1ec700 1 -- 172.21.15.73:0/1960221718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd748100830 msgr2=0x7fd748196740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:13.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.449+0000 7fd74d1ec700 1 --2- 172.21.15.73:0/1960221718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd748100830 0x7fd748196740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:13.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.449+0000 7fd74d1ec700 1 -- 172.21.15.73:0/1960221718 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd740009d00 con 0x7fd7481023d0 2023-08-10T11:52:13.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.449+0000 7fd74d1ec700 1 --2- 172.21.15.73:0/1960221718 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7481023d0 0x7fd74819dd00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd74000d010 tx=0x7fd7400094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:13.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.449+0000 7fd745ffb700 1 -- 172.21.15.73:0/1960221718 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74000e040 con 0x7fd7481023d0 2023-08-10T11:52:13.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.449+0000 7fd745ffb700 1 -- 172.21.15.73:0/1960221718 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd740003e10 con 0x7fd7481023d0 2023-08-10T11:52:13.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.449+0000 7fd74ec4f700 1 -- 172.21.15.73:0/1960221718 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd74819e820 con 0x7fd7481023d0 2023-08-10T11:52:13.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.449+0000 7fd745ffb700 1 -- 172.21.15.73:0/1960221718 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd740012b50 con 0x7fd7481023d0 2023-08-10T11:52:13.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.449+0000 7fd74ec4f700 1 -- 172.21.15.73:0/1960221718 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd74819ecb0 con 0x7fd7481023d0 2023-08-10T11:52:13.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.450+0000 7fd74ec4f700 1 -- 172.21.15.73:0/1960221718 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd748107e30 con 0x7fd7481023d0 2023-08-10T11:52:13.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.451+0000 7fd745ffb700 1 -- 172.21.15.73:0/1960221718 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fd740012cb0 con 0x7fd7481023d0 2023-08-10T11:52:13.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.452+0000 7fd745ffb700 1 --2- 172.21.15.73:0/1960221718 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd7380a1260 0x7fd7380a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:13.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.452+0000 7fd74c9eb700 1 --2- 172.21.15.73:0/1960221718 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd7380a1260 0x7fd7380a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:13.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.452+0000 7fd745ffb700 1 -- 172.21.15.73:0/1960221718 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd7400cea80 con 0x7fd7481023d0 2023-08-10T11:52:13.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.452+0000 7fd74c9eb700 1 --2- 172.21.15.73:0/1960221718 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd7380a1260 0x7fd7380a3720 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd748101890 tx=0x7fd73c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:13.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.455+0000 7fd745ffb700 1 -- 172.21.15.73:0/1960221718 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fd7400980b0 con 0x7fd7481023d0 2023-08-10T11:52:13.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.647+0000 7fd74ec4f700 1 -- 172.21.15.73:0/1960221718 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7fd74802c970 con 0x7fd7481023d0 2023-08-10T11:52:13.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.647+0000 7fd745ffb700 1 -- 172.21.15.73:0/1960221718 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v85) v1 ==== 56+0+5276 (secure 0 0 0) 0x7fd74009b6d0 con 0x7fd7481023d0 2023-08-10T11:52:13.649 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 85 2023-08-10T11:52:13.649 INFO:teuthology.orchestra.run.smithi073.stdout:fsid 0e619a74-3773-11ee-9b37-001a4aab830c 2023-08-10T11:52:13.650 INFO:teuthology.orchestra.run.smithi073.stdout:created 2023-08-10T11:43:53.974768+0000 2023-08-10T11:52:13.650 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2023-08-10T11:51:49.637159+0000 2023-08-10T11:52:13.650 INFO:teuthology.orchestra.run.smithi073.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-08-10T11:52:13.650 INFO:teuthology.orchestra.run.smithi073.stdout:crush_version 26 2023-08-10T11:52:13.650 INFO:teuthology.orchestra.run.smithi073.stdout:full_ratio 0.95 2023-08-10T11:52:13.650 INFO:teuthology.orchestra.run.smithi073.stdout:backfillfull_ratio 0.9 2023-08-10T11:52:13.650 INFO:teuthology.orchestra.run.smithi073.stdout:nearfull_ratio 0.85 2023-08-10T11:52:13.650 INFO:teuthology.orchestra.run.smithi073.stdout:require_min_compat_client luminous 2023-08-10T11:52:13.651 INFO:teuthology.orchestra.run.smithi073.stdout:min_compat_client luminous 2023-08-10T11:52:13.651 INFO:teuthology.orchestra.run.smithi073.stdout:require_osd_release reef 2023-08-10T11:52:13.651 INFO:teuthology.orchestra.run.smithi073.stdout:stretch_mode_enabled false 2023-08-10T11:52:13.651 INFO:teuthology.orchestra.run.smithi073.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-08-10T11:52:13.651 INFO:teuthology.orchestra.run.smithi073.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2023-08-10T11:52:13.651 INFO:teuthology.orchestra.run.smithi073.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 83 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2023-08-10T11:52:13.651 INFO:teuthology.orchestra.run.smithi073.stdout:max_osd 12 2023-08-10T11:52:13.652 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 up in weight 1 up_from 8 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6802/2725694252,v1:172.21.15.73:6803/2725694252] [v2:172.21.15.73:6804/2725694252,v1:172.21.15.73:6805/2725694252] exists,up 3219ae18-cc4c-4712-b616-79f6949066e3 2023-08-10T11:52:13.652 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 up in weight 1 up_from 13 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6800/836829168,v1:172.21.15.152:6801/836829168] [v2:172.21.15.152:6802/836829168,v1:172.21.15.152:6803/836829168] exists,up bbfe6cd9-b3d3-4b8d-8814-507a867f8c02 2023-08-10T11:52:13.652 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 up in weight 1 up_from 18 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.156:6800/1789212298,v1:172.21.15.156:6801/1789212298] [v2:172.21.15.156:6802/1789212298,v1:172.21.15.156:6803/1789212298] exists,up f57f5b2c-3208-45c0-beba-8501694b99c5 2023-08-10T11:52:13.652 INFO:teuthology.orchestra.run.smithi073.stdout:osd.3 up in weight 1 up_from 25 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6810/3101572649,v1:172.21.15.73:6811/3101572649] [v2:172.21.15.73:6812/3101572649,v1:172.21.15.73:6813/3101572649] exists,up 18592408-3696-4ab8-ad41-c172b8409829 2023-08-10T11:52:13.652 INFO:teuthology.orchestra.run.smithi073.stdout:osd.4 up in weight 1 up_from 32 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6808/1451517889,v1:172.21.15.152:6809/1451517889] [v2:172.21.15.152:6810/1451517889,v1:172.21.15.152:6811/1451517889] exists,up fb3adb09-8807-42d9-8db9-1867c5fe02da 2023-08-10T11:52:13.652 INFO:teuthology.orchestra.run.smithi073.stdout:osd.5 up in weight 1 up_from 37 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.156:6808/3823368741,v1:172.21.15.156:6809/3823368741] [v2:172.21.15.156:6810/3823368741,v1:172.21.15.156:6811/3823368741] exists,up af58a7bd-4e58-4639-95b2-4a76011b61dc 2023-08-10T11:52:13.652 INFO:teuthology.orchestra.run.smithi073.stdout:osd.6 up in weight 1 up_from 45 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6818/2533620458,v1:172.21.15.73:6819/2533620458] [v2:172.21.15.73:6820/2533620458,v1:172.21.15.73:6821/2533620458] exists,up f6ae502d-4af9-4f6a-8636-b5b683dfdfd9 2023-08-10T11:52:13.652 INFO:teuthology.orchestra.run.smithi073.stdout:osd.7 up in weight 1 up_from 50 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6816/4059538477,v1:172.21.15.152:6817/4059538477] [v2:172.21.15.152:6818/4059538477,v1:172.21.15.152:6819/4059538477] exists,up 398fd334-5f6f-427c-95ae-3244fb466f77 2023-08-10T11:52:13.653 INFO:teuthology.orchestra.run.smithi073.stdout:osd.8 up in weight 1 up_from 57 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.156:6816/96487555,v1:172.21.15.156:6817/96487555] [v2:172.21.15.156:6818/96487555,v1:172.21.15.156:6819/96487555] exists,up 58f46e64-2624-4ad4-bb6a-225624153837 2023-08-10T11:52:13.653 INFO:teuthology.orchestra.run.smithi073.stdout:osd.9 up in weight 1 up_from 65 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6826/2050124321,v1:172.21.15.73:6827/2050124321] [v2:172.21.15.73:6828/2050124321,v1:172.21.15.73:6829/2050124321] exists,up 9389dd5b-da2d-43b6-8bc0-bb1af13f72c8 2023-08-10T11:52:13.653 INFO:teuthology.orchestra.run.smithi073.stdout:osd.10 up in weight 1 up_from 70 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6824/1513186350,v1:172.21.15.152:6825/1513186350] [v2:172.21.15.152:6826/1513186350,v1:172.21.15.152:6827/1513186350] exists,up 563c1e34-3acd-46ab-ba36-e9d87f635e3a 2023-08-10T11:52:13.653 INFO:teuthology.orchestra.run.smithi073.stdout:osd.11 up in weight 1 up_from 78 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.156:6824/737904755,v1:172.21.15.156:6825/737904755] [v2:172.21.15.156:6826/737904755,v1:172.21.15.156:6827/737904755] exists,up f1b55889-14fd-4cc9-bed7-43748086fb77 2023-08-10T11:52:13.653 INFO:teuthology.orchestra.run.smithi073.stdout:pg_upmap_items 2.4 [2,11] 2023-08-10T11:52:13.653 INFO:teuthology.orchestra.run.smithi073.stdout:pg_upmap_items 2.8 [2,11] 2023-08-10T11:52:13.653 INFO:teuthology.orchestra.run.smithi073.stdout:pg_upmap_items 2.1f [8,4] 2023-08-10T11:52:13.653 INFO:teuthology.orchestra.run.smithi073.stdout:pg_upmap_items 3.3 [4,9] 2023-08-10T11:52:13.654 INFO:teuthology.orchestra.run.smithi073.stdout:pg_upmap_items 3.13 [4,9] 2023-08-10T11:52:13.654 INFO:teuthology.orchestra.run.smithi073.stdout:pg_upmap_items 3.18 [3,9] 2023-08-10T11:52:13.654 INFO:teuthology.orchestra.run.smithi073.stdout:pg_upmap_items 3.1a [5,6] 2023-08-10T11:52:13.654 INFO:teuthology.orchestra.run.smithi073.stdout:pg_upmap_items 3.3a [4,8] 2023-08-10T11:52:13.654 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:0/2202785670 expires 2023-08-11T11:44:48.401660+0000 2023-08-10T11:52:13.654 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:6801/16358451 expires 2023-08-11T11:44:48.401660+0000 2023-08-10T11:52:13.654 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:6800/16358451 expires 2023-08-11T11:44:48.401660+0000 2023-08-10T11:52:13.654 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:6801/3290717807 expires 2023-08-11T11:44:25.974867+0000 2023-08-10T11:52:13.655 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:6800/3290717807 expires 2023-08-11T11:44:25.974867+0000 2023-08-10T11:52:13.655 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:0/1447381524 expires 2023-08-11T11:44:48.401660+0000 2023-08-10T11:52:13.655 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:0/2545059698 expires 2023-08-11T11:44:25.974867+0000 2023-08-10T11:52:13.655 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:0/4193457623 expires 2023-08-11T11:44:25.974867+0000 2023-08-10T11:52:13.655 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:0/2561039569 expires 2023-08-11T11:44:25.974867+0000 2023-08-10T11:52:13.655 INFO:teuthology.orchestra.run.smithi073.stdout:blocklist 172.21.15.73:0/2927950081 expires 2023-08-11T11:44:48.401660+0000 2023-08-10T11:52:13.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.650+0000 7fd74ec4f700 1 -- 172.21.15.73:0/1960221718 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd7380a1260 msgr2=0x7fd7380a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:13.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.650+0000 7fd74ec4f700 1 --2- 172.21.15.73:0/1960221718 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd7380a1260 0x7fd7380a3720 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd748101890 tx=0x7fd73c009190 comp rx=0 tx=0).stop 2023-08-10T11:52:13.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.650+0000 7fd74ec4f700 1 -- 172.21.15.73:0/1960221718 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7481023d0 msgr2=0x7fd74819dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:13.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.650+0000 7fd74ec4f700 1 --2- 172.21.15.73:0/1960221718 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7481023d0 0x7fd74819dd00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd74000d010 tx=0x7fd7400094c0 comp rx=0 tx=0).stop 2023-08-10T11:52:13.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.650+0000 7fd74ec4f700 1 -- 172.21.15.73:0/1960221718 shutdown_connections 2023-08-10T11:52:13.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.650+0000 7fd74ec4f700 1 --2- 172.21.15.73:0/1960221718 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd7380a1260 0x7fd7380a3720 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:13.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.650+0000 7fd74ec4f700 1 --2- 172.21.15.73:0/1960221718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd748100830 0x7fd748196740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:13.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.650+0000 7fd74ec4f700 1 --2- 172.21.15.73:0/1960221718 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7481023d0 0x7fd74819dd00 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:13.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.650+0000 7fd74ec4f700 1 --2- 172.21.15.73:0/1960221718 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd748101a30 0x7fd748196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:13.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.650+0000 7fd74ec4f700 1 -- 172.21.15.73:0/1960221718 >> 172.21.15.73:0/1960221718 conn(0x7fd7480fbdf0 msgr2=0x7fd748104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:13.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.650+0000 7fd74ec4f700 1 -- 172.21.15.73:0/1960221718 shutdown_connections 2023-08-10T11:52:13.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:13.650+0000 7fd74ec4f700 1 -- 172.21.15.73:0/1960221718 wait complete. 2023-08-10T11:52:14.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:13 smithi073 ceph-mon[128869]: pgmap v297: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T11:52:14.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:13 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1960221718' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-08-10T11:52:14.181 INFO:teuthology.run_tasks:Running task fs.ready... 2023-08-10T11:52:14.199 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T11:52:14.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:13 smithi152 ceph-mon[130220]: pgmap v297: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T11:52:14.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:13 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1960221718' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-08-10T11:52:14.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:13 smithi156 ceph-mon[130574]: pgmap v297: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T11:52:14.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:13 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1960221718' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-08-10T11:52:14.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.324+0000 7fcf55b3a700 1 -- 172.21.15.73:0/956346309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf50101230 msgr2=0x7fcf50107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:14.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.324+0000 7fcf55b3a700 1 --2- 172.21.15.73:0/956346309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf50101230 0x7fcf50107ae0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800b0d0 tx=0x7fcf4800b3e0 comp rx=0 tx=0).stop 2023-08-10T11:52:14.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.324+0000 7fcf55b3a700 1 -- 172.21.15.73:0/956346309 shutdown_connections 2023-08-10T11:52:14.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.324+0000 7fcf55b3a700 1 --2- 172.21.15.73:0/956346309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf50101230 0x7fcf50107ae0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:14.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.324+0000 7fcf55b3a700 1 --2- 172.21.15.73:0/956346309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf500ff6a0 0x7fcf500ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:14.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.324+0000 7fcf55b3a700 1 --2- 172.21.15.73:0/956346309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf50100890 0x7fcf50100cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:14.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.324+0000 7fcf55b3a700 1 -- 172.21.15.73:0/956346309 >> 172.21.15.73:0/956346309 conn(0x7fcf500fabf0 msgr2=0x7fcf500fd050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:14.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.324+0000 7fcf55b3a700 1 -- 172.21.15.73:0/956346309 shutdown_connections 2023-08-10T11:52:14.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.324+0000 7fcf55b3a700 1 -- 172.21.15.73:0/956346309 wait complete. 2023-08-10T11:52:14.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.325+0000 7fcf55b3a700 1 Processor -- start 2023-08-10T11:52:14.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.325+0000 7fcf55b3a700 1 -- start start 2023-08-10T11:52:14.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.325+0000 7fcf55b3a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf500ff6a0 0x7fcf50195460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:14.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.325+0000 7fcf55b3a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf50100890 0x7fcf501959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:14.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.325+0000 7fcf55b3a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf50101230 0x7fcf5019ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:14.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.325+0000 7fcf55b3a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5019cfe0 con 0x7fcf50101230 2023-08-10T11:52:14.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.325+0000 7fcf55b3a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5019d120 con 0x7fcf500ff6a0 2023-08-10T11:52:14.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.325+0000 7fcf55b3a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5019d2b0 con 0x7fcf50100890 2023-08-10T11:52:14.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.325+0000 7fcf4ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf50101230 0x7fcf5019ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:14.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.325+0000 7fcf4ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf50101230 0x7fcf5019ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60046/0 (socket says 172.21.15.73:60046) 2023-08-10T11:52:14.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.325+0000 7fcf4ffff700 1 -- 172.21.15.73:0/2847314404 learned_addr learned my addr 172.21.15.73:0/2847314404 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:14.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.326+0000 7fcf4f7fe700 1 --2- 172.21.15.73:0/2847314404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf500ff6a0 0x7fcf50195460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:14.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.326+0000 7fcf4ffff700 1 -- 172.21.15.73:0/2847314404 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf50100890 msgr2=0x7fcf501959a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:14.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.326+0000 7fcf4effd700 1 --2- 172.21.15.73:0/2847314404 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf50100890 0x7fcf501959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:14.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.326+0000 7fcf4ffff700 1 --2- 172.21.15.73:0/2847314404 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf50100890 0x7fcf501959a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:14.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.326+0000 7fcf4ffff700 1 -- 172.21.15.73:0/2847314404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf500ff6a0 msgr2=0x7fcf50195460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:14.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.326+0000 7fcf4ffff700 1 --2- 172.21.15.73:0/2847314404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf500ff6a0 0x7fcf50195460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:14.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.326+0000 7fcf4ffff700 1 -- 172.21.15.73:0/2847314404 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf48009d00 con 0x7fcf50101230 2023-08-10T11:52:14.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.326+0000 7fcf4f7fe700 1 --2- 172.21.15.73:0/2847314404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf500ff6a0 0x7fcf50195460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:52:14.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.326+0000 7fcf4ffff700 1 --2- 172.21.15.73:0/2847314404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf50101230 0x7fcf5019ca10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcf48007a00 tx=0x7fcf48009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:14.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.326+0000 7fcf4cff9700 1 -- 172.21.15.73:0/2847314404 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4800e040 con 0x7fcf50101230 2023-08-10T11:52:14.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.326+0000 7fcf4cff9700 1 -- 172.21.15.73:0/2847314404 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf48003e10 con 0x7fcf50101230 2023-08-10T11:52:14.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.326+0000 7fcf55b3a700 1 -- 172.21.15.73:0/2847314404 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5019d530 con 0x7fcf50101230 2023-08-10T11:52:14.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.326+0000 7fcf4cff9700 1 -- 172.21.15.73:0/2847314404 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf48005750 con 0x7fcf50101230 2023-08-10T11:52:14.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.326+0000 7fcf55b3a700 1 -- 172.21.15.73:0/2847314404 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5019d9d0 con 0x7fcf50101230 2023-08-10T11:52:14.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.327+0000 7fcf55b3a700 1 -- 172.21.15.73:0/2847314404 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf50106b40 con 0x7fcf50101230 2023-08-10T11:52:14.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.328+0000 7fcf4cff9700 1 -- 172.21.15.73:0/2847314404 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fcf48012cb0 con 0x7fcf50101230 2023-08-10T11:52:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.329+0000 7fcf4cff9700 1 --2- 172.21.15.73:0/2847314404 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fcf3c0a1220 0x7fcf3c0a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.329+0000 7fcf4f7fe700 1 --2- 172.21.15.73:0/2847314404 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fcf3c0a1220 0x7fcf3c0a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.329+0000 7fcf4cff9700 1 -- 172.21.15.73:0/2847314404 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fcf480ceb50 con 0x7fcf50101230 2023-08-10T11:52:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.329+0000 7fcf4f7fe700 1 --2- 172.21.15.73:0/2847314404 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fcf3c0a1220 0x7fcf3c0a36e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcf501006f0 tx=0x7fcf40008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.333+0000 7fcf4cff9700 1 -- 172.21.15.73:0/2847314404 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fcf480981e0 con 0x7fcf50101230 2023-08-10T11:52:14.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.523+0000 7fcf55b3a700 1 -- 172.21.15.73:0/2847314404 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf5002c970 con 0x7fcf50101230 2023-08-10T11:52:14.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.525+0000 7fcf4cff9700 1 -- 172.21.15.73:0/2847314404 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22482 (secure 0 0 0) 0x7fcf4809b800 con 0x7fcf50101230 2023-08-10T11:52:14.527 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:52:14.527 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":85,"fsid":"0e619a74-3773-11ee-9b37-001a4aab830c","created":"2023-08-10T11:43:53.974768+0000","modified":"2023-08-10T11:51:49.637159+0000","last_up_change":"2023-08-10T11:50:12.914422+0000","last_in_change":"2023-08-10T11:49:54.624543+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T11:46:58.735153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T11:50:52.517974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T11:50:53.465357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3219ae18-cc4c-4712-b616-79f6949066e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6803","nonce":2725694252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6805","nonce":2725694252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6809","nonce":2725694252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6807","nonce":2725694252}]},"public_addr":"172.21.15.73:6803/2725694252","cluster_addr":"172.21.15.73:6805/2725694252","heartbeat_back_addr":"172.21.15.73:6809/2725694252","heartbeat_front_addr":"172.21.15.73:6807/2725694252","state":["exists","up"]},{"osd":1,"uuid":"bbfe6cd9-b3d3-4b8d-8814-507a867f8c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6801","nonce":836829168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6803","nonce":836829168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6807","nonce":836829168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6805","nonce":836829168}]},"public_addr":"172.21.15.152:6801/836829168","cluster_addr":"172.21.15.152:6803/836829168","heartbeat_back_addr":"172.21.15.152:6807/836829168","heartbeat_front_addr":"172.21.15.152:6805/836829168","state":["exists","up"]},{"osd":2,"uuid":"f57f5b2c-3208-45c0-beba-8501694b99c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6801","nonce":1789212298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6803","nonce":1789212298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6807","nonce":1789212298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6805","nonce":1789212298}]},"public_addr":"172.21.15.156:6801/1789212298","cluster_addr":"172.21.15.156:6803/1789212298","heartbeat_back_addr":"172.21.15.156:6807/1789212298","heartbeat_front_addr":"172.21.15.156:6805/1789212298","state":["exists","up"]},{"osd":3,"uuid":"18592408-3696-4ab8-ad41-c172b8409829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6811","nonce":3101572649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6813","nonce":3101572649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6817","nonce":3101572649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6815","nonce":3101572649}]},"public_addr":"172.21.15.73:6811/3101572649","cluster_addr":"172.21.15.73:6813/3101572649","heartbeat_back_addr":"172.21.15.73:6817/3101572649","heartbeat_front_addr":"172.21.15.73:6815/3101572649","state":["exists","up"]},{"osd":4,"uuid":"fb3adb09-8807-42d9-8db9-1867c5fe02da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6809","nonce":1451517889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6811","nonce":1451517889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6815","nonce":1451517889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6813","nonce":1451517889}]},"public_addr":"172.21.15.152:6809/1451517889","cluster_addr":"172.21.15.152:6811/1451517889","heartbeat_back_addr":"172.21.15.152:6815/1451517889","heartbeat_front_addr":"172.21.15.152:6813/1451517889","state":["exists","up"]},{"osd":5,"uuid":"af58a7bd-4e58-4639-95b2-4a76011b61dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6809","nonce":3823368741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6811","nonce":3823368741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6815","nonce":3823368741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6813","nonce":3823368741}]},"public_addr":"172.21.15.156:6809/3823368741","cluster_addr":"172.21.15.156:6811/3823368741","heartbeat_back_addr":"172.21.15.156:6815/3823368741","heartbeat_front_addr":"172.21.15.156:6813/3823368741","state":["exists","up"]},{"osd":6,"uuid":"f6ae502d-4af9-4f6a-8636-b5b683dfdfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6819","nonce":2533620458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6821","nonce":2533620458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6825","nonce":2533620458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6823","nonce":2533620458}]},"public_addr":"172.21.15.73:6819/2533620458","cluster_addr":"172.21.15.73:6821/2533620458","heartbeat_back_addr":"172.21.15.73:6825/2533620458","heartbeat_front_addr":"172.21.15.73:6823/2533620458","state":["exists","up"]},{"osd":7,"uuid":"398fd334-5f6f-427c-95ae-3244fb466f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6817","nonce":4059538477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6819","nonce":4059538477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6823","nonce":4059538477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6821","nonce":4059538477}]},"public_addr":"172.21.15.152:6817/4059538477","cluster_addr":"172.21.15.152:6819/4059538477","heartbeat_back_addr":"172.21.15.152:6823/4059538477","heartbeat_front_addr":"172.21.15.152:6821/4059538477","state":["exists","up"]},{"osd":8,"uuid":"58f46e64-2624-4ad4-bb6a-225624153837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6817","nonce":96487555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6819","nonce":96487555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6823","nonce":96487555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6821","nonce":96487555}]},"public_addr":"172.21.15.156:6817/96487555","cluster_addr":"172.21.15.156:6819/96487555","heartbeat_back_addr":"172.21.15.156:6823/96487555","heartbeat_front_addr":"172.21.15.156:6821/96487555","state":["exists","up"]},{"osd":9,"uuid":"9389dd5b-da2d-43b6-8bc0-bb1af13f72c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6827","nonce":2050124321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6829","nonce":2050124321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6833","nonce":2050124321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6831","nonce":2050124321}]},"public_addr":"172.21.15.73:6827/2050124321","cluster_addr":"172.21.15.73:6829/2050124321","heartbeat_back_addr":"172.21.15.73:6833/2050124321","heartbeat_front_addr":"172.21.15.73:6831/2050124321","state":["exists","up"]},{"osd":10,"uuid":"563c1e34-3acd-46ab-ba36-e9d87f635e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6825","nonce":1513186350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6827","nonce":1513186350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6831","nonce":1513186350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6829","nonce":1513186350}]},"public_addr":"172.21.15.152:6825/1513186350","cluster_addr":"172.21.15.152:6827/1513186350","heartbeat_back_addr":"172.21.15.152:6831/1513186350","heartbeat_front_addr":"172.21.15.152:6829/1513186350","state":["exists","up"]},{"osd":11,"uuid":"f1b55889-14fd-4cc9-bed7-43748086fb77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6825","nonce":737904755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6827","nonce":737904755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6831","nonce":737904755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6829","nonce":737904755}]},"public_addr":"172.21.15.156:6825/737904755","cluster_addr":"172.21.15.156:6827/737904755","heartbeat_back_addr":"172.21.15.156:6831/737904755","heartbeat_front_addr":"172.21.15.156:6829/737904755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:12.023797+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:33.872883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:55.856970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:18.013196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:39.202872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:00.393920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:22.743083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:43.921728+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:05.859488+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:27.618714+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:48.880286+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:50:11.055141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/2202785670":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6800/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:6800/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/1447381524":"2023-08-11T11:44:48.401660+0000","172.21.15.73:0/2545059698":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/4193457623":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2561039569":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2927950081":"2023-08-11T11:44:48.401660+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T11:52:14.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.527+0000 7fcf55b3a700 1 -- 172.21.15.73:0/2847314404 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fcf3c0a1220 msgr2=0x7fcf3c0a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:14.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.527+0000 7fcf55b3a700 1 --2- 172.21.15.73:0/2847314404 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fcf3c0a1220 0x7fcf3c0a36e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcf501006f0 tx=0x7fcf40008040 comp rx=0 tx=0).stop 2023-08-10T11:52:14.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.527+0000 7fcf55b3a700 1 -- 172.21.15.73:0/2847314404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf50101230 msgr2=0x7fcf5019ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:14.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.527+0000 7fcf55b3a700 1 --2- 172.21.15.73:0/2847314404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf50101230 0x7fcf5019ca10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcf48007a00 tx=0x7fcf48009570 comp rx=0 tx=0).stop 2023-08-10T11:52:14.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.527+0000 7fcf55b3a700 1 -- 172.21.15.73:0/2847314404 shutdown_connections 2023-08-10T11:52:14.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.527+0000 7fcf55b3a700 1 --2- 172.21.15.73:0/2847314404 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fcf3c0a1220 0x7fcf3c0a36e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:14.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.527+0000 7fcf55b3a700 1 --2- 172.21.15.73:0/2847314404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf500ff6a0 0x7fcf50195460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:14.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.527+0000 7fcf55b3a700 1 --2- 172.21.15.73:0/2847314404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf50101230 0x7fcf5019ca10 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:14.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.527+0000 7fcf55b3a700 1 --2- 172.21.15.73:0/2847314404 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf50100890 0x7fcf501959a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:14.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.527+0000 7fcf55b3a700 1 -- 172.21.15.73:0/2847314404 >> 172.21.15.73:0/2847314404 conn(0x7fcf500fabf0 msgr2=0x7fcf50103c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:14.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.527+0000 7fcf55b3a700 1 -- 172.21.15.73:0/2847314404 shutdown_connections 2023-08-10T11:52:14.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.527+0000 7fcf55b3a700 1 -- 172.21.15.73:0/2847314404 wait complete. 2023-08-10T11:52:14.541 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T11:46:58.735153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T11:50:52.517974+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T11:50:53.465357+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T11:52:14.542 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T11:52:14.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.665+0000 7fbb703ad700 1 -- 172.21.15.73:0/3803456261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb68100cd0 msgr2=0x7fbb681010f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:14.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.665+0000 7fbb703ad700 1 --2- 172.21.15.73:0/3803456261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb68100cd0 0x7fbb681010f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c009990 tx=0x7fbb5c009ca0 comp rx=0 tx=0).stop 2023-08-10T11:52:14.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.665+0000 7fbb703ad700 1 -- 172.21.15.73:0/3803456261 shutdown_connections 2023-08-10T11:52:14.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.665+0000 7fbb703ad700 1 --2- 172.21.15.73:0/3803456261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb68100250 0x7fbb68107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:14.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.665+0000 7fbb703ad700 1 --2- 172.21.15.73:0/3803456261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb68100cd0 0x7fbb681010f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:14.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.665+0000 7fbb703ad700 1 --2- 172.21.15.73:0/3803456261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb680ff890 0x7fbb680ffd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:14.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.665+0000 7fbb703ad700 1 -- 172.21.15.73:0/3803456261 >> 172.21.15.73:0/3803456261 conn(0x7fbb680fa340 msgr2=0x7fbb680fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:14.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.665+0000 7fbb703ad700 1 -- 172.21.15.73:0/3803456261 shutdown_connections 2023-08-10T11:52:14.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.665+0000 7fbb703ad700 1 -- 172.21.15.73:0/3803456261 wait complete. 2023-08-10T11:52:14.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.665+0000 7fbb703ad700 1 Processor -- start 2023-08-10T11:52:14.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.665+0000 7fbb703ad700 1 -- start start 2023-08-10T11:52:14.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.666+0000 7fbb703ad700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb680ff890 0x7fbb680ff2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:14.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.666+0000 7fbb703ad700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb68100250 0x7fbb6819d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:14.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.666+0000 7fbb703ad700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb68100cd0 0x7fbb6819fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:14.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.666+0000 7fbb703ad700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb681a01b0 con 0x7fbb68100250 2023-08-10T11:52:14.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.666+0000 7fbb703ad700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb681a0320 con 0x7fbb680ff890 2023-08-10T11:52:14.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.666+0000 7fbb703ad700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb681a04e0 con 0x7fbb68100cd0 2023-08-10T11:52:14.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.666+0000 7fbb6d948700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb68100250 0x7fbb6819d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:14.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.666+0000 7fbb6d948700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb68100250 0x7fbb6819d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60058/0 (socket says 172.21.15.73:60058) 2023-08-10T11:52:14.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.666+0000 7fbb6d948700 1 -- 172.21.15.73:0/3227192942 learned_addr learned my addr 172.21.15.73:0/3227192942 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:14.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.666+0000 7fbb6e94a700 1 --2- 172.21.15.73:0/3227192942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb68100cd0 0x7fbb6819fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:14.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.666+0000 7fbb6e149700 1 --2- 172.21.15.73:0/3227192942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb680ff890 0x7fbb680ff2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:14.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.666+0000 7fbb6d948700 1 -- 172.21.15.73:0/3227192942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb68100cd0 msgr2=0x7fbb6819fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:14.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.666+0000 7fbb6d948700 1 --2- 172.21.15.73:0/3227192942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb68100cd0 0x7fbb6819fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:14.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.666+0000 7fbb6d948700 1 -- 172.21.15.73:0/3227192942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb680ff890 msgr2=0x7fbb680ff2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:14.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.666+0000 7fbb6d948700 1 --2- 172.21.15.73:0/3227192942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb680ff890 0x7fbb680ff2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:14.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.666+0000 7fbb6d948700 1 -- 172.21.15.73:0/3227192942 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5c0095f0 con 0x7fbb68100250 2023-08-10T11:52:14.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.666+0000 7fbb6e149700 1 --2- 172.21.15.73:0/3227192942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb680ff890 0x7fbb680ff2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:52:14.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.666+0000 7fbb6d948700 1 --2- 172.21.15.73:0/3227192942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb68100250 0x7fbb6819d5b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbb6400d950 tx=0x7fbb6400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:14.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.666+0000 7fbb5b7fe700 1 -- 172.21.15.73:0/3227192942 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb64009940 con 0x7fbb68100250 2023-08-10T11:52:14.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.666+0000 7fbb5b7fe700 1 -- 172.21.15.73:0/3227192942 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbb64010460 con 0x7fbb68100250 2023-08-10T11:52:14.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.666+0000 7fbb703ad700 1 -- 172.21.15.73:0/3227192942 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb681a07c0 con 0x7fbb68100250 2023-08-10T11:52:14.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.666+0000 7fbb5b7fe700 1 -- 172.21.15.73:0/3227192942 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6400f620 con 0x7fbb68100250 2023-08-10T11:52:14.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.666+0000 7fbb703ad700 1 -- 172.21.15.73:0/3227192942 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb681a0cd0 con 0x7fbb68100250 2023-08-10T11:52:14.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.667+0000 7fbb703ad700 1 -- 172.21.15.73:0/3227192942 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb68106690 con 0x7fbb68100250 2023-08-10T11:52:14.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.668+0000 7fbb5b7fe700 1 -- 172.21.15.73:0/3227192942 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fbb640108d0 con 0x7fbb68100250 2023-08-10T11:52:14.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.669+0000 7fbb5b7fe700 1 --2- 172.21.15.73:0/3227192942 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fbb540a11e0 0x7fbb540a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:14.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.669+0000 7fbb6e149700 1 --2- 172.21.15.73:0/3227192942 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fbb540a11e0 0x7fbb540a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:14.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.669+0000 7fbb5b7fe700 1 -- 172.21.15.73:0/3227192942 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbb640cc920 con 0x7fbb68100250 2023-08-10T11:52:14.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.670+0000 7fbb6e149700 1 --2- 172.21.15.73:0/3227192942 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fbb540a11e0 0x7fbb540a36a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c006010 tx=0x7fbb5c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:14.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.673+0000 7fbb5b7fe700 1 -- 172.21.15.73:0/3227192942 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fbb64095f20 con 0x7fbb68100250 2023-08-10T11:52:14.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.864+0000 7fbb703ad700 1 -- 172.21.15.73:0/3227192942 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbb6802cbc0 con 0x7fbb68100250 2023-08-10T11:52:14.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.864+0000 7fbb5b7fe700 1 -- 172.21.15.73:0/3227192942 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbb64020020 con 0x7fbb68100250 2023-08-10T11:52:14.866 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-08-10T11:52:14.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.866+0000 7fbb703ad700 1 -- 172.21.15.73:0/3227192942 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fbb540a11e0 msgr2=0x7fbb540a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:14.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.866+0000 7fbb703ad700 1 --2- 172.21.15.73:0/3227192942 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fbb540a11e0 0x7fbb540a36a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c006010 tx=0x7fbb5c00b540 comp rx=0 tx=0).stop 2023-08-10T11:52:14.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.866+0000 7fbb703ad700 1 -- 172.21.15.73:0/3227192942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb68100250 msgr2=0x7fbb6819d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:14.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.866+0000 7fbb703ad700 1 --2- 172.21.15.73:0/3227192942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb68100250 0x7fbb6819d5b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbb6400d950 tx=0x7fbb6400dc60 comp rx=0 tx=0).stop 2023-08-10T11:52:14.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.866+0000 7fbb703ad700 1 -- 172.21.15.73:0/3227192942 shutdown_connections 2023-08-10T11:52:14.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.866+0000 7fbb703ad700 1 --2- 172.21.15.73:0/3227192942 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fbb540a11e0 0x7fbb540a36a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:14.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.866+0000 7fbb703ad700 1 --2- 172.21.15.73:0/3227192942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb680ff890 0x7fbb680ff2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:14.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.866+0000 7fbb703ad700 1 --2- 172.21.15.73:0/3227192942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb68100cd0 0x7fbb6819fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:14.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.866+0000 7fbb703ad700 1 --2- 172.21.15.73:0/3227192942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb68100250 0x7fbb6819d5b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:14.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.866+0000 7fbb703ad700 1 -- 172.21.15.73:0/3227192942 >> 172.21.15.73:0/3227192942 conn(0x7fbb680fa340 msgr2=0x7fbb680fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:14.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.867+0000 7fbb703ad700 1 -- 172.21.15.73:0/3227192942 shutdown_connections 2023-08-10T11:52:14.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:14.867+0000 7fbb703ad700 1 -- 172.21.15.73:0/3227192942 wait complete. 2023-08-10T11:52:14.881 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T11:52:15.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.007+0000 7f24fc47e700 1 -- 172.21.15.73:0/215716256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24f4100760 msgr2=0x7f24f4100b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:15.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.007+0000 7f24fc47e700 1 --2- 172.21.15.73:0/215716256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24f4100760 0x7f24f4100b80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f24e40099c0 tx=0x7f24e4009cd0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.007+0000 7f24fc47e700 1 -- 172.21.15.73:0/215716256 shutdown_connections 2023-08-10T11:52:15.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.007+0000 7f24fc47e700 1 --2- 172.21.15.73:0/215716256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f41022f0 0x7f24f4108ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.007+0000 7f24fc47e700 1 --2- 172.21.15.73:0/215716256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24f4100760 0x7f24f4100b80 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.007+0000 7f24fc47e700 1 --2- 172.21.15.73:0/215716256 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f4101950 0x7f24f4101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.007+0000 7f24fc47e700 1 -- 172.21.15.73:0/215716256 >> 172.21.15.73:0/215716256 conn(0x7f24f40fbcf0 msgr2=0x7f24f40fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:15.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.007+0000 7f24fc47e700 1 -- 172.21.15.73:0/215716256 shutdown_connections 2023-08-10T11:52:15.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.007+0000 7f24fc47e700 1 -- 172.21.15.73:0/215716256 wait complete. 2023-08-10T11:52:15.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.008+0000 7f24fc47e700 1 Processor -- start 2023-08-10T11:52:15.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.008+0000 7f24fc47e700 1 -- start start 2023-08-10T11:52:15.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.008+0000 7f24fc47e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24f4100760 0x7f24f4196400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:15.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.008+0000 7f24fc47e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f4101950 0x7f24f4196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:15.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.008+0000 7f24fc47e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f41022f0 0x7f24f419d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:15.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.008+0000 7f24fc47e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f419df80 con 0x7f24f4100760 2023-08-10T11:52:15.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.008+0000 7f24fc47e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f419e0c0 con 0x7f24f41022f0 2023-08-10T11:52:15.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.008+0000 7f24fc47e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f419e250 con 0x7f24f4101950 2023-08-10T11:52:15.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.008+0000 7f24fa21a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24f4100760 0x7f24f4196400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:15.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.008+0000 7f24fa21a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24f4100760 0x7f24f4196400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60070/0 (socket says 172.21.15.73:60070) 2023-08-10T11:52:15.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.008+0000 7f24fa21a700 1 -- 172.21.15.73:0/3449665393 learned_addr learned my addr 172.21.15.73:0/3449665393 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:15.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.008+0000 7f24f9a19700 1 --2- 172.21.15.73:0/3449665393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f4101950 0x7f24f4196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:15.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.008+0000 7f24faa1b700 1 --2- 172.21.15.73:0/3449665393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f41022f0 0x7f24f419d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:15.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.008+0000 7f24fa21a700 1 -- 172.21.15.73:0/3449665393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f4101950 msgr2=0x7f24f4196940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:15.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.008+0000 7f24fa21a700 1 --2- 172.21.15.73:0/3449665393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f4101950 0x7f24f4196940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.008+0000 7f24fa21a700 1 -- 172.21.15.73:0/3449665393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f41022f0 msgr2=0x7f24f419d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:15.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.008+0000 7f24fa21a700 1 --2- 172.21.15.73:0/3449665393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f41022f0 0x7f24f419d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.008+0000 7f24fa21a700 1 -- 172.21.15.73:0/3449665393 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e40095f0 con 0x7f24f4100760 2023-08-10T11:52:15.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.008+0000 7f24faa1b700 1 --2- 172.21.15.73:0/3449665393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f41022f0 0x7f24f419d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:52:15.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.008+0000 7f24fa21a700 1 --2- 172.21.15.73:0/3449665393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24f4100760 0x7f24f4196400 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f24e4009f50 tx=0x7f24e40057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:15.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.009+0000 7f24eb7fe700 1 -- 172.21.15.73:0/3449665393 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e401d070 con 0x7f24f4100760 2023-08-10T11:52:15.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.009+0000 7f24eb7fe700 1 -- 172.21.15.73:0/3449665393 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f24e4004110 con 0x7f24f4100760 2023-08-10T11:52:15.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.009+0000 7f24fc47e700 1 -- 172.21.15.73:0/3449665393 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f419e4d0 con 0x7f24f4100760 2023-08-10T11:52:15.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.009+0000 7f24eb7fe700 1 -- 172.21.15.73:0/3449665393 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e4022dd0 con 0x7f24f4100760 2023-08-10T11:52:15.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.009+0000 7f24fc47e700 1 -- 172.21.15.73:0/3449665393 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f419e980 con 0x7f24f4100760 2023-08-10T11:52:15.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.010+0000 7f24fc47e700 1 -- 172.21.15.73:0/3449665393 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f410bf70 con 0x7f24f4100760 2023-08-10T11:52:15.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.011+0000 7f24eb7fe700 1 -- 172.21.15.73:0/3449665393 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f24e4022500 con 0x7f24f4100760 2023-08-10T11:52:15.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.011+0000 7f24eb7fe700 1 --2- 172.21.15.73:0/3449665393 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f24e00a11e0 0x7f24e00a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:15.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.011+0000 7f24eb7fe700 1 -- 172.21.15.73:0/3449665393 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f24e40ce5c0 con 0x7f24f4100760 2023-08-10T11:52:15.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.011+0000 7f24f9a19700 1 --2- 172.21.15.73:0/3449665393 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f24e00a11e0 0x7f24e00a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:15.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.012+0000 7f24f9a19700 1 --2- 172.21.15.73:0/3449665393 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f24e00a11e0 0x7f24e00a36a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f24f0005ea0 tx=0x7f24f0005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:15.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.015+0000 7f24eb7fe700 1 -- 172.21.15.73:0/3449665393 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f24e4097c50 con 0x7f24f4100760 2023-08-10T11:52:15.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.202+0000 7f24fc47e700 1 -- 172.21.15.73:0/3449665393 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f24f4107680 con 0x7f24f4100760 2023-08-10T11:52:15.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.202+0000 7f24eb7fe700 1 -- 172.21.15.73:0/3449665393 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7f24e409b270 con 0x7f24f4100760 2023-08-10T11:52:15.205 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-08-10T11:52:15.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.204+0000 7f24fc47e700 1 -- 172.21.15.73:0/3449665393 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f24e00a11e0 msgr2=0x7f24e00a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:15.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.204+0000 7f24fc47e700 1 --2- 172.21.15.73:0/3449665393 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f24e00a11e0 0x7f24e00a36a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f24f0005ea0 tx=0x7f24f0005e30 comp rx=0 tx=0).stop 2023-08-10T11:52:15.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.204+0000 7f24fc47e700 1 -- 172.21.15.73:0/3449665393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24f4100760 msgr2=0x7f24f4196400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:15.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.204+0000 7f24fc47e700 1 --2- 172.21.15.73:0/3449665393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24f4100760 0x7f24f4196400 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f24e4009f50 tx=0x7f24e40057d0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.205+0000 7f24fc47e700 1 -- 172.21.15.73:0/3449665393 shutdown_connections 2023-08-10T11:52:15.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.205+0000 7f24fc47e700 1 --2- 172.21.15.73:0/3449665393 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f24e00a11e0 0x7f24e00a36a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.205+0000 7f24fc47e700 1 --2- 172.21.15.73:0/3449665393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f41022f0 0x7f24f419d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.205+0000 7f24fc47e700 1 --2- 172.21.15.73:0/3449665393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24f4100760 0x7f24f4196400 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.205+0000 7f24fc47e700 1 --2- 172.21.15.73:0/3449665393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f4101950 0x7f24f4196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.205+0000 7f24fc47e700 1 -- 172.21.15.73:0/3449665393 >> 172.21.15.73:0/3449665393 conn(0x7f24f40fbcf0 msgr2=0x7f24f40fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:15.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.205+0000 7f24fc47e700 1 -- 172.21.15.73:0/3449665393 shutdown_connections 2023-08-10T11:52:15.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.205+0000 7f24fc47e700 1 -- 172.21.15.73:0/3449665393 wait complete. 2023-08-10T11:52:15.217 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:14 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2847314404' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:52:15.218 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:14 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3227192942' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:52:15.218 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T11:52:15.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:14 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/2847314404' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:52:15.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:14 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3227192942' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:52:15.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:14 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/2847314404' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:52:15.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:14 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3227192942' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:52:15.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.340+0000 7f36f23e8700 1 -- 172.21.15.73:0/2388783603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36ec101250 msgr2=0x7f36ec107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:15.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.340+0000 7f36f23e8700 1 --2- 172.21.15.73:0/2388783603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36ec101250 0x7f36ec107b00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f36e400b0d0 tx=0x7f36e400b3e0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.340+0000 7f36f23e8700 1 -- 172.21.15.73:0/2388783603 shutdown_connections 2023-08-10T11:52:15.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.340+0000 7f36f23e8700 1 --2- 172.21.15.73:0/2388783603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36ec0ff6c0 0x7f36ec0ffae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.340+0000 7f36f23e8700 1 --2- 172.21.15.73:0/2388783603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36ec101250 0x7f36ec107b00 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.340+0000 7f36f23e8700 1 --2- 172.21.15.73:0/2388783603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36ec1008b0 0x7f36ec100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.340+0000 7f36f23e8700 1 -- 172.21.15.73:0/2388783603 >> 172.21.15.73:0/2388783603 conn(0x7f36ec0fac70 msgr2=0x7f36ec0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:15.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.340+0000 7f36f23e8700 1 -- 172.21.15.73:0/2388783603 shutdown_connections 2023-08-10T11:52:15.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.340+0000 7f36f23e8700 1 -- 172.21.15.73:0/2388783603 wait complete. 2023-08-10T11:52:15.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.340+0000 7f36f23e8700 1 Processor -- start 2023-08-10T11:52:15.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.341+0000 7f36f23e8700 1 -- start start 2023-08-10T11:52:15.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.341+0000 7f36f23e8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36ec0ff6c0 0x7f36ec103650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:15.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.341+0000 7f36f23e8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36ec1008b0 0x7f36ec101c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:15.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.341+0000 7f36f23e8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36ec101250 0x7f36ec1021d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:15.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.341+0000 7f36f23e8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec102970 con 0x7f36ec0ff6c0 2023-08-10T11:52:15.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.341+0000 7f36f23e8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec102ae0 con 0x7f36ec1008b0 2023-08-10T11:52:15.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.341+0000 7f36f23e8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec1a0470 con 0x7f36ec101250 2023-08-10T11:52:15.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.341+0000 7f36ebfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36ec0ff6c0 0x7f36ec103650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:15.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.341+0000 7f36ebfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36ec0ff6c0 0x7f36ec103650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60084/0 (socket says 172.21.15.73:60084) 2023-08-10T11:52:15.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.341+0000 7f36ebfff700 1 -- 172.21.15.73:0/4196804598 learned_addr learned my addr 172.21.15.73:0/4196804598 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:15.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.341+0000 7f36eb7fe700 1 --2- 172.21.15.73:0/4196804598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36ec1008b0 0x7f36ec101c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:15.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.341+0000 7f36f0985700 1 --2- 172.21.15.73:0/4196804598 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36ec101250 0x7f36ec1021d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:15.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.341+0000 7f36ebfff700 1 -- 172.21.15.73:0/4196804598 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36ec101250 msgr2=0x7f36ec1021d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:15.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.341+0000 7f36ebfff700 1 --2- 172.21.15.73:0/4196804598 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36ec101250 0x7f36ec1021d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.341+0000 7f36ebfff700 1 -- 172.21.15.73:0/4196804598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36ec1008b0 msgr2=0x7f36ec101c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:15.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.341+0000 7f36ebfff700 1 --2- 172.21.15.73:0/4196804598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36ec1008b0 0x7f36ec101c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.341+0000 7f36ebfff700 1 -- 172.21.15.73:0/4196804598 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e4009d00 con 0x7f36ec0ff6c0 2023-08-10T11:52:15.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.341+0000 7f36ebfff700 1 --2- 172.21.15.73:0/4196804598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36ec0ff6c0 0x7f36ec103650 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f36d400c990 tx=0x7f36d400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:15.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.341+0000 7f36e97fa700 1 -- 172.21.15.73:0/4196804598 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d4007b00 con 0x7f36ec0ff6c0 2023-08-10T11:52:15.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.342+0000 7f36f23e8700 1 -- 172.21.15.73:0/4196804598 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ec1a0750 con 0x7f36ec0ff6c0 2023-08-10T11:52:15.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.342+0000 7f36e97fa700 1 -- 172.21.15.73:0/4196804598 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36d4007c60 con 0x7f36ec0ff6c0 2023-08-10T11:52:15.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.342+0000 7f36e97fa700 1 -- 172.21.15.73:0/4196804598 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d400fea0 con 0x7f36ec0ff6c0 2023-08-10T11:52:15.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.342+0000 7f36f23e8700 1 -- 172.21.15.73:0/4196804598 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ec1a0cb0 con 0x7f36ec0ff6c0 2023-08-10T11:52:15.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.342+0000 7f36f23e8700 1 -- 172.21.15.73:0/4196804598 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ec10ae70 con 0x7f36ec0ff6c0 2023-08-10T11:52:15.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.343+0000 7f36e97fa700 1 -- 172.21.15.73:0/4196804598 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f36d400f450 con 0x7f36ec0ff6c0 2023-08-10T11:52:15.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.344+0000 7f36e97fa700 1 --2- 172.21.15.73:0/4196804598 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f36d80a11e0 0x7f36d80a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:15.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.344+0000 7f36eb7fe700 1 --2- 172.21.15.73:0/4196804598 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f36d80a11e0 0x7f36d80a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:15.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.344+0000 7f36e97fa700 1 -- 172.21.15.73:0/4196804598 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f36d40ccb50 con 0x7f36ec0ff6c0 2023-08-10T11:52:15.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.344+0000 7f36eb7fe700 1 --2- 172.21.15.73:0/4196804598 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f36d80a11e0 0x7f36d80a36a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f36dc00ac50 tx=0x7f36dc00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:15.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.347+0000 7f36e97fa700 1 -- 172.21.15.73:0/4196804598 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f36d40961e0 con 0x7f36ec0ff6c0 2023-08-10T11:52:15.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.537+0000 7f36f23e8700 1 -- 172.21.15.73:0/4196804598 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f36ec1a1350 con 0x7f36ec0ff6c0 2023-08-10T11:52:15.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.538+0000 7f36e97fa700 1 -- 172.21.15.73:0/4196804598 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7f36d4099800 con 0x7f36ec0ff6c0 2023-08-10T11:52:15.540 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-08-10T11:52:15.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.540+0000 7f36f23e8700 1 -- 172.21.15.73:0/4196804598 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f36d80a11e0 msgr2=0x7f36d80a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:15.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.540+0000 7f36f23e8700 1 --2- 172.21.15.73:0/4196804598 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f36d80a11e0 0x7f36d80a36a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f36dc00ac50 tx=0x7f36dc00a380 comp rx=0 tx=0).stop 2023-08-10T11:52:15.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.540+0000 7f36f23e8700 1 -- 172.21.15.73:0/4196804598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36ec0ff6c0 msgr2=0x7f36ec103650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:15.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.540+0000 7f36f23e8700 1 --2- 172.21.15.73:0/4196804598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36ec0ff6c0 0x7f36ec103650 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f36d400c990 tx=0x7f36d400cca0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.540+0000 7f36f23e8700 1 -- 172.21.15.73:0/4196804598 shutdown_connections 2023-08-10T11:52:15.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.540+0000 7f36f23e8700 1 --2- 172.21.15.73:0/4196804598 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36ec101250 0x7f36ec1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.540+0000 7f36f23e8700 1 --2- 172.21.15.73:0/4196804598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36ec0ff6c0 0x7f36ec103650 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.540+0000 7f36f23e8700 1 --2- 172.21.15.73:0/4196804598 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f36d80a11e0 0x7f36d80a36a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.540+0000 7f36f23e8700 1 --2- 172.21.15.73:0/4196804598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36ec1008b0 0x7f36ec101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.540+0000 7f36f23e8700 1 -- 172.21.15.73:0/4196804598 >> 172.21.15.73:0/4196804598 conn(0x7f36ec0fac70 msgr2=0x7f36ec068be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.540+0000 7f36f23e8700 1 -- 172.21.15.73:0/4196804598 shutdown_connections 2023-08-10T11:52:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.540+0000 7f36f23e8700 1 -- 172.21.15.73:0/4196804598 wait complete. 2023-08-10T11:52:15.553 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T11:52:15.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.673+0000 7f31e6958700 1 -- 172.21.15.73:0/1336145153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31e0100840 msgr2=0x7f31e0100ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:15.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.673+0000 7f31e6958700 1 --2- 172.21.15.73:0/1336145153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31e0100840 0x7f31e0100ca0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f31d40099c0 tx=0x7f31d4009cd0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.673+0000 7f31e6958700 1 -- 172.21.15.73:0/1336145153 shutdown_connections 2023-08-10T11:52:15.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.673+0000 7f31e6958700 1 --2- 172.21.15.73:0/1336145153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31e01011e0 0x7f31e0107a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.673+0000 7f31e6958700 1 --2- 172.21.15.73:0/1336145153 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31e00ff650 0x7f31e00ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.673+0000 7f31e6958700 1 --2- 172.21.15.73:0/1336145153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31e0100840 0x7f31e0100ca0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.673+0000 7f31e6958700 1 -- 172.21.15.73:0/1336145153 >> 172.21.15.73:0/1336145153 conn(0x7f31e00faba0 msgr2=0x7f31e00fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:15.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.673+0000 7f31e6958700 1 -- 172.21.15.73:0/1336145153 shutdown_connections 2023-08-10T11:52:15.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.673+0000 7f31e6958700 1 -- 172.21.15.73:0/1336145153 wait complete. 2023-08-10T11:52:15.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.673+0000 7f31e6958700 1 Processor -- start 2023-08-10T11:52:15.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.673+0000 7f31e6958700 1 -- start start 2023-08-10T11:52:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.674+0000 7f31e6958700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31e00ff650 0x7f31e0068460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.674+0000 7f31e6958700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31e0100840 0x7f31e019b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.674+0000 7f31e6958700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31e01011e0 0x7f31e019d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.674+0000 7f31e6958700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e019dff0 con 0x7f31e0100840 2023-08-10T11:52:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.674+0000 7f31e6958700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e019e160 con 0x7f31e00ff650 2023-08-10T11:52:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.674+0000 7f31e6958700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e019e320 con 0x7f31e01011e0 2023-08-10T11:52:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.674+0000 7f31df7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31e0100840 0x7f31e019b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.674+0000 7f31df7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31e0100840 0x7f31e019b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60100/0 (socket says 172.21.15.73:60100) 2023-08-10T11:52:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.674+0000 7f31df7fe700 1 -- 172.21.15.73:0/3264687167 learned_addr learned my addr 172.21.15.73:0/3264687167 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.674+0000 7f31dffff700 1 --2- 172.21.15.73:0/3264687167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31e00ff650 0x7f31e0068460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:15.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.674+0000 7f31e4ef5700 1 --2- 172.21.15.73:0/3264687167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31e01011e0 0x7f31e019d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:15.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.674+0000 7f31df7fe700 1 -- 172.21.15.73:0/3264687167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31e01011e0 msgr2=0x7f31e019d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:15.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.674+0000 7f31df7fe700 1 --2- 172.21.15.73:0/3264687167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31e01011e0 0x7f31e019d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.674+0000 7f31df7fe700 1 -- 172.21.15.73:0/3264687167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31e00ff650 msgr2=0x7f31e0068460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:15.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.674+0000 7f31df7fe700 1 --2- 172.21.15.73:0/3264687167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31e00ff650 0x7f31e0068460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.674+0000 7f31df7fe700 1 -- 172.21.15.73:0/3264687167 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d40095f0 con 0x7f31e0100840 2023-08-10T11:52:15.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.674+0000 7f31df7fe700 1 --2- 172.21.15.73:0/3264687167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31e0100840 0x7f31e019b1d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f31d40036f0 tx=0x7f31d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:15.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.674+0000 7f31dd7fa700 1 -- 172.21.15.73:0/3264687167 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d401d070 con 0x7f31e0100840 2023-08-10T11:52:15.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.674+0000 7f31e6958700 1 -- 172.21.15.73:0/3264687167 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e019e5a0 con 0x7f31e0100840 2023-08-10T11:52:15.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.674+0000 7f31dd7fa700 1 -- 172.21.15.73:0/3264687167 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31d4004110 con 0x7f31e0100840 2023-08-10T11:52:15.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.674+0000 7f31dd7fa700 1 -- 172.21.15.73:0/3264687167 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d4022ea0 con 0x7f31e0100840 2023-08-10T11:52:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.674+0000 7f31e6958700 1 -- 172.21.15.73:0/3264687167 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e019e9c0 con 0x7f31e0100840 2023-08-10T11:52:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.675+0000 7f31e6958700 1 -- 172.21.15.73:0/3264687167 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e010af00 con 0x7f31e0100840 2023-08-10T11:52:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.676+0000 7f31dd7fa700 1 -- 172.21.15.73:0/3264687167 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f31d4022600 con 0x7f31e0100840 2023-08-10T11:52:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.677+0000 7f31dd7fa700 1 --2- 172.21.15.73:0/3264687167 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f31c80a1220 0x7f31c80a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.677+0000 7f31dffff700 1 --2- 172.21.15.73:0/3264687167 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f31c80a1220 0x7f31c80a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.677+0000 7f31dd7fa700 1 -- 172.21.15.73:0/3264687167 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f31d40ce310 con 0x7f31e0100840 2023-08-10T11:52:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.677+0000 7f31dffff700 1 --2- 172.21.15.73:0/3264687167 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f31c80a1220 0x7f31c80a36e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f31d0006fd0 tx=0x7f31d0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.680+0000 7f31dd7fa700 1 -- 172.21.15.73:0/3264687167 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f31d40979a0 con 0x7f31e0100840 2023-08-10T11:52:15.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.914+0000 7f31e6958700 1 -- 172.21.15.73:0/3264687167 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31e0106530 con 0x7f31e0100840 2023-08-10T11:52:15.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.914+0000 7f31dd7fa700 1 -- 172.21.15.73:0/3264687167 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10891 (secure 0 0 0) 0x7f31d409afc0 con 0x7f31e0100840 2023-08-10T11:52:15.916 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:52:15.916 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1319360725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1319360725},{"type":"v1","addr":"172.21.15.73:6835","nonce":1319360725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/431221951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":431221951},{"type":"v1","addr":"172.21.15.73:6837","nonce":431221951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-10T11:50:54.304447+0000","modified":"2023-08-10T11:51:01.523452+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24503,"mds_1":24479,"mds_2":24451,"mds_3":24443,"mds_4":24419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6839/1099539481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1099539481},{"type":"v1","addr":"172.21.15.73:6839","nonce":1099539481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6841/3067925859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":3067925859},{"type":"v1","addr":"172.21.15.73:6841","nonce":3067925859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24397":{"gid":24397,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6833/3028461815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3028461815},{"type":"v1","addr":"172.21.15.156:6833","nonce":3028461815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24419":{"gid":24419,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6833/4148407154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4148407154},{"type":"v1","addr":"172.21.15.152:6833","nonce":4148407154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24443":{"gid":24443,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.152:6835/1791572604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1791572604},{"type":"v1","addr":"172.21.15.152:6835","nonce":1791572604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.156:6835/904126790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":904126790},{"type":"v1","addr":"172.21.15.156:6835","nonce":904126790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24457":{"gid":24457,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/4284306352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":4284306352},{"type":"v1","addr":"172.21.15.156:6837","nonce":4284306352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6839/3361058731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":3361058731},{"type":"v1","addr":"172.21.15.156:6839","nonce":3361058731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6837/74214089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":74214089},{"type":"v1","addr":"172.21.15.152:6837","nonce":74214089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6839/3870202690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3870202690},{"type":"v1","addr":"172.21.15.152:6839","nonce":3870202690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T11:52:15.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.916+0000 7f31e6958700 1 -- 172.21.15.73:0/3264687167 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f31c80a1220 msgr2=0x7f31c80a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:15.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.916+0000 7f31e6958700 1 --2- 172.21.15.73:0/3264687167 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f31c80a1220 0x7f31c80a36e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f31d0006fd0 tx=0x7f31d0008040 comp rx=0 tx=0).stop 2023-08-10T11:52:15.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.916+0000 7f31e6958700 1 -- 172.21.15.73:0/3264687167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31e0100840 msgr2=0x7f31e019b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:15.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.916+0000 7f31e6958700 1 --2- 172.21.15.73:0/3264687167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31e0100840 0x7f31e019b1d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f31d40036f0 tx=0x7f31d40057f0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.916+0000 7f31e6958700 1 -- 172.21.15.73:0/3264687167 shutdown_connections 2023-08-10T11:52:15.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.916+0000 7f31e6958700 1 --2- 172.21.15.73:0/3264687167 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f31c80a1220 0x7f31c80a36e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.916+0000 7f31e6958700 1 --2- 172.21.15.73:0/3264687167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31e00ff650 0x7f31e0068460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.916+0000 7f31e6958700 1 --2- 172.21.15.73:0/3264687167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31e01011e0 0x7f31e019d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.916+0000 7f31e6958700 1 --2- 172.21.15.73:0/3264687167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31e0100840 0x7f31e019b1d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:15.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.916+0000 7f31e6958700 1 -- 172.21.15.73:0/3264687167 >> 172.21.15.73:0/3264687167 conn(0x7f31e00faba0 msgr2=0x7f31e00fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:15.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.917+0000 7f31e6958700 1 -- 172.21.15.73:0/3264687167 shutdown_connections 2023-08-10T11:52:15.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:15.917+0000 7f31e6958700 1 -- 172.21.15.73:0/3264687167 wait complete. 2023-08-10T11:52:15.920 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 27 2023-08-10T11:52:15.931 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T11:52:16.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.051+0000 7ffa8cb3f700 1 -- 172.21.15.73:0/3279914150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa880fede0 msgr2=0x7ffa880ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:16.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.051+0000 7ffa8cb3f700 1 --2- 172.21.15.73:0/3279914150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa880fede0 0x7ffa880ff200 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c0099c0 tx=0x7ffa7c009cd0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.051+0000 7ffa8cb3f700 1 -- 172.21.15.73:0/3279914150 shutdown_connections 2023-08-10T11:52:16.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.051+0000 7ffa8cb3f700 1 --2- 172.21.15.73:0/3279914150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa88100970 0x7ffa88107220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.051+0000 7ffa8cb3f700 1 --2- 172.21.15.73:0/3279914150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa880fede0 0x7ffa880ff200 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.051+0000 7ffa8cb3f700 1 --2- 172.21.15.73:0/3279914150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa880fffd0 0x7ffa88100430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.051+0000 7ffa8cb3f700 1 -- 172.21.15.73:0/3279914150 >> 172.21.15.73:0/3279914150 conn(0x7ffa880fa330 msgr2=0x7ffa880fc790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:16.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.051+0000 7ffa8cb3f700 1 -- 172.21.15.73:0/3279914150 shutdown_connections 2023-08-10T11:52:16.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.051+0000 7ffa8cb3f700 1 -- 172.21.15.73:0/3279914150 wait complete. 2023-08-10T11:52:16.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.052+0000 7ffa8cb3f700 1 Processor -- start 2023-08-10T11:52:16.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.052+0000 7ffa8cb3f700 1 -- start start 2023-08-10T11:52:16.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.052+0000 7ffa8cb3f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa880fede0 0x7ffa8810bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:16.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.052+0000 7ffa8cb3f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa880fffd0 0x7ffa8819b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:16.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.052+0000 7ffa8cb3f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa88100970 0x7ffa8819d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:16.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.052+0000 7ffa8cb3f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8819df40 con 0x7ffa880fffd0 2023-08-10T11:52:16.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.052+0000 7ffa8cb3f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8819e0b0 con 0x7ffa880fede0 2023-08-10T11:52:16.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.052+0000 7ffa8cb3f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8819e270 con 0x7ffa88100970 2023-08-10T11:52:16.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.053+0000 7ffa85d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa880fffd0 0x7ffa8819b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:16.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.053+0000 7ffa85d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa880fffd0 0x7ffa8819b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60114/0 (socket says 172.21.15.73:60114) 2023-08-10T11:52:16.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.053+0000 7ffa85d9b700 1 -- 172.21.15.73:0/2228993465 learned_addr learned my addr 172.21.15.73:0/2228993465 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:16.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.053+0000 7ffa86d9d700 1 --2- 172.21.15.73:0/2228993465 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa88100970 0x7ffa8819d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:16.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.053+0000 7ffa8659c700 1 --2- 172.21.15.73:0/2228993465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa880fede0 0x7ffa8810bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:16.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.053+0000 7ffa85d9b700 1 -- 172.21.15.73:0/2228993465 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa88100970 msgr2=0x7ffa8819d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:16.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.053+0000 7ffa85d9b700 1 --2- 172.21.15.73:0/2228993465 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa88100970 0x7ffa8819d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.053+0000 7ffa85d9b700 1 -- 172.21.15.73:0/2228993465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa880fede0 msgr2=0x7ffa8810bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:16.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.053+0000 7ffa85d9b700 1 --2- 172.21.15.73:0/2228993465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa880fede0 0x7ffa8810bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.053+0000 7ffa85d9b700 1 -- 172.21.15.73:0/2228993465 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c0095f0 con 0x7ffa880fffd0 2023-08-10T11:52:16.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.053+0000 7ffa8659c700 1 --2- 172.21.15.73:0/2228993465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa880fede0 0x7ffa8810bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:52:16.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.053+0000 7ffa85d9b700 1 --2- 172.21.15.73:0/2228993465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa880fffd0 0x7ffa8819b120 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800c920 tx=0x7ffa7800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:16.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.053+0000 7ffa777fe700 1 -- 172.21.15.73:0/2228993465 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa78007b00 con 0x7ffa880fffd0 2023-08-10T11:52:16.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.053+0000 7ffa777fe700 1 -- 172.21.15.73:0/2228993465 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffa7800ce70 con 0x7ffa880fffd0 2023-08-10T11:52:16.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.053+0000 7ffa8cb3f700 1 -- 172.21.15.73:0/2228993465 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa8819e550 con 0x7ffa880fffd0 2023-08-10T11:52:16.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.053+0000 7ffa777fe700 1 -- 172.21.15.73:0/2228993465 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa780054e0 con 0x7ffa880fffd0 2023-08-10T11:52:16.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.053+0000 7ffa8cb3f700 1 -- 172.21.15.73:0/2228993465 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa8819eab0 con 0x7ffa880fffd0 2023-08-10T11:52:16.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.054+0000 7ffa8cb3f700 1 -- 172.21.15.73:0/2228993465 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa881059b0 con 0x7ffa880fffd0 2023-08-10T11:52:16.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.056+0000 7ffa777fe700 1 -- 172.21.15.73:0/2228993465 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7ffa78004750 con 0x7ffa880fffd0 2023-08-10T11:52:16.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.056+0000 7ffa777fe700 1 --2- 172.21.15.73:0/2228993465 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ffa700a12a0 0x7ffa700a3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:16.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.056+0000 7ffa777fe700 1 -- 172.21.15.73:0/2228993465 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ffa780cca60 con 0x7ffa880fffd0 2023-08-10T11:52:16.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.056+0000 7ffa8659c700 1 --2- 172.21.15.73:0/2228993465 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ffa700a12a0 0x7ffa700a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:16.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.057+0000 7ffa8659c700 1 --2- 172.21.15.73:0/2228993465 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ffa700a12a0 0x7ffa700a3760 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c0098e0 tx=0x7ffa7c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:16.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.059+0000 7ffa777fe700 1 -- 172.21.15.73:0/2228993465 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ffa780960e0 con 0x7ffa880fffd0 2023-08-10T11:52:16.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:15 smithi152 ceph-mon[130220]: pgmap v298: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T11:52:16.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:15 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3449665393' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:52:16.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:15 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/4196804598' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:52:16.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.251+0000 7ffa8cb3f700 1 -- 172.21.15.73:0/2228993465 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa8802c970 con 0x7ffa880fffd0 2023-08-10T11:52:16.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.252+0000 7ffa777fe700 1 -- 172.21.15.73:0/2228993465 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22482 (secure 0 0 0) 0x7ffa78099700 con 0x7ffa880fffd0 2023-08-10T11:52:16.254 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:52:16.255 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":85,"fsid":"0e619a74-3773-11ee-9b37-001a4aab830c","created":"2023-08-10T11:43:53.974768+0000","modified":"2023-08-10T11:51:49.637159+0000","last_up_change":"2023-08-10T11:50:12.914422+0000","last_in_change":"2023-08-10T11:49:54.624543+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T11:46:58.735153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T11:50:52.517974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T11:50:53.465357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3219ae18-cc4c-4712-b616-79f6949066e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6803","nonce":2725694252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6805","nonce":2725694252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6809","nonce":2725694252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6807","nonce":2725694252}]},"public_addr":"172.21.15.73:6803/2725694252","cluster_addr":"172.21.15.73:6805/2725694252","heartbeat_back_addr":"172.21.15.73:6809/2725694252","heartbeat_front_addr":"172.21.15.73:6807/2725694252","state":["exists","up"]},{"osd":1,"uuid":"bbfe6cd9-b3d3-4b8d-8814-507a867f8c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6801","nonce":836829168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6803","nonce":836829168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6807","nonce":836829168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6805","nonce":836829168}]},"public_addr":"172.21.15.152:6801/836829168","cluster_addr":"172.21.15.152:6803/836829168","heartbeat_back_addr":"172.21.15.152:6807/836829168","heartbeat_front_addr":"172.21.15.152:6805/836829168","state":["exists","up"]},{"osd":2,"uuid":"f57f5b2c-3208-45c0-beba-8501694b99c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6801","nonce":1789212298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6803","nonce":1789212298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6807","nonce":1789212298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6805","nonce":1789212298}]},"public_addr":"172.21.15.156:6801/1789212298","cluster_addr":"172.21.15.156:6803/1789212298","heartbeat_back_addr":"172.21.15.156:6807/1789212298","heartbeat_front_addr":"172.21.15.156:6805/1789212298","state":["exists","up"]},{"osd":3,"uuid":"18592408-3696-4ab8-ad41-c172b8409829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6811","nonce":3101572649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6813","nonce":3101572649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6817","nonce":3101572649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6815","nonce":3101572649}]},"public_addr":"172.21.15.73:6811/3101572649","cluster_addr":"172.21.15.73:6813/3101572649","heartbeat_back_addr":"172.21.15.73:6817/3101572649","heartbeat_front_addr":"172.21.15.73:6815/3101572649","state":["exists","up"]},{"osd":4,"uuid":"fb3adb09-8807-42d9-8db9-1867c5fe02da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6809","nonce":1451517889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6811","nonce":1451517889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6815","nonce":1451517889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6813","nonce":1451517889}]},"public_addr":"172.21.15.152:6809/1451517889","cluster_addr":"172.21.15.152:6811/1451517889","heartbeat_back_addr":"172.21.15.152:6815/1451517889","heartbeat_front_addr":"172.21.15.152:6813/1451517889","state":["exists","up"]},{"osd":5,"uuid":"af58a7bd-4e58-4639-95b2-4a76011b61dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6809","nonce":3823368741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6811","nonce":3823368741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6815","nonce":3823368741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6813","nonce":3823368741}]},"public_addr":"172.21.15.156:6809/3823368741","cluster_addr":"172.21.15.156:6811/3823368741","heartbeat_back_addr":"172.21.15.156:6815/3823368741","heartbeat_front_addr":"172.21.15.156:6813/3823368741","state":["exists","up"]},{"osd":6,"uuid":"f6ae502d-4af9-4f6a-8636-b5b683dfdfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6819","nonce":2533620458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6821","nonce":2533620458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6825","nonce":2533620458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6823","nonce":2533620458}]},"public_addr":"172.21.15.73:6819/2533620458","cluster_addr":"172.21.15.73:6821/2533620458","heartbeat_back_addr":"172.21.15.73:6825/2533620458","heartbeat_front_addr":"172.21.15.73:6823/2533620458","state":["exists","up"]},{"osd":7,"uuid":"398fd334-5f6f-427c-95ae-3244fb466f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6817","nonce":4059538477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6819","nonce":4059538477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6823","nonce":4059538477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6821","nonce":4059538477}]},"public_addr":"172.21.15.152:6817/4059538477","cluster_addr":"172.21.15.152:6819/4059538477","heartbeat_back_addr":"172.21.15.152:6823/4059538477","heartbeat_front_addr":"172.21.15.152:6821/4059538477","state":["exists","up"]},{"osd":8,"uuid":"58f46e64-2624-4ad4-bb6a-225624153837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6817","nonce":96487555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6819","nonce":96487555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6823","nonce":96487555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6821","nonce":96487555}]},"public_addr":"172.21.15.156:6817/96487555","cluster_addr":"172.21.15.156:6819/96487555","heartbeat_back_addr":"172.21.15.156:6823/96487555","heartbeat_front_addr":"172.21.15.156:6821/96487555","state":["exists","up"]},{"osd":9,"uuid":"9389dd5b-da2d-43b6-8bc0-bb1af13f72c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6827","nonce":2050124321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6829","nonce":2050124321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6833","nonce":2050124321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6831","nonce":2050124321}]},"public_addr":"172.21.15.73:6827/2050124321","cluster_addr":"172.21.15.73:6829/2050124321","heartbeat_back_addr":"172.21.15.73:6833/2050124321","heartbeat_front_addr":"172.21.15.73:6831/2050124321","state":["exists","up"]},{"osd":10,"uuid":"563c1e34-3acd-46ab-ba36-e9d87f635e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6825","nonce":1513186350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6827","nonce":1513186350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6831","nonce":1513186350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6829","nonce":1513186350}]},"public_addr":"172.21.15.152:6825/1513186350","cluster_addr":"172.21.15.152:6827/1513186350","heartbeat_back_addr":"172.21.15.152:6831/1513186350","heartbeat_front_addr":"172.21.15.152:6829/1513186350","state":["exists","up"]},{"osd":11,"uuid":"f1b55889-14fd-4cc9-bed7-43748086fb77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6825","nonce":737904755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6827","nonce":737904755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6831","nonce":737904755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6829","nonce":737904755}]},"public_addr":"172.21.15.156:6825/737904755","cluster_addr":"172.21.15.156:6827/737904755","heartbeat_back_addr":"172.21.15.156:6831/737904755","heartbeat_front_addr":"172.21.15.156:6829/737904755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:12.023797+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:33.872883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:55.856970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:18.013196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:39.202872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:00.393920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:22.743083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:43.921728+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:05.859488+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:27.618714+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:48.880286+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:50:11.055141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/2202785670":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6800/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:6800/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/1447381524":"2023-08-11T11:44:48.401660+0000","172.21.15.73:0/2545059698":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/4193457623":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2561039569":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2927950081":"2023-08-11T11:44:48.401660+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T11:52:16.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:15 smithi156 ceph-mon[130574]: pgmap v298: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T11:52:16.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:15 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3449665393' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:52:16.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:15 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/4196804598' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:52:16.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.254+0000 7ffa8cb3f700 1 -- 172.21.15.73:0/2228993465 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ffa700a12a0 msgr2=0x7ffa700a3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:16.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.254+0000 7ffa8cb3f700 1 --2- 172.21.15.73:0/2228993465 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ffa700a12a0 0x7ffa700a3760 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c0098e0 tx=0x7ffa7c000bc0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.254+0000 7ffa8cb3f700 1 -- 172.21.15.73:0/2228993465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa880fffd0 msgr2=0x7ffa8819b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:16.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.254+0000 7ffa8cb3f700 1 --2- 172.21.15.73:0/2228993465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa880fffd0 0x7ffa8819b120 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800c920 tx=0x7ffa7800cc30 comp rx=0 tx=0).stop 2023-08-10T11:52:16.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.254+0000 7ffa8cb3f700 1 -- 172.21.15.73:0/2228993465 shutdown_connections 2023-08-10T11:52:16.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.254+0000 7ffa8cb3f700 1 --2- 172.21.15.73:0/2228993465 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7ffa700a12a0 0x7ffa700a3760 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.255+0000 7ffa8cb3f700 1 --2- 172.21.15.73:0/2228993465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa880fede0 0x7ffa8810bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.255+0000 7ffa8cb3f700 1 --2- 172.21.15.73:0/2228993465 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa88100970 0x7ffa8819d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.255+0000 7ffa8cb3f700 1 --2- 172.21.15.73:0/2228993465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa880fffd0 0x7ffa8819b120 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.255+0000 7ffa8cb3f700 1 -- 172.21.15.73:0/2228993465 >> 172.21.15.73:0/2228993465 conn(0x7ffa880fa330 msgr2=0x7ffa880fbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:16.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.255+0000 7ffa8cb3f700 1 -- 172.21.15.73:0/2228993465 shutdown_connections 2023-08-10T11:52:16.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.255+0000 7ffa8cb3f700 1 -- 172.21.15.73:0/2228993465 wait complete. 2023-08-10T11:52:16.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:15 smithi073 ceph-mon[128869]: pgmap v298: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T11:52:16.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:15 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3449665393' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:52:16.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:15 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/4196804598' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:52:16.269 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T11:46:58.735153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T11:50:52.517974+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T11:50:53.465357+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T11:52:16.270 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T11:52:16.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.392+0000 7fb2f5fb7700 1 -- 172.21.15.73:0/2570351021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2f0100770 msgr2=0x7fb2f0100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:16.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.392+0000 7fb2f5fb7700 1 --2- 172.21.15.73:0/2570351021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2f0100770 0x7fb2f0100b90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80099c0 tx=0x7fb2d8009cd0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.392+0000 7fb2f5fb7700 1 -- 172.21.15.73:0/2570351021 shutdown_connections 2023-08-10T11:52:16.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.392+0000 7fb2f5fb7700 1 --2- 172.21.15.73:0/2570351021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2f0102300 0x7fb2f0108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.392+0000 7fb2f5fb7700 1 --2- 172.21.15.73:0/2570351021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2f0100770 0x7fb2f0100b90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.392+0000 7fb2f5fb7700 1 --2- 172.21.15.73:0/2570351021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2f0101960 0x7fb2f0101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.392+0000 7fb2f5fb7700 1 -- 172.21.15.73:0/2570351021 >> 172.21.15.73:0/2570351021 conn(0x7fb2f00fbcc0 msgr2=0x7fb2f00fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:16.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.392+0000 7fb2f5fb7700 1 -- 172.21.15.73:0/2570351021 shutdown_connections 2023-08-10T11:52:16.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.392+0000 7fb2f5fb7700 1 -- 172.21.15.73:0/2570351021 wait complete. 2023-08-10T11:52:16.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.392+0000 7fb2f5fb7700 1 Processor -- start 2023-08-10T11:52:16.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.393+0000 7fb2f5fb7700 1 -- start start 2023-08-10T11:52:16.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.393+0000 7fb2f5fb7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2f0100770 0x7fb2f0196500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:16.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.393+0000 7fb2f5fb7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2f0101960 0x7fb2f0196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:16.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.393+0000 7fb2f5fb7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2f0102300 0x7fb2f019dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:16.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.393+0000 7fb2f5fb7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f019e080 con 0x7fb2f0102300 2023-08-10T11:52:16.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.393+0000 7fb2f5fb7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f019e1c0 con 0x7fb2f0100770 2023-08-10T11:52:16.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.393+0000 7fb2f5fb7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f019e350 con 0x7fb2f0101960 2023-08-10T11:52:16.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.393+0000 7fb2effff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2f0102300 0x7fb2f019dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:16.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.393+0000 7fb2effff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2f0102300 0x7fb2f019dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60130/0 (socket says 172.21.15.73:60130) 2023-08-10T11:52:16.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.393+0000 7fb2effff700 1 -- 172.21.15.73:0/236699201 learned_addr learned my addr 172.21.15.73:0/236699201 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:16.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.393+0000 7fb2ef7fe700 1 --2- 172.21.15.73:0/236699201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2f0100770 0x7fb2f0196500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:16.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.393+0000 7fb2eeffd700 1 --2- 172.21.15.73:0/236699201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2f0101960 0x7fb2f0196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:16.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.393+0000 7fb2effff700 1 -- 172.21.15.73:0/236699201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2f0101960 msgr2=0x7fb2f0196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:16.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.393+0000 7fb2effff700 1 --2- 172.21.15.73:0/236699201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2f0101960 0x7fb2f0196a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.393+0000 7fb2effff700 1 -- 172.21.15.73:0/236699201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2f0100770 msgr2=0x7fb2f0196500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:16.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.393+0000 7fb2effff700 1 --2- 172.21.15.73:0/236699201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2f0100770 0x7fb2f0196500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.393+0000 7fb2effff700 1 -- 172.21.15.73:0/236699201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d80095f0 con 0x7fb2f0102300 2023-08-10T11:52:16.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.393+0000 7fb2effff700 1 --2- 172.21.15.73:0/236699201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2f0102300 0x7fb2f019dab0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800b970 tx=0x7fb2e800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:16.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.394+0000 7fb2ecff9700 1 -- 172.21.15.73:0/236699201 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e800c9b0 con 0x7fb2f0102300 2023-08-10T11:52:16.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.394+0000 7fb2ecff9700 1 -- 172.21.15.73:0/236699201 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb2e8014440 con 0x7fb2f0102300 2023-08-10T11:52:16.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.394+0000 7fb2f5fb7700 1 -- 172.21.15.73:0/236699201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f019e630 con 0x7fb2f0102300 2023-08-10T11:52:16.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.394+0000 7fb2ecff9700 1 -- 172.21.15.73:0/236699201 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e80075d0 con 0x7fb2f0102300 2023-08-10T11:52:16.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.394+0000 7fb2f5fb7700 1 -- 172.21.15.73:0/236699201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f019eaf0 con 0x7fb2f0102300 2023-08-10T11:52:16.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.395+0000 7fb2f5fb7700 1 -- 172.21.15.73:0/236699201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f010c060 con 0x7fb2f0102300 2023-08-10T11:52:16.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.396+0000 7fb2ecff9700 1 -- 172.21.15.73:0/236699201 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fb2e80145b0 con 0x7fb2f0102300 2023-08-10T11:52:16.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.396+0000 7fb2ecff9700 1 --2- 172.21.15.73:0/236699201 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb2dc0a11e0 0x7fb2dc0a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:16.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.396+0000 7fb2ef7fe700 1 --2- 172.21.15.73:0/236699201 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb2dc0a11e0 0x7fb2dc0a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:16.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.396+0000 7fb2ecff9700 1 -- 172.21.15.73:0/236699201 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb2e8006e40 con 0x7fb2f0102300 2023-08-10T11:52:16.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.397+0000 7fb2ef7fe700 1 --2- 172.21.15.73:0/236699201 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb2dc0a11e0 0x7fb2dc0a36a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb2d800b580 tx=0x7fb2d8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:16.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.400+0000 7fb2ecff9700 1 -- 172.21.15.73:0/236699201 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fb2e804e790 con 0x7fb2f0102300 2023-08-10T11:52:16.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.589+0000 7fb2f5fb7700 1 -- 172.21.15.73:0/236699201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb2f01076b0 con 0x7fb2f0102300 2023-08-10T11:52:16.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.590+0000 7fb2ecff9700 1 -- 172.21.15.73:0/236699201 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb2e8095850 con 0x7fb2f0102300 2023-08-10T11:52:16.592 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-08-10T11:52:16.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.592+0000 7fb2f5fb7700 1 -- 172.21.15.73:0/236699201 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb2dc0a11e0 msgr2=0x7fb2dc0a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:16.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.592+0000 7fb2f5fb7700 1 --2- 172.21.15.73:0/236699201 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb2dc0a11e0 0x7fb2dc0a36a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb2d800b580 tx=0x7fb2d8005fd0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.592+0000 7fb2f5fb7700 1 -- 172.21.15.73:0/236699201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2f0102300 msgr2=0x7fb2f019dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:16.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.592+0000 7fb2f5fb7700 1 --2- 172.21.15.73:0/236699201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2f0102300 0x7fb2f019dab0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800b970 tx=0x7fb2e800bd30 comp rx=0 tx=0).stop 2023-08-10T11:52:16.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.592+0000 7fb2f5fb7700 1 -- 172.21.15.73:0/236699201 shutdown_connections 2023-08-10T11:52:16.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.592+0000 7fb2f5fb7700 1 --2- 172.21.15.73:0/236699201 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fb2dc0a11e0 0x7fb2dc0a36a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.592+0000 7fb2f5fb7700 1 --2- 172.21.15.73:0/236699201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2f0100770 0x7fb2f0196500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.592+0000 7fb2f5fb7700 1 --2- 172.21.15.73:0/236699201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2f0102300 0x7fb2f019dab0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.592+0000 7fb2f5fb7700 1 --2- 172.21.15.73:0/236699201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2f0101960 0x7fb2f0196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.592+0000 7fb2f5fb7700 1 -- 172.21.15.73:0/236699201 >> 172.21.15.73:0/236699201 conn(0x7fb2f00fbcc0 msgr2=0x7fb2f00fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:16.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.592+0000 7fb2f5fb7700 1 -- 172.21.15.73:0/236699201 shutdown_connections 2023-08-10T11:52:16.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.592+0000 7fb2f5fb7700 1 -- 172.21.15.73:0/236699201 wait complete. 2023-08-10T11:52:16.606 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T11:52:16.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.729+0000 7f7e81b99700 1 -- 172.21.15.73:0/413086199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e7c1011f0 msgr2=0x7f7e7c107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:16.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.729+0000 7f7e81b99700 1 --2- 172.21.15.73:0/413086199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e7c1011f0 0x7f7e7c107aa0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400b0d0 tx=0x7f7e7400b3e0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.729+0000 7f7e81b99700 1 -- 172.21.15.73:0/413086199 shutdown_connections 2023-08-10T11:52:16.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.729+0000 7f7e81b99700 1 --2- 172.21.15.73:0/413086199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e7c0ff660 0x7f7e7c0ffa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.729+0000 7f7e81b99700 1 --2- 172.21.15.73:0/413086199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e7c1011f0 0x7f7e7c107aa0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.729+0000 7f7e81b99700 1 --2- 172.21.15.73:0/413086199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e7c100850 0x7f7e7c100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.729+0000 7f7e81b99700 1 -- 172.21.15.73:0/413086199 >> 172.21.15.73:0/413086199 conn(0x7f7e7c0fabd0 msgr2=0x7f7e7c0fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:16.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.729+0000 7f7e81b99700 1 -- 172.21.15.73:0/413086199 shutdown_connections 2023-08-10T11:52:16.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.729+0000 7f7e81b99700 1 -- 172.21.15.73:0/413086199 wait complete. 2023-08-10T11:52:16.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.730+0000 7f7e81b99700 1 Processor -- start 2023-08-10T11:52:16.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.730+0000 7f7e81b99700 1 -- start start 2023-08-10T11:52:16.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.730+0000 7f7e81b99700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e7c0ff660 0x7f7e7c195470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:16.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.730+0000 7f7e81b99700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e7c100850 0x7f7e7c1959b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:16.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.730+0000 7f7e81b99700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e7c1011f0 0x7f7e7c19ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:16.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.730+0000 7f7e81b99700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c19cff0 con 0x7f7e7c100850 2023-08-10T11:52:16.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.730+0000 7f7e81b99700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c19d130 con 0x7f7e7c0ff660 2023-08-10T11:52:16.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.730+0000 7f7e81b99700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c19d2c0 con 0x7f7e7c1011f0 2023-08-10T11:52:16.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.730+0000 7f7e7affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e7c100850 0x7f7e7c1959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:16.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.730+0000 7f7e7affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e7c100850 0x7f7e7c1959b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60142/0 (socket says 172.21.15.73:60142) 2023-08-10T11:52:16.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.730+0000 7f7e7affd700 1 -- 172.21.15.73:0/4200659864 learned_addr learned my addr 172.21.15.73:0/4200659864 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:16.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.730+0000 7f7e7b7fe700 1 --2- 172.21.15.73:0/4200659864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e7c0ff660 0x7f7e7c195470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:16.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.731+0000 7f7e7bfff700 1 --2- 172.21.15.73:0/4200659864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e7c1011f0 0x7f7e7c19ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:16.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.731+0000 7f7e7affd700 1 -- 172.21.15.73:0/4200659864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e7c1011f0 msgr2=0x7f7e7c19ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:16.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.731+0000 7f7e7affd700 1 --2- 172.21.15.73:0/4200659864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e7c1011f0 0x7f7e7c19ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.731+0000 7f7e7affd700 1 -- 172.21.15.73:0/4200659864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e7c0ff660 msgr2=0x7f7e7c195470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:16.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.731+0000 7f7e7affd700 1 --2- 172.21.15.73:0/4200659864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e7c0ff660 0x7f7e7c195470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.731+0000 7f7e7affd700 1 -- 172.21.15.73:0/4200659864 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e74009d00 con 0x7f7e7c100850 2023-08-10T11:52:16.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.731+0000 7f7e7b7fe700 1 --2- 172.21.15.73:0/4200659864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e7c0ff660 0x7f7e7c195470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:52:16.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.731+0000 7f7e7affd700 1 --2- 172.21.15.73:0/4200659864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e7c100850 0x7f7e7c1959b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7e7000d950 tx=0x7f7e7000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:16.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.731+0000 7f7e78ff9700 1 -- 172.21.15.73:0/4200659864 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e70009b40 con 0x7f7e7c100850 2023-08-10T11:52:16.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.731+0000 7f7e81b99700 1 -- 172.21.15.73:0/4200659864 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e7c0679f0 con 0x7f7e7c100850 2023-08-10T11:52:16.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.731+0000 7f7e78ff9700 1 -- 172.21.15.73:0/4200659864 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e70009ca0 con 0x7f7e7c100850 2023-08-10T11:52:16.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.731+0000 7f7e78ff9700 1 -- 172.21.15.73:0/4200659864 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7000f620 con 0x7f7e7c100850 2023-08-10T11:52:16.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.731+0000 7f7e81b99700 1 -- 172.21.15.73:0/4200659864 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e7c067f00 con 0x7f7e7c100850 2023-08-10T11:52:16.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.732+0000 7f7e81b99700 1 -- 172.21.15.73:0/4200659864 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e7c10aed0 con 0x7f7e7c100850 2023-08-10T11:52:16.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.733+0000 7f7e78ff9700 1 -- 172.21.15.73:0/4200659864 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f7e70010460 con 0x7f7e7c100850 2023-08-10T11:52:16.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.733+0000 7f7e78ff9700 1 --2- 172.21.15.73:0/4200659864 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f7e640a11e0 0x7f7e640a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:16.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.733+0000 7f7e78ff9700 1 -- 172.21.15.73:0/4200659864 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7e700cce10 con 0x7f7e7c100850 2023-08-10T11:52:16.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.733+0000 7f7e7b7fe700 1 --2- 172.21.15.73:0/4200659864 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f7e640a11e0 0x7f7e640a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:16.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.734+0000 7f7e7b7fe700 1 --2- 172.21.15.73:0/4200659864 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f7e640a11e0 0x7f7e640a36a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c005950 tx=0x7f7e6c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:16.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.738+0000 7f7e78ff9700 1 -- 172.21.15.73:0/4200659864 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f7e70096410 con 0x7f7e7c100850 2023-08-10T11:52:16.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.928+0000 7f7e81b99700 1 -- 172.21.15.73:0/4200659864 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7e7c1063b0 con 0x7f7e7c100850 2023-08-10T11:52:16.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.928+0000 7f7e78ff9700 1 -- 172.21.15.73:0/4200659864 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7e70020020 con 0x7f7e7c100850 2023-08-10T11:52:16.931 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-08-10T11:52:16.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.931+0000 7f7e81b99700 1 -- 172.21.15.73:0/4200659864 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f7e640a11e0 msgr2=0x7f7e640a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.931+0000 7f7e81b99700 1 --2- 172.21.15.73:0/4200659864 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f7e640a11e0 0x7f7e640a36a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c005950 tx=0x7f7e6c0058e0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.931+0000 7f7e81b99700 1 -- 172.21.15.73:0/4200659864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e7c100850 msgr2=0x7f7e7c1959b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.931+0000 7f7e81b99700 1 --2- 172.21.15.73:0/4200659864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e7c100850 0x7f7e7c1959b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7e7000d950 tx=0x7f7e7000dd10 comp rx=0 tx=0).stop 2023-08-10T11:52:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.931+0000 7f7e81b99700 1 -- 172.21.15.73:0/4200659864 shutdown_connections 2023-08-10T11:52:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.931+0000 7f7e81b99700 1 --2- 172.21.15.73:0/4200659864 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f7e640a11e0 0x7f7e640a36a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.931+0000 7f7e81b99700 1 --2- 172.21.15.73:0/4200659864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e7c0ff660 0x7f7e7c195470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.931+0000 7f7e81b99700 1 --2- 172.21.15.73:0/4200659864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e7c1011f0 0x7f7e7c19ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.931+0000 7f7e81b99700 1 --2- 172.21.15.73:0/4200659864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e7c100850 0x7f7e7c1959b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:16.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.931+0000 7f7e81b99700 1 -- 172.21.15.73:0/4200659864 >> 172.21.15.73:0/4200659864 conn(0x7f7e7c0fabd0 msgr2=0x7f7e7c0fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:16.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.931+0000 7f7e81b99700 1 -- 172.21.15.73:0/4200659864 shutdown_connections 2023-08-10T11:52:16.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:16.931+0000 7f7e81b99700 1 -- 172.21.15.73:0/4200659864 wait complete. 2023-08-10T11:52:16.945 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T11:52:17.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.067+0000 7f880b7a9700 1 -- 172.21.15.73:0/3263374369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8804101240 msgr2=0x7f8804103630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:17.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.067+0000 7f880b7a9700 1 --2- 172.21.15.73:0/3263374369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8804101240 0x7f8804103630 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009990 tx=0x7f87f4009ca0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.067+0000 7f880b7a9700 1 -- 172.21.15.73:0/3263374369 shutdown_connections 2023-08-10T11:52:17.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.067+0000 7f880b7a9700 1 --2- 172.21.15.73:0/3263374369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88041064a0 0x7f88041088b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.067+0000 7f880b7a9700 1 --2- 172.21.15.73:0/3263374369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8804101240 0x7f8804103630 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.067+0000 7f880b7a9700 1 --2- 172.21.15.73:0/3263374369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8804103b70 0x7f8804105f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.067+0000 7f880b7a9700 1 -- 172.21.15.73:0/3263374369 >> 172.21.15.73:0/3263374369 conn(0x7f88040fabd0 msgr2=0x7f88040fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:17.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.067+0000 7f880b7a9700 1 -- 172.21.15.73:0/3263374369 shutdown_connections 2023-08-10T11:52:17.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.067+0000 7f880b7a9700 1 -- 172.21.15.73:0/3263374369 wait complete. 2023-08-10T11:52:17.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.068+0000 7f880b7a9700 1 Processor -- start 2023-08-10T11:52:17.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.068+0000 7f880b7a9700 1 -- start start 2023-08-10T11:52:17.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.068+0000 7f880b7a9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8804101240 0x7f88041964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:17.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.068+0000 7f880b7a9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8804103b70 0x7f8804196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:17.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.068+0000 7f880b7a9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88041064a0 0x7f880419da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:17.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.068+0000 7f880b7a9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880419e050 con 0x7f8804101240 2023-08-10T11:52:17.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.068+0000 7f880b7a9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880419e190 con 0x7f8804103b70 2023-08-10T11:52:17.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.068+0000 7f880b7a9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880419e320 con 0x7f88041064a0 2023-08-10T11:52:17.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.068+0000 7f8809545700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8804101240 0x7f88041964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:17.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.068+0000 7f8809545700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8804101240 0x7f88041964d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60154/0 (socket says 172.21.15.73:60154) 2023-08-10T11:52:17.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.068+0000 7f8809545700 1 -- 172.21.15.73:0/2667219787 learned_addr learned my addr 172.21.15.73:0/2667219787 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:17.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.068+0000 7f8808d44700 1 --2- 172.21.15.73:0/2667219787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8804103b70 0x7f8804196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:17.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.068+0000 7f8809545700 1 -- 172.21.15.73:0/2667219787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88041064a0 msgr2=0x7f880419da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:17.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.068+0000 7f8809545700 1 --2- 172.21.15.73:0/2667219787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88041064a0 0x7f880419da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.068+0000 7f8809545700 1 -- 172.21.15.73:0/2667219787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8804103b70 msgr2=0x7f8804196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:17.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.068+0000 7f8809545700 1 --2- 172.21.15.73:0/2667219787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8804103b70 0x7f8804196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.068+0000 7f8809545700 1 -- 172.21.15.73:0/2667219787 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f40095f0 con 0x7f8804101240 2023-08-10T11:52:17.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.068+0000 7f8808d44700 1 --2- 172.21.15.73:0/2667219787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8804103b70 0x7f8804196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:52:17.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.068+0000 7f8809545700 1 --2- 172.21.15.73:0/2667219787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8804101240 0x7f88041964d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f87f4005910 tx=0x7f87f400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:17.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.068+0000 7f87fa7fc700 1 -- 172.21.15.73:0/2667219787 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f401d070 con 0x7f8804101240 2023-08-10T11:52:17.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.068+0000 7f87fa7fc700 1 -- 172.21.15.73:0/2667219787 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f87f400fc30 con 0x7f8804101240 2023-08-10T11:52:17.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.068+0000 7f880b7a9700 1 -- 172.21.15.73:0/2667219787 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f880419e5a0 con 0x7f8804101240 2023-08-10T11:52:17.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.068+0000 7f87fa7fc700 1 -- 172.21.15.73:0/2667219787 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f4017650 con 0x7f8804101240 2023-08-10T11:52:17.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.068+0000 7f880b7a9700 1 -- 172.21.15.73:0/2667219787 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f880419e9c0 con 0x7f8804101240 2023-08-10T11:52:17.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.069+0000 7f880b7a9700 1 -- 172.21.15.73:0/2667219787 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88040fc750 con 0x7f8804101240 2023-08-10T11:52:17.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.070+0000 7f87fa7fc700 1 -- 172.21.15.73:0/2667219787 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f87f4022470 con 0x7f8804101240 2023-08-10T11:52:17.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.071+0000 7f87fa7fc700 1 --2- 172.21.15.73:0/2667219787 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f87f00a11e0 0x7f87f00a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:17.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.071+0000 7f8808d44700 1 --2- 172.21.15.73:0/2667219787 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f87f00a11e0 0x7f87f00a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:17.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.071+0000 7f87fa7fc700 1 -- 172.21.15.73:0/2667219787 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f87f40ce320 con 0x7f8804101240 2023-08-10T11:52:17.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.071+0000 7f8808d44700 1 --2- 172.21.15.73:0/2667219787 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f87f00a11e0 0x7f87f00a36a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f880000ac10 tx=0x7f8800005f30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:17.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.074+0000 7f87fa7fc700 1 -- 172.21.15.73:0/2667219787 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f87f4097a40 con 0x7f8804101240 2023-08-10T11:52:17.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:16 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3264687167' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:52:17.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:16 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/2228993465' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:52:17.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:16 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/236699201' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:52:17.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:16 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3264687167' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:52:17.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:16 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/2228993465' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:52:17.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:16 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/236699201' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:52:17.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.261+0000 7f880b7a9700 1 -- 172.21.15.73:0/2667219787 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f880402cbe0 con 0x7f8804101240 2023-08-10T11:52:17.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.261+0000 7f87fa7fc700 1 -- 172.21.15.73:0/2667219787 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87f409b060 con 0x7f8804101240 2023-08-10T11:52:17.263 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-08-10T11:52:17.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.263+0000 7f880b7a9700 1 -- 172.21.15.73:0/2667219787 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f87f00a11e0 msgr2=0x7f87f00a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:17.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.263+0000 7f880b7a9700 1 --2- 172.21.15.73:0/2667219787 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f87f00a11e0 0x7f87f00a36a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f880000ac10 tx=0x7f8800005f30 comp rx=0 tx=0).stop 2023-08-10T11:52:17.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.263+0000 7f880b7a9700 1 -- 172.21.15.73:0/2667219787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8804101240 msgr2=0x7f88041964d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:17.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.263+0000 7f880b7a9700 1 --2- 172.21.15.73:0/2667219787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8804101240 0x7f88041964d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f87f4005910 tx=0x7f87f400f740 comp rx=0 tx=0).stop 2023-08-10T11:52:17.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.263+0000 7f880b7a9700 1 -- 172.21.15.73:0/2667219787 shutdown_connections 2023-08-10T11:52:17.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.263+0000 7f880b7a9700 1 --2- 172.21.15.73:0/2667219787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88041064a0 0x7f880419da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.263+0000 7f880b7a9700 1 --2- 172.21.15.73:0/2667219787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8804101240 0x7f88041964d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.263+0000 7f880b7a9700 1 --2- 172.21.15.73:0/2667219787 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f87f00a11e0 0x7f87f00a36a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.263+0000 7f880b7a9700 1 --2- 172.21.15.73:0/2667219787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8804103b70 0x7f8804196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.263+0000 7f880b7a9700 1 -- 172.21.15.73:0/2667219787 >> 172.21.15.73:0/2667219787 conn(0x7f88040fabd0 msgr2=0x7f8804101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:17.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.263+0000 7f880b7a9700 1 -- 172.21.15.73:0/2667219787 shutdown_connections 2023-08-10T11:52:17.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.263+0000 7f880b7a9700 1 -- 172.21.15.73:0/2667219787 wait complete. 2023-08-10T11:52:17.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:16 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3264687167' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:52:17.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:16 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2228993465' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:52:17.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:16 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/236699201' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:52:17.278 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T11:52:17.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.396+0000 7fd080636700 1 -- 172.21.15.73:0/1124556711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd078100890 msgr2=0x7fd078100cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:17.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.396+0000 7fd080636700 1 --2- 172.21.15.73:0/1124556711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd078100890 0x7fd078100cf0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd0740099c0 tx=0x7fd074009cd0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.396+0000 7fd080636700 1 -- 172.21.15.73:0/1124556711 shutdown_connections 2023-08-10T11:52:17.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.396+0000 7fd080636700 1 --2- 172.21.15.73:0/1124556711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd078101230 0x7fd078107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.396+0000 7fd080636700 1 --2- 172.21.15.73:0/1124556711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0780ff6a0 0x7fd0780ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.396+0000 7fd080636700 1 --2- 172.21.15.73:0/1124556711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd078100890 0x7fd078100cf0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.396+0000 7fd080636700 1 -- 172.21.15.73:0/1124556711 >> 172.21.15.73:0/1124556711 conn(0x7fd0780fabf0 msgr2=0x7fd0780fd050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:17.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.396+0000 7fd080636700 1 -- 172.21.15.73:0/1124556711 shutdown_connections 2023-08-10T11:52:17.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.396+0000 7fd080636700 1 -- 172.21.15.73:0/1124556711 wait complete. 2023-08-10T11:52:17.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.397+0000 7fd080636700 1 Processor -- start 2023-08-10T11:52:17.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.397+0000 7fd080636700 1 -- start start 2023-08-10T11:52:17.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.397+0000 7fd080636700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0780ff6a0 0x7fd0780696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:17.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.397+0000 7fd080636700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd078100890 0x7fd07819b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:17.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.397+0000 7fd080636700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd078101230 0x7fd07819d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:17.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.397+0000 7fd080636700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07819df80 con 0x7fd0780ff6a0 2023-08-10T11:52:17.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.397+0000 7fd080636700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07819e0f0 con 0x7fd078101230 2023-08-10T11:52:17.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.397+0000 7fd080636700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07819e2b0 con 0x7fd078100890 2023-08-10T11:52:17.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.397+0000 7fd07e3d2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0780ff6a0 0x7fd0780696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:17.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.397+0000 7fd07e3d2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0780ff6a0 0x7fd0780696c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60168/0 (socket says 172.21.15.73:60168) 2023-08-10T11:52:17.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.397+0000 7fd07e3d2700 1 -- 172.21.15.73:0/3596875992 learned_addr learned my addr 172.21.15.73:0/3596875992 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:17.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.397+0000 7fd07ebd3700 1 --2- 172.21.15.73:0/3596875992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd078101230 0x7fd07819d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:17.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.397+0000 7fd07dbd1700 1 --2- 172.21.15.73:0/3596875992 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd078100890 0x7fd07819b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:17.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.397+0000 7fd07e3d2700 1 -- 172.21.15.73:0/3596875992 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd078100890 msgr2=0x7fd07819b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:17.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.397+0000 7fd07e3d2700 1 --2- 172.21.15.73:0/3596875992 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd078100890 0x7fd07819b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.398+0000 7fd07e3d2700 1 -- 172.21.15.73:0/3596875992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd078101230 msgr2=0x7fd07819d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:17.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.398+0000 7fd07e3d2700 1 --2- 172.21.15.73:0/3596875992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd078101230 0x7fd07819d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.398+0000 7fd07e3d2700 1 -- 172.21.15.73:0/3596875992 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0740095f0 con 0x7fd0780ff6a0 2023-08-10T11:52:17.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.398+0000 7fd07ebd3700 1 --2- 172.21.15.73:0/3596875992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd078101230 0x7fd07819d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:52:17.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.398+0000 7fd07dbd1700 1 --2- 172.21.15.73:0/3596875992 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd078100890 0x7fd07819b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:52:17.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.398+0000 7fd07e3d2700 1 --2- 172.21.15.73:0/3596875992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0780ff6a0 0x7fd0780696c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd06800d980 tx=0x7fd06800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:17.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.398+0000 7fd06f7fe700 1 -- 172.21.15.73:0/3596875992 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06800de60 con 0x7fd0780ff6a0 2023-08-10T11:52:17.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.398+0000 7fd06f7fe700 1 -- 172.21.15.73:0/3596875992 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0680044e0 con 0x7fd0780ff6a0 2023-08-10T11:52:17.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.398+0000 7fd06f7fe700 1 -- 172.21.15.73:0/3596875992 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd068003be0 con 0x7fd0780ff6a0 2023-08-10T11:52:17.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.398+0000 7fd080636700 1 -- 172.21.15.73:0/3596875992 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd07819e590 con 0x7fd0780ff6a0 2023-08-10T11:52:17.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.398+0000 7fd080636700 1 -- 172.21.15.73:0/3596875992 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd07819eaa0 con 0x7fd0780ff6a0 2023-08-10T11:52:17.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.399+0000 7fd080636700 1 -- 172.21.15.73:0/3596875992 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd078106b90 con 0x7fd0780ff6a0 2023-08-10T11:52:17.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.400+0000 7fd06f7fe700 1 -- 172.21.15.73:0/3596875992 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fd068009bb0 con 0x7fd0780ff6a0 2023-08-10T11:52:17.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.400+0000 7fd06f7fe700 1 --2- 172.21.15.73:0/3596875992 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd0640a12a0 0x7fd0640a3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:17.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.401+0000 7fd07dbd1700 1 --2- 172.21.15.73:0/3596875992 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd0640a12a0 0x7fd0640a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:17.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.401+0000 7fd06f7fe700 1 -- 172.21.15.73:0/3596875992 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd0680ccb30 con 0x7fd0780ff6a0 2023-08-10T11:52:17.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.401+0000 7fd07dbd1700 1 --2- 172.21.15.73:0/3596875992 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd0640a12a0 0x7fd0640a3760 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd074006010 tx=0x7fd074000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:17.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.404+0000 7fd06f7fe700 1 -- 172.21.15.73:0/3596875992 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fd0680961b0 con 0x7fd0780ff6a0 2023-08-10T11:52:17.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.637+0000 7fd080636700 1 -- 172.21.15.73:0/3596875992 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd07802c970 con 0x7fd0780ff6a0 2023-08-10T11:52:17.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.637+0000 7fd06f7fe700 1 -- 172.21.15.73:0/3596875992 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10891 (secure 0 0 0) 0x7fd068009940 con 0x7fd0780ff6a0 2023-08-10T11:52:17.639 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:52:17.640 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1319360725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1319360725},{"type":"v1","addr":"172.21.15.73:6835","nonce":1319360725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/431221951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":431221951},{"type":"v1","addr":"172.21.15.73:6837","nonce":431221951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-10T11:50:54.304447+0000","modified":"2023-08-10T11:51:01.523452+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24503,"mds_1":24479,"mds_2":24451,"mds_3":24443,"mds_4":24419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6839/1099539481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1099539481},{"type":"v1","addr":"172.21.15.73:6839","nonce":1099539481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6841/3067925859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":3067925859},{"type":"v1","addr":"172.21.15.73:6841","nonce":3067925859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24397":{"gid":24397,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6833/3028461815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3028461815},{"type":"v1","addr":"172.21.15.156:6833","nonce":3028461815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24419":{"gid":24419,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6833/4148407154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4148407154},{"type":"v1","addr":"172.21.15.152:6833","nonce":4148407154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24443":{"gid":24443,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.152:6835/1791572604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1791572604},{"type":"v1","addr":"172.21.15.152:6835","nonce":1791572604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.156:6835/904126790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":904126790},{"type":"v1","addr":"172.21.15.156:6835","nonce":904126790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24457":{"gid":24457,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/4284306352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":4284306352},{"type":"v1","addr":"172.21.15.156:6837","nonce":4284306352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6839/3361058731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":3361058731},{"type":"v1","addr":"172.21.15.156:6839","nonce":3361058731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6837/74214089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":74214089},{"type":"v1","addr":"172.21.15.152:6837","nonce":74214089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6839/3870202690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3870202690},{"type":"v1","addr":"172.21.15.152:6839","nonce":3870202690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T11:52:17.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.639+0000 7fd080636700 1 -- 172.21.15.73:0/3596875992 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd0640a12a0 msgr2=0x7fd0640a3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:17.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.639+0000 7fd080636700 1 --2- 172.21.15.73:0/3596875992 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd0640a12a0 0x7fd0640a3760 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd074006010 tx=0x7fd074000bc0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.639+0000 7fd080636700 1 -- 172.21.15.73:0/3596875992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0780ff6a0 msgr2=0x7fd0780696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:17.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.639+0000 7fd080636700 1 --2- 172.21.15.73:0/3596875992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0780ff6a0 0x7fd0780696c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd06800d980 tx=0x7fd06800dd40 comp rx=0 tx=0).stop 2023-08-10T11:52:17.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.639+0000 7fd080636700 1 -- 172.21.15.73:0/3596875992 shutdown_connections 2023-08-10T11:52:17.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.639+0000 7fd080636700 1 --2- 172.21.15.73:0/3596875992 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd0640a12a0 0x7fd0640a3760 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.639+0000 7fd080636700 1 --2- 172.21.15.73:0/3596875992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd078101230 0x7fd07819d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.639+0000 7fd080636700 1 --2- 172.21.15.73:0/3596875992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0780ff6a0 0x7fd0780696c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.639+0000 7fd080636700 1 --2- 172.21.15.73:0/3596875992 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd078100890 0x7fd07819b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.639+0000 7fd080636700 1 -- 172.21.15.73:0/3596875992 >> 172.21.15.73:0/3596875992 conn(0x7fd0780fabf0 msgr2=0x7fd078103cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:17.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.639+0000 7fd080636700 1 -- 172.21.15.73:0/3596875992 shutdown_connections 2023-08-10T11:52:17.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.639+0000 7fd080636700 1 -- 172.21.15.73:0/3596875992 wait complete. 2023-08-10T11:52:17.643 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 27 2023-08-10T11:52:17.654 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T11:52:17.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.773+0000 7fae214de700 1 -- 172.21.15.73:0/1257000598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae1c0fea40 msgr2=0x7fae1c0fee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:17.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.773+0000 7fae214de700 1 --2- 172.21.15.73:0/1257000598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae1c0fea40 0x7fae1c0fee60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fae10009990 tx=0x7fae10009ca0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.773+0000 7fae214de700 1 -- 172.21.15.73:0/1257000598 shutdown_connections 2023-08-10T11:52:17.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.773+0000 7fae214de700 1 --2- 172.21.15.73:0/1257000598 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae1c102450 0x7fae1c108d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.773+0000 7fae214de700 1 --2- 172.21.15.73:0/1257000598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae1c0fea40 0x7fae1c0fee60 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.773+0000 7fae214de700 1 --2- 172.21.15.73:0/1257000598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae1c101ab0 0x7fae1c101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.773+0000 7fae214de700 1 -- 172.21.15.73:0/1257000598 >> 172.21.15.73:0/1257000598 conn(0x7fae1c0fa330 msgr2=0x7fae1c0fc790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:17.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.773+0000 7fae214de700 1 -- 172.21.15.73:0/1257000598 shutdown_connections 2023-08-10T11:52:17.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.773+0000 7fae214de700 1 -- 172.21.15.73:0/1257000598 wait complete. 2023-08-10T11:52:17.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.773+0000 7fae214de700 1 Processor -- start 2023-08-10T11:52:17.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.774+0000 7fae214de700 1 -- start start 2023-08-10T11:52:17.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.774+0000 7fae214de700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae1c0fea40 0x7fae1c1986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:17.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.774+0000 7fae214de700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae1c101ab0 0x7fae1c198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:17.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.774+0000 7fae214de700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae1c102450 0x7fae1c19fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:17.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.774+0000 7fae214de700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c1a0240 con 0x7fae1c102450 2023-08-10T11:52:17.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.774+0000 7fae214de700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c1a0380 con 0x7fae1c101ab0 2023-08-10T11:52:17.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.774+0000 7fae214de700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c1a0510 con 0x7fae1c0fea40 2023-08-10T11:52:17.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.774+0000 7fae1b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae1c102450 0x7fae1c19fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:17.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.774+0000 7fae1b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae1c102450 0x7fae1c19fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60186/0 (socket says 172.21.15.73:60186) 2023-08-10T11:52:17.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.774+0000 7fae1b7fe700 1 -- 172.21.15.73:0/2829325830 learned_addr learned my addr 172.21.15.73:0/2829325830 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:17.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.774+0000 7fae1a7fc700 1 --2- 172.21.15.73:0/2829325830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae1c101ab0 0x7fae1c198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:17.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.774+0000 7fae1affd700 1 --2- 172.21.15.73:0/2829325830 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae1c0fea40 0x7fae1c1986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:17.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.774+0000 7fae1b7fe700 1 -- 172.21.15.73:0/2829325830 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae1c0fea40 msgr2=0x7fae1c1986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:17.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.774+0000 7fae1b7fe700 1 --2- 172.21.15.73:0/2829325830 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae1c0fea40 0x7fae1c1986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.774+0000 7fae1b7fe700 1 -- 172.21.15.73:0/2829325830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae1c101ab0 msgr2=0x7fae1c198c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:17.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.774+0000 7fae1b7fe700 1 --2- 172.21.15.73:0/2829325830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae1c101ab0 0x7fae1c198c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.774+0000 7fae1b7fe700 1 -- 172.21.15.73:0/2829325830 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae100095f0 con 0x7fae1c102450 2023-08-10T11:52:17.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.774+0000 7fae1affd700 1 --2- 172.21.15.73:0/2829325830 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae1c0fea40 0x7fae1c1986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:52:17.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.774+0000 7fae1b7fe700 1 --2- 172.21.15.73:0/2829325830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae1c102450 0x7fae1c19fc70 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fae14007ee0 tx=0x7fae1400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:17.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.774+0000 7fae03fff700 1 -- 172.21.15.73:0/2829325830 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae14017070 con 0x7fae1c102450 2023-08-10T11:52:17.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.774+0000 7fae214de700 1 -- 172.21.15.73:0/2829325830 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae1c1a07f0 con 0x7fae1c102450 2023-08-10T11:52:17.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.774+0000 7fae03fff700 1 -- 172.21.15.73:0/2829325830 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae1400f040 con 0x7fae1c102450 2023-08-10T11:52:17.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.774+0000 7fae03fff700 1 -- 172.21.15.73:0/2829325830 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae14005740 con 0x7fae1c102450 2023-08-10T11:52:17.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.774+0000 7fae214de700 1 -- 172.21.15.73:0/2829325830 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae1c1a0d00 con 0x7fae1c102450 2023-08-10T11:52:17.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.775+0000 7fae214de700 1 -- 172.21.15.73:0/2829325830 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae1c192da0 con 0x7fae1c102450 2023-08-10T11:52:17.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.777+0000 7fae03fff700 1 -- 172.21.15.73:0/2829325830 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fae1400dc60 con 0x7fae1c102450 2023-08-10T11:52:17.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.777+0000 7fae03fff700 1 --2- 172.21.15.73:0/2829325830 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fae040a1220 0x7fae040a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:17.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.778+0000 7fae1affd700 1 --2- 172.21.15.73:0/2829325830 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fae040a1220 0x7fae040a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:17.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.778+0000 7fae03fff700 1 -- 172.21.15.73:0/2829325830 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fae140cc860 con 0x7fae1c102450 2023-08-10T11:52:17.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.778+0000 7fae1affd700 1 --2- 172.21.15.73:0/2829325830 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fae040a1220 0x7fae040a36e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fae1000b5c0 tx=0x7fae10005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:17.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.781+0000 7fae03fff700 1 -- 172.21.15.73:0/2829325830 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fae14095e60 con 0x7fae1c102450 2023-08-10T11:52:17.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.973+0000 7fae214de700 1 -- 172.21.15.73:0/2829325830 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae1c02cbc0 con 0x7fae1c102450 2023-08-10T11:52:17.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.975+0000 7fae03fff700 1 -- 172.21.15.73:0/2829325830 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22482 (secure 0 0 0) 0x7fae14099480 con 0x7fae1c102450 2023-08-10T11:52:17.977 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:52:17.978 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":85,"fsid":"0e619a74-3773-11ee-9b37-001a4aab830c","created":"2023-08-10T11:43:53.974768+0000","modified":"2023-08-10T11:51:49.637159+0000","last_up_change":"2023-08-10T11:50:12.914422+0000","last_in_change":"2023-08-10T11:49:54.624543+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T11:46:58.735153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T11:50:52.517974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T11:50:53.465357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3219ae18-cc4c-4712-b616-79f6949066e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6803","nonce":2725694252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6805","nonce":2725694252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6809","nonce":2725694252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6807","nonce":2725694252}]},"public_addr":"172.21.15.73:6803/2725694252","cluster_addr":"172.21.15.73:6805/2725694252","heartbeat_back_addr":"172.21.15.73:6809/2725694252","heartbeat_front_addr":"172.21.15.73:6807/2725694252","state":["exists","up"]},{"osd":1,"uuid":"bbfe6cd9-b3d3-4b8d-8814-507a867f8c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6801","nonce":836829168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6803","nonce":836829168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6807","nonce":836829168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6805","nonce":836829168}]},"public_addr":"172.21.15.152:6801/836829168","cluster_addr":"172.21.15.152:6803/836829168","heartbeat_back_addr":"172.21.15.152:6807/836829168","heartbeat_front_addr":"172.21.15.152:6805/836829168","state":["exists","up"]},{"osd":2,"uuid":"f57f5b2c-3208-45c0-beba-8501694b99c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6801","nonce":1789212298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6803","nonce":1789212298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6807","nonce":1789212298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6805","nonce":1789212298}]},"public_addr":"172.21.15.156:6801/1789212298","cluster_addr":"172.21.15.156:6803/1789212298","heartbeat_back_addr":"172.21.15.156:6807/1789212298","heartbeat_front_addr":"172.21.15.156:6805/1789212298","state":["exists","up"]},{"osd":3,"uuid":"18592408-3696-4ab8-ad41-c172b8409829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6811","nonce":3101572649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6813","nonce":3101572649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6817","nonce":3101572649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6815","nonce":3101572649}]},"public_addr":"172.21.15.73:6811/3101572649","cluster_addr":"172.21.15.73:6813/3101572649","heartbeat_back_addr":"172.21.15.73:6817/3101572649","heartbeat_front_addr":"172.21.15.73:6815/3101572649","state":["exists","up"]},{"osd":4,"uuid":"fb3adb09-8807-42d9-8db9-1867c5fe02da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6809","nonce":1451517889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6811","nonce":1451517889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6815","nonce":1451517889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6813","nonce":1451517889}]},"public_addr":"172.21.15.152:6809/1451517889","cluster_addr":"172.21.15.152:6811/1451517889","heartbeat_back_addr":"172.21.15.152:6815/1451517889","heartbeat_front_addr":"172.21.15.152:6813/1451517889","state":["exists","up"]},{"osd":5,"uuid":"af58a7bd-4e58-4639-95b2-4a76011b61dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6809","nonce":3823368741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6811","nonce":3823368741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6815","nonce":3823368741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6813","nonce":3823368741}]},"public_addr":"172.21.15.156:6809/3823368741","cluster_addr":"172.21.15.156:6811/3823368741","heartbeat_back_addr":"172.21.15.156:6815/3823368741","heartbeat_front_addr":"172.21.15.156:6813/3823368741","state":["exists","up"]},{"osd":6,"uuid":"f6ae502d-4af9-4f6a-8636-b5b683dfdfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6819","nonce":2533620458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6821","nonce":2533620458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6825","nonce":2533620458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6823","nonce":2533620458}]},"public_addr":"172.21.15.73:6819/2533620458","cluster_addr":"172.21.15.73:6821/2533620458","heartbeat_back_addr":"172.21.15.73:6825/2533620458","heartbeat_front_addr":"172.21.15.73:6823/2533620458","state":["exists","up"]},{"osd":7,"uuid":"398fd334-5f6f-427c-95ae-3244fb466f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6817","nonce":4059538477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6819","nonce":4059538477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6823","nonce":4059538477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6821","nonce":4059538477}]},"public_addr":"172.21.15.152:6817/4059538477","cluster_addr":"172.21.15.152:6819/4059538477","heartbeat_back_addr":"172.21.15.152:6823/4059538477","heartbeat_front_addr":"172.21.15.152:6821/4059538477","state":["exists","up"]},{"osd":8,"uuid":"58f46e64-2624-4ad4-bb6a-225624153837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6817","nonce":96487555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6819","nonce":96487555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6823","nonce":96487555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6821","nonce":96487555}]},"public_addr":"172.21.15.156:6817/96487555","cluster_addr":"172.21.15.156:6819/96487555","heartbeat_back_addr":"172.21.15.156:6823/96487555","heartbeat_front_addr":"172.21.15.156:6821/96487555","state":["exists","up"]},{"osd":9,"uuid":"9389dd5b-da2d-43b6-8bc0-bb1af13f72c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6827","nonce":2050124321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6829","nonce":2050124321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6833","nonce":2050124321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6831","nonce":2050124321}]},"public_addr":"172.21.15.73:6827/2050124321","cluster_addr":"172.21.15.73:6829/2050124321","heartbeat_back_addr":"172.21.15.73:6833/2050124321","heartbeat_front_addr":"172.21.15.73:6831/2050124321","state":["exists","up"]},{"osd":10,"uuid":"563c1e34-3acd-46ab-ba36-e9d87f635e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6825","nonce":1513186350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6827","nonce":1513186350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6831","nonce":1513186350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6829","nonce":1513186350}]},"public_addr":"172.21.15.152:6825/1513186350","cluster_addr":"172.21.15.152:6827/1513186350","heartbeat_back_addr":"172.21.15.152:6831/1513186350","heartbeat_front_addr":"172.21.15.152:6829/1513186350","state":["exists","up"]},{"osd":11,"uuid":"f1b55889-14fd-4cc9-bed7-43748086fb77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6825","nonce":737904755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6827","nonce":737904755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6831","nonce":737904755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6829","nonce":737904755}]},"public_addr":"172.21.15.156:6825/737904755","cluster_addr":"172.21.15.156:6827/737904755","heartbeat_back_addr":"172.21.15.156:6831/737904755","heartbeat_front_addr":"172.21.15.156:6829/737904755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:12.023797+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:33.872883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:55.856970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:18.013196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:39.202872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:00.393920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:22.743083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:43.921728+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:05.859488+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:27.618714+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:48.880286+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:50:11.055141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/2202785670":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6800/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:6800/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/1447381524":"2023-08-11T11:44:48.401660+0000","172.21.15.73:0/2545059698":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/4193457623":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2561039569":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2927950081":"2023-08-11T11:44:48.401660+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T11:52:17.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.977+0000 7fae214de700 1 -- 172.21.15.73:0/2829325830 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fae040a1220 msgr2=0x7fae040a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:17.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.977+0000 7fae214de700 1 --2- 172.21.15.73:0/2829325830 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fae040a1220 0x7fae040a36e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fae1000b5c0 tx=0x7fae10005fb0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.977+0000 7fae214de700 1 -- 172.21.15.73:0/2829325830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae1c102450 msgr2=0x7fae1c19fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:17.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.977+0000 7fae214de700 1 --2- 172.21.15.73:0/2829325830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae1c102450 0x7fae1c19fc70 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fae14007ee0 tx=0x7fae1400d3b0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.977+0000 7fae214de700 1 -- 172.21.15.73:0/2829325830 shutdown_connections 2023-08-10T11:52:17.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.977+0000 7fae214de700 1 --2- 172.21.15.73:0/2829325830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae1c102450 0x7fae1c19fc70 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.977+0000 7fae214de700 1 --2- 172.21.15.73:0/2829325830 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae1c0fea40 0x7fae1c1986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.977+0000 7fae214de700 1 --2- 172.21.15.73:0/2829325830 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fae040a1220 0x7fae040a36e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.977+0000 7fae214de700 1 --2- 172.21.15.73:0/2829325830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae1c101ab0 0x7fae1c198c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:17.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.977+0000 7fae214de700 1 -- 172.21.15.73:0/2829325830 >> 172.21.15.73:0/2829325830 conn(0x7fae1c0fa330 msgr2=0x7fae1c107380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:17.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.977+0000 7fae214de700 1 -- 172.21.15.73:0/2829325830 shutdown_connections 2023-08-10T11:52:17.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:17.977+0000 7fae214de700 1 -- 172.21.15.73:0/2829325830 wait complete. 2023-08-10T11:52:17.990 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:17 smithi073 ceph-mon[128869]: pgmap v299: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-08-10T11:52:17.990 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:17 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/4200659864' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:52:17.990 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:17 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2667219787' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:52:17.990 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:17 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3596875992' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:52:17.993 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-08-10T11:50:54.304447+0000', 'modified': '2023-08-10T11:51:01.523452+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24503, 'mds_1': 24479, 'mds_2': 24451, 'mds_3': 24443, 'mds_4': 24419}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14613': {'gid': 14613, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.73:6839/1099539481', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6838', 'nonce': 1099539481}, {'type': 'v1', 'addr': '172.21.15.73:6839', 'nonce': 1099539481}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_14625': {'gid': 14625, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.73:6841/3067925859', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6840', 'nonce': 3067925859}, {'type': 'v1', 'addr': '172.21.15.73:6841', 'nonce': 3067925859}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24397': {'gid': 24397, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.156:6833/3028461815', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6832', 'nonce': 3028461815}, {'type': 'v1', 'addr': '172.21.15.156:6833', 'nonce': 3028461815}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24419': {'gid': 24419, 'name': 'k', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.152:6833/4148407154', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6832', 'nonce': 4148407154}, {'type': 'v1', 'addr': '172.21.15.152:6833', 'nonce': 4148407154}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24443': {'gid': 24443, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.152:6835/1791572604', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6834', 'nonce': 1791572604}, {'type': 'v1', 'addr': '172.21.15.152:6835', 'nonce': 1791572604}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24451': {'gid': 24451, 'name': 'f', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.156:6835/904126790', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6834', 'nonce': 904126790}, {'type': 'v1', 'addr': '172.21.15.156:6835', 'nonce': 904126790}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24457': {'gid': 24457, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.156:6837/4284306352', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6836', 'nonce': 4284306352}, {'type': 'v1', 'addr': '172.21.15.156:6837', 'nonce': 4284306352}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24475': {'gid': 24475, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.156:6839/3361058731', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6838', 'nonce': 3361058731}, {'type': 'v1', 'addr': '172.21.15.156:6839', 'nonce': 3361058731}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24479': {'gid': 24479, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.152:6837/74214089', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6836', 'nonce': 74214089}, {'type': 'v1', 'addr': '172.21.15.152:6837', 'nonce': 74214089}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24503': {'gid': 24503, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.152:6839/3870202690', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6838', 'nonce': 3870202690}, {'type': 'v1', 'addr': '172.21.15.152:6839', 'nonce': 3870202690}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-10T11:52:17.993 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-08-10T11:52:17.994 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.k status 2023-08-10T11:52:18.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.115+0000 7fceeab93700 1 -- 172.21.15.73:0/1673473585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcee40fea50 msgr2=0x7fcee40fee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.115+0000 7fceeab93700 1 --2- 172.21.15.73:0/1673473585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcee40fea50 0x7fcee40fee70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fced8009990 tx=0x7fced8009ca0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.115+0000 7fceeab93700 1 -- 172.21.15.73:0/1673473585 shutdown_connections 2023-08-10T11:52:18.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.115+0000 7fceeab93700 1 --2- 172.21.15.73:0/1673473585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcee41023c0 0x7fcee4108c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.115+0000 7fceeab93700 1 --2- 172.21.15.73:0/1673473585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcee40fea50 0x7fcee40fee70 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.115+0000 7fceeab93700 1 --2- 172.21.15.73:0/1673473585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcee4101a20 0x7fcee4101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.115+0000 7fceeab93700 1 -- 172.21.15.73:0/1673473585 >> 172.21.15.73:0/1673473585 conn(0x7fcee40fa360 msgr2=0x7fcee40fc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.115+0000 7fceeab93700 1 -- 172.21.15.73:0/1673473585 shutdown_connections 2023-08-10T11:52:18.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.115+0000 7fceeab93700 1 -- 172.21.15.73:0/1673473585 wait complete. 2023-08-10T11:52:18.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.116+0000 7fceeab93700 1 Processor -- start 2023-08-10T11:52:18.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.116+0000 7fceeab93700 1 -- start start 2023-08-10T11:52:18.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.116+0000 7fceeab93700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcee40fea50 0x7fcee4101390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.116+0000 7fceeab93700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcee4101a20 0x7fcee40ff9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.116+0000 7fceeab93700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcee41023c0 0x7fcee40fff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.116+0000 7fceeab93700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee41006b0 con 0x7fcee40fea50 2023-08-10T11:52:18.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.116+0000 7fceeab93700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee4100820 con 0x7fcee41023c0 2023-08-10T11:52:18.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.116+0000 7fceeab93700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee41a0520 con 0x7fcee4101a20 2023-08-10T11:52:18.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.116+0000 7fcee892f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcee40fea50 0x7fcee4101390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.116+0000 7fcee892f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcee40fea50 0x7fcee4101390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60196/0 (socket says 172.21.15.73:60196) 2023-08-10T11:52:18.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.116+0000 7fcee892f700 1 -- 172.21.15.73:0/1242006669 learned_addr learned my addr 172.21.15.73:0/1242006669 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:18.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.116+0000 7fcee3fff700 1 --2- 172.21.15.73:0/1242006669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcee4101a20 0x7fcee40ff9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.116+0000 7fcee892f700 1 -- 172.21.15.73:0/1242006669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcee4101a20 msgr2=0x7fcee40ff9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.116+0000 7fcee9130700 1 --2- 172.21.15.73:0/1242006669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcee41023c0 0x7fcee40fff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.116+0000 7fcee892f700 1 --2- 172.21.15.73:0/1242006669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcee4101a20 0x7fcee40ff9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.116+0000 7fcee892f700 1 -- 172.21.15.73:0/1242006669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcee41023c0 msgr2=0x7fcee40fff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.116+0000 7fcee892f700 1 --2- 172.21.15.73:0/1242006669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcee41023c0 0x7fcee40fff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.116+0000 7fcee892f700 1 -- 172.21.15.73:0/1242006669 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced80095f0 con 0x7fcee40fea50 2023-08-10T11:52:18.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.117+0000 7fcee892f700 1 --2- 172.21.15.73:0/1242006669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcee40fea50 0x7fcee4101390 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fced8000c00 tx=0x7fced800f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.117+0000 7fcee1ffb700 1 -- 172.21.15.73:0/1242006669 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced801d070 con 0x7fcee40fea50 2023-08-10T11:52:18.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.117+0000 7fcee1ffb700 1 -- 172.21.15.73:0/1242006669 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fced8005510 con 0x7fcee40fea50 2023-08-10T11:52:18.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.117+0000 7fceeab93700 1 -- 172.21.15.73:0/1242006669 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee41a07a0 con 0x7fcee40fea50 2023-08-10T11:52:18.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.117+0000 7fcee1ffb700 1 -- 172.21.15.73:0/1242006669 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced8004c70 con 0x7fcee40fea50 2023-08-10T11:52:18.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.117+0000 7fceeab93700 1 -- 172.21.15.73:0/1242006669 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee41a0c20 con 0x7fcee40fea50 2023-08-10T11:52:18.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.119+0000 7fcee1ffb700 1 -- 172.21.15.73:0/1242006669 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fced800fc00 con 0x7fcee40fea50 2023-08-10T11:52:18.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.119+0000 7fcee1ffb700 1 --2- 172.21.15.73:0/1242006669 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fced40a1260 0x7fced40a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.120+0000 7fcee3fff700 1 --2- 172.21.15.73:0/1242006669 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fced40a1260 0x7fced40a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.120+0000 7fcee1ffb700 1 -- 172.21.15.73:0/1242006669 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fced80cdb80 con 0x7fcee40fea50 2023-08-10T11:52:18.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.120+0000 7fcee3fff700 1 --2- 172.21.15.73:0/1242006669 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fced40a1260 0x7fced40a3720 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fced000ba60 tx=0x7fced0005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.120+0000 7fcef6d2cb80 1 Processor -- start 2023-08-10T11:52:18.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.120+0000 7fcef6d2cb80 1 -- start start 2023-08-10T11:52:18.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.121+0000 7fcef6d2cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4b738d4f0 0x55d4b738d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.121+0000 7fcef6d2cb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 0x55d4b738e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.121+0000 7fcef6d2cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4b738e910 0x55d4b738eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.121+0000 7fcef6d2cb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4b7308d70 con 0x55d4b738de50 2023-08-10T11:52:18.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.121+0000 7fcef6d2cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4b72e5540 con 0x55d4b738d4f0 2023-08-10T11:52:18.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.121+0000 7fcef6d2cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4b72e2e60 con 0x55d4b738e910 2023-08-10T11:52:18.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.121+0000 7fcee3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 0x55d4b738e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.121+0000 7fcee3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 0x55d4b738e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60206/0 (socket says 172.21.15.73:60206) 2023-08-10T11:52:18.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.121+0000 7fcee3fff700 1 -- 172.21.15.73:0/588238352 learned_addr learned my addr 172.21.15.73:0/588238352 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:18.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.121+0000 7fcee9130700 1 --2- 172.21.15.73:0/588238352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4b738e910 0x55d4b738eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.121+0000 7fcee3fff700 1 -- 172.21.15.73:0/588238352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4b738e910 msgr2=0x55d4b738eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.121+0000 7fcee3fff700 1 --2- 172.21.15.73:0/588238352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4b738e910 0x55d4b738eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.121+0000 7fcee3fff700 1 -- 172.21.15.73:0/588238352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4b738d4f0 msgr2=0x55d4b738d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.121+0000 7fcee3fff700 1 --2- 172.21.15.73:0/588238352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4b738d4f0 0x55d4b738d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.121+0000 7fcee3fff700 1 -- 172.21.15.73:0/588238352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4b715f5e0 con 0x55d4b738de50 2023-08-10T11:52:18.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.121+0000 7fcee3fff700 1 --2- 172.21.15.73:0/588238352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 0x55d4b738e380 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fced000dc20 tx=0x7fced0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9762471f0cf99f8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.121+0000 7fceceffd700 1 -- 172.21.15.73:0/588238352 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced000fa70 con 0x55d4b738de50 2023-08-10T11:52:18.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.121+0000 7fceceffd700 1 -- 172.21.15.73:0/588238352 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fced000fbd0 con 0x55d4b738de50 2023-08-10T11:52:18.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.121+0000 7fceceffd700 1 -- 172.21.15.73:0/588238352 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced001b610 con 0x55d4b738de50 2023-08-10T11:52:18.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.122+0000 7fcef6d2cb80 1 -- 172.21.15.73:0/588238352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 msgr2=0x55d4b738e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.122+0000 7fcef6d2cb80 1 --2- 172.21.15.73:0/588238352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 0x55d4b738e380 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fced000dc20 tx=0x7fced0010000 comp rx=0 tx=0).stop 2023-08-10T11:52:18.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.122+0000 7fcef6d2cb80 1 -- 172.21.15.73:0/588238352 shutdown_connections 2023-08-10T11:52:18.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.122+0000 7fcef6d2cb80 1 --2- 172.21.15.73:0/588238352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4b738d4f0 0x55d4b738d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.122+0000 7fcef6d2cb80 1 --2- 172.21.15.73:0/588238352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4b738e910 0x55d4b738eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.122+0000 7fcef6d2cb80 1 --2- 172.21.15.73:0/588238352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 0x55d4b738e380 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.122+0000 7fcef6d2cb80 1 -- 172.21.15.73:0/588238352 >> 172.21.15.73:0/588238352 conn(0x55d4b72eac80 msgr2=0x55d4b7388280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.122+0000 7fcef6d2cb80 1 -- 172.21.15.73:0/588238352 shutdown_connections 2023-08-10T11:52:18.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.122+0000 7fcef6d2cb80 1 -- 172.21.15.73:0/588238352 wait complete. 2023-08-10T11:52:18.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.122+0000 7fcef6d2cb80 1 -- start start 2023-08-10T11:52:18.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.122+0000 7fcef6d2cb80 1 Processor -- start 2023-08-10T11:52:18.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.123+0000 7fcef6d2cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4b738d4f0 0x55d4b7397020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.123+0000 7fcef6d2cb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 0x55d4b7397560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.123+0000 7fcef6d2cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4b738e910 0x55d4b739e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.123+0000 7fcef6d2cb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4b72de750 con 0x55d4b738de50 2023-08-10T11:52:18.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.123+0000 7fcef6d2cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4b727da70 con 0x55d4b738d4f0 2023-08-10T11:52:18.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.123+0000 7fcef6d2cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4b727d770 con 0x55d4b738e910 2023-08-10T11:52:18.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.123+0000 7fcef6d2cb80 10 client.0 _ll_register_callbacks cb 0x55d4b727b630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:52:18.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.123+0000 7fcee3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 0x55d4b7397560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.123+0000 7fcee3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 0x55d4b7397560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60212/0 (socket says 172.21.15.73:60212) 2023-08-10T11:52:18.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.123+0000 7fcee3fff700 1 -- 172.21.15.73:0/2054719744 learned_addr learned my addr 172.21.15.73:0/2054719744 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:18.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.123+0000 7fcee892f700 1 --2- 172.21.15.73:0/2054719744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4b738d4f0 0x55d4b7397020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.123+0000 7fcee9130700 1 --2- 172.21.15.73:0/2054719744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4b738e910 0x55d4b739e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.123+0000 7fcee3fff700 1 -- 172.21.15.73:0/2054719744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4b738e910 msgr2=0x55d4b739e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.123+0000 7fcee3fff700 1 --2- 172.21.15.73:0/2054719744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4b738e910 0x55d4b739e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.123+0000 7fcee3fff700 1 -- 172.21.15.73:0/2054719744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4b738d4f0 msgr2=0x55d4b7397020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.123+0000 7fcee3fff700 1 --2- 172.21.15.73:0/2054719744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4b738d4f0 0x55d4b7397020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.123+0000 7fcee3fff700 1 -- 172.21.15.73:0/2054719744 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced000d8d0 con 0x55d4b738de50 2023-08-10T11:52:18.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.123+0000 7fcee3fff700 1 --2- 172.21.15.73:0/2054719744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 0x55d4b7397560 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fced000dbf0 tx=0x7fced001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f18ee2a7f155bce server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.123+0000 7fcec3fff700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:52:18.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.123+0000 7fcec3fff700 1 -- 172.21.15.73:0/2054719744 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced002b070 con 0x55d4b738de50 2023-08-10T11:52:18.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.123+0000 7fcec3fff700 1 -- 172.21.15.73:0/2054719744 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fced001ce40 con 0x55d4b738de50 2023-08-10T11:52:18.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.123+0000 7fcef6d2cb80 1 -- 172.21.15.73:0/2054719744 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d4b7380420 con 0x55d4b738de50 2023-08-10T11:52:18.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.124+0000 7fcec3fff700 1 -- 172.21.15.73:0/2054719744 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fced001c9f0 con 0x55d4b738de50 2023-08-10T11:52:18.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.124+0000 7fcef6d2cb80 10 client.15231 fetch_fsmap learned FSMap version 27 2023-08-10T11:52:18.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.124+0000 7fcef6d2cb80 1 -- 172.21.15.73:0/2054719744 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55d4b710bd90 con 0x55d4b738de50 2023-08-10T11:52:18.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.124+0000 7fcec3fff700 1 -- 172.21.15.73:0/2054719744 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d4b7380420 con 0x55d4b738de50 2023-08-10T11:52:18.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.124+0000 7fcec3fff700 1 -- 172.21.15.73:0/2054719744 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fced0004d20 con 0x55d4b738de50 2023-08-10T11:52:18.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.124+0000 7fcef6d2cb80 10 client.15231 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:52:18.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.124+0000 7fcef6d2cb80 10 client.15231 resolve_mds: resolved name 'k' to daemon mds.k 2023-08-10T11:52:18.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.124+0000 7fcef6d2cb80 20 client.15231 populate_metadata read hostname 'smithi073' 2023-08-10T11:52:18.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.124+0000 7fcef6d2cb80 1 --2- 172.21.15.73:0/2054719744 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55d4b73a2760 0x55d4b73a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.124+0000 7fcef6d2cb80 4 client.15231 mds_command: new command op to 24419 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:52:18.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.124+0000 7fcef6d2cb80 1 -- 172.21.15.73:0/2054719744 --> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d4b735c980 con 0x55d4b73a2760 2023-08-10T11:52:18.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.124+0000 7fcee892f700 1 --2- 172.21.15.73:0/2054719744 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55d4b73a2760 0x55d4b73a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.125+0000 7fcec3fff700 10 client.15231 ms_handle_connect on v2:172.21.15.152:6832/4148407154 2023-08-10T11:52:18.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.125+0000 7fcee892f700 1 --2- 172.21.15.73:0/2054719744 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55d4b73a2760 0x55d4b73a15e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=96194a71d46a4076 server_cookie=d605d836db5810ec in_seq=0 out_seq=0 2023-08-10T11:52:18.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.125+0000 7fcec3fff700 1 -- 172.21.15.73:0/2054719744 <== mds.4 v2:172.21.15.152:6832/4148407154 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55d4b735c980 con 0x55d4b73a2760 2023-08-10T11:52:18.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.125+0000 7fcec3fff700 10 client.15231 handle_command_reply: tid=0 2023-08-10T11:52:18.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.125+0000 7fcef6d2cb80 1 client.15231 shutdown 2023-08-10T11:52:18.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.125+0000 7fcef6d2cb80 1 -- 172.21.15.73:0/2054719744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 msgr2=0x55d4b7397560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.125+0000 7fcef6d2cb80 1 --2- 172.21.15.73:0/2054719744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 0x55d4b7397560 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fced000dbf0 tx=0x7fced001c500 comp rx=0 tx=0).stop 2023-08-10T11:52:18.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.126+0000 7fcef6d2cb80 1 -- 172.21.15.73:0/2054719744 shutdown_connections 2023-08-10T11:52:18.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.126+0000 7fcef6d2cb80 1 --2- 172.21.15.73:0/2054719744 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55d4b73a2760 0x55d4b73a15e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.126+0000 7fcef6d2cb80 1 --2- 172.21.15.73:0/2054719744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4b738d4f0 0x55d4b7397020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.126+0000 7fcec3fff700 0 client.15231 ms_handle_reset on v2:172.21.15.152:6832/4148407154 2023-08-10T11:52:18.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.126+0000 7fcef6d2cb80 1 --2- 172.21.15.73:0/2054719744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4b738e910 0x55d4b739e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.126+0000 7fcef6d2cb80 1 --2- 172.21.15.73:0/2054719744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 0x55d4b7397560 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.126+0000 7fcef6d2cb80 1 -- 172.21.15.73:0/2054719744 >> 172.21.15.73:0/2054719744 conn(0x55d4b72eac80 msgr2=0x55d4b7387960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.126+0000 7fcef6d2cb80 1 -- 172.21.15.73:0/2054719744 shutdown_connections 2023-08-10T11:52:18.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.126+0000 7fcef6d2cb80 1 -- 172.21.15.73:0/2054719744 wait complete. 2023-08-10T11:52:18.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.126+0000 7fcef6d2cb80 20 client.15231 trim_cache size 0 max 16384 2023-08-10T11:52:18.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.143+0000 7fcef6d2cb80 1 Processor -- start 2023-08-10T11:52:18.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.143+0000 7fcef6d2cb80 1 -- start start 2023-08-10T11:52:18.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.143+0000 7fcef6d2cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4b738d4f0 0x55d4b73a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.143+0000 7fcef6d2cb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 0x55d4b73aae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.143+0000 7fcef6d2cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4b738e910 0x55d4b7391980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.143+0000 7fcef6d2cb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4b7396bf0 con 0x55d4b738de50 2023-08-10T11:52:18.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.143+0000 7fcef6d2cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4b71618d0 con 0x55d4b738d4f0 2023-08-10T11:52:18.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.143+0000 7fcef6d2cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4b738e230 con 0x55d4b738e910 2023-08-10T11:52:18.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.143+0000 7fcee3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 0x55d4b73aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.143+0000 7fcee3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 0x55d4b73aae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60220/0 (socket says 172.21.15.73:60220) 2023-08-10T11:52:18.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.143+0000 7fcee3fff700 1 -- 172.21.15.73:0/1303826844 learned_addr learned my addr 172.21.15.73:0/1303826844 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:18.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.143+0000 7fcee9130700 1 --2- 172.21.15.73:0/1303826844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4b738e910 0x55d4b7391980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.144+0000 7fcee892f700 1 --2- 172.21.15.73:0/1303826844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4b738d4f0 0x55d4b73a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.144+0000 7fcee3fff700 1 -- 172.21.15.73:0/1303826844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4b738e910 msgr2=0x55d4b7391980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.144+0000 7fcee3fff700 1 --2- 172.21.15.73:0/1303826844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4b738e910 0x55d4b7391980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.144+0000 7fcee3fff700 1 -- 172.21.15.73:0/1303826844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4b738d4f0 msgr2=0x55d4b73a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.144+0000 7fcee3fff700 1 --2- 172.21.15.73:0/1303826844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4b738d4f0 0x55d4b73a15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.144+0000 7fcee3fff700 1 -- 172.21.15.73:0/1303826844 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4b70f4c10 con 0x55d4b738de50 2023-08-10T11:52:18.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.144+0000 7fcee9130700 1 --2- 172.21.15.73:0/1303826844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4b738e910 0x55d4b7391980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:52:18.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.144+0000 7fcee892f700 1 --2- 172.21.15.73:0/1303826844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4b738d4f0 0x55d4b73a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:52:18.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.144+0000 7fcee3fff700 1 --2- 172.21.15.73:0/1303826844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 0x55d4b73aae80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fced000dbc0 tx=0x7fced00256f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab20f214d3693426 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.144+0000 7fcecf7fe700 1 -- 172.21.15.73:0/1303826844 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced002b070 con 0x55d4b738de50 2023-08-10T11:52:18.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.144+0000 7fcecf7fe700 1 -- 172.21.15.73:0/1303826844 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fced00257c0 con 0x55d4b738de50 2023-08-10T11:52:18.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.144+0000 7fcecf7fe700 1 -- 172.21.15.73:0/1303826844 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced0005400 con 0x55d4b738de50 2023-08-10T11:52:18.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.144+0000 7fcef6d2cb80 1 -- 172.21.15.73:0/1303826844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 msgr2=0x55d4b73aae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.144+0000 7fcef6d2cb80 1 --2- 172.21.15.73:0/1303826844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 0x55d4b73aae80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fced000dbc0 tx=0x7fced00256f0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.144+0000 7fcef6d2cb80 1 -- 172.21.15.73:0/1303826844 shutdown_connections 2023-08-10T11:52:18.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.144+0000 7fcef6d2cb80 1 --2- 172.21.15.73:0/1303826844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4b738d4f0 0x55d4b73a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.144+0000 7fcef6d2cb80 1 --2- 172.21.15.73:0/1303826844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4b738e910 0x55d4b7391980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.144+0000 7fcef6d2cb80 1 --2- 172.21.15.73:0/1303826844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 0x55d4b73aae80 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.144+0000 7fcef6d2cb80 1 -- 172.21.15.73:0/1303826844 >> 172.21.15.73:0/1303826844 conn(0x55d4b72eac80 msgr2=0x55d4b7395c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.144+0000 7fcef6d2cb80 1 -- 172.21.15.73:0/1303826844 shutdown_connections 2023-08-10T11:52:18.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.144+0000 7fcef6d2cb80 1 -- 172.21.15.73:0/1303826844 wait complete. 2023-08-10T11:52:18.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.145+0000 7fcef6d2cb80 1 -- start start 2023-08-10T11:52:18.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.145+0000 7fcef6d2cb80 1 Processor -- start 2023-08-10T11:52:18.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.145+0000 7fcef6d2cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4b738d4f0 0x55d4b73a7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.145+0000 7fcef6d2cb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 0x55d4b73a8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.145+0000 7fcef6d2cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4b738e910 0x55d4b73f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.145+0000 7fcef6d2cb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4b73ab020 con 0x55d4b738de50 2023-08-10T11:52:18.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.145+0000 7fcef6d2cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4b73ab190 con 0x55d4b738d4f0 2023-08-10T11:52:18.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.145+0000 7fcef6d2cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4b73f62d0 con 0x55d4b738e910 2023-08-10T11:52:18.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.145+0000 7fcef6d2cb80 10 client.0 _ll_register_callbacks cb 0x55d4b727b630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:52:18.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.145+0000 7fcee3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 0x55d4b73a8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.145+0000 7fcee3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 0x55d4b73a8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60226/0 (socket says 172.21.15.73:60226) 2023-08-10T11:52:18.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.145+0000 7fcee3fff700 1 -- 172.21.15.73:0/457571849 learned_addr learned my addr 172.21.15.73:0/457571849 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:18.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.145+0000 7fcee9130700 1 --2- 172.21.15.73:0/457571849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4b738e910 0x55d4b73f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.145+0000 7fcee892f700 1 --2- 172.21.15.73:0/457571849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4b738d4f0 0x55d4b73a7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.146+0000 7fcee3fff700 1 -- 172.21.15.73:0/457571849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4b738e910 msgr2=0x55d4b73f5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.146+0000 7fcee3fff700 1 --2- 172.21.15.73:0/457571849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4b738e910 0x55d4b73f5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.146+0000 7fcee3fff700 1 -- 172.21.15.73:0/457571849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4b738d4f0 msgr2=0x55d4b73a7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.146+0000 7fcee3fff700 1 --2- 172.21.15.73:0/457571849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4b738d4f0 0x55d4b73a7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.146+0000 7fcee3fff700 1 -- 172.21.15.73:0/457571849 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4b710bd90 con 0x55d4b738de50 2023-08-10T11:52:18.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.146+0000 7fcee892f700 1 --2- 172.21.15.73:0/457571849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4b738d4f0 0x55d4b73a7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:52:18.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.146+0000 7fcee9130700 1 --2- 172.21.15.73:0/457571849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4b738e910 0x55d4b73f5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:52:18.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.146+0000 7fcee3fff700 1 --2- 172.21.15.73:0/457571849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 0x55d4b73a8060 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fced0025790 tx=0x7fced001cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff15f1cff752e0d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.146+0000 7fcec3fff700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:52:18.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.146+0000 7fcec3fff700 1 -- 172.21.15.73:0/457571849 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced002b040 con 0x55d4b738de50 2023-08-10T11:52:18.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.146+0000 7fcec3fff700 1 -- 172.21.15.73:0/457571849 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fced0005140 con 0x55d4b738de50 2023-08-10T11:52:18.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.146+0000 7fcef6d2cb80 1 -- 172.21.15.73:0/457571849 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fced000fbd0 con 0x55d4b738de50 2023-08-10T11:52:18.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.146+0000 7fcec3fff700 1 -- 172.21.15.73:0/457571849 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fced0005300 con 0x55d4b738de50 2023-08-10T11:52:18.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.146+0000 7fcef6d2cb80 10 client.15237 fetch_fsmap learned FSMap version 27 2023-08-10T11:52:18.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.146+0000 7fcef6d2cb80 1 -- 172.21.15.73:0/457571849 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55d4b7132200 con 0x55d4b738de50 2023-08-10T11:52:18.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.146+0000 7fcec3fff700 1 -- 172.21.15.73:0/457571849 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fced000fbd0 con 0x55d4b738de50 2023-08-10T11:52:18.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.146+0000 7fcec3fff700 1 -- 172.21.15.73:0/457571849 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fced0044450 con 0x55d4b738de50 2023-08-10T11:52:18.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.146+0000 7fcef6d2cb80 10 client.15237 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:52:18.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.146+0000 7fcef6d2cb80 10 client.15237 resolve_mds: resolved name 'k' to daemon mds.k 2023-08-10T11:52:18.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.146+0000 7fcef6d2cb80 20 client.15237 populate_metadata read hostname 'smithi073' 2023-08-10T11:52:18.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.146+0000 7fcef6d2cb80 1 --2- 172.21.15.73:0/457571849 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55d4b73fa940 0x55d4b73f7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.146+0000 7fcef6d2cb80 4 client.15237 mds_command: new command op to 24419 tid=0[{"prefix": "status"}] 2023-08-10T11:52:18.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.146+0000 7fcef6d2cb80 1 -- 172.21.15.73:0/457571849 --> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d4b72d7730 con 0x55d4b73fa940 2023-08-10T11:52:18.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.147+0000 7fcee892f700 1 --2- 172.21.15.73:0/457571849 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55d4b73fa940 0x55d4b73f7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.147+0000 7fcee892f700 1 --2- 172.21.15.73:0/457571849 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55d4b73fa940 0x55d4b73f7340 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f4dfea43dd9e50f9 server_cookie=ccd81a61cbfae74a in_seq=0 out_seq=0 2023-08-10T11:52:18.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.147+0000 7fcec3fff700 10 client.15237 ms_handle_connect on v2:172.21.15.152:6832/4148407154 2023-08-10T11:52:18.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.147+0000 7fcec3fff700 1 -- 172.21.15.73:0/457571849 <== mds.4 v2:172.21.15.152:6832/4148407154 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+320 (crc 0 0 0) 0x55d4b72d7730 con 0x55d4b73fa940 2023-08-10T11:52:18.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.147+0000 7fcec3fff700 10 client.15237 handle_command_reply: tid=0 2023-08-10T11:52:18.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.147+0000 7fcef6d2cb80 1 client.15237 shutdown 2023-08-10T11:52:18.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.148+0000 7fcef6d2cb80 1 -- 172.21.15.73:0/457571849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 msgr2=0x55d4b73a8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.148+0000 7fcef6d2cb80 1 --2- 172.21.15.73:0/457571849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 0x55d4b73a8060 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fced0025790 tx=0x7fced001cd50 comp rx=0 tx=0).stop 2023-08-10T11:52:18.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.148+0000 7fcef6d2cb80 1 -- 172.21.15.73:0/457571849 shutdown_connections 2023-08-10T11:52:18.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.148+0000 7fcef6d2cb80 1 --2- 172.21.15.73:0/457571849 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55d4b73fa940 0x55d4b73f7340 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.148+0000 7fcef6d2cb80 1 --2- 172.21.15.73:0/457571849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d4b738d4f0 0x55d4b73a7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.148+0000 7fcef6d2cb80 1 --2- 172.21.15.73:0/457571849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4b738e910 0x55d4b73f5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.148+0000 7fcef6d2cb80 1 --2- 172.21.15.73:0/457571849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4b738de50 0x55d4b73a8060 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.148+0000 7fcec3fff700 0 client.15237 ms_handle_reset on v2:172.21.15.152:6832/4148407154 2023-08-10T11:52:18.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.148+0000 7fcef6d2cb80 1 -- 172.21.15.73:0/457571849 >> 172.21.15.73:0/457571849 conn(0x55d4b72eac80 msgr2=0x55d4b73a15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.148+0000 7fcef6d2cb80 1 -- 172.21.15.73:0/457571849 shutdown_connections 2023-08-10T11:52:18.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.148+0000 7fcef6d2cb80 1 -- 172.21.15.73:0/457571849 wait complete. 2023-08-10T11:52:18.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.148+0000 7fcef6d2cb80 20 client.15237 trim_cache size 0 max 16384 2023-08-10T11:52:18.168 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:52:18.169 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "0e619a74-3773-11ee-9b37-001a4aab830c", 2023-08-10T11:52:18.169 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 4, 2023-08-10T11:52:18.169 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 24419, 2023-08-10T11:52:18.170 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2023-08-10T11:52:18.170 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2023-08-10T11:52:18.170 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2023-08-10T11:52:18.170 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 77.62835278, 2023-08-10T11:52:18.171 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 27, 2023-08-10T11:52:18.171 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 85, 2023-08-10T11:52:18.171 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 83, 2023-08-10T11:52:18.172 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 111.148567056 2023-08-10T11:52:18.172 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:52:18.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.148+0000 7fceeab93700 1 -- 172.21.15.73:0/1242006669 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fced40a1260 msgr2=0x7fced40a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.148+0000 7fceeab93700 1 --2- 172.21.15.73:0/1242006669 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fced40a1260 0x7fced40a3720 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fced000ba60 tx=0x7fced0005d50 comp rx=0 tx=0).stop 2023-08-10T11:52:18.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.148+0000 7fceeab93700 1 -- 172.21.15.73:0/1242006669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcee40fea50 msgr2=0x7fcee4101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.148+0000 7fceeab93700 1 --2- 172.21.15.73:0/1242006669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcee40fea50 0x7fcee4101390 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fced8000c00 tx=0x7fced800f720 comp rx=0 tx=0).stop 2023-08-10T11:52:18.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.148+0000 7fceeab93700 1 -- 172.21.15.73:0/1242006669 shutdown_connections 2023-08-10T11:52:18.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.148+0000 7fceeab93700 1 --2- 172.21.15.73:0/1242006669 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fced40a1260 0x7fced40a3720 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.148+0000 7fceeab93700 1 --2- 172.21.15.73:0/1242006669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcee41023c0 0x7fcee40fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.148+0000 7fceeab93700 1 --2- 172.21.15.73:0/1242006669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcee40fea50 0x7fcee4101390 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.148+0000 7fceeab93700 1 --2- 172.21.15.73:0/1242006669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcee4101a20 0x7fcee40ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.148+0000 7fceeab93700 1 -- 172.21.15.73:0/1242006669 >> 172.21.15.73:0/1242006669 conn(0x7fcee40fa360 msgr2=0x7fcee4104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.149+0000 7fceeab93700 1 -- 172.21.15.73:0/1242006669 shutdown_connections 2023-08-10T11:52:18.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.149+0000 7fceeab93700 1 -- 172.21.15.73:0/1242006669 wait complete. 2023-08-10T11:52:18.176 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-08-10T11:52:18.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:17 smithi152 ceph-mon[130220]: pgmap v299: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-08-10T11:52:18.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:17 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/4200659864' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:52:18.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:17 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/2667219787' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:52:18.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:17 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3596875992' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:52:18.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:17 smithi156 ceph-mon[130574]: pgmap v299: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-08-10T11:52:18.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:17 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/4200659864' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:52:18.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:17 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/2667219787' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:52:18.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:17 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3596875992' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:52:18.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.296+0000 7f04cbcd0700 1 -- 172.21.15.73:0/1105704621 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04c40fedd0 msgr2=0x7f04c40ff1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.296+0000 7f04cbcd0700 1 --2- 172.21.15.73:0/1105704621 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04c40fedd0 0x7f04c40ff1f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f04b40099c0 tx=0x7f04b4009cd0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.296+0000 7f04cbcd0700 1 -- 172.21.15.73:0/1105704621 shutdown_connections 2023-08-10T11:52:18.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.296+0000 7f04cbcd0700 1 --2- 172.21.15.73:0/1105704621 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04c4100960 0x7f04c4107210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.296+0000 7f04cbcd0700 1 --2- 172.21.15.73:0/1105704621 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04c40fedd0 0x7f04c40ff1f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.296+0000 7f04cbcd0700 1 --2- 172.21.15.73:0/1105704621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04c40fffc0 0x7f04c4100420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.296+0000 7f04cbcd0700 1 -- 172.21.15.73:0/1105704621 >> 172.21.15.73:0/1105704621 conn(0x7f04c40fa340 msgr2=0x7f04c40fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.296+0000 7f04cbcd0700 1 -- 172.21.15.73:0/1105704621 shutdown_connections 2023-08-10T11:52:18.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.296+0000 7f04cbcd0700 1 -- 172.21.15.73:0/1105704621 wait complete. 2023-08-10T11:52:18.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.296+0000 7f04cbcd0700 1 Processor -- start 2023-08-10T11:52:18.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.296+0000 7f04cbcd0700 1 -- start start 2023-08-10T11:52:18.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.297+0000 7f04cbcd0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04c40fedd0 0x7f04c40fc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.297+0000 7f04cbcd0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04c40fffc0 0x7f04c419b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.297+0000 7f04cbcd0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04c4100960 0x7f04c419d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.297+0000 7f04cbcd0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c419df70 con 0x7f04c4100960 2023-08-10T11:52:18.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.297+0000 7f04cbcd0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c419e0e0 con 0x7f04c40fedd0 2023-08-10T11:52:18.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.297+0000 7f04cbcd0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c419e2a0 con 0x7f04c40fffc0 2023-08-10T11:52:18.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.297+0000 7f04ca26d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04c4100960 0x7f04c419d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.297+0000 7f04ca26d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04c4100960 0x7f04c419d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60242/0 (socket says 172.21.15.73:60242) 2023-08-10T11:52:18.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.297+0000 7f04ca26d700 1 -- 172.21.15.73:0/1390789401 learned_addr learned my addr 172.21.15.73:0/1390789401 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:18.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.297+0000 7f04c9a6c700 1 --2- 172.21.15.73:0/1390789401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04c40fedd0 0x7f04c40fc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.297+0000 7f04c926b700 1 --2- 172.21.15.73:0/1390789401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04c40fffc0 0x7f04c419b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.297+0000 7f04ca26d700 1 -- 172.21.15.73:0/1390789401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04c40fffc0 msgr2=0x7f04c419b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.297+0000 7f04ca26d700 1 --2- 172.21.15.73:0/1390789401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04c40fffc0 0x7f04c419b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.297+0000 7f04ca26d700 1 -- 172.21.15.73:0/1390789401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04c40fedd0 msgr2=0x7f04c40fc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.297+0000 7f04ca26d700 1 --2- 172.21.15.73:0/1390789401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04c40fedd0 0x7f04c40fc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.297+0000 7f04ca26d700 1 -- 172.21.15.73:0/1390789401 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b40095f0 con 0x7f04c4100960 2023-08-10T11:52:18.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.297+0000 7f04ca26d700 1 --2- 172.21.15.73:0/1390789401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04c4100960 0x7f04c419d7d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f04bc007ee0 tx=0x7f04bc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.297+0000 7f04baffd700 1 -- 172.21.15.73:0/1390789401 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc017070 con 0x7f04c4100960 2023-08-10T11:52:18.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.297+0000 7f04baffd700 1 -- 172.21.15.73:0/1390789401 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04bc00f040 con 0x7f04c4100960 2023-08-10T11:52:18.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.297+0000 7f04cbcd0700 1 -- 172.21.15.73:0/1390789401 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c419e580 con 0x7f04c4100960 2023-08-10T11:52:18.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.297+0000 7f04baffd700 1 -- 172.21.15.73:0/1390789401 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc005580 con 0x7f04c4100960 2023-08-10T11:52:18.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.297+0000 7f04cbcd0700 1 -- 172.21.15.73:0/1390789401 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c419ea90 con 0x7f04c4100960 2023-08-10T11:52:18.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.299+0000 7f04baffd700 1 -- 172.21.15.73:0/1390789401 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f04bc00db20 con 0x7f04c4100960 2023-08-10T11:52:18.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.300+0000 7f04baffd700 1 --2- 172.21.15.73:0/1390789401 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f04b00a11e0 0x7f04b00a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.300+0000 7f04baffd700 1 -- 172.21.15.73:0/1390789401 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f04bc0cc190 con 0x7f04c4100960 2023-08-10T11:52:18.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.300+0000 7f04c9a6c700 1 --2- 172.21.15.73:0/1390789401 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f04b00a11e0 0x7f04b00a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.300+0000 7f04c9a6c700 1 --2- 172.21.15.73:0/1390789401 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f04b00a11e0 0x7f04b00a36a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f04b4009f50 tx=0x7f04b400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.301+0000 7f04d7e69b80 1 Processor -- start 2023-08-10T11:52:18.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.301+0000 7f04d7e69b80 1 -- start start 2023-08-10T11:52:18.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.301+0000 7f04d7e69b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565309ff54f0 0x565309ff5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.301+0000 7f04d7e69b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff5e50 0x565309ff6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.301+0000 7f04d7e69b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565309ff6910 0x565309ff6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.301+0000 7f04d7e69b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x565309f70d70 con 0x565309ff5e50 2023-08-10T11:52:18.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.301+0000 7f04d7e69b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x565309f4d540 con 0x565309ff6910 2023-08-10T11:52:18.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.301+0000 7f04d7e69b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x565309f4ae60 con 0x565309ff54f0 2023-08-10T11:52:18.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.301+0000 7f04c926b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff5e50 0x565309ff6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.301+0000 7f04c926b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff5e50 0x565309ff6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60248/0 (socket says 172.21.15.73:60248) 2023-08-10T11:52:18.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.301+0000 7f04c926b700 1 -- 172.21.15.73:0/3045705470 learned_addr learned my addr 172.21.15.73:0/3045705470 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:18.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.302+0000 7f04ca26d700 1 --2- 172.21.15.73:0/3045705470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565309ff6910 0x565309ff6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.302+0000 7f04c9a6c700 1 --2- 172.21.15.73:0/3045705470 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565309ff54f0 0x565309ff5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.302+0000 7f04c926b700 1 -- 172.21.15.73:0/3045705470 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565309ff54f0 msgr2=0x565309ff5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.302+0000 7f04c926b700 1 --2- 172.21.15.73:0/3045705470 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565309ff54f0 0x565309ff5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.302+0000 7f04c926b700 1 -- 172.21.15.73:0/3045705470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565309ff6910 msgr2=0x565309ff6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.302+0000 7f04c926b700 1 --2- 172.21.15.73:0/3045705470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565309ff6910 0x565309ff6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.302+0000 7f04c926b700 1 -- 172.21.15.73:0/3045705470 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565309dc75e0 con 0x565309ff5e50 2023-08-10T11:52:18.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.302+0000 7f04c926b700 1 --2- 172.21.15.73:0/3045705470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff5e50 0x565309ff6380 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f04c000bd70 tx=0x7f04c00106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3355a7e52bad6f26 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.302+0000 7f04affff700 1 -- 172.21.15.73:0/3045705470 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c0010ec0 con 0x565309ff5e50 2023-08-10T11:52:18.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.302+0000 7f04affff700 1 -- 172.21.15.73:0/3045705470 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04c0015070 con 0x565309ff5e50 2023-08-10T11:52:18.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.302+0000 7f04affff700 1 -- 172.21.15.73:0/3045705470 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c0011800 con 0x565309ff5e50 2023-08-10T11:52:18.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.303+0000 7f04d7e69b80 1 -- 172.21.15.73:0/3045705470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff5e50 msgr2=0x565309ff6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.303+0000 7f04d7e69b80 1 --2- 172.21.15.73:0/3045705470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff5e50 0x565309ff6380 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f04c000bd70 tx=0x7f04c00106b0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.303+0000 7f04d7e69b80 1 -- 172.21.15.73:0/3045705470 shutdown_connections 2023-08-10T11:52:18.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.303+0000 7f04d7e69b80 1 --2- 172.21.15.73:0/3045705470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565309ff6910 0x565309ff6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.303+0000 7f04d7e69b80 1 --2- 172.21.15.73:0/3045705470 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565309ff54f0 0x565309ff5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.303+0000 7f04d7e69b80 1 --2- 172.21.15.73:0/3045705470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff5e50 0x565309ff6380 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.303+0000 7f04d7e69b80 1 -- 172.21.15.73:0/3045705470 >> 172.21.15.73:0/3045705470 conn(0x565309f52c80 msgr2=0x565309ff0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.303+0000 7f04d7e69b80 1 -- 172.21.15.73:0/3045705470 shutdown_connections 2023-08-10T11:52:18.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.303+0000 7f04d7e69b80 1 -- 172.21.15.73:0/3045705470 wait complete. 2023-08-10T11:52:18.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.303+0000 7f04d7e69b80 1 -- start start 2023-08-10T11:52:18.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.303+0000 7f04d7e69b80 1 Processor -- start 2023-08-10T11:52:18.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.304+0000 7f04d7e69b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565309ff54f0 0x565309ffefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.304+0000 7f04d7e69b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff5e50 0x565309fff500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.304+0000 7f04d7e69b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565309ff6910 0x56530a006540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.304+0000 7f04d7e69b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x565309f46750 con 0x565309ff5e50 2023-08-10T11:52:18.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.304+0000 7f04d7e69b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x565309ee5a70 con 0x565309ff6910 2023-08-10T11:52:18.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.304+0000 7f04d7e69b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x565309ee5770 con 0x565309ff54f0 2023-08-10T11:52:18.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.304+0000 7f04d7e69b80 10 client.0 _ll_register_callbacks cb 0x565309ee3630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:52:18.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.304+0000 7f04c926b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff5e50 0x565309fff500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.304+0000 7f04c926b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff5e50 0x565309fff500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60254/0 (socket says 172.21.15.73:60254) 2023-08-10T11:52:18.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.304+0000 7f04c926b700 1 -- 172.21.15.73:0/3085704608 learned_addr learned my addr 172.21.15.73:0/3085704608 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:18.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.304+0000 7f04c9a6c700 1 --2- 172.21.15.73:0/3085704608 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565309ff54f0 0x565309ffefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.304+0000 7f04ca26d700 1 --2- 172.21.15.73:0/3085704608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565309ff6910 0x56530a006540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.304+0000 7f04c926b700 1 -- 172.21.15.73:0/3085704608 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565309ff54f0 msgr2=0x565309ffefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.304+0000 7f04c926b700 1 --2- 172.21.15.73:0/3085704608 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565309ff54f0 0x565309ffefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.304+0000 7f04c926b700 1 -- 172.21.15.73:0/3085704608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565309ff6910 msgr2=0x56530a006540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.304+0000 7f04c926b700 1 --2- 172.21.15.73:0/3085704608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565309ff6910 0x56530a006540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.304+0000 7f04c926b700 1 -- 172.21.15.73:0/3085704608 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c000b9a0 con 0x565309ff5e50 2023-08-10T11:52:18.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.304+0000 7f04c926b700 1 --2- 172.21.15.73:0/3085704608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff5e50 0x565309fff500 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f04c000bd40 tx=0x7f04c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b1442b8f22e19 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.304+0000 7f04ad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:52:18.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.304+0000 7f04ad7fa700 1 -- 172.21.15.73:0/3085704608 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c001ca50 con 0x565309ff5e50 2023-08-10T11:52:18.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.304+0000 7f04ad7fa700 1 -- 172.21.15.73:0/3085704608 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f04c0017070 con 0x565309ff5e50 2023-08-10T11:52:18.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.304+0000 7f04d7e69b80 1 -- 172.21.15.73:0/3085704608 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565309fe8420 con 0x565309ff5e50 2023-08-10T11:52:18.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.304+0000 7f04ad7fa700 1 -- 172.21.15.73:0/3085704608 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04c0004030 con 0x565309ff5e50 2023-08-10T11:52:18.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.304+0000 7f04d7e69b80 10 client.15249 fetch_fsmap learned FSMap version 27 2023-08-10T11:52:18.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.304+0000 7f04d7e69b80 1 -- 172.21.15.73:0/3085704608 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x565309d73d90 con 0x565309ff5e50 2023-08-10T11:52:18.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.305+0000 7f04ad7fa700 1 -- 172.21.15.73:0/3085704608 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x565309fe8420 con 0x565309ff5e50 2023-08-10T11:52:18.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.305+0000 7f04ad7fa700 1 -- 172.21.15.73:0/3085704608 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f04c0003d10 con 0x565309ff5e50 2023-08-10T11:52:18.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.305+0000 7f04d7e69b80 10 client.15249 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:52:18.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.305+0000 7f04d7e69b80 10 client.15249 resolve_mds: resolved name 'e' to daemon mds.e 2023-08-10T11:52:18.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.305+0000 7f04d7e69b80 20 client.15249 populate_metadata read hostname 'smithi073' 2023-08-10T11:52:18.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.305+0000 7f04d7e69b80 1 --2- 172.21.15.73:0/3085704608 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x56530a00a130 0x56530a009590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.305+0000 7f04d7e69b80 4 client.15249 mds_command: new command op to 24443 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:52:18.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.305+0000 7f04d7e69b80 1 -- 172.21.15.73:0/3085704608 --> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565309fc4980 con 0x56530a00a130 2023-08-10T11:52:18.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.305+0000 7f04c9a6c700 1 --2- 172.21.15.73:0/3085704608 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x56530a00a130 0x56530a009590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.305+0000 7f04ad7fa700 10 client.15249 ms_handle_connect on v2:172.21.15.152:6834/1791572604 2023-08-10T11:52:18.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.305+0000 7f04c9a6c700 1 --2- 172.21.15.73:0/3085704608 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x56530a00a130 0x56530a009590 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f6ccacb89390261f server_cookie=225d46f12a447b36 in_seq=0 out_seq=0 2023-08-10T11:52:18.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.306+0000 7f04ad7fa700 1 -- 172.21.15.73:0/3085704608 <== mds.3 v2:172.21.15.152:6834/1791572604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x565309fc4980 con 0x56530a00a130 2023-08-10T11:52:18.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.306+0000 7f04ad7fa700 10 client.15249 handle_command_reply: tid=0 2023-08-10T11:52:18.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.306+0000 7f04d7e69b80 1 client.15249 shutdown 2023-08-10T11:52:18.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.306+0000 7f04d7e69b80 1 -- 172.21.15.73:0/3085704608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff5e50 msgr2=0x565309fff500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.306+0000 7f04d7e69b80 1 --2- 172.21.15.73:0/3085704608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff5e50 0x565309fff500 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f04c000bd40 tx=0x7f04c00057f0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.306+0000 7f04d7e69b80 1 -- 172.21.15.73:0/3085704608 shutdown_connections 2023-08-10T11:52:18.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.306+0000 7f04d7e69b80 1 --2- 172.21.15.73:0/3085704608 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x56530a00a130 0x56530a009590 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.306+0000 7f04d7e69b80 1 --2- 172.21.15.73:0/3085704608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565309ff6910 0x56530a006540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.306+0000 7f04d7e69b80 1 --2- 172.21.15.73:0/3085704608 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565309ff54f0 0x565309ffefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.306+0000 7f04d7e69b80 1 --2- 172.21.15.73:0/3085704608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff5e50 0x565309fff500 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.306+0000 7f04ad7fa700 0 client.15249 ms_handle_reset on v2:172.21.15.152:6834/1791572604 2023-08-10T11:52:18.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.306+0000 7f04d7e69b80 1 -- 172.21.15.73:0/3085704608 >> 172.21.15.73:0/3085704608 conn(0x565309f52c80 msgr2=0x565309fef960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.306+0000 7f04d7e69b80 1 -- 172.21.15.73:0/3085704608 shutdown_connections 2023-08-10T11:52:18.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.306+0000 7f04d7e69b80 1 -- 172.21.15.73:0/3085704608 wait complete. 2023-08-10T11:52:18.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.306+0000 7f04d7e69b80 20 client.15249 trim_cache size 0 max 16384 2023-08-10T11:52:18.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.324+0000 7f04d7e69b80 1 Processor -- start 2023-08-10T11:52:18.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.324+0000 7f04d7e69b80 1 -- start start 2023-08-10T11:52:18.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.324+0000 7f04d7e69b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff54f0 0x565309ffccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.324+0000 7f04d7e69b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565309ff5e50 0x565309ffd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.324+0000 7f04d7e69b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565309ff6910 0x56530a006500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.324+0000 7f04d7e69b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x565309dc98d0 con 0x565309ff54f0 2023-08-10T11:52:18.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.324+0000 7f04d7e69b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x565309fecf80 con 0x565309ff6910 2023-08-10T11:52:18.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.324+0000 7f04d7e69b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x565309fc49b0 con 0x565309ff5e50 2023-08-10T11:52:18.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.324+0000 7f04c9a6c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff54f0 0x565309ffccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.324+0000 7f04c9a6c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff54f0 0x565309ffccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60260/0 (socket says 172.21.15.73:60260) 2023-08-10T11:52:18.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.324+0000 7f04c9a6c700 1 -- 172.21.15.73:0/413302284 learned_addr learned my addr 172.21.15.73:0/413302284 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:18.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.324+0000 7f04c9a6c700 1 -- 172.21.15.73:0/413302284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565309ff5e50 msgr2=0x565309ffd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.324+0000 7f04c926b700 1 --2- 172.21.15.73:0/413302284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565309ff5e50 0x565309ffd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.324+0000 7f04c9a6c700 1 --2- 172.21.15.73:0/413302284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565309ff5e50 0x565309ffd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.324+0000 7f04ca26d700 1 --2- 172.21.15.73:0/413302284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565309ff6910 0x56530a006500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.324+0000 7f04c9a6c700 1 -- 172.21.15.73:0/413302284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565309ff6910 msgr2=0x56530a006500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.324+0000 7f04c9a6c700 1 --2- 172.21.15.73:0/413302284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565309ff6910 0x56530a006500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.324+0000 7f04c9a6c700 1 -- 172.21.15.73:0/413302284 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565309fec650 con 0x565309ff54f0 2023-08-10T11:52:18.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.324+0000 7f04c9a6c700 1 --2- 172.21.15.73:0/413302284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff54f0 0x565309ffccf0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f04b4000c00 tx=0x7f04b4020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e57ebda131aff114 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.324+0000 7f04b8ff9700 1 -- 172.21.15.73:0/413302284 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b4034070 con 0x565309ff54f0 2023-08-10T11:52:18.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.324+0000 7f04b8ff9700 1 -- 172.21.15.73:0/413302284 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04b401e040 con 0x565309ff54f0 2023-08-10T11:52:18.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.324+0000 7f04b8ff9700 1 -- 172.21.15.73:0/413302284 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b40038c0 con 0x565309ff54f0 2023-08-10T11:52:18.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.325+0000 7f04d7e69b80 1 -- 172.21.15.73:0/413302284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff54f0 msgr2=0x565309ffccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.325+0000 7f04d7e69b80 1 --2- 172.21.15.73:0/413302284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff54f0 0x565309ffccf0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f04b4000c00 tx=0x7f04b4020000 comp rx=0 tx=0).stop 2023-08-10T11:52:18.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.325+0000 7f04d7e69b80 1 -- 172.21.15.73:0/413302284 shutdown_connections 2023-08-10T11:52:18.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.325+0000 7f04d7e69b80 1 --2- 172.21.15.73:0/413302284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565309ff6910 0x56530a006500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.325+0000 7f04d7e69b80 1 --2- 172.21.15.73:0/413302284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff54f0 0x565309ffccf0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.325+0000 7f04d7e69b80 1 --2- 172.21.15.73:0/413302284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565309ff5e50 0x565309ffd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.325+0000 7f04d7e69b80 1 -- 172.21.15.73:0/413302284 >> 172.21.15.73:0/413302284 conn(0x565309f52c80 msgr2=0x565309ffdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.325+0000 7f04d7e69b80 1 -- 172.21.15.73:0/413302284 shutdown_connections 2023-08-10T11:52:18.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.325+0000 7f04d7e69b80 1 -- 172.21.15.73:0/413302284 wait complete. 2023-08-10T11:52:18.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.325+0000 7f04d7e69b80 1 -- start start 2023-08-10T11:52:18.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.325+0000 7f04d7e69b80 1 Processor -- start 2023-08-10T11:52:18.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.326+0000 7f04d7e69b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565309ff54f0 0x56530a001720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.326+0000 7f04d7e69b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565309ff5e50 0x56530a001c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.326+0000 7f04d7e69b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff6910 0x56530a004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.326+0000 7f04d7e69b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56530a0051c0 con 0x565309ff6910 2023-08-10T11:52:18.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.326+0000 7f04d7e69b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56530a005330 con 0x565309ff5e50 2023-08-10T11:52:18.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.326+0000 7f04d7e69b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56530a0054f0 con 0x565309ff54f0 2023-08-10T11:52:18.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.326+0000 7f04d7e69b80 10 client.0 _ll_register_callbacks cb 0x565309ee3630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:52:18.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.326+0000 7f04ca26d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff6910 0x56530a004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.326+0000 7f04ca26d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff6910 0x56530a004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60270/0 (socket says 172.21.15.73:60270) 2023-08-10T11:52:18.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.326+0000 7f04ca26d700 1 -- 172.21.15.73:0/2001736500 learned_addr learned my addr 172.21.15.73:0/2001736500 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:18.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.326+0000 7f04c926b700 1 --2- 172.21.15.73:0/2001736500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565309ff5e50 0x56530a001c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.326+0000 7f04c9a6c700 1 --2- 172.21.15.73:0/2001736500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565309ff54f0 0x56530a001720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.326+0000 7f04ca26d700 1 -- 172.21.15.73:0/2001736500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565309ff54f0 msgr2=0x56530a001720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.326+0000 7f04ca26d700 1 --2- 172.21.15.73:0/2001736500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565309ff54f0 0x56530a001720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.326+0000 7f04ca26d700 1 -- 172.21.15.73:0/2001736500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565309ff5e50 msgr2=0x56530a001c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.326+0000 7f04ca26d700 1 --2- 172.21.15.73:0/2001736500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565309ff5e50 0x56530a001c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.326+0000 7f04ca26d700 1 -- 172.21.15.73:0/2001736500 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b402c040 con 0x565309ff6910 2023-08-10T11:52:18.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.326+0000 7f04ca26d700 1 --2- 172.21.15.73:0/2001736500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff6910 0x56530a004c80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f04bc004f50 tx=0x7f04bc084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a295cc2226c51bca server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.326+0000 7f04ad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:52:18.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.326+0000 7f04ad7fa700 1 -- 172.21.15.73:0/2001736500 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc09d480 con 0x565309ff6910 2023-08-10T11:52:18.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.327+0000 7f04ad7fa700 1 -- 172.21.15.73:0/2001736500 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f04bc0a18a0 con 0x565309ff6910 2023-08-10T11:52:18.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.327+0000 7f04d7e69b80 1 -- 172.21.15.73:0/2001736500 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f04c0015070 con 0x565309ff6910 2023-08-10T11:52:18.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.327+0000 7f04ad7fa700 1 -- 172.21.15.73:0/2001736500 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04bc004c40 con 0x565309ff6910 2023-08-10T11:52:18.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.327+0000 7f04d7e69b80 10 client.15255 fetch_fsmap learned FSMap version 27 2023-08-10T11:52:18.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.327+0000 7f04d7e69b80 1 -- 172.21.15.73:0/2001736500 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x565309d5cc10 con 0x565309ff6910 2023-08-10T11:52:18.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.327+0000 7f04ad7fa700 1 -- 172.21.15.73:0/2001736500 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04bc0c7020 con 0x565309ff6910 2023-08-10T11:52:18.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.327+0000 7f04ad7fa700 1 -- 172.21.15.73:0/2001736500 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f04bc0989b0 con 0x565309ff6910 2023-08-10T11:52:18.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.327+0000 7f04d7e69b80 10 client.15255 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:52:18.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.327+0000 7f04d7e69b80 10 client.15255 resolve_mds: resolved name 'e' to daemon mds.e 2023-08-10T11:52:18.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.327+0000 7f04d7e69b80 20 client.15255 populate_metadata read hostname 'smithi073' 2023-08-10T11:52:18.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.327+0000 7f04d7e69b80 1 --2- 172.21.15.73:0/2001736500 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x56530a063610 0x56530a05ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.327+0000 7f04d7e69b80 4 client.15255 mds_command: new command op to 24443 tid=0[{"prefix": "status"}] 2023-08-10T11:52:18.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.327+0000 7f04d7e69b80 1 -- 172.21.15.73:0/2001736500 --> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] -- command(tid 0: {"prefix": "status"}) v1 -- 0x565309f3f730 con 0x56530a063610 2023-08-10T11:52:18.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.327+0000 7f04c9a6c700 1 --2- 172.21.15.73:0/2001736500 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x56530a063610 0x56530a05ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.328+0000 7f04ad7fa700 10 client.15255 ms_handle_connect on v2:172.21.15.152:6834/1791572604 2023-08-10T11:52:18.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.328+0000 7f04c9a6c700 1 --2- 172.21.15.73:0/2001736500 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x56530a063610 0x56530a05ff80 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=92aaf6bf61b1b3d8 server_cookie=ddb10013a837b5ac in_seq=0 out_seq=0 2023-08-10T11:52:18.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.328+0000 7f04ad7fa700 1 -- 172.21.15.73:0/2001736500 <== mds.3 v2:172.21.15.152:6834/1791572604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x565309f3f730 con 0x56530a063610 2023-08-10T11:52:18.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.328+0000 7f04ad7fa700 10 client.15255 handle_command_reply: tid=0 2023-08-10T11:52:18.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.328+0000 7f04d7e69b80 1 client.15255 shutdown 2023-08-10T11:52:18.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.328+0000 7f04d7e69b80 1 -- 172.21.15.73:0/2001736500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff6910 msgr2=0x56530a004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.328+0000 7f04d7e69b80 1 --2- 172.21.15.73:0/2001736500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff6910 0x56530a004c80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f04bc004f50 tx=0x7f04bc084040 comp rx=0 tx=0).stop 2023-08-10T11:52:18.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.328+0000 7f04d7e69b80 1 -- 172.21.15.73:0/2001736500 shutdown_connections 2023-08-10T11:52:18.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.328+0000 7f04d7e69b80 1 --2- 172.21.15.73:0/2001736500 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x56530a063610 0x56530a05ff80 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.328+0000 7f04d7e69b80 1 --2- 172.21.15.73:0/2001736500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x565309ff6910 0x56530a004c80 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.328+0000 7f04d7e69b80 1 --2- 172.21.15.73:0/2001736500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565309ff54f0 0x56530a001720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.328+0000 7f04ad7fa700 0 client.15255 ms_handle_reset on v2:172.21.15.152:6834/1791572604 2023-08-10T11:52:18.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.328+0000 7f04d7e69b80 1 --2- 172.21.15.73:0/2001736500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565309ff5e50 0x56530a001c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.328+0000 7f04d7e69b80 1 -- 172.21.15.73:0/2001736500 >> 172.21.15.73:0/2001736500 conn(0x565309f52c80 msgr2=0x565309ffccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.328+0000 7f04d7e69b80 1 -- 172.21.15.73:0/2001736500 shutdown_connections 2023-08-10T11:52:18.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.328+0000 7f04d7e69b80 1 -- 172.21.15.73:0/2001736500 wait complete. 2023-08-10T11:52:18.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.328+0000 7f04d7e69b80 20 client.15255 trim_cache size 0 max 16384 2023-08-10T11:52:18.340 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:52:18.341 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "0e619a74-3773-11ee-9b37-001a4aab830c", 2023-08-10T11:52:18.341 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 3, 2023-08-10T11:52:18.341 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 24443, 2023-08-10T11:52:18.341 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2023-08-10T11:52:18.341 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2023-08-10T11:52:18.341 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2023-08-10T11:52:18.341 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 78.825854894000003, 2023-08-10T11:52:18.342 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 27, 2023-08-10T11:52:18.342 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 85, 2023-08-10T11:52:18.342 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 83, 2023-08-10T11:52:18.342 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 104.55052474199999 2023-08-10T11:52:18.342 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:52:18.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.329+0000 7f04cbcd0700 1 -- 172.21.15.73:0/1390789401 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f04b00a11e0 msgr2=0x7f04b00a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.329+0000 7f04cbcd0700 1 --2- 172.21.15.73:0/1390789401 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f04b00a11e0 0x7f04b00a36a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f04b4009f50 tx=0x7f04b400b540 comp rx=0 tx=0).stop 2023-08-10T11:52:18.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.329+0000 7f04cbcd0700 1 -- 172.21.15.73:0/1390789401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04c4100960 msgr2=0x7f04c419d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.329+0000 7f04cbcd0700 1 --2- 172.21.15.73:0/1390789401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04c4100960 0x7f04c419d7d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f04bc007ee0 tx=0x7f04bc00d3b0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.329+0000 7f04cbcd0700 1 -- 172.21.15.73:0/1390789401 shutdown_connections 2023-08-10T11:52:18.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.329+0000 7f04cbcd0700 1 --2- 172.21.15.73:0/1390789401 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f04b00a11e0 0x7f04b00a36a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.329+0000 7f04cbcd0700 1 --2- 172.21.15.73:0/1390789401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04c40fedd0 0x7f04c40fc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.329+0000 7f04cbcd0700 1 --2- 172.21.15.73:0/1390789401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04c4100960 0x7f04c419d7d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.329+0000 7f04cbcd0700 1 --2- 172.21.15.73:0/1390789401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04c40fffc0 0x7f04c419b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.329+0000 7f04cbcd0700 1 -- 172.21.15.73:0/1390789401 >> 172.21.15.73:0/1390789401 conn(0x7f04c40fa340 msgr2=0x7f04c4103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.329+0000 7f04cbcd0700 1 -- 172.21.15.73:0/1390789401 shutdown_connections 2023-08-10T11:52:18.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.329+0000 7f04cbcd0700 1 -- 172.21.15.73:0/1390789401 wait complete. 2023-08-10T11:52:18.345 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-08-10T11:52:18.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.466+0000 7f1cbd0f9700 1 -- 172.21.15.73:0/2597242066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cb80ff660 msgr2=0x7f1cb80ffa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.466+0000 7f1cbd0f9700 1 --2- 172.21.15.73:0/2597242066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cb80ff660 0x7f1cb80ffa80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0099c0 tx=0x7f1cac009cd0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.466+0000 7f1cbd0f9700 1 -- 172.21.15.73:0/2597242066 shutdown_connections 2023-08-10T11:52:18.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.466+0000 7f1cbd0f9700 1 --2- 172.21.15.73:0/2597242066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cb81011f0 0x7f1cb8107aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.466+0000 7f1cbd0f9700 1 --2- 172.21.15.73:0/2597242066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cb80ff660 0x7f1cb80ffa80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.466+0000 7f1cbd0f9700 1 --2- 172.21.15.73:0/2597242066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cb8100850 0x7f1cb8100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.466+0000 7f1cbd0f9700 1 -- 172.21.15.73:0/2597242066 >> 172.21.15.73:0/2597242066 conn(0x7f1cb80fabd0 msgr2=0x7f1cb80fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.466+0000 7f1cbd0f9700 1 -- 172.21.15.73:0/2597242066 shutdown_connections 2023-08-10T11:52:18.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.466+0000 7f1cbd0f9700 1 -- 172.21.15.73:0/2597242066 wait complete. 2023-08-10T11:52:18.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.467+0000 7f1cbd0f9700 1 Processor -- start 2023-08-10T11:52:18.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.467+0000 7f1cbd0f9700 1 -- start start 2023-08-10T11:52:18.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.467+0000 7f1cbd0f9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cb80ff660 0x7f1cb8068440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.467+0000 7f1cbd0f9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cb8100850 0x7f1cb819b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.467+0000 7f1cbd0f9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cb81011f0 0x7f1cb819d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.467+0000 7f1cbd0f9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb819df50 con 0x7f1cb81011f0 2023-08-10T11:52:18.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.467+0000 7f1cbd0f9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb819e0c0 con 0x7f1cb8100850 2023-08-10T11:52:18.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.467+0000 7f1cbd0f9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb819e280 con 0x7f1cb80ff660 2023-08-10T11:52:18.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.467+0000 7f1cb759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cb81011f0 0x7f1cb819d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.467+0000 7f1cb759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cb81011f0 0x7f1cb819d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60284/0 (socket says 172.21.15.73:60284) 2023-08-10T11:52:18.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.467+0000 7f1cb759e700 1 -- 172.21.15.73:0/163214057 learned_addr learned my addr 172.21.15.73:0/163214057 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:18.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.467+0000 7f1cb659c700 1 --2- 172.21.15.73:0/163214057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cb8100850 0x7f1cb819b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.468+0000 7f1cb6d9d700 1 --2- 172.21.15.73:0/163214057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cb80ff660 0x7f1cb8068440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.468+0000 7f1cb759e700 1 -- 172.21.15.73:0/163214057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cb80ff660 msgr2=0x7f1cb8068440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.468+0000 7f1cb759e700 1 --2- 172.21.15.73:0/163214057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cb80ff660 0x7f1cb8068440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.468+0000 7f1cb759e700 1 -- 172.21.15.73:0/163214057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cb8100850 msgr2=0x7f1cb819b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.468+0000 7f1cb759e700 1 --2- 172.21.15.73:0/163214057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cb8100850 0x7f1cb819b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.468+0000 7f1cb759e700 1 -- 172.21.15.73:0/163214057 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cac0095f0 con 0x7f1cb81011f0 2023-08-10T11:52:18.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.468+0000 7f1cb759e700 1 --2- 172.21.15.73:0/163214057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cb81011f0 0x7f1cb819d7b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0007ee0 tx=0x7f1cb000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.468+0000 7f1c9ffff700 1 -- 172.21.15.73:0/163214057 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0017070 con 0x7f1cb81011f0 2023-08-10T11:52:18.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.468+0000 7f1c9ffff700 1 -- 172.21.15.73:0/163214057 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1cb000f040 con 0x7f1cb81011f0 2023-08-10T11:52:18.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.468+0000 7f1cbd0f9700 1 -- 172.21.15.73:0/163214057 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb819e560 con 0x7f1cb81011f0 2023-08-10T11:52:18.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.468+0000 7f1c9ffff700 1 -- 172.21.15.73:0/163214057 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0005740 con 0x7f1cb81011f0 2023-08-10T11:52:18.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.468+0000 7f1cbd0f9700 1 -- 172.21.15.73:0/163214057 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb819ea20 con 0x7f1cb81011f0 2023-08-10T11:52:18.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.470+0000 7f1c9ffff700 1 -- 172.21.15.73:0/163214057 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f1cb00058a0 con 0x7f1cb81011f0 2023-08-10T11:52:18.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.471+0000 7f1c9ffff700 1 --2- 172.21.15.73:0/163214057 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f1ca00a11e0 0x7f1ca00a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.471+0000 7f1cb6d9d700 1 --2- 172.21.15.73:0/163214057 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f1ca00a11e0 0x7f1ca00a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.471+0000 7f1c9ffff700 1 -- 172.21.15.73:0/163214057 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1cb00cc350 con 0x7f1cb81011f0 2023-08-10T11:52:18.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.471+0000 7f1cb6d9d700 1 --2- 172.21.15.73:0/163214057 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f1ca00a11e0 0x7f1ca00a36a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0098e0 tx=0x7f1cac005c00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.472+0000 7f1cc9292b80 1 Processor -- start 2023-08-10T11:52:18.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.472+0000 7f1cc9292b80 1 -- start start 2023-08-10T11:52:18.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.472+0000 7f1cc9292b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee44341950 0x55ee44341d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.472+0000 7f1cc9292b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ee443422b0 0x55ee44342780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.472+0000 7f1cc9292b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee44342d60 0x55ee443431e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.472+0000 7f1cc9292b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee442b8d70 con 0x55ee44341950 2023-08-10T11:52:18.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.472+0000 7f1cc9292b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee44295540 con 0x55ee44342d60 2023-08-10T11:52:18.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.472+0000 7f1cc9292b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee44292e60 con 0x55ee443422b0 2023-08-10T11:52:18.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.472+0000 7f1cb6d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee44341950 0x55ee44341d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.472+0000 7f1cb6d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee44341950 0x55ee44341d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60288/0 (socket says 172.21.15.73:60288) 2023-08-10T11:52:18.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.472+0000 7f1cb6d9d700 1 -- 172.21.15.73:0/522939299 learned_addr learned my addr 172.21.15.73:0/522939299 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:18.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.472+0000 7f1cb759e700 1 --2- 172.21.15.73:0/522939299 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee44342d60 0x55ee443431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.472+0000 7f1cb659c700 1 --2- 172.21.15.73:0/522939299 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ee443422b0 0x55ee44342780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.472+0000 7f1cb6d9d700 1 -- 172.21.15.73:0/522939299 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ee443422b0 msgr2=0x55ee44342780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.472+0000 7f1cb6d9d700 1 --2- 172.21.15.73:0/522939299 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ee443422b0 0x55ee44342780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.472+0000 7f1cb6d9d700 1 -- 172.21.15.73:0/522939299 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee44342d60 msgr2=0x55ee443431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.472+0000 7f1cb6d9d700 1 --2- 172.21.15.73:0/522939299 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee44342d60 0x55ee443431e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.472+0000 7f1cb6d9d700 1 -- 172.21.15.73:0/522939299 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee4410f5e0 con 0x55ee44341950 2023-08-10T11:52:18.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.472+0000 7f1cb659c700 1 --2- 172.21.15.73:0/522939299 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ee443422b0 0x55ee44342780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:52:18.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.473+0000 7f1cb6d9d700 1 --2- 172.21.15.73:0/522939299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee44341950 0x55ee44341d70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1cac015000 tx=0x7f1cac01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9754f358b7174980 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.473+0000 7f1c9d7fa700 1 -- 172.21.15.73:0/522939299 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac00b990 con 0x55ee44341950 2023-08-10T11:52:18.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.473+0000 7f1c9d7fa700 1 -- 172.21.15.73:0/522939299 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1cac01d040 con 0x55ee44341950 2023-08-10T11:52:18.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.473+0000 7f1c9d7fa700 1 -- 172.21.15.73:0/522939299 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac004f90 con 0x55ee44341950 2023-08-10T11:52:18.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.474+0000 7f1cc9292b80 1 -- 172.21.15.73:0/522939299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee44341950 msgr2=0x55ee44341d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.474+0000 7f1cc9292b80 1 --2- 172.21.15.73:0/522939299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee44341950 0x55ee44341d70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1cac015000 tx=0x7f1cac01e000 comp rx=0 tx=0).stop 2023-08-10T11:52:18.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.474+0000 7f1cc9292b80 1 -- 172.21.15.73:0/522939299 shutdown_connections 2023-08-10T11:52:18.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.474+0000 7f1cc9292b80 1 --2- 172.21.15.73:0/522939299 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee44342d60 0x55ee443431e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.474+0000 7f1cc9292b80 1 --2- 172.21.15.73:0/522939299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee44341950 0x55ee44341d70 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.474+0000 7f1cc9292b80 1 --2- 172.21.15.73:0/522939299 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ee443422b0 0x55ee44342780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.474+0000 7f1cc9292b80 1 -- 172.21.15.73:0/522939299 >> 172.21.15.73:0/522939299 conn(0x55ee4429ac80 msgr2=0x55ee44338280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.474+0000 7f1cc9292b80 1 -- 172.21.15.73:0/522939299 shutdown_connections 2023-08-10T11:52:18.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.474+0000 7f1cc9292b80 1 -- 172.21.15.73:0/522939299 wait complete. 2023-08-10T11:52:18.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.474+0000 7f1cc9292b80 1 -- start start 2023-08-10T11:52:18.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.474+0000 7f1cc9292b80 1 Processor -- start 2023-08-10T11:52:18.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.474+0000 7f1cc9292b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ee44341950 0x55ee4434b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.474+0000 7f1cc9292b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee443422b0 0x55ee4434b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.474+0000 7f1cc9292b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee44342d60 0x55ee44352840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.474+0000 7f1cc9292b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee4428e750 con 0x55ee443422b0 2023-08-10T11:52:18.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.474+0000 7f1cc9292b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee4422da70 con 0x55ee44342d60 2023-08-10T11:52:18.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.474+0000 7f1cc9292b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee4422d770 con 0x55ee44341950 2023-08-10T11:52:18.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.474+0000 7f1cc9292b80 10 client.0 _ll_register_callbacks cb 0x55ee4422b630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:52:18.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.474+0000 7f1cb659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee443422b0 0x55ee4434b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.474+0000 7f1cb659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee443422b0 0x55ee4434b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60296/0 (socket says 172.21.15.73:60296) 2023-08-10T11:52:18.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.474+0000 7f1cb659c700 1 -- 172.21.15.73:0/1522333807 learned_addr learned my addr 172.21.15.73:0/1522333807 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:18.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.475+0000 7f1cb6d9d700 1 --2- 172.21.15.73:0/1522333807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ee44341950 0x55ee4434b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.475+0000 7f1cb759e700 1 --2- 172.21.15.73:0/1522333807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee44342d60 0x55ee44352840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.475+0000 7f1cb659c700 1 -- 172.21.15.73:0/1522333807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ee44341950 msgr2=0x55ee4434b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.475+0000 7f1cb659c700 1 --2- 172.21.15.73:0/1522333807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ee44341950 0x55ee4434b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.475+0000 7f1cb659c700 1 -- 172.21.15.73:0/1522333807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee44342d60 msgr2=0x55ee44352840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.475+0000 7f1cb659c700 1 --2- 172.21.15.73:0/1522333807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee44342d60 0x55ee44352840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.475+0000 7f1cb659c700 1 -- 172.21.15.73:0/1522333807 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb81083f0 con 0x55ee443422b0 2023-08-10T11:52:18.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.475+0000 7f1cb659c700 1 --2- 172.21.15.73:0/1522333807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee443422b0 0x55ee4434b800 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8010810 tx=0x7f1ca8010b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7935fcb5aa2515a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.475+0000 7f1c9aff5700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:52:18.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.475+0000 7f1c9aff5700 1 -- 172.21.15.73:0/1522333807 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca8004a30 con 0x55ee443422b0 2023-08-10T11:52:18.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.475+0000 7f1c9aff5700 1 -- 172.21.15.73:0/1522333807 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1ca8017070 con 0x55ee443422b0 2023-08-10T11:52:18.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.475+0000 7f1cc9292b80 1 -- 172.21.15.73:0/1522333807 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee44330420 con 0x55ee443422b0 2023-08-10T11:52:18.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.475+0000 7f1c9aff5700 1 -- 172.21.15.73:0/1522333807 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ca8004b90 con 0x55ee443422b0 2023-08-10T11:52:18.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.475+0000 7f1cc9292b80 10 client.15267 fetch_fsmap learned FSMap version 27 2023-08-10T11:52:18.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.475+0000 7f1cc9292b80 1 -- 172.21.15.73:0/1522333807 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55ee440bbd90 con 0x55ee443422b0 2023-08-10T11:52:18.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.476+0000 7f1c9aff5700 1 -- 172.21.15.73:0/1522333807 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ee44330420 con 0x55ee443422b0 2023-08-10T11:52:18.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.476+0000 7f1c9aff5700 1 -- 172.21.15.73:0/1522333807 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1ca8024070 con 0x55ee443422b0 2023-08-10T11:52:18.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.476+0000 7f1cc9292b80 10 client.15267 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:52:18.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.476+0000 7f1cc9292b80 10 client.15267 resolve_mds: resolved name 'f' to daemon mds.f 2023-08-10T11:52:18.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.476+0000 7f1cc9292b80 20 client.15267 populate_metadata read hostname 'smithi073' 2023-08-10T11:52:18.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.476+0000 7f1cc9292b80 1 --2- 172.21.15.73:0/1522333807 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55ee443565f0 0x55ee443559f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.476+0000 7f1cc9292b80 4 client.15267 mds_command: new command op to 24451 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:52:18.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.476+0000 7f1cc9292b80 1 -- 172.21.15.73:0/1522333807 --> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee4430c980 con 0x55ee443565f0 2023-08-10T11:52:18.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.477+0000 7f1cb6d9d700 1 --2- 172.21.15.73:0/1522333807 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55ee443565f0 0x55ee443559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.478+0000 7f1cb6d9d700 1 --2- 172.21.15.73:0/1522333807 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55ee443565f0 0x55ee443559f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4e895246f8d10bd server_cookie=d9a8dd2353fc8684 in_seq=0 out_seq=0 2023-08-10T11:52:18.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.482+0000 7f1c9aff5700 10 client.15267 ms_handle_connect on v2:172.21.15.156:6834/904126790 2023-08-10T11:52:18.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.482+0000 7f1c9aff5700 1 -- 172.21.15.73:0/1522333807 <== mds.2 v2:172.21.15.156:6834/904126790 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55ee4430c980 con 0x55ee443565f0 2023-08-10T11:52:18.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.482+0000 7f1c9aff5700 10 client.15267 handle_command_reply: tid=0 2023-08-10T11:52:18.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.482+0000 7f1cc9292b80 1 client.15267 shutdown 2023-08-10T11:52:18.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.483+0000 7f1cc9292b80 1 -- 172.21.15.73:0/1522333807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee443422b0 msgr2=0x55ee4434b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.483+0000 7f1cc9292b80 1 --2- 172.21.15.73:0/1522333807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee443422b0 0x55ee4434b800 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8010810 tx=0x7f1ca8010b20 comp rx=0 tx=0).stop 2023-08-10T11:52:18.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.483+0000 7f1cc9292b80 1 -- 172.21.15.73:0/1522333807 shutdown_connections 2023-08-10T11:52:18.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.483+0000 7f1cc9292b80 1 --2- 172.21.15.73:0/1522333807 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55ee443565f0 0x55ee443559f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.483+0000 7f1cc9292b80 1 --2- 172.21.15.73:0/1522333807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee44342d60 0x55ee44352840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.483+0000 7f1cc9292b80 1 --2- 172.21.15.73:0/1522333807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ee44341950 0x55ee4434b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.483+0000 7f1c9aff5700 0 client.15267 ms_handle_reset on v2:172.21.15.156:6834/904126790 2023-08-10T11:52:18.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.483+0000 7f1cc9292b80 1 --2- 172.21.15.73:0/1522333807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee443422b0 0x55ee4434b800 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.483+0000 7f1cc9292b80 1 -- 172.21.15.73:0/1522333807 >> 172.21.15.73:0/1522333807 conn(0x55ee4429ac80 msgr2=0x55ee44337960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.483+0000 7f1cc9292b80 1 -- 172.21.15.73:0/1522333807 shutdown_connections 2023-08-10T11:52:18.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.483+0000 7f1cc9292b80 1 -- 172.21.15.73:0/1522333807 wait complete. 2023-08-10T11:52:18.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.483+0000 7f1cc9292b80 20 client.15267 trim_cache size 0 max 16384 2023-08-10T11:52:18.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.516+0000 7f1cc9292b80 1 Processor -- start 2023-08-10T11:52:18.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.516+0000 7f1cc9292b80 1 -- start start 2023-08-10T11:52:18.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.516+0000 7f1cc9292b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ee44341950 0x55ee443559f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.516+0000 7f1cc9292b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee443422b0 0x55ee44355f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.516+0000 7f1cc9292b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee44342d60 0x55ee44352800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.516+0000 7f1cc9292b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee441118d0 con 0x55ee443422b0 2023-08-10T11:52:18.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.516+0000 7f1cc9292b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee44332810 con 0x55ee44342d60 2023-08-10T11:52:18.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.516+0000 7f1cc9292b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee44334f80 con 0x55ee44341950 2023-08-10T11:52:18.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.516+0000 7f1cb659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee443422b0 0x55ee44355f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.516+0000 7f1cb659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee443422b0 0x55ee44355f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60302/0 (socket says 172.21.15.73:60302) 2023-08-10T11:52:18.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.516+0000 7f1cb659c700 1 -- 172.21.15.73:0/3086769974 learned_addr learned my addr 172.21.15.73:0/3086769974 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:18.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.516+0000 7f1cb6d9d700 1 --2- 172.21.15.73:0/3086769974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ee44341950 0x55ee443559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.516+0000 7f1cb759e700 1 --2- 172.21.15.73:0/3086769974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee44342d60 0x55ee44352800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.517+0000 7f1cb659c700 1 -- 172.21.15.73:0/3086769974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ee44341950 msgr2=0x55ee443559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.517+0000 7f1cb659c700 1 --2- 172.21.15.73:0/3086769974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ee44341950 0x55ee443559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.517+0000 7f1cb659c700 1 -- 172.21.15.73:0/3086769974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee44342d60 msgr2=0x55ee44352800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.517+0000 7f1cb659c700 1 --2- 172.21.15.73:0/3086769974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee44342d60 0x55ee44352800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.517+0000 7f1cb659c700 1 -- 172.21.15.73:0/3086769974 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee440a4c10 con 0x55ee443422b0 2023-08-10T11:52:18.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.517+0000 7f1cb659c700 1 --2- 172.21.15.73:0/3086769974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee443422b0 0x55ee44355f30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8005410 tx=0x7f1ca8010fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea520b8c37a3bcf5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.519+0000 7f1c9dffb700 1 -- 172.21.15.73:0/3086769974 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca800e9e0 con 0x55ee443422b0 2023-08-10T11:52:18.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.519+0000 7f1c9dffb700 1 -- 172.21.15.73:0/3086769974 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1ca8021070 con 0x55ee443422b0 2023-08-10T11:52:18.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.519+0000 7f1c9dffb700 1 -- 172.21.15.73:0/3086769974 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca8026cf0 con 0x55ee443422b0 2023-08-10T11:52:18.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.520+0000 7f1cc9292b80 1 -- 172.21.15.73:0/3086769974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee443422b0 msgr2=0x55ee44355f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.520+0000 7f1cc9292b80 1 --2- 172.21.15.73:0/3086769974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee443422b0 0x55ee44355f30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8005410 tx=0x7f1ca8010fd0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.520+0000 7f1cc9292b80 1 -- 172.21.15.73:0/3086769974 shutdown_connections 2023-08-10T11:52:18.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.520+0000 7f1cc9292b80 1 --2- 172.21.15.73:0/3086769974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee44342d60 0x55ee44352800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.520+0000 7f1cc9292b80 1 --2- 172.21.15.73:0/3086769974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ee44341950 0x55ee443559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.520+0000 7f1cc9292b80 1 --2- 172.21.15.73:0/3086769974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee443422b0 0x55ee44355f30 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.520+0000 7f1cc9292b80 1 -- 172.21.15.73:0/3086769974 >> 172.21.15.73:0/3086769974 conn(0x55ee4429ac80 msgr2=0x55ee44349fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.520+0000 7f1cc9292b80 1 -- 172.21.15.73:0/3086769974 shutdown_connections 2023-08-10T11:52:18.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.520+0000 7f1cc9292b80 1 -- 172.21.15.73:0/3086769974 wait complete. 2023-08-10T11:52:18.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.521+0000 7f1cc9292b80 1 -- start start 2023-08-10T11:52:18.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.521+0000 7f1cc9292b80 1 Processor -- start 2023-08-10T11:52:18.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.521+0000 7f1cc9292b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee44341950 0x55ee4434de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.521+0000 7f1cc9292b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee443422b0 0x55ee4434e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.521+0000 7f1cc9292b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ee44342d60 0x55ee44351390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.521+0000 7f1cc9292b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee443518d0 con 0x55ee44341950 2023-08-10T11:52:18.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.521+0000 7f1cc9292b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee44351a40 con 0x55ee443422b0 2023-08-10T11:52:18.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.521+0000 7f1cc9292b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee44351c00 con 0x55ee44342d60 2023-08-10T11:52:18.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.521+0000 7f1cc9292b80 10 client.0 _ll_register_callbacks cb 0x55ee4422b630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:52:18.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.521+0000 7f1cb6d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee44341950 0x55ee4434de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.521+0000 7f1cb6d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee44341950 0x55ee4434de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60306/0 (socket says 172.21.15.73:60306) 2023-08-10T11:52:18.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.521+0000 7f1cb6d9d700 1 -- 172.21.15.73:0/360240024 learned_addr learned my addr 172.21.15.73:0/360240024 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:18.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.521+0000 7f1cb759e700 1 --2- 172.21.15.73:0/360240024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ee44342d60 0x55ee44351390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.521+0000 7f1cb659c700 1 --2- 172.21.15.73:0/360240024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee443422b0 0x55ee4434e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.521+0000 7f1cb6d9d700 1 -- 172.21.15.73:0/360240024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ee44342d60 msgr2=0x55ee44351390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.521+0000 7f1cb6d9d700 1 --2- 172.21.15.73:0/360240024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ee44342d60 0x55ee44351390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.522+0000 7f1cb6d9d700 1 -- 172.21.15.73:0/360240024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee443422b0 msgr2=0x55ee4434e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.522+0000 7f1cb6d9d700 1 --2- 172.21.15.73:0/360240024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee443422b0 0x55ee4434e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.522+0000 7f1cb6d9d700 1 -- 172.21.15.73:0/360240024 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ee440bbd90 con 0x55ee44341950 2023-08-10T11:52:18.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.522+0000 7f1cb759e700 1 --2- 172.21.15.73:0/360240024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ee44342d60 0x55ee44351390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:52:18.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.522+0000 7f1cb6d9d700 1 --2- 172.21.15.73:0/360240024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee44341950 0x55ee4434de30 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1cac015000 tx=0x7f1cac00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a72acd9b3c4a4b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.522+0000 7f1c9aff5700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:52:18.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.522+0000 7f1c9aff5700 1 -- 172.21.15.73:0/360240024 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac03d070 con 0x55ee44341950 2023-08-10T11:52:18.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.522+0000 7f1c9aff5700 1 -- 172.21.15.73:0/360240024 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1cac00bce0 con 0x55ee44341950 2023-08-10T11:52:18.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.522+0000 7f1cc9292b80 1 -- 172.21.15.73:0/360240024 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1cac01d040 con 0x55ee44341950 2023-08-10T11:52:18.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.522+0000 7f1c9aff5700 1 -- 172.21.15.73:0/360240024 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1cac00bea0 con 0x55ee44341950 2023-08-10T11:52:18.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.522+0000 7f1cc9292b80 10 client.15273 fetch_fsmap learned FSMap version 27 2023-08-10T11:52:18.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.522+0000 7f1cc9292b80 1 -- 172.21.15.73:0/360240024 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55ee440e2200 con 0x55ee44341950 2023-08-10T11:52:18.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.522+0000 7f1c9aff5700 1 -- 172.21.15.73:0/360240024 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1cac01d040 con 0x55ee44341950 2023-08-10T11:52:18.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.522+0000 7f1c9aff5700 1 -- 172.21.15.73:0/360240024 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1cac020070 con 0x55ee44341950 2023-08-10T11:52:18.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.522+0000 7f1cc9292b80 10 client.15273 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:52:18.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.522+0000 7f1cc9292b80 10 client.15273 resolve_mds: resolved name 'f' to daemon mds.f 2023-08-10T11:52:18.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.522+0000 7f1cc9292b80 20 client.15273 populate_metadata read hostname 'smithi073' 2023-08-10T11:52:18.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.522+0000 7f1cc9292b80 1 --2- 172.21.15.73:0/360240024 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55ee443afa30 0x55ee443ac470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.522+0000 7f1cc9292b80 4 client.15273 mds_command: new command op to 24451 tid=0[{"prefix": "status"}] 2023-08-10T11:52:18.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.522+0000 7f1cc9292b80 1 -- 172.21.15.73:0/360240024 --> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ee44287730 con 0x55ee443afa30 2023-08-10T11:52:18.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.523+0000 7f1cb659c700 1 --2- 172.21.15.73:0/360240024 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55ee443afa30 0x55ee443ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.523+0000 7f1c9aff5700 10 client.15273 ms_handle_connect on v2:172.21.15.156:6834/904126790 2023-08-10T11:52:18.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.523+0000 7f1cb659c700 1 --2- 172.21.15.73:0/360240024 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55ee443afa30 0x55ee443ac470 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4561d6b99f2a4be3 server_cookie=e1252885187d7e86 in_seq=0 out_seq=0 2023-08-10T11:52:18.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.523+0000 7f1c9aff5700 1 -- 172.21.15.73:0/360240024 <== mds.2 v2:172.21.15.156:6834/904126790 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55ee44287730 con 0x55ee443afa30 2023-08-10T11:52:18.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.523+0000 7f1c9aff5700 10 client.15273 handle_command_reply: tid=0 2023-08-10T11:52:18.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.523+0000 7f1cc9292b80 1 client.15273 shutdown 2023-08-10T11:52:18.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.523+0000 7f1cc9292b80 1 -- 172.21.15.73:0/360240024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee44341950 msgr2=0x55ee4434de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.523+0000 7f1cc9292b80 1 --2- 172.21.15.73:0/360240024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee44341950 0x55ee4434de30 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1cac015000 tx=0x7f1cac00b870 comp rx=0 tx=0).stop 2023-08-10T11:52:18.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.523+0000 7f1cc9292b80 1 -- 172.21.15.73:0/360240024 shutdown_connections 2023-08-10T11:52:18.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.523+0000 7f1cc9292b80 1 --2- 172.21.15.73:0/360240024 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55ee443afa30 0x55ee443ac470 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.523+0000 7f1cc9292b80 1 --2- 172.21.15.73:0/360240024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ee44342d60 0x55ee44351390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.523+0000 7f1cc9292b80 1 --2- 172.21.15.73:0/360240024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ee44341950 0x55ee4434de30 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.523+0000 7f1cc9292b80 1 --2- 172.21.15.73:0/360240024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ee443422b0 0x55ee4434e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.523+0000 7f1c9aff5700 0 client.15273 ms_handle_reset on v2:172.21.15.156:6834/904126790 2023-08-10T11:52:18.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.523+0000 7f1cc9292b80 1 -- 172.21.15.73:0/360240024 >> 172.21.15.73:0/360240024 conn(0x55ee4429ac80 msgr2=0x55ee443559f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.524+0000 7f1cc9292b80 1 -- 172.21.15.73:0/360240024 shutdown_connections 2023-08-10T11:52:18.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.524+0000 7f1cc9292b80 1 -- 172.21.15.73:0/360240024 wait complete. 2023-08-10T11:52:18.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.524+0000 7f1cc9292b80 20 client.15273 trim_cache size 0 max 16384 2023-08-10T11:52:18.535 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:52:18.535 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "0e619a74-3773-11ee-9b37-001a4aab830c", 2023-08-10T11:52:18.536 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 2, 2023-08-10T11:52:18.536 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 24451, 2023-08-10T11:52:18.536 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2023-08-10T11:52:18.536 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2023-08-10T11:52:18.536 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2023-08-10T11:52:18.536 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 80.026969989999998, 2023-08-10T11:52:18.536 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 27, 2023-08-10T11:52:18.537 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 85, 2023-08-10T11:52:18.537 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 83, 2023-08-10T11:52:18.537 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 102.308477604 2023-08-10T11:52:18.537 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:52:18.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.524+0000 7f1cbd0f9700 1 -- 172.21.15.73:0/163214057 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f1ca00a11e0 msgr2=0x7f1ca00a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.524+0000 7f1cbd0f9700 1 --2- 172.21.15.73:0/163214057 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f1ca00a11e0 0x7f1ca00a36a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0098e0 tx=0x7f1cac005c00 comp rx=0 tx=0).stop 2023-08-10T11:52:18.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.524+0000 7f1cbd0f9700 1 -- 172.21.15.73:0/163214057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cb81011f0 msgr2=0x7f1cb819d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.524+0000 7f1cbd0f9700 1 --2- 172.21.15.73:0/163214057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cb81011f0 0x7f1cb819d7b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0007ee0 tx=0x7f1cb000d3b0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.524+0000 7f1cbd0f9700 1 -- 172.21.15.73:0/163214057 shutdown_connections 2023-08-10T11:52:18.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.524+0000 7f1cbd0f9700 1 --2- 172.21.15.73:0/163214057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cb81011f0 0x7f1cb819d7b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.524+0000 7f1cbd0f9700 1 --2- 172.21.15.73:0/163214057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cb80ff660 0x7f1cb8068440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.524+0000 7f1cbd0f9700 1 --2- 172.21.15.73:0/163214057 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f1ca00a11e0 0x7f1ca00a36a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.524+0000 7f1cbd0f9700 1 --2- 172.21.15.73:0/163214057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cb8100850 0x7f1cb819b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.524+0000 7f1cbd0f9700 1 -- 172.21.15.73:0/163214057 >> 172.21.15.73:0/163214057 conn(0x7f1cb80fabd0 msgr2=0x7f1cb80fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.524+0000 7f1cbd0f9700 1 -- 172.21.15.73:0/163214057 shutdown_connections 2023-08-10T11:52:18.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.524+0000 7f1cbd0f9700 1 -- 172.21.15.73:0/163214057 wait complete. 2023-08-10T11:52:18.540 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-08-10T11:52:18.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.660+0000 7fc96768b700 1 -- 172.21.15.73:0/2441186095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc960101970 msgr2=0x7fc960101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.660+0000 7fc96768b700 1 --2- 172.21.15.73:0/2441186095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc960101970 0x7fc960101dd0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc9500099c0 tx=0x7fc950009cd0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.660+0000 7fc96768b700 1 -- 172.21.15.73:0/2441186095 shutdown_connections 2023-08-10T11:52:18.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.660+0000 7fc96768b700 1 --2- 172.21.15.73:0/2441186095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc960102310 0x7fc960108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.660+0000 7fc96768b700 1 --2- 172.21.15.73:0/2441186095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc960100780 0x7fc960100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.661+0000 7fc96768b700 1 --2- 172.21.15.73:0/2441186095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc960101970 0x7fc960101dd0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.661+0000 7fc96768b700 1 -- 172.21.15.73:0/2441186095 >> 172.21.15.73:0/2441186095 conn(0x7fc9600fbcf0 msgr2=0x7fc9600fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.661+0000 7fc96768b700 1 -- 172.21.15.73:0/2441186095 shutdown_connections 2023-08-10T11:52:18.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.661+0000 7fc96768b700 1 -- 172.21.15.73:0/2441186095 wait complete. 2023-08-10T11:52:18.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.661+0000 7fc96768b700 1 Processor -- start 2023-08-10T11:52:18.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.661+0000 7fc96768b700 1 -- start start 2023-08-10T11:52:18.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.661+0000 7fc96768b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc960100780 0x7fc9601964e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.661+0000 7fc96768b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc960101970 0x7fc960196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.661+0000 7fc96768b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc960102310 0x7fc96019da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.661+0000 7fc96768b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96019e060 con 0x7fc960100780 2023-08-10T11:52:18.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.661+0000 7fc96768b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96019e1a0 con 0x7fc960101970 2023-08-10T11:52:18.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.661+0000 7fc96768b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96019e330 con 0x7fc960102310 2023-08-10T11:52:18.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.661+0000 7fc965427700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc960100780 0x7fc9601964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.661+0000 7fc965427700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc960100780 0x7fc9601964e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60320/0 (socket says 172.21.15.73:60320) 2023-08-10T11:52:18.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.661+0000 7fc965427700 1 -- 172.21.15.73:0/2779824753 learned_addr learned my addr 172.21.15.73:0/2779824753 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:18.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.662+0000 7fc964c26700 1 --2- 172.21.15.73:0/2779824753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc960101970 0x7fc960196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.662+0000 7fc965427700 1 -- 172.21.15.73:0/2779824753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc960102310 msgr2=0x7fc96019da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.662+0000 7fc965427700 1 --2- 172.21.15.73:0/2779824753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc960102310 0x7fc96019da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.662+0000 7fc965427700 1 -- 172.21.15.73:0/2779824753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc960101970 msgr2=0x7fc960196a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.662+0000 7fc965427700 1 --2- 172.21.15.73:0/2779824753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc960101970 0x7fc960196a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.662+0000 7fc965427700 1 -- 172.21.15.73:0/2779824753 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9500095f0 con 0x7fc960100780 2023-08-10T11:52:18.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.662+0000 7fc964c26700 1 --2- 172.21.15.73:0/2779824753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc960101970 0x7fc960196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:52:18.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.662+0000 7fc965427700 1 --2- 172.21.15.73:0/2779824753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc960100780 0x7fc9601964e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00c970 tx=0x7fc95c00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.662+0000 7fc9567fc700 1 -- 172.21.15.73:0/2779824753 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c004220 con 0x7fc960100780 2023-08-10T11:52:18.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.662+0000 7fc9567fc700 1 -- 172.21.15.73:0/2779824753 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc95c007d60 con 0x7fc960100780 2023-08-10T11:52:18.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.662+0000 7fc9567fc700 1 -- 172.21.15.73:0/2779824753 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c003d00 con 0x7fc960100780 2023-08-10T11:52:18.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.662+0000 7fc96768b700 1 -- 172.21.15.73:0/2779824753 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc96019e610 con 0x7fc960100780 2023-08-10T11:52:18.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.662+0000 7fc96768b700 1 -- 172.21.15.73:0/2779824753 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96019eb20 con 0x7fc960100780 2023-08-10T11:52:18.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.665+0000 7fc9567fc700 1 -- 172.21.15.73:0/2779824753 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fc95c004380 con 0x7fc960100780 2023-08-10T11:52:18.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.665+0000 7fc9567fc700 1 --2- 172.21.15.73:0/2779824753 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc94c0a1260 0x7fc94c0a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.665+0000 7fc964c26700 1 --2- 172.21.15.73:0/2779824753 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc94c0a1260 0x7fc94c0a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.665+0000 7fc9567fc700 1 -- 172.21.15.73:0/2779824753 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc95c0cc9c0 con 0x7fc960100780 2023-08-10T11:52:18.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.666+0000 7fc964c26700 1 --2- 172.21.15.73:0/2779824753 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc94c0a1260 0x7fc94c0a3720 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc950006010 tx=0x7fc950000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.666+0000 7fc973824b80 1 Processor -- start 2023-08-10T11:52:18.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.666+0000 7fc973824b80 1 -- start start 2023-08-10T11:52:18.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.666+0000 7fc973824b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559d6c7974f0 0x559d6c797910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.666+0000 7fc973824b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d6c797e50 0x559d6c798380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.666+0000 7fc973824b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c798910 0x559d6c798da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.666+0000 7fc973824b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d6c712d70 con 0x559d6c798910 2023-08-10T11:52:18.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.666+0000 7fc973824b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d6c6ef540 con 0x559d6c797e50 2023-08-10T11:52:18.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.666+0000 7fc973824b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d6c6ece60 con 0x559d6c7974f0 2023-08-10T11:52:18.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.666+0000 7fc965c28700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c798910 0x559d6c798da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.666+0000 7fc965c28700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c798910 0x559d6c798da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60332/0 (socket says 172.21.15.73:60332) 2023-08-10T11:52:18.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.666+0000 7fc965c28700 1 -- 172.21.15.73:0/3511712861 learned_addr learned my addr 172.21.15.73:0/3511712861 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:18.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.667+0000 7fc964c26700 1 --2- 172.21.15.73:0/3511712861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d6c797e50 0x559d6c798380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.667+0000 7fc965427700 1 --2- 172.21.15.73:0/3511712861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559d6c7974f0 0x559d6c797910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.667+0000 7fc965c28700 1 -- 172.21.15.73:0/3511712861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559d6c7974f0 msgr2=0x559d6c797910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.667+0000 7fc965c28700 1 --2- 172.21.15.73:0/3511712861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559d6c7974f0 0x559d6c797910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.667+0000 7fc965c28700 1 -- 172.21.15.73:0/3511712861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d6c797e50 msgr2=0x559d6c798380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.667+0000 7fc965c28700 1 --2- 172.21.15.73:0/3511712861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d6c797e50 0x559d6c798380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.667+0000 7fc965c28700 1 -- 172.21.15.73:0/3511712861 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d6c5695e0 con 0x559d6c798910 2023-08-10T11:52:18.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.667+0000 7fc965427700 1 --2- 172.21.15.73:0/3511712861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559d6c7974f0 0x559d6c797910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:52:18.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.667+0000 7fc964c26700 1 --2- 172.21.15.73:0/3511712861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d6c797e50 0x559d6c798380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:52:18.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.667+0000 7fc965c28700 1 --2- 172.21.15.73:0/3511712861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c798910 0x559d6c798da0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc958009d10 tx=0x7fc9580077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f85430c8dd6d3cf server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.667+0000 7fc94b7fe700 1 -- 172.21.15.73:0/3511712861 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958003c00 con 0x559d6c798910 2023-08-10T11:52:18.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.667+0000 7fc94b7fe700 1 -- 172.21.15.73:0/3511712861 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc95800f040 con 0x559d6c798910 2023-08-10T11:52:18.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.667+0000 7fc94b7fe700 1 -- 172.21.15.73:0/3511712861 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958013650 con 0x559d6c798910 2023-08-10T11:52:18.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.668+0000 7fc973824b80 1 -- 172.21.15.73:0/3511712861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c798910 msgr2=0x559d6c798da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.668+0000 7fc973824b80 1 --2- 172.21.15.73:0/3511712861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c798910 0x559d6c798da0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc958009d10 tx=0x7fc9580077e0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.668+0000 7fc973824b80 1 -- 172.21.15.73:0/3511712861 shutdown_connections 2023-08-10T11:52:18.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.668+0000 7fc973824b80 1 --2- 172.21.15.73:0/3511712861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c798910 0x559d6c798da0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.668+0000 7fc973824b80 1 --2- 172.21.15.73:0/3511712861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559d6c7974f0 0x559d6c797910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.668+0000 7fc973824b80 1 --2- 172.21.15.73:0/3511712861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d6c797e50 0x559d6c798380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.668+0000 7fc973824b80 1 -- 172.21.15.73:0/3511712861 >> 172.21.15.73:0/3511712861 conn(0x559d6c6f4c80 msgr2=0x559d6c792280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.668+0000 7fc973824b80 1 -- 172.21.15.73:0/3511712861 shutdown_connections 2023-08-10T11:52:18.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.668+0000 7fc973824b80 1 -- 172.21.15.73:0/3511712861 wait complete. 2023-08-10T11:52:18.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.668+0000 7fc973824b80 1 -- start start 2023-08-10T11:52:18.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.668+0000 7fc973824b80 1 Processor -- start 2023-08-10T11:52:18.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.669+0000 7fc973824b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d6c7974f0 0x559d6c7a0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.669+0000 7fc973824b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559d6c797e50 0x559d6c7a1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.669+0000 7fc973824b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c798910 0x559d6c7a8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.669+0000 7fc973824b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d6c6e8750 con 0x559d6c798910 2023-08-10T11:52:18.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.669+0000 7fc973824b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d6c687a70 con 0x559d6c7974f0 2023-08-10T11:52:18.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.669+0000 7fc973824b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d6c687770 con 0x559d6c797e50 2023-08-10T11:52:18.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.669+0000 7fc973824b80 10 client.0 _ll_register_callbacks cb 0x559d6c685630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:52:18.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.669+0000 7fc965c28700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c798910 0x559d6c7a8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.669+0000 7fc965c28700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c798910 0x559d6c7a8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60336/0 (socket says 172.21.15.73:60336) 2023-08-10T11:52:18.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.669+0000 7fc965c28700 1 -- 172.21.15.73:0/3025130285 learned_addr learned my addr 172.21.15.73:0/3025130285 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:18.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.669+0000 7fc965427700 1 --2- 172.21.15.73:0/3025130285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d6c7974f0 0x559d6c7a0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.669+0000 7fc965c28700 1 -- 172.21.15.73:0/3025130285 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559d6c797e50 msgr2=0x559d6c7a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.669+0000 7fc965c28700 1 --2- 172.21.15.73:0/3025130285 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559d6c797e50 0x559d6c7a1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.669+0000 7fc965c28700 1 -- 172.21.15.73:0/3025130285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d6c7974f0 msgr2=0x559d6c7a0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.669+0000 7fc965c28700 1 --2- 172.21.15.73:0/3025130285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d6c7974f0 0x559d6c7a0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.669+0000 7fc965c28700 1 -- 172.21.15.73:0/3025130285 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc958009940 con 0x559d6c798910 2023-08-10T11:52:18.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.669+0000 7fc965c28700 1 --2- 172.21.15.73:0/3025130285 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c798910 0x559d6c7a8440 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc958009790 tx=0x7fc958009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c0b508be584377 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.669+0000 7fc948ff9700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:52:18.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.669+0000 7fc948ff9700 1 -- 172.21.15.73:0/3025130285 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958003e90 con 0x559d6c798910 2023-08-10T11:52:18.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.669+0000 7fc973824b80 1 -- 172.21.15.73:0/3025130285 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d6c78a420 con 0x559d6c798910 2023-08-10T11:52:18.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.669+0000 7fc948ff9700 1 -- 172.21.15.73:0/3025130285 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc95801c430 con 0x559d6c798910 2023-08-10T11:52:18.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.670+0000 7fc948ff9700 1 -- 172.21.15.73:0/3025130285 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc95801c5f0 con 0x559d6c798910 2023-08-10T11:52:18.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.670+0000 7fc973824b80 10 client.15285 fetch_fsmap learned FSMap version 27 2023-08-10T11:52:18.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.670+0000 7fc973824b80 1 -- 172.21.15.73:0/3025130285 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559d6c515d90 con 0x559d6c798910 2023-08-10T11:52:18.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.670+0000 7fc948ff9700 1 -- 172.21.15.73:0/3025130285 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559d6c78a420 con 0x559d6c798910 2023-08-10T11:52:18.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.670+0000 7fc948ff9700 1 -- 172.21.15.73:0/3025130285 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc958013860 con 0x559d6c798910 2023-08-10T11:52:18.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.670+0000 7fc973824b80 10 client.15285 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:52:18.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.670+0000 7fc973824b80 10 client.15285 resolve_mds: resolved name 'h' to daemon mds.h 2023-08-10T11:52:18.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.670+0000 7fc973824b80 20 client.15285 populate_metadata read hostname 'smithi073' 2023-08-10T11:52:18.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.670+0000 7fc973824b80 1 --2- 172.21.15.73:0/3025130285 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x559d6c7abf40 0x559d6c7ab330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.670+0000 7fc973824b80 4 client.15285 mds_command: new command op to 24479 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:52:18.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.670+0000 7fc973824b80 1 -- 172.21.15.73:0/3025130285 --> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559d6c766980 con 0x559d6c7abf40 2023-08-10T11:52:18.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.670+0000 7fc965427700 1 --2- 172.21.15.73:0/3025130285 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x559d6c7abf40 0x559d6c7ab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.671+0000 7fc948ff9700 10 client.15285 ms_handle_connect on v2:172.21.15.152:6836/74214089 2023-08-10T11:52:18.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.671+0000 7fc965427700 1 --2- 172.21.15.73:0/3025130285 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x559d6c7abf40 0x559d6c7ab330 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9bdbd52f0ba51800 server_cookie=f22f474433263036 in_seq=0 out_seq=0 2023-08-10T11:52:18.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.671+0000 7fc948ff9700 1 -- 172.21.15.73:0/3025130285 <== mds.1 v2:172.21.15.152:6836/74214089 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x559d6c766980 con 0x559d6c7abf40 2023-08-10T11:52:18.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.671+0000 7fc948ff9700 10 client.15285 handle_command_reply: tid=0 2023-08-10T11:52:18.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.671+0000 7fc973824b80 1 client.15285 shutdown 2023-08-10T11:52:18.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.671+0000 7fc973824b80 1 -- 172.21.15.73:0/3025130285 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c798910 msgr2=0x559d6c7a8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.671+0000 7fc973824b80 1 --2- 172.21.15.73:0/3025130285 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c798910 0x559d6c7a8440 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc958009790 tx=0x7fc958009680 comp rx=0 tx=0).stop 2023-08-10T11:52:18.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.671+0000 7fc973824b80 1 -- 172.21.15.73:0/3025130285 shutdown_connections 2023-08-10T11:52:18.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.671+0000 7fc973824b80 1 --2- 172.21.15.73:0/3025130285 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x559d6c7abf40 0x559d6c7ab330 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.671+0000 7fc973824b80 1 --2- 172.21.15.73:0/3025130285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d6c7974f0 0x559d6c7a0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.671+0000 7fc973824b80 1 --2- 172.21.15.73:0/3025130285 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c798910 0x559d6c7a8440 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.671+0000 7fc973824b80 1 --2- 172.21.15.73:0/3025130285 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559d6c797e50 0x559d6c7a1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.671+0000 7fc948ff9700 0 client.15285 ms_handle_reset on v2:172.21.15.152:6836/74214089 2023-08-10T11:52:18.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.671+0000 7fc973824b80 1 -- 172.21.15.73:0/3025130285 >> 172.21.15.73:0/3025130285 conn(0x559d6c6f4c80 msgr2=0x559d6c791960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.671+0000 7fc973824b80 1 -- 172.21.15.73:0/3025130285 shutdown_connections 2023-08-10T11:52:18.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.671+0000 7fc973824b80 1 -- 172.21.15.73:0/3025130285 wait complete. 2023-08-10T11:52:18.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.672+0000 7fc973824b80 20 client.15285 trim_cache size 0 max 16384 2023-08-10T11:52:18.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.689+0000 7fc973824b80 1 Processor -- start 2023-08-10T11:52:18.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.689+0000 7fc973824b80 1 -- start start 2023-08-10T11:52:18.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.689+0000 7fc973824b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c7974f0 0x559d6c792250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.689+0000 7fc973824b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d6c797e50 0x559d6c7a8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.689+0000 7fc973824b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559d6c798910 0x559d6c7ab330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.689+0000 7fc973824b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d6c56b8d0 con 0x559d6c7974f0 2023-08-10T11:52:18.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.689+0000 7fc973824b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d6c7a03c0 con 0x559d6c797e50 2023-08-10T11:52:18.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.689+0000 7fc973824b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d6c7a1d70 con 0x559d6c798910 2023-08-10T11:52:18.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.689+0000 7fc965427700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c7974f0 0x559d6c792250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.689+0000 7fc965427700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c7974f0 0x559d6c792250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60342/0 (socket says 172.21.15.73:60342) 2023-08-10T11:52:18.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.689+0000 7fc965427700 1 -- 172.21.15.73:0/2985303861 learned_addr learned my addr 172.21.15.73:0/2985303861 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:18.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.689+0000 7fc964c26700 1 --2- 172.21.15.73:0/2985303861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d6c797e50 0x559d6c7a8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.689+0000 7fc965427700 1 -- 172.21.15.73:0/2985303861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559d6c798910 msgr2=0x559d6c7ab330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.689+0000 7fc965c28700 1 --2- 172.21.15.73:0/2985303861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559d6c798910 0x559d6c7ab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.689+0000 7fc965427700 1 --2- 172.21.15.73:0/2985303861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559d6c798910 0x559d6c7ab330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.689+0000 7fc965427700 1 -- 172.21.15.73:0/2985303861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d6c797e50 msgr2=0x559d6c7a8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.689+0000 7fc965427700 1 --2- 172.21.15.73:0/2985303861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d6c797e50 0x559d6c7a8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.689+0000 7fc965427700 1 -- 172.21.15.73:0/2985303861 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d6c78e650 con 0x559d6c7974f0 2023-08-10T11:52:18.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.689+0000 7fc965c28700 1 --2- 172.21.15.73:0/2985303861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559d6c798910 0x559d6c7ab330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:52:18.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.689+0000 7fc965427700 1 --2- 172.21.15.73:0/2985303861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c7974f0 0x559d6c792250 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00c940 tx=0x7fc95c00a600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7597654c769b2e7a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.689+0000 7fc94bfff700 1 -- 172.21.15.73:0/2985303861 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c0a20d0 con 0x559d6c7974f0 2023-08-10T11:52:18.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.689+0000 7fc94bfff700 1 -- 172.21.15.73:0/2985303861 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc95c098020 con 0x559d6c7974f0 2023-08-10T11:52:18.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.689+0000 7fc94bfff700 1 -- 172.21.15.73:0/2985303861 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c099ee0 con 0x559d6c7974f0 2023-08-10T11:52:18.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.690+0000 7fc973824b80 1 -- 172.21.15.73:0/2985303861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c7974f0 msgr2=0x559d6c792250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.690+0000 7fc973824b80 1 --2- 172.21.15.73:0/2985303861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c7974f0 0x559d6c792250 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00c940 tx=0x7fc95c00a600 comp rx=0 tx=0).stop 2023-08-10T11:52:18.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.690+0000 7fc973824b80 1 -- 172.21.15.73:0/2985303861 shutdown_connections 2023-08-10T11:52:18.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.690+0000 7fc973824b80 1 --2- 172.21.15.73:0/2985303861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559d6c798910 0x559d6c7ab330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.690+0000 7fc973824b80 1 --2- 172.21.15.73:0/2985303861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c7974f0 0x559d6c792250 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.690+0000 7fc973824b80 1 --2- 172.21.15.73:0/2985303861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d6c797e50 0x559d6c7a8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.690+0000 7fc973824b80 1 -- 172.21.15.73:0/2985303861 >> 172.21.15.73:0/2985303861 conn(0x559d6c6f4c80 msgr2=0x559d6c793320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.690+0000 7fc973824b80 1 -- 172.21.15.73:0/2985303861 shutdown_connections 2023-08-10T11:52:18.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.690+0000 7fc973824b80 1 -- 172.21.15.73:0/2985303861 wait complete. 2023-08-10T11:52:18.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.690+0000 7fc973824b80 1 -- start start 2023-08-10T11:52:18.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.690+0000 7fc973824b80 1 Processor -- start 2023-08-10T11:52:18.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.691+0000 7fc973824b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d6c7974f0 0x559d6c7a33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.691+0000 7fc973824b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559d6c797e50 0x559d6c7a3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.691+0000 7fc973824b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c798910 0x559d6c7a6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.691+0000 7fc973824b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d6c7a6e60 con 0x559d6c798910 2023-08-10T11:52:18.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.691+0000 7fc973824b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d6c7a6fd0 con 0x559d6c7974f0 2023-08-10T11:52:18.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.691+0000 7fc973824b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d6c7a7190 con 0x559d6c797e50 2023-08-10T11:52:18.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.691+0000 7fc973824b80 10 client.0 _ll_register_callbacks cb 0x559d6c685630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:52:18.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.691+0000 7fc965c28700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c798910 0x559d6c7a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.691+0000 7fc965c28700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c798910 0x559d6c7a6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60352/0 (socket says 172.21.15.73:60352) 2023-08-10T11:52:18.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.691+0000 7fc965c28700 1 -- 172.21.15.73:0/2592763865 learned_addr learned my addr 172.21.15.73:0/2592763865 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:18.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.691+0000 7fc964c26700 1 --2- 172.21.15.73:0/2592763865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559d6c797e50 0x559d6c7a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.691+0000 7fc965427700 1 --2- 172.21.15.73:0/2592763865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d6c7974f0 0x559d6c7a33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.691+0000 7fc965c28700 1 -- 172.21.15.73:0/2592763865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559d6c797e50 msgr2=0x559d6c7a3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.691+0000 7fc965c28700 1 --2- 172.21.15.73:0/2592763865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559d6c797e50 0x559d6c7a3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.691+0000 7fc965c28700 1 -- 172.21.15.73:0/2592763865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d6c7974f0 msgr2=0x559d6c7a33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.691+0000 7fc965c28700 1 --2- 172.21.15.73:0/2592763865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d6c7974f0 0x559d6c7a33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.691+0000 7fc965c28700 1 -- 172.21.15.73:0/2592763865 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96019eb20 con 0x559d6c798910 2023-08-10T11:52:18.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.691+0000 7fc965c28700 1 --2- 172.21.15.73:0/2592763865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c798910 0x559d6c7a6920 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc958007820 tx=0x7fc958009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921db2b16f08dd3b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.691+0000 7fc948ff9700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:52:18.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.691+0000 7fc948ff9700 1 -- 172.21.15.73:0/2592763865 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958003ea0 con 0x559d6c798910 2023-08-10T11:52:18.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.692+0000 7fc948ff9700 1 -- 172.21.15.73:0/2592763865 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc958009430 con 0x559d6c798910 2023-08-10T11:52:18.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.692+0000 7fc973824b80 1 -- 172.21.15.73:0/2592763865 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc95800f040 con 0x559d6c798910 2023-08-10T11:52:18.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.692+0000 7fc948ff9700 1 -- 172.21.15.73:0/2592763865 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc958036030 con 0x559d6c798910 2023-08-10T11:52:18.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.692+0000 7fc973824b80 10 client.15291 fetch_fsmap learned FSMap version 27 2023-08-10T11:52:18.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.692+0000 7fc973824b80 1 -- 172.21.15.73:0/2592763865 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559d6c4fec10 con 0x559d6c798910 2023-08-10T11:52:18.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.692+0000 7fc948ff9700 1 -- 172.21.15.73:0/2592763865 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc95800f040 con 0x559d6c798910 2023-08-10T11:52:18.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.692+0000 7fc948ff9700 1 -- 172.21.15.73:0/2592763865 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc958004bb0 con 0x559d6c798910 2023-08-10T11:52:18.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.692+0000 7fc973824b80 10 client.15291 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:52:18.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.692+0000 7fc973824b80 10 client.15291 resolve_mds: resolved name 'h' to daemon mds.h 2023-08-10T11:52:18.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.692+0000 7fc973824b80 20 client.15291 populate_metadata read hostname 'smithi073' 2023-08-10T11:52:18.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.692+0000 7fc973824b80 1 --2- 172.21.15.73:0/2592763865 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x559d6c80d6d0 0x559d6c80a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.692+0000 7fc973824b80 4 client.15291 mds_command: new command op to 24479 tid=0[{"prefix": "status"}] 2023-08-10T11:52:18.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.692+0000 7fc973824b80 1 -- 172.21.15.73:0/2592763865 --> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559d6c6e1730 con 0x559d6c80d6d0 2023-08-10T11:52:18.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.692+0000 7fc965427700 1 --2- 172.21.15.73:0/2592763865 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x559d6c80d6d0 0x559d6c80a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.693+0000 7fc948ff9700 10 client.15291 ms_handle_connect on v2:172.21.15.152:6836/74214089 2023-08-10T11:52:18.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.693+0000 7fc965427700 1 --2- 172.21.15.73:0/2592763865 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x559d6c80d6d0 0x559d6c80a4e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6825d5f4776da940 server_cookie=a824b67b6400ed9 in_seq=0 out_seq=0 2023-08-10T11:52:18.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.693+0000 7fc948ff9700 1 -- 172.21.15.73:0/2592763865 <== mds.1 v2:172.21.15.152:6836/74214089 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x559d6c6e1730 con 0x559d6c80d6d0 2023-08-10T11:52:18.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.693+0000 7fc948ff9700 10 client.15291 handle_command_reply: tid=0 2023-08-10T11:52:18.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.693+0000 7fc973824b80 1 client.15291 shutdown 2023-08-10T11:52:18.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.693+0000 7fc973824b80 1 -- 172.21.15.73:0/2592763865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c798910 msgr2=0x559d6c7a6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.693+0000 7fc973824b80 1 --2- 172.21.15.73:0/2592763865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c798910 0x559d6c7a6920 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc958007820 tx=0x7fc958009cd0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.693+0000 7fc973824b80 1 -- 172.21.15.73:0/2592763865 shutdown_connections 2023-08-10T11:52:18.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.693+0000 7fc973824b80 1 --2- 172.21.15.73:0/2592763865 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x559d6c80d6d0 0x559d6c80a4e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.693+0000 7fc973824b80 1 --2- 172.21.15.73:0/2592763865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d6c7974f0 0x559d6c7a33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.693+0000 7fc948ff9700 0 client.15291 ms_handle_reset on v2:172.21.15.152:6836/74214089 2023-08-10T11:52:18.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.693+0000 7fc973824b80 1 --2- 172.21.15.73:0/2592763865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559d6c798910 0x559d6c7a6920 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.693+0000 7fc973824b80 1 --2- 172.21.15.73:0/2592763865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559d6c797e50 0x559d6c7a3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.693+0000 7fc973824b80 1 -- 172.21.15.73:0/2592763865 >> 172.21.15.73:0/2592763865 conn(0x559d6c6f4c80 msgr2=0x559d6c7921d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.693+0000 7fc973824b80 1 -- 172.21.15.73:0/2592763865 shutdown_connections 2023-08-10T11:52:18.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.693+0000 7fc973824b80 1 -- 172.21.15.73:0/2592763865 wait complete. 2023-08-10T11:52:18.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.693+0000 7fc973824b80 20 client.15291 trim_cache size 0 max 16384 2023-08-10T11:52:18.706 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:52:18.707 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "0e619a74-3773-11ee-9b37-001a4aab830c", 2023-08-10T11:52:18.707 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 1, 2023-08-10T11:52:18.707 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 24479, 2023-08-10T11:52:18.707 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2023-08-10T11:52:18.707 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2023-08-10T11:52:18.707 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2023-08-10T11:52:18.707 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 80.776439652999997, 2023-08-10T11:52:18.708 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 27, 2023-08-10T11:52:18.708 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 85, 2023-08-10T11:52:18.708 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 83, 2023-08-10T11:52:18.708 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 97.929912329999993 2023-08-10T11:52:18.708 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:52:18.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.694+0000 7fc96768b700 1 -- 172.21.15.73:0/2779824753 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc94c0a1260 msgr2=0x7fc94c0a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.694+0000 7fc96768b700 1 --2- 172.21.15.73:0/2779824753 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc94c0a1260 0x7fc94c0a3720 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc950006010 tx=0x7fc950000bc0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.694+0000 7fc96768b700 1 -- 172.21.15.73:0/2779824753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc960100780 msgr2=0x7fc9601964e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.694+0000 7fc96768b700 1 --2- 172.21.15.73:0/2779824753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc960100780 0x7fc9601964e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00c970 tx=0x7fc95c00cd30 comp rx=0 tx=0).stop 2023-08-10T11:52:18.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.694+0000 7fc96768b700 1 -- 172.21.15.73:0/2779824753 shutdown_connections 2023-08-10T11:52:18.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.694+0000 7fc96768b700 1 --2- 172.21.15.73:0/2779824753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc960102310 0x7fc96019da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.694+0000 7fc96768b700 1 --2- 172.21.15.73:0/2779824753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc960100780 0x7fc9601964e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.694+0000 7fc96768b700 1 --2- 172.21.15.73:0/2779824753 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fc94c0a1260 0x7fc94c0a3720 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.694+0000 7fc96768b700 1 --2- 172.21.15.73:0/2779824753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc960101970 0x7fc960196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.694+0000 7fc96768b700 1 -- 172.21.15.73:0/2779824753 >> 172.21.15.73:0/2779824753 conn(0x7fc9600fbcf0 msgr2=0x7fc960104eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.694+0000 7fc96768b700 1 -- 172.21.15.73:0/2779824753 shutdown_connections 2023-08-10T11:52:18.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.694+0000 7fc96768b700 1 -- 172.21.15.73:0/2779824753 wait complete. 2023-08-10T11:52:18.711 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-10T11:52:18.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.833+0000 7f57da1ab700 1 -- 172.21.15.73:0/3567163949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57d4101970 msgr2=0x7f57d4101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.833+0000 7f57da1ab700 1 --2- 172.21.15.73:0/3567163949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57d4101970 0x7f57d4101dd0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f57c40099c0 tx=0x7f57c4009cd0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.833+0000 7f57da1ab700 1 -- 172.21.15.73:0/3567163949 shutdown_connections 2023-08-10T11:52:18.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.833+0000 7f57da1ab700 1 --2- 172.21.15.73:0/3567163949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57d4102310 0x7f57d4108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.833+0000 7f57da1ab700 1 --2- 172.21.15.73:0/3567163949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57d4100780 0x7f57d4100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.833+0000 7f57da1ab700 1 --2- 172.21.15.73:0/3567163949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57d4101970 0x7f57d4101dd0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.833+0000 7f57da1ab700 1 -- 172.21.15.73:0/3567163949 >> 172.21.15.73:0/3567163949 conn(0x7f57d40fbcf0 msgr2=0x7f57d40fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.833+0000 7f57da1ab700 1 -- 172.21.15.73:0/3567163949 shutdown_connections 2023-08-10T11:52:18.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.833+0000 7f57da1ab700 1 -- 172.21.15.73:0/3567163949 wait complete. 2023-08-10T11:52:18.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.833+0000 7f57da1ab700 1 Processor -- start 2023-08-10T11:52:18.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.834+0000 7f57da1ab700 1 -- start start 2023-08-10T11:52:18.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.834+0000 7f57da1ab700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57d4100780 0x7f57d4196440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.834+0000 7f57da1ab700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57d4101970 0x7f57d4196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.834+0000 7f57da1ab700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57d4102310 0x7f57d419d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.834+0000 7f57da1ab700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d419dfc0 con 0x7f57d4101970 2023-08-10T11:52:18.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.834+0000 7f57da1ab700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d419e100 con 0x7f57d4100780 2023-08-10T11:52:18.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.834+0000 7f57da1ab700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d419e290 con 0x7f57d4102310 2023-08-10T11:52:18.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.834+0000 7f57d2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57d4101970 0x7f57d4196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.834+0000 7f57d2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57d4101970 0x7f57d4196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60364/0 (socket says 172.21.15.73:60364) 2023-08-10T11:52:18.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.834+0000 7f57d2ffd700 1 -- 172.21.15.73:0/3211436031 learned_addr learned my addr 172.21.15.73:0/3211436031 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:18.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.834+0000 7f57d3fff700 1 --2- 172.21.15.73:0/3211436031 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57d4102310 0x7f57d419d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.834+0000 7f57d37fe700 1 --2- 172.21.15.73:0/3211436031 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57d4100780 0x7f57d4196440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.834+0000 7f57d2ffd700 1 -- 172.21.15.73:0/3211436031 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57d4102310 msgr2=0x7f57d419d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.834+0000 7f57d2ffd700 1 --2- 172.21.15.73:0/3211436031 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57d4102310 0x7f57d419d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.834+0000 7f57d2ffd700 1 -- 172.21.15.73:0/3211436031 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57d4100780 msgr2=0x7f57d4196440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.834+0000 7f57d2ffd700 1 --2- 172.21.15.73:0/3211436031 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57d4100780 0x7f57d4196440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.834+0000 7f57d2ffd700 1 -- 172.21.15.73:0/3211436031 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c40095f0 con 0x7f57d4101970 2023-08-10T11:52:18.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.834+0000 7f57d37fe700 1 --2- 172.21.15.73:0/3211436031 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57d4100780 0x7f57d4196440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:52:18.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.835+0000 7f57d2ffd700 1 --2- 172.21.15.73:0/3211436031 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57d4101970 0x7f57d4196980 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f57c4009990 tx=0x7f57c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.835+0000 7f57d0ff9700 1 -- 172.21.15.73:0/3211436031 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c401d070 con 0x7f57d4101970 2023-08-10T11:52:18.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.835+0000 7f57da1ab700 1 -- 172.21.15.73:0/3211436031 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d419e510 con 0x7f57d4101970 2023-08-10T11:52:18.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.835+0000 7f57d0ff9700 1 -- 172.21.15.73:0/3211436031 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f57c4004090 con 0x7f57d4101970 2023-08-10T11:52:18.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.835+0000 7f57d0ff9700 1 -- 172.21.15.73:0/3211436031 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c4004a00 con 0x7f57d4101970 2023-08-10T11:52:18.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.835+0000 7f57da1ab700 1 -- 172.21.15.73:0/3211436031 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d419ea10 con 0x7f57d4101970 2023-08-10T11:52:18.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.837+0000 7f57d0ff9700 1 -- 172.21.15.73:0/3211436031 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f57c4003bd0 con 0x7f57d4101970 2023-08-10T11:52:18.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.837+0000 7f57d0ff9700 1 --2- 172.21.15.73:0/3211436031 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f57bc0a11e0 0x7f57bc0a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.837+0000 7f57d37fe700 1 --2- 172.21.15.73:0/3211436031 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f57bc0a11e0 0x7f57bc0a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.837+0000 7f57d0ff9700 1 -- 172.21.15.73:0/3211436031 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f57c40cd9c0 con 0x7f57d4101970 2023-08-10T11:52:18.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.838+0000 7f57d37fe700 1 --2- 172.21.15.73:0/3211436031 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f57bc0a11e0 0x7f57bc0a36a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f57c8005950 tx=0x7f57c80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.838+0000 7f57e6344b80 1 Processor -- start 2023-08-10T11:52:18.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.838+0000 7f57e6344b80 1 -- start start 2023-08-10T11:52:18.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.838+0000 7f57e6344b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56005e0b94f0 0x56005e0b9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.838+0000 7f57e6344b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b9e50 0x56005e0ba380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.838+0000 7f57e6344b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005e0ba910 0x56005e0bada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.838+0000 7f57e6344b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005e034d70 con 0x56005e0b9e50 2023-08-10T11:52:18.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.838+0000 7f57e6344b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005e011540 con 0x56005e0b94f0 2023-08-10T11:52:18.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.838+0000 7f57e6344b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005e00ee60 con 0x56005e0ba910 2023-08-10T11:52:18.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.839+0000 7f57d2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b9e50 0x56005e0ba380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.839+0000 7f57d2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b9e50 0x56005e0ba380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60372/0 (socket says 172.21.15.73:60372) 2023-08-10T11:52:18.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.839+0000 7f57d2ffd700 1 -- 172.21.15.73:0/2239920292 learned_addr learned my addr 172.21.15.73:0/2239920292 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:18.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.839+0000 7f57d3fff700 1 --2- 172.21.15.73:0/2239920292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005e0ba910 0x56005e0bada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.839+0000 7f57d37fe700 1 --2- 172.21.15.73:0/2239920292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56005e0b94f0 0x56005e0b9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.839+0000 7f57d2ffd700 1 -- 172.21.15.73:0/2239920292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005e0ba910 msgr2=0x56005e0bada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.839+0000 7f57d2ffd700 1 --2- 172.21.15.73:0/2239920292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005e0ba910 0x56005e0bada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.839+0000 7f57d2ffd700 1 -- 172.21.15.73:0/2239920292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56005e0b94f0 msgr2=0x56005e0b9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.839+0000 7f57d2ffd700 1 --2- 172.21.15.73:0/2239920292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56005e0b94f0 0x56005e0b9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.839+0000 7f57d2ffd700 1 -- 172.21.15.73:0/2239920292 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56005de8b5e0 con 0x56005e0b9e50 2023-08-10T11:52:18.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.839+0000 7f57d3fff700 1 --2- 172.21.15.73:0/2239920292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005e0ba910 0x56005e0bada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:52:18.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.839+0000 7f57d37fe700 1 --2- 172.21.15.73:0/2239920292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56005e0b94f0 0x56005e0b9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:52:18.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.839+0000 7f57d2ffd700 1 --2- 172.21.15.73:0/2239920292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b9e50 0x56005e0ba380 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f57c40cb3b0 tx=0x7f57c409a670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab40af231a5445f8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.839+0000 7f57b9ffb700 1 -- 172.21.15.73:0/2239920292 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c409ed40 con 0x56005e0b9e50 2023-08-10T11:52:18.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.839+0000 7f57b9ffb700 1 -- 172.21.15.73:0/2239920292 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f57c40a30d0 con 0x56005e0b9e50 2023-08-10T11:52:18.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.839+0000 7f57b9ffb700 1 -- 172.21.15.73:0/2239920292 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c409a460 con 0x56005e0b9e50 2023-08-10T11:52:18.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.840+0000 7f57e6344b80 1 -- 172.21.15.73:0/2239920292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b9e50 msgr2=0x56005e0ba380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.840+0000 7f57e6344b80 1 --2- 172.21.15.73:0/2239920292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b9e50 0x56005e0ba380 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f57c40cb3b0 tx=0x7f57c409a670 comp rx=0 tx=0).stop 2023-08-10T11:52:18.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.840+0000 7f57e6344b80 1 -- 172.21.15.73:0/2239920292 shutdown_connections 2023-08-10T11:52:18.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.840+0000 7f57e6344b80 1 --2- 172.21.15.73:0/2239920292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56005e0b94f0 0x56005e0b9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.840+0000 7f57e6344b80 1 --2- 172.21.15.73:0/2239920292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005e0ba910 0x56005e0bada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.840+0000 7f57e6344b80 1 --2- 172.21.15.73:0/2239920292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b9e50 0x56005e0ba380 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.840+0000 7f57e6344b80 1 -- 172.21.15.73:0/2239920292 >> 172.21.15.73:0/2239920292 conn(0x56005e016c80 msgr2=0x56005e0b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.840+0000 7f57e6344b80 1 -- 172.21.15.73:0/2239920292 shutdown_connections 2023-08-10T11:52:18.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.840+0000 7f57e6344b80 1 -- 172.21.15.73:0/2239920292 wait complete. 2023-08-10T11:52:18.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.840+0000 7f57e6344b80 1 -- start start 2023-08-10T11:52:18.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.840+0000 7f57e6344b80 1 Processor -- start 2023-08-10T11:52:18.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.841+0000 7f57e6344b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56005e0b94f0 0x56005e0c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.841+0000 7f57e6344b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b9e50 0x56005e0c3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.841+0000 7f57e6344b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005e0ba910 0x56005e0ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.841+0000 7f57e6344b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005e00a750 con 0x56005e0b9e50 2023-08-10T11:52:18.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.841+0000 7f57e6344b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005dfa9a70 con 0x56005e0b94f0 2023-08-10T11:52:18.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.841+0000 7f57e6344b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005dfa9770 con 0x56005e0ba910 2023-08-10T11:52:18.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.841+0000 7f57e6344b80 10 client.0 _ll_register_callbacks cb 0x56005dfa7630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:52:18.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.841+0000 7f57d2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b9e50 0x56005e0c3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.841+0000 7f57d2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b9e50 0x56005e0c3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60378/0 (socket says 172.21.15.73:60378) 2023-08-10T11:52:18.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.841+0000 7f57d2ffd700 1 -- 172.21.15.73:0/2897768043 learned_addr learned my addr 172.21.15.73:0/2897768043 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:18.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.841+0000 7f57d3fff700 1 --2- 172.21.15.73:0/2897768043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005e0ba910 0x56005e0ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.841+0000 7f57d37fe700 1 --2- 172.21.15.73:0/2897768043 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56005e0b94f0 0x56005e0c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.841+0000 7f57d2ffd700 1 -- 172.21.15.73:0/2897768043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005e0ba910 msgr2=0x56005e0ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.841+0000 7f57d2ffd700 1 --2- 172.21.15.73:0/2897768043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005e0ba910 0x56005e0ca1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.841+0000 7f57d2ffd700 1 -- 172.21.15.73:0/2897768043 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56005e0b94f0 msgr2=0x56005e0c2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.841+0000 7f57d2ffd700 1 --2- 172.21.15.73:0/2897768043 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56005e0b94f0 0x56005e0c2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.841+0000 7f57d2ffd700 1 -- 172.21.15.73:0/2897768043 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d419ea10 con 0x56005e0b9e50 2023-08-10T11:52:18.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.841+0000 7f57d2ffd700 1 --2- 172.21.15.73:0/2897768043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b9e50 0x56005e0c3190 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f57c40971c0 tx=0x7f57c4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4195e7feab44b76 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.841+0000 7f57b2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:52:18.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.841+0000 7f57b2ffd700 1 -- 172.21.15.73:0/2897768043 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c409ed40 con 0x56005e0b9e50 2023-08-10T11:52:18.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.841+0000 7f57b2ffd700 1 -- 172.21.15.73:0/2897768043 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f57c40a2e50 con 0x56005e0b9e50 2023-08-10T11:52:18.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.841+0000 7f57e6344b80 1 -- 172.21.15.73:0/2897768043 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56005e0ac420 con 0x56005e0b9e50 2023-08-10T11:52:18.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.841+0000 7f57b2ffd700 1 -- 172.21.15.73:0/2897768043 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57c40b3180 con 0x56005e0b9e50 2023-08-10T11:52:18.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.842+0000 7f57e6344b80 10 client.15303 fetch_fsmap learned FSMap version 27 2023-08-10T11:52:18.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.842+0000 7f57e6344b80 1 -- 172.21.15.73:0/2897768043 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56005de37d90 con 0x56005e0b9e50 2023-08-10T11:52:18.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.842+0000 7f57b2ffd700 1 -- 172.21.15.73:0/2897768043 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f57c40b7020 con 0x56005e0b9e50 2023-08-10T11:52:18.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.842+0000 7f57b2ffd700 1 -- 172.21.15.73:0/2897768043 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f57c40ba050 con 0x56005e0b9e50 2023-08-10T11:52:18.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.842+0000 7f57e6344b80 10 client.15303 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:52:18.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.842+0000 7f57e6344b80 10 client.15303 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-10T11:52:18.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.842+0000 7f57e6344b80 20 client.15303 populate_metadata read hostname 'smithi073' 2023-08-10T11:52:18.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.842+0000 7f57e6344b80 1 --2- 172.21.15.73:0/2897768043 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56005e0cdf60 0x56005e0cd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.842+0000 7f57e6344b80 4 client.15303 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:52:18.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.842+0000 7f57e6344b80 1 -- 172.21.15.73:0/2897768043 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56005e088980 con 0x56005e0cdf60 2023-08-10T11:52:18.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.842+0000 7f57d37fe700 1 --2- 172.21.15.73:0/2897768043 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56005e0cdf60 0x56005e0cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.842+0000 7f57b2ffd700 10 client.15303 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:52:18.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.842+0000 7f57d37fe700 1 --2- 172.21.15.73:0/2897768043 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56005e0cdf60 0x56005e0cd070 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd549fc4883a8bb2 server_cookie=1a0e1d1840f84ef6 in_seq=0 out_seq=0 2023-08-10T11:52:18.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.843+0000 7f57b2ffd700 1 -- 172.21.15.73:0/2897768043 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x56005e088980 con 0x56005e0cdf60 2023-08-10T11:52:18.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.843+0000 7f57b2ffd700 10 client.15303 handle_command_reply: tid=0 2023-08-10T11:52:18.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.843+0000 7f57e6344b80 1 client.15303 shutdown 2023-08-10T11:52:18.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.843+0000 7f57e6344b80 1 -- 172.21.15.73:0/2897768043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b9e50 msgr2=0x56005e0c3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.843+0000 7f57e6344b80 1 --2- 172.21.15.73:0/2897768043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b9e50 0x56005e0c3190 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f57c40971c0 tx=0x7f57c4009310 comp rx=0 tx=0).stop 2023-08-10T11:52:18.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.843+0000 7f57e6344b80 1 -- 172.21.15.73:0/2897768043 shutdown_connections 2023-08-10T11:52:18.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.843+0000 7f57e6344b80 1 --2- 172.21.15.73:0/2897768043 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56005e0cdf60 0x56005e0cd070 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.843+0000 7f57e6344b80 1 --2- 172.21.15.73:0/2897768043 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56005e0b94f0 0x56005e0c2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.843+0000 7f57e6344b80 1 --2- 172.21.15.73:0/2897768043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005e0ba910 0x56005e0ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.843+0000 7f57b2ffd700 0 client.15303 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:52:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.843+0000 7f57e6344b80 1 --2- 172.21.15.73:0/2897768043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b9e50 0x56005e0c3190 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.843+0000 7f57e6344b80 1 -- 172.21.15.73:0/2897768043 >> 172.21.15.73:0/2897768043 conn(0x56005e016c80 msgr2=0x56005e0b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.843+0000 7f57e6344b80 1 -- 172.21.15.73:0/2897768043 shutdown_connections 2023-08-10T11:52:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.843+0000 7f57e6344b80 1 -- 172.21.15.73:0/2897768043 wait complete. 2023-08-10T11:52:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.844+0000 7f57e6344b80 20 client.15303 trim_cache size 0 max 16384 2023-08-10T11:52:18.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.861+0000 7f57e6344b80 1 Processor -- start 2023-08-10T11:52:18.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.861+0000 7f57e6344b80 1 -- start start 2023-08-10T11:52:18.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.861+0000 7f57e6344b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b94f0 0x56005e0bd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.861+0000 7f57e6344b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005e0b9e50 0x56005e0bdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.861+0000 7f57e6344b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56005e0ba910 0x56005e0c2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.861+0000 7f57e6344b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005de8d8d0 con 0x56005e0b94f0 2023-08-10T11:52:18.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.861+0000 7f57e6344b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005e0cec30 con 0x56005e0ba910 2023-08-10T11:52:18.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.861+0000 7f57e6344b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005e0ae810 con 0x56005e0b9e50 2023-08-10T11:52:18.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.861+0000 7f57d37fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b94f0 0x56005e0bd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.861+0000 7f57d37fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b94f0 0x56005e0bd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60384/0 (socket says 172.21.15.73:60384) 2023-08-10T11:52:18.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.861+0000 7f57d37fe700 1 -- 172.21.15.73:0/1096655331 learned_addr learned my addr 172.21.15.73:0/1096655331 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:18.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.861+0000 7f57d37fe700 1 -- 172.21.15.73:0/1096655331 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005e0b9e50 msgr2=0x56005e0bdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.861+0000 7f57d37fe700 1 --2- 172.21.15.73:0/1096655331 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005e0b9e50 0x56005e0bdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.861+0000 7f57d37fe700 1 -- 172.21.15.73:0/1096655331 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56005e0ba910 msgr2=0x56005e0c2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.861+0000 7f57d37fe700 1 --2- 172.21.15.73:0/1096655331 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56005e0ba910 0x56005e0c2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.861+0000 7f57d37fe700 1 -- 172.21.15.73:0/1096655331 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56005e0b0650 con 0x56005e0b94f0 2023-08-10T11:52:18.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.861+0000 7f57d37fe700 1 --2- 172.21.15.73:0/1096655331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b94f0 0x56005e0bd780 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f57c800baa0 tx=0x7f57c8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90553826d4608fde server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.861+0000 7f57ba7fc700 1 -- 172.21.15.73:0/1096655331 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c8024040 con 0x56005e0b94f0 2023-08-10T11:52:18.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.861+0000 7f57ba7fc700 1 -- 172.21.15.73:0/1096655331 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f57c8027e80 con 0x56005e0b94f0 2023-08-10T11:52:18.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.861+0000 7f57ba7fc700 1 -- 172.21.15.73:0/1096655331 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c801f670 con 0x56005e0b94f0 2023-08-10T11:52:18.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.862+0000 7f57e6344b80 1 -- 172.21.15.73:0/1096655331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b94f0 msgr2=0x56005e0bd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.862+0000 7f57e6344b80 1 --2- 172.21.15.73:0/1096655331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b94f0 0x56005e0bd780 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f57c800baa0 tx=0x7f57c8015000 comp rx=0 tx=0).stop 2023-08-10T11:52:18.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.862+0000 7f57e6344b80 1 -- 172.21.15.73:0/1096655331 shutdown_connections 2023-08-10T11:52:18.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.862+0000 7f57e6344b80 1 --2- 172.21.15.73:0/1096655331 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56005e0ba910 0x56005e0c2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.862+0000 7f57e6344b80 1 --2- 172.21.15.73:0/1096655331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b94f0 0x56005e0bd780 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.862+0000 7f57e6344b80 1 --2- 172.21.15.73:0/1096655331 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005e0b9e50 0x56005e0bdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.862+0000 7f57e6344b80 1 -- 172.21.15.73:0/1096655331 >> 172.21.15.73:0/1096655331 conn(0x56005e016c80 msgr2=0x56005e0c0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.862+0000 7f57e6344b80 1 -- 172.21.15.73:0/1096655331 shutdown_connections 2023-08-10T11:52:18.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.862+0000 7f57e6344b80 1 -- 172.21.15.73:0/1096655331 wait complete. 2023-08-10T11:52:18.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.862+0000 7f57e6344b80 1 -- start start 2023-08-10T11:52:18.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.862+0000 7f57e6344b80 1 Processor -- start 2023-08-10T11:52:18.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.863+0000 7f57e6344b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b94f0 0x56005e0c5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.863+0000 7f57e6344b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005e0b9e50 0x56005e0c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.863+0000 7f57e6344b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56005e0ba910 0x56005e125a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.863+0000 7f57e6344b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005e125f50 con 0x56005e0b94f0 2023-08-10T11:52:18.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.863+0000 7f57e6344b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005e126090 con 0x56005e0ba910 2023-08-10T11:52:18.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.863+0000 7f57e6344b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005e126220 con 0x56005e0b9e50 2023-08-10T11:52:18.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.863+0000 7f57e6344b80 10 client.0 _ll_register_callbacks cb 0x56005dfa7630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:52:18.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.863+0000 7f57d37fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b94f0 0x56005e0c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.863+0000 7f57d37fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b94f0 0x56005e0c5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60390/0 (socket says 172.21.15.73:60390) 2023-08-10T11:52:18.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.863+0000 7f57d37fe700 1 -- 172.21.15.73:0/442263886 learned_addr learned my addr 172.21.15.73:0/442263886 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:18.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.863+0000 7f57d2ffd700 1 --2- 172.21.15.73:0/442263886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005e0b9e50 0x56005e0c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.863+0000 7f57d3fff700 1 --2- 172.21.15.73:0/442263886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56005e0ba910 0x56005e125a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.863+0000 7f57d37fe700 1 -- 172.21.15.73:0/442263886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005e0b9e50 msgr2=0x56005e0c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.863+0000 7f57d37fe700 1 --2- 172.21.15.73:0/442263886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005e0b9e50 0x56005e0c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.863+0000 7f57d37fe700 1 -- 172.21.15.73:0/442263886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56005e0ba910 msgr2=0x56005e125a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:18.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.863+0000 7f57d37fe700 1 --2- 172.21.15.73:0/442263886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56005e0ba910 0x56005e125a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.863+0000 7f57d37fe700 1 -- 172.21.15.73:0/442263886 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c800fd50 con 0x56005e0b94f0 2023-08-10T11:52:18.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.863+0000 7f57d2ffd700 1 --2- 172.21.15.73:0/442263886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005e0b9e50 0x56005e0c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:52:18.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.863+0000 7f57d37fe700 1 --2- 172.21.15.73:0/442263886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b94f0 0x56005e0c5060 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f57c8014040 tx=0x7f57c8011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b01712bab55af14 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:18.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.863+0000 7f57b2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:52:18.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.863+0000 7f57b2ffd700 1 -- 172.21.15.73:0/442263886 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c8035070 con 0x56005e0b94f0 2023-08-10T11:52:18.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.863+0000 7f57b2ffd700 1 -- 172.21.15.73:0/442263886 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f57c8011650 con 0x56005e0b94f0 2023-08-10T11:52:18.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.863+0000 7f57e6344b80 1 -- 172.21.15.73:0/442263886 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56005e003730 con 0x56005e0b94f0 2023-08-10T11:52:18.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.863+0000 7f57b2ffd700 1 -- 172.21.15.73:0/442263886 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57c8011810 con 0x56005e0b94f0 2023-08-10T11:52:18.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.863+0000 7f57e6344b80 10 client.15309 fetch_fsmap learned FSMap version 27 2023-08-10T11:52:18.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.863+0000 7f57e6344b80 1 -- 172.21.15.73:0/442263886 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56005de20c10 con 0x56005e0b94f0 2023-08-10T11:52:18.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.864+0000 7f57b2ffd700 1 -- 172.21.15.73:0/442263886 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f57c8040020 con 0x56005e0b94f0 2023-08-10T11:52:18.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.864+0000 7f57b2ffd700 1 -- 172.21.15.73:0/442263886 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f57c8038020 con 0x56005e0b94f0 2023-08-10T11:52:18.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.864+0000 7f57e6344b80 10 client.15309 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:52:18.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.864+0000 7f57e6344b80 10 client.15309 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-10T11:52:18.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.864+0000 7f57e6344b80 20 client.15309 populate_metadata read hostname 'smithi073' 2023-08-10T11:52:18.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.864+0000 7f57e6344b80 1 --2- 172.21.15.73:0/442263886 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56005e12afa0 0x56005e127970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:18.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.864+0000 7f57e6344b80 4 client.15309 mds_command: new command op to 24503 tid=0[{"prefix": "status"}] 2023-08-10T11:52:18.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.864+0000 7f57e6344b80 1 -- 172.21.15.73:0/442263886 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56005dfc5000 con 0x56005e12afa0 2023-08-10T11:52:18.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.864+0000 7f57d2ffd700 1 --2- 172.21.15.73:0/442263886 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56005e12afa0 0x56005e127970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:18.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.864+0000 7f57b2ffd700 10 client.15309 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:52:18.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.864+0000 7f57d2ffd700 1 --2- 172.21.15.73:0/442263886 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56005e12afa0 0x56005e127970 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c26fd1e5ecbe74c5 server_cookie=92126f5c2852a5f8 in_seq=0 out_seq=0 2023-08-10T11:52:18.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.865+0000 7f57b2ffd700 1 -- 172.21.15.73:0/442263886 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x56005dfc5000 con 0x56005e12afa0 2023-08-10T11:52:18.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.865+0000 7f57b2ffd700 10 client.15309 handle_command_reply: tid=0 2023-08-10T11:52:18.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.865+0000 7f57e6344b80 1 client.15309 shutdown 2023-08-10T11:52:18.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.865+0000 7f57e6344b80 1 -- 172.21.15.73:0/442263886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b94f0 msgr2=0x56005e0c5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.865+0000 7f57e6344b80 1 --2- 172.21.15.73:0/442263886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b94f0 0x56005e0c5060 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f57c8014040 tx=0x7f57c8011c40 comp rx=0 tx=0).stop 2023-08-10T11:52:18.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.865+0000 7f57e6344b80 1 -- 172.21.15.73:0/442263886 shutdown_connections 2023-08-10T11:52:18.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.865+0000 7f57e6344b80 1 --2- 172.21.15.73:0/442263886 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56005e12afa0 0x56005e127970 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.865+0000 7f57e6344b80 1 --2- 172.21.15.73:0/442263886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56005e0ba910 0x56005e125a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.865+0000 7f57e6344b80 1 --2- 172.21.15.73:0/442263886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56005e0b94f0 0x56005e0c5060 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.865+0000 7f57e6344b80 1 --2- 172.21.15.73:0/442263886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005e0b9e50 0x56005e0c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.865+0000 7f57b2ffd700 0 client.15309 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:52:18.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.865+0000 7f57e6344b80 1 -- 172.21.15.73:0/442263886 >> 172.21.15.73:0/442263886 conn(0x56005e016c80 msgr2=0x56005e0c0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.865+0000 7f57e6344b80 1 -- 172.21.15.73:0/442263886 shutdown_connections 2023-08-10T11:52:18.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.865+0000 7f57e6344b80 1 -- 172.21.15.73:0/442263886 wait complete. 2023-08-10T11:52:18.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.865+0000 7f57e6344b80 20 client.15309 trim_cache size 0 max 16384 2023-08-10T11:52:18.886 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:52:18.886 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "0e619a74-3773-11ee-9b37-001a4aab830c", 2023-08-10T11:52:18.886 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2023-08-10T11:52:18.886 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 24503, 2023-08-10T11:52:18.886 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2023-08-10T11:52:18.886 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2023-08-10T11:52:18.887 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2023-08-10T11:52:18.887 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 83.961329321999997, 2023-08-10T11:52:18.887 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 27, 2023-08-10T11:52:18.887 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 85, 2023-08-10T11:52:18.887 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 83, 2023-08-10T11:52:18.887 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 89.181611373999999 2023-08-10T11:52:18.887 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:52:18.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.865+0000 7f57da1ab700 1 -- 172.21.15.73:0/3211436031 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f57bc0a11e0 msgr2=0x7f57bc0a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.865+0000 7f57da1ab700 1 --2- 172.21.15.73:0/3211436031 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f57bc0a11e0 0x7f57bc0a36a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f57c8005950 tx=0x7f57c80058e0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.865+0000 7f57da1ab700 1 -- 172.21.15.73:0/3211436031 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57d4101970 msgr2=0x7f57d4196980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:18.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.865+0000 7f57da1ab700 1 --2- 172.21.15.73:0/3211436031 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57d4101970 0x7f57d4196980 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f57c4009990 tx=0x7f57c4004730 comp rx=0 tx=0).stop 2023-08-10T11:52:18.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.866+0000 7f57da1ab700 1 -- 172.21.15.73:0/3211436031 shutdown_connections 2023-08-10T11:52:18.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.866+0000 7f57da1ab700 1 --2- 172.21.15.73:0/3211436031 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f57bc0a11e0 0x7f57bc0a36a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.866+0000 7f57da1ab700 1 --2- 172.21.15.73:0/3211436031 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57d4100780 0x7f57d4196440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.866+0000 7f57da1ab700 1 --2- 172.21.15.73:0/3211436031 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57d4102310 0x7f57d419d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.866+0000 7f57da1ab700 1 --2- 172.21.15.73:0/3211436031 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57d4101970 0x7f57d4196980 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:18.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.866+0000 7f57da1ab700 1 -- 172.21.15.73:0/3211436031 >> 172.21.15.73:0/3211436031 conn(0x7f57d40fbcf0 msgr2=0x7f57d40fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:18.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.866+0000 7f57da1ab700 1 -- 172.21.15.73:0/3211436031 shutdown_connections 2023-08-10T11:52:18.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:18.866+0000 7f57da1ab700 1 -- 172.21.15.73:0/3211436031 wait complete. 2023-08-10T11:52:18.890 INFO:teuthology.run_tasks:Running task kclient... 2023-08-10T11:52:18.915 INFO:tasks.kclient:Mounting kernel clients... 2023-08-10T11:52:18.916 INFO:tasks.kclient:config is {'client.0': {}} 2023-08-10T11:52:18.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T11:52:18.917 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-08-10T11:52:18.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T11:52:18.934 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2023-08-10T11:52:18.997 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:18 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2829325830' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:52:19.003 INFO:teuthology.orchestra.run.smithi073.stderr:Cannot find device "ceph-brx" 2023-08-10T11:52:19.004 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T11:52:19.005 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'nowsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2023-08-10T11:52:19.005 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-10T11:52:19.005 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-10T11:52:19.006 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph fs ls 2023-08-10T11:52:19.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:18 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/2829325830' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:52:19.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:18 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/2829325830' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:52:19.595 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:52:20.220 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:19 smithi073 ceph-mon[128869]: pgmap v300: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T11:52:20.220 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:19 smithi073 ceph-mon[128869]: mgrmap e18: x(active, since 7m), standbys: z, y 2023-08-10T11:52:20.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:19 smithi152 ceph-mon[130220]: pgmap v300: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T11:52:20.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:19 smithi152 ceph-mon[130220]: mgrmap e18: x(active, since 7m), standbys: z, y 2023-08-10T11:52:20.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:19 smithi156 ceph-mon[130574]: pgmap v300: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T11:52:20.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:19 smithi156 ceph-mon[130574]: mgrmap e18: x(active, since 7m), standbys: z, y 2023-08-10T11:52:21.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.016+0000 7f8989fd7700 1 -- 172.21.15.73:0/2991342723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8984100070 msgr2=0x7f898410c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:21.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.016+0000 7f8989fd7700 1 --2- 172.21.15.73:0/2991342723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8984100070 0x7f898410c510 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f897c00b0a0 tx=0x7f897c00b3b0 comp rx=0 tx=0).stop 2023-08-10T11:52:21.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.016+0000 7f8989fd7700 1 -- 172.21.15.73:0/2991342723 shutdown_connections 2023-08-10T11:52:21.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.016+0000 7f8989fd7700 1 --2- 172.21.15.73:0/2991342723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8984100070 0x7f898410c510 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:21.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.016+0000 7f8989fd7700 1 --2- 172.21.15.73:0/2991342723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8984104580 0x7f8984104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.016+0000 7f8989fd7700 1 --2- 172.21.15.73:0/2991342723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89840ff6b0 0x7f89840ffb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.016+0000 7f8989fd7700 1 -- 172.21.15.73:0/2991342723 >> 172.21.15.73:0/2991342723 conn(0x7f8984076770 msgr2=0x7f8984076b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.016+0000 7f8989fd7700 1 -- 172.21.15.73:0/2991342723 shutdown_connections 2023-08-10T11:52:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.016+0000 7f8989fd7700 1 -- 172.21.15.73:0/2991342723 wait complete. 2023-08-10T11:52:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.017+0000 7f8989fd7700 1 Processor -- start 2023-08-10T11:52:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.017+0000 7f8989fd7700 1 -- start start 2023-08-10T11:52:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.017+0000 7f8989fd7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89840ff6b0 0x7f8984101230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:21.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.017+0000 7f8989fd7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8984100070 0x7f8984101770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:21.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.017+0000 7f8989fd7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8984104580 0x7f8984101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:21.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.017+0000 7f8989fd7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89841a4eb0 con 0x7f8984104580 2023-08-10T11:52:21.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.017+0000 7f8989fd7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89841a5020 con 0x7f89840ff6b0 2023-08-10T11:52:21.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.017+0000 7f8989fd7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89841a51e0 con 0x7f8984100070 2023-08-10T11:52:21.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.017+0000 7f8983fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8984104580 0x7f8984101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:21.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.017+0000 7f8983fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8984104580 0x7f8984101cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60406/0 (socket says 172.21.15.73:60406) 2023-08-10T11:52:21.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.017+0000 7f8983fff700 1 -- 172.21.15.73:0/3691407951 learned_addr learned my addr 172.21.15.73:0/3691407951 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:21.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.017+0000 7f89837fe700 1 --2- 172.21.15.73:0/3691407951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89840ff6b0 0x7f8984101230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:21.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.018+0000 7f8983fff700 1 -- 172.21.15.73:0/3691407951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8984100070 msgr2=0x7f8984101770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:21.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.018+0000 7f8982ffd700 1 --2- 172.21.15.73:0/3691407951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8984100070 0x7f8984101770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:21.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.018+0000 7f8983fff700 1 --2- 172.21.15.73:0/3691407951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8984100070 0x7f8984101770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:21.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.018+0000 7f8983fff700 1 -- 172.21.15.73:0/3691407951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89840ff6b0 msgr2=0x7f8984101230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:21.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.018+0000 7f8983fff700 1 --2- 172.21.15.73:0/3691407951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89840ff6b0 0x7f8984101230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:21.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.018+0000 7f8983fff700 1 -- 172.21.15.73:0/3691407951 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897c009d00 con 0x7f8984104580 2023-08-10T11:52:21.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.018+0000 7f8982ffd700 1 --2- 172.21.15.73:0/3691407951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8984100070 0x7f8984101770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:52:21.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.018+0000 7f89837fe700 1 --2- 172.21.15.73:0/3691407951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89840ff6b0 0x7f8984101230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:52:21.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.018+0000 7f8983fff700 1 --2- 172.21.15.73:0/3691407951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8984104580 0x7f8984101cf0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f897c00b070 tx=0x7f897c004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:21.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.018+0000 7f8980ff9700 1 -- 172.21.15.73:0/3691407951 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c00e040 con 0x7f8984104580 2023-08-10T11:52:21.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.018+0000 7f8980ff9700 1 -- 172.21.15.73:0/3691407951 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f897c01db50 con 0x7f8984104580 2023-08-10T11:52:21.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.018+0000 7f8989fd7700 1 -- 172.21.15.73:0/3691407951 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89841a5460 con 0x7f8984104580 2023-08-10T11:52:21.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.018+0000 7f8980ff9700 1 -- 172.21.15.73:0/3691407951 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c01bc30 con 0x7f8984104580 2023-08-10T11:52:21.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.018+0000 7f8989fd7700 1 -- 172.21.15.73:0/3691407951 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89841a5960 con 0x7f8984104580 2023-08-10T11:52:21.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.019+0000 7f8989fd7700 1 -- 172.21.15.73:0/3691407951 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f898404e470 con 0x7f8984104580 2023-08-10T11:52:21.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.021+0000 7f8980ff9700 1 -- 172.21.15.73:0/3691407951 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f897c01dcc0 con 0x7f8984104580 2023-08-10T11:52:21.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.021+0000 7f8980ff9700 1 --2- 172.21.15.73:0/3691407951 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f896c0a1150 0x7f896c0a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:21.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.021+0000 7f89837fe700 1 --2- 172.21.15.73:0/3691407951 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f896c0a1150 0x7f896c0a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:21.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.021+0000 7f8980ff9700 1 -- 172.21.15.73:0/3691407951 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f897c0ceb90 con 0x7f8984104580 2023-08-10T11:52:21.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.022+0000 7f89837fe700 1 --2- 172.21.15.73:0/3691407951 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f896c0a1150 0x7f896c0a3610 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8978005fd0 tx=0x7f8978005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:21.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.024+0000 7f8980ff9700 1 -- 172.21.15.73:0/3691407951 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f897c098440 con 0x7f8984104580 2023-08-10T11:52:21.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.250+0000 7f8989fd7700 1 -- 172.21.15.73:0/3691407951 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f89841a5b80 con 0x7f8984104580 2023-08-10T11:52:21.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.251+0000 7f8980ff9700 1 -- 172.21.15.73:0/3691407951 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+73 (secure 0 0 0) 0x7f897c021060 con 0x7f8984104580 2023-08-10T11:52:21.253 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-10T11:52:21.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.253+0000 7f8989fd7700 1 -- 172.21.15.73:0/3691407951 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f896c0a1150 msgr2=0x7f896c0a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:21.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.253+0000 7f8989fd7700 1 --2- 172.21.15.73:0/3691407951 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f896c0a1150 0x7f896c0a3610 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8978005fd0 tx=0x7f8978005e30 comp rx=0 tx=0).stop 2023-08-10T11:52:21.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.253+0000 7f8989fd7700 1 -- 172.21.15.73:0/3691407951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8984104580 msgr2=0x7f8984101cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:21.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.253+0000 7f8989fd7700 1 --2- 172.21.15.73:0/3691407951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8984104580 0x7f8984101cf0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f897c00b070 tx=0x7f897c004d30 comp rx=0 tx=0).stop 2023-08-10T11:52:21.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.253+0000 7f8989fd7700 1 -- 172.21.15.73:0/3691407951 shutdown_connections 2023-08-10T11:52:21.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.253+0000 7f8989fd7700 1 --2- 172.21.15.73:0/3691407951 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f896c0a1150 0x7f896c0a3610 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:21.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.253+0000 7f8989fd7700 1 --2- 172.21.15.73:0/3691407951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89840ff6b0 0x7f8984101230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:21.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.253+0000 7f8989fd7700 1 --2- 172.21.15.73:0/3691407951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8984104580 0x7f8984101cf0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:21.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.253+0000 7f8989fd7700 1 --2- 172.21.15.73:0/3691407951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8984100070 0x7f8984101770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:21.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.253+0000 7f8989fd7700 1 -- 172.21.15.73:0/3691407951 >> 172.21.15.73:0/3691407951 conn(0x7f8984076770 msgr2=0x7f8984068290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:21.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.253+0000 7f8989fd7700 1 -- 172.21.15.73:0/3691407951 shutdown_connections 2023-08-10T11:52:21.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:21.253+0000 7f8989fd7700 1 -- 172.21.15.73:0/3691407951 wait complete. 2023-08-10T11:52:21.739 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-10T11:52:21.739 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T11:52:21.740 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2023-08-10T11:52:21.740 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-10T11:52:21.740 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-10T11:52:21.740 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-10T11:52:21.740 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-10T11:52:21.741 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T11:52:21.741 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-10T11:52:21.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T11:52:21.742 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2023-08-10T11:52:21.759 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T11:52:21.760 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T11:52:21.760 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T11:52:21.760 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-08-10T11:52:21.760 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2023-08-10T11:52:21.760 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-08-10T11:52:21.760 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T11:52:21.761 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2023-08-10T11:52:21.761 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T11:52:21.761 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2023-08-10T11:52:21.761 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T11:52:21.761 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2023-08-10T11:52:21.761 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T11:52:21.761 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2023-08-10T11:52:21.762 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-10T11:52:21.762 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 41001sec preferred_lft 41001sec 2023-08-10T11:52:21.762 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c422:4ecc:c537:3a4c/64 scope link noprefixroute 2023-08-10T11:52:21.762 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-08-10T11:52:21.762 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-10T11:52:21.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T11:52:21.763 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-08-10T11:52:21.763 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-08-10T11:52:21.764 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add name ceph-brx type bridge 2023-08-10T11:52:21.764 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr flush dev ceph-brx 2023-08-10T11:52:21.764 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set ceph-brx up 2023-08-10T11:52:21.764 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-10T11:52:21.764 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-08-10T11:52:21.901 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:21 smithi073 ceph-mon[128869]: pgmap v301: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 11 op/s 2023-08-10T11:52:21.902 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:21 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3691407951' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-08-10T11:52:21.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T11:52:21.942 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T11:52:21.969 INFO:teuthology.orchestra.run.smithi073.stdout:1 2023-08-10T11:52:21.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T11:52:21.971 DEBUG:teuthology.orchestra.run.smithi073:> route 2023-08-10T11:52:22.041 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2023-08-10T11:52:22.041 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T11:52:22.042 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-10T11:52:22.042 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-10T11:52:22.042 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T11:52:22.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T11:52:22.043 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-08-10T11:52:22.043 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-08-10T11:52:22.043 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-10T11:52:22.043 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-10T11:52:22.043 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-10T11:52:22.044 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-08-10T11:52:22.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:21 smithi152 ceph-mon[130220]: pgmap v301: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 11 op/s 2023-08-10T11:52:22.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:21 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3691407951' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-08-10T11:52:22.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:21 smithi156 ceph-mon[130574]: pgmap v301: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 11 op/s 2023-08-10T11:52:22.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:21 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3691407951' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-08-10T11:52:22.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T11:52:22.330 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-08-10T11:52:22.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T11:52:22.348 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2023-08-10T11:52:22.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T11:52:22.405 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-08-10T11:52:22.406 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-08-10T11:52:22.406 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-10T11:52:22.407 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-08-10T11:52:22.407 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-08-10T11:52:22.499 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-08-10T11:52:22.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T11:52:22.500 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-08-10T11:52:22.500 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-08-10T11:52:22.500 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-08-10T11:52:22.501 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-10T11:52:22.501 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-08-10T11:52:22.501 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-08-10T11:52:22.501 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-08-10T11:52:22.502 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-08-10T11:52:22.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T11:52:22.717 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-08-10T11:52:22.718 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-08-10T11:52:22.718 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2023-08-10T11:52:22.718 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.0 master ceph-brx 2023-08-10T11:52:22.718 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-08-10T11:52:22.815 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T11:52:22.815 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-10T11:52:22.832 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-10T11:52:22.832 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T11:52:22.833 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-10T11:52:22.890 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2023-08-10T11:52:22.891 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2023-08-10T11:52:22.891 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8 2023-08-10T11:52:22.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T11:52:22.892 DEBUG:teuthology.orchestra.run.smithi073:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2023-08-10T11:52:22.985 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2023-08-10T11:52:22.986 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync". 2023-08-10T11:52:22.986 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2023-08-10T11:52:23.127 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2023-08-10T11:52:23.128 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync". 2023-08-10T11:52:23.128 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2023-08-10T11:52:23.128 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.152:3300,172.21.15.156:3300" 2023-08-10T11:52:23.128 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.73:3300,172.21.15.152:3300,172.21.15.156:3300:/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8 2023-08-10T11:52:23.128 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,key=0,fsid=0e619a74-3773-11ee-9b37-001a4aab830c" will pass to kernel 2023-08-10T11:52:23.131 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T11:52:23.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T11:52:23.131 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-10T11:52:23.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T11:52:23.160 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T11:52:23.232 INFO:teuthology.orchestra.run.smithi073.stdout:client15318 2023-08-10T11:52:23.232 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-08-10T11:52:23.233 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T11:52:23.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T11:52:23.290 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T11:52:23.362 INFO:teuthology.orchestra.run.smithi073.stdout:client15318 2023-08-10T11:52:23.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T11:52:23.363 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T11:52:23.434 INFO:teuthology.orchestra.run.smithi073.stdout:client15318 2023-08-10T11:52:23.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T11:52:23.435 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/0e619a74-3773-11ee-9b37-001a4aab830c.client15318/status') 2023-08-10T11:52:23.515 INFO:teuthology.orchestra.run.smithi073.stdout:instance: client.15318 (3)192.168.0.1:0/2837499992 2023-08-10T11:52:23.515 INFO:teuthology.orchestra.run.smithi073.stdout:blocklisted: false 2023-08-10T11:52:23.516 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records in 2023-08-10T11:52:23.516 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records out 2023-08-10T11:52:23.516 INFO:teuthology.orchestra.run.smithi073.stderr:70 bytes copied, 2.2996e-05 s, 3.0 MB/s 2023-08-10T11:52:23.517 INFO:teuthology.run_tasks:Running task check-counter... 2023-08-10T11:52:23.528 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-08-10T11:52:23.538 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T11:52:23.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.678+0000 7f5073bdc700 1 -- 172.21.15.73:0/1471693359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f506c101210 msgr2=0x7f506c107ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:23.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.678+0000 7f5073bdc700 1 --2- 172.21.15.73:0/1471693359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f506c101210 0x7f506c107ac0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f506400b0d0 tx=0x7f506400b3e0 comp rx=0 tx=0).stop 2023-08-10T11:52:23.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.678+0000 7f5073bdc700 1 -- 172.21.15.73:0/1471693359 shutdown_connections 2023-08-10T11:52:23.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.678+0000 7f5073bdc700 1 --2- 172.21.15.73:0/1471693359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f506c101210 0x7f506c107ac0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:23.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.678+0000 7f5073bdc700 1 --2- 172.21.15.73:0/1471693359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f506c0ff680 0x7f506c0ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:23.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.678+0000 7f5073bdc700 1 --2- 172.21.15.73:0/1471693359 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f506c100870 0x7f506c100cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:23.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.678+0000 7f5073bdc700 1 -- 172.21.15.73:0/1471693359 >> 172.21.15.73:0/1471693359 conn(0x7f506c0fabf0 msgr2=0x7f506c0fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:23.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.678+0000 7f5073bdc700 1 -- 172.21.15.73:0/1471693359 shutdown_connections 2023-08-10T11:52:23.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.678+0000 7f5073bdc700 1 -- 172.21.15.73:0/1471693359 wait complete. 2023-08-10T11:52:23.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.679+0000 7f5073bdc700 1 Processor -- start 2023-08-10T11:52:23.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.679+0000 7f5073bdc700 1 -- start start 2023-08-10T11:52:23.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.679+0000 7f5073bdc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f506c0ff680 0x7f506c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.679+0000 7f5073bdc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f506c100870 0x7f506c19b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.679+0000 7f5073bdc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f506c101210 0x7f506c19d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.679+0000 7f5073bdc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c19dfe0 con 0x7f506c100870 2023-08-10T11:52:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.679+0000 7f5073bdc700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c19e150 con 0x7f506c0ff680 2023-08-10T11:52:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.679+0000 7f5073bdc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c19e310 con 0x7f506c101210 2023-08-10T11:52:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.679+0000 7f5071177700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f506c100870 0x7f506c19b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.679+0000 7f5071177700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f506c100870 0x7f506c19b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60436/0 (socket says 172.21.15.73:60436) 2023-08-10T11:52:23.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.679+0000 7f5071177700 1 -- 172.21.15.73:0/356168273 learned_addr learned my addr 172.21.15.73:0/356168273 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:23.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.679+0000 7f5071978700 1 --2- 172.21.15.73:0/356168273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f506c0ff680 0x7f506c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:23.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.679+0000 7f5072179700 1 --2- 172.21.15.73:0/356168273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f506c101210 0x7f506c19d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:23.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.679+0000 7f5071177700 1 -- 172.21.15.73:0/356168273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f506c101210 msgr2=0x7f506c19d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:23.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.679+0000 7f5071177700 1 --2- 172.21.15.73:0/356168273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f506c101210 0x7f506c19d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:23.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.679+0000 7f5071177700 1 -- 172.21.15.73:0/356168273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f506c0ff680 msgr2=0x7f506c069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:23.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.679+0000 7f5071177700 1 --2- 172.21.15.73:0/356168273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f506c0ff680 0x7f506c069450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:23.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.679+0000 7f5071177700 1 -- 172.21.15.73:0/356168273 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5064009d00 con 0x7f506c100870 2023-08-10T11:52:23.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.679+0000 7f5071978700 1 --2- 172.21.15.73:0/356168273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f506c0ff680 0x7f506c069450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:52:23.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.679+0000 7f5072179700 1 --2- 172.21.15.73:0/356168273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f506c101210 0x7f506c19d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:52:23.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.680+0000 7f5071177700 1 --2- 172.21.15.73:0/356168273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f506c100870 0x7f506c19b1c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f506800c9b0 tx=0x7f506800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:23.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.680+0000 7f5062ffd700 1 -- 172.21.15.73:0/356168273 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068007b00 con 0x7f506c100870 2023-08-10T11:52:23.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.680+0000 7f5062ffd700 1 -- 172.21.15.73:0/356168273 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5068007c60 con 0x7f506c100870 2023-08-10T11:52:23.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.680+0000 7f5073bdc700 1 -- 172.21.15.73:0/356168273 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f506c19e5f0 con 0x7f506c100870 2023-08-10T11:52:23.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.680+0000 7f5062ffd700 1 -- 172.21.15.73:0/356168273 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068018660 con 0x7f506c100870 2023-08-10T11:52:23.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.680+0000 7f5073bdc700 1 -- 172.21.15.73:0/356168273 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f506c19eb00 con 0x7f506c100870 2023-08-10T11:52:23.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.681+0000 7f5073bdc700 1 -- 172.21.15.73:0/356168273 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f506c106ae0 con 0x7f506c100870 2023-08-10T11:52:23.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.682+0000 7f5062ffd700 1 -- 172.21.15.73:0/356168273 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f5068018880 con 0x7f506c100870 2023-08-10T11:52:23.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.683+0000 7f5062ffd700 1 --2- 172.21.15.73:0/356168273 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f50580a11a0 0x7f50580a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:23.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.683+0000 7f5062ffd700 1 -- 172.21.15.73:0/356168273 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f50680ccbb0 con 0x7f506c100870 2023-08-10T11:52:23.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.683+0000 7f5071978700 1 --2- 172.21.15.73:0/356168273 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f50580a11a0 0x7f50580a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:23.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.683+0000 7f5071978700 1 --2- 172.21.15.73:0/356168273 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f50580a11a0 0x7f50580a3660 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f506c1006d0 tx=0x7f505c00b670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:23.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.686+0000 7f5062ffd700 1 -- 172.21.15.73:0/356168273 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f50680963a0 con 0x7f506c100870 2023-08-10T11:52:23.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.876+0000 7f5073bdc700 1 -- 172.21.15.73:0/356168273 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f506c02c970 con 0x7f506c100870 2023-08-10T11:52:23.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.877+0000 7f5062ffd700 1 -- 172.21.15.73:0/356168273 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22482 (secure 0 0 0) 0x7f50680999c0 con 0x7f506c100870 2023-08-10T11:52:23.878 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:52:23.879 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":85,"fsid":"0e619a74-3773-11ee-9b37-001a4aab830c","created":"2023-08-10T11:43:53.974768+0000","modified":"2023-08-10T11:51:49.637159+0000","last_up_change":"2023-08-10T11:50:12.914422+0000","last_in_change":"2023-08-10T11:49:54.624543+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T11:46:58.735153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T11:50:52.517974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T11:50:53.465357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3219ae18-cc4c-4712-b616-79f6949066e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6803","nonce":2725694252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6805","nonce":2725694252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6809","nonce":2725694252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6807","nonce":2725694252}]},"public_addr":"172.21.15.73:6803/2725694252","cluster_addr":"172.21.15.73:6805/2725694252","heartbeat_back_addr":"172.21.15.73:6809/2725694252","heartbeat_front_addr":"172.21.15.73:6807/2725694252","state":["exists","up"]},{"osd":1,"uuid":"bbfe6cd9-b3d3-4b8d-8814-507a867f8c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6801","nonce":836829168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6803","nonce":836829168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6807","nonce":836829168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6805","nonce":836829168}]},"public_addr":"172.21.15.152:6801/836829168","cluster_addr":"172.21.15.152:6803/836829168","heartbeat_back_addr":"172.21.15.152:6807/836829168","heartbeat_front_addr":"172.21.15.152:6805/836829168","state":["exists","up"]},{"osd":2,"uuid":"f57f5b2c-3208-45c0-beba-8501694b99c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6801","nonce":1789212298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6803","nonce":1789212298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6807","nonce":1789212298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6805","nonce":1789212298}]},"public_addr":"172.21.15.156:6801/1789212298","cluster_addr":"172.21.15.156:6803/1789212298","heartbeat_back_addr":"172.21.15.156:6807/1789212298","heartbeat_front_addr":"172.21.15.156:6805/1789212298","state":["exists","up"]},{"osd":3,"uuid":"18592408-3696-4ab8-ad41-c172b8409829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6811","nonce":3101572649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6813","nonce":3101572649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6817","nonce":3101572649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6815","nonce":3101572649}]},"public_addr":"172.21.15.73:6811/3101572649","cluster_addr":"172.21.15.73:6813/3101572649","heartbeat_back_addr":"172.21.15.73:6817/3101572649","heartbeat_front_addr":"172.21.15.73:6815/3101572649","state":["exists","up"]},{"osd":4,"uuid":"fb3adb09-8807-42d9-8db9-1867c5fe02da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6809","nonce":1451517889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6811","nonce":1451517889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6815","nonce":1451517889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6813","nonce":1451517889}]},"public_addr":"172.21.15.152:6809/1451517889","cluster_addr":"172.21.15.152:6811/1451517889","heartbeat_back_addr":"172.21.15.152:6815/1451517889","heartbeat_front_addr":"172.21.15.152:6813/1451517889","state":["exists","up"]},{"osd":5,"uuid":"af58a7bd-4e58-4639-95b2-4a76011b61dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6809","nonce":3823368741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6811","nonce":3823368741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6815","nonce":3823368741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6813","nonce":3823368741}]},"public_addr":"172.21.15.156:6809/3823368741","cluster_addr":"172.21.15.156:6811/3823368741","heartbeat_back_addr":"172.21.15.156:6815/3823368741","heartbeat_front_addr":"172.21.15.156:6813/3823368741","state":["exists","up"]},{"osd":6,"uuid":"f6ae502d-4af9-4f6a-8636-b5b683dfdfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6819","nonce":2533620458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6821","nonce":2533620458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6825","nonce":2533620458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6823","nonce":2533620458}]},"public_addr":"172.21.15.73:6819/2533620458","cluster_addr":"172.21.15.73:6821/2533620458","heartbeat_back_addr":"172.21.15.73:6825/2533620458","heartbeat_front_addr":"172.21.15.73:6823/2533620458","state":["exists","up"]},{"osd":7,"uuid":"398fd334-5f6f-427c-95ae-3244fb466f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6817","nonce":4059538477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6819","nonce":4059538477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6823","nonce":4059538477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6821","nonce":4059538477}]},"public_addr":"172.21.15.152:6817/4059538477","cluster_addr":"172.21.15.152:6819/4059538477","heartbeat_back_addr":"172.21.15.152:6823/4059538477","heartbeat_front_addr":"172.21.15.152:6821/4059538477","state":["exists","up"]},{"osd":8,"uuid":"58f46e64-2624-4ad4-bb6a-225624153837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6817","nonce":96487555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6819","nonce":96487555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6823","nonce":96487555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6821","nonce":96487555}]},"public_addr":"172.21.15.156:6817/96487555","cluster_addr":"172.21.15.156:6819/96487555","heartbeat_back_addr":"172.21.15.156:6823/96487555","heartbeat_front_addr":"172.21.15.156:6821/96487555","state":["exists","up"]},{"osd":9,"uuid":"9389dd5b-da2d-43b6-8bc0-bb1af13f72c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6827","nonce":2050124321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6829","nonce":2050124321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6833","nonce":2050124321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6831","nonce":2050124321}]},"public_addr":"172.21.15.73:6827/2050124321","cluster_addr":"172.21.15.73:6829/2050124321","heartbeat_back_addr":"172.21.15.73:6833/2050124321","heartbeat_front_addr":"172.21.15.73:6831/2050124321","state":["exists","up"]},{"osd":10,"uuid":"563c1e34-3acd-46ab-ba36-e9d87f635e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6825","nonce":1513186350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6827","nonce":1513186350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6831","nonce":1513186350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6829","nonce":1513186350}]},"public_addr":"172.21.15.152:6825/1513186350","cluster_addr":"172.21.15.152:6827/1513186350","heartbeat_back_addr":"172.21.15.152:6831/1513186350","heartbeat_front_addr":"172.21.15.152:6829/1513186350","state":["exists","up"]},{"osd":11,"uuid":"f1b55889-14fd-4cc9-bed7-43748086fb77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6825","nonce":737904755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6827","nonce":737904755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6831","nonce":737904755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6829","nonce":737904755}]},"public_addr":"172.21.15.156:6825/737904755","cluster_addr":"172.21.15.156:6827/737904755","heartbeat_back_addr":"172.21.15.156:6831/737904755","heartbeat_front_addr":"172.21.15.156:6829/737904755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:12.023797+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:33.872883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:55.856970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:18.013196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:39.202872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:00.393920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:22.743083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:43.921728+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:05.859488+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:27.618714+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:48.880286+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:50:11.055141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/2202785670":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6800/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:6800/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/1447381524":"2023-08-11T11:44:48.401660+0000","172.21.15.73:0/2545059698":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/4193457623":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2561039569":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2927950081":"2023-08-11T11:44:48.401660+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T11:52:23.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.879+0000 7f5073bdc700 1 -- 172.21.15.73:0/356168273 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f50580a11a0 msgr2=0x7f50580a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:23.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.879+0000 7f5073bdc700 1 --2- 172.21.15.73:0/356168273 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f50580a11a0 0x7f50580a3660 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f506c1006d0 tx=0x7f505c00b670 comp rx=0 tx=0).stop 2023-08-10T11:52:23.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.879+0000 7f5073bdc700 1 -- 172.21.15.73:0/356168273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f506c100870 msgr2=0x7f506c19b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:23.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.879+0000 7f5073bdc700 1 --2- 172.21.15.73:0/356168273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f506c100870 0x7f506c19b1c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f506800c9b0 tx=0x7f506800cd70 comp rx=0 tx=0).stop 2023-08-10T11:52:23.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.879+0000 7f5073bdc700 1 -- 172.21.15.73:0/356168273 shutdown_connections 2023-08-10T11:52:23.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.879+0000 7f5073bdc700 1 --2- 172.21.15.73:0/356168273 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f50580a11a0 0x7f50580a3660 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:23.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.879+0000 7f5073bdc700 1 --2- 172.21.15.73:0/356168273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f506c0ff680 0x7f506c069450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:23.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.879+0000 7f5073bdc700 1 --2- 172.21.15.73:0/356168273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f506c101210 0x7f506c19d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:23.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.879+0000 7f5073bdc700 1 --2- 172.21.15.73:0/356168273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f506c100870 0x7f506c19b1c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:23.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.879+0000 7f5073bdc700 1 -- 172.21.15.73:0/356168273 >> 172.21.15.73:0/356168273 conn(0x7f506c0fabf0 msgr2=0x7f506c103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:23.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.880+0000 7f5073bdc700 1 -- 172.21.15.73:0/356168273 shutdown_connections 2023-08-10T11:52:23.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:23.880+0000 7f5073bdc700 1 -- 172.21.15.73:0/356168273 wait complete. 2023-08-10T11:52:23.893 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T11:46:58.735153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T11:50:52.517974+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T11:50:53.465357+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T11:52:23.893 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T11:52:24.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.017+0000 7f31e86dc700 1 -- 172.21.15.73:0/4209859043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31e00ff660 msgr2=0x7f31e00ffa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:24.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.017+0000 7f31e86dc700 1 --2- 172.21.15.73:0/4209859043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31e00ff660 0x7f31e00ffa80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f31dc0099c0 tx=0x7f31dc009cd0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.017+0000 7f31e86dc700 1 -- 172.21.15.73:0/4209859043 shutdown_connections 2023-08-10T11:52:24.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.017+0000 7f31e86dc700 1 --2- 172.21.15.73:0/4209859043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31e01011f0 0x7f31e0107aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.017+0000 7f31e86dc700 1 --2- 172.21.15.73:0/4209859043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31e00ff660 0x7f31e00ffa80 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.017+0000 7f31e86dc700 1 --2- 172.21.15.73:0/4209859043 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31e0100850 0x7f31e0100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.017+0000 7f31e86dc700 1 -- 172.21.15.73:0/4209859043 >> 172.21.15.73:0/4209859043 conn(0x7f31e00fabd0 msgr2=0x7f31e00fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:24.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.017+0000 7f31e86dc700 1 -- 172.21.15.73:0/4209859043 shutdown_connections 2023-08-10T11:52:24.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.017+0000 7f31e86dc700 1 -- 172.21.15.73:0/4209859043 wait complete. 2023-08-10T11:52:24.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.018+0000 7f31e86dc700 1 Processor -- start 2023-08-10T11:52:24.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.018+0000 7f31e86dc700 1 -- start start 2023-08-10T11:52:24.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.018+0000 7f31e86dc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31e00ff660 0x7f31e0069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:24.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.018+0000 7f31e86dc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31e0100850 0x7f31e019b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:24.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.018+0000 7f31e86dc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31e01011f0 0x7f31e019d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:24.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.018+0000 7f31e86dc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e019df60 con 0x7f31e0100850 2023-08-10T11:52:24.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.018+0000 7f31e86dc700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e019e0d0 con 0x7f31e00ff660 2023-08-10T11:52:24.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.018+0000 7f31e86dc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e019e290 con 0x7f31e01011f0 2023-08-10T11:52:24.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.018+0000 7f31e5c77700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31e0100850 0x7f31e019b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:24.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.018+0000 7f31e5c77700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31e0100850 0x7f31e019b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60450/0 (socket says 172.21.15.73:60450) 2023-08-10T11:52:24.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.018+0000 7f31e5c77700 1 -- 172.21.15.73:0/1083143199 learned_addr learned my addr 172.21.15.73:0/1083143199 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:24.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.018+0000 7f31e6478700 1 --2- 172.21.15.73:0/1083143199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31e00ff660 0x7f31e0069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:24.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.018+0000 7f31e6c79700 1 --2- 172.21.15.73:0/1083143199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31e01011f0 0x7f31e019d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:24.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.018+0000 7f31e5c77700 1 -- 172.21.15.73:0/1083143199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31e01011f0 msgr2=0x7f31e019d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:24.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.018+0000 7f31e5c77700 1 --2- 172.21.15.73:0/1083143199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31e01011f0 0x7f31e019d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.018+0000 7f31e5c77700 1 -- 172.21.15.73:0/1083143199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31e00ff660 msgr2=0x7f31e0069470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:24.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.018+0000 7f31e5c77700 1 --2- 172.21.15.73:0/1083143199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31e00ff660 0x7f31e0069470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.018+0000 7f31e5c77700 1 -- 172.21.15.73:0/1083143199 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31dc0095f0 con 0x7f31e0100850 2023-08-10T11:52:24.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.019+0000 7f31e5c77700 1 --2- 172.21.15.73:0/1083143199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31e0100850 0x7f31e019b180 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f31d000e9a0 tx=0x7f31d000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:24.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.019+0000 7f31d77fe700 1 -- 172.21.15.73:0/1083143199 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d0009790 con 0x7f31e0100850 2023-08-10T11:52:24.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.019+0000 7f31e86dc700 1 -- 172.21.15.73:0/1083143199 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e019e570 con 0x7f31e0100850 2023-08-10T11:52:24.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.019+0000 7f31d77fe700 1 -- 172.21.15.73:0/1083143199 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31d000cbd0 con 0x7f31e0100850 2023-08-10T11:52:24.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.019+0000 7f31d77fe700 1 -- 172.21.15.73:0/1083143199 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d0018680 con 0x7f31e0100850 2023-08-10T11:52:24.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.019+0000 7f31e86dc700 1 -- 172.21.15.73:0/1083143199 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e019ea80 con 0x7f31e0100850 2023-08-10T11:52:24.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.020+0000 7f31e86dc700 1 -- 172.21.15.73:0/1083143199 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e010ae80 con 0x7f31e0100850 2023-08-10T11:52:24.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.021+0000 7f31d77fe700 1 -- 172.21.15.73:0/1083143199 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f31d000cd40 con 0x7f31e0100850 2023-08-10T11:52:24.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.021+0000 7f31d77fe700 1 --2- 172.21.15.73:0/1083143199 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f31cc0a1150 0x7f31cc0a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:24.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.021+0000 7f31e6478700 1 --2- 172.21.15.73:0/1083143199 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f31cc0a1150 0x7f31cc0a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:24.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.021+0000 7f31d77fe700 1 -- 172.21.15.73:0/1083143199 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f31d0014070 con 0x7f31e0100850 2023-08-10T11:52:24.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.022+0000 7f31e6478700 1 --2- 172.21.15.73:0/1083143199 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f31cc0a1150 0x7f31cc0a3610 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f31dc009fd0 tx=0x7f31dc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:24.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.025+0000 7f31d77fe700 1 -- 172.21.15.73:0/1083143199 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f31d0096850 con 0x7f31e0100850 2023-08-10T11:52:24.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.211+0000 7f31e86dc700 1 -- 172.21.15.73:0/1083143199 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f31e0106560 con 0x7f31e0100850 2023-08-10T11:52:24.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.211+0000 7f31d77fe700 1 -- 172.21.15.73:0/1083143199 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f31d0099e70 con 0x7f31e0100850 2023-08-10T11:52:24.212 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-08-10T11:52:24.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.213+0000 7f31e86dc700 1 -- 172.21.15.73:0/1083143199 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f31cc0a1150 msgr2=0x7f31cc0a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:24.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.213+0000 7f31e86dc700 1 --2- 172.21.15.73:0/1083143199 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f31cc0a1150 0x7f31cc0a3610 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f31dc009fd0 tx=0x7f31dc01a040 comp rx=0 tx=0).stop 2023-08-10T11:52:24.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.213+0000 7f31e86dc700 1 -- 172.21.15.73:0/1083143199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31e0100850 msgr2=0x7f31e019b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:24.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.213+0000 7f31e86dc700 1 --2- 172.21.15.73:0/1083143199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31e0100850 0x7f31e019b180 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f31d000e9a0 tx=0x7f31d000ed60 comp rx=0 tx=0).stop 2023-08-10T11:52:24.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.213+0000 7f31e86dc700 1 -- 172.21.15.73:0/1083143199 shutdown_connections 2023-08-10T11:52:24.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.213+0000 7f31e86dc700 1 --2- 172.21.15.73:0/1083143199 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f31cc0a1150 0x7f31cc0a3610 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.213+0000 7f31e86dc700 1 --2- 172.21.15.73:0/1083143199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31e00ff660 0x7f31e0069470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.213+0000 7f31e86dc700 1 --2- 172.21.15.73:0/1083143199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31e01011f0 0x7f31e019d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.213+0000 7f31e86dc700 1 --2- 172.21.15.73:0/1083143199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31e0100850 0x7f31e019b180 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.213+0000 7f31e86dc700 1 -- 172.21.15.73:0/1083143199 >> 172.21.15.73:0/1083143199 conn(0x7f31e00fabd0 msgr2=0x7f31e00fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:24.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.213+0000 7f31e86dc700 1 -- 172.21.15.73:0/1083143199 shutdown_connections 2023-08-10T11:52:24.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.213+0000 7f31e86dc700 1 -- 172.21.15.73:0/1083143199 wait complete. 2023-08-10T11:52:24.225 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:23 smithi073 ceph-mon[128869]: pgmap v302: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 10 op/s 2023-08-10T11:52:24.225 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:23 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/356168273' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:52:24.226 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T11:52:24.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:23 smithi152 ceph-mon[130220]: pgmap v302: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 10 op/s 2023-08-10T11:52:24.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:23 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/356168273' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:52:24.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:23 smithi156 ceph-mon[130574]: pgmap v302: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 10 op/s 2023-08-10T11:52:24.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:23 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/356168273' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:52:24.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.350+0000 7f84a0da0700 1 -- 172.21.15.73:0/585693751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f849c0ff690 msgr2=0x7f849c0ffab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:24.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.350+0000 7f84a0da0700 1 --2- 172.21.15.73:0/585693751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f849c0ff690 0x7f849c0ffab0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f84900099c0 tx=0x7f8490009cd0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.350+0000 7f84a0da0700 1 -- 172.21.15.73:0/585693751 shutdown_connections 2023-08-10T11:52:24.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.350+0000 7f84a0da0700 1 --2- 172.21.15.73:0/585693751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f849c101220 0x7f849c107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.350+0000 7f84a0da0700 1 --2- 172.21.15.73:0/585693751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f849c0ff690 0x7f849c0ffab0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.350+0000 7f84a0da0700 1 --2- 172.21.15.73:0/585693751 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f849c100880 0x7f849c100ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.350+0000 7f84a0da0700 1 -- 172.21.15.73:0/585693751 >> 172.21.15.73:0/585693751 conn(0x7f849c0fac00 msgr2=0x7f849c0fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:24.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.350+0000 7f84a0da0700 1 -- 172.21.15.73:0/585693751 shutdown_connections 2023-08-10T11:52:24.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.350+0000 7f84a0da0700 1 -- 172.21.15.73:0/585693751 wait complete. 2023-08-10T11:52:24.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.351+0000 7f84a0da0700 1 Processor -- start 2023-08-10T11:52:24.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.351+0000 7f84a0da0700 1 -- start start 2023-08-10T11:52:24.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.351+0000 7f84a0da0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f849c0ff690 0x7f849c103620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:24.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.351+0000 7f84a0da0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f849c100880 0x7f849c101c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:24.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.351+0000 7f84a0da0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f849c101220 0x7f849c1021a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:24.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.351+0000 7f84a0da0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849c102940 con 0x7f849c100880 2023-08-10T11:52:24.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.351+0000 7f84a0da0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849c102ab0 con 0x7f849c101220 2023-08-10T11:52:24.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.351+0000 7f84a0da0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849c1a0540 con 0x7f849c0ff690 2023-08-10T11:52:24.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.351+0000 7f8499d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f849c100880 0x7f849c101c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:24.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.351+0000 7f8499d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f849c100880 0x7f849c101c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60464/0 (socket says 172.21.15.73:60464) 2023-08-10T11:52:24.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.351+0000 7f8499d9b700 1 -- 172.21.15.73:0/1308039553 learned_addr learned my addr 172.21.15.73:0/1308039553 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:24.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.351+0000 7f849ad9d700 1 --2- 172.21.15.73:0/1308039553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f849c101220 0x7f849c1021a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:24.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.351+0000 7f849a59c700 1 --2- 172.21.15.73:0/1308039553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f849c0ff690 0x7f849c103620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:24.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.351+0000 7f8499d9b700 1 -- 172.21.15.73:0/1308039553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f849c0ff690 msgr2=0x7f849c103620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:24.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.351+0000 7f8499d9b700 1 --2- 172.21.15.73:0/1308039553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f849c0ff690 0x7f849c103620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.351+0000 7f8499d9b700 1 -- 172.21.15.73:0/1308039553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f849c101220 msgr2=0x7f849c1021a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:24.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.351+0000 7f8499d9b700 1 --2- 172.21.15.73:0/1308039553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f849c101220 0x7f849c1021a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.351+0000 7f8499d9b700 1 -- 172.21.15.73:0/1308039553 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84900095f0 con 0x7f849c100880 2023-08-10T11:52:24.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.351+0000 7f849ad9d700 1 --2- 172.21.15.73:0/1308039553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f849c101220 0x7f849c1021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:52:24.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.351+0000 7f8499d9b700 1 --2- 172.21.15.73:0/1308039553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f849c100880 0x7f849c101c60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f848c00c920 tx=0x7f848c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:24.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.352+0000 7f848b7fe700 1 -- 172.21.15.73:0/1308039553 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c007b00 con 0x7f849c100880 2023-08-10T11:52:24.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.352+0000 7f848b7fe700 1 -- 172.21.15.73:0/1308039553 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f848c004cf0 con 0x7f849c100880 2023-08-10T11:52:24.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.352+0000 7f84a0da0700 1 -- 172.21.15.73:0/1308039553 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f849c1a0820 con 0x7f849c100880 2023-08-10T11:52:24.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.352+0000 7f848b7fe700 1 -- 172.21.15.73:0/1308039553 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c005610 con 0x7f849c100880 2023-08-10T11:52:24.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.352+0000 7f84a0da0700 1 -- 172.21.15.73:0/1308039553 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f849c1a0d80 con 0x7f849c100880 2023-08-10T11:52:24.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.353+0000 7f84a0da0700 1 -- 172.21.15.73:0/1308039553 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f849c10aef0 con 0x7f849c100880 2023-08-10T11:52:24.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.354+0000 7f848b7fe700 1 -- 172.21.15.73:0/1308039553 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f848c004750 con 0x7f849c100880 2023-08-10T11:52:24.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.355+0000 7f848b7fe700 1 --2- 172.21.15.73:0/1308039553 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f84840a11d0 0x7f84840a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:24.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.355+0000 7f849a59c700 1 --2- 172.21.15.73:0/1308039553 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f84840a11d0 0x7f84840a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:24.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.355+0000 7f848b7fe700 1 -- 172.21.15.73:0/1308039553 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f848c0cc870 con 0x7f849c100880 2023-08-10T11:52:24.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.355+0000 7f849a59c700 1 --2- 172.21.15.73:0/1308039553 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f84840a11d0 0x7f84840a3690 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f849000b580 tx=0x7f8490005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:24.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.358+0000 7f848b7fe700 1 -- 172.21.15.73:0/1308039553 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f848c096050 con 0x7f849c100880 2023-08-10T11:52:24.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.547+0000 7f84a0da0700 1 -- 172.21.15.73:0/1308039553 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f849c1a1420 con 0x7f849c100880 2023-08-10T11:52:24.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.547+0000 7f848b7fe700 1 -- 172.21.15.73:0/1308039553 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7f848c01d020 con 0x7f849c100880 2023-08-10T11:52:24.548 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-08-10T11:52:24.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.549+0000 7f84a0da0700 1 -- 172.21.15.73:0/1308039553 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f84840a11d0 msgr2=0x7f84840a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:24.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.549+0000 7f84a0da0700 1 --2- 172.21.15.73:0/1308039553 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f84840a11d0 0x7f84840a3690 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f849000b580 tx=0x7f8490005fb0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.549+0000 7f84a0da0700 1 -- 172.21.15.73:0/1308039553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f849c100880 msgr2=0x7f849c101c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:24.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.549+0000 7f84a0da0700 1 --2- 172.21.15.73:0/1308039553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f849c100880 0x7f849c101c60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f848c00c920 tx=0x7f848c00cce0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.549+0000 7f84a0da0700 1 -- 172.21.15.73:0/1308039553 shutdown_connections 2023-08-10T11:52:24.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.549+0000 7f84a0da0700 1 --2- 172.21.15.73:0/1308039553 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f84840a11d0 0x7f84840a3690 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.549+0000 7f84a0da0700 1 --2- 172.21.15.73:0/1308039553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f849c101220 0x7f849c1021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.549+0000 7f84a0da0700 1 --2- 172.21.15.73:0/1308039553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f849c0ff690 0x7f849c103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.549+0000 7f84a0da0700 1 --2- 172.21.15.73:0/1308039553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f849c100880 0x7f849c101c60 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.549+0000 7f84a0da0700 1 -- 172.21.15.73:0/1308039553 >> 172.21.15.73:0/1308039553 conn(0x7f849c0fac00 msgr2=0x7f849c068920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:24.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.549+0000 7f84a0da0700 1 -- 172.21.15.73:0/1308039553 shutdown_connections 2023-08-10T11:52:24.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.549+0000 7f84a0da0700 1 -- 172.21.15.73:0/1308039553 wait complete. 2023-08-10T11:52:24.562 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T11:52:24.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.686+0000 7f0e6d73a700 1 -- 172.21.15.73:0/3907918523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e68101260 msgr2=0x7f0e68107b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:24.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.686+0000 7f0e6d73a700 1 --2- 172.21.15.73:0/3907918523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e68101260 0x7f0e68107b10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0e6000b0d0 tx=0x7f0e6000b3e0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.686+0000 7f0e6d73a700 1 -- 172.21.15.73:0/3907918523 shutdown_connections 2023-08-10T11:52:24.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.686+0000 7f0e6d73a700 1 --2- 172.21.15.73:0/3907918523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e680ff6d0 0x7f0e680ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.686+0000 7f0e6d73a700 1 --2- 172.21.15.73:0/3907918523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e68101260 0x7f0e68107b10 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.686+0000 7f0e6d73a700 1 --2- 172.21.15.73:0/3907918523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e681008c0 0x7f0e68100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.686+0000 7f0e6d73a700 1 -- 172.21.15.73:0/3907918523 >> 172.21.15.73:0/3907918523 conn(0x7f0e680fac40 msgr2=0x7f0e680fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:24.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.686+0000 7f0e6d73a700 1 -- 172.21.15.73:0/3907918523 shutdown_connections 2023-08-10T11:52:24.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.686+0000 7f0e6d73a700 1 -- 172.21.15.73:0/3907918523 wait complete. 2023-08-10T11:52:24.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.687+0000 7f0e6d73a700 1 Processor -- start 2023-08-10T11:52:24.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.687+0000 7f0e6d73a700 1 -- start start 2023-08-10T11:52:24.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.688+0000 7f0e6d73a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e680ff6d0 0x7f0e68195450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:24.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.688+0000 7f0e6d73a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e681008c0 0x7f0e68195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:24.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.688+0000 7f0e6d73a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e68101260 0x7f0e6819ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:24.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.688+0000 7f0e6d73a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6819cfd0 con 0x7f0e680ff6d0 2023-08-10T11:52:24.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.688+0000 7f0e6d73a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6819d110 con 0x7f0e68101260 2023-08-10T11:52:24.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.688+0000 7f0e6d73a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6819d2a0 con 0x7f0e681008c0 2023-08-10T11:52:24.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.688+0000 7f0e66ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e680ff6d0 0x7f0e68195450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:24.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.688+0000 7f0e66ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e680ff6d0 0x7f0e68195450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60474/0 (socket says 172.21.15.73:60474) 2023-08-10T11:52:24.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.688+0000 7f0e66ffd700 1 -- 172.21.15.73:0/750059214 learned_addr learned my addr 172.21.15.73:0/750059214 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:24.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.688+0000 7f0e667fc700 1 --2- 172.21.15.73:0/750059214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e681008c0 0x7f0e68195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:24.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.688+0000 7f0e66ffd700 1 -- 172.21.15.73:0/750059214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e681008c0 msgr2=0x7f0e68195990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:24.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.688+0000 7f0e66ffd700 1 --2- 172.21.15.73:0/750059214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e681008c0 0x7f0e68195990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.688+0000 7f0e66ffd700 1 -- 172.21.15.73:0/750059214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e68101260 msgr2=0x7f0e6819ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:24.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.688+0000 7f0e66ffd700 1 --2- 172.21.15.73:0/750059214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e68101260 0x7f0e6819ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.688+0000 7f0e66ffd700 1 -- 172.21.15.73:0/750059214 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e60009d00 con 0x7f0e680ff6d0 2023-08-10T11:52:24.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.688+0000 7f0e66ffd700 1 --2- 172.21.15.73:0/750059214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e680ff6d0 0x7f0e68195450 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0e580098f0 tx=0x7f0e58009cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:24.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.688+0000 7f0e4ffff700 1 -- 172.21.15.73:0/750059214 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e58012070 con 0x7f0e680ff6d0 2023-08-10T11:52:24.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.688+0000 7f0e6d73a700 1 -- 172.21.15.73:0/750059214 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e68068b20 con 0x7f0e680ff6d0 2023-08-10T11:52:24.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.688+0000 7f0e4ffff700 1 -- 172.21.15.73:0/750059214 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e580044e0 con 0x7f0e680ff6d0 2023-08-10T11:52:24.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.688+0000 7f0e4ffff700 1 -- 172.21.15.73:0/750059214 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e58007d10 con 0x7f0e680ff6d0 2023-08-10T11:52:24.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.688+0000 7f0e6d73a700 1 -- 172.21.15.73:0/750059214 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e68069080 con 0x7f0e680ff6d0 2023-08-10T11:52:24.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.689+0000 7f0e6d73a700 1 -- 172.21.15.73:0/750059214 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e6810aed0 con 0x7f0e680ff6d0 2023-08-10T11:52:24.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.691+0000 7f0e4ffff700 1 -- 172.21.15.73:0/750059214 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f0e58016030 con 0x7f0e680ff6d0 2023-08-10T11:52:24.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.691+0000 7f0e4ffff700 1 --2- 172.21.15.73:0/750059214 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0e500a1150 0x7f0e500a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:24.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.691+0000 7f0e667fc700 1 --2- 172.21.15.73:0/750059214 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0e500a1150 0x7f0e500a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:24.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.691+0000 7f0e4ffff700 1 -- 172.21.15.73:0/750059214 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0e580cdfd0 con 0x7f0e680ff6d0 2023-08-10T11:52:24.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.692+0000 7f0e667fc700 1 --2- 172.21.15.73:0/750059214 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0e500a1150 0x7f0e500a3610 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c009bf0 tx=0x7f0e5c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:24.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.695+0000 7f0e4ffff700 1 -- 172.21.15.73:0/750059214 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0e58097730 con 0x7f0e680ff6d0 2023-08-10T11:52:24.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.883+0000 7f0e6d73a700 1 -- 172.21.15.73:0/750059214 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0e681069c0 con 0x7f0e680ff6d0 2023-08-10T11:52:24.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.883+0000 7f0e4ffff700 1 -- 172.21.15.73:0/750059214 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0e5809ad50 con 0x7f0e680ff6d0 2023-08-10T11:52:24.885 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-08-10T11:52:24.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.886+0000 7f0e6d73a700 1 -- 172.21.15.73:0/750059214 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0e500a1150 msgr2=0x7f0e500a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:24.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.886+0000 7f0e6d73a700 1 --2- 172.21.15.73:0/750059214 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0e500a1150 0x7f0e500a3610 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c009bf0 tx=0x7f0e5c009260 comp rx=0 tx=0).stop 2023-08-10T11:52:24.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.886+0000 7f0e6d73a700 1 -- 172.21.15.73:0/750059214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e680ff6d0 msgr2=0x7f0e68195450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:24.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.886+0000 7f0e6d73a700 1 --2- 172.21.15.73:0/750059214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e680ff6d0 0x7f0e68195450 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0e580098f0 tx=0x7f0e58009cb0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.886+0000 7f0e6d73a700 1 -- 172.21.15.73:0/750059214 shutdown_connections 2023-08-10T11:52:24.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.886+0000 7f0e6d73a700 1 --2- 172.21.15.73:0/750059214 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f0e500a1150 0x7f0e500a3610 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.886+0000 7f0e6d73a700 1 --2- 172.21.15.73:0/750059214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e68101260 0x7f0e6819ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.886+0000 7f0e6d73a700 1 --2- 172.21.15.73:0/750059214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e680ff6d0 0x7f0e68195450 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.886+0000 7f0e6d73a700 1 --2- 172.21.15.73:0/750059214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e681008c0 0x7f0e68195990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:24.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.886+0000 7f0e6d73a700 1 -- 172.21.15.73:0/750059214 >> 172.21.15.73:0/750059214 conn(0x7f0e680fac40 msgr2=0x7f0e68103d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:24.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.886+0000 7f0e6d73a700 1 -- 172.21.15.73:0/750059214 shutdown_connections 2023-08-10T11:52:24.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:24.886+0000 7f0e6d73a700 1 -- 172.21.15.73:0/750059214 wait complete. 2023-08-10T11:52:24.899 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T11:52:25.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.020+0000 7f6738e00700 1 -- 172.21.15.73:0/3206536093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67340fede0 msgr2=0x7f67340ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:25.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.020+0000 7f6738e00700 1 --2- 172.21.15.73:0/3206536093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67340fede0 0x7f67340ff200 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f67240099c0 tx=0x7f6724009cd0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.020+0000 7f6738e00700 1 -- 172.21.15.73:0/3206536093 shutdown_connections 2023-08-10T11:52:25.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.020+0000 7f6738e00700 1 --2- 172.21.15.73:0/3206536093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6734100970 0x7f6734107220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.020+0000 7f6738e00700 1 --2- 172.21.15.73:0/3206536093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67340fede0 0x7f67340ff200 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.020+0000 7f6738e00700 1 --2- 172.21.15.73:0/3206536093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67340fffd0 0x7f6734100430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.020+0000 7f6738e00700 1 -- 172.21.15.73:0/3206536093 >> 172.21.15.73:0/3206536093 conn(0x7f67340fa330 msgr2=0x7f67340fc790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:25.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.020+0000 7f6738e00700 1 -- 172.21.15.73:0/3206536093 shutdown_connections 2023-08-10T11:52:25.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.020+0000 7f6738e00700 1 -- 172.21.15.73:0/3206536093 wait complete. 2023-08-10T11:52:25.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.021+0000 7f6738e00700 1 Processor -- start 2023-08-10T11:52:25.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.021+0000 7f6738e00700 1 -- start start 2023-08-10T11:52:25.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.021+0000 7f6738e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67340fede0 0x7f6734198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:25.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.021+0000 7f6738e00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67340fffd0 0x7f6734198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:25.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.021+0000 7f6738e00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6734100970 0x7f673419fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:25.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.021+0000 7f6738e00700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67341a0110 con 0x7f67340fede0 2023-08-10T11:52:25.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.021+0000 7f6738e00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67341a0250 con 0x7f6734100970 2023-08-10T11:52:25.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.021+0000 7f6738e00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67341a03e0 con 0x7f67340fffd0 2023-08-10T11:52:25.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.021+0000 7f673259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67340fede0 0x7f6734198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:25.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.021+0000 7f673259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67340fede0 0x7f6734198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60488/0 (socket says 172.21.15.73:60488) 2023-08-10T11:52:25.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.021+0000 7f673259c700 1 -- 172.21.15.73:0/3037512676 learned_addr learned my addr 172.21.15.73:0/3037512676 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:25.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.022+0000 7f6731d9b700 1 --2- 172.21.15.73:0/3037512676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67340fffd0 0x7f6734198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:25.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.022+0000 7f6732d9d700 1 --2- 172.21.15.73:0/3037512676 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6734100970 0x7f673419fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:25.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.022+0000 7f673259c700 1 -- 172.21.15.73:0/3037512676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67340fffd0 msgr2=0x7f6734198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:25.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.022+0000 7f673259c700 1 --2- 172.21.15.73:0/3037512676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67340fffd0 0x7f6734198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.022+0000 7f673259c700 1 -- 172.21.15.73:0/3037512676 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6734100970 msgr2=0x7f673419fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:25.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.022+0000 7f673259c700 1 --2- 172.21.15.73:0/3037512676 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6734100970 0x7f673419fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.022+0000 7f673259c700 1 -- 172.21.15.73:0/3037512676 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67240095f0 con 0x7f67340fede0 2023-08-10T11:52:25.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.022+0000 7f673259c700 1 --2- 172.21.15.73:0/3037512676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67340fede0 0x7f6734198590 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6724009f50 tx=0x7f67240057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:25.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.022+0000 7f67237fe700 1 -- 172.21.15.73:0/3037512676 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672401d070 con 0x7f67340fede0 2023-08-10T11:52:25.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.022+0000 7f67237fe700 1 -- 172.21.15.73:0/3037512676 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6724004110 con 0x7f67340fede0 2023-08-10T11:52:25.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.022+0000 7f6738e00700 1 -- 172.21.15.73:0/3037512676 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67341a0660 con 0x7f67340fede0 2023-08-10T11:52:25.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.022+0000 7f67237fe700 1 -- 172.21.15.73:0/3037512676 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6724022dd0 con 0x7f67340fede0 2023-08-10T11:52:25.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.022+0000 7f6738e00700 1 -- 172.21.15.73:0/3037512676 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67341a0b10 con 0x7f67340fede0 2023-08-10T11:52:25.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.023+0000 7f6738e00700 1 -- 172.21.15.73:0/3037512676 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67341059b0 con 0x7f67340fede0 2023-08-10T11:52:25.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.024+0000 7f67237fe700 1 -- 172.21.15.73:0/3037512676 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f6724022500 con 0x7f67340fede0 2023-08-10T11:52:25.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.025+0000 7f67237fe700 1 --2- 172.21.15.73:0/3037512676 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f671c0a11a0 0x7f671c0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:25.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.025+0000 7f6731d9b700 1 --2- 172.21.15.73:0/3037512676 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f671c0a11a0 0x7f671c0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:25.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.025+0000 7f67237fe700 1 -- 172.21.15.73:0/3037512676 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f67240ce490 con 0x7f67340fede0 2023-08-10T11:52:25.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.025+0000 7f6731d9b700 1 --2- 172.21.15.73:0/3037512676 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f671c0a11a0 0x7f671c0a3660 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f672800bbd0 tx=0x7f672800b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:25.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.028+0000 7f67237fe700 1 -- 172.21.15.73:0/3037512676 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f6724097c20 con 0x7f67340fede0 2023-08-10T11:52:25.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.220+0000 7f6738e00700 1 -- 172.21.15.73:0/3037512676 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f673402c970 con 0x7f67340fede0 2023-08-10T11:52:25.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.222+0000 7f67237fe700 1 -- 172.21.15.73:0/3037512676 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22482 (secure 0 0 0) 0x7f672409b240 con 0x7f67340fede0 2023-08-10T11:52:25.223 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:52:25.223 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":85,"fsid":"0e619a74-3773-11ee-9b37-001a4aab830c","created":"2023-08-10T11:43:53.974768+0000","modified":"2023-08-10T11:51:49.637159+0000","last_up_change":"2023-08-10T11:50:12.914422+0000","last_in_change":"2023-08-10T11:49:54.624543+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T11:46:58.735153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T11:50:52.517974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T11:50:53.465357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3219ae18-cc4c-4712-b616-79f6949066e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6803","nonce":2725694252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6805","nonce":2725694252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6809","nonce":2725694252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6807","nonce":2725694252}]},"public_addr":"172.21.15.73:6803/2725694252","cluster_addr":"172.21.15.73:6805/2725694252","heartbeat_back_addr":"172.21.15.73:6809/2725694252","heartbeat_front_addr":"172.21.15.73:6807/2725694252","state":["exists","up"]},{"osd":1,"uuid":"bbfe6cd9-b3d3-4b8d-8814-507a867f8c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6801","nonce":836829168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6803","nonce":836829168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6807","nonce":836829168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6805","nonce":836829168}]},"public_addr":"172.21.15.152:6801/836829168","cluster_addr":"172.21.15.152:6803/836829168","heartbeat_back_addr":"172.21.15.152:6807/836829168","heartbeat_front_addr":"172.21.15.152:6805/836829168","state":["exists","up"]},{"osd":2,"uuid":"f57f5b2c-3208-45c0-beba-8501694b99c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6801","nonce":1789212298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6803","nonce":1789212298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6807","nonce":1789212298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6805","nonce":1789212298}]},"public_addr":"172.21.15.156:6801/1789212298","cluster_addr":"172.21.15.156:6803/1789212298","heartbeat_back_addr":"172.21.15.156:6807/1789212298","heartbeat_front_addr":"172.21.15.156:6805/1789212298","state":["exists","up"]},{"osd":3,"uuid":"18592408-3696-4ab8-ad41-c172b8409829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6811","nonce":3101572649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6813","nonce":3101572649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6817","nonce":3101572649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6815","nonce":3101572649}]},"public_addr":"172.21.15.73:6811/3101572649","cluster_addr":"172.21.15.73:6813/3101572649","heartbeat_back_addr":"172.21.15.73:6817/3101572649","heartbeat_front_addr":"172.21.15.73:6815/3101572649","state":["exists","up"]},{"osd":4,"uuid":"fb3adb09-8807-42d9-8db9-1867c5fe02da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6809","nonce":1451517889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6811","nonce":1451517889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6815","nonce":1451517889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6813","nonce":1451517889}]},"public_addr":"172.21.15.152:6809/1451517889","cluster_addr":"172.21.15.152:6811/1451517889","heartbeat_back_addr":"172.21.15.152:6815/1451517889","heartbeat_front_addr":"172.21.15.152:6813/1451517889","state":["exists","up"]},{"osd":5,"uuid":"af58a7bd-4e58-4639-95b2-4a76011b61dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6809","nonce":3823368741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6811","nonce":3823368741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6815","nonce":3823368741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6813","nonce":3823368741}]},"public_addr":"172.21.15.156:6809/3823368741","cluster_addr":"172.21.15.156:6811/3823368741","heartbeat_back_addr":"172.21.15.156:6815/3823368741","heartbeat_front_addr":"172.21.15.156:6813/3823368741","state":["exists","up"]},{"osd":6,"uuid":"f6ae502d-4af9-4f6a-8636-b5b683dfdfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6819","nonce":2533620458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6821","nonce":2533620458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6825","nonce":2533620458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6823","nonce":2533620458}]},"public_addr":"172.21.15.73:6819/2533620458","cluster_addr":"172.21.15.73:6821/2533620458","heartbeat_back_addr":"172.21.15.73:6825/2533620458","heartbeat_front_addr":"172.21.15.73:6823/2533620458","state":["exists","up"]},{"osd":7,"uuid":"398fd334-5f6f-427c-95ae-3244fb466f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6817","nonce":4059538477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6819","nonce":4059538477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6823","nonce":4059538477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6821","nonce":4059538477}]},"public_addr":"172.21.15.152:6817/4059538477","cluster_addr":"172.21.15.152:6819/4059538477","heartbeat_back_addr":"172.21.15.152:6823/4059538477","heartbeat_front_addr":"172.21.15.152:6821/4059538477","state":["exists","up"]},{"osd":8,"uuid":"58f46e64-2624-4ad4-bb6a-225624153837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6817","nonce":96487555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6819","nonce":96487555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6823","nonce":96487555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6821","nonce":96487555}]},"public_addr":"172.21.15.156:6817/96487555","cluster_addr":"172.21.15.156:6819/96487555","heartbeat_back_addr":"172.21.15.156:6823/96487555","heartbeat_front_addr":"172.21.15.156:6821/96487555","state":["exists","up"]},{"osd":9,"uuid":"9389dd5b-da2d-43b6-8bc0-bb1af13f72c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6827","nonce":2050124321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6829","nonce":2050124321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6833","nonce":2050124321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6831","nonce":2050124321}]},"public_addr":"172.21.15.73:6827/2050124321","cluster_addr":"172.21.15.73:6829/2050124321","heartbeat_back_addr":"172.21.15.73:6833/2050124321","heartbeat_front_addr":"172.21.15.73:6831/2050124321","state":["exists","up"]},{"osd":10,"uuid":"563c1e34-3acd-46ab-ba36-e9d87f635e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6825","nonce":1513186350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6827","nonce":1513186350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6831","nonce":1513186350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6829","nonce":1513186350}]},"public_addr":"172.21.15.152:6825/1513186350","cluster_addr":"172.21.15.152:6827/1513186350","heartbeat_back_addr":"172.21.15.152:6831/1513186350","heartbeat_front_addr":"172.21.15.152:6829/1513186350","state":["exists","up"]},{"osd":11,"uuid":"f1b55889-14fd-4cc9-bed7-43748086fb77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6825","nonce":737904755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6827","nonce":737904755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6831","nonce":737904755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6829","nonce":737904755}]},"public_addr":"172.21.15.156:6825/737904755","cluster_addr":"172.21.15.156:6827/737904755","heartbeat_back_addr":"172.21.15.156:6831/737904755","heartbeat_front_addr":"172.21.15.156:6829/737904755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:12.023797+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:33.872883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:55.856970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:18.013196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:39.202872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:00.393920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:22.743083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:43.921728+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:05.859488+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:27.618714+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:48.880286+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:50:11.055141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/2202785670":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6800/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:6800/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/1447381524":"2023-08-11T11:44:48.401660+0000","172.21.15.73:0/2545059698":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/4193457623":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2561039569":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2927950081":"2023-08-11T11:44:48.401660+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T11:52:25.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.224+0000 7f6738e00700 1 -- 172.21.15.73:0/3037512676 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f671c0a11a0 msgr2=0x7f671c0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:25.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.224+0000 7f6738e00700 1 --2- 172.21.15.73:0/3037512676 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f671c0a11a0 0x7f671c0a3660 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f672800bbd0 tx=0x7f672800b5b0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.224+0000 7f6738e00700 1 -- 172.21.15.73:0/3037512676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67340fede0 msgr2=0x7f6734198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:25.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.224+0000 7f6738e00700 1 --2- 172.21.15.73:0/3037512676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67340fede0 0x7f6734198590 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6724009f50 tx=0x7f67240057d0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.224+0000 7f6738e00700 1 -- 172.21.15.73:0/3037512676 shutdown_connections 2023-08-10T11:52:25.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.224+0000 7f6738e00700 1 --2- 172.21.15.73:0/3037512676 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f671c0a11a0 0x7f671c0a3660 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.224+0000 7f6738e00700 1 --2- 172.21.15.73:0/3037512676 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6734100970 0x7f673419fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.224+0000 7f6738e00700 1 --2- 172.21.15.73:0/3037512676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67340fede0 0x7f6734198590 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.224+0000 7f6738e00700 1 --2- 172.21.15.73:0/3037512676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67340fffd0 0x7f6734198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.224+0000 7f6738e00700 1 -- 172.21.15.73:0/3037512676 >> 172.21.15.73:0/3037512676 conn(0x7f67340fa330 msgr2=0x7f67340fc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:25.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.224+0000 7f6738e00700 1 -- 172.21.15.73:0/3037512676 shutdown_connections 2023-08-10T11:52:25.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.224+0000 7f6738e00700 1 -- 172.21.15.73:0/3037512676 wait complete. 2023-08-10T11:52:25.236 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:24 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1083143199' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:52:25.236 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:24 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1308039553' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:52:25.236 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:24 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/750059214' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:52:25.237 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T11:46:58.735153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T11:50:52.517974+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T11:50:53.465357+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T11:52:25.238 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T11:52:25.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:24 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1083143199' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:52:25.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:24 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1308039553' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:52:25.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:24 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/750059214' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:52:25.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:24 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1083143199' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:52:25.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:24 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1308039553' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:52:25.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:24 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/750059214' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:52:25.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.361+0000 7f484d73c700 1 -- 172.21.15.73:0/346908120 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4848100890 msgr2=0x7f4848100cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:25.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.361+0000 7f484d73c700 1 --2- 172.21.15.73:0/346908120 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4848100890 0x7f4848100cf0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f483c0099c0 tx=0x7f483c009cd0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.362+0000 7f484d73c700 1 -- 172.21.15.73:0/346908120 shutdown_connections 2023-08-10T11:52:25.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.362+0000 7f484d73c700 1 --2- 172.21.15.73:0/346908120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48480ff6a0 0x7f48480ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.362+0000 7f484d73c700 1 --2- 172.21.15.73:0/346908120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4848101230 0x7f4848107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.362+0000 7f484d73c700 1 --2- 172.21.15.73:0/346908120 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4848100890 0x7f4848100cf0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.362+0000 7f484d73c700 1 -- 172.21.15.73:0/346908120 >> 172.21.15.73:0/346908120 conn(0x7f48480fabf0 msgr2=0x7f48480fd050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:25.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.362+0000 7f484d73c700 1 -- 172.21.15.73:0/346908120 shutdown_connections 2023-08-10T11:52:25.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.362+0000 7f484d73c700 1 -- 172.21.15.73:0/346908120 wait complete. 2023-08-10T11:52:25.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.362+0000 7f484d73c700 1 Processor -- start 2023-08-10T11:52:25.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.362+0000 7f484d73c700 1 -- start start 2023-08-10T11:52:25.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.362+0000 7f484d73c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48480ff6a0 0x7f4848198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:25.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.362+0000 7f484d73c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4848100890 0x7f4848198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:25.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.362+0000 7f484d73c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4848101230 0x7f484819fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:25.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.362+0000 7f484d73c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48481a01c0 con 0x7f48480ff6a0 2023-08-10T11:52:25.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.362+0000 7f484d73c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48481a0300 con 0x7f4848101230 2023-08-10T11:52:25.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.362+0000 7f484d73c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48481a0490 con 0x7f4848100890 2023-08-10T11:52:25.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.363+0000 7f4846ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48480ff6a0 0x7f4848198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:25.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.363+0000 7f4846ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48480ff6a0 0x7f4848198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60502/0 (socket says 172.21.15.73:60502) 2023-08-10T11:52:25.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.363+0000 7f4846ffd700 1 -- 172.21.15.73:0/490957785 learned_addr learned my addr 172.21.15.73:0/490957785 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:25.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.363+0000 7f48467fc700 1 --2- 172.21.15.73:0/490957785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4848100890 0x7f4848198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:25.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.363+0000 7f4846ffd700 1 -- 172.21.15.73:0/490957785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4848100890 msgr2=0x7f4848198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:25.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.363+0000 7f4846ffd700 1 --2- 172.21.15.73:0/490957785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4848100890 0x7f4848198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.363+0000 7f4846ffd700 1 -- 172.21.15.73:0/490957785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4848101230 msgr2=0x7f484819fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:25.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.363+0000 7f4846ffd700 1 --2- 172.21.15.73:0/490957785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4848101230 0x7f484819fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.363+0000 7f4846ffd700 1 -- 172.21.15.73:0/490957785 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483c0095f0 con 0x7f48480ff6a0 2023-08-10T11:52:25.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.363+0000 7f4846ffd700 1 --2- 172.21.15.73:0/490957785 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48480ff6a0 0x7f4848198640 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f483800d980 tx=0x7f483800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:25.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.363+0000 7f482ffff700 1 -- 172.21.15.73:0/490957785 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483800b950 con 0x7f48480ff6a0 2023-08-10T11:52:25.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.363+0000 7f484d73c700 1 -- 172.21.15.73:0/490957785 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48481a0770 con 0x7f48480ff6a0 2023-08-10T11:52:25.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.363+0000 7f482ffff700 1 -- 172.21.15.73:0/490957785 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4838007620 con 0x7f48480ff6a0 2023-08-10T11:52:25.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.363+0000 7f482ffff700 1 -- 172.21.15.73:0/490957785 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483800f3c0 con 0x7f48480ff6a0 2023-08-10T11:52:25.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.363+0000 7f484d73c700 1 -- 172.21.15.73:0/490957785 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48481a0cd0 con 0x7f48480ff6a0 2023-08-10T11:52:25.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.364+0000 7f484d73c700 1 -- 172.21.15.73:0/490957785 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4848106be0 con 0x7f48480ff6a0 2023-08-10T11:52:25.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.365+0000 7f482ffff700 1 -- 172.21.15.73:0/490957785 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f4838010640 con 0x7f48480ff6a0 2023-08-10T11:52:25.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.366+0000 7f482ffff700 1 --2- 172.21.15.73:0/490957785 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f48300a1130 0x7f48300a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:25.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.366+0000 7f48467fc700 1 --2- 172.21.15.73:0/490957785 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f48300a1130 0x7f48300a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:25.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.366+0000 7f482ffff700 1 -- 172.21.15.73:0/490957785 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f48380ccfb0 con 0x7f48480ff6a0 2023-08-10T11:52:25.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.366+0000 7f48467fc700 1 --2- 172.21.15.73:0/490957785 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f48300a1130 0x7f48300a35f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f483c00b580 tx=0x7f483c005bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:25.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.369+0000 7f482ffff700 1 -- 172.21.15.73:0/490957785 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f48380967b0 con 0x7f48480ff6a0 2023-08-10T11:52:25.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.557+0000 7f484d73c700 1 -- 172.21.15.73:0/490957785 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f484802cc20 con 0x7f48480ff6a0 2023-08-10T11:52:25.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.558+0000 7f482ffff700 1 -- 172.21.15.73:0/490957785 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f483800ee60 con 0x7f48480ff6a0 2023-08-10T11:52:25.559 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-08-10T11:52:25.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.560+0000 7f484d73c700 1 -- 172.21.15.73:0/490957785 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f48300a1130 msgr2=0x7f48300a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:25.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.560+0000 7f484d73c700 1 --2- 172.21.15.73:0/490957785 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f48300a1130 0x7f48300a35f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f483c00b580 tx=0x7f483c005bc0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.560+0000 7f484d73c700 1 -- 172.21.15.73:0/490957785 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48480ff6a0 msgr2=0x7f4848198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:25.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.560+0000 7f484d73c700 1 --2- 172.21.15.73:0/490957785 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48480ff6a0 0x7f4848198640 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f483800d980 tx=0x7f483800dc90 comp rx=0 tx=0).stop 2023-08-10T11:52:25.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.560+0000 7f484d73c700 1 -- 172.21.15.73:0/490957785 shutdown_connections 2023-08-10T11:52:25.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.560+0000 7f484d73c700 1 --2- 172.21.15.73:0/490957785 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f48300a1130 0x7f48300a35f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.560+0000 7f484d73c700 1 --2- 172.21.15.73:0/490957785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4848101230 0x7f484819fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.560+0000 7f484d73c700 1 --2- 172.21.15.73:0/490957785 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48480ff6a0 0x7f4848198640 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.560+0000 7f484d73c700 1 --2- 172.21.15.73:0/490957785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4848100890 0x7f4848198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.560+0000 7f484d73c700 1 -- 172.21.15.73:0/490957785 >> 172.21.15.73:0/490957785 conn(0x7f48480fabf0 msgr2=0x7f4848103d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:25.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.560+0000 7f484d73c700 1 -- 172.21.15.73:0/490957785 shutdown_connections 2023-08-10T11:52:25.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.560+0000 7f484d73c700 1 -- 172.21.15.73:0/490957785 wait complete. 2023-08-10T11:52:25.573 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T11:52:25.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.697+0000 7fa635408700 1 -- 172.21.15.73:0/1631577110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6300ff6a0 msgr2=0x7fa6300ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:25.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.697+0000 7fa635408700 1 --2- 172.21.15.73:0/1631577110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6300ff6a0 0x7fa6300ffac0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa62000b0d0 tx=0x7fa62000b3e0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.697+0000 7fa635408700 1 -- 172.21.15.73:0/1631577110 shutdown_connections 2023-08-10T11:52:25.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.697+0000 7fa635408700 1 --2- 172.21.15.73:0/1631577110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa630101230 0x7fa630107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.697+0000 7fa635408700 1 --2- 172.21.15.73:0/1631577110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6300ff6a0 0x7fa6300ffac0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.697+0000 7fa635408700 1 --2- 172.21.15.73:0/1631577110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa630100890 0x7fa630100cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.697+0000 7fa635408700 1 -- 172.21.15.73:0/1631577110 >> 172.21.15.73:0/1631577110 conn(0x7fa6300fabf0 msgr2=0x7fa6300fd050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:25.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.697+0000 7fa635408700 1 -- 172.21.15.73:0/1631577110 shutdown_connections 2023-08-10T11:52:25.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.697+0000 7fa635408700 1 -- 172.21.15.73:0/1631577110 wait complete. 2023-08-10T11:52:25.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.698+0000 7fa635408700 1 Processor -- start 2023-08-10T11:52:25.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.698+0000 7fa635408700 1 -- start start 2023-08-10T11:52:25.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.698+0000 7fa635408700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6300ff6a0 0x7fa6301954e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:25.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.698+0000 7fa635408700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa630100890 0x7fa630195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:25.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.698+0000 7fa635408700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa630101230 0x7fa63019ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:25.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.698+0000 7fa635408700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63019d060 con 0x7fa630100890 2023-08-10T11:52:25.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.698+0000 7fa635408700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63019d1a0 con 0x7fa6300ff6a0 2023-08-10T11:52:25.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.699+0000 7fa635408700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63019d330 con 0x7fa630101230 2023-08-10T11:52:25.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.699+0000 7fa62e7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa630100890 0x7fa630195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:25.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.699+0000 7fa62e7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa630100890 0x7fa630195a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60518/0 (socket says 172.21.15.73:60518) 2023-08-10T11:52:25.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.699+0000 7fa62e7fc700 1 -- 172.21.15.73:0/663822974 learned_addr learned my addr 172.21.15.73:0/663822974 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:25.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.699+0000 7fa62effd700 1 --2- 172.21.15.73:0/663822974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6300ff6a0 0x7fa6301954e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:25.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.699+0000 7fa62f7fe700 1 --2- 172.21.15.73:0/663822974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa630101230 0x7fa63019ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:25.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.699+0000 7fa62e7fc700 1 -- 172.21.15.73:0/663822974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa630101230 msgr2=0x7fa63019ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:25.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.699+0000 7fa62e7fc700 1 --2- 172.21.15.73:0/663822974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa630101230 0x7fa63019ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.699+0000 7fa62e7fc700 1 -- 172.21.15.73:0/663822974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6300ff6a0 msgr2=0x7fa6301954e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:25.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.699+0000 7fa62e7fc700 1 --2- 172.21.15.73:0/663822974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6300ff6a0 0x7fa6301954e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.699+0000 7fa62e7fc700 1 -- 172.21.15.73:0/663822974 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa620009d00 con 0x7fa630100890 2023-08-10T11:52:25.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.699+0000 7fa62e7fc700 1 --2- 172.21.15.73:0/663822974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa630100890 0x7fa630195a20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa61800d950 tx=0x7fa61800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:25.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.699+0000 7fa627fff700 1 -- 172.21.15.73:0/663822974 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa618009940 con 0x7fa630100890 2023-08-10T11:52:25.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.699+0000 7fa635408700 1 -- 172.21.15.73:0/663822974 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63019d610 con 0x7fa630100890 2023-08-10T11:52:25.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.699+0000 7fa627fff700 1 -- 172.21.15.73:0/663822974 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa618010460 con 0x7fa630100890 2023-08-10T11:52:25.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.699+0000 7fa627fff700 1 -- 172.21.15.73:0/663822974 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61800f620 con 0x7fa630100890 2023-08-10T11:52:25.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.699+0000 7fa635408700 1 -- 172.21.15.73:0/663822974 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63019db20 con 0x7fa630100890 2023-08-10T11:52:25.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.700+0000 7fa635408700 1 -- 172.21.15.73:0/663822974 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa630106c60 con 0x7fa630100890 2023-08-10T11:52:25.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.702+0000 7fa627fff700 1 -- 172.21.15.73:0/663822974 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fa6180108d0 con 0x7fa630100890 2023-08-10T11:52:25.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.702+0000 7fa627fff700 1 --2- 172.21.15.73:0/663822974 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa61c0a1150 0x7fa61c0a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:25.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.703+0000 7fa62effd700 1 --2- 172.21.15.73:0/663822974 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa61c0a1150 0x7fa61c0a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:25.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.703+0000 7fa627fff700 1 -- 172.21.15.73:0/663822974 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa6180cc790 con 0x7fa630100890 2023-08-10T11:52:25.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.703+0000 7fa62effd700 1 --2- 172.21.15.73:0/663822974 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa61c0a1150 0x7fa61c0a3610 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa620009fd0 tx=0x7fa62000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:25.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.706+0000 7fa627fff700 1 -- 172.21.15.73:0/663822974 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fa618095ef0 con 0x7fa630100890 2023-08-10T11:52:25.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.897+0000 7fa635408700 1 -- 172.21.15.73:0/663822974 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa63002cbc0 con 0x7fa630100890 2023-08-10T11:52:25.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.897+0000 7fa627fff700 1 -- 172.21.15.73:0/663822974 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa618016020 con 0x7fa630100890 2023-08-10T11:52:25.898 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-08-10T11:52:25.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.899+0000 7fa635408700 1 -- 172.21.15.73:0/663822974 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa61c0a1150 msgr2=0x7fa61c0a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:25.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.899+0000 7fa635408700 1 --2- 172.21.15.73:0/663822974 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa61c0a1150 0x7fa61c0a3610 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa620009fd0 tx=0x7fa62000b040 comp rx=0 tx=0).stop 2023-08-10T11:52:25.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.899+0000 7fa635408700 1 -- 172.21.15.73:0/663822974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa630100890 msgr2=0x7fa630195a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:25.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.899+0000 7fa635408700 1 --2- 172.21.15.73:0/663822974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa630100890 0x7fa630195a20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa61800d950 tx=0x7fa61800dc60 comp rx=0 tx=0).stop 2023-08-10T11:52:25.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.899+0000 7fa635408700 1 -- 172.21.15.73:0/663822974 shutdown_connections 2023-08-10T11:52:25.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.899+0000 7fa635408700 1 --2- 172.21.15.73:0/663822974 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa61c0a1150 0x7fa61c0a3610 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.899+0000 7fa635408700 1 --2- 172.21.15.73:0/663822974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6300ff6a0 0x7fa6301954e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.899+0000 7fa635408700 1 --2- 172.21.15.73:0/663822974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa630101230 0x7fa63019ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.899+0000 7fa635408700 1 --2- 172.21.15.73:0/663822974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa630100890 0x7fa630195a20 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:25.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.899+0000 7fa635408700 1 -- 172.21.15.73:0/663822974 >> 172.21.15.73:0/663822974 conn(0x7fa6300fabf0 msgr2=0x7fa630103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:25.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.899+0000 7fa635408700 1 -- 172.21.15.73:0/663822974 shutdown_connections 2023-08-10T11:52:25.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:25.899+0000 7fa635408700 1 -- 172.21.15.73:0/663822974 wait complete. 2023-08-10T11:52:25.913 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T11:52:26.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.036+0000 7f409ca30700 1 -- 172.21.15.73:0/3569493753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4098100cd0 msgr2=0x7f40981010f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:26.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.036+0000 7f409ca30700 1 --2- 172.21.15.73:0/3569493753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4098100cd0 0x7f40981010f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f408c009990 tx=0x7f408c009ca0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.036+0000 7f409ca30700 1 -- 172.21.15.73:0/3569493753 shutdown_connections 2023-08-10T11:52:26.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.036+0000 7f409ca30700 1 --2- 172.21.15.73:0/3569493753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4098100250 0x7f4098107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.036+0000 7f409ca30700 1 --2- 172.21.15.73:0/3569493753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4098100cd0 0x7f40981010f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.036+0000 7f409ca30700 1 --2- 172.21.15.73:0/3569493753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f40980ff890 0x7f40980ffd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.036+0000 7f409ca30700 1 -- 172.21.15.73:0/3569493753 >> 172.21.15.73:0/3569493753 conn(0x7f40980fa340 msgr2=0x7f40980fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:26.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.036+0000 7f409ca30700 1 -- 172.21.15.73:0/3569493753 shutdown_connections 2023-08-10T11:52:26.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.036+0000 7f409ca30700 1 -- 172.21.15.73:0/3569493753 wait complete. 2023-08-10T11:52:26.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.037+0000 7f409ca30700 1 Processor -- start 2023-08-10T11:52:26.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.037+0000 7f409ca30700 1 -- start start 2023-08-10T11:52:26.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.037+0000 7f409ca30700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40980ff890 0x7f40980ff310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:26.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.037+0000 7f409ca30700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4098100250 0x7f409819b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:26.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.037+0000 7f409ca30700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4098100cd0 0x7f409819d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:26.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.037+0000 7f409ca30700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409819df50 con 0x7f4098100250 2023-08-10T11:52:26.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.037+0000 7f409ca30700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409819e0c0 con 0x7f40980ff890 2023-08-10T11:52:26.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.037+0000 7f409ca30700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409819e280 con 0x7f4098100cd0 2023-08-10T11:52:26.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.037+0000 7f4095d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4098100250 0x7f409819b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:26.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.037+0000 7f4095d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4098100250 0x7f409819b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60532/0 (socket says 172.21.15.73:60532) 2023-08-10T11:52:26.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.037+0000 7f4095d9b700 1 -- 172.21.15.73:0/4288664029 learned_addr learned my addr 172.21.15.73:0/4288664029 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:26.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.037+0000 7f4096d9d700 1 --2- 172.21.15.73:0/4288664029 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4098100cd0 0x7f409819d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:26.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.037+0000 7f409659c700 1 --2- 172.21.15.73:0/4288664029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40980ff890 0x7f40980ff310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:26.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.037+0000 7f4095d9b700 1 -- 172.21.15.73:0/4288664029 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4098100cd0 msgr2=0x7f409819d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:26.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.037+0000 7f4095d9b700 1 --2- 172.21.15.73:0/4288664029 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4098100cd0 0x7f409819d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.037+0000 7f4095d9b700 1 -- 172.21.15.73:0/4288664029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40980ff890 msgr2=0x7f40980ff310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:26.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.037+0000 7f4095d9b700 1 --2- 172.21.15.73:0/4288664029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40980ff890 0x7f40980ff310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.037+0000 7f4095d9b700 1 -- 172.21.15.73:0/4288664029 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c0095f0 con 0x7f4098100250 2023-08-10T11:52:26.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.037+0000 7f409659c700 1 --2- 172.21.15.73:0/4288664029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40980ff890 0x7f40980ff310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:52:26.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.038+0000 7f4095d9b700 1 --2- 172.21.15.73:0/4288664029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4098100250 0x7f409819b130 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f408800c9b0 tx=0x7f408800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:26.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.038+0000 7f40877fe700 1 -- 172.21.15.73:0/4288664029 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4088007b00 con 0x7f4098100250 2023-08-10T11:52:26.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.038+0000 7f40877fe700 1 -- 172.21.15.73:0/4288664029 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4088007c60 con 0x7f4098100250 2023-08-10T11:52:26.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.038+0000 7f409ca30700 1 -- 172.21.15.73:0/4288664029 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f409819e560 con 0x7f4098100250 2023-08-10T11:52:26.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.038+0000 7f40877fe700 1 -- 172.21.15.73:0/4288664029 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4088018660 con 0x7f4098100250 2023-08-10T11:52:26.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.038+0000 7f409ca30700 1 -- 172.21.15.73:0/4288664029 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f409819ea70 con 0x7f4098100250 2023-08-10T11:52:26.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.039+0000 7f409ca30700 1 -- 172.21.15.73:0/4288664029 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40981065e0 con 0x7f4098100250 2023-08-10T11:52:26.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.040+0000 7f40877fe700 1 -- 172.21.15.73:0/4288664029 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f4088018880 con 0x7f4098100250 2023-08-10T11:52:26.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.040+0000 7f40877fe700 1 --2- 172.21.15.73:0/4288664029 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f40800a1150 0x7f40800a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:26.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.041+0000 7f409659c700 1 --2- 172.21.15.73:0/4288664029 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f40800a1150 0x7f40800a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:26.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.041+0000 7f40877fe700 1 -- 172.21.15.73:0/4288664029 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f40880ccca0 con 0x7f4098100250 2023-08-10T11:52:26.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.041+0000 7f409659c700 1 --2- 172.21.15.73:0/4288664029 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f40800a1150 0x7f40800a3610 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f408c00b5c0 tx=0x7f408c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:26.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.044+0000 7f40877fe700 1 -- 172.21.15.73:0/4288664029 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f4088096490 con 0x7f4098100250 2023-08-10T11:52:26.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.234+0000 7f409ca30700 1 -- 172.21.15.73:0/4288664029 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f409802cbc0 con 0x7f4098100250 2023-08-10T11:52:26.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.234+0000 7f40877fe700 1 -- 172.21.15.73:0/4288664029 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4088099ab0 con 0x7f4098100250 2023-08-10T11:52:26.235 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-08-10T11:52:26.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.236+0000 7f409ca30700 1 -- 172.21.15.73:0/4288664029 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f40800a1150 msgr2=0x7f40800a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:26.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.236+0000 7f409ca30700 1 --2- 172.21.15.73:0/4288664029 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f40800a1150 0x7f40800a3610 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f408c00b5c0 tx=0x7f408c005fb0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.236+0000 7f409ca30700 1 -- 172.21.15.73:0/4288664029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4098100250 msgr2=0x7f409819b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:26.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.236+0000 7f409ca30700 1 --2- 172.21.15.73:0/4288664029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4098100250 0x7f409819b130 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f408800c9b0 tx=0x7f408800cd70 comp rx=0 tx=0).stop 2023-08-10T11:52:26.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.237+0000 7f409ca30700 1 -- 172.21.15.73:0/4288664029 shutdown_connections 2023-08-10T11:52:26.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.237+0000 7f409ca30700 1 --2- 172.21.15.73:0/4288664029 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f40800a1150 0x7f40800a3610 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.237+0000 7f409ca30700 1 --2- 172.21.15.73:0/4288664029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40980ff890 0x7f40980ff310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.237+0000 7f409ca30700 1 --2- 172.21.15.73:0/4288664029 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4098100cd0 0x7f409819d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.237+0000 7f409ca30700 1 --2- 172.21.15.73:0/4288664029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4098100250 0x7f409819b130 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.237+0000 7f409ca30700 1 -- 172.21.15.73:0/4288664029 >> 172.21.15.73:0/4288664029 conn(0x7f40980fa340 msgr2=0x7f40980fc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:26.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.237+0000 7f409ca30700 1 -- 172.21.15.73:0/4288664029 shutdown_connections 2023-08-10T11:52:26.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.237+0000 7f409ca30700 1 -- 172.21.15.73:0/4288664029 wait complete. 2023-08-10T11:52:26.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:25 smithi152 ceph-mon[130220]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2023-08-10T11:52:26.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:25 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3037512676' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:52:26.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:25 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/490957785' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:52:26.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:25 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/663822974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:52:26.248 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:25 smithi073 ceph-mon[128869]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2023-08-10T11:52:26.249 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:25 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3037512676' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:52:26.249 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:25 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/490957785' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:52:26.249 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:25 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/663822974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:52:26.250 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-08-10T11:52:26.250 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T11:52:26.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:25 smithi156 ceph-mon[130574]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2023-08-10T11:52:26.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:25 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3037512676' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:52:26.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:25 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/490957785' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:52:26.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:25 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/663822974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:52:26.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.371+0000 7f40c4c34700 1 -- 172.21.15.73:0/2541009927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40c00ff650 msgr2=0x7f40c00ffa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:26.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.371+0000 7f40c4c34700 1 --2- 172.21.15.73:0/2541009927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40c00ff650 0x7f40c00ffa70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f40b00099c0 tx=0x7f40b0009cd0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.371+0000 7f40c4c34700 1 -- 172.21.15.73:0/2541009927 shutdown_connections 2023-08-10T11:52:26.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.371+0000 7f40c4c34700 1 --2- 172.21.15.73:0/2541009927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40c01011e0 0x7f40c0107a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.371+0000 7f40c4c34700 1 --2- 172.21.15.73:0/2541009927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40c00ff650 0x7f40c00ffa70 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.371+0000 7f40c4c34700 1 --2- 172.21.15.73:0/2541009927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f40c0100840 0x7f40c0100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.371+0000 7f40c4c34700 1 -- 172.21.15.73:0/2541009927 >> 172.21.15.73:0/2541009927 conn(0x7f40c00faba0 msgr2=0x7f40c00fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:26.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.371+0000 7f40c4c34700 1 -- 172.21.15.73:0/2541009927 shutdown_connections 2023-08-10T11:52:26.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.372+0000 7f40c4c34700 1 -- 172.21.15.73:0/2541009927 wait complete. 2023-08-10T11:52:26.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.372+0000 7f40c4c34700 1 Processor -- start 2023-08-10T11:52:26.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.372+0000 7f40c4c34700 1 -- start start 2023-08-10T11:52:26.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.372+0000 7f40c4c34700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40c00ff650 0x7f40c0196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:26.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.372+0000 7f40c4c34700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40c0100840 0x7f40c01968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:26.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.372+0000 7f40c4c34700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f40c01011e0 0x7f40c019d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:26.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.372+0000 7f40c4c34700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c019df00 con 0x7f40c0100840 2023-08-10T11:52:26.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.372+0000 7f40c4c34700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c019e040 con 0x7f40c00ff650 2023-08-10T11:52:26.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.372+0000 7f40c4c34700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c019e1d0 con 0x7f40c01011e0 2023-08-10T11:52:26.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.372+0000 7f40bdd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40c0100840 0x7f40c01968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:26.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.373+0000 7f40bdd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40c0100840 0x7f40c01968c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60546/0 (socket says 172.21.15.73:60546) 2023-08-10T11:52:26.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.373+0000 7f40bdd9b700 1 -- 172.21.15.73:0/601197322 learned_addr learned my addr 172.21.15.73:0/601197322 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:26.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.373+0000 7f40be59c700 1 --2- 172.21.15.73:0/601197322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40c00ff650 0x7f40c0196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:26.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.373+0000 7f40bed9d700 1 --2- 172.21.15.73:0/601197322 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f40c01011e0 0x7f40c019d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:26.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.373+0000 7f40bdd9b700 1 -- 172.21.15.73:0/601197322 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f40c01011e0 msgr2=0x7f40c019d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:26.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.373+0000 7f40bdd9b700 1 --2- 172.21.15.73:0/601197322 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f40c01011e0 0x7f40c019d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.373+0000 7f40bdd9b700 1 -- 172.21.15.73:0/601197322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40c00ff650 msgr2=0x7f40c0196380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:26.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.373+0000 7f40bdd9b700 1 --2- 172.21.15.73:0/601197322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40c00ff650 0x7f40c0196380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.373+0000 7f40bdd9b700 1 -- 172.21.15.73:0/601197322 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b00095f0 con 0x7f40c0100840 2023-08-10T11:52:26.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.373+0000 7f40bed9d700 1 --2- 172.21.15.73:0/601197322 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f40c01011e0 0x7f40c019d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:52:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.373+0000 7f40bdd9b700 1 --2- 172.21.15.73:0/601197322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40c0100840 0x7f40c01968c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f40b400d950 tx=0x7f40b400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.373+0000 7f40af7fe700 1 -- 172.21.15.73:0/601197322 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4009940 con 0x7f40c0100840 2023-08-10T11:52:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.373+0000 7f40af7fe700 1 -- 172.21.15.73:0/601197322 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f40b4010460 con 0x7f40c0100840 2023-08-10T11:52:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.373+0000 7f40af7fe700 1 -- 172.21.15.73:0/601197322 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b400f620 con 0x7f40c0100840 2023-08-10T11:52:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.373+0000 7f40c4c34700 1 -- 172.21.15.73:0/601197322 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c019e4b0 con 0x7f40c0100840 2023-08-10T11:52:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.373+0000 7f40c4c34700 1 -- 172.21.15.73:0/601197322 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c019e970 con 0x7f40c0100840 2023-08-10T11:52:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.374+0000 7f40c4c34700 1 -- 172.21.15.73:0/601197322 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c0107630 con 0x7f40c0100840 2023-08-10T11:52:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.375+0000 7f40af7fe700 1 -- 172.21.15.73:0/601197322 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f40b40108d0 con 0x7f40c0100840 2023-08-10T11:52:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.376+0000 7f40af7fe700 1 --2- 172.21.15.73:0/601197322 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f40a80a11a0 0x7f40a80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:26.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.376+0000 7f40be59c700 1 --2- 172.21.15.73:0/601197322 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f40a80a11a0 0x7f40a80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:26.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.376+0000 7f40af7fe700 1 -- 172.21.15.73:0/601197322 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f40b40cc720 con 0x7f40c0100840 2023-08-10T11:52:26.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.376+0000 7f40be59c700 1 --2- 172.21.15.73:0/601197322 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f40a80a11a0 0x7f40a80a3660 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f40b0009f50 tx=0x7f40b000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:26.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.379+0000 7f40af7fe700 1 -- 172.21.15.73:0/601197322 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f40b4095e80 con 0x7f40c0100840 2023-08-10T11:52:26.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.613+0000 7f40c4c34700 1 -- 172.21.15.73:0/601197322 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40c002c970 con 0x7f40c0100840 2023-08-10T11:52:26.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.614+0000 7f40af7fe700 1 -- 172.21.15.73:0/601197322 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10891 (secure 0 0 0) 0x7f40b4016090 con 0x7f40c0100840 2023-08-10T11:52:26.615 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:52:26.615 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1319360725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1319360725},{"type":"v1","addr":"172.21.15.73:6835","nonce":1319360725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/431221951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":431221951},{"type":"v1","addr":"172.21.15.73:6837","nonce":431221951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-10T11:50:54.304447+0000","modified":"2023-08-10T11:51:01.523452+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24503,"mds_1":24479,"mds_2":24451,"mds_3":24443,"mds_4":24419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6839/1099539481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1099539481},{"type":"v1","addr":"172.21.15.73:6839","nonce":1099539481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6841/3067925859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":3067925859},{"type":"v1","addr":"172.21.15.73:6841","nonce":3067925859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24397":{"gid":24397,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6833/3028461815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3028461815},{"type":"v1","addr":"172.21.15.156:6833","nonce":3028461815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24419":{"gid":24419,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6833/4148407154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4148407154},{"type":"v1","addr":"172.21.15.152:6833","nonce":4148407154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24443":{"gid":24443,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.152:6835/1791572604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1791572604},{"type":"v1","addr":"172.21.15.152:6835","nonce":1791572604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.156:6835/904126790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":904126790},{"type":"v1","addr":"172.21.15.156:6835","nonce":904126790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24457":{"gid":24457,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/4284306352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":4284306352},{"type":"v1","addr":"172.21.15.156:6837","nonce":4284306352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6839/3361058731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":3361058731},{"type":"v1","addr":"172.21.15.156:6839","nonce":3361058731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6837/74214089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":74214089},{"type":"v1","addr":"172.21.15.152:6837","nonce":74214089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6839/3870202690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3870202690},{"type":"v1","addr":"172.21.15.152:6839","nonce":3870202690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T11:52:26.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.616+0000 7f40c4c34700 1 -- 172.21.15.73:0/601197322 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f40a80a11a0 msgr2=0x7f40a80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:26.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.616+0000 7f40c4c34700 1 --2- 172.21.15.73:0/601197322 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f40a80a11a0 0x7f40a80a3660 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f40b0009f50 tx=0x7f40b000b540 comp rx=0 tx=0).stop 2023-08-10T11:52:26.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.616+0000 7f40c4c34700 1 -- 172.21.15.73:0/601197322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40c0100840 msgr2=0x7f40c01968c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:26.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.616+0000 7f40c4c34700 1 --2- 172.21.15.73:0/601197322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40c0100840 0x7f40c01968c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f40b400d950 tx=0x7f40b400dc60 comp rx=0 tx=0).stop 2023-08-10T11:52:26.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.616+0000 7f40c4c34700 1 -- 172.21.15.73:0/601197322 shutdown_connections 2023-08-10T11:52:26.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.616+0000 7f40c4c34700 1 --2- 172.21.15.73:0/601197322 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f40a80a11a0 0x7f40a80a3660 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.616+0000 7f40c4c34700 1 --2- 172.21.15.73:0/601197322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40c00ff650 0x7f40c0196380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.616+0000 7f40c4c34700 1 --2- 172.21.15.73:0/601197322 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f40c01011e0 0x7f40c019d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.616+0000 7f40c4c34700 1 --2- 172.21.15.73:0/601197322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40c0100840 0x7f40c01968c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.616+0000 7f40c4c34700 1 -- 172.21.15.73:0/601197322 >> 172.21.15.73:0/601197322 conn(0x7f40c00faba0 msgr2=0x7f40c00fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:26.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.616+0000 7f40c4c34700 1 -- 172.21.15.73:0/601197322 shutdown_connections 2023-08-10T11:52:26.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.616+0000 7f40c4c34700 1 -- 172.21.15.73:0/601197322 wait complete. 2023-08-10T11:52:26.619 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 27 2023-08-10T11:52:26.630 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-08-10T11:52:26.630 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-08-10T11:52:26.630 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T11:52:26.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.750+0000 7f8978218700 1 -- 172.21.15.73:0/2332042310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89700ff680 msgr2=0x7f89700ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:26.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.750+0000 7f8978218700 1 --2- 172.21.15.73:0/2332042310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89700ff680 0x7f89700ffaa0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f89600099c0 tx=0x7f8960009cd0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.750+0000 7f8978218700 1 -- 172.21.15.73:0/2332042310 shutdown_connections 2023-08-10T11:52:26.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.750+0000 7f8978218700 1 --2- 172.21.15.73:0/2332042310 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8970101210 0x7f8970107ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.750+0000 7f8978218700 1 --2- 172.21.15.73:0/2332042310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89700ff680 0x7f89700ffaa0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.750+0000 7f8978218700 1 --2- 172.21.15.73:0/2332042310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8970100870 0x7f8970100cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.750+0000 7f8978218700 1 -- 172.21.15.73:0/2332042310 >> 172.21.15.73:0/2332042310 conn(0x7f89700fabf0 msgr2=0x7f89700fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:26.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.750+0000 7f8978218700 1 -- 172.21.15.73:0/2332042310 shutdown_connections 2023-08-10T11:52:26.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.750+0000 7f8978218700 1 -- 172.21.15.73:0/2332042310 wait complete. 2023-08-10T11:52:26.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.751+0000 7f8978218700 1 Processor -- start 2023-08-10T11:52:26.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.751+0000 7f8978218700 1 -- start start 2023-08-10T11:52:26.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.751+0000 7f8978218700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89700ff680 0x7f8970198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:26.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.751+0000 7f8978218700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8970100870 0x7f8970198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:26.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.751+0000 7f8978218700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8970101210 0x7f897019fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:26.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.751+0000 7f8978218700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89701a01f0 con 0x7f89700ff680 2023-08-10T11:52:26.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.751+0000 7f8978218700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89701a0330 con 0x7f8970100870 2023-08-10T11:52:26.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.751+0000 7f8978218700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89701a04c0 con 0x7f8970101210 2023-08-10T11:52:26.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.751+0000 7f8975fb4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89700ff680 0x7f8970198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:26.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.751+0000 7f8975fb4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89700ff680 0x7f8970198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60558/0 (socket says 172.21.15.73:60558) 2023-08-10T11:52:26.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.751+0000 7f8975fb4700 1 -- 172.21.15.73:0/1617449451 learned_addr learned my addr 172.21.15.73:0/1617449451 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:26.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.751+0000 7f89757b3700 1 --2- 172.21.15.73:0/1617449451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8970100870 0x7f8970198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:26.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.751+0000 7f8975fb4700 1 -- 172.21.15.73:0/1617449451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8970101210 msgr2=0x7f897019fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:26.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.751+0000 7f8975fb4700 1 --2- 172.21.15.73:0/1617449451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8970101210 0x7f897019fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.751+0000 7f8975fb4700 1 -- 172.21.15.73:0/1617449451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8970100870 msgr2=0x7f8970198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:26.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.751+0000 7f8975fb4700 1 --2- 172.21.15.73:0/1617449451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8970100870 0x7f8970198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.751+0000 7f8975fb4700 1 -- 172.21.15.73:0/1617449451 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89600095f0 con 0x7f89700ff680 2023-08-10T11:52:26.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.752+0000 7f8975fb4700 1 --2- 172.21.15.73:0/1617449451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89700ff680 0x7f8970198670 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f89600036f0 tx=0x7f89600038c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:26.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.752+0000 7f8966ffd700 1 -- 172.21.15.73:0/1617449451 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896001d070 con 0x7f89700ff680 2023-08-10T11:52:26.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.752+0000 7f8966ffd700 1 -- 172.21.15.73:0/1617449451 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8960022470 con 0x7f89700ff680 2023-08-10T11:52:26.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.752+0000 7f8966ffd700 1 -- 172.21.15.73:0/1617449451 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896000f6c0 con 0x7f89700ff680 2023-08-10T11:52:26.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.752+0000 7f8978218700 1 -- 172.21.15.73:0/1617449451 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89701a0740 con 0x7f89700ff680 2023-08-10T11:52:26.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.752+0000 7f8978218700 1 -- 172.21.15.73:0/1617449451 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89701a0b10 con 0x7f89700ff680 2023-08-10T11:52:26.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.753+0000 7f8978218700 1 -- 172.21.15.73:0/1617449451 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f897010aee0 con 0x7f89700ff680 2023-08-10T11:52:26.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.754+0000 7f8966ffd700 1 -- 172.21.15.73:0/1617449451 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f89600225e0 con 0x7f89700ff680 2023-08-10T11:52:26.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.754+0000 7f8966ffd700 1 --2- 172.21.15.73:0/1617449451 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f895c0a11a0 0x7f895c0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:26.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.755+0000 7f89757b3700 1 --2- 172.21.15.73:0/1617449451 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f895c0a11a0 0x7f895c0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:26.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.755+0000 7f8966ffd700 1 -- 172.21.15.73:0/1617449451 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f89600ce6c0 con 0x7f89700ff680 2023-08-10T11:52:26.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.755+0000 7f89757b3700 1 --2- 172.21.15.73:0/1617449451 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f895c0a11a0 0x7f895c0a3660 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f896c005fd0 tx=0x7f896c00a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:26.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.758+0000 7f8966ffd700 1 -- 172.21.15.73:0/1617449451 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8960097e50 con 0x7f89700ff680 2023-08-10T11:52:26.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.947+0000 7f8978218700 1 -- 172.21.15.73:0/1617449451 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8970069280 con 0x7f895c0a11a0 2023-08-10T11:52:26.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.958+0000 7f8966ffd700 1 -- 172.21.15.73:0/1617449451 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344700 (secure 0 0 0) 0x7f8970069280 con 0x7f895c0a11a0 2023-08-10T11:52:26.962 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:52:26.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.961+0000 7f8978218700 1 -- 172.21.15.73:0/1617449451 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f895c0a11a0 msgr2=0x7f895c0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:26.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.961+0000 7f8978218700 1 --2- 172.21.15.73:0/1617449451 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f895c0a11a0 0x7f895c0a3660 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f896c005fd0 tx=0x7f896c00a560 comp rx=0 tx=0).stop 2023-08-10T11:52:26.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.961+0000 7f8978218700 1 -- 172.21.15.73:0/1617449451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89700ff680 msgr2=0x7f8970198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:26.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.961+0000 7f8978218700 1 --2- 172.21.15.73:0/1617449451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89700ff680 0x7f8970198670 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f89600036f0 tx=0x7f89600038c0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.961+0000 7f8978218700 1 -- 172.21.15.73:0/1617449451 shutdown_connections 2023-08-10T11:52:26.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.961+0000 7f8978218700 1 --2- 172.21.15.73:0/1617449451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8970101210 0x7f897019fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.961+0000 7f8978218700 1 --2- 172.21.15.73:0/1617449451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89700ff680 0x7f8970198670 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.961+0000 7f8978218700 1 --2- 172.21.15.73:0/1617449451 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f895c0a11a0 0x7f895c0a3660 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.961+0000 7f8978218700 1 --2- 172.21.15.73:0/1617449451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8970100870 0x7f8970198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:26.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.961+0000 7f8978218700 1 -- 172.21.15.73:0/1617449451 >> 172.21.15.73:0/1617449451 conn(0x7f89700fabf0 msgr2=0x7f8970068b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:26.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.961+0000 7f8978218700 1 -- 172.21.15.73:0/1617449451 shutdown_connections 2023-08-10T11:52:26.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:26.961+0000 7f8978218700 1 -- 172.21.15.73:0/1617449451 wait complete. 2023-08-10T11:52:26.966 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-08-10T11:52:26.974 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2023-08-10T11:52:26.502435+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659562,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1017,"num_read_kb":628,"num_write":423,"num_write_kb":3077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1181408,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":849,"ondisk_log_size":849,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337240,"kb_used_data":13048,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124604584,"statfs":{"total":1151940427776,"available":1151595094016,"internally_reserved":0,"allocated":13361152,"data_stored":7320112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6087,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":78,"num_write":11,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002929"},"pg_stats":[{"pgid":"3.3f","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.525060+0000","last_change":"2023-08-10T11:50:54.902569+0000","last_active":"2023-08-10T11:52:18.525060+0000","last_peered":"2023-08-10T11:52:18.525060+0000","last_clean":"2023-08-10T11:52:18.525060+0000","last_became_active":"2023-08-10T11:50:54.902058+0000","last_became_peered":"2023-08-10T11:50:54.902058+0000","last_unstale":"2023-08-10T11:52:18.525060+0000","last_undegraded":"2023-08-10T11:52:18.525060+0000","last_fullsized":"2023-08-10T11:52:18.525060+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:46:00.569005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.510420+0000","last_change":"2023-08-10T11:50:54.942908+0000","last_active":"2023-08-10T11:52:18.510420+0000","last_peered":"2023-08-10T11:52:18.510420+0000","last_clean":"2023-08-10T11:52:18.510420+0000","last_became_active":"2023-08-10T11:50:54.941765+0000","last_became_peered":"2023-08-10T11:50:54.941765+0000","last_unstale":"2023-08-10T11:52:18.510420+0000","last_undegraded":"2023-08-10T11:52:18.510420+0000","last_fullsized":"2023-08-10T11:52:18.510420+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:53:56.170569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.519409+0000","last_change":"2023-08-10T11:50:54.940670+0000","last_active":"2023-08-10T11:52:18.519409+0000","last_peered":"2023-08-10T11:52:18.519409+0000","last_clean":"2023-08-10T11:52:18.519409+0000","last_became_active":"2023-08-10T11:50:54.939906+0000","last_became_peered":"2023-08-10T11:50:54.939906+0000","last_unstale":"2023-08-10T11:52:18.519409+0000","last_undegraded":"2023-08-10T11:52:18.519409+0000","last_fullsized":"2023-08-10T11:52:18.519409+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:43:14.123136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.513041+0000","last_change":"2023-08-10T11:50:54.910964+0000","last_active":"2023-08-10T11:52:18.513041+0000","last_peered":"2023-08-10T11:52:18.513041+0000","last_clean":"2023-08-10T11:52:18.513041+0000","last_became_active":"2023-08-10T11:50:54.910185+0000","last_became_peered":"2023-08-10T11:50:54.910185+0000","last_unstale":"2023-08-10T11:52:18.513041+0000","last_undegraded":"2023-08-10T11:52:18.513041+0000","last_fullsized":"2023-08-10T11:52:18.513041+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:55:02.929754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.508834+0000","last_change":"2023-08-10T11:50:54.905354+0000","last_active":"2023-08-10T11:52:18.508834+0000","last_peered":"2023-08-10T11:52:18.508834+0000","last_clean":"2023-08-10T11:52:18.508834+0000","last_became_active":"2023-08-10T11:50:54.904982+0000","last_became_peered":"2023-08-10T11:50:54.904982+0000","last_unstale":"2023-08-10T11:52:18.508834+0000","last_undegraded":"2023-08-10T11:52:18.508834+0000","last_fullsized":"2023-08-10T11:52:18.508834+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:57:07.369827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.514900+0000","last_change":"2023-08-10T11:51:49.650435+0000","last_active":"2023-08-10T11:52:18.514900+0000","last_peered":"2023-08-10T11:52:18.514900+0000","last_clean":"2023-08-10T11:52:18.514900+0000","last_became_active":"2023-08-10T11:51:49.649975+0000","last_became_peered":"2023-08-10T11:51:49.649975+0000","last_unstale":"2023-08-10T11:52:18.514900+0000","last_undegraded":"2023-08-10T11:52:18.514900+0000","last_fullsized":"2023-08-10T11:52:18.514900+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:15:31.959610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.511353+0000","last_change":"2023-08-10T11:50:54.904604+0000","last_active":"2023-08-10T11:52:18.511353+0000","last_peered":"2023-08-10T11:52:18.511353+0000","last_clean":"2023-08-10T11:52:18.511353+0000","last_became_active":"2023-08-10T11:50:54.904295+0000","last_became_peered":"2023-08-10T11:50:54.904295+0000","last_unstale":"2023-08-10T11:52:18.511353+0000","last_undegraded":"2023-08-10T11:52:18.511353+0000","last_fullsized":"2023-08-10T11:52:18.511353+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:32:18.264657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.515232+0000","last_change":"2023-08-10T11:50:54.963398+0000","last_active":"2023-08-10T11:52:18.515232+0000","last_peered":"2023-08-10T11:52:18.515232+0000","last_clean":"2023-08-10T11:52:18.515232+0000","last_became_active":"2023-08-10T11:50:54.963048+0000","last_became_peered":"2023-08-10T11:50:54.963048+0000","last_unstale":"2023-08-10T11:52:18.515232+0000","last_undegraded":"2023-08-10T11:52:18.515232+0000","last_fullsized":"2023-08-10T11:52:18.515232+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:28:39.416861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.521717+0000","last_change":"2023-08-10T11:50:54.913426+0000","last_active":"2023-08-10T11:52:18.521717+0000","last_peered":"2023-08-10T11:52:18.521717+0000","last_clean":"2023-08-10T11:52:18.521717+0000","last_became_active":"2023-08-10T11:50:54.913099+0000","last_became_peered":"2023-08-10T11:50:54.913099+0000","last_unstale":"2023-08-10T11:52:18.521717+0000","last_undegraded":"2023-08-10T11:52:18.521717+0000","last_fullsized":"2023-08-10T11:52:18.521717+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:45:48.662369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.514590+0000","last_change":"2023-08-10T11:50:54.909259+0000","last_active":"2023-08-10T11:52:18.514590+0000","last_peered":"2023-08-10T11:52:18.514590+0000","last_clean":"2023-08-10T11:52:18.514590+0000","last_became_active":"2023-08-10T11:50:54.908898+0000","last_became_peered":"2023-08-10T11:50:54.908898+0000","last_unstale":"2023-08-10T11:52:18.514590+0000","last_undegraded":"2023-08-10T11:52:18.514590+0000","last_fullsized":"2023-08-10T11:52:18.514590+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:36:43.966446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.522763+0000","last_change":"2023-08-10T11:50:54.906152+0000","last_active":"2023-08-10T11:52:18.522763+0000","last_peered":"2023-08-10T11:52:18.522763+0000","last_clean":"2023-08-10T11:52:18.522763+0000","last_became_active":"2023-08-10T11:50:54.905859+0000","last_became_peered":"2023-08-10T11:50:54.905859+0000","last_unstale":"2023-08-10T11:52:18.522763+0000","last_undegraded":"2023-08-10T11:52:18.522763+0000","last_fullsized":"2023-08-10T11:52:18.522763+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:37:40.007291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.510458+0000","last_change":"2023-08-10T11:50:54.911195+0000","last_active":"2023-08-10T11:52:18.510458+0000","last_peered":"2023-08-10T11:52:18.510458+0000","last_clean":"2023-08-10T11:52:18.510458+0000","last_became_active":"2023-08-10T11:50:54.910618+0000","last_became_peered":"2023-08-10T11:50:54.910618+0000","last_unstale":"2023-08-10T11:52:18.510458+0000","last_undegraded":"2023-08-10T11:52:18.510458+0000","last_fullsized":"2023-08-10T11:52:18.510458+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:37:39.875599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.517052+0000","last_change":"2023-08-10T11:50:54.908051+0000","last_active":"2023-08-10T11:52:18.517052+0000","last_peered":"2023-08-10T11:52:18.517052+0000","last_clean":"2023-08-10T11:52:18.517052+0000","last_became_active":"2023-08-10T11:50:54.907772+0000","last_became_peered":"2023-08-10T11:50:54.907772+0000","last_unstale":"2023-08-10T11:52:18.517052+0000","last_undegraded":"2023-08-10T11:52:18.517052+0000","last_fullsized":"2023-08-10T11:52:18.517052+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:13:41.292582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.522591+0000","last_change":"2023-08-10T11:50:54.941327+0000","last_active":"2023-08-10T11:52:18.522591+0000","last_peered":"2023-08-10T11:52:18.522591+0000","last_clean":"2023-08-10T11:52:18.522591+0000","last_became_active":"2023-08-10T11:50:54.941020+0000","last_became_peered":"2023-08-10T11:50:54.941020+0000","last_unstale":"2023-08-10T11:52:18.522591+0000","last_undegraded":"2023-08-10T11:52:18.522591+0000","last_fullsized":"2023-08-10T11:52:18.522591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:39:28.002709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.517814+0000","last_change":"2023-08-10T11:50:54.940236+0000","last_active":"2023-08-10T11:52:18.517814+0000","last_peered":"2023-08-10T11:52:18.517814+0000","last_clean":"2023-08-10T11:52:18.517814+0000","last_became_active":"2023-08-10T11:50:54.939921+0000","last_became_peered":"2023-08-10T11:50:54.939921+0000","last_unstale":"2023-08-10T11:52:18.517814+0000","last_undegraded":"2023-08-10T11:52:18.517814+0000","last_fullsized":"2023-08-10T11:52:18.517814+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:26:42.811526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.524237+0000","last_change":"2023-08-10T11:50:54.903773+0000","last_active":"2023-08-10T11:52:18.524237+0000","last_peered":"2023-08-10T11:52:18.524237+0000","last_clean":"2023-08-10T11:52:18.524237+0000","last_became_active":"2023-08-10T11:50:54.903516+0000","last_became_peered":"2023-08-10T11:50:54.903516+0000","last_unstale":"2023-08-10T11:52:18.524237+0000","last_undegraded":"2023-08-10T11:52:18.524237+0000","last_fullsized":"2023-08-10T11:52:18.524237+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:14:22.982193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.525326+0000","last_change":"2023-08-10T11:50:54.902364+0000","last_active":"2023-08-10T11:52:18.525326+0000","last_peered":"2023-08-10T11:52:18.525326+0000","last_clean":"2023-08-10T11:52:18.525326+0000","last_became_active":"2023-08-10T11:50:54.901673+0000","last_became_peered":"2023-08-10T11:50:54.901673+0000","last_unstale":"2023-08-10T11:52:18.525326+0000","last_undegraded":"2023-08-10T11:52:18.525326+0000","last_fullsized":"2023-08-10T11:52:18.525326+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:29:24.743838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.513050+0000","last_change":"2023-08-10T11:50:54.911896+0000","last_active":"2023-08-10T11:52:18.513050+0000","last_peered":"2023-08-10T11:52:18.513050+0000","last_clean":"2023-08-10T11:52:18.513050+0000","last_became_active":"2023-08-10T11:50:54.911469+0000","last_became_peered":"2023-08-10T11:50:54.911469+0000","last_unstale":"2023-08-10T11:52:18.513050+0000","last_undegraded":"2023-08-10T11:52:18.513050+0000","last_fullsized":"2023-08-10T11:52:18.513050+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:44:23.395246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.503698+0000","last_change":"2023-08-10T11:50:54.964030+0000","last_active":"2023-08-10T11:52:18.503698+0000","last_peered":"2023-08-10T11:52:18.503698+0000","last_clean":"2023-08-10T11:52:18.503698+0000","last_became_active":"2023-08-10T11:50:54.963744+0000","last_became_peered":"2023-08-10T11:50:54.963744+0000","last_unstale":"2023-08-10T11:52:18.503698+0000","last_undegraded":"2023-08-10T11:52:18.503698+0000","last_fullsized":"2023-08-10T11:52:18.503698+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:38:53.944486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:23.279365+0000","last_change":"2023-08-10T11:51:50.242773+0000","last_active":"2023-08-10T11:52:23.279365+0000","last_peered":"2023-08-10T11:52:23.279365+0000","last_clean":"2023-08-10T11:52:23.279365+0000","last_became_active":"2023-08-10T11:51:50.231825+0000","last_became_peered":"2023-08-10T11:51:50.231825+0000","last_unstale":"2023-08-10T11:52:23.279365+0000","last_undegraded":"2023-08-10T11:52:23.279365+0000","last_fullsized":"2023-08-10T11:52:23.279365+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:05:02.299515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":77,"num_read_kb":77,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.505872+0000","last_change":"2023-08-10T11:50:54.961422+0000","last_active":"2023-08-10T11:52:18.505872+0000","last_peered":"2023-08-10T11:52:18.505872+0000","last_clean":"2023-08-10T11:52:18.505872+0000","last_became_active":"2023-08-10T11:50:54.960627+0000","last_became_peered":"2023-08-10T11:50:54.960627+0000","last_unstale":"2023-08-10T11:52:18.505872+0000","last_undegraded":"2023-08-10T11:52:18.505872+0000","last_fullsized":"2023-08-10T11:52:18.505872+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:39:24.168437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:50.151329+0000","last_change":"2023-08-10T11:50:53.907291+0000","last_active":"2023-08-10T11:51:50.151329+0000","last_peered":"2023-08-10T11:51:50.151329+0000","last_clean":"2023-08-10T11:51:50.151329+0000","last_became_active":"2023-08-10T11:50:53.906997+0000","last_became_peered":"2023-08-10T11:50:53.906997+0000","last_unstale":"2023-08-10T11:51:50.151329+0000","last_undegraded":"2023-08-10T11:51:50.151329+0000","last_fullsized":"2023-08-10T11:51:50.151329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:38:08.640581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.524609+0000","last_change":"2023-08-10T11:50:54.940828+0000","last_active":"2023-08-10T11:52:18.524609+0000","last_peered":"2023-08-10T11:52:18.524609+0000","last_clean":"2023-08-10T11:52:18.524609+0000","last_became_active":"2023-08-10T11:50:54.940169+0000","last_became_peered":"2023-08-10T11:50:54.940169+0000","last_unstale":"2023-08-10T11:52:18.524609+0000","last_undegraded":"2023-08-10T11:52:18.524609+0000","last_fullsized":"2023-08-10T11:52:18.524609+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:24:33.034519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.648534+0000","last_change":"2023-08-10T11:50:53.906366+0000","last_active":"2023-08-10T11:51:49.648534+0000","last_peered":"2023-08-10T11:51:49.648534+0000","last_clean":"2023-08-10T11:51:49.648534+0000","last_became_active":"2023-08-10T11:50:53.906057+0000","last_became_peered":"2023-08-10T11:50:53.906057+0000","last_unstale":"2023-08-10T11:51:49.648534+0000","last_undegraded":"2023-08-10T11:51:49.648534+0000","last_fullsized":"2023-08-10T11:51:49.648534+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:30:54.764094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.524595+0000","last_change":"2023-08-10T11:50:54.908534+0000","last_active":"2023-08-10T11:52:18.524595+0000","last_peered":"2023-08-10T11:52:18.524595+0000","last_clean":"2023-08-10T11:52:18.524595+0000","last_became_active":"2023-08-10T11:50:54.908244+0000","last_became_peered":"2023-08-10T11:50:54.908244+0000","last_unstale":"2023-08-10T11:52:18.524595+0000","last_undegraded":"2023-08-10T11:52:18.524595+0000","last_fullsized":"2023-08-10T11:52:18.524595+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:47:54.968386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.648328+0000","last_change":"2023-08-10T11:50:53.902325+0000","last_active":"2023-08-10T11:51:49.648328+0000","last_peered":"2023-08-10T11:51:49.648328+0000","last_clean":"2023-08-10T11:51:49.648328+0000","last_became_active":"2023-08-10T11:50:53.902020+0000","last_became_peered":"2023-08-10T11:50:53.902020+0000","last_unstale":"2023-08-10T11:51:49.648328+0000","last_undegraded":"2023-08-10T11:51:49.648328+0000","last_fullsized":"2023-08-10T11:51:49.648328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:38:19.283511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.519269+0000","last_change":"2023-08-10T11:50:54.910291+0000","last_active":"2023-08-10T11:52:18.519269+0000","last_peered":"2023-08-10T11:52:18.519269+0000","last_clean":"2023-08-10T11:52:18.519269+0000","last_became_active":"2023-08-10T11:50:54.909886+0000","last_became_peered":"2023-08-10T11:50:54.909886+0000","last_unstale":"2023-08-10T11:52:18.519269+0000","last_undegraded":"2023-08-10T11:52:18.519269+0000","last_fullsized":"2023-08-10T11:52:18.519269+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:50:14.009986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'5","reported_seq":109,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:20.633349+0000","last_change":"2023-08-10T11:50:53.904363+0000","last_active":"2023-08-10T11:52:20.633349+0000","last_peered":"2023-08-10T11:52:20.633349+0000","last_clean":"2023-08-10T11:52:20.633349+0000","last_became_active":"2023-08-10T11:50:53.904049+0000","last_became_peered":"2023-08-10T11:50:53.904049+0000","last_unstale":"2023-08-10T11:52:20.633349+0000","last_undegraded":"2023-08-10T11:52:20.633349+0000","last_fullsized":"2023-08-10T11:52:20.633349+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:39:46.229197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.509027+0000","last_change":"2023-08-10T11:51:49.652004+0000","last_active":"2023-08-10T11:52:18.509027+0000","last_peered":"2023-08-10T11:52:18.509027+0000","last_clean":"2023-08-10T11:52:18.509027+0000","last_became_active":"2023-08-10T11:51:49.651676+0000","last_became_peered":"2023-08-10T11:51:49.651676+0000","last_unstale":"2023-08-10T11:52:18.509027+0000","last_undegraded":"2023-08-10T11:52:18.509027+0000","last_fullsized":"2023-08-10T11:52:18.509027+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:19:00.457378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.649031+0000","last_change":"2023-08-10T11:50:53.901161+0000","last_active":"2023-08-10T11:51:49.649031+0000","last_peered":"2023-08-10T11:51:49.649031+0000","last_clean":"2023-08-10T11:51:49.649031+0000","last_became_active":"2023-08-10T11:50:53.900806+0000","last_became_peered":"2023-08-10T11:50:53.900806+0000","last_unstale":"2023-08-10T11:51:49.649031+0000","last_undegraded":"2023-08-10T11:51:49.649031+0000","last_fullsized":"2023-08-10T11:51:49.649031+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:17:50.056350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.515867+0000","last_change":"2023-08-10T11:50:54.905753+0000","last_active":"2023-08-10T11:52:18.515867+0000","last_peered":"2023-08-10T11:52:18.515867+0000","last_clean":"2023-08-10T11:52:18.515867+0000","last_became_active":"2023-08-10T11:50:54.905463+0000","last_became_peered":"2023-08-10T11:50:54.905463+0000","last_unstale":"2023-08-10T11:52:18.515867+0000","last_undegraded":"2023-08-10T11:52:18.515867+0000","last_fullsized":"2023-08-10T11:52:18.515867+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:36:59.884914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.645068+0000","last_change":"2023-08-10T11:50:53.895021+0000","last_active":"2023-08-10T11:51:49.645068+0000","last_peered":"2023-08-10T11:51:49.645068+0000","last_clean":"2023-08-10T11:51:49.645068+0000","last_became_active":"2023-08-10T11:50:53.894732+0000","last_became_peered":"2023-08-10T11:50:53.894732+0000","last_unstale":"2023-08-10T11:51:49.645068+0000","last_undegraded":"2023-08-10T11:51:49.645068+0000","last_fullsized":"2023-08-10T11:51:49.645068+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:40:51.375268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.509399+0000","last_change":"2023-08-10T11:51:49.905280+0000","last_active":"2023-08-10T11:52:18.509399+0000","last_peered":"2023-08-10T11:52:18.509399+0000","last_clean":"2023-08-10T11:52:18.509399+0000","last_became_active":"2023-08-10T11:51:49.904907+0000","last_became_peered":"2023-08-10T11:51:49.904907+0000","last_unstale":"2023-08-10T11:52:18.509399+0000","last_undegraded":"2023-08-10T11:52:18.509399+0000","last_fullsized":"2023-08-10T11:52:18.509399+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:19:37.005133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:50.254434+0000","last_change":"2023-08-10T11:50:53.899939+0000","last_active":"2023-08-10T11:51:50.254434+0000","last_peered":"2023-08-10T11:51:50.254434+0000","last_clean":"2023-08-10T11:51:50.254434+0000","last_became_active":"2023-08-10T11:50:53.899648+0000","last_became_peered":"2023-08-10T11:50:53.899648+0000","last_unstale":"2023-08-10T11:51:50.254434+0000","last_undegraded":"2023-08-10T11:51:50.254434+0000","last_fullsized":"2023-08-10T11:51:50.254434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:36:22.989138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.508840+0000","last_change":"2023-08-10T11:50:54.959487+0000","last_active":"2023-08-10T11:52:18.508840+0000","last_peered":"2023-08-10T11:52:18.508840+0000","last_clean":"2023-08-10T11:52:18.508840+0000","last_became_active":"2023-08-10T11:50:54.959153+0000","last_became_peered":"2023-08-10T11:50:54.959153+0000","last_unstale":"2023-08-10T11:52:18.508840+0000","last_undegraded":"2023-08-10T11:52:18.508840+0000","last_fullsized":"2023-08-10T11:52:18.508840+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:19:22.749093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'5","reported_seq":194,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:24.639818+0000","last_change":"2023-08-10T11:50:53.898037+0000","last_active":"2023-08-10T11:52:24.639818+0000","last_peered":"2023-08-10T11:52:24.639818+0000","last_clean":"2023-08-10T11:52:24.639818+0000","last_became_active":"2023-08-10T11:50:53.897715+0000","last_became_peered":"2023-08-10T11:50:53.897715+0000","last_unstale":"2023-08-10T11:52:24.639818+0000","last_undegraded":"2023-08-10T11:52:24.639818+0000","last_fullsized":"2023-08-10T11:52:24.639818+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:20:04.670260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":171,"num_read_kb":171,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.523129+0000","last_change":"2023-08-10T11:50:54.908337+0000","last_active":"2023-08-10T11:52:18.523129+0000","last_peered":"2023-08-10T11:52:18.523129+0000","last_clean":"2023-08-10T11:52:18.523129+0000","last_became_active":"2023-08-10T11:50:54.907990+0000","last_became_peered":"2023-08-10T11:50:54.907990+0000","last_unstale":"2023-08-10T11:52:18.523129+0000","last_undegraded":"2023-08-10T11:52:18.523129+0000","last_fullsized":"2023-08-10T11:52:18.523129+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:31:10.108965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.647765+0000","last_change":"2023-08-10T11:50:53.901498+0000","last_active":"2023-08-10T11:51:49.647765+0000","last_peered":"2023-08-10T11:51:49.647765+0000","last_clean":"2023-08-10T11:51:49.647765+0000","last_became_active":"2023-08-10T11:50:53.901146+0000","last_became_peered":"2023-08-10T11:50:53.901146+0000","last_unstale":"2023-08-10T11:51:49.647765+0000","last_undegraded":"2023-08-10T11:51:49.647765+0000","last_fullsized":"2023-08-10T11:51:49.647765+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:19:18.819828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.517381+0000","last_change":"2023-08-10T11:50:54.901550+0000","last_active":"2023-08-10T11:52:18.517381+0000","last_peered":"2023-08-10T11:52:18.517381+0000","last_clean":"2023-08-10T11:52:18.517381+0000","last_became_active":"2023-08-10T11:50:54.901214+0000","last_became_peered":"2023-08-10T11:50:54.901214+0000","last_unstale":"2023-08-10T11:52:18.517381+0000","last_undegraded":"2023-08-10T11:52:18.517381+0000","last_fullsized":"2023-08-10T11:52:18.517381+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:18:47.307577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:50.254486+0000","last_change":"2023-08-10T11:50:53.901337+0000","last_active":"2023-08-10T11:51:50.254486+0000","last_peered":"2023-08-10T11:51:50.254486+0000","last_clean":"2023-08-10T11:51:50.254486+0000","last_became_active":"2023-08-10T11:50:53.901005+0000","last_became_peered":"2023-08-10T11:50:53.901005+0000","last_unstale":"2023-08-10T11:51:50.254486+0000","last_undegraded":"2023-08-10T11:51:50.254486+0000","last_fullsized":"2023-08-10T11:51:50.254486+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:49:14.022036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.524258+0000","last_change":"2023-08-10T11:50:54.905466+0000","last_active":"2023-08-10T11:52:18.524258+0000","last_peered":"2023-08-10T11:52:18.524258+0000","last_clean":"2023-08-10T11:52:18.524258+0000","last_became_active":"2023-08-10T11:50:54.905175+0000","last_became_peered":"2023-08-10T11:50:54.905175+0000","last_unstale":"2023-08-10T11:52:18.524258+0000","last_undegraded":"2023-08-10T11:52:18.524258+0000","last_fullsized":"2023-08-10T11:52:18.524258+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:47:31.552287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'34","reported_seq":236,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:24.640752+0000","last_change":"2023-08-10T11:50:53.894717+0000","last_active":"2023-08-10T11:52:24.640752+0000","last_peered":"2023-08-10T11:52:24.640752+0000","last_clean":"2023-08-10T11:52:24.640752+0000","last_became_active":"2023-08-10T11:50:53.894390+0000","last_became_peered":"2023-08-10T11:50:53.894390+0000","last_unstale":"2023-08-10T11:52:24.640752+0000","last_undegraded":"2023-08-10T11:52:24.640752+0000","last_fullsized":"2023-08-10T11:52:24.640752+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:27:27.793650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62187,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":184,"num_read_kb":147,"num_write":36,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.512511+0000","last_change":"2023-08-10T11:50:54.908021+0000","last_active":"2023-08-10T11:52:18.512511+0000","last_peered":"2023-08-10T11:52:18.512511+0000","last_clean":"2023-08-10T11:52:18.512511+0000","last_became_active":"2023-08-10T11:50:54.907527+0000","last_became_peered":"2023-08-10T11:50:54.907527+0000","last_unstale":"2023-08-10T11:52:18.512511+0000","last_undegraded":"2023-08-10T11:52:18.512511+0000","last_fullsized":"2023-08-10T11:52:18.512511+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:00:47.270564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.645734+0000","last_change":"2023-08-10T11:50:53.906448+0000","last_active":"2023-08-10T11:51:49.645734+0000","last_peered":"2023-08-10T11:51:49.645734+0000","last_clean":"2023-08-10T11:51:49.645734+0000","last_became_active":"2023-08-10T11:50:53.906157+0000","last_became_peered":"2023-08-10T11:50:53.906157+0000","last_unstale":"2023-08-10T11:51:49.645734+0000","last_undegraded":"2023-08-10T11:51:49.645734+0000","last_fullsized":"2023-08-10T11:51:49.645734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:24:30.851722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.516150+0000","last_change":"2023-08-10T11:50:54.906467+0000","last_active":"2023-08-10T11:52:18.516150+0000","last_peered":"2023-08-10T11:52:18.516150+0000","last_clean":"2023-08-10T11:52:18.516150+0000","last_became_active":"2023-08-10T11:50:54.901119+0000","last_became_peered":"2023-08-10T11:50:54.901119+0000","last_unstale":"2023-08-10T11:52:18.516150+0000","last_undegraded":"2023-08-10T11:52:18.516150+0000","last_fullsized":"2023-08-10T11:52:18.516150+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:36:00.415680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:50.254434+0000","last_change":"2023-08-10T11:50:53.906435+0000","last_active":"2023-08-10T11:51:50.254434+0000","last_peered":"2023-08-10T11:51:50.254434+0000","last_clean":"2023-08-10T11:51:50.254434+0000","last_became_active":"2023-08-10T11:50:53.905545+0000","last_became_peered":"2023-08-10T11:50:53.905545+0000","last_unstale":"2023-08-10T11:51:50.254434+0000","last_undegraded":"2023-08-10T11:51:50.254434+0000","last_fullsized":"2023-08-10T11:51:50.254434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:57:09.505126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.520305+0000","last_change":"2023-08-10T11:51:49.650294+0000","last_active":"2023-08-10T11:52:18.520305+0000","last_peered":"2023-08-10T11:52:18.520305+0000","last_clean":"2023-08-10T11:52:18.520305+0000","last_became_active":"2023-08-10T11:51:49.649843+0000","last_became_peered":"2023-08-10T11:51:49.649843+0000","last_unstale":"2023-08-10T11:52:18.520305+0000","last_undegraded":"2023-08-10T11:52:18.520305+0000","last_fullsized":"2023-08-10T11:52:18.520305+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:42:09.106998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":110,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:24.669378+0000","last_change":"2023-08-10T11:50:53.898252+0000","last_active":"2023-08-10T11:52:24.669378+0000","last_peered":"2023-08-10T11:52:24.669378+0000","last_clean":"2023-08-10T11:52:24.669378+0000","last_became_active":"2023-08-10T11:50:53.897992+0000","last_became_peered":"2023-08-10T11:50:53.897992+0000","last_unstale":"2023-08-10T11:52:24.669378+0000","last_undegraded":"2023-08-10T11:52:24.669378+0000","last_fullsized":"2023-08-10T11:52:24.669378+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:47:25.880201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.511719+0000","last_change":"2023-08-10T11:50:54.913297+0000","last_active":"2023-08-10T11:52:18.511719+0000","last_peered":"2023-08-10T11:52:18.511719+0000","last_clean":"2023-08-10T11:52:18.511719+0000","last_became_active":"2023-08-10T11:50:54.912997+0000","last_became_peered":"2023-08-10T11:50:54.912997+0000","last_unstale":"2023-08-10T11:52:18.511719+0000","last_undegraded":"2023-08-10T11:52:18.511719+0000","last_fullsized":"2023-08-10T11:52:18.511719+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:24:06.668386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.647911+0000","last_change":"2023-08-10T11:50:53.904095+0000","last_active":"2023-08-10T11:51:49.647911+0000","last_peered":"2023-08-10T11:51:49.647911+0000","last_clean":"2023-08-10T11:51:49.647911+0000","last_became_active":"2023-08-10T11:50:53.903712+0000","last_became_peered":"2023-08-10T11:50:53.903712+0000","last_unstale":"2023-08-10T11:51:49.647911+0000","last_undegraded":"2023-08-10T11:51:49.647911+0000","last_fullsized":"2023-08-10T11:51:49.647911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:03:23.690223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.519308+0000","last_change":"2023-08-10T11:50:54.904763+0000","last_active":"2023-08-10T11:52:18.519308+0000","last_peered":"2023-08-10T11:52:18.519308+0000","last_clean":"2023-08-10T11:52:18.519308+0000","last_became_active":"2023-08-10T11:50:54.904467+0000","last_became_peered":"2023-08-10T11:50:54.904467+0000","last_unstale":"2023-08-10T11:52:18.519308+0000","last_undegraded":"2023-08-10T11:52:18.519308+0000","last_fullsized":"2023-08-10T11:52:18.519308+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:50:10.747719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.648580+0000","last_change":"2023-08-10T11:50:53.904605+0000","last_active":"2023-08-10T11:51:49.648580+0000","last_peered":"2023-08-10T11:51:49.648580+0000","last_clean":"2023-08-10T11:51:49.648580+0000","last_became_active":"2023-08-10T11:50:53.904236+0000","last_became_peered":"2023-08-10T11:50:53.904236+0000","last_unstale":"2023-08-10T11:51:49.648580+0000","last_undegraded":"2023-08-10T11:51:49.648580+0000","last_fullsized":"2023-08-10T11:51:49.648580+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:45:39.040420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.510048+0000","last_change":"2023-08-10T11:50:54.903881+0000","last_active":"2023-08-10T11:52:18.510048+0000","last_peered":"2023-08-10T11:52:18.510048+0000","last_clean":"2023-08-10T11:52:18.510048+0000","last_became_active":"2023-08-10T11:50:54.903563+0000","last_became_peered":"2023-08-10T11:50:54.903563+0000","last_unstale":"2023-08-10T11:52:18.510048+0000","last_undegraded":"2023-08-10T11:52:18.510048+0000","last_fullsized":"2023-08-10T11:52:18.510048+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:52:13.889541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.905322+0000","last_change":"2023-08-10T11:51:49.905322+0000","last_active":"2023-08-10T11:51:49.905322+0000","last_peered":"2023-08-10T11:51:49.905322+0000","last_clean":"2023-08-10T11:51:49.905322+0000","last_became_active":"2023-08-10T11:51:49.904918+0000","last_became_peered":"2023-08-10T11:51:49.904918+0000","last_unstale":"2023-08-10T11:51:49.905322+0000","last_undegraded":"2023-08-10T11:51:49.905322+0000","last_fullsized":"2023-08-10T11:51:49.905322+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:28:04.207502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.515886+0000","last_change":"2023-08-10T11:50:54.906531+0000","last_active":"2023-08-10T11:52:18.515886+0000","last_peered":"2023-08-10T11:52:18.515886+0000","last_clean":"2023-08-10T11:52:18.515886+0000","last_became_active":"2023-08-10T11:50:54.906239+0000","last_became_peered":"2023-08-10T11:50:54.906239+0000","last_unstale":"2023-08-10T11:52:18.515886+0000","last_undegraded":"2023-08-10T11:52:18.515886+0000","last_fullsized":"2023-08-10T11:52:18.515886+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:16:28.328008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":108,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:24.281487+0000","last_change":"2023-08-10T11:50:53.899835+0000","last_active":"2023-08-10T11:52:24.281487+0000","last_peered":"2023-08-10T11:52:24.281487+0000","last_clean":"2023-08-10T11:52:24.281487+0000","last_became_active":"2023-08-10T11:50:53.898318+0000","last_became_peered":"2023-08-10T11:50:53.898318+0000","last_unstale":"2023-08-10T11:52:24.281487+0000","last_undegraded":"2023-08-10T11:52:24.281487+0000","last_fullsized":"2023-08-10T11:52:24.281487+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:18:26.753294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":85,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.516846+0000","last_change":"2023-08-10T11:51:49.651543+0000","last_active":"2023-08-10T11:52:18.516846+0000","last_peered":"2023-08-10T11:52:18.516846+0000","last_clean":"2023-08-10T11:52:18.516846+0000","last_became_active":"2023-08-10T11:51:49.651250+0000","last_became_peered":"2023-08-10T11:51:49.651250+0000","last_unstale":"2023-08-10T11:52:18.516846+0000","last_undegraded":"2023-08-10T11:52:18.516846+0000","last_fullsized":"2023-08-10T11:52:18.516846+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:54:51.559253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.513046+0000","last_change":"2023-08-10T11:50:54.910544+0000","last_active":"2023-08-10T11:52:18.513046+0000","last_peered":"2023-08-10T11:52:18.513046+0000","last_clean":"2023-08-10T11:52:18.513046+0000","last_became_active":"2023-08-10T11:50:54.910210+0000","last_became_peered":"2023-08-10T11:50:54.910210+0000","last_unstale":"2023-08-10T11:52:18.513046+0000","last_undegraded":"2023-08-10T11:52:18.513046+0000","last_fullsized":"2023-08-10T11:52:18.513046+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:19:19.096119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":108,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:23.667001+0000","last_change":"2023-08-10T11:50:53.906293+0000","last_active":"2023-08-10T11:52:23.667001+0000","last_peered":"2023-08-10T11:52:23.667001+0000","last_clean":"2023-08-10T11:52:23.667001+0000","last_became_active":"2023-08-10T11:50:53.905998+0000","last_became_peered":"2023-08-10T11:50:53.905998+0000","last_unstale":"2023-08-10T11:52:23.667001+0000","last_undegraded":"2023-08-10T11:52:23.667001+0000","last_fullsized":"2023-08-10T11:52:23.667001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:16:54.570216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.511276+0000","last_change":"2023-08-10T11:50:54.960147+0000","last_active":"2023-08-10T11:52:18.511276+0000","last_peered":"2023-08-10T11:52:18.511276+0000","last_clean":"2023-08-10T11:52:18.511276+0000","last_became_active":"2023-08-10T11:50:54.959842+0000","last_became_peered":"2023-08-10T11:50:54.959842+0000","last_unstale":"2023-08-10T11:52:18.511276+0000","last_undegraded":"2023-08-10T11:52:18.511276+0000","last_fullsized":"2023-08-10T11:52:18.511276+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:11:47.254665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:50.229596+0000","last_change":"2023-08-10T11:50:53.899292+0000","last_active":"2023-08-10T11:51:50.229596+0000","last_peered":"2023-08-10T11:51:50.229596+0000","last_clean":"2023-08-10T11:51:50.229596+0000","last_became_active":"2023-08-10T11:50:53.898917+0000","last_became_peered":"2023-08-10T11:50:53.898917+0000","last_unstale":"2023-08-10T11:51:50.229596+0000","last_undegraded":"2023-08-10T11:51:50.229596+0000","last_fullsized":"2023-08-10T11:51:50.229596+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:26:56.629842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":345,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.647330+0000","last_change":"2023-08-10T11:49:54.492617+0000","last_active":"2023-08-10T11:51:49.647330+0000","last_peered":"2023-08-10T11:51:49.647330+0000","last_clean":"2023-08-10T11:51:49.647330+0000","last_became_active":"2023-08-10T11:49:54.492146+0000","last_became_peered":"2023-08-10T11:49:54.492146+0000","last_unstale":"2023-08-10T11:51:49.647330+0000","last_undegraded":"2023-08-10T11:51:49.647330+0000","last_fullsized":"2023-08-10T11:51:49.647330+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:46:58.862300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:46:58.862300+0000","last_clean_scrub_stamp":"2023-08-10T11:46:58.862300+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:07:45.490118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.511341+0000","last_change":"2023-08-10T11:50:54.907704+0000","last_active":"2023-08-10T11:52:18.511341+0000","last_peered":"2023-08-10T11:52:18.511341+0000","last_clean":"2023-08-10T11:52:18.511341+0000","last_became_active":"2023-08-10T11:50:54.907409+0000","last_became_peered":"2023-08-10T11:50:54.907409+0000","last_unstale":"2023-08-10T11:52:18.511341+0000","last_undegraded":"2023-08-10T11:52:18.511341+0000","last_fullsized":"2023-08-10T11:52:18.511341+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:48:34.334091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.647261+0000","last_change":"2023-08-10T11:50:53.902548+0000","last_active":"2023-08-10T11:51:49.647261+0000","last_peered":"2023-08-10T11:51:49.647261+0000","last_clean":"2023-08-10T11:51:49.647261+0000","last_became_active":"2023-08-10T11:50:53.902021+0000","last_became_peered":"2023-08-10T11:50:53.902021+0000","last_unstale":"2023-08-10T11:51:49.647261+0000","last_undegraded":"2023-08-10T11:51:49.647261+0000","last_fullsized":"2023-08-10T11:51:49.647261+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:38:41.663639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.648441+0000","last_change":"2023-08-10T11:50:53.906326+0000","last_active":"2023-08-10T11:51:49.648441+0000","last_peered":"2023-08-10T11:51:49.648441+0000","last_clean":"2023-08-10T11:51:49.648441+0000","last_became_active":"2023-08-10T11:50:53.906017+0000","last_became_peered":"2023-08-10T11:50:53.906017+0000","last_unstale":"2023-08-10T11:51:49.648441+0000","last_undegraded":"2023-08-10T11:51:49.648441+0000","last_fullsized":"2023-08-10T11:51:49.648441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:58:22.859318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.514258+0000","last_change":"2023-08-10T11:50:54.906513+0000","last_active":"2023-08-10T11:52:18.514258+0000","last_peered":"2023-08-10T11:52:18.514258+0000","last_clean":"2023-08-10T11:52:18.514258+0000","last_became_active":"2023-08-10T11:50:54.901642+0000","last_became_peered":"2023-08-10T11:50:54.901642+0000","last_unstale":"2023-08-10T11:52:18.514258+0000","last_undegraded":"2023-08-10T11:52:18.514258+0000","last_fullsized":"2023-08-10T11:52:18.514258+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:39:01.747637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'11","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:19.690281+0000","last_change":"2023-08-10T11:50:53.908025+0000","last_active":"2023-08-10T11:52:19.690281+0000","last_peered":"2023-08-10T11:52:19.690281+0000","last_clean":"2023-08-10T11:52:19.690281+0000","last_became_active":"2023-08-10T11:50:53.907745+0000","last_became_peered":"2023-08-10T11:50:53.907745+0000","last_unstale":"2023-08-10T11:52:19.690281+0000","last_undegraded":"2023-08-10T11:52:19.690281+0000","last_fullsized":"2023-08-10T11:52:19.690281+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:06:52.964591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.514530+0000","last_change":"2023-08-10T11:50:54.958653+0000","last_active":"2023-08-10T11:52:18.514530+0000","last_peered":"2023-08-10T11:52:18.514530+0000","last_clean":"2023-08-10T11:52:18.514530+0000","last_became_active":"2023-08-10T11:50:54.958281+0000","last_became_peered":"2023-08-10T11:50:54.958281+0000","last_unstale":"2023-08-10T11:52:18.514530+0000","last_undegraded":"2023-08-10T11:52:18.514530+0000","last_fullsized":"2023-08-10T11:52:18.514530+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:21:48.120998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:50.229654+0000","last_change":"2023-08-10T11:50:53.895770+0000","last_active":"2023-08-10T11:51:50.229654+0000","last_peered":"2023-08-10T11:51:50.229654+0000","last_clean":"2023-08-10T11:51:50.229654+0000","last_became_active":"2023-08-10T11:50:53.895433+0000","last_became_peered":"2023-08-10T11:50:53.895433+0000","last_unstale":"2023-08-10T11:51:50.229654+0000","last_undegraded":"2023-08-10T11:51:50.229654+0000","last_fullsized":"2023-08-10T11:51:50.229654+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:11:48.769660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.517250+0000","last_change":"2023-08-10T11:50:54.957297+0000","last_active":"2023-08-10T11:52:18.517250+0000","last_peered":"2023-08-10T11:52:18.517250+0000","last_clean":"2023-08-10T11:52:18.517250+0000","last_became_active":"2023-08-10T11:50:54.956966+0000","last_became_peered":"2023-08-10T11:50:54.956966+0000","last_unstale":"2023-08-10T11:52:18.517250+0000","last_undegraded":"2023-08-10T11:52:18.517250+0000","last_fullsized":"2023-08-10T11:52:18.517250+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:38:11.077269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.908404+0000","last_change":"2023-08-10T11:51:49.908404+0000","last_active":"2023-08-10T11:51:49.908404+0000","last_peered":"2023-08-10T11:51:49.908404+0000","last_clean":"2023-08-10T11:51:49.908404+0000","last_became_active":"2023-08-10T11:51:49.904994+0000","last_became_peered":"2023-08-10T11:51:49.904994+0000","last_unstale":"2023-08-10T11:51:49.908404+0000","last_undegraded":"2023-08-10T11:51:49.908404+0000","last_fullsized":"2023-08-10T11:51:49.908404+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:07:30.549050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.479893+0000","last_change":"2023-08-10T11:50:54.908185+0000","last_active":"2023-08-10T11:52:18.479893+0000","last_peered":"2023-08-10T11:52:18.479893+0000","last_clean":"2023-08-10T11:52:18.479893+0000","last_became_active":"2023-08-10T11:50:54.907649+0000","last_became_peered":"2023-08-10T11:50:54.907649+0000","last_unstale":"2023-08-10T11:52:18.479893+0000","last_undegraded":"2023-08-10T11:52:18.479893+0000","last_fullsized":"2023-08-10T11:52:18.479893+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:40:30.222828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:50.151298+0000","last_change":"2023-08-10T11:50:53.908748+0000","last_active":"2023-08-10T11:51:50.151298+0000","last_peered":"2023-08-10T11:51:50.151298+0000","last_clean":"2023-08-10T11:51:50.151298+0000","last_became_active":"2023-08-10T11:50:53.908494+0000","last_became_peered":"2023-08-10T11:50:53.908494+0000","last_unstale":"2023-08-10T11:51:50.151298+0000","last_undegraded":"2023-08-10T11:51:50.151298+0000","last_fullsized":"2023-08-10T11:51:50.151298+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:27:58.338302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.514270+0000","last_change":"2023-08-10T11:50:54.903493+0000","last_active":"2023-08-10T11:52:18.514270+0000","last_peered":"2023-08-10T11:52:18.514270+0000","last_clean":"2023-08-10T11:52:18.514270+0000","last_became_active":"2023-08-10T11:50:54.903118+0000","last_became_peered":"2023-08-10T11:50:54.903118+0000","last_unstale":"2023-08-10T11:52:18.514270+0000","last_undegraded":"2023-08-10T11:52:18.514270+0000","last_fullsized":"2023-08-10T11:52:18.514270+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:44:59.035303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.645508+0000","last_change":"2023-08-10T11:50:53.905075+0000","last_active":"2023-08-10T11:51:49.645508+0000","last_peered":"2023-08-10T11:51:49.645508+0000","last_clean":"2023-08-10T11:51:49.645508+0000","last_became_active":"2023-08-10T11:50:53.904769+0000","last_became_peered":"2023-08-10T11:50:53.904769+0000","last_unstale":"2023-08-10T11:51:49.645508+0000","last_undegraded":"2023-08-10T11:51:49.645508+0000","last_fullsized":"2023-08-10T11:51:49.645508+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:05:15.250724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.513888+0000","last_change":"2023-08-10T11:50:54.963860+0000","last_active":"2023-08-10T11:52:18.513888+0000","last_peered":"2023-08-10T11:52:18.513888+0000","last_clean":"2023-08-10T11:52:18.513888+0000","last_became_active":"2023-08-10T11:50:54.963335+0000","last_became_peered":"2023-08-10T11:50:54.963335+0000","last_unstale":"2023-08-10T11:52:18.513888+0000","last_undegraded":"2023-08-10T11:52:18.513888+0000","last_fullsized":"2023-08-10T11:52:18.513888+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:49:54.348522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.648142+0000","last_change":"2023-08-10T11:50:53.899673+0000","last_active":"2023-08-10T11:51:49.648142+0000","last_peered":"2023-08-10T11:51:49.648142+0000","last_clean":"2023-08-10T11:51:49.648142+0000","last_became_active":"2023-08-10T11:50:53.898830+0000","last_became_peered":"2023-08-10T11:50:53.898830+0000","last_unstale":"2023-08-10T11:51:49.648142+0000","last_undegraded":"2023-08-10T11:51:49.648142+0000","last_fullsized":"2023-08-10T11:51:49.648142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:03:06.415674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.522208+0000","last_change":"2023-08-10T11:50:54.900606+0000","last_active":"2023-08-10T11:52:18.522208+0000","last_peered":"2023-08-10T11:52:18.522208+0000","last_clean":"2023-08-10T11:52:18.522208+0000","last_became_active":"2023-08-10T11:50:54.900293+0000","last_became_peered":"2023-08-10T11:50:54.900293+0000","last_unstale":"2023-08-10T11:52:18.522208+0000","last_undegraded":"2023-08-10T11:52:18.522208+0000","last_fullsized":"2023-08-10T11:52:18.522208+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:30:39.482183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'7","reported_seq":110,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:21.649523+0000","last_change":"2023-08-10T11:50:53.894526+0000","last_active":"2023-08-10T11:52:21.649523+0000","last_peered":"2023-08-10T11:52:21.649523+0000","last_clean":"2023-08-10T11:52:21.649523+0000","last_became_active":"2023-08-10T11:50:53.894211+0000","last_became_peered":"2023-08-10T11:50:53.894211+0000","last_unstale":"2023-08-10T11:52:21.649523+0000","last_undegraded":"2023-08-10T11:52:21.649523+0000","last_fullsized":"2023-08-10T11:52:21.649523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:25:42.483916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1653,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.522978+0000","last_change":"2023-08-10T11:50:54.900511+0000","last_active":"2023-08-10T11:52:18.522978+0000","last_peered":"2023-08-10T11:52:18.522978+0000","last_clean":"2023-08-10T11:52:18.522978+0000","last_became_active":"2023-08-10T11:50:54.900200+0000","last_became_peered":"2023-08-10T11:50:54.900200+0000","last_unstale":"2023-08-10T11:52:18.522978+0000","last_undegraded":"2023-08-10T11:52:18.522978+0000","last_fullsized":"2023-08-10T11:52:18.522978+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:50:34.494222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:50.254733+0000","last_change":"2023-08-10T11:50:53.906235+0000","last_active":"2023-08-10T11:51:50.254733+0000","last_peered":"2023-08-10T11:51:50.254733+0000","last_clean":"2023-08-10T11:51:50.254733+0000","last_became_active":"2023-08-10T11:50:53.905630+0000","last_became_peered":"2023-08-10T11:50:53.905630+0000","last_unstale":"2023-08-10T11:51:50.254733+0000","last_undegraded":"2023-08-10T11:51:50.254733+0000","last_fullsized":"2023-08-10T11:51:50.254733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:28:57.652862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.511265+0000","last_change":"2023-08-10T11:50:54.907280+0000","last_active":"2023-08-10T11:52:18.511265+0000","last_peered":"2023-08-10T11:52:18.511265+0000","last_clean":"2023-08-10T11:52:18.511265+0000","last_became_active":"2023-08-10T11:50:54.906987+0000","last_became_peered":"2023-08-10T11:50:54.906987+0000","last_unstale":"2023-08-10T11:52:18.511265+0000","last_undegraded":"2023-08-10T11:52:18.511265+0000","last_fullsized":"2023-08-10T11:52:18.511265+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:17.214303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.645134+0000","last_change":"2023-08-10T11:50:53.906537+0000","last_active":"2023-08-10T11:51:49.645134+0000","last_peered":"2023-08-10T11:51:49.645134+0000","last_clean":"2023-08-10T11:51:49.645134+0000","last_became_active":"2023-08-10T11:50:53.905975+0000","last_became_peered":"2023-08-10T11:50:53.905975+0000","last_unstale":"2023-08-10T11:51:49.645134+0000","last_undegraded":"2023-08-10T11:51:49.645134+0000","last_fullsized":"2023-08-10T11:51:49.645134+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:07:24.856158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.512484+0000","last_change":"2023-08-10T11:50:54.905656+0000","last_active":"2023-08-10T11:52:18.512484+0000","last_peered":"2023-08-10T11:52:18.512484+0000","last_clean":"2023-08-10T11:52:18.512484+0000","last_became_active":"2023-08-10T11:50:54.905314+0000","last_became_peered":"2023-08-10T11:50:54.905314+0000","last_unstale":"2023-08-10T11:52:18.512484+0000","last_undegraded":"2023-08-10T11:52:18.512484+0000","last_fullsized":"2023-08-10T11:52:18.512484+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:07:15.802238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.508971+0000","last_change":"2023-08-10T11:50:54.911564+0000","last_active":"2023-08-10T11:52:18.508971+0000","last_peered":"2023-08-10T11:52:18.508971+0000","last_clean":"2023-08-10T11:52:18.508971+0000","last_became_active":"2023-08-10T11:50:54.910375+0000","last_became_peered":"2023-08-10T11:50:54.910375+0000","last_unstale":"2023-08-10T11:52:18.508971+0000","last_undegraded":"2023-08-10T11:52:18.508971+0000","last_fullsized":"2023-08-10T11:52:18.508971+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:26:31.205736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.515660+0000","last_change":"2023-08-10T11:50:54.913247+0000","last_active":"2023-08-10T11:52:18.515660+0000","last_peered":"2023-08-10T11:52:18.515660+0000","last_clean":"2023-08-10T11:52:18.515660+0000","last_became_active":"2023-08-10T11:50:54.912941+0000","last_became_peered":"2023-08-10T11:50:54.912941+0000","last_unstale":"2023-08-10T11:52:18.515660+0000","last_undegraded":"2023-08-10T11:52:18.515660+0000","last_fullsized":"2023-08-10T11:52:18.515660+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:20:21.810895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.494303+0000","last_change":"2023-08-10T11:50:54.959735+0000","last_active":"2023-08-10T11:52:18.494303+0000","last_peered":"2023-08-10T11:52:18.494303+0000","last_clean":"2023-08-10T11:52:18.494303+0000","last_became_active":"2023-08-10T11:50:54.959476+0000","last_became_peered":"2023-08-10T11:50:54.959476+0000","last_unstale":"2023-08-10T11:52:18.494303+0000","last_undegraded":"2023-08-10T11:52:18.494303+0000","last_fullsized":"2023-08-10T11:52:18.494303+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:45:42.510412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.516946+0000","last_change":"2023-08-10T11:50:54.942753+0000","last_active":"2023-08-10T11:52:18.516946+0000","last_peered":"2023-08-10T11:52:18.516946+0000","last_clean":"2023-08-10T11:52:18.516946+0000","last_became_active":"2023-08-10T11:50:54.941715+0000","last_became_peered":"2023-08-10T11:50:54.941715+0000","last_unstale":"2023-08-10T11:52:18.516946+0000","last_undegraded":"2023-08-10T11:52:18.516946+0000","last_fullsized":"2023-08-10T11:52:18.516946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:56:27.450708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.514041+0000","last_change":"2023-08-10T11:50:54.898919+0000","last_active":"2023-08-10T11:52:18.514041+0000","last_peered":"2023-08-10T11:52:18.514041+0000","last_clean":"2023-08-10T11:52:18.514041+0000","last_became_active":"2023-08-10T11:50:54.898599+0000","last_became_peered":"2023-08-10T11:50:54.898599+0000","last_unstale":"2023-08-10T11:52:18.514041+0000","last_undegraded":"2023-08-10T11:52:18.514041+0000","last_fullsized":"2023-08-10T11:52:18.514041+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:37:35.242025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.509666+0000","last_change":"2023-08-10T11:50:54.911359+0000","last_active":"2023-08-10T11:52:18.509666+0000","last_peered":"2023-08-10T11:52:18.509666+0000","last_clean":"2023-08-10T11:52:18.509666+0000","last_became_active":"2023-08-10T11:50:54.911049+0000","last_became_peered":"2023-08-10T11:50:54.911049+0000","last_unstale":"2023-08-10T11:52:18.509666+0000","last_undegraded":"2023-08-10T11:52:18.509666+0000","last_fullsized":"2023-08-10T11:52:18.509666+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:15:12.906005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.513742+0000","last_change":"2023-08-10T11:50:54.906811+0000","last_active":"2023-08-10T11:52:18.513742+0000","last_peered":"2023-08-10T11:52:18.513742+0000","last_clean":"2023-08-10T11:52:18.513742+0000","last_became_active":"2023-08-10T11:50:54.906456+0000","last_became_peered":"2023-08-10T11:50:54.906456+0000","last_unstale":"2023-08-10T11:52:18.513742+0000","last_undegraded":"2023-08-10T11:52:18.513742+0000","last_fullsized":"2023-08-10T11:52:18.513742+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:08:08.681010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.512297+0000","last_change":"2023-08-10T11:50:54.957297+0000","last_active":"2023-08-10T11:52:18.512297+0000","last_peered":"2023-08-10T11:52:18.512297+0000","last_clean":"2023-08-10T11:52:18.512297+0000","last_became_active":"2023-08-10T11:50:54.956977+0000","last_became_peered":"2023-08-10T11:50:54.956977+0000","last_unstale":"2023-08-10T11:52:18.512297+0000","last_undegraded":"2023-08-10T11:52:18.512297+0000","last_fullsized":"2023-08-10T11:52:18.512297+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:42:14.272800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.512035+0000","last_change":"2023-08-10T11:50:54.964300+0000","last_active":"2023-08-10T11:52:18.512035+0000","last_peered":"2023-08-10T11:52:18.512035+0000","last_clean":"2023-08-10T11:52:18.512035+0000","last_became_active":"2023-08-10T11:50:54.963876+0000","last_became_peered":"2023-08-10T11:50:54.963876+0000","last_unstale":"2023-08-10T11:52:18.512035+0000","last_undegraded":"2023-08-10T11:52:18.512035+0000","last_fullsized":"2023-08-10T11:52:18.512035+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:21:05.020811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.514754+0000","last_change":"2023-08-10T11:50:54.958661+0000","last_active":"2023-08-10T11:52:18.514754+0000","last_peered":"2023-08-10T11:52:18.514754+0000","last_clean":"2023-08-10T11:52:18.514754+0000","last_became_active":"2023-08-10T11:50:54.958342+0000","last_became_peered":"2023-08-10T11:50:54.958342+0000","last_unstale":"2023-08-10T11:52:18.514754+0000","last_undegraded":"2023-08-10T11:52:18.514754+0000","last_fullsized":"2023-08-10T11:52:18.514754+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:38:54.463137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.524077+0000","last_change":"2023-08-10T11:50:54.902033+0000","last_active":"2023-08-10T11:52:18.524077+0000","last_peered":"2023-08-10T11:52:18.524077+0000","last_clean":"2023-08-10T11:52:18.524077+0000","last_became_active":"2023-08-10T11:50:54.901713+0000","last_became_peered":"2023-08-10T11:50:54.901713+0000","last_unstale":"2023-08-10T11:52:18.524077+0000","last_undegraded":"2023-08-10T11:52:18.524077+0000","last_fullsized":"2023-08-10T11:52:18.524077+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:42:12.029831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.519845+0000","last_change":"2023-08-10T11:50:54.899377+0000","last_active":"2023-08-10T11:52:18.519845+0000","last_peered":"2023-08-10T11:52:18.519845+0000","last_clean":"2023-08-10T11:52:18.519845+0000","last_became_active":"2023-08-10T11:50:54.898657+0000","last_became_peered":"2023-08-10T11:50:54.898657+0000","last_unstale":"2023-08-10T11:52:18.519845+0000","last_undegraded":"2023-08-10T11:52:18.519845+0000","last_fullsized":"2023-08-10T11:52:18.519845+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:49:40.082347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.509905+0000","last_change":"2023-08-10T11:50:54.900304+0000","last_active":"2023-08-10T11:52:18.509905+0000","last_peered":"2023-08-10T11:52:18.509905+0000","last_clean":"2023-08-10T11:52:18.509905+0000","last_became_active":"2023-08-10T11:50:54.899978+0000","last_became_peered":"2023-08-10T11:50:54.899978+0000","last_unstale":"2023-08-10T11:52:18.509905+0000","last_undegraded":"2023-08-10T11:52:18.509905+0000","last_fullsized":"2023-08-10T11:52:18.509905+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:03:38.365482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68948,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":881,"num_read_kb":509,"num_write":240,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":195450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449118,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":447844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.41899999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.495,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.42199999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.57899999999999996,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67000000000000004,"15min":0.67100000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77900000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65200000000000002,"15min":0.65300000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90600000000000003,"5min":1.163,"15min":1.163},"last":0.746}]},{"osd":2,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.38700000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70499999999999996,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.501,"15min":0.502},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.50800000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.82499999999999996,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66100000000000003,"15min":0.66000000000000003},"min":{"1min":0.48899999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.85199999999999998,"5min":1.046,"15min":1.046},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.38600000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.63100000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.621},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.621,"15min":0.61799999999999999},"min":{"1min":0.52200000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81699999999999995,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64400000000000002,"15min":0.65100000000000002},"min":{"1min":0.41999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84099999999999997,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.65400000000000003,"15min":0.65200000000000002},"min":{"1min":0.47299999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.83199999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.78400000000000003,"15min":0.78000000000000003},"min":{"1min":0.60199999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.96199999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.75600000000000001,"15min":0.75700000000000001},"min":{"1min":0.63300000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90500000000000003,"5min":1.224,"15min":1.224},"last":0.85799999999999998}]},{"osd":8,"last update":"Thu Aug 10 11:51:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.874}]},{"osd":9,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.746,"15min":0.74199999999999999},"min":{"1min":0.58099999999999996,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.86399999999999999,"5min":1.024,"15min":1.024},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.79400000000000004,"15min":0.78600000000000003},"min":{"1min":0.65400000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.97499999999999998,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.90200000000000002}]},{"osd":10,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.68300000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.94399999999999995,"5min":1.341,"15min":1.341},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.78900000000000003,"15min":0.78700000000000003},"min":{"1min":0.65500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.91900000000000004,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.80100000000000005}]}]},{"osd":10,"up_from":70,"seq":300647710754,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1630208,"data_stored":1100204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":6.7350000000000003,"5min":6.7350000000000003,"15min":6.7350000000000003},"last":0.432},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":6.7800000000000002,"5min":6.7800000000000002,"15min":6.7800000000000002},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47099999999999997,"15min":0.47499999999999998},"min":{"1min":0.309,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.61099999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.504,"15min":0.51000000000000001},"min":{"1min":0.35999999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.64200000000000002,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.628,"15min":0.626},"min":{"1min":0.442,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.47499999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.64600000000000002}]},{"osd":3,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.627,"15min":0.63900000000000001},"min":{"1min":0.443,"5min":0.432,"15min":0.432},"max":{"1min":0.70499999999999996,"5min":0.878,"15min":0.878},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.65100000000000002,"15min":0.65900000000000003},"min":{"1min":0.41999999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73799999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.62,"15min":0.624},"min":{"1min":0.41099999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80500000000000005,"5min":0.879,"15min":0.879},"last":0.622},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.58799999999999997,"15min":0.59499999999999997},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78200000000000003,"5min":1.177,"15min":1.177},"last":0.72599999999999998}]},{"osd":5,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71699999999999997,"15min":0.71899999999999997},"min":{"1min":0.52400000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84299999999999997,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.88,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.79800000000000004}]},{"osd":6,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73999999999999999,"15min":0.746},"min":{"1min":0.39600000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.464,"5min":2.464,"15min":2.464},"last":0.745},{"interface":"front","average":{"1min":1.0589999999999999,"5min":0.85099999999999998,"15min":0.81699999999999995},"min":{"1min":0.59999999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":7.7110000000000003,"5min":7.7110000000000003,"15min":7.7110000000000003},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":8,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79600000000000004,"15min":0.80000000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.93799999999999994,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.58999999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.94999999999999996,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.81200000000000006}]},{"osd":9,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":0.89600000000000002,"15min":0.86399999999999999},"min":{"1min":0.55400000000000005,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":7.6369999999999996,"5min":7.6369999999999996,"15min":7.6369999999999996},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.81000000000000005,"15min":0.82799999999999996},"min":{"1min":0.52300000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97999999999999998,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.85199999999999998}]},{"osd":11,"last update":"Thu Aug 10 11:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.76700000000000002,"15min":0.76100000000000001},"min":{"1min":0.59699999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.92100000000000004,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.873},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.79000000000000004,"15min":0.78400000000000003},"min":{"1min":0.66900000000000004,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.99399999999999999,"5min":0.998,"15min":0.998},"last":0.88500000000000001}]}]},{"osd":9,"up_from":65,"seq":279172874279,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":447291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.39400000000000002,"15min":0.39800000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.41199999999999998,"15min":0.42199999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.499,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.316}]},{"osd":1,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.58299999999999996,"15min":0.59199999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.66000000000000003,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.59899999999999998,"15min":0.60999999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70599999999999996,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.501}]},{"osd":2,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.61599999999999999,"15min":0.628},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.68300000000000005,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.61599999999999999,"15min":0.628},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73799999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.44500000000000001,"15min":0.45400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.55700000000000005,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50600000000000001,"15min":0.50900000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.63500000000000001,"15min":0.65200000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.66300000000000003,"5min":0.87,"15min":0.87},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.64000000000000001,"15min":0.65400000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80900000000000005,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.46800000000000003}]},{"osd":5,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.622,"15min":0.622},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.68899999999999995,"15min":0.70199999999999996},"min":{"1min":0.42599999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78600000000000003,"5min":1.032,"15min":1.032},"last":0.51900000000000002}]},{"osd":6,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.61899999999999999,"15min":0.629},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.01,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63700000000000001,"15min":0.64300000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.41899999999999998}]},{"osd":7,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65800000000000003,"15min":0.66600000000000004},"min":{"1min":0.44600000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81299999999999994,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.71799999999999997,"15min":0.73499999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.84899999999999998,"5min":1.133,"15min":1.133},"last":0.57599999999999996}]},{"osd":8,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.72399999999999998,"15min":0.73999999999999999},"min":{"1min":0.45800000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80900000000000005,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.95199999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.55000000000000004}]},{"osd":10,"last update":"Thu Aug 10 11:51:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69899999999999995,"15min":0.70699999999999996},"min":{"1min":0.47599999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84099999999999997,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.69799999999999995,"15min":0.70499999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82699999999999996,"5min":1.101,"15min":1.101},"last":0.53000000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":8,"up_from":57,"seq":244813135915,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":446997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.54800000000000004},"min":{"1min":0.42899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81699999999999995,"5min":1.069,"15min":1.069},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.36099999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.79600000000000004,"5min":0.88,"15min":0.88},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Aug 10 11:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.626,"15min":0.61199999999999999},"min":{"1min":0.433,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.64700000000000002,"15min":0.63100000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Aug 10 11:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.44700000000000001,"15min":0.435},"min":{"1min":0.32900000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.48799999999999999,"15min":0.46999999999999997},"min":{"1min":0.28199999999999997,"5min":0.248,"15min":0.248},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Aug 10 11:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.41199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.61899999999999999,"15min":0.56999999999999995},"min":{"1min":0.39400000000000002,"5min":0.374,"15min":0.374},"max":{"1min":5.141,"5min":5.141,"15min":5.141},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Aug 10 11:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.621,"15min":0.59999999999999998},"min":{"1min":0.45700000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65100000000000002,"15min":0.63},"min":{"1min":0.48099999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.877,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Aug 10 11:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58999999999999997,"15min":0.58399999999999996},"min":{"1min":0.376,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56999999999999995,"15min":0.55600000000000005},"min":{"1min":0.39000000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.85299999999999998,"5min":1,"15min":1},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Aug 10 11:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.42099999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.96299999999999997,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73799999999999999,"15min":0.73899999999999999},"min":{"1min":0.53100000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Aug 10 11:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.78100000000000003,"15min":0.76900000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.754},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.72799999999999998,"15min":0.71499999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.85099999999999998}]},{"osd":9,"last update":"Thu Aug 10 11:51:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72499999999999998,"15min":0.71999999999999997},"min":{"1min":0.58299999999999996,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78200000000000003,"15min":0.77600000000000002},"min":{"1min":0.54500000000000004,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.66000000000000003}]},{"osd":10,"last update":"Thu Aug 10 11:51:54 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.77500000000000002,"15min":0.76500000000000001},"min":{"1min":0.67900000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.80400000000000005,"15min":0.79800000000000004},"min":{"1min":0.72999999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.73499999999999999}]},{"osd":11,"last update":"Thu Aug 10 11:51:54 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.81499999999999995}]}]},{"osd":7,"up_from":50,"seq":214748364847,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1544192,"data_stored":1039385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.54500000000000004,"15min":0.53100000000000003},"min":{"1min":0.42099999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.51500000000000001,"15min":0.503},"min":{"1min":0.434,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.40899999999999997}]},{"osd":1,"last update":"Thu Aug 10 11:51:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.432,"15min":0.41199999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63800000000000001,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.501,"5min":0.45500000000000002,"15min":0.432},"min":{"1min":0.36699999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81000000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Aug 10 11:51:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61499999999999999,"15min":0.60799999999999998},"min":{"1min":0.40600000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82799999999999996,"5min":0.878,"15min":0.878},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.60899999999999999,"15min":0.59499999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.876}]},{"osd":3,"last update":"Thu Aug 10 11:51:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.56799999999999995,"15min":0.53800000000000003},"min":{"1min":0.496,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.745},{"interface":"front","average":{"1min":1.012,"5min":0.68400000000000005,"15min":0.61399999999999999},"min":{"1min":0.54300000000000004,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":8.1829999999999998,"5min":8.1829999999999998,"15min":8.1829999999999998},"last":0.80900000000000005}]},{"osd":4,"last update":"Thu Aug 10 11:51:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76100000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35799999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73199999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Aug 10 11:51:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.65700000000000003,"15min":0.64700000000000002},"min":{"1min":0.48499999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.88,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.66100000000000003,"15min":0.63900000000000001},"min":{"1min":0.46200000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.94099999999999995}]},{"osd":6,"last update":"Thu Aug 10 11:51:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.71799999999999997,"15min":0.68899999999999995},"min":{"1min":0.55300000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68799999999999994,"15min":0.67200000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.84499999999999997}]},{"osd":8,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76100000000000001,"15min":0.754},"min":{"1min":0.63100000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.96799999999999997,"5min":1.002,"15min":1.002},"last":1.006},{"interface":"front","average":{"1min":0.754,"5min":0.748,"15min":0.752},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.91500000000000004,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.89400000000000002}]},{"osd":9,"last update":"Thu Aug 10 11:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76100000000000001,"15min":0.75900000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.82299999999999995,"15min":0.82499999999999996},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.0449999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.91200000000000003}]},{"osd":10,"last update":"Thu Aug 10 11:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.81799999999999995,"15min":0.81999999999999995},"min":{"1min":0.60099999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":0.96799999999999997,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76100000000000001,"15min":0.75900000000000001},"min":{"1min":0.56599999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94999999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.99099999999999999}]},{"osd":11,"last update":"Thu Aug 10 11:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":1.024}]}]},{"osd":6,"up_from":45,"seq":193273528372,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":446966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.46700000000000003,"15min":0.38900000000000001},"min":{"1min":0.27500000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":8.9930000000000003,"5min":8.9930000000000003,"15min":8.9930000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":1.03,"5min":0.52900000000000003,"15min":0.434},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":12.326000000000001,"5min":12.326000000000001,"15min":12.326000000000001},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":0.66600000000000004,"15min":0.56399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":11.275,"5min":11.275,"15min":11.275},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.56899999999999995,"15min":0.53800000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.6909999999999998,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":0.69499999999999995,"15min":0.60599999999999998},"min":{"1min":0.40000000000000002,"5min":0.38,"15min":0.38},"max":{"1min":12.244,"5min":12.244,"15min":12.244},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.1619999999999999,"5min":0.68400000000000005,"15min":0.60799999999999998},"min":{"1min":0.443,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":11.195,"5min":11.195,"15min":11.195},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.54300000000000004,"15min":0.44700000000000001},"min":{"1min":0.29799999999999999,"5min":0.254,"15min":0.254},"max":{"1min":11.439,"5min":11.439,"15min":11.439},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.48599999999999999,"15min":0.46800000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.443}]},{"osd":4,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":0.70099999999999996,"15min":0.60499999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":12.272,"5min":12.272,"15min":12.272},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.216,"5min":0.72099999999999997,"15min":0.623},"min":{"1min":0.45300000000000001,"5min":0.433,"15min":0.433},"max":{"1min":11.35,"5min":11.35,"15min":11.35},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.63600000000000001,"15min":0.61599999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":0.505},{"interface":"front","average":{"1min":1.2250000000000001,"5min":0.746,"15min":0.66200000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":12.177,"5min":12.177,"15min":12.177},"last":0.48999999999999999}]},{"osd":7,"last update":"Thu Aug 10 11:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66000000000000003,"15min":0.64700000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.7189999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.1899999999999999,"5min":0.76700000000000002,"15min":0.68700000000000006},"min":{"1min":0.49399999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":11.317,"5min":11.317,"15min":11.317},"last":0.60499999999999998}]},{"osd":8,"last update":"Thu Aug 10 11:52:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":0.78800000000000003,"15min":0.72199999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":11.242000000000001,"5min":11.242000000000001,"15min":11.242000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.3169999999999999,"5min":0.81699999999999995,"15min":0.748},"min":{"1min":0.495,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":12.215,"5min":12.215,"15min":12.215},"last":0.55100000000000005}]},{"osd":9,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":0.77900000000000003,"15min":0.71599999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":12.300000000000001,"5min":12.300000000000001,"15min":12.300000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":1.1539999999999999,"5min":0.78500000000000003,"15min":0.72299999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":11.411,"5min":11.411,"15min":11.411},"last":0.63}]},{"osd":10,"last update":"Thu Aug 10 11:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.72499999999999998,"15min":0.71699999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.7480000000000002,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":0.59299999999999997},{"interface":"front","average":{"1min":1.2909999999999999,"5min":0.875,"15min":0.80500000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":11.379,"5min":11.379,"15min":11.379},"last":0.70499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":504363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.41699999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.54400000000000004,"15min":0.52000000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Aug 10 11:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.64500000000000002,"15min":0.59599999999999997},"min":{"1min":0.39900000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96899999999999997,"5min":1.05,"15min":1.05},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.61699999999999999,"15min":0.57399999999999995},"min":{"1min":0.47599999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86299999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.73899999999999999}]},{"osd":3,"last update":"Thu Aug 10 11:51:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.55200000000000005},"min":{"1min":0.37,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79500000000000004,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.41099999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.35999999999999999}]},{"osd":4,"last update":"Thu Aug 10 11:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.45000000000000001,"15min":0.442},"min":{"1min":0.309,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67200000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.504,"15min":0.48199999999999998},"min":{"1min":0.372,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.83699999999999997,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.41699999999999998}]},{"osd":5,"last update":"Thu Aug 10 11:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.60799999999999998,"15min":0.55200000000000005},"min":{"1min":0.57699999999999996,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.85499999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.628,"15min":0.57199999999999995},"min":{"1min":0.42799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.93500000000000005,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Aug 10 11:51:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65400000000000003,"15min":0.64900000000000002},"min":{"1min":0.42699999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90900000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.754},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58499999999999996,"15min":0.58799999999999997},"min":{"1min":0.38,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78200000000000003,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.46300000000000002}]},{"osd":7,"last update":"Thu Aug 10 11:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.58599999999999997,"15min":0.56799999999999995},"min":{"1min":0.44,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.89300000000000002,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.63100000000000001,"15min":0.61099999999999999},"min":{"1min":0.45200000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.97099999999999997,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.625}]},{"osd":8,"last update":"Thu Aug 10 11:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63400000000000001,"15min":0.61799999999999999},"min":{"1min":0.443,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.72299999999999998,"15min":0.70199999999999996},"min":{"1min":0.61799999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95399999999999996,"5min":1.085,"15min":1.085},"last":0.68000000000000005}]},{"osd":9,"last update":"Thu Aug 10 11:51:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.73999999999999999,"15min":0.73099999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97299999999999998,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.67000000000000004},"min":{"1min":0.51500000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85499999999999998,"5min":1.026,"15min":1.026},"last":0.56100000000000005}]},{"osd":10,"last update":"Thu Aug 10 11:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.65800000000000003,"15min":0.64900000000000002},"min":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91500000000000004,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.753,"15min":0.74399999999999999},"min":{"1min":0.67900000000000005,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92600000000000005,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.57399999999999995}]},{"osd":11,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.71399999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738445,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":448830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 11:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56599999999999995,"15min":0.51200000000000001},"min":{"1min":0.33800000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.755,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56399999999999995,"15min":0.52800000000000002},"min":{"1min":0.48299999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73399999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Aug 10 11:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.40999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69299999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57699999999999996,"15min":0.54400000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77900000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Aug 10 11:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56100000000000005,"15min":0.53300000000000003},"min":{"1min":0.374,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70399999999999996,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53500000000000003,"15min":0.52100000000000002},"min":{"1min":0.38700000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.61799999999999999,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Aug 10 11:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56100000000000005,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78800000000000003,"5min":0.874,"15min":0.874},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.40799999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.64500000000000002,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Aug 10 11:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.77700000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.66100000000000003,"5min":0.872,"15min":0.872},"last":0.497}]},{"osd":7,"last update":"Thu Aug 10 11:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.498,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.505}]},{"osd":8,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.67700000000000005,"15min":0.70799999999999996},"min":{"1min":0.46800000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.83599999999999997,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66000000000000003,"15min":0.68700000000000006},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82299999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.51900000000000002}]},{"osd":9,"last update":"Thu Aug 10 11:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.59999999999999998,"15min":0.61399999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67900000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.69499999999999995,"15min":0.72099999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79100000000000004,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.64000000000000001}]},{"osd":10,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.69699999999999995,"15min":0.70599999999999996},"min":{"1min":0.48799999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80800000000000005,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68899999999999995,"15min":0.69299999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.82899999999999996,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.62}]},{"osd":11,"last update":"Thu Aug 10 11:52:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66400000000000003,"15min":0.66100000000000003},"min":{"1min":0.58299999999999996,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85499999999999998,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.627,"15min":0.621},"min":{"1min":0.52200000000000002,"5min":0.502,"15min":0.502},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.65700000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411397,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":505066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54800000000000004,"15min":0.51200000000000001},"min":{"1min":0.373,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.81599999999999995,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.51700000000000002},"min":{"1min":0.38900000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.746,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Aug 10 11:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56100000000000005,"15min":0.52500000000000002},"min":{"1min":0.30199999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.64900000000000002,"15min":0.66700000000000004},"min":{"1min":0.45400000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.85199999999999998,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Aug 10 11:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.64300000000000002,"15min":0.68500000000000005},"min":{"1min":0.433,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86699999999999999,"5min":3.7519999999999998,"15min":3.7519999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52000000000000002,"15min":0.495},"min":{"1min":0.36699999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74399999999999999,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Aug 10 11:51:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Aug 10 11:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.497,"15min":0.47699999999999998},"min":{"1min":0.38400000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.379},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.46899999999999997,"15min":0.441},"min":{"1min":0.33800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Aug 10 11:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58199999999999996,"15min":0.56299999999999994},"min":{"1min":0.46300000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85999999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66200000000000003,"15min":0.64800000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.91300000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.73899999999999999,"15min":0.73799999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.503}]},{"osd":8,"last update":"Thu Aug 10 11:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.628,"15min":0.60699999999999998},"min":{"1min":0.46700000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.98199999999999998,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.622},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.58899999999999997,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.64900000000000002}]},{"osd":9,"last update":"Thu Aug 10 11:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.82999999999999996,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.70499999999999996,"15min":0.70699999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.82899999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.51700000000000002}]},{"osd":10,"last update":"Thu Aug 10 11:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.70199999999999996,"15min":0.69399999999999995},"min":{"1min":0.52200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.77700000000000002,"15min":0.77200000000000002},"min":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.78800000000000003}]},{"osd":11,"last update":"Thu Aug 10 11:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.72099999999999997}]}]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":446845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:52:24 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.35799999999999998,"15min":0.35899999999999999},"min":{"1min":0.26000000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.47399999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.36699999999999999,"15min":0.35899999999999999},"min":{"1min":0.249,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.44600000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Aug 10 11:52:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56699999999999995,"15min":0.55600000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56499999999999995,"15min":0.55600000000000005},"min":{"1min":0.41499999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82199999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Aug 10 11:52:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59199999999999997,"15min":0.55900000000000005},"min":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.4049999999999998,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":0.498},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58799999999999997,"15min":0.55100000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68899999999999995,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.629}]},{"osd":4,"last update":"Thu Aug 10 11:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.376,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74299999999999999,"5min":1.028,"15min":1.028},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59799999999999998,"15min":0.59499999999999997},"min":{"1min":0.40899999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77000000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Aug 10 11:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.58299999999999996,"15min":0.57199999999999995},"min":{"1min":0.38,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78700000000000003,"5min":0.999,"15min":0.999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.61899999999999999,"15min":0.60699999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73299999999999998,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Aug 10 11:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.48099999999999998,"15min":0.46700000000000003},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.69699999999999995,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.434},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48299999999999998,"15min":0.46100000000000002},"min":{"1min":0.35499999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.45000000000000001}]},{"osd":7,"last update":"Thu Aug 10 11:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78100000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.63800000000000001,"15min":0.623},"min":{"1min":0.47899999999999998,"5min":0.434,"15min":0.434},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.60099999999999998}]},{"osd":8,"last update":"Thu Aug 10 11:50:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.67900000000000005}]},{"osd":9,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.627,"15min":0.64500000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83999999999999997,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.621,"15min":0.64100000000000001},"min":{"1min":0.38100000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.85699999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.46400000000000002}]},{"osd":10,"last update":"Thu Aug 10 11:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.73199999999999998,"15min":0.749},"min":{"1min":0.45800000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.80300000000000005,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.64700000000000002}]},{"osd":11,"last update":"Thu Aug 10 11:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.375,"5min":2.375,"15min":2.375},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.65900000000000003}]}]},{"osd":4,"up_from":32,"seq":137438953533,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":447493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54200000000000004,"15min":0.51400000000000001},"min":{"1min":0.39500000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79700000000000004,"5min":1.875,"15min":1.875},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.54300000000000004,"15min":0.51700000000000002},"min":{"1min":0.40899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Aug 10 11:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41999999999999998,"15min":0.40500000000000003},"min":{"1min":0.26300000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.57299999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.42899999999999999,"15min":0.40200000000000002},"min":{"1min":0.30199999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.57499999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Aug 10 11:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.59499999999999997,"15min":0.57899999999999996},"min":{"1min":0.47899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59299999999999997,"15min":0.57799999999999996},"min":{"1min":0.46700000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75800000000000001,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.626}]},{"osd":3,"last update":"Thu Aug 10 11:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59199999999999997,"15min":0.54900000000000004},"min":{"1min":0.40400000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76800000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56599999999999995,"15min":0.55400000000000005},"min":{"1min":0.40699999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76000000000000001,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.55000000000000004}]},{"osd":5,"last update":"Thu Aug 10 11:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.622,"15min":0.59999999999999998},"min":{"1min":0.47999999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81200000000000006,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.65300000000000002,"15min":0.60399999999999998},"min":{"1min":0.504,"5min":0.374,"15min":0.374},"max":{"1min":0.90400000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.71899999999999997}]},{"osd":6,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67100000000000004,"15min":0.67200000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92000000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83099999999999996,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.46899999999999997}]},{"osd":7,"last update":"Thu Aug 10 11:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.58399999999999996,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.92200000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.55800000000000005,"15min":0.53200000000000003},"min":{"1min":0.33700000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.70199999999999996}]},{"osd":8,"last update":"Thu Aug 10 11:52:18 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71699999999999997,"15min":0.70599999999999996},"min":{"1min":0.47199999999999998,"5min":0.441,"15min":0.441},"max":{"1min":0.92700000000000005,"5min":1.004,"15min":1.004},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.77000000000000002,"15min":0.753},"min":{"1min":0.56299999999999994,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95399999999999996,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.84599999999999997}]},{"osd":9,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.69199999999999995}]},{"osd":10,"last update":"Thu Aug 10 11:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76300000000000001,"15min":0.76100000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.90900000000000003,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.81799999999999995,"15min":0.81999999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.97799999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.79000000000000004}]},{"osd":11,"last update":"Thu Aug 10 11:51:54 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.80300000000000005}]}]},{"osd":5,"up_from":37,"seq":158913790007,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1552384,"data_stored":1038828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76200000000000001,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.628},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34399999999999997,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.56999999999999995}]},{"osd":1,"last update":"Thu Aug 10 11:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.56699999999999995,"15min":0.53000000000000003},"min":{"1min":0.45800000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.92200000000000004,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.58699999999999997,"15min":0.55000000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Aug 10 11:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.42499999999999999,"15min":0.39200000000000002},"min":{"1min":0.35299999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.435,"15min":0.40899999999999997},"min":{"1min":0.375,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.67000000000000004}]},{"osd":3,"last update":"Thu Aug 10 11:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56100000000000005,"15min":0.55300000000000005},"min":{"1min":0.34200000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.54300000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76300000000000001,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.70399999999999996}]},{"osd":4,"last update":"Thu Aug 10 11:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.624,"15min":0.59599999999999997},"min":{"1min":0.52600000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93000000000000005,"5min":1.109,"15min":1.109},"last":0.749},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.61299999999999999,"15min":0.58699999999999997},"min":{"1min":0.47599999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91800000000000004,"5min":1.002,"15min":1.002},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Aug 10 11:51:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.60799999999999998,"15min":0.58199999999999996},"min":{"1min":0.46700000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.64700000000000002,"15min":0.63900000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90200000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.83499999999999996}]},{"osd":7,"last update":"Thu Aug 10 11:51:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.63500000000000001,"15min":0.623},"min":{"1min":0.36299999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.66300000000000003,"15min":0.65100000000000002},"min":{"1min":0.49099999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94699999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.85299999999999998}]},{"osd":8,"last update":"Thu Aug 10 11:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.64600000000000002,"15min":0.63200000000000001},"min":{"1min":0.48199999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.44,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.88900000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.93000000000000005}]},{"osd":9,"last update":"Thu Aug 10 11:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.73599999999999999,"15min":0.69999999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":5.2999999999999998,"5min":5.2999999999999998,"15min":5.2999999999999998},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.73599999999999999,"15min":0.72899999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.91600000000000004}]},{"osd":10,"last update":"Thu Aug 10 11:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.71599999999999997,"15min":0.70499999999999996},"min":{"1min":0.53200000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.73099999999999998,"15min":0.71799999999999997},"min":{"1min":0.622,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.90100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":58194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":63875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T11:52:26.983 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T11:52:27.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.135+0000 7f2285df5700 1 -- 172.21.15.73:0/1851757200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2280101210 msgr2=0x7f2280107ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:27.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.135+0000 7f2285df5700 1 --2- 172.21.15.73:0/1851757200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2280101210 0x7f2280107ac0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f227800b0d0 tx=0x7f227800b3e0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.135+0000 7f2285df5700 1 -- 172.21.15.73:0/1851757200 shutdown_connections 2023-08-10T11:52:27.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.135+0000 7f2285df5700 1 --2- 172.21.15.73:0/1851757200 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22800ff680 0x7f22800ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.135+0000 7f2285df5700 1 --2- 172.21.15.73:0/1851757200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2280101210 0x7f2280107ac0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.135+0000 7f2285df5700 1 --2- 172.21.15.73:0/1851757200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2280100870 0x7f2280100cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.135+0000 7f2285df5700 1 -- 172.21.15.73:0/1851757200 >> 172.21.15.73:0/1851757200 conn(0x7f22800fabd0 msgr2=0x7f22800fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:27.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.135+0000 7f2285df5700 1 -- 172.21.15.73:0/1851757200 shutdown_connections 2023-08-10T11:52:27.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.135+0000 7f2285df5700 1 -- 172.21.15.73:0/1851757200 wait complete. 2023-08-10T11:52:27.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.136+0000 7f2285df5700 1 Processor -- start 2023-08-10T11:52:27.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.136+0000 7f2285df5700 1 -- start start 2023-08-10T11:52:27.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.136+0000 7f2285df5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22800ff680 0x7f2280195400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:27.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.136+0000 7f2285df5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2280100870 0x7f2280195940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:27.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.136+0000 7f2285df5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2280101210 0x7f228019c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:27.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.136+0000 7f2285df5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228019cf80 con 0x7f2280100870 2023-08-10T11:52:27.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.136+0000 7f2285df5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228019d0c0 con 0x7f2280101210 2023-08-10T11:52:27.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.136+0000 7f2285df5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228019d250 con 0x7f22800ff680 2023-08-10T11:52:27.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.136+0000 7f227effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2280100870 0x7f2280195940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:27.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.136+0000 7f227effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2280100870 0x7f2280195940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60574/0 (socket says 172.21.15.73:60574) 2023-08-10T11:52:27.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.136+0000 7f227effd700 1 -- 172.21.15.73:0/3100398017 learned_addr learned my addr 172.21.15.73:0/3100398017 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:27.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.137+0000 7f227f7fe700 1 --2- 172.21.15.73:0/3100398017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22800ff680 0x7f2280195400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:27.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.137+0000 7f227effd700 1 -- 172.21.15.73:0/3100398017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22800ff680 msgr2=0x7f2280195400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:27.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.137+0000 7f227effd700 1 --2- 172.21.15.73:0/3100398017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22800ff680 0x7f2280195400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.137+0000 7f227effd700 1 -- 172.21.15.73:0/3100398017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2280101210 msgr2=0x7f228019c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:27.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.137+0000 7f227ffff700 1 --2- 172.21.15.73:0/3100398017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2280101210 0x7f228019c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:27.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.137+0000 7f227effd700 1 --2- 172.21.15.73:0/3100398017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2280101210 0x7f228019c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.137+0000 7f227effd700 1 -- 172.21.15.73:0/3100398017 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2278009d00 con 0x7f2280100870 2023-08-10T11:52:27.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.137+0000 7f227ffff700 1 --2- 172.21.15.73:0/3100398017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2280101210 0x7f228019c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:52:27.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.137+0000 7f227effd700 1 --2- 172.21.15.73:0/3100398017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2280100870 0x7f2280195940 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f227000eab0 tx=0x7f227000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:27.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.137+0000 7f227cff9700 1 -- 172.21.15.73:0/3100398017 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2270013070 con 0x7f2280100870 2023-08-10T11:52:27.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.137+0000 7f227cff9700 1 -- 172.21.15.73:0/3100398017 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2270017410 con 0x7f2280100870 2023-08-10T11:52:27.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.137+0000 7f227cff9700 1 -- 172.21.15.73:0/3100398017 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2270016610 con 0x7f2280100870 2023-08-10T11:52:27.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.137+0000 7f2285df5700 1 -- 172.21.15.73:0/3100398017 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2280068b90 con 0x7f2280100870 2023-08-10T11:52:27.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.137+0000 7f2285df5700 1 -- 172.21.15.73:0/3100398017 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22800690a0 con 0x7f2280100870 2023-08-10T11:52:27.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.138+0000 7f2285df5700 1 -- 172.21.15.73:0/3100398017 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f228010aef0 con 0x7f2280100870 2023-08-10T11:52:27.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.139+0000 7f227cff9700 1 -- 172.21.15.73:0/3100398017 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f2270017880 con 0x7f2280100870 2023-08-10T11:52:27.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.139+0000 7f227cff9700 1 --2- 172.21.15.73:0/3100398017 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f226c0a1220 0x7f226c0a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:27.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.140+0000 7f227f7fe700 1 --2- 172.21.15.73:0/3100398017 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f226c0a1220 0x7f226c0a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:27.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.140+0000 7f227cff9700 1 -- 172.21.15.73:0/3100398017 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f22700cdeb0 con 0x7f2280100870 2023-08-10T11:52:27.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.140+0000 7f227f7fe700 1 --2- 172.21.15.73:0/3100398017 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f226c0a1220 0x7f226c0a36e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f22801006d0 tx=0x7f226800b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:27.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.144+0000 7f227cff9700 1 -- 172.21.15.73:0/3100398017 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f2270097610 con 0x7f2280100870 2023-08-10T11:52:27.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:26 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/4288664029' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:52:27.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:26 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/601197322' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:52:27.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:26 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/4288664029' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:52:27.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:26 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/601197322' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:52:27.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:26 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/4288664029' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:52:27.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:26 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/601197322' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:52:27.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.329+0000 7f2285df5700 1 -- 172.21.15.73:0/3100398017 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2280060bb0 con 0x7f226c0a1220 2023-08-10T11:52:27.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.338+0000 7f227cff9700 1 -- 172.21.15.73:0/3100398017 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344700 (secure 0 0 0) 0x7f2280060bb0 con 0x7f226c0a1220 2023-08-10T11:52:27.343 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:52:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.342+0000 7f2285df5700 1 -- 172.21.15.73:0/3100398017 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f226c0a1220 msgr2=0x7f226c0a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.342+0000 7f2285df5700 1 --2- 172.21.15.73:0/3100398017 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f226c0a1220 0x7f226c0a36e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f22801006d0 tx=0x7f226800b5b0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.342+0000 7f2285df5700 1 -- 172.21.15.73:0/3100398017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2280100870 msgr2=0x7f2280195940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.342+0000 7f2285df5700 1 --2- 172.21.15.73:0/3100398017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2280100870 0x7f2280195940 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f227000eab0 tx=0x7f227000ee70 comp rx=0 tx=0).stop 2023-08-10T11:52:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.342+0000 7f2285df5700 1 -- 172.21.15.73:0/3100398017 shutdown_connections 2023-08-10T11:52:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.342+0000 7f2285df5700 1 --2- 172.21.15.73:0/3100398017 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f226c0a1220 0x7f226c0a36e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.342+0000 7f2285df5700 1 --2- 172.21.15.73:0/3100398017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2280101210 0x7f228019c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.342+0000 7f2285df5700 1 --2- 172.21.15.73:0/3100398017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22800ff680 0x7f2280195400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.342+0000 7f2285df5700 1 --2- 172.21.15.73:0/3100398017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2280100870 0x7f2280195940 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.342+0000 7f2285df5700 1 -- 172.21.15.73:0/3100398017 >> 172.21.15.73:0/3100398017 conn(0x7f22800fabd0 msgr2=0x7f22800fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.343+0000 7f2285df5700 1 -- 172.21.15.73:0/3100398017 shutdown_connections 2023-08-10T11:52:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.343+0000 7f2285df5700 1 -- 172.21.15.73:0/3100398017 wait complete. 2023-08-10T11:52:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-08-10T11:52:27.355 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2023-08-10T11:52:26.502435+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659562,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1017,"num_read_kb":628,"num_write":423,"num_write_kb":3077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1181408,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":849,"ondisk_log_size":849,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337240,"kb_used_data":13048,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124604584,"statfs":{"total":1151940427776,"available":1151595094016,"internally_reserved":0,"allocated":13361152,"data_stored":7320112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6087,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":78,"num_write":11,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002929"},"pg_stats":[{"pgid":"3.3f","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.525060+0000","last_change":"2023-08-10T11:50:54.902569+0000","last_active":"2023-08-10T11:52:18.525060+0000","last_peered":"2023-08-10T11:52:18.525060+0000","last_clean":"2023-08-10T11:52:18.525060+0000","last_became_active":"2023-08-10T11:50:54.902058+0000","last_became_peered":"2023-08-10T11:50:54.902058+0000","last_unstale":"2023-08-10T11:52:18.525060+0000","last_undegraded":"2023-08-10T11:52:18.525060+0000","last_fullsized":"2023-08-10T11:52:18.525060+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:46:00.569005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.510420+0000","last_change":"2023-08-10T11:50:54.942908+0000","last_active":"2023-08-10T11:52:18.510420+0000","last_peered":"2023-08-10T11:52:18.510420+0000","last_clean":"2023-08-10T11:52:18.510420+0000","last_became_active":"2023-08-10T11:50:54.941765+0000","last_became_peered":"2023-08-10T11:50:54.941765+0000","last_unstale":"2023-08-10T11:52:18.510420+0000","last_undegraded":"2023-08-10T11:52:18.510420+0000","last_fullsized":"2023-08-10T11:52:18.510420+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:53:56.170569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.519409+0000","last_change":"2023-08-10T11:50:54.940670+0000","last_active":"2023-08-10T11:52:18.519409+0000","last_peered":"2023-08-10T11:52:18.519409+0000","last_clean":"2023-08-10T11:52:18.519409+0000","last_became_active":"2023-08-10T11:50:54.939906+0000","last_became_peered":"2023-08-10T11:50:54.939906+0000","last_unstale":"2023-08-10T11:52:18.519409+0000","last_undegraded":"2023-08-10T11:52:18.519409+0000","last_fullsized":"2023-08-10T11:52:18.519409+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:43:14.123136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.513041+0000","last_change":"2023-08-10T11:50:54.910964+0000","last_active":"2023-08-10T11:52:18.513041+0000","last_peered":"2023-08-10T11:52:18.513041+0000","last_clean":"2023-08-10T11:52:18.513041+0000","last_became_active":"2023-08-10T11:50:54.910185+0000","last_became_peered":"2023-08-10T11:50:54.910185+0000","last_unstale":"2023-08-10T11:52:18.513041+0000","last_undegraded":"2023-08-10T11:52:18.513041+0000","last_fullsized":"2023-08-10T11:52:18.513041+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:55:02.929754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.508834+0000","last_change":"2023-08-10T11:50:54.905354+0000","last_active":"2023-08-10T11:52:18.508834+0000","last_peered":"2023-08-10T11:52:18.508834+0000","last_clean":"2023-08-10T11:52:18.508834+0000","last_became_active":"2023-08-10T11:50:54.904982+0000","last_became_peered":"2023-08-10T11:50:54.904982+0000","last_unstale":"2023-08-10T11:52:18.508834+0000","last_undegraded":"2023-08-10T11:52:18.508834+0000","last_fullsized":"2023-08-10T11:52:18.508834+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:57:07.369827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.514900+0000","last_change":"2023-08-10T11:51:49.650435+0000","last_active":"2023-08-10T11:52:18.514900+0000","last_peered":"2023-08-10T11:52:18.514900+0000","last_clean":"2023-08-10T11:52:18.514900+0000","last_became_active":"2023-08-10T11:51:49.649975+0000","last_became_peered":"2023-08-10T11:51:49.649975+0000","last_unstale":"2023-08-10T11:52:18.514900+0000","last_undegraded":"2023-08-10T11:52:18.514900+0000","last_fullsized":"2023-08-10T11:52:18.514900+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:15:31.959610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.511353+0000","last_change":"2023-08-10T11:50:54.904604+0000","last_active":"2023-08-10T11:52:18.511353+0000","last_peered":"2023-08-10T11:52:18.511353+0000","last_clean":"2023-08-10T11:52:18.511353+0000","last_became_active":"2023-08-10T11:50:54.904295+0000","last_became_peered":"2023-08-10T11:50:54.904295+0000","last_unstale":"2023-08-10T11:52:18.511353+0000","last_undegraded":"2023-08-10T11:52:18.511353+0000","last_fullsized":"2023-08-10T11:52:18.511353+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:32:18.264657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.515232+0000","last_change":"2023-08-10T11:50:54.963398+0000","last_active":"2023-08-10T11:52:18.515232+0000","last_peered":"2023-08-10T11:52:18.515232+0000","last_clean":"2023-08-10T11:52:18.515232+0000","last_became_active":"2023-08-10T11:50:54.963048+0000","last_became_peered":"2023-08-10T11:50:54.963048+0000","last_unstale":"2023-08-10T11:52:18.515232+0000","last_undegraded":"2023-08-10T11:52:18.515232+0000","last_fullsized":"2023-08-10T11:52:18.515232+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:28:39.416861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.521717+0000","last_change":"2023-08-10T11:50:54.913426+0000","last_active":"2023-08-10T11:52:18.521717+0000","last_peered":"2023-08-10T11:52:18.521717+0000","last_clean":"2023-08-10T11:52:18.521717+0000","last_became_active":"2023-08-10T11:50:54.913099+0000","last_became_peered":"2023-08-10T11:50:54.913099+0000","last_unstale":"2023-08-10T11:52:18.521717+0000","last_undegraded":"2023-08-10T11:52:18.521717+0000","last_fullsized":"2023-08-10T11:52:18.521717+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:45:48.662369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.514590+0000","last_change":"2023-08-10T11:50:54.909259+0000","last_active":"2023-08-10T11:52:18.514590+0000","last_peered":"2023-08-10T11:52:18.514590+0000","last_clean":"2023-08-10T11:52:18.514590+0000","last_became_active":"2023-08-10T11:50:54.908898+0000","last_became_peered":"2023-08-10T11:50:54.908898+0000","last_unstale":"2023-08-10T11:52:18.514590+0000","last_undegraded":"2023-08-10T11:52:18.514590+0000","last_fullsized":"2023-08-10T11:52:18.514590+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:36:43.966446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.522763+0000","last_change":"2023-08-10T11:50:54.906152+0000","last_active":"2023-08-10T11:52:18.522763+0000","last_peered":"2023-08-10T11:52:18.522763+0000","last_clean":"2023-08-10T11:52:18.522763+0000","last_became_active":"2023-08-10T11:50:54.905859+0000","last_became_peered":"2023-08-10T11:50:54.905859+0000","last_unstale":"2023-08-10T11:52:18.522763+0000","last_undegraded":"2023-08-10T11:52:18.522763+0000","last_fullsized":"2023-08-10T11:52:18.522763+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:37:40.007291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.510458+0000","last_change":"2023-08-10T11:50:54.911195+0000","last_active":"2023-08-10T11:52:18.510458+0000","last_peered":"2023-08-10T11:52:18.510458+0000","last_clean":"2023-08-10T11:52:18.510458+0000","last_became_active":"2023-08-10T11:50:54.910618+0000","last_became_peered":"2023-08-10T11:50:54.910618+0000","last_unstale":"2023-08-10T11:52:18.510458+0000","last_undegraded":"2023-08-10T11:52:18.510458+0000","last_fullsized":"2023-08-10T11:52:18.510458+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:37:39.875599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.517052+0000","last_change":"2023-08-10T11:50:54.908051+0000","last_active":"2023-08-10T11:52:18.517052+0000","last_peered":"2023-08-10T11:52:18.517052+0000","last_clean":"2023-08-10T11:52:18.517052+0000","last_became_active":"2023-08-10T11:50:54.907772+0000","last_became_peered":"2023-08-10T11:50:54.907772+0000","last_unstale":"2023-08-10T11:52:18.517052+0000","last_undegraded":"2023-08-10T11:52:18.517052+0000","last_fullsized":"2023-08-10T11:52:18.517052+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:13:41.292582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.522591+0000","last_change":"2023-08-10T11:50:54.941327+0000","last_active":"2023-08-10T11:52:18.522591+0000","last_peered":"2023-08-10T11:52:18.522591+0000","last_clean":"2023-08-10T11:52:18.522591+0000","last_became_active":"2023-08-10T11:50:54.941020+0000","last_became_peered":"2023-08-10T11:50:54.941020+0000","last_unstale":"2023-08-10T11:52:18.522591+0000","last_undegraded":"2023-08-10T11:52:18.522591+0000","last_fullsized":"2023-08-10T11:52:18.522591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:39:28.002709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.517814+0000","last_change":"2023-08-10T11:50:54.940236+0000","last_active":"2023-08-10T11:52:18.517814+0000","last_peered":"2023-08-10T11:52:18.517814+0000","last_clean":"2023-08-10T11:52:18.517814+0000","last_became_active":"2023-08-10T11:50:54.939921+0000","last_became_peered":"2023-08-10T11:50:54.939921+0000","last_unstale":"2023-08-10T11:52:18.517814+0000","last_undegraded":"2023-08-10T11:52:18.517814+0000","last_fullsized":"2023-08-10T11:52:18.517814+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:26:42.811526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.524237+0000","last_change":"2023-08-10T11:50:54.903773+0000","last_active":"2023-08-10T11:52:18.524237+0000","last_peered":"2023-08-10T11:52:18.524237+0000","last_clean":"2023-08-10T11:52:18.524237+0000","last_became_active":"2023-08-10T11:50:54.903516+0000","last_became_peered":"2023-08-10T11:50:54.903516+0000","last_unstale":"2023-08-10T11:52:18.524237+0000","last_undegraded":"2023-08-10T11:52:18.524237+0000","last_fullsized":"2023-08-10T11:52:18.524237+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:14:22.982193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.525326+0000","last_change":"2023-08-10T11:50:54.902364+0000","last_active":"2023-08-10T11:52:18.525326+0000","last_peered":"2023-08-10T11:52:18.525326+0000","last_clean":"2023-08-10T11:52:18.525326+0000","last_became_active":"2023-08-10T11:50:54.901673+0000","last_became_peered":"2023-08-10T11:50:54.901673+0000","last_unstale":"2023-08-10T11:52:18.525326+0000","last_undegraded":"2023-08-10T11:52:18.525326+0000","last_fullsized":"2023-08-10T11:52:18.525326+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:29:24.743838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.513050+0000","last_change":"2023-08-10T11:50:54.911896+0000","last_active":"2023-08-10T11:52:18.513050+0000","last_peered":"2023-08-10T11:52:18.513050+0000","last_clean":"2023-08-10T11:52:18.513050+0000","last_became_active":"2023-08-10T11:50:54.911469+0000","last_became_peered":"2023-08-10T11:50:54.911469+0000","last_unstale":"2023-08-10T11:52:18.513050+0000","last_undegraded":"2023-08-10T11:52:18.513050+0000","last_fullsized":"2023-08-10T11:52:18.513050+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:44:23.395246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.503698+0000","last_change":"2023-08-10T11:50:54.964030+0000","last_active":"2023-08-10T11:52:18.503698+0000","last_peered":"2023-08-10T11:52:18.503698+0000","last_clean":"2023-08-10T11:52:18.503698+0000","last_became_active":"2023-08-10T11:50:54.963744+0000","last_became_peered":"2023-08-10T11:50:54.963744+0000","last_unstale":"2023-08-10T11:52:18.503698+0000","last_undegraded":"2023-08-10T11:52:18.503698+0000","last_fullsized":"2023-08-10T11:52:18.503698+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:38:53.944486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:23.279365+0000","last_change":"2023-08-10T11:51:50.242773+0000","last_active":"2023-08-10T11:52:23.279365+0000","last_peered":"2023-08-10T11:52:23.279365+0000","last_clean":"2023-08-10T11:52:23.279365+0000","last_became_active":"2023-08-10T11:51:50.231825+0000","last_became_peered":"2023-08-10T11:51:50.231825+0000","last_unstale":"2023-08-10T11:52:23.279365+0000","last_undegraded":"2023-08-10T11:52:23.279365+0000","last_fullsized":"2023-08-10T11:52:23.279365+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:05:02.299515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":77,"num_read_kb":77,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.505872+0000","last_change":"2023-08-10T11:50:54.961422+0000","last_active":"2023-08-10T11:52:18.505872+0000","last_peered":"2023-08-10T11:52:18.505872+0000","last_clean":"2023-08-10T11:52:18.505872+0000","last_became_active":"2023-08-10T11:50:54.960627+0000","last_became_peered":"2023-08-10T11:50:54.960627+0000","last_unstale":"2023-08-10T11:52:18.505872+0000","last_undegraded":"2023-08-10T11:52:18.505872+0000","last_fullsized":"2023-08-10T11:52:18.505872+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:39:24.168437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:50.151329+0000","last_change":"2023-08-10T11:50:53.907291+0000","last_active":"2023-08-10T11:51:50.151329+0000","last_peered":"2023-08-10T11:51:50.151329+0000","last_clean":"2023-08-10T11:51:50.151329+0000","last_became_active":"2023-08-10T11:50:53.906997+0000","last_became_peered":"2023-08-10T11:50:53.906997+0000","last_unstale":"2023-08-10T11:51:50.151329+0000","last_undegraded":"2023-08-10T11:51:50.151329+0000","last_fullsized":"2023-08-10T11:51:50.151329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:38:08.640581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.524609+0000","last_change":"2023-08-10T11:50:54.940828+0000","last_active":"2023-08-10T11:52:18.524609+0000","last_peered":"2023-08-10T11:52:18.524609+0000","last_clean":"2023-08-10T11:52:18.524609+0000","last_became_active":"2023-08-10T11:50:54.940169+0000","last_became_peered":"2023-08-10T11:50:54.940169+0000","last_unstale":"2023-08-10T11:52:18.524609+0000","last_undegraded":"2023-08-10T11:52:18.524609+0000","last_fullsized":"2023-08-10T11:52:18.524609+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:24:33.034519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.648534+0000","last_change":"2023-08-10T11:50:53.906366+0000","last_active":"2023-08-10T11:51:49.648534+0000","last_peered":"2023-08-10T11:51:49.648534+0000","last_clean":"2023-08-10T11:51:49.648534+0000","last_became_active":"2023-08-10T11:50:53.906057+0000","last_became_peered":"2023-08-10T11:50:53.906057+0000","last_unstale":"2023-08-10T11:51:49.648534+0000","last_undegraded":"2023-08-10T11:51:49.648534+0000","last_fullsized":"2023-08-10T11:51:49.648534+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:30:54.764094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.524595+0000","last_change":"2023-08-10T11:50:54.908534+0000","last_active":"2023-08-10T11:52:18.524595+0000","last_peered":"2023-08-10T11:52:18.524595+0000","last_clean":"2023-08-10T11:52:18.524595+0000","last_became_active":"2023-08-10T11:50:54.908244+0000","last_became_peered":"2023-08-10T11:50:54.908244+0000","last_unstale":"2023-08-10T11:52:18.524595+0000","last_undegraded":"2023-08-10T11:52:18.524595+0000","last_fullsized":"2023-08-10T11:52:18.524595+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:47:54.968386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.648328+0000","last_change":"2023-08-10T11:50:53.902325+0000","last_active":"2023-08-10T11:51:49.648328+0000","last_peered":"2023-08-10T11:51:49.648328+0000","last_clean":"2023-08-10T11:51:49.648328+0000","last_became_active":"2023-08-10T11:50:53.902020+0000","last_became_peered":"2023-08-10T11:50:53.902020+0000","last_unstale":"2023-08-10T11:51:49.648328+0000","last_undegraded":"2023-08-10T11:51:49.648328+0000","last_fullsized":"2023-08-10T11:51:49.648328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:38:19.283511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.519269+0000","last_change":"2023-08-10T11:50:54.910291+0000","last_active":"2023-08-10T11:52:18.519269+0000","last_peered":"2023-08-10T11:52:18.519269+0000","last_clean":"2023-08-10T11:52:18.519269+0000","last_became_active":"2023-08-10T11:50:54.909886+0000","last_became_peered":"2023-08-10T11:50:54.909886+0000","last_unstale":"2023-08-10T11:52:18.519269+0000","last_undegraded":"2023-08-10T11:52:18.519269+0000","last_fullsized":"2023-08-10T11:52:18.519269+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:50:14.009986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'5","reported_seq":109,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:20.633349+0000","last_change":"2023-08-10T11:50:53.904363+0000","last_active":"2023-08-10T11:52:20.633349+0000","last_peered":"2023-08-10T11:52:20.633349+0000","last_clean":"2023-08-10T11:52:20.633349+0000","last_became_active":"2023-08-10T11:50:53.904049+0000","last_became_peered":"2023-08-10T11:50:53.904049+0000","last_unstale":"2023-08-10T11:52:20.633349+0000","last_undegraded":"2023-08-10T11:52:20.633349+0000","last_fullsized":"2023-08-10T11:52:20.633349+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:39:46.229197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.509027+0000","last_change":"2023-08-10T11:51:49.652004+0000","last_active":"2023-08-10T11:52:18.509027+0000","last_peered":"2023-08-10T11:52:18.509027+0000","last_clean":"2023-08-10T11:52:18.509027+0000","last_became_active":"2023-08-10T11:51:49.651676+0000","last_became_peered":"2023-08-10T11:51:49.651676+0000","last_unstale":"2023-08-10T11:52:18.509027+0000","last_undegraded":"2023-08-10T11:52:18.509027+0000","last_fullsized":"2023-08-10T11:52:18.509027+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:19:00.457378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.649031+0000","last_change":"2023-08-10T11:50:53.901161+0000","last_active":"2023-08-10T11:51:49.649031+0000","last_peered":"2023-08-10T11:51:49.649031+0000","last_clean":"2023-08-10T11:51:49.649031+0000","last_became_active":"2023-08-10T11:50:53.900806+0000","last_became_peered":"2023-08-10T11:50:53.900806+0000","last_unstale":"2023-08-10T11:51:49.649031+0000","last_undegraded":"2023-08-10T11:51:49.649031+0000","last_fullsized":"2023-08-10T11:51:49.649031+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:17:50.056350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.515867+0000","last_change":"2023-08-10T11:50:54.905753+0000","last_active":"2023-08-10T11:52:18.515867+0000","last_peered":"2023-08-10T11:52:18.515867+0000","last_clean":"2023-08-10T11:52:18.515867+0000","last_became_active":"2023-08-10T11:50:54.905463+0000","last_became_peered":"2023-08-10T11:50:54.905463+0000","last_unstale":"2023-08-10T11:52:18.515867+0000","last_undegraded":"2023-08-10T11:52:18.515867+0000","last_fullsized":"2023-08-10T11:52:18.515867+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:36:59.884914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.645068+0000","last_change":"2023-08-10T11:50:53.895021+0000","last_active":"2023-08-10T11:51:49.645068+0000","last_peered":"2023-08-10T11:51:49.645068+0000","last_clean":"2023-08-10T11:51:49.645068+0000","last_became_active":"2023-08-10T11:50:53.894732+0000","last_became_peered":"2023-08-10T11:50:53.894732+0000","last_unstale":"2023-08-10T11:51:49.645068+0000","last_undegraded":"2023-08-10T11:51:49.645068+0000","last_fullsized":"2023-08-10T11:51:49.645068+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:40:51.375268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.509399+0000","last_change":"2023-08-10T11:51:49.905280+0000","last_active":"2023-08-10T11:52:18.509399+0000","last_peered":"2023-08-10T11:52:18.509399+0000","last_clean":"2023-08-10T11:52:18.509399+0000","last_became_active":"2023-08-10T11:51:49.904907+0000","last_became_peered":"2023-08-10T11:51:49.904907+0000","last_unstale":"2023-08-10T11:52:18.509399+0000","last_undegraded":"2023-08-10T11:52:18.509399+0000","last_fullsized":"2023-08-10T11:52:18.509399+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:19:37.005133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:50.254434+0000","last_change":"2023-08-10T11:50:53.899939+0000","last_active":"2023-08-10T11:51:50.254434+0000","last_peered":"2023-08-10T11:51:50.254434+0000","last_clean":"2023-08-10T11:51:50.254434+0000","last_became_active":"2023-08-10T11:50:53.899648+0000","last_became_peered":"2023-08-10T11:50:53.899648+0000","last_unstale":"2023-08-10T11:51:50.254434+0000","last_undegraded":"2023-08-10T11:51:50.254434+0000","last_fullsized":"2023-08-10T11:51:50.254434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:36:22.989138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.508840+0000","last_change":"2023-08-10T11:50:54.959487+0000","last_active":"2023-08-10T11:52:18.508840+0000","last_peered":"2023-08-10T11:52:18.508840+0000","last_clean":"2023-08-10T11:52:18.508840+0000","last_became_active":"2023-08-10T11:50:54.959153+0000","last_became_peered":"2023-08-10T11:50:54.959153+0000","last_unstale":"2023-08-10T11:52:18.508840+0000","last_undegraded":"2023-08-10T11:52:18.508840+0000","last_fullsized":"2023-08-10T11:52:18.508840+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:19:22.749093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'5","reported_seq":194,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:24.639818+0000","last_change":"2023-08-10T11:50:53.898037+0000","last_active":"2023-08-10T11:52:24.639818+0000","last_peered":"2023-08-10T11:52:24.639818+0000","last_clean":"2023-08-10T11:52:24.639818+0000","last_became_active":"2023-08-10T11:50:53.897715+0000","last_became_peered":"2023-08-10T11:50:53.897715+0000","last_unstale":"2023-08-10T11:52:24.639818+0000","last_undegraded":"2023-08-10T11:52:24.639818+0000","last_fullsized":"2023-08-10T11:52:24.639818+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:20:04.670260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":171,"num_read_kb":171,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.523129+0000","last_change":"2023-08-10T11:50:54.908337+0000","last_active":"2023-08-10T11:52:18.523129+0000","last_peered":"2023-08-10T11:52:18.523129+0000","last_clean":"2023-08-10T11:52:18.523129+0000","last_became_active":"2023-08-10T11:50:54.907990+0000","last_became_peered":"2023-08-10T11:50:54.907990+0000","last_unstale":"2023-08-10T11:52:18.523129+0000","last_undegraded":"2023-08-10T11:52:18.523129+0000","last_fullsized":"2023-08-10T11:52:18.523129+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:31:10.108965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.647765+0000","last_change":"2023-08-10T11:50:53.901498+0000","last_active":"2023-08-10T11:51:49.647765+0000","last_peered":"2023-08-10T11:51:49.647765+0000","last_clean":"2023-08-10T11:51:49.647765+0000","last_became_active":"2023-08-10T11:50:53.901146+0000","last_became_peered":"2023-08-10T11:50:53.901146+0000","last_unstale":"2023-08-10T11:51:49.647765+0000","last_undegraded":"2023-08-10T11:51:49.647765+0000","last_fullsized":"2023-08-10T11:51:49.647765+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:19:18.819828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.517381+0000","last_change":"2023-08-10T11:50:54.901550+0000","last_active":"2023-08-10T11:52:18.517381+0000","last_peered":"2023-08-10T11:52:18.517381+0000","last_clean":"2023-08-10T11:52:18.517381+0000","last_became_active":"2023-08-10T11:50:54.901214+0000","last_became_peered":"2023-08-10T11:50:54.901214+0000","last_unstale":"2023-08-10T11:52:18.517381+0000","last_undegraded":"2023-08-10T11:52:18.517381+0000","last_fullsized":"2023-08-10T11:52:18.517381+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:18:47.307577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:50.254486+0000","last_change":"2023-08-10T11:50:53.901337+0000","last_active":"2023-08-10T11:51:50.254486+0000","last_peered":"2023-08-10T11:51:50.254486+0000","last_clean":"2023-08-10T11:51:50.254486+0000","last_became_active":"2023-08-10T11:50:53.901005+0000","last_became_peered":"2023-08-10T11:50:53.901005+0000","last_unstale":"2023-08-10T11:51:50.254486+0000","last_undegraded":"2023-08-10T11:51:50.254486+0000","last_fullsized":"2023-08-10T11:51:50.254486+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:49:14.022036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.524258+0000","last_change":"2023-08-10T11:50:54.905466+0000","last_active":"2023-08-10T11:52:18.524258+0000","last_peered":"2023-08-10T11:52:18.524258+0000","last_clean":"2023-08-10T11:52:18.524258+0000","last_became_active":"2023-08-10T11:50:54.905175+0000","last_became_peered":"2023-08-10T11:50:54.905175+0000","last_unstale":"2023-08-10T11:52:18.524258+0000","last_undegraded":"2023-08-10T11:52:18.524258+0000","last_fullsized":"2023-08-10T11:52:18.524258+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:47:31.552287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'34","reported_seq":236,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:24.640752+0000","last_change":"2023-08-10T11:50:53.894717+0000","last_active":"2023-08-10T11:52:24.640752+0000","last_peered":"2023-08-10T11:52:24.640752+0000","last_clean":"2023-08-10T11:52:24.640752+0000","last_became_active":"2023-08-10T11:50:53.894390+0000","last_became_peered":"2023-08-10T11:50:53.894390+0000","last_unstale":"2023-08-10T11:52:24.640752+0000","last_undegraded":"2023-08-10T11:52:24.640752+0000","last_fullsized":"2023-08-10T11:52:24.640752+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:27:27.793650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62187,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":184,"num_read_kb":147,"num_write":36,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.512511+0000","last_change":"2023-08-10T11:50:54.908021+0000","last_active":"2023-08-10T11:52:18.512511+0000","last_peered":"2023-08-10T11:52:18.512511+0000","last_clean":"2023-08-10T11:52:18.512511+0000","last_became_active":"2023-08-10T11:50:54.907527+0000","last_became_peered":"2023-08-10T11:50:54.907527+0000","last_unstale":"2023-08-10T11:52:18.512511+0000","last_undegraded":"2023-08-10T11:52:18.512511+0000","last_fullsized":"2023-08-10T11:52:18.512511+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:00:47.270564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.645734+0000","last_change":"2023-08-10T11:50:53.906448+0000","last_active":"2023-08-10T11:51:49.645734+0000","last_peered":"2023-08-10T11:51:49.645734+0000","last_clean":"2023-08-10T11:51:49.645734+0000","last_became_active":"2023-08-10T11:50:53.906157+0000","last_became_peered":"2023-08-10T11:50:53.906157+0000","last_unstale":"2023-08-10T11:51:49.645734+0000","last_undegraded":"2023-08-10T11:51:49.645734+0000","last_fullsized":"2023-08-10T11:51:49.645734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:24:30.851722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.516150+0000","last_change":"2023-08-10T11:50:54.906467+0000","last_active":"2023-08-10T11:52:18.516150+0000","last_peered":"2023-08-10T11:52:18.516150+0000","last_clean":"2023-08-10T11:52:18.516150+0000","last_became_active":"2023-08-10T11:50:54.901119+0000","last_became_peered":"2023-08-10T11:50:54.901119+0000","last_unstale":"2023-08-10T11:52:18.516150+0000","last_undegraded":"2023-08-10T11:52:18.516150+0000","last_fullsized":"2023-08-10T11:52:18.516150+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:36:00.415680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:50.254434+0000","last_change":"2023-08-10T11:50:53.906435+0000","last_active":"2023-08-10T11:51:50.254434+0000","last_peered":"2023-08-10T11:51:50.254434+0000","last_clean":"2023-08-10T11:51:50.254434+0000","last_became_active":"2023-08-10T11:50:53.905545+0000","last_became_peered":"2023-08-10T11:50:53.905545+0000","last_unstale":"2023-08-10T11:51:50.254434+0000","last_undegraded":"2023-08-10T11:51:50.254434+0000","last_fullsized":"2023-08-10T11:51:50.254434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:57:09.505126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.520305+0000","last_change":"2023-08-10T11:51:49.650294+0000","last_active":"2023-08-10T11:52:18.520305+0000","last_peered":"2023-08-10T11:52:18.520305+0000","last_clean":"2023-08-10T11:52:18.520305+0000","last_became_active":"2023-08-10T11:51:49.649843+0000","last_became_peered":"2023-08-10T11:51:49.649843+0000","last_unstale":"2023-08-10T11:52:18.520305+0000","last_undegraded":"2023-08-10T11:52:18.520305+0000","last_fullsized":"2023-08-10T11:52:18.520305+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:42:09.106998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":110,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:24.669378+0000","last_change":"2023-08-10T11:50:53.898252+0000","last_active":"2023-08-10T11:52:24.669378+0000","last_peered":"2023-08-10T11:52:24.669378+0000","last_clean":"2023-08-10T11:52:24.669378+0000","last_became_active":"2023-08-10T11:50:53.897992+0000","last_became_peered":"2023-08-10T11:50:53.897992+0000","last_unstale":"2023-08-10T11:52:24.669378+0000","last_undegraded":"2023-08-10T11:52:24.669378+0000","last_fullsized":"2023-08-10T11:52:24.669378+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:47:25.880201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.511719+0000","last_change":"2023-08-10T11:50:54.913297+0000","last_active":"2023-08-10T11:52:18.511719+0000","last_peered":"2023-08-10T11:52:18.511719+0000","last_clean":"2023-08-10T11:52:18.511719+0000","last_became_active":"2023-08-10T11:50:54.912997+0000","last_became_peered":"2023-08-10T11:50:54.912997+0000","last_unstale":"2023-08-10T11:52:18.511719+0000","last_undegraded":"2023-08-10T11:52:18.511719+0000","last_fullsized":"2023-08-10T11:52:18.511719+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:24:06.668386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.647911+0000","last_change":"2023-08-10T11:50:53.904095+0000","last_active":"2023-08-10T11:51:49.647911+0000","last_peered":"2023-08-10T11:51:49.647911+0000","last_clean":"2023-08-10T11:51:49.647911+0000","last_became_active":"2023-08-10T11:50:53.903712+0000","last_became_peered":"2023-08-10T11:50:53.903712+0000","last_unstale":"2023-08-10T11:51:49.647911+0000","last_undegraded":"2023-08-10T11:51:49.647911+0000","last_fullsized":"2023-08-10T11:51:49.647911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:03:23.690223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.519308+0000","last_change":"2023-08-10T11:50:54.904763+0000","last_active":"2023-08-10T11:52:18.519308+0000","last_peered":"2023-08-10T11:52:18.519308+0000","last_clean":"2023-08-10T11:52:18.519308+0000","last_became_active":"2023-08-10T11:50:54.904467+0000","last_became_peered":"2023-08-10T11:50:54.904467+0000","last_unstale":"2023-08-10T11:52:18.519308+0000","last_undegraded":"2023-08-10T11:52:18.519308+0000","last_fullsized":"2023-08-10T11:52:18.519308+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:50:10.747719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.648580+0000","last_change":"2023-08-10T11:50:53.904605+0000","last_active":"2023-08-10T11:51:49.648580+0000","last_peered":"2023-08-10T11:51:49.648580+0000","last_clean":"2023-08-10T11:51:49.648580+0000","last_became_active":"2023-08-10T11:50:53.904236+0000","last_became_peered":"2023-08-10T11:50:53.904236+0000","last_unstale":"2023-08-10T11:51:49.648580+0000","last_undegraded":"2023-08-10T11:51:49.648580+0000","last_fullsized":"2023-08-10T11:51:49.648580+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:45:39.040420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.510048+0000","last_change":"2023-08-10T11:50:54.903881+0000","last_active":"2023-08-10T11:52:18.510048+0000","last_peered":"2023-08-10T11:52:18.510048+0000","last_clean":"2023-08-10T11:52:18.510048+0000","last_became_active":"2023-08-10T11:50:54.903563+0000","last_became_peered":"2023-08-10T11:50:54.903563+0000","last_unstale":"2023-08-10T11:52:18.510048+0000","last_undegraded":"2023-08-10T11:52:18.510048+0000","last_fullsized":"2023-08-10T11:52:18.510048+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:52:13.889541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.905322+0000","last_change":"2023-08-10T11:51:49.905322+0000","last_active":"2023-08-10T11:51:49.905322+0000","last_peered":"2023-08-10T11:51:49.905322+0000","last_clean":"2023-08-10T11:51:49.905322+0000","last_became_active":"2023-08-10T11:51:49.904918+0000","last_became_peered":"2023-08-10T11:51:49.904918+0000","last_unstale":"2023-08-10T11:51:49.905322+0000","last_undegraded":"2023-08-10T11:51:49.905322+0000","last_fullsized":"2023-08-10T11:51:49.905322+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:28:04.207502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.515886+0000","last_change":"2023-08-10T11:50:54.906531+0000","last_active":"2023-08-10T11:52:18.515886+0000","last_peered":"2023-08-10T11:52:18.515886+0000","last_clean":"2023-08-10T11:52:18.515886+0000","last_became_active":"2023-08-10T11:50:54.906239+0000","last_became_peered":"2023-08-10T11:50:54.906239+0000","last_unstale":"2023-08-10T11:52:18.515886+0000","last_undegraded":"2023-08-10T11:52:18.515886+0000","last_fullsized":"2023-08-10T11:52:18.515886+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:16:28.328008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":108,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:24.281487+0000","last_change":"2023-08-10T11:50:53.899835+0000","last_active":"2023-08-10T11:52:24.281487+0000","last_peered":"2023-08-10T11:52:24.281487+0000","last_clean":"2023-08-10T11:52:24.281487+0000","last_became_active":"2023-08-10T11:50:53.898318+0000","last_became_peered":"2023-08-10T11:50:53.898318+0000","last_unstale":"2023-08-10T11:52:24.281487+0000","last_undegraded":"2023-08-10T11:52:24.281487+0000","last_fullsized":"2023-08-10T11:52:24.281487+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:18:26.753294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":85,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.516846+0000","last_change":"2023-08-10T11:51:49.651543+0000","last_active":"2023-08-10T11:52:18.516846+0000","last_peered":"2023-08-10T11:52:18.516846+0000","last_clean":"2023-08-10T11:52:18.516846+0000","last_became_active":"2023-08-10T11:51:49.651250+0000","last_became_peered":"2023-08-10T11:51:49.651250+0000","last_unstale":"2023-08-10T11:52:18.516846+0000","last_undegraded":"2023-08-10T11:52:18.516846+0000","last_fullsized":"2023-08-10T11:52:18.516846+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:54:51.559253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.513046+0000","last_change":"2023-08-10T11:50:54.910544+0000","last_active":"2023-08-10T11:52:18.513046+0000","last_peered":"2023-08-10T11:52:18.513046+0000","last_clean":"2023-08-10T11:52:18.513046+0000","last_became_active":"2023-08-10T11:50:54.910210+0000","last_became_peered":"2023-08-10T11:50:54.910210+0000","last_unstale":"2023-08-10T11:52:18.513046+0000","last_undegraded":"2023-08-10T11:52:18.513046+0000","last_fullsized":"2023-08-10T11:52:18.513046+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:19:19.096119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":108,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:23.667001+0000","last_change":"2023-08-10T11:50:53.906293+0000","last_active":"2023-08-10T11:52:23.667001+0000","last_peered":"2023-08-10T11:52:23.667001+0000","last_clean":"2023-08-10T11:52:23.667001+0000","last_became_active":"2023-08-10T11:50:53.905998+0000","last_became_peered":"2023-08-10T11:50:53.905998+0000","last_unstale":"2023-08-10T11:52:23.667001+0000","last_undegraded":"2023-08-10T11:52:23.667001+0000","last_fullsized":"2023-08-10T11:52:23.667001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:16:54.570216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.511276+0000","last_change":"2023-08-10T11:50:54.960147+0000","last_active":"2023-08-10T11:52:18.511276+0000","last_peered":"2023-08-10T11:52:18.511276+0000","last_clean":"2023-08-10T11:52:18.511276+0000","last_became_active":"2023-08-10T11:50:54.959842+0000","last_became_peered":"2023-08-10T11:50:54.959842+0000","last_unstale":"2023-08-10T11:52:18.511276+0000","last_undegraded":"2023-08-10T11:52:18.511276+0000","last_fullsized":"2023-08-10T11:52:18.511276+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:11:47.254665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:50.229596+0000","last_change":"2023-08-10T11:50:53.899292+0000","last_active":"2023-08-10T11:51:50.229596+0000","last_peered":"2023-08-10T11:51:50.229596+0000","last_clean":"2023-08-10T11:51:50.229596+0000","last_became_active":"2023-08-10T11:50:53.898917+0000","last_became_peered":"2023-08-10T11:50:53.898917+0000","last_unstale":"2023-08-10T11:51:50.229596+0000","last_undegraded":"2023-08-10T11:51:50.229596+0000","last_fullsized":"2023-08-10T11:51:50.229596+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:26:56.629842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":345,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.647330+0000","last_change":"2023-08-10T11:49:54.492617+0000","last_active":"2023-08-10T11:51:49.647330+0000","last_peered":"2023-08-10T11:51:49.647330+0000","last_clean":"2023-08-10T11:51:49.647330+0000","last_became_active":"2023-08-10T11:49:54.492146+0000","last_became_peered":"2023-08-10T11:49:54.492146+0000","last_unstale":"2023-08-10T11:51:49.647330+0000","last_undegraded":"2023-08-10T11:51:49.647330+0000","last_fullsized":"2023-08-10T11:51:49.647330+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:46:58.862300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:46:58.862300+0000","last_clean_scrub_stamp":"2023-08-10T11:46:58.862300+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:07:45.490118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.511341+0000","last_change":"2023-08-10T11:50:54.907704+0000","last_active":"2023-08-10T11:52:18.511341+0000","last_peered":"2023-08-10T11:52:18.511341+0000","last_clean":"2023-08-10T11:52:18.511341+0000","last_became_active":"2023-08-10T11:50:54.907409+0000","last_became_peered":"2023-08-10T11:50:54.907409+0000","last_unstale":"2023-08-10T11:52:18.511341+0000","last_undegraded":"2023-08-10T11:52:18.511341+0000","last_fullsized":"2023-08-10T11:52:18.511341+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:48:34.334091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.647261+0000","last_change":"2023-08-10T11:50:53.902548+0000","last_active":"2023-08-10T11:51:49.647261+0000","last_peered":"2023-08-10T11:51:49.647261+0000","last_clean":"2023-08-10T11:51:49.647261+0000","last_became_active":"2023-08-10T11:50:53.902021+0000","last_became_peered":"2023-08-10T11:50:53.902021+0000","last_unstale":"2023-08-10T11:51:49.647261+0000","last_undegraded":"2023-08-10T11:51:49.647261+0000","last_fullsized":"2023-08-10T11:51:49.647261+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:38:41.663639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.648441+0000","last_change":"2023-08-10T11:50:53.906326+0000","last_active":"2023-08-10T11:51:49.648441+0000","last_peered":"2023-08-10T11:51:49.648441+0000","last_clean":"2023-08-10T11:51:49.648441+0000","last_became_active":"2023-08-10T11:50:53.906017+0000","last_became_peered":"2023-08-10T11:50:53.906017+0000","last_unstale":"2023-08-10T11:51:49.648441+0000","last_undegraded":"2023-08-10T11:51:49.648441+0000","last_fullsized":"2023-08-10T11:51:49.648441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:58:22.859318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.514258+0000","last_change":"2023-08-10T11:50:54.906513+0000","last_active":"2023-08-10T11:52:18.514258+0000","last_peered":"2023-08-10T11:52:18.514258+0000","last_clean":"2023-08-10T11:52:18.514258+0000","last_became_active":"2023-08-10T11:50:54.901642+0000","last_became_peered":"2023-08-10T11:50:54.901642+0000","last_unstale":"2023-08-10T11:52:18.514258+0000","last_undegraded":"2023-08-10T11:52:18.514258+0000","last_fullsized":"2023-08-10T11:52:18.514258+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:39:01.747637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'11","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:19.690281+0000","last_change":"2023-08-10T11:50:53.908025+0000","last_active":"2023-08-10T11:52:19.690281+0000","last_peered":"2023-08-10T11:52:19.690281+0000","last_clean":"2023-08-10T11:52:19.690281+0000","last_became_active":"2023-08-10T11:50:53.907745+0000","last_became_peered":"2023-08-10T11:50:53.907745+0000","last_unstale":"2023-08-10T11:52:19.690281+0000","last_undegraded":"2023-08-10T11:52:19.690281+0000","last_fullsized":"2023-08-10T11:52:19.690281+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:06:52.964591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.514530+0000","last_change":"2023-08-10T11:50:54.958653+0000","last_active":"2023-08-10T11:52:18.514530+0000","last_peered":"2023-08-10T11:52:18.514530+0000","last_clean":"2023-08-10T11:52:18.514530+0000","last_became_active":"2023-08-10T11:50:54.958281+0000","last_became_peered":"2023-08-10T11:50:54.958281+0000","last_unstale":"2023-08-10T11:52:18.514530+0000","last_undegraded":"2023-08-10T11:52:18.514530+0000","last_fullsized":"2023-08-10T11:52:18.514530+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:21:48.120998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:50.229654+0000","last_change":"2023-08-10T11:50:53.895770+0000","last_active":"2023-08-10T11:51:50.229654+0000","last_peered":"2023-08-10T11:51:50.229654+0000","last_clean":"2023-08-10T11:51:50.229654+0000","last_became_active":"2023-08-10T11:50:53.895433+0000","last_became_peered":"2023-08-10T11:50:53.895433+0000","last_unstale":"2023-08-10T11:51:50.229654+0000","last_undegraded":"2023-08-10T11:51:50.229654+0000","last_fullsized":"2023-08-10T11:51:50.229654+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:11:48.769660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.517250+0000","last_change":"2023-08-10T11:50:54.957297+0000","last_active":"2023-08-10T11:52:18.517250+0000","last_peered":"2023-08-10T11:52:18.517250+0000","last_clean":"2023-08-10T11:52:18.517250+0000","last_became_active":"2023-08-10T11:50:54.956966+0000","last_became_peered":"2023-08-10T11:50:54.956966+0000","last_unstale":"2023-08-10T11:52:18.517250+0000","last_undegraded":"2023-08-10T11:52:18.517250+0000","last_fullsized":"2023-08-10T11:52:18.517250+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:38:11.077269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.908404+0000","last_change":"2023-08-10T11:51:49.908404+0000","last_active":"2023-08-10T11:51:49.908404+0000","last_peered":"2023-08-10T11:51:49.908404+0000","last_clean":"2023-08-10T11:51:49.908404+0000","last_became_active":"2023-08-10T11:51:49.904994+0000","last_became_peered":"2023-08-10T11:51:49.904994+0000","last_unstale":"2023-08-10T11:51:49.908404+0000","last_undegraded":"2023-08-10T11:51:49.908404+0000","last_fullsized":"2023-08-10T11:51:49.908404+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:07:30.549050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.479893+0000","last_change":"2023-08-10T11:50:54.908185+0000","last_active":"2023-08-10T11:52:18.479893+0000","last_peered":"2023-08-10T11:52:18.479893+0000","last_clean":"2023-08-10T11:52:18.479893+0000","last_became_active":"2023-08-10T11:50:54.907649+0000","last_became_peered":"2023-08-10T11:50:54.907649+0000","last_unstale":"2023-08-10T11:52:18.479893+0000","last_undegraded":"2023-08-10T11:52:18.479893+0000","last_fullsized":"2023-08-10T11:52:18.479893+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:40:30.222828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:50.151298+0000","last_change":"2023-08-10T11:50:53.908748+0000","last_active":"2023-08-10T11:51:50.151298+0000","last_peered":"2023-08-10T11:51:50.151298+0000","last_clean":"2023-08-10T11:51:50.151298+0000","last_became_active":"2023-08-10T11:50:53.908494+0000","last_became_peered":"2023-08-10T11:50:53.908494+0000","last_unstale":"2023-08-10T11:51:50.151298+0000","last_undegraded":"2023-08-10T11:51:50.151298+0000","last_fullsized":"2023-08-10T11:51:50.151298+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:27:58.338302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.514270+0000","last_change":"2023-08-10T11:50:54.903493+0000","last_active":"2023-08-10T11:52:18.514270+0000","last_peered":"2023-08-10T11:52:18.514270+0000","last_clean":"2023-08-10T11:52:18.514270+0000","last_became_active":"2023-08-10T11:50:54.903118+0000","last_became_peered":"2023-08-10T11:50:54.903118+0000","last_unstale":"2023-08-10T11:52:18.514270+0000","last_undegraded":"2023-08-10T11:52:18.514270+0000","last_fullsized":"2023-08-10T11:52:18.514270+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:44:59.035303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.645508+0000","last_change":"2023-08-10T11:50:53.905075+0000","last_active":"2023-08-10T11:51:49.645508+0000","last_peered":"2023-08-10T11:51:49.645508+0000","last_clean":"2023-08-10T11:51:49.645508+0000","last_became_active":"2023-08-10T11:50:53.904769+0000","last_became_peered":"2023-08-10T11:50:53.904769+0000","last_unstale":"2023-08-10T11:51:49.645508+0000","last_undegraded":"2023-08-10T11:51:49.645508+0000","last_fullsized":"2023-08-10T11:51:49.645508+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:05:15.250724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.513888+0000","last_change":"2023-08-10T11:50:54.963860+0000","last_active":"2023-08-10T11:52:18.513888+0000","last_peered":"2023-08-10T11:52:18.513888+0000","last_clean":"2023-08-10T11:52:18.513888+0000","last_became_active":"2023-08-10T11:50:54.963335+0000","last_became_peered":"2023-08-10T11:50:54.963335+0000","last_unstale":"2023-08-10T11:52:18.513888+0000","last_undegraded":"2023-08-10T11:52:18.513888+0000","last_fullsized":"2023-08-10T11:52:18.513888+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:49:54.348522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.648142+0000","last_change":"2023-08-10T11:50:53.899673+0000","last_active":"2023-08-10T11:51:49.648142+0000","last_peered":"2023-08-10T11:51:49.648142+0000","last_clean":"2023-08-10T11:51:49.648142+0000","last_became_active":"2023-08-10T11:50:53.898830+0000","last_became_peered":"2023-08-10T11:50:53.898830+0000","last_unstale":"2023-08-10T11:51:49.648142+0000","last_undegraded":"2023-08-10T11:51:49.648142+0000","last_fullsized":"2023-08-10T11:51:49.648142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:03:06.415674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.522208+0000","last_change":"2023-08-10T11:50:54.900606+0000","last_active":"2023-08-10T11:52:18.522208+0000","last_peered":"2023-08-10T11:52:18.522208+0000","last_clean":"2023-08-10T11:52:18.522208+0000","last_became_active":"2023-08-10T11:50:54.900293+0000","last_became_peered":"2023-08-10T11:50:54.900293+0000","last_unstale":"2023-08-10T11:52:18.522208+0000","last_undegraded":"2023-08-10T11:52:18.522208+0000","last_fullsized":"2023-08-10T11:52:18.522208+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:30:39.482183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'7","reported_seq":110,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:21.649523+0000","last_change":"2023-08-10T11:50:53.894526+0000","last_active":"2023-08-10T11:52:21.649523+0000","last_peered":"2023-08-10T11:52:21.649523+0000","last_clean":"2023-08-10T11:52:21.649523+0000","last_became_active":"2023-08-10T11:50:53.894211+0000","last_became_peered":"2023-08-10T11:50:53.894211+0000","last_unstale":"2023-08-10T11:52:21.649523+0000","last_undegraded":"2023-08-10T11:52:21.649523+0000","last_fullsized":"2023-08-10T11:52:21.649523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:25:42.483916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1653,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.522978+0000","last_change":"2023-08-10T11:50:54.900511+0000","last_active":"2023-08-10T11:52:18.522978+0000","last_peered":"2023-08-10T11:52:18.522978+0000","last_clean":"2023-08-10T11:52:18.522978+0000","last_became_active":"2023-08-10T11:50:54.900200+0000","last_became_peered":"2023-08-10T11:50:54.900200+0000","last_unstale":"2023-08-10T11:52:18.522978+0000","last_undegraded":"2023-08-10T11:52:18.522978+0000","last_fullsized":"2023-08-10T11:52:18.522978+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:50:34.494222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:50.254733+0000","last_change":"2023-08-10T11:50:53.906235+0000","last_active":"2023-08-10T11:51:50.254733+0000","last_peered":"2023-08-10T11:51:50.254733+0000","last_clean":"2023-08-10T11:51:50.254733+0000","last_became_active":"2023-08-10T11:50:53.905630+0000","last_became_peered":"2023-08-10T11:50:53.905630+0000","last_unstale":"2023-08-10T11:51:50.254733+0000","last_undegraded":"2023-08-10T11:51:50.254733+0000","last_fullsized":"2023-08-10T11:51:50.254733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:28:57.652862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.511265+0000","last_change":"2023-08-10T11:50:54.907280+0000","last_active":"2023-08-10T11:52:18.511265+0000","last_peered":"2023-08-10T11:52:18.511265+0000","last_clean":"2023-08-10T11:52:18.511265+0000","last_became_active":"2023-08-10T11:50:54.906987+0000","last_became_peered":"2023-08-10T11:50:54.906987+0000","last_unstale":"2023-08-10T11:52:18.511265+0000","last_undegraded":"2023-08-10T11:52:18.511265+0000","last_fullsized":"2023-08-10T11:52:18.511265+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:17.214303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.645134+0000","last_change":"2023-08-10T11:50:53.906537+0000","last_active":"2023-08-10T11:51:49.645134+0000","last_peered":"2023-08-10T11:51:49.645134+0000","last_clean":"2023-08-10T11:51:49.645134+0000","last_became_active":"2023-08-10T11:50:53.905975+0000","last_became_peered":"2023-08-10T11:50:53.905975+0000","last_unstale":"2023-08-10T11:51:49.645134+0000","last_undegraded":"2023-08-10T11:51:49.645134+0000","last_fullsized":"2023-08-10T11:51:49.645134+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:07:24.856158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.512484+0000","last_change":"2023-08-10T11:50:54.905656+0000","last_active":"2023-08-10T11:52:18.512484+0000","last_peered":"2023-08-10T11:52:18.512484+0000","last_clean":"2023-08-10T11:52:18.512484+0000","last_became_active":"2023-08-10T11:50:54.905314+0000","last_became_peered":"2023-08-10T11:50:54.905314+0000","last_unstale":"2023-08-10T11:52:18.512484+0000","last_undegraded":"2023-08-10T11:52:18.512484+0000","last_fullsized":"2023-08-10T11:52:18.512484+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:07:15.802238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.508971+0000","last_change":"2023-08-10T11:50:54.911564+0000","last_active":"2023-08-10T11:52:18.508971+0000","last_peered":"2023-08-10T11:52:18.508971+0000","last_clean":"2023-08-10T11:52:18.508971+0000","last_became_active":"2023-08-10T11:50:54.910375+0000","last_became_peered":"2023-08-10T11:50:54.910375+0000","last_unstale":"2023-08-10T11:52:18.508971+0000","last_undegraded":"2023-08-10T11:52:18.508971+0000","last_fullsized":"2023-08-10T11:52:18.508971+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:26:31.205736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.515660+0000","last_change":"2023-08-10T11:50:54.913247+0000","last_active":"2023-08-10T11:52:18.515660+0000","last_peered":"2023-08-10T11:52:18.515660+0000","last_clean":"2023-08-10T11:52:18.515660+0000","last_became_active":"2023-08-10T11:50:54.912941+0000","last_became_peered":"2023-08-10T11:50:54.912941+0000","last_unstale":"2023-08-10T11:52:18.515660+0000","last_undegraded":"2023-08-10T11:52:18.515660+0000","last_fullsized":"2023-08-10T11:52:18.515660+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:20:21.810895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.494303+0000","last_change":"2023-08-10T11:50:54.959735+0000","last_active":"2023-08-10T11:52:18.494303+0000","last_peered":"2023-08-10T11:52:18.494303+0000","last_clean":"2023-08-10T11:52:18.494303+0000","last_became_active":"2023-08-10T11:50:54.959476+0000","last_became_peered":"2023-08-10T11:50:54.959476+0000","last_unstale":"2023-08-10T11:52:18.494303+0000","last_undegraded":"2023-08-10T11:52:18.494303+0000","last_fullsized":"2023-08-10T11:52:18.494303+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:45:42.510412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.516946+0000","last_change":"2023-08-10T11:50:54.942753+0000","last_active":"2023-08-10T11:52:18.516946+0000","last_peered":"2023-08-10T11:52:18.516946+0000","last_clean":"2023-08-10T11:52:18.516946+0000","last_became_active":"2023-08-10T11:50:54.941715+0000","last_became_peered":"2023-08-10T11:50:54.941715+0000","last_unstale":"2023-08-10T11:52:18.516946+0000","last_undegraded":"2023-08-10T11:52:18.516946+0000","last_fullsized":"2023-08-10T11:52:18.516946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:56:27.450708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.514041+0000","last_change":"2023-08-10T11:50:54.898919+0000","last_active":"2023-08-10T11:52:18.514041+0000","last_peered":"2023-08-10T11:52:18.514041+0000","last_clean":"2023-08-10T11:52:18.514041+0000","last_became_active":"2023-08-10T11:50:54.898599+0000","last_became_peered":"2023-08-10T11:50:54.898599+0000","last_unstale":"2023-08-10T11:52:18.514041+0000","last_undegraded":"2023-08-10T11:52:18.514041+0000","last_fullsized":"2023-08-10T11:52:18.514041+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:37:35.242025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.509666+0000","last_change":"2023-08-10T11:50:54.911359+0000","last_active":"2023-08-10T11:52:18.509666+0000","last_peered":"2023-08-10T11:52:18.509666+0000","last_clean":"2023-08-10T11:52:18.509666+0000","last_became_active":"2023-08-10T11:50:54.911049+0000","last_became_peered":"2023-08-10T11:50:54.911049+0000","last_unstale":"2023-08-10T11:52:18.509666+0000","last_undegraded":"2023-08-10T11:52:18.509666+0000","last_fullsized":"2023-08-10T11:52:18.509666+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:15:12.906005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.513742+0000","last_change":"2023-08-10T11:50:54.906811+0000","last_active":"2023-08-10T11:52:18.513742+0000","last_peered":"2023-08-10T11:52:18.513742+0000","last_clean":"2023-08-10T11:52:18.513742+0000","last_became_active":"2023-08-10T11:50:54.906456+0000","last_became_peered":"2023-08-10T11:50:54.906456+0000","last_unstale":"2023-08-10T11:52:18.513742+0000","last_undegraded":"2023-08-10T11:52:18.513742+0000","last_fullsized":"2023-08-10T11:52:18.513742+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:08:08.681010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.512297+0000","last_change":"2023-08-10T11:50:54.957297+0000","last_active":"2023-08-10T11:52:18.512297+0000","last_peered":"2023-08-10T11:52:18.512297+0000","last_clean":"2023-08-10T11:52:18.512297+0000","last_became_active":"2023-08-10T11:50:54.956977+0000","last_became_peered":"2023-08-10T11:50:54.956977+0000","last_unstale":"2023-08-10T11:52:18.512297+0000","last_undegraded":"2023-08-10T11:52:18.512297+0000","last_fullsized":"2023-08-10T11:52:18.512297+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:42:14.272800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.512035+0000","last_change":"2023-08-10T11:50:54.964300+0000","last_active":"2023-08-10T11:52:18.512035+0000","last_peered":"2023-08-10T11:52:18.512035+0000","last_clean":"2023-08-10T11:52:18.512035+0000","last_became_active":"2023-08-10T11:50:54.963876+0000","last_became_peered":"2023-08-10T11:50:54.963876+0000","last_unstale":"2023-08-10T11:52:18.512035+0000","last_undegraded":"2023-08-10T11:52:18.512035+0000","last_fullsized":"2023-08-10T11:52:18.512035+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:21:05.020811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.514754+0000","last_change":"2023-08-10T11:50:54.958661+0000","last_active":"2023-08-10T11:52:18.514754+0000","last_peered":"2023-08-10T11:52:18.514754+0000","last_clean":"2023-08-10T11:52:18.514754+0000","last_became_active":"2023-08-10T11:50:54.958342+0000","last_became_peered":"2023-08-10T11:50:54.958342+0000","last_unstale":"2023-08-10T11:52:18.514754+0000","last_undegraded":"2023-08-10T11:52:18.514754+0000","last_fullsized":"2023-08-10T11:52:18.514754+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:38:54.463137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.524077+0000","last_change":"2023-08-10T11:50:54.902033+0000","last_active":"2023-08-10T11:52:18.524077+0000","last_peered":"2023-08-10T11:52:18.524077+0000","last_clean":"2023-08-10T11:52:18.524077+0000","last_became_active":"2023-08-10T11:50:54.901713+0000","last_became_peered":"2023-08-10T11:50:54.901713+0000","last_unstale":"2023-08-10T11:52:18.524077+0000","last_undegraded":"2023-08-10T11:52:18.524077+0000","last_fullsized":"2023-08-10T11:52:18.524077+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:42:12.029831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.519845+0000","last_change":"2023-08-10T11:50:54.899377+0000","last_active":"2023-08-10T11:52:18.519845+0000","last_peered":"2023-08-10T11:52:18.519845+0000","last_clean":"2023-08-10T11:52:18.519845+0000","last_became_active":"2023-08-10T11:50:54.898657+0000","last_became_peered":"2023-08-10T11:50:54.898657+0000","last_unstale":"2023-08-10T11:52:18.519845+0000","last_undegraded":"2023-08-10T11:52:18.519845+0000","last_fullsized":"2023-08-10T11:52:18.519845+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:49:40.082347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.509905+0000","last_change":"2023-08-10T11:50:54.900304+0000","last_active":"2023-08-10T11:52:18.509905+0000","last_peered":"2023-08-10T11:52:18.509905+0000","last_clean":"2023-08-10T11:52:18.509905+0000","last_became_active":"2023-08-10T11:50:54.899978+0000","last_became_peered":"2023-08-10T11:50:54.899978+0000","last_unstale":"2023-08-10T11:52:18.509905+0000","last_undegraded":"2023-08-10T11:52:18.509905+0000","last_fullsized":"2023-08-10T11:52:18.509905+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:03:38.365482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68948,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":881,"num_read_kb":509,"num_write":240,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":195450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449118,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":447844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.41899999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.495,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.42199999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.57899999999999996,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67000000000000004,"15min":0.67100000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77900000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65200000000000002,"15min":0.65300000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90600000000000003,"5min":1.163,"15min":1.163},"last":0.746}]},{"osd":2,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.38700000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70499999999999996,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.501,"15min":0.502},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.50800000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.82499999999999996,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66100000000000003,"15min":0.66000000000000003},"min":{"1min":0.48899999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.85199999999999998,"5min":1.046,"15min":1.046},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.38600000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.63100000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.621},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.621,"15min":0.61799999999999999},"min":{"1min":0.52200000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81699999999999995,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64400000000000002,"15min":0.65100000000000002},"min":{"1min":0.41999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84099999999999997,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.65400000000000003,"15min":0.65200000000000002},"min":{"1min":0.47299999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.83199999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.78400000000000003,"15min":0.78000000000000003},"min":{"1min":0.60199999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.96199999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.75600000000000001,"15min":0.75700000000000001},"min":{"1min":0.63300000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90500000000000003,"5min":1.224,"15min":1.224},"last":0.85799999999999998}]},{"osd":8,"last update":"Thu Aug 10 11:51:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.874}]},{"osd":9,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.746,"15min":0.74199999999999999},"min":{"1min":0.58099999999999996,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.86399999999999999,"5min":1.024,"15min":1.024},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.79400000000000004,"15min":0.78600000000000003},"min":{"1min":0.65400000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.97499999999999998,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.90200000000000002}]},{"osd":10,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.68300000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.94399999999999995,"5min":1.341,"15min":1.341},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.78900000000000003,"15min":0.78700000000000003},"min":{"1min":0.65500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.91900000000000004,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.80100000000000005}]}]},{"osd":10,"up_from":70,"seq":300647710754,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1630208,"data_stored":1100204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":6.7350000000000003,"5min":6.7350000000000003,"15min":6.7350000000000003},"last":0.432},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":6.7800000000000002,"5min":6.7800000000000002,"15min":6.7800000000000002},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47099999999999997,"15min":0.47499999999999998},"min":{"1min":0.309,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.61099999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.504,"15min":0.51000000000000001},"min":{"1min":0.35999999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.64200000000000002,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.628,"15min":0.626},"min":{"1min":0.442,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.47499999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.64600000000000002}]},{"osd":3,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.627,"15min":0.63900000000000001},"min":{"1min":0.443,"5min":0.432,"15min":0.432},"max":{"1min":0.70499999999999996,"5min":0.878,"15min":0.878},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.65100000000000002,"15min":0.65900000000000003},"min":{"1min":0.41999999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73799999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.62,"15min":0.624},"min":{"1min":0.41099999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80500000000000005,"5min":0.879,"15min":0.879},"last":0.622},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.58799999999999997,"15min":0.59499999999999997},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78200000000000003,"5min":1.177,"15min":1.177},"last":0.72599999999999998}]},{"osd":5,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71699999999999997,"15min":0.71899999999999997},"min":{"1min":0.52400000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84299999999999997,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.88,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.79800000000000004}]},{"osd":6,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73999999999999999,"15min":0.746},"min":{"1min":0.39600000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.464,"5min":2.464,"15min":2.464},"last":0.745},{"interface":"front","average":{"1min":1.0589999999999999,"5min":0.85099999999999998,"15min":0.81699999999999995},"min":{"1min":0.59999999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":7.7110000000000003,"5min":7.7110000000000003,"15min":7.7110000000000003},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":8,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79600000000000004,"15min":0.80000000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.93799999999999994,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.58999999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.94999999999999996,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.81200000000000006}]},{"osd":9,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":0.89600000000000002,"15min":0.86399999999999999},"min":{"1min":0.55400000000000005,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":7.6369999999999996,"5min":7.6369999999999996,"15min":7.6369999999999996},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.81000000000000005,"15min":0.82799999999999996},"min":{"1min":0.52300000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97999999999999998,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.85199999999999998}]},{"osd":11,"last update":"Thu Aug 10 11:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.76700000000000002,"15min":0.76100000000000001},"min":{"1min":0.59699999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.92100000000000004,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.873},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.79000000000000004,"15min":0.78400000000000003},"min":{"1min":0.66900000000000004,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.99399999999999999,"5min":0.998,"15min":0.998},"last":0.88500000000000001}]}]},{"osd":9,"up_from":65,"seq":279172874279,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":447291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.39400000000000002,"15min":0.39800000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.41199999999999998,"15min":0.42199999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.499,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.316}]},{"osd":1,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.58299999999999996,"15min":0.59199999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.66000000000000003,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.59899999999999998,"15min":0.60999999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70599999999999996,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.501}]},{"osd":2,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.61599999999999999,"15min":0.628},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.68300000000000005,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.61599999999999999,"15min":0.628},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73799999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.44500000000000001,"15min":0.45400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.55700000000000005,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50600000000000001,"15min":0.50900000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.63500000000000001,"15min":0.65200000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.66300000000000003,"5min":0.87,"15min":0.87},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.64000000000000001,"15min":0.65400000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80900000000000005,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.46800000000000003}]},{"osd":5,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.622,"15min":0.622},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.68899999999999995,"15min":0.70199999999999996},"min":{"1min":0.42599999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78600000000000003,"5min":1.032,"15min":1.032},"last":0.51900000000000002}]},{"osd":6,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.61899999999999999,"15min":0.629},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.01,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63700000000000001,"15min":0.64300000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.41899999999999998}]},{"osd":7,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65800000000000003,"15min":0.66600000000000004},"min":{"1min":0.44600000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81299999999999994,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.71799999999999997,"15min":0.73499999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.84899999999999998,"5min":1.133,"15min":1.133},"last":0.57599999999999996}]},{"osd":8,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.72399999999999998,"15min":0.73999999999999999},"min":{"1min":0.45800000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80900000000000005,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.95199999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.55000000000000004}]},{"osd":10,"last update":"Thu Aug 10 11:51:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69899999999999995,"15min":0.70699999999999996},"min":{"1min":0.47599999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84099999999999997,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.69799999999999995,"15min":0.70499999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82699999999999996,"5min":1.101,"15min":1.101},"last":0.53000000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":8,"up_from":57,"seq":244813135915,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":446997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.54800000000000004},"min":{"1min":0.42899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81699999999999995,"5min":1.069,"15min":1.069},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.36099999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.79600000000000004,"5min":0.88,"15min":0.88},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Aug 10 11:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.626,"15min":0.61199999999999999},"min":{"1min":0.433,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.64700000000000002,"15min":0.63100000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Aug 10 11:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.44700000000000001,"15min":0.435},"min":{"1min":0.32900000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.48799999999999999,"15min":0.46999999999999997},"min":{"1min":0.28199999999999997,"5min":0.248,"15min":0.248},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Aug 10 11:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.41199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.61899999999999999,"15min":0.56999999999999995},"min":{"1min":0.39400000000000002,"5min":0.374,"15min":0.374},"max":{"1min":5.141,"5min":5.141,"15min":5.141},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Aug 10 11:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.621,"15min":0.59999999999999998},"min":{"1min":0.45700000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65100000000000002,"15min":0.63},"min":{"1min":0.48099999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.877,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Aug 10 11:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58999999999999997,"15min":0.58399999999999996},"min":{"1min":0.376,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56999999999999995,"15min":0.55600000000000005},"min":{"1min":0.39000000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.85299999999999998,"5min":1,"15min":1},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Aug 10 11:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.42099999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.96299999999999997,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73799999999999999,"15min":0.73899999999999999},"min":{"1min":0.53100000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Aug 10 11:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.78100000000000003,"15min":0.76900000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.754},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.72799999999999998,"15min":0.71499999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.85099999999999998}]},{"osd":9,"last update":"Thu Aug 10 11:51:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72499999999999998,"15min":0.71999999999999997},"min":{"1min":0.58299999999999996,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78200000000000003,"15min":0.77600000000000002},"min":{"1min":0.54500000000000004,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.66000000000000003}]},{"osd":10,"last update":"Thu Aug 10 11:51:54 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.77500000000000002,"15min":0.76500000000000001},"min":{"1min":0.67900000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.80400000000000005,"15min":0.79800000000000004},"min":{"1min":0.72999999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.73499999999999999}]},{"osd":11,"last update":"Thu Aug 10 11:51:54 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.81499999999999995}]}]},{"osd":7,"up_from":50,"seq":214748364847,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1544192,"data_stored":1039385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.54500000000000004,"15min":0.53100000000000003},"min":{"1min":0.42099999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.51500000000000001,"15min":0.503},"min":{"1min":0.434,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.40899999999999997}]},{"osd":1,"last update":"Thu Aug 10 11:51:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.432,"15min":0.41199999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63800000000000001,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.501,"5min":0.45500000000000002,"15min":0.432},"min":{"1min":0.36699999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81000000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Aug 10 11:51:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61499999999999999,"15min":0.60799999999999998},"min":{"1min":0.40600000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82799999999999996,"5min":0.878,"15min":0.878},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.60899999999999999,"15min":0.59499999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.876}]},{"osd":3,"last update":"Thu Aug 10 11:51:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.56799999999999995,"15min":0.53800000000000003},"min":{"1min":0.496,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.745},{"interface":"front","average":{"1min":1.012,"5min":0.68400000000000005,"15min":0.61399999999999999},"min":{"1min":0.54300000000000004,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":8.1829999999999998,"5min":8.1829999999999998,"15min":8.1829999999999998},"last":0.80900000000000005}]},{"osd":4,"last update":"Thu Aug 10 11:51:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76100000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35799999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73199999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Aug 10 11:51:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.65700000000000003,"15min":0.64700000000000002},"min":{"1min":0.48499999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.88,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.66100000000000003,"15min":0.63900000000000001},"min":{"1min":0.46200000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.94099999999999995}]},{"osd":6,"last update":"Thu Aug 10 11:51:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.71799999999999997,"15min":0.68899999999999995},"min":{"1min":0.55300000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68799999999999994,"15min":0.67200000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.84499999999999997}]},{"osd":8,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76100000000000001,"15min":0.754},"min":{"1min":0.63100000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.96799999999999997,"5min":1.002,"15min":1.002},"last":1.006},{"interface":"front","average":{"1min":0.754,"5min":0.748,"15min":0.752},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.91500000000000004,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.89400000000000002}]},{"osd":9,"last update":"Thu Aug 10 11:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76100000000000001,"15min":0.75900000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.82299999999999995,"15min":0.82499999999999996},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.0449999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.91200000000000003}]},{"osd":10,"last update":"Thu Aug 10 11:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.81799999999999995,"15min":0.81999999999999995},"min":{"1min":0.60099999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":0.96799999999999997,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76100000000000001,"15min":0.75900000000000001},"min":{"1min":0.56599999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94999999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.99099999999999999}]},{"osd":11,"last update":"Thu Aug 10 11:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":1.024}]}]},{"osd":6,"up_from":45,"seq":193273528372,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":446966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.46700000000000003,"15min":0.38900000000000001},"min":{"1min":0.27500000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":8.9930000000000003,"5min":8.9930000000000003,"15min":8.9930000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":1.03,"5min":0.52900000000000003,"15min":0.434},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":12.326000000000001,"5min":12.326000000000001,"15min":12.326000000000001},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":0.66600000000000004,"15min":0.56399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":11.275,"5min":11.275,"15min":11.275},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.56899999999999995,"15min":0.53800000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.6909999999999998,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":0.69499999999999995,"15min":0.60599999999999998},"min":{"1min":0.40000000000000002,"5min":0.38,"15min":0.38},"max":{"1min":12.244,"5min":12.244,"15min":12.244},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.1619999999999999,"5min":0.68400000000000005,"15min":0.60799999999999998},"min":{"1min":0.443,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":11.195,"5min":11.195,"15min":11.195},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.54300000000000004,"15min":0.44700000000000001},"min":{"1min":0.29799999999999999,"5min":0.254,"15min":0.254},"max":{"1min":11.439,"5min":11.439,"15min":11.439},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.48599999999999999,"15min":0.46800000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.443}]},{"osd":4,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":0.70099999999999996,"15min":0.60499999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":12.272,"5min":12.272,"15min":12.272},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.216,"5min":0.72099999999999997,"15min":0.623},"min":{"1min":0.45300000000000001,"5min":0.433,"15min":0.433},"max":{"1min":11.35,"5min":11.35,"15min":11.35},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.63600000000000001,"15min":0.61599999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":0.505},{"interface":"front","average":{"1min":1.2250000000000001,"5min":0.746,"15min":0.66200000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":12.177,"5min":12.177,"15min":12.177},"last":0.48999999999999999}]},{"osd":7,"last update":"Thu Aug 10 11:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66000000000000003,"15min":0.64700000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.7189999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.1899999999999999,"5min":0.76700000000000002,"15min":0.68700000000000006},"min":{"1min":0.49399999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":11.317,"5min":11.317,"15min":11.317},"last":0.60499999999999998}]},{"osd":8,"last update":"Thu Aug 10 11:52:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":0.78800000000000003,"15min":0.72199999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":11.242000000000001,"5min":11.242000000000001,"15min":11.242000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.3169999999999999,"5min":0.81699999999999995,"15min":0.748},"min":{"1min":0.495,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":12.215,"5min":12.215,"15min":12.215},"last":0.55100000000000005}]},{"osd":9,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":0.77900000000000003,"15min":0.71599999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":12.300000000000001,"5min":12.300000000000001,"15min":12.300000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":1.1539999999999999,"5min":0.78500000000000003,"15min":0.72299999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":11.411,"5min":11.411,"15min":11.411},"last":0.63}]},{"osd":10,"last update":"Thu Aug 10 11:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.72499999999999998,"15min":0.71699999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.7480000000000002,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":0.59299999999999997},{"interface":"front","average":{"1min":1.2909999999999999,"5min":0.875,"15min":0.80500000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":11.379,"5min":11.379,"15min":11.379},"last":0.70499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":504363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.41699999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.54400000000000004,"15min":0.52000000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Aug 10 11:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.64500000000000002,"15min":0.59599999999999997},"min":{"1min":0.39900000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96899999999999997,"5min":1.05,"15min":1.05},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.61699999999999999,"15min":0.57399999999999995},"min":{"1min":0.47599999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86299999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.73899999999999999}]},{"osd":3,"last update":"Thu Aug 10 11:51:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.55200000000000005},"min":{"1min":0.37,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79500000000000004,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.41099999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.35999999999999999}]},{"osd":4,"last update":"Thu Aug 10 11:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.45000000000000001,"15min":0.442},"min":{"1min":0.309,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67200000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.504,"15min":0.48199999999999998},"min":{"1min":0.372,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.83699999999999997,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.41699999999999998}]},{"osd":5,"last update":"Thu Aug 10 11:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.60799999999999998,"15min":0.55200000000000005},"min":{"1min":0.57699999999999996,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.85499999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.628,"15min":0.57199999999999995},"min":{"1min":0.42799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.93500000000000005,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Aug 10 11:51:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65400000000000003,"15min":0.64900000000000002},"min":{"1min":0.42699999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90900000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.754},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58499999999999996,"15min":0.58799999999999997},"min":{"1min":0.38,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78200000000000003,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.46300000000000002}]},{"osd":7,"last update":"Thu Aug 10 11:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.58599999999999997,"15min":0.56799999999999995},"min":{"1min":0.44,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.89300000000000002,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.63100000000000001,"15min":0.61099999999999999},"min":{"1min":0.45200000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.97099999999999997,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.625}]},{"osd":8,"last update":"Thu Aug 10 11:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63400000000000001,"15min":0.61799999999999999},"min":{"1min":0.443,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.72299999999999998,"15min":0.70199999999999996},"min":{"1min":0.61799999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95399999999999996,"5min":1.085,"15min":1.085},"last":0.68000000000000005}]},{"osd":9,"last update":"Thu Aug 10 11:51:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.73999999999999999,"15min":0.73099999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97299999999999998,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.67000000000000004},"min":{"1min":0.51500000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85499999999999998,"5min":1.026,"15min":1.026},"last":0.56100000000000005}]},{"osd":10,"last update":"Thu Aug 10 11:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.65800000000000003,"15min":0.64900000000000002},"min":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91500000000000004,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.753,"15min":0.74399999999999999},"min":{"1min":0.67900000000000005,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92600000000000005,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.57399999999999995}]},{"osd":11,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.71399999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738445,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":448830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 11:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56599999999999995,"15min":0.51200000000000001},"min":{"1min":0.33800000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.755,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56399999999999995,"15min":0.52800000000000002},"min":{"1min":0.48299999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73399999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Aug 10 11:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.40999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69299999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57699999999999996,"15min":0.54400000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77900000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Aug 10 11:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56100000000000005,"15min":0.53300000000000003},"min":{"1min":0.374,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70399999999999996,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53500000000000003,"15min":0.52100000000000002},"min":{"1min":0.38700000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.61799999999999999,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Aug 10 11:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56100000000000005,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78800000000000003,"5min":0.874,"15min":0.874},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.40799999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.64500000000000002,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Aug 10 11:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.77700000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.66100000000000003,"5min":0.872,"15min":0.872},"last":0.497}]},{"osd":7,"last update":"Thu Aug 10 11:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.498,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.505}]},{"osd":8,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.67700000000000005,"15min":0.70799999999999996},"min":{"1min":0.46800000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.83599999999999997,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66000000000000003,"15min":0.68700000000000006},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82299999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.51900000000000002}]},{"osd":9,"last update":"Thu Aug 10 11:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.59999999999999998,"15min":0.61399999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67900000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.69499999999999995,"15min":0.72099999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79100000000000004,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.64000000000000001}]},{"osd":10,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.69699999999999995,"15min":0.70599999999999996},"min":{"1min":0.48799999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80800000000000005,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68899999999999995,"15min":0.69299999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.82899999999999996,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.62}]},{"osd":11,"last update":"Thu Aug 10 11:52:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66400000000000003,"15min":0.66100000000000003},"min":{"1min":0.58299999999999996,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85499999999999998,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.627,"15min":0.621},"min":{"1min":0.52200000000000002,"5min":0.502,"15min":0.502},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.65700000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411397,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":505066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54800000000000004,"15min":0.51200000000000001},"min":{"1min":0.373,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.81599999999999995,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.51700000000000002},"min":{"1min":0.38900000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.746,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Aug 10 11:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56100000000000005,"15min":0.52500000000000002},"min":{"1min":0.30199999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.64900000000000002,"15min":0.66700000000000004},"min":{"1min":0.45400000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.85199999999999998,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Aug 10 11:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.64300000000000002,"15min":0.68500000000000005},"min":{"1min":0.433,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86699999999999999,"5min":3.7519999999999998,"15min":3.7519999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52000000000000002,"15min":0.495},"min":{"1min":0.36699999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74399999999999999,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Aug 10 11:51:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Aug 10 11:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.497,"15min":0.47699999999999998},"min":{"1min":0.38400000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.379},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.46899999999999997,"15min":0.441},"min":{"1min":0.33800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Aug 10 11:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58199999999999996,"15min":0.56299999999999994},"min":{"1min":0.46300000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85999999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66200000000000003,"15min":0.64800000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.91300000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.73899999999999999,"15min":0.73799999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.503}]},{"osd":8,"last update":"Thu Aug 10 11:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.628,"15min":0.60699999999999998},"min":{"1min":0.46700000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.98199999999999998,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.622},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.58899999999999997,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.64900000000000002}]},{"osd":9,"last update":"Thu Aug 10 11:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.82999999999999996,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.70499999999999996,"15min":0.70699999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.82899999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.51700000000000002}]},{"osd":10,"last update":"Thu Aug 10 11:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.70199999999999996,"15min":0.69399999999999995},"min":{"1min":0.52200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.77700000000000002,"15min":0.77200000000000002},"min":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.78800000000000003}]},{"osd":11,"last update":"Thu Aug 10 11:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.72099999999999997}]}]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":446845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:52:24 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.35799999999999998,"15min":0.35899999999999999},"min":{"1min":0.26000000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.47399999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.36699999999999999,"15min":0.35899999999999999},"min":{"1min":0.249,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.44600000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Aug 10 11:52:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56699999999999995,"15min":0.55600000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56499999999999995,"15min":0.55600000000000005},"min":{"1min":0.41499999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82199999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Aug 10 11:52:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59199999999999997,"15min":0.55900000000000005},"min":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.4049999999999998,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":0.498},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58799999999999997,"15min":0.55100000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68899999999999995,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.629}]},{"osd":4,"last update":"Thu Aug 10 11:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.376,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74299999999999999,"5min":1.028,"15min":1.028},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59799999999999998,"15min":0.59499999999999997},"min":{"1min":0.40899999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77000000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Aug 10 11:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.58299999999999996,"15min":0.57199999999999995},"min":{"1min":0.38,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78700000000000003,"5min":0.999,"15min":0.999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.61899999999999999,"15min":0.60699999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73299999999999998,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Aug 10 11:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.48099999999999998,"15min":0.46700000000000003},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.69699999999999995,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.434},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48299999999999998,"15min":0.46100000000000002},"min":{"1min":0.35499999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.45000000000000001}]},{"osd":7,"last update":"Thu Aug 10 11:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78100000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.63800000000000001,"15min":0.623},"min":{"1min":0.47899999999999998,"5min":0.434,"15min":0.434},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.60099999999999998}]},{"osd":8,"last update":"Thu Aug 10 11:50:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.67900000000000005}]},{"osd":9,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.627,"15min":0.64500000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83999999999999997,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.621,"15min":0.64100000000000001},"min":{"1min":0.38100000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.85699999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.46400000000000002}]},{"osd":10,"last update":"Thu Aug 10 11:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.73199999999999998,"15min":0.749},"min":{"1min":0.45800000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.80300000000000005,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.64700000000000002}]},{"osd":11,"last update":"Thu Aug 10 11:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.375,"5min":2.375,"15min":2.375},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.65900000000000003}]}]},{"osd":4,"up_from":32,"seq":137438953533,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":447493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54200000000000004,"15min":0.51400000000000001},"min":{"1min":0.39500000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79700000000000004,"5min":1.875,"15min":1.875},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.54300000000000004,"15min":0.51700000000000002},"min":{"1min":0.40899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Aug 10 11:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41999999999999998,"15min":0.40500000000000003},"min":{"1min":0.26300000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.57299999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.42899999999999999,"15min":0.40200000000000002},"min":{"1min":0.30199999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.57499999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Aug 10 11:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.59499999999999997,"15min":0.57899999999999996},"min":{"1min":0.47899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59299999999999997,"15min":0.57799999999999996},"min":{"1min":0.46700000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75800000000000001,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.626}]},{"osd":3,"last update":"Thu Aug 10 11:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59199999999999997,"15min":0.54900000000000004},"min":{"1min":0.40400000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76800000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56599999999999995,"15min":0.55400000000000005},"min":{"1min":0.40699999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76000000000000001,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.55000000000000004}]},{"osd":5,"last update":"Thu Aug 10 11:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.622,"15min":0.59999999999999998},"min":{"1min":0.47999999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81200000000000006,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.65300000000000002,"15min":0.60399999999999998},"min":{"1min":0.504,"5min":0.374,"15min":0.374},"max":{"1min":0.90400000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.71899999999999997}]},{"osd":6,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67100000000000004,"15min":0.67200000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92000000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83099999999999996,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.46899999999999997}]},{"osd":7,"last update":"Thu Aug 10 11:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.58399999999999996,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.92200000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.55800000000000005,"15min":0.53200000000000003},"min":{"1min":0.33700000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.70199999999999996}]},{"osd":8,"last update":"Thu Aug 10 11:52:18 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71699999999999997,"15min":0.70599999999999996},"min":{"1min":0.47199999999999998,"5min":0.441,"15min":0.441},"max":{"1min":0.92700000000000005,"5min":1.004,"15min":1.004},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.77000000000000002,"15min":0.753},"min":{"1min":0.56299999999999994,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95399999999999996,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.84599999999999997}]},{"osd":9,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.69199999999999995}]},{"osd":10,"last update":"Thu Aug 10 11:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76300000000000001,"15min":0.76100000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.90900000000000003,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.81799999999999995,"15min":0.81999999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.97799999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.79000000000000004}]},{"osd":11,"last update":"Thu Aug 10 11:51:54 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.80300000000000005}]}]},{"osd":5,"up_from":37,"seq":158913790007,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1552384,"data_stored":1038828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76200000000000001,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.628},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34399999999999997,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.56999999999999995}]},{"osd":1,"last update":"Thu Aug 10 11:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.56699999999999995,"15min":0.53000000000000003},"min":{"1min":0.45800000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.92200000000000004,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.58699999999999997,"15min":0.55000000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Aug 10 11:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.42499999999999999,"15min":0.39200000000000002},"min":{"1min":0.35299999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.435,"15min":0.40899999999999997},"min":{"1min":0.375,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.67000000000000004}]},{"osd":3,"last update":"Thu Aug 10 11:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56100000000000005,"15min":0.55300000000000005},"min":{"1min":0.34200000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.54300000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76300000000000001,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.70399999999999996}]},{"osd":4,"last update":"Thu Aug 10 11:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.624,"15min":0.59599999999999997},"min":{"1min":0.52600000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93000000000000005,"5min":1.109,"15min":1.109},"last":0.749},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.61299999999999999,"15min":0.58699999999999997},"min":{"1min":0.47599999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91800000000000004,"5min":1.002,"15min":1.002},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Aug 10 11:51:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.60799999999999998,"15min":0.58199999999999996},"min":{"1min":0.46700000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.64700000000000002,"15min":0.63900000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90200000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.83499999999999996}]},{"osd":7,"last update":"Thu Aug 10 11:51:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.63500000000000001,"15min":0.623},"min":{"1min":0.36299999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.66300000000000003,"15min":0.65100000000000002},"min":{"1min":0.49099999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94699999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.85299999999999998}]},{"osd":8,"last update":"Thu Aug 10 11:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.64600000000000002,"15min":0.63200000000000001},"min":{"1min":0.48199999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.44,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.88900000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.93000000000000005}]},{"osd":9,"last update":"Thu Aug 10 11:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.73599999999999999,"15min":0.69999999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":5.2999999999999998,"5min":5.2999999999999998,"15min":5.2999999999999998},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.73599999999999999,"15min":0.72899999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.91600000000000004}]},{"osd":10,"last update":"Thu Aug 10 11:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.71599999999999997,"15min":0.70499999999999996},"min":{"1min":0.53200000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.73099999999999998,"15min":0.71799999999999997},"min":{"1min":0.622,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.90100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":58194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":63875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T11:52:27.364 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-08-10T11:52:27.364 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T11:52:27.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.516+0000 7f68d5d87700 1 -- 172.21.15.73:0/2891623278 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68d0100770 msgr2=0x7f68d0100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:27.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.516+0000 7f68d5d87700 1 --2- 172.21.15.73:0/2891623278 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68d0100770 0x7f68d0100b90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f68c00099c0 tx=0x7f68c0009cd0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.516+0000 7f68d5d87700 1 -- 172.21.15.73:0/2891623278 shutdown_connections 2023-08-10T11:52:27.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.516+0000 7f68d5d87700 1 --2- 172.21.15.73:0/2891623278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68d0102300 0x7f68d0108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.516+0000 7f68d5d87700 1 --2- 172.21.15.73:0/2891623278 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68d0100770 0x7f68d0100b90 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.516+0000 7f68d5d87700 1 --2- 172.21.15.73:0/2891623278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68d0101960 0x7f68d0101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.516+0000 7f68d5d87700 1 -- 172.21.15.73:0/2891623278 >> 172.21.15.73:0/2891623278 conn(0x7f68d00fbcc0 msgr2=0x7f68d00fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:27.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.516+0000 7f68d5d87700 1 -- 172.21.15.73:0/2891623278 shutdown_connections 2023-08-10T11:52:27.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.516+0000 7f68d5d87700 1 -- 172.21.15.73:0/2891623278 wait complete. 2023-08-10T11:52:27.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.517+0000 7f68d5d87700 1 Processor -- start 2023-08-10T11:52:27.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.517+0000 7f68d5d87700 1 -- start start 2023-08-10T11:52:27.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.517+0000 7f68d5d87700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68d0100770 0x7f68d01963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:27.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.517+0000 7f68d5d87700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68d0101960 0x7f68d0196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:27.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.517+0000 7f68d5d87700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68d0102300 0x7f68d019d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:27.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.517+0000 7f68d5d87700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d019df60 con 0x7f68d0102300 2023-08-10T11:52:27.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.517+0000 7f68d5d87700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d019e0a0 con 0x7f68d0100770 2023-08-10T11:52:27.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.517+0000 7f68d5d87700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d019e230 con 0x7f68d0101960 2023-08-10T11:52:27.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.517+0000 7f68cffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68d0102300 0x7f68d019d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:27.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.517+0000 7f68cffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68d0102300 0x7f68d019d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60590/0 (socket says 172.21.15.73:60590) 2023-08-10T11:52:27.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.517+0000 7f68cffff700 1 -- 172.21.15.73:0/699461312 learned_addr learned my addr 172.21.15.73:0/699461312 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:27.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.517+0000 7f68cf7fe700 1 --2- 172.21.15.73:0/699461312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68d0100770 0x7f68d01963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:27.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.517+0000 7f68ceffd700 1 --2- 172.21.15.73:0/699461312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68d0101960 0x7f68d0196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:27.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.517+0000 7f68cffff700 1 -- 172.21.15.73:0/699461312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68d0101960 msgr2=0x7f68d0196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:27.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.517+0000 7f68cffff700 1 --2- 172.21.15.73:0/699461312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68d0101960 0x7f68d0196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.517+0000 7f68cffff700 1 -- 172.21.15.73:0/699461312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68d0100770 msgr2=0x7f68d01963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:27.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.517+0000 7f68cffff700 1 --2- 172.21.15.73:0/699461312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68d0100770 0x7f68d01963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.517+0000 7f68cffff700 1 -- 172.21.15.73:0/699461312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c00095f0 con 0x7f68d0102300 2023-08-10T11:52:27.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.518+0000 7f68cf7fe700 1 --2- 172.21.15.73:0/699461312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68d0100770 0x7f68d01963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:52:27.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.518+0000 7f68ceffd700 1 --2- 172.21.15.73:0/699461312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68d0101960 0x7f68d0196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:52:27.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.518+0000 7f68cffff700 1 --2- 172.21.15.73:0/699461312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68d0102300 0x7f68d019d990 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f68c8007ee0 tx=0x7f68c800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:27.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.518+0000 7f68ccff9700 1 -- 172.21.15.73:0/699461312 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c8017070 con 0x7f68d0102300 2023-08-10T11:52:27.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.518+0000 7f68ccff9700 1 -- 172.21.15.73:0/699461312 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68c800f040 con 0x7f68d0102300 2023-08-10T11:52:27.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.518+0000 7f68d5d87700 1 -- 172.21.15.73:0/699461312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d019e510 con 0x7f68d0102300 2023-08-10T11:52:27.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.518+0000 7f68ccff9700 1 -- 172.21.15.73:0/699461312 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c8005740 con 0x7f68d0102300 2023-08-10T11:52:27.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.518+0000 7f68d5d87700 1 -- 172.21.15.73:0/699461312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d019e9d0 con 0x7f68d0102300 2023-08-10T11:52:27.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.519+0000 7f68d5d87700 1 -- 172.21.15.73:0/699461312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d010bf80 con 0x7f68d0102300 2023-08-10T11:52:27.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.521+0000 7f68ccff9700 1 -- 172.21.15.73:0/699461312 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f68c80058a0 con 0x7f68d0102300 2023-08-10T11:52:27.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.521+0000 7f68ccff9700 1 --2- 172.21.15.73:0/699461312 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f68bc0a11a0 0x7f68bc0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:27.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.521+0000 7f68cf7fe700 1 --2- 172.21.15.73:0/699461312 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f68bc0a11a0 0x7f68bc0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:27.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.521+0000 7f68ccff9700 1 -- 172.21.15.73:0/699461312 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f68c80cc7a0 con 0x7f68d0102300 2023-08-10T11:52:27.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.522+0000 7f68cf7fe700 1 --2- 172.21.15.73:0/699461312 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f68bc0a11a0 0x7f68bc0a3660 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f68c000b580 tx=0x7f68c0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:27.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.525+0000 7f68ccff9700 1 -- 172.21.15.73:0/699461312 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f68c8095f00 con 0x7f68d0102300 2023-08-10T11:52:27.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.713+0000 7f68d5d87700 1 -- 172.21.15.73:0/699461312 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f68d0060bb0 con 0x7f68bc0a11a0 2023-08-10T11:52:27.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.723+0000 7f68ccff9700 1 -- 172.21.15.73:0/699461312 <== mgr.14152 v2:172.21.15.73:6800/3797582815 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344700 (secure 0 0 0) 0x7f68d0060bb0 con 0x7f68bc0a11a0 2023-08-10T11:52:27.727 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:52:27.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.726+0000 7f68d5d87700 1 -- 172.21.15.73:0/699461312 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f68bc0a11a0 msgr2=0x7f68bc0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:27.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.726+0000 7f68d5d87700 1 --2- 172.21.15.73:0/699461312 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f68bc0a11a0 0x7f68bc0a3660 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f68c000b580 tx=0x7f68c0005fb0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.726+0000 7f68d5d87700 1 -- 172.21.15.73:0/699461312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68d0102300 msgr2=0x7f68d019d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:27.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.726+0000 7f68d5d87700 1 --2- 172.21.15.73:0/699461312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68d0102300 0x7f68d019d990 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f68c8007ee0 tx=0x7f68c800d3b0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.726+0000 7f68d5d87700 1 -- 172.21.15.73:0/699461312 shutdown_connections 2023-08-10T11:52:27.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.726+0000 7f68d5d87700 1 --2- 172.21.15.73:0/699461312 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f68bc0a11a0 0x7f68bc0a3660 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.726+0000 7f68d5d87700 1 --2- 172.21.15.73:0/699461312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68d0100770 0x7f68d01963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.726+0000 7f68d5d87700 1 --2- 172.21.15.73:0/699461312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68d0102300 0x7f68d019d990 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.726+0000 7f68d5d87700 1 --2- 172.21.15.73:0/699461312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68d0101960 0x7f68d0196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.726+0000 7f68d5d87700 1 -- 172.21.15.73:0/699461312 >> 172.21.15.73:0/699461312 conn(0x7f68d00fbcc0 msgr2=0x7f68d00fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:27.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.726+0000 7f68d5d87700 1 -- 172.21.15.73:0/699461312 shutdown_connections 2023-08-10T11:52:27.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.726+0000 7f68d5d87700 1 -- 172.21.15.73:0/699461312 wait complete. 2023-08-10T11:52:27.731 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-08-10T11:52:27.739 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2023-08-10T11:52:26.502435+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659562,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1017,"num_read_kb":628,"num_write":423,"num_write_kb":3077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1181408,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":849,"ondisk_log_size":849,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337240,"kb_used_data":13048,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124604584,"statfs":{"total":1151940427776,"available":1151595094016,"internally_reserved":0,"allocated":13361152,"data_stored":7320112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6087,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":78,"num_write":11,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002929"},"pg_stats":[{"pgid":"3.3f","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.525060+0000","last_change":"2023-08-10T11:50:54.902569+0000","last_active":"2023-08-10T11:52:18.525060+0000","last_peered":"2023-08-10T11:52:18.525060+0000","last_clean":"2023-08-10T11:52:18.525060+0000","last_became_active":"2023-08-10T11:50:54.902058+0000","last_became_peered":"2023-08-10T11:50:54.902058+0000","last_unstale":"2023-08-10T11:52:18.525060+0000","last_undegraded":"2023-08-10T11:52:18.525060+0000","last_fullsized":"2023-08-10T11:52:18.525060+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:46:00.569005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.510420+0000","last_change":"2023-08-10T11:50:54.942908+0000","last_active":"2023-08-10T11:52:18.510420+0000","last_peered":"2023-08-10T11:52:18.510420+0000","last_clean":"2023-08-10T11:52:18.510420+0000","last_became_active":"2023-08-10T11:50:54.941765+0000","last_became_peered":"2023-08-10T11:50:54.941765+0000","last_unstale":"2023-08-10T11:52:18.510420+0000","last_undegraded":"2023-08-10T11:52:18.510420+0000","last_fullsized":"2023-08-10T11:52:18.510420+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:53:56.170569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.519409+0000","last_change":"2023-08-10T11:50:54.940670+0000","last_active":"2023-08-10T11:52:18.519409+0000","last_peered":"2023-08-10T11:52:18.519409+0000","last_clean":"2023-08-10T11:52:18.519409+0000","last_became_active":"2023-08-10T11:50:54.939906+0000","last_became_peered":"2023-08-10T11:50:54.939906+0000","last_unstale":"2023-08-10T11:52:18.519409+0000","last_undegraded":"2023-08-10T11:52:18.519409+0000","last_fullsized":"2023-08-10T11:52:18.519409+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:43:14.123136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.513041+0000","last_change":"2023-08-10T11:50:54.910964+0000","last_active":"2023-08-10T11:52:18.513041+0000","last_peered":"2023-08-10T11:52:18.513041+0000","last_clean":"2023-08-10T11:52:18.513041+0000","last_became_active":"2023-08-10T11:50:54.910185+0000","last_became_peered":"2023-08-10T11:50:54.910185+0000","last_unstale":"2023-08-10T11:52:18.513041+0000","last_undegraded":"2023-08-10T11:52:18.513041+0000","last_fullsized":"2023-08-10T11:52:18.513041+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:55:02.929754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.508834+0000","last_change":"2023-08-10T11:50:54.905354+0000","last_active":"2023-08-10T11:52:18.508834+0000","last_peered":"2023-08-10T11:52:18.508834+0000","last_clean":"2023-08-10T11:52:18.508834+0000","last_became_active":"2023-08-10T11:50:54.904982+0000","last_became_peered":"2023-08-10T11:50:54.904982+0000","last_unstale":"2023-08-10T11:52:18.508834+0000","last_undegraded":"2023-08-10T11:52:18.508834+0000","last_fullsized":"2023-08-10T11:52:18.508834+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:57:07.369827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.514900+0000","last_change":"2023-08-10T11:51:49.650435+0000","last_active":"2023-08-10T11:52:18.514900+0000","last_peered":"2023-08-10T11:52:18.514900+0000","last_clean":"2023-08-10T11:52:18.514900+0000","last_became_active":"2023-08-10T11:51:49.649975+0000","last_became_peered":"2023-08-10T11:51:49.649975+0000","last_unstale":"2023-08-10T11:52:18.514900+0000","last_undegraded":"2023-08-10T11:52:18.514900+0000","last_fullsized":"2023-08-10T11:52:18.514900+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:15:31.959610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.511353+0000","last_change":"2023-08-10T11:50:54.904604+0000","last_active":"2023-08-10T11:52:18.511353+0000","last_peered":"2023-08-10T11:52:18.511353+0000","last_clean":"2023-08-10T11:52:18.511353+0000","last_became_active":"2023-08-10T11:50:54.904295+0000","last_became_peered":"2023-08-10T11:50:54.904295+0000","last_unstale":"2023-08-10T11:52:18.511353+0000","last_undegraded":"2023-08-10T11:52:18.511353+0000","last_fullsized":"2023-08-10T11:52:18.511353+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:32:18.264657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.515232+0000","last_change":"2023-08-10T11:50:54.963398+0000","last_active":"2023-08-10T11:52:18.515232+0000","last_peered":"2023-08-10T11:52:18.515232+0000","last_clean":"2023-08-10T11:52:18.515232+0000","last_became_active":"2023-08-10T11:50:54.963048+0000","last_became_peered":"2023-08-10T11:50:54.963048+0000","last_unstale":"2023-08-10T11:52:18.515232+0000","last_undegraded":"2023-08-10T11:52:18.515232+0000","last_fullsized":"2023-08-10T11:52:18.515232+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:28:39.416861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.521717+0000","last_change":"2023-08-10T11:50:54.913426+0000","last_active":"2023-08-10T11:52:18.521717+0000","last_peered":"2023-08-10T11:52:18.521717+0000","last_clean":"2023-08-10T11:52:18.521717+0000","last_became_active":"2023-08-10T11:50:54.913099+0000","last_became_peered":"2023-08-10T11:50:54.913099+0000","last_unstale":"2023-08-10T11:52:18.521717+0000","last_undegraded":"2023-08-10T11:52:18.521717+0000","last_fullsized":"2023-08-10T11:52:18.521717+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:45:48.662369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.514590+0000","last_change":"2023-08-10T11:50:54.909259+0000","last_active":"2023-08-10T11:52:18.514590+0000","last_peered":"2023-08-10T11:52:18.514590+0000","last_clean":"2023-08-10T11:52:18.514590+0000","last_became_active":"2023-08-10T11:50:54.908898+0000","last_became_peered":"2023-08-10T11:50:54.908898+0000","last_unstale":"2023-08-10T11:52:18.514590+0000","last_undegraded":"2023-08-10T11:52:18.514590+0000","last_fullsized":"2023-08-10T11:52:18.514590+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:36:43.966446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.522763+0000","last_change":"2023-08-10T11:50:54.906152+0000","last_active":"2023-08-10T11:52:18.522763+0000","last_peered":"2023-08-10T11:52:18.522763+0000","last_clean":"2023-08-10T11:52:18.522763+0000","last_became_active":"2023-08-10T11:50:54.905859+0000","last_became_peered":"2023-08-10T11:50:54.905859+0000","last_unstale":"2023-08-10T11:52:18.522763+0000","last_undegraded":"2023-08-10T11:52:18.522763+0000","last_fullsized":"2023-08-10T11:52:18.522763+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:37:40.007291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.510458+0000","last_change":"2023-08-10T11:50:54.911195+0000","last_active":"2023-08-10T11:52:18.510458+0000","last_peered":"2023-08-10T11:52:18.510458+0000","last_clean":"2023-08-10T11:52:18.510458+0000","last_became_active":"2023-08-10T11:50:54.910618+0000","last_became_peered":"2023-08-10T11:50:54.910618+0000","last_unstale":"2023-08-10T11:52:18.510458+0000","last_undegraded":"2023-08-10T11:52:18.510458+0000","last_fullsized":"2023-08-10T11:52:18.510458+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:37:39.875599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.517052+0000","last_change":"2023-08-10T11:50:54.908051+0000","last_active":"2023-08-10T11:52:18.517052+0000","last_peered":"2023-08-10T11:52:18.517052+0000","last_clean":"2023-08-10T11:52:18.517052+0000","last_became_active":"2023-08-10T11:50:54.907772+0000","last_became_peered":"2023-08-10T11:50:54.907772+0000","last_unstale":"2023-08-10T11:52:18.517052+0000","last_undegraded":"2023-08-10T11:52:18.517052+0000","last_fullsized":"2023-08-10T11:52:18.517052+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:13:41.292582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.522591+0000","last_change":"2023-08-10T11:50:54.941327+0000","last_active":"2023-08-10T11:52:18.522591+0000","last_peered":"2023-08-10T11:52:18.522591+0000","last_clean":"2023-08-10T11:52:18.522591+0000","last_became_active":"2023-08-10T11:50:54.941020+0000","last_became_peered":"2023-08-10T11:50:54.941020+0000","last_unstale":"2023-08-10T11:52:18.522591+0000","last_undegraded":"2023-08-10T11:52:18.522591+0000","last_fullsized":"2023-08-10T11:52:18.522591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:39:28.002709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.517814+0000","last_change":"2023-08-10T11:50:54.940236+0000","last_active":"2023-08-10T11:52:18.517814+0000","last_peered":"2023-08-10T11:52:18.517814+0000","last_clean":"2023-08-10T11:52:18.517814+0000","last_became_active":"2023-08-10T11:50:54.939921+0000","last_became_peered":"2023-08-10T11:50:54.939921+0000","last_unstale":"2023-08-10T11:52:18.517814+0000","last_undegraded":"2023-08-10T11:52:18.517814+0000","last_fullsized":"2023-08-10T11:52:18.517814+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:26:42.811526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.524237+0000","last_change":"2023-08-10T11:50:54.903773+0000","last_active":"2023-08-10T11:52:18.524237+0000","last_peered":"2023-08-10T11:52:18.524237+0000","last_clean":"2023-08-10T11:52:18.524237+0000","last_became_active":"2023-08-10T11:50:54.903516+0000","last_became_peered":"2023-08-10T11:50:54.903516+0000","last_unstale":"2023-08-10T11:52:18.524237+0000","last_undegraded":"2023-08-10T11:52:18.524237+0000","last_fullsized":"2023-08-10T11:52:18.524237+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:14:22.982193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.525326+0000","last_change":"2023-08-10T11:50:54.902364+0000","last_active":"2023-08-10T11:52:18.525326+0000","last_peered":"2023-08-10T11:52:18.525326+0000","last_clean":"2023-08-10T11:52:18.525326+0000","last_became_active":"2023-08-10T11:50:54.901673+0000","last_became_peered":"2023-08-10T11:50:54.901673+0000","last_unstale":"2023-08-10T11:52:18.525326+0000","last_undegraded":"2023-08-10T11:52:18.525326+0000","last_fullsized":"2023-08-10T11:52:18.525326+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:29:24.743838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.513050+0000","last_change":"2023-08-10T11:50:54.911896+0000","last_active":"2023-08-10T11:52:18.513050+0000","last_peered":"2023-08-10T11:52:18.513050+0000","last_clean":"2023-08-10T11:52:18.513050+0000","last_became_active":"2023-08-10T11:50:54.911469+0000","last_became_peered":"2023-08-10T11:50:54.911469+0000","last_unstale":"2023-08-10T11:52:18.513050+0000","last_undegraded":"2023-08-10T11:52:18.513050+0000","last_fullsized":"2023-08-10T11:52:18.513050+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:44:23.395246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.503698+0000","last_change":"2023-08-10T11:50:54.964030+0000","last_active":"2023-08-10T11:52:18.503698+0000","last_peered":"2023-08-10T11:52:18.503698+0000","last_clean":"2023-08-10T11:52:18.503698+0000","last_became_active":"2023-08-10T11:50:54.963744+0000","last_became_peered":"2023-08-10T11:50:54.963744+0000","last_unstale":"2023-08-10T11:52:18.503698+0000","last_undegraded":"2023-08-10T11:52:18.503698+0000","last_fullsized":"2023-08-10T11:52:18.503698+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:38:53.944486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:23.279365+0000","last_change":"2023-08-10T11:51:50.242773+0000","last_active":"2023-08-10T11:52:23.279365+0000","last_peered":"2023-08-10T11:52:23.279365+0000","last_clean":"2023-08-10T11:52:23.279365+0000","last_became_active":"2023-08-10T11:51:50.231825+0000","last_became_peered":"2023-08-10T11:51:50.231825+0000","last_unstale":"2023-08-10T11:52:23.279365+0000","last_undegraded":"2023-08-10T11:52:23.279365+0000","last_fullsized":"2023-08-10T11:52:23.279365+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:05:02.299515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":77,"num_read_kb":77,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.505872+0000","last_change":"2023-08-10T11:50:54.961422+0000","last_active":"2023-08-10T11:52:18.505872+0000","last_peered":"2023-08-10T11:52:18.505872+0000","last_clean":"2023-08-10T11:52:18.505872+0000","last_became_active":"2023-08-10T11:50:54.960627+0000","last_became_peered":"2023-08-10T11:50:54.960627+0000","last_unstale":"2023-08-10T11:52:18.505872+0000","last_undegraded":"2023-08-10T11:52:18.505872+0000","last_fullsized":"2023-08-10T11:52:18.505872+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:39:24.168437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:50.151329+0000","last_change":"2023-08-10T11:50:53.907291+0000","last_active":"2023-08-10T11:51:50.151329+0000","last_peered":"2023-08-10T11:51:50.151329+0000","last_clean":"2023-08-10T11:51:50.151329+0000","last_became_active":"2023-08-10T11:50:53.906997+0000","last_became_peered":"2023-08-10T11:50:53.906997+0000","last_unstale":"2023-08-10T11:51:50.151329+0000","last_undegraded":"2023-08-10T11:51:50.151329+0000","last_fullsized":"2023-08-10T11:51:50.151329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:38:08.640581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.524609+0000","last_change":"2023-08-10T11:50:54.940828+0000","last_active":"2023-08-10T11:52:18.524609+0000","last_peered":"2023-08-10T11:52:18.524609+0000","last_clean":"2023-08-10T11:52:18.524609+0000","last_became_active":"2023-08-10T11:50:54.940169+0000","last_became_peered":"2023-08-10T11:50:54.940169+0000","last_unstale":"2023-08-10T11:52:18.524609+0000","last_undegraded":"2023-08-10T11:52:18.524609+0000","last_fullsized":"2023-08-10T11:52:18.524609+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:24:33.034519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.648534+0000","last_change":"2023-08-10T11:50:53.906366+0000","last_active":"2023-08-10T11:51:49.648534+0000","last_peered":"2023-08-10T11:51:49.648534+0000","last_clean":"2023-08-10T11:51:49.648534+0000","last_became_active":"2023-08-10T11:50:53.906057+0000","last_became_peered":"2023-08-10T11:50:53.906057+0000","last_unstale":"2023-08-10T11:51:49.648534+0000","last_undegraded":"2023-08-10T11:51:49.648534+0000","last_fullsized":"2023-08-10T11:51:49.648534+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:30:54.764094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.524595+0000","last_change":"2023-08-10T11:50:54.908534+0000","last_active":"2023-08-10T11:52:18.524595+0000","last_peered":"2023-08-10T11:52:18.524595+0000","last_clean":"2023-08-10T11:52:18.524595+0000","last_became_active":"2023-08-10T11:50:54.908244+0000","last_became_peered":"2023-08-10T11:50:54.908244+0000","last_unstale":"2023-08-10T11:52:18.524595+0000","last_undegraded":"2023-08-10T11:52:18.524595+0000","last_fullsized":"2023-08-10T11:52:18.524595+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:47:54.968386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.648328+0000","last_change":"2023-08-10T11:50:53.902325+0000","last_active":"2023-08-10T11:51:49.648328+0000","last_peered":"2023-08-10T11:51:49.648328+0000","last_clean":"2023-08-10T11:51:49.648328+0000","last_became_active":"2023-08-10T11:50:53.902020+0000","last_became_peered":"2023-08-10T11:50:53.902020+0000","last_unstale":"2023-08-10T11:51:49.648328+0000","last_undegraded":"2023-08-10T11:51:49.648328+0000","last_fullsized":"2023-08-10T11:51:49.648328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:38:19.283511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.519269+0000","last_change":"2023-08-10T11:50:54.910291+0000","last_active":"2023-08-10T11:52:18.519269+0000","last_peered":"2023-08-10T11:52:18.519269+0000","last_clean":"2023-08-10T11:52:18.519269+0000","last_became_active":"2023-08-10T11:50:54.909886+0000","last_became_peered":"2023-08-10T11:50:54.909886+0000","last_unstale":"2023-08-10T11:52:18.519269+0000","last_undegraded":"2023-08-10T11:52:18.519269+0000","last_fullsized":"2023-08-10T11:52:18.519269+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:50:14.009986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'5","reported_seq":109,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:20.633349+0000","last_change":"2023-08-10T11:50:53.904363+0000","last_active":"2023-08-10T11:52:20.633349+0000","last_peered":"2023-08-10T11:52:20.633349+0000","last_clean":"2023-08-10T11:52:20.633349+0000","last_became_active":"2023-08-10T11:50:53.904049+0000","last_became_peered":"2023-08-10T11:50:53.904049+0000","last_unstale":"2023-08-10T11:52:20.633349+0000","last_undegraded":"2023-08-10T11:52:20.633349+0000","last_fullsized":"2023-08-10T11:52:20.633349+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:39:46.229197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.509027+0000","last_change":"2023-08-10T11:51:49.652004+0000","last_active":"2023-08-10T11:52:18.509027+0000","last_peered":"2023-08-10T11:52:18.509027+0000","last_clean":"2023-08-10T11:52:18.509027+0000","last_became_active":"2023-08-10T11:51:49.651676+0000","last_became_peered":"2023-08-10T11:51:49.651676+0000","last_unstale":"2023-08-10T11:52:18.509027+0000","last_undegraded":"2023-08-10T11:52:18.509027+0000","last_fullsized":"2023-08-10T11:52:18.509027+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:19:00.457378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.649031+0000","last_change":"2023-08-10T11:50:53.901161+0000","last_active":"2023-08-10T11:51:49.649031+0000","last_peered":"2023-08-10T11:51:49.649031+0000","last_clean":"2023-08-10T11:51:49.649031+0000","last_became_active":"2023-08-10T11:50:53.900806+0000","last_became_peered":"2023-08-10T11:50:53.900806+0000","last_unstale":"2023-08-10T11:51:49.649031+0000","last_undegraded":"2023-08-10T11:51:49.649031+0000","last_fullsized":"2023-08-10T11:51:49.649031+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:17:50.056350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.515867+0000","last_change":"2023-08-10T11:50:54.905753+0000","last_active":"2023-08-10T11:52:18.515867+0000","last_peered":"2023-08-10T11:52:18.515867+0000","last_clean":"2023-08-10T11:52:18.515867+0000","last_became_active":"2023-08-10T11:50:54.905463+0000","last_became_peered":"2023-08-10T11:50:54.905463+0000","last_unstale":"2023-08-10T11:52:18.515867+0000","last_undegraded":"2023-08-10T11:52:18.515867+0000","last_fullsized":"2023-08-10T11:52:18.515867+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:36:59.884914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.645068+0000","last_change":"2023-08-10T11:50:53.895021+0000","last_active":"2023-08-10T11:51:49.645068+0000","last_peered":"2023-08-10T11:51:49.645068+0000","last_clean":"2023-08-10T11:51:49.645068+0000","last_became_active":"2023-08-10T11:50:53.894732+0000","last_became_peered":"2023-08-10T11:50:53.894732+0000","last_unstale":"2023-08-10T11:51:49.645068+0000","last_undegraded":"2023-08-10T11:51:49.645068+0000","last_fullsized":"2023-08-10T11:51:49.645068+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:40:51.375268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.509399+0000","last_change":"2023-08-10T11:51:49.905280+0000","last_active":"2023-08-10T11:52:18.509399+0000","last_peered":"2023-08-10T11:52:18.509399+0000","last_clean":"2023-08-10T11:52:18.509399+0000","last_became_active":"2023-08-10T11:51:49.904907+0000","last_became_peered":"2023-08-10T11:51:49.904907+0000","last_unstale":"2023-08-10T11:52:18.509399+0000","last_undegraded":"2023-08-10T11:52:18.509399+0000","last_fullsized":"2023-08-10T11:52:18.509399+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:19:37.005133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:50.254434+0000","last_change":"2023-08-10T11:50:53.899939+0000","last_active":"2023-08-10T11:51:50.254434+0000","last_peered":"2023-08-10T11:51:50.254434+0000","last_clean":"2023-08-10T11:51:50.254434+0000","last_became_active":"2023-08-10T11:50:53.899648+0000","last_became_peered":"2023-08-10T11:50:53.899648+0000","last_unstale":"2023-08-10T11:51:50.254434+0000","last_undegraded":"2023-08-10T11:51:50.254434+0000","last_fullsized":"2023-08-10T11:51:50.254434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:36:22.989138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.508840+0000","last_change":"2023-08-10T11:50:54.959487+0000","last_active":"2023-08-10T11:52:18.508840+0000","last_peered":"2023-08-10T11:52:18.508840+0000","last_clean":"2023-08-10T11:52:18.508840+0000","last_became_active":"2023-08-10T11:50:54.959153+0000","last_became_peered":"2023-08-10T11:50:54.959153+0000","last_unstale":"2023-08-10T11:52:18.508840+0000","last_undegraded":"2023-08-10T11:52:18.508840+0000","last_fullsized":"2023-08-10T11:52:18.508840+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:19:22.749093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'5","reported_seq":194,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:24.639818+0000","last_change":"2023-08-10T11:50:53.898037+0000","last_active":"2023-08-10T11:52:24.639818+0000","last_peered":"2023-08-10T11:52:24.639818+0000","last_clean":"2023-08-10T11:52:24.639818+0000","last_became_active":"2023-08-10T11:50:53.897715+0000","last_became_peered":"2023-08-10T11:50:53.897715+0000","last_unstale":"2023-08-10T11:52:24.639818+0000","last_undegraded":"2023-08-10T11:52:24.639818+0000","last_fullsized":"2023-08-10T11:52:24.639818+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:20:04.670260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":171,"num_read_kb":171,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.523129+0000","last_change":"2023-08-10T11:50:54.908337+0000","last_active":"2023-08-10T11:52:18.523129+0000","last_peered":"2023-08-10T11:52:18.523129+0000","last_clean":"2023-08-10T11:52:18.523129+0000","last_became_active":"2023-08-10T11:50:54.907990+0000","last_became_peered":"2023-08-10T11:50:54.907990+0000","last_unstale":"2023-08-10T11:52:18.523129+0000","last_undegraded":"2023-08-10T11:52:18.523129+0000","last_fullsized":"2023-08-10T11:52:18.523129+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:31:10.108965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.647765+0000","last_change":"2023-08-10T11:50:53.901498+0000","last_active":"2023-08-10T11:51:49.647765+0000","last_peered":"2023-08-10T11:51:49.647765+0000","last_clean":"2023-08-10T11:51:49.647765+0000","last_became_active":"2023-08-10T11:50:53.901146+0000","last_became_peered":"2023-08-10T11:50:53.901146+0000","last_unstale":"2023-08-10T11:51:49.647765+0000","last_undegraded":"2023-08-10T11:51:49.647765+0000","last_fullsized":"2023-08-10T11:51:49.647765+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:19:18.819828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.517381+0000","last_change":"2023-08-10T11:50:54.901550+0000","last_active":"2023-08-10T11:52:18.517381+0000","last_peered":"2023-08-10T11:52:18.517381+0000","last_clean":"2023-08-10T11:52:18.517381+0000","last_became_active":"2023-08-10T11:50:54.901214+0000","last_became_peered":"2023-08-10T11:50:54.901214+0000","last_unstale":"2023-08-10T11:52:18.517381+0000","last_undegraded":"2023-08-10T11:52:18.517381+0000","last_fullsized":"2023-08-10T11:52:18.517381+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:18:47.307577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:50.254486+0000","last_change":"2023-08-10T11:50:53.901337+0000","last_active":"2023-08-10T11:51:50.254486+0000","last_peered":"2023-08-10T11:51:50.254486+0000","last_clean":"2023-08-10T11:51:50.254486+0000","last_became_active":"2023-08-10T11:50:53.901005+0000","last_became_peered":"2023-08-10T11:50:53.901005+0000","last_unstale":"2023-08-10T11:51:50.254486+0000","last_undegraded":"2023-08-10T11:51:50.254486+0000","last_fullsized":"2023-08-10T11:51:50.254486+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:49:14.022036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.524258+0000","last_change":"2023-08-10T11:50:54.905466+0000","last_active":"2023-08-10T11:52:18.524258+0000","last_peered":"2023-08-10T11:52:18.524258+0000","last_clean":"2023-08-10T11:52:18.524258+0000","last_became_active":"2023-08-10T11:50:54.905175+0000","last_became_peered":"2023-08-10T11:50:54.905175+0000","last_unstale":"2023-08-10T11:52:18.524258+0000","last_undegraded":"2023-08-10T11:52:18.524258+0000","last_fullsized":"2023-08-10T11:52:18.524258+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:47:31.552287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'34","reported_seq":236,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:24.640752+0000","last_change":"2023-08-10T11:50:53.894717+0000","last_active":"2023-08-10T11:52:24.640752+0000","last_peered":"2023-08-10T11:52:24.640752+0000","last_clean":"2023-08-10T11:52:24.640752+0000","last_became_active":"2023-08-10T11:50:53.894390+0000","last_became_peered":"2023-08-10T11:50:53.894390+0000","last_unstale":"2023-08-10T11:52:24.640752+0000","last_undegraded":"2023-08-10T11:52:24.640752+0000","last_fullsized":"2023-08-10T11:52:24.640752+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:27:27.793650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62187,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":184,"num_read_kb":147,"num_write":36,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.512511+0000","last_change":"2023-08-10T11:50:54.908021+0000","last_active":"2023-08-10T11:52:18.512511+0000","last_peered":"2023-08-10T11:52:18.512511+0000","last_clean":"2023-08-10T11:52:18.512511+0000","last_became_active":"2023-08-10T11:50:54.907527+0000","last_became_peered":"2023-08-10T11:50:54.907527+0000","last_unstale":"2023-08-10T11:52:18.512511+0000","last_undegraded":"2023-08-10T11:52:18.512511+0000","last_fullsized":"2023-08-10T11:52:18.512511+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:00:47.270564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.645734+0000","last_change":"2023-08-10T11:50:53.906448+0000","last_active":"2023-08-10T11:51:49.645734+0000","last_peered":"2023-08-10T11:51:49.645734+0000","last_clean":"2023-08-10T11:51:49.645734+0000","last_became_active":"2023-08-10T11:50:53.906157+0000","last_became_peered":"2023-08-10T11:50:53.906157+0000","last_unstale":"2023-08-10T11:51:49.645734+0000","last_undegraded":"2023-08-10T11:51:49.645734+0000","last_fullsized":"2023-08-10T11:51:49.645734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:24:30.851722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.516150+0000","last_change":"2023-08-10T11:50:54.906467+0000","last_active":"2023-08-10T11:52:18.516150+0000","last_peered":"2023-08-10T11:52:18.516150+0000","last_clean":"2023-08-10T11:52:18.516150+0000","last_became_active":"2023-08-10T11:50:54.901119+0000","last_became_peered":"2023-08-10T11:50:54.901119+0000","last_unstale":"2023-08-10T11:52:18.516150+0000","last_undegraded":"2023-08-10T11:52:18.516150+0000","last_fullsized":"2023-08-10T11:52:18.516150+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:36:00.415680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:50.254434+0000","last_change":"2023-08-10T11:50:53.906435+0000","last_active":"2023-08-10T11:51:50.254434+0000","last_peered":"2023-08-10T11:51:50.254434+0000","last_clean":"2023-08-10T11:51:50.254434+0000","last_became_active":"2023-08-10T11:50:53.905545+0000","last_became_peered":"2023-08-10T11:50:53.905545+0000","last_unstale":"2023-08-10T11:51:50.254434+0000","last_undegraded":"2023-08-10T11:51:50.254434+0000","last_fullsized":"2023-08-10T11:51:50.254434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:57:09.505126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.520305+0000","last_change":"2023-08-10T11:51:49.650294+0000","last_active":"2023-08-10T11:52:18.520305+0000","last_peered":"2023-08-10T11:52:18.520305+0000","last_clean":"2023-08-10T11:52:18.520305+0000","last_became_active":"2023-08-10T11:51:49.649843+0000","last_became_peered":"2023-08-10T11:51:49.649843+0000","last_unstale":"2023-08-10T11:52:18.520305+0000","last_undegraded":"2023-08-10T11:52:18.520305+0000","last_fullsized":"2023-08-10T11:52:18.520305+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:42:09.106998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":110,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:24.669378+0000","last_change":"2023-08-10T11:50:53.898252+0000","last_active":"2023-08-10T11:52:24.669378+0000","last_peered":"2023-08-10T11:52:24.669378+0000","last_clean":"2023-08-10T11:52:24.669378+0000","last_became_active":"2023-08-10T11:50:53.897992+0000","last_became_peered":"2023-08-10T11:50:53.897992+0000","last_unstale":"2023-08-10T11:52:24.669378+0000","last_undegraded":"2023-08-10T11:52:24.669378+0000","last_fullsized":"2023-08-10T11:52:24.669378+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:47:25.880201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.511719+0000","last_change":"2023-08-10T11:50:54.913297+0000","last_active":"2023-08-10T11:52:18.511719+0000","last_peered":"2023-08-10T11:52:18.511719+0000","last_clean":"2023-08-10T11:52:18.511719+0000","last_became_active":"2023-08-10T11:50:54.912997+0000","last_became_peered":"2023-08-10T11:50:54.912997+0000","last_unstale":"2023-08-10T11:52:18.511719+0000","last_undegraded":"2023-08-10T11:52:18.511719+0000","last_fullsized":"2023-08-10T11:52:18.511719+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:24:06.668386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.647911+0000","last_change":"2023-08-10T11:50:53.904095+0000","last_active":"2023-08-10T11:51:49.647911+0000","last_peered":"2023-08-10T11:51:49.647911+0000","last_clean":"2023-08-10T11:51:49.647911+0000","last_became_active":"2023-08-10T11:50:53.903712+0000","last_became_peered":"2023-08-10T11:50:53.903712+0000","last_unstale":"2023-08-10T11:51:49.647911+0000","last_undegraded":"2023-08-10T11:51:49.647911+0000","last_fullsized":"2023-08-10T11:51:49.647911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:03:23.690223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.519308+0000","last_change":"2023-08-10T11:50:54.904763+0000","last_active":"2023-08-10T11:52:18.519308+0000","last_peered":"2023-08-10T11:52:18.519308+0000","last_clean":"2023-08-10T11:52:18.519308+0000","last_became_active":"2023-08-10T11:50:54.904467+0000","last_became_peered":"2023-08-10T11:50:54.904467+0000","last_unstale":"2023-08-10T11:52:18.519308+0000","last_undegraded":"2023-08-10T11:52:18.519308+0000","last_fullsized":"2023-08-10T11:52:18.519308+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:50:10.747719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.648580+0000","last_change":"2023-08-10T11:50:53.904605+0000","last_active":"2023-08-10T11:51:49.648580+0000","last_peered":"2023-08-10T11:51:49.648580+0000","last_clean":"2023-08-10T11:51:49.648580+0000","last_became_active":"2023-08-10T11:50:53.904236+0000","last_became_peered":"2023-08-10T11:50:53.904236+0000","last_unstale":"2023-08-10T11:51:49.648580+0000","last_undegraded":"2023-08-10T11:51:49.648580+0000","last_fullsized":"2023-08-10T11:51:49.648580+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:45:39.040420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.510048+0000","last_change":"2023-08-10T11:50:54.903881+0000","last_active":"2023-08-10T11:52:18.510048+0000","last_peered":"2023-08-10T11:52:18.510048+0000","last_clean":"2023-08-10T11:52:18.510048+0000","last_became_active":"2023-08-10T11:50:54.903563+0000","last_became_peered":"2023-08-10T11:50:54.903563+0000","last_unstale":"2023-08-10T11:52:18.510048+0000","last_undegraded":"2023-08-10T11:52:18.510048+0000","last_fullsized":"2023-08-10T11:52:18.510048+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:52:13.889541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.905322+0000","last_change":"2023-08-10T11:51:49.905322+0000","last_active":"2023-08-10T11:51:49.905322+0000","last_peered":"2023-08-10T11:51:49.905322+0000","last_clean":"2023-08-10T11:51:49.905322+0000","last_became_active":"2023-08-10T11:51:49.904918+0000","last_became_peered":"2023-08-10T11:51:49.904918+0000","last_unstale":"2023-08-10T11:51:49.905322+0000","last_undegraded":"2023-08-10T11:51:49.905322+0000","last_fullsized":"2023-08-10T11:51:49.905322+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:28:04.207502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.515886+0000","last_change":"2023-08-10T11:50:54.906531+0000","last_active":"2023-08-10T11:52:18.515886+0000","last_peered":"2023-08-10T11:52:18.515886+0000","last_clean":"2023-08-10T11:52:18.515886+0000","last_became_active":"2023-08-10T11:50:54.906239+0000","last_became_peered":"2023-08-10T11:50:54.906239+0000","last_unstale":"2023-08-10T11:52:18.515886+0000","last_undegraded":"2023-08-10T11:52:18.515886+0000","last_fullsized":"2023-08-10T11:52:18.515886+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:16:28.328008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":108,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:24.281487+0000","last_change":"2023-08-10T11:50:53.899835+0000","last_active":"2023-08-10T11:52:24.281487+0000","last_peered":"2023-08-10T11:52:24.281487+0000","last_clean":"2023-08-10T11:52:24.281487+0000","last_became_active":"2023-08-10T11:50:53.898318+0000","last_became_peered":"2023-08-10T11:50:53.898318+0000","last_unstale":"2023-08-10T11:52:24.281487+0000","last_undegraded":"2023-08-10T11:52:24.281487+0000","last_fullsized":"2023-08-10T11:52:24.281487+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:18:26.753294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":85,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.516846+0000","last_change":"2023-08-10T11:51:49.651543+0000","last_active":"2023-08-10T11:52:18.516846+0000","last_peered":"2023-08-10T11:52:18.516846+0000","last_clean":"2023-08-10T11:52:18.516846+0000","last_became_active":"2023-08-10T11:51:49.651250+0000","last_became_peered":"2023-08-10T11:51:49.651250+0000","last_unstale":"2023-08-10T11:52:18.516846+0000","last_undegraded":"2023-08-10T11:52:18.516846+0000","last_fullsized":"2023-08-10T11:52:18.516846+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:54:51.559253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.513046+0000","last_change":"2023-08-10T11:50:54.910544+0000","last_active":"2023-08-10T11:52:18.513046+0000","last_peered":"2023-08-10T11:52:18.513046+0000","last_clean":"2023-08-10T11:52:18.513046+0000","last_became_active":"2023-08-10T11:50:54.910210+0000","last_became_peered":"2023-08-10T11:50:54.910210+0000","last_unstale":"2023-08-10T11:52:18.513046+0000","last_undegraded":"2023-08-10T11:52:18.513046+0000","last_fullsized":"2023-08-10T11:52:18.513046+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:19:19.096119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":108,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:23.667001+0000","last_change":"2023-08-10T11:50:53.906293+0000","last_active":"2023-08-10T11:52:23.667001+0000","last_peered":"2023-08-10T11:52:23.667001+0000","last_clean":"2023-08-10T11:52:23.667001+0000","last_became_active":"2023-08-10T11:50:53.905998+0000","last_became_peered":"2023-08-10T11:50:53.905998+0000","last_unstale":"2023-08-10T11:52:23.667001+0000","last_undegraded":"2023-08-10T11:52:23.667001+0000","last_fullsized":"2023-08-10T11:52:23.667001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:16:54.570216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.511276+0000","last_change":"2023-08-10T11:50:54.960147+0000","last_active":"2023-08-10T11:52:18.511276+0000","last_peered":"2023-08-10T11:52:18.511276+0000","last_clean":"2023-08-10T11:52:18.511276+0000","last_became_active":"2023-08-10T11:50:54.959842+0000","last_became_peered":"2023-08-10T11:50:54.959842+0000","last_unstale":"2023-08-10T11:52:18.511276+0000","last_undegraded":"2023-08-10T11:52:18.511276+0000","last_fullsized":"2023-08-10T11:52:18.511276+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:11:47.254665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:50.229596+0000","last_change":"2023-08-10T11:50:53.899292+0000","last_active":"2023-08-10T11:51:50.229596+0000","last_peered":"2023-08-10T11:51:50.229596+0000","last_clean":"2023-08-10T11:51:50.229596+0000","last_became_active":"2023-08-10T11:50:53.898917+0000","last_became_peered":"2023-08-10T11:50:53.898917+0000","last_unstale":"2023-08-10T11:51:50.229596+0000","last_undegraded":"2023-08-10T11:51:50.229596+0000","last_fullsized":"2023-08-10T11:51:50.229596+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:26:56.629842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":345,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.647330+0000","last_change":"2023-08-10T11:49:54.492617+0000","last_active":"2023-08-10T11:51:49.647330+0000","last_peered":"2023-08-10T11:51:49.647330+0000","last_clean":"2023-08-10T11:51:49.647330+0000","last_became_active":"2023-08-10T11:49:54.492146+0000","last_became_peered":"2023-08-10T11:49:54.492146+0000","last_unstale":"2023-08-10T11:51:49.647330+0000","last_undegraded":"2023-08-10T11:51:49.647330+0000","last_fullsized":"2023-08-10T11:51:49.647330+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:46:58.862300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:46:58.862300+0000","last_clean_scrub_stamp":"2023-08-10T11:46:58.862300+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:07:45.490118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.511341+0000","last_change":"2023-08-10T11:50:54.907704+0000","last_active":"2023-08-10T11:52:18.511341+0000","last_peered":"2023-08-10T11:52:18.511341+0000","last_clean":"2023-08-10T11:52:18.511341+0000","last_became_active":"2023-08-10T11:50:54.907409+0000","last_became_peered":"2023-08-10T11:50:54.907409+0000","last_unstale":"2023-08-10T11:52:18.511341+0000","last_undegraded":"2023-08-10T11:52:18.511341+0000","last_fullsized":"2023-08-10T11:52:18.511341+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:48:34.334091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.647261+0000","last_change":"2023-08-10T11:50:53.902548+0000","last_active":"2023-08-10T11:51:49.647261+0000","last_peered":"2023-08-10T11:51:49.647261+0000","last_clean":"2023-08-10T11:51:49.647261+0000","last_became_active":"2023-08-10T11:50:53.902021+0000","last_became_peered":"2023-08-10T11:50:53.902021+0000","last_unstale":"2023-08-10T11:51:49.647261+0000","last_undegraded":"2023-08-10T11:51:49.647261+0000","last_fullsized":"2023-08-10T11:51:49.647261+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:38:41.663639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.648441+0000","last_change":"2023-08-10T11:50:53.906326+0000","last_active":"2023-08-10T11:51:49.648441+0000","last_peered":"2023-08-10T11:51:49.648441+0000","last_clean":"2023-08-10T11:51:49.648441+0000","last_became_active":"2023-08-10T11:50:53.906017+0000","last_became_peered":"2023-08-10T11:50:53.906017+0000","last_unstale":"2023-08-10T11:51:49.648441+0000","last_undegraded":"2023-08-10T11:51:49.648441+0000","last_fullsized":"2023-08-10T11:51:49.648441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:58:22.859318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.514258+0000","last_change":"2023-08-10T11:50:54.906513+0000","last_active":"2023-08-10T11:52:18.514258+0000","last_peered":"2023-08-10T11:52:18.514258+0000","last_clean":"2023-08-10T11:52:18.514258+0000","last_became_active":"2023-08-10T11:50:54.901642+0000","last_became_peered":"2023-08-10T11:50:54.901642+0000","last_unstale":"2023-08-10T11:52:18.514258+0000","last_undegraded":"2023-08-10T11:52:18.514258+0000","last_fullsized":"2023-08-10T11:52:18.514258+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:39:01.747637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'11","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:19.690281+0000","last_change":"2023-08-10T11:50:53.908025+0000","last_active":"2023-08-10T11:52:19.690281+0000","last_peered":"2023-08-10T11:52:19.690281+0000","last_clean":"2023-08-10T11:52:19.690281+0000","last_became_active":"2023-08-10T11:50:53.907745+0000","last_became_peered":"2023-08-10T11:50:53.907745+0000","last_unstale":"2023-08-10T11:52:19.690281+0000","last_undegraded":"2023-08-10T11:52:19.690281+0000","last_fullsized":"2023-08-10T11:52:19.690281+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:06:52.964591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.514530+0000","last_change":"2023-08-10T11:50:54.958653+0000","last_active":"2023-08-10T11:52:18.514530+0000","last_peered":"2023-08-10T11:52:18.514530+0000","last_clean":"2023-08-10T11:52:18.514530+0000","last_became_active":"2023-08-10T11:50:54.958281+0000","last_became_peered":"2023-08-10T11:50:54.958281+0000","last_unstale":"2023-08-10T11:52:18.514530+0000","last_undegraded":"2023-08-10T11:52:18.514530+0000","last_fullsized":"2023-08-10T11:52:18.514530+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:21:48.120998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:50.229654+0000","last_change":"2023-08-10T11:50:53.895770+0000","last_active":"2023-08-10T11:51:50.229654+0000","last_peered":"2023-08-10T11:51:50.229654+0000","last_clean":"2023-08-10T11:51:50.229654+0000","last_became_active":"2023-08-10T11:50:53.895433+0000","last_became_peered":"2023-08-10T11:50:53.895433+0000","last_unstale":"2023-08-10T11:51:50.229654+0000","last_undegraded":"2023-08-10T11:51:50.229654+0000","last_fullsized":"2023-08-10T11:51:50.229654+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:11:48.769660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.517250+0000","last_change":"2023-08-10T11:50:54.957297+0000","last_active":"2023-08-10T11:52:18.517250+0000","last_peered":"2023-08-10T11:52:18.517250+0000","last_clean":"2023-08-10T11:52:18.517250+0000","last_became_active":"2023-08-10T11:50:54.956966+0000","last_became_peered":"2023-08-10T11:50:54.956966+0000","last_unstale":"2023-08-10T11:52:18.517250+0000","last_undegraded":"2023-08-10T11:52:18.517250+0000","last_fullsized":"2023-08-10T11:52:18.517250+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:38:11.077269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.908404+0000","last_change":"2023-08-10T11:51:49.908404+0000","last_active":"2023-08-10T11:51:49.908404+0000","last_peered":"2023-08-10T11:51:49.908404+0000","last_clean":"2023-08-10T11:51:49.908404+0000","last_became_active":"2023-08-10T11:51:49.904994+0000","last_became_peered":"2023-08-10T11:51:49.904994+0000","last_unstale":"2023-08-10T11:51:49.908404+0000","last_undegraded":"2023-08-10T11:51:49.908404+0000","last_fullsized":"2023-08-10T11:51:49.908404+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:07:30.549050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.479893+0000","last_change":"2023-08-10T11:50:54.908185+0000","last_active":"2023-08-10T11:52:18.479893+0000","last_peered":"2023-08-10T11:52:18.479893+0000","last_clean":"2023-08-10T11:52:18.479893+0000","last_became_active":"2023-08-10T11:50:54.907649+0000","last_became_peered":"2023-08-10T11:50:54.907649+0000","last_unstale":"2023-08-10T11:52:18.479893+0000","last_undegraded":"2023-08-10T11:52:18.479893+0000","last_fullsized":"2023-08-10T11:52:18.479893+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:40:30.222828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:50.151298+0000","last_change":"2023-08-10T11:50:53.908748+0000","last_active":"2023-08-10T11:51:50.151298+0000","last_peered":"2023-08-10T11:51:50.151298+0000","last_clean":"2023-08-10T11:51:50.151298+0000","last_became_active":"2023-08-10T11:50:53.908494+0000","last_became_peered":"2023-08-10T11:50:53.908494+0000","last_unstale":"2023-08-10T11:51:50.151298+0000","last_undegraded":"2023-08-10T11:51:50.151298+0000","last_fullsized":"2023-08-10T11:51:50.151298+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:27:58.338302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.514270+0000","last_change":"2023-08-10T11:50:54.903493+0000","last_active":"2023-08-10T11:52:18.514270+0000","last_peered":"2023-08-10T11:52:18.514270+0000","last_clean":"2023-08-10T11:52:18.514270+0000","last_became_active":"2023-08-10T11:50:54.903118+0000","last_became_peered":"2023-08-10T11:50:54.903118+0000","last_unstale":"2023-08-10T11:52:18.514270+0000","last_undegraded":"2023-08-10T11:52:18.514270+0000","last_fullsized":"2023-08-10T11:52:18.514270+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:44:59.035303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.645508+0000","last_change":"2023-08-10T11:50:53.905075+0000","last_active":"2023-08-10T11:51:49.645508+0000","last_peered":"2023-08-10T11:51:49.645508+0000","last_clean":"2023-08-10T11:51:49.645508+0000","last_became_active":"2023-08-10T11:50:53.904769+0000","last_became_peered":"2023-08-10T11:50:53.904769+0000","last_unstale":"2023-08-10T11:51:49.645508+0000","last_undegraded":"2023-08-10T11:51:49.645508+0000","last_fullsized":"2023-08-10T11:51:49.645508+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:05:15.250724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.513888+0000","last_change":"2023-08-10T11:50:54.963860+0000","last_active":"2023-08-10T11:52:18.513888+0000","last_peered":"2023-08-10T11:52:18.513888+0000","last_clean":"2023-08-10T11:52:18.513888+0000","last_became_active":"2023-08-10T11:50:54.963335+0000","last_became_peered":"2023-08-10T11:50:54.963335+0000","last_unstale":"2023-08-10T11:52:18.513888+0000","last_undegraded":"2023-08-10T11:52:18.513888+0000","last_fullsized":"2023-08-10T11:52:18.513888+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:49:54.348522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.648142+0000","last_change":"2023-08-10T11:50:53.899673+0000","last_active":"2023-08-10T11:51:49.648142+0000","last_peered":"2023-08-10T11:51:49.648142+0000","last_clean":"2023-08-10T11:51:49.648142+0000","last_became_active":"2023-08-10T11:50:53.898830+0000","last_became_peered":"2023-08-10T11:50:53.898830+0000","last_unstale":"2023-08-10T11:51:49.648142+0000","last_undegraded":"2023-08-10T11:51:49.648142+0000","last_fullsized":"2023-08-10T11:51:49.648142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:03:06.415674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.522208+0000","last_change":"2023-08-10T11:50:54.900606+0000","last_active":"2023-08-10T11:52:18.522208+0000","last_peered":"2023-08-10T11:52:18.522208+0000","last_clean":"2023-08-10T11:52:18.522208+0000","last_became_active":"2023-08-10T11:50:54.900293+0000","last_became_peered":"2023-08-10T11:50:54.900293+0000","last_unstale":"2023-08-10T11:52:18.522208+0000","last_undegraded":"2023-08-10T11:52:18.522208+0000","last_fullsized":"2023-08-10T11:52:18.522208+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:30:39.482183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'7","reported_seq":110,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:21.649523+0000","last_change":"2023-08-10T11:50:53.894526+0000","last_active":"2023-08-10T11:52:21.649523+0000","last_peered":"2023-08-10T11:52:21.649523+0000","last_clean":"2023-08-10T11:52:21.649523+0000","last_became_active":"2023-08-10T11:50:53.894211+0000","last_became_peered":"2023-08-10T11:50:53.894211+0000","last_unstale":"2023-08-10T11:52:21.649523+0000","last_undegraded":"2023-08-10T11:52:21.649523+0000","last_fullsized":"2023-08-10T11:52:21.649523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:25:42.483916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1653,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.522978+0000","last_change":"2023-08-10T11:50:54.900511+0000","last_active":"2023-08-10T11:52:18.522978+0000","last_peered":"2023-08-10T11:52:18.522978+0000","last_clean":"2023-08-10T11:52:18.522978+0000","last_became_active":"2023-08-10T11:50:54.900200+0000","last_became_peered":"2023-08-10T11:50:54.900200+0000","last_unstale":"2023-08-10T11:52:18.522978+0000","last_undegraded":"2023-08-10T11:52:18.522978+0000","last_fullsized":"2023-08-10T11:52:18.522978+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:50:34.494222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:50.254733+0000","last_change":"2023-08-10T11:50:53.906235+0000","last_active":"2023-08-10T11:51:50.254733+0000","last_peered":"2023-08-10T11:51:50.254733+0000","last_clean":"2023-08-10T11:51:50.254733+0000","last_became_active":"2023-08-10T11:50:53.905630+0000","last_became_peered":"2023-08-10T11:50:53.905630+0000","last_unstale":"2023-08-10T11:51:50.254733+0000","last_undegraded":"2023-08-10T11:51:50.254733+0000","last_fullsized":"2023-08-10T11:51:50.254733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:28:57.652862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.511265+0000","last_change":"2023-08-10T11:50:54.907280+0000","last_active":"2023-08-10T11:52:18.511265+0000","last_peered":"2023-08-10T11:52:18.511265+0000","last_clean":"2023-08-10T11:52:18.511265+0000","last_became_active":"2023-08-10T11:50:54.906987+0000","last_became_peered":"2023-08-10T11:50:54.906987+0000","last_unstale":"2023-08-10T11:52:18.511265+0000","last_undegraded":"2023-08-10T11:52:18.511265+0000","last_fullsized":"2023-08-10T11:52:18.511265+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:17.214303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:51:49.645134+0000","last_change":"2023-08-10T11:50:53.906537+0000","last_active":"2023-08-10T11:51:49.645134+0000","last_peered":"2023-08-10T11:51:49.645134+0000","last_clean":"2023-08-10T11:51:49.645134+0000","last_became_active":"2023-08-10T11:50:53.905975+0000","last_became_peered":"2023-08-10T11:50:53.905975+0000","last_unstale":"2023-08-10T11:51:49.645134+0000","last_undegraded":"2023-08-10T11:51:49.645134+0000","last_fullsized":"2023-08-10T11:51:49.645134+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:52.874029+0000","last_clean_scrub_stamp":"2023-08-10T11:50:52.874029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:07:24.856158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.512484+0000","last_change":"2023-08-10T11:50:54.905656+0000","last_active":"2023-08-10T11:52:18.512484+0000","last_peered":"2023-08-10T11:52:18.512484+0000","last_clean":"2023-08-10T11:52:18.512484+0000","last_became_active":"2023-08-10T11:50:54.905314+0000","last_became_peered":"2023-08-10T11:50:54.905314+0000","last_unstale":"2023-08-10T11:52:18.512484+0000","last_undegraded":"2023-08-10T11:52:18.512484+0000","last_fullsized":"2023-08-10T11:52:18.512484+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:07:15.802238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.508971+0000","last_change":"2023-08-10T11:50:54.911564+0000","last_active":"2023-08-10T11:52:18.508971+0000","last_peered":"2023-08-10T11:52:18.508971+0000","last_clean":"2023-08-10T11:52:18.508971+0000","last_became_active":"2023-08-10T11:50:54.910375+0000","last_became_peered":"2023-08-10T11:50:54.910375+0000","last_unstale":"2023-08-10T11:52:18.508971+0000","last_undegraded":"2023-08-10T11:52:18.508971+0000","last_fullsized":"2023-08-10T11:52:18.508971+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:26:31.205736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.515660+0000","last_change":"2023-08-10T11:50:54.913247+0000","last_active":"2023-08-10T11:52:18.515660+0000","last_peered":"2023-08-10T11:52:18.515660+0000","last_clean":"2023-08-10T11:52:18.515660+0000","last_became_active":"2023-08-10T11:50:54.912941+0000","last_became_peered":"2023-08-10T11:50:54.912941+0000","last_unstale":"2023-08-10T11:52:18.515660+0000","last_undegraded":"2023-08-10T11:52:18.515660+0000","last_fullsized":"2023-08-10T11:52:18.515660+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:20:21.810895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.494303+0000","last_change":"2023-08-10T11:50:54.959735+0000","last_active":"2023-08-10T11:52:18.494303+0000","last_peered":"2023-08-10T11:52:18.494303+0000","last_clean":"2023-08-10T11:52:18.494303+0000","last_became_active":"2023-08-10T11:50:54.959476+0000","last_became_peered":"2023-08-10T11:50:54.959476+0000","last_unstale":"2023-08-10T11:52:18.494303+0000","last_undegraded":"2023-08-10T11:52:18.494303+0000","last_fullsized":"2023-08-10T11:52:18.494303+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:45:42.510412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.516946+0000","last_change":"2023-08-10T11:50:54.942753+0000","last_active":"2023-08-10T11:52:18.516946+0000","last_peered":"2023-08-10T11:52:18.516946+0000","last_clean":"2023-08-10T11:52:18.516946+0000","last_became_active":"2023-08-10T11:50:54.941715+0000","last_became_peered":"2023-08-10T11:50:54.941715+0000","last_unstale":"2023-08-10T11:52:18.516946+0000","last_undegraded":"2023-08-10T11:52:18.516946+0000","last_fullsized":"2023-08-10T11:52:18.516946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:56:27.450708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.514041+0000","last_change":"2023-08-10T11:50:54.898919+0000","last_active":"2023-08-10T11:52:18.514041+0000","last_peered":"2023-08-10T11:52:18.514041+0000","last_clean":"2023-08-10T11:52:18.514041+0000","last_became_active":"2023-08-10T11:50:54.898599+0000","last_became_peered":"2023-08-10T11:50:54.898599+0000","last_unstale":"2023-08-10T11:52:18.514041+0000","last_undegraded":"2023-08-10T11:52:18.514041+0000","last_fullsized":"2023-08-10T11:52:18.514041+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:37:35.242025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.509666+0000","last_change":"2023-08-10T11:50:54.911359+0000","last_active":"2023-08-10T11:52:18.509666+0000","last_peered":"2023-08-10T11:52:18.509666+0000","last_clean":"2023-08-10T11:52:18.509666+0000","last_became_active":"2023-08-10T11:50:54.911049+0000","last_became_peered":"2023-08-10T11:50:54.911049+0000","last_unstale":"2023-08-10T11:52:18.509666+0000","last_undegraded":"2023-08-10T11:52:18.509666+0000","last_fullsized":"2023-08-10T11:52:18.509666+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:15:12.906005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.513742+0000","last_change":"2023-08-10T11:50:54.906811+0000","last_active":"2023-08-10T11:52:18.513742+0000","last_peered":"2023-08-10T11:52:18.513742+0000","last_clean":"2023-08-10T11:52:18.513742+0000","last_became_active":"2023-08-10T11:50:54.906456+0000","last_became_peered":"2023-08-10T11:50:54.906456+0000","last_unstale":"2023-08-10T11:52:18.513742+0000","last_undegraded":"2023-08-10T11:52:18.513742+0000","last_fullsized":"2023-08-10T11:52:18.513742+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:08:08.681010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.512297+0000","last_change":"2023-08-10T11:50:54.957297+0000","last_active":"2023-08-10T11:52:18.512297+0000","last_peered":"2023-08-10T11:52:18.512297+0000","last_clean":"2023-08-10T11:52:18.512297+0000","last_became_active":"2023-08-10T11:50:54.956977+0000","last_became_peered":"2023-08-10T11:50:54.956977+0000","last_unstale":"2023-08-10T11:52:18.512297+0000","last_undegraded":"2023-08-10T11:52:18.512297+0000","last_fullsized":"2023-08-10T11:52:18.512297+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:42:14.272800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.512035+0000","last_change":"2023-08-10T11:50:54.964300+0000","last_active":"2023-08-10T11:52:18.512035+0000","last_peered":"2023-08-10T11:52:18.512035+0000","last_clean":"2023-08-10T11:52:18.512035+0000","last_became_active":"2023-08-10T11:50:54.963876+0000","last_became_peered":"2023-08-10T11:50:54.963876+0000","last_unstale":"2023-08-10T11:52:18.512035+0000","last_undegraded":"2023-08-10T11:52:18.512035+0000","last_fullsized":"2023-08-10T11:52:18.512035+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:21:05.020811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.514754+0000","last_change":"2023-08-10T11:50:54.958661+0000","last_active":"2023-08-10T11:52:18.514754+0000","last_peered":"2023-08-10T11:52:18.514754+0000","last_clean":"2023-08-10T11:52:18.514754+0000","last_became_active":"2023-08-10T11:50:54.958342+0000","last_became_peered":"2023-08-10T11:50:54.958342+0000","last_unstale":"2023-08-10T11:52:18.514754+0000","last_undegraded":"2023-08-10T11:52:18.514754+0000","last_fullsized":"2023-08-10T11:52:18.514754+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:38:54.463137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.524077+0000","last_change":"2023-08-10T11:50:54.902033+0000","last_active":"2023-08-10T11:52:18.524077+0000","last_peered":"2023-08-10T11:52:18.524077+0000","last_clean":"2023-08-10T11:52:18.524077+0000","last_became_active":"2023-08-10T11:50:54.901713+0000","last_became_peered":"2023-08-10T11:50:54.901713+0000","last_unstale":"2023-08-10T11:52:18.524077+0000","last_undegraded":"2023-08-10T11:52:18.524077+0000","last_fullsized":"2023-08-10T11:52:18.524077+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:42:12.029831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.519845+0000","last_change":"2023-08-10T11:50:54.899377+0000","last_active":"2023-08-10T11:52:18.519845+0000","last_peered":"2023-08-10T11:52:18.519845+0000","last_clean":"2023-08-10T11:52:18.519845+0000","last_became_active":"2023-08-10T11:50:54.898657+0000","last_became_peered":"2023-08-10T11:50:54.898657+0000","last_unstale":"2023-08-10T11:52:18.519845+0000","last_undegraded":"2023-08-10T11:52:18.519845+0000","last_fullsized":"2023-08-10T11:52:18.519845+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:49:40.082347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-08-10T11:52:18.509905+0000","last_change":"2023-08-10T11:50:54.900304+0000","last_active":"2023-08-10T11:52:18.509905+0000","last_peered":"2023-08-10T11:52:18.509905+0000","last_clean":"2023-08-10T11:52:18.509905+0000","last_became_active":"2023-08-10T11:50:54.899978+0000","last_became_peered":"2023-08-10T11:50:54.899978+0000","last_unstale":"2023-08-10T11:52:18.509905+0000","last_undegraded":"2023-08-10T11:52:18.509905+0000","last_fullsized":"2023-08-10T11:52:18.509905+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T11:50:53.880480+0000","last_clean_scrub_stamp":"2023-08-10T11:50:53.880480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T23:03:38.365482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68948,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":881,"num_read_kb":509,"num_write":240,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":195450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449118,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":447844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.41899999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.495,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.42199999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.57899999999999996,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67000000000000004,"15min":0.67100000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77900000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65200000000000002,"15min":0.65300000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90600000000000003,"5min":1.163,"15min":1.163},"last":0.746}]},{"osd":2,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.38700000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70499999999999996,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.501,"15min":0.502},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.50800000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.82499999999999996,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66100000000000003,"15min":0.66000000000000003},"min":{"1min":0.48899999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.85199999999999998,"5min":1.046,"15min":1.046},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.38600000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.63100000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.621},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.621,"15min":0.61799999999999999},"min":{"1min":0.52200000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81699999999999995,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64400000000000002,"15min":0.65100000000000002},"min":{"1min":0.41999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84099999999999997,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.65400000000000003,"15min":0.65200000000000002},"min":{"1min":0.47299999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.83199999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.78400000000000003,"15min":0.78000000000000003},"min":{"1min":0.60199999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.96199999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.75600000000000001,"15min":0.75700000000000001},"min":{"1min":0.63300000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90500000000000003,"5min":1.224,"15min":1.224},"last":0.85799999999999998}]},{"osd":8,"last update":"Thu Aug 10 11:51:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.874}]},{"osd":9,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.746,"15min":0.74199999999999999},"min":{"1min":0.58099999999999996,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.86399999999999999,"5min":1.024,"15min":1.024},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.79400000000000004,"15min":0.78600000000000003},"min":{"1min":0.65400000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.97499999999999998,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.90200000000000002}]},{"osd":10,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.68300000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.94399999999999995,"5min":1.341,"15min":1.341},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.78900000000000003,"15min":0.78700000000000003},"min":{"1min":0.65500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.91900000000000004,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.80100000000000005}]}]},{"osd":10,"up_from":70,"seq":300647710754,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1630208,"data_stored":1100204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":6.7350000000000003,"5min":6.7350000000000003,"15min":6.7350000000000003},"last":0.432},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":6.7800000000000002,"5min":6.7800000000000002,"15min":6.7800000000000002},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47099999999999997,"15min":0.47499999999999998},"min":{"1min":0.309,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.61099999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.504,"15min":0.51000000000000001},"min":{"1min":0.35999999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.64200000000000002,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.628,"15min":0.626},"min":{"1min":0.442,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.47499999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.64600000000000002}]},{"osd":3,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.627,"15min":0.63900000000000001},"min":{"1min":0.443,"5min":0.432,"15min":0.432},"max":{"1min":0.70499999999999996,"5min":0.878,"15min":0.878},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.65100000000000002,"15min":0.65900000000000003},"min":{"1min":0.41999999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73799999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.62,"15min":0.624},"min":{"1min":0.41099999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80500000000000005,"5min":0.879,"15min":0.879},"last":0.622},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.58799999999999997,"15min":0.59499999999999997},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78200000000000003,"5min":1.177,"15min":1.177},"last":0.72599999999999998}]},{"osd":5,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71699999999999997,"15min":0.71899999999999997},"min":{"1min":0.52400000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84299999999999997,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.88,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.79800000000000004}]},{"osd":6,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73999999999999999,"15min":0.746},"min":{"1min":0.39600000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.464,"5min":2.464,"15min":2.464},"last":0.745},{"interface":"front","average":{"1min":1.0589999999999999,"5min":0.85099999999999998,"15min":0.81699999999999995},"min":{"1min":0.59999999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":7.7110000000000003,"5min":7.7110000000000003,"15min":7.7110000000000003},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":8,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79600000000000004,"15min":0.80000000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.93799999999999994,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.58999999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.94999999999999996,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.81200000000000006}]},{"osd":9,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":0.89600000000000002,"15min":0.86399999999999999},"min":{"1min":0.55400000000000005,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":7.6369999999999996,"5min":7.6369999999999996,"15min":7.6369999999999996},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.81000000000000005,"15min":0.82799999999999996},"min":{"1min":0.52300000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97999999999999998,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.85199999999999998}]},{"osd":11,"last update":"Thu Aug 10 11:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.76700000000000002,"15min":0.76100000000000001},"min":{"1min":0.59699999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.92100000000000004,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.873},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.79000000000000004,"15min":0.78400000000000003},"min":{"1min":0.66900000000000004,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.99399999999999999,"5min":0.998,"15min":0.998},"last":0.88500000000000001}]}]},{"osd":9,"up_from":65,"seq":279172874279,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":447291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.39400000000000002,"15min":0.39800000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.41199999999999998,"15min":0.42199999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.499,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.316}]},{"osd":1,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.58299999999999996,"15min":0.59199999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.66000000000000003,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.59899999999999998,"15min":0.60999999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70599999999999996,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.501}]},{"osd":2,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.61599999999999999,"15min":0.628},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.68300000000000005,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.61599999999999999,"15min":0.628},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73799999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.44500000000000001,"15min":0.45400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.55700000000000005,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50600000000000001,"15min":0.50900000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.63500000000000001,"15min":0.65200000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.66300000000000003,"5min":0.87,"15min":0.87},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.64000000000000001,"15min":0.65400000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80900000000000005,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.46800000000000003}]},{"osd":5,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.622,"15min":0.622},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.68899999999999995,"15min":0.70199999999999996},"min":{"1min":0.42599999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78600000000000003,"5min":1.032,"15min":1.032},"last":0.51900000000000002}]},{"osd":6,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.61899999999999999,"15min":0.629},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.01,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63700000000000001,"15min":0.64300000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.41899999999999998}]},{"osd":7,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65800000000000003,"15min":0.66600000000000004},"min":{"1min":0.44600000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81299999999999994,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.71799999999999997,"15min":0.73499999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.84899999999999998,"5min":1.133,"15min":1.133},"last":0.57599999999999996}]},{"osd":8,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.72399999999999998,"15min":0.73999999999999999},"min":{"1min":0.45800000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80900000000000005,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.95199999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.55000000000000004}]},{"osd":10,"last update":"Thu Aug 10 11:51:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69899999999999995,"15min":0.70699999999999996},"min":{"1min":0.47599999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84099999999999997,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.69799999999999995,"15min":0.70499999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82699999999999996,"5min":1.101,"15min":1.101},"last":0.53000000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":8,"up_from":57,"seq":244813135915,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":446997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.54800000000000004},"min":{"1min":0.42899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81699999999999995,"5min":1.069,"15min":1.069},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.36099999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.79600000000000004,"5min":0.88,"15min":0.88},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Aug 10 11:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.626,"15min":0.61199999999999999},"min":{"1min":0.433,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.64700000000000002,"15min":0.63100000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Aug 10 11:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.44700000000000001,"15min":0.435},"min":{"1min":0.32900000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.48799999999999999,"15min":0.46999999999999997},"min":{"1min":0.28199999999999997,"5min":0.248,"15min":0.248},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Aug 10 11:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.41199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.61899999999999999,"15min":0.56999999999999995},"min":{"1min":0.39400000000000002,"5min":0.374,"15min":0.374},"max":{"1min":5.141,"5min":5.141,"15min":5.141},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Aug 10 11:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.621,"15min":0.59999999999999998},"min":{"1min":0.45700000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65100000000000002,"15min":0.63},"min":{"1min":0.48099999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.877,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Aug 10 11:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58999999999999997,"15min":0.58399999999999996},"min":{"1min":0.376,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56999999999999995,"15min":0.55600000000000005},"min":{"1min":0.39000000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.85299999999999998,"5min":1,"15min":1},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Aug 10 11:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.42099999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.96299999999999997,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73799999999999999,"15min":0.73899999999999999},"min":{"1min":0.53100000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Aug 10 11:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.78100000000000003,"15min":0.76900000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.754},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.72799999999999998,"15min":0.71499999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.85099999999999998}]},{"osd":9,"last update":"Thu Aug 10 11:51:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72499999999999998,"15min":0.71999999999999997},"min":{"1min":0.58299999999999996,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78200000000000003,"15min":0.77600000000000002},"min":{"1min":0.54500000000000004,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.66000000000000003}]},{"osd":10,"last update":"Thu Aug 10 11:51:54 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.77500000000000002,"15min":0.76500000000000001},"min":{"1min":0.67900000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.80400000000000005,"15min":0.79800000000000004},"min":{"1min":0.72999999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.73499999999999999}]},{"osd":11,"last update":"Thu Aug 10 11:51:54 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.81499999999999995}]}]},{"osd":7,"up_from":50,"seq":214748364847,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1544192,"data_stored":1039385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.54500000000000004,"15min":0.53100000000000003},"min":{"1min":0.42099999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.51500000000000001,"15min":0.503},"min":{"1min":0.434,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.40899999999999997}]},{"osd":1,"last update":"Thu Aug 10 11:51:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.432,"15min":0.41199999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63800000000000001,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.501,"5min":0.45500000000000002,"15min":0.432},"min":{"1min":0.36699999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81000000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Aug 10 11:51:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61499999999999999,"15min":0.60799999999999998},"min":{"1min":0.40600000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82799999999999996,"5min":0.878,"15min":0.878},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.60899999999999999,"15min":0.59499999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.876}]},{"osd":3,"last update":"Thu Aug 10 11:51:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.56799999999999995,"15min":0.53800000000000003},"min":{"1min":0.496,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.745},{"interface":"front","average":{"1min":1.012,"5min":0.68400000000000005,"15min":0.61399999999999999},"min":{"1min":0.54300000000000004,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":8.1829999999999998,"5min":8.1829999999999998,"15min":8.1829999999999998},"last":0.80900000000000005}]},{"osd":4,"last update":"Thu Aug 10 11:51:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76100000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35799999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73199999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Aug 10 11:51:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.65700000000000003,"15min":0.64700000000000002},"min":{"1min":0.48499999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.88,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.66100000000000003,"15min":0.63900000000000001},"min":{"1min":0.46200000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.94099999999999995}]},{"osd":6,"last update":"Thu Aug 10 11:51:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.71799999999999997,"15min":0.68899999999999995},"min":{"1min":0.55300000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68799999999999994,"15min":0.67200000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.84499999999999997}]},{"osd":8,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76100000000000001,"15min":0.754},"min":{"1min":0.63100000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.96799999999999997,"5min":1.002,"15min":1.002},"last":1.006},{"interface":"front","average":{"1min":0.754,"5min":0.748,"15min":0.752},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.91500000000000004,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.89400000000000002}]},{"osd":9,"last update":"Thu Aug 10 11:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76100000000000001,"15min":0.75900000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.82299999999999995,"15min":0.82499999999999996},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.0449999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.91200000000000003}]},{"osd":10,"last update":"Thu Aug 10 11:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.81799999999999995,"15min":0.81999999999999995},"min":{"1min":0.60099999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":0.96799999999999997,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76100000000000001,"15min":0.75900000000000001},"min":{"1min":0.56599999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94999999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.99099999999999999}]},{"osd":11,"last update":"Thu Aug 10 11:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":1.024}]}]},{"osd":6,"up_from":45,"seq":193273528372,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":446966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.46700000000000003,"15min":0.38900000000000001},"min":{"1min":0.27500000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":8.9930000000000003,"5min":8.9930000000000003,"15min":8.9930000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":1.03,"5min":0.52900000000000003,"15min":0.434},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":12.326000000000001,"5min":12.326000000000001,"15min":12.326000000000001},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":0.66600000000000004,"15min":0.56399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":11.275,"5min":11.275,"15min":11.275},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.56899999999999995,"15min":0.53800000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.6909999999999998,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":0.69499999999999995,"15min":0.60599999999999998},"min":{"1min":0.40000000000000002,"5min":0.38,"15min":0.38},"max":{"1min":12.244,"5min":12.244,"15min":12.244},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.1619999999999999,"5min":0.68400000000000005,"15min":0.60799999999999998},"min":{"1min":0.443,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":11.195,"5min":11.195,"15min":11.195},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.54300000000000004,"15min":0.44700000000000001},"min":{"1min":0.29799999999999999,"5min":0.254,"15min":0.254},"max":{"1min":11.439,"5min":11.439,"15min":11.439},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.48599999999999999,"15min":0.46800000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.443}]},{"osd":4,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":0.70099999999999996,"15min":0.60499999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":12.272,"5min":12.272,"15min":12.272},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.216,"5min":0.72099999999999997,"15min":0.623},"min":{"1min":0.45300000000000001,"5min":0.433,"15min":0.433},"max":{"1min":11.35,"5min":11.35,"15min":11.35},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.63600000000000001,"15min":0.61599999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":0.505},{"interface":"front","average":{"1min":1.2250000000000001,"5min":0.746,"15min":0.66200000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":12.177,"5min":12.177,"15min":12.177},"last":0.48999999999999999}]},{"osd":7,"last update":"Thu Aug 10 11:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66000000000000003,"15min":0.64700000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.7189999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.1899999999999999,"5min":0.76700000000000002,"15min":0.68700000000000006},"min":{"1min":0.49399999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":11.317,"5min":11.317,"15min":11.317},"last":0.60499999999999998}]},{"osd":8,"last update":"Thu Aug 10 11:52:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":0.78800000000000003,"15min":0.72199999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":11.242000000000001,"5min":11.242000000000001,"15min":11.242000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.3169999999999999,"5min":0.81699999999999995,"15min":0.748},"min":{"1min":0.495,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":12.215,"5min":12.215,"15min":12.215},"last":0.55100000000000005}]},{"osd":9,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":0.77900000000000003,"15min":0.71599999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":12.300000000000001,"5min":12.300000000000001,"15min":12.300000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":1.1539999999999999,"5min":0.78500000000000003,"15min":0.72299999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":11.411,"5min":11.411,"15min":11.411},"last":0.63}]},{"osd":10,"last update":"Thu Aug 10 11:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.72499999999999998,"15min":0.71699999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.7480000000000002,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":0.59299999999999997},{"interface":"front","average":{"1min":1.2909999999999999,"5min":0.875,"15min":0.80500000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":11.379,"5min":11.379,"15min":11.379},"last":0.70499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":504363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.41699999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.54400000000000004,"15min":0.52000000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Aug 10 11:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.64500000000000002,"15min":0.59599999999999997},"min":{"1min":0.39900000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96899999999999997,"5min":1.05,"15min":1.05},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.61699999999999999,"15min":0.57399999999999995},"min":{"1min":0.47599999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86299999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.73899999999999999}]},{"osd":3,"last update":"Thu Aug 10 11:51:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.55200000000000005},"min":{"1min":0.37,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79500000000000004,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.41099999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.35999999999999999}]},{"osd":4,"last update":"Thu Aug 10 11:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.45000000000000001,"15min":0.442},"min":{"1min":0.309,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67200000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.504,"15min":0.48199999999999998},"min":{"1min":0.372,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.83699999999999997,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.41699999999999998}]},{"osd":5,"last update":"Thu Aug 10 11:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.60799999999999998,"15min":0.55200000000000005},"min":{"1min":0.57699999999999996,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.85499999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.628,"15min":0.57199999999999995},"min":{"1min":0.42799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.93500000000000005,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Aug 10 11:51:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65400000000000003,"15min":0.64900000000000002},"min":{"1min":0.42699999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90900000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.754},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58499999999999996,"15min":0.58799999999999997},"min":{"1min":0.38,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78200000000000003,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.46300000000000002}]},{"osd":7,"last update":"Thu Aug 10 11:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.58599999999999997,"15min":0.56799999999999995},"min":{"1min":0.44,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.89300000000000002,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.63100000000000001,"15min":0.61099999999999999},"min":{"1min":0.45200000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.97099999999999997,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.625}]},{"osd":8,"last update":"Thu Aug 10 11:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63400000000000001,"15min":0.61799999999999999},"min":{"1min":0.443,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.72299999999999998,"15min":0.70199999999999996},"min":{"1min":0.61799999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95399999999999996,"5min":1.085,"15min":1.085},"last":0.68000000000000005}]},{"osd":9,"last update":"Thu Aug 10 11:51:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.73999999999999999,"15min":0.73099999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97299999999999998,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.67000000000000004},"min":{"1min":0.51500000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85499999999999998,"5min":1.026,"15min":1.026},"last":0.56100000000000005}]},{"osd":10,"last update":"Thu Aug 10 11:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.65800000000000003,"15min":0.64900000000000002},"min":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91500000000000004,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.753,"15min":0.74399999999999999},"min":{"1min":0.67900000000000005,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92600000000000005,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.57399999999999995}]},{"osd":11,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.71399999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738445,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":448830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 11:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56599999999999995,"15min":0.51200000000000001},"min":{"1min":0.33800000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.755,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56399999999999995,"15min":0.52800000000000002},"min":{"1min":0.48299999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73399999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Aug 10 11:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.40999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69299999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57699999999999996,"15min":0.54400000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77900000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Aug 10 11:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56100000000000005,"15min":0.53300000000000003},"min":{"1min":0.374,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70399999999999996,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53500000000000003,"15min":0.52100000000000002},"min":{"1min":0.38700000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.61799999999999999,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Aug 10 11:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56100000000000005,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78800000000000003,"5min":0.874,"15min":0.874},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.40799999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.64500000000000002,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Aug 10 11:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.77700000000000002,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.66100000000000003,"5min":0.872,"15min":0.872},"last":0.497}]},{"osd":7,"last update":"Thu Aug 10 11:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.498,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.505}]},{"osd":8,"last update":"Thu Aug 10 11:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.67700000000000005,"15min":0.70799999999999996},"min":{"1min":0.46800000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.83599999999999997,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66000000000000003,"15min":0.68700000000000006},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82299999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.51900000000000002}]},{"osd":9,"last update":"Thu Aug 10 11:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.59999999999999998,"15min":0.61399999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67900000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.69499999999999995,"15min":0.72099999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79100000000000004,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.64000000000000001}]},{"osd":10,"last update":"Thu Aug 10 11:51:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.69699999999999995,"15min":0.70599999999999996},"min":{"1min":0.48799999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80800000000000005,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68899999999999995,"15min":0.69299999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.82899999999999996,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.62}]},{"osd":11,"last update":"Thu Aug 10 11:52:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66400000000000003,"15min":0.66100000000000003},"min":{"1min":0.58299999999999996,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85499999999999998,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.627,"15min":0.621},"min":{"1min":0.52200000000000002,"5min":0.502,"15min":0.502},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.65700000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411397,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":505066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54800000000000004,"15min":0.51200000000000001},"min":{"1min":0.373,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.81599999999999995,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.51700000000000002},"min":{"1min":0.38900000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.746,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Aug 10 11:52:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56100000000000005,"15min":0.52500000000000002},"min":{"1min":0.30199999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.64900000000000002,"15min":0.66700000000000004},"min":{"1min":0.45400000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.85199999999999998,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Aug 10 11:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.64300000000000002,"15min":0.68500000000000005},"min":{"1min":0.433,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86699999999999999,"5min":3.7519999999999998,"15min":3.7519999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52000000000000002,"15min":0.495},"min":{"1min":0.36699999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74399999999999999,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Aug 10 11:51:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Aug 10 11:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.497,"15min":0.47699999999999998},"min":{"1min":0.38400000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.379},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.46899999999999997,"15min":0.441},"min":{"1min":0.33800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Aug 10 11:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58199999999999996,"15min":0.56299999999999994},"min":{"1min":0.46300000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85999999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66200000000000003,"15min":0.64800000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.91300000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Aug 10 11:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.73899999999999999,"15min":0.73799999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.503}]},{"osd":8,"last update":"Thu Aug 10 11:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.628,"15min":0.60699999999999998},"min":{"1min":0.46700000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.98199999999999998,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.622},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.58899999999999997,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.64900000000000002}]},{"osd":9,"last update":"Thu Aug 10 11:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.82999999999999996,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.70499999999999996,"15min":0.70699999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.82899999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.51700000000000002}]},{"osd":10,"last update":"Thu Aug 10 11:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.70199999999999996,"15min":0.69399999999999995},"min":{"1min":0.52200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.77700000000000002,"15min":0.77200000000000002},"min":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.78800000000000003}]},{"osd":11,"last update":"Thu Aug 10 11:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.72099999999999997}]}]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":446845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:52:24 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.35799999999999998,"15min":0.35899999999999999},"min":{"1min":0.26000000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.47399999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.36699999999999999,"15min":0.35899999999999999},"min":{"1min":0.249,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.44600000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Aug 10 11:52:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56699999999999995,"15min":0.55600000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56499999999999995,"15min":0.55600000000000005},"min":{"1min":0.41499999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82199999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Aug 10 11:52:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59199999999999997,"15min":0.55900000000000005},"min":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.4049999999999998,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":0.498},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58799999999999997,"15min":0.55100000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68899999999999995,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.629}]},{"osd":4,"last update":"Thu Aug 10 11:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.376,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74299999999999999,"5min":1.028,"15min":1.028},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59799999999999998,"15min":0.59499999999999997},"min":{"1min":0.40899999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77000000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Aug 10 11:52:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.58299999999999996,"15min":0.57199999999999995},"min":{"1min":0.38,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78700000000000003,"5min":0.999,"15min":0.999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.61899999999999999,"15min":0.60699999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73299999999999998,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Aug 10 11:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.48099999999999998,"15min":0.46700000000000003},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.69699999999999995,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.434},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48299999999999998,"15min":0.46100000000000002},"min":{"1min":0.35499999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.45000000000000001}]},{"osd":7,"last update":"Thu Aug 10 11:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78100000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.63800000000000001,"15min":0.623},"min":{"1min":0.47899999999999998,"5min":0.434,"15min":0.434},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.60099999999999998}]},{"osd":8,"last update":"Thu Aug 10 11:50:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.67900000000000005}]},{"osd":9,"last update":"Thu Aug 10 11:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.627,"15min":0.64500000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83999999999999997,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.621,"15min":0.64100000000000001},"min":{"1min":0.38100000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.85699999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.46400000000000002}]},{"osd":10,"last update":"Thu Aug 10 11:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.73199999999999998,"15min":0.749},"min":{"1min":0.45800000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.80300000000000005,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.64700000000000002}]},{"osd":11,"last update":"Thu Aug 10 11:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.375,"5min":2.375,"15min":2.375},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.65900000000000003}]}]},{"osd":4,"up_from":32,"seq":137438953533,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":447493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54200000000000004,"15min":0.51400000000000001},"min":{"1min":0.39500000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79700000000000004,"5min":1.875,"15min":1.875},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.54300000000000004,"15min":0.51700000000000002},"min":{"1min":0.40899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Aug 10 11:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41999999999999998,"15min":0.40500000000000003},"min":{"1min":0.26300000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.57299999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.42899999999999999,"15min":0.40200000000000002},"min":{"1min":0.30199999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.57499999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Aug 10 11:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.59499999999999997,"15min":0.57899999999999996},"min":{"1min":0.47899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59299999999999997,"15min":0.57799999999999996},"min":{"1min":0.46700000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75800000000000001,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.626}]},{"osd":3,"last update":"Thu Aug 10 11:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59199999999999997,"15min":0.54900000000000004},"min":{"1min":0.40400000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76800000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56599999999999995,"15min":0.55400000000000005},"min":{"1min":0.40699999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76000000000000001,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.55000000000000004}]},{"osd":5,"last update":"Thu Aug 10 11:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.622,"15min":0.59999999999999998},"min":{"1min":0.47999999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81200000000000006,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.65300000000000002,"15min":0.60399999999999998},"min":{"1min":0.504,"5min":0.374,"15min":0.374},"max":{"1min":0.90400000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.71899999999999997}]},{"osd":6,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67100000000000004,"15min":0.67200000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92000000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83099999999999996,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.46899999999999997}]},{"osd":7,"last update":"Thu Aug 10 11:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.58399999999999996,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.92200000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.55800000000000005,"15min":0.53200000000000003},"min":{"1min":0.33700000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.70199999999999996}]},{"osd":8,"last update":"Thu Aug 10 11:52:18 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71699999999999997,"15min":0.70599999999999996},"min":{"1min":0.47199999999999998,"5min":0.441,"15min":0.441},"max":{"1min":0.92700000000000005,"5min":1.004,"15min":1.004},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.77000000000000002,"15min":0.753},"min":{"1min":0.56299999999999994,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95399999999999996,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.84599999999999997}]},{"osd":9,"last update":"Thu Aug 10 11:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.69199999999999995}]},{"osd":10,"last update":"Thu Aug 10 11:51:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76300000000000001,"15min":0.76100000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.90900000000000003,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.81799999999999995,"15min":0.81999999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.97799999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.79000000000000004}]},{"osd":11,"last update":"Thu Aug 10 11:51:54 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.80300000000000005}]}]},{"osd":5,"up_from":37,"seq":158913790007,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1552384,"data_stored":1038828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 11:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76200000000000001,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.628},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34399999999999997,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.56999999999999995}]},{"osd":1,"last update":"Thu Aug 10 11:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.56699999999999995,"15min":0.53000000000000003},"min":{"1min":0.45800000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.92200000000000004,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.58699999999999997,"15min":0.55000000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Aug 10 11:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.42499999999999999,"15min":0.39200000000000002},"min":{"1min":0.35299999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.435,"15min":0.40899999999999997},"min":{"1min":0.375,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.67000000000000004}]},{"osd":3,"last update":"Thu Aug 10 11:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56100000000000005,"15min":0.55300000000000005},"min":{"1min":0.34200000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.54300000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76300000000000001,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.70399999999999996}]},{"osd":4,"last update":"Thu Aug 10 11:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.624,"15min":0.59599999999999997},"min":{"1min":0.52600000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93000000000000005,"5min":1.109,"15min":1.109},"last":0.749},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.61299999999999999,"15min":0.58699999999999997},"min":{"1min":0.47599999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91800000000000004,"5min":1.002,"15min":1.002},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Aug 10 11:51:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.60799999999999998,"15min":0.58199999999999996},"min":{"1min":0.46700000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.64700000000000002,"15min":0.63900000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90200000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.83499999999999996}]},{"osd":7,"last update":"Thu Aug 10 11:51:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.63500000000000001,"15min":0.623},"min":{"1min":0.36299999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.66300000000000003,"15min":0.65100000000000002},"min":{"1min":0.49099999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94699999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.85299999999999998}]},{"osd":8,"last update":"Thu Aug 10 11:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.64600000000000002,"15min":0.63200000000000001},"min":{"1min":0.48199999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.44,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.88900000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.93000000000000005}]},{"osd":9,"last update":"Thu Aug 10 11:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.73599999999999999,"15min":0.69999999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":5.2999999999999998,"5min":5.2999999999999998,"15min":5.2999999999999998},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.73599999999999999,"15min":0.72899999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.91600000000000004}]},{"osd":10,"last update":"Thu Aug 10 11:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.71599999999999997,"15min":0.70499999999999996},"min":{"1min":0.53200000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.73099999999999998,"15min":0.71799999999999997},"min":{"1min":0.622,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.90100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":58194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":63875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T11:52:27.748 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T11:52:27.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.899+0000 7fce4e248700 1 -- 172.21.15.73:0/3854638654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce480ff650 msgr2=0x7fce480ffa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:27.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.899+0000 7fce4e248700 1 --2- 172.21.15.73:0/3854638654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce480ff650 0x7fce480ffa70 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fce3c0099c0 tx=0x7fce3c009cd0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.899+0000 7fce4e248700 1 -- 172.21.15.73:0/3854638654 shutdown_connections 2023-08-10T11:52:27.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.899+0000 7fce4e248700 1 --2- 172.21.15.73:0/3854638654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce481011e0 0x7fce48107a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.899+0000 7fce4e248700 1 --2- 172.21.15.73:0/3854638654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce480ff650 0x7fce480ffa70 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.899+0000 7fce4e248700 1 --2- 172.21.15.73:0/3854638654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce48100840 0x7fce48100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.899+0000 7fce4e248700 1 -- 172.21.15.73:0/3854638654 >> 172.21.15.73:0/3854638654 conn(0x7fce480faba0 msgr2=0x7fce480fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:27.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.899+0000 7fce4e248700 1 -- 172.21.15.73:0/3854638654 shutdown_connections 2023-08-10T11:52:27.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.899+0000 7fce4e248700 1 -- 172.21.15.73:0/3854638654 wait complete. 2023-08-10T11:52:27.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.900+0000 7fce4e248700 1 Processor -- start 2023-08-10T11:52:27.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.900+0000 7fce4e248700 1 -- start start 2023-08-10T11:52:27.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.900+0000 7fce4e248700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce480ff650 0x7fce481952d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:27.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.900+0000 7fce4e248700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce48100840 0x7fce48195810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:27.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.900+0000 7fce4e248700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce481011e0 0x7fce4819c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:27.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.900+0000 7fce4e248700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4819ce50 con 0x7fce48100840 2023-08-10T11:52:27.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.900+0000 7fce4e248700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4819cf90 con 0x7fce481011e0 2023-08-10T11:52:27.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.900+0000 7fce4e248700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4819d120 con 0x7fce480ff650 2023-08-10T11:52:27.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.900+0000 7fce46ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce48100840 0x7fce48195810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:27.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.900+0000 7fce46ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce48100840 0x7fce48195810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60602/0 (socket says 172.21.15.73:60602) 2023-08-10T11:52:27.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.900+0000 7fce46ffd700 1 -- 172.21.15.73:0/2543418958 learned_addr learned my addr 172.21.15.73:0/2543418958 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:27.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.900+0000 7fce477fe700 1 --2- 172.21.15.73:0/2543418958 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce480ff650 0x7fce481952d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:27.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.900+0000 7fce47fff700 1 --2- 172.21.15.73:0/2543418958 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce481011e0 0x7fce4819c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:27.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.901+0000 7fce46ffd700 1 -- 172.21.15.73:0/2543418958 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce480ff650 msgr2=0x7fce481952d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:27.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.901+0000 7fce46ffd700 1 --2- 172.21.15.73:0/2543418958 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce480ff650 0x7fce481952d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.901+0000 7fce46ffd700 1 -- 172.21.15.73:0/2543418958 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce481011e0 msgr2=0x7fce4819c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:27.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.901+0000 7fce46ffd700 1 --2- 172.21.15.73:0/2543418958 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce481011e0 0x7fce4819c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:27.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.901+0000 7fce46ffd700 1 -- 172.21.15.73:0/2543418958 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3c0095f0 con 0x7fce48100840 2023-08-10T11:52:27.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.901+0000 7fce46ffd700 1 --2- 172.21.15.73:0/2543418958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce48100840 0x7fce48195810 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fce3800d950 tx=0x7fce3800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:27.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.901+0000 7fce44ff9700 1 -- 172.21.15.73:0/2543418958 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3800f890 con 0x7fce48100840 2023-08-10T11:52:27.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.901+0000 7fce4e248700 1 -- 172.21.15.73:0/2543418958 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce4819d400 con 0x7fce48100840 2023-08-10T11:52:27.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.901+0000 7fce44ff9700 1 -- 172.21.15.73:0/2543418958 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fce38010460 con 0x7fce48100840 2023-08-10T11:52:27.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.901+0000 7fce44ff9700 1 -- 172.21.15.73:0/2543418958 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3800e610 con 0x7fce48100840 2023-08-10T11:52:27.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.901+0000 7fce4e248700 1 -- 172.21.15.73:0/2543418958 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce4819d960 con 0x7fce48100840 2023-08-10T11:52:27.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.902+0000 7fce4e248700 1 -- 172.21.15.73:0/2543418958 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce48106550 con 0x7fce48100840 2023-08-10T11:52:27.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.903+0000 7fce44ff9700 1 -- 172.21.15.73:0/2543418958 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fce380108d0 con 0x7fce48100840 2023-08-10T11:52:27.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.904+0000 7fce44ff9700 1 --2- 172.21.15.73:0/2543418958 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fce300a11a0 0x7fce300a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:27.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.904+0000 7fce477fe700 1 --2- 172.21.15.73:0/2543418958 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fce300a11a0 0x7fce300a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:27.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.904+0000 7fce44ff9700 1 -- 172.21.15.73:0/2543418958 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fce380cc7b0 con 0x7fce48100840 2023-08-10T11:52:27.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.904+0000 7fce477fe700 1 --2- 172.21.15.73:0/2543418958 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fce300a11a0 0x7fce300a3660 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00b580 tx=0x7fce3c009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:27.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:27.907+0000 7fce44ff9700 1 -- 172.21.15.73:0/2543418958 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fce38095eb0 con 0x7fce48100840 2023-08-10T11:52:28.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:27 smithi073 ceph-mon[128869]: pgmap v304: 97 pgs: 97 active+clean; 644 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-08-10T11:52:28.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.100+0000 7fce4e248700 1 -- 172.21.15.73:0/2543418958 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce4802cb70 con 0x7fce48100840 2023-08-10T11:52:28.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.101+0000 7fce44ff9700 1 -- 172.21.15.73:0/2543418958 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22482 (secure 0 0 0) 0x7fce380994d0 con 0x7fce48100840 2023-08-10T11:52:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:52:28.103 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":85,"fsid":"0e619a74-3773-11ee-9b37-001a4aab830c","created":"2023-08-10T11:43:53.974768+0000","modified":"2023-08-10T11:51:49.637159+0000","last_up_change":"2023-08-10T11:50:12.914422+0000","last_in_change":"2023-08-10T11:49:54.624543+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T11:46:58.735153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T11:50:52.517974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T11:50:53.465357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3219ae18-cc4c-4712-b616-79f6949066e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6803","nonce":2725694252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6805","nonce":2725694252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6809","nonce":2725694252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6807","nonce":2725694252}]},"public_addr":"172.21.15.73:6803/2725694252","cluster_addr":"172.21.15.73:6805/2725694252","heartbeat_back_addr":"172.21.15.73:6809/2725694252","heartbeat_front_addr":"172.21.15.73:6807/2725694252","state":["exists","up"]},{"osd":1,"uuid":"bbfe6cd9-b3d3-4b8d-8814-507a867f8c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6801","nonce":836829168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6803","nonce":836829168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6807","nonce":836829168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6805","nonce":836829168}]},"public_addr":"172.21.15.152:6801/836829168","cluster_addr":"172.21.15.152:6803/836829168","heartbeat_back_addr":"172.21.15.152:6807/836829168","heartbeat_front_addr":"172.21.15.152:6805/836829168","state":["exists","up"]},{"osd":2,"uuid":"f57f5b2c-3208-45c0-beba-8501694b99c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6801","nonce":1789212298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6803","nonce":1789212298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6807","nonce":1789212298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6805","nonce":1789212298}]},"public_addr":"172.21.15.156:6801/1789212298","cluster_addr":"172.21.15.156:6803/1789212298","heartbeat_back_addr":"172.21.15.156:6807/1789212298","heartbeat_front_addr":"172.21.15.156:6805/1789212298","state":["exists","up"]},{"osd":3,"uuid":"18592408-3696-4ab8-ad41-c172b8409829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6811","nonce":3101572649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6813","nonce":3101572649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6817","nonce":3101572649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6815","nonce":3101572649}]},"public_addr":"172.21.15.73:6811/3101572649","cluster_addr":"172.21.15.73:6813/3101572649","heartbeat_back_addr":"172.21.15.73:6817/3101572649","heartbeat_front_addr":"172.21.15.73:6815/3101572649","state":["exists","up"]},{"osd":4,"uuid":"fb3adb09-8807-42d9-8db9-1867c5fe02da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6809","nonce":1451517889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6811","nonce":1451517889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6815","nonce":1451517889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6813","nonce":1451517889}]},"public_addr":"172.21.15.152:6809/1451517889","cluster_addr":"172.21.15.152:6811/1451517889","heartbeat_back_addr":"172.21.15.152:6815/1451517889","heartbeat_front_addr":"172.21.15.152:6813/1451517889","state":["exists","up"]},{"osd":5,"uuid":"af58a7bd-4e58-4639-95b2-4a76011b61dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6809","nonce":3823368741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6811","nonce":3823368741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6815","nonce":3823368741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6813","nonce":3823368741}]},"public_addr":"172.21.15.156:6809/3823368741","cluster_addr":"172.21.15.156:6811/3823368741","heartbeat_back_addr":"172.21.15.156:6815/3823368741","heartbeat_front_addr":"172.21.15.156:6813/3823368741","state":["exists","up"]},{"osd":6,"uuid":"f6ae502d-4af9-4f6a-8636-b5b683dfdfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6819","nonce":2533620458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6821","nonce":2533620458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6825","nonce":2533620458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6823","nonce":2533620458}]},"public_addr":"172.21.15.73:6819/2533620458","cluster_addr":"172.21.15.73:6821/2533620458","heartbeat_back_addr":"172.21.15.73:6825/2533620458","heartbeat_front_addr":"172.21.15.73:6823/2533620458","state":["exists","up"]},{"osd":7,"uuid":"398fd334-5f6f-427c-95ae-3244fb466f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6817","nonce":4059538477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6819","nonce":4059538477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6823","nonce":4059538477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6821","nonce":4059538477}]},"public_addr":"172.21.15.152:6817/4059538477","cluster_addr":"172.21.15.152:6819/4059538477","heartbeat_back_addr":"172.21.15.152:6823/4059538477","heartbeat_front_addr":"172.21.15.152:6821/4059538477","state":["exists","up"]},{"osd":8,"uuid":"58f46e64-2624-4ad4-bb6a-225624153837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6817","nonce":96487555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6819","nonce":96487555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6823","nonce":96487555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6821","nonce":96487555}]},"public_addr":"172.21.15.156:6817/96487555","cluster_addr":"172.21.15.156:6819/96487555","heartbeat_back_addr":"172.21.15.156:6823/96487555","heartbeat_front_addr":"172.21.15.156:6821/96487555","state":["exists","up"]},{"osd":9,"uuid":"9389dd5b-da2d-43b6-8bc0-bb1af13f72c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6827","nonce":2050124321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6829","nonce":2050124321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6833","nonce":2050124321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6831","nonce":2050124321}]},"public_addr":"172.21.15.73:6827/2050124321","cluster_addr":"172.21.15.73:6829/2050124321","heartbeat_back_addr":"172.21.15.73:6833/2050124321","heartbeat_front_addr":"172.21.15.73:6831/2050124321","state":["exists","up"]},{"osd":10,"uuid":"563c1e34-3acd-46ab-ba36-e9d87f635e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6825","nonce":1513186350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6827","nonce":1513186350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6831","nonce":1513186350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6829","nonce":1513186350}]},"public_addr":"172.21.15.152:6825/1513186350","cluster_addr":"172.21.15.152:6827/1513186350","heartbeat_back_addr":"172.21.15.152:6831/1513186350","heartbeat_front_addr":"172.21.15.152:6829/1513186350","state":["exists","up"]},{"osd":11,"uuid":"f1b55889-14fd-4cc9-bed7-43748086fb77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6825","nonce":737904755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6827","nonce":737904755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6831","nonce":737904755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6829","nonce":737904755}]},"public_addr":"172.21.15.156:6825/737904755","cluster_addr":"172.21.15.156:6827/737904755","heartbeat_back_addr":"172.21.15.156:6831/737904755","heartbeat_front_addr":"172.21.15.156:6829/737904755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:12.023797+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:33.872883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:55.856970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:18.013196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:39.202872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:00.393920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:22.743083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:43.921728+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:05.859488+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:27.618714+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:48.880286+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:50:11.055141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/2202785670":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6800/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:6800/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/1447381524":"2023-08-11T11:44:48.401660+0000","172.21.15.73:0/2545059698":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/4193457623":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2561039569":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2927950081":"2023-08-11T11:44:48.401660+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T11:52:28.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.104+0000 7fce4e248700 1 -- 172.21.15.73:0/2543418958 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fce300a11a0 msgr2=0x7fce300a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:28.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.104+0000 7fce4e248700 1 --2- 172.21.15.73:0/2543418958 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fce300a11a0 0x7fce300a3660 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00b580 tx=0x7fce3c009f10 comp rx=0 tx=0).stop 2023-08-10T11:52:28.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.104+0000 7fce4e248700 1 -- 172.21.15.73:0/2543418958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce48100840 msgr2=0x7fce48195810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:28.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.104+0000 7fce4e248700 1 --2- 172.21.15.73:0/2543418958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce48100840 0x7fce48195810 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fce3800d950 tx=0x7fce3800dc60 comp rx=0 tx=0).stop 2023-08-10T11:52:28.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.104+0000 7fce4e248700 1 -- 172.21.15.73:0/2543418958 shutdown_connections 2023-08-10T11:52:28.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.104+0000 7fce4e248700 1 --2- 172.21.15.73:0/2543418958 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fce300a11a0 0x7fce300a3660 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.104+0000 7fce4e248700 1 --2- 172.21.15.73:0/2543418958 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce481011e0 0x7fce4819c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.104+0000 7fce4e248700 1 --2- 172.21.15.73:0/2543418958 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce480ff650 0x7fce481952d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.104+0000 7fce4e248700 1 --2- 172.21.15.73:0/2543418958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce48100840 0x7fce48195810 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.104+0000 7fce4e248700 1 -- 172.21.15.73:0/2543418958 >> 172.21.15.73:0/2543418958 conn(0x7fce480faba0 msgr2=0x7fce480fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:28.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.104+0000 7fce4e248700 1 -- 172.21.15.73:0/2543418958 shutdown_connections 2023-08-10T11:52:28.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.104+0000 7fce4e248700 1 -- 172.21.15.73:0/2543418958 wait complete. 2023-08-10T11:52:28.117 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T11:46:58.735153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T11:50:52.517974+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T11:50:53.465357+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T11:52:28.117 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T11:52:28.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.240+0000 7f822fde7700 1 -- 172.21.15.73:0/1611434983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8228100c60 msgr2=0x7f8228101080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:28.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.240+0000 7f822fde7700 1 --2- 172.21.15.73:0/1611434983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8228100c60 0x7f8228101080 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8218009990 tx=0x7f8218009ca0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.240+0000 7f822fde7700 1 -- 172.21.15.73:0/1611434983 shutdown_connections 2023-08-10T11:52:28.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.240+0000 7f822fde7700 1 --2- 172.21.15.73:0/1611434983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8228100270 0x7f8228107b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.240+0000 7f822fde7700 1 --2- 172.21.15.73:0/1611434983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8228100c60 0x7f8228101080 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.240+0000 7f822fde7700 1 --2- 172.21.15.73:0/1611434983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82280ff8b0 0x7f82280ffd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.240+0000 7f822fde7700 1 -- 172.21.15.73:0/1611434983 >> 172.21.15.73:0/1611434983 conn(0x7f82280fa340 msgr2=0x7f82280fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:28.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.240+0000 7f822fde7700 1 -- 172.21.15.73:0/1611434983 shutdown_connections 2023-08-10T11:52:28.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.240+0000 7f822fde7700 1 -- 172.21.15.73:0/1611434983 wait complete. 2023-08-10T11:52:28.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.241+0000 7f822fde7700 1 Processor -- start 2023-08-10T11:52:28.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.241+0000 7f822fde7700 1 -- start start 2023-08-10T11:52:28.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.241+0000 7f822fde7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82280ff8b0 0x7f82280ff330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:28.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.241+0000 7f822fde7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8228100270 0x7f822819b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:28.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.241+0000 7f822fde7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8228100c60 0x7f822819d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:28.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.241+0000 7f822fde7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822819e0a0 con 0x7f8228100270 2023-08-10T11:52:28.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.241+0000 7f822fde7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822819e210 con 0x7f8228100c60 2023-08-10T11:52:28.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.241+0000 7f822fde7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822819e3d0 con 0x7f82280ff8b0 2023-08-10T11:52:28.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.241+0000 7f822d382700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8228100270 0x7f822819b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:28.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.241+0000 7f822d382700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8228100270 0x7f822819b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60616/0 (socket says 172.21.15.73:60616) 2023-08-10T11:52:28.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.241+0000 7f822d382700 1 -- 172.21.15.73:0/2607913478 learned_addr learned my addr 172.21.15.73:0/2607913478 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:28.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.241+0000 7f822e384700 1 --2- 172.21.15.73:0/2607913478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8228100c60 0x7f822819d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:28.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.241+0000 7f822d382700 1 -- 172.21.15.73:0/2607913478 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82280ff8b0 msgr2=0x7f82280ff330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:28.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.241+0000 7f822db83700 1 --2- 172.21.15.73:0/2607913478 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82280ff8b0 0x7f82280ff330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:28.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.241+0000 7f822d382700 1 --2- 172.21.15.73:0/2607913478 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82280ff8b0 0x7f82280ff330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.241+0000 7f822d382700 1 -- 172.21.15.73:0/2607913478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8228100c60 msgr2=0x7f822819d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:28.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.241+0000 7f822d382700 1 --2- 172.21.15.73:0/2607913478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8228100c60 0x7f822819d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.241+0000 7f822d382700 1 -- 172.21.15.73:0/2607913478 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82180095f0 con 0x7f8228100270 2023-08-10T11:52:28.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.242+0000 7f822e384700 1 --2- 172.21.15.73:0/2607913478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8228100c60 0x7f822819d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:52:28.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.242+0000 7f822d382700 1 --2- 172.21.15.73:0/2607913478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8228100270 0x7f822819b280 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f822400b530 tx=0x7f822400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:28.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.242+0000 7f821effd700 1 -- 172.21.15.73:0/2607913478 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224011830 con 0x7f8228100270 2023-08-10T11:52:28.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.242+0000 7f821effd700 1 -- 172.21.15.73:0/2607913478 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8224011e50 con 0x7f8228100270 2023-08-10T11:52:28.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.242+0000 7f822fde7700 1 -- 172.21.15.73:0/2607913478 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f822819e6b0 con 0x7f8228100270 2023-08-10T11:52:28.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.242+0000 7f821effd700 1 -- 172.21.15.73:0/2607913478 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822400f2e0 con 0x7f8228100270 2023-08-10T11:52:28.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.242+0000 7f822fde7700 1 -- 172.21.15.73:0/2607913478 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822819ebc0 con 0x7f8228100270 2023-08-10T11:52:28.250 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:27 smithi152 ceph-mon[130220]: pgmap v304: 97 pgs: 97 active+clean; 644 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-08-10T11:52:28.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.243+0000 7f822fde7700 1 -- 172.21.15.73:0/2607913478 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f822810af20 con 0x7f8228100270 2023-08-10T11:52:28.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.244+0000 7f821effd700 1 -- 172.21.15.73:0/2607913478 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f8224010580 con 0x7f8228100270 2023-08-10T11:52:28.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.244+0000 7f821effd700 1 --2- 172.21.15.73:0/2607913478 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f82140a11d0 0x7f82140a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:28.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.245+0000 7f822db83700 1 --2- 172.21.15.73:0/2607913478 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f82140a11d0 0x7f82140a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:28.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.245+0000 7f821effd700 1 -- 172.21.15.73:0/2607913478 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f82240cc490 con 0x7f8228100270 2023-08-10T11:52:28.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.245+0000 7f822db83700 1 --2- 172.21.15.73:0/2607913478 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f82140a11d0 0x7f82140a3690 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8218000c00 tx=0x7f8218005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:28.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.249+0000 7f821effd700 1 -- 172.21.15.73:0/2607913478 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8224095b90 con 0x7f8228100270 2023-08-10T11:52:28.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:27 smithi156 ceph-mon[130574]: pgmap v304: 97 pgs: 97 active+clean; 644 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-08-10T11:52:28.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.437+0000 7f822fde7700 1 -- 172.21.15.73:0/2607913478 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f822819f260 con 0x7f8228100270 2023-08-10T11:52:28.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.437+0000 7f821effd700 1 -- 172.21.15.73:0/2607913478 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f82240991b0 con 0x7f8228100270 2023-08-10T11:52:28.438 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-08-10T11:52:28.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.440+0000 7f822fde7700 1 -- 172.21.15.73:0/2607913478 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f82140a11d0 msgr2=0x7f82140a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:28.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.440+0000 7f822fde7700 1 --2- 172.21.15.73:0/2607913478 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f82140a11d0 0x7f82140a3690 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8218000c00 tx=0x7f8218005fb0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.440+0000 7f822fde7700 1 -- 172.21.15.73:0/2607913478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8228100270 msgr2=0x7f822819b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:28.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.440+0000 7f822fde7700 1 --2- 172.21.15.73:0/2607913478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8228100270 0x7f822819b280 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f822400b530 tx=0x7f822400b8f0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.440+0000 7f822fde7700 1 -- 172.21.15.73:0/2607913478 shutdown_connections 2023-08-10T11:52:28.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.440+0000 7f822fde7700 1 --2- 172.21.15.73:0/2607913478 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f82140a11d0 0x7f82140a3690 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.440+0000 7f822fde7700 1 --2- 172.21.15.73:0/2607913478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8228100c60 0x7f822819d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.440+0000 7f822fde7700 1 --2- 172.21.15.73:0/2607913478 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82280ff8b0 0x7f82280ff330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.440+0000 7f822fde7700 1 --2- 172.21.15.73:0/2607913478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8228100270 0x7f822819b280 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.440+0000 7f822fde7700 1 -- 172.21.15.73:0/2607913478 >> 172.21.15.73:0/2607913478 conn(0x7f82280fa340 msgr2=0x7f82280fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:28.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.440+0000 7f822fde7700 1 -- 172.21.15.73:0/2607913478 shutdown_connections 2023-08-10T11:52:28.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.440+0000 7f822fde7700 1 -- 172.21.15.73:0/2607913478 wait complete. 2023-08-10T11:52:28.453 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T11:52:28.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.578+0000 7f2c49baa700 1 -- 172.21.15.73:0/894940619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c44100850 msgr2=0x7f2c44100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:28.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.578+0000 7f2c49baa700 1 --2- 172.21.15.73:0/894940619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c44100850 0x7f2c44100cb0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2c340099c0 tx=0x7f2c34009cd0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.578+0000 7f2c49baa700 1 -- 172.21.15.73:0/894940619 shutdown_connections 2023-08-10T11:52:28.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.578+0000 7f2c49baa700 1 --2- 172.21.15.73:0/894940619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c440ff660 0x7f2c440ffa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.578+0000 7f2c49baa700 1 --2- 172.21.15.73:0/894940619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c441011f0 0x7f2c44107aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.578+0000 7f2c49baa700 1 --2- 172.21.15.73:0/894940619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c44100850 0x7f2c44100cb0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.578+0000 7f2c49baa700 1 -- 172.21.15.73:0/894940619 >> 172.21.15.73:0/894940619 conn(0x7f2c440fabd0 msgr2=0x7f2c440fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:28.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.578+0000 7f2c49baa700 1 -- 172.21.15.73:0/894940619 shutdown_connections 2023-08-10T11:52:28.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.578+0000 7f2c49baa700 1 -- 172.21.15.73:0/894940619 wait complete. 2023-08-10T11:52:28.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.579+0000 7f2c49baa700 1 Processor -- start 2023-08-10T11:52:28.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.579+0000 7f2c49baa700 1 -- start start 2023-08-10T11:52:28.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.579+0000 7f2c49baa700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c440ff660 0x7f2c44068460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:28.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.579+0000 7f2c49baa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c44100850 0x7f2c4419b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:28.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.579+0000 7f2c49baa700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c441011f0 0x7f2c4419d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:28.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.579+0000 7f2c49baa700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4419dfa0 con 0x7f2c441011f0 2023-08-10T11:52:28.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.579+0000 7f2c49baa700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4419e110 con 0x7f2c44100850 2023-08-10T11:52:28.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.579+0000 7f2c49baa700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4419e2d0 con 0x7f2c440ff660 2023-08-10T11:52:28.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.579+0000 7f2c43fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c441011f0 0x7f2c4419d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:28.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.579+0000 7f2c43fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c441011f0 0x7f2c4419d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60632/0 (socket says 172.21.15.73:60632) 2023-08-10T11:52:28.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.579+0000 7f2c43fff700 1 -- 172.21.15.73:0/4090729376 learned_addr learned my addr 172.21.15.73:0/4090729376 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:28.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.579+0000 7f2c437fe700 1 --2- 172.21.15.73:0/4090729376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c440ff660 0x7f2c44068460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:28.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.579+0000 7f2c42ffd700 1 --2- 172.21.15.73:0/4090729376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c44100850 0x7f2c4419b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:28.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.579+0000 7f2c43fff700 1 -- 172.21.15.73:0/4090729376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c440ff660 msgr2=0x7f2c44068460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:28.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.579+0000 7f2c43fff700 1 --2- 172.21.15.73:0/4090729376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c440ff660 0x7f2c44068460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.579+0000 7f2c43fff700 1 -- 172.21.15.73:0/4090729376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c44100850 msgr2=0x7f2c4419b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:28.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.579+0000 7f2c43fff700 1 --2- 172.21.15.73:0/4090729376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c44100850 0x7f2c4419b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.579+0000 7f2c43fff700 1 -- 172.21.15.73:0/4090729376 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c340095f0 con 0x7f2c441011f0 2023-08-10T11:52:28.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.580+0000 7f2c43fff700 1 --2- 172.21.15.73:0/4090729376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c441011f0 0x7f2c4419d7d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c00ef30 tx=0x7f2c3c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:28.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.580+0000 7f2c40ff9700 1 -- 172.21.15.73:0/4090729376 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c018070 con 0x7f2c441011f0 2023-08-10T11:52:28.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.580+0000 7f2c40ff9700 1 -- 172.21.15.73:0/4090729376 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c3c00f040 con 0x7f2c441011f0 2023-08-10T11:52:28.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.580+0000 7f2c49baa700 1 -- 172.21.15.73:0/4090729376 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c4419e550 con 0x7f2c441011f0 2023-08-10T11:52:28.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.580+0000 7f2c40ff9700 1 -- 172.21.15.73:0/4090729376 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c00cd00 con 0x7f2c441011f0 2023-08-10T11:52:28.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.580+0000 7f2c49baa700 1 -- 172.21.15.73:0/4090729376 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c4419e9e0 con 0x7f2c441011f0 2023-08-10T11:52:28.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.581+0000 7f2c49baa700 1 -- 172.21.15.73:0/4090729376 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c441065e0 con 0x7f2c441011f0 2023-08-10T11:52:28.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.582+0000 7f2c40ff9700 1 -- 172.21.15.73:0/4090729376 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f2c3c003a00 con 0x7f2c441011f0 2023-08-10T11:52:28.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.582+0000 7f2c40ff9700 1 --2- 172.21.15.73:0/4090729376 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f2c2c0a1150 0x7f2c2c0a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:28.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.583+0000 7f2c40ff9700 1 -- 172.21.15.73:0/4090729376 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2c3c0cce00 con 0x7f2c441011f0 2023-08-10T11:52:28.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.583+0000 7f2c437fe700 1 --2- 172.21.15.73:0/4090729376 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f2c2c0a1150 0x7f2c2c0a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:28.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.583+0000 7f2c437fe700 1 --2- 172.21.15.73:0/4090729376 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f2c2c0a1150 0x7f2c2c0a3610 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2c441006b0 tx=0x7f2c3800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:28.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.586+0000 7f2c40ff9700 1 -- 172.21.15.73:0/4090729376 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f2c3c0965f0 con 0x7f2c441011f0 2023-08-10T11:52:28.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.777+0000 7f2c49baa700 1 -- 172.21.15.73:0/4090729376 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2c4402cb00 con 0x7f2c441011f0 2023-08-10T11:52:28.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.777+0000 7f2c40ff9700 1 -- 172.21.15.73:0/4090729376 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2c3c099c10 con 0x7f2c441011f0 2023-08-10T11:52:28.778 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-08-10T11:52:28.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.779+0000 7f2c49baa700 1 -- 172.21.15.73:0/4090729376 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f2c2c0a1150 msgr2=0x7f2c2c0a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:28.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.779+0000 7f2c49baa700 1 --2- 172.21.15.73:0/4090729376 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f2c2c0a1150 0x7f2c2c0a3610 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2c441006b0 tx=0x7f2c3800b410 comp rx=0 tx=0).stop 2023-08-10T11:52:28.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.779+0000 7f2c49baa700 1 -- 172.21.15.73:0/4090729376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c441011f0 msgr2=0x7f2c4419d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:28.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.779+0000 7f2c49baa700 1 --2- 172.21.15.73:0/4090729376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c441011f0 0x7f2c4419d7d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c00ef30 tx=0x7f2c3c00c3a0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.779+0000 7f2c49baa700 1 -- 172.21.15.73:0/4090729376 shutdown_connections 2023-08-10T11:52:28.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.779+0000 7f2c49baa700 1 --2- 172.21.15.73:0/4090729376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c441011f0 0x7f2c4419d7d0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.779+0000 7f2c49baa700 1 --2- 172.21.15.73:0/4090729376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c440ff660 0x7f2c44068460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.779+0000 7f2c49baa700 1 --2- 172.21.15.73:0/4090729376 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f2c2c0a1150 0x7f2c2c0a3610 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.779+0000 7f2c49baa700 1 --2- 172.21.15.73:0/4090729376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c44100850 0x7f2c4419b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.780+0000 7f2c49baa700 1 -- 172.21.15.73:0/4090729376 >> 172.21.15.73:0/4090729376 conn(0x7f2c440fabd0 msgr2=0x7f2c440fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:28.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.780+0000 7f2c49baa700 1 -- 172.21.15.73:0/4090729376 shutdown_connections 2023-08-10T11:52:28.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.780+0000 7f2c49baa700 1 -- 172.21.15.73:0/4090729376 wait complete. 2023-08-10T11:52:28.793 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T11:52:28.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.916+0000 7fa207364700 1 -- 172.21.15.73:0/3252355659 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa200101260 msgr2=0x7fa200107b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:28.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.916+0000 7fa207364700 1 --2- 172.21.15.73:0/3252355659 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa200101260 0x7fa200107b10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa1f800b0d0 tx=0x7fa1f800b3e0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.916+0000 7fa207364700 1 -- 172.21.15.73:0/3252355659 shutdown_connections 2023-08-10T11:52:28.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.916+0000 7fa207364700 1 --2- 172.21.15.73:0/3252355659 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa200101260 0x7fa200107b10 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.916+0000 7fa207364700 1 --2- 172.21.15.73:0/3252355659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2000ff6d0 0x7fa2000ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.916+0000 7fa207364700 1 --2- 172.21.15.73:0/3252355659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2001008c0 0x7fa200100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.916+0000 7fa207364700 1 -- 172.21.15.73:0/3252355659 >> 172.21.15.73:0/3252355659 conn(0x7fa2000fac40 msgr2=0x7fa2000fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:28.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.917+0000 7fa207364700 1 -- 172.21.15.73:0/3252355659 shutdown_connections 2023-08-10T11:52:28.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.917+0000 7fa207364700 1 -- 172.21.15.73:0/3252355659 wait complete. 2023-08-10T11:52:28.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.917+0000 7fa207364700 1 Processor -- start 2023-08-10T11:52:28.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.917+0000 7fa207364700 1 -- start start 2023-08-10T11:52:28.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.918+0000 7fa207364700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2000ff6d0 0x7fa200195440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:28.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.918+0000 7fa207364700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2001008c0 0x7fa200195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:28.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.918+0000 7fa207364700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa200101260 0x7fa20019c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:28.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.918+0000 7fa207364700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20019cfc0 con 0x7fa2000ff6d0 2023-08-10T11:52:28.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.918+0000 7fa207364700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20019d100 con 0x7fa2001008c0 2023-08-10T11:52:28.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.918+0000 7fa207364700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20019d290 con 0x7fa200101260 2023-08-10T11:52:28.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.918+0000 7fa205100700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2000ff6d0 0x7fa200195440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:28.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.918+0000 7fa205100700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2000ff6d0 0x7fa200195440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60640/0 (socket says 172.21.15.73:60640) 2023-08-10T11:52:28.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.918+0000 7fa205100700 1 -- 172.21.15.73:0/2294637296 learned_addr learned my addr 172.21.15.73:0/2294637296 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:28.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.918+0000 7fa2048ff700 1 --2- 172.21.15.73:0/2294637296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2001008c0 0x7fa200195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:28.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.918+0000 7fa205901700 1 --2- 172.21.15.73:0/2294637296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa200101260 0x7fa20019c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:28.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.918+0000 7fa205100700 1 -- 172.21.15.73:0/2294637296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa200101260 msgr2=0x7fa20019c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:28.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.918+0000 7fa205100700 1 --2- 172.21.15.73:0/2294637296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa200101260 0x7fa20019c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.918+0000 7fa205100700 1 -- 172.21.15.73:0/2294637296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2001008c0 msgr2=0x7fa200195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:28.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.918+0000 7fa205100700 1 --2- 172.21.15.73:0/2294637296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2001008c0 0x7fa200195980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:28.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.918+0000 7fa205100700 1 -- 172.21.15.73:0/2294637296 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f8009d00 con 0x7fa2000ff6d0 2023-08-10T11:52:28.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.918+0000 7fa205901700 1 --2- 172.21.15.73:0/2294637296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa200101260 0x7fa20019c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:52:28.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.918+0000 7fa2048ff700 1 --2- 172.21.15.73:0/2294637296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2001008c0 0x7fa200195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:52:28.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.918+0000 7fa205100700 1 --2- 172.21.15.73:0/2294637296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2000ff6d0 0x7fa200195440 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00d980 tx=0x7fa1fc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:28.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.918+0000 7fa1f67fc700 1 -- 172.21.15.73:0/2294637296 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc00bb60 con 0x7fa2000ff6d0 2023-08-10T11:52:28.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.918+0000 7fa1f67fc700 1 -- 172.21.15.73:0/2294637296 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1fc007620 con 0x7fa2000ff6d0 2023-08-10T11:52:28.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.918+0000 7fa207364700 1 -- 172.21.15.73:0/2294637296 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa20019d570 con 0x7fa2000ff6d0 2023-08-10T11:52:28.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.918+0000 7fa1f67fc700 1 -- 172.21.15.73:0/2294637296 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc00f620 con 0x7fa2000ff6d0 2023-08-10T11:52:28.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.918+0000 7fa207364700 1 -- 172.21.15.73:0/2294637296 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa20019dad0 con 0x7fa2000ff6d0 2023-08-10T11:52:28.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.919+0000 7fa207364700 1 -- 172.21.15.73:0/2294637296 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa200106c40 con 0x7fa2000ff6d0 2023-08-10T11:52:28.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.920+0000 7fa1f67fc700 1 -- 172.21.15.73:0/2294637296 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fa1fc010460 con 0x7fa2000ff6d0 2023-08-10T11:52:28.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.921+0000 7fa1f67fc700 1 --2- 172.21.15.73:0/2294637296 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa1ec0a11d0 0x7fa1ec0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:28.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.921+0000 7fa2048ff700 1 --2- 172.21.15.73:0/2294637296 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa1ec0a11d0 0x7fa1ec0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:28.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.922+0000 7fa2048ff700 1 --2- 172.21.15.73:0/2294637296 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa1ec0a11d0 0x7fa1ec0a3690 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0005e10 tx=0x7fa1f0005d60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:28.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.922+0000 7fa1f67fc700 1 -- 172.21.15.73:0/2294637296 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa1fc010e40 con 0x7fa2000ff6d0 2023-08-10T11:52:28.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:28.927+0000 7fa1f67fc700 1 -- 172.21.15.73:0/2294637296 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fa1fc096840 con 0x7fa2000ff6d0 2023-08-10T11:52:29.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.113+0000 7fa207364700 1 -- 172.21.15.73:0/2294637296 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa20002cc20 con 0x7fa2000ff6d0 2023-08-10T11:52:29.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.114+0000 7fa1f67fc700 1 -- 172.21.15.73:0/2294637296 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa1fc0160a0 con 0x7fa2000ff6d0 2023-08-10T11:52:29.116 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-08-10T11:52:29.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.116+0000 7fa207364700 1 -- 172.21.15.73:0/2294637296 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa1ec0a11d0 msgr2=0x7fa1ec0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:29.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.116+0000 7fa207364700 1 --2- 172.21.15.73:0/2294637296 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa1ec0a11d0 0x7fa1ec0a3690 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0005e10 tx=0x7fa1f0005d60 comp rx=0 tx=0).stop 2023-08-10T11:52:29.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.116+0000 7fa207364700 1 -- 172.21.15.73:0/2294637296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2000ff6d0 msgr2=0x7fa200195440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:29.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.116+0000 7fa207364700 1 --2- 172.21.15.73:0/2294637296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2000ff6d0 0x7fa200195440 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00d980 tx=0x7fa1fc00dd40 comp rx=0 tx=0).stop 2023-08-10T11:52:29.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.116+0000 7fa207364700 1 -- 172.21.15.73:0/2294637296 shutdown_connections 2023-08-10T11:52:29.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.116+0000 7fa207364700 1 --2- 172.21.15.73:0/2294637296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa200101260 0x7fa20019c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.116+0000 7fa207364700 1 --2- 172.21.15.73:0/2294637296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2000ff6d0 0x7fa200195440 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.116+0000 7fa207364700 1 --2- 172.21.15.73:0/2294637296 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fa1ec0a11d0 0x7fa1ec0a3690 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.116+0000 7fa207364700 1 --2- 172.21.15.73:0/2294637296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2001008c0 0x7fa200195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.116+0000 7fa207364700 1 -- 172.21.15.73:0/2294637296 >> 172.21.15.73:0/2294637296 conn(0x7fa2000fac40 msgr2=0x7fa200103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:29.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.116+0000 7fa207364700 1 -- 172.21.15.73:0/2294637296 shutdown_connections 2023-08-10T11:52:29.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.116+0000 7fa207364700 1 -- 172.21.15.73:0/2294637296 wait complete. 2023-08-10T11:52:29.128 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:28 smithi073 ceph-mon[128869]: from='client.15378 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T11:52:29.128 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:28 smithi073 ceph-mon[128869]: from='client.15384 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T11:52:29.128 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:28 smithi073 ceph-mon[128869]: from='client.15390 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T11:52:29.128 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:28 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2543418958' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:52:29.128 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:28 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2607913478' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:52:29.128 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:28 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/4090729376' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:52:29.129 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T11:52:29.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:28 smithi152 ceph-mon[130220]: from='client.15378 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T11:52:29.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:28 smithi152 ceph-mon[130220]: from='client.15384 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T11:52:29.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:28 smithi152 ceph-mon[130220]: from='client.15390 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T11:52:29.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:28 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/2543418958' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:52:29.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:28 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/2607913478' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:52:29.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:28 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/4090729376' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:52:29.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.249+0000 7f74c76d6700 1 -- 172.21.15.73:0/720162165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74c00ff660 msgr2=0x7f74c00ffa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:29.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.249+0000 7f74c76d6700 1 --2- 172.21.15.73:0/720162165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74c00ff660 0x7f74c00ffa80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f74b00099c0 tx=0x7f74b0009cd0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.249+0000 7f74c76d6700 1 -- 172.21.15.73:0/720162165 shutdown_connections 2023-08-10T11:52:29.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.249+0000 7f74c76d6700 1 --2- 172.21.15.73:0/720162165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74c01011f0 0x7f74c0107aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.249+0000 7f74c76d6700 1 --2- 172.21.15.73:0/720162165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74c00ff660 0x7f74c00ffa80 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.249+0000 7f74c76d6700 1 --2- 172.21.15.73:0/720162165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74c0100850 0x7f74c0100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.249+0000 7f74c76d6700 1 -- 172.21.15.73:0/720162165 >> 172.21.15.73:0/720162165 conn(0x7f74c00fabd0 msgr2=0x7f74c00fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:29.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.249+0000 7f74c76d6700 1 -- 172.21.15.73:0/720162165 shutdown_connections 2023-08-10T11:52:29.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.249+0000 7f74c76d6700 1 -- 172.21.15.73:0/720162165 wait complete. 2023-08-10T11:52:29.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.250+0000 7f74c76d6700 1 Processor -- start 2023-08-10T11:52:29.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.250+0000 7f74c76d6700 1 -- start start 2023-08-10T11:52:29.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.250+0000 7f74c76d6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74c00ff660 0x7f74c0069660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:29.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.250+0000 7f74c76d6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74c0100850 0x7f74c019b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:29.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.250+0000 7f74c76d6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74c01011f0 0x7f74c019d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:29.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.250+0000 7f74c76d6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c019df50 con 0x7f74c0100850 2023-08-10T11:52:29.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.250+0000 7f74c76d6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c019e0c0 con 0x7f74c01011f0 2023-08-10T11:52:29.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.250+0000 7f74c76d6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c019e280 con 0x7f74c00ff660 2023-08-10T11:52:29.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.250+0000 7f74c4c71700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74c0100850 0x7f74c019b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:29.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.250+0000 7f74c4c71700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74c0100850 0x7f74c019b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60656/0 (socket says 172.21.15.73:60656) 2023-08-10T11:52:29.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.250+0000 7f74c4c71700 1 -- 172.21.15.73:0/919682275 learned_addr learned my addr 172.21.15.73:0/919682275 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:29.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.250+0000 7f74c5472700 1 --2- 172.21.15.73:0/919682275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74c00ff660 0x7f74c0069660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:29.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.250+0000 7f74c5c73700 1 --2- 172.21.15.73:0/919682275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74c01011f0 0x7f74c019d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:29.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.250+0000 7f74c4c71700 1 -- 172.21.15.73:0/919682275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74c00ff660 msgr2=0x7f74c0069660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:29.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.250+0000 7f74c4c71700 1 --2- 172.21.15.73:0/919682275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74c00ff660 0x7f74c0069660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.251+0000 7f74c4c71700 1 -- 172.21.15.73:0/919682275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74c01011f0 msgr2=0x7f74c019d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:29.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.251+0000 7f74c4c71700 1 --2- 172.21.15.73:0/919682275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74c01011f0 0x7f74c019d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.251+0000 7f74c4c71700 1 -- 172.21.15.73:0/919682275 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b00095f0 con 0x7f74c0100850 2023-08-10T11:52:29.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.251+0000 7f74c4c71700 1 --2- 172.21.15.73:0/919682275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74c0100850 0x7f74c019b170 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f74bc00e9a0 tx=0x7f74bc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:29.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.251+0000 7f74b67fc700 1 -- 172.21.15.73:0/919682275 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc009790 con 0x7f74c0100850 2023-08-10T11:52:29.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.251+0000 7f74b67fc700 1 -- 172.21.15.73:0/919682275 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f74bc00cbd0 con 0x7f74c0100850 2023-08-10T11:52:29.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.251+0000 7f74c76d6700 1 -- 172.21.15.73:0/919682275 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c019e560 con 0x7f74c0100850 2023-08-10T11:52:29.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.251+0000 7f74b67fc700 1 -- 172.21.15.73:0/919682275 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc018680 con 0x7f74c0100850 2023-08-10T11:52:29.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.251+0000 7f74c76d6700 1 -- 172.21.15.73:0/919682275 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c019ea70 con 0x7f74c0100850 2023-08-10T11:52:29.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.252+0000 7f74c76d6700 1 -- 172.21.15.73:0/919682275 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c010ae80 con 0x7f74c0100850 2023-08-10T11:52:29.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.253+0000 7f74b67fc700 1 -- 172.21.15.73:0/919682275 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f74bc00cd40 con 0x7f74c0100850 2023-08-10T11:52:29.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.253+0000 7f74b67fc700 1 --2- 172.21.15.73:0/919682275 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f74ac0a11a0 0x7f74ac0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:29.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.253+0000 7f74c5472700 1 --2- 172.21.15.73:0/919682275 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f74ac0a11a0 0x7f74ac0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:29.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.253+0000 7f74b67fc700 1 -- 172.21.15.73:0/919682275 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f74bc014070 con 0x7f74c0100850 2023-08-10T11:52:29.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.254+0000 7f74c5472700 1 --2- 172.21.15.73:0/919682275 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f74ac0a11a0 0x7f74ac0a3660 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f74b0009fd0 tx=0x7f74b0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:29.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.257+0000 7f74b67fc700 1 -- 172.21.15.73:0/919682275 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f74bc096590 con 0x7f74c0100850 2023-08-10T11:52:29.264 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:28 smithi156 ceph-mon[130574]: from='client.15378 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T11:52:29.264 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:28 smithi156 ceph-mon[130574]: from='client.15384 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T11:52:29.264 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:28 smithi156 ceph-mon[130574]: from='client.15390 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T11:52:29.264 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:28 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/2543418958' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:52:29.264 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:28 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/2607913478' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:52:29.265 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:28 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/4090729376' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:52:29.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.488+0000 7f74c76d6700 1 -- 172.21.15.73:0/919682275 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74c01065a0 con 0x7f74c0100850 2023-08-10T11:52:29.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.488+0000 7f74b67fc700 1 -- 172.21.15.73:0/919682275 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10891 (secure 0 0 0) 0x7f74bc094e60 con 0x7f74c0100850 2023-08-10T11:52:29.489 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:52:29.490 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1319360725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1319360725},{"type":"v1","addr":"172.21.15.73:6835","nonce":1319360725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/431221951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":431221951},{"type":"v1","addr":"172.21.15.73:6837","nonce":431221951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-10T11:50:54.304447+0000","modified":"2023-08-10T11:51:01.523452+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24503,"mds_1":24479,"mds_2":24451,"mds_3":24443,"mds_4":24419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6839/1099539481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1099539481},{"type":"v1","addr":"172.21.15.73:6839","nonce":1099539481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6841/3067925859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":3067925859},{"type":"v1","addr":"172.21.15.73:6841","nonce":3067925859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24397":{"gid":24397,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6833/3028461815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3028461815},{"type":"v1","addr":"172.21.15.156:6833","nonce":3028461815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24419":{"gid":24419,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6833/4148407154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4148407154},{"type":"v1","addr":"172.21.15.152:6833","nonce":4148407154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24443":{"gid":24443,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.152:6835/1791572604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1791572604},{"type":"v1","addr":"172.21.15.152:6835","nonce":1791572604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.156:6835/904126790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":904126790},{"type":"v1","addr":"172.21.15.156:6835","nonce":904126790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24457":{"gid":24457,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/4284306352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":4284306352},{"type":"v1","addr":"172.21.15.156:6837","nonce":4284306352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6839/3361058731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":3361058731},{"type":"v1","addr":"172.21.15.156:6839","nonce":3361058731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6837/74214089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":74214089},{"type":"v1","addr":"172.21.15.152:6837","nonce":74214089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6839/3870202690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3870202690},{"type":"v1","addr":"172.21.15.152:6839","nonce":3870202690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T11:52:29.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.490+0000 7f74c76d6700 1 -- 172.21.15.73:0/919682275 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f74ac0a11a0 msgr2=0x7f74ac0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:29.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.490+0000 7f74c76d6700 1 --2- 172.21.15.73:0/919682275 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f74ac0a11a0 0x7f74ac0a3660 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f74b0009fd0 tx=0x7f74b0005fb0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.490+0000 7f74c76d6700 1 -- 172.21.15.73:0/919682275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74c0100850 msgr2=0x7f74c019b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:29.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.490+0000 7f74c76d6700 1 --2- 172.21.15.73:0/919682275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74c0100850 0x7f74c019b170 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f74bc00e9a0 tx=0x7f74bc00ecb0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.491+0000 7f74c76d6700 1 -- 172.21.15.73:0/919682275 shutdown_connections 2023-08-10T11:52:29.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.491+0000 7f74c76d6700 1 --2- 172.21.15.73:0/919682275 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f74ac0a11a0 0x7f74ac0a3660 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.491+0000 7f74c76d6700 1 --2- 172.21.15.73:0/919682275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74c01011f0 0x7f74c019d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.491+0000 7f74c76d6700 1 --2- 172.21.15.73:0/919682275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74c00ff660 0x7f74c0069660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.491+0000 7f74c76d6700 1 --2- 172.21.15.73:0/919682275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74c0100850 0x7f74c019b170 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.491+0000 7f74c76d6700 1 -- 172.21.15.73:0/919682275 >> 172.21.15.73:0/919682275 conn(0x7f74c00fabd0 msgr2=0x7f74c00fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:29.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.491+0000 7f74c76d6700 1 -- 172.21.15.73:0/919682275 shutdown_connections 2023-08-10T11:52:29.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.491+0000 7f74c76d6700 1 -- 172.21.15.73:0/919682275 wait complete. 2023-08-10T11:52:29.494 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 27 2023-08-10T11:52:29.504 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T11:52:29.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.624+0000 7f4b9c763700 1 -- 172.21.15.73:0/1832057990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b94100970 msgr2=0x7f4b94107220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:29.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.624+0000 7f4b9c763700 1 --2- 172.21.15.73:0/1832057990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b94100970 0x7f4b94107220 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c00b1d0 tx=0x7f4b8c00b4e0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.625+0000 7f4b9c763700 1 -- 172.21.15.73:0/1832057990 shutdown_connections 2023-08-10T11:52:29.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.625+0000 7f4b9c763700 1 --2- 172.21.15.73:0/1832057990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b940fede0 0x7f4b940ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.625+0000 7f4b9c763700 1 --2- 172.21.15.73:0/1832057990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b94100970 0x7f4b94107220 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.625+0000 7f4b9c763700 1 --2- 172.21.15.73:0/1832057990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b940fffd0 0x7f4b94100430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.625+0000 7f4b9c763700 1 -- 172.21.15.73:0/1832057990 >> 172.21.15.73:0/1832057990 conn(0x7f4b940fa330 msgr2=0x7f4b940fc790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:29.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.625+0000 7f4b9c763700 1 -- 172.21.15.73:0/1832057990 shutdown_connections 2023-08-10T11:52:29.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.625+0000 7f4b9c763700 1 -- 172.21.15.73:0/1832057990 wait complete. 2023-08-10T11:52:29.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.625+0000 7f4b9c763700 1 Processor -- start 2023-08-10T11:52:29.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.625+0000 7f4b9c763700 1 -- start start 2023-08-10T11:52:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.625+0000 7f4b9c763700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b940fede0 0x7f4b94194130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.625+0000 7f4b9c763700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b940fffd0 0x7f4b94194670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.625+0000 7f4b9c763700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b94100970 0x7f4b9419b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.625+0000 7f4b9c763700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9419bcb0 con 0x7f4b94100970 2023-08-10T11:52:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.625+0000 7f4b9c763700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9419bdf0 con 0x7f4b940fffd0 2023-08-10T11:52:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.625+0000 7f4b9c763700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9419bf80 con 0x7f4b940fede0 2023-08-10T11:52:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.626+0000 7f4b9ad00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b94100970 0x7f4b9419b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.626+0000 7f4b9ad00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b94100970 0x7f4b9419b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60672/0 (socket says 172.21.15.73:60672) 2023-08-10T11:52:29.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.626+0000 7f4b9ad00700 1 -- 172.21.15.73:0/2653131118 learned_addr learned my addr 172.21.15.73:0/2653131118 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:29.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.626+0000 7f4b9a4ff700 1 --2- 172.21.15.73:0/2653131118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b940fede0 0x7f4b94194130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:29.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.626+0000 7f4b9ad00700 1 -- 172.21.15.73:0/2653131118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b940fede0 msgr2=0x7f4b94194130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:29.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.626+0000 7f4b9ad00700 1 --2- 172.21.15.73:0/2653131118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b940fede0 0x7f4b94194130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.626+0000 7f4b99cfe700 1 --2- 172.21.15.73:0/2653131118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b940fffd0 0x7f4b94194670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:29.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.626+0000 7f4b9ad00700 1 -- 172.21.15.73:0/2653131118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b940fffd0 msgr2=0x7f4b94194670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:29.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.626+0000 7f4b9ad00700 1 --2- 172.21.15.73:0/2653131118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b940fffd0 0x7f4b94194670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.626+0000 7f4b9ad00700 1 -- 172.21.15.73:0/2653131118 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8c009d00 con 0x7f4b94100970 2023-08-10T11:52:29.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.626+0000 7f4b9a4ff700 1 --2- 172.21.15.73:0/2653131118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b940fede0 0x7f4b94194130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:52:29.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.626+0000 7f4b9ad00700 1 --2- 172.21.15.73:0/2653131118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b94100970 0x7f4b9419b6e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c009bb0 tx=0x7f4b8c008f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:29.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.626+0000 7f4b8b7fe700 1 -- 172.21.15.73:0/2653131118 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c003e10 con 0x7f4b94100970 2023-08-10T11:52:29.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.626+0000 7f4b8b7fe700 1 -- 172.21.15.73:0/2653131118 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b8c011920 con 0x7f4b94100970 2023-08-10T11:52:29.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.626+0000 7f4b8b7fe700 1 -- 172.21.15.73:0/2653131118 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c005430 con 0x7f4b94100970 2023-08-10T11:52:29.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.626+0000 7f4b9c763700 1 -- 172.21.15.73:0/2653131118 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b9419c200 con 0x7f4b94100970 2023-08-10T11:52:29.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.626+0000 7f4b9c763700 1 -- 172.21.15.73:0/2653131118 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9419c630 con 0x7f4b94100970 2023-08-10T11:52:29.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.627+0000 7f4b9c763700 1 -- 172.21.15.73:0/2653131118 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b94105c20 con 0x7f4b94100970 2023-08-10T11:52:29.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.628+0000 7f4b8b7fe700 1 -- 172.21.15.73:0/2653131118 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f4b8c011460 con 0x7f4b94100970 2023-08-10T11:52:29.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.629+0000 7f4b8b7fe700 1 --2- 172.21.15.73:0/2653131118 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4b800a1220 0x7f4b800a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:29.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.629+0000 7f4b8b7fe700 1 -- 172.21.15.73:0/2653131118 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4b8c0d0390 con 0x7f4b94100970 2023-08-10T11:52:29.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.629+0000 7f4b9a4ff700 1 --2- 172.21.15.73:0/2653131118 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4b800a1220 0x7f4b800a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:29.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.629+0000 7f4b9a4ff700 1 --2- 172.21.15.73:0/2653131118 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4b800a1220 0x7f4b800a36e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4b90005950 tx=0x7f4b900058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:29.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.632+0000 7f4b8b7fe700 1 -- 172.21.15.73:0/2653131118 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f4b8c099b20 con 0x7f4b94100970 2023-08-10T11:52:29.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.826+0000 7f4b9c763700 1 -- 172.21.15.73:0/2653131118 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b9402cb40 con 0x7f4b94100970 2023-08-10T11:52:29.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.827+0000 7f4b8b7fe700 1 -- 172.21.15.73:0/2653131118 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22482 (secure 0 0 0) 0x7f4b8c09d140 con 0x7f4b94100970 2023-08-10T11:52:29.829 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:52:29.829 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":85,"fsid":"0e619a74-3773-11ee-9b37-001a4aab830c","created":"2023-08-10T11:43:53.974768+0000","modified":"2023-08-10T11:51:49.637159+0000","last_up_change":"2023-08-10T11:50:12.914422+0000","last_in_change":"2023-08-10T11:49:54.624543+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T11:46:58.735153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T11:50:52.517974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T11:50:53.465357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3219ae18-cc4c-4712-b616-79f6949066e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6803","nonce":2725694252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6805","nonce":2725694252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6809","nonce":2725694252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6807","nonce":2725694252}]},"public_addr":"172.21.15.73:6803/2725694252","cluster_addr":"172.21.15.73:6805/2725694252","heartbeat_back_addr":"172.21.15.73:6809/2725694252","heartbeat_front_addr":"172.21.15.73:6807/2725694252","state":["exists","up"]},{"osd":1,"uuid":"bbfe6cd9-b3d3-4b8d-8814-507a867f8c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6801","nonce":836829168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6803","nonce":836829168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6807","nonce":836829168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6805","nonce":836829168}]},"public_addr":"172.21.15.152:6801/836829168","cluster_addr":"172.21.15.152:6803/836829168","heartbeat_back_addr":"172.21.15.152:6807/836829168","heartbeat_front_addr":"172.21.15.152:6805/836829168","state":["exists","up"]},{"osd":2,"uuid":"f57f5b2c-3208-45c0-beba-8501694b99c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6801","nonce":1789212298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6803","nonce":1789212298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6807","nonce":1789212298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6805","nonce":1789212298}]},"public_addr":"172.21.15.156:6801/1789212298","cluster_addr":"172.21.15.156:6803/1789212298","heartbeat_back_addr":"172.21.15.156:6807/1789212298","heartbeat_front_addr":"172.21.15.156:6805/1789212298","state":["exists","up"]},{"osd":3,"uuid":"18592408-3696-4ab8-ad41-c172b8409829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6811","nonce":3101572649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6813","nonce":3101572649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6817","nonce":3101572649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6815","nonce":3101572649}]},"public_addr":"172.21.15.73:6811/3101572649","cluster_addr":"172.21.15.73:6813/3101572649","heartbeat_back_addr":"172.21.15.73:6817/3101572649","heartbeat_front_addr":"172.21.15.73:6815/3101572649","state":["exists","up"]},{"osd":4,"uuid":"fb3adb09-8807-42d9-8db9-1867c5fe02da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6809","nonce":1451517889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6811","nonce":1451517889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6815","nonce":1451517889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6813","nonce":1451517889}]},"public_addr":"172.21.15.152:6809/1451517889","cluster_addr":"172.21.15.152:6811/1451517889","heartbeat_back_addr":"172.21.15.152:6815/1451517889","heartbeat_front_addr":"172.21.15.152:6813/1451517889","state":["exists","up"]},{"osd":5,"uuid":"af58a7bd-4e58-4639-95b2-4a76011b61dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6809","nonce":3823368741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6811","nonce":3823368741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6815","nonce":3823368741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6813","nonce":3823368741}]},"public_addr":"172.21.15.156:6809/3823368741","cluster_addr":"172.21.15.156:6811/3823368741","heartbeat_back_addr":"172.21.15.156:6815/3823368741","heartbeat_front_addr":"172.21.15.156:6813/3823368741","state":["exists","up"]},{"osd":6,"uuid":"f6ae502d-4af9-4f6a-8636-b5b683dfdfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6819","nonce":2533620458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6821","nonce":2533620458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6825","nonce":2533620458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6823","nonce":2533620458}]},"public_addr":"172.21.15.73:6819/2533620458","cluster_addr":"172.21.15.73:6821/2533620458","heartbeat_back_addr":"172.21.15.73:6825/2533620458","heartbeat_front_addr":"172.21.15.73:6823/2533620458","state":["exists","up"]},{"osd":7,"uuid":"398fd334-5f6f-427c-95ae-3244fb466f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6817","nonce":4059538477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6819","nonce":4059538477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6823","nonce":4059538477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6821","nonce":4059538477}]},"public_addr":"172.21.15.152:6817/4059538477","cluster_addr":"172.21.15.152:6819/4059538477","heartbeat_back_addr":"172.21.15.152:6823/4059538477","heartbeat_front_addr":"172.21.15.152:6821/4059538477","state":["exists","up"]},{"osd":8,"uuid":"58f46e64-2624-4ad4-bb6a-225624153837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6817","nonce":96487555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6819","nonce":96487555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6823","nonce":96487555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6821","nonce":96487555}]},"public_addr":"172.21.15.156:6817/96487555","cluster_addr":"172.21.15.156:6819/96487555","heartbeat_back_addr":"172.21.15.156:6823/96487555","heartbeat_front_addr":"172.21.15.156:6821/96487555","state":["exists","up"]},{"osd":9,"uuid":"9389dd5b-da2d-43b6-8bc0-bb1af13f72c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6827","nonce":2050124321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6829","nonce":2050124321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6833","nonce":2050124321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6831","nonce":2050124321}]},"public_addr":"172.21.15.73:6827/2050124321","cluster_addr":"172.21.15.73:6829/2050124321","heartbeat_back_addr":"172.21.15.73:6833/2050124321","heartbeat_front_addr":"172.21.15.73:6831/2050124321","state":["exists","up"]},{"osd":10,"uuid":"563c1e34-3acd-46ab-ba36-e9d87f635e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6825","nonce":1513186350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6827","nonce":1513186350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6831","nonce":1513186350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6829","nonce":1513186350}]},"public_addr":"172.21.15.152:6825/1513186350","cluster_addr":"172.21.15.152:6827/1513186350","heartbeat_back_addr":"172.21.15.152:6831/1513186350","heartbeat_front_addr":"172.21.15.152:6829/1513186350","state":["exists","up"]},{"osd":11,"uuid":"f1b55889-14fd-4cc9-bed7-43748086fb77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6825","nonce":737904755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6827","nonce":737904755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6831","nonce":737904755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6829","nonce":737904755}]},"public_addr":"172.21.15.156:6825/737904755","cluster_addr":"172.21.15.156:6827/737904755","heartbeat_back_addr":"172.21.15.156:6831/737904755","heartbeat_front_addr":"172.21.15.156:6829/737904755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:12.023797+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:33.872883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:55.856970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:18.013196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:39.202872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:00.393920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:22.743083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:43.921728+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:05.859488+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:27.618714+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:48.880286+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:50:11.055141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/2202785670":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6800/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:6800/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/1447381524":"2023-08-11T11:44:48.401660+0000","172.21.15.73:0/2545059698":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/4193457623":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2561039569":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2927950081":"2023-08-11T11:44:48.401660+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T11:52:29.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.829+0000 7f4b9c763700 1 -- 172.21.15.73:0/2653131118 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4b800a1220 msgr2=0x7f4b800a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:29.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.829+0000 7f4b9c763700 1 --2- 172.21.15.73:0/2653131118 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4b800a1220 0x7f4b800a36e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4b90005950 tx=0x7f4b900058e0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.829+0000 7f4b9c763700 1 -- 172.21.15.73:0/2653131118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b94100970 msgr2=0x7f4b9419b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:29.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.829+0000 7f4b9c763700 1 --2- 172.21.15.73:0/2653131118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b94100970 0x7f4b9419b6e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c009bb0 tx=0x7f4b8c008f30 comp rx=0 tx=0).stop 2023-08-10T11:52:29.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.829+0000 7f4b9c763700 1 -- 172.21.15.73:0/2653131118 shutdown_connections 2023-08-10T11:52:29.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.829+0000 7f4b9c763700 1 --2- 172.21.15.73:0/2653131118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b94100970 0x7f4b9419b6e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.829+0000 7f4b9c763700 1 --2- 172.21.15.73:0/2653131118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b940fede0 0x7f4b94194130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.829+0000 7f4b9c763700 1 --2- 172.21.15.73:0/2653131118 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f4b800a1220 0x7f4b800a36e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.829+0000 7f4b9c763700 1 --2- 172.21.15.73:0/2653131118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b940fffd0 0x7f4b94194670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.829+0000 7f4b9c763700 1 -- 172.21.15.73:0/2653131118 >> 172.21.15.73:0/2653131118 conn(0x7f4b940fa330 msgr2=0x7f4b940fc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:29.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.829+0000 7f4b9c763700 1 -- 172.21.15.73:0/2653131118 shutdown_connections 2023-08-10T11:52:29.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.829+0000 7f4b9c763700 1 -- 172.21.15.73:0/2653131118 wait complete. 2023-08-10T11:52:29.843 DEBUG:tasks.fwd_scrub:Yielding 2023-08-10T11:52:29.843 INFO:teuthology.run_tasks:Running task exec... 2023-08-10T11:52:29.858 INFO:teuthology.task.exec:Executing custom commands... 2023-08-10T11:52:29.858 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi073.front.sepia.ceph.com 2023-08-10T11:52:29.859 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2023-08-10T11:52:29.859 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-08-10T11:52:29.859 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-08-10T11:52:29.860 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-08-10T11:52:29.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.986+0000 7f44bcf6b700 1 -- 172.21.15.73:0/1055637772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44b81064f0 msgr2=0x7f44b81088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:29.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.986+0000 7f44bcf6b700 1 --2- 172.21.15.73:0/1055637772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44b81064f0 0x7f44b81088e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f44b000b0a0 tx=0x7f44b000b3b0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.986+0000 7f44bcf6b700 1 -- 172.21.15.73:0/1055637772 shutdown_connections 2023-08-10T11:52:29.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.986+0000 7f44bcf6b700 1 --2- 172.21.15.73:0/1055637772 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44b8101290 0x7f44b8103680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.986+0000 7f44bcf6b700 1 --2- 172.21.15.73:0/1055637772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44b81064f0 0x7f44b81088e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.986+0000 7f44bcf6b700 1 --2- 172.21.15.73:0/1055637772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44b8103bc0 0x7f44b8105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.986+0000 7f44bcf6b700 1 -- 172.21.15.73:0/1055637772 >> 172.21.15.73:0/1055637772 conn(0x7f44b80fabc0 msgr2=0x7f44b80fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:29.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.986+0000 7f44bcf6b700 1 -- 172.21.15.73:0/1055637772 shutdown_connections 2023-08-10T11:52:29.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.986+0000 7f44bcf6b700 1 -- 172.21.15.73:0/1055637772 wait complete. 2023-08-10T11:52:29.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.987+0000 7f44bcf6b700 1 Processor -- start 2023-08-10T11:52:29.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.987+0000 7f44bcf6b700 1 -- start start 2023-08-10T11:52:29.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.987+0000 7f44bcf6b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44b8101290 0x7f44b81965f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:29.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.987+0000 7f44bcf6b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44b8103bc0 0x7f44b8196b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:29.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.987+0000 7f44bcf6b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44b81064f0 0x7f44b81979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:29.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.987+0000 7f44bcf6b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b8198010 con 0x7f44b8101290 2023-08-10T11:52:29.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.987+0000 7f44bcf6b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b8198180 con 0x7f44b8103bc0 2023-08-10T11:52:29.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.987+0000 7f44bcf6b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b8198340 con 0x7f44b81064f0 2023-08-10T11:52:29.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.988+0000 7f44b659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44b8101290 0x7f44b81965f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:29.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.988+0000 7f44b659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44b8101290 0x7f44b81965f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60684/0 (socket says 172.21.15.73:60684) 2023-08-10T11:52:29.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.988+0000 7f44b659c700 1 -- 172.21.15.73:0/643759633 learned_addr learned my addr 172.21.15.73:0/643759633 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:29.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.988+0000 7f44b6d9d700 1 --2- 172.21.15.73:0/643759633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44b81064f0 0x7f44b81979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:29.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.988+0000 7f44b5d9b700 1 --2- 172.21.15.73:0/643759633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44b8103bc0 0x7f44b8196b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:29.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.988+0000 7f44b659c700 1 -- 172.21.15.73:0/643759633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44b81064f0 msgr2=0x7f44b81979b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:29.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.988+0000 7f44b659c700 1 --2- 172.21.15.73:0/643759633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44b81064f0 0x7f44b81979b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.988+0000 7f44b659c700 1 -- 172.21.15.73:0/643759633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44b8103bc0 msgr2=0x7f44b8196b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:29.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.988+0000 7f44b659c700 1 --2- 172.21.15.73:0/643759633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44b8103bc0 0x7f44b8196b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.988+0000 7f44b659c700 1 -- 172.21.15.73:0/643759633 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b0009d00 con 0x7f44b8101290 2023-08-10T11:52:29.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.988+0000 7f44b659c700 1 --2- 172.21.15.73:0/643759633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44b8101290 0x7f44b81965f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f44a800d950 tx=0x7f44a800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:29.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.988+0000 7f44a77fe700 1 -- 172.21.15.73:0/643759633 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a800f890 con 0x7f44b8101290 2023-08-10T11:52:29.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.988+0000 7f44a77fe700 1 -- 172.21.15.73:0/643759633 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f44a8010460 con 0x7f44b8101290 2023-08-10T11:52:29.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.988+0000 7f44bcf6b700 1 -- 172.21.15.73:0/643759633 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b8198620 con 0x7f44b8101290 2023-08-10T11:52:29.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.988+0000 7f44a77fe700 1 -- 172.21.15.73:0/643759633 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a800e610 con 0x7f44b8101290 2023-08-10T11:52:29.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.989+0000 7f44bcf6b700 1 -- 172.21.15.73:0/643759633 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b819ede0 con 0x7f44b8101290 2023-08-10T11:52:29.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.989+0000 7f44bcf6b700 1 -- 172.21.15.73:0/643759633 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b804e550 con 0x7f44b8101290 2023-08-10T11:52:29.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.990+0000 7f392f870700 1 -- 172.21.15.73:0/2401984107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39280ff660 msgr2=0x7f39280ffa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:29.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.990+0000 7f392f870700 1 --2- 172.21.15.73:0/2401984107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39280ff660 0x7f39280ffa80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f39240099c0 tx=0x7f3924009cd0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.990+0000 7f392f870700 1 -- 172.21.15.73:0/2401984107 shutdown_connections 2023-08-10T11:52:29.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.990+0000 7f392f870700 1 --2- 172.21.15.73:0/2401984107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39280ff660 0x7f39280ffa80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.990+0000 7f392f870700 1 --2- 172.21.15.73:0/2401984107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39281011f0 0x7f3928107aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.990+0000 7f392f870700 1 --2- 172.21.15.73:0/2401984107 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3928100850 0x7f3928100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:29.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.990+0000 7f392f870700 1 -- 172.21.15.73:0/2401984107 >> 172.21.15.73:0/2401984107 conn(0x7f39280fabd0 msgr2=0x7f39280fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:29.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.990+0000 7f392f870700 1 -- 172.21.15.73:0/2401984107 shutdown_connections 2023-08-10T11:52:29.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.990+0000 7f392f870700 1 -- 172.21.15.73:0/2401984107 wait complete. 2023-08-10T11:52:29.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.990+0000 7f392f870700 1 Processor -- start 2023-08-10T11:52:29.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.990+0000 7f392f870700 1 -- start start 2023-08-10T11:52:29.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.990+0000 7f392f870700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39280ff660 0x7f3928068460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:29.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.990+0000 7f392f870700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3928100850 0x7f392819b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:29.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.991+0000 7f392f870700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39281011f0 0x7f392819d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:29.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.991+0000 7f392f870700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392819dfb0 con 0x7f39281011f0 2023-08-10T11:52:29.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.991+0000 7f392f870700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392819e120 con 0x7f3928100850 2023-08-10T11:52:29.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.991+0000 7f392f870700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392819e2e0 con 0x7f39280ff660 2023-08-10T11:52:30.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.991+0000 7f44a77fe700 1 -- 172.21.15.73:0/643759633 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f44a80108d0 con 0x7f44b8101290 2023-08-10T11:52:30.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.991+0000 7f392de0d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39281011f0 0x7f392819d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.991+0000 7f392de0d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39281011f0 0x7f392819d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60700/0 (socket says 172.21.15.73:60700) 2023-08-10T11:52:30.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.991+0000 7f392de0d700 1 -- 172.21.15.73:0/3266389090 learned_addr learned my addr 172.21.15.73:0/3266389090 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:30.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.991+0000 7f392ce0b700 1 --2- 172.21.15.73:0/3266389090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3928100850 0x7f392819b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.991+0000 7f392d60c700 1 --2- 172.21.15.73:0/3266389090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39280ff660 0x7f3928068460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.991+0000 7f392de0d700 1 -- 172.21.15.73:0/3266389090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39280ff660 msgr2=0x7f3928068460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:30.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.991+0000 7f392de0d700 1 --2- 172.21.15.73:0/3266389090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39280ff660 0x7f3928068460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.991+0000 7f392de0d700 1 -- 172.21.15.73:0/3266389090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3928100850 msgr2=0x7f392819b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:30.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.991+0000 7f392de0d700 1 --2- 172.21.15.73:0/3266389090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3928100850 0x7f392819b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.991+0000 7f392de0d700 1 -- 172.21.15.73:0/3266389090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39240095f0 con 0x7f39281011f0 2023-08-10T11:52:30.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.991+0000 7f392ce0b700 1 --2- 172.21.15.73:0/3266389090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3928100850 0x7f392819b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:52:30.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.991+0000 7f392de0d700 1 --2- 172.21.15.73:0/3266389090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39281011f0 0x7f392819d7e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f392000ef30 tx=0x7f392000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:30.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.991+0000 7f44a77fe700 1 --2- 172.21.15.73:0/643759633 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f44a00a1150 0x7f44a00a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.991+0000 7f44b5d9b700 1 --2- 172.21.15.73:0/643759633 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f44a00a1150 0x7f44a00a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.991+0000 7f44a77fe700 1 -- 172.21.15.73:0/643759633 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f44a80cc6e0 con 0x7f44b8101290 2023-08-10T11:52:30.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.992+0000 7f44b5d9b700 1 --2- 172.21.15.73:0/643759633 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f44a00a1150 0x7f44a00a3610 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f44ac005950 tx=0x7f44ac00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:30.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.995+0000 7f391e7fc700 1 -- 172.21.15.73:0/3266389090 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920018070 con 0x7f39281011f0 2023-08-10T11:52:30.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.995+0000 7f391e7fc700 1 -- 172.21.15.73:0/3266389090 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f392000f040 con 0x7f39281011f0 2023-08-10T11:52:30.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.995+0000 7f392f870700 1 -- 172.21.15.73:0/3266389090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392819e560 con 0x7f39281011f0 2023-08-10T11:52:30.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.995+0000 7f391e7fc700 1 -- 172.21.15.73:0/3266389090 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392000cd00 con 0x7f39281011f0 2023-08-10T11:52:30.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.995+0000 7f44a77fe700 1 -- 172.21.15.73:0/643759633 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f44a8095e40 con 0x7f44b8101290 2023-08-10T11:52:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.996+0000 7f392f870700 1 -- 172.21.15.73:0/3266389090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392819eac0 con 0x7f39281011f0 2023-08-10T11:52:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.999+0000 7f391e7fc700 1 -- 172.21.15.73:0/3266389090 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f3920003a00 con 0x7f39281011f0 2023-08-10T11:52:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:29.999+0000 7f393ba09b80 1 Processor -- start 2023-08-10T11:52:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.000+0000 7f393ba09b80 1 -- start start 2023-08-10T11:52:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.000+0000 7f393ba09b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623f824ca20 0x5623f824ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.000+0000 7f393ba09b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623f824d380 0x5623f824d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.000+0000 7f393ba09b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824de30 0x5623f824e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.000+0000 7f393ba09b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623f81c3e40 con 0x5623f824de30 2023-08-10T11:52:30.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.000+0000 7f393ba09b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623f81a0610 con 0x5623f824d380 2023-08-10T11:52:30.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.000+0000 7f393ba09b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623f819df30 con 0x5623f824ca20 2023-08-10T11:52:30.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.000+0000 7f392ce0b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824de30 0x5623f824e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.000+0000 7f392ce0b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824de30 0x5623f824e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60708/0 (socket says 172.21.15.73:60708) 2023-08-10T11:52:30.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.000+0000 7f392ce0b700 1 -- 172.21.15.73:0/2677408067 learned_addr learned my addr 172.21.15.73:0/2677408067 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:30.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.000+0000 7f392ce0b700 1 --2- 172.21.15.73:0/2677408067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623f824ca20 0x5623f824ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.000+0000 7f392d60c700 1 --2- 172.21.15.73:0/2677408067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623f824d380 0x5623f824d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.000+0000 7f392ce0b700 1 -- 172.21.15.73:0/2677408067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623f824ca20 msgr2=0x5623f824ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:30.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.000+0000 7f392ce0b700 1 --2- 172.21.15.73:0/2677408067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623f824ca20 0x5623f824ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.000+0000 7f392ce0b700 1 -- 172.21.15.73:0/2677408067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623f824d380 msgr2=0x5623f824d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:30.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.000+0000 7f392ce0b700 1 --2- 172.21.15.73:0/2677408067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623f824d380 0x5623f824d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.000+0000 7f392ce0b700 1 -- 172.21.15.73:0/2677408067 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623f801a6b0 con 0x5623f824de30 2023-08-10T11:52:30.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.000+0000 7f391e7fc700 1 --2- 172.21.15.73:0/3266389090 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f39140a11d0 0x7f39140a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.000+0000 7f392ce0b700 1 --2- 172.21.15.73:0/2677408067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824de30 0x5623f824e2b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f39180129f0 tx=0x7f3918007bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce07551dceb0587f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:30.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.000+0000 7f392d60c700 1 --2- 172.21.15.73:0/3266389090 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f39140a11d0 0x7f39140a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.001+0000 7f391e7fc700 1 -- 172.21.15.73:0/3266389090 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f39200cc310 con 0x7f39281011f0 2023-08-10T11:52:30.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.001+0000 7f39137fe700 1 -- 172.21.15.73:0/2677408067 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3918004250 con 0x5623f824de30 2023-08-10T11:52:30.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.001+0000 7f39137fe700 1 -- 172.21.15.73:0/2677408067 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f39180043b0 con 0x5623f824de30 2023-08-10T11:52:30.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.001+0000 7f39137fe700 1 -- 172.21.15.73:0/2677408067 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39180108c0 con 0x5623f824de30 2023-08-10T11:52:30.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.001+0000 7f393ba09b80 1 -- 172.21.15.73:0/2677408067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824de30 msgr2=0x5623f824e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:30.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.001+0000 7f392d60c700 1 --2- 172.21.15.73:0/3266389090 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f39140a11d0 0x7f39140a3690 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3924009fd0 tx=0x7f3924005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:30.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.001+0000 7f393ba09b80 1 --2- 172.21.15.73:0/2677408067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824de30 0x5623f824e2b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f39180129f0 tx=0x7f3918007bf0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.002+0000 7f393ba09b80 1 -- 172.21.15.73:0/2677408067 shutdown_connections 2023-08-10T11:52:30.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.002+0000 7f393ba09b80 1 --2- 172.21.15.73:0/2677408067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824de30 0x5623f824e2b0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.002+0000 7f393ba09b80 1 --2- 172.21.15.73:0/2677408067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623f824ca20 0x5623f824ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.002+0000 7f393ba09b80 1 --2- 172.21.15.73:0/2677408067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623f824d380 0x5623f824d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.002+0000 7f393ba09b80 1 -- 172.21.15.73:0/2677408067 >> 172.21.15.73:0/2677408067 conn(0x5623f81a5d50 msgr2=0x5623f8243350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:30.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.002+0000 7f393ba09b80 1 -- 172.21.15.73:0/2677408067 shutdown_connections 2023-08-10T11:52:30.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.002+0000 7f393ba09b80 1 -- 172.21.15.73:0/2677408067 wait complete. 2023-08-10T11:52:30.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.002+0000 7f393ba09b80 1 -- start start 2023-08-10T11:52:30.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.002+0000 7f393ba09b80 1 Processor -- start 2023-08-10T11:52:30.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.002+0000 7f393ba09b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824ca20 0x5623f82564c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.002+0000 7f393ba09b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623f824d380 0x5623f8256a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.002+0000 7f393ba09b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623f824de30 0x5623f825da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.002+0000 7f393ba09b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623f8199820 con 0x5623f824ca20 2023-08-10T11:52:30.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.002+0000 7f393ba09b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623f8138b40 con 0x5623f824d380 2023-08-10T11:52:30.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.002+0000 7f393ba09b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623f8138840 con 0x5623f824de30 2023-08-10T11:52:30.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.002+0000 7f393ba09b80 10 client.0 _ll_register_callbacks cb 0x5623f8136700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:52:30.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.003+0000 7f392d60c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824ca20 0x5623f82564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.003+0000 7f392d60c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824ca20 0x5623f82564c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60712/0 (socket says 172.21.15.73:60712) 2023-08-10T11:52:30.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.003+0000 7f392d60c700 1 -- 172.21.15.73:0/1721117019 learned_addr learned my addr 172.21.15.73:0/1721117019 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:30.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.003+0000 7f392de0d700 1 --2- 172.21.15.73:0/1721117019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623f824de30 0x5623f825da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.003+0000 7f392ce0b700 1 --2- 172.21.15.73:0/1721117019 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623f824d380 0x5623f8256a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.003+0000 7f392d60c700 1 -- 172.21.15.73:0/1721117019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623f824de30 msgr2=0x5623f825da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:30.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.003+0000 7f392d60c700 1 --2- 172.21.15.73:0/1721117019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623f824de30 0x5623f825da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.003+0000 7f392d60c700 1 -- 172.21.15.73:0/1721117019 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623f824d380 msgr2=0x5623f8256a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:30.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.003+0000 7f392d60c700 1 --2- 172.21.15.73:0/1721117019 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623f824d380 0x5623f8256a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.003+0000 7f392d60c700 1 -- 172.21.15.73:0/1721117019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3918012660 con 0x5623f824ca20 2023-08-10T11:52:30.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.003+0000 7f392d60c700 1 --2- 172.21.15.73:0/1721117019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824ca20 0x5623f82564c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f39281006b0 tx=0x7f3924009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f7d72aa4bf97ed server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:30.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.003+0000 7f3910ff9700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:52:30.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.003+0000 7f3910ff9700 1 -- 172.21.15.73:0/1721117019 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3924005620 con 0x5623f824ca20 2023-08-10T11:52:30.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.003+0000 7f3910ff9700 1 -- 172.21.15.73:0/1721117019 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f392400f460 con 0x5623f824ca20 2023-08-10T11:52:30.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.003+0000 7f393ba09b80 1 -- 172.21.15.73:0/1721117019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5623f823b4f0 con 0x5623f824ca20 2023-08-10T11:52:30.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.003+0000 7f3910ff9700 1 -- 172.21.15.73:0/1721117019 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3924003e80 con 0x5623f824ca20 2023-08-10T11:52:30.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.003+0000 7f393ba09b80 10 client.15444 fetch_fsmap learned FSMap version 27 2023-08-10T11:52:30.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.003+0000 7f393ba09b80 1 -- 172.21.15.73:0/1721117019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5623f7fc6e60 con 0x5623f824ca20 2023-08-10T11:52:30.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.004+0000 7f3910ff9700 1 -- 172.21.15.73:0/1721117019 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5623f823b4f0 con 0x5623f824ca20 2023-08-10T11:52:30.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.004+0000 7f3910ff9700 1 -- 172.21.15.73:0/1721117019 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3924024690 con 0x5623f824ca20 2023-08-10T11:52:30.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.004+0000 7f393ba09b80 10 client.15444 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:52:30.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.004+0000 7f393ba09b80 10 client.15444 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:52:30.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.004+0000 7f393ba09b80 20 client.15444 populate_metadata read hostname 'smithi073' 2023-08-10T11:52:30.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.004+0000 7f393ba09b80 1 --2- 172.21.15.73:0/1721117019 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5623f8262220 0x5623f8264640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.004+0000 7f393ba09b80 4 client.15444 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:52:30.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.004+0000 7f393ba09b80 1 -- 172.21.15.73:0/1721117019 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5623f8217a50 con 0x5623f8262220 2023-08-10T11:52:30.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.004+0000 7f392ce0b700 1 --2- 172.21.15.73:0/1721117019 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5623f8262220 0x5623f8264640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.004+0000 7f3910ff9700 10 client.15444 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:52:30.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.004+0000 7f392ce0b700 1 --2- 172.21.15.73:0/1721117019 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5623f8262220 0x5623f8264640 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b428f47108ef41a7 server_cookie=3961862dfddb1174 in_seq=0 out_seq=0 2023-08-10T11:52:30.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.005+0000 7f3910ff9700 1 -- 172.21.15.73:0/1721117019 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5623f8217a50 con 0x5623f8262220 2023-08-10T11:52:30.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.005+0000 7f3910ff9700 10 client.15444 handle_command_reply: tid=0 2023-08-10T11:52:30.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.005+0000 7f393ba09b80 1 client.15444 shutdown 2023-08-10T11:52:30.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.005+0000 7f393ba09b80 1 -- 172.21.15.73:0/1721117019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824ca20 msgr2=0x5623f82564c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:30.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.005+0000 7f393ba09b80 1 --2- 172.21.15.73:0/1721117019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824ca20 0x5623f82564c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f39281006b0 tx=0x7f3924009310 comp rx=0 tx=0).stop 2023-08-10T11:52:30.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.005+0000 7f393ba09b80 1 -- 172.21.15.73:0/1721117019 shutdown_connections 2023-08-10T11:52:30.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.005+0000 7f393ba09b80 1 --2- 172.21.15.73:0/1721117019 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5623f8262220 0x5623f8264640 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.005+0000 7f393ba09b80 1 --2- 172.21.15.73:0/1721117019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623f824de30 0x5623f825da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.005+0000 7f393ba09b80 1 --2- 172.21.15.73:0/1721117019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824ca20 0x5623f82564c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.005+0000 7f393ba09b80 1 --2- 172.21.15.73:0/1721117019 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623f824d380 0x5623f8256a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.005+0000 7f393ba09b80 1 -- 172.21.15.73:0/1721117019 >> 172.21.15.73:0/1721117019 conn(0x5623f81a5d50 msgr2=0x5623f8242a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:30.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.005+0000 7f3910ff9700 0 client.15444 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:52:30.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.005+0000 7f393ba09b80 1 -- 172.21.15.73:0/1721117019 shutdown_connections 2023-08-10T11:52:30.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.005+0000 7f393ba09b80 1 -- 172.21.15.73:0/1721117019 wait complete. 2023-08-10T11:52:30.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.006+0000 7f393ba09b80 20 client.15444 trim_cache size 0 max 16384 2023-08-10T11:52:30.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.022+0000 7f393ba09b80 1 Processor -- start 2023-08-10T11:52:30.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.022+0000 7f393ba09b80 1 -- start start 2023-08-10T11:52:30.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.022+0000 7f393ba09b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623f824ca20 0x5623f8256270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.022+0000 7f393ba09b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623f824d380 0x5623f825da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.022+0000 7f393ba09b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824de30 0x5623f82567b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.022+0000 7f393ba09b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623f801c9a0 con 0x5623f824de30 2023-08-10T11:52:30.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.022+0000 7f393ba09b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623f824dcb0 con 0x5623f824d380 2023-08-10T11:52:30.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.022+0000 7f393ba09b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623f8255970 con 0x5623f824ca20 2023-08-10T11:52:30.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.023+0000 7f392de0d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824de30 0x5623f82567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.023+0000 7f392de0d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824de30 0x5623f82567b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60724/0 (socket says 172.21.15.73:60724) 2023-08-10T11:52:30.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.023+0000 7f392d60c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623f824ca20 0x5623f8256270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.023+0000 7f392de0d700 1 -- 172.21.15.73:0/880541659 learned_addr learned my addr 172.21.15.73:0/880541659 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:30.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.023+0000 7f392ce0b700 1 --2- 172.21.15.73:0/880541659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623f824d380 0x5623f825da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.023+0000 7f392de0d700 1 -- 172.21.15.73:0/880541659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623f824ca20 msgr2=0x5623f8256270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:30.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.023+0000 7f392de0d700 1 --2- 172.21.15.73:0/880541659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623f824ca20 0x5623f8256270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.023+0000 7f392de0d700 1 -- 172.21.15.73:0/880541659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623f824d380 msgr2=0x5623f825da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:30.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.023+0000 7f392de0d700 1 --2- 172.21.15.73:0/880541659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623f824d380 0x5623f825da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.023+0000 7f392de0d700 1 -- 172.21.15.73:0/880541659 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623f823f720 con 0x5623f824de30 2023-08-10T11:52:30.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.023+0000 7f392d60c700 1 --2- 172.21.15.73:0/880541659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623f824ca20 0x5623f8256270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:52:30.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.023+0000 7f392de0d700 1 --2- 172.21.15.73:0/880541659 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824de30 0x5623f82567b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3920004d70 tx=0x7f3920099300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=765f33956eec2b61 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:30.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.023+0000 7f3913fff700 1 -- 172.21.15.73:0/880541659 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920004ad0 con 0x5623f824de30 2023-08-10T11:52:30.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.023+0000 7f3913fff700 1 -- 172.21.15.73:0/880541659 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f392000ce60 con 0x5623f824de30 2023-08-10T11:52:30.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.023+0000 7f3913fff700 1 -- 172.21.15.73:0/880541659 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920099a20 con 0x5623f824de30 2023-08-10T11:52:30.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.024+0000 7f393ba09b80 1 -- 172.21.15.73:0/880541659 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824de30 msgr2=0x5623f82567b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:30.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.024+0000 7f393ba09b80 1 --2- 172.21.15.73:0/880541659 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824de30 0x5623f82567b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3920004d70 tx=0x7f3920099300 comp rx=0 tx=0).stop 2023-08-10T11:52:30.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.024+0000 7f393ba09b80 1 -- 172.21.15.73:0/880541659 shutdown_connections 2023-08-10T11:52:30.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.024+0000 7f393ba09b80 1 --2- 172.21.15.73:0/880541659 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824de30 0x5623f82567b0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.024+0000 7f393ba09b80 1 --2- 172.21.15.73:0/880541659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623f824ca20 0x5623f8256270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.024+0000 7f393ba09b80 1 --2- 172.21.15.73:0/880541659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623f824d380 0x5623f825da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.024+0000 7f393ba09b80 1 -- 172.21.15.73:0/880541659 >> 172.21.15.73:0/880541659 conn(0x5623f81a5d50 msgr2=0x5623f8250cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:30.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.024+0000 7f393ba09b80 1 -- 172.21.15.73:0/880541659 shutdown_connections 2023-08-10T11:52:30.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.024+0000 7f393ba09b80 1 -- 172.21.15.73:0/880541659 wait complete. 2023-08-10T11:52:30.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.024+0000 7f393ba09b80 1 -- start start 2023-08-10T11:52:30.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.025+0000 7f393ba09b80 1 Processor -- start 2023-08-10T11:52:30.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.025+0000 7f393ba09b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824ca20 0x5623f825a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.025+0000 7f393ba09b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623f824d380 0x5623f825ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.025+0000 7f393ba09b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623f824de30 0x5623f82b5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.025+0000 7f393ba09b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623f825dbb0 con 0x5623f824ca20 2023-08-10T11:52:30.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.025+0000 7f393ba09b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623f825dd20 con 0x5623f824de30 2023-08-10T11:52:30.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.025+0000 7f393ba09b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623f82b6400 con 0x5623f824d380 2023-08-10T11:52:30.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.025+0000 7f393ba09b80 10 client.0 _ll_register_callbacks cb 0x5623f8136700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:52:30.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.025+0000 7f392d60c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824ca20 0x5623f825a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.025+0000 7f392d60c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824ca20 0x5623f825a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60726/0 (socket says 172.21.15.73:60726) 2023-08-10T11:52:30.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.025+0000 7f392d60c700 1 -- 172.21.15.73:0/856396855 learned_addr learned my addr 172.21.15.73:0/856396855 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:30.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.025+0000 7f392de0d700 1 --2- 172.21.15.73:0/856396855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623f824de30 0x5623f82b5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.025+0000 7f392ce0b700 1 --2- 172.21.15.73:0/856396855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623f824d380 0x5623f825ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.025+0000 7f392d60c700 1 -- 172.21.15.73:0/856396855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623f824d380 msgr2=0x5623f825ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:30.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.025+0000 7f392d60c700 1 --2- 172.21.15.73:0/856396855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623f824d380 0x5623f825ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.025+0000 7f392d60c700 1 -- 172.21.15.73:0/856396855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623f824de30 msgr2=0x5623f82b5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:30.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.025+0000 7f392d60c700 1 --2- 172.21.15.73:0/856396855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623f824de30 0x5623f82b5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.025+0000 7f392d60c700 1 -- 172.21.15.73:0/856396855 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5623f7fc6e60 con 0x5623f824ca20 2023-08-10T11:52:30.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.025+0000 7f392ce0b700 1 --2- 172.21.15.73:0/856396855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623f824d380 0x5623f825ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:52:30.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.026+0000 7f392d60c700 1 --2- 172.21.15.73:0/856396855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824ca20 0x5623f825a650 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f39240058e0 tx=0x7f3924024e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab22bf44400ea57 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:30.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.026+0000 7f3910ff9700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:52:30.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.026+0000 7f3910ff9700 1 -- 172.21.15.73:0/856396855 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3924005320 con 0x5623f824ca20 2023-08-10T11:52:30.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.026+0000 7f3910ff9700 1 -- 172.21.15.73:0/856396855 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3924005480 con 0x5623f824ca20 2023-08-10T11:52:30.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.026+0000 7f393ba09b80 1 -- 172.21.15.73:0/856396855 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5623f82557d0 con 0x5623f824ca20 2023-08-10T11:52:30.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.026+0000 7f3910ff9700 1 -- 172.21.15.73:0/856396855 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f392404a030 con 0x5623f824ca20 2023-08-10T11:52:30.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.026+0000 7f393ba09b80 10 client.15450 fetch_fsmap learned FSMap version 27 2023-08-10T11:52:30.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.026+0000 7f393ba09b80 1 -- 172.21.15.73:0/856396855 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f392819eac0 con 0x5623f824ca20 2023-08-10T11:52:30.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.026+0000 7f3910ff9700 1 -- 172.21.15.73:0/856396855 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5623f82557d0 con 0x5623f824ca20 2023-08-10T11:52:30.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.026+0000 7f3910ff9700 1 -- 172.21.15.73:0/856396855 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f392400f460 con 0x5623f824ca20 2023-08-10T11:52:30.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.026+0000 7f393ba09b80 10 client.15450 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:52:30.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.026+0000 7f393ba09b80 10 client.15450 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:52:30.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.026+0000 7f393ba09b80 20 client.15450 populate_metadata read hostname 'smithi073' 2023-08-10T11:52:30.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.026+0000 7f393ba09b80 1 --2- 172.21.15.73:0/856396855 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5623f82b79f0 0x5623f82b9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.026+0000 7f393ba09b80 4 client.15450 mds_command: new command op to 24503 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-08-10T11:52:30.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.026+0000 7f393ba09b80 1 -- 172.21.15.73:0/856396855 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x7f39180043b0 con 0x5623f82b79f0 2023-08-10T11:52:30.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.027+0000 7f392ce0b700 1 --2- 172.21.15.73:0/856396855 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5623f82b79f0 0x5623f82b9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.027+0000 7f3910ff9700 10 client.15450 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:52:30.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.027+0000 7f392ce0b700 1 --2- 172.21.15.73:0/856396855 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5623f82b79f0 0x5623f82b9de0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5b38bbd466eab9 server_cookie=20c6cd63b491ee2e in_seq=0 out_seq=0 2023-08-10T11:52:30.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.028+0000 7f3910ff9700 1 -- 172.21.15.73:0/856396855 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x7f39180043b0 con 0x5623f82b79f0 2023-08-10T11:52:30.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.028+0000 7f3910ff9700 10 client.15450 handle_command_reply: tid=0 2023-08-10T11:52:30.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.028+0000 7f393ba09b80 1 client.15450 shutdown 2023-08-10T11:52:30.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.028+0000 7f393ba09b80 1 -- 172.21.15.73:0/856396855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824ca20 msgr2=0x5623f825a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:30.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.028+0000 7f393ba09b80 1 --2- 172.21.15.73:0/856396855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824ca20 0x5623f825a650 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f39240058e0 tx=0x7f3924024e40 comp rx=0 tx=0).stop 2023-08-10T11:52:30.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.028+0000 7f393ba09b80 1 -- 172.21.15.73:0/856396855 shutdown_connections 2023-08-10T11:52:30.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.028+0000 7f393ba09b80 1 --2- 172.21.15.73:0/856396855 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5623f82b79f0 0x5623f82b9de0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.028+0000 7f393ba09b80 1 --2- 172.21.15.73:0/856396855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5623f824de30 0x5623f82b5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.028+0000 7f393ba09b80 1 --2- 172.21.15.73:0/856396855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5623f824ca20 0x5623f825a650 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.028+0000 7f393ba09b80 1 --2- 172.21.15.73:0/856396855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623f824d380 0x5623f825ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.028+0000 7f393ba09b80 1 -- 172.21.15.73:0/856396855 >> 172.21.15.73:0/856396855 conn(0x5623f81a5d50 msgr2=0x5623f8256270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.028+0000 7f3910ff9700 0 client.15450 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:52:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.028+0000 7f393ba09b80 1 -- 172.21.15.73:0/856396855 shutdown_connections 2023-08-10T11:52:30.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.028+0000 7f393ba09b80 1 -- 172.21.15.73:0/856396855 wait complete. 2023-08-10T11:52:30.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.029+0000 7f393ba09b80 20 client.15450 trim_cache size 0 max 16384 2023-08-10T11:52:30.047 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:52:30.047 INFO:teuthology.orchestra.run.smithi073.stdout: "return_code": 0, 2023-08-10T11:52:30.048 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_tag": "e0cc7f67-f4bd-4749-956a-f7b7c5b97293", 2023-08-10T11:52:30.048 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": "asynchronous" 2023-08-10T11:52:30.048 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:52:30.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.029+0000 7f392f870700 1 -- 172.21.15.73:0/3266389090 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f39140a11d0 msgr2=0x7f39140a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:30.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.029+0000 7f392f870700 1 --2- 172.21.15.73:0/3266389090 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f39140a11d0 0x7f39140a3690 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3924009fd0 tx=0x7f3924005fb0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.029+0000 7f392f870700 1 -- 172.21.15.73:0/3266389090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39281011f0 msgr2=0x7f392819d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:30.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.029+0000 7f392f870700 1 --2- 172.21.15.73:0/3266389090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39281011f0 0x7f392819d7e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f392000ef30 tx=0x7f392000c3a0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.029+0000 7f392f870700 1 -- 172.21.15.73:0/3266389090 shutdown_connections 2023-08-10T11:52:30.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.029+0000 7f392f870700 1 --2- 172.21.15.73:0/3266389090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39281011f0 0x7f392819d7e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.029+0000 7f392f870700 1 --2- 172.21.15.73:0/3266389090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39280ff660 0x7f3928068460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.029+0000 7f392f870700 1 --2- 172.21.15.73:0/3266389090 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f39140a11d0 0x7f39140a3690 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.029+0000 7f392f870700 1 --2- 172.21.15.73:0/3266389090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3928100850 0x7f392819b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.029+0000 7f392f870700 1 -- 172.21.15.73:0/3266389090 >> 172.21.15.73:0/3266389090 conn(0x7f39280fabd0 msgr2=0x7f39280fceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:30.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.029+0000 7f392f870700 1 -- 172.21.15.73:0/3266389090 shutdown_connections 2023-08-10T11:52:30.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.029+0000 7f392f870700 1 -- 172.21.15.73:0/3266389090 wait complete. 2023-08-10T11:52:30.051 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:52:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.175+0000 7f3a5f12c700 1 -- 172.21.15.73:0/954197173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a580fea30 msgr2=0x7f3a580fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.175+0000 7f3a5f12c700 1 --2- 172.21.15.73:0/954197173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a580fea30 0x7f3a580fee50 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c009990 tx=0x7f3a4c009ca0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.175+0000 7f3a5f12c700 1 -- 172.21.15.73:0/954197173 shutdown_connections 2023-08-10T11:52:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.175+0000 7f3a5f12c700 1 --2- 172.21.15.73:0/954197173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a58102440 0x7f3a58108cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.175+0000 7f3a5f12c700 1 --2- 172.21.15.73:0/954197173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a580fea30 0x7f3a580fee50 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.175+0000 7f3a5f12c700 1 --2- 172.21.15.73:0/954197173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a58101aa0 0x7f3a58101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.175+0000 7f3a5f12c700 1 -- 172.21.15.73:0/954197173 >> 172.21.15.73:0/954197173 conn(0x7f3a580fa340 msgr2=0x7f3a580fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.175+0000 7f3a5f12c700 1 -- 172.21.15.73:0/954197173 shutdown_connections 2023-08-10T11:52:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.175+0000 7f3a5f12c700 1 -- 172.21.15.73:0/954197173 wait complete. 2023-08-10T11:52:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.176+0000 7f3a5f12c700 1 Processor -- start 2023-08-10T11:52:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.176+0000 7f3a5f12c700 1 -- start start 2023-08-10T11:52:30.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.176+0000 7f3a5f12c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a580fea30 0x7f3a58196490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.177+0000 7f3a5f12c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a58101aa0 0x7f3a581969d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.177+0000 7f3a5f12c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a58102440 0x7f3a5819da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.177+0000 7f3a5f12c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5819e010 con 0x7f3a58102440 2023-08-10T11:52:30.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.177+0000 7f3a5f12c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5819e150 con 0x7f3a58101aa0 2023-08-10T11:52:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.177+0000 7f3a5f12c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5819e2e0 con 0x7f3a580fea30 2023-08-10T11:52:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.177+0000 7f3a5d6c9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a58102440 0x7f3a5819da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.177+0000 7f3a5cec8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a580fea30 0x7f3a58196490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.177+0000 7f3a5d6c9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a58102440 0x7f3a5819da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60744/0 (socket says 172.21.15.73:60744) 2023-08-10T11:52:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.177+0000 7f3a5d6c9700 1 -- 172.21.15.73:0/113854444 learned_addr learned my addr 172.21.15.73:0/113854444 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.177+0000 7f3a57fff700 1 --2- 172.21.15.73:0/113854444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a58101aa0 0x7f3a581969d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.177+0000 7f3a5d6c9700 1 -- 172.21.15.73:0/113854444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a580fea30 msgr2=0x7f3a58196490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:30.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.177+0000 7f3a5d6c9700 1 --2- 172.21.15.73:0/113854444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a580fea30 0x7f3a58196490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.177+0000 7f3a5d6c9700 1 -- 172.21.15.73:0/113854444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a58101aa0 msgr2=0x7f3a581969d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:30.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.177+0000 7f3a5d6c9700 1 --2- 172.21.15.73:0/113854444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a58101aa0 0x7f3a581969d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.177+0000 7f3a5d6c9700 1 -- 172.21.15.73:0/113854444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c0095f0 con 0x7f3a58102440 2023-08-10T11:52:30.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.177+0000 7f3a5d6c9700 1 --2- 172.21.15.73:0/113854444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a58102440 0x7f3a5819da40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3a50007ee0 tx=0x7f3a5000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:30.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.177+0000 7f3a55ffb700 1 -- 172.21.15.73:0/113854444 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5000dd20 con 0x7f3a58102440 2023-08-10T11:52:30.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.177+0000 7f3a55ffb700 1 -- 172.21.15.73:0/113854444 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a5000f040 con 0x7f3a58102440 2023-08-10T11:52:30.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.177+0000 7f3a5f12c700 1 -- 172.21.15.73:0/113854444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5819e5c0 con 0x7f3a58102440 2023-08-10T11:52:30.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.177+0000 7f3a55ffb700 1 -- 172.21.15.73:0/113854444 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a500048a0 con 0x7f3a58102440 2023-08-10T11:52:30.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.178+0000 7f3a5f12c700 1 -- 172.21.15.73:0/113854444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a5819ea80 con 0x7f3a58102440 2023-08-10T11:52:30.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.179+0000 7f3a55ffb700 1 -- 172.21.15.73:0/113854444 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f3a50003a00 con 0x7f3a58102440 2023-08-10T11:52:30.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.180+0000 7f3a55ffb700 1 --2- 172.21.15.73:0/113854444 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3a480a1150 0x7f3a480a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.180+0000 7f3a55ffb700 1 -- 172.21.15.73:0/113854444 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3a500cc160 con 0x7f3a58102440 2023-08-10T11:52:30.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.180+0000 7f3a5cec8700 1 --2- 172.21.15.73:0/113854444 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3a480a1150 0x7f3a480a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.180+0000 7f3a5cec8700 1 --2- 172.21.15.73:0/113854444 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3a480a1150 0x7f3a480a3610 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c00b5c0 tx=0x7f3a4c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:30.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.182+0000 7f3a6b2c5b80 1 Processor -- start 2023-08-10T11:52:30.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.183+0000 7f3a6b2c5b80 1 -- start start 2023-08-10T11:52:30.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.183+0000 7f3a6b2c5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613513bd540 0x5613513bd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.183+0000 7f3a6b2c5b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613513bdea0 0x5613513be3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.183+0000 7f3a6b2c5b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513be960 0x5613513bedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.183+0000 7f3a6b2c5b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561351338dc0 con 0x5613513be960 2023-08-10T11:52:30.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.183+0000 7f3a6b2c5b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561351315590 con 0x5613513bdea0 2023-08-10T11:52:30.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.183+0000 7f3a6b2c5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561351312eb0 con 0x5613513bd540 2023-08-10T11:52:30.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.183+0000 7f3a5d6c9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513be960 0x5613513bedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.183+0000 7f3a5d6c9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513be960 0x5613513bedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60752/0 (socket says 172.21.15.73:60752) 2023-08-10T11:52:30.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.183+0000 7f3a5d6c9700 1 -- 172.21.15.73:0/1336503169 learned_addr learned my addr 172.21.15.73:0/1336503169 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:30.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.183+0000 7f3a5cec8700 1 --2- 172.21.15.73:0/1336503169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613513bd540 0x5613513bd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.183+0000 7f3a57fff700 1 --2- 172.21.15.73:0/1336503169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613513bdea0 0x5613513be3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.183+0000 7f3a5d6c9700 1 -- 172.21.15.73:0/1336503169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613513bd540 msgr2=0x5613513bd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:30.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.183+0000 7f3a5d6c9700 1 --2- 172.21.15.73:0/1336503169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613513bd540 0x5613513bd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.183+0000 7f3a5d6c9700 1 -- 172.21.15.73:0/1336503169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613513bdea0 msgr2=0x5613513be3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:30.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.183+0000 7f3a5d6c9700 1 --2- 172.21.15.73:0/1336503169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613513bdea0 0x5613513be3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.183+0000 7f3a5d6c9700 1 -- 172.21.15.73:0/1336503169 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56135118f630 con 0x5613513be960 2023-08-10T11:52:30.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.183+0000 7f3a5d6c9700 1 --2- 172.21.15.73:0/1336503169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513be960 0x5613513bedf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3a500a14a0 tx=0x7f3a500990c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2da79321f5674b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:30.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.184+0000 7f3a42ffd700 1 -- 172.21.15.73:0/1336503169 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a500cb030 con 0x5613513be960 2023-08-10T11:52:30.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.184+0000 7f3a42ffd700 1 -- 172.21.15.73:0/1336503169 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a500b9070 con 0x5613513be960 2023-08-10T11:52:30.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.184+0000 7f3a42ffd700 1 -- 172.21.15.73:0/1336503169 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a50095c90 con 0x5613513be960 2023-08-10T11:52:30.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.184+0000 7f3a6b2c5b80 1 -- 172.21.15.73:0/1336503169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513be960 msgr2=0x5613513bedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:30.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.184+0000 7f3a6b2c5b80 1 --2- 172.21.15.73:0/1336503169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513be960 0x5613513bedf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3a500a14a0 tx=0x7f3a500990c0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.184+0000 7f3a6b2c5b80 1 -- 172.21.15.73:0/1336503169 shutdown_connections 2023-08-10T11:52:30.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.184+0000 7f3a6b2c5b80 1 --2- 172.21.15.73:0/1336503169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513be960 0x5613513bedf0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.184+0000 7f3a6b2c5b80 1 --2- 172.21.15.73:0/1336503169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613513bd540 0x5613513bd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.184+0000 7f3a6b2c5b80 1 --2- 172.21.15.73:0/1336503169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613513bdea0 0x5613513be3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.184+0000 7f3a6b2c5b80 1 -- 172.21.15.73:0/1336503169 >> 172.21.15.73:0/1336503169 conn(0x56135131acd0 msgr2=0x5613513b82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:30.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.184+0000 7f3a6b2c5b80 1 -- 172.21.15.73:0/1336503169 shutdown_connections 2023-08-10T11:52:30.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.184+0000 7f3a6b2c5b80 1 -- 172.21.15.73:0/1336503169 wait complete. 2023-08-10T11:52:30.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.185+0000 7f3a6b2c5b80 1 -- start start 2023-08-10T11:52:30.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.185+0000 7f3a6b2c5b80 1 Processor -- start 2023-08-10T11:52:30.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.185+0000 7f3a6b2c5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613513bd540 0x5613513c7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.185+0000 7f3a6b2c5b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513bdea0 0x5613513c7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.185+0000 7f3a6b2c5b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613513be960 0x5613513ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.185+0000 7f3a6b2c5b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56135130e7a0 con 0x5613513bdea0 2023-08-10T11:52:30.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.185+0000 7f3a6b2c5b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613512adac0 con 0x5613513be960 2023-08-10T11:52:30.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.185+0000 7f3a6b2c5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613512ad7c0 con 0x5613513bd540 2023-08-10T11:52:30.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.185+0000 7f3a6b2c5b80 10 client.0 _ll_register_callbacks cb 0x5613512ab680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:52:30.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.185+0000 7f3a57fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513bdea0 0x5613513c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.185+0000 7f3a57fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513bdea0 0x5613513c7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60756/0 (socket says 172.21.15.73:60756) 2023-08-10T11:52:30.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.185+0000 7f3a57fff700 1 -- 172.21.15.73:0/1774852390 learned_addr learned my addr 172.21.15.73:0/1774852390 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:30.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.185+0000 7f3a5cec8700 1 --2- 172.21.15.73:0/1774852390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613513bd540 0x5613513c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.185+0000 7f3a5d6c9700 1 --2- 172.21.15.73:0/1774852390 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613513be960 0x5613513ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.185+0000 7f3a57fff700 1 -- 172.21.15.73:0/1774852390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613513bd540 msgr2=0x5613513c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:30.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.185+0000 7f3a57fff700 1 --2- 172.21.15.73:0/1774852390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613513bd540 0x5613513c7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.185+0000 7f3a57fff700 1 -- 172.21.15.73:0/1774852390 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613513be960 msgr2=0x5613513ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:30.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.185+0000 7f3a57fff700 1 --2- 172.21.15.73:0/1774852390 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613513be960 0x5613513ce5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.185+0000 7f3a57fff700 1 -- 172.21.15.73:0/1774852390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a5819ea80 con 0x5613513bdea0 2023-08-10T11:52:30.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.185+0000 7f3a5cec8700 1 --2- 172.21.15.73:0/1774852390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613513bd540 0x5613513c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:52:30.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.186+0000 7f3a57fff700 1 --2- 172.21.15.73:0/1774852390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513bdea0 0x5613513c7580 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3a440046e0 tx=0x7f3a4400bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c5b7d6963baba1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:30.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.186+0000 7f3a37fff700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:52:30.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.186+0000 7f3a37fff700 1 -- 172.21.15.73:0/1774852390 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44016070 con 0x5613513bdea0 2023-08-10T11:52:30.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.186+0000 7f3a37fff700 1 -- 172.21.15.73:0/1774852390 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3a44003d00 con 0x5613513bdea0 2023-08-10T11:52:30.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.186+0000 7f3a6b2c5b80 1 -- 172.21.15.73:0/1774852390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5613513b0470 con 0x5613513bdea0 2023-08-10T11:52:30.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.186+0000 7f3a37fff700 1 -- 172.21.15.73:0/1774852390 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a44021030 con 0x5613513bdea0 2023-08-10T11:52:30.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.186+0000 7f3a6b2c5b80 10 client.15462 fetch_fsmap learned FSMap version 27 2023-08-10T11:52:30.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.186+0000 7f3a6b2c5b80 1 -- 172.21.15.73:0/1774852390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56135113bde0 con 0x5613513bdea0 2023-08-10T11:52:30.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.186+0000 7f3a37fff700 1 -- 172.21.15.73:0/1774852390 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5613513b0470 con 0x5613513bdea0 2023-08-10T11:52:30.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.186+0000 7f3a37fff700 1 -- 172.21.15.73:0/1774852390 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3a440114d0 con 0x5613513bdea0 2023-08-10T11:52:30.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.186+0000 7f3a6b2c5b80 10 client.15462 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:52:30.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.186+0000 7f3a6b2c5b80 10 client.15462 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:52:30.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.186+0000 7f3a6b2c5b80 20 client.15462 populate_metadata read hostname 'smithi073' 2023-08-10T11:52:30.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.186+0000 7f3a6b2c5b80 1 --2- 172.21.15.73:0/1774852390 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5613513d2e80 0x5613513d52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.186+0000 7f3a6b2c5b80 4 client.15462 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:52:30.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.186+0000 7f3a6b2c5b80 1 -- 172.21.15.73:0/1774852390 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56135138c9d0 con 0x5613513d2e80 2023-08-10T11:52:30.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.187+0000 7f3a5cec8700 1 --2- 172.21.15.73:0/1774852390 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5613513d2e80 0x5613513d52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.187+0000 7f3a5cec8700 1 --2- 172.21.15.73:0/1774852390 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5613513d2e80 0x5613513d52a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6616ff3647401892 server_cookie=b61f42b3242da8be in_seq=0 out_seq=0 2023-08-10T11:52:30.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.187+0000 7f3a37fff700 10 client.15462 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:52:30.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.188+0000 7f3a37fff700 1 -- 172.21.15.73:0/1774852390 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x56135138c9d0 con 0x5613513d2e80 2023-08-10T11:52:30.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.188+0000 7f3a37fff700 10 client.15462 handle_command_reply: tid=0 2023-08-10T11:52:30.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.188+0000 7f3a6b2c5b80 1 client.15462 shutdown 2023-08-10T11:52:30.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.188+0000 7f3a6b2c5b80 1 -- 172.21.15.73:0/1774852390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513bdea0 msgr2=0x5613513c7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:30.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.188+0000 7f3a6b2c5b80 1 --2- 172.21.15.73:0/1774852390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513bdea0 0x5613513c7580 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3a440046e0 tx=0x7f3a4400bca0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.188+0000 7f3a6b2c5b80 1 -- 172.21.15.73:0/1774852390 shutdown_connections 2023-08-10T11:52:30.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.188+0000 7f3a6b2c5b80 1 --2- 172.21.15.73:0/1774852390 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5613513d2e80 0x5613513d52a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.188+0000 7f3a6b2c5b80 1 --2- 172.21.15.73:0/1774852390 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613513be960 0x5613513ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.188+0000 7f3a37fff700 0 client.15462 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:52:30.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.188+0000 7f3a6b2c5b80 1 --2- 172.21.15.73:0/1774852390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613513bd540 0x5613513c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.188+0000 7f3a6b2c5b80 1 --2- 172.21.15.73:0/1774852390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513bdea0 0x5613513c7580 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.188+0000 7f3a6b2c5b80 1 -- 172.21.15.73:0/1774852390 >> 172.21.15.73:0/1774852390 conn(0x56135131acd0 msgr2=0x5613513b79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:30.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.188+0000 7f3a6b2c5b80 1 -- 172.21.15.73:0/1774852390 shutdown_connections 2023-08-10T11:52:30.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.188+0000 7f3a6b2c5b80 1 -- 172.21.15.73:0/1774852390 wait complete. 2023-08-10T11:52:30.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.188+0000 7f3a6b2c5b80 20 client.15462 trim_cache size 0 max 16384 2023-08-10T11:52:30.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.205+0000 7f3a6b2c5b80 1 Processor -- start 2023-08-10T11:52:30.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.205+0000 7f3a6b2c5b80 1 -- start start 2023-08-10T11:52:30.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.205+0000 7f3a6b2c5b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613513bd540 0x5613513c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.205+0000 7f3a6b2c5b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513bdea0 0x5613513ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.205+0000 7f3a6b2c5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613513be960 0x5613513c7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.205+0000 7f3a6b2c5b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561351191920 con 0x5613513bdea0 2023-08-10T11:52:30.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.205+0000 7f3a6b2c5b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613513c6330 con 0x5613513bd540 2023-08-10T11:52:30.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.205+0000 7f3a6b2c5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613513c6be0 con 0x5613513be960 2023-08-10T11:52:30.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.205+0000 7f3a57fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513bdea0 0x5613513ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.205+0000 7f3a57fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513bdea0 0x5613513ce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60764/0 (socket says 172.21.15.73:60764) 2023-08-10T11:52:30.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.205+0000 7f3a57fff700 1 -- 172.21.15.73:0/659306656 learned_addr learned my addr 172.21.15.73:0/659306656 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:30.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.205+0000 7f3a5cec8700 1 --2- 172.21.15.73:0/659306656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613513bd540 0x5613513c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.205+0000 7f3a5d6c9700 1 --2- 172.21.15.73:0/659306656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613513be960 0x5613513c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.205+0000 7f3a57fff700 1 -- 172.21.15.73:0/659306656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613513be960 msgr2=0x5613513c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:30.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.205+0000 7f3a57fff700 1 --2- 172.21.15.73:0/659306656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613513be960 0x5613513c7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.205+0000 7f3a57fff700 1 -- 172.21.15.73:0/659306656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613513bd540 msgr2=0x5613513c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:30.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.205+0000 7f3a57fff700 1 --2- 172.21.15.73:0/659306656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613513bd540 0x5613513c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.205+0000 7f3a57fff700 1 -- 172.21.15.73:0/659306656 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561351124c60 con 0x5613513bdea0 2023-08-10T11:52:30.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.206+0000 7f3a57fff700 1 --2- 172.21.15.73:0/659306656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513bdea0 0x5613513ce580 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3a44010020 tx=0x7f3a440039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34bcfcfb74168c98 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:30.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.206+0000 7f3a437fe700 1 -- 172.21.15.73:0/659306656 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44016070 con 0x5613513bdea0 2023-08-10T11:52:30.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.206+0000 7f3a437fe700 1 -- 172.21.15.73:0/659306656 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a44017040 con 0x5613513bdea0 2023-08-10T11:52:30.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.206+0000 7f3a437fe700 1 -- 172.21.15.73:0/659306656 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44021040 con 0x5613513bdea0 2023-08-10T11:52:30.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.206+0000 7f3a6b2c5b80 1 -- 172.21.15.73:0/659306656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513bdea0 msgr2=0x5613513ce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:30.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.206+0000 7f3a6b2c5b80 1 --2- 172.21.15.73:0/659306656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513bdea0 0x5613513ce580 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3a44010020 tx=0x7f3a440039e0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.206+0000 7f3a6b2c5b80 1 -- 172.21.15.73:0/659306656 shutdown_connections 2023-08-10T11:52:30.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.206+0000 7f3a6b2c5b80 1 --2- 172.21.15.73:0/659306656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613513bd540 0x5613513c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.206+0000 7f3a6b2c5b80 1 --2- 172.21.15.73:0/659306656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613513be960 0x5613513c7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.206+0000 7f3a6b2c5b80 1 --2- 172.21.15.73:0/659306656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513bdea0 0x5613513ce580 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.206+0000 7f3a6b2c5b80 1 -- 172.21.15.73:0/659306656 >> 172.21.15.73:0/659306656 conn(0x56135131acd0 msgr2=0x5613513c18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:30.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.206+0000 7f3a6b2c5b80 1 -- 172.21.15.73:0/659306656 shutdown_connections 2023-08-10T11:52:30.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.206+0000 7f3a6b2c5b80 1 -- 172.21.15.73:0/659306656 wait complete. 2023-08-10T11:52:30.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.207+0000 7f3a6b2c5b80 1 -- start start 2023-08-10T11:52:30.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.207+0000 7f3a6b2c5b80 1 Processor -- start 2023-08-10T11:52:30.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.207+0000 7f3a6b2c5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613513bd540 0x5613513ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.207+0000 7f3a6b2c5b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513bdea0 0x5613513cad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.207+0000 7f3a6b2c5b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613513be960 0x5613513cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.207+0000 7f3a6b2c5b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613513cb810 con 0x5613513bdea0 2023-08-10T11:52:30.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.207+0000 7f3a6b2c5b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613513cb950 con 0x5613513be960 2023-08-10T11:52:30.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.207+0000 7f3a6b2c5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561351426b20 con 0x5613513bd540 2023-08-10T11:52:30.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.207+0000 7f3a6b2c5b80 10 client.0 _ll_register_callbacks cb 0x5613512ab680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:52:30.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.207+0000 7f3a57fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513bdea0 0x5613513cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.207+0000 7f3a57fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513bdea0 0x5613513cad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60770/0 (socket says 172.21.15.73:60770) 2023-08-10T11:52:30.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.207+0000 7f3a57fff700 1 -- 172.21.15.73:0/3074685564 learned_addr learned my addr 172.21.15.73:0/3074685564 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:30.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.207+0000 7f3a5d6c9700 1 --2- 172.21.15.73:0/3074685564 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613513be960 0x5613513cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.208+0000 7f3a5cec8700 1 --2- 172.21.15.73:0/3074685564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613513bd540 0x5613513ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.208+0000 7f3a57fff700 1 -- 172.21.15.73:0/3074685564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613513bd540 msgr2=0x5613513ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:30.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.208+0000 7f3a57fff700 1 --2- 172.21.15.73:0/3074685564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613513bd540 0x5613513ce2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.208+0000 7f3a57fff700 1 -- 172.21.15.73:0/3074685564 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613513be960 msgr2=0x5613513cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:30.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.208+0000 7f3a57fff700 1 --2- 172.21.15.73:0/3074685564 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613513be960 0x5613513cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.208+0000 7f3a57fff700 1 -- 172.21.15.73:0/3074685564 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56135113bde0 con 0x5613513bdea0 2023-08-10T11:52:30.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.208+0000 7f3a5cec8700 1 --2- 172.21.15.73:0/3074685564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613513bd540 0x5613513ce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:52:30.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.208+0000 7f3a57fff700 1 --2- 172.21.15.73:0/3074685564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513bdea0 0x5613513cad50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3a44030040 tx=0x7f3a44011770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd13bb33c0838ec3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:30.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.208+0000 7f3a37fff700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:52:30.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.208+0000 7f3a37fff700 1 -- 172.21.15.73:0/3074685564 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44016030 con 0x5613513bdea0 2023-08-10T11:52:30.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.208+0000 7f3a6b2c5b80 1 -- 172.21.15.73:0/3074685564 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3a500b9070 con 0x5613513bdea0 2023-08-10T11:52:30.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.208+0000 7f3a37fff700 1 -- 172.21.15.73:0/3074685564 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3a4402a070 con 0x5613513bdea0 2023-08-10T11:52:30.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.208+0000 7f3a37fff700 1 -- 172.21.15.73:0/3074685564 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a4401b880 con 0x5613513bdea0 2023-08-10T11:52:30.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.208+0000 7f3a6b2c5b80 10 client.15468 fetch_fsmap learned FSMap version 27 2023-08-10T11:52:30.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.208+0000 7f3a6b2c5b80 1 -- 172.21.15.73:0/3074685564 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561351162250 con 0x5613513bdea0 2023-08-10T11:52:30.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.208+0000 7f3a37fff700 1 -- 172.21.15.73:0/3074685564 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a500b9070 con 0x5613513bdea0 2023-08-10T11:52:30.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.208+0000 7f3a37fff700 1 -- 172.21.15.73:0/3074685564 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3a4402eb10 con 0x5613513bdea0 2023-08-10T11:52:30.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.208+0000 7f3a6b2c5b80 10 client.15468 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:52:30.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.208+0000 7f3a6b2c5b80 10 client.15468 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:52:30.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.208+0000 7f3a6b2c5b80 20 client.15468 populate_metadata read hostname 'smithi073' 2023-08-10T11:52:30.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.208+0000 7f3a6b2c5b80 1 --2- 172.21.15.73:0/3074685564 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5613514280f0 0x56135142a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:30.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.208+0000 7f3a6b2c5b80 4 client.15468 mds_command: new command op to 24503 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:52:30.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.208+0000 7f3a6b2c5b80 1 -- 172.21.15.73:0/3074685564 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561351307780 con 0x5613514280f0 2023-08-10T11:52:30.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.209+0000 7f3a5cec8700 1 --2- 172.21.15.73:0/3074685564 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5613514280f0 0x56135142a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:30.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.209+0000 7f3a5cec8700 1 --2- 172.21.15.73:0/3074685564 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5613514280f0 0x56135142a510 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96fb008695d560ca server_cookie=7bc049c5ab576c6b in_seq=0 out_seq=0 2023-08-10T11:52:30.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.209+0000 7f3a37fff700 10 client.15468 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:52:30.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.209+0000 7f3a37fff700 1 -- 172.21.15.73:0/3074685564 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x561351307780 con 0x5613514280f0 2023-08-10T11:52:30.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.209+0000 7f3a37fff700 10 client.15468 handle_command_reply: tid=0 2023-08-10T11:52:30.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.209+0000 7f3a6b2c5b80 1 client.15468 shutdown 2023-08-10T11:52:30.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.209+0000 7f3a6b2c5b80 1 -- 172.21.15.73:0/3074685564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513bdea0 msgr2=0x5613513cad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:30.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.209+0000 7f3a6b2c5b80 1 --2- 172.21.15.73:0/3074685564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513bdea0 0x5613513cad50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3a44030040 tx=0x7f3a44011770 comp rx=0 tx=0).stop 2023-08-10T11:52:30.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.209+0000 7f3a6b2c5b80 1 -- 172.21.15.73:0/3074685564 shutdown_connections 2023-08-10T11:52:30.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.209+0000 7f3a6b2c5b80 1 --2- 172.21.15.73:0/3074685564 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5613514280f0 0x56135142a510 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.209+0000 7f3a6b2c5b80 1 --2- 172.21.15.73:0/3074685564 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5613513be960 0x5613513cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.209+0000 7f3a6b2c5b80 1 --2- 172.21.15.73:0/3074685564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613513bd540 0x5613513ce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.209+0000 7f3a6b2c5b80 1 --2- 172.21.15.73:0/3074685564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613513bdea0 0x5613513cad50 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.209+0000 7f3a37fff700 0 client.15468 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:52:30.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.209+0000 7f3a6b2c5b80 1 -- 172.21.15.73:0/3074685564 >> 172.21.15.73:0/3074685564 conn(0x56135131acd0 msgr2=0x5613513c6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:30.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.210+0000 7f3a6b2c5b80 1 -- 172.21.15.73:0/3074685564 shutdown_connections 2023-08-10T11:52:30.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.210+0000 7f3a6b2c5b80 1 -- 172.21.15.73:0/3074685564 wait complete. 2023-08-10T11:52:30.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.210+0000 7f3a6b2c5b80 20 client.15468 trim_cache size 0 max 16384 2023-08-10T11:52:30.231 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:52:30.231 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:52:30.231 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": { 2023-08-10T11:52:30.232 INFO:teuthology.orchestra.run.smithi073.stdout: "e0cc7f67-f4bd-4749-956a-f7b7c5b97293": { 2023-08-10T11:52:30.232 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2023-08-10T11:52:30.232 INFO:teuthology.orchestra.run.smithi073.stdout: "tag": "e0cc7f67-f4bd-4749-956a-f7b7c5b97293", 2023-08-10T11:52:30.232 INFO:teuthology.orchestra.run.smithi073.stdout: "options": "recursive,force" 2023-08-10T11:52:30.232 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:52:30.232 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:52:30.232 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:52:30.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.210+0000 7f3a5f12c700 1 -- 172.21.15.73:0/113854444 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3a480a1150 msgr2=0x7f3a480a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:30.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.210+0000 7f3a5f12c700 1 --2- 172.21.15.73:0/113854444 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3a480a1150 0x7f3a480a3610 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c00b5c0 tx=0x7f3a4c005fd0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.210+0000 7f3a5f12c700 1 -- 172.21.15.73:0/113854444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a58102440 msgr2=0x7f3a5819da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:30.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.210+0000 7f3a5f12c700 1 --2- 172.21.15.73:0/113854444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a58102440 0x7f3a5819da40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3a50007ee0 tx=0x7f3a5000d3b0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.210+0000 7f3a5f12c700 1 -- 172.21.15.73:0/113854444 shutdown_connections 2023-08-10T11:52:30.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.210+0000 7f3a5f12c700 1 --2- 172.21.15.73:0/113854444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a58102440 0x7f3a5819da40 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.210+0000 7f3a5f12c700 1 --2- 172.21.15.73:0/113854444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a580fea30 0x7f3a58196490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.210+0000 7f3a5f12c700 1 --2- 172.21.15.73:0/113854444 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f3a480a1150 0x7f3a480a3610 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.210+0000 7f3a5f12c700 1 --2- 172.21.15.73:0/113854444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a58101aa0 0x7f3a581969d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.210+0000 7f3a5f12c700 1 -- 172.21.15.73:0/113854444 >> 172.21.15.73:0/113854444 conn(0x7f3a580fa340 msgr2=0x7f3a580fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:30.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.210+0000 7f3a5f12c700 1 -- 172.21.15.73:0/113854444 shutdown_connections 2023-08-10T11:52:30.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.210+0000 7f3a5f12c700 1 -- 172.21.15.73:0/113854444 wait complete. 2023-08-10T11:52:30.235 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:29 smithi073 ceph-mon[128869]: pgmap v305: 97 pgs: 97 active+clean; 644 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2023-08-10T11:52:30.235 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:29 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2294637296' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:52:30.235 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:29 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/919682275' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:52:30.236 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:29 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2653131118' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:52:30.236 INFO:tasks.cephfs.filesystem:scrub status for tag:e0cc7f67-f4bd-4749-956a-f7b7c5b97293 - {'path': '/', 'tag': 'e0cc7f67-f4bd-4749-956a-f7b7c5b97293', 'options': 'recursive,force'} 2023-08-10T11:52:30.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:29 smithi152 ceph-mon[130220]: pgmap v305: 97 pgs: 97 active+clean; 644 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2023-08-10T11:52:30.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:29 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/2294637296' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:52:30.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:29 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/919682275' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:52:30.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:29 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/2653131118' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:52:30.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:29 smithi156 ceph-mon[130574]: pgmap v305: 97 pgs: 97 active+clean; 644 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2023-08-10T11:52:30.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:29 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/2294637296' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:52:30.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:29 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/919682275' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:52:30.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:29 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/2653131118' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:52:30.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.260+0000 7f44bcf6b700 1 -- 172.21.15.73:0/643759633 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f44b819efd0 con 0x7f44b8101290 2023-08-10T11:52:30.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.941+0000 7f44a77fe700 1 -- 172.21.15.73:0/643759633 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 19) v1 ==== 135732+0+0 (secure 0 0 0) 0x7f44a80105d0 con 0x7f44b8101290 2023-08-10T11:52:30.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.943+0000 7f44a77fe700 1 -- 172.21.15.73:0/643759633 <== mon.0 v2:172.21.15.73:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) v1 ==== 92+0+0 (secure 0 0 0) 0x7f44a8095e40 con 0x7f44b8101290 2023-08-10T11:52:30.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.945+0000 7f44bcf6b700 1 -- 172.21.15.73:0/643759633 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f44a00a1150 msgr2=0x7f44a00a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:30.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.945+0000 7f44bcf6b700 1 --2- 172.21.15.73:0/643759633 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f44a00a1150 0x7f44a00a3610 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f44ac005950 tx=0x7f44ac00b410 comp rx=0 tx=0).stop 2023-08-10T11:52:30.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.945+0000 7f44bcf6b700 1 -- 172.21.15.73:0/643759633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44b8101290 msgr2=0x7f44b81965f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:30.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.945+0000 7f44bcf6b700 1 --2- 172.21.15.73:0/643759633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44b8101290 0x7f44b81965f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f44a800d950 tx=0x7f44a800dc60 comp rx=0 tx=0).stop 2023-08-10T11:52:30.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.945+0000 7f44bcf6b700 1 -- 172.21.15.73:0/643759633 shutdown_connections 2023-08-10T11:52:30.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.945+0000 7f44bcf6b700 1 --2- 172.21.15.73:0/643759633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44b81064f0 0x7f44b81979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.945+0000 7f44bcf6b700 1 --2- 172.21.15.73:0/643759633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44b8101290 0x7f44b81965f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.945+0000 7f44bcf6b700 1 --2- 172.21.15.73:0/643759633 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f44a00a1150 0x7f44a00a3610 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.945+0000 7f44bcf6b700 1 --2- 172.21.15.73:0/643759633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44b8103bc0 0x7f44b8196b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:30.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.945+0000 7f44bcf6b700 1 -- 172.21.15.73:0/643759633 >> 172.21.15.73:0/643759633 conn(0x7f44b80fabc0 msgr2=0x7f44b81026e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:30.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.945+0000 7f44bcf6b700 1 -- 172.21.15.73:0/643759633 shutdown_connections 2023-08-10T11:52:30.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:30.945+0000 7f44bcf6b700 1 -- 172.21.15.73:0/643759633 wait complete. 2023-08-10T11:52:30.961 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2023-08-10T11:52:31.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.127+0000 7f8acda36700 1 -- 172.21.15.73:0/3974365529 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ac8106540 msgr2=0x7f8ac8108930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:31.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.127+0000 7f8acda36700 1 --2- 172.21.15.73:0/3974365529 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ac8106540 0x7f8ac8108930 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000b0a0 tx=0x7f8ac000b3b0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.127+0000 7f8acda36700 1 -- 172.21.15.73:0/3974365529 shutdown_connections 2023-08-10T11:52:31.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.127+0000 7f8acda36700 1 --2- 172.21.15.73:0/3974365529 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ac8106540 0x7f8ac8108930 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.127+0000 7f8acda36700 1 --2- 172.21.15.73:0/3974365529 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ac81012e0 0x7f8ac81036d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.127+0000 7f8acda36700 1 --2- 172.21.15.73:0/3974365529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ac8103c10 0x7f8ac8106000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.127+0000 7f8acda36700 1 -- 172.21.15.73:0/3974365529 >> 172.21.15.73:0/3974365529 conn(0x7f8ac80fabf0 msgr2=0x7f8ac80fd050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:31.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.127+0000 7f8acda36700 1 -- 172.21.15.73:0/3974365529 shutdown_connections 2023-08-10T11:52:31.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.127+0000 7f8acda36700 1 -- 172.21.15.73:0/3974365529 wait complete. 2023-08-10T11:52:31.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.128+0000 7f8acda36700 1 Processor -- start 2023-08-10T11:52:31.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.128+0000 7f8acda36700 1 -- start start 2023-08-10T11:52:31.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.128+0000 7f8acda36700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ac81012e0 0x7f8ac8196670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:31.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.128+0000 7f8acda36700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ac8103c10 0x7f8ac8196bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:31.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.128+0000 7f8acda36700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ac8106540 0x7f8ac8197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:31.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.128+0000 7f8acda36700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac8198090 con 0x7f8ac8103c10 2023-08-10T11:52:31.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.128+0000 7f8acda36700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac8198200 con 0x7f8ac8106540 2023-08-10T11:52:31.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.128+0000 7f8acda36700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac81983c0 con 0x7f8ac81012e0 2023-08-10T11:52:31.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.128+0000 7f8ac67fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ac8103c10 0x7f8ac8196bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:31.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.128+0000 7f8ac67fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ac8103c10 0x7f8ac8196bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60810/0 (socket says 172.21.15.73:60810) 2023-08-10T11:52:31.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.128+0000 7f8ac67fc700 1 -- 172.21.15.73:0/3183438712 learned_addr learned my addr 172.21.15.73:0/3183438712 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:31.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.128+0000 7f8ac77fe700 1 --2- 172.21.15.73:0/3183438712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ac8106540 0x7f8ac8197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:31.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.128+0000 7f8ac6ffd700 1 --2- 172.21.15.73:0/3183438712 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ac81012e0 0x7f8ac8196670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:31.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.129+0000 7f8ac67fc700 1 -- 172.21.15.73:0/3183438712 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ac81012e0 msgr2=0x7f8ac8196670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:31.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.129+0000 7f8ac67fc700 1 --2- 172.21.15.73:0/3183438712 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ac81012e0 0x7f8ac8196670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.129+0000 7f8ac67fc700 1 -- 172.21.15.73:0/3183438712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ac8106540 msgr2=0x7f8ac8197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:31.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.129+0000 7f8ac67fc700 1 --2- 172.21.15.73:0/3183438712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ac8106540 0x7f8ac8197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.129+0000 7f8ac67fc700 1 -- 172.21.15.73:0/3183438712 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac0009d00 con 0x7f8ac8103c10 2023-08-10T11:52:31.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.129+0000 7f8ac67fc700 1 --2- 172.21.15.73:0/3183438712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ac8103c10 0x7f8ac8196bb0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8abc00d980 tx=0x7f8abc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:31.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.129+0000 7f8acca34700 1 -- 172.21.15.73:0/3183438712 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc004220 con 0x7f8ac8103c10 2023-08-10T11:52:31.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.129+0000 7f8acca34700 1 -- 172.21.15.73:0/3183438712 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8abc007640 con 0x7f8ac8103c10 2023-08-10T11:52:31.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.129+0000 7f8acda36700 1 -- 172.21.15.73:0/3183438712 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac81986a0 con 0x7f8ac8103c10 2023-08-10T11:52:31.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.129+0000 7f8acca34700 1 -- 172.21.15.73:0/3183438712 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc005690 con 0x7f8ac8103c10 2023-08-10T11:52:31.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.129+0000 7f8acda36700 1 -- 172.21.15.73:0/3183438712 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac819ee60 con 0x7f8ac8103c10 2023-08-10T11:52:31.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.130+0000 7f8acda36700 1 -- 172.21.15.73:0/3183438712 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac80fc770 con 0x7f8ac8103c10 2023-08-10T11:52:31.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.131+0000 7f8acca34700 1 -- 172.21.15.73:0/3183438712 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 135732+0+0 (secure 0 0 0) 0x7f8abc004750 con 0x7f8ac8103c10 2023-08-10T11:52:31.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.132+0000 7f8acca34700 1 --2- 172.21.15.73:0/3183438712 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8ab00a11a0 0x7f8ab00a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:31.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.132+0000 7f8ac6ffd700 1 -- 172.21.15.73:0/3183438712 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8ab00a11a0 msgr2=0x7f8ab00a3660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/3797582815 2023-08-10T11:52:31.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.132+0000 7f8acca34700 1 -- 172.21.15.73:0/3183438712 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8abc0ccc40 con 0x7f8ac8103c10 2023-08-10T11:52:31.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.132+0000 7f8ac6ffd700 1 --2- 172.21.15.73:0/3183438712 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8ab00a11a0 0x7f8ab00a3660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-10T11:52:31.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.136+0000 7f8acca34700 1 -- 172.21.15.73:0/3183438712 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8abc0963a0 con 0x7f8ac8103c10 2023-08-10T11:52:31.188 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:30 smithi156 ceph-mon[130574]: scrub queued for path: / 2023-08-10T11:52:31.188 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:30 smithi156 ceph-mon[130574]: scrub summary: idle+waiting paths [/] 2023-08-10T11:52:31.188 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:30 smithi156 ceph-mon[130574]: scrub summary: active paths [/] 2023-08-10T11:52:31.188 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:30 smithi156 ceph-mon[130574]: scrub summary: idle+waiting paths [/] 2023-08-10T11:52:31.188 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:30 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/643759633' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-08-10T11:52:31.189 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:52:30 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: ignoring --setuser ceph since I am not root 2023-08-10T11:52:31.189 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:52:30 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: ignoring --setgroup ceph since I am not root 2023-08-10T11:52:31.189 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:52:31 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:52:31.106+0000 7f85fa701200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-10T11:52:31.189 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:52:31 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:52:31.187+0000 7f85fa701200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-10T11:52:31.190 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:30 smithi152 ceph-mon[130220]: scrub queued for path: / 2023-08-10T11:52:31.190 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:30 smithi152 ceph-mon[130220]: scrub summary: idle+waiting paths [/] 2023-08-10T11:52:31.190 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:30 smithi152 ceph-mon[130220]: scrub summary: active paths [/] 2023-08-10T11:52:31.190 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:30 smithi152 ceph-mon[130220]: scrub summary: idle+waiting paths [/] 2023-08-10T11:52:31.190 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:30 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/643759633' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-08-10T11:52:31.190 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:30 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: ignoring --setuser ceph since I am not root 2023-08-10T11:52:31.191 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:30 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: ignoring --setgroup ceph since I am not root 2023-08-10T11:52:31.191 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:30 smithi152 ceph-mgr[131692]: -- 172.21.15.152:0/2622962598 <== mon.1 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f30f6cd1e0 con 0x55f30f6a2800 2023-08-10T11:52:31.191 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:31 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:52:31.106+0000 7f19e6713200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-10T11:52:31.195 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:30 smithi073 ceph-mon[128869]: scrub queued for path: / 2023-08-10T11:52:31.195 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:30 smithi073 ceph-mon[128869]: scrub summary: idle+waiting paths [/] 2023-08-10T11:52:31.196 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:30 smithi073 ceph-mon[128869]: scrub summary: active paths [/] 2023-08-10T11:52:31.196 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:30 smithi073 ceph-mon[128869]: scrub summary: idle+waiting paths [/] 2023-08-10T11:52:31.196 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:30 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/643759633' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-08-10T11:52:31.196 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:30 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: ignoring --setuser ceph since I am not root 2023-08-10T11:52:31.196 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:30 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: ignoring --setgroup ceph since I am not root 2023-08-10T11:52:31.197 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:31 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:31.110+0000 7f8087cb6200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-10T11:52:31.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.333+0000 7f8ac6ffd700 1 -- 172.21.15.73:0/3183438712 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8ab00a11a0 msgr2=0x7f8ab00a3660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/3797582815 2023-08-10T11:52:31.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.333+0000 7f8ac6ffd700 1 --2- 172.21.15.73:0/3183438712 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8ab00a11a0 0x7f8ab00a3660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-10T11:52:31.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.333+0000 7f8acda36700 1 -- 172.21.15.73:0/3183438712 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f8ac804e550 con 0x7f8ac8103c10 2023-08-10T11:52:31.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.339+0000 7f8acca34700 1 -- 172.21.15.73:0/3183438712 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8abc016020 con 0x7f8ac8103c10 2023-08-10T11:52:31.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.342+0000 7f8acda36700 1 -- 172.21.15.73:0/3183438712 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8ab00a11a0 msgr2=0x7f8ab00a3660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T11:52:31.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.342+0000 7f8acda36700 1 --2- 172.21.15.73:0/3183438712 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8ab00a11a0 0x7f8ab00a3660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.342+0000 7f8acda36700 1 -- 172.21.15.73:0/3183438712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ac8103c10 msgr2=0x7f8ac8196bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:31.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.342+0000 7f8acda36700 1 --2- 172.21.15.73:0/3183438712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ac8103c10 0x7f8ac8196bb0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8abc00d980 tx=0x7f8abc00dc90 comp rx=0 tx=0).stop 2023-08-10T11:52:31.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.342+0000 7f8acda36700 1 -- 172.21.15.73:0/3183438712 shutdown_connections 2023-08-10T11:52:31.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.342+0000 7f8acda36700 1 --2- 172.21.15.73:0/3183438712 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f8ab00a11a0 0x7f8ab00a3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.342+0000 7f8acda36700 1 --2- 172.21.15.73:0/3183438712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ac8106540 0x7f8ac8197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.342+0000 7f8acda36700 1 --2- 172.21.15.73:0/3183438712 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ac81012e0 0x7f8ac8196670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.342+0000 7f8acda36700 1 --2- 172.21.15.73:0/3183438712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ac8103c10 0x7f8ac8196bb0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.342+0000 7f8acda36700 1 -- 172.21.15.73:0/3183438712 >> 172.21.15.73:0/3183438712 conn(0x7f8ac80fabf0 msgr2=0x7f8ac8101f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.342+0000 7f8acda36700 1 -- 172.21.15.73:0/3183438712 shutdown_connections 2023-08-10T11:52:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.342+0000 7f8acda36700 1 -- 172.21.15.73:0/3183438712 wait complete. 2023-08-10T11:52:31.356 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2023-08-10T11:52:31.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.481+0000 7f99622af700 1 -- 172.21.15.73:0/2943944487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f995c101200 msgr2=0x7f995c107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:31.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.481+0000 7f99622af700 1 --2- 172.21.15.73:0/2943944487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f995c101200 0x7f995c107ab0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f995400b0d0 tx=0x7f995400b3e0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.481+0000 7f99622af700 1 -- 172.21.15.73:0/2943944487 shutdown_connections 2023-08-10T11:52:31.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.481+0000 7f99622af700 1 --2- 172.21.15.73:0/2943944487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f995c101200 0x7f995c107ab0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.481+0000 7f99622af700 1 --2- 172.21.15.73:0/2943944487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f995c0ff670 0x7f995c0ffa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.481+0000 7f99622af700 1 --2- 172.21.15.73:0/2943944487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f995c100860 0x7f995c100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.481+0000 7f99622af700 1 -- 172.21.15.73:0/2943944487 >> 172.21.15.73:0/2943944487 conn(0x7f995c0fabc0 msgr2=0x7f995c0fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:31.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.481+0000 7f99622af700 1 -- 172.21.15.73:0/2943944487 shutdown_connections 2023-08-10T11:52:31.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.481+0000 7f99622af700 1 -- 172.21.15.73:0/2943944487 wait complete. 2023-08-10T11:52:31.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.482+0000 7f99622af700 1 Processor -- start 2023-08-10T11:52:31.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.482+0000 7f99622af700 1 -- start start 2023-08-10T11:52:31.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.482+0000 7f99622af700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f995c0ff670 0x7f995c196630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:31.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.482+0000 7f99622af700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f995c100860 0x7f995c196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:31.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.482+0000 7f99622af700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f995c101200 0x7f995c1979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:31.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.482+0000 7f99622af700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995c198050 con 0x7f995c0ff670 2023-08-10T11:52:31.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.482+0000 7f99622af700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995c1981c0 con 0x7f995c100860 2023-08-10T11:52:31.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.482+0000 7f99622af700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995c198380 con 0x7f995c101200 2023-08-10T11:52:31.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.482+0000 7f995bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f995c0ff670 0x7f995c196630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:31.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.482+0000 7f995bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f995c0ff670 0x7f995c196630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60846/0 (socket says 172.21.15.73:60846) 2023-08-10T11:52:31.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.482+0000 7f995bfff700 1 -- 172.21.15.73:0/670590995 learned_addr learned my addr 172.21.15.73:0/670590995 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:31.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.482+0000 7f996084c700 1 --2- 172.21.15.73:0/670590995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f995c101200 0x7f995c1979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:31.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.482+0000 7f995b7fe700 1 --2- 172.21.15.73:0/670590995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f995c100860 0x7f995c196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:31.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.482+0000 7f995bfff700 1 -- 172.21.15.73:0/670590995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f995c101200 msgr2=0x7f995c1979f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:31.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.482+0000 7f995bfff700 1 --2- 172.21.15.73:0/670590995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f995c101200 0x7f995c1979f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.482+0000 7f995bfff700 1 -- 172.21.15.73:0/670590995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f995c100860 msgr2=0x7f995c196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:31.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.482+0000 7f995bfff700 1 --2- 172.21.15.73:0/670590995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f995c100860 0x7f995c196b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.482+0000 7f995bfff700 1 -- 172.21.15.73:0/670590995 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9954009d00 con 0x7f995c0ff670 2023-08-10T11:52:31.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.482+0000 7f995b7fe700 1 --2- 172.21.15.73:0/670590995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f995c100860 0x7f995c196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:52:31.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.483+0000 7f995bfff700 1 --2- 172.21.15.73:0/670590995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f995c0ff670 0x7f995c196630 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f994c00e970 tx=0x7f994c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:31.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.483+0000 7f99597fa700 1 -- 172.21.15.73:0/670590995 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c009790 con 0x7f995c0ff670 2023-08-10T11:52:31.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.483+0000 7f99597fa700 1 -- 172.21.15.73:0/670590995 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f994c00eec0 con 0x7f995c0ff670 2023-08-10T11:52:31.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.483+0000 7f99622af700 1 -- 172.21.15.73:0/670590995 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f995c198660 con 0x7f995c0ff670 2023-08-10T11:52:31.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.483+0000 7f99597fa700 1 -- 172.21.15.73:0/670590995 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c003cf0 con 0x7f995c0ff670 2023-08-10T11:52:31.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.483+0000 7f99622af700 1 -- 172.21.15.73:0/670590995 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f995c19ee20 con 0x7f995c0ff670 2023-08-10T11:52:31.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.484+0000 7f99622af700 1 -- 172.21.15.73:0/670590995 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f995c1076d0 con 0x7f995c0ff670 2023-08-10T11:52:31.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.485+0000 7f99597fa700 1 -- 172.21.15.73:0/670590995 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 135732+0+0 (secure 0 0 0) 0x7f994c00ccd0 con 0x7f995c0ff670 2023-08-10T11:52:31.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.485+0000 7f99597fa700 1 --2- 172.21.15.73:0/670590995 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f99440a11a0 0x7f99440a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:31.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.485+0000 7f995b7fe700 1 -- 172.21.15.73:0/670590995 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f99440a11a0 msgr2=0x7f99440a3660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/3797582815 2023-08-10T11:52:31.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.486+0000 7f99597fa700 1 -- 172.21.15.73:0/670590995 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f994c014070 con 0x7f995c0ff670 2023-08-10T11:52:31.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.486+0000 7f995b7fe700 1 --2- 172.21.15.73:0/670590995 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f99440a11a0 0x7f99440a3660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-10T11:52:31.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.489+0000 7f99597fa700 1 -- 172.21.15.73:0/670590995 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f994c096450 con 0x7f995c0ff670 2023-08-10T11:52:31.495 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:31 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:52:31.187+0000 7f19e6713200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-10T11:52:31.495 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:31 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:52:31.277+0000 7f19e6713200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-10T11:52:31.495 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:31 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:52:31.371+0000 7f19e6713200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-10T11:52:31.505 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:52:31 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:52:31.277+0000 7f85fa701200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-10T11:52:31.505 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:52:31 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:52:31.371+0000 7f85fa701200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-10T11:52:31.517 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:31 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:31.195+0000 7f8087cb6200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-10T11:52:31.518 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:31 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:31.286+0000 7f8087cb6200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-10T11:52:31.518 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:31 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:31.388+0000 7f8087cb6200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-10T11:52:31.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.686+0000 7f99622af700 1 -- 172.21.15.73:0/670590995 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f995c02c970 con 0x7f995c0ff670 2023-08-10T11:52:31.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.687+0000 7f995b7fe700 1 -- 172.21.15.73:0/670590995 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f99440a11a0 msgr2=0x7f99440a3660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/3797582815 2023-08-10T11:52:31.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.687+0000 7f995b7fe700 1 --2- 172.21.15.73:0/670590995 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f99440a11a0 0x7f99440a3660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-10T11:52:31.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.691+0000 7f99597fa700 1 -- 172.21.15.73:0/670590995 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v24)=0 v24) v1 ==== 133+0+0 (secure 0 0 0) 0x7f994c01f340 con 0x7f995c0ff670 2023-08-10T11:52:31.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.693+0000 7f99622af700 1 -- 172.21.15.73:0/670590995 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f99440a11a0 msgr2=0x7f99440a3660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T11:52:31.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.693+0000 7f99622af700 1 --2- 172.21.15.73:0/670590995 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f99440a11a0 0x7f99440a3660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.693+0000 7f99622af700 1 -- 172.21.15.73:0/670590995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f995c0ff670 msgr2=0x7f995c196630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:31.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.693+0000 7f99622af700 1 --2- 172.21.15.73:0/670590995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f995c0ff670 0x7f995c196630 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f994c00e970 tx=0x7f994c00ec80 comp rx=0 tx=0).stop 2023-08-10T11:52:31.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.694+0000 7f99622af700 1 -- 172.21.15.73:0/670590995 shutdown_connections 2023-08-10T11:52:31.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.694+0000 7f99622af700 1 --2- 172.21.15.73:0/670590995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f995c101200 0x7f995c1979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.694+0000 7f99622af700 1 --2- 172.21.15.73:0/670590995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f995c0ff670 0x7f995c196630 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.694+0000 7f99622af700 1 --2- 172.21.15.73:0/670590995 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7f99440a11a0 0x7f99440a3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.694+0000 7f99622af700 1 --2- 172.21.15.73:0/670590995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f995c100860 0x7f995c196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.694+0000 7f99622af700 1 -- 172.21.15.73:0/670590995 >> 172.21.15.73:0/670590995 conn(0x7f995c0fabc0 msgr2=0x7f995c0fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:31.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.694+0000 7f99622af700 1 -- 172.21.15.73:0/670590995 shutdown_connections 2023-08-10T11:52:31.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.694+0000 7f99622af700 1 -- 172.21.15.73:0/670590995 wait complete. 2023-08-10T11:52:31.707 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1M' 2023-08-10T11:52:31.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.830+0000 7fd665127700 1 -- 172.21.15.73:0/4193308177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd660100ca0 msgr2=0x7fd6601010c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:31.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.830+0000 7fd665127700 1 --2- 172.21.15.73:0/4193308177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd660100ca0 0x7fd6601010c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd650009990 tx=0x7fd650009ca0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.830+0000 7fd665127700 1 -- 172.21.15.73:0/4193308177 shutdown_connections 2023-08-10T11:52:31.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.830+0000 7fd665127700 1 --2- 172.21.15.73:0/4193308177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6601002e0 0x7fd660107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.830+0000 7fd665127700 1 --2- 172.21.15.73:0/4193308177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd660100ca0 0x7fd6601010c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.830+0000 7fd665127700 1 --2- 172.21.15.73:0/4193308177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6600ff940 0x7fd6600ffda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.830+0000 7fd665127700 1 -- 172.21.15.73:0/4193308177 >> 172.21.15.73:0/4193308177 conn(0x7fd6600fa390 msgr2=0x7fd6600fc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:31.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.830+0000 7fd665127700 1 -- 172.21.15.73:0/4193308177 shutdown_connections 2023-08-10T11:52:31.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.830+0000 7fd665127700 1 -- 172.21.15.73:0/4193308177 wait complete. 2023-08-10T11:52:31.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.831+0000 7fd665127700 1 Processor -- start 2023-08-10T11:52:31.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.831+0000 7fd665127700 1 -- start start 2023-08-10T11:52:31.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.831+0000 7fd665127700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6600ff940 0x7fd660102050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:31.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.831+0000 7fd665127700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6601002e0 0x7fd660102590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:31.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.831+0000 7fd665127700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd660100ca0 0x7fd660102ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:31.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.831+0000 7fd665127700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6601a0510 con 0x7fd6600ff940 2023-08-10T11:52:31.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.831+0000 7fd665127700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6601a0650 con 0x7fd660100ca0 2023-08-10T11:52:31.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.831+0000 7fd665127700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6601a0790 con 0x7fd6601002e0 2023-08-10T11:52:31.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.832+0000 7fd65ed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6600ff940 0x7fd660102050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:31.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.832+0000 7fd65ed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6600ff940 0x7fd660102050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60886/0 (socket says 172.21.15.73:60886) 2023-08-10T11:52:31.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.832+0000 7fd65ed9d700 1 -- 172.21.15.73:0/215413749 learned_addr learned my addr 172.21.15.73:0/215413749 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:31.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.832+0000 7fd65e59c700 1 --2- 172.21.15.73:0/215413749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6601002e0 0x7fd660102590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:31.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.832+0000 7fd65f59e700 1 --2- 172.21.15.73:0/215413749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd660100ca0 0x7fd660102ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:31.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.832+0000 7fd65ed9d700 1 -- 172.21.15.73:0/215413749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6601002e0 msgr2=0x7fd660102590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:31.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.832+0000 7fd65ed9d700 1 --2- 172.21.15.73:0/215413749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6601002e0 0x7fd660102590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.832+0000 7fd65ed9d700 1 -- 172.21.15.73:0/215413749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd660100ca0 msgr2=0x7fd660102ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:31.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.832+0000 7fd65ed9d700 1 --2- 172.21.15.73:0/215413749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd660100ca0 0x7fd660102ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:31.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.832+0000 7fd65ed9d700 1 -- 172.21.15.73:0/215413749 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6500095f0 con 0x7fd6600ff940 2023-08-10T11:52:31.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.832+0000 7fd65f59e700 1 --2- 172.21.15.73:0/215413749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd660100ca0 0x7fd660102ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:52:31.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.832+0000 7fd65e59c700 1 --2- 172.21.15.73:0/215413749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6601002e0 0x7fd660102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:52:31.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.832+0000 7fd65ed9d700 1 --2- 172.21.15.73:0/215413749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6600ff940 0x7fd660102050 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd650000c00 tx=0x7fd650005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:31.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.832+0000 7fd647fff700 1 -- 172.21.15.73:0/215413749 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65001d070 con 0x7fd6600ff940 2023-08-10T11:52:31.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.832+0000 7fd665127700 1 -- 172.21.15.73:0/215413749 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6601a09c0 con 0x7fd6600ff940 2023-08-10T11:52:31.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.832+0000 7fd647fff700 1 -- 172.21.15.73:0/215413749 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd650022470 con 0x7fd6600ff940 2023-08-10T11:52:31.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.832+0000 7fd647fff700 1 -- 172.21.15.73:0/215413749 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd650017650 con 0x7fd6600ff940 2023-08-10T11:52:31.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.832+0000 7fd665127700 1 -- 172.21.15.73:0/215413749 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6601a0e40 con 0x7fd6600ff940 2023-08-10T11:52:31.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.833+0000 7fd665127700 1 -- 172.21.15.73:0/215413749 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd660107850 con 0x7fd6600ff940 2023-08-10T11:52:31.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.835+0000 7fd647fff700 1 -- 172.21.15.73:0/215413749 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 19) v1 ==== 135732+0+0 (secure 0 0 0) 0x7fd6500225e0 con 0x7fd6600ff940 2023-08-10T11:52:31.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.836+0000 7fd647fff700 1 --2- 172.21.15.73:0/215413749 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd6480a11a0 0x7fd6480a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:31.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.836+0000 7fd65e59c700 1 -- 172.21.15.73:0/215413749 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd6480a11a0 msgr2=0x7fd6480a3660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/3797582815 2023-08-10T11:52:31.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.836+0000 7fd647fff700 1 -- 172.21.15.73:0/215413749 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd6500cdd00 con 0x7fd6600ff940 2023-08-10T11:52:31.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.836+0000 7fd65e59c700 1 --2- 172.21.15.73:0/215413749 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd6480a11a0 0x7fd6480a3660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-10T11:52:31.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:31.844+0000 7fd647fff700 1 -- 172.21.15.73:0/215413749 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fd65005c790 con 0x7fd6600ff940 2023-08-10T11:52:31.851 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:31 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:52:31.541+0000 7f19e6713200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-10T11:52:31.852 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:52:31 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:52:31.542+0000 7f85fa701200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-10T11:52:31.893 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:31 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:31.568+0000 7f8087cb6200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-10T11:52:32.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:32.037+0000 7fd65e59c700 1 -- 172.21.15.73:0/215413749 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd6480a11a0 msgr2=0x7fd6480a3660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/3797582815 2023-08-10T11:52:32.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:32.037+0000 7fd65e59c700 1 --2- 172.21.15.73:0/215413749 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd6480a11a0 0x7fd6480a3660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-10T11:52:32.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:32.069+0000 7fd665127700 1 -- 172.21.15.73:0/215413749 --> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd660060bb0 con 0x7fd6480a11a0 2023-08-10T11:52:32.166 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:31 smithi152 ceph-mon[130220]: pgmap v306: 97 pgs: 97 active+clean; 644 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-08-10T11:52:32.166 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:31 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/643759633' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-08-10T11:52:32.166 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:31 smithi152 ceph-mon[130220]: mgrmap e19: x(active, since 7m), standbys: z, y 2023-08-10T11:52:32.166 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:31 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3183438712' entity='client.admin' 2023-08-10T11:52:32.166 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:31 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/670590995' entity='client.admin' 2023-08-10T11:52:32.167 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:31 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:52:31.850+0000 7f19e6713200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-10T11:52:32.167 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:31 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:52:31.940+0000 7f19e6713200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-10T11:52:32.167 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:32 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:52:32.069+0000 7f19e6713200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-10T11:52:32.167 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:32 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:52:32.165+0000 7f19e6713200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-10T11:52:32.168 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:31 smithi156 ceph-mon[130574]: pgmap v306: 97 pgs: 97 active+clean; 644 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-08-10T11:52:32.168 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:31 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/643759633' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-08-10T11:52:32.168 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:31 smithi156 ceph-mon[130574]: mgrmap e19: x(active, since 7m), standbys: z, y 2023-08-10T11:52:32.168 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:31 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3183438712' entity='client.admin' 2023-08-10T11:52:32.169 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:31 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/670590995' entity='client.admin' 2023-08-10T11:52:32.169 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:52:31 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:52:31.852+0000 7f85fa701200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-10T11:52:32.169 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:52:31 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:52:31.942+0000 7f85fa701200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-10T11:52:32.169 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:52:32 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:52:32.072+0000 7f85fa701200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-10T11:52:32.210 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:31 smithi073 ceph-mon[128869]: pgmap v306: 97 pgs: 97 active+clean; 644 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-08-10T11:52:32.210 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:31 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/643759633' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-08-10T11:52:32.211 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:31 smithi073 ceph-mon[128869]: mgrmap e19: x(active, since 7m), standbys: z, y 2023-08-10T11:52:32.211 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:31 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3183438712' entity='client.admin' 2023-08-10T11:52:32.211 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:31 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/670590995' entity='client.admin' 2023-08-10T11:52:32.211 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:31 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:31.892+0000 7f8087cb6200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-10T11:52:32.211 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:31 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:31.984+0000 7f8087cb6200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-10T11:52:32.211 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:32 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:32.116+0000 7f8087cb6200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-10T11:52:32.212 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:32 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:32.209+0000 7f8087cb6200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-10T11:52:32.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:32.438+0000 7fd65e59c700 1 -- 172.21.15.73:0/215413749 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd6480a11a0 msgr2=0x7fd6480a3660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/3797582815 2023-08-10T11:52:32.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:32.438+0000 7fd65e59c700 1 --2- 172.21.15.73:0/215413749 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd6480a11a0 0x7fd6480a3660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-08-10T11:52:32.505 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:52:32 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:52:32.167+0000 7f85fa701200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-10T11:52:32.996 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:32 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:52:32.587+0000 7f19e6713200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-10T11:52:33.010 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:52:32 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:52:32.590+0000 7f85fa701200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-10T11:52:33.018 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:32 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:32.631+0000 7f8087cb6200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-10T11:52:33.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:33.239+0000 7fd65e59c700 1 -- 172.21.15.73:0/215413749 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd6480a11a0 msgr2=0x7fd6480a3660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/3797582815 2023-08-10T11:52:33.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:33.239+0000 7fd65e59c700 1 --2- 172.21.15.73:0/215413749 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd6480a11a0 0x7fd6480a3660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-08-10T11:52:33.495 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:33 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:52:33.150+0000 7f19e6713200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-10T11:52:33.496 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:33 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:52:33.322+0000 7f19e6713200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-10T11:52:33.505 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:52:33 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:52:33.156+0000 7f85fa701200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-10T11:52:33.505 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:52:33 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:52:33.327+0000 7f85fa701200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-10T11:52:33.517 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:33 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:33.189+0000 7f8087cb6200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-10T11:52:33.517 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:33 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:33.359+0000 7f8087cb6200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-10T11:52:34.355 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:34 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:52:34.091+0000 7f19e6713200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-10T11:52:34.355 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:34 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:52:34.182+0000 7f19e6713200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-10T11:52:34.355 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:34 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:52:34.354+0000 7f19e6713200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-10T11:52:34.361 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:52:34 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:52:34.097+0000 7f85fa701200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-10T11:52:34.361 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:52:34 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:52:34.188+0000 7f85fa701200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-10T11:52:34.391 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:34 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:34.123+0000 7f8087cb6200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-10T11:52:34.391 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:34 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:34.216+0000 7f8087cb6200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-10T11:52:34.391 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:34 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:34.390+0000 7f8087cb6200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-10T11:52:34.640 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:52:34 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:52:34.360+0000 7f85fa701200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-10T11:52:34.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:34.840+0000 7fd65e59c700 1 -- 172.21.15.73:0/215413749 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd6480a11a0 msgr2=0x7fd6480a3660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:6800/3797582815 2023-08-10T11:52:34.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:34.840+0000 7fd65e59c700 1 --2- 172.21.15.73:0/215413749 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd6480a11a0 0x7fd6480a3660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-08-10T11:52:34.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:34 smithi152 ceph-mon[130220]: scrub summary: idle 2023-08-10T11:52:34.995 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:34 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:52:34.634+0000 7f19e6713200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-10T11:52:34.996 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:34 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:52:34.865+0000 7f19e6713200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-10T11:52:35.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:34 smithi156 ceph-mon[130574]: scrub summary: idle 2023-08-10T11:52:35.005 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:52:34 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:52:34.639+0000 7f85fa701200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-10T11:52:35.006 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:52:34 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:52:34.871+0000 7f85fa701200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-10T11:52:35.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:34 smithi073 ceph-mon[128869]: scrub summary: idle 2023-08-10T11:52:35.018 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:34 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:34.670+0000 7f8087cb6200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-10T11:52:35.019 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:34 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:34.897+0000 7f8087cb6200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-10T11:52:35.276 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:35 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:52:35.015+0000 7f19e6713200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-10T11:52:35.282 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:52:35 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:52:35.020+0000 7f85fa701200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-10T11:52:35.311 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:35 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:35.046+0000 7f8087cb6200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-10T11:52:35.745 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:35 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:52:35.275+0000 7f19e6713200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-10T11:52:35.755 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:52:35 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:52:35.281+0000 7f85fa701200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-10T11:52:35.767 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:35 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:35.310+0000 7f8087cb6200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-10T11:52:36.245 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:35 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:52:35.980+0000 7f19e6713200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-10T11:52:36.245 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:36 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:52:36.110+0000 7f19e6713200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-10T11:52:36.255 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:52:35 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:52:35.990+0000 7f85fa701200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-10T11:52:36.255 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:52:36 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:52:36.120+0000 7f85fa701200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-10T11:52:36.267 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:36 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:36.009+0000 7f8087cb6200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-10T11:52:36.268 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:36 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:36.140+0000 7f8087cb6200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-10T11:52:36.631 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:36 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:52:36.300+0000 7f19e6713200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-10T11:52:36.631 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:36 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:52:36.413+0000 7f19e6713200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-10T11:52:36.641 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:52:36 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:52:36.311+0000 7f85fa701200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-10T11:52:36.642 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:52:36 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:52:36.425+0000 7f85fa701200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-10T11:52:36.668 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:36 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:36.332+0000 7f8087cb6200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-10T11:52:36.668 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:36 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:36.447+0000 7f8087cb6200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-10T11:52:36.668 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:36 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:36.667+0000 7f8087cb6200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-10T11:52:37.005 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:52:36 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:52:36.641+0000 7f85fa701200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-10T11:52:37.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:37.557+0000 7fd647fff700 1 -- 172.21.15.73:0/215413749 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mgrmap(e 20) v1 ==== 135400+0+0 (secure 0 0 0) 0x7fd650097860 con 0x7fd6600ff940 2023-08-10T11:52:37.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:37.557+0000 7fd647fff700 1 -- 172.21.15.73:0/215413749 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd6480a11a0 msgr2=0x7fd6480a3660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T11:52:37.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:37.557+0000 7fd647fff700 1 --2- 172.21.15.73:0/215413749 >> [v2:172.21.15.73:6800/3797582815,v1:172.21.15.73:6801/3797582815] conn(0x7fd6480a11a0 0x7fd6480a3660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:37.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:37 smithi152 ceph-mon[130220]: Standby manager daemon y restarted 2023-08-10T11:52:37.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:37 smithi152 ceph-mon[130220]: Standby manager daemon y started 2023-08-10T11:52:37.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:37 smithi152 ceph-mon[130220]: from='mgr.? 172.21.15.152:0/3030653897' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-08-10T11:52:37.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:37 smithi152 ceph-mon[130220]: from='mgr.? 172.21.15.152:0/3030653897' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-10T11:52:37.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:37 smithi152 ceph-mon[130220]: from='mgr.? 172.21.15.152:0/3030653897' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-08-10T11:52:37.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:37 smithi152 ceph-mon[130220]: from='mgr.? 172.21.15.152:0/3030653897' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-10T11:52:37.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:37 smithi152 ceph-mon[130220]: Standby manager daemon z restarted 2023-08-10T11:52:37.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:37 smithi152 ceph-mon[130220]: Standby manager daemon z started 2023-08-10T11:52:37.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:37 smithi152 ceph-mon[130220]: from='mgr.? 172.21.15.156:0/4133409653' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-08-10T11:52:37.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:37 smithi152 ceph-mon[130220]: from='mgr.? 172.21.15.156:0/4133409653' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-10T11:52:37.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:37 smithi152 ceph-mon[130220]: from='mgr.? 172.21.15.156:0/4133409653' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-08-10T11:52:37.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:37 smithi152 ceph-mon[130220]: from='mgr.? 172.21.15.156:0/4133409653' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-10T11:52:37.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:37 smithi152 ceph-mon[130220]: Active manager daemon x restarted 2023-08-10T11:52:37.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:37 smithi152 ceph-mon[130220]: Activating manager daemon x 2023-08-10T11:52:37.747 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:36 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:52:36.629+0000 7f19e6713200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-10T11:52:37.748 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Aug 10 11:52:37 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-y[131668]: 2023-08-10T11:52:37.488+0000 7f19e6713200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-10T11:52:37.772 INFO:journalctl@ceph.mgr.z.smithi156.stdout:Aug 10 11:52:37 smithi156 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-z[132552]: 2023-08-10T11:52:37.506+0000 7f85fa701200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-10T11:52:37.772 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:37 smithi156 ceph-mon[130574]: Standby manager daemon y restarted 2023-08-10T11:52:37.772 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:37 smithi156 ceph-mon[130574]: Standby manager daemon y started 2023-08-10T11:52:37.773 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:37 smithi156 ceph-mon[130574]: from='mgr.? 172.21.15.152:0/3030653897' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-08-10T11:52:37.773 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:37 smithi156 ceph-mon[130574]: from='mgr.? 172.21.15.152:0/3030653897' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-10T11:52:37.773 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:37 smithi156 ceph-mon[130574]: from='mgr.? 172.21.15.152:0/3030653897' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-08-10T11:52:37.773 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:37 smithi156 ceph-mon[130574]: from='mgr.? 172.21.15.152:0/3030653897' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-10T11:52:37.773 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:37 smithi156 ceph-mon[130574]: Standby manager daemon z restarted 2023-08-10T11:52:37.773 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:37 smithi156 ceph-mon[130574]: Standby manager daemon z started 2023-08-10T11:52:37.773 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:37 smithi156 ceph-mon[130574]: from='mgr.? 172.21.15.156:0/4133409653' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-08-10T11:52:37.774 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:37 smithi156 ceph-mon[130574]: from='mgr.? 172.21.15.156:0/4133409653' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-10T11:52:37.774 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:37 smithi156 ceph-mon[130574]: from='mgr.? 172.21.15.156:0/4133409653' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-08-10T11:52:37.774 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:37 smithi156 ceph-mon[130574]: from='mgr.? 172.21.15.156:0/4133409653' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-10T11:52:37.774 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:37 smithi156 ceph-mon[130574]: Active manager daemon x restarted 2023-08-10T11:52:37.774 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:37 smithi156 ceph-mon[130574]: Activating manager daemon x 2023-08-10T11:52:37.784 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:37 smithi073 ceph-mon[128869]: Standby manager daemon y restarted 2023-08-10T11:52:37.784 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:37 smithi073 ceph-mon[128869]: Standby manager daemon y started 2023-08-10T11:52:37.784 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:37 smithi073 ceph-mon[128869]: from='mgr.? 172.21.15.152:0/3030653897' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-08-10T11:52:37.784 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:37 smithi073 ceph-mon[128869]: from='mgr.? 172.21.15.152:0/3030653897' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-10T11:52:37.785 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:37 smithi073 ceph-mon[128869]: from='mgr.? 172.21.15.152:0/3030653897' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-08-10T11:52:37.785 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:37 smithi073 ceph-mon[128869]: from='mgr.? 172.21.15.152:0/3030653897' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-10T11:52:37.785 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:37 smithi073 ceph-mon[128869]: Standby manager daemon z restarted 2023-08-10T11:52:37.785 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:37 smithi073 ceph-mon[128869]: Standby manager daemon z started 2023-08-10T11:52:37.785 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:37 smithi073 ceph-mon[128869]: from='mgr.? 172.21.15.156:0/4133409653' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-08-10T11:52:37.785 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:37 smithi073 ceph-mon[128869]: from='mgr.? 172.21.15.156:0/4133409653' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-10T11:52:37.785 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:37 smithi073 ceph-mon[128869]: from='mgr.? 172.21.15.156:0/4133409653' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-08-10T11:52:37.785 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:37 smithi073 ceph-mon[128869]: from='mgr.? 172.21.15.156:0/4133409653' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-10T11:52:37.786 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:37 smithi073 ceph-mon[128869]: Active manager daemon x restarted 2023-08-10T11:52:37.786 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:37 smithi073 ceph-mon[128869]: Activating manager daemon x 2023-08-10T11:52:37.786 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:37 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:37.531+0000 7f8087cb6200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-10T11:52:37.786 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:37 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:37.731+0000 7f7fea13b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T11:52:37.786 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:37 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:37.731+0000 7f7fea13b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T11:52:37.787 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:37 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:37.731+0000 7f7fea13b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T11:52:37.787 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:37 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:37.731+0000 7f7fea13b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T11:52:37.787 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:37 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:37.731+0000 7f7fea13b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T11:52:37.787 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:37 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:37.731+0000 7f7fe8137700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T11:52:37.787 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:37 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:37.731+0000 7f7fe8137700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T11:52:37.787 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:37 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:37.731+0000 7f7fe8137700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T11:52:37.787 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:37 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:37.731+0000 7f7fe8137700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T11:52:37.788 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:52:37 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:52:37.731+0000 7f7fe8137700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T11:52:38.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.580+0000 7fd647fff700 1 -- 172.21.15.73:0/215413749 <== mon.0 v2:172.21.15.73:3300/0 8 ==== mgrmap(e 21) v1 ==== 135527+0+0 (secure 0 0 0) 0x7fd6500cb830 con 0x7fd6600ff940 2023-08-10T11:52:38.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.580+0000 7fd647fff700 1 --2- 172.21.15.73:0/215413749 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd648069200 0x7fd6480695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:38.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.580+0000 7fd647fff700 1 -- 172.21.15.73:0/215413749 --> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd660060bb0 con 0x7fd648069200 2023-08-10T11:52:38.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.583+0000 7fd65e59c700 1 --2- 172.21.15.73:0/215413749 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd648069200 0x7fd6480695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:38.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.585+0000 7fd65e59c700 1 --2- 172.21.15.73:0/215413749 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd648069200 0x7fd6480695e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd660103350 tx=0x7fd654009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:38.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.644+0000 7fd647fff700 1 -- 172.21.15.73:0/215413749 <== mgr.25060 v2:172.21.15.73:6800/807677460 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fd660060bb0 con 0x7fd648069200 2023-08-10T11:52:38.645 INFO:teuthology.orchestra.run.smithi073.stdout:Schedule set for path / 2023-08-10T11:52:38.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.646+0000 7fd665127700 1 -- 172.21.15.73:0/215413749 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd648069200 msgr2=0x7fd6480695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:38.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.646+0000 7fd665127700 1 --2- 172.21.15.73:0/215413749 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd648069200 0x7fd6480695e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd660103350 tx=0x7fd654009260 comp rx=0 tx=0).stop 2023-08-10T11:52:38.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.646+0000 7fd665127700 1 -- 172.21.15.73:0/215413749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6600ff940 msgr2=0x7fd660102050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:38.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.646+0000 7fd665127700 1 --2- 172.21.15.73:0/215413749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6600ff940 0x7fd660102050 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd650000c00 tx=0x7fd650005720 comp rx=0 tx=0).stop 2023-08-10T11:52:38.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.646+0000 7fd65f59e700 1 -- 172.21.15.73:0/215413749 reap_dead start 2023-08-10T11:52:38.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.646+0000 7fd665127700 1 -- 172.21.15.73:0/215413749 shutdown_connections 2023-08-10T11:52:38.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.646+0000 7fd665127700 1 -- 172.21.15.73:0/215413749 >> 172.21.15.73:0/215413749 conn(0x7fd6600fa390 msgr2=0x7fd6600fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:38.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.646+0000 7fd665127700 1 -- 172.21.15.73:0/215413749 shutdown_connections 2023-08-10T11:52:38.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.646+0000 7fd665127700 1 -- 172.21.15.73:0/215413749 wait complete. 2023-08-10T11:52:38.660 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6M3h' 2023-08-10T11:52:38.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.789+0000 7f7ed3bc8700 1 -- 172.21.15.73:0/3394203071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ecc0ff670 msgr2=0x7f7ecc0ffa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:38.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.789+0000 7f7ed3bc8700 1 --2- 172.21.15.73:0/3394203071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ecc0ff670 0x7f7ecc0ffa90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7ec80099c0 tx=0x7f7ec8009cd0 comp rx=0 tx=0).stop 2023-08-10T11:52:38.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.789+0000 7f7ed3bc8700 1 -- 172.21.15.73:0/3394203071 shutdown_connections 2023-08-10T11:52:38.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.789+0000 7f7ed3bc8700 1 --2- 172.21.15.73:0/3394203071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ecc101200 0x7f7ecc107ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:38.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.789+0000 7f7ed3bc8700 1 --2- 172.21.15.73:0/3394203071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ecc0ff670 0x7f7ecc0ffa90 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:38.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.789+0000 7f7ed3bc8700 1 --2- 172.21.15.73:0/3394203071 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ecc100860 0x7f7ecc100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:38.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.789+0000 7f7ed3bc8700 1 -- 172.21.15.73:0/3394203071 >> 172.21.15.73:0/3394203071 conn(0x7f7ecc0fabc0 msgr2=0x7f7ecc0fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:38.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.789+0000 7f7ed3bc8700 1 -- 172.21.15.73:0/3394203071 shutdown_connections 2023-08-10T11:52:38.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.789+0000 7f7ed3bc8700 1 -- 172.21.15.73:0/3394203071 wait complete. 2023-08-10T11:52:38.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.790+0000 7f7ed3bc8700 1 Processor -- start 2023-08-10T11:52:38.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.790+0000 7f7ed3bc8700 1 -- start start 2023-08-10T11:52:38.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.790+0000 7f7ed3bc8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ecc0ff670 0x7f7ecc1991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:38.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.790+0000 7f7ed3bc8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ecc100860 0x7f7ecc19b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:38.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.790+0000 7f7ed3bc8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ecc101200 0x7f7ecc19dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:38.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.790+0000 7f7ed3bc8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc19e240 con 0x7f7ecc101200 2023-08-10T11:52:38.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.790+0000 7f7ed3bc8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc19e3b0 con 0x7f7ecc0ff670 2023-08-10T11:52:38.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.790+0000 7f7ed3bc8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc19e570 con 0x7f7ecc100860 2023-08-10T11:52:38.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.790+0000 7f7ed2165700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ecc101200 0x7f7ecc19dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:38.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.790+0000 7f7ed2165700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ecc101200 0x7f7ecc19dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:32888/0 (socket says 172.21.15.73:32888) 2023-08-10T11:52:38.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.790+0000 7f7ed2165700 1 -- 172.21.15.73:0/1603456682 learned_addr learned my addr 172.21.15.73:0/1603456682 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:38.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.790+0000 7f7ed1163700 1 --2- 172.21.15.73:0/1603456682 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ecc100860 0x7f7ecc19b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:38.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.790+0000 7f7ed1964700 1 --2- 172.21.15.73:0/1603456682 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ecc0ff670 0x7f7ecc1991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:38.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.791+0000 7f7ed2165700 1 -- 172.21.15.73:0/1603456682 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ecc100860 msgr2=0x7f7ecc19b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:38.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.791+0000 7f7ed2165700 1 --2- 172.21.15.73:0/1603456682 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ecc100860 0x7f7ecc19b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:38.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.791+0000 7f7ed2165700 1 -- 172.21.15.73:0/1603456682 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ecc0ff670 msgr2=0x7f7ecc1991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:38.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.791+0000 7f7ed2165700 1 --2- 172.21.15.73:0/1603456682 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ecc0ff670 0x7f7ecc1991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:38.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.791+0000 7f7ed2165700 1 -- 172.21.15.73:0/1603456682 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec80095f0 con 0x7f7ecc101200 2023-08-10T11:52:38.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.791+0000 7f7ed1964700 1 --2- 172.21.15.73:0/1603456682 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ecc0ff670 0x7f7ecc1991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:52:38.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.791+0000 7f7ed2165700 1 --2- 172.21.15.73:0/1603456682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ecc101200 0x7f7ecc19dc40 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7ec400b970 tx=0x7f7ec400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:38.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.791+0000 7f7ec2ffd700 1 -- 172.21.15.73:0/1603456682 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec400c930 con 0x7f7ecc101200 2023-08-10T11:52:38.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.791+0000 7f7ec2ffd700 1 -- 172.21.15.73:0/1603456682 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ec4014440 con 0x7f7ecc101200 2023-08-10T11:52:38.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.791+0000 7f7ed3bc8700 1 -- 172.21.15.73:0/1603456682 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ecc19e850 con 0x7f7ecc101200 2023-08-10T11:52:38.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.791+0000 7f7ec2ffd700 1 -- 172.21.15.73:0/1603456682 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec40075d0 con 0x7f7ecc101200 2023-08-10T11:52:38.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.791+0000 7f7ed3bc8700 1 -- 172.21.15.73:0/1603456682 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ecc19ed10 con 0x7f7ecc101200 2023-08-10T11:52:38.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.792+0000 7f7ed3bc8700 1 -- 172.21.15.73:0/1603456682 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ecc1065a0 con 0x7f7ecc101200 2023-08-10T11:52:38.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.793+0000 7f7ec2ffd700 1 -- 172.21.15.73:0/1603456682 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 21) v1 ==== 135527+0+0 (secure 0 0 0) 0x7f7ec40145b0 con 0x7f7ecc101200 2023-08-10T11:52:38.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.794+0000 7f7ec2ffd700 1 --2- 172.21.15.73:0/1603456682 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f7eb80a0f50 0x7f7eb80a3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:38.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.794+0000 7f7ed1964700 1 --2- 172.21.15.73:0/1603456682 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f7eb80a0f50 0x7f7eb80a3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:38.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.794+0000 7f7ec2ffd700 1 -- 172.21.15.73:0/1603456682 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7ec4006e40 con 0x7f7ecc101200 2023-08-10T11:52:38.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.794+0000 7f7ed1964700 1 --2- 172.21.15.73:0/1603456682 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f7eb80a0f50 0x7f7eb80a3410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc068680 tx=0x7f7ec8005e80 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:38.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:38.798+0000 7f7ec2ffd700 1 -- 172.21.15.73:0/1603456682 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f7ec4095a60 con 0x7f7ecc101200 2023-08-10T11:52:38.955 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: osdmap e86: 12 total, 12 up, 12 in 2023-08-10T11:52:38.956 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: mgrmap e20: x(active, starting, since 0.0138779s), standbys: z, y 2023-08-10T11:52:38.956 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T11:52:38.956 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:52:38.956 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:52:38.956 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-08-10T11:52:38.957 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-08-10T11:52:38.957 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-08-10T11:52:38.957 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-08-10T11:52:38.957 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-08-10T11:52:38.957 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-08-10T11:52:38.958 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-08-10T11:52:38.958 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-08-10T11:52:38.958 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-08-10T11:52:38.958 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-08-10T11:52:38.958 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-08-10T11:52:38.959 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-08-10T11:52:38.959 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-08-10T11:52:38.959 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-08-10T11:52:38.959 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-08-10T11:52:38.960 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T11:52:38.960 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T11:52:38.960 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T11:52:38.961 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T11:52:38.961 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T11:52:38.961 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T11:52:38.961 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T11:52:38.962 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T11:52:38.962 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T11:52:38.962 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T11:52:38.962 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T11:52:38.962 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T11:52:38.962 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-08-10T11:52:38.963 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-08-10T11:52:38.963 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-08-10T11:52:38.963 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: Manager daemon x is now available 2023-08-10T11:52:38.963 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:52:38.964 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:52:38.964 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-08-10T11:52:38.964 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-08-10T11:52:38.964 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-08-10T11:52:38.964 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:38 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-08-10T11:52:38.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: osdmap e86: 12 total, 12 up, 12 in 2023-08-10T11:52:38.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: mgrmap e20: x(active, starting, since 0.0138779s), standbys: z, y 2023-08-10T11:52:38.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T11:52:38.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:52:38.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:52:38.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-08-10T11:52:38.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-08-10T11:52:38.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-08-10T11:52:38.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-08-10T11:52:38.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-08-10T11:52:38.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-08-10T11:52:38.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-08-10T11:52:38.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-08-10T11:52:38.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-08-10T11:52:38.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-08-10T11:52:38.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-08-10T11:52:38.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-08-10T11:52:38.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-08-10T11:52:38.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-08-10T11:52:38.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-08-10T11:52:38.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T11:52:38.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T11:52:38.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T11:52:38.999 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T11:52:38.999 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T11:52:38.999 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T11:52:38.999 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T11:52:38.999 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T11:52:38.999 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T11:52:38.999 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T11:52:39.000 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T11:52:39.000 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T11:52:39.000 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-08-10T11:52:39.000 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-08-10T11:52:39.000 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-08-10T11:52:39.000 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: Manager daemon x is now available 2023-08-10T11:52:39.000 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:52:39.000 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:52:39.001 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-08-10T11:52:39.001 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-08-10T11:52:39.001 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-08-10T11:52:39.001 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:38 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-08-10T11:52:39.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: osdmap e86: 12 total, 12 up, 12 in 2023-08-10T11:52:39.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: mgrmap e20: x(active, starting, since 0.0138779s), standbys: z, y 2023-08-10T11:52:39.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T11:52:39.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T11:52:39.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T11:52:39.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-08-10T11:52:39.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-08-10T11:52:39.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-08-10T11:52:39.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-08-10T11:52:39.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-08-10T11:52:39.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-08-10T11:52:39.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-08-10T11:52:39.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-08-10T11:52:39.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-08-10T11:52:39.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-08-10T11:52:39.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-08-10T11:52:39.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-08-10T11:52:39.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-08-10T11:52:39.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-08-10T11:52:39.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-08-10T11:52:39.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T11:52:39.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T11:52:39.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T11:52:39.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T11:52:39.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T11:52:39.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T11:52:39.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T11:52:39.022 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T11:52:39.022 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T11:52:39.022 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T11:52:39.022 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T11:52:39.022 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T11:52:39.022 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-08-10T11:52:39.022 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-08-10T11:52:39.023 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-08-10T11:52:39.023 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: Manager daemon x is now available 2023-08-10T11:52:39.023 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:52:39.023 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:52:39.023 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-08-10T11:52:39.023 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-08-10T11:52:39.023 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-08-10T11:52:39.023 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:38 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-08-10T11:52:39.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.047+0000 7f7ed3bc8700 1 -- 172.21.15.73:0/1603456682 --> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ecc060bb0 con 0x7f7eb80a0f50 2023-08-10T11:52:39.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.101+0000 7f7ec2ffd700 1 -- 172.21.15.73:0/1603456682 <== mgr.25060 v2:172.21.15.73:6800/807677460 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f7ecc060bb0 con 0x7f7eb80a0f50 2023-08-10T11:52:39.102 INFO:teuthology.orchestra.run.smithi073.stdout:Retention added to path / 2023-08-10T11:52:39.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.103+0000 7f7ed3bc8700 1 -- 172.21.15.73:0/1603456682 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f7eb80a0f50 msgr2=0x7f7eb80a3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:39.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.103+0000 7f7ed3bc8700 1 --2- 172.21.15.73:0/1603456682 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f7eb80a0f50 0x7f7eb80a3410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc068680 tx=0x7f7ec8005e80 comp rx=0 tx=0).stop 2023-08-10T11:52:39.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.103+0000 7f7ed3bc8700 1 -- 172.21.15.73:0/1603456682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ecc101200 msgr2=0x7f7ecc19dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:39.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.103+0000 7f7ed3bc8700 1 --2- 172.21.15.73:0/1603456682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ecc101200 0x7f7ecc19dc40 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7ec400b970 tx=0x7f7ec400bc80 comp rx=0 tx=0).stop 2023-08-10T11:52:39.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.103+0000 7f7ed3bc8700 1 -- 172.21.15.73:0/1603456682 shutdown_connections 2023-08-10T11:52:39.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.103+0000 7f7ed3bc8700 1 --2- 172.21.15.73:0/1603456682 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f7eb80a0f50 0x7f7eb80a3410 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:39.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.103+0000 7f7ed3bc8700 1 --2- 172.21.15.73:0/1603456682 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ecc0ff670 0x7f7ecc1991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:39.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.103+0000 7f7ed3bc8700 1 --2- 172.21.15.73:0/1603456682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ecc101200 0x7f7ecc19dc40 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:39.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.103+0000 7f7ed3bc8700 1 --2- 172.21.15.73:0/1603456682 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ecc100860 0x7f7ecc19b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:39.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.103+0000 7f7ed3bc8700 1 -- 172.21.15.73:0/1603456682 >> 172.21.15.73:0/1603456682 conn(0x7f7ecc0fabc0 msgr2=0x7f7ecc0fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:39.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.103+0000 7f7ed3bc8700 1 -- 172.21.15.73:0/1603456682 shutdown_connections 2023-08-10T11:52:39.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.103+0000 7f7ed3bc8700 1 -- 172.21.15.73:0/1603456682 wait complete. 2023-08-10T11:52:39.120 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-08-10T11:52:39.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.245+0000 7ffa3aa03700 1 -- 172.21.15.73:0/4238446991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa340ff670 msgr2=0x7ffa340ffa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:39.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.245+0000 7ffa3aa03700 1 --2- 172.21.15.73:0/4238446991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa340ff670 0x7ffa340ffa90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ffa280099c0 tx=0x7ffa28009cd0 comp rx=0 tx=0).stop 2023-08-10T11:52:39.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.245+0000 7ffa3aa03700 1 -- 172.21.15.73:0/4238446991 shutdown_connections 2023-08-10T11:52:39.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.245+0000 7ffa3aa03700 1 --2- 172.21.15.73:0/4238446991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa34101200 0x7ffa34107ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:39.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.245+0000 7ffa3aa03700 1 --2- 172.21.15.73:0/4238446991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa340ff670 0x7ffa340ffa90 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:39.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.245+0000 7ffa3aa03700 1 --2- 172.21.15.73:0/4238446991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa34100860 0x7ffa34100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:39.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.245+0000 7ffa3aa03700 1 -- 172.21.15.73:0/4238446991 >> 172.21.15.73:0/4238446991 conn(0x7ffa340fabc0 msgr2=0x7ffa340fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:39.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.245+0000 7ffa3aa03700 1 -- 172.21.15.73:0/4238446991 shutdown_connections 2023-08-10T11:52:39.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.245+0000 7ffa3aa03700 1 -- 172.21.15.73:0/4238446991 wait complete. 2023-08-10T11:52:39.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.246+0000 7ffa3aa03700 1 Processor -- start 2023-08-10T11:52:39.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.246+0000 7ffa3aa03700 1 -- start start 2023-08-10T11:52:39.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.247+0000 7ffa3aa03700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa340ff670 0x7ffa341954f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:39.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.247+0000 7ffa3aa03700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa34100860 0x7ffa34195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:39.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.247+0000 7ffa3aa03700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa34101200 0x7ffa341968b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:39.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.247+0000 7ffa3aa03700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa34196f10 con 0x7ffa34101200 2023-08-10T11:52:39.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.247+0000 7ffa3aa03700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa34197080 con 0x7ffa340ff670 2023-08-10T11:52:39.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.247+0000 7ffa3aa03700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa34197240 con 0x7ffa34100860 2023-08-10T11:52:39.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.247+0000 7ffa38fa0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa34101200 0x7ffa341968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:39.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.247+0000 7ffa38fa0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa34101200 0x7ffa341968b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:32900/0 (socket says 172.21.15.73:32900) 2023-08-10T11:52:39.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.247+0000 7ffa38fa0700 1 -- 172.21.15.73:0/2092310779 learned_addr learned my addr 172.21.15.73:0/2092310779 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:39.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.247+0000 7ffa337fe700 1 --2- 172.21.15.73:0/2092310779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa34100860 0x7ffa34195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:39.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.247+0000 7ffa33fff700 1 --2- 172.21.15.73:0/2092310779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa340ff670 0x7ffa341954f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:39.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.247+0000 7ffa38fa0700 1 -- 172.21.15.73:0/2092310779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa34100860 msgr2=0x7ffa34195a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:39.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.247+0000 7ffa38fa0700 1 --2- 172.21.15.73:0/2092310779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa34100860 0x7ffa34195a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:39.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.247+0000 7ffa38fa0700 1 -- 172.21.15.73:0/2092310779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa340ff670 msgr2=0x7ffa341954f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:39.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.247+0000 7ffa38fa0700 1 --2- 172.21.15.73:0/2092310779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa340ff670 0x7ffa341954f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:39.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.247+0000 7ffa38fa0700 1 -- 172.21.15.73:0/2092310779 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa280095f0 con 0x7ffa34101200 2023-08-10T11:52:39.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.247+0000 7ffa38fa0700 1 --2- 172.21.15.73:0/2092310779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa34101200 0x7ffa341968b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c00ef30 tx=0x7ffa2c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:39.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.247+0000 7ffa317fa700 1 -- 172.21.15.73:0/2092310779 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c018070 con 0x7ffa34101200 2023-08-10T11:52:39.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.247+0000 7ffa3aa03700 1 -- 172.21.15.73:0/2092310779 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa341974c0 con 0x7ffa34101200 2023-08-10T11:52:39.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.247+0000 7ffa317fa700 1 -- 172.21.15.73:0/2092310779 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffa2c00f040 con 0x7ffa34101200 2023-08-10T11:52:39.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.247+0000 7ffa317fa700 1 -- 172.21.15.73:0/2092310779 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c00cd00 con 0x7ffa34101200 2023-08-10T11:52:39.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.247+0000 7ffa3aa03700 1 -- 172.21.15.73:0/2092310779 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa3419dce0 con 0x7ffa34101200 2023-08-10T11:52:39.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.248+0000 7ffa3aa03700 1 -- 172.21.15.73:0/2092310779 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa34106cb0 con 0x7ffa34101200 2023-08-10T11:52:39.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.249+0000 7ffa317fa700 1 -- 172.21.15.73:0/2092310779 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 21) v1 ==== 135527+0+0 (secure 0 0 0) 0x7ffa2c003a00 con 0x7ffa34101200 2023-08-10T11:52:39.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.250+0000 7ffa317fa700 1 --2- 172.21.15.73:0/2092310779 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ffa1c0a0f50 0x7ffa1c0a3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:39.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.250+0000 7ffa317fa700 1 -- 172.21.15.73:0/2092310779 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ffa2c0cca70 con 0x7ffa34101200 2023-08-10T11:52:39.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.250+0000 7ffa33fff700 1 --2- 172.21.15.73:0/2092310779 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ffa1c0a0f50 0x7ffa1c0a3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:39.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.250+0000 7ffa33fff700 1 --2- 172.21.15.73:0/2092310779 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ffa1c0a0f50 0x7ffa1c0a3410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009990 tx=0x7ffa28005fb0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:39.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.254+0000 7ffa317fa700 1 -- 172.21.15.73:0/2092310779 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ffa2c096450 con 0x7ffa34101200 2023-08-10T11:52:39.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.480+0000 7ffa3aa03700 1 -- 172.21.15.73:0/2092310779 --> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa34060bb0 con 0x7ffa1c0a0f50 2023-08-10T11:52:39.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.488+0000 7ffa317fa700 1 -- 172.21.15.73:0/2092310779 <== mgr.25060 v2:172.21.15.73:6800/807677460 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+283 (secure 0 0 0) 0x7ffa34060bb0 con 0x7ffa1c0a0f50 2023-08-10T11:52:39.488 INFO:teuthology.orchestra.run.smithi073.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1M", "retention": {"h": 3, "M": 6}, "start": "2023-08-10T00:00:00", "created": "2023-08-10T11:52:38", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2023-08-10T11:52:39.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.490+0000 7ffa3aa03700 1 -- 172.21.15.73:0/2092310779 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ffa1c0a0f50 msgr2=0x7ffa1c0a3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:39.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.490+0000 7ffa3aa03700 1 --2- 172.21.15.73:0/2092310779 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ffa1c0a0f50 0x7ffa1c0a3410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009990 tx=0x7ffa28005fb0 comp rx=0 tx=0).stop 2023-08-10T11:52:39.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.490+0000 7ffa3aa03700 1 -- 172.21.15.73:0/2092310779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa34101200 msgr2=0x7ffa341968b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:39.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.490+0000 7ffa3aa03700 1 --2- 172.21.15.73:0/2092310779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa34101200 0x7ffa341968b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c00ef30 tx=0x7ffa2c00c3a0 comp rx=0 tx=0).stop 2023-08-10T11:52:39.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.490+0000 7ffa3aa03700 1 -- 172.21.15.73:0/2092310779 shutdown_connections 2023-08-10T11:52:39.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.490+0000 7ffa3aa03700 1 --2- 172.21.15.73:0/2092310779 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ffa1c0a0f50 0x7ffa1c0a3410 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:39.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.490+0000 7ffa3aa03700 1 --2- 172.21.15.73:0/2092310779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa340ff670 0x7ffa341954f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:39.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.490+0000 7ffa3aa03700 1 --2- 172.21.15.73:0/2092310779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa34101200 0x7ffa341968b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:39.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.490+0000 7ffa3aa03700 1 --2- 172.21.15.73:0/2092310779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa34100860 0x7ffa34195a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:39.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.490+0000 7ffa3aa03700 1 -- 172.21.15.73:0/2092310779 >> 172.21.15.73:0/2092310779 conn(0x7ffa340fabc0 msgr2=0x7ffa34103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:39.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.490+0000 7ffa3aa03700 1 -- 172.21.15.73:0/2092310779 shutdown_connections 2023-08-10T11:52:39.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.490+0000 7ffa3aa03700 1 -- 172.21.15.73:0/2092310779 wait complete. 2023-08-10T11:52:39.502 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-08-10T11:52:39.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.637+0000 7fcda387a700 1 -- 172.21.15.73:0/2594301109 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd9c100870 msgr2=0x7fcd9c100cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:39.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.637+0000 7fcda387a700 1 --2- 172.21.15.73:0/2594301109 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd9c100870 0x7fcd9c100cd0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0099c0 tx=0x7fcd8c009cd0 comp rx=0 tx=0).stop 2023-08-10T11:52:39.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.637+0000 7fcda387a700 1 -- 172.21.15.73:0/2594301109 shutdown_connections 2023-08-10T11:52:39.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.637+0000 7fcda387a700 1 --2- 172.21.15.73:0/2594301109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd9c0ff680 0x7fcd9c0ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:39.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.637+0000 7fcda387a700 1 --2- 172.21.15.73:0/2594301109 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd9c101210 0x7fcd9c107ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:39.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.637+0000 7fcda387a700 1 --2- 172.21.15.73:0/2594301109 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd9c100870 0x7fcd9c100cd0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:39.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.637+0000 7fcda387a700 1 -- 172.21.15.73:0/2594301109 >> 172.21.15.73:0/2594301109 conn(0x7fcd9c0fac10 msgr2=0x7fcd9c0fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:39.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.637+0000 7fcda387a700 1 -- 172.21.15.73:0/2594301109 shutdown_connections 2023-08-10T11:52:39.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.637+0000 7fcda387a700 1 -- 172.21.15.73:0/2594301109 wait complete. 2023-08-10T11:52:39.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.638+0000 7fcda387a700 1 Processor -- start 2023-08-10T11:52:39.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.638+0000 7fcda387a700 1 -- start start 2023-08-10T11:52:39.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.638+0000 7fcda387a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd9c0ff680 0x7fcd9c101c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:39.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.638+0000 7fcda387a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd9c100870 0x7fcd9c102190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:39.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.638+0000 7fcda387a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd9c101210 0x7fcd9c1026d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:39.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.638+0000 7fcda387a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c1a04e0 con 0x7fcd9c101210 2023-08-10T11:52:39.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.638+0000 7fcda387a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c1a0620 con 0x7fcd9c100870 2023-08-10T11:52:39.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.638+0000 7fcda387a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c1a0760 con 0x7fcd9c0ff680 2023-08-10T11:52:39.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.638+0000 7fcda1e17700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd9c101210 0x7fcd9c1026d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:39.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.638+0000 7fcda1e17700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd9c101210 0x7fcd9c1026d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:32916/0 (socket says 172.21.15.73:32916) 2023-08-10T11:52:39.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.638+0000 7fcda1616700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd9c0ff680 0x7fcd9c101c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:39.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.638+0000 7fcda1e17700 1 -- 172.21.15.73:0/855805694 learned_addr learned my addr 172.21.15.73:0/855805694 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:39.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.638+0000 7fcda0e15700 1 --2- 172.21.15.73:0/855805694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd9c100870 0x7fcd9c102190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:39.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.638+0000 7fcda1e17700 1 -- 172.21.15.73:0/855805694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd9c0ff680 msgr2=0x7fcd9c101c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:39.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.638+0000 7fcda1e17700 1 --2- 172.21.15.73:0/855805694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd9c0ff680 0x7fcd9c101c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:39.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.638+0000 7fcda1e17700 1 -- 172.21.15.73:0/855805694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd9c100870 msgr2=0x7fcd9c102190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:39.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.638+0000 7fcda1e17700 1 --2- 172.21.15.73:0/855805694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd9c100870 0x7fcd9c102190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:39.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.638+0000 7fcda1e17700 1 -- 172.21.15.73:0/855805694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd98009520 con 0x7fcd9c101210 2023-08-10T11:52:39.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.638+0000 7fcda1e17700 1 --2- 172.21.15.73:0/855805694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd9c101210 0x7fcd9c1026d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fcd9400ef30 tx=0x7fcd9400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:39.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.639+0000 7fcd927fc700 1 -- 172.21.15.73:0/855805694 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94018070 con 0x7fcd9c101210 2023-08-10T11:52:39.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.639+0000 7fcd927fc700 1 -- 172.21.15.73:0/855805694 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd9400f040 con 0x7fcd9c101210 2023-08-10T11:52:39.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.639+0000 7fcda387a700 1 -- 172.21.15.73:0/855805694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd8c0095f0 con 0x7fcd9c101210 2023-08-10T11:52:39.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.639+0000 7fcd927fc700 1 -- 172.21.15.73:0/855805694 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9400cd00 con 0x7fcd9c101210 2023-08-10T11:52:39.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.639+0000 7fcda387a700 1 -- 172.21.15.73:0/855805694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9c1a0cc0 con 0x7fcd9c101210 2023-08-10T11:52:39.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.640+0000 7fcda387a700 1 -- 172.21.15.73:0/855805694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd9c04e550 con 0x7fcd9c101210 2023-08-10T11:52:39.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.641+0000 7fcd927fc700 1 -- 172.21.15.73:0/855805694 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 22) v1 ==== 135835+0+0 (secure 0 0 0) 0x7fcd94003a00 con 0x7fcd9c101210 2023-08-10T11:52:39.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.641+0000 7fcd927fc700 1 --2- 172.21.15.73:0/855805694 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fcd880a12c0 0x7fcd880a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:39.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.641+0000 7fcda1616700 1 --2- 172.21.15.73:0/855805694 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fcd880a12c0 0x7fcd880a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:39.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.641+0000 7fcd927fc700 1 -- 172.21.15.73:0/855805694 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fcd940cd1e0 con 0x7fcd9c101210 2023-08-10T11:52:39.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.642+0000 7fcda1616700 1 --2- 172.21.15.73:0/855805694 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fcd880a12c0 0x7fcd880a3780 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c103560 tx=0x7fcd98009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:39.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.645+0000 7fcd927fc700 1 -- 172.21.15.73:0/855805694 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fcd940966b0 con 0x7fcd9c101210 2023-08-10T11:52:39.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:39 smithi073 ceph-mon[128869]: [10/Aug/2023:11:52:38] ENGINE Bus STARTING 2023-08-10T11:52:39.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:39 smithi073 ceph-mon[128869]: mgrmap e21: x(active, since 1.03542s), standbys: z, y 2023-08-10T11:52:39.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:39 smithi073 ceph-mon[128869]: from='client.15504 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:52:39.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:39 smithi073 ceph-mon[128869]: pgmap v3: 97 pgs: 97 active+clean; 1.0 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:52:39.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:39 smithi073 ceph-mon[128869]: [10/Aug/2023:11:52:38] ENGINE Serving on https://172.21.15.73:7150 2023-08-10T11:52:39.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:39 smithi073 ceph-mon[128869]: [10/Aug/2023:11:52:38] ENGINE Serving on http://172.21.15.73:8765 2023-08-10T11:52:39.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:39 smithi073 ceph-mon[128869]: [10/Aug/2023:11:52:38] ENGINE Bus STARTED 2023-08-10T11:52:39.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.868+0000 7fcda387a700 1 -- 172.21.15.73:0/855805694 --> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fcd9c1a0ee0 con 0x7fcd880a12c0 2023-08-10T11:52:39.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.875+0000 7fcd927fc700 1 -- 172.21.15.73:0/855805694 <== mgr.25060 v2:172.21.15.73:6800/807677460 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7fcd9c1a0ee0 con 0x7fcd880a12c0 2023-08-10T11:52:39.876 INFO:teuthology.orchestra.run.smithi073.stdout:/ 1M 6M3h 2023-08-10T11:52:39.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.877+0000 7fcda387a700 1 -- 172.21.15.73:0/855805694 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fcd880a12c0 msgr2=0x7fcd880a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:39.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.877+0000 7fcda387a700 1 --2- 172.21.15.73:0/855805694 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fcd880a12c0 0x7fcd880a3780 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c103560 tx=0x7fcd98009260 comp rx=0 tx=0).stop 2023-08-10T11:52:39.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.877+0000 7fcda387a700 1 -- 172.21.15.73:0/855805694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd9c101210 msgr2=0x7fcd9c1026d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:39.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.877+0000 7fcda387a700 1 --2- 172.21.15.73:0/855805694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd9c101210 0x7fcd9c1026d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fcd9400ef30 tx=0x7fcd9400c3a0 comp rx=0 tx=0).stop 2023-08-10T11:52:39.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.877+0000 7fcda387a700 1 -- 172.21.15.73:0/855805694 shutdown_connections 2023-08-10T11:52:39.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.877+0000 7fcda387a700 1 --2- 172.21.15.73:0/855805694 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fcd880a12c0 0x7fcd880a3780 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:39.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.877+0000 7fcda387a700 1 --2- 172.21.15.73:0/855805694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd9c101210 0x7fcd9c1026d0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:39.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.877+0000 7fcda387a700 1 --2- 172.21.15.73:0/855805694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd9c0ff680 0x7fcd9c101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:39.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.877+0000 7fcda387a700 1 --2- 172.21.15.73:0/855805694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd9c100870 0x7fcd9c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:39.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.877+0000 7fcda387a700 1 -- 172.21.15.73:0/855805694 >> 172.21.15.73:0/855805694 conn(0x7fcd9c0fac10 msgr2=0x7fcd9c068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:39.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.877+0000 7fcda387a700 1 -- 172.21.15.73:0/855805694 shutdown_connections 2023-08-10T11:52:39.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:52:39.877+0000 7fcda387a700 1 -- 172.21.15.73:0/855805694 wait complete. 2023-08-10T11:52:39.893 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2023-08-10T11:52:39.922 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2023-08-10T11:52:39.937 INFO:teuthology.run_tasks:Running task background_exec... 2023-08-10T11:52:40.069 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi073.front.sepia.ceph.com 2023-08-10T11:52:40.070 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2023-08-10T11:52:40.071 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:39 smithi156 ceph-mon[130574]: [10/Aug/2023:11:52:38] ENGINE Bus STARTING 2023-08-10T11:52:40.071 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:39 smithi156 ceph-mon[130574]: mgrmap e21: x(active, since 1.03542s), standbys: z, y 2023-08-10T11:52:40.071 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:39 smithi156 ceph-mon[130574]: from='client.15504 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:52:40.072 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:39 smithi156 ceph-mon[130574]: pgmap v3: 97 pgs: 97 active+clean; 1.0 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:52:40.072 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:39 smithi156 ceph-mon[130574]: [10/Aug/2023:11:52:38] ENGINE Serving on https://172.21.15.73:7150 2023-08-10T11:52:40.072 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:39 smithi156 ceph-mon[130574]: [10/Aug/2023:11:52:38] ENGINE Serving on http://172.21.15.73:8765 2023-08-10T11:52:40.072 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:39 smithi156 ceph-mon[130574]: [10/Aug/2023:11:52:38] ENGINE Bus STARTED 2023-08-10T11:52:40.072 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:39 smithi152 ceph-mon[130220]: [10/Aug/2023:11:52:38] ENGINE Bus STARTING 2023-08-10T11:52:40.072 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:39 smithi152 ceph-mon[130220]: mgrmap e21: x(active, since 1.03542s), standbys: z, y 2023-08-10T11:52:40.073 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:39 smithi152 ceph-mon[130220]: from='client.15504 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:52:40.073 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:39 smithi152 ceph-mon[130220]: pgmap v3: 97 pgs: 97 active+clean; 1.0 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:52:40.073 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:39 smithi152 ceph-mon[130220]: [10/Aug/2023:11:52:38] ENGINE Serving on https://172.21.15.73:7150 2023-08-10T11:52:40.073 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:39 smithi152 ceph-mon[130220]: [10/Aug/2023:11:52:38] ENGINE Serving on http://172.21.15.73:8765 2023-08-10T11:52:40.073 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:39 smithi152 ceph-mon[130220]: [10/Aug/2023:11:52:38] ENGINE Bus STARTED 2023-08-10T11:52:40.074 INFO:teuthology.run_tasks:Running task workunit... 2023-08-10T11:52:40.102 INFO:tasks.workunit:Pulling workunits from ref a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T11:52:40.103 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-08-10T11:52:40.103 INFO:tasks.workunit:timeout=3h 2023-08-10T11:52:40.103 INFO:tasks.workunit:cleanup=True 2023-08-10T11:52:40.103 DEBUG:teuthology.orchestra.run.smithi073:> stat -- /home/ubuntu/cephtest/mnt.0 2023-08-10T11:52:40.120 INFO:teuthology.orchestra.run.smithi073.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-08-10T11:52:40.120 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-08-10T11:52:40.121 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 7ch/124d Inode: 1099511628283 Links: 2 2023-08-10T11:52:40.121 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T11:52:40.121 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:cephfs_t:s0 2023-08-10T11:52:40.121 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-08-10 11:51:01.302635730 +0000 2023-08-10T11:52:40.121 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-08-10 11:51:01.302635730 +0000 2023-08-10T11:52:40.121 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-08-10 11:52:23.156615496 +0000 2023-08-10T11:52:40.121 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2023-08-10 11:51:01.302635730 +0000 2023-08-10T11:52:40.122 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-08-10T11:52:40.122 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-08-10T11:52:40.241 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T11:52:40.259 INFO:tasks.workunit.client.0.smithi073.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-08-10T11:52:40.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:40 smithi152 ceph-mon[130220]: from='client.15543 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:52:40.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:40 smithi152 ceph-mon[130220]: from='client.15549 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:52:40.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:40 smithi152 ceph-mon[130220]: pgmap v4: 97 pgs: 97 active+clean; 1.0 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:52:40.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:40 smithi152 ceph-mon[130220]: mgrmap e22: x(active, since 2s), standbys: z, y 2023-08-10T11:52:40.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:40 smithi152 ceph-mon[130220]: from='client.15555 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:52:41.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:40 smithi156 ceph-mon[130574]: from='client.15543 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:52:41.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:40 smithi156 ceph-mon[130574]: from='client.15549 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:52:41.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:40 smithi156 ceph-mon[130574]: pgmap v4: 97 pgs: 97 active+clean; 1.0 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:52:41.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:40 smithi156 ceph-mon[130574]: mgrmap e22: x(active, since 2s), standbys: z, y 2023-08-10T11:52:41.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:40 smithi156 ceph-mon[130574]: from='client.15555 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:52:41.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:40 smithi073 ceph-mon[128869]: from='client.15543 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:52:41.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:40 smithi073 ceph-mon[128869]: from='client.15549 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:52:41.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:40 smithi073 ceph-mon[128869]: pgmap v4: 97 pgs: 97 active+clean; 1.0 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:52:41.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:40 smithi073 ceph-mon[128869]: mgrmap e22: x(active, since 2s), standbys: z, y 2023-08-10T11:52:41.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:40 smithi073 ceph-mon[128869]: from='client.15555 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:52:41.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:41.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:41.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:41.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:41.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:41.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:41.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:41.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:41.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:41.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:41.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:41.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:41.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:41.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:41.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:41.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:41.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:41.999 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:41.999 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:41.999 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:41.999 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.000 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.000 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.000 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.000 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.000 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.000 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:42.000 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:42.001 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.001 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.001 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.001 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.001 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.001 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.001 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.001 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.002 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:52:42.002 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:41 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:52:42.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:42.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:42.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:42.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:42.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:42.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:42.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:42.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:42.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:42.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:42.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:42.010 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:42.010 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.010 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.010 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.010 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.011 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.012 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.012 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.012 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.012 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:52:42.012 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:41 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:52:42.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:42.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:42.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:42.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:42.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:42.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:42.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:42.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:42.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:42.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:42.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.022 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.022 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:42.022 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:42.022 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.022 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.022 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.022 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.023 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.023 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.023 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.023 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:52:42.023 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:52:42.023 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:41 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:52:42.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:42 smithi152 ceph-mon[130220]: Adjusting osd_memory_target on smithi152 to 196.2M 2023-08-10T11:52:42.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:42 smithi152 ceph-mon[130220]: Unable to set osd_memory_target on smithi152 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-08-10T11:52:42.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:42 smithi152 ceph-mon[130220]: pgmap v5: 97 pgs: 97 active+clean; 1.0 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:52:42.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:42 smithi152 ceph-mon[130220]: Adjusting osd_memory_target on smithi156 to 196.2M 2023-08-10T11:52:42.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:42 smithi152 ceph-mon[130220]: Unable to set osd_memory_target on smithi156 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-08-10T11:52:42.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:42 smithi152 ceph-mon[130220]: Adjusting osd_memory_target on smithi073 to 196.2M 2023-08-10T11:52:42.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:42 smithi152 ceph-mon[130220]: Unable to set osd_memory_target on smithi073 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-08-10T11:52:42.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:42 smithi152 ceph-mon[130220]: Updating smithi073:/etc/ceph/ceph.conf 2023-08-10T11:52:42.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:42 smithi152 ceph-mon[130220]: Updating smithi152:/etc/ceph/ceph.conf 2023-08-10T11:52:42.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:42 smithi152 ceph-mon[130220]: Updating smithi156:/etc/ceph/ceph.conf 2023-08-10T11:52:42.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:42 smithi152 ceph-mon[130220]: Updating smithi152:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T11:52:42.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:42 smithi152 ceph-mon[130220]: Updating smithi073:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T11:52:42.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:42 smithi152 ceph-mon[130220]: Updating smithi156:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T11:52:42.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:42 smithi152 ceph-mon[130220]: mgrmap e23: x(active, since 4s), standbys: z, y 2023-08-10T11:52:43.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:42 smithi156 ceph-mon[130574]: Adjusting osd_memory_target on smithi152 to 196.2M 2023-08-10T11:52:43.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:42 smithi156 ceph-mon[130574]: Unable to set osd_memory_target on smithi152 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-08-10T11:52:43.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:42 smithi156 ceph-mon[130574]: pgmap v5: 97 pgs: 97 active+clean; 1.0 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:52:43.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:42 smithi156 ceph-mon[130574]: Adjusting osd_memory_target on smithi156 to 196.2M 2023-08-10T11:52:43.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:42 smithi156 ceph-mon[130574]: Unable to set osd_memory_target on smithi156 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-08-10T11:52:43.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:42 smithi156 ceph-mon[130574]: Adjusting osd_memory_target on smithi073 to 196.2M 2023-08-10T11:52:43.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:42 smithi156 ceph-mon[130574]: Unable to set osd_memory_target on smithi073 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-08-10T11:52:43.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:42 smithi156 ceph-mon[130574]: Updating smithi073:/etc/ceph/ceph.conf 2023-08-10T11:52:43.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:42 smithi156 ceph-mon[130574]: Updating smithi152:/etc/ceph/ceph.conf 2023-08-10T11:52:43.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:42 smithi156 ceph-mon[130574]: Updating smithi156:/etc/ceph/ceph.conf 2023-08-10T11:52:43.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:42 smithi156 ceph-mon[130574]: Updating smithi152:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T11:52:43.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:42 smithi156 ceph-mon[130574]: Updating smithi073:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T11:52:43.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:42 smithi156 ceph-mon[130574]: Updating smithi156:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T11:52:43.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:42 smithi156 ceph-mon[130574]: mgrmap e23: x(active, since 4s), standbys: z, y 2023-08-10T11:52:43.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:42 smithi073 ceph-mon[128869]: Adjusting osd_memory_target on smithi152 to 196.2M 2023-08-10T11:52:43.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:42 smithi073 ceph-mon[128869]: Unable to set osd_memory_target on smithi152 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-08-10T11:52:43.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:42 smithi073 ceph-mon[128869]: pgmap v5: 97 pgs: 97 active+clean; 1.0 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:52:43.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:42 smithi073 ceph-mon[128869]: Adjusting osd_memory_target on smithi156 to 196.2M 2023-08-10T11:52:43.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:42 smithi073 ceph-mon[128869]: Unable to set osd_memory_target on smithi156 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-08-10T11:52:43.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:42 smithi073 ceph-mon[128869]: Adjusting osd_memory_target on smithi073 to 196.2M 2023-08-10T11:52:43.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:42 smithi073 ceph-mon[128869]: Unable to set osd_memory_target on smithi073 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-08-10T11:52:43.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:42 smithi073 ceph-mon[128869]: Updating smithi073:/etc/ceph/ceph.conf 2023-08-10T11:52:43.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:42 smithi073 ceph-mon[128869]: Updating smithi152:/etc/ceph/ceph.conf 2023-08-10T11:52:43.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:42 smithi073 ceph-mon[128869]: Updating smithi156:/etc/ceph/ceph.conf 2023-08-10T11:52:43.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:42 smithi073 ceph-mon[128869]: Updating smithi152:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T11:52:43.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:42 smithi073 ceph-mon[128869]: Updating smithi073:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T11:52:43.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:42 smithi073 ceph-mon[128869]: Updating smithi156:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T11:52:43.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:42 smithi073 ceph-mon[128869]: mgrmap e23: x(active, since 4s), standbys: z, y 2023-08-10T11:52:43.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:43 smithi152 ceph-mon[130220]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2023-08-10T11:52:43.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:43 smithi152 ceph-mon[130220]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2023-08-10T11:52:43.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:43 smithi152 ceph-mon[130220]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2023-08-10T11:52:43.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:43 smithi152 ceph-mon[130220]: Updating smithi152:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T11:52:43.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:43 smithi152 ceph-mon[130220]: Updating smithi073:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T11:52:43.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:43 smithi152 ceph-mon[130220]: Updating smithi156:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T11:52:43.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:43 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:43.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:43 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:43.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:43 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:43.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:43 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:43.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:43 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:43.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:43 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:43.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:43 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:43.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:43 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:52:43.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:43 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:52:43.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:43 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:52:43.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:43 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:44.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:43 smithi156 ceph-mon[130574]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2023-08-10T11:52:44.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:43 smithi156 ceph-mon[130574]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2023-08-10T11:52:44.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:43 smithi156 ceph-mon[130574]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2023-08-10T11:52:44.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:43 smithi156 ceph-mon[130574]: Updating smithi152:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T11:52:44.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:43 smithi156 ceph-mon[130574]: Updating smithi073:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T11:52:44.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:43 smithi156 ceph-mon[130574]: Updating smithi156:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T11:52:44.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:43 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:44.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:43 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:44.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:43 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:44.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:43 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:44.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:43 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:44.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:43 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:44.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:43 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:44.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:43 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:52:44.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:43 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:52:44.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:43 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:52:44.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:43 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:44.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:43 smithi073 ceph-mon[128869]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2023-08-10T11:52:44.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:43 smithi073 ceph-mon[128869]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2023-08-10T11:52:44.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:43 smithi073 ceph-mon[128869]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2023-08-10T11:52:44.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:43 smithi073 ceph-mon[128869]: Updating smithi152:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T11:52:44.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:43 smithi073 ceph-mon[128869]: Updating smithi073:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T11:52:44.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:43 smithi073 ceph-mon[128869]: Updating smithi156:/var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T11:52:44.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:43 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:44.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:43 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:44.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:43 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:44.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:43 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:44.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:43 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:44.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:43 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:44.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:43 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:44.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:43 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:52:44.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:43 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:52:44.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:43 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:52:44.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:43 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:52:44.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:44 smithi152 ceph-mon[130220]: pgmap v6: 97 pgs: 97 active+clean; 1.0 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:52:45.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:44 smithi156 ceph-mon[130574]: pgmap v6: 97 pgs: 97 active+clean; 1.0 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:52:45.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:44 smithi073 ceph-mon[128869]: pgmap v6: 97 pgs: 97 active+clean; 1.0 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T11:52:46.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:46 smithi152 ceph-mon[130220]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 133 KiB/s wr, 72 op/s 2023-08-10T11:52:47.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:46 smithi156 ceph-mon[130574]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 133 KiB/s wr, 72 op/s 2023-08-10T11:52:47.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:46 smithi073 ceph-mon[128869]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 133 KiB/s wr, 72 op/s 2023-08-10T11:52:48.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:48 smithi152 ceph-mon[130220]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 103 KiB/s wr, 56 op/s 2023-08-10T11:52:49.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:48 smithi156 ceph-mon[130574]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 103 KiB/s wr, 56 op/s 2023-08-10T11:52:49.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:48 smithi073 ceph-mon[128869]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 103 KiB/s wr, 56 op/s 2023-08-10T11:52:50.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:50 smithi152 ceph-mon[130220]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 84 KiB/s wr, 50 op/s 2023-08-10T11:52:51.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:50 smithi156 ceph-mon[130574]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 84 KiB/s wr, 50 op/s 2023-08-10T11:52:51.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:50 smithi073 ceph-mon[128869]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 84 KiB/s wr, 50 op/s 2023-08-10T11:52:52.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:52 smithi152 ceph-mon[130220]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 46 op/s 2023-08-10T11:52:53.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:52 smithi156 ceph-mon[130574]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 46 op/s 2023-08-10T11:52:53.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:52 smithi073 ceph-mon[128869]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 46 op/s 2023-08-10T11:52:53.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.230+0000 7f65c6f90700 1 -- 172.21.15.73:0/2320183249 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65c01001c0 msgr2=0x7f65c010c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:53.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.230+0000 7f65c6f90700 1 --2- 172.21.15.73:0/2320183249 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65c01001c0 0x7f65c010c4c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f65b800b0a0 tx=0x7f65b800b3b0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.230+0000 7f65c6f90700 1 -- 172.21.15.73:0/2320183249 shutdown_connections 2023-08-10T11:52:53.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.230+0000 7f65c6f90700 1 --2- 172.21.15.73:0/2320183249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65c0105690 0x7f65c0105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.230+0000 7f65c6f90700 1 --2- 172.21.15.73:0/2320183249 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65c01001c0 0x7f65c010c4c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.230+0000 7f65c6f90700 1 --2- 172.21.15.73:0/2320183249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65c00ff800 0x7f65c00ffc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.230+0000 7f65c6f90700 1 -- 172.21.15.73:0/2320183249 >> 172.21.15.73:0/2320183249 conn(0x7f65c0077540 msgr2=0x7f65c0077950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.230+0000 7f65c6f90700 1 -- 172.21.15.73:0/2320183249 shutdown_connections 2023-08-10T11:52:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.230+0000 7f65c6f90700 1 -- 172.21.15.73:0/2320183249 wait complete. 2023-08-10T11:52:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.231+0000 7f65c6f90700 1 Processor -- start 2023-08-10T11:52:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.231+0000 7f65c6f90700 1 -- start start 2023-08-10T11:52:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.231+0000 7f65c6f90700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65c00ff800 0x7f65c019e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.231+0000 7f65c6f90700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65c01001c0 0x7f65c019ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.231+0000 7f65c6f90700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65c0105690 0x7f65c0198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.231+0000 7f65c6f90700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c0198ee0 con 0x7f65c01001c0 2023-08-10T11:52:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.231+0000 7f65c6f90700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c0199050 con 0x7f65c0105690 2023-08-10T11:52:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.231+0000 7f65c6f90700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c0199210 con 0x7f65c00ff800 2023-08-10T11:52:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.231+0000 7f65bffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65c01001c0 0x7f65c019ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.231+0000 7f65bffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65c01001c0 0x7f65c019ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:32950/0 (socket says 172.21.15.73:32950) 2023-08-10T11:52:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.231+0000 7f65bffff700 1 -- 172.21.15.73:0/4082266271 learned_addr learned my addr 172.21.15.73:0/4082266271 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.231+0000 7f65c552d700 1 --2- 172.21.15.73:0/4082266271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65c0105690 0x7f65c0198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.232+0000 7f65c4d2c700 1 --2- 172.21.15.73:0/4082266271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65c00ff800 0x7f65c019e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.232+0000 7f65bffff700 1 -- 172.21.15.73:0/4082266271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65c00ff800 msgr2=0x7f65c019e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.232+0000 7f65bffff700 1 --2- 172.21.15.73:0/4082266271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65c00ff800 0x7f65c019e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.232+0000 7f65bffff700 1 -- 172.21.15.73:0/4082266271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65c0105690 msgr2=0x7f65c0198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:53.237 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.232+0000 7f65bffff700 1 --2- 172.21.15.73:0/4082266271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65c0105690 0x7f65c0198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.232+0000 7f65bffff700 1 -- 172.21.15.73:0/4082266271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b8009d00 con 0x7f65c01001c0 2023-08-10T11:52:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.232+0000 7f65c4d2c700 1 --2- 172.21.15.73:0/4082266271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65c00ff800 0x7f65c019e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:52:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.232+0000 7f65bffff700 1 --2- 172.21.15.73:0/4082266271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65c01001c0 0x7f65c019ee80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00d950 tx=0x7f65ac00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.232+0000 7f65bdffb700 1 -- 172.21.15.73:0/4082266271 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac009b40 con 0x7f65c01001c0 2023-08-10T11:52:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.232+0000 7f65bdffb700 1 -- 172.21.15.73:0/4082266271 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f65ac009ca0 con 0x7f65c01001c0 2023-08-10T11:52:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.232+0000 7f65c6f90700 1 -- 172.21.15.73:0/4082266271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c01994f0 con 0x7f65c01001c0 2023-08-10T11:52:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.232+0000 7f65bdffb700 1 -- 172.21.15.73:0/4082266271 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac00f620 con 0x7f65c01001c0 2023-08-10T11:52:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.232+0000 7f65c6f90700 1 -- 172.21.15.73:0/4082266271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c01a58c0 con 0x7f65c01001c0 2023-08-10T11:52:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.234+0000 7f65bdffb700 1 -- 172.21.15.73:0/4082266271 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 23) v1 ==== 135891+0+0 (secure 0 0 0) 0x7f65ac010460 con 0x7f65c01001c0 2023-08-10T11:52:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.234+0000 7f65bdffb700 1 --2- 172.21.15.73:0/4082266271 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f65b00a1350 0x7f65b00a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:53.243 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.235+0000 7f65bdffb700 1 -- 172.21.15.73:0/4082266271 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f65ac0cd210 con 0x7f65c01001c0 2023-08-10T11:52:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.235+0000 7f65c4d2c700 1 --2- 172.21.15.73:0/4082266271 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f65b00a1350 0x7f65b00a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.235+0000 7f65c4d2c700 1 --2- 172.21.15.73:0/4082266271 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f65b00a1350 0x7f65b00a3810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f65b4005e10 tx=0x7f65b4005d20 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.236+0000 7f65d3129b80 1 Processor -- start 2023-08-10T11:52:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.236+0000 7f65d3129b80 1 -- start start 2023-08-10T11:52:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.236+0000 7f65d3129b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561da4b5ca40 0x561da4b5ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.236+0000 7f65d3129b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b5d360 0x561da4b57010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.236+0000 7f65d3129b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561da4b57550 0x561da4b579d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.236+0000 7f65d3129b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561da4ad2d60 con 0x561da4b5d360 2023-08-10T11:52:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.236+0000 7f65d3129b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561da4aaf530 con 0x561da4b5ca40 2023-08-10T11:52:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.236+0000 7f65d3129b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561da4aace50 con 0x561da4b57550 2023-08-10T11:52:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.236+0000 7f65bffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b5d360 0x561da4b57010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.236+0000 7f65bffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b5d360 0x561da4b57010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:32958/0 (socket says 172.21.15.73:32958) 2023-08-10T11:52:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.236+0000 7f65bffff700 1 -- 172.21.15.73:0/1895296087 learned_addr learned my addr 172.21.15.73:0/1895296087 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.236+0000 7f65c4d2c700 1 --2- 172.21.15.73:0/1895296087 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561da4b5ca40 0x561da4b5ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:53.246 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.236+0000 7f65bffff700 1 -- 172.21.15.73:0/1895296087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561da4b57550 msgr2=0x561da4b579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:53.246 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.236+0000 7f65bffff700 1 --2- 172.21.15.73:0/1895296087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561da4b57550 0x561da4b579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.246 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.236+0000 7f65bffff700 1 -- 172.21.15.73:0/1895296087 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561da4b5ca40 msgr2=0x561da4b5ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:53.246 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.236+0000 7f65bffff700 1 --2- 172.21.15.73:0/1895296087 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561da4b5ca40 0x561da4b5ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.246 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.236+0000 7f65bffff700 1 -- 172.21.15.73:0/1895296087 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561da49295d0 con 0x561da4b5d360 2023-08-10T11:52:53.246 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.236+0000 7f65bffff700 1 --2- 172.21.15.73:0/1895296087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b5d360 0x561da4b57010 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0966a0 tx=0x7f65ac099d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f049da77402fc72 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:53.246 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.237+0000 7f65aaffd700 1 -- 172.21.15.73:0/1895296087 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac0adea0 con 0x561da4b5d360 2023-08-10T11:52:53.246 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.237+0000 7f65aaffd700 1 -- 172.21.15.73:0/1895296087 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f65ac09e1d0 con 0x561da4b5d360 2023-08-10T11:52:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.237+0000 7f65aaffd700 1 -- 172.21.15.73:0/1895296087 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac09a400 con 0x561da4b5d360 2023-08-10T11:52:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.237+0000 7f65d3129b80 1 -- 172.21.15.73:0/1895296087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b5d360 msgr2=0x561da4b57010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.237+0000 7f65d3129b80 1 --2- 172.21.15.73:0/1895296087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b5d360 0x561da4b57010 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0966a0 tx=0x7f65ac099d60 comp rx=0 tx=0).stop 2023-08-10T11:52:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.237+0000 7f65d3129b80 1 -- 172.21.15.73:0/1895296087 shutdown_connections 2023-08-10T11:52:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.237+0000 7f65d3129b80 1 --2- 172.21.15.73:0/1895296087 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561da4b5ca40 0x561da4b5ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.237+0000 7f65d3129b80 1 --2- 172.21.15.73:0/1895296087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561da4b57550 0x561da4b579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.237+0000 7f65d3129b80 1 --2- 172.21.15.73:0/1895296087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b5d360 0x561da4b57010 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.237+0000 7f65d3129b80 1 -- 172.21.15.73:0/1895296087 >> 172.21.15.73:0/1895296087 conn(0x561da4ab4c70 msgr2=0x561da4b51d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.237+0000 7f65d3129b80 1 -- 172.21.15.73:0/1895296087 shutdown_connections 2023-08-10T11:52:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.237+0000 7f65d3129b80 1 -- 172.21.15.73:0/1895296087 wait complete. 2023-08-10T11:52:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.238+0000 7f65d3129b80 1 -- start start 2023-08-10T11:52:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.238+0000 7f65d3129b80 1 Processor -- start 2023-08-10T11:52:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.238+0000 7f65d3129b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b57550 0x561da4b60720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.238+0000 7f65d3129b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561da4b5ca40 0x561da4b60c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.238+0000 7f65d3129b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561da4b5d360 0x561da4b611a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.238+0000 7f65d3129b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561da4aa8740 con 0x561da4b57550 2023-08-10T11:52:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.238+0000 7f65d3129b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561da4a47a60 con 0x561da4b5ca40 2023-08-10T11:52:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.238+0000 7f65d3129b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561da4a47760 con 0x561da4b5d360 2023-08-10T11:52:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.238+0000 7f65d3129b80 10 client.0 _ll_register_callbacks cb 0x561da4a45620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:52:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.238+0000 7f65c4d2c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b57550 0x561da4b60720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:53.250 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.238+0000 7f65c4d2c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b57550 0x561da4b60720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:32962/0 (socket says 172.21.15.73:32962) 2023-08-10T11:52:53.250 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.238+0000 7f65c4d2c700 1 -- 172.21.15.73:0/4115797377 learned_addr learned my addr 172.21.15.73:0/4115797377 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:53.250 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.238+0000 7f65c552d700 1 --2- 172.21.15.73:0/4115797377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561da4b5d360 0x561da4b611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:53.250 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.238+0000 7f65bffff700 1 --2- 172.21.15.73:0/4115797377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561da4b5ca40 0x561da4b60c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:53.250 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.239+0000 7f65c4d2c700 1 -- 172.21.15.73:0/4115797377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561da4b5d360 msgr2=0x561da4b611a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:53.250 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.239+0000 7f65c4d2c700 1 --2- 172.21.15.73:0/4115797377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561da4b5d360 0x561da4b611a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.250 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.239+0000 7f65c4d2c700 1 -- 172.21.15.73:0/4115797377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561da4b5ca40 msgr2=0x561da4b60c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:53.250 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.239+0000 7f65c4d2c700 1 --2- 172.21.15.73:0/4115797377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561da4b5ca40 0x561da4b60c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.239+0000 7f65c4d2c700 1 -- 172.21.15.73:0/4115797377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c01a58c0 con 0x561da4b57550 2023-08-10T11:52:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.239+0000 7f65c4d2c700 1 --2- 172.21.15.73:0/4115797377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b57550 0x561da4b60720 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f65b4011720 tx=0x7f65b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c1b77860e57f87 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.239+0000 7f659ffff700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:52:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.239+0000 7f659ffff700 1 -- 172.21.15.73:0/4115797377 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b401f830 con 0x561da4b57550 2023-08-10T11:52:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.239+0000 7f659ffff700 1 -- 172.21.15.73:0/4115797377 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f65b401f990 con 0x561da4b57550 2023-08-10T11:52:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.239+0000 7f65d3129b80 1 -- 172.21.15.73:0/4115797377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561da4b4a1c0 con 0x561da4b57550 2023-08-10T11:52:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.239+0000 7f659ffff700 1 -- 172.21.15.73:0/4115797377 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65b401fb50 con 0x561da4b57550 2023-08-10T11:52:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.239+0000 7f65d3129b80 10 client.15573 fetch_fsmap learned FSMap version 27 2023-08-10T11:52:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.239+0000 7f65d3129b80 1 -- 172.21.15.73:0/4115797377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561da48d5d80 con 0x561da4b57550 2023-08-10T11:52:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.239+0000 7f659ffff700 1 -- 172.21.15.73:0/4115797377 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561da4b4a1c0 con 0x561da4b57550 2023-08-10T11:52:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.240+0000 7f659ffff700 1 -- 172.21.15.73:0/4115797377 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f65b40050b0 con 0x561da4b57550 2023-08-10T11:52:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.240+0000 7f65d3129b80 10 client.15573 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:52:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.240+0000 7f65d3129b80 10 client.15573 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:52:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.240+0000 7f65d3129b80 20 client.15573 populate_metadata read hostname 'smithi073' 2023-08-10T11:52:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.240+0000 7f65d3129b80 1 --2- 172.21.15.73:0/4115797377 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561da4b70db0 0x561da4b731d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:53.253 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.240+0000 7f65d3129b80 4 client.15573 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:52:53.253 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.240+0000 7f65d3129b80 1 -- 172.21.15.73:0/4115797377 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561da4b26970 con 0x561da4b70db0 2023-08-10T11:52:53.253 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.240+0000 7f65bffff700 1 --2- 172.21.15.73:0/4115797377 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561da4b70db0 0x561da4b731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:53.253 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.240+0000 7f659ffff700 10 client.15573 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:52:53.253 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.240+0000 7f65bffff700 1 --2- 172.21.15.73:0/4115797377 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561da4b70db0 0x561da4b731d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12c5158946fdeb27 server_cookie=cd26163bca66429e in_seq=0 out_seq=0 2023-08-10T11:52:53.253 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.241+0000 7f659ffff700 1 -- 172.21.15.73:0/4115797377 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x561da4b26970 con 0x561da4b70db0 2023-08-10T11:52:53.253 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.241+0000 7f659ffff700 10 client.15573 handle_command_reply: tid=0 2023-08-10T11:52:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.241+0000 7f65d3129b80 1 client.15573 shutdown 2023-08-10T11:52:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.241+0000 7f65d3129b80 1 -- 172.21.15.73:0/4115797377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b57550 msgr2=0x561da4b60720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.241+0000 7f65d3129b80 1 --2- 172.21.15.73:0/4115797377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b57550 0x561da4b60720 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f65b4011720 tx=0x7f65b4004750 comp rx=0 tx=0).stop 2023-08-10T11:52:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.241+0000 7f65d3129b80 1 -- 172.21.15.73:0/4115797377 shutdown_connections 2023-08-10T11:52:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.241+0000 7f65d3129b80 1 --2- 172.21.15.73:0/4115797377 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561da4b70db0 0x561da4b731d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.241+0000 7f65d3129b80 1 --2- 172.21.15.73:0/4115797377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561da4b5d360 0x561da4b611a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.241+0000 7f659ffff700 0 client.15573 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:52:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.241+0000 7f65d3129b80 1 --2- 172.21.15.73:0/4115797377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b57550 0x561da4b60720 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.241+0000 7f65d3129b80 1 --2- 172.21.15.73:0/4115797377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561da4b5ca40 0x561da4b60c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.241+0000 7f65d3129b80 1 -- 172.21.15.73:0/4115797377 >> 172.21.15.73:0/4115797377 conn(0x561da4ab4c70 msgr2=0x561da4b514b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.241+0000 7f65d3129b80 1 -- 172.21.15.73:0/4115797377 shutdown_connections 2023-08-10T11:52:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.241+0000 7f65d3129b80 1 -- 172.21.15.73:0/4115797377 wait complete. 2023-08-10T11:52:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.241+0000 7f65d3129b80 20 client.15573 trim_cache size 0 max 16384 2023-08-10T11:52:53.258 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.256+0000 7f65d3129b80 1 Processor -- start 2023-08-10T11:52:53.258 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.256+0000 7f65d3129b80 1 -- start start 2023-08-10T11:52:53.258 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.256+0000 7f65d3129b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561da4b57550 0x561da4b57010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:53.259 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.256+0000 7f65d3129b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561da4b5ca40 0x561da4b77b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:53.259 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.256+0000 7f65d3129b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b5d360 0x561da4b51c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:53.259 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.256+0000 7f65d3129b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561da492b8c0 con 0x561da4b5d360 2023-08-10T11:52:53.259 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.256+0000 7f65d3129b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561da4b53450 con 0x561da4b57550 2023-08-10T11:52:53.259 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.256+0000 7f65d3129b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561da4b5a480 con 0x561da4b5ca40 2023-08-10T11:52:53.259 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.256+0000 7f65c552d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b5d360 0x561da4b51c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:53.259 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.256+0000 7f65c552d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b5d360 0x561da4b51c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:32974/0 (socket says 172.21.15.73:32974) 2023-08-10T11:52:53.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.256+0000 7f65c552d700 1 -- 172.21.15.73:0/1869903513 learned_addr learned my addr 172.21.15.73:0/1869903513 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:53.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.256+0000 7f65c4d2c700 1 --2- 172.21.15.73:0/1869903513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561da4b57550 0x561da4b57010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:53.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.256+0000 7f65bffff700 1 --2- 172.21.15.73:0/1869903513 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561da4b5ca40 0x561da4b77b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:53.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.256+0000 7f65c552d700 1 -- 172.21.15.73:0/1869903513 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561da4b5ca40 msgr2=0x561da4b77b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:53.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.256+0000 7f65c552d700 1 --2- 172.21.15.73:0/1869903513 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561da4b5ca40 0x561da4b77b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.256+0000 7f65c552d700 1 -- 172.21.15.73:0/1869903513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561da4b57550 msgr2=0x561da4b57010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:53.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.256+0000 7f65c552d700 1 --2- 172.21.15.73:0/1869903513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561da4b57550 0x561da4b57010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.256+0000 7f65c552d700 1 -- 172.21.15.73:0/1869903513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561da48bec00 con 0x561da4b5d360 2023-08-10T11:52:53.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.256+0000 7f65c552d700 1 --2- 172.21.15.73:0/1869903513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b5d360 0x561da4b51c30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f65b8015000 tx=0x7f65b80091b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=703cbaa1051010e9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:53.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.257+0000 7f65ab7fe700 1 -- 172.21.15.73:0/1869903513 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b800e040 con 0x561da4b5d360 2023-08-10T11:52:53.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.257+0000 7f65ab7fe700 1 -- 172.21.15.73:0/1869903513 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f65b80074e0 con 0x561da4b5d360 2023-08-10T11:52:53.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.257+0000 7f65ab7fe700 1 -- 172.21.15.73:0/1869903513 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b80054a0 con 0x561da4b5d360 2023-08-10T11:52:53.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.257+0000 7f65d3129b80 1 -- 172.21.15.73:0/1869903513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b5d360 msgr2=0x561da4b51c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:53.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.257+0000 7f65d3129b80 1 --2- 172.21.15.73:0/1869903513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b5d360 0x561da4b51c30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f65b8015000 tx=0x7f65b80091b0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.257+0000 7f65d3129b80 1 -- 172.21.15.73:0/1869903513 shutdown_connections 2023-08-10T11:52:53.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.257+0000 7f65d3129b80 1 --2- 172.21.15.73:0/1869903513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561da4b57550 0x561da4b57010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.257+0000 7f65d3129b80 1 --2- 172.21.15.73:0/1869903513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b5d360 0x561da4b51c30 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.257+0000 7f65d3129b80 1 --2- 172.21.15.73:0/1869903513 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561da4b5ca40 0x561da4b77b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.257+0000 7f65d3129b80 1 -- 172.21.15.73:0/1869903513 >> 172.21.15.73:0/1869903513 conn(0x561da4ab4c70 msgr2=0x561da4b5d780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:53.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.257+0000 7f65d3129b80 1 -- 172.21.15.73:0/1869903513 shutdown_connections 2023-08-10T11:52:53.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.257+0000 7f65d3129b80 1 -- 172.21.15.73:0/1869903513 wait complete. 2023-08-10T11:52:53.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.257+0000 7f65d3129b80 1 -- start start 2023-08-10T11:52:53.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.258+0000 7f65d3129b80 1 Processor -- start 2023-08-10T11:52:53.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.258+0000 7f65d3129b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561da4b57550 0x561da4b67a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:53.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.258+0000 7f65d3129b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b5ca40 0x561da4b65d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:53.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.258+0000 7f65d3129b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561da4b5d360 0x561da4b662a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:53.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.258+0000 7f65d3129b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561da4b667e0 con 0x561da4b5ca40 2023-08-10T11:52:53.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.258+0000 7f65d3129b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561da4b66950 con 0x561da4b57550 2023-08-10T11:52:53.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.258+0000 7f65d3129b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561da4b66b10 con 0x561da4b5d360 2023-08-10T11:52:53.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.258+0000 7f65d3129b80 10 client.0 _ll_register_callbacks cb 0x561da4a45620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:52:53.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.258+0000 7f65bffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b5ca40 0x561da4b65d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:53.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.258+0000 7f65bffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b5ca40 0x561da4b65d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:32978/0 (socket says 172.21.15.73:32978) 2023-08-10T11:52:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.258+0000 7f65bffff700 1 -- 172.21.15.73:0/2367237721 learned_addr learned my addr 172.21.15.73:0/2367237721 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:52:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.258+0000 7f65c552d700 1 --2- 172.21.15.73:0/2367237721 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561da4b5d360 0x561da4b662a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.258+0000 7f65c4d2c700 1 --2- 172.21.15.73:0/2367237721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561da4b57550 0x561da4b67a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.258+0000 7f65bffff700 1 -- 172.21.15.73:0/2367237721 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561da4b5d360 msgr2=0x561da4b662a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.258+0000 7f65bffff700 1 --2- 172.21.15.73:0/2367237721 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561da4b5d360 0x561da4b662a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.258+0000 7f65bffff700 1 -- 172.21.15.73:0/2367237721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561da4b57550 msgr2=0x561da4b67a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:52:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.258+0000 7f65bffff700 1 --2- 172.21.15.73:0/2367237721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561da4b57550 0x561da4b67a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.258+0000 7f65bffff700 1 -- 172.21.15.73:0/2367237721 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c010cdc0 con 0x561da4b5ca40 2023-08-10T11:52:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.258+0000 7f65c4d2c700 1 --2- 172.21.15.73:0/2367237721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561da4b57550 0x561da4b67a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:52:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.259+0000 7f65bffff700 1 --2- 172.21.15.73:0/2367237721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b5ca40 0x561da4b65d60 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0966a0 tx=0x7f65ac09a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7d3970fc99338d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:52:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.259+0000 7f659ffff700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:52:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.259+0000 7f659ffff700 1 -- 172.21.15.73:0/2367237721 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac0b2040 con 0x561da4b5ca40 2023-08-10T11:52:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.259+0000 7f659ffff700 1 -- 172.21.15.73:0/2367237721 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f65ac010910 con 0x561da4b5ca40 2023-08-10T11:52:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.259+0000 7f65d3129b80 1 -- 172.21.15.73:0/2367237721 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f65ac09e1d0 con 0x561da4b5ca40 2023-08-10T11:52:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.259+0000 7f659ffff700 1 -- 172.21.15.73:0/2367237721 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65ac0adea0 con 0x561da4b5ca40 2023-08-10T11:52:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.259+0000 7f65d3129b80 10 client.15579 fetch_fsmap learned FSMap version 27 2023-08-10T11:52:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.259+0000 7f65d3129b80 1 -- 172.21.15.73:0/2367237721 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561da48fc1f0 con 0x561da4b5ca40 2023-08-10T11:52:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.259+0000 7f659ffff700 1 -- 172.21.15.73:0/2367237721 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f65ac09e1d0 con 0x561da4b5ca40 2023-08-10T11:52:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.259+0000 7f659ffff700 1 -- 172.21.15.73:0/2367237721 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f65ac0a2160 con 0x561da4b5ca40 2023-08-10T11:52:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.259+0000 7f65d3129b80 10 client.15579 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:52:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.259+0000 7f65d3129b80 10 client.15579 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:52:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.259+0000 7f65d3129b80 20 client.15579 populate_metadata read hostname 'smithi073' 2023-08-10T11:52:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.259+0000 7f65d3129b80 1 --2- 172.21.15.73:0/2367237721 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561da4bc59d0 0x561da4bc7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:52:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.259+0000 7f65d3129b80 4 client.15579 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:52:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.259+0000 7f65d3129b80 1 -- 172.21.15.73:0/2367237721 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561da4aa1720 con 0x561da4bc59d0 2023-08-10T11:52:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.260+0000 7f65c4d2c700 1 --2- 172.21.15.73:0/2367237721 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561da4bc59d0 0x561da4bc7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:52:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.260+0000 7f659ffff700 10 client.15579 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:52:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.260+0000 7f65c4d2c700 1 --2- 172.21.15.73:0/2367237721 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561da4bc59d0 0x561da4bc7df0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b82421fb37d84f46 server_cookie=f8e3d2be06b5f65b in_seq=0 out_seq=0 2023-08-10T11:52:53.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.273+0000 7f659ffff700 1 -- 172.21.15.73:0/2367237721 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561da4aa1720 con 0x561da4bc59d0 2023-08-10T11:52:53.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.273+0000 7f659ffff700 10 client.15579 handle_command_reply: tid=0 2023-08-10T11:52:53.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.273+0000 7f65d3129b80 1 client.15579 shutdown 2023-08-10T11:52:53.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.273+0000 7f65d3129b80 1 -- 172.21.15.73:0/2367237721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b5ca40 msgr2=0x561da4b65d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:53.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.273+0000 7f65d3129b80 1 --2- 172.21.15.73:0/2367237721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b5ca40 0x561da4b65d60 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0966a0 tx=0x7f65ac09a320 comp rx=0 tx=0).stop 2023-08-10T11:52:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.273+0000 7f65d3129b80 1 -- 172.21.15.73:0/2367237721 shutdown_connections 2023-08-10T11:52:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.273+0000 7f65d3129b80 1 --2- 172.21.15.73:0/2367237721 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561da4bc59d0 0x561da4bc7df0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.273+0000 7f65d3129b80 1 --2- 172.21.15.73:0/2367237721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561da4b57550 0x561da4b67a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.273+0000 7f659ffff700 0 client.15579 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:52:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.273+0000 7f65d3129b80 1 --2- 172.21.15.73:0/2367237721 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561da4b5d360 0x561da4b662a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.273+0000 7f65d3129b80 1 --2- 172.21.15.73:0/2367237721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561da4b5ca40 0x561da4b65d60 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.273+0000 7f65d3129b80 1 -- 172.21.15.73:0/2367237721 >> 172.21.15.73:0/2367237721 conn(0x561da4ab4c70 msgr2=0x561da4b5bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.273+0000 7f65d3129b80 1 -- 172.21.15.73:0/2367237721 shutdown_connections 2023-08-10T11:52:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.273+0000 7f65d3129b80 1 -- 172.21.15.73:0/2367237721 wait complete. 2023-08-10T11:52:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.273+0000 7f65d3129b80 20 client.15579 trim_cache size 0 max 16384 2023-08-10T11:52:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:52:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:52:53.278 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:52:53.278 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:52:53.279 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.274+0000 7f65c6f90700 1 -- 172.21.15.73:0/4082266271 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f65b00a1350 msgr2=0x7f65b00a3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:53.279 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.274+0000 7f65c6f90700 1 --2- 172.21.15.73:0/4082266271 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f65b00a1350 0x7f65b00a3810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f65b4005e10 tx=0x7f65b4005d20 comp rx=0 tx=0).stop 2023-08-10T11:52:53.279 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.274+0000 7f65c6f90700 1 -- 172.21.15.73:0/4082266271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65c01001c0 msgr2=0x7f65c019ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:52:53.279 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.274+0000 7f65c6f90700 1 --2- 172.21.15.73:0/4082266271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65c01001c0 0x7f65c019ee80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00d950 tx=0x7f65ac00dd10 comp rx=0 tx=0).stop 2023-08-10T11:52:53.279 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.274+0000 7f65c6f90700 1 -- 172.21.15.73:0/4082266271 shutdown_connections 2023-08-10T11:52:53.279 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.274+0000 7f65c6f90700 1 --2- 172.21.15.73:0/4082266271 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f65b00a1350 0x7f65b00a3810 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.279 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.274+0000 7f65c6f90700 1 --2- 172.21.15.73:0/4082266271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65c0105690 0x7f65c0198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.274+0000 7f65c6f90700 1 --2- 172.21.15.73:0/4082266271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65c00ff800 0x7f65c019e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.274+0000 7f65c6f90700 1 --2- 172.21.15.73:0/4082266271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65c01001c0 0x7f65c019ee80 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:52:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.274+0000 7f65c6f90700 1 -- 172.21.15.73:0/4082266271 >> 172.21.15.73:0/4082266271 conn(0x7f65c0077540 msgr2=0x7f65c00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:52:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.274+0000 7f65c6f90700 1 -- 172.21.15.73:0/4082266271 shutdown_connections 2023-08-10T11:52:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:52:53.274+0000 7f65c6f90700 1 -- 172.21.15.73:0/4082266271 wait complete. 2023-08-10T11:52:54.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:54 smithi152 ceph-mon[130220]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 46 op/s 2023-08-10T11:52:55.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:54 smithi156 ceph-mon[130574]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 46 op/s 2023-08-10T11:52:55.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:54 smithi073 ceph-mon[128869]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 46 op/s 2023-08-10T11:52:56.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:56 smithi152 ceph-mon[130220]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 79 KiB/s wr, 55 op/s 2023-08-10T11:52:57.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:56 smithi156 ceph-mon[130574]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 79 KiB/s wr, 55 op/s 2023-08-10T11:52:57.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:56 smithi073 ceph-mon[128869]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 79 KiB/s wr, 55 op/s 2023-08-10T11:52:58.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:52:58 smithi152 ceph-mon[130220]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2023-08-10T11:52:59.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:52:58 smithi156 ceph-mon[130574]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2023-08-10T11:52:59.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:52:58 smithi073 ceph-mon[128869]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2023-08-10T11:53:00.237 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:53:00.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.378+0000 7fd53faf0700 1 -- 172.21.15.73:0/2333807421 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5380ffda0 msgr2=0x7fd538100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:00.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.378+0000 7fd53faf0700 1 --2- 172.21.15.73:0/2333807421 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5380ffda0 0x7fd538100220 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd528009990 tx=0x7fd528009ca0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.379+0000 7fd53faf0700 1 -- 172.21.15.73:0/2333807421 shutdown_connections 2023-08-10T11:53:00.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.379+0000 7fd53faf0700 1 --2- 172.21.15.73:0/2333807421 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd538100760 0x7fd53810c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.379+0000 7fd53faf0700 1 --2- 172.21.15.73:0/2333807421 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5381045e0 0x7fd5381049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.379+0000 7fd53faf0700 1 --2- 172.21.15.73:0/2333807421 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5380ffda0 0x7fd538100220 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.379+0000 7fd53faf0700 1 -- 172.21.15.73:0/2333807421 >> 172.21.15.73:0/2333807421 conn(0x7fd538076be0 msgr2=0x7fd5380fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:00.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.379+0000 7fd53faf0700 1 -- 172.21.15.73:0/2333807421 shutdown_connections 2023-08-10T11:53:00.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.379+0000 7fd53faf0700 1 -- 172.21.15.73:0/2333807421 wait complete. 2023-08-10T11:53:00.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.379+0000 7fd53faf0700 1 Processor -- start 2023-08-10T11:53:00.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.379+0000 7fd53faf0700 1 -- start start 2023-08-10T11:53:00.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.379+0000 7fd53faf0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5380ffda0 0x7fd5381966f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.379+0000 7fd53faf0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd538100760 0x7fd538196c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.379+0000 7fd53faf0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5381045e0 0x7fd538199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.379+0000 7fd53faf0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53819a5e0 con 0x7fd5381045e0 2023-08-10T11:53:00.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.379+0000 7fd53faf0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53819a750 con 0x7fd5380ffda0 2023-08-10T11:53:00.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.379+0000 7fd53faf0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53819a910 con 0x7fd538100760 2023-08-10T11:53:00.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.380+0000 7fd53e08d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5381045e0 0x7fd538199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.380+0000 7fd53e08d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5381045e0 0x7fd538199fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33012/0 (socket says 172.21.15.73:33012) 2023-08-10T11:53:00.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.380+0000 7fd53e08d700 1 -- 172.21.15.73:0/3811040259 learned_addr learned my addr 172.21.15.73:0/3811040259 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:00.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.380+0000 7fd53d08b700 1 --2- 172.21.15.73:0/3811040259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd538100760 0x7fd538196c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.380+0000 7fd53d88c700 1 --2- 172.21.15.73:0/3811040259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5380ffda0 0x7fd5381966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.380+0000 7fd53e08d700 1 -- 172.21.15.73:0/3811040259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd538100760 msgr2=0x7fd538196c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:00.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.380+0000 7fd53e08d700 1 --2- 172.21.15.73:0/3811040259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd538100760 0x7fd538196c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.380+0000 7fd53e08d700 1 -- 172.21.15.73:0/3811040259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5380ffda0 msgr2=0x7fd5381966f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:00.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.380+0000 7fd53e08d700 1 --2- 172.21.15.73:0/3811040259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5380ffda0 0x7fd5381966f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.380+0000 7fd53e08d700 1 -- 172.21.15.73:0/3811040259 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5280095f0 con 0x7fd5381045e0 2023-08-10T11:53:00.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.380+0000 7fd53d88c700 1 --2- 172.21.15.73:0/3811040259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5380ffda0 0x7fd5381966f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:53:00.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.380+0000 7fd53e08d700 1 --2- 172.21.15.73:0/3811040259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5381045e0 0x7fd538199fe0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd530007d70 tx=0x7fd53000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:00.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.380+0000 7fd52effd700 1 -- 172.21.15.73:0/3811040259 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53000ad40 con 0x7fd5381045e0 2023-08-10T11:53:00.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.380+0000 7fd52effd700 1 -- 172.21.15.73:0/3811040259 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd5300128e0 con 0x7fd5381045e0 2023-08-10T11:53:00.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.380+0000 7fd53faf0700 1 -- 172.21.15.73:0/3811040259 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53819abf0 con 0x7fd5381045e0 2023-08-10T11:53:00.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.380+0000 7fd52effd700 1 -- 172.21.15.73:0/3811040259 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5300116b0 con 0x7fd5381045e0 2023-08-10T11:53:00.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.380+0000 7fd53faf0700 1 -- 172.21.15.73:0/3811040259 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5381a3550 con 0x7fd5381045e0 2023-08-10T11:53:00.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.382+0000 7fd52effd700 1 -- 172.21.15.73:0/3811040259 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 23) v1 ==== 135891+0+0 (secure 0 0 0) 0x7fd530012420 con 0x7fd5381045e0 2023-08-10T11:53:00.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.383+0000 7fd52effd700 1 --2- 172.21.15.73:0/3811040259 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd5240a1350 0x7fd5240a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.383+0000 7fd53d88c700 1 --2- 172.21.15.73:0/3811040259 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd5240a1350 0x7fd5240a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.383+0000 7fd52effd700 1 -- 172.21.15.73:0/3811040259 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd5300cd000 con 0x7fd5381045e0 2023-08-10T11:53:00.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.383+0000 7fd53d88c700 1 --2- 172.21.15.73:0/3811040259 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd5240a1350 0x7fd5240a3810 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd534005950 tx=0x7fd5340058e0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:00.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.384+0000 7fd54bc89b80 1 Processor -- start 2023-08-10T11:53:00.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.384+0000 7fd54bc89b80 1 -- start start 2023-08-10T11:53:00.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.385+0000 7fd54bc89b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf1f50 0x55e790cf2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.385+0000 7fd54bc89b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e790cf2870 0x55e790cec2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.385+0000 7fd54bc89b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e790cec800 0x55e790cecc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.385+0000 7fd54bc89b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e790c67dc0 con 0x55e790cf1f50 2023-08-10T11:53:00.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.385+0000 7fd54bc89b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e790c44590 con 0x55e790cf2870 2023-08-10T11:53:00.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.385+0000 7fd54bc89b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e790c41eb0 con 0x55e790cec800 2023-08-10T11:53:00.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.385+0000 7fd53d88c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf1f50 0x55e790cf2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.385+0000 7fd53d88c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf1f50 0x55e790cf2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33016/0 (socket says 172.21.15.73:33016) 2023-08-10T11:53:00.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.385+0000 7fd53d88c700 1 -- 172.21.15.73:0/85797823 learned_addr learned my addr 172.21.15.73:0/85797823 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:00.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.385+0000 7fd53d08b700 1 --2- 172.21.15.73:0/85797823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e790cf2870 0x55e790cec2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.385+0000 7fd53d88c700 1 -- 172.21.15.73:0/85797823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e790cec800 msgr2=0x55e790cecc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:00.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.385+0000 7fd53d88c700 1 --2- 172.21.15.73:0/85797823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e790cec800 0x55e790cecc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.385+0000 7fd53d88c700 1 -- 172.21.15.73:0/85797823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e790cf2870 msgr2=0x55e790cec2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:00.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.385+0000 7fd53d88c700 1 --2- 172.21.15.73:0/85797823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e790cf2870 0x55e790cec2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.385+0000 7fd53d88c700 1 -- 172.21.15.73:0/85797823 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e790abe630 con 0x55e790cf1f50 2023-08-10T11:53:00.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.385+0000 7fd53d88c700 1 --2- 172.21.15.73:0/85797823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf1f50 0x55e790cf2330 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fd53400ff00 tx=0x7fd534012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b340fc3811efd29 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:00.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.385+0000 7fd523fff700 1 -- 172.21.15.73:0/85797823 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534017040 con 0x55e790cf1f50 2023-08-10T11:53:00.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.385+0000 7fd523fff700 1 -- 172.21.15.73:0/85797823 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd534003d40 con 0x55e790cf1f50 2023-08-10T11:53:00.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.385+0000 7fd523fff700 1 -- 172.21.15.73:0/85797823 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53401fd10 con 0x55e790cf1f50 2023-08-10T11:53:00.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.386+0000 7fd54bc89b80 1 -- 172.21.15.73:0/85797823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf1f50 msgr2=0x55e790cf2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:00.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.386+0000 7fd54bc89b80 1 --2- 172.21.15.73:0/85797823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf1f50 0x55e790cf2330 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fd53400ff00 tx=0x7fd534012000 comp rx=0 tx=0).stop 2023-08-10T11:53:00.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.386+0000 7fd54bc89b80 1 -- 172.21.15.73:0/85797823 shutdown_connections 2023-08-10T11:53:00.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.386+0000 7fd54bc89b80 1 --2- 172.21.15.73:0/85797823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e790cec800 0x55e790cecc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.386+0000 7fd54bc89b80 1 --2- 172.21.15.73:0/85797823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf1f50 0x55e790cf2330 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.386+0000 7fd54bc89b80 1 --2- 172.21.15.73:0/85797823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e790cf2870 0x55e790cec2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.386+0000 7fd54bc89b80 1 -- 172.21.15.73:0/85797823 >> 172.21.15.73:0/85797823 conn(0x55e790c49cd0 msgr2=0x55e790ce74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:00.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.386+0000 7fd54bc89b80 1 -- 172.21.15.73:0/85797823 shutdown_connections 2023-08-10T11:53:00.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.386+0000 7fd54bc89b80 1 -- 172.21.15.73:0/85797823 wait complete. 2023-08-10T11:53:00.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.386+0000 7fd54bc89b80 1 -- start start 2023-08-10T11:53:00.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.386+0000 7fd54bc89b80 1 Processor -- start 2023-08-10T11:53:00.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.387+0000 7fd54bc89b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e790cec800 0x55e790cf5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.387+0000 7fd54bc89b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e790cf1f50 0x55e790cf6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.387+0000 7fd54bc89b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf2870 0x55e790cf66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.387+0000 7fd54bc89b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e790c3d7a0 con 0x55e790cf2870 2023-08-10T11:53:00.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.387+0000 7fd54bc89b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e790bdcac0 con 0x55e790cf1f50 2023-08-10T11:53:00.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.387+0000 7fd54bc89b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e790bdc7c0 con 0x55e790cec800 2023-08-10T11:53:00.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.387+0000 7fd54bc89b80 10 client.0 _ll_register_callbacks cb 0x55e790bda680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:00.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.387+0000 7fd53e08d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf2870 0x55e790cf66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.387+0000 7fd53e08d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf2870 0x55e790cf66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33026/0 (socket says 172.21.15.73:33026) 2023-08-10T11:53:00.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.387+0000 7fd53e08d700 1 -- 172.21.15.73:0/1294763079 learned_addr learned my addr 172.21.15.73:0/1294763079 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:00.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.387+0000 7fd53d88c700 1 --2- 172.21.15.73:0/1294763079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e790cec800 0x55e790cf5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.387+0000 7fd53d08b700 1 --2- 172.21.15.73:0/1294763079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e790cf1f50 0x55e790cf6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.387+0000 7fd53e08d700 1 -- 172.21.15.73:0/1294763079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e790cec800 msgr2=0x55e790cf5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:00.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.387+0000 7fd53e08d700 1 --2- 172.21.15.73:0/1294763079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e790cec800 0x55e790cf5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.387+0000 7fd53e08d700 1 -- 172.21.15.73:0/1294763079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e790cf1f50 msgr2=0x55e790cf6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:00.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.387+0000 7fd53e08d700 1 --2- 172.21.15.73:0/1294763079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e790cf1f50 0x55e790cf6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.387+0000 7fd53e08d700 1 -- 172.21.15.73:0/1294763079 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53400fbe0 con 0x55e790cf2870 2023-08-10T11:53:00.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.388+0000 7fd53e08d700 1 --2- 172.21.15.73:0/1294763079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf2870 0x55e790cf66d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd5300ca860 tx=0x7fd530012a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73226c156543fd0f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:00.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.388+0000 7fd5217fa700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:00.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.388+0000 7fd5217fa700 1 -- 172.21.15.73:0/1294763079 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53009e0d0 con 0x55e790cf2870 2023-08-10T11:53:00.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.388+0000 7fd5217fa700 1 -- 172.21.15.73:0/1294763079 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd5300a24f0 con 0x55e790cf2870 2023-08-10T11:53:00.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.388+0000 7fd54bc89b80 1 -- 172.21.15.73:0/1294763079 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e790cdf470 con 0x55e790cf2870 2023-08-10T11:53:00.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.388+0000 7fd5217fa700 1 -- 172.21.15.73:0/1294763079 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd53009a300 con 0x55e790cf2870 2023-08-10T11:53:00.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.388+0000 7fd54bc89b80 10 client.15597 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:00.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.388+0000 7fd54bc89b80 1 -- 172.21.15.73:0/1294763079 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55e790a6ade0 con 0x55e790cf2870 2023-08-10T11:53:00.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.388+0000 7fd5217fa700 1 -- 172.21.15.73:0/1294763079 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd5300b6080 con 0x55e790cf2870 2023-08-10T11:53:00.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.388+0000 7fd5217fa700 1 -- 172.21.15.73:0/1294763079 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd530004ad0 con 0x55e790cf2870 2023-08-10T11:53:00.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.388+0000 7fd54bc89b80 10 client.15597 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:00.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.388+0000 7fd54bc89b80 10 client.15597 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:53:00.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.388+0000 7fd54bc89b80 20 client.15597 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:00.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.388+0000 7fd54bc89b80 1 --2- 172.21.15.73:0/1294763079 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e790d06350 0x55e790d08770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.388+0000 7fd54bc89b80 4 client.15597 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:53:00.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.388+0000 7fd54bc89b80 1 -- 172.21.15.73:0/1294763079 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e790cbb9d0 con 0x55e790d06350 2023-08-10T11:53:00.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.388+0000 7fd53d88c700 1 --2- 172.21.15.73:0/1294763079 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e790d06350 0x55e790d08770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.389+0000 7fd5217fa700 10 client.15597 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:00.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.389+0000 7fd53d88c700 1 --2- 172.21.15.73:0/1294763079 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e790d06350 0x55e790d08770 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba04e41c462751bd server_cookie=f0da124936686d4a in_seq=0 out_seq=0 2023-08-10T11:53:00.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.389+0000 7fd5217fa700 1 -- 172.21.15.73:0/1294763079 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55e790cbb9d0 con 0x55e790d06350 2023-08-10T11:53:00.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.389+0000 7fd5217fa700 10 client.15597 handle_command_reply: tid=0 2023-08-10T11:53:00.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.390+0000 7fd54bc89b80 1 client.15597 shutdown 2023-08-10T11:53:00.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.390+0000 7fd54bc89b80 1 -- 172.21.15.73:0/1294763079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf2870 msgr2=0x55e790cf66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:00.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.390+0000 7fd54bc89b80 1 --2- 172.21.15.73:0/1294763079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf2870 0x55e790cf66d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd5300ca860 tx=0x7fd530012a50 comp rx=0 tx=0).stop 2023-08-10T11:53:00.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.390+0000 7fd54bc89b80 1 -- 172.21.15.73:0/1294763079 shutdown_connections 2023-08-10T11:53:00.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.390+0000 7fd54bc89b80 1 --2- 172.21.15.73:0/1294763079 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e790d06350 0x55e790d08770 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.390+0000 7fd54bc89b80 1 --2- 172.21.15.73:0/1294763079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf2870 0x55e790cf66d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.390+0000 7fd54bc89b80 1 --2- 172.21.15.73:0/1294763079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e790cec800 0x55e790cf5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.390+0000 7fd5217fa700 0 client.15597 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:00.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.390+0000 7fd54bc89b80 1 --2- 172.21.15.73:0/1294763079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e790cf1f50 0x55e790cf6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.390+0000 7fd54bc89b80 1 -- 172.21.15.73:0/1294763079 >> 172.21.15.73:0/1294763079 conn(0x55e790c49cd0 msgr2=0x55e790ce69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:00.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.390+0000 7fd54bc89b80 1 -- 172.21.15.73:0/1294763079 shutdown_connections 2023-08-10T11:53:00.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.390+0000 7fd54bc89b80 1 -- 172.21.15.73:0/1294763079 wait complete. 2023-08-10T11:53:00.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.390+0000 7fd54bc89b80 20 client.15597 trim_cache size 0 max 16384 2023-08-10T11:53:00.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.406+0000 7fd54bc89b80 1 Processor -- start 2023-08-10T11:53:00.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.407+0000 7fd54bc89b80 1 -- start start 2023-08-10T11:53:00.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.407+0000 7fd54bc89b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e790cec800 0x55e790cfd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.407+0000 7fd54bc89b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e790cf1f50 0x55e790cf13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.407+0000 7fd54bc89b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf2870 0x55e790ce7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.407+0000 7fd54bc89b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e790ac0920 con 0x55e790cf2870 2023-08-10T11:53:00.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.407+0000 7fd54bc89b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e790d03a90 con 0x55e790cec800 2023-08-10T11:53:00.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.407+0000 7fd54bc89b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e790cf87e0 con 0x55e790cf1f50 2023-08-10T11:53:00.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.407+0000 7fd53e08d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf2870 0x55e790ce7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.407+0000 7fd53e08d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf2870 0x55e790ce7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33034/0 (socket says 172.21.15.73:33034) 2023-08-10T11:53:00.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.407+0000 7fd53e08d700 1 -- 172.21.15.73:0/2448020608 learned_addr learned my addr 172.21.15.73:0/2448020608 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:00.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.407+0000 7fd53d88c700 1 --2- 172.21.15.73:0/2448020608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e790cec800 0x55e790cfd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.407+0000 7fd53e08d700 1 -- 172.21.15.73:0/2448020608 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e790cf1f50 msgr2=0x55e790cf13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:00.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.407+0000 7fd53d08b700 1 --2- 172.21.15.73:0/2448020608 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e790cf1f50 0x55e790cf13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.407+0000 7fd53e08d700 1 --2- 172.21.15.73:0/2448020608 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e790cf1f50 0x55e790cf13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.407+0000 7fd53e08d700 1 -- 172.21.15.73:0/2448020608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e790cec800 msgr2=0x55e790cfd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:00.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.407+0000 7fd53e08d700 1 --2- 172.21.15.73:0/2448020608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e790cec800 0x55e790cfd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.407+0000 7fd53e08d700 1 -- 172.21.15.73:0/2448020608 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e790a53c60 con 0x55e790cf2870 2023-08-10T11:53:00.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.407+0000 7fd53d88c700 1 --2- 172.21.15.73:0/2448020608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e790cec800 0x55e790cfd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:00.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.407+0000 7fd53d08b700 1 --2- 172.21.15.73:0/2448020608 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e790cf1f50 0x55e790cf13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:00.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.407+0000 7fd53e08d700 1 --2- 172.21.15.73:0/2448020608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf2870 0x55e790ce7130 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd53000a740 tx=0x7fd530007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b694c8caebef21 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:00.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.407+0000 7fd52cdaa700 1 -- 172.21.15.73:0/2448020608 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53009e0d0 con 0x55e790cf2870 2023-08-10T11:53:00.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.407+0000 7fd52cdaa700 1 -- 172.21.15.73:0/2448020608 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e790cdf470 con 0x55e790cf2870 2023-08-10T11:53:00.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.407+0000 7fd52cdaa700 1 -- 172.21.15.73:0/2448020608 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd530099590 con 0x55e790cf2870 2023-08-10T11:53:00.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.408+0000 7fd54bc89b80 1 -- 172.21.15.73:0/2448020608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf2870 msgr2=0x55e790ce7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:00.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.408+0000 7fd54bc89b80 1 --2- 172.21.15.73:0/2448020608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf2870 0x55e790ce7130 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd53000a740 tx=0x7fd530007ec0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.408+0000 7fd54bc89b80 1 -- 172.21.15.73:0/2448020608 shutdown_connections 2023-08-10T11:53:00.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.408+0000 7fd54bc89b80 1 --2- 172.21.15.73:0/2448020608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e790cec800 0x55e790cfd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.408+0000 7fd54bc89b80 1 --2- 172.21.15.73:0/2448020608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf2870 0x55e790ce7130 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.408+0000 7fd54bc89b80 1 --2- 172.21.15.73:0/2448020608 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e790cf1f50 0x55e790cf13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.408+0000 7fd54bc89b80 1 -- 172.21.15.73:0/2448020608 >> 172.21.15.73:0/2448020608 conn(0x55e790c49cd0 msgr2=0x55e790cf0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:00.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.408+0000 7fd54bc89b80 1 -- 172.21.15.73:0/2448020608 shutdown_connections 2023-08-10T11:53:00.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.408+0000 7fd54bc89b80 1 -- 172.21.15.73:0/2448020608 wait complete. 2023-08-10T11:53:00.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.408+0000 7fd54bc89b80 1 -- start start 2023-08-10T11:53:00.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.408+0000 7fd54bc89b80 1 Processor -- start 2023-08-10T11:53:00.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.409+0000 7fd54bc89b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e790cec800 0x55e790d537a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.409+0000 7fd54bc89b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf1f50 0x55e790d53ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.409+0000 7fd54bc89b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e790cf2870 0x55e790d4df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.409+0000 7fd54bc89b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e790d4e5a0 con 0x55e790cf1f50 2023-08-10T11:53:00.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.409+0000 7fd54bc89b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e790d4e710 con 0x55e790cf2870 2023-08-10T11:53:00.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.409+0000 7fd54bc89b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e790d4e8d0 con 0x55e790cec800 2023-08-10T11:53:00.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.409+0000 7fd54bc89b80 10 client.0 _ll_register_callbacks cb 0x55e790bda680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:00.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.409+0000 7fd53d08b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf1f50 0x55e790d53ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.409+0000 7fd53d08b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf1f50 0x55e790d53ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33038/0 (socket says 172.21.15.73:33038) 2023-08-10T11:53:00.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.409+0000 7fd53d08b700 1 -- 172.21.15.73:0/4254390960 learned_addr learned my addr 172.21.15.73:0/4254390960 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:00.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.409+0000 7fd53d88c700 1 --2- 172.21.15.73:0/4254390960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e790cec800 0x55e790d537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.409+0000 7fd53e08d700 1 --2- 172.21.15.73:0/4254390960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e790cf2870 0x55e790d4df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.409+0000 7fd53d08b700 1 -- 172.21.15.73:0/4254390960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e790cec800 msgr2=0x55e790d537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:00.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.409+0000 7fd53d08b700 1 --2- 172.21.15.73:0/4254390960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e790cec800 0x55e790d537a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.409+0000 7fd53d08b700 1 -- 172.21.15.73:0/4254390960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e790cf2870 msgr2=0x55e790d4df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:00.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.409+0000 7fd53d08b700 1 --2- 172.21.15.73:0/4254390960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e790cf2870 0x55e790d4df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.409+0000 7fd53d08b700 1 -- 172.21.15.73:0/4254390960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e790a6ade0 con 0x55e790cf1f50 2023-08-10T11:53:00.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.409+0000 7fd53e08d700 1 --2- 172.21.15.73:0/4254390960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e790cf2870 0x55e790d4df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:00.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.410+0000 7fd53d08b700 1 --2- 172.21.15.73:0/4254390960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf1f50 0x55e790d53ce0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd5280098e0 tx=0x7fd528009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b97e840f5c32637 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:00.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.410+0000 7fd5217fa700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:00.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.410+0000 7fd5217fa700 1 -- 172.21.15.73:0/4254390960 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd528003d60 con 0x55e790cf1f50 2023-08-10T11:53:00.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.410+0000 7fd5217fa700 1 -- 172.21.15.73:0/4254390960 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd528005070 con 0x55e790cf1f50 2023-08-10T11:53:00.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.410+0000 7fd54bc89b80 1 -- 172.21.15.73:0/4254390960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd534003d40 con 0x55e790cf1f50 2023-08-10T11:53:00.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.410+0000 7fd5217fa700 1 -- 172.21.15.73:0/4254390960 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd528005270 con 0x55e790cf1f50 2023-08-10T11:53:00.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.410+0000 7fd54bc89b80 10 client.15603 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:00.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.410+0000 7fd54bc89b80 1 -- 172.21.15.73:0/4254390960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55e790a91250 con 0x55e790cf1f50 2023-08-10T11:53:00.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.410+0000 7fd5217fa700 1 -- 172.21.15.73:0/4254390960 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd534003d40 con 0x55e790cf1f50 2023-08-10T11:53:00.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.410+0000 7fd5217fa700 1 -- 172.21.15.73:0/4254390960 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd528023040 con 0x55e790cf1f50 2023-08-10T11:53:00.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.410+0000 7fd54bc89b80 10 client.15603 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:00.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.410+0000 7fd54bc89b80 10 client.15603 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:53:00.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.410+0000 7fd54bc89b80 20 client.15603 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:00.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.410+0000 7fd54bc89b80 1 --2- 172.21.15.73:0/4254390960 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e790d5b620 0x55e790d5da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.410+0000 7fd54bc89b80 4 client.15603 mds_command: new command op to 24503 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:53:00.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.410+0000 7fd54bc89b80 1 -- 172.21.15.73:0/4254390960 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e790c36780 con 0x55e790d5b620 2023-08-10T11:53:00.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.410+0000 7fd53d88c700 1 --2- 172.21.15.73:0/4254390960 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e790d5b620 0x55e790d5da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.411+0000 7fd53d88c700 1 --2- 172.21.15.73:0/4254390960 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e790d5b620 0x55e790d5da40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d93ee749fcae7f1 server_cookie=8d2b4fda78644102 in_seq=0 out_seq=0 2023-08-10T11:53:00.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.411+0000 7fd5217fa700 10 client.15603 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:00.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.411+0000 7fd5217fa700 1 -- 172.21.15.73:0/4254390960 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55e790c36780 con 0x55e790d5b620 2023-08-10T11:53:00.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.411+0000 7fd5217fa700 10 client.15603 handle_command_reply: tid=0 2023-08-10T11:53:00.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.411+0000 7fd54bc89b80 1 client.15603 shutdown 2023-08-10T11:53:00.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.411+0000 7fd54bc89b80 1 -- 172.21.15.73:0/4254390960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf1f50 msgr2=0x55e790d53ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:00.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.411+0000 7fd54bc89b80 1 --2- 172.21.15.73:0/4254390960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf1f50 0x55e790d53ce0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd5280098e0 tx=0x7fd528009f70 comp rx=0 tx=0).stop 2023-08-10T11:53:00.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.411+0000 7fd54bc89b80 1 -- 172.21.15.73:0/4254390960 shutdown_connections 2023-08-10T11:53:00.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.411+0000 7fd54bc89b80 1 --2- 172.21.15.73:0/4254390960 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e790d5b620 0x55e790d5da40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.411+0000 7fd54bc89b80 1 --2- 172.21.15.73:0/4254390960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e790cf2870 0x55e790d4df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.411+0000 7fd54bc89b80 1 --2- 172.21.15.73:0/4254390960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e790cec800 0x55e790d537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.411+0000 7fd54bc89b80 1 --2- 172.21.15.73:0/4254390960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e790cf1f50 0x55e790d53ce0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.411+0000 7fd5217fa700 0 client.15603 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:00.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.411+0000 7fd54bc89b80 1 -- 172.21.15.73:0/4254390960 >> 172.21.15.73:0/4254390960 conn(0x55e790c49cd0 msgr2=0x55e790cf1550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:00.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.411+0000 7fd54bc89b80 1 -- 172.21.15.73:0/4254390960 shutdown_connections 2023-08-10T11:53:00.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.411+0000 7fd54bc89b80 1 -- 172.21.15.73:0/4254390960 wait complete. 2023-08-10T11:53:00.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.411+0000 7fd54bc89b80 20 client.15603 trim_cache size 0 max 16384 2023-08-10T11:53:00.433 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:53:00.434 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "no active scrubs running", 2023-08-10T11:53:00.434 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": {} 2023-08-10T11:53:00.434 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:53:00.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.412+0000 7fd53faf0700 1 -- 172.21.15.73:0/3811040259 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd5240a1350 msgr2=0x7fd5240a3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:00.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.412+0000 7fd53faf0700 1 --2- 172.21.15.73:0/3811040259 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd5240a1350 0x7fd5240a3810 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd534005950 tx=0x7fd5340058e0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.412+0000 7fd53faf0700 1 -- 172.21.15.73:0/3811040259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5381045e0 msgr2=0x7fd538199fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:00.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.412+0000 7fd53faf0700 1 --2- 172.21.15.73:0/3811040259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5381045e0 0x7fd538199fe0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd530007d70 tx=0x7fd53000a340 comp rx=0 tx=0).stop 2023-08-10T11:53:00.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.412+0000 7fd53faf0700 1 -- 172.21.15.73:0/3811040259 shutdown_connections 2023-08-10T11:53:00.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.412+0000 7fd53faf0700 1 --2- 172.21.15.73:0/3811040259 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd5240a1350 0x7fd5240a3810 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.412+0000 7fd53faf0700 1 --2- 172.21.15.73:0/3811040259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5380ffda0 0x7fd5381966f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.412+0000 7fd53faf0700 1 --2- 172.21.15.73:0/3811040259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5381045e0 0x7fd538199fe0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.412+0000 7fd53faf0700 1 --2- 172.21.15.73:0/3811040259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd538100760 0x7fd538196c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.412+0000 7fd53faf0700 1 -- 172.21.15.73:0/3811040259 >> 172.21.15.73:0/3811040259 conn(0x7fd538076be0 msgr2=0x7fd5380fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:00.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.412+0000 7fd53faf0700 1 -- 172.21.15.73:0/3811040259 shutdown_connections 2023-08-10T11:53:00.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.412+0000 7fd53faf0700 1 -- 172.21.15.73:0/3811040259 wait complete. 2023-08-10T11:53:00.437 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:53:00 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:53:00.112+0000 7f7fc8cf9700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T11:53:00.437 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:53:00 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:53:00.112+0000 7f7fc8cf9700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T11:53:00.437 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:53:00 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:53:00.112+0000 7f7fc8cf9700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T11:53:00.437 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:53:00 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:53:00.112+0000 7f7fc8cf9700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T11:53:00.437 INFO:journalctl@ceph.mgr.x.smithi073.stdout:Aug 10 11:53:00 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mgr-x[129118]: 2023-08-10T11:53:00.112+0000 7f7fc8cf9700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T11:53:00.438 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-08-10T11:53:00.438 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T11:53:00.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.558+0000 7fa3b3831700 1 -- 172.21.15.73:0/1721682068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3ac105680 msgr2=0x7fa3ac105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:00.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.558+0000 7fa3b3831700 1 --2- 172.21.15.73:0/1721682068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3ac105680 0x7fa3ac105a60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009990 tx=0x7fa39c009ca0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.558+0000 7fa3b3831700 1 -- 172.21.15.73:0/1721682068 shutdown_connections 2023-08-10T11:53:00.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.558+0000 7fa3b3831700 1 --2- 172.21.15.73:0/1721682068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3ac0fffa0 0x7fa3ac10c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.558+0000 7fa3b3831700 1 --2- 172.21.15.73:0/1721682068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3ac105680 0x7fa3ac105a60 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.558+0000 7fa3b3831700 1 --2- 172.21.15.73:0/1721682068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3ac0ff5e0 0x7fa3ac0ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.558+0000 7fa3b3831700 1 -- 172.21.15.73:0/1721682068 >> 172.21.15.73:0/1721682068 conn(0x7fa3ac0fb0d0 msgr2=0x7fa3ac0fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:00.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.558+0000 7fa3b3831700 1 -- 172.21.15.73:0/1721682068 shutdown_connections 2023-08-10T11:53:00.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.558+0000 7fa3b3831700 1 -- 172.21.15.73:0/1721682068 wait complete. 2023-08-10T11:53:00.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.559+0000 7fa3b3831700 1 Processor -- start 2023-08-10T11:53:00.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.559+0000 7fa3b3831700 1 -- start start 2023-08-10T11:53:00.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.559+0000 7fa3b3831700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3ac0ff5e0 0x7fa3ac197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.559+0000 7fa3b3831700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3ac0fffa0 0x7fa3ac197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.559+0000 7fa3b3831700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3ac105680 0x7fa3ac1a2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.559+0000 7fa3b3831700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac198310 con 0x7fa3ac105680 2023-08-10T11:53:00.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.559+0000 7fa3b3831700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac1a2ad0 con 0x7fa3ac0fffa0 2023-08-10T11:53:00.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.559+0000 7fa3b3831700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac1a2c10 con 0x7fa3ac0ff5e0 2023-08-10T11:53:00.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.559+0000 7fa3b1dce700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3ac105680 0x7fa3ac1a2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.559+0000 7fa3b1dce700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3ac105680 0x7fa3ac1a2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33054/0 (socket says 172.21.15.73:33054) 2023-08-10T11:53:00.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.559+0000 7fa3b1dce700 1 -- 172.21.15.73:0/10514076 learned_addr learned my addr 172.21.15.73:0/10514076 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:00.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.559+0000 7fa3b15cd700 1 --2- 172.21.15.73:0/10514076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3ac0ff5e0 0x7fa3ac197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.559+0000 7fa3b0dcc700 1 --2- 172.21.15.73:0/10514076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3ac0fffa0 0x7fa3ac197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.559+0000 7fa3b1dce700 1 -- 172.21.15.73:0/10514076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3ac0ff5e0 msgr2=0x7fa3ac197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:00.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.559+0000 7fa3b1dce700 1 --2- 172.21.15.73:0/10514076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3ac0ff5e0 0x7fa3ac197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.559+0000 7fa3b1dce700 1 -- 172.21.15.73:0/10514076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3ac0fffa0 msgr2=0x7fa3ac197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:00.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.559+0000 7fa3b1dce700 1 --2- 172.21.15.73:0/10514076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3ac0fffa0 0x7fa3ac197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.559+0000 7fa3b1dce700 1 -- 172.21.15.73:0/10514076 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c0095f0 con 0x7fa3ac105680 2023-08-10T11:53:00.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.560+0000 7fa3b1dce700 1 --2- 172.21.15.73:0/10514076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3ac105680 0x7fa3ac1a2590 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4007d70 tx=0x7fa3a400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:00.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.560+0000 7fa3a27fc700 1 -- 172.21.15.73:0/10514076 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a400ad40 con 0x7fa3ac105680 2023-08-10T11:53:00.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.560+0000 7fa3a27fc700 1 -- 172.21.15.73:0/10514076 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3a40128e0 con 0x7fa3ac105680 2023-08-10T11:53:00.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.560+0000 7fa3b3831700 1 -- 172.21.15.73:0/10514076 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ac1a2ef0 con 0x7fa3ac105680 2023-08-10T11:53:00.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.560+0000 7fa3a27fc700 1 -- 172.21.15.73:0/10514076 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a40116b0 con 0x7fa3ac105680 2023-08-10T11:53:00.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.560+0000 7fa3b3831700 1 -- 172.21.15.73:0/10514076 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ac1a3380 con 0x7fa3ac105680 2023-08-10T11:53:00.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.561+0000 7fa3b3831700 1 -- 172.21.15.73:0/10514076 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ac066cd0 con 0x7fa3ac105680 2023-08-10T11:53:00.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.562+0000 7fa3a27fc700 1 -- 172.21.15.73:0/10514076 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 23) v1 ==== 135891+0+0 (secure 0 0 0) 0x7fa3a4012420 con 0x7fa3ac105680 2023-08-10T11:53:00.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.562+0000 7fa3a27fc700 1 --2- 172.21.15.73:0/10514076 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa3980a1390 0x7fa3980a3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.562+0000 7fa3b15cd700 1 --2- 172.21.15.73:0/10514076 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa3980a1390 0x7fa3980a3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.562+0000 7fa3a27fc700 1 -- 172.21.15.73:0/10514076 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fa3a40cd340 con 0x7fa3ac105680 2023-08-10T11:53:00.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.563+0000 7fa3b15cd700 1 --2- 172.21.15.73:0/10514076 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa3980a1390 0x7fa3980a3850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00b2e0 tx=0x7fa39c005fd0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:00.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.566+0000 7fa3a27fc700 1 -- 172.21.15.73:0/10514076 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fa3a4096720 con 0x7fa3ac105680 2023-08-10T11:53:00.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:00 smithi073 ceph-mon[128869]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.8 KiB/s wr, 17 op/s 2023-08-10T11:53:00.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.800+0000 7fa3b3831700 1 -- 172.21.15.73:0/10514076 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3ac068ed0 con 0x7fa3ac105680 2023-08-10T11:53:00.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.801+0000 7fa3a27fc700 1 -- 172.21.15.73:0/10514076 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10891 (secure 0 0 0) 0x7fa3a4023350 con 0x7fa3ac105680 2023-08-10T11:53:00.803 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:53:00.803 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1319360725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1319360725},{"type":"v1","addr":"172.21.15.73:6835","nonce":1319360725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/431221951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":431221951},{"type":"v1","addr":"172.21.15.73:6837","nonce":431221951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-10T11:50:54.304447+0000","modified":"2023-08-10T11:51:01.523452+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24503,"mds_1":24479,"mds_2":24451,"mds_3":24443,"mds_4":24419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6839/1099539481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1099539481},{"type":"v1","addr":"172.21.15.73:6839","nonce":1099539481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6841/3067925859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":3067925859},{"type":"v1","addr":"172.21.15.73:6841","nonce":3067925859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24397":{"gid":24397,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6833/3028461815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3028461815},{"type":"v1","addr":"172.21.15.156:6833","nonce":3028461815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24419":{"gid":24419,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6833/4148407154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4148407154},{"type":"v1","addr":"172.21.15.152:6833","nonce":4148407154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24443":{"gid":24443,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.152:6835/1791572604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1791572604},{"type":"v1","addr":"172.21.15.152:6835","nonce":1791572604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.156:6835/904126790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":904126790},{"type":"v1","addr":"172.21.15.156:6835","nonce":904126790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24457":{"gid":24457,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/4284306352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":4284306352},{"type":"v1","addr":"172.21.15.156:6837","nonce":4284306352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6839/3361058731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":3361058731},{"type":"v1","addr":"172.21.15.156:6839","nonce":3361058731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6837/74214089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":74214089},{"type":"v1","addr":"172.21.15.152:6837","nonce":74214089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6839/3870202690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3870202690},{"type":"v1","addr":"172.21.15.152:6839","nonce":3870202690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T11:53:00.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.803+0000 7fa3b3831700 1 -- 172.21.15.73:0/10514076 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa3980a1390 msgr2=0x7fa3980a3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:00.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.803+0000 7fa3b3831700 1 --2- 172.21.15.73:0/10514076 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa3980a1390 0x7fa3980a3850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00b2e0 tx=0x7fa39c005fd0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.803+0000 7fa3b3831700 1 -- 172.21.15.73:0/10514076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3ac105680 msgr2=0x7fa3ac1a2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:00.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.803+0000 7fa3b3831700 1 --2- 172.21.15.73:0/10514076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3ac105680 0x7fa3ac1a2590 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4007d70 tx=0x7fa3a400a340 comp rx=0 tx=0).stop 2023-08-10T11:53:00.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.803+0000 7fa3b3831700 1 -- 172.21.15.73:0/10514076 shutdown_connections 2023-08-10T11:53:00.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.803+0000 7fa3b3831700 1 --2- 172.21.15.73:0/10514076 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa3980a1390 0x7fa3980a3850 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.803+0000 7fa3b3831700 1 --2- 172.21.15.73:0/10514076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3ac105680 0x7fa3ac1a2590 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.803+0000 7fa3b3831700 1 --2- 172.21.15.73:0/10514076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3ac0ff5e0 0x7fa3ac197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.803+0000 7fa3b3831700 1 --2- 172.21.15.73:0/10514076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3ac0fffa0 0x7fa3ac197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.803+0000 7fa3b3831700 1 -- 172.21.15.73:0/10514076 >> 172.21.15.73:0/10514076 conn(0x7fa3ac0fb0d0 msgr2=0x7fa3ac0fc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:00.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.803+0000 7fa3b3831700 1 -- 172.21.15.73:0/10514076 shutdown_connections 2023-08-10T11:53:00.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.803+0000 7fa3b3831700 1 -- 172.21.15.73:0/10514076 wait complete. 2023-08-10T11:53:00.807 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 27 2023-08-10T11:53:00.817 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-08-10T11:53:00.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.938+0000 7f37938ae700 1 -- 172.21.15.73:0/3197996191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f378c0ff5d0 msgr2=0x7f378c10d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:00.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.938+0000 7f37938ae700 1 --2- 172.21.15.73:0/3197996191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f378c0ff5d0 0x7f378c10d590 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f378400b0a0 tx=0x7f378400b3b0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.938+0000 7f37938ae700 1 -- 172.21.15.73:0/3197996191 shutdown_connections 2023-08-10T11:53:00.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.938+0000 7f37938ae700 1 --2- 172.21.15.73:0/3197996191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f378c0ff5d0 0x7f378c10d590 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.938+0000 7f37938ae700 1 --2- 172.21.15.73:0/3197996191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f378c106710 0x7f378c106af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.938+0000 7f37938ae700 1 --2- 172.21.15.73:0/3197996191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f378c0fec10 0x7f378c0ff090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.938+0000 7f37938ae700 1 -- 172.21.15.73:0/3197996191 >> 172.21.15.73:0/3197996191 conn(0x7f378c076be0 msgr2=0x7f378c0fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:00.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.938+0000 7f37938ae700 1 -- 172.21.15.73:0/3197996191 shutdown_connections 2023-08-10T11:53:00.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.938+0000 7f37938ae700 1 -- 172.21.15.73:0/3197996191 wait complete. 2023-08-10T11:53:00.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.938+0000 7f37938ae700 1 Processor -- start 2023-08-10T11:53:00.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.939+0000 7f37938ae700 1 -- start start 2023-08-10T11:53:00.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.939+0000 7f37938ae700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f378c0fec10 0x7f378c196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.939+0000 7f37938ae700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f378c0ff5d0 0x7f378c196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.939+0000 7f37938ae700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f378c106710 0x7f378c19b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.939+0000 7f37938ae700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378c19b920 con 0x7f378c106710 2023-08-10T11:53:00.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.939+0000 7f37938ae700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378c19ba90 con 0x7f378c0ff5d0 2023-08-10T11:53:00.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.939+0000 7f37938ae700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378c19bc50 con 0x7f378c0fec10 2023-08-10T11:53:00.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.939+0000 7f3791e4b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f378c106710 0x7f378c19b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.939+0000 7f3791e4b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f378c106710 0x7f378c19b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33068/0 (socket says 172.21.15.73:33068) 2023-08-10T11:53:00.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.939+0000 7f3791e4b700 1 -- 172.21.15.73:0/157346683 learned_addr learned my addr 172.21.15.73:0/157346683 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:00.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.939+0000 7f3790e49700 1 --2- 172.21.15.73:0/157346683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f378c0ff5d0 0x7f378c196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.939+0000 7f379164a700 1 --2- 172.21.15.73:0/157346683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f378c0fec10 0x7f378c196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.939+0000 7f3791e4b700 1 -- 172.21.15.73:0/157346683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f378c0fec10 msgr2=0x7f378c196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:00.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.939+0000 7f3791e4b700 1 --2- 172.21.15.73:0/157346683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f378c0fec10 0x7f378c196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.939+0000 7f3791e4b700 1 -- 172.21.15.73:0/157346683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f378c0ff5d0 msgr2=0x7f378c196ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:00.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.939+0000 7f3791e4b700 1 --2- 172.21.15.73:0/157346683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f378c0ff5d0 0x7f378c196ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.939+0000 7f3791e4b700 1 -- 172.21.15.73:0/157346683 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3784009d00 con 0x7f378c106710 2023-08-10T11:53:00.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.939+0000 7f3790e49700 1 --2- 172.21.15.73:0/157346683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f378c0ff5d0 0x7f378c196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:00.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.939+0000 7f3791e4b700 1 --2- 172.21.15.73:0/157346683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f378c106710 0x7f378c19b350 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f378400b830 tx=0x7f3784007a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:00.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.939+0000 7f37827fc700 1 -- 172.21.15.73:0/157346683 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378400e040 con 0x7f378c106710 2023-08-10T11:53:00.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.940+0000 7f37827fc700 1 -- 172.21.15.73:0/157346683 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3784004e10 con 0x7f378c106710 2023-08-10T11:53:00.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.940+0000 7f37938ae700 1 -- 172.21.15.73:0/157346683 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f378c19bed0 con 0x7f378c106710 2023-08-10T11:53:00.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.940+0000 7f37827fc700 1 -- 172.21.15.73:0/157346683 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378401d480 con 0x7f378c106710 2023-08-10T11:53:00.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.940+0000 7f37938ae700 1 -- 172.21.15.73:0/157346683 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f378c1a37e0 con 0x7f378c106710 2023-08-10T11:53:00.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.942+0000 7f37827fc700 1 -- 172.21.15.73:0/157346683 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 23) v1 ==== 135891+0+0 (secure 0 0 0) 0x7f3784003a00 con 0x7f378c106710 2023-08-10T11:53:00.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.942+0000 7f37827fc700 1 --2- 172.21.15.73:0/157346683 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f37780a1350 0x7f37780a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.942+0000 7f379164a700 1 --2- 172.21.15.73:0/157346683 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f37780a1350 0x7f37780a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.942+0000 7f37827fc700 1 -- 172.21.15.73:0/157346683 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f37840ce700 con 0x7f378c106710 2023-08-10T11:53:00.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.943+0000 7f379164a700 1 --2- 172.21.15.73:0/157346683 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f37780a1350 0x7f37780a3810 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3788005950 tx=0x7f3788005c70 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:00.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.943+0000 7f379fa47b80 1 Processor -- start 2023-08-10T11:53:00.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.943+0000 7f379fa47b80 1 -- start start 2023-08-10T11:53:00.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.943+0000 7f379fa47b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ad39f17f50 0x55ad39f18330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.943+0000 7f379fa47b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f18870 0x55ad39f122c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.943+0000 7f379fa47b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad39f12800 0x55ad39f12c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.943+0000 7f379fa47b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad39e8ddc0 con 0x55ad39f18870 2023-08-10T11:53:00.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.943+0000 7f379fa47b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad39e6a590 con 0x55ad39f17f50 2023-08-10T11:53:00.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.943+0000 7f379fa47b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad39e67eb0 con 0x55ad39f12800 2023-08-10T11:53:00.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.944+0000 7f3790e49700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f18870 0x55ad39f122c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.944+0000 7f3790e49700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f18870 0x55ad39f122c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33074/0 (socket says 172.21.15.73:33074) 2023-08-10T11:53:00.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.944+0000 7f3790e49700 1 -- 172.21.15.73:0/463361622 learned_addr learned my addr 172.21.15.73:0/463361622 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:00.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.944+0000 7f3791e4b700 1 --2- 172.21.15.73:0/463361622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad39f12800 0x55ad39f12c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.944+0000 7f3790e49700 1 -- 172.21.15.73:0/463361622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad39f12800 msgr2=0x55ad39f12c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:00.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.944+0000 7f3790e49700 1 --2- 172.21.15.73:0/463361622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad39f12800 0x55ad39f12c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.944+0000 7f379164a700 1 --2- 172.21.15.73:0/463361622 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ad39f17f50 0x55ad39f18330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.944+0000 7f3790e49700 1 -- 172.21.15.73:0/463361622 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ad39f17f50 msgr2=0x55ad39f18330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:00.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.944+0000 7f3790e49700 1 --2- 172.21.15.73:0/463361622 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ad39f17f50 0x55ad39f18330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.944+0000 7f3790e49700 1 -- 172.21.15.73:0/463361622 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad39ce4630 con 0x55ad39f18870 2023-08-10T11:53:00.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.944+0000 7f379164a700 1 --2- 172.21.15.73:0/463361622 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ad39f17f50 0x55ad39f18330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:00.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.944+0000 7f3790e49700 1 --2- 172.21.15.73:0/463361622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f18870 0x55ad39f122c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f377c009c70 tx=0x7f377c009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a46567cd697b635 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:00.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.944+0000 7f37777fe700 1 -- 172.21.15.73:0/463361622 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c00eb00 con 0x55ad39f18870 2023-08-10T11:53:00.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.944+0000 7f37777fe700 1 -- 172.21.15.73:0/463361622 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f377c004cf0 con 0x55ad39f18870 2023-08-10T11:53:00.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.944+0000 7f37777fe700 1 -- 172.21.15.73:0/463361622 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c005620 con 0x55ad39f18870 2023-08-10T11:53:00.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.945+0000 7f379fa47b80 1 -- 172.21.15.73:0/463361622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f18870 msgr2=0x55ad39f122c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:00.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.945+0000 7f379fa47b80 1 --2- 172.21.15.73:0/463361622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f18870 0x55ad39f122c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f377c009c70 tx=0x7f377c009f80 comp rx=0 tx=0).stop 2023-08-10T11:53:00.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.945+0000 7f379fa47b80 1 -- 172.21.15.73:0/463361622 shutdown_connections 2023-08-10T11:53:00.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.945+0000 7f379fa47b80 1 --2- 172.21.15.73:0/463361622 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ad39f17f50 0x55ad39f18330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.945+0000 7f379fa47b80 1 --2- 172.21.15.73:0/463361622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad39f12800 0x55ad39f12c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.945+0000 7f379fa47b80 1 --2- 172.21.15.73:0/463361622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f18870 0x55ad39f122c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.945+0000 7f379fa47b80 1 -- 172.21.15.73:0/463361622 >> 172.21.15.73:0/463361622 conn(0x55ad39e6fcd0 msgr2=0x55ad39f0d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:00.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.945+0000 7f379fa47b80 1 -- 172.21.15.73:0/463361622 shutdown_connections 2023-08-10T11:53:00.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.945+0000 7f379fa47b80 1 -- 172.21.15.73:0/463361622 wait complete. 2023-08-10T11:53:00.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.945+0000 7f379fa47b80 1 -- start start 2023-08-10T11:53:00.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.945+0000 7f379fa47b80 1 Processor -- start 2023-08-10T11:53:00.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.946+0000 7f379fa47b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ad39f12800 0x55ad39f1e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.946+0000 7f379fa47b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad39f17f50 0x55ad39f1bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.946+0000 7f379fa47b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f18870 0x55ad39f1c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.946+0000 7f379fa47b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad39e637a0 con 0x55ad39f18870 2023-08-10T11:53:00.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.946+0000 7f379fa47b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad39e02ac0 con 0x55ad39f12800 2023-08-10T11:53:00.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.946+0000 7f379fa47b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad39e027c0 con 0x55ad39f17f50 2023-08-10T11:53:00.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.946+0000 7f379fa47b80 10 client.0 _ll_register_callbacks cb 0x55ad39e00680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:00.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.946+0000 7f3791e4b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f18870 0x55ad39f1c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.946+0000 7f3791e4b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f18870 0x55ad39f1c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33082/0 (socket says 172.21.15.73:33082) 2023-08-10T11:53:00.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.946+0000 7f3791e4b700 1 -- 172.21.15.73:0/751712412 learned_addr learned my addr 172.21.15.73:0/751712412 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:00.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.946+0000 7f379164a700 1 --2- 172.21.15.73:0/751712412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ad39f12800 0x55ad39f1e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.946+0000 7f3790e49700 1 --2- 172.21.15.73:0/751712412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad39f17f50 0x55ad39f1bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.946+0000 7f3791e4b700 1 -- 172.21.15.73:0/751712412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad39f17f50 msgr2=0x55ad39f1bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:00.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.946+0000 7f3791e4b700 1 --2- 172.21.15.73:0/751712412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad39f17f50 0x55ad39f1bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.946+0000 7f3791e4b700 1 -- 172.21.15.73:0/751712412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ad39f12800 msgr2=0x55ad39f1e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:00.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.946+0000 7f3791e4b700 1 --2- 172.21.15.73:0/751712412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ad39f12800 0x55ad39f1e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.946+0000 7f3791e4b700 1 -- 172.21.15.73:0/751712412 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377c0098a0 con 0x55ad39f18870 2023-08-10T11:53:00.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.946+0000 7f3790e49700 1 --2- 172.21.15.73:0/751712412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad39f17f50 0x55ad39f1bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:00.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.946+0000 7f3791e4b700 1 --2- 172.21.15.73:0/751712412 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f18870 0x55ad39f1c200 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f378409b6b0 tx=0x7f378400b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84cff127cc853fb1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:00.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.946+0000 7f3774ff9700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:00.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.947+0000 7f3774ff9700 1 -- 172.21.15.73:0/751712412 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378409b720 con 0x55ad39f18870 2023-08-10T11:53:00.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.947+0000 7f3774ff9700 1 -- 172.21.15.73:0/751712412 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f378409f750 con 0x55ad39f18870 2023-08-10T11:53:00.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.947+0000 7f379fa47b80 1 -- 172.21.15.73:0/751712412 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ad39f05470 con 0x55ad39f18870 2023-08-10T11:53:00.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.947+0000 7f3774ff9700 1 -- 172.21.15.73:0/751712412 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37840a3ae0 con 0x55ad39f18870 2023-08-10T11:53:00.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.947+0000 7f379fa47b80 10 client.15621 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:00.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.947+0000 7f379fa47b80 1 -- 172.21.15.73:0/751712412 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55ad39c90de0 con 0x55ad39f18870 2023-08-10T11:53:00.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.947+0000 7f3774ff9700 1 -- 172.21.15.73:0/751712412 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f37840b7030 con 0x55ad39f18870 2023-08-10T11:53:00.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.947+0000 7f3774ff9700 1 -- 172.21.15.73:0/751712412 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f378409ac10 con 0x55ad39f18870 2023-08-10T11:53:00.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.947+0000 7f379fa47b80 10 client.15621 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:00.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.947+0000 7f379fa47b80 10 client.15621 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2023-08-10T11:53:00.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.947+0000 7f379fa47b80 20 client.15621 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:00.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.947+0000 7f379fa47b80 1 --2- 172.21.15.73:0/751712412 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55ad39f2c050 0x55ad39f2e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.947+0000 7f379fa47b80 4 client.15621 mds_command: new command op to 24419 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:53:00.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.947+0000 7f379fa47b80 1 -- 172.21.15.73:0/751712412 --> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ad39ee19d0 con 0x55ad39f2c050 2023-08-10T11:53:00.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.947+0000 7f379164a700 1 --2- 172.21.15.73:0/751712412 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55ad39f2c050 0x55ad39f2e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.948+0000 7f3774ff9700 10 client.15621 ms_handle_connect on v2:172.21.15.152:6832/4148407154 2023-08-10T11:53:00.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.948+0000 7f379164a700 1 --2- 172.21.15.73:0/751712412 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55ad39f2c050 0x55ad39f2e470 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2831ba7e10cf0ef3 server_cookie=19cdb163b73d9aa in_seq=0 out_seq=0 2023-08-10T11:53:00.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.948+0000 7f3774ff9700 1 -- 172.21.15.73:0/751712412 <== mds.4 v2:172.21.15.152:6832/4148407154 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55ad39ee19d0 con 0x55ad39f2c050 2023-08-10T11:53:00.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.949+0000 7f3774ff9700 10 client.15621 handle_command_reply: tid=0 2023-08-10T11:53:00.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.949+0000 7f379fa47b80 1 client.15621 shutdown 2023-08-10T11:53:00.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.949+0000 7f379fa47b80 1 -- 172.21.15.73:0/751712412 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f18870 msgr2=0x55ad39f1c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:00.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.949+0000 7f379fa47b80 1 --2- 172.21.15.73:0/751712412 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f18870 0x55ad39f1c200 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f378409b6b0 tx=0x7f378400b3b0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.949+0000 7f379fa47b80 1 -- 172.21.15.73:0/751712412 shutdown_connections 2023-08-10T11:53:00.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.949+0000 7f379fa47b80 1 --2- 172.21.15.73:0/751712412 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55ad39f2c050 0x55ad39f2e470 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.949+0000 7f379fa47b80 1 --2- 172.21.15.73:0/751712412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ad39f12800 0x55ad39f1e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.949+0000 7f3774ff9700 0 client.15621 ms_handle_reset on v2:172.21.15.152:6832/4148407154 2023-08-10T11:53:00.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.949+0000 7f379fa47b80 1 --2- 172.21.15.73:0/751712412 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f18870 0x55ad39f1c200 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.949+0000 7f379fa47b80 1 --2- 172.21.15.73:0/751712412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad39f17f50 0x55ad39f1bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.949+0000 7f379fa47b80 1 -- 172.21.15.73:0/751712412 >> 172.21.15.73:0/751712412 conn(0x55ad39e6fcd0 msgr2=0x55ad39f0c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:00.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.949+0000 7f379fa47b80 1 -- 172.21.15.73:0/751712412 shutdown_connections 2023-08-10T11:53:00.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.949+0000 7f379fa47b80 1 -- 172.21.15.73:0/751712412 wait complete. 2023-08-10T11:53:00.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.949+0000 7f379fa47b80 20 client.15621 trim_cache size 0 max 16384 2023-08-10T11:53:00.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.961+0000 7f379fa47b80 1 Processor -- start 2023-08-10T11:53:00.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.961+0000 7f379fa47b80 1 -- start start 2023-08-10T11:53:00.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.962+0000 7f379fa47b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f12800 0x55ad39f172b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.962+0000 7f379fa47b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ad39f17f50 0x55ad39f0d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.962+0000 7f379fa47b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad39f18870 0x55ad39f0d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.962+0000 7f379fa47b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad39ce6920 con 0x55ad39f12800 2023-08-10T11:53:00.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.962+0000 7f379fa47b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad39f1a1a0 con 0x55ad39f17f50 2023-08-10T11:53:00.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.962+0000 7f379fa47b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad39f16810 con 0x55ad39f18870 2023-08-10T11:53:00.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.962+0000 7f379164a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f12800 0x55ad39f172b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.962+0000 7f379164a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f12800 0x55ad39f172b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33086/0 (socket says 172.21.15.73:33086) 2023-08-10T11:53:00.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.962+0000 7f379164a700 1 -- 172.21.15.73:0/3101817594 learned_addr learned my addr 172.21.15.73:0/3101817594 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:00.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.962+0000 7f3791e4b700 1 --2- 172.21.15.73:0/3101817594 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad39f18870 0x55ad39f0d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.962+0000 7f379164a700 1 -- 172.21.15.73:0/3101817594 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad39f18870 msgr2=0x55ad39f0d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:00.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.962+0000 7f3790e49700 1 --2- 172.21.15.73:0/3101817594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ad39f17f50 0x55ad39f0d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.962+0000 7f379164a700 1 --2- 172.21.15.73:0/3101817594 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad39f18870 0x55ad39f0d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.962+0000 7f379164a700 1 -- 172.21.15.73:0/3101817594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ad39f17f50 msgr2=0x55ad39f0d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:00.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.962+0000 7f379164a700 1 --2- 172.21.15.73:0/3101817594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ad39f17f50 0x55ad39f0d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.962+0000 7f379164a700 1 -- 172.21.15.73:0/3101817594 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad39c79c60 con 0x55ad39f12800 2023-08-10T11:53:00.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.962+0000 7f3791e4b700 1 --2- 172.21.15.73:0/3101817594 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad39f18870 0x55ad39f0d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:00.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.962+0000 7f3790e49700 1 --2- 172.21.15.73:0/3101817594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ad39f17f50 0x55ad39f0d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:00.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.962+0000 7f379164a700 1 --2- 172.21.15.73:0/3101817594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f12800 0x55ad39f172b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3788012040 tx=0x7f3788013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c9d664fd1073f5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:00.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.962+0000 7f3777fff700 1 -- 172.21.15.73:0/3101817594 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3788022040 con 0x55ad39f12800 2023-08-10T11:53:00.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.962+0000 7f3777fff700 1 -- 172.21.15.73:0/3101817594 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f378801cd40 con 0x55ad39f12800 2023-08-10T11:53:00.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.962+0000 7f3777fff700 1 -- 172.21.15.73:0/3101817594 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3788004d90 con 0x55ad39f12800 2023-08-10T11:53:00.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.963+0000 7f379fa47b80 1 -- 172.21.15.73:0/3101817594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f12800 msgr2=0x55ad39f172b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:00.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.963+0000 7f379fa47b80 1 --2- 172.21.15.73:0/3101817594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f12800 0x55ad39f172b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3788012040 tx=0x7f3788013000 comp rx=0 tx=0).stop 2023-08-10T11:53:00.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.963+0000 7f379fa47b80 1 -- 172.21.15.73:0/3101817594 shutdown_connections 2023-08-10T11:53:00.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.963+0000 7f379fa47b80 1 --2- 172.21.15.73:0/3101817594 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad39f18870 0x55ad39f0d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.963+0000 7f379fa47b80 1 --2- 172.21.15.73:0/3101817594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f12800 0x55ad39f172b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.963+0000 7f379fa47b80 1 --2- 172.21.15.73:0/3101817594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ad39f17f50 0x55ad39f0d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.963+0000 7f379fa47b80 1 -- 172.21.15.73:0/3101817594 >> 172.21.15.73:0/3101817594 conn(0x55ad39e6fcd0 msgr2=0x55ad39f16ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:00.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.963+0000 7f379fa47b80 1 -- 172.21.15.73:0/3101817594 shutdown_connections 2023-08-10T11:53:00.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.963+0000 7f379fa47b80 1 -- 172.21.15.73:0/3101817594 wait complete. 2023-08-10T11:53:00.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.963+0000 7f379fa47b80 1 -- start start 2023-08-10T11:53:00.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.963+0000 7f379fa47b80 1 Processor -- start 2023-08-10T11:53:00.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.964+0000 7f379fa47b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ad39f12800 0x55ad39f21990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.964+0000 7f379fa47b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad39f17f50 0x55ad39f21ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.964+0000 7f379fa47b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f18870 0x55ad39f22410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.964+0000 7f379fa47b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad39f238a0 con 0x55ad39f18870 2023-08-10T11:53:00.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.964+0000 7f379fa47b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad39f7fd10 con 0x55ad39f12800 2023-08-10T11:53:00.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.964+0000 7f379fa47b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad39f7fea0 con 0x55ad39f17f50 2023-08-10T11:53:00.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.964+0000 7f379fa47b80 10 client.0 _ll_register_callbacks cb 0x55ad39e00680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:00.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.964+0000 7f3791e4b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f18870 0x55ad39f22410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.964+0000 7f3791e4b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f18870 0x55ad39f22410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33096/0 (socket says 172.21.15.73:33096) 2023-08-10T11:53:00.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.964+0000 7f3791e4b700 1 -- 172.21.15.73:0/510621792 learned_addr learned my addr 172.21.15.73:0/510621792 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:00.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.964+0000 7f379164a700 1 --2- 172.21.15.73:0/510621792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ad39f12800 0x55ad39f21990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.964+0000 7f3790e49700 1 --2- 172.21.15.73:0/510621792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad39f17f50 0x55ad39f21ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.964+0000 7f3791e4b700 1 -- 172.21.15.73:0/510621792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad39f17f50 msgr2=0x55ad39f21ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:00.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.964+0000 7f3791e4b700 1 --2- 172.21.15.73:0/510621792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad39f17f50 0x55ad39f21ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.964+0000 7f3791e4b700 1 -- 172.21.15.73:0/510621792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ad39f12800 msgr2=0x55ad39f21990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:00.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.964+0000 7f3791e4b700 1 --2- 172.21.15.73:0/510621792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ad39f12800 0x55ad39f21990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.964+0000 7f3791e4b700 1 -- 172.21.15.73:0/510621792 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f378800dc10 con 0x55ad39f18870 2023-08-10T11:53:00.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.964+0000 7f3791e4b700 1 --2- 172.21.15.73:0/510621792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f18870 0x55ad39f22410 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f378409b420 tx=0x7f3784099cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6c281259c779de server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:00.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.964+0000 7f3774ff9700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:00.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.964+0000 7f3774ff9700 1 -- 172.21.15.73:0/510621792 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37840cc270 con 0x55ad39f18870 2023-08-10T11:53:00.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.964+0000 7f3774ff9700 1 -- 172.21.15.73:0/510621792 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f378409b980 con 0x55ad39f18870 2023-08-10T11:53:00.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.964+0000 7f379fa47b80 1 -- 172.21.15.73:0/510621792 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f377c004cf0 con 0x55ad39f18870 2023-08-10T11:53:00.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.965+0000 7f3774ff9700 1 -- 172.21.15.73:0/510621792 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37840cbd00 con 0x55ad39f18870 2023-08-10T11:53:00.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.965+0000 7f379fa47b80 10 client.15627 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:00.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.965+0000 7f379fa47b80 1 -- 172.21.15.73:0/510621792 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55ad39cb7250 con 0x55ad39f18870 2023-08-10T11:53:00.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.965+0000 7f3774ff9700 1 -- 172.21.15.73:0/510621792 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f377c004cf0 con 0x55ad39f18870 2023-08-10T11:53:00.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.965+0000 7f3774ff9700 1 -- 172.21.15.73:0/510621792 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f378409cb80 con 0x55ad39f18870 2023-08-10T11:53:00.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.965+0000 7f379fa47b80 10 client.15627 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:00.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.965+0000 7f379fa47b80 10 client.15627 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2023-08-10T11:53:00.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.965+0000 7f379fa47b80 20 client.15627 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:00.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.965+0000 7f379fa47b80 1 --2- 172.21.15.73:0/510621792 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55ad39f2c050 0x55ad39f83010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:00.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.965+0000 7f379fa47b80 4 client.15627 mds_command: new command op to 24419 tid=0[{"prefix": "damage ls"}] 2023-08-10T11:53:00.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.965+0000 7f379fa47b80 1 -- 172.21.15.73:0/510621792 --> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ad39e5c780 con 0x55ad39f2c050 2023-08-10T11:53:00.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.965+0000 7f379164a700 1 --2- 172.21.15.73:0/510621792 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55ad39f2c050 0x55ad39f83010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:00.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.966+0000 7f3774ff9700 10 client.15627 ms_handle_connect on v2:172.21.15.152:6832/4148407154 2023-08-10T11:53:00.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.966+0000 7f379164a700 1 --2- 172.21.15.73:0/510621792 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55ad39f2c050 0x55ad39f83010 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f16905ec066743fb server_cookie=8f7648cd7f74929a in_seq=0 out_seq=0 2023-08-10T11:53:00.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.966+0000 7f3774ff9700 1 -- 172.21.15.73:0/510621792 <== mds.4 v2:172.21.15.152:6832/4148407154 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ad39e5c780 con 0x55ad39f2c050 2023-08-10T11:53:00.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.966+0000 7f3774ff9700 10 client.15627 handle_command_reply: tid=0 2023-08-10T11:53:00.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.966+0000 7f379fa47b80 1 client.15627 shutdown 2023-08-10T11:53:00.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.966+0000 7f379fa47b80 1 -- 172.21.15.73:0/510621792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f18870 msgr2=0x55ad39f22410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:00.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.966+0000 7f379fa47b80 1 --2- 172.21.15.73:0/510621792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f18870 0x55ad39f22410 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f378409b420 tx=0x7f3784099cd0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.966+0000 7f379fa47b80 1 -- 172.21.15.73:0/510621792 shutdown_connections 2023-08-10T11:53:00.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.966+0000 7f379fa47b80 1 --2- 172.21.15.73:0/510621792 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55ad39f2c050 0x55ad39f83010 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.966+0000 7f379fa47b80 1 --2- 172.21.15.73:0/510621792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ad39f12800 0x55ad39f21990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.966+0000 7f379fa47b80 1 --2- 172.21.15.73:0/510621792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ad39f18870 0x55ad39f22410 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.966+0000 7f379fa47b80 1 --2- 172.21.15.73:0/510621792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad39f17f50 0x55ad39f21ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.966+0000 7f379fa47b80 1 -- 172.21.15.73:0/510621792 >> 172.21.15.73:0/510621792 conn(0x55ad39e6fcd0 msgr2=0x55ad39f1d420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:00.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.966+0000 7f3774ff9700 0 client.15627 ms_handle_reset on v2:172.21.15.152:6832/4148407154 2023-08-10T11:53:00.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.966+0000 7f379fa47b80 1 -- 172.21.15.73:0/510621792 shutdown_connections 2023-08-10T11:53:00.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.966+0000 7f379fa47b80 1 -- 172.21.15.73:0/510621792 wait complete. 2023-08-10T11:53:00.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.966+0000 7f379fa47b80 20 client.15627 trim_cache size 0 max 16384 2023-08-10T11:53:00.989 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2023-08-10T11:53:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.967+0000 7f37938ae700 1 -- 172.21.15.73:0/157346683 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f37780a1350 msgr2=0x7f37780a3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.967+0000 7f37938ae700 1 --2- 172.21.15.73:0/157346683 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f37780a1350 0x7f37780a3810 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3788005950 tx=0x7f3788005c70 comp rx=0 tx=0).stop 2023-08-10T11:53:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.967+0000 7f37938ae700 1 -- 172.21.15.73:0/157346683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f378c106710 msgr2=0x7f378c19b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.967+0000 7f37938ae700 1 --2- 172.21.15.73:0/157346683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f378c106710 0x7f378c19b350 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f378400b830 tx=0x7f3784007a60 comp rx=0 tx=0).stop 2023-08-10T11:53:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.967+0000 7f37938ae700 1 -- 172.21.15.73:0/157346683 shutdown_connections 2023-08-10T11:53:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.967+0000 7f37938ae700 1 --2- 172.21.15.73:0/157346683 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f37780a1350 0x7f37780a3810 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.967+0000 7f37938ae700 1 --2- 172.21.15.73:0/157346683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f378c106710 0x7f378c19b350 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.967+0000 7f37938ae700 1 --2- 172.21.15.73:0/157346683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f378c0fec10 0x7f378c196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.967+0000 7f37938ae700 1 --2- 172.21.15.73:0/157346683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f378c0ff5d0 0x7f378c196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:00.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.967+0000 7f37938ae700 1 -- 172.21.15.73:0/157346683 >> 172.21.15.73:0/157346683 conn(0x7f378c076be0 msgr2=0x7f378c0fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:00.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.967+0000 7f37938ae700 1 -- 172.21.15.73:0/157346683 shutdown_connections 2023-08-10T11:53:00.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:00.967+0000 7f37938ae700 1 -- 172.21.15.73:0/157346683 wait complete. 2023-08-10T11:53:00.992 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-08-10T11:53:00.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:00 smithi152 ceph-mon[130220]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.8 KiB/s wr, 17 op/s 2023-08-10T11:53:01.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:00 smithi156 ceph-mon[130574]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.8 KiB/s wr, 17 op/s 2023-08-10T11:53:01.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.112+0000 7f44ab473700 1 -- 172.21.15.73:0/1255102370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44a40fff90 msgr2=0x7f44a410c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.112+0000 7f44ab473700 1 --2- 172.21.15.73:0/1255102370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44a40fff90 0x7f44a410c450 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f449c00b0d0 tx=0x7f449c00b3e0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.112+0000 7f44ab473700 1 -- 172.21.15.73:0/1255102370 shutdown_connections 2023-08-10T11:53:01.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.112+0000 7f44ab473700 1 --2- 172.21.15.73:0/1255102370 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44a4105690 0x7f44a4105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.112+0000 7f44ab473700 1 --2- 172.21.15.73:0/1255102370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44a40fff90 0x7f44a410c450 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.112+0000 7f44ab473700 1 --2- 172.21.15.73:0/1255102370 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44a40ff5d0 0x7f44a40ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.112+0000 7f44ab473700 1 -- 172.21.15.73:0/1255102370 >> 172.21.15.73:0/1255102370 conn(0x7f44a40fb0c0 msgr2=0x7f44a40fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:01.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.112+0000 7f44ab473700 1 -- 172.21.15.73:0/1255102370 shutdown_connections 2023-08-10T11:53:01.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.112+0000 7f44ab473700 1 -- 172.21.15.73:0/1255102370 wait complete. 2023-08-10T11:53:01.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.113+0000 7f44ab473700 1 Processor -- start 2023-08-10T11:53:01.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.113+0000 7f44ab473700 1 -- start start 2023-08-10T11:53:01.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.113+0000 7f44ab473700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44a40ff5d0 0x7f44a419b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.113+0000 7f44ab473700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44a40fff90 0x7f44a419bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.113+0000 7f44ab473700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44a4105690 0x7f44a4195660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.113+0000 7f44ab473700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a4195cd0 con 0x7f44a40ff5d0 2023-08-10T11:53:01.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.113+0000 7f44ab473700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a4195e40 con 0x7f44a4105690 2023-08-10T11:53:01.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.113+0000 7f44ab473700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a4196000 con 0x7f44a40fff90 2023-08-10T11:53:01.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.113+0000 7f44a920f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44a40ff5d0 0x7f44a419b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.113+0000 7f44a920f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44a40ff5d0 0x7f44a419b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33106/0 (socket says 172.21.15.73:33106) 2023-08-10T11:53:01.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.113+0000 7f44a920f700 1 -- 172.21.15.73:0/2883764950 learned_addr learned my addr 172.21.15.73:0/2883764950 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:01.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.114+0000 7f44a920f700 1 -- 172.21.15.73:0/2883764950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44a40fff90 msgr2=0x7f44a419bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.114+0000 7f44a9a10700 1 --2- 172.21.15.73:0/2883764950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44a4105690 0x7f44a4195660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.114+0000 7f44a920f700 1 --2- 172.21.15.73:0/2883764950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44a40fff90 0x7f44a419bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.114+0000 7f44a920f700 1 -- 172.21.15.73:0/2883764950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44a4105690 msgr2=0x7f44a4195660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.114+0000 7f44a920f700 1 --2- 172.21.15.73:0/2883764950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44a4105690 0x7f44a4195660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.114+0000 7f44a920f700 1 -- 172.21.15.73:0/2883764950 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c009d00 con 0x7f44a40ff5d0 2023-08-10T11:53:01.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.114+0000 7f44a920f700 1 --2- 172.21.15.73:0/2883764950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44a40ff5d0 0x7f44a419b5a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f449400c920 tx=0x7f449400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:01.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.114+0000 7f449a7fc700 1 -- 172.21.15.73:0/2883764950 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494007b00 con 0x7f44a40ff5d0 2023-08-10T11:53:01.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.114+0000 7f449a7fc700 1 -- 172.21.15.73:0/2883764950 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4494004cf0 con 0x7f44a40ff5d0 2023-08-10T11:53:01.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.114+0000 7f44ab473700 1 -- 172.21.15.73:0/2883764950 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a41962e0 con 0x7f44a40ff5d0 2023-08-10T11:53:01.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.114+0000 7f449a7fc700 1 -- 172.21.15.73:0/2883764950 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494005610 con 0x7f44a40ff5d0 2023-08-10T11:53:01.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.114+0000 7f44ab473700 1 -- 172.21.15.73:0/2883764950 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a41a2590 con 0x7f44a40ff5d0 2023-08-10T11:53:01.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.116+0000 7f449a7fc700 1 -- 172.21.15.73:0/2883764950 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 23) v1 ==== 135891+0+0 (secure 0 0 0) 0x7f4494004750 con 0x7f44a40ff5d0 2023-08-10T11:53:01.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.117+0000 7f449a7fc700 1 --2- 172.21.15.73:0/2883764950 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f44900a1350 0x7f44900a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.117+0000 7f44a8a0e700 1 --2- 172.21.15.73:0/2883764950 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f44900a1350 0x7f44900a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.117+0000 7f449a7fc700 1 -- 172.21.15.73:0/2883764950 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f44940cce60 con 0x7f44a40ff5d0 2023-08-10T11:53:01.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.117+0000 7f44a8a0e700 1 --2- 172.21.15.73:0/2883764950 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f44900a1350 0x7f44900a3810 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f44a0005950 tx=0x7f44a00058e0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:01.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.118+0000 7f44b760cb80 1 Processor -- start 2023-08-10T11:53:01.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.118+0000 7f44b760cb80 1 -- start start 2023-08-10T11:53:01.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.118+0000 7f44b760cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940a917f50 0x55940a918330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.118+0000 7f44b760cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55940a918870 0x55940a9122c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.118+0000 7f44b760cb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a912800 0x55940a912c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.118+0000 7f44b760cb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940a88ddc0 con 0x55940a912800 2023-08-10T11:53:01.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.118+0000 7f44b760cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940a86a590 con 0x55940a917f50 2023-08-10T11:53:01.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.118+0000 7f44b760cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940a867eb0 con 0x55940a918870 2023-08-10T11:53:01.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.118+0000 7f44a9a10700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a912800 0x55940a912c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.118+0000 7f44a9a10700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a912800 0x55940a912c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33118/0 (socket says 172.21.15.73:33118) 2023-08-10T11:53:01.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.118+0000 7f44a9a10700 1 -- 172.21.15.73:0/2043950928 learned_addr learned my addr 172.21.15.73:0/2043950928 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:01.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.118+0000 7f44a920f700 1 --2- 172.21.15.73:0/2043950928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940a917f50 0x55940a918330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.118+0000 7f44a8a0e700 1 --2- 172.21.15.73:0/2043950928 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55940a918870 0x55940a9122c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.118+0000 7f44a9a10700 1 -- 172.21.15.73:0/2043950928 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55940a918870 msgr2=0x55940a9122c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.118+0000 7f44a9a10700 1 --2- 172.21.15.73:0/2043950928 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55940a918870 0x55940a9122c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.118+0000 7f44a9a10700 1 -- 172.21.15.73:0/2043950928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940a917f50 msgr2=0x55940a918330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.118+0000 7f44a9a10700 1 --2- 172.21.15.73:0/2043950928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940a917f50 0x55940a918330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.118+0000 7f44a9a10700 1 -- 172.21.15.73:0/2043950928 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55940a6e4630 con 0x55940a912800 2023-08-10T11:53:01.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.118+0000 7f44a9a10700 1 --2- 172.21.15.73:0/2043950928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a912800 0x55940a912c80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f449c006070 tx=0x7f449c009c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a743a7ac785e7620 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:01.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.119+0000 7f448f7fe700 1 -- 172.21.15.73:0/2043950928 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c00e070 con 0x55940a912800 2023-08-10T11:53:01.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.119+0000 7f448f7fe700 1 -- 172.21.15.73:0/2043950928 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f449c004a50 con 0x55940a912800 2023-08-10T11:53:01.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.119+0000 7f448f7fe700 1 -- 172.21.15.73:0/2043950928 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c005040 con 0x55940a912800 2023-08-10T11:53:01.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.119+0000 7f44b760cb80 1 -- 172.21.15.73:0/2043950928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a912800 msgr2=0x55940a912c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.119+0000 7f44b760cb80 1 --2- 172.21.15.73:0/2043950928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a912800 0x55940a912c80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f449c006070 tx=0x7f449c009c40 comp rx=0 tx=0).stop 2023-08-10T11:53:01.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.119+0000 7f44b760cb80 1 -- 172.21.15.73:0/2043950928 shutdown_connections 2023-08-10T11:53:01.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.119+0000 7f44b760cb80 1 --2- 172.21.15.73:0/2043950928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940a917f50 0x55940a918330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.119+0000 7f44b760cb80 1 --2- 172.21.15.73:0/2043950928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a912800 0x55940a912c80 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.119+0000 7f44b760cb80 1 --2- 172.21.15.73:0/2043950928 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55940a918870 0x55940a9122c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.119+0000 7f44b760cb80 1 -- 172.21.15.73:0/2043950928 >> 172.21.15.73:0/2043950928 conn(0x55940a86fcd0 msgr2=0x55940a90d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:01.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.119+0000 7f44b760cb80 1 -- 172.21.15.73:0/2043950928 shutdown_connections 2023-08-10T11:53:01.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.119+0000 7f44b760cb80 1 -- 172.21.15.73:0/2043950928 wait complete. 2023-08-10T11:53:01.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.120+0000 7f44b760cb80 1 -- start start 2023-08-10T11:53:01.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.120+0000 7f44b760cb80 1 Processor -- start 2023-08-10T11:53:01.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.120+0000 7f44b760cb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a912800 0x55940a91e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.120+0000 7f44b760cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940a917f50 0x55940a91bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.120+0000 7f44b760cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55940a918870 0x55940a91c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.120+0000 7f44b760cb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940a8637a0 con 0x55940a912800 2023-08-10T11:53:01.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.120+0000 7f44b760cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940a802ac0 con 0x55940a917f50 2023-08-10T11:53:01.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.120+0000 7f44b760cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940a8027c0 con 0x55940a918870 2023-08-10T11:53:01.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.120+0000 7f44b760cb80 10 client.0 _ll_register_callbacks cb 0x55940a800680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:01.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.120+0000 7f44a920f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a912800 0x55940a91e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.120+0000 7f44a920f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a912800 0x55940a91e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33120/0 (socket says 172.21.15.73:33120) 2023-08-10T11:53:01.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.120+0000 7f44a920f700 1 -- 172.21.15.73:0/3989720271 learned_addr learned my addr 172.21.15.73:0/3989720271 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:01.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.120+0000 7f44a8a0e700 1 --2- 172.21.15.73:0/3989720271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940a917f50 0x55940a91bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.121+0000 7f44a920f700 1 -- 172.21.15.73:0/3989720271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55940a918870 msgr2=0x55940a91c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.121+0000 7f44a9a10700 1 --2- 172.21.15.73:0/3989720271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55940a918870 0x55940a91c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.121+0000 7f44a920f700 1 --2- 172.21.15.73:0/3989720271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55940a918870 0x55940a91c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.121+0000 7f44a920f700 1 -- 172.21.15.73:0/3989720271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940a917f50 msgr2=0x55940a91bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.121+0000 7f44a920f700 1 --2- 172.21.15.73:0/3989720271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940a917f50 0x55940a91bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.121+0000 7f44a920f700 1 -- 172.21.15.73:0/3989720271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a410cd50 con 0x55940a912800 2023-08-10T11:53:01.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.121+0000 7f44a9a10700 1 --2- 172.21.15.73:0/3989720271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55940a918870 0x55940a91c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:01.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.121+0000 7f44a8a0e700 1 --2- 172.21.15.73:0/3989720271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940a917f50 0x55940a91bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:53:01.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.121+0000 7f44a920f700 1 --2- 172.21.15.73:0/3989720271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a912800 0x55940a91e900 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4494096800 tx=0x7f449409de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6150ba49f0ab21cf server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:01.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.121+0000 7f448cff9700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:01.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.121+0000 7f448cff9700 1 -- 172.21.15.73:0/3989720271 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494098250 con 0x55940a912800 2023-08-10T11:53:01.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.121+0000 7f448cff9700 1 -- 172.21.15.73:0/3989720271 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f44940ca770 con 0x55940a912800 2023-08-10T11:53:01.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.121+0000 7f44b760cb80 1 -- 172.21.15.73:0/3989720271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55940a905470 con 0x55940a912800 2023-08-10T11:53:01.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.121+0000 7f448cff9700 1 -- 172.21.15.73:0/3989720271 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44940ca930 con 0x55940a912800 2023-08-10T11:53:01.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.121+0000 7f44b760cb80 10 client.15639 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:01.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.121+0000 7f44b760cb80 1 -- 172.21.15.73:0/3989720271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55940a690de0 con 0x55940a912800 2023-08-10T11:53:01.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.121+0000 7f448cff9700 1 -- 172.21.15.73:0/3989720271 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55940a905470 con 0x55940a912800 2023-08-10T11:53:01.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.121+0000 7f448cff9700 1 -- 172.21.15.73:0/3989720271 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f44940c9f90 con 0x55940a912800 2023-08-10T11:53:01.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.121+0000 7f44b760cb80 10 client.15639 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:01.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.121+0000 7f44b760cb80 10 client.15639 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-08-10T11:53:01.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.121+0000 7f44b760cb80 20 client.15639 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:01.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.121+0000 7f44b760cb80 1 --2- 172.21.15.73:0/3989720271 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x55940a92c180 0x55940a92e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.121+0000 7f44b760cb80 4 client.15639 mds_command: new command op to 24443 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:53:01.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.121+0000 7f44b760cb80 1 -- 172.21.15.73:0/3989720271 --> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55940a8e19d0 con 0x55940a92c180 2023-08-10T11:53:01.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.122+0000 7f44a8a0e700 1 --2- 172.21.15.73:0/3989720271 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x55940a92c180 0x55940a92e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.122+0000 7f448cff9700 10 client.15639 ms_handle_connect on v2:172.21.15.152:6834/1791572604 2023-08-10T11:53:01.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.122+0000 7f44a8a0e700 1 --2- 172.21.15.73:0/3989720271 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x55940a92c180 0x55940a92e5a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=44db610daa1543a1 server_cookie=817b95d42b671ba4 in_seq=0 out_seq=0 2023-08-10T11:53:01.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.123+0000 7f448cff9700 1 -- 172.21.15.73:0/3989720271 <== mds.3 v2:172.21.15.152:6834/1791572604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55940a8e19d0 con 0x55940a92c180 2023-08-10T11:53:01.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.123+0000 7f448cff9700 10 client.15639 handle_command_reply: tid=0 2023-08-10T11:53:01.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.123+0000 7f44b760cb80 1 client.15639 shutdown 2023-08-10T11:53:01.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.123+0000 7f44b760cb80 1 -- 172.21.15.73:0/3989720271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a912800 msgr2=0x55940a91e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.123+0000 7f44b760cb80 1 --2- 172.21.15.73:0/3989720271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a912800 0x55940a91e900 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4494096800 tx=0x7f449409de70 comp rx=0 tx=0).stop 2023-08-10T11:53:01.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.123+0000 7f44b760cb80 1 -- 172.21.15.73:0/3989720271 shutdown_connections 2023-08-10T11:53:01.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.123+0000 7f44b760cb80 1 --2- 172.21.15.73:0/3989720271 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x55940a92c180 0x55940a92e5a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.123+0000 7f44b760cb80 1 --2- 172.21.15.73:0/3989720271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55940a918870 0x55940a91c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.123+0000 7f44b760cb80 1 --2- 172.21.15.73:0/3989720271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a912800 0x55940a91e900 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.123+0000 7f44b760cb80 1 --2- 172.21.15.73:0/3989720271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940a917f50 0x55940a91bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.123+0000 7f448cff9700 0 client.15639 ms_handle_reset on v2:172.21.15.152:6834/1791572604 2023-08-10T11:53:01.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.123+0000 7f44b760cb80 1 -- 172.21.15.73:0/3989720271 >> 172.21.15.73:0/3989720271 conn(0x55940a86fcd0 msgr2=0x55940a90c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:01.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.123+0000 7f44b760cb80 1 -- 172.21.15.73:0/3989720271 shutdown_connections 2023-08-10T11:53:01.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.123+0000 7f44b760cb80 1 -- 172.21.15.73:0/3989720271 wait complete. 2023-08-10T11:53:01.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.123+0000 7f44b760cb80 20 client.15639 trim_cache size 0 max 16384 2023-08-10T11:53:01.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.136+0000 7f44b760cb80 1 Processor -- start 2023-08-10T11:53:01.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.136+0000 7f44b760cb80 1 -- start start 2023-08-10T11:53:01.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.136+0000 7f44b760cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55940a912800 0x55940a9122c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.136+0000 7f44b760cb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a917f50 0x55940a917490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.136+0000 7f44b760cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940a918870 0x55940a923310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.136+0000 7f44b760cb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940a6e6920 con 0x55940a917f50 2023-08-10T11:53:01.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.136+0000 7f44b760cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940a90ea60 con 0x55940a918870 2023-08-10T11:53:01.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.136+0000 7f44b760cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940a909f80 con 0x55940a912800 2023-08-10T11:53:01.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.136+0000 7f44a8a0e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a917f50 0x55940a917490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.136+0000 7f44a8a0e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a917f50 0x55940a917490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33130/0 (socket says 172.21.15.73:33130) 2023-08-10T11:53:01.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.136+0000 7f44a8a0e700 1 -- 172.21.15.73:0/3275667924 learned_addr learned my addr 172.21.15.73:0/3275667924 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:01.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.136+0000 7f44a920f700 1 --2- 172.21.15.73:0/3275667924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55940a912800 0x55940a9122c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.136+0000 7f44a9a10700 1 --2- 172.21.15.73:0/3275667924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940a918870 0x55940a923310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.136+0000 7f44a8a0e700 1 -- 172.21.15.73:0/3275667924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55940a912800 msgr2=0x55940a9122c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.136+0000 7f44a8a0e700 1 --2- 172.21.15.73:0/3275667924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55940a912800 0x55940a9122c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.136+0000 7f44a8a0e700 1 -- 172.21.15.73:0/3275667924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940a918870 msgr2=0x55940a923310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.136+0000 7f44a8a0e700 1 --2- 172.21.15.73:0/3275667924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940a918870 0x55940a923310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.136+0000 7f44a8a0e700 1 -- 172.21.15.73:0/3275667924 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55940a679c60 con 0x55940a917f50 2023-08-10T11:53:01.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.136+0000 7f44a9a10700 1 --2- 172.21.15.73:0/3275667924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940a918870 0x55940a923310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:01.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.136+0000 7f44a8a0e700 1 --2- 172.21.15.73:0/3275667924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a917f50 0x55940a917490 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f44a0005d90 tx=0x7f44a0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a37bb44c0f07b6da server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:01.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.136+0000 7f448ffff700 1 -- 172.21.15.73:0/3275667924 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0024040 con 0x55940a917f50 2023-08-10T11:53:01.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.137+0000 7f448ffff700 1 -- 172.21.15.73:0/3275667924 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f44a0025240 con 0x55940a917f50 2023-08-10T11:53:01.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.137+0000 7f448ffff700 1 -- 172.21.15.73:0/3275667924 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a001f400 con 0x55940a917f50 2023-08-10T11:53:01.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.137+0000 7f44b760cb80 1 -- 172.21.15.73:0/3275667924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a917f50 msgr2=0x55940a917490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.137+0000 7f44b760cb80 1 --2- 172.21.15.73:0/3275667924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a917f50 0x55940a917490 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f44a0005d90 tx=0x7f44a0012000 comp rx=0 tx=0).stop 2023-08-10T11:53:01.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.137+0000 7f44b760cb80 1 -- 172.21.15.73:0/3275667924 shutdown_connections 2023-08-10T11:53:01.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.137+0000 7f44b760cb80 1 --2- 172.21.15.73:0/3275667924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940a918870 0x55940a923310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.137+0000 7f44b760cb80 1 --2- 172.21.15.73:0/3275667924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55940a912800 0x55940a9122c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.137+0000 7f44b760cb80 1 --2- 172.21.15.73:0/3275667924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a917f50 0x55940a917490 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.137+0000 7f44b760cb80 1 -- 172.21.15.73:0/3275667924 >> 172.21.15.73:0/3275667924 conn(0x55940a86fcd0 msgr2=0x55940a918d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:01.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.137+0000 7f44b760cb80 1 -- 172.21.15.73:0/3275667924 shutdown_connections 2023-08-10T11:53:01.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.137+0000 7f44b760cb80 1 -- 172.21.15.73:0/3275667924 wait complete. 2023-08-10T11:53:01.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.137+0000 7f44b760cb80 1 -- start start 2023-08-10T11:53:01.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.138+0000 7f44b760cb80 1 Processor -- start 2023-08-10T11:53:01.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.138+0000 7f44b760cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940a912800 0x55940a923380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.138+0000 7f44b760cb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a917f50 0x55940a921740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.138+0000 7f44b760cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55940a918870 0x55940a921d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.138+0000 7f44b760cb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940a922450 con 0x55940a917f50 2023-08-10T11:53:01.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.138+0000 7f44b760cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940a9225c0 con 0x55940a912800 2023-08-10T11:53:01.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.138+0000 7f44b760cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940a984280 con 0x55940a918870 2023-08-10T11:53:01.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.138+0000 7f44b760cb80 10 client.0 _ll_register_callbacks cb 0x55940a800680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:01.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.138+0000 7f44a8a0e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a917f50 0x55940a921740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.138+0000 7f44a8a0e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a917f50 0x55940a921740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33136/0 (socket says 172.21.15.73:33136) 2023-08-10T11:53:01.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.138+0000 7f44a8a0e700 1 -- 172.21.15.73:0/1731509787 learned_addr learned my addr 172.21.15.73:0/1731509787 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:01.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.138+0000 7f44a920f700 1 --2- 172.21.15.73:0/1731509787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940a912800 0x55940a923380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.138+0000 7f44a9a10700 1 --2- 172.21.15.73:0/1731509787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55940a918870 0x55940a921d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.138+0000 7f44a8a0e700 1 -- 172.21.15.73:0/1731509787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55940a918870 msgr2=0x55940a921d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.138+0000 7f44a8a0e700 1 --2- 172.21.15.73:0/1731509787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55940a918870 0x55940a921d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.138+0000 7f44a8a0e700 1 -- 172.21.15.73:0/1731509787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940a912800 msgr2=0x55940a923380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.138+0000 7f44a8a0e700 1 --2- 172.21.15.73:0/1731509787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940a912800 0x55940a923380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.138+0000 7f44a8a0e700 1 -- 172.21.15.73:0/1731509787 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a000d910 con 0x55940a917f50 2023-08-10T11:53:01.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.139+0000 7f44a9a10700 1 --2- 172.21.15.73:0/1731509787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55940a918870 0x55940a921d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:01.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.139+0000 7f44a8a0e700 1 --2- 172.21.15.73:0/1731509787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a917f50 0x55940a921740 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f44a0005d60 tx=0x7f44a0010f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5200146c3e7ac793 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:01.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.139+0000 7f448cff9700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:01.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.139+0000 7f448cff9700 1 -- 172.21.15.73:0/1731509787 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0024030 con 0x55940a917f50 2023-08-10T11:53:01.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.139+0000 7f448cff9700 1 -- 172.21.15.73:0/1731509787 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f44a001f810 con 0x55940a917f50 2023-08-10T11:53:01.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.139+0000 7f44b760cb80 1 -- 172.21.15.73:0/1731509787 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f449c004a50 con 0x55940a917f50 2023-08-10T11:53:01.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.139+0000 7f448cff9700 1 -- 172.21.15.73:0/1731509787 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44a001f9d0 con 0x55940a917f50 2023-08-10T11:53:01.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.139+0000 7f44b760cb80 10 client.15645 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:01.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.139+0000 7f44b760cb80 1 -- 172.21.15.73:0/1731509787 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55940a6b7250 con 0x55940a917f50 2023-08-10T11:53:01.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.139+0000 7f448cff9700 1 -- 172.21.15.73:0/1731509787 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f449c004a50 con 0x55940a917f50 2023-08-10T11:53:01.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.139+0000 7f448cff9700 1 -- 172.21.15.73:0/1731509787 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f44a0037c60 con 0x55940a917f50 2023-08-10T11:53:01.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.139+0000 7f44b760cb80 10 client.15645 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:01.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.139+0000 7f44b760cb80 10 client.15645 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-08-10T11:53:01.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.139+0000 7f44b760cb80 20 client.15645 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:01.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.139+0000 7f44b760cb80 1 --2- 172.21.15.73:0/1731509787 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x55940a9857c0 0x55940a987be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.139+0000 7f44b760cb80 4 client.15645 mds_command: new command op to 24443 tid=0[{"prefix": "damage ls"}] 2023-08-10T11:53:01.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.139+0000 7f44b760cb80 1 -- 172.21.15.73:0/1731509787 --> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55940a85c780 con 0x55940a9857c0 2023-08-10T11:53:01.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.139+0000 7f44a920f700 1 --2- 172.21.15.73:0/1731509787 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x55940a9857c0 0x55940a987be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.140+0000 7f448cff9700 10 client.15645 ms_handle_connect on v2:172.21.15.152:6834/1791572604 2023-08-10T11:53:01.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.140+0000 7f44a920f700 1 --2- 172.21.15.73:0/1731509787 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x55940a9857c0 0x55940a987be0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c8cd223883d22c4b server_cookie=d951cb90acd37a52 in_seq=0 out_seq=0 2023-08-10T11:53:01.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.140+0000 7f448cff9700 1 -- 172.21.15.73:0/1731509787 <== mds.3 v2:172.21.15.152:6834/1791572604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55940a85c780 con 0x55940a9857c0 2023-08-10T11:53:01.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.140+0000 7f448cff9700 10 client.15645 handle_command_reply: tid=0 2023-08-10T11:53:01.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.140+0000 7f44b760cb80 1 client.15645 shutdown 2023-08-10T11:53:01.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.140+0000 7f44b760cb80 1 -- 172.21.15.73:0/1731509787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a917f50 msgr2=0x55940a921740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.140+0000 7f44b760cb80 1 --2- 172.21.15.73:0/1731509787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a917f50 0x55940a921740 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f44a0005d60 tx=0x7f44a0010f10 comp rx=0 tx=0).stop 2023-08-10T11:53:01.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.140+0000 7f44b760cb80 1 -- 172.21.15.73:0/1731509787 shutdown_connections 2023-08-10T11:53:01.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.140+0000 7f44b760cb80 1 --2- 172.21.15.73:0/1731509787 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x55940a9857c0 0x55940a987be0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.140+0000 7f44b760cb80 1 --2- 172.21.15.73:0/1731509787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55940a912800 0x55940a923380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.140+0000 7f448cff9700 0 client.15645 ms_handle_reset on v2:172.21.15.152:6834/1791572604 2023-08-10T11:53:01.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.140+0000 7f44b760cb80 1 --2- 172.21.15.73:0/1731509787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55940a918870 0x55940a921d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.140+0000 7f44b760cb80 1 --2- 172.21.15.73:0/1731509787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55940a917f50 0x55940a921740 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.140+0000 7f44b760cb80 1 -- 172.21.15.73:0/1731509787 >> 172.21.15.73:0/1731509787 conn(0x55940a86fcd0 msgr2=0x55940a916c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:01.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.140+0000 7f44b760cb80 1 -- 172.21.15.73:0/1731509787 shutdown_connections 2023-08-10T11:53:01.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.140+0000 7f44b760cb80 1 -- 172.21.15.73:0/1731509787 wait complete. 2023-08-10T11:53:01.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.140+0000 7f44b760cb80 20 client.15645 trim_cache size 0 max 16384 2023-08-10T11:53:01.154 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2023-08-10T11:53:01.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.141+0000 7f44ab473700 1 -- 172.21.15.73:0/2883764950 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f44900a1350 msgr2=0x7f44900a3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.141+0000 7f44ab473700 1 --2- 172.21.15.73:0/2883764950 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f44900a1350 0x7f44900a3810 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f44a0005950 tx=0x7f44a00058e0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.141+0000 7f44ab473700 1 -- 172.21.15.73:0/2883764950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44a40ff5d0 msgr2=0x7f44a419b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.141+0000 7f44ab473700 1 --2- 172.21.15.73:0/2883764950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44a40ff5d0 0x7f44a419b5a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f449400c920 tx=0x7f449400cce0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.141+0000 7f44ab473700 1 -- 172.21.15.73:0/2883764950 shutdown_connections 2023-08-10T11:53:01.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.141+0000 7f44ab473700 1 --2- 172.21.15.73:0/2883764950 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f44900a1350 0x7f44900a3810 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.141+0000 7f44ab473700 1 --2- 172.21.15.73:0/2883764950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44a4105690 0x7f44a4195660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.141+0000 7f44ab473700 1 --2- 172.21.15.73:0/2883764950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44a40ff5d0 0x7f44a419b5a0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.141+0000 7f44ab473700 1 --2- 172.21.15.73:0/2883764950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44a40fff90 0x7f44a419bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.141+0000 7f44ab473700 1 -- 172.21.15.73:0/2883764950 >> 172.21.15.73:0/2883764950 conn(0x7f44a40fb0c0 msgr2=0x7f44a40fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:01.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.141+0000 7f44ab473700 1 -- 172.21.15.73:0/2883764950 shutdown_connections 2023-08-10T11:53:01.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.141+0000 7f44ab473700 1 -- 172.21.15.73:0/2883764950 wait complete. 2023-08-10T11:53:01.157 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-08-10T11:53:01.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.278+0000 7f4c750e6700 1 -- 172.21.15.73:0/3497633139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c700fff90 msgr2=0x7f4c7010c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.278+0000 7f4c750e6700 1 --2- 172.21.15.73:0/3497633139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c700fff90 0x7f4c7010c450 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800b0d0 tx=0x7f4c6800b3e0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.278+0000 7f4c750e6700 1 -- 172.21.15.73:0/3497633139 shutdown_connections 2023-08-10T11:53:01.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.278+0000 7f4c750e6700 1 --2- 172.21.15.73:0/3497633139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c700fff90 0x7f4c7010c450 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.278+0000 7f4c750e6700 1 --2- 172.21.15.73:0/3497633139 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c70105690 0x7f4c70105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.278+0000 7f4c750e6700 1 --2- 172.21.15.73:0/3497633139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c700ff5d0 0x7f4c700ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.278+0000 7f4c750e6700 1 -- 172.21.15.73:0/3497633139 >> 172.21.15.73:0/3497633139 conn(0x7f4c700fb0c0 msgr2=0x7f4c700fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:01.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.278+0000 7f4c750e6700 1 -- 172.21.15.73:0/3497633139 shutdown_connections 2023-08-10T11:53:01.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.278+0000 7f4c750e6700 1 -- 172.21.15.73:0/3497633139 wait complete. 2023-08-10T11:53:01.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.279+0000 7f4c750e6700 1 Processor -- start 2023-08-10T11:53:01.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.279+0000 7f4c750e6700 1 -- start start 2023-08-10T11:53:01.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.280+0000 7f4c750e6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c700ff5d0 0x7f4c701975f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.280+0000 7f4c750e6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c700fff90 0x7f4c70197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.280+0000 7f4c750e6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c70105690 0x7f4c701a2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.280+0000 7f4c750e6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c701a2bb0 con 0x7f4c700ff5d0 2023-08-10T11:53:01.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.280+0000 7f4c750e6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c701a2cf0 con 0x7f4c700fff90 2023-08-10T11:53:01.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.280+0000 7f4c750e6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c701a2e30 con 0x7f4c70105690 2023-08-10T11:53:01.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.280+0000 7f4c6ed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c700ff5d0 0x7f4c701975f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.280+0000 7f4c6ed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c700ff5d0 0x7f4c701975f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33148/0 (socket says 172.21.15.73:33148) 2023-08-10T11:53:01.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.280+0000 7f4c6ed9d700 1 -- 172.21.15.73:0/2868277799 learned_addr learned my addr 172.21.15.73:0/2868277799 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:01.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.280+0000 7f4c6e59c700 1 --2- 172.21.15.73:0/2868277799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c700fff90 0x7f4c70197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.280+0000 7f4c6f59e700 1 --2- 172.21.15.73:0/2868277799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c70105690 0x7f4c701a2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.280+0000 7f4c6ed9d700 1 -- 172.21.15.73:0/2868277799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c70105690 msgr2=0x7f4c701a2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.280+0000 7f4c6ed9d700 1 --2- 172.21.15.73:0/2868277799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c70105690 0x7f4c701a2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.280+0000 7f4c6ed9d700 1 -- 172.21.15.73:0/2868277799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c700fff90 msgr2=0x7f4c70197b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.280+0000 7f4c6ed9d700 1 --2- 172.21.15.73:0/2868277799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c700fff90 0x7f4c70197b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.280+0000 7f4c6ed9d700 1 -- 172.21.15.73:0/2868277799 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c68009d00 con 0x7f4c700ff5d0 2023-08-10T11:53:01.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.280+0000 7f4c6ed9d700 1 --2- 172.21.15.73:0/2868277799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c700ff5d0 0x7f4c701975f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000c920 tx=0x7f4c6000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:01.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.280+0000 7f4c57fff700 1 -- 172.21.15.73:0/2868277799 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60007b00 con 0x7f4c700ff5d0 2023-08-10T11:53:01.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.280+0000 7f4c750e6700 1 -- 172.21.15.73:0/2868277799 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c701a3090 con 0x7f4c700ff5d0 2023-08-10T11:53:01.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.280+0000 7f4c57fff700 1 -- 172.21.15.73:0/2868277799 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c6000ce70 con 0x7f4c700ff5d0 2023-08-10T11:53:01.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.280+0000 7f4c57fff700 1 -- 172.21.15.73:0/2868277799 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60005460 con 0x7f4c700ff5d0 2023-08-10T11:53:01.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.280+0000 7f4c750e6700 1 -- 172.21.15.73:0/2868277799 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c701a35c0 con 0x7f4c700ff5d0 2023-08-10T11:53:01.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.283+0000 7f4c57fff700 1 -- 172.21.15.73:0/2868277799 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 23) v1 ==== 135891+0+0 (secure 0 0 0) 0x7f4c60004750 con 0x7f4c700ff5d0 2023-08-10T11:53:01.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.284+0000 7f4c57fff700 1 --2- 172.21.15.73:0/2868277799 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f4c580a1350 0x7f4c580a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.284+0000 7f4c6e59c700 1 --2- 172.21.15.73:0/2868277799 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f4c580a1350 0x7f4c580a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.284+0000 7f4c57fff700 1 -- 172.21.15.73:0/2868277799 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f4c600cc7c0 con 0x7f4c700ff5d0 2023-08-10T11:53:01.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.284+0000 7f4c6e59c700 1 --2- 172.21.15.73:0/2868277799 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f4c580a1350 0x7f4c580a3810 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400ac50 tx=0x7f4c6400a380 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:01.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.284+0000 7f4c8127fb80 1 Processor -- start 2023-08-10T11:53:01.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.284+0000 7f4c8127fb80 1 -- start start 2023-08-10T11:53:01.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.284+0000 7f4c8127fb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90f4f50 0x55f3f90f5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.284+0000 7f4c8127fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3f90f5870 0x55f3f90ef2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.284+0000 7f4c8127fb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3f90ef800 0x55f3f90efc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.285+0000 7f4c8127fb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f906adc0 con 0x55f3f90f4f50 2023-08-10T11:53:01.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.285+0000 7f4c8127fb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f9047590 con 0x55f3f90ef800 2023-08-10T11:53:01.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.285+0000 7f4c8127fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f9044eb0 con 0x55f3f90f5870 2023-08-10T11:53:01.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.285+0000 7f4c6ed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90f4f50 0x55f3f90f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.285+0000 7f4c6ed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90f4f50 0x55f3f90f5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33156/0 (socket says 172.21.15.73:33156) 2023-08-10T11:53:01.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.285+0000 7f4c6ed9d700 1 -- 172.21.15.73:0/1403815810 learned_addr learned my addr 172.21.15.73:0/1403815810 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:01.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.285+0000 7f4c6e59c700 1 --2- 172.21.15.73:0/1403815810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3f90f5870 0x55f3f90ef2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.285+0000 7f4c6ed9d700 1 -- 172.21.15.73:0/1403815810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3f90f5870 msgr2=0x55f3f90ef2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.285+0000 7f4c6ed9d700 1 --2- 172.21.15.73:0/1403815810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3f90f5870 0x55f3f90ef2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.285+0000 7f4c6ed9d700 1 -- 172.21.15.73:0/1403815810 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3f90ef800 msgr2=0x55f3f90efc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.285+0000 7f4c6f59e700 1 --2- 172.21.15.73:0/1403815810 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3f90ef800 0x55f3f90efc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.285+0000 7f4c6ed9d700 1 --2- 172.21.15.73:0/1403815810 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3f90ef800 0x55f3f90efc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.285+0000 7f4c6ed9d700 1 -- 172.21.15.73:0/1403815810 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3f8ec1630 con 0x55f3f90f4f50 2023-08-10T11:53:01.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.285+0000 7f4c6e59c700 1 --2- 172.21.15.73:0/1403815810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3f90f5870 0x55f3f90ef2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:01.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.285+0000 7f4c6f59e700 1 --2- 172.21.15.73:0/1403815810 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3f90ef800 0x55f3f90efc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:01.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.285+0000 7f4c6ed9d700 1 --2- 172.21.15.73:0/1403815810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90f4f50 0x55f3f90f5330 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4c600993f0 tx=0x7f4c60099590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f1e012839462be8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:01.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.285+0000 7f4c557fa700 1 -- 172.21.15.73:0/1403815810 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6009d720 con 0x55f3f90f4f50 2023-08-10T11:53:01.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.285+0000 7f4c557fa700 1 -- 172.21.15.73:0/1403815810 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c600a1b40 con 0x55f3f90f4f50 2023-08-10T11:53:01.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.285+0000 7f4c557fa700 1 -- 172.21.15.73:0/1403815810 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60099950 con 0x55f3f90f4f50 2023-08-10T11:53:01.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.286+0000 7f4c8127fb80 1 -- 172.21.15.73:0/1403815810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90f4f50 msgr2=0x55f3f90f5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.286+0000 7f4c8127fb80 1 --2- 172.21.15.73:0/1403815810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90f4f50 0x55f3f90f5330 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4c600993f0 tx=0x7f4c60099590 comp rx=0 tx=0).stop 2023-08-10T11:53:01.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.286+0000 7f4c8127fb80 1 -- 172.21.15.73:0/1403815810 shutdown_connections 2023-08-10T11:53:01.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.286+0000 7f4c8127fb80 1 --2- 172.21.15.73:0/1403815810 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3f90ef800 0x55f3f90efc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.286+0000 7f4c8127fb80 1 --2- 172.21.15.73:0/1403815810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90f4f50 0x55f3f90f5330 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.286+0000 7f4c8127fb80 1 --2- 172.21.15.73:0/1403815810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3f90f5870 0x55f3f90ef2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.286+0000 7f4c8127fb80 1 -- 172.21.15.73:0/1403815810 >> 172.21.15.73:0/1403815810 conn(0x55f3f904ccd0 msgr2=0x55f3f90ea4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:01.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.286+0000 7f4c8127fb80 1 -- 172.21.15.73:0/1403815810 shutdown_connections 2023-08-10T11:53:01.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.286+0000 7f4c8127fb80 1 -- 172.21.15.73:0/1403815810 wait complete. 2023-08-10T11:53:01.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.286+0000 7f4c8127fb80 1 -- start start 2023-08-10T11:53:01.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.286+0000 7f4c8127fb80 1 Processor -- start 2023-08-10T11:53:01.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.287+0000 7f4c8127fb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90ef800 0x55f3f90fb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.287+0000 7f4c8127fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3f90f4f50 0x55f3f90f8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.287+0000 7f4c8127fb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3f90f5870 0x55f3f90f90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.287+0000 7f4c8127fb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f90407a0 con 0x55f3f90ef800 2023-08-10T11:53:01.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.287+0000 7f4c8127fb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f8fdfac0 con 0x55f3f90f5870 2023-08-10T11:53:01.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.287+0000 7f4c8127fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f8fdf7c0 con 0x55f3f90f4f50 2023-08-10T11:53:01.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.287+0000 7f4c8127fb80 10 client.0 _ll_register_callbacks cb 0x55f3f8fdd680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:01.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.287+0000 7f4c6ed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90ef800 0x55f3f90fb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.287+0000 7f4c6ed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90ef800 0x55f3f90fb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33162/0 (socket says 172.21.15.73:33162) 2023-08-10T11:53:01.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.287+0000 7f4c6ed9d700 1 -- 172.21.15.73:0/1277027698 learned_addr learned my addr 172.21.15.73:0/1277027698 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:01.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.287+0000 7f4c6e59c700 1 --2- 172.21.15.73:0/1277027698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3f90f4f50 0x55f3f90f8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.287+0000 7f4c6f59e700 1 --2- 172.21.15.73:0/1277027698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3f90f5870 0x55f3f90f90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.287+0000 7f4c6ed9d700 1 -- 172.21.15.73:0/1277027698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3f90f4f50 msgr2=0x55f3f90f8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.287+0000 7f4c6ed9d700 1 --2- 172.21.15.73:0/1277027698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3f90f4f50 0x55f3f90f8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.287+0000 7f4c6ed9d700 1 -- 172.21.15.73:0/1277027698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3f90f5870 msgr2=0x55f3f90f90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.287+0000 7f4c6ed9d700 1 --2- 172.21.15.73:0/1277027698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3f90f5870 0x55f3f90f90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.287+0000 7f4c6ed9d700 1 -- 172.21.15.73:0/1277027698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c701a35c0 con 0x55f3f90ef800 2023-08-10T11:53:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.287+0000 7f4c6f59e700 1 --2- 172.21.15.73:0/1277027698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3f90f5870 0x55f3f90f90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:53:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.287+0000 7f4c6ed9d700 1 --2- 172.21.15.73:0/1277027698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90ef800 0x55f3f90fb8b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4c600074a0 tx=0x7f4c60097a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422e506b548b4a69 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.287+0000 7f4c52ff5700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.287+0000 7f4c52ff5700 1 -- 172.21.15.73:0/1277027698 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60098de0 con 0x55f3f90ef800 2023-08-10T11:53:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.287+0000 7f4c52ff5700 1 -- 172.21.15.73:0/1277027698 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f4c60099950 con 0x55f3f90ef800 2023-08-10T11:53:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.287+0000 7f4c8127fb80 1 -- 172.21.15.73:0/1277027698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f3f90e2470 con 0x55f3f90ef800 2023-08-10T11:53:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.287+0000 7f4c52ff5700 1 -- 172.21.15.73:0/1277027698 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c60099b10 con 0x55f3f90ef800 2023-08-10T11:53:01.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.287+0000 7f4c8127fb80 10 client.15657 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:01.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.287+0000 7f4c8127fb80 1 -- 172.21.15.73:0/1277027698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f3f8e6dde0 con 0x55f3f90ef800 2023-08-10T11:53:01.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.288+0000 7f4c52ff5700 1 -- 172.21.15.73:0/1277027698 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f3f90e2470 con 0x55f3f90ef800 2023-08-10T11:53:01.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.288+0000 7f4c52ff5700 1 -- 172.21.15.73:0/1277027698 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4c600b7d20 con 0x55f3f90ef800 2023-08-10T11:53:01.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.288+0000 7f4c8127fb80 10 client.15657 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:01.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.288+0000 7f4c8127fb80 10 client.15657 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-08-10T11:53:01.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.288+0000 7f4c8127fb80 20 client.15657 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:01.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.288+0000 7f4c8127fb80 1 --2- 172.21.15.73:0/1277027698 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55f3f9108b70 0x55f3f910af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.288+0000 7f4c8127fb80 4 client.15657 mds_command: new command op to 24451 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:53:01.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.288+0000 7f4c8127fb80 1 -- 172.21.15.73:0/1277027698 --> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f3f90be9d0 con 0x55f3f9108b70 2023-08-10T11:53:01.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.288+0000 7f4c6e59c700 1 --2- 172.21.15.73:0/1277027698 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55f3f9108b70 0x55f3f910af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.289+0000 7f4c52ff5700 10 client.15657 ms_handle_connect on v2:172.21.15.156:6834/904126790 2023-08-10T11:53:01.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.289+0000 7f4c6e59c700 1 --2- 172.21.15.73:0/1277027698 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55f3f9108b70 0x55f3f910af60 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6d9128eff3ea5e02 server_cookie=7265e9a2b805afb5 in_seq=0 out_seq=0 2023-08-10T11:53:01.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.289+0000 7f4c52ff5700 1 -- 172.21.15.73:0/1277027698 <== mds.2 v2:172.21.15.156:6834/904126790 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55f3f90be9d0 con 0x55f3f9108b70 2023-08-10T11:53:01.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.289+0000 7f4c52ff5700 10 client.15657 handle_command_reply: tid=0 2023-08-10T11:53:01.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.289+0000 7f4c8127fb80 1 client.15657 shutdown 2023-08-10T11:53:01.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.289+0000 7f4c8127fb80 1 -- 172.21.15.73:0/1277027698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90ef800 msgr2=0x55f3f90fb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.289+0000 7f4c8127fb80 1 --2- 172.21.15.73:0/1277027698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90ef800 0x55f3f90fb8b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4c600074a0 tx=0x7f4c60097a90 comp rx=0 tx=0).stop 2023-08-10T11:53:01.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.289+0000 7f4c8127fb80 1 -- 172.21.15.73:0/1277027698 shutdown_connections 2023-08-10T11:53:01.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.289+0000 7f4c8127fb80 1 --2- 172.21.15.73:0/1277027698 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55f3f9108b70 0x55f3f910af60 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.289+0000 7f4c8127fb80 1 --2- 172.21.15.73:0/1277027698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3f90f5870 0x55f3f90f90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.289+0000 7f4c52ff5700 0 client.15657 ms_handle_reset on v2:172.21.15.156:6834/904126790 2023-08-10T11:53:01.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.289+0000 7f4c8127fb80 1 --2- 172.21.15.73:0/1277027698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90ef800 0x55f3f90fb8b0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.289+0000 7f4c8127fb80 1 --2- 172.21.15.73:0/1277027698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3f90f4f50 0x55f3f90f8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.289+0000 7f4c8127fb80 1 -- 172.21.15.73:0/1277027698 >> 172.21.15.73:0/1277027698 conn(0x55f3f904ccd0 msgr2=0x55f3f90e99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:01.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.290+0000 7f4c8127fb80 1 -- 172.21.15.73:0/1277027698 shutdown_connections 2023-08-10T11:53:01.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.290+0000 7f4c8127fb80 1 -- 172.21.15.73:0/1277027698 wait complete. 2023-08-10T11:53:01.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.290+0000 7f4c8127fb80 20 client.15657 trim_cache size 0 max 16384 2023-08-10T11:53:01.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.302+0000 7f4c8127fb80 1 Processor -- start 2023-08-10T11:53:01.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.302+0000 7f4c8127fb80 1 -- start start 2023-08-10T11:53:01.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.302+0000 7f4c8127fb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3f90ef800 0x55f3f90f8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.303+0000 7f4c8127fb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90f4f50 0x55f3f910f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.303+0000 7f4c8127fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3f90f5870 0x55f3f9100240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.303+0000 7f4c8127fb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f8ec3920 con 0x55f3f90f4f50 2023-08-10T11:53:01.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.303+0000 7f4c8127fb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f9100780 con 0x55f3f90ef800 2023-08-10T11:53:01.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.303+0000 7f4c8127fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f90eb390 con 0x55f3f90f5870 2023-08-10T11:53:01.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.303+0000 7f4c6e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90f4f50 0x55f3f910f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.303+0000 7f4c6e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90f4f50 0x55f3f910f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33172/0 (socket says 172.21.15.73:33172) 2023-08-10T11:53:01.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.303+0000 7f4c6e59c700 1 -- 172.21.15.73:0/3576933935 learned_addr learned my addr 172.21.15.73:0/3576933935 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:01.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.303+0000 7f4c6f59e700 1 --2- 172.21.15.73:0/3576933935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3f90f5870 0x55f3f9100240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.303+0000 7f4c6e59c700 1 -- 172.21.15.73:0/3576933935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3f90f5870 msgr2=0x55f3f9100240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.303+0000 7f4c6e59c700 1 --2- 172.21.15.73:0/3576933935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3f90f5870 0x55f3f9100240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.303+0000 7f4c6e59c700 1 -- 172.21.15.73:0/3576933935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3f90ef800 msgr2=0x55f3f90f8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.303+0000 7f4c6e59c700 1 --2- 172.21.15.73:0/3576933935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3f90ef800 0x55f3f90f8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.303+0000 7f4c6e59c700 1 -- 172.21.15.73:0/3576933935 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3f8e56c60 con 0x55f3f90f4f50 2023-08-10T11:53:01.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.303+0000 7f4c6e59c700 1 --2- 172.21.15.73:0/3576933935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90f4f50 0x55f3f910f850 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x55f3f90f5cf0 tx=0x7f4c64012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49074a6dd7697cd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:01.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.303+0000 7f4c55ffb700 1 -- 172.21.15.73:0/3576933935 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c64023070 con 0x55f3f90f4f50 2023-08-10T11:53:01.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.303+0000 7f4c55ffb700 1 -- 172.21.15.73:0/3576933935 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c64003e20 con 0x55f3f90f4f50 2023-08-10T11:53:01.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.303+0000 7f4c55ffb700 1 -- 172.21.15.73:0/3576933935 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c64025d40 con 0x55f3f90f4f50 2023-08-10T11:53:01.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.304+0000 7f4c8127fb80 1 -- 172.21.15.73:0/3576933935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90f4f50 msgr2=0x55f3f910f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.304+0000 7f4c8127fb80 1 --2- 172.21.15.73:0/3576933935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90f4f50 0x55f3f910f850 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x55f3f90f5cf0 tx=0x7f4c64012000 comp rx=0 tx=0).stop 2023-08-10T11:53:01.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.304+0000 7f4c8127fb80 1 -- 172.21.15.73:0/3576933935 shutdown_connections 2023-08-10T11:53:01.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.304+0000 7f4c8127fb80 1 --2- 172.21.15.73:0/3576933935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3f90ef800 0x55f3f90f8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.304+0000 7f4c8127fb80 1 --2- 172.21.15.73:0/3576933935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3f90f5870 0x55f3f9100240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.304+0000 7f4c8127fb80 1 --2- 172.21.15.73:0/3576933935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90f4f50 0x55f3f910f850 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.304+0000 7f4c8127fb80 1 -- 172.21.15.73:0/3576933935 >> 172.21.15.73:0/3576933935 conn(0x55f3f904ccd0 msgr2=0x55f3f90f8360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:01.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.304+0000 7f4c8127fb80 1 -- 172.21.15.73:0/3576933935 shutdown_connections 2023-08-10T11:53:01.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.304+0000 7f4c8127fb80 1 -- 172.21.15.73:0/3576933935 wait complete. 2023-08-10T11:53:01.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.304+0000 7f4c8127fb80 1 -- start start 2023-08-10T11:53:01.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.304+0000 7f4c8127fb80 1 Processor -- start 2023-08-10T11:53:01.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.304+0000 7f4c8127fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3f90ef800 0x55f3f9154b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.304+0000 7f4c8127fb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3f90f4f50 0x55f3f9155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.304+0000 7f4c8127fb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90f5870 0x55f3f90fc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.304+0000 7f4c8127fb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f90fc7f0 con 0x55f3f90f5870 2023-08-10T11:53:01.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.304+0000 7f4c8127fb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f90fc960 con 0x55f3f90f4f50 2023-08-10T11:53:01.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.304+0000 7f4c8127fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f90fcb20 con 0x55f3f90ef800 2023-08-10T11:53:01.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.304+0000 7f4c8127fb80 10 client.0 _ll_register_callbacks cb 0x55f3f8fdd680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:01.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.304+0000 7f4c6f59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90f5870 0x55f3f90fc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.304+0000 7f4c6f59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90f5870 0x55f3f90fc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33180/0 (socket says 172.21.15.73:33180) 2023-08-10T11:53:01.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.304+0000 7f4c6f59e700 1 -- 172.21.15.73:0/770429466 learned_addr learned my addr 172.21.15.73:0/770429466 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:01.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.305+0000 7f4c6ed9d700 1 --2- 172.21.15.73:0/770429466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3f90ef800 0x55f3f9154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.305+0000 7f4c6f59e700 1 -- 172.21.15.73:0/770429466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3f90ef800 msgr2=0x55f3f9154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.305+0000 7f4c6f59e700 1 --2- 172.21.15.73:0/770429466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3f90ef800 0x55f3f9154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.305+0000 7f4c6f59e700 1 -- 172.21.15.73:0/770429466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3f90f4f50 msgr2=0x55f3f9155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.305+0000 7f4c6f59e700 1 --2- 172.21.15.73:0/770429466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3f90f4f50 0x55f3f9155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.305+0000 7f4c6f59e700 1 -- 172.21.15.73:0/770429466 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c64004030 con 0x55f3f90f5870 2023-08-10T11:53:01.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.305+0000 7f4c6ed9d700 1 --2- 172.21.15.73:0/770429466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3f90ef800 0x55f3f9154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:01.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.305+0000 7f4c6f59e700 1 --2- 172.21.15.73:0/770429466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90f5870 0x55f3f90fc220 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4c68015000 tx=0x7f4c68004d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8efece8cb95bf855 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:01.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.305+0000 7f4c52ff5700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:01.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.305+0000 7f4c52ff5700 1 -- 172.21.15.73:0/770429466 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6800e040 con 0x55f3f90f5870 2023-08-10T11:53:01.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.305+0000 7f4c52ff5700 1 -- 172.21.15.73:0/770429466 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f4c68007760 con 0x55f3f90f5870 2023-08-10T11:53:01.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.305+0000 7f4c8127fb80 1 -- 172.21.15.73:0/770429466 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4c600a1b40 con 0x55f3f90f5870 2023-08-10T11:53:01.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.305+0000 7f4c52ff5700 1 -- 172.21.15.73:0/770429466 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c68007940 con 0x55f3f90f5870 2023-08-10T11:53:01.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.305+0000 7f4c8127fb80 10 client.15663 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:01.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.305+0000 7f4c8127fb80 1 -- 172.21.15.73:0/770429466 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f3f8e94250 con 0x55f3f90f5870 2023-08-10T11:53:01.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.305+0000 7f4c52ff5700 1 -- 172.21.15.73:0/770429466 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c600a1b40 con 0x55f3f90f5870 2023-08-10T11:53:01.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.305+0000 7f4c52ff5700 1 -- 172.21.15.73:0/770429466 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4c6800b100 con 0x55f3f90f5870 2023-08-10T11:53:01.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.306+0000 7f4c8127fb80 10 client.15663 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:01.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.306+0000 7f4c8127fb80 10 client.15663 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-08-10T11:53:01.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.306+0000 7f4c8127fb80 20 client.15663 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:01.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.306+0000 7f4c8127fb80 1 --2- 172.21.15.73:0/770429466 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55f3f915da30 0x55f3f915fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.306+0000 7f4c8127fb80 4 client.15663 mds_command: new command op to 24451 tid=0[{"prefix": "damage ls"}] 2023-08-10T11:53:01.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.306+0000 7f4c8127fb80 1 -- 172.21.15.73:0/770429466 --> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f3f9039780 con 0x55f3f915da30 2023-08-10T11:53:01.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.306+0000 7f4c6ed9d700 1 --2- 172.21.15.73:0/770429466 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55f3f915da30 0x55f3f915fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.306+0000 7f4c6ed9d700 1 --2- 172.21.15.73:0/770429466 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55f3f915da30 0x55f3f915fe50 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=87381c484cb35b0e server_cookie=1d1d56b46dd9cd31 in_seq=0 out_seq=0 2023-08-10T11:53:01.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.306+0000 7f4c52ff5700 10 client.15663 ms_handle_connect on v2:172.21.15.156:6834/904126790 2023-08-10T11:53:01.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.306+0000 7f4c52ff5700 1 -- 172.21.15.73:0/770429466 <== mds.2 v2:172.21.15.156:6834/904126790 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f3f9039780 con 0x55f3f915da30 2023-08-10T11:53:01.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.306+0000 7f4c52ff5700 10 client.15663 handle_command_reply: tid=0 2023-08-10T11:53:01.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.306+0000 7f4c8127fb80 1 client.15663 shutdown 2023-08-10T11:53:01.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.306+0000 7f4c8127fb80 1 -- 172.21.15.73:0/770429466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90f5870 msgr2=0x55f3f90fc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.306+0000 7f4c8127fb80 1 --2- 172.21.15.73:0/770429466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90f5870 0x55f3f90fc220 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4c68015000 tx=0x7f4c68004d80 comp rx=0 tx=0).stop 2023-08-10T11:53:01.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.306+0000 7f4c8127fb80 1 -- 172.21.15.73:0/770429466 shutdown_connections 2023-08-10T11:53:01.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.306+0000 7f4c8127fb80 1 --2- 172.21.15.73:0/770429466 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55f3f915da30 0x55f3f915fe50 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.306+0000 7f4c8127fb80 1 --2- 172.21.15.73:0/770429466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f3f90f5870 0x55f3f90fc220 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.306+0000 7f4c52ff5700 0 client.15663 ms_handle_reset on v2:172.21.15.156:6834/904126790 2023-08-10T11:53:01.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.306+0000 7f4c8127fb80 1 --2- 172.21.15.73:0/770429466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3f90ef800 0x55f3f9154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.306+0000 7f4c8127fb80 1 --2- 172.21.15.73:0/770429466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3f90f4f50 0x55f3f9155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.306+0000 7f4c8127fb80 1 -- 172.21.15.73:0/770429466 >> 172.21.15.73:0/770429466 conn(0x55f3f904ccd0 msgr2=0x55f3f90f43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:01.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.307+0000 7f4c8127fb80 1 -- 172.21.15.73:0/770429466 shutdown_connections 2023-08-10T11:53:01.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.307+0000 7f4c8127fb80 1 -- 172.21.15.73:0/770429466 wait complete. 2023-08-10T11:53:01.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.307+0000 7f4c8127fb80 20 client.15663 trim_cache size 0 max 16384 2023-08-10T11:53:01.323 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2023-08-10T11:53:01.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.307+0000 7f4c750e6700 1 -- 172.21.15.73:0/2868277799 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f4c580a1350 msgr2=0x7f4c580a3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.307+0000 7f4c750e6700 1 --2- 172.21.15.73:0/2868277799 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f4c580a1350 0x7f4c580a3810 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400ac50 tx=0x7f4c6400a380 comp rx=0 tx=0).stop 2023-08-10T11:53:01.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.307+0000 7f4c750e6700 1 -- 172.21.15.73:0/2868277799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c700ff5d0 msgr2=0x7f4c701975f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.307+0000 7f4c750e6700 1 --2- 172.21.15.73:0/2868277799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c700ff5d0 0x7f4c701975f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000c920 tx=0x7f4c6000cc30 comp rx=0 tx=0).stop 2023-08-10T11:53:01.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.307+0000 7f4c750e6700 1 -- 172.21.15.73:0/2868277799 shutdown_connections 2023-08-10T11:53:01.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.307+0000 7f4c750e6700 1 --2- 172.21.15.73:0/2868277799 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f4c580a1350 0x7f4c580a3810 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.307+0000 7f4c750e6700 1 --2- 172.21.15.73:0/2868277799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c70105690 0x7f4c701a2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.307+0000 7f4c750e6700 1 --2- 172.21.15.73:0/2868277799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c700ff5d0 0x7f4c701975f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.307+0000 7f4c750e6700 1 --2- 172.21.15.73:0/2868277799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c700fff90 0x7f4c70197b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.307+0000 7f4c750e6700 1 -- 172.21.15.73:0/2868277799 >> 172.21.15.73:0/2868277799 conn(0x7f4c700fb0c0 msgr2=0x7f4c700fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:01.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.307+0000 7f4c750e6700 1 -- 172.21.15.73:0/2868277799 shutdown_connections 2023-08-10T11:53:01.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.307+0000 7f4c750e6700 1 -- 172.21.15.73:0/2868277799 wait complete. 2023-08-10T11:53:01.326 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-08-10T11:53:01.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.446+0000 7f3687e83700 1 -- 172.21.15.73:0/2589250139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36801056a0 msgr2=0x7f3680105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.446+0000 7f3687e83700 1 --2- 172.21.15.73:0/2589250139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36801056a0 0x7f3680105a80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f3670009990 tx=0x7f3670009ca0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.446+0000 7f3687e83700 1 -- 172.21.15.73:0/2589250139 shutdown_connections 2023-08-10T11:53:01.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.446+0000 7f3687e83700 1 --2- 172.21.15.73:0/2589250139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36800fffc0 0x7f368010c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.446+0000 7f3687e83700 1 --2- 172.21.15.73:0/2589250139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36801056a0 0x7f3680105a80 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.446+0000 7f3687e83700 1 --2- 172.21.15.73:0/2589250139 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36800ff600 0x7f36800ffa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.446+0000 7f3687e83700 1 -- 172.21.15.73:0/2589250139 >> 172.21.15.73:0/2589250139 conn(0x7f36800fb110 msgr2=0x7f36800fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:01.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.446+0000 7f3687e83700 1 -- 172.21.15.73:0/2589250139 shutdown_connections 2023-08-10T11:53:01.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.446+0000 7f3687e83700 1 -- 172.21.15.73:0/2589250139 wait complete. 2023-08-10T11:53:01.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.447+0000 7f3687e83700 1 Processor -- start 2023-08-10T11:53:01.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.447+0000 7f3687e83700 1 -- start start 2023-08-10T11:53:01.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.447+0000 7f3687e83700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36800ff600 0x7f36801012a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.447+0000 7f3687e83700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36800fffc0 0x7f36801017e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.448+0000 7f3687e83700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36801056a0 0x7f36801a4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.448+0000 7f3687e83700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3680102010 con 0x7f36800fffc0 2023-08-10T11:53:01.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.448+0000 7f3687e83700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36801a4e90 con 0x7f36801056a0 2023-08-10T11:53:01.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.448+0000 7f3687e83700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36801a4fd0 con 0x7f36800ff600 2023-08-10T11:53:01.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.448+0000 7f368541e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36800fffc0 0x7f36801017e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.448+0000 7f368541e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36800fffc0 0x7f36801017e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33192/0 (socket says 172.21.15.73:33192) 2023-08-10T11:53:01.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.448+0000 7f368541e700 1 -- 172.21.15.73:0/2600540486 learned_addr learned my addr 172.21.15.73:0/2600540486 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:01.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.448+0000 7f3685c1f700 1 --2- 172.21.15.73:0/2600540486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36800ff600 0x7f36801012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.448+0000 7f3686420700 1 --2- 172.21.15.73:0/2600540486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36801056a0 0x7f36801a4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.448+0000 7f368541e700 1 -- 172.21.15.73:0/2600540486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36800ff600 msgr2=0x7f36801012a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.448+0000 7f368541e700 1 --2- 172.21.15.73:0/2600540486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36800ff600 0x7f36801012a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.448+0000 7f368541e700 1 -- 172.21.15.73:0/2600540486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36801056a0 msgr2=0x7f36801a4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.448+0000 7f368541e700 1 --2- 172.21.15.73:0/2600540486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36801056a0 0x7f36801a4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.448+0000 7f368541e700 1 -- 172.21.15.73:0/2600540486 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36700095f0 con 0x7f36800fffc0 2023-08-10T11:53:01.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.448+0000 7f3686420700 1 --2- 172.21.15.73:0/2600540486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36801056a0 0x7f36801a4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:01.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.448+0000 7f368541e700 1 --2- 172.21.15.73:0/2600540486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36800fffc0 0x7f36801017e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f367c00c920 tx=0x7f367c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:01.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.448+0000 7f3676ffd700 1 -- 172.21.15.73:0/2600540486 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c007b00 con 0x7f36800fffc0 2023-08-10T11:53:01.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.448+0000 7f3676ffd700 1 -- 172.21.15.73:0/2600540486 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f367c00ce70 con 0x7f36800fffc0 2023-08-10T11:53:01.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.448+0000 7f3687e83700 1 -- 172.21.15.73:0/2600540486 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36801a5230 con 0x7f36800fffc0 2023-08-10T11:53:01.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.448+0000 7f3676ffd700 1 -- 172.21.15.73:0/2600540486 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c0054e0 con 0x7f36800fffc0 2023-08-10T11:53:01.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.448+0000 7f3687e83700 1 -- 172.21.15.73:0/2600540486 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36801a5710 con 0x7f36800fffc0 2023-08-10T11:53:01.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.450+0000 7f3676ffd700 1 -- 172.21.15.73:0/2600540486 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 23) v1 ==== 135891+0+0 (secure 0 0 0) 0x7f367c004750 con 0x7f36800fffc0 2023-08-10T11:53:01.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.451+0000 7f3676ffd700 1 --2- 172.21.15.73:0/2600540486 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f366c0a1350 0x7f366c0a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.451+0000 7f3676ffd700 1 -- 172.21.15.73:0/2600540486 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f367c0cc9f0 con 0x7f36800fffc0 2023-08-10T11:53:01.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.451+0000 7f3685c1f700 1 --2- 172.21.15.73:0/2600540486 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f366c0a1350 0x7f366c0a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.451+0000 7f3685c1f700 1 --2- 172.21.15.73:0/2600540486 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f366c0a1350 0x7f366c0a3810 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f367000b5c0 tx=0x7f3670005fd0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:01.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.452+0000 7f369401cb80 1 Processor -- start 2023-08-10T11:53:01.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.452+0000 7f369401cb80 1 -- start start 2023-08-10T11:53:01.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.452+0000 7f369401cb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997dcf50 0x55e6997dd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.452+0000 7f369401cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e6997dd870 0x55e6997d72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.452+0000 7f369401cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6997d7800 0x55e6997d7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.452+0000 7f369401cb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e699752dc0 con 0x55e6997dcf50 2023-08-10T11:53:01.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.452+0000 7f369401cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69972f590 con 0x55e6997d7800 2023-08-10T11:53:01.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.452+0000 7f369401cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69972ceb0 con 0x55e6997dd870 2023-08-10T11:53:01.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.452+0000 7f3685c1f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997dcf50 0x55e6997dd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.452+0000 7f3685c1f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997dcf50 0x55e6997dd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33198/0 (socket says 172.21.15.73:33198) 2023-08-10T11:53:01.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.452+0000 7f3685c1f700 1 -- 172.21.15.73:0/1828255317 learned_addr learned my addr 172.21.15.73:0/1828255317 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:01.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.452+0000 7f368541e700 1 --2- 172.21.15.73:0/1828255317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e6997dd870 0x55e6997d72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.452+0000 7f3685c1f700 1 -- 172.21.15.73:0/1828255317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e6997dd870 msgr2=0x55e6997d72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.452+0000 7f3685c1f700 1 --2- 172.21.15.73:0/1828255317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e6997dd870 0x55e6997d72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.452+0000 7f3686420700 1 --2- 172.21.15.73:0/1828255317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6997d7800 0x55e6997d7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.452+0000 7f3685c1f700 1 -- 172.21.15.73:0/1828255317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6997d7800 msgr2=0x55e6997d7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.452+0000 7f3685c1f700 1 --2- 172.21.15.73:0/1828255317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6997d7800 0x55e6997d7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.452+0000 7f3685c1f700 1 -- 172.21.15.73:0/1828255317 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e6995a9630 con 0x55e6997dcf50 2023-08-10T11:53:01.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.452+0000 7f3686420700 1 --2- 172.21.15.73:0/1828255317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6997d7800 0x55e6997d7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:01.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.453+0000 7f3685c1f700 1 --2- 172.21.15.73:0/1828255317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997dcf50 0x55e6997dd330 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f3670003730 tx=0x7f3670020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3b7fa6ef882b98 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:01.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.453+0000 7f366bfff700 1 -- 172.21.15.73:0/1828255317 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367002a070 con 0x55e6997dcf50 2023-08-10T11:53:01.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.453+0000 7f366bfff700 1 -- 172.21.15.73:0/1828255317 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f367001e040 con 0x55e6997dcf50 2023-08-10T11:53:01.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.453+0000 7f366bfff700 1 -- 172.21.15.73:0/1828255317 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36700239f0 con 0x55e6997dcf50 2023-08-10T11:53:01.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.453+0000 7f369401cb80 1 -- 172.21.15.73:0/1828255317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997dcf50 msgr2=0x55e6997dd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.453+0000 7f369401cb80 1 --2- 172.21.15.73:0/1828255317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997dcf50 0x55e6997dd330 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f3670003730 tx=0x7f3670020000 comp rx=0 tx=0).stop 2023-08-10T11:53:01.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.453+0000 7f369401cb80 1 -- 172.21.15.73:0/1828255317 shutdown_connections 2023-08-10T11:53:01.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.453+0000 7f369401cb80 1 --2- 172.21.15.73:0/1828255317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6997d7800 0x55e6997d7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.453+0000 7f369401cb80 1 --2- 172.21.15.73:0/1828255317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997dcf50 0x55e6997dd330 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.453+0000 7f369401cb80 1 --2- 172.21.15.73:0/1828255317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e6997dd870 0x55e6997d72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.453+0000 7f369401cb80 1 -- 172.21.15.73:0/1828255317 >> 172.21.15.73:0/1828255317 conn(0x55e699734cd0 msgr2=0x55e6997d24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:01.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.454+0000 7f369401cb80 1 -- 172.21.15.73:0/1828255317 shutdown_connections 2023-08-10T11:53:01.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.454+0000 7f369401cb80 1 -- 172.21.15.73:0/1828255317 wait complete. 2023-08-10T11:53:01.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.454+0000 7f369401cb80 1 -- start start 2023-08-10T11:53:01.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.454+0000 7f369401cb80 1 Processor -- start 2023-08-10T11:53:01.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.454+0000 7f369401cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e6997d7800 0x55e6997e0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.454+0000 7f369401cb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997dcf50 0x55e6997e10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.454+0000 7f369401cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6997dd870 0x55e6997e1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.454+0000 7f369401cb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6997287a0 con 0x55e6997dcf50 2023-08-10T11:53:01.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.454+0000 7f369401cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6996c7ac0 con 0x55e6997dd870 2023-08-10T11:53:01.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.454+0000 7f369401cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6996c77c0 con 0x55e6997d7800 2023-08-10T11:53:01.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.454+0000 7f369401cb80 10 client.0 _ll_register_callbacks cb 0x55e6996c5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:01.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.454+0000 7f368541e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997dcf50 0x55e6997e10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.455+0000 7f368541e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997dcf50 0x55e6997e10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33206/0 (socket says 172.21.15.73:33206) 2023-08-10T11:53:01.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.455+0000 7f368541e700 1 -- 172.21.15.73:0/2840982743 learned_addr learned my addr 172.21.15.73:0/2840982743 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:01.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.455+0000 7f3686420700 1 --2- 172.21.15.73:0/2840982743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6997dd870 0x55e6997e1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.455+0000 7f3685c1f700 1 --2- 172.21.15.73:0/2840982743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e6997d7800 0x55e6997e0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.455+0000 7f368541e700 1 -- 172.21.15.73:0/2840982743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e6997d7800 msgr2=0x55e6997e0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.455+0000 7f368541e700 1 --2- 172.21.15.73:0/2840982743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e6997d7800 0x55e6997e0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.455+0000 7f368541e700 1 -- 172.21.15.73:0/2840982743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6997dd870 msgr2=0x55e6997e1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.455+0000 7f368541e700 1 --2- 172.21.15.73:0/2840982743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6997dd870 0x55e6997e1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.455+0000 7f368541e700 1 -- 172.21.15.73:0/2840982743 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f368010cdd0 con 0x55e6997dcf50 2023-08-10T11:53:01.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.455+0000 7f3686420700 1 --2- 172.21.15.73:0/2840982743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6997dd870 0x55e6997e1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:53:01.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.455+0000 7f368541e700 1 --2- 172.21.15.73:0/2840982743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997dcf50 0x55e6997e10e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f367c0074a0 tx=0x7f367c09da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238c5ddb9a9b1bb6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:01.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.455+0000 7f36697fa700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:01.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.455+0000 7f36697fa700 1 -- 172.21.15.73:0/2840982743 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c099be0 con 0x55e6997dcf50 2023-08-10T11:53:01.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.455+0000 7f36697fa700 1 -- 172.21.15.73:0/2840982743 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f367c099d40 con 0x55e6997dcf50 2023-08-10T11:53:01.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.455+0000 7f369401cb80 1 -- 172.21.15.73:0/2840982743 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e6997ca470 con 0x55e6997dcf50 2023-08-10T11:53:01.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.455+0000 7f36697fa700 1 -- 172.21.15.73:0/2840982743 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f367c098e70 con 0x55e6997dcf50 2023-08-10T11:53:01.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.455+0000 7f369401cb80 10 client.15675 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:01.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.455+0000 7f369401cb80 1 -- 172.21.15.73:0/2840982743 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55e699555de0 con 0x55e6997dcf50 2023-08-10T11:53:01.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.455+0000 7f36697fa700 1 -- 172.21.15.73:0/2840982743 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e6997ca470 con 0x55e6997dcf50 2023-08-10T11:53:01.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.456+0000 7f36697fa700 1 -- 172.21.15.73:0/2840982743 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f367c095770 con 0x55e6997dcf50 2023-08-10T11:53:01.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.456+0000 7f369401cb80 10 client.15675 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:01.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.456+0000 7f369401cb80 10 client.15675 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-08-10T11:53:01.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.456+0000 7f369401cb80 20 client.15675 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:01.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.456+0000 7f369401cb80 1 --2- 172.21.15.73:0/2840982743 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x55e6997f1070 0x55e6997f3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.456+0000 7f369401cb80 4 client.15675 mds_command: new command op to 24479 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:53:01.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.456+0000 7f369401cb80 1 -- 172.21.15.73:0/2840982743 --> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e6997a69d0 con 0x55e6997f1070 2023-08-10T11:53:01.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.456+0000 7f3685c1f700 1 --2- 172.21.15.73:0/2840982743 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x55e6997f1070 0x55e6997f3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.456+0000 7f36697fa700 10 client.15675 ms_handle_connect on v2:172.21.15.152:6836/74214089 2023-08-10T11:53:01.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.456+0000 7f3685c1f700 1 --2- 172.21.15.73:0/2840982743 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x55e6997f1070 0x55e6997f3490 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6d30b5a3fd0925a7 server_cookie=22c4cb95c11100ad in_seq=0 out_seq=0 2023-08-10T11:53:01.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.457+0000 7f36697fa700 1 -- 172.21.15.73:0/2840982743 <== mds.1 v2:172.21.15.152:6836/74214089 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55e6997a69d0 con 0x55e6997f1070 2023-08-10T11:53:01.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.457+0000 7f36697fa700 10 client.15675 handle_command_reply: tid=0 2023-08-10T11:53:01.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.457+0000 7f369401cb80 1 client.15675 shutdown 2023-08-10T11:53:01.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.457+0000 7f369401cb80 1 -- 172.21.15.73:0/2840982743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997dcf50 msgr2=0x55e6997e10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.457+0000 7f369401cb80 1 --2- 172.21.15.73:0/2840982743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997dcf50 0x55e6997e10e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f367c0074a0 tx=0x7f367c09da60 comp rx=0 tx=0).stop 2023-08-10T11:53:01.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.457+0000 7f369401cb80 1 -- 172.21.15.73:0/2840982743 shutdown_connections 2023-08-10T11:53:01.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.457+0000 7f369401cb80 1 --2- 172.21.15.73:0/2840982743 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x55e6997f1070 0x55e6997f3490 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.457+0000 7f369401cb80 1 --2- 172.21.15.73:0/2840982743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6997dd870 0x55e6997e1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.457+0000 7f36697fa700 0 client.15675 ms_handle_reset on v2:172.21.15.152:6836/74214089 2023-08-10T11:53:01.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.457+0000 7f369401cb80 1 --2- 172.21.15.73:0/2840982743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e6997d7800 0x55e6997e0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.457+0000 7f369401cb80 1 --2- 172.21.15.73:0/2840982743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997dcf50 0x55e6997e10e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.457+0000 7f369401cb80 1 -- 172.21.15.73:0/2840982743 >> 172.21.15.73:0/2840982743 conn(0x55e699734cd0 msgr2=0x55e6997d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:01.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.457+0000 7f369401cb80 1 -- 172.21.15.73:0/2840982743 shutdown_connections 2023-08-10T11:53:01.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.457+0000 7f369401cb80 1 -- 172.21.15.73:0/2840982743 wait complete. 2023-08-10T11:53:01.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.457+0000 7f369401cb80 20 client.15675 trim_cache size 0 max 16384 2023-08-10T11:53:01.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.470+0000 7f369401cb80 1 Processor -- start 2023-08-10T11:53:01.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.470+0000 7f369401cb80 1 -- start start 2023-08-10T11:53:01.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.470+0000 7f369401cb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997d7800 0x55e6997e8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.470+0000 7f369401cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e6997dcf50 0x55e6997dc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.470+0000 7f369401cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6997dd870 0x55e6997d2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.470+0000 7f369401cb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6995ab920 con 0x55e6997d7800 2023-08-10T11:53:01.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.470+0000 7f369401cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6997e3e40 con 0x55e6997dd870 2023-08-10T11:53:01.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.470+0000 7f369401cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6997cefb0 con 0x55e6997dcf50 2023-08-10T11:53:01.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.471+0000 7f3685c1f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997d7800 0x55e6997e8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.471+0000 7f3685c1f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997d7800 0x55e6997e8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33212/0 (socket says 172.21.15.73:33212) 2023-08-10T11:53:01.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.471+0000 7f3685c1f700 1 -- 172.21.15.73:0/2784362377 learned_addr learned my addr 172.21.15.73:0/2784362377 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:01.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.471+0000 7f368541e700 1 --2- 172.21.15.73:0/2784362377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e6997dcf50 0x55e6997dc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.471+0000 7f3686420700 1 --2- 172.21.15.73:0/2784362377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6997dd870 0x55e6997d2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.471+0000 7f3685c1f700 1 -- 172.21.15.73:0/2784362377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e6997dcf50 msgr2=0x55e6997dc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.471+0000 7f3685c1f700 1 --2- 172.21.15.73:0/2784362377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e6997dcf50 0x55e6997dc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.471+0000 7f3685c1f700 1 -- 172.21.15.73:0/2784362377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6997dd870 msgr2=0x55e6997d2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.471+0000 7f3685c1f700 1 --2- 172.21.15.73:0/2784362377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6997dd870 0x55e6997d2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.471+0000 7f3685c1f700 1 -- 172.21.15.73:0/2784362377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e69953ec60 con 0x55e6997d7800 2023-08-10T11:53:01.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.471+0000 7f3686420700 1 --2- 172.21.15.73:0/2784362377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6997dd870 0x55e6997d2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:01.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.471+0000 7f3685c1f700 1 --2- 172.21.15.73:0/2784362377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997d7800 0x55e6997e8300 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3670023540 tx=0x7f3670005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c7b1664782cc33 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:01.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.471+0000 7f3674ff9700 1 -- 172.21.15.73:0/2784362377 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367002a070 con 0x55e6997d7800 2023-08-10T11:53:01.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.471+0000 7f3674ff9700 1 -- 172.21.15.73:0/2784362377 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f367002b040 con 0x55e6997d7800 2023-08-10T11:53:01.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.471+0000 7f3674ff9700 1 -- 172.21.15.73:0/2784362377 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3670023c80 con 0x55e6997d7800 2023-08-10T11:53:01.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.472+0000 7f369401cb80 1 -- 172.21.15.73:0/2784362377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997d7800 msgr2=0x55e6997e8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.472+0000 7f369401cb80 1 --2- 172.21.15.73:0/2784362377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997d7800 0x55e6997e8300 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3670023540 tx=0x7f3670005040 comp rx=0 tx=0).stop 2023-08-10T11:53:01.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.472+0000 7f369401cb80 1 -- 172.21.15.73:0/2784362377 shutdown_connections 2023-08-10T11:53:01.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.472+0000 7f369401cb80 1 --2- 172.21.15.73:0/2784362377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6997dd870 0x55e6997d2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.472+0000 7f369401cb80 1 --2- 172.21.15.73:0/2784362377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997d7800 0x55e6997e8300 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.472+0000 7f369401cb80 1 --2- 172.21.15.73:0/2784362377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e6997dcf50 0x55e6997dc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.472+0000 7f369401cb80 1 -- 172.21.15.73:0/2784362377 >> 172.21.15.73:0/2784362377 conn(0x55e699734cd0 msgr2=0x55e6997dbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:01.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.472+0000 7f369401cb80 1 -- 172.21.15.73:0/2784362377 shutdown_connections 2023-08-10T11:53:01.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.472+0000 7f369401cb80 1 -- 172.21.15.73:0/2784362377 wait complete. 2023-08-10T11:53:01.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.472+0000 7f369401cb80 1 -- start start 2023-08-10T11:53:01.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.472+0000 7f369401cb80 1 Processor -- start 2023-08-10T11:53:01.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.473+0000 7f369401cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6997d7800 0x55e6997e64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.473+0000 7f369401cb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997dcf50 0x55e6997e6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.473+0000 7f369401cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e6997dd870 0x55e69983dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.473+0000 7f369401cb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69983e2a0 con 0x55e6997dcf50 2023-08-10T11:53:01.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.473+0000 7f369401cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69983e410 con 0x55e6997d7800 2023-08-10T11:53:01.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.473+0000 7f369401cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69983e5d0 con 0x55e6997dd870 2023-08-10T11:53:01.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.473+0000 7f369401cb80 10 client.0 _ll_register_callbacks cb 0x55e6996c5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:01.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.473+0000 7f368541e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997dcf50 0x55e6997e6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.473+0000 7f368541e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997dcf50 0x55e6997e6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33220/0 (socket says 172.21.15.73:33220) 2023-08-10T11:53:01.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.473+0000 7f368541e700 1 -- 172.21.15.73:0/4188385772 learned_addr learned my addr 172.21.15.73:0/4188385772 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:01.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.473+0000 7f3685c1f700 1 --2- 172.21.15.73:0/4188385772 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6997d7800 0x55e6997e64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.473+0000 7f3686420700 1 --2- 172.21.15.73:0/4188385772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e6997dd870 0x55e69983dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.473+0000 7f368541e700 1 -- 172.21.15.73:0/4188385772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e6997dd870 msgr2=0x55e69983dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.473+0000 7f368541e700 1 --2- 172.21.15.73:0/4188385772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e6997dd870 0x55e69983dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.473+0000 7f368541e700 1 -- 172.21.15.73:0/4188385772 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6997d7800 msgr2=0x55e6997e64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.473+0000 7f368541e700 1 --2- 172.21.15.73:0/4188385772 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6997d7800 0x55e6997e64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.473+0000 7f368541e700 1 -- 172.21.15.73:0/4188385772 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e6995a9630 con 0x55e6997dcf50 2023-08-10T11:53:01.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.473+0000 7f368541e700 1 --2- 172.21.15.73:0/4188385772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997dcf50 0x55e6997e6a20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f367c0963f0 tx=0x7f367c005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268ab5221ec96ca9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:01.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.473+0000 7f36697fa700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:01.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.473+0000 7f36697fa700 1 -- 172.21.15.73:0/4188385772 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c099070 con 0x55e6997dcf50 2023-08-10T11:53:01.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.473+0000 7f36697fa700 1 -- 172.21.15.73:0/4188385772 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f367c0a1940 con 0x55e6997dcf50 2023-08-10T11:53:01.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.473+0000 7f369401cb80 1 -- 172.21.15.73:0/4188385772 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f367001e040 con 0x55e6997dcf50 2023-08-10T11:53:01.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.473+0000 7f36697fa700 1 -- 172.21.15.73:0/4188385772 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f367c0c9ff0 con 0x55e6997dcf50 2023-08-10T11:53:01.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.473+0000 7f369401cb80 10 client.15681 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:01.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.473+0000 7f369401cb80 1 -- 172.21.15.73:0/4188385772 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55e69957c250 con 0x55e6997dcf50 2023-08-10T11:53:01.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.474+0000 7f36697fa700 1 -- 172.21.15.73:0/4188385772 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f367c07c080 con 0x55e6997dcf50 2023-08-10T11:53:01.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.474+0000 7f36697fa700 1 -- 172.21.15.73:0/4188385772 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f367c099be0 con 0x55e6997dcf50 2023-08-10T11:53:01.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.474+0000 7f369401cb80 10 client.15681 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:01.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.474+0000 7f369401cb80 10 client.15681 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-08-10T11:53:01.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.474+0000 7f369401cb80 20 client.15681 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:01.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.474+0000 7f369401cb80 1 --2- 172.21.15.73:0/4188385772 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x55e699845800 0x55e699847bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.474+0000 7f369401cb80 4 client.15681 mds_command: new command op to 24479 tid=0[{"prefix": "damage ls"}] 2023-08-10T11:53:01.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.474+0000 7f369401cb80 1 -- 172.21.15.73:0/4188385772 --> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e699721780 con 0x55e699845800 2023-08-10T11:53:01.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.474+0000 7f3685c1f700 1 --2- 172.21.15.73:0/4188385772 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x55e699845800 0x55e699847bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.474+0000 7f36697fa700 10 client.15681 ms_handle_connect on v2:172.21.15.152:6836/74214089 2023-08-10T11:53:01.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.474+0000 7f3685c1f700 1 --2- 172.21.15.73:0/4188385772 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x55e699845800 0x55e699847bf0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d06a2ecf14a8db1b server_cookie=c474ad8b7e8be6d4 in_seq=0 out_seq=0 2023-08-10T11:53:01.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.474+0000 7f36697fa700 1 -- 172.21.15.73:0/4188385772 <== mds.1 v2:172.21.15.152:6836/74214089 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e699721780 con 0x55e699845800 2023-08-10T11:53:01.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.474+0000 7f36697fa700 10 client.15681 handle_command_reply: tid=0 2023-08-10T11:53:01.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.474+0000 7f369401cb80 1 client.15681 shutdown 2023-08-10T11:53:01.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.475+0000 7f369401cb80 1 -- 172.21.15.73:0/4188385772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997dcf50 msgr2=0x55e6997e6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.475+0000 7f369401cb80 1 --2- 172.21.15.73:0/4188385772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997dcf50 0x55e6997e6a20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f367c0963f0 tx=0x7f367c005870 comp rx=0 tx=0).stop 2023-08-10T11:53:01.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.475+0000 7f369401cb80 1 -- 172.21.15.73:0/4188385772 shutdown_connections 2023-08-10T11:53:01.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.475+0000 7f369401cb80 1 --2- 172.21.15.73:0/4188385772 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x55e699845800 0x55e699847bf0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.475+0000 7f369401cb80 1 --2- 172.21.15.73:0/4188385772 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6997d7800 0x55e6997e64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.475+0000 7f369401cb80 1 --2- 172.21.15.73:0/4188385772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e6997dd870 0x55e69983dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.475+0000 7f36697fa700 0 client.15681 ms_handle_reset on v2:172.21.15.152:6836/74214089 2023-08-10T11:53:01.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.475+0000 7f369401cb80 1 --2- 172.21.15.73:0/4188385772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e6997dcf50 0x55e6997e6a20 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.475+0000 7f369401cb80 1 -- 172.21.15.73:0/4188385772 >> 172.21.15.73:0/4188385772 conn(0x55e699734cd0 msgr2=0x55e6997dc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:01.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.475+0000 7f369401cb80 1 -- 172.21.15.73:0/4188385772 shutdown_connections 2023-08-10T11:53:01.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.475+0000 7f369401cb80 1 -- 172.21.15.73:0/4188385772 wait complete. 2023-08-10T11:53:01.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.475+0000 7f369401cb80 20 client.15681 trim_cache size 0 max 16384 2023-08-10T11:53:01.489 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2023-08-10T11:53:01.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.475+0000 7f3687e83700 1 -- 172.21.15.73:0/2600540486 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f366c0a1350 msgr2=0x7f366c0a3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.475+0000 7f3687e83700 1 --2- 172.21.15.73:0/2600540486 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f366c0a1350 0x7f366c0a3810 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f367000b5c0 tx=0x7f3670005fd0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.475+0000 7f3687e83700 1 -- 172.21.15.73:0/2600540486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36800fffc0 msgr2=0x7f36801017e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.475+0000 7f3687e83700 1 --2- 172.21.15.73:0/2600540486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36800fffc0 0x7f36801017e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f367c00c920 tx=0x7f367c00cc30 comp rx=0 tx=0).stop 2023-08-10T11:53:01.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.475+0000 7f3687e83700 1 -- 172.21.15.73:0/2600540486 shutdown_connections 2023-08-10T11:53:01.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.475+0000 7f3687e83700 1 --2- 172.21.15.73:0/2600540486 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f366c0a1350 0x7f366c0a3810 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.475+0000 7f3687e83700 1 --2- 172.21.15.73:0/2600540486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36801056a0 0x7f36801a4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.475+0000 7f3687e83700 1 --2- 172.21.15.73:0/2600540486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36800ff600 0x7f36801012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.475+0000 7f3687e83700 1 --2- 172.21.15.73:0/2600540486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36800fffc0 0x7f36801017e0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.475+0000 7f3687e83700 1 -- 172.21.15.73:0/2600540486 >> 172.21.15.73:0/2600540486 conn(0x7f36800fb110 msgr2=0x7f3680068bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:01.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.475+0000 7f3687e83700 1 -- 172.21.15.73:0/2600540486 shutdown_connections 2023-08-10T11:53:01.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.476+0000 7f3687e83700 1 -- 172.21.15.73:0/2600540486 wait complete. 2023-08-10T11:53:01.492 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-08-10T11:53:01.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.615+0000 7f0b65770700 1 -- 172.21.15.73:0/1164302021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b600feff0 msgr2=0x7f0b600ff3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.615+0000 7f0b65770700 1 --2- 172.21.15.73:0/1164302021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b600feff0 0x7f0b600ff3d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009990 tx=0x7f0b50009ca0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.615+0000 7f0b65770700 1 -- 172.21.15.73:0/1164302021 shutdown_connections 2023-08-10T11:53:01.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.615+0000 7f0b65770700 1 --2- 172.21.15.73:0/1164302021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b60104110 0x7f0b6010bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.615+0000 7f0b65770700 1 --2- 172.21.15.73:0/1164302021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b600feff0 0x7f0b600ff3d0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.615+0000 7f0b65770700 1 --2- 172.21.15.73:0/1164302021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b600ff9a0 0x7f0b601039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.615+0000 7f0b65770700 1 -- 172.21.15.73:0/1164302021 >> 172.21.15.73:0/1164302021 conn(0x7f0b60076be0 msgr2=0x7f0b600fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:01.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.615+0000 7f0b65770700 1 -- 172.21.15.73:0/1164302021 shutdown_connections 2023-08-10T11:53:01.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.615+0000 7f0b65770700 1 -- 172.21.15.73:0/1164302021 wait complete. 2023-08-10T11:53:01.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.615+0000 7f0b65770700 1 Processor -- start 2023-08-10T11:53:01.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.616+0000 7f0b65770700 1 -- start start 2023-08-10T11:53:01.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.616+0000 7f0b65770700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b600feff0 0x7f0b60197730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.616+0000 7f0b65770700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b60104110 0x7f0b60197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.616+0000 7f0b65770700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b60198250 0x7f0b601a27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.616+0000 7f0b65770700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b601a2f60 con 0x7f0b600feff0 2023-08-10T11:53:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.616+0000 7f0b65770700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b601a30d0 con 0x7f0b60198250 2023-08-10T11:53:01.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.616+0000 7f0b65770700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b601a3290 con 0x7f0b60104110 2023-08-10T11:53:01.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.616+0000 7f0b5effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b600feff0 0x7f0b60197730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.616+0000 7f0b5effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b600feff0 0x7f0b60197730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33232/0 (socket says 172.21.15.73:33232) 2023-08-10T11:53:01.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.616+0000 7f0b5effd700 1 -- 172.21.15.73:0/2525528738 learned_addr learned my addr 172.21.15.73:0/2525528738 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:01.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.616+0000 7f0b5f7fe700 1 --2- 172.21.15.73:0/2525528738 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b60198250 0x7f0b601a27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.616+0000 7f0b5e7fc700 1 --2- 172.21.15.73:0/2525528738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b60104110 0x7f0b60197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.616+0000 7f0b5effd700 1 -- 172.21.15.73:0/2525528738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b60104110 msgr2=0x7f0b60197c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.616+0000 7f0b5effd700 1 --2- 172.21.15.73:0/2525528738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b60104110 0x7f0b60197c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.616+0000 7f0b5effd700 1 -- 172.21.15.73:0/2525528738 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b60198250 msgr2=0x7f0b601a27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.616+0000 7f0b5effd700 1 --2- 172.21.15.73:0/2525528738 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b60198250 0x7f0b601a27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.616+0000 7f0b5effd700 1 -- 172.21.15.73:0/2525528738 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b500095f0 con 0x7f0b600feff0 2023-08-10T11:53:01.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.616+0000 7f0b5e7fc700 1 --2- 172.21.15.73:0/2525528738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b60104110 0x7f0b60197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:01.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.616+0000 7f0b5f7fe700 1 --2- 172.21.15.73:0/2525528738 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b60198250 0x7f0b601a27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:53:01.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.616+0000 7f0b5effd700 1 --2- 172.21.15.73:0/2525528738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b600feff0 0x7f0b60197730 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0b50005910 tx=0x7f0b5000bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:01.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.616+0000 7f0b47fff700 1 -- 172.21.15.73:0/2525528738 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5001d070 con 0x7f0b600feff0 2023-08-10T11:53:01.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.616+0000 7f0b65770700 1 -- 172.21.15.73:0/2525528738 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b601a3510 con 0x7f0b600feff0 2023-08-10T11:53:01.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.616+0000 7f0b47fff700 1 -- 172.21.15.73:0/2525528738 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b50022470 con 0x7f0b600feff0 2023-08-10T11:53:01.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.617+0000 7f0b47fff700 1 -- 172.21.15.73:0/2525528738 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b50017650 con 0x7f0b600feff0 2023-08-10T11:53:01.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.617+0000 7f0b65770700 1 -- 172.21.15.73:0/2525528738 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b601a3990 con 0x7f0b600feff0 2023-08-10T11:53:01.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.618+0000 7f0b47fff700 1 -- 172.21.15.73:0/2525528738 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 23) v1 ==== 135891+0+0 (secure 0 0 0) 0x7f0b500225e0 con 0x7f0b600feff0 2023-08-10T11:53:01.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.619+0000 7f0b47fff700 1 --2- 172.21.15.73:0/2525528738 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0b480a1350 0x7f0b480a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.619+0000 7f0b5e7fc700 1 --2- 172.21.15.73:0/2525528738 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0b480a1350 0x7f0b480a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.619+0000 7f0b47fff700 1 -- 172.21.15.73:0/2525528738 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f0b500ce390 con 0x7f0b600feff0 2023-08-10T11:53:01.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.619+0000 7f0b5e7fc700 1 --2- 172.21.15.73:0/2525528738 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0b480a1350 0x7f0b480a3810 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0b54005fd0 tx=0x7f0b54005f00 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:01.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.620+0000 7f0b71909b80 1 Processor -- start 2023-08-10T11:53:01.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.620+0000 7f0b71909b80 1 -- start start 2023-08-10T11:53:01.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.620+0000 7f0b71909b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5631eb18bf50 0x5631eb18c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.620+0000 7f0b71909b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631eb18c870 0x5631eb1862c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.620+0000 7f0b71909b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb186800 0x5631eb186c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.620+0000 7f0b71909b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631eb101dc0 con 0x5631eb186800 2023-08-10T11:53:01.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.620+0000 7f0b71909b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631eb0de590 con 0x5631eb18bf50 2023-08-10T11:53:01.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.620+0000 7f0b71909b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631eb0dbeb0 con 0x5631eb18c870 2023-08-10T11:53:01.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.620+0000 7f0b5f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb186800 0x5631eb186c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.620+0000 7f0b5f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb186800 0x5631eb186c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33244/0 (socket says 172.21.15.73:33244) 2023-08-10T11:53:01.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.620+0000 7f0b5f7fe700 1 -- 172.21.15.73:0/1774577214 learned_addr learned my addr 172.21.15.73:0/1774577214 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:01.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.620+0000 7f0b5effd700 1 --2- 172.21.15.73:0/1774577214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5631eb18bf50 0x5631eb18c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.620+0000 7f0b5e7fc700 1 --2- 172.21.15.73:0/1774577214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631eb18c870 0x5631eb1862c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.620+0000 7f0b5f7fe700 1 -- 172.21.15.73:0/1774577214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631eb18c870 msgr2=0x5631eb1862c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.620+0000 7f0b5f7fe700 1 --2- 172.21.15.73:0/1774577214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631eb18c870 0x5631eb1862c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.620+0000 7f0b5f7fe700 1 -- 172.21.15.73:0/1774577214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5631eb18bf50 msgr2=0x5631eb18c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.620+0000 7f0b5f7fe700 1 --2- 172.21.15.73:0/1774577214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5631eb18bf50 0x5631eb18c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.620+0000 7f0b5f7fe700 1 -- 172.21.15.73:0/1774577214 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5631eaf58630 con 0x5631eb186800 2023-08-10T11:53:01.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.620+0000 7f0b5e7fc700 1 --2- 172.21.15.73:0/1774577214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631eb18c870 0x5631eb1862c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:01.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.620+0000 7f0b5effd700 1 --2- 172.21.15.73:0/1774577214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5631eb18bf50 0x5631eb18c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:53:01.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.621+0000 7f0b5f7fe700 1 --2- 172.21.15.73:0/1774577214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb186800 0x5631eb186c80 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009440 tx=0x7f0b58009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ccb90703dc213ae server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:01.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.621+0000 7f0b457fa700 1 -- 172.21.15.73:0/1774577214 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5800e070 con 0x5631eb186800 2023-08-10T11:53:01.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.621+0000 7f0b457fa700 1 -- 172.21.15.73:0/1774577214 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b5800f040 con 0x5631eb186800 2023-08-10T11:53:01.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.621+0000 7f0b457fa700 1 -- 172.21.15.73:0/1774577214 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b58014b20 con 0x5631eb186800 2023-08-10T11:53:01.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.621+0000 7f0b71909b80 1 -- 172.21.15.73:0/1774577214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb186800 msgr2=0x5631eb186c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.621+0000 7f0b71909b80 1 --2- 172.21.15.73:0/1774577214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb186800 0x5631eb186c80 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009440 tx=0x7f0b58009920 comp rx=0 tx=0).stop 2023-08-10T11:53:01.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.621+0000 7f0b71909b80 1 -- 172.21.15.73:0/1774577214 shutdown_connections 2023-08-10T11:53:01.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.621+0000 7f0b71909b80 1 --2- 172.21.15.73:0/1774577214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5631eb18bf50 0x5631eb18c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.621+0000 7f0b71909b80 1 --2- 172.21.15.73:0/1774577214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb186800 0x5631eb186c80 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.621+0000 7f0b71909b80 1 --2- 172.21.15.73:0/1774577214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631eb18c870 0x5631eb1862c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.621+0000 7f0b71909b80 1 -- 172.21.15.73:0/1774577214 >> 172.21.15.73:0/1774577214 conn(0x5631eb0e3cd0 msgr2=0x5631eb1814d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:01.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.622+0000 7f0b71909b80 1 -- 172.21.15.73:0/1774577214 shutdown_connections 2023-08-10T11:53:01.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.622+0000 7f0b71909b80 1 -- 172.21.15.73:0/1774577214 wait complete. 2023-08-10T11:53:01.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.622+0000 7f0b71909b80 1 -- start start 2023-08-10T11:53:01.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.622+0000 7f0b71909b80 1 Processor -- start 2023-08-10T11:53:01.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.622+0000 7f0b71909b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631eb186800 0x5631eb1928b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.622+0000 7f0b71909b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb18bf50 0x5631eb18fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.622+0000 7f0b71909b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5631eb18c870 0x5631eb190140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.622+0000 7f0b71909b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631eb0d77a0 con 0x5631eb18bf50 2023-08-10T11:53:01.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.622+0000 7f0b71909b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631eb076ac0 con 0x5631eb18c870 2023-08-10T11:53:01.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.622+0000 7f0b71909b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631eb0767c0 con 0x5631eb186800 2023-08-10T11:53:01.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.622+0000 7f0b71909b80 10 client.0 _ll_register_callbacks cb 0x5631eb074680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:01.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.622+0000 7f0b5e7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb18bf50 0x5631eb18fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.622+0000 7f0b5e7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb18bf50 0x5631eb18fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33248/0 (socket says 172.21.15.73:33248) 2023-08-10T11:53:01.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.622+0000 7f0b5e7fc700 1 -- 172.21.15.73:0/2647366056 learned_addr learned my addr 172.21.15.73:0/2647366056 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:01.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.622+0000 7f0b5f7fe700 1 --2- 172.21.15.73:0/2647366056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5631eb18c870 0x5631eb190140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.622+0000 7f0b5effd700 1 --2- 172.21.15.73:0/2647366056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631eb186800 0x5631eb1928b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.623+0000 7f0b5e7fc700 1 -- 172.21.15.73:0/2647366056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631eb186800 msgr2=0x5631eb1928b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.623+0000 7f0b5e7fc700 1 --2- 172.21.15.73:0/2647366056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631eb186800 0x5631eb1928b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.623+0000 7f0b5e7fc700 1 -- 172.21.15.73:0/2647366056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5631eb18c870 msgr2=0x5631eb190140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.623+0000 7f0b5e7fc700 1 --2- 172.21.15.73:0/2647366056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5631eb18c870 0x5631eb190140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.623+0000 7f0b5e7fc700 1 -- 172.21.15.73:0/2647366056 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b580090f0 con 0x5631eb18bf50 2023-08-10T11:53:01.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.623+0000 7f0b5e7fc700 1 --2- 172.21.15.73:0/2647366056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb18bf50 0x5631eb18fb30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0b540116f0 tx=0x7f0b54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d97bab83269c96f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:01.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.623+0000 7f0b42ff5700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:01.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.623+0000 7f0b42ff5700 1 -- 172.21.15.73:0/2647366056 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b54004220 con 0x5631eb18bf50 2023-08-10T11:53:01.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.623+0000 7f0b42ff5700 1 -- 172.21.15.73:0/2647366056 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f0b54004380 con 0x5631eb18bf50 2023-08-10T11:53:01.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.623+0000 7f0b71909b80 1 -- 172.21.15.73:0/2647366056 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5631eb179470 con 0x5631eb18bf50 2023-08-10T11:53:01.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.623+0000 7f0b42ff5700 1 -- 172.21.15.73:0/2647366056 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b54011e90 con 0x5631eb18bf50 2023-08-10T11:53:01.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.623+0000 7f0b71909b80 10 client.15693 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:01.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.623+0000 7f0b71909b80 1 -- 172.21.15.73:0/2647366056 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5631eaf04de0 con 0x5631eb18bf50 2023-08-10T11:53:01.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.623+0000 7f0b42ff5700 1 -- 172.21.15.73:0/2647366056 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5631eb179470 con 0x5631eb18bf50 2023-08-10T11:53:01.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.623+0000 7f0b42ff5700 1 -- 172.21.15.73:0/2647366056 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0b5401e900 con 0x5631eb18bf50 2023-08-10T11:53:01.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.623+0000 7f0b71909b80 10 client.15693 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:01.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.623+0000 7f0b71909b80 10 client.15693 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:53:01.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.623+0000 7f0b71909b80 20 client.15693 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:01.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.623+0000 7f0b71909b80 1 --2- 172.21.15.73:0/2647366056 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5631eb1a01b0 0x5631eb1a25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.623+0000 7f0b71909b80 4 client.15693 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:53:01.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.623+0000 7f0b71909b80 1 -- 172.21.15.73:0/2647366056 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5631eb1559d0 con 0x5631eb1a01b0 2023-08-10T11:53:01.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.624+0000 7f0b5effd700 1 --2- 172.21.15.73:0/2647366056 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5631eb1a01b0 0x5631eb1a25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.624+0000 7f0b5effd700 1 --2- 172.21.15.73:0/2647366056 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5631eb1a01b0 0x5631eb1a25d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fff0788c097009 server_cookie=c5bce99cd429f80e in_seq=0 out_seq=0 2023-08-10T11:53:01.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.624+0000 7f0b42ff5700 10 client.15693 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:01.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.625+0000 7f0b42ff5700 1 -- 172.21.15.73:0/2647366056 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5631eb1559d0 con 0x5631eb1a01b0 2023-08-10T11:53:01.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.625+0000 7f0b42ff5700 10 client.15693 handle_command_reply: tid=0 2023-08-10T11:53:01.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.625+0000 7f0b71909b80 1 client.15693 shutdown 2023-08-10T11:53:01.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.625+0000 7f0b71909b80 1 -- 172.21.15.73:0/2647366056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb18bf50 msgr2=0x5631eb18fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.625+0000 7f0b71909b80 1 --2- 172.21.15.73:0/2647366056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb18bf50 0x5631eb18fb30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0b540116f0 tx=0x7f0b54004750 comp rx=0 tx=0).stop 2023-08-10T11:53:01.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.625+0000 7f0b71909b80 1 -- 172.21.15.73:0/2647366056 shutdown_connections 2023-08-10T11:53:01.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.625+0000 7f0b71909b80 1 --2- 172.21.15.73:0/2647366056 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5631eb1a01b0 0x5631eb1a25d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.625+0000 7f0b71909b80 1 --2- 172.21.15.73:0/2647366056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5631eb18c870 0x5631eb190140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.625+0000 7f0b42ff5700 0 client.15693 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:01.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.625+0000 7f0b71909b80 1 --2- 172.21.15.73:0/2647366056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631eb186800 0x5631eb1928b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.625+0000 7f0b71909b80 1 --2- 172.21.15.73:0/2647366056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb18bf50 0x5631eb18fb30 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.625+0000 7f0b71909b80 1 -- 172.21.15.73:0/2647366056 >> 172.21.15.73:0/2647366056 conn(0x5631eb0e3cd0 msgr2=0x5631eb1809b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:01.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.625+0000 7f0b71909b80 1 -- 172.21.15.73:0/2647366056 shutdown_connections 2023-08-10T11:53:01.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.625+0000 7f0b71909b80 1 -- 172.21.15.73:0/2647366056 wait complete. 2023-08-10T11:53:01.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.625+0000 7f0b71909b80 20 client.15693 trim_cache size 0 max 16384 2023-08-10T11:53:01.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.638+0000 7f0b71909b80 1 Processor -- start 2023-08-10T11:53:01.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.638+0000 7f0b71909b80 1 -- start start 2023-08-10T11:53:01.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.638+0000 7f0b71909b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631eb186800 0x5631eb1862c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.638+0000 7f0b71909b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb18bf50 0x5631eb1a6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.638+0000 7f0b71909b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5631eb18c870 0x5631eb197360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.638+0000 7f0b71909b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631eaf5a920 con 0x5631eb18bf50 2023-08-10T11:53:01.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.638+0000 7f0b71909b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631eb1978a0 con 0x5631eb18c870 2023-08-10T11:53:01.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.638+0000 7f0b71909b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631eb18a730 con 0x5631eb186800 2023-08-10T11:53:01.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.638+0000 7f0b5e7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb18bf50 0x5631eb1a6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.638+0000 7f0b5e7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb18bf50 0x5631eb1a6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33256/0 (socket says 172.21.15.73:33256) 2023-08-10T11:53:01.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.638+0000 7f0b5e7fc700 1 -- 172.21.15.73:0/956185162 learned_addr learned my addr 172.21.15.73:0/956185162 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:01.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.639+0000 7f0b5effd700 1 --2- 172.21.15.73:0/956185162 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631eb186800 0x5631eb1862c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.639+0000 7f0b5e7fc700 1 -- 172.21.15.73:0/956185162 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631eb186800 msgr2=0x5631eb1862c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.639+0000 7f0b5e7fc700 1 --2- 172.21.15.73:0/956185162 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631eb186800 0x5631eb1862c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.639+0000 7f0b5e7fc700 1 -- 172.21.15.73:0/956185162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5631eb18c870 msgr2=0x5631eb197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.639+0000 7f0b5f7fe700 1 --2- 172.21.15.73:0/956185162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5631eb18c870 0x5631eb197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.639+0000 7f0b5e7fc700 1 --2- 172.21.15.73:0/956185162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5631eb18c870 0x5631eb197360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.639+0000 7f0b5e7fc700 1 -- 172.21.15.73:0/956185162 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5631eaeedc60 con 0x5631eb18bf50 2023-08-10T11:53:01.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.639+0000 7f0b5effd700 1 --2- 172.21.15.73:0/956185162 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631eb186800 0x5631eb1862c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:53:01.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.639+0000 7f0b5e7fc700 1 --2- 172.21.15.73:0/956185162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb18bf50 0x5631eb1a6f30 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0b5401ed10 tx=0x7f0b5400e700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e179bdbc794bc5c2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:01.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.639+0000 7f0b45ffb700 1 -- 172.21.15.73:0/956185162 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5401e620 con 0x5631eb18bf50 2023-08-10T11:53:01.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.639+0000 7f0b45ffb700 1 -- 172.21.15.73:0/956185162 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b54004830 con 0x5631eb18bf50 2023-08-10T11:53:01.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.639+0000 7f0b45ffb700 1 -- 172.21.15.73:0/956185162 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b54005390 con 0x5631eb18bf50 2023-08-10T11:53:01.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.640+0000 7f0b71909b80 1 -- 172.21.15.73:0/956185162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb18bf50 msgr2=0x5631eb1a6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.640+0000 7f0b71909b80 1 --2- 172.21.15.73:0/956185162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb18bf50 0x5631eb1a6f30 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0b5401ed10 tx=0x7f0b5400e700 comp rx=0 tx=0).stop 2023-08-10T11:53:01.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.640+0000 7f0b71909b80 1 -- 172.21.15.73:0/956185162 shutdown_connections 2023-08-10T11:53:01.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.640+0000 7f0b71909b80 1 --2- 172.21.15.73:0/956185162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5631eb18c870 0x5631eb197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.640+0000 7f0b71909b80 1 --2- 172.21.15.73:0/956185162 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631eb186800 0x5631eb1862c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.640+0000 7f0b71909b80 1 --2- 172.21.15.73:0/956185162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb18bf50 0x5631eb1a6f30 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.640+0000 7f0b71909b80 1 -- 172.21.15.73:0/956185162 >> 172.21.15.73:0/956185162 conn(0x5631eb0e3cd0 msgr2=0x5631eb189bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:01.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.640+0000 7f0b71909b80 1 -- 172.21.15.73:0/956185162 shutdown_connections 2023-08-10T11:53:01.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.640+0000 7f0b71909b80 1 -- 172.21.15.73:0/956185162 wait complete. 2023-08-10T11:53:01.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.640+0000 7f0b71909b80 1 -- start start 2023-08-10T11:53:01.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.640+0000 7f0b71909b80 1 Processor -- start 2023-08-10T11:53:01.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.641+0000 7f0b71909b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb186800 0x5631eb188cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.641+0000 7f0b71909b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631eb18bf50 0x5631eb189200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.641+0000 7f0b71909b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5631eb18c870 0x5631eb187970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.641+0000 7f0b71909b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631eb188030 con 0x5631eb186800 2023-08-10T11:53:01.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.641+0000 7f0b71909b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631eb1881a0 con 0x5631eb18c870 2023-08-10T11:53:01.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.641+0000 7f0b71909b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631eb188360 con 0x5631eb18bf50 2023-08-10T11:53:01.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.641+0000 7f0b71909b80 10 client.0 _ll_register_callbacks cb 0x5631eb074680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:01.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.641+0000 7f0b5effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb186800 0x5631eb188cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.641+0000 7f0b5effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb186800 0x5631eb188cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33260/0 (socket says 172.21.15.73:33260) 2023-08-10T11:53:01.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.641+0000 7f0b5effd700 1 -- 172.21.15.73:0/4031875015 learned_addr learned my addr 172.21.15.73:0/4031875015 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:01.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.641+0000 7f0b5f7fe700 1 --2- 172.21.15.73:0/4031875015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5631eb18c870 0x5631eb187970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.641+0000 7f0b5e7fc700 1 --2- 172.21.15.73:0/4031875015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631eb18bf50 0x5631eb189200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.641+0000 7f0b5effd700 1 -- 172.21.15.73:0/4031875015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631eb18bf50 msgr2=0x5631eb189200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.641+0000 7f0b5effd700 1 --2- 172.21.15.73:0/4031875015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631eb18bf50 0x5631eb189200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.641+0000 7f0b5effd700 1 -- 172.21.15.73:0/4031875015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5631eb18c870 msgr2=0x5631eb187970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:01.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.641+0000 7f0b5effd700 1 --2- 172.21.15.73:0/4031875015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5631eb18c870 0x5631eb187970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.641+0000 7f0b5effd700 1 -- 172.21.15.73:0/4031875015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5631eaf04de0 con 0x5631eb186800 2023-08-10T11:53:01.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.641+0000 7f0b5effd700 1 --2- 172.21.15.73:0/4031875015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb186800 0x5631eb188cc0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0b500cbbc0 tx=0x7f0b50022ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fefd62a3debc4719 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:01.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.641+0000 7f0b42ff5700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:01.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.641+0000 7f0b42ff5700 1 -- 172.21.15.73:0/4031875015 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5009f2b0 con 0x5631eb186800 2023-08-10T11:53:01.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.641+0000 7f0b42ff5700 1 -- 172.21.15.73:0/4031875015 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f0b500860b0 con 0x5631eb186800 2023-08-10T11:53:01.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.641+0000 7f0b71909b80 1 -- 172.21.15.73:0/4031875015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0b5800f040 con 0x5631eb186800 2023-08-10T11:53:01.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.641+0000 7f0b42ff5700 1 -- 172.21.15.73:0/4031875015 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b500cbd00 con 0x5631eb186800 2023-08-10T11:53:01.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.641+0000 7f0b71909b80 10 client.15699 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:01.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.641+0000 7f0b71909b80 1 -- 172.21.15.73:0/4031875015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5631eaf2b250 con 0x5631eb186800 2023-08-10T11:53:01.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.642+0000 7f0b42ff5700 1 -- 172.21.15.73:0/4031875015 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b5800f040 con 0x5631eb186800 2023-08-10T11:53:01.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.642+0000 7f0b42ff5700 1 -- 172.21.15.73:0/4031875015 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0b50062020 con 0x5631eb186800 2023-08-10T11:53:01.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.642+0000 7f0b71909b80 10 client.15699 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:01.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.642+0000 7f0b71909b80 10 client.15699 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:53:01.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.642+0000 7f0b71909b80 20 client.15699 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:01.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.642+0000 7f0b71909b80 1 --2- 172.21.15.73:0/4031875015 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5631eb1a01b0 0x5631eb1f6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:01.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.642+0000 7f0b71909b80 4 client.15699 mds_command: new command op to 24503 tid=0[{"prefix": "damage ls"}] 2023-08-10T11:53:01.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.642+0000 7f0b71909b80 1 -- 172.21.15.73:0/4031875015 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5631eb0d0780 con 0x5631eb1a01b0 2023-08-10T11:53:01.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.642+0000 7f0b5e7fc700 1 --2- 172.21.15.73:0/4031875015 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5631eb1a01b0 0x5631eb1f6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:01.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.642+0000 7f0b42ff5700 10 client.15699 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:01.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.642+0000 7f0b5e7fc700 1 --2- 172.21.15.73:0/4031875015 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5631eb1a01b0 0x5631eb1f6c30 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb6135d888aabb30 server_cookie=f1f67a3391cb77b7 in_seq=0 out_seq=0 2023-08-10T11:53:01.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.643+0000 7f0b42ff5700 1 -- 172.21.15.73:0/4031875015 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5631eb0d0780 con 0x5631eb1a01b0 2023-08-10T11:53:01.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.643+0000 7f0b42ff5700 10 client.15699 handle_command_reply: tid=0 2023-08-10T11:53:01.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.643+0000 7f0b71909b80 1 client.15699 shutdown 2023-08-10T11:53:01.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.643+0000 7f0b71909b80 1 -- 172.21.15.73:0/4031875015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb186800 msgr2=0x5631eb188cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.643+0000 7f0b71909b80 1 --2- 172.21.15.73:0/4031875015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb186800 0x5631eb188cc0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0b500cbbc0 tx=0x7f0b50022ca0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.643+0000 7f0b71909b80 1 -- 172.21.15.73:0/4031875015 shutdown_connections 2023-08-10T11:53:01.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.643+0000 7f0b71909b80 1 --2- 172.21.15.73:0/4031875015 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5631eb1a01b0 0x5631eb1f6c30 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.643+0000 7f0b71909b80 1 --2- 172.21.15.73:0/4031875015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5631eb18c870 0x5631eb187970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.643+0000 7f0b71909b80 1 --2- 172.21.15.73:0/4031875015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5631eb186800 0x5631eb188cc0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.643+0000 7f0b42ff5700 0 client.15699 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:01.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.643+0000 7f0b71909b80 1 --2- 172.21.15.73:0/4031875015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631eb18bf50 0x5631eb189200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.643+0000 7f0b71909b80 1 -- 172.21.15.73:0/4031875015 >> 172.21.15.73:0/4031875015 conn(0x5631eb0e3cd0 msgr2=0x5631eb18ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:01.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.643+0000 7f0b71909b80 1 -- 172.21.15.73:0/4031875015 shutdown_connections 2023-08-10T11:53:01.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.643+0000 7f0b71909b80 1 -- 172.21.15.73:0/4031875015 wait complete. 2023-08-10T11:53:01.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.643+0000 7f0b71909b80 20 client.15699 trim_cache size 0 max 16384 2023-08-10T11:53:01.671 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2023-08-10T11:53:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.643+0000 7f0b65770700 1 -- 172.21.15.73:0/2525528738 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0b480a1350 msgr2=0x7f0b480a3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.643+0000 7f0b65770700 1 --2- 172.21.15.73:0/2525528738 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0b480a1350 0x7f0b480a3810 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0b54005fd0 tx=0x7f0b54005f00 comp rx=0 tx=0).stop 2023-08-10T11:53:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.643+0000 7f0b65770700 1 -- 172.21.15.73:0/2525528738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b600feff0 msgr2=0x7f0b60197730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.643+0000 7f0b65770700 1 --2- 172.21.15.73:0/2525528738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b600feff0 0x7f0b60197730 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0b50005910 tx=0x7f0b5000bfa0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.643+0000 7f0b65770700 1 -- 172.21.15.73:0/2525528738 shutdown_connections 2023-08-10T11:53:01.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.643+0000 7f0b65770700 1 --2- 172.21.15.73:0/2525528738 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0b480a1350 0x7f0b480a3810 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.643+0000 7f0b65770700 1 --2- 172.21.15.73:0/2525528738 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b60198250 0x7f0b601a27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.643+0000 7f0b65770700 1 --2- 172.21.15.73:0/2525528738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b600feff0 0x7f0b60197730 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.643+0000 7f0b65770700 1 --2- 172.21.15.73:0/2525528738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b60104110 0x7f0b60197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:01.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.643+0000 7f0b65770700 1 -- 172.21.15.73:0/2525528738 >> 172.21.15.73:0/2525528738 conn(0x7f0b60076be0 msgr2=0x7f0b600fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:01.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.643+0000 7f0b65770700 1 -- 172.21.15.73:0/2525528738 shutdown_connections 2023-08-10T11:53:01.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:01.644+0000 7f0b65770700 1 -- 172.21.15.73:0/2525528738 wait complete. 2023-08-10T11:53:01.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:01 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/10514076' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:53:01.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:01 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/10514076' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:53:02.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:01 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/10514076' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:53:02.678 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-08-10T11:53:02.678 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-08-10T11:53:02.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.811+0000 7f571d634700 1 -- 172.21.15.73:0/3167607586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57180fff90 msgr2=0x7f571810c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:02.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.811+0000 7f571d634700 1 --2- 172.21.15.73:0/3167607586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57180fff90 0x7f571810c450 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f571000b0d0 tx=0x7f571000b3e0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.811+0000 7f571d634700 1 -- 172.21.15.73:0/3167607586 shutdown_connections 2023-08-10T11:53:02.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.811+0000 7f571d634700 1 --2- 172.21.15.73:0/3167607586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5718105690 0x7f5718105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.811+0000 7f571d634700 1 --2- 172.21.15.73:0/3167607586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57180fff90 0x7f571810c450 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.811+0000 7f571d634700 1 --2- 172.21.15.73:0/3167607586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57180ff5d0 0x7f57180ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.811+0000 7f571d634700 1 -- 172.21.15.73:0/3167607586 >> 172.21.15.73:0/3167607586 conn(0x7f57180fb0c0 msgr2=0x7f57180fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:02.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.811+0000 7f571d634700 1 -- 172.21.15.73:0/3167607586 shutdown_connections 2023-08-10T11:53:02.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.811+0000 7f571d634700 1 -- 172.21.15.73:0/3167607586 wait complete. 2023-08-10T11:53:02.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.812+0000 7f571d634700 1 Processor -- start 2023-08-10T11:53:02.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.812+0000 7f571d634700 1 -- start start 2023-08-10T11:53:02.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.812+0000 7f571d634700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57180ff5d0 0x7f57181956b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:02.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.812+0000 7f571d634700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57180fff90 0x7f5718195bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:02.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.812+0000 7f571d634700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5718105690 0x7f5718198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:02.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.812+0000 7f571d634700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57181995a0 con 0x7f57180fff90 2023-08-10T11:53:02.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.812+0000 7f571d634700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5718199710 con 0x7f57180ff5d0 2023-08-10T11:53:02.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.812+0000 7f571d634700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57181998d0 con 0x7f5718105690 2023-08-10T11:53:02.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.812+0000 7f57167fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57180fff90 0x7f5718195bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:02.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.812+0000 7f57167fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57180fff90 0x7f5718195bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33276/0 (socket says 172.21.15.73:33276) 2023-08-10T11:53:02.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.812+0000 7f57167fc700 1 -- 172.21.15.73:0/2878291476 learned_addr learned my addr 172.21.15.73:0/2878291476 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:02.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.812+0000 7f5716ffd700 1 --2- 172.21.15.73:0/2878291476 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57180ff5d0 0x7f57181956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:02.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.813+0000 7f57177fe700 1 --2- 172.21.15.73:0/2878291476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5718105690 0x7f5718198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:02.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.813+0000 7f57167fc700 1 -- 172.21.15.73:0/2878291476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5718105690 msgr2=0x7f5718198fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:02.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.813+0000 7f57167fc700 1 --2- 172.21.15.73:0/2878291476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5718105690 0x7f5718198fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.813+0000 7f57167fc700 1 -- 172.21.15.73:0/2878291476 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57180ff5d0 msgr2=0x7f57181956b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:02.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.813+0000 7f57167fc700 1 --2- 172.21.15.73:0/2878291476 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57180ff5d0 0x7f57181956b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.813+0000 7f57167fc700 1 -- 172.21.15.73:0/2878291476 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5710009d00 con 0x7f57180fff90 2023-08-10T11:53:02.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.813+0000 7f57177fe700 1 --2- 172.21.15.73:0/2878291476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5718105690 0x7f5718198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:02.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.813+0000 7f57167fc700 1 --2- 172.21.15.73:0/2878291476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57180fff90 0x7f5718195bf0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f570c00c9b0 tx=0x7f570c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:02.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.813+0000 7f56fffff700 1 -- 172.21.15.73:0/2878291476 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c007b00 con 0x7f57180fff90 2023-08-10T11:53:02.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.813+0000 7f571d634700 1 -- 172.21.15.73:0/2878291476 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5718199bb0 con 0x7f57180fff90 2023-08-10T11:53:02.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.813+0000 7f56fffff700 1 -- 172.21.15.73:0/2878291476 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f570c007c60 con 0x7f57180fff90 2023-08-10T11:53:02.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.813+0000 7f56fffff700 1 -- 172.21.15.73:0/2878291476 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c018660 con 0x7f57180fff90 2023-08-10T11:53:02.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.813+0000 7f571d634700 1 -- 172.21.15.73:0/2878291476 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57181a2510 con 0x7f57180fff90 2023-08-10T11:53:02.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.815+0000 7f56fffff700 1 -- 172.21.15.73:0/2878291476 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f570c00f450 con 0x7f57180fff90 2023-08-10T11:53:02.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.816+0000 7f56fffff700 1 --2- 172.21.15.73:0/2878291476 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f57000a13e0 0x7f57000a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:02.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.816+0000 7f5716ffd700 1 --2- 172.21.15.73:0/2878291476 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f57000a13e0 0x7f57000a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:02.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.816+0000 7f56fffff700 1 -- 172.21.15.73:0/2878291476 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f570c0ccf90 con 0x7f57180fff90 2023-08-10T11:53:02.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.816+0000 7f5716ffd700 1 --2- 172.21.15.73:0/2878291476 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f57000a13e0 0x7f57000a38a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5708005950 tx=0x7f570800a300 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:02.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.816+0000 7f57297cdb80 1 Processor -- start 2023-08-10T11:53:02.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.817+0000 7f57297cdb80 1 -- start start 2023-08-10T11:53:02.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.817+0000 7f57297cdb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ced3d9fd0 0x557ced3da3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:02.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.817+0000 7f57297cdb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3da8f0 0x557ced3d4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:02.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.817+0000 7f57297cdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ced3d4880 0x557ced3d4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:02.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.817+0000 7f57297cdb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ced34fe40 con 0x557ced3da8f0 2023-08-10T11:53:02.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.817+0000 7f57297cdb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ced32c610 con 0x557ced3d9fd0 2023-08-10T11:53:02.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.817+0000 7f57297cdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ced329f30 con 0x557ced3d4880 2023-08-10T11:53:02.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.817+0000 7f57167fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3da8f0 0x557ced3d4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:02.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.817+0000 7f57167fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3da8f0 0x557ced3d4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33284/0 (socket says 172.21.15.73:33284) 2023-08-10T11:53:02.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.817+0000 7f57167fc700 1 -- 172.21.15.73:0/98284764 learned_addr learned my addr 172.21.15.73:0/98284764 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:02.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.817+0000 7f5716ffd700 1 --2- 172.21.15.73:0/98284764 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ced3d9fd0 0x557ced3da3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:02.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.817+0000 7f57177fe700 1 --2- 172.21.15.73:0/98284764 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ced3d4880 0x557ced3d4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:02.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.817+0000 7f57167fc700 1 -- 172.21.15.73:0/98284764 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ced3d4880 msgr2=0x557ced3d4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:02.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.817+0000 7f57167fc700 1 --2- 172.21.15.73:0/98284764 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ced3d4880 0x557ced3d4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.817+0000 7f57167fc700 1 -- 172.21.15.73:0/98284764 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ced3d9fd0 msgr2=0x557ced3da3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:02.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.817+0000 7f57167fc700 1 --2- 172.21.15.73:0/98284764 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ced3d9fd0 0x557ced3da3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.817+0000 7f57167fc700 1 -- 172.21.15.73:0/98284764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ced1a66b0 con 0x557ced3da8f0 2023-08-10T11:53:02.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.817+0000 7f5716ffd700 1 --2- 172.21.15.73:0/98284764 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ced3d9fd0 0x557ced3da3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:53:02.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.817+0000 7f57177fe700 1 --2- 172.21.15.73:0/98284764 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ced3d4880 0x557ced3d4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:02.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.817+0000 7f57167fc700 1 --2- 172.21.15.73:0/98284764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3da8f0 0x557ced3d4340 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f570c096340 tx=0x7f570c0997a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd29ee85a364e5f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:02.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.818+0000 7f56fd7fa700 1 -- 172.21.15.73:0/98284764 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c099e40 con 0x557ced3da8f0 2023-08-10T11:53:02.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.818+0000 7f56fd7fa700 1 -- 172.21.15.73:0/98284764 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f570c09de70 con 0x557ced3da8f0 2023-08-10T11:53:02.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.818+0000 7f56fd7fa700 1 -- 172.21.15.73:0/98284764 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c09a300 con 0x557ced3da8f0 2023-08-10T11:53:02.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.818+0000 7f57297cdb80 1 -- 172.21.15.73:0/98284764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3da8f0 msgr2=0x557ced3d4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:02.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.818+0000 7f57297cdb80 1 --2- 172.21.15.73:0/98284764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3da8f0 0x557ced3d4340 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f570c096340 tx=0x7f570c0997a0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.818+0000 7f57297cdb80 1 -- 172.21.15.73:0/98284764 shutdown_connections 2023-08-10T11:53:02.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.818+0000 7f57297cdb80 1 --2- 172.21.15.73:0/98284764 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ced3d9fd0 0x557ced3da3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.818+0000 7f57297cdb80 1 --2- 172.21.15.73:0/98284764 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ced3d4880 0x557ced3d4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.818+0000 7f57297cdb80 1 --2- 172.21.15.73:0/98284764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3da8f0 0x557ced3d4340 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.818+0000 7f57297cdb80 1 -- 172.21.15.73:0/98284764 >> 172.21.15.73:0/98284764 conn(0x557ced331d50 msgr2=0x557ced3cf550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:02.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.818+0000 7f57297cdb80 1 -- 172.21.15.73:0/98284764 shutdown_connections 2023-08-10T11:53:02.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.818+0000 7f57297cdb80 1 -- 172.21.15.73:0/98284764 wait complete. 2023-08-10T11:53:02.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.819+0000 7f57297cdb80 1 -- start start 2023-08-10T11:53:02.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.819+0000 7f57297cdb80 1 Processor -- start 2023-08-10T11:53:02.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.819+0000 7f57297cdb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ced3d4880 0x557ced3e60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:02.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.819+0000 7f57297cdb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3d9fd0 0x557ced3e6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:02.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.819+0000 7f57297cdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ced3da8f0 0x557ced3dfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:02.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.819+0000 7f57297cdb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ced325820 con 0x557ced3d9fd0 2023-08-10T11:53:02.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.819+0000 7f57297cdb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ced2c4b40 con 0x557ced3d4880 2023-08-10T11:53:02.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.819+0000 7f57297cdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ced2c4840 con 0x557ced3da8f0 2023-08-10T11:53:02.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.819+0000 7f57297cdb80 10 client.0 _ll_register_callbacks cb 0x557ced2c2700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:02.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.819+0000 7f57167fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3d9fd0 0x557ced3e6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:02.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.819+0000 7f57167fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3d9fd0 0x557ced3e6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33290/0 (socket says 172.21.15.73:33290) 2023-08-10T11:53:02.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.819+0000 7f57167fc700 1 -- 172.21.15.73:0/4275760616 learned_addr learned my addr 172.21.15.73:0/4275760616 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:02.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.819+0000 7f5716ffd700 1 --2- 172.21.15.73:0/4275760616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ced3d4880 0x557ced3e60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:02.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.819+0000 7f57177fe700 1 --2- 172.21.15.73:0/4275760616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ced3da8f0 0x557ced3dfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:02.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.819+0000 7f57167fc700 1 -- 172.21.15.73:0/4275760616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ced3da8f0 msgr2=0x557ced3dfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:02.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.819+0000 7f57167fc700 1 --2- 172.21.15.73:0/4275760616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ced3da8f0 0x557ced3dfdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.819+0000 7f57167fc700 1 -- 172.21.15.73:0/4275760616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ced3d4880 msgr2=0x557ced3e60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:02.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.819+0000 7f57167fc700 1 --2- 172.21.15.73:0/4275760616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ced3d4880 0x557ced3e60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.819+0000 7f57167fc700 1 -- 172.21.15.73:0/4275760616 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57181a2510 con 0x557ced3d9fd0 2023-08-10T11:53:02.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.819+0000 7f5716ffd700 1 --2- 172.21.15.73:0/4275760616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ced3d4880 0x557ced3e60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:53:02.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.819+0000 7f57177fe700 1 --2- 172.21.15.73:0/4275760616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ced3da8f0 0x557ced3dfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:02.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.820+0000 7f57167fc700 1 --2- 172.21.15.73:0/4275760616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3d9fd0 0x557ced3e6610 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f570c099dd0 tx=0x7f570c00fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f49c6662be0461 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:02.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.820+0000 7f56faff5700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:02.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.820+0000 7f56faff5700 1 -- 172.21.15.73:0/4275760616 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c099e40 con 0x557ced3d9fd0 2023-08-10T11:53:02.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.820+0000 7f56faff5700 1 -- 172.21.15.73:0/4275760616 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f570c0981e0 con 0x557ced3d9fd0 2023-08-10T11:53:02.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.820+0000 7f57297cdb80 1 -- 172.21.15.73:0/4275760616 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557ced3c74f0 con 0x557ced3d9fd0 2023-08-10T11:53:02.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.820+0000 7f56faff5700 1 -- 172.21.15.73:0/4275760616 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f570c0b81f0 con 0x557ced3d9fd0 2023-08-10T11:53:02.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.820+0000 7f57297cdb80 10 client.15711 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:02.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.820+0000 7f57297cdb80 1 -- 172.21.15.73:0/4275760616 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557ced152e60 con 0x557ced3d9fd0 2023-08-10T11:53:02.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.820+0000 7f56faff5700 1 -- 172.21.15.73:0/4275760616 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f570c07c080 con 0x557ced3d9fd0 2023-08-10T11:53:02.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.820+0000 7f56faff5700 1 -- 172.21.15.73:0/4275760616 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f570c0ca870 con 0x557ced3d9fd0 2023-08-10T11:53:02.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.820+0000 7f57297cdb80 10 client.15711 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:02.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.820+0000 7f57297cdb80 10 client.15711 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:53:02.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.820+0000 7f57297cdb80 20 client.15711 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:02.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.820+0000 7f57297cdb80 1 --2- 172.21.15.73:0/4275760616 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x557ced3effc0 0x557ced3f23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:02.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.820+0000 7f57297cdb80 4 client.15711 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:53:02.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.820+0000 7f57297cdb80 1 -- 172.21.15.73:0/4275760616 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557ced3a3a50 con 0x557ced3effc0 2023-08-10T11:53:02.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.821+0000 7f5716ffd700 1 --2- 172.21.15.73:0/4275760616 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x557ced3effc0 0x557ced3f23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:02.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.821+0000 7f56faff5700 10 client.15711 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:02.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.821+0000 7f5716ffd700 1 --2- 172.21.15.73:0/4275760616 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x557ced3effc0 0x557ced3f23b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88617adb4e0debbd server_cookie=1a5abc1f8c7edc4a in_seq=0 out_seq=0 2023-08-10T11:53:02.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.822+0000 7f56faff5700 1 -- 172.21.15.73:0/4275760616 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x557ced3a3a50 con 0x557ced3effc0 2023-08-10T11:53:02.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.822+0000 7f56faff5700 10 client.15711 handle_command_reply: tid=0 2023-08-10T11:53:02.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.822+0000 7f57297cdb80 1 client.15711 shutdown 2023-08-10T11:53:02.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.822+0000 7f57297cdb80 1 -- 172.21.15.73:0/4275760616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3d9fd0 msgr2=0x557ced3e6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:02.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.822+0000 7f57297cdb80 1 --2- 172.21.15.73:0/4275760616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3d9fd0 0x557ced3e6610 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f570c099dd0 tx=0x7f570c00fc30 comp rx=0 tx=0).stop 2023-08-10T11:53:02.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.822+0000 7f57297cdb80 1 -- 172.21.15.73:0/4275760616 shutdown_connections 2023-08-10T11:53:02.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.822+0000 7f57297cdb80 1 --2- 172.21.15.73:0/4275760616 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x557ced3effc0 0x557ced3f23b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.822+0000 7f57297cdb80 1 --2- 172.21.15.73:0/4275760616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ced3d4880 0x557ced3e60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.822+0000 7f57297cdb80 1 --2- 172.21.15.73:0/4275760616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ced3da8f0 0x557ced3dfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.822+0000 7f56faff5700 0 client.15711 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:02.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.822+0000 7f57297cdb80 1 --2- 172.21.15.73:0/4275760616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3d9fd0 0x557ced3e6610 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.822+0000 7f57297cdb80 1 -- 172.21.15.73:0/4275760616 >> 172.21.15.73:0/4275760616 conn(0x557ced331d50 msgr2=0x557ced3cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:02.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.822+0000 7f57297cdb80 1 -- 172.21.15.73:0/4275760616 shutdown_connections 2023-08-10T11:53:02.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.822+0000 7f57297cdb80 1 -- 172.21.15.73:0/4275760616 wait complete. 2023-08-10T11:53:02.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.822+0000 7f57297cdb80 20 client.15711 trim_cache size 0 max 16384 2023-08-10T11:53:02.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.839+0000 7f57297cdb80 1 Processor -- start 2023-08-10T11:53:02.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.839+0000 7f57297cdb80 1 -- start start 2023-08-10T11:53:02.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.839+0000 7f57297cdb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ced3d4880 0x557ced3e6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:02.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.839+0000 7f57297cdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ced3d9fd0 0x557ced3d9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:02.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.839+0000 7f57297cdb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3da8f0 0x557ced3dcaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:02.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.839+0000 7f57297cdb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ced1a89a0 con 0x557ced3da8f0 2023-08-10T11:53:02.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.839+0000 7f57297cdb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ced3d0cf0 con 0x557ced3d4880 2023-08-10T11:53:02.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.839+0000 7f57297cdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ced3f29e0 con 0x557ced3d9fd0 2023-08-10T11:53:02.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.839+0000 7f57177fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3da8f0 0x557ced3dcaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:02.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.839+0000 7f57177fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3da8f0 0x557ced3dcaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33300/0 (socket says 172.21.15.73:33300) 2023-08-10T11:53:02.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.839+0000 7f57177fe700 1 -- 172.21.15.73:0/1844887001 learned_addr learned my addr 172.21.15.73:0/1844887001 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:02.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.839+0000 7f5716ffd700 1 --2- 172.21.15.73:0/1844887001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ced3d4880 0x557ced3e6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:02.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.839+0000 7f57167fc700 1 --2- 172.21.15.73:0/1844887001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ced3d9fd0 0x557ced3d9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:02.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.839+0000 7f57177fe700 1 -- 172.21.15.73:0/1844887001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ced3d9fd0 msgr2=0x557ced3d9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:02.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.839+0000 7f57177fe700 1 --2- 172.21.15.73:0/1844887001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ced3d9fd0 0x557ced3d9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.839+0000 7f57177fe700 1 -- 172.21.15.73:0/1844887001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ced3d4880 msgr2=0x557ced3e6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:02.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.839+0000 7f57177fe700 1 --2- 172.21.15.73:0/1844887001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ced3d4880 0x557ced3e6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.839+0000 7f57177fe700 1 -- 172.21.15.73:0/1844887001 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ced13bce0 con 0x557ced3da8f0 2023-08-10T11:53:02.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.839+0000 7f5716ffd700 1 --2- 172.21.15.73:0/1844887001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ced3d4880 0x557ced3e6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:53:02.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.840+0000 7f57177fe700 1 --2- 172.21.15.73:0/1844887001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3da8f0 0x557ced3dcaa0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f5710009160 tx=0x7f5710009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1668e7c82924cc5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:02.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.840+0000 7f56fdffb700 1 -- 172.21.15.73:0/1844887001 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571000e040 con 0x557ced3da8f0 2023-08-10T11:53:02.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.840+0000 7f56fdffb700 1 -- 172.21.15.73:0/1844887001 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5710009b80 con 0x557ced3da8f0 2023-08-10T11:53:02.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.840+0000 7f56fdffb700 1 -- 172.21.15.73:0/1844887001 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571001c800 con 0x557ced3da8f0 2023-08-10T11:53:02.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.840+0000 7f57297cdb80 1 -- 172.21.15.73:0/1844887001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3da8f0 msgr2=0x557ced3dcaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:02.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.840+0000 7f57297cdb80 1 --2- 172.21.15.73:0/1844887001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3da8f0 0x557ced3dcaa0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f5710009160 tx=0x7f5710009190 comp rx=0 tx=0).stop 2023-08-10T11:53:02.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.840+0000 7f57297cdb80 1 -- 172.21.15.73:0/1844887001 shutdown_connections 2023-08-10T11:53:02.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.840+0000 7f57297cdb80 1 --2- 172.21.15.73:0/1844887001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ced3d4880 0x557ced3e6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.840+0000 7f57297cdb80 1 --2- 172.21.15.73:0/1844887001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3da8f0 0x557ced3dcaa0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.840+0000 7f57297cdb80 1 --2- 172.21.15.73:0/1844887001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ced3d9fd0 0x557ced3d9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.840+0000 7f57297cdb80 1 -- 172.21.15.73:0/1844887001 >> 172.21.15.73:0/1844887001 conn(0x557ced331d50 msgr2=0x557ced3dc390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:02.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.840+0000 7f57297cdb80 1 -- 172.21.15.73:0/1844887001 shutdown_connections 2023-08-10T11:53:02.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.840+0000 7f57297cdb80 1 -- 172.21.15.73:0/1844887001 wait complete. 2023-08-10T11:53:02.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.841+0000 7f57297cdb80 1 -- start start 2023-08-10T11:53:02.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.841+0000 7f57297cdb80 1 Processor -- start 2023-08-10T11:53:02.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.841+0000 7f57297cdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ced3d4880 0x557ced43e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:02.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.841+0000 7f57297cdb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3d9fd0 0x557ced43e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:02.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.841+0000 7f57297cdb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ced3da8f0 0x557ced3ebb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:02.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.841+0000 7f57297cdb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ced3ec160 con 0x557ced3d9fd0 2023-08-10T11:53:02.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.841+0000 7f57297cdb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ced3ec2d0 con 0x557ced3da8f0 2023-08-10T11:53:02.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.841+0000 7f57297cdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ced3ec490 con 0x557ced3d4880 2023-08-10T11:53:02.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.841+0000 7f57297cdb80 10 client.0 _ll_register_callbacks cb 0x557ced2c2700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:02.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.841+0000 7f57167fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3d9fd0 0x557ced43e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:02.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.841+0000 7f57167fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3d9fd0 0x557ced43e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33304/0 (socket says 172.21.15.73:33304) 2023-08-10T11:53:02.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.841+0000 7f57167fc700 1 -- 172.21.15.73:0/3301149713 learned_addr learned my addr 172.21.15.73:0/3301149713 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:02.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.841+0000 7f5716ffd700 1 --2- 172.21.15.73:0/3301149713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ced3d4880 0x557ced43e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:02.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.841+0000 7f57167fc700 1 -- 172.21.15.73:0/3301149713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ced3d4880 msgr2=0x557ced43e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:02.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.841+0000 7f57167fc700 1 --2- 172.21.15.73:0/3301149713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ced3d4880 0x557ced43e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.841+0000 7f57167fc700 1 -- 172.21.15.73:0/3301149713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ced3da8f0 msgr2=0x557ced3ebb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:02.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.841+0000 7f57167fc700 1 --2- 172.21.15.73:0/3301149713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ced3da8f0 0x557ced3ebb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.841+0000 7f57167fc700 1 -- 172.21.15.73:0/3301149713 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f571810cd50 con 0x557ced3d9fd0 2023-08-10T11:53:02.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.841+0000 7f5716ffd700 1 --2- 172.21.15.73:0/3301149713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ced3d4880 0x557ced43e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:53:02.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.842+0000 7f57167fc700 1 --2- 172.21.15.73:0/3301149713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3d9fd0 0x557ced43e660 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f570c005110 tx=0x7f570c0a2400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802abec96bfe501c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:02.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.842+0000 7f56faff5700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:02.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.842+0000 7f56faff5700 1 -- 172.21.15.73:0/3301149713 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c0ca4d0 con 0x557ced3d9fd0 2023-08-10T11:53:02.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.842+0000 7f56faff5700 1 -- 172.21.15.73:0/3301149713 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f570c063030 con 0x557ced3d9fd0 2023-08-10T11:53:02.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.842+0000 7f57297cdb80 1 -- 172.21.15.73:0/3301149713 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557ced31e800 con 0x557ced3d9fd0 2023-08-10T11:53:02.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.842+0000 7f56faff5700 1 -- 172.21.15.73:0/3301149713 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f570c0a2010 con 0x557ced3d9fd0 2023-08-10T11:53:02.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.842+0000 7f57297cdb80 10 client.15717 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:02.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.842+0000 7f57297cdb80 1 -- 172.21.15.73:0/3301149713 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557ced1792d0 con 0x557ced3d9fd0 2023-08-10T11:53:02.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.842+0000 7f56faff5700 1 -- 172.21.15.73:0/3301149713 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557ced31e800 con 0x557ced3d9fd0 2023-08-10T11:53:02.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.842+0000 7f56faff5700 1 -- 172.21.15.73:0/3301149713 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f570c098e10 con 0x557ced3d9fd0 2023-08-10T11:53:02.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.842+0000 7f57297cdb80 10 client.15717 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:02.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.842+0000 7f57297cdb80 10 client.15717 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:53:02.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.842+0000 7f57297cdb80 20 client.15717 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:02.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.842+0000 7f57297cdb80 1 --2- 172.21.15.73:0/3301149713 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x557ced445b30 0x557ced447f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:02.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.842+0000 7f57297cdb80 4 client.15717 mds_command: new command op to 24503 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-08-10T11:53:02.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.842+0000 7f57297cdb80 1 -- 172.21.15.73:0/3301149713 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x557ced2e00d0 con 0x557ced445b30 2023-08-10T11:53:02.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.843+0000 7f5716ffd700 1 --2- 172.21.15.73:0/3301149713 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x557ced445b30 0x557ced447f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:02.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.843+0000 7f56faff5700 10 client.15717 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:02.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.843+0000 7f5716ffd700 1 --2- 172.21.15.73:0/3301149713 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x557ced445b30 0x557ced447f20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c548f443dc1880dd server_cookie=9c18d582d4722c87 in_seq=0 out_seq=0 2023-08-10T11:53:02.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.844+0000 7f56faff5700 1 -- 172.21.15.73:0/3301149713 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x557ced2e00d0 con 0x557ced445b30 2023-08-10T11:53:02.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.844+0000 7f56faff5700 10 client.15717 handle_command_reply: tid=0 2023-08-10T11:53:02.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.844+0000 7f57297cdb80 1 client.15717 shutdown 2023-08-10T11:53:02.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.845+0000 7f57297cdb80 1 -- 172.21.15.73:0/3301149713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3d9fd0 msgr2=0x557ced43e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:02.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.845+0000 7f57297cdb80 1 --2- 172.21.15.73:0/3301149713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3d9fd0 0x557ced43e660 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f570c005110 tx=0x7f570c0a2400 comp rx=0 tx=0).stop 2023-08-10T11:53:02.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.845+0000 7f57297cdb80 1 -- 172.21.15.73:0/3301149713 shutdown_connections 2023-08-10T11:53:02.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.845+0000 7f57297cdb80 1 --2- 172.21.15.73:0/3301149713 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x557ced445b30 0x557ced447f20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.845+0000 7f57297cdb80 1 --2- 172.21.15.73:0/3301149713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557ced3da8f0 0x557ced3ebb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.845+0000 7f56faff5700 0 client.15717 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:02.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.845+0000 7f57297cdb80 1 --2- 172.21.15.73:0/3301149713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ced3d4880 0x557ced43e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.845+0000 7f57297cdb80 1 --2- 172.21.15.73:0/3301149713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557ced3d9fd0 0x557ced43e660 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.845+0000 7f57297cdb80 1 -- 172.21.15.73:0/3301149713 >> 172.21.15.73:0/3301149713 conn(0x557ced331d50 msgr2=0x557ced3dcc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:02.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.845+0000 7f57297cdb80 1 -- 172.21.15.73:0/3301149713 shutdown_connections 2023-08-10T11:53:02.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.845+0000 7f57297cdb80 1 -- 172.21.15.73:0/3301149713 wait complete. 2023-08-10T11:53:02.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.845+0000 7f57297cdb80 20 client.15717 trim_cache size 0 max 16384 2023-08-10T11:53:02.856 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:53:02.857 INFO:teuthology.orchestra.run.smithi073.stdout: "return_code": 0, 2023-08-10T11:53:02.857 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_tag": "9f0dbd36-4200-471e-bb8c-ee9cfa881dfe", 2023-08-10T11:53:02.857 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": "asynchronous" 2023-08-10T11:53:02.857 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:53:02.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.845+0000 7f571d634700 1 -- 172.21.15.73:0/2878291476 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f57000a13e0 msgr2=0x7f57000a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:02.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.845+0000 7f571d634700 1 --2- 172.21.15.73:0/2878291476 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f57000a13e0 0x7f57000a38a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5708005950 tx=0x7f570800a300 comp rx=0 tx=0).stop 2023-08-10T11:53:02.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.845+0000 7f571d634700 1 -- 172.21.15.73:0/2878291476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57180fff90 msgr2=0x7f5718195bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:02.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.845+0000 7f571d634700 1 --2- 172.21.15.73:0/2878291476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57180fff90 0x7f5718195bf0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f570c00c9b0 tx=0x7f570c00ccc0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.846+0000 7f571d634700 1 -- 172.21.15.73:0/2878291476 shutdown_connections 2023-08-10T11:53:02.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.846+0000 7f571d634700 1 --2- 172.21.15.73:0/2878291476 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f57000a13e0 0x7f57000a38a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.846+0000 7f571d634700 1 --2- 172.21.15.73:0/2878291476 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57180ff5d0 0x7f57181956b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.846+0000 7f571d634700 1 --2- 172.21.15.73:0/2878291476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5718105690 0x7f5718198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.846+0000 7f571d634700 1 --2- 172.21.15.73:0/2878291476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57180fff90 0x7f5718195bf0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.846+0000 7f571d634700 1 -- 172.21.15.73:0/2878291476 >> 172.21.15.73:0/2878291476 conn(0x7f57180fb0c0 msgr2=0x7f57180fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:02.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.846+0000 7f571d634700 1 -- 172.21.15.73:0/2878291476 shutdown_connections 2023-08-10T11:53:02.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.846+0000 7f571d634700 1 -- 172.21.15.73:0/2878291476 wait complete. 2023-08-10T11:53:02.860 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:53:02.885 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:02 smithi073 ceph-mon[128869]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-08-10T11:53:02.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.988+0000 7f6374fd9700 1 -- 172.21.15.73:0/1767066989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63701066f0 msgr2=0x7f6370106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:02.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.988+0000 7f6374fd9700 1 --2- 172.21.15.73:0/1767066989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63701066f0 0x7f6370106ad0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f6360009990 tx=0x7f6360009ca0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.988+0000 7f6374fd9700 1 -- 172.21.15.73:0/1767066989 shutdown_connections 2023-08-10T11:53:02.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.988+0000 7f6374fd9700 1 --2- 172.21.15.73:0/1767066989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63701010a0 0x7f637010d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.988+0000 7f6374fd9700 1 --2- 172.21.15.73:0/1767066989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63701066f0 0x7f6370106ad0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.988+0000 7f6374fd9700 1 --2- 172.21.15.73:0/1767066989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63701006e0 0x7f6370100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.988+0000 7f6374fd9700 1 -- 172.21.15.73:0/1767066989 >> 172.21.15.73:0/1767066989 conn(0x7f63700fc1d0 msgr2=0x7f63700fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:02.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.988+0000 7f6374fd9700 1 -- 172.21.15.73:0/1767066989 shutdown_connections 2023-08-10T11:53:02.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.988+0000 7f6374fd9700 1 -- 172.21.15.73:0/1767066989 wait complete. 2023-08-10T11:53:02.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.989+0000 7f6374fd9700 1 Processor -- start 2023-08-10T11:53:02.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.989+0000 7f6374fd9700 1 -- start start 2023-08-10T11:53:02.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.989+0000 7f6374fd9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63701006e0 0x7f637019c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:02.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.989+0000 7f6374fd9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63701010a0 0x7f637019cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:02.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.989+0000 7f6374fd9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63701066f0 0x7f6370196610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:02.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.989+0000 7f6374fd9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6370196c80 con 0x7f63701010a0 2023-08-10T11:53:02.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.989+0000 7f6374fd9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6370196df0 con 0x7f63701006e0 2023-08-10T11:53:02.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.989+0000 7f6374fd9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6370196fb0 con 0x7f63701066f0 2023-08-10T11:53:02.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.989+0000 7f636dd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63701010a0 0x7f637019cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:02.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.989+0000 7f636dd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63701010a0 0x7f637019cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33318/0 (socket says 172.21.15.73:33318) 2023-08-10T11:53:02.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.989+0000 7f636dd9b700 1 -- 172.21.15.73:0/4262921960 learned_addr learned my addr 172.21.15.73:0/4262921960 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:02.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.989+0000 7f636e59c700 1 --2- 172.21.15.73:0/4262921960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63701006e0 0x7f637019c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:02.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.990+0000 7f636ed9d700 1 --2- 172.21.15.73:0/4262921960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63701066f0 0x7f6370196610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:02.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.990+0000 7f636dd9b700 1 -- 172.21.15.73:0/4262921960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63701066f0 msgr2=0x7f6370196610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:02.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.990+0000 7f636dd9b700 1 --2- 172.21.15.73:0/4262921960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63701066f0 0x7f6370196610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.990+0000 7f636dd9b700 1 -- 172.21.15.73:0/4262921960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63701006e0 msgr2=0x7f637019c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:02.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.990+0000 7f636dd9b700 1 --2- 172.21.15.73:0/4262921960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63701006e0 0x7f637019c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:02.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.990+0000 7f636dd9b700 1 -- 172.21.15.73:0/4262921960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63600095f0 con 0x7f63701010a0 2023-08-10T11:53:02.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.990+0000 7f636dd9b700 1 --2- 172.21.15.73:0/4262921960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63701010a0 0x7f637019cae0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f636400b530 tx=0x7f636400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:02.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.990+0000 7f635f7fe700 1 -- 172.21.15.73:0/4262921960 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6364011830 con 0x7f63701010a0 2023-08-10T11:53:02.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.990+0000 7f635f7fe700 1 -- 172.21.15.73:0/4262921960 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6364011e50 con 0x7f63701010a0 2023-08-10T11:53:02.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.990+0000 7f6374fd9700 1 -- 172.21.15.73:0/4262921960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6370197290 con 0x7f63701010a0 2023-08-10T11:53:02.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.990+0000 7f635f7fe700 1 -- 172.21.15.73:0/4262921960 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636400f2e0 con 0x7f63701010a0 2023-08-10T11:53:02.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.990+0000 7f6374fd9700 1 -- 172.21.15.73:0/4262921960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63701a3590 con 0x7f63701010a0 2023-08-10T11:53:02.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.992+0000 7f635f7fe700 1 -- 172.21.15.73:0/4262921960 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f6364010380 con 0x7f63701010a0 2023-08-10T11:53:02.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:02 smithi152 ceph-mon[130220]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-08-10T11:53:03.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.992+0000 7f635f7fe700 1 --2- 172.21.15.73:0/4262921960 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f63580a13e0 0x7f63580a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:03.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.993+0000 7f636e59c700 1 --2- 172.21.15.73:0/4262921960 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f63580a13e0 0x7f63580a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:03.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.993+0000 7f635f7fe700 1 -- 172.21.15.73:0/4262921960 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f63640cc920 con 0x7f63701010a0 2023-08-10T11:53:03.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.993+0000 7f636e59c700 1 --2- 172.21.15.73:0/4262921960 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f63580a13e0 0x7f63580a38a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f636000b2e0 tx=0x7f6360005fd0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:03.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.993+0000 7f6381172b80 1 Processor -- start 2023-08-10T11:53:03.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.994+0000 7f6381172b80 1 -- start start 2023-08-10T11:53:03.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.994+0000 7f6381172b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbbdf50 0x55f24cbbe330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:03.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.994+0000 7f6381172b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f24cbbe870 0x55f24cbb82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:03.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.994+0000 7f6381172b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f24cbb8800 0x55f24cbb8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:03.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.994+0000 7f6381172b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24cb33dc0 con 0x55f24cbbdf50 2023-08-10T11:53:03.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.994+0000 7f6381172b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24cb10590 con 0x55f24cbb8800 2023-08-10T11:53:03.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.994+0000 7f6381172b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24cb0deb0 con 0x55f24cbbe870 2023-08-10T11:53:03.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.994+0000 7f636e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbbdf50 0x55f24cbbe330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:03.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.994+0000 7f636e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbbdf50 0x55f24cbbe330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33324/0 (socket says 172.21.15.73:33324) 2023-08-10T11:53:03.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.994+0000 7f636e59c700 1 -- 172.21.15.73:0/286324760 learned_addr learned my addr 172.21.15.73:0/286324760 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:03.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.994+0000 7f636ed9d700 1 --2- 172.21.15.73:0/286324760 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f24cbb8800 0x55f24cbb8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:03.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.994+0000 7f636dd9b700 1 --2- 172.21.15.73:0/286324760 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f24cbbe870 0x55f24cbb82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:03.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.994+0000 7f636e59c700 1 -- 172.21.15.73:0/286324760 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f24cbbe870 msgr2=0x55f24cbb82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:03.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.994+0000 7f636e59c700 1 --2- 172.21.15.73:0/286324760 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f24cbbe870 0x55f24cbb82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.994+0000 7f636e59c700 1 -- 172.21.15.73:0/286324760 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f24cbb8800 msgr2=0x55f24cbb8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:03.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.994+0000 7f636e59c700 1 --2- 172.21.15.73:0/286324760 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f24cbb8800 0x55f24cbb8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.994+0000 7f636e59c700 1 -- 172.21.15.73:0/286324760 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f24c98a630 con 0x55f24cbbdf50 2023-08-10T11:53:03.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.994+0000 7f636e59c700 1 --2- 172.21.15.73:0/286324760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbbdf50 0x55f24cbbe330 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f6360015000 tx=0x7f6360020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d8decdc8b543b1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:03.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.995+0000 7f635cff9700 1 -- 172.21.15.73:0/286324760 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636002b070 con 0x55f24cbbdf50 2023-08-10T11:53:03.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.995+0000 7f635cff9700 1 -- 172.21.15.73:0/286324760 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f636001e040 con 0x55f24cbbdf50 2023-08-10T11:53:03.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.995+0000 7f635cff9700 1 -- 172.21.15.73:0/286324760 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636000f860 con 0x55f24cbbdf50 2023-08-10T11:53:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.995+0000 7f6381172b80 1 -- 172.21.15.73:0/286324760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbbdf50 msgr2=0x55f24cbbe330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.995+0000 7f6381172b80 1 --2- 172.21.15.73:0/286324760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbbdf50 0x55f24cbbe330 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f6360015000 tx=0x7f6360020000 comp rx=0 tx=0).stop 2023-08-10T11:53:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.995+0000 7f6381172b80 1 -- 172.21.15.73:0/286324760 shutdown_connections 2023-08-10T11:53:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.995+0000 7f6381172b80 1 --2- 172.21.15.73:0/286324760 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f24cbb8800 0x55f24cbb8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.995+0000 7f6381172b80 1 --2- 172.21.15.73:0/286324760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbbdf50 0x55f24cbbe330 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.995+0000 7f6381172b80 1 --2- 172.21.15.73:0/286324760 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f24cbbe870 0x55f24cbb82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.995+0000 7f6381172b80 1 -- 172.21.15.73:0/286324760 >> 172.21.15.73:0/286324760 conn(0x55f24cb15cd0 msgr2=0x55f24cbb34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:03.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.995+0000 7f6381172b80 1 -- 172.21.15.73:0/286324760 shutdown_connections 2023-08-10T11:53:03.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.995+0000 7f6381172b80 1 -- 172.21.15.73:0/286324760 wait complete. 2023-08-10T11:53:03.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.996+0000 7f6381172b80 1 -- start start 2023-08-10T11:53:03.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.996+0000 7f6381172b80 1 Processor -- start 2023-08-10T11:53:03.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.996+0000 7f6381172b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbb8800 0x55f24cbc1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:03.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.996+0000 7f6381172b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f24cbbdf50 0x55f24cbc2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:03.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.996+0000 7f6381172b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f24cbbe870 0x55f24cbc2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:03.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.996+0000 7f6381172b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24cb097a0 con 0x55f24cbb8800 2023-08-10T11:53:03.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.996+0000 7f6381172b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24caa8ac0 con 0x55f24cbbe870 2023-08-10T11:53:03.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.996+0000 7f6381172b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24caa87c0 con 0x55f24cbbdf50 2023-08-10T11:53:03.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.996+0000 7f6381172b80 10 client.0 _ll_register_callbacks cb 0x55f24caa6680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:03.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.996+0000 7f636e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbb8800 0x55f24cbc1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:03.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.996+0000 7f636e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbb8800 0x55f24cbc1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33330/0 (socket says 172.21.15.73:33330) 2023-08-10T11:53:03.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.996+0000 7f636e59c700 1 -- 172.21.15.73:0/2048143314 learned_addr learned my addr 172.21.15.73:0/2048143314 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:03.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.997+0000 7f636dd9b700 1 --2- 172.21.15.73:0/2048143314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f24cbbdf50 0x55f24cbc2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:03.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.997+0000 7f636ed9d700 1 --2- 172.21.15.73:0/2048143314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f24cbbe870 0x55f24cbc2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:03.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.997+0000 7f636e59c700 1 -- 172.21.15.73:0/2048143314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f24cbbdf50 msgr2=0x55f24cbc2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:03.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.997+0000 7f636e59c700 1 --2- 172.21.15.73:0/2048143314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f24cbbdf50 0x55f24cbc2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.997+0000 7f636e59c700 1 -- 172.21.15.73:0/2048143314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f24cbbe870 msgr2=0x55f24cbc2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:03.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.997+0000 7f636e59c700 1 --2- 172.21.15.73:0/2048143314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f24cbbe870 0x55f24cbc2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.997+0000 7f636e59c700 1 -- 172.21.15.73:0/2048143314 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637010deb0 con 0x55f24cbb8800 2023-08-10T11:53:03.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.997+0000 7f636e59c700 1 --2- 172.21.15.73:0/2048143314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbb8800 0x55f24cbc1c00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6360005ad0 tx=0x7f6360004ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7004097e7232c6e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:03.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.997+0000 7f6355ffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:03.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.997+0000 7f6355ffb700 1 -- 172.21.15.73:0/2048143314 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636002b040 con 0x55f24cbb8800 2023-08-10T11:53:03.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.997+0000 7f6355ffb700 1 -- 172.21.15.73:0/2048143314 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f636000f870 con 0x55f24cbb8800 2023-08-10T11:53:03.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.997+0000 7f6381172b80 1 -- 172.21.15.73:0/2048143314 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f24cbab470 con 0x55f24cbb8800 2023-08-10T11:53:03.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.997+0000 7f6355ffb700 1 -- 172.21.15.73:0/2048143314 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f636000fa30 con 0x55f24cbb8800 2023-08-10T11:53:03.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.997+0000 7f6381172b80 10 client.15729 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:03.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.997+0000 7f6381172b80 1 -- 172.21.15.73:0/2048143314 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f24c936de0 con 0x55f24cbb8800 2023-08-10T11:53:03.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.997+0000 7f6355ffb700 1 -- 172.21.15.73:0/2048143314 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f24cbab470 con 0x55f24cbb8800 2023-08-10T11:53:03.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.998+0000 7f6355ffb700 1 -- 172.21.15.73:0/2048143314 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6360036030 con 0x55f24cbb8800 2023-08-10T11:53:03.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.998+0000 7f6381172b80 10 client.15729 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:03.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.998+0000 7f6381172b80 10 client.15729 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:53:03.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.998+0000 7f6381172b80 20 client.15729 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:03.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.998+0000 7f6381172b80 1 --2- 172.21.15.73:0/2048143314 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f24cbd1e10 0x55f24cbd4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:03.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.998+0000 7f6381172b80 4 client.15729 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:53:03.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.998+0000 7f6381172b80 1 -- 172.21.15.73:0/2048143314 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f24cb879d0 con 0x55f24cbd1e10 2023-08-10T11:53:03.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.998+0000 7f636dd9b700 1 --2- 172.21.15.73:0/2048143314 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f24cbd1e10 0x55f24cbd4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:03.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.998+0000 7f6355ffb700 10 client.15729 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:03.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.998+0000 7f636dd9b700 1 --2- 172.21.15.73:0/2048143314 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f24cbd1e10 0x55f24cbd4200 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d9d2fef9ef92269 server_cookie=499b7b71571dd3c3 in_seq=0 out_seq=0 2023-08-10T11:53:03.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.999+0000 7f6355ffb700 1 -- 172.21.15.73:0/2048143314 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55f24cb879d0 con 0x55f24cbd1e10 2023-08-10T11:53:03.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.999+0000 7f6355ffb700 10 client.15729 handle_command_reply: tid=0 2023-08-10T11:53:03.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.999+0000 7f6381172b80 1 client.15729 shutdown 2023-08-10T11:53:03.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.999+0000 7f6381172b80 1 -- 172.21.15.73:0/2048143314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbb8800 msgr2=0x55f24cbc1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:03.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.999+0000 7f6381172b80 1 --2- 172.21.15.73:0/2048143314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbb8800 0x55f24cbc1c00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6360005ad0 tx=0x7f6360004ba0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.999+0000 7f6381172b80 1 -- 172.21.15.73:0/2048143314 shutdown_connections 2023-08-10T11:53:03.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.999+0000 7f6381172b80 1 --2- 172.21.15.73:0/2048143314 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f24cbd1e10 0x55f24cbd4200 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.999+0000 7f6381172b80 1 --2- 172.21.15.73:0/2048143314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f24cbbe870 0x55f24cbc2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.999+0000 7f6355ffb700 0 client.15729 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:03.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.999+0000 7f6381172b80 1 --2- 172.21.15.73:0/2048143314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbb8800 0x55f24cbc1c00 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.999+0000 7f6381172b80 1 --2- 172.21.15.73:0/2048143314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f24cbbdf50 0x55f24cbc2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.999+0000 7f6381172b80 1 -- 172.21.15.73:0/2048143314 >> 172.21.15.73:0/2048143314 conn(0x55f24cb15cd0 msgr2=0x55f24cbb29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:03.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.999+0000 7f6381172b80 1 -- 172.21.15.73:0/2048143314 shutdown_connections 2023-08-10T11:53:03.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.999+0000 7f6381172b80 1 -- 172.21.15.73:0/2048143314 wait complete. 2023-08-10T11:53:03.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:02.999+0000 7f6381172b80 20 client.15729 trim_cache size 0 max 16384 2023-08-10T11:53:03.015 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:02 smithi156 ceph-mon[130574]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-08-10T11:53:03.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.017+0000 7f6381172b80 1 Processor -- start 2023-08-10T11:53:03.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.017+0000 7f6381172b80 1 -- start start 2023-08-10T11:53:03.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.018+0000 7f6381172b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f24cbb8800 0x55f24cbc0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:03.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.018+0000 7f6381172b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbbdf50 0x55f24cbbd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:03.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.018+0000 7f6381172b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f24cbbe870 0x55f24cbb3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:03.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.018+0000 7f6381172b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24c98c920 con 0x55f24cbbdf50 2023-08-10T11:53:03.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.018+0000 7f6381172b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24cbab370 con 0x55f24cbbe870 2023-08-10T11:53:03.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.018+0000 7f6381172b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24cbc4cb0 con 0x55f24cbb8800 2023-08-10T11:53:03.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.018+0000 7f636dd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbbdf50 0x55f24cbbd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:03.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.018+0000 7f636dd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbbdf50 0x55f24cbbd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33340/0 (socket says 172.21.15.73:33340) 2023-08-10T11:53:03.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.018+0000 7f636dd9b700 1 -- 172.21.15.73:0/39217133 learned_addr learned my addr 172.21.15.73:0/39217133 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:03.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.018+0000 7f636e59c700 1 --2- 172.21.15.73:0/39217133 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f24cbb8800 0x55f24cbc0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:03.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.018+0000 7f636dd9b700 1 -- 172.21.15.73:0/39217133 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f24cbb8800 msgr2=0x55f24cbc0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:03.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.018+0000 7f636dd9b700 1 --2- 172.21.15.73:0/39217133 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f24cbb8800 0x55f24cbc0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.018+0000 7f636dd9b700 1 -- 172.21.15.73:0/39217133 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f24cbbe870 msgr2=0x55f24cbb3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:03.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.018+0000 7f636dd9b700 1 --2- 172.21.15.73:0/39217133 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f24cbbe870 0x55f24cbb3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.018+0000 7f636dd9b700 1 -- 172.21.15.73:0/39217133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f24cbaf6a0 con 0x55f24cbbdf50 2023-08-10T11:53:03.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.018+0000 7f636dd9b700 1 --2- 172.21.15.73:0/39217133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbbdf50 0x55f24cbbd510 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f63640ca6a0 tx=0x7f63640998b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4288d41740165e7e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:03.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.018+0000 7f635d7fa700 1 -- 172.21.15.73:0/39217133 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63640b20d0 con 0x55f24cbbdf50 2023-08-10T11:53:03.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.018+0000 7f635d7fa700 1 -- 172.21.15.73:0/39217133 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6364097d50 con 0x55f24cbbdf50 2023-08-10T11:53:03.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.018+0000 7f635d7fa700 1 -- 172.21.15.73:0/39217133 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63640a1bd0 con 0x55f24cbbdf50 2023-08-10T11:53:03.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.019+0000 7f6381172b80 1 -- 172.21.15.73:0/39217133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbbdf50 msgr2=0x55f24cbbd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:03.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.019+0000 7f6381172b80 1 --2- 172.21.15.73:0/39217133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbbdf50 0x55f24cbbd510 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f63640ca6a0 tx=0x7f63640998b0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.019+0000 7f6381172b80 1 -- 172.21.15.73:0/39217133 shutdown_connections 2023-08-10T11:53:03.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.019+0000 7f6381172b80 1 --2- 172.21.15.73:0/39217133 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f24cbbe870 0x55f24cbb3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.019+0000 7f6381172b80 1 --2- 172.21.15.73:0/39217133 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f24cbb8800 0x55f24cbc0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.019+0000 7f6381172b80 1 --2- 172.21.15.73:0/39217133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbbdf50 0x55f24cbbd510 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.019+0000 7f6381172b80 1 -- 172.21.15.73:0/39217133 >> 172.21.15.73:0/39217133 conn(0x55f24cb15cd0 msgr2=0x55f24cbbec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:03.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.019+0000 7f6381172b80 1 -- 172.21.15.73:0/39217133 shutdown_connections 2023-08-10T11:53:03.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.019+0000 7f6381172b80 1 -- 172.21.15.73:0/39217133 wait complete. 2023-08-10T11:53:03.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.019+0000 7f6381172b80 1 -- start start 2023-08-10T11:53:03.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.020+0000 7f6381172b80 1 Processor -- start 2023-08-10T11:53:03.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.020+0000 7f6381172b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbb8800 0x55f24cbc79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:03.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.020+0000 7f6381172b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f24cbbdf50 0x55f24cbc7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:03.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.020+0000 7f6381172b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f24cbbe870 0x55f24cbc8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:03.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.020+0000 7f6381172b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24cc25ac0 con 0x55f24cbb8800 2023-08-10T11:53:03.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.020+0000 7f6381172b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24cc25c00 con 0x55f24cbbe870 2023-08-10T11:53:03.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.020+0000 7f6381172b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24cc25dc0 con 0x55f24cbbdf50 2023-08-10T11:53:03.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.020+0000 7f6381172b80 10 client.0 _ll_register_callbacks cb 0x55f24caa6680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:03.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.020+0000 7f636e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbb8800 0x55f24cbc79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:03.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.020+0000 7f636e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbb8800 0x55f24cbc79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33344/0 (socket says 172.21.15.73:33344) 2023-08-10T11:53:03.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.020+0000 7f636e59c700 1 -- 172.21.15.73:0/1418252219 learned_addr learned my addr 172.21.15.73:0/1418252219 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:03.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.020+0000 7f636dd9b700 1 --2- 172.21.15.73:0/1418252219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f24cbbdf50 0x55f24cbc7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:03.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.020+0000 7f636ed9d700 1 --2- 172.21.15.73:0/1418252219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f24cbbe870 0x55f24cbc8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:03.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.020+0000 7f636e59c700 1 -- 172.21.15.73:0/1418252219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f24cbbdf50 msgr2=0x55f24cbc7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:03.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.020+0000 7f636e59c700 1 --2- 172.21.15.73:0/1418252219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f24cbbdf50 0x55f24cbc7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.020+0000 7f636e59c700 1 -- 172.21.15.73:0/1418252219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f24cbbe870 msgr2=0x55f24cbc8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:03.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.020+0000 7f636e59c700 1 --2- 172.21.15.73:0/1418252219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f24cbbe870 0x55f24cbc8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.020+0000 7f636e59c700 1 -- 172.21.15.73:0/1418252219 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63701a3590 con 0x55f24cbb8800 2023-08-10T11:53:03.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.020+0000 7f636ed9d700 1 --2- 172.21.15.73:0/1418252219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f24cbbe870 0x55f24cbc8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:03.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.020+0000 7f636e59c700 1 --2- 172.21.15.73:0/1418252219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbb8800 0x55f24cbc79d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6360005b00 tx=0x7f6360024a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7705171e027583f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:03.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.020+0000 7f6355ffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:03.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.021+0000 7f6355ffb700 1 -- 172.21.15.73:0/1418252219 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636002b040 con 0x55f24cbb8800 2023-08-10T11:53:03.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.021+0000 7f6381172b80 1 -- 172.21.15.73:0/1418252219 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f636001e040 con 0x55f24cbb8800 2023-08-10T11:53:03.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.021+0000 7f6355ffb700 1 -- 172.21.15.73:0/1418252219 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f63600056b0 con 0x55f24cbb8800 2023-08-10T11:53:03.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.021+0000 7f6355ffb700 1 -- 172.21.15.73:0/1418252219 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6360024560 con 0x55f24cbb8800 2023-08-10T11:53:03.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.021+0000 7f6381172b80 10 client.15735 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:03.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.021+0000 7f6381172b80 1 -- 172.21.15.73:0/1418252219 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f24c91fc60 con 0x55f24cbb8800 2023-08-10T11:53:03.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.021+0000 7f6355ffb700 1 -- 172.21.15.73:0/1418252219 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f636001e040 con 0x55f24cbb8800 2023-08-10T11:53:03.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.021+0000 7f6355ffb700 1 -- 172.21.15.73:0/1418252219 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6360036070 con 0x55f24cbb8800 2023-08-10T11:53:03.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.021+0000 7f6381172b80 10 client.15735 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:03.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.021+0000 7f6381172b80 10 client.15735 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:53:03.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.021+0000 7f6381172b80 20 client.15735 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:03.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.021+0000 7f6381172b80 1 --2- 172.21.15.73:0/1418252219 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f24cc27070 0x55f24cc29460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:03.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.021+0000 7f6381172b80 4 client.15735 mds_command: new command op to 24503 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:53:03.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.021+0000 7f6381172b80 1 -- 172.21.15.73:0/1418252219 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f24cb02780 con 0x55f24cc27070 2023-08-10T11:53:03.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.022+0000 7f636dd9b700 1 --2- 172.21.15.73:0/1418252219 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f24cc27070 0x55f24cc29460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:03.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.022+0000 7f6355ffb700 10 client.15735 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:03.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.022+0000 7f636dd9b700 1 --2- 172.21.15.73:0/1418252219 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f24cc27070 0x55f24cc29460 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20bf4e4b5c5da791 server_cookie=f29024ba6079d85b in_seq=0 out_seq=0 2023-08-10T11:53:03.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.022+0000 7f6355ffb700 1 -- 172.21.15.73:0/1418252219 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55f24cb02780 con 0x55f24cc27070 2023-08-10T11:53:03.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.022+0000 7f6355ffb700 10 client.15735 handle_command_reply: tid=0 2023-08-10T11:53:03.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.022+0000 7f6381172b80 1 client.15735 shutdown 2023-08-10T11:53:03.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.022+0000 7f6381172b80 1 -- 172.21.15.73:0/1418252219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbb8800 msgr2=0x55f24cbc79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:03.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.022+0000 7f6381172b80 1 --2- 172.21.15.73:0/1418252219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbb8800 0x55f24cbc79d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6360005b00 tx=0x7f6360024a50 comp rx=0 tx=0).stop 2023-08-10T11:53:03.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.022+0000 7f6381172b80 1 -- 172.21.15.73:0/1418252219 shutdown_connections 2023-08-10T11:53:03.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.022+0000 7f6381172b80 1 --2- 172.21.15.73:0/1418252219 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f24cc27070 0x55f24cc29460 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.022+0000 7f6381172b80 1 --2- 172.21.15.73:0/1418252219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f24cbbe870 0x55f24cbc8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.022+0000 7f6381172b80 1 --2- 172.21.15.73:0/1418252219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f24cbb8800 0x55f24cbc79d0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.022+0000 7f6355ffb700 0 client.15735 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:03.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.022+0000 7f6381172b80 1 --2- 172.21.15.73:0/1418252219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f24cbbdf50 0x55f24cbc7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.022+0000 7f6381172b80 1 -- 172.21.15.73:0/1418252219 >> 172.21.15.73:0/1418252219 conn(0x55f24cb15cd0 msgr2=0x55f24cbbf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:03.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.023+0000 7f6381172b80 1 -- 172.21.15.73:0/1418252219 shutdown_connections 2023-08-10T11:53:03.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.023+0000 7f6381172b80 1 -- 172.21.15.73:0/1418252219 wait complete. 2023-08-10T11:53:03.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.023+0000 7f6381172b80 20 client.15735 trim_cache size 0 max 16384 2023-08-10T11:53:03.035 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:53:03.036 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:53:03.036 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": { 2023-08-10T11:53:03.036 INFO:teuthology.orchestra.run.smithi073.stdout: "9f0dbd36-4200-471e-bb8c-ee9cfa881dfe": { 2023-08-10T11:53:03.036 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2023-08-10T11:53:03.036 INFO:teuthology.orchestra.run.smithi073.stdout: "tag": "9f0dbd36-4200-471e-bb8c-ee9cfa881dfe", 2023-08-10T11:53:03.036 INFO:teuthology.orchestra.run.smithi073.stdout: "options": "recursive,force" 2023-08-10T11:53:03.036 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:53:03.037 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:53:03.037 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:53:03.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.023+0000 7f6374fd9700 1 -- 172.21.15.73:0/4262921960 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f63580a13e0 msgr2=0x7f63580a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:03.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.023+0000 7f6374fd9700 1 --2- 172.21.15.73:0/4262921960 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f63580a13e0 0x7f63580a38a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f636000b2e0 tx=0x7f6360005fd0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.023+0000 7f6374fd9700 1 -- 172.21.15.73:0/4262921960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63701010a0 msgr2=0x7f637019cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:03.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.023+0000 7f6374fd9700 1 --2- 172.21.15.73:0/4262921960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63701010a0 0x7f637019cae0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f636400b530 tx=0x7f636400b840 comp rx=0 tx=0).stop 2023-08-10T11:53:03.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.023+0000 7f6374fd9700 1 -- 172.21.15.73:0/4262921960 shutdown_connections 2023-08-10T11:53:03.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.023+0000 7f6374fd9700 1 --2- 172.21.15.73:0/4262921960 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f63580a13e0 0x7f63580a38a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.023+0000 7f6374fd9700 1 --2- 172.21.15.73:0/4262921960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63701006e0 0x7f637019c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.023+0000 7f6374fd9700 1 --2- 172.21.15.73:0/4262921960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63701066f0 0x7f6370196610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.023+0000 7f6374fd9700 1 --2- 172.21.15.73:0/4262921960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63701010a0 0x7f637019cae0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:03.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.023+0000 7f6374fd9700 1 -- 172.21.15.73:0/4262921960 >> 172.21.15.73:0/4262921960 conn(0x7f63700fc1d0 msgr2=0x7f63700fc790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:03.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.023+0000 7f6374fd9700 1 -- 172.21.15.73:0/4262921960 shutdown_connections 2023-08-10T11:53:03.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:03.023+0000 7f6374fd9700 1 -- 172.21.15.73:0/4262921960 wait complete. 2023-08-10T11:53:03.040 INFO:tasks.cephfs.filesystem:scrub status for tag:9f0dbd36-4200-471e-bb8c-ee9cfa881dfe - {'path': '/', 'tag': '9f0dbd36-4200-471e-bb8c-ee9cfa881dfe', 'options': 'recursive,force'} 2023-08-10T11:53:03.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:03 smithi152 ceph-mon[130220]: mgrmap e24: x(active, since 25s), standbys: z, y 2023-08-10T11:53:04.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:03 smithi156 ceph-mon[130574]: mgrmap e24: x(active, since 25s), standbys: z, y 2023-08-10T11:53:04.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:03 smithi073 ceph-mon[128869]: mgrmap e24: x(active, since 25s), standbys: z, y 2023-08-10T11:53:04.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:04 smithi152 ceph-mon[130220]: scrub queued for path: / 2023-08-10T11:53:04.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:04 smithi152 ceph-mon[130220]: scrub summary: idle+waiting paths [/] 2023-08-10T11:53:04.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:04 smithi152 ceph-mon[130220]: scrub summary: active paths [/] 2023-08-10T11:53:04.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:04 smithi152 ceph-mon[130220]: scrub summary: idle+waiting paths [/] 2023-08-10T11:53:04.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:04 smithi152 ceph-mon[130220]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-08-10T11:53:05.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:04 smithi156 ceph-mon[130574]: scrub queued for path: / 2023-08-10T11:53:05.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:04 smithi156 ceph-mon[130574]: scrub summary: idle+waiting paths [/] 2023-08-10T11:53:05.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:04 smithi156 ceph-mon[130574]: scrub summary: active paths [/] 2023-08-10T11:53:05.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:04 smithi156 ceph-mon[130574]: scrub summary: idle+waiting paths [/] 2023-08-10T11:53:05.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:04 smithi156 ceph-mon[130574]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-08-10T11:53:05.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:04 smithi073 ceph-mon[128869]: scrub queued for path: / 2023-08-10T11:53:05.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:04 smithi073 ceph-mon[128869]: scrub summary: idle+waiting paths [/] 2023-08-10T11:53:05.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:04 smithi073 ceph-mon[128869]: scrub summary: active paths [/] 2023-08-10T11:53:05.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:04 smithi073 ceph-mon[128869]: scrub summary: idle+waiting paths [/] 2023-08-10T11:53:05.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:04 smithi073 ceph-mon[128869]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-08-10T11:53:05.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:05 smithi152 ceph-mon[130220]: scrub summary: idle 2023-08-10T11:53:06.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:05 smithi156 ceph-mon[130574]: scrub summary: idle 2023-08-10T11:53:06.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:05 smithi073 ceph-mon[128869]: scrub summary: idle 2023-08-10T11:53:06.387 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.386+0000 7f546eb63700 1 -- 172.21.15.73:0/2298690811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54680ff8d0 msgr2=0x7f54680ffd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:06.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.386+0000 7f546eb63700 1 --2- 172.21.15.73:0/2298690811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54680ff8d0 0x7f54680ffd50 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f5454009990 tx=0x7f5454009ca0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.386+0000 7f546eb63700 1 -- 172.21.15.73:0/2298690811 shutdown_connections 2023-08-10T11:53:06.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.386+0000 7f546eb63700 1 --2- 172.21.15.73:0/2298690811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5468100290 0x7f546810c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.386+0000 7f546eb63700 1 --2- 172.21.15.73:0/2298690811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5468105670 0x7f5468105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.386+0000 7f546eb63700 1 --2- 172.21.15.73:0/2298690811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54680ff8d0 0x7f54680ffd50 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.386+0000 7f546eb63700 1 -- 172.21.15.73:0/2298690811 >> 172.21.15.73:0/2298690811 conn(0x7f54680750a0 msgr2=0x7f54680754b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:06.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.386+0000 7f546eb63700 1 -- 172.21.15.73:0/2298690811 shutdown_connections 2023-08-10T11:53:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.386+0000 7f546eb63700 1 -- 172.21.15.73:0/2298690811 wait complete. 2023-08-10T11:53:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.387+0000 7f546eb63700 1 Processor -- start 2023-08-10T11:53:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.387+0000 7f546eb63700 1 -- start start 2023-08-10T11:53:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.387+0000 7f546eb63700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54680ff8d0 0x7f5468196750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.387+0000 7f546eb63700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5468100290 0x7f5468196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.387+0000 7f546eb63700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5468105670 0x7f546819b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.387+0000 7f546eb63700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546819b900 con 0x7f54680ff8d0 2023-08-10T11:53:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.387+0000 7f546eb63700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546819ba70 con 0x7f5468100290 2023-08-10T11:53:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.387+0000 7f546eb63700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546819bc30 con 0x7f5468105670 2023-08-10T11:53:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.387+0000 7f546c8ff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54680ff8d0 0x7f5468196750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.387+0000 7f546c8ff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54680ff8d0 0x7f5468196750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33358/0 (socket says 172.21.15.73:33358) 2023-08-10T11:53:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.387+0000 7f546c8ff700 1 -- 172.21.15.73:0/775685244 learned_addr learned my addr 172.21.15.73:0/775685244 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.387+0000 7f5467fff700 1 --2- 172.21.15.73:0/775685244 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5468100290 0x7f5468196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.387+0000 7f546d100700 1 --2- 172.21.15.73:0/775685244 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5468105670 0x7f546819b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.388+0000 7f546c8ff700 1 -- 172.21.15.73:0/775685244 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5468105670 msgr2=0x7f546819b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.388+0000 7f546c8ff700 1 --2- 172.21.15.73:0/775685244 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5468105670 0x7f546819b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.388+0000 7f546c8ff700 1 -- 172.21.15.73:0/775685244 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5468100290 msgr2=0x7f5468196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:06.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.388+0000 7f546c8ff700 1 --2- 172.21.15.73:0/775685244 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5468100290 0x7f5468196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.388+0000 7f546c8ff700 1 -- 172.21.15.73:0/775685244 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54540095f0 con 0x7f54680ff8d0 2023-08-10T11:53:06.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.388+0000 7f546d100700 1 --2- 172.21.15.73:0/775685244 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5468105670 0x7f546819b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:06.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.388+0000 7f5467fff700 1 --2- 172.21.15.73:0/775685244 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5468100290 0x7f5468196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:53:06.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.388+0000 7f546c8ff700 1 --2- 172.21.15.73:0/775685244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54680ff8d0 0x7f5468196750 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f545c00d980 tx=0x7f545c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:06.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.388+0000 7f5465ffb700 1 -- 172.21.15.73:0/775685244 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c00de60 con 0x7f54680ff8d0 2023-08-10T11:53:06.394 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.388+0000 7f5465ffb700 1 -- 172.21.15.73:0/775685244 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f545c0044e0 con 0x7f54680ff8d0 2023-08-10T11:53:06.394 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.388+0000 7f5465ffb700 1 -- 172.21.15.73:0/775685244 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c003be0 con 0x7f54680ff8d0 2023-08-10T11:53:06.394 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.388+0000 7f546eb63700 1 -- 172.21.15.73:0/775685244 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f546819bf10 con 0x7f54680ff8d0 2023-08-10T11:53:06.394 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.388+0000 7f546eb63700 1 -- 172.21.15.73:0/775685244 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54681a37c0 con 0x7f54680ff8d0 2023-08-10T11:53:06.398 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.391+0000 7f5465ffb700 1 -- 172.21.15.73:0/775685244 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f545c009bb0 con 0x7f54680ff8d0 2023-08-10T11:53:06.398 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.391+0000 7f5465ffb700 1 --2- 172.21.15.73:0/775685244 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f54580a13e0 0x7f54580a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:06.398 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.391+0000 7f5465ffb700 1 -- 172.21.15.73:0/775685244 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f545c0ccd50 con 0x7f54680ff8d0 2023-08-10T11:53:06.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.391+0000 7f5467fff700 1 --2- 172.21.15.73:0/775685244 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f54580a13e0 0x7f54580a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:06.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.392+0000 7f5467fff700 1 --2- 172.21.15.73:0/775685244 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f54580a13e0 0x7f54580a38a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f545400b5c0 tx=0x7f5454005fb0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:06.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.392+0000 7f547acfcb80 1 Processor -- start 2023-08-10T11:53:06.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.392+0000 7f547acfcb80 1 -- start start 2023-08-10T11:53:06.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.392+0000 7f547acfcb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ff123da40 0x558ff123de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:06.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.392+0000 7f547acfcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ff123e360 0x558ff1238010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:06.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.392+0000 7f547acfcb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff1238550 0x558ff12389d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:06.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.392+0000 7f547acfcb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff11b3d60 con 0x558ff1238550 2023-08-10T11:53:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.392+0000 7f547acfcb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff1190530 con 0x558ff123da40 2023-08-10T11:53:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.392+0000 7f547acfcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff118de50 con 0x558ff123e360 2023-08-10T11:53:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.393+0000 7f546d100700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff1238550 0x558ff12389d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.393+0000 7f546d100700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff1238550 0x558ff12389d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33370/0 (socket says 172.21.15.73:33370) 2023-08-10T11:53:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.393+0000 7f5467fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ff123e360 0x558ff1238010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.393+0000 7f546d100700 1 -- 172.21.15.73:0/1225910760 learned_addr learned my addr 172.21.15.73:0/1225910760 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.393+0000 7f546c8ff700 1 --2- 172.21.15.73:0/1225910760 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ff123da40 0x558ff123de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.393+0000 7f546d100700 1 -- 172.21.15.73:0/1225910760 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ff123e360 msgr2=0x558ff1238010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.393+0000 7f546d100700 1 --2- 172.21.15.73:0/1225910760 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ff123e360 0x558ff1238010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.393+0000 7f546d100700 1 -- 172.21.15.73:0/1225910760 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ff123da40 msgr2=0x558ff123de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.393+0000 7f546d100700 1 --2- 172.21.15.73:0/1225910760 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ff123da40 0x558ff123de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.393+0000 7f546d100700 1 -- 172.21.15.73:0/1225910760 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ff100a5d0 con 0x558ff1238550 2023-08-10T11:53:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.393+0000 7f546d100700 1 --2- 172.21.15.73:0/1225910760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff1238550 0x558ff12389d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5460009d50 tx=0x7f54600077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f3a8ff1feb13d7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.393+0000 7f5452ffd700 1 -- 172.21.15.73:0/1225910760 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5460009ea0 con 0x558ff1238550 2023-08-10T11:53:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.393+0000 7f5452ffd700 1 -- 172.21.15.73:0/1225910760 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5460014ac0 con 0x558ff1238550 2023-08-10T11:53:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.393+0000 7f5452ffd700 1 -- 172.21.15.73:0/1225910760 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5460013aa0 con 0x558ff1238550 2023-08-10T11:53:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.394+0000 7f547acfcb80 1 -- 172.21.15.73:0/1225910760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff1238550 msgr2=0x558ff12389d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.394+0000 7f547acfcb80 1 --2- 172.21.15.73:0/1225910760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff1238550 0x558ff12389d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5460009d50 tx=0x7f54600077e0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.394+0000 7f547acfcb80 1 -- 172.21.15.73:0/1225910760 shutdown_connections 2023-08-10T11:53:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.394+0000 7f547acfcb80 1 --2- 172.21.15.73:0/1225910760 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ff123da40 0x558ff123de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.394+0000 7f547acfcb80 1 --2- 172.21.15.73:0/1225910760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff1238550 0x558ff12389d0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.394+0000 7f547acfcb80 1 --2- 172.21.15.73:0/1225910760 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ff123e360 0x558ff1238010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.394+0000 7f547acfcb80 1 -- 172.21.15.73:0/1225910760 >> 172.21.15.73:0/1225910760 conn(0x558ff1195c70 msgr2=0x558ff1232d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.394+0000 7f547acfcb80 1 -- 172.21.15.73:0/1225910760 shutdown_connections 2023-08-10T11:53:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.394+0000 7f547acfcb80 1 -- 172.21.15.73:0/1225910760 wait complete. 2023-08-10T11:53:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.394+0000 7f547acfcb80 1 -- start start 2023-08-10T11:53:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.395+0000 7f547acfcb80 1 Processor -- start 2023-08-10T11:53:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.395+0000 7f547acfcb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff1238550 0x558ff1241720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.395+0000 7f547acfcb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ff123da40 0x558ff1241c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.395+0000 7f547acfcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ff123e360 0x558ff12421a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.395+0000 7f547acfcb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff1189740 con 0x558ff1238550 2023-08-10T11:53:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.395+0000 7f547acfcb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff1128a60 con 0x558ff123da40 2023-08-10T11:53:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.395+0000 7f547acfcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff1128760 con 0x558ff123e360 2023-08-10T11:53:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.395+0000 7f547acfcb80 10 client.0 _ll_register_callbacks cb 0x558ff1126620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.395+0000 7f546c8ff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff1238550 0x558ff1241720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.395+0000 7f546c8ff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff1238550 0x558ff1241720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33372/0 (socket says 172.21.15.73:33372) 2023-08-10T11:53:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.395+0000 7f546c8ff700 1 -- 172.21.15.73:0/458881923 learned_addr learned my addr 172.21.15.73:0/458881923 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.395+0000 7f5467fff700 1 --2- 172.21.15.73:0/458881923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ff123da40 0x558ff1241c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.395+0000 7f546d100700 1 --2- 172.21.15.73:0/458881923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ff123e360 0x558ff12421a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.395+0000 7f546c8ff700 1 -- 172.21.15.73:0/458881923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ff123e360 msgr2=0x558ff12421a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.395+0000 7f546c8ff700 1 --2- 172.21.15.73:0/458881923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ff123e360 0x558ff12421a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.395+0000 7f546c8ff700 1 -- 172.21.15.73:0/458881923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ff123da40 msgr2=0x558ff1241c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.395+0000 7f546c8ff700 1 --2- 172.21.15.73:0/458881923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ff123da40 0x558ff1241c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.395+0000 7f546c8ff700 1 -- 172.21.15.73:0/458881923 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5460009980 con 0x558ff1238550 2023-08-10T11:53:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.396+0000 7f546c8ff700 1 --2- 172.21.15.73:0/458881923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff1238550 0x558ff1241720 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f545c009fd0 tx=0x7f545c099d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3016098f2d43a4f5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:06.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.396+0000 7f5447fff700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:06.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.396+0000 7f5447fff700 1 -- 172.21.15.73:0/458881923 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c0b1070 con 0x558ff1238550 2023-08-10T11:53:06.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.396+0000 7f5447fff700 1 -- 172.21.15.73:0/458881923 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f545c099300 con 0x558ff1238550 2023-08-10T11:53:06.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.396+0000 7f547acfcb80 1 -- 172.21.15.73:0/458881923 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558ff122b1c0 con 0x558ff1238550 2023-08-10T11:53:06.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.396+0000 7f5447fff700 1 -- 172.21.15.73:0/458881923 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f545c0b2220 con 0x558ff1238550 2023-08-10T11:53:06.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.396+0000 7f547acfcb80 10 client.15747 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:06.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.396+0000 7f547acfcb80 1 -- 172.21.15.73:0/458881923 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x558ff0fb6d80 con 0x558ff1238550 2023-08-10T11:53:06.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.396+0000 7f5447fff700 1 -- 172.21.15.73:0/458881923 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f545c0c8020 con 0x558ff1238550 2023-08-10T11:53:06.407 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.396+0000 7f5447fff700 1 -- 172.21.15.73:0/458881923 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f545c0ca6a0 con 0x558ff1238550 2023-08-10T11:53:06.407 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.396+0000 7f547acfcb80 10 client.15747 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:06.407 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.396+0000 7f547acfcb80 10 client.15747 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:53:06.407 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.396+0000 7f547acfcb80 20 client.15747 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:06.407 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.396+0000 7f547acfcb80 1 --2- 172.21.15.73:0/458881923 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x558ff1251dd0 0x558ff12541c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:06.407 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.396+0000 7f547acfcb80 4 client.15747 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:53:06.407 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.396+0000 7f547acfcb80 1 -- 172.21.15.73:0/458881923 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558ff1207970 con 0x558ff1251dd0 2023-08-10T11:53:06.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.397+0000 7f5467fff700 1 --2- 172.21.15.73:0/458881923 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x558ff1251dd0 0x558ff12541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:06.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.397+0000 7f5447fff700 10 client.15747 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:06.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.397+0000 7f5467fff700 1 --2- 172.21.15.73:0/458881923 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x558ff1251dd0 0x558ff12541c0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7160749a218e3f0e server_cookie=b16853edab1d8e51 in_seq=0 out_seq=0 2023-08-10T11:53:06.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.398+0000 7f5447fff700 1 -- 172.21.15.73:0/458881923 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x558ff1207970 con 0x558ff1251dd0 2023-08-10T11:53:06.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.398+0000 7f5447fff700 10 client.15747 handle_command_reply: tid=0 2023-08-10T11:53:06.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.398+0000 7f547acfcb80 1 client.15747 shutdown 2023-08-10T11:53:06.409 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.398+0000 7f547acfcb80 1 -- 172.21.15.73:0/458881923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff1238550 msgr2=0x558ff1241720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:06.409 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.398+0000 7f547acfcb80 1 --2- 172.21.15.73:0/458881923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff1238550 0x558ff1241720 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f545c009fd0 tx=0x7f545c099d40 comp rx=0 tx=0).stop 2023-08-10T11:53:06.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.398+0000 7f547acfcb80 1 -- 172.21.15.73:0/458881923 shutdown_connections 2023-08-10T11:53:06.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.398+0000 7f547acfcb80 1 --2- 172.21.15.73:0/458881923 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x558ff1251dd0 0x558ff12541c0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.398+0000 7f547acfcb80 1 --2- 172.21.15.73:0/458881923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ff123e360 0x558ff12421a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.398+0000 7f547acfcb80 1 --2- 172.21.15.73:0/458881923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff1238550 0x558ff1241720 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.398+0000 7f5447fff700 0 client.15747 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:06.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.398+0000 7f547acfcb80 1 --2- 172.21.15.73:0/458881923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ff123da40 0x558ff1241c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.398+0000 7f547acfcb80 1 -- 172.21.15.73:0/458881923 >> 172.21.15.73:0/458881923 conn(0x558ff1195c70 msgr2=0x558ff12324b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:06.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.398+0000 7f547acfcb80 1 -- 172.21.15.73:0/458881923 shutdown_connections 2023-08-10T11:53:06.411 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.398+0000 7f547acfcb80 1 -- 172.21.15.73:0/458881923 wait complete. 2023-08-10T11:53:06.411 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.398+0000 7f547acfcb80 20 client.15747 trim_cache size 0 max 16384 2023-08-10T11:53:06.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.412+0000 7f547acfcb80 1 Processor -- start 2023-08-10T11:53:06.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.412+0000 7f547acfcb80 1 -- start start 2023-08-10T11:53:06.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.413+0000 7f547acfcb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ff1238550 0x558ff1238010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:06.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.413+0000 7f547acfcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ff123da40 0x558ff123d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:06.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.413+0000 7f547acfcb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff123e360 0x558ff1232c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:06.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.413+0000 7f547acfcb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff100c8c0 con 0x558ff123e360 2023-08-10T11:53:06.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.413+0000 7f547acfcb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff12339b0 con 0x558ff1238550 2023-08-10T11:53:06.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.413+0000 7f547acfcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff1233c10 con 0x558ff123da40 2023-08-10T11:53:06.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.413+0000 7f546d100700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff123e360 0x558ff1232c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:06.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.413+0000 7f546d100700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff123e360 0x558ff1232c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33384/0 (socket says 172.21.15.73:33384) 2023-08-10T11:53:06.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.413+0000 7f546d100700 1 -- 172.21.15.73:0/3124636482 learned_addr learned my addr 172.21.15.73:0/3124636482 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:06.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.413+0000 7f546c8ff700 1 --2- 172.21.15.73:0/3124636482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ff1238550 0x558ff1238010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:06.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.413+0000 7f5467fff700 1 --2- 172.21.15.73:0/3124636482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ff123da40 0x558ff123d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.413+0000 7f546d100700 1 -- 172.21.15.73:0/3124636482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ff123da40 msgr2=0x558ff123d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.413+0000 7f546d100700 1 --2- 172.21.15.73:0/3124636482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ff123da40 0x558ff123d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.413+0000 7f546d100700 1 -- 172.21.15.73:0/3124636482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ff1238550 msgr2=0x558ff1238010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.413+0000 7f546d100700 1 --2- 172.21.15.73:0/3124636482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ff1238550 0x558ff1238010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.413+0000 7f546d100700 1 -- 172.21.15.73:0/3124636482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ff0f9fc00 con 0x558ff123e360 2023-08-10T11:53:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.413+0000 7f546c8ff700 1 --2- 172.21.15.73:0/3124636482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ff1238550 0x558ff1238010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:53:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.413+0000 7f546d100700 1 --2- 172.21.15.73:0/3124636482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff123e360 0x558ff1232c30 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5460009d20 tx=0x7f54600060a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d43b753dc63bc6c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.413+0000 7f54537fe700 1 -- 172.21.15.73:0/3124636482 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5460009ea0 con 0x558ff123e360 2023-08-10T11:53:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.413+0000 7f54537fe700 1 -- 172.21.15.73:0/3124636482 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f54600148c0 con 0x558ff123e360 2023-08-10T11:53:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.413+0000 7f54537fe700 1 -- 172.21.15.73:0/3124636482 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54600056c0 con 0x558ff123e360 2023-08-10T11:53:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.414+0000 7f547acfcb80 1 -- 172.21.15.73:0/3124636482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff123e360 msgr2=0x558ff1232c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.414+0000 7f547acfcb80 1 --2- 172.21.15.73:0/3124636482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff123e360 0x558ff1232c30 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5460009d20 tx=0x7f54600060a0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.414+0000 7f547acfcb80 1 -- 172.21.15.73:0/3124636482 shutdown_connections 2023-08-10T11:53:06.420 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.414+0000 7f547acfcb80 1 --2- 172.21.15.73:0/3124636482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ff1238550 0x558ff1238010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.420 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.414+0000 7f547acfcb80 1 --2- 172.21.15.73:0/3124636482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff123e360 0x558ff1232c30 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.420 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.414+0000 7f547acfcb80 1 --2- 172.21.15.73:0/3124636482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ff123da40 0x558ff123d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.420 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.414+0000 7f547acfcb80 1 -- 172.21.15.73:0/3124636482 >> 172.21.15.73:0/3124636482 conn(0x558ff1195c70 msgr2=0x558ff123ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:06.420 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.414+0000 7f547acfcb80 1 -- 172.21.15.73:0/3124636482 shutdown_connections 2023-08-10T11:53:06.420 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.414+0000 7f547acfcb80 1 -- 172.21.15.73:0/3124636482 wait complete. 2023-08-10T11:53:06.420 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.414+0000 7f547acfcb80 1 -- start start 2023-08-10T11:53:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.415+0000 7f547acfcb80 1 Processor -- start 2023-08-10T11:53:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.415+0000 7f547acfcb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff1238550 0x558ff1247440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.415+0000 7f547acfcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ff123da40 0x558ff1247980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.415+0000 7f547acfcb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ff123e360 0x558ff1247ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.415+0000 7f547acfcb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff12a5ae0 con 0x558ff1238550 2023-08-10T11:53:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.415+0000 7f547acfcb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff12a5c50 con 0x558ff123e360 2023-08-10T11:53:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.415+0000 7f547acfcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff12a5e10 con 0x558ff123da40 2023-08-10T11:53:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.415+0000 7f547acfcb80 10 client.0 _ll_register_callbacks cb 0x558ff1126620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.415+0000 7f546c8ff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff1238550 0x558ff1247440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.415+0000 7f546c8ff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff1238550 0x558ff1247440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33386/0 (socket says 172.21.15.73:33386) 2023-08-10T11:53:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.415+0000 7f546c8ff700 1 -- 172.21.15.73:0/3509589560 learned_addr learned my addr 172.21.15.73:0/3509589560 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.415+0000 7f5467fff700 1 --2- 172.21.15.73:0/3509589560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ff123da40 0x558ff1247980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.415+0000 7f546c8ff700 1 -- 172.21.15.73:0/3509589560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ff123da40 msgr2=0x558ff1247980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.415+0000 7f546c8ff700 1 --2- 172.21.15.73:0/3509589560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ff123da40 0x558ff1247980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.415+0000 7f546c8ff700 1 -- 172.21.15.73:0/3509589560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ff123e360 msgr2=0x558ff1247ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.415+0000 7f546c8ff700 1 --2- 172.21.15.73:0/3509589560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ff123e360 0x558ff1247ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.415+0000 7f546c8ff700 1 -- 172.21.15.73:0/3509589560 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558ff100a5d0 con 0x558ff1238550 2023-08-10T11:53:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.416+0000 7f546c8ff700 1 --2- 172.21.15.73:0/3509589560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff1238550 0x558ff1247440 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f545c0ca460 tx=0x7f545c009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99437dcbd6e429b9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.416+0000 7f5447fff700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.416+0000 7f5447fff700 1 -- 172.21.15.73:0/3509589560 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c0b1030 con 0x558ff1238550 2023-08-10T11:53:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.416+0000 7f5447fff700 1 -- 172.21.15.73:0/3509589560 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f545c0b2070 con 0x558ff1238550 2023-08-10T11:53:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.416+0000 7f547acfcb80 1 -- 172.21.15.73:0/3509589560 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5460014ac0 con 0x558ff1238550 2023-08-10T11:53:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.416+0000 7f5447fff700 1 -- 172.21.15.73:0/3509589560 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f545c0ca290 con 0x558ff1238550 2023-08-10T11:53:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.416+0000 7f547acfcb80 10 client.15753 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.416+0000 7f547acfcb80 1 -- 172.21.15.73:0/3509589560 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x558ff0fdd1f0 con 0x558ff1238550 2023-08-10T11:53:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.416+0000 7f5447fff700 1 -- 172.21.15.73:0/3509589560 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5460014ac0 con 0x558ff1238550 2023-08-10T11:53:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.416+0000 7f5447fff700 1 -- 172.21.15.73:0/3509589560 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f545c0ca6c0 con 0x558ff1238550 2023-08-10T11:53:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.416+0000 7f547acfcb80 10 client.15753 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.416+0000 7f547acfcb80 10 client.15753 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:53:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.416+0000 7f547acfcb80 20 client.15753 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.416+0000 7f547acfcb80 1 --2- 172.21.15.73:0/3509589560 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x558ff12a7300 0x558ff12a9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.416+0000 7f547acfcb80 4 client.15753 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:53:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.416+0000 7f547acfcb80 1 -- 172.21.15.73:0/3509589560 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558ff1182720 con 0x558ff12a7300 2023-08-10T11:53:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.417+0000 7f5467fff700 1 --2- 172.21.15.73:0/3509589560 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x558ff12a7300 0x558ff12a9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.417+0000 7f5467fff700 1 --2- 172.21.15.73:0/3509589560 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x558ff12a7300 0x558ff12a9720 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=caa68718cb47f6f0 server_cookie=1184bb63fc42aa87 in_seq=0 out_seq=0 2023-08-10T11:53:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.417+0000 7f5447fff700 10 client.15753 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:06.426 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.425+0000 7f5447fff700 1 -- 172.21.15.73:0/3509589560 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558ff1182720 con 0x558ff12a7300 2023-08-10T11:53:06.426 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.425+0000 7f5447fff700 10 client.15753 handle_command_reply: tid=0 2023-08-10T11:53:06.426 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.425+0000 7f547acfcb80 1 client.15753 shutdown 2023-08-10T11:53:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.425+0000 7f547acfcb80 1 -- 172.21.15.73:0/3509589560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff1238550 msgr2=0x558ff1247440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.425+0000 7f547acfcb80 1 --2- 172.21.15.73:0/3509589560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff1238550 0x558ff1247440 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f545c0ca460 tx=0x7f545c009a10 comp rx=0 tx=0).stop 2023-08-10T11:53:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.425+0000 7f547acfcb80 1 -- 172.21.15.73:0/3509589560 shutdown_connections 2023-08-10T11:53:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.425+0000 7f547acfcb80 1 --2- 172.21.15.73:0/3509589560 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x558ff12a7300 0x558ff12a9720 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.425+0000 7f547acfcb80 1 --2- 172.21.15.73:0/3509589560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558ff123e360 0x558ff1247ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.425+0000 7f547acfcb80 1 --2- 172.21.15.73:0/3509589560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ff1238550 0x558ff1247440 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.425+0000 7f5447fff700 0 client.15753 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:06.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.425+0000 7f547acfcb80 1 --2- 172.21.15.73:0/3509589560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ff123da40 0x558ff1247980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.425+0000 7f547acfcb80 1 -- 172.21.15.73:0/3509589560 >> 172.21.15.73:0/3509589560 conn(0x558ff1195c70 msgr2=0x558ff123efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:06.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.425+0000 7f547acfcb80 1 -- 172.21.15.73:0/3509589560 shutdown_connections 2023-08-10T11:53:06.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.425+0000 7f547acfcb80 1 -- 172.21.15.73:0/3509589560 wait complete. 2023-08-10T11:53:06.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.425+0000 7f547acfcb80 20 client.15753 trim_cache size 0 max 16384 2023-08-10T11:53:06.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:53:06.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:53:06.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:53:06.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:53:06.430 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.426+0000 7f546eb63700 1 -- 172.21.15.73:0/775685244 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f54580a13e0 msgr2=0x7f54580a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:06.430 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.426+0000 7f546eb63700 1 --2- 172.21.15.73:0/775685244 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f54580a13e0 0x7f54580a38a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f545400b5c0 tx=0x7f5454005fb0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.430 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.426+0000 7f546eb63700 1 -- 172.21.15.73:0/775685244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54680ff8d0 msgr2=0x7f5468196750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:06.430 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.426+0000 7f546eb63700 1 --2- 172.21.15.73:0/775685244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54680ff8d0 0x7f5468196750 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f545c00d980 tx=0x7f545c00dd40 comp rx=0 tx=0).stop 2023-08-10T11:53:06.430 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.426+0000 7f546eb63700 1 -- 172.21.15.73:0/775685244 shutdown_connections 2023-08-10T11:53:06.430 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.426+0000 7f546eb63700 1 --2- 172.21.15.73:0/775685244 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f54580a13e0 0x7f54580a38a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.430 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.426+0000 7f546eb63700 1 --2- 172.21.15.73:0/775685244 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5468105670 0x7f546819b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.431 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.426+0000 7f546eb63700 1 --2- 172.21.15.73:0/775685244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54680ff8d0 0x7f5468196750 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.431 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.426+0000 7f546eb63700 1 --2- 172.21.15.73:0/775685244 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5468100290 0x7f5468196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:06.431 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.426+0000 7f546eb63700 1 -- 172.21.15.73:0/775685244 >> 172.21.15.73:0/775685244 conn(0x7f54680750a0 msgr2=0x7f54680fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:06.431 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.426+0000 7f546eb63700 1 -- 172.21.15.73:0/775685244 shutdown_connections 2023-08-10T11:53:06.431 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:06.426+0000 7f546eb63700 1 -- 172.21.15.73:0/775685244 wait complete. 2023-08-10T11:53:06.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:06 smithi152 ceph-mon[130220]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 30 op/s 2023-08-10T11:53:07.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:06 smithi156 ceph-mon[130574]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 30 op/s 2023-08-10T11:53:07.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:06 smithi073 ceph-mon[128869]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 30 op/s 2023-08-10T11:53:08.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:08 smithi152 ceph-mon[130220]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2023-08-10T11:53:09.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:08 smithi156 ceph-mon[130574]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2023-08-10T11:53:09.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:08 smithi073 ceph-mon[128869]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2023-08-10T11:53:10.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:10 smithi152 ceph-mon[130220]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 28 op/s 2023-08-10T11:53:11.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:10 smithi156 ceph-mon[130574]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 28 op/s 2023-08-10T11:53:11.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:10 smithi073 ceph-mon[128869]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 28 op/s 2023-08-10T11:53:12.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:12 smithi152 ceph-mon[130220]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 24 op/s 2023-08-10T11:53:13.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:12 smithi156 ceph-mon[130574]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 24 op/s 2023-08-10T11:53:13.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:12 smithi073 ceph-mon[128869]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 24 op/s 2023-08-10T11:53:14.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:14 smithi152 ceph-mon[130220]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 24 op/s 2023-08-10T11:53:15.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:14 smithi156 ceph-mon[130574]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 24 op/s 2023-08-10T11:53:15.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:14 smithi073 ceph-mon[128869]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 24 op/s 2023-08-10T11:53:16.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:16 smithi152 ceph-mon[130220]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 KiB/s wr, 28 op/s 2023-08-10T11:53:17.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:16 smithi156 ceph-mon[130574]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 KiB/s wr, 28 op/s 2023-08-10T11:53:17.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:16 smithi073 ceph-mon[128869]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 KiB/s wr, 28 op/s 2023-08-10T11:53:18.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:18 smithi152 ceph-mon[130220]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2023-08-10T11:53:19.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:18 smithi156 ceph-mon[130574]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2023-08-10T11:53:19.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:18 smithi073 ceph-mon[128869]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2023-08-10T11:53:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.585+0000 7f8010c64700 1 -- 172.21.15.73:0/3936649973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800c104940 msgr2=0x7f800c10c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.585+0000 7f8010c64700 1 --2- 172.21.15.73:0/3936649973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800c104940 0x7f800c10c550 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f800400b0a0 tx=0x7f800400b3b0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.585+0000 7f8010c64700 1 -- 172.21.15.73:0/3936649973 shutdown_connections 2023-08-10T11:53:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.585+0000 7f8010c64700 1 --2- 172.21.15.73:0/3936649973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800c104940 0x7f800c10c550 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.585+0000 7f8010c64700 1 --2- 172.21.15.73:0/3936649973 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f800c0fff90 0x7f800c100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.585+0000 7f8010c64700 1 --2- 172.21.15.73:0/3936649973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f800c100940 0x7f800c104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.585+0000 7f8010c64700 1 -- 172.21.15.73:0/3936649973 >> 172.21.15.73:0/3936649973 conn(0x7f800c076b40 msgr2=0x7f800c0fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.585+0000 7f8010c64700 1 -- 172.21.15.73:0/3936649973 shutdown_connections 2023-08-10T11:53:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.585+0000 7f8010c64700 1 -- 172.21.15.73:0/3936649973 wait complete. 2023-08-10T11:53:19.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.586+0000 7f8010c64700 1 Processor -- start 2023-08-10T11:53:19.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.586+0000 7f8010c64700 1 -- start start 2023-08-10T11:53:19.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.587+0000 7f8010c64700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f800c0fff90 0x7f800c19c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:19.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.587+0000 7f8010c64700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f800c104940 0x7f800c19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:19.590 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.587+0000 7f8010c64700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800c196710 0x7f800c196bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:19.590 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.587+0000 7f8010c64700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c197190 con 0x7f800c196710 2023-08-10T11:53:19.590 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.587+0000 7f8010c64700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c1972d0 con 0x7f800c104940 2023-08-10T11:53:19.590 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.587+0000 7f8010c64700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c197490 con 0x7f800c0fff90 2023-08-10T11:53:19.590 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.587+0000 7f800ad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800c196710 0x7f800c196bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:19.590 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.587+0000 7f800ad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800c196710 0x7f800c196bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33404/0 (socket says 172.21.15.73:33404) 2023-08-10T11:53:19.590 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.587+0000 7f800ad9d700 1 -- 172.21.15.73:0/4189564276 learned_addr learned my addr 172.21.15.73:0/4189564276 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:19.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.587+0000 7f800a59c700 1 --2- 172.21.15.73:0/4189564276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f800c0fff90 0x7f800c19c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:19.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.587+0000 7f8009d9b700 1 --2- 172.21.15.73:0/4189564276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f800c104940 0x7f800c19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:19.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.587+0000 7f800ad9d700 1 -- 172.21.15.73:0/4189564276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f800c0fff90 msgr2=0x7f800c19c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:19.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.587+0000 7f800ad9d700 1 --2- 172.21.15.73:0/4189564276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f800c0fff90 0x7f800c19c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.587+0000 7f800ad9d700 1 -- 172.21.15.73:0/4189564276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f800c104940 msgr2=0x7f800c19cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.587+0000 7f800ad9d700 1 --2- 172.21.15.73:0/4189564276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f800c104940 0x7f800c19cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.587+0000 7f800ad9d700 1 -- 172.21.15.73:0/4189564276 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8004009d00 con 0x7f800c196710 2023-08-10T11:53:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.587+0000 7f800ad9d700 1 --2- 172.21.15.73:0/4189564276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800c196710 0x7f800c196bc0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f800400d010 tx=0x7f80040079b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.588+0000 7f7ffb7fe700 1 -- 172.21.15.73:0/4189564276 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800400e040 con 0x7f800c196710 2023-08-10T11:53:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.588+0000 7f8010c64700 1 -- 172.21.15.73:0/4189564276 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f800c10cbd0 con 0x7f800c196710 2023-08-10T11:53:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.588+0000 7f8010c64700 1 -- 172.21.15.73:0/4189564276 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800c10d100 con 0x7f800c196710 2023-08-10T11:53:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.588+0000 7f7ffb7fe700 1 -- 172.21.15.73:0/4189564276 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f800400bde0 con 0x7f800c196710 2023-08-10T11:53:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.588+0000 7f7ffb7fe700 1 -- 172.21.15.73:0/4189564276 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800401dea0 con 0x7f800c196710 2023-08-10T11:53:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.592+0000 7f7ffb7fe700 1 -- 172.21.15.73:0/4189564276 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f8004004c50 con 0x7f800c196710 2023-08-10T11:53:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.592+0000 7f7ffb7fe700 1 --2- 172.21.15.73:0/4189564276 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f7ff40a13e0 0x7f7ff40a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.592+0000 7f801cdfdb80 1 Processor -- start 2023-08-10T11:53:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.592+0000 7f7ffb7fe700 1 -- 172.21.15.73:0/4189564276 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f80040ce330 con 0x7f800c196710 2023-08-10T11:53:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.593+0000 7f801cdfdb80 1 -- start start 2023-08-10T11:53:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.593+0000 7f800a59c700 1 --2- 172.21.15.73:0/4189564276 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f7ff40a13e0 0x7f7ff40a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.593+0000 7f801cdfdb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e81216a40 0x561e81216e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.593+0000 7f801cdfdb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561e81217360 0x561e81211010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.593+0000 7f801cdfdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e81211550 0x561e812119d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.593+0000 7f801cdfdb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e8118cd60 con 0x561e81216a40 2023-08-10T11:53:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.593+0000 7f801cdfdb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e81169530 con 0x561e81217360 2023-08-10T11:53:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.593+0000 7f801cdfdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e81166e50 con 0x561e81211550 2023-08-10T11:53:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.593+0000 7f800ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e81211550 0x561e812119d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.593+0000 7f800ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e81211550 0x561e812119d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:58914/0 (socket says 172.21.15.73:58914) 2023-08-10T11:53:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.593+0000 7f800ad9d700 1 -- 172.21.15.73:0/4227620593 learned_addr learned my addr 172.21.15.73:0/4227620593 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.593+0000 7f800a59c700 1 --2- 172.21.15.73:0/4227620593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e81216a40 0x561e81216e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.594+0000 7f800a59c700 1 --2- 172.21.15.73:0/4189564276 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f7ff40a13e0 0x7f7ff40a38a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc009d80 tx=0x7f7ffc0098c0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.594+0000 7f8009d9b700 1 --2- 172.21.15.73:0/4227620593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561e81217360 0x561e81211010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.594+0000 7f800ad9d700 1 -- 172.21.15.73:0/4227620593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561e81217360 msgr2=0x561e81211010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.594+0000 7f800ad9d700 1 --2- 172.21.15.73:0/4227620593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561e81217360 0x561e81211010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.594+0000 7f800ad9d700 1 -- 172.21.15.73:0/4227620593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e81216a40 msgr2=0x561e81216e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.594+0000 7f800ad9d700 1 --2- 172.21.15.73:0/4227620593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e81216a40 0x561e81216e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.594+0000 7f800ad9d700 1 -- 172.21.15.73:0/4227620593 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e80fe35d0 con 0x561e81211550 2023-08-10T11:53:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.594+0000 7f800ad9d700 1 --2- 172.21.15.73:0/4227620593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e81211550 0x561e812119d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8004007a20 tx=0x7f800409b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1d994d6401293b8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.594+0000 7f7ff8ff9700 1 -- 172.21.15.73:0/4227620593 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80040a1110 con 0x561e81211550 2023-08-10T11:53:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.594+0000 7f7ff8ff9700 1 -- 172.21.15.73:0/4227620593 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f800409b270 con 0x561e81211550 2023-08-10T11:53:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.594+0000 7f7ff8ff9700 1 -- 172.21.15.73:0/4227620593 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800409b730 con 0x561e81211550 2023-08-10T11:53:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.595+0000 7f801cdfdb80 1 -- 172.21.15.73:0/4227620593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e81211550 msgr2=0x561e812119d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.595+0000 7f801cdfdb80 1 --2- 172.21.15.73:0/4227620593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e81211550 0x561e812119d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8004007a20 tx=0x7f800409b040 comp rx=0 tx=0).stop 2023-08-10T11:53:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.595+0000 7f801cdfdb80 1 -- 172.21.15.73:0/4227620593 shutdown_connections 2023-08-10T11:53:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.595+0000 7f801cdfdb80 1 --2- 172.21.15.73:0/4227620593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e81211550 0x561e812119d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.595+0000 7f801cdfdb80 1 --2- 172.21.15.73:0/4227620593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e81216a40 0x561e81216e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.595+0000 7f801cdfdb80 1 --2- 172.21.15.73:0/4227620593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561e81217360 0x561e81211010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.595+0000 7f801cdfdb80 1 -- 172.21.15.73:0/4227620593 >> 172.21.15.73:0/4227620593 conn(0x561e8116ec70 msgr2=0x561e8120bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.595+0000 7f801cdfdb80 1 -- 172.21.15.73:0/4227620593 shutdown_connections 2023-08-10T11:53:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.595+0000 7f801cdfdb80 1 -- 172.21.15.73:0/4227620593 wait complete. 2023-08-10T11:53:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.596+0000 7f801cdfdb80 1 -- start start 2023-08-10T11:53:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.596+0000 7f801cdfdb80 1 Processor -- start 2023-08-10T11:53:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.596+0000 7f801cdfdb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561e81211550 0x561e8121d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:19.610 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.596+0000 7f801cdfdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e81216a40 0x561e8121a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:19.610 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.596+0000 7f801cdfdb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e81217360 0x561e8121ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:19.610 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.596+0000 7f801cdfdb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e81162740 con 0x561e81217360 2023-08-10T11:53:19.610 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.596+0000 7f801cdfdb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e81101a60 con 0x561e81211550 2023-08-10T11:53:19.610 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.596+0000 7f801cdfdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e81101760 con 0x561e81216a40 2023-08-10T11:53:19.610 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.596+0000 7f801cdfdb80 10 client.0 _ll_register_callbacks cb 0x561e810ff620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:19.610 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.596+0000 7f800a59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561e81211550 0x561e8121d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:19.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.596+0000 7f800ad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e81217360 0x561e8121ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:19.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.596+0000 7f800ad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e81217360 0x561e8121ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33418/0 (socket says 172.21.15.73:33418) 2023-08-10T11:53:19.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.597+0000 7f800ad9d700 1 -- 172.21.15.73:0/4253013823 learned_addr learned my addr 172.21.15.73:0/4253013823 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:19.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.597+0000 7f8009d9b700 1 --2- 172.21.15.73:0/4253013823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e81216a40 0x561e8121a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:19.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.597+0000 7f800ad9d700 1 -- 172.21.15.73:0/4253013823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e81216a40 msgr2=0x561e8121a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:19.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.597+0000 7f800ad9d700 1 --2- 172.21.15.73:0/4253013823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e81216a40 0x561e8121a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.597+0000 7f800ad9d700 1 -- 172.21.15.73:0/4253013823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561e81211550 msgr2=0x561e8121d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:19.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.597+0000 7f800ad9d700 1 --2- 172.21.15.73:0/4253013823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561e81211550 0x561e8121d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.612 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.597+0000 7f800ad9d700 1 -- 172.21.15.73:0/4253013823 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800c10d100 con 0x561e81217360 2023-08-10T11:53:19.612 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.597+0000 7f800ad9d700 1 --2- 172.21.15.73:0/4253013823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e81217360 0x561e8121ab90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f80040a3100 tx=0x7f800409a990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cdc30024437e9f3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:19.612 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.597+0000 7f7ff1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:19.612 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.597+0000 7f7ff1ffb700 1 -- 172.21.15.73:0/4253013823 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80040b7070 con 0x561e81217360 2023-08-10T11:53:19.612 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.597+0000 7f7ff1ffb700 1 -- 172.21.15.73:0/4253013823 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f800409f2a0 con 0x561e81217360 2023-08-10T11:53:19.612 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.597+0000 7f801cdfdb80 1 -- 172.21.15.73:0/4253013823 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561e812041c0 con 0x561e81217360 2023-08-10T11:53:19.612 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.597+0000 7f7ff1ffb700 1 -- 172.21.15.73:0/4253013823 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80040a1110 con 0x561e81217360 2023-08-10T11:53:19.613 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.597+0000 7f801cdfdb80 10 client.15765 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:19.613 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.597+0000 7f801cdfdb80 1 -- 172.21.15.73:0/4253013823 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561e80f8fd80 con 0x561e81217360 2023-08-10T11:53:19.613 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.598+0000 7f7ff1ffb700 1 -- 172.21.15.73:0/4253013823 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561e812041c0 con 0x561e81217360 2023-08-10T11:53:19.613 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.598+0000 7f7ff1ffb700 1 -- 172.21.15.73:0/4253013823 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f80040a3230 con 0x561e81217360 2023-08-10T11:53:19.613 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.598+0000 7f801cdfdb80 10 client.15765 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:19.613 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.598+0000 7f801cdfdb80 10 client.15765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:53:19.613 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.598+0000 7f801cdfdb80 20 client.15765 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:19.613 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.598+0000 7f801cdfdb80 1 --2- 172.21.15.73:0/4253013823 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561e8123b600 0x561e8123d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:19.614 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.598+0000 7f801cdfdb80 4 client.15765 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:53:19.614 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.598+0000 7f801cdfdb80 1 -- 172.21.15.73:0/4253013823 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561e811e0970 con 0x561e8123b600 2023-08-10T11:53:19.614 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.598+0000 7f800a59c700 1 --2- 172.21.15.73:0/4253013823 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561e8123b600 0x561e8123d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:19.614 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.599+0000 7f7ff1ffb700 10 client.15765 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:19.614 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.599+0000 7f800a59c700 1 --2- 172.21.15.73:0/4253013823 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561e8123b600 0x561e8123d9f0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f5599089c0fa276 server_cookie=397e8e26615388e7 in_seq=0 out_seq=0 2023-08-10T11:53:19.616 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.599+0000 7f7ff1ffb700 1 -- 172.21.15.73:0/4253013823 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x561e811e0970 con 0x561e8123b600 2023-08-10T11:53:19.616 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.599+0000 7f7ff1ffb700 10 client.15765 handle_command_reply: tid=0 2023-08-10T11:53:19.616 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.599+0000 7f801cdfdb80 1 client.15765 shutdown 2023-08-10T11:53:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.600+0000 7f801cdfdb80 1 -- 172.21.15.73:0/4253013823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e81217360 msgr2=0x561e8121ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.600+0000 7f801cdfdb80 1 --2- 172.21.15.73:0/4253013823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e81217360 0x561e8121ab90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f80040a3100 tx=0x7f800409a990 comp rx=0 tx=0).stop 2023-08-10T11:53:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.600+0000 7f801cdfdb80 1 -- 172.21.15.73:0/4253013823 shutdown_connections 2023-08-10T11:53:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.600+0000 7f801cdfdb80 1 --2- 172.21.15.73:0/4253013823 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561e8123b600 0x561e8123d9f0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.600+0000 7f801cdfdb80 1 --2- 172.21.15.73:0/4253013823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561e81211550 0x561e8121d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.600+0000 7f801cdfdb80 1 --2- 172.21.15.73:0/4253013823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e81217360 0x561e8121ab90 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.600+0000 7f801cdfdb80 1 --2- 172.21.15.73:0/4253013823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e81216a40 0x561e8121a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.600+0000 7f7ff1ffb700 0 client.15765 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.600+0000 7f801cdfdb80 1 -- 172.21.15.73:0/4253013823 >> 172.21.15.73:0/4253013823 conn(0x561e8116ec70 msgr2=0x561e8120b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.600+0000 7f801cdfdb80 1 -- 172.21.15.73:0/4253013823 shutdown_connections 2023-08-10T11:53:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.600+0000 7f801cdfdb80 1 -- 172.21.15.73:0/4253013823 wait complete. 2023-08-10T11:53:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.600+0000 7f801cdfdb80 20 client.15765 trim_cache size 0 max 16384 2023-08-10T11:53:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.614+0000 7f801cdfdb80 1 Processor -- start 2023-08-10T11:53:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.614+0000 7f801cdfdb80 1 -- start start 2023-08-10T11:53:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.615+0000 7f801cdfdb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e81211550 0x561e81211010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:19.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.615+0000 7f801cdfdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e81216a40 0x561e81215f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:19.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.615+0000 7f801cdfdb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561e81217360 0x561e81232c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:19.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.615+0000 7f801cdfdb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e80fe58c0 con 0x561e81211550 2023-08-10T11:53:19.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.615+0000 7f801cdfdb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e8121b670 con 0x561e81217360 2023-08-10T11:53:19.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.615+0000 7f801cdfdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e81204070 con 0x561e81216a40 2023-08-10T11:53:19.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.615+0000 7f800a59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e81211550 0x561e81211010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:19.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.615+0000 7f800a59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e81211550 0x561e81211010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33422/0 (socket says 172.21.15.73:33422) 2023-08-10T11:53:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.615+0000 7f800a59c700 1 -- 172.21.15.73:0/3733631748 learned_addr learned my addr 172.21.15.73:0/3733631748 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.615+0000 7f800ad9d700 1 --2- 172.21.15.73:0/3733631748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561e81217360 0x561e81232c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.615+0000 7f8009d9b700 1 --2- 172.21.15.73:0/3733631748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e81216a40 0x561e81215f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.615+0000 7f800a59c700 1 -- 172.21.15.73:0/3733631748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e81216a40 msgr2=0x561e81215f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.615+0000 7f800a59c700 1 --2- 172.21.15.73:0/3733631748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e81216a40 0x561e81215f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.615+0000 7f800a59c700 1 -- 172.21.15.73:0/3733631748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561e81217360 msgr2=0x561e81232c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.615+0000 7f800a59c700 1 --2- 172.21.15.73:0/3733631748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561e81217360 0x561e81232c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.615+0000 7f800a59c700 1 -- 172.21.15.73:0/3733631748 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e80f78c00 con 0x561e81211550 2023-08-10T11:53:19.621 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.615+0000 7f8009d9b700 1 --2- 172.21.15.73:0/3733631748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e81216a40 0x561e81215f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:53:19.621 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.615+0000 7f800a59c700 1 --2- 172.21.15.73:0/3733631748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e81211550 0x561e81211010 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc009fd0 tx=0x7f7ffc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e05f4b0f9f01115 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:19.621 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.616+0000 7f7ff97fa700 1 -- 172.21.15.73:0/3733631748 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc031070 con 0x561e81211550 2023-08-10T11:53:19.621 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.616+0000 7f7ff97fa700 1 -- 172.21.15.73:0/3733631748 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ffc023040 con 0x561e81211550 2023-08-10T11:53:19.621 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.616+0000 7f7ff97fa700 1 -- 172.21.15.73:0/3733631748 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc022040 con 0x561e81211550 2023-08-10T11:53:19.623 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.616+0000 7f801cdfdb80 1 -- 172.21.15.73:0/3733631748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e81211550 msgr2=0x561e81211010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:19.623 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.616+0000 7f801cdfdb80 1 --2- 172.21.15.73:0/3733631748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e81211550 0x561e81211010 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc009fd0 tx=0x7f7ffc016000 comp rx=0 tx=0).stop 2023-08-10T11:53:19.623 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.617+0000 7f801cdfdb80 1 -- 172.21.15.73:0/3733631748 shutdown_connections 2023-08-10T11:53:19.624 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.617+0000 7f801cdfdb80 1 --2- 172.21.15.73:0/3733631748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561e81217360 0x561e81232c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.624 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.617+0000 7f801cdfdb80 1 --2- 172.21.15.73:0/3733631748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e81211550 0x561e81211010 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.624 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.617+0000 7f801cdfdb80 1 --2- 172.21.15.73:0/3733631748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e81216a40 0x561e81215f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.624 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.617+0000 7f801cdfdb80 1 -- 172.21.15.73:0/3733631748 >> 172.21.15.73:0/3733631748 conn(0x561e8116ec70 msgr2=0x561e81217740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:19.624 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.617+0000 7f801cdfdb80 1 -- 172.21.15.73:0/3733631748 shutdown_connections 2023-08-10T11:53:19.624 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.617+0000 7f801cdfdb80 1 -- 172.21.15.73:0/3733631748 wait complete. 2023-08-10T11:53:19.624 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.617+0000 7f801cdfdb80 1 -- start start 2023-08-10T11:53:19.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.617+0000 7f801cdfdb80 1 Processor -- start 2023-08-10T11:53:19.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.617+0000 7f801cdfdb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561e81211550 0x561e812316e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:19.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.617+0000 7f801cdfdb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e81216a40 0x561e81231c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:19.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.617+0000 7f801cdfdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e81217360 0x561e81297a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:19.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.617+0000 7f801cdfdb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e812322f0 con 0x561e81216a40 2023-08-10T11:53:19.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.617+0000 7f801cdfdb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e81297f70 con 0x561e81211550 2023-08-10T11:53:19.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.617+0000 7f801cdfdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e812980b0 con 0x561e81217360 2023-08-10T11:53:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.618+0000 7f801cdfdb80 10 client.0 _ll_register_callbacks cb 0x561e810ff620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.618+0000 7f8009d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e81216a40 0x561e81231c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.618+0000 7f8009d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e81216a40 0x561e81231c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33430/0 (socket says 172.21.15.73:33430) 2023-08-10T11:53:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.618+0000 7f8009d9b700 1 -- 172.21.15.73:0/3421986337 learned_addr learned my addr 172.21.15.73:0/3421986337 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.618+0000 7f800a59c700 1 --2- 172.21.15.73:0/3421986337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561e81211550 0x561e812316e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.618+0000 7f800ad9d700 1 --2- 172.21.15.73:0/3421986337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e81217360 0x561e81297a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.618+0000 7f8009d9b700 1 -- 172.21.15.73:0/3421986337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e81217360 msgr2=0x561e81297a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.618+0000 7f8009d9b700 1 --2- 172.21.15.73:0/3421986337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e81217360 0x561e81297a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.618+0000 7f8009d9b700 1 -- 172.21.15.73:0/3421986337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561e81211550 msgr2=0x561e812316e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:19.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.618+0000 7f8009d9b700 1 --2- 172.21.15.73:0/3421986337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561e81211550 0x561e812316e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.618+0000 7f8009d9b700 1 -- 172.21.15.73:0/3421986337 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ffc019050 con 0x561e81216a40 2023-08-10T11:53:19.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.618+0000 7f8009d9b700 1 --2- 172.21.15.73:0/3421986337 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e81216a40 0x561e81231c20 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f800c102060 tx=0x7f8000010990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8950e75f97cb1880 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:19.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.618+0000 7f7ff1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:19.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.618+0000 7f7ff1ffb700 1 -- 172.21.15.73:0/3421986337 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8000019040 con 0x561e81216a40 2023-08-10T11:53:19.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.618+0000 7f7ff1ffb700 1 -- 172.21.15.73:0/3421986337 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f800000f7d0 con 0x561e81216a40 2023-08-10T11:53:19.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.619+0000 7f801cdfdb80 1 -- 172.21.15.73:0/3421986337 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f800409b270 con 0x561e81216a40 2023-08-10T11:53:19.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.619+0000 7f7ff1ffb700 1 -- 172.21.15.73:0/3421986337 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f800000f990 con 0x561e81216a40 2023-08-10T11:53:19.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.619+0000 7f801cdfdb80 10 client.15771 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:19.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.619+0000 7f801cdfdb80 1 -- 172.21.15.73:0/3421986337 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561e80fb61f0 con 0x561e81216a40 2023-08-10T11:53:19.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.619+0000 7f7ff1ffb700 1 -- 172.21.15.73:0/3421986337 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f800409b270 con 0x561e81216a40 2023-08-10T11:53:19.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.619+0000 7f7ff1ffb700 1 -- 172.21.15.73:0/3421986337 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8000025070 con 0x561e81216a40 2023-08-10T11:53:19.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.619+0000 7f801cdfdb80 10 client.15771 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:19.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.619+0000 7f801cdfdb80 10 client.15771 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:53:19.629 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.619+0000 7f801cdfdb80 20 client.15771 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:19.629 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.619+0000 7f801cdfdb80 1 --2- 172.21.15.73:0/3421986337 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561e81299860 0x561e8129bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:19.629 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.619+0000 7f801cdfdb80 4 client.15771 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:53:19.629 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.619+0000 7f801cdfdb80 1 -- 172.21.15.73:0/3421986337 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561e8115b720 con 0x561e81299860 2023-08-10T11:53:19.629 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.620+0000 7f800a59c700 1 --2- 172.21.15.73:0/3421986337 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561e81299860 0x561e8129bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:19.629 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.620+0000 7f7ff1ffb700 10 client.15771 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:19.629 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.620+0000 7f800a59c700 1 --2- 172.21.15.73:0/3421986337 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561e81299860 0x561e8129bc80 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c75ee10f2edab2 server_cookie=9d76f4a76396dbfb in_seq=0 out_seq=0 2023-08-10T11:53:19.633 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.632+0000 7f7ff1ffb700 1 -- 172.21.15.73:0/3421986337 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561e8115b720 con 0x561e81299860 2023-08-10T11:53:19.633 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.632+0000 7f7ff1ffb700 10 client.15771 handle_command_reply: tid=0 2023-08-10T11:53:19.633 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.632+0000 7f801cdfdb80 1 client.15771 shutdown 2023-08-10T11:53:19.633 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.632+0000 7f801cdfdb80 1 -- 172.21.15.73:0/3421986337 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e81216a40 msgr2=0x561e81231c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:19.634 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.632+0000 7f801cdfdb80 1 --2- 172.21.15.73:0/3421986337 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e81216a40 0x561e81231c20 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f800c102060 tx=0x7f8000010990 comp rx=0 tx=0).stop 2023-08-10T11:53:19.634 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.632+0000 7f801cdfdb80 1 -- 172.21.15.73:0/3421986337 shutdown_connections 2023-08-10T11:53:19.634 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.632+0000 7f801cdfdb80 1 --2- 172.21.15.73:0/3421986337 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561e81299860 0x561e8129bc80 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.634 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.632+0000 7f801cdfdb80 1 --2- 172.21.15.73:0/3421986337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561e81211550 0x561e812316e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.634 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.632+0000 7f801cdfdb80 1 --2- 172.21.15.73:0/3421986337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e81217360 0x561e81297a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.634 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.632+0000 7f801cdfdb80 1 --2- 172.21.15.73:0/3421986337 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561e81216a40 0x561e81231c20 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.634 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.632+0000 7f7ff1ffb700 0 client.15771 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.632+0000 7f801cdfdb80 1 -- 172.21.15.73:0/3421986337 >> 172.21.15.73:0/3421986337 conn(0x561e8116ec70 msgr2=0x561e81215700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.632+0000 7f801cdfdb80 1 -- 172.21.15.73:0/3421986337 shutdown_connections 2023-08-10T11:53:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.632+0000 7f801cdfdb80 1 -- 172.21.15.73:0/3421986337 wait complete. 2023-08-10T11:53:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.633+0000 7f801cdfdb80 20 client.15771 trim_cache size 0 max 16384 2023-08-10T11:53:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:53:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:53:19.636 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:53:19.636 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:53:19.636 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.633+0000 7f8010c64700 1 -- 172.21.15.73:0/4189564276 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f7ff40a13e0 msgr2=0x7f7ff40a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.633+0000 7f8010c64700 1 --2- 172.21.15.73:0/4189564276 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f7ff40a13e0 0x7f7ff40a38a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc009d80 tx=0x7f7ffc0098c0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.633+0000 7f8010c64700 1 -- 172.21.15.73:0/4189564276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800c196710 msgr2=0x7f800c196bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.633+0000 7f8010c64700 1 --2- 172.21.15.73:0/4189564276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800c196710 0x7f800c196bc0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f800400d010 tx=0x7f80040079b0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.633+0000 7f8010c64700 1 -- 172.21.15.73:0/4189564276 shutdown_connections 2023-08-10T11:53:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.633+0000 7f8010c64700 1 --2- 172.21.15.73:0/4189564276 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f7ff40a13e0 0x7f7ff40a38a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.633+0000 7f8010c64700 1 --2- 172.21.15.73:0/4189564276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800c196710 0x7f800c196bc0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.633+0000 7f8010c64700 1 --2- 172.21.15.73:0/4189564276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f800c0fff90 0x7f800c19c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.638 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.633+0000 7f8010c64700 1 --2- 172.21.15.73:0/4189564276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f800c104940 0x7f800c19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:19.638 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.633+0000 7f8010c64700 1 -- 172.21.15.73:0/4189564276 >> 172.21.15.73:0/4189564276 conn(0x7f800c076b40 msgr2=0x7f800c102880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:19.638 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.633+0000 7f8010c64700 1 -- 172.21.15.73:0/4189564276 shutdown_connections 2023-08-10T11:53:19.638 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:19.633+0000 7f8010c64700 1 -- 172.21.15.73:0/4189564276 wait complete. 2023-08-10T11:53:20.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:20 smithi152 ceph-mon[130220]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2023-08-10T11:53:21.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:20 smithi156 ceph-mon[130574]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2023-08-10T11:53:21.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:20 smithi073 ceph-mon[128869]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2023-08-10T11:53:22.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:22 smithi152 ceph-mon[130220]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2023-08-10T11:53:23.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:22 smithi156 ceph-mon[130574]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2023-08-10T11:53:23.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:22 smithi073 ceph-mon[128869]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2023-08-10T11:53:24.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:24 smithi152 ceph-mon[130220]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2023-08-10T11:53:25.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:24 smithi156 ceph-mon[130574]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2023-08-10T11:53:25.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:24 smithi073 ceph-mon[128869]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2023-08-10T11:53:26.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:26 smithi152 ceph-mon[130220]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2023-08-10T11:53:27.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:26 smithi156 ceph-mon[130574]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2023-08-10T11:53:27.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:26 smithi073 ceph-mon[128869]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2023-08-10T11:53:28.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:28 smithi152 ceph-mon[130220]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-08-10T11:53:29.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:28 smithi156 ceph-mon[130574]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-08-10T11:53:29.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:28 smithi073 ceph-mon[128869]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-08-10T11:53:30.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:30 smithi152 ceph-mon[130220]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2023-08-10T11:53:31.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:30 smithi156 ceph-mon[130574]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2023-08-10T11:53:31.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:30 smithi073 ceph-mon[128869]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2023-08-10T11:53:32.801 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.800+0000 7fde7fe51700 1 -- 172.21.15.73:0/1937872089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde78105650 msgr2=0x7fde78105a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:32.802 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.800+0000 7fde7fe51700 1 --2- 172.21.15.73:0/1937872089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde78105650 0x7fde78105a30 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fde74009990 tx=0x7fde74009ca0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.802 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.800+0000 7fde7fe51700 1 -- 172.21.15.73:0/1937872089 shutdown_connections 2023-08-10T11:53:32.802 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.800+0000 7fde7fe51700 1 --2- 172.21.15.73:0/1937872089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde781001c0 0x7fde7810c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.802 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.800+0000 7fde7fe51700 1 --2- 172.21.15.73:0/1937872089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde78105650 0x7fde78105a30 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.800+0000 7fde7fe51700 1 --2- 172.21.15.73:0/1937872089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde780ff800 0x7fde780ffc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.800+0000 7fde7fe51700 1 -- 172.21.15.73:0/1937872089 >> 172.21.15.73:0/1937872089 conn(0x7fde780775a0 msgr2=0x7fde780779b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.800+0000 7fde7fe51700 1 -- 172.21.15.73:0/1937872089 shutdown_connections 2023-08-10T11:53:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.800+0000 7fde7fe51700 1 -- 172.21.15.73:0/1937872089 wait complete. 2023-08-10T11:53:32.804 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.801+0000 7fde7fe51700 1 Processor -- start 2023-08-10T11:53:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.801+0000 7fde7fe51700 1 -- start start 2023-08-10T11:53:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.801+0000 7fde7fe51700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde780ff800 0x7fde78197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.801+0000 7fde7fe51700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde781001c0 0x7fde78197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.801+0000 7fde7fe51700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde78105650 0x7fde781a26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.801+0000 7fde7fe51700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde781a2c80 con 0x7fde780ff800 2023-08-10T11:53:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.801+0000 7fde7fe51700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde781a2df0 con 0x7fde78105650 2023-08-10T11:53:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.801+0000 7fde7fe51700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde781954a0 con 0x7fde781001c0 2023-08-10T11:53:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.801+0000 7fde7dbed700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde780ff800 0x7fde78197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.801+0000 7fde7dbed700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde780ff800 0x7fde78197810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33442/0 (socket says 172.21.15.73:33442) 2023-08-10T11:53:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.801+0000 7fde7dbed700 1 -- 172.21.15.73:0/1838112867 learned_addr learned my addr 172.21.15.73:0/1838112867 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.802+0000 7fde7dbed700 1 -- 172.21.15.73:0/1838112867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde781001c0 msgr2=0x7fde78197d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.802+0000 7fde7dbed700 1 --2- 172.21.15.73:0/1838112867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde781001c0 0x7fde78197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.802+0000 7fde7dbed700 1 -- 172.21.15.73:0/1838112867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde78105650 msgr2=0x7fde781a26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.802+0000 7fde7e3ee700 1 --2- 172.21.15.73:0/1838112867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde78105650 0x7fde781a26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.802+0000 7fde7dbed700 1 --2- 172.21.15.73:0/1838112867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde78105650 0x7fde781a26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.802+0000 7fde7dbed700 1 -- 172.21.15.73:0/1838112867 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde740095f0 con 0x7fde780ff800 2023-08-10T11:53:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.802+0000 7fde7dbed700 1 --2- 172.21.15.73:0/1838112867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde780ff800 0x7fde78197810 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fde74000c00 tx=0x7fde7400f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.802+0000 7fde6effd700 1 -- 172.21.15.73:0/1838112867 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7401d070 con 0x7fde780ff800 2023-08-10T11:53:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.802+0000 7fde7fe51700 1 -- 172.21.15.73:0/1838112867 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde78195780 con 0x7fde780ff800 2023-08-10T11:53:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.802+0000 7fde7fe51700 1 -- 172.21.15.73:0/1838112867 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde78195ce0 con 0x7fde780ff800 2023-08-10T11:53:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.802+0000 7fde6effd700 1 -- 172.21.15.73:0/1838112867 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fde7400fc20 con 0x7fde780ff800 2023-08-10T11:53:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.802+0000 7fde6effd700 1 -- 172.21.15.73:0/1838112867 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7402a3b0 con 0x7fde780ff800 2023-08-10T11:53:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.805+0000 7fde6effd700 1 -- 172.21.15.73:0/1838112867 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7fde740173f0 con 0x7fde780ff800 2023-08-10T11:53:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.806+0000 7fde6effd700 1 --2- 172.21.15.73:0/1838112867 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fde640a13e0 0x7fde640a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.806+0000 7fde7d3ec700 1 --2- 172.21.15.73:0/1838112867 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fde640a13e0 0x7fde640a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.806+0000 7fde6effd700 1 -- 172.21.15.73:0/1838112867 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fde740ce090 con 0x7fde780ff800 2023-08-10T11:53:32.810 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.807+0000 7fde8bfeab80 1 Processor -- start 2023-08-10T11:53:32.810 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.807+0000 7fde7d3ec700 1 --2- 172.21.15.73:0/1838112867 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fde640a13e0 0x7fde640a38a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fde68005950 tx=0x7fde680058e0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:32.810 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.807+0000 7fde8bfeab80 1 -- start start 2023-08-10T11:53:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.807+0000 7fde8bfeab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5b4eeaac0 0x55e5b4eeaea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.807+0000 7fde8bfeab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5b4eec810 0x55e5b4eecc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.807+0000 7fde8bfeab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5b4eed1d0 0x55e5b4ee4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.807+0000 7fde8bfeab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5b4e63d60 con 0x55e5b4eec810 2023-08-10T11:53:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.807+0000 7fde8bfeab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5b4e40530 con 0x55e5b4eed1d0 2023-08-10T11:53:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.807+0000 7fde8bfeab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5b4e3de50 con 0x55e5b4eeaac0 2023-08-10T11:53:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.808+0000 7fde7d3ec700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5b4eec810 0x55e5b4eecc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.808+0000 7fde7d3ec700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5b4eec810 0x55e5b4eecc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33452/0 (socket says 172.21.15.73:33452) 2023-08-10T11:53:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.808+0000 7fde7d3ec700 1 -- 172.21.15.73:0/2268016158 learned_addr learned my addr 172.21.15.73:0/2268016158 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.808+0000 7fde7dbed700 1 --2- 172.21.15.73:0/2268016158 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5b4eeaac0 0x55e5b4eeaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.808+0000 7fde7e3ee700 1 --2- 172.21.15.73:0/2268016158 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5b4eed1d0 0x55e5b4ee4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.808+0000 7fde7d3ec700 1 -- 172.21.15.73:0/2268016158 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5b4eeaac0 msgr2=0x55e5b4eeaea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.808+0000 7fde7d3ec700 1 --2- 172.21.15.73:0/2268016158 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5b4eeaac0 0x55e5b4eeaea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.808+0000 7fde7d3ec700 1 -- 172.21.15.73:0/2268016158 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5b4eed1d0 msgr2=0x55e5b4ee4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.808+0000 7fde7d3ec700 1 --2- 172.21.15.73:0/2268016158 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5b4eed1d0 0x55e5b4ee4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.808+0000 7fde7d3ec700 1 -- 172.21.15.73:0/2268016158 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5b4cba5d0 con 0x55e5b4eec810 2023-08-10T11:53:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.808+0000 7fde7d3ec700 1 --2- 172.21.15.73:0/2268016158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5b4eec810 0x55e5b4eecc90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fde68009270 tx=0x7fde68010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4224b943e96c6274 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.808+0000 7fde63fff700 1 -- 172.21.15.73:0/2268016158 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde68010af0 con 0x55e5b4eec810 2023-08-10T11:53:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.808+0000 7fde63fff700 1 -- 172.21.15.73:0/2268016158 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fde68010c50 con 0x55e5b4eec810 2023-08-10T11:53:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.808+0000 7fde63fff700 1 -- 172.21.15.73:0/2268016158 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6800f3c0 con 0x55e5b4eec810 2023-08-10T11:53:32.815 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.809+0000 7fde8bfeab80 1 -- 172.21.15.73:0/2268016158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5b4eec810 msgr2=0x55e5b4eecc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.809+0000 7fde8bfeab80 1 --2- 172.21.15.73:0/2268016158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5b4eec810 0x55e5b4eecc90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fde68009270 tx=0x7fde68010000 comp rx=0 tx=0).stop 2023-08-10T11:53:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.809+0000 7fde8bfeab80 1 -- 172.21.15.73:0/2268016158 shutdown_connections 2023-08-10T11:53:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.809+0000 7fde8bfeab80 1 --2- 172.21.15.73:0/2268016158 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5b4eed1d0 0x55e5b4ee4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.810+0000 7fde8bfeab80 1 --2- 172.21.15.73:0/2268016158 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5b4eeaac0 0x55e5b4eeaea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.810+0000 7fde8bfeab80 1 --2- 172.21.15.73:0/2268016158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5b4eec810 0x55e5b4eecc90 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.810+0000 7fde8bfeab80 1 -- 172.21.15.73:0/2268016158 >> 172.21.15.73:0/2268016158 conn(0x55e5b4e45c70 msgr2=0x55e5b4ee2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.810+0000 7fde8bfeab80 1 -- 172.21.15.73:0/2268016158 shutdown_connections 2023-08-10T11:53:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.810+0000 7fde8bfeab80 1 -- 172.21.15.73:0/2268016158 wait complete. 2023-08-10T11:53:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.810+0000 7fde8bfeab80 1 -- start start 2023-08-10T11:53:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.810+0000 7fde8bfeab80 1 Processor -- start 2023-08-10T11:53:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.811+0000 7fde8bfeab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5b4eeaac0 0x55e5b4f087a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.811+0000 7fde8bfeab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5b4eec810 0x55e5b4f08ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.811+0000 7fde8bfeab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5b4eed1d0 0x55e5b4f02a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:32.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.811+0000 7fde8bfeab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5b4e39740 con 0x55e5b4eec810 2023-08-10T11:53:32.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.811+0000 7fde8bfeab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5b4dd8a60 con 0x55e5b4eed1d0 2023-08-10T11:53:32.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.811+0000 7fde8bfeab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5b4dd8760 con 0x55e5b4eeaac0 2023-08-10T11:53:32.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.811+0000 7fde8bfeab80 10 client.0 _ll_register_callbacks cb 0x55e5b4dd6620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:32.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.811+0000 7fde7dbed700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5b4eeaac0 0x55e5b4f087a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:32.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.811+0000 7fde7dbed700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5b4eeaac0 0x55e5b4f087a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:58960/0 (socket says 172.21.15.73:58960) 2023-08-10T11:53:32.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.811+0000 7fde7dbed700 1 -- 172.21.15.73:0/2787263576 learned_addr learned my addr 172.21.15.73:0/2787263576 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:32.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.811+0000 7fde7e3ee700 1 --2- 172.21.15.73:0/2787263576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5b4eed1d0 0x55e5b4f02a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:32.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.811+0000 7fde7d3ec700 1 --2- 172.21.15.73:0/2787263576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5b4eec810 0x55e5b4f08ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:32.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.811+0000 7fde7e3ee700 1 -- 172.21.15.73:0/2787263576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5b4eeaac0 msgr2=0x55e5b4f087a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:32.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.811+0000 7fde7e3ee700 1 --2- 172.21.15.73:0/2787263576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5b4eeaac0 0x55e5b4f087a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.811+0000 7fde7e3ee700 1 -- 172.21.15.73:0/2787263576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5b4eec810 msgr2=0x55e5b4f08ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:32.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.811+0000 7fde7e3ee700 1 --2- 172.21.15.73:0/2787263576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5b4eec810 0x55e5b4f08ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.811+0000 7fde7e3ee700 1 -- 172.21.15.73:0/2787263576 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde6800d930 con 0x55e5b4eed1d0 2023-08-10T11:53:32.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.812+0000 7fde7e3ee700 1 --2- 172.21.15.73:0/2787263576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5b4eed1d0 0x55e5b4f02a60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fde70007a80 tx=0x7fde70007d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b34a3450cc440f9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.812+0000 7fde617fa700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T11:53:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.812+0000 7fde617fa700 1 -- 172.21.15.73:0/2787263576 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde70003e10 con 0x55e5b4eed1d0 2023-08-10T11:53:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.812+0000 7fde617fa700 1 -- 172.21.15.73:0/2787263576 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fde70004bb0 con 0x55e5b4eed1d0 2023-08-10T11:53:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.812+0000 7fde8bfeab80 1 -- 172.21.15.73:0/2787263576 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e5b4edb1c0 con 0x55e5b4eed1d0 2023-08-10T11:53:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.812+0000 7fde617fa700 1 -- 172.21.15.73:0/2787263576 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde70004d70 con 0x55e5b4eed1d0 2023-08-10T11:53:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.812+0000 7fde8bfeab80 10 client.25226 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.812+0000 7fde8bfeab80 1 -- 172.21.15.73:0/2787263576 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55e5b4c66d80 con 0x55e5b4eed1d0 2023-08-10T11:53:32.821 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.812+0000 7fde617fa700 1 -- 172.21.15.73:0/2787263576 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e5b4edb1c0 con 0x55e5b4eed1d0 2023-08-10T11:53:32.821 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.813+0000 7fde617fa700 1 -- 172.21.15.73:0/2787263576 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fde700118d0 con 0x55e5b4eed1d0 2023-08-10T11:53:32.821 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.813+0000 7fde8bfeab80 10 client.25226 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:32.821 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.813+0000 7fde8bfeab80 10 client.25226 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:53:32.821 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.813+0000 7fde8bfeab80 20 client.25226 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:32.821 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.813+0000 7fde8bfeab80 1 --2- 172.21.15.73:0/2787263576 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e5b4f12d60 0x55e5b4f15180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:32.821 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.813+0000 7fde8bfeab80 4 client.25226 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:53:32.822 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.813+0000 7fde8bfeab80 1 -- 172.21.15.73:0/2787263576 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e5b4eb7970 con 0x55e5b4f12d60 2023-08-10T11:53:32.822 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.813+0000 7fde7dbed700 1 --2- 172.21.15.73:0/2787263576 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e5b4f12d60 0x55e5b4f15180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:32.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.817+0000 7fde617fa700 10 client.25226 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:32.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.817+0000 7fde7dbed700 1 --2- 172.21.15.73:0/2787263576 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e5b4f12d60 0x55e5b4f15180 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=149dc184afa1563f server_cookie=d3edd71477d3134d in_seq=0 out_seq=0 2023-08-10T11:53:32.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.817+0000 7fde617fa700 1 -- 172.21.15.73:0/2787263576 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55e5b4eb7970 con 0x55e5b4f12d60 2023-08-10T11:53:32.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.817+0000 7fde617fa700 10 client.25226 handle_command_reply: tid=0 2023-08-10T11:53:32.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.817+0000 7fde8bfeab80 1 client.25226 shutdown 2023-08-10T11:53:32.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.818+0000 7fde8bfeab80 1 -- 172.21.15.73:0/2787263576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5b4eed1d0 msgr2=0x55e5b4f02a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:32.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.818+0000 7fde8bfeab80 1 --2- 172.21.15.73:0/2787263576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5b4eed1d0 0x55e5b4f02a60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fde70007a80 tx=0x7fde70007d90 comp rx=0 tx=0).stop 2023-08-10T11:53:32.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.818+0000 7fde8bfeab80 1 -- 172.21.15.73:0/2787263576 shutdown_connections 2023-08-10T11:53:32.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.818+0000 7fde8bfeab80 1 --2- 172.21.15.73:0/2787263576 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e5b4f12d60 0x55e5b4f15180 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.818+0000 7fde8bfeab80 1 --2- 172.21.15.73:0/2787263576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5b4eed1d0 0x55e5b4f02a60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.818+0000 7fde8bfeab80 1 --2- 172.21.15.73:0/2787263576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5b4eeaac0 0x55e5b4f087a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.818+0000 7fde8bfeab80 1 --2- 172.21.15.73:0/2787263576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5b4eec810 0x55e5b4f08ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.818+0000 7fde8bfeab80 1 -- 172.21.15.73:0/2787263576 >> 172.21.15.73:0/2787263576 conn(0x55e5b4e45c70 msgr2=0x55e5b4ee1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.818+0000 7fde617fa700 0 client.25226 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.818+0000 7fde8bfeab80 1 -- 172.21.15.73:0/2787263576 shutdown_connections 2023-08-10T11:53:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.818+0000 7fde8bfeab80 1 -- 172.21.15.73:0/2787263576 wait complete. 2023-08-10T11:53:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.818+0000 7fde8bfeab80 20 client.25226 trim_cache size 0 max 16384 2023-08-10T11:53:32.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.845+0000 7fde8bfeab80 1 Processor -- start 2023-08-10T11:53:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.846+0000 7fde8bfeab80 1 -- start start 2023-08-10T11:53:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.846+0000 7fde8bfeab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5b4eeaac0 0x55e5b4ee4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.846+0000 7fde8bfeab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5b4eec810 0x55e5b4f033f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.846+0000 7fde8bfeab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5b4eed1d0 0x55e5b4f02840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.846+0000 7fde8bfeab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5b4cbc8c0 con 0x55e5b4eeaac0 2023-08-10T11:53:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.846+0000 7fde8bfeab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5b4ee9e10 con 0x55e5b4eed1d0 2023-08-10T11:53:32.849 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.846+0000 7fde8bfeab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5b4ee3ba0 con 0x55e5b4eec810 2023-08-10T11:53:32.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.846+0000 7fde7dbed700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5b4eeaac0 0x55e5b4ee4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:32.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.846+0000 7fde7dbed700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5b4eeaac0 0x55e5b4ee4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33464/0 (socket says 172.21.15.73:33464) 2023-08-10T11:53:32.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.846+0000 7fde7dbed700 1 -- 172.21.15.73:0/207711554 learned_addr learned my addr 172.21.15.73:0/207711554 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:32.851 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.846+0000 7fde7e3ee700 1 --2- 172.21.15.73:0/207711554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5b4eed1d0 0x55e5b4f02840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:32.851 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.846+0000 7fde7dbed700 1 -- 172.21.15.73:0/207711554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5b4eec810 msgr2=0x55e5b4f033f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:32.851 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.846+0000 7fde7dbed700 1 --2- 172.21.15.73:0/207711554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5b4eec810 0x55e5b4f033f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.851 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.846+0000 7fde7dbed700 1 -- 172.21.15.73:0/207711554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5b4eed1d0 msgr2=0x55e5b4f02840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:32.851 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.846+0000 7fde7dbed700 1 --2- 172.21.15.73:0/207711554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5b4eed1d0 0x55e5b4f02840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.851 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.846+0000 7fde7dbed700 1 -- 172.21.15.73:0/207711554 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5b4c4fc00 con 0x55e5b4eeaac0 2023-08-10T11:53:32.851 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.846+0000 7fde7e3ee700 1 --2- 172.21.15.73:0/207711554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5b4eed1d0 0x55e5b4f02840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:32.851 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.847+0000 7fde7dbed700 1 --2- 172.21.15.73:0/207711554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5b4eeaac0 0x55e5b4ee4720 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fde740cb840 tx=0x7fde74009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19af7c4239504eb9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:32.852 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.847+0000 7fde6cff9700 1 -- 172.21.15.73:0/207711554 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7409f0a0 con 0x55e5b4eeaac0 2023-08-10T11:53:32.852 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.847+0000 7fde6cff9700 1 -- 172.21.15.73:0/207711554 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fde740a3430 con 0x55e5b4eeaac0 2023-08-10T11:53:32.852 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.847+0000 7fde6cff9700 1 -- 172.21.15.73:0/207711554 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde740a2fa0 con 0x55e5b4eeaac0 2023-08-10T11:53:32.852 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.848+0000 7fde8bfeab80 1 -- 172.21.15.73:0/207711554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5b4eeaac0 msgr2=0x55e5b4ee4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:32.852 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.848+0000 7fde8bfeab80 1 --2- 172.21.15.73:0/207711554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5b4eeaac0 0x55e5b4ee4720 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fde740cb840 tx=0x7fde74009310 comp rx=0 tx=0).stop 2023-08-10T11:53:32.852 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.848+0000 7fde8bfeab80 1 -- 172.21.15.73:0/207711554 shutdown_connections 2023-08-10T11:53:32.853 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.848+0000 7fde8bfeab80 1 --2- 172.21.15.73:0/207711554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5b4eed1d0 0x55e5b4f02840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.853 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.848+0000 7fde8bfeab80 1 --2- 172.21.15.73:0/207711554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5b4eeaac0 0x55e5b4ee4720 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.853 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.848+0000 7fde8bfeab80 1 --2- 172.21.15.73:0/207711554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5b4eec810 0x55e5b4f033f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.853 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.848+0000 7fde8bfeab80 1 -- 172.21.15.73:0/207711554 >> 172.21.15.73:0/207711554 conn(0x55e5b4e45c70 msgr2=0x55e5b4ee2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:32.853 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.848+0000 7fde8bfeab80 1 -- 172.21.15.73:0/207711554 shutdown_connections 2023-08-10T11:53:32.853 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.848+0000 7fde8bfeab80 1 -- 172.21.15.73:0/207711554 wait complete. 2023-08-10T11:53:32.853 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.848+0000 7fde8bfeab80 1 -- start start 2023-08-10T11:53:32.853 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.849+0000 7fde8bfeab80 1 Processor -- start 2023-08-10T11:53:32.855 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.849+0000 7fde8bfeab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5b4eeaac0 0x55e5b4f06410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:32.855 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.849+0000 7fde8bfeab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5b4eec810 0x55e5b4f06950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:32.855 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.849+0000 7fde8bfeab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5b4eed1d0 0x55e5b4f65a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:32.855 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.849+0000 7fde8bfeab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5b4f070c0 con 0x55e5b4eeaac0 2023-08-10T11:53:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.849+0000 7fde8bfeab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5b4f07230 con 0x55e5b4eed1d0 2023-08-10T11:53:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.849+0000 7fde8bfeab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5b4f65f50 con 0x55e5b4eec810 2023-08-10T11:53:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.849+0000 7fde8bfeab80 10 client.0 _ll_register_callbacks cb 0x55e5b4dd6620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.849+0000 7fde7dbed700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5b4eeaac0 0x55e5b4f06410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.849+0000 7fde7dbed700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5b4eeaac0 0x55e5b4f06410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33470/0 (socket says 172.21.15.73:33470) 2023-08-10T11:53:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.849+0000 7fde7dbed700 1 -- 172.21.15.73:0/2469969357 learned_addr learned my addr 172.21.15.73:0/2469969357 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.850+0000 7fde7dbed700 1 -- 172.21.15.73:0/2469969357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5b4eec810 msgr2=0x55e5b4f06950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:32.857 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.850+0000 7fde7dbed700 1 --2- 172.21.15.73:0/2469969357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5b4eec810 0x55e5b4f06950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.857 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.850+0000 7fde7dbed700 1 -- 172.21.15.73:0/2469969357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5b4eed1d0 msgr2=0x55e5b4f65a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:32.857 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.850+0000 7fde7dbed700 1 --2- 172.21.15.73:0/2469969357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5b4eed1d0 0x55e5b4f65a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.857 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.850+0000 7fde7dbed700 1 -- 172.21.15.73:0/2469969357 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde78195ce0 con 0x55e5b4eeaac0 2023-08-10T11:53:32.857 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.850+0000 7fde7dbed700 1 --2- 172.21.15.73:0/2469969357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5b4eeaac0 0x55e5b4f06410 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fde740a2f00 tx=0x7fde7400fe40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841be5a2f6951d2c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:32.857 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.850+0000 7fde617fa700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:32.858 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.850+0000 7fde617fa700 1 -- 172.21.15.73:0/2469969357 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde740a31a0 con 0x55e5b4eeaac0 2023-08-10T11:53:32.858 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.850+0000 7fde617fa700 1 -- 172.21.15.73:0/2469969357 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fde740cba10 con 0x55e5b4eeaac0 2023-08-10T11:53:32.858 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.850+0000 7fde8bfeab80 1 -- 172.21.15.73:0/2469969357 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fde68010c50 con 0x55e5b4eeaac0 2023-08-10T11:53:32.858 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.850+0000 7fde617fa700 1 -- 172.21.15.73:0/2469969357 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde74099510 con 0x55e5b4eeaac0 2023-08-10T11:53:32.858 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.850+0000 7fde8bfeab80 10 client.15789 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:32.859 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.850+0000 7fde8bfeab80 1 -- 172.21.15.73:0/2469969357 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55e5b4c8d1f0 con 0x55e5b4eeaac0 2023-08-10T11:53:32.859 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.850+0000 7fde617fa700 1 -- 172.21.15.73:0/2469969357 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fde740ca080 con 0x55e5b4eeaac0 2023-08-10T11:53:32.859 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.851+0000 7fde617fa700 1 -- 172.21.15.73:0/2469969357 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fde740b91b0 con 0x55e5b4eeaac0 2023-08-10T11:53:32.859 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.851+0000 7fde8bfeab80 10 client.15789 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:32.859 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.851+0000 7fde8bfeab80 10 client.15789 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:53:32.859 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.851+0000 7fde8bfeab80 20 client.15789 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:32.859 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.851+0000 7fde8bfeab80 1 --2- 172.21.15.73:0/2469969357 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e5b4f67140 0x55e5b4f69530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:32.860 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.851+0000 7fde8bfeab80 4 client.15789 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:53:32.860 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.851+0000 7fde8bfeab80 1 -- 172.21.15.73:0/2469969357 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e5b4e32720 con 0x55e5b4f67140 2023-08-10T11:53:32.860 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.851+0000 7fde7d3ec700 1 --2- 172.21.15.73:0/2469969357 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e5b4f67140 0x55e5b4f69530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:32.860 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.852+0000 7fde617fa700 10 client.15789 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:32.860 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.852+0000 7fde7d3ec700 1 --2- 172.21.15.73:0/2469969357 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e5b4f67140 0x55e5b4f69530 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f29280929627eccd server_cookie=e47d74233eb537a0 in_seq=0 out_seq=0 2023-08-10T11:53:32.861 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.855+0000 7fde617fa700 1 -- 172.21.15.73:0/2469969357 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e5b4e32720 con 0x55e5b4f67140 2023-08-10T11:53:32.861 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.855+0000 7fde617fa700 10 client.15789 handle_command_reply: tid=0 2023-08-10T11:53:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.856+0000 7fde8bfeab80 1 client.15789 shutdown 2023-08-10T11:53:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.856+0000 7fde8bfeab80 1 -- 172.21.15.73:0/2469969357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5b4eeaac0 msgr2=0x55e5b4f06410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.856+0000 7fde8bfeab80 1 --2- 172.21.15.73:0/2469969357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5b4eeaac0 0x55e5b4f06410 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fde740a2f00 tx=0x7fde7400fe40 comp rx=0 tx=0).stop 2023-08-10T11:53:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.856+0000 7fde8bfeab80 1 -- 172.21.15.73:0/2469969357 shutdown_connections 2023-08-10T11:53:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.856+0000 7fde8bfeab80 1 --2- 172.21.15.73:0/2469969357 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e5b4f67140 0x55e5b4f69530 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.856+0000 7fde8bfeab80 1 --2- 172.21.15.73:0/2469969357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e5b4eed1d0 0x55e5b4f65a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.856+0000 7fde617fa700 0 client.15789 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.856+0000 7fde8bfeab80 1 --2- 172.21.15.73:0/2469969357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e5b4eeaac0 0x55e5b4f06410 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.856+0000 7fde8bfeab80 1 --2- 172.21.15.73:0/2469969357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5b4eec810 0x55e5b4f06950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.856+0000 7fde8bfeab80 1 -- 172.21.15.73:0/2469969357 >> 172.21.15.73:0/2469969357 conn(0x55e5b4e45c70 msgr2=0x55e5b4f033f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.856+0000 7fde8bfeab80 1 -- 172.21.15.73:0/2469969357 shutdown_connections 2023-08-10T11:53:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.856+0000 7fde8bfeab80 1 -- 172.21.15.73:0/2469969357 wait complete. 2023-08-10T11:53:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.856+0000 7fde8bfeab80 20 client.15789 trim_cache size 0 max 16384 2023-08-10T11:53:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:53:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:53:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:53:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:53:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.857+0000 7fde7fe51700 1 -- 172.21.15.73:0/1838112867 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fde640a13e0 msgr2=0x7fde640a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.857+0000 7fde7fe51700 1 --2- 172.21.15.73:0/1838112867 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fde640a13e0 0x7fde640a38a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fde68005950 tx=0x7fde680058e0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.857+0000 7fde7fe51700 1 -- 172.21.15.73:0/1838112867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde780ff800 msgr2=0x7fde78197810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.857+0000 7fde7fe51700 1 --2- 172.21.15.73:0/1838112867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde780ff800 0x7fde78197810 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fde74000c00 tx=0x7fde7400f510 comp rx=0 tx=0).stop 2023-08-10T11:53:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.857+0000 7fde7fe51700 1 -- 172.21.15.73:0/1838112867 shutdown_connections 2023-08-10T11:53:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.857+0000 7fde7fe51700 1 --2- 172.21.15.73:0/1838112867 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fde640a13e0 0x7fde640a38a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.857+0000 7fde7fe51700 1 --2- 172.21.15.73:0/1838112867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde78105650 0x7fde781a26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.857+0000 7fde7fe51700 1 --2- 172.21.15.73:0/1838112867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde780ff800 0x7fde78197810 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.857+0000 7fde7fe51700 1 --2- 172.21.15.73:0/1838112867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde781001c0 0x7fde78197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.857+0000 7fde7fe51700 1 -- 172.21.15.73:0/1838112867 >> 172.21.15.73:0/1838112867 conn(0x7fde780775a0 msgr2=0x7fde780fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.857+0000 7fde7fe51700 1 -- 172.21.15.73:0/1838112867 shutdown_connections 2023-08-10T11:53:32.868 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:32.857+0000 7fde7fe51700 1 -- 172.21.15.73:0/1838112867 wait complete. 2023-08-10T11:53:32.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:32 smithi152 ceph-mon[130220]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-08-10T11:53:33.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:32 smithi156 ceph-mon[130574]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-08-10T11:53:33.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:32 smithi073 ceph-mon[128869]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-08-10T11:53:33.041 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:53:33.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.231+0000 7f57aa077700 1 -- 172.21.15.73:0/2411864378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57a40fff90 msgr2=0x7f57a410c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:33.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.231+0000 7f57aa077700 1 --2- 172.21.15.73:0/2411864378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57a40fff90 0x7f57a410c450 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f579c00b0a0 tx=0x7f579c00b3b0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.231+0000 7f57aa077700 1 -- 172.21.15.73:0/2411864378 shutdown_connections 2023-08-10T11:53:33.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.231+0000 7f57aa077700 1 --2- 172.21.15.73:0/2411864378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57a40fff90 0x7f57a410c450 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.231+0000 7f57aa077700 1 --2- 172.21.15.73:0/2411864378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57a4105690 0x7f57a4105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.231+0000 7f57aa077700 1 --2- 172.21.15.73:0/2411864378 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57a40ff5d0 0x7f57a40ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.231+0000 7f57aa077700 1 -- 172.21.15.73:0/2411864378 >> 172.21.15.73:0/2411864378 conn(0x7f57a40fb0c0 msgr2=0x7f57a40fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:33.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.231+0000 7f57aa077700 1 -- 172.21.15.73:0/2411864378 shutdown_connections 2023-08-10T11:53:33.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.231+0000 7f57aa077700 1 -- 172.21.15.73:0/2411864378 wait complete. 2023-08-10T11:53:33.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.232+0000 7f57aa077700 1 Processor -- start 2023-08-10T11:53:33.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.232+0000 7f57aa077700 1 -- start start 2023-08-10T11:53:33.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.233+0000 7f57aa077700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57a40ff5d0 0x7f57a419c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:33.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.233+0000 7f57aa077700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57a40fff90 0x7f57a419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:33.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.233+0000 7f57aa077700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57a4105690 0x7f57a4196720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:33.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.233+0000 7f57aa077700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a4196d90 con 0x7f57a40fff90 2023-08-10T11:53:33.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.233+0000 7f57aa077700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a4196f00 con 0x7f57a40ff5d0 2023-08-10T11:53:33.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.233+0000 7f57aa077700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a41970c0 con 0x7f57a4105690 2023-08-10T11:53:33.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.233+0000 7f57a2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57a40fff90 0x7f57a419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:33.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.233+0000 7f57a2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57a40fff90 0x7f57a419cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33486/0 (socket says 172.21.15.73:33486) 2023-08-10T11:53:33.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.233+0000 7f57a2ffd700 1 -- 172.21.15.73:0/3907218160 learned_addr learned my addr 172.21.15.73:0/3907218160 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:33.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.233+0000 7f57a37fe700 1 --2- 172.21.15.73:0/3907218160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57a40ff5d0 0x7f57a419c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:33.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.233+0000 7f57a3fff700 1 --2- 172.21.15.73:0/3907218160 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57a4105690 0x7f57a4196720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:33.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.233+0000 7f57a2ffd700 1 -- 172.21.15.73:0/3907218160 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57a4105690 msgr2=0x7f57a4196720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:33.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.233+0000 7f57a2ffd700 1 --2- 172.21.15.73:0/3907218160 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57a4105690 0x7f57a4196720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.233+0000 7f57a2ffd700 1 -- 172.21.15.73:0/3907218160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57a40ff5d0 msgr2=0x7f57a419c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:33.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.233+0000 7f57a2ffd700 1 --2- 172.21.15.73:0/3907218160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57a40ff5d0 0x7f57a419c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.233+0000 7f57a2ffd700 1 -- 172.21.15.73:0/3907218160 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c009d00 con 0x7f57a40fff90 2023-08-10T11:53:33.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.233+0000 7f57a2ffd700 1 --2- 172.21.15.73:0/3907218160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57a40fff90 0x7f57a419cbf0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f579800d980 tx=0x7f579800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:33.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.234+0000 7f57a0ff9700 1 -- 172.21.15.73:0/3907218160 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5798004220 con 0x7f57a40fff90 2023-08-10T11:53:33.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.234+0000 7f57a0ff9700 1 -- 172.21.15.73:0/3907218160 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5798007640 con 0x7f57a40fff90 2023-08-10T11:53:33.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.234+0000 7f57a0ff9700 1 -- 172.21.15.73:0/3907218160 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5798005690 con 0x7f57a40fff90 2023-08-10T11:53:33.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.234+0000 7f57aa077700 1 -- 172.21.15.73:0/3907218160 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a41973a0 con 0x7f57a40fff90 2023-08-10T11:53:33.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.234+0000 7f57aa077700 1 -- 172.21.15.73:0/3907218160 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a41a36a0 con 0x7f57a40fff90 2023-08-10T11:53:33.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.237+0000 7f57a0ff9700 1 -- 172.21.15.73:0/3907218160 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f5798004750 con 0x7f57a40fff90 2023-08-10T11:53:33.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.238+0000 7f57a0ff9700 1 --2- 172.21.15.73:0/3907218160 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f578c0a1460 0x7f578c0a3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:33.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.238+0000 7f57a0ff9700 1 -- 172.21.15.73:0/3907218160 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f57980cccf0 con 0x7f57a40fff90 2023-08-10T11:53:33.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.238+0000 7f57a37fe700 1 --2- 172.21.15.73:0/3907218160 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f578c0a1460 0x7f578c0a3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:33.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.239+0000 7f57b6210b80 1 Processor -- start 2023-08-10T11:53:33.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.239+0000 7f57a37fe700 1 --2- 172.21.15.73:0/3907218160 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f578c0a1460 0x7f578c0a3920 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5794009be0 tx=0x7f5794009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:33.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.239+0000 7f57b6210b80 1 -- start start 2023-08-10T11:53:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.239+0000 7f57b6210b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb4b016890 0x55fb4b016c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.239+0000 7f57b6210b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fb4b0171b0 0x55fb4b0082c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.239+0000 7f57b6210b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb4b008800 0x55fb4b008c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.239+0000 7f57b6210b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb4af83dc0 con 0x55fb4b0171b0 2023-08-10T11:53:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.239+0000 7f57b6210b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb4af60590 con 0x55fb4b016890 2023-08-10T11:53:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.239+0000 7f57b6210b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb4af5deb0 con 0x55fb4b008800 2023-08-10T11:53:33.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.239+0000 7f57a2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fb4b0171b0 0x55fb4b0082c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:33.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.239+0000 7f57a2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fb4b0171b0 0x55fb4b0082c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33494/0 (socket says 172.21.15.73:33494) 2023-08-10T11:53:33.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.239+0000 7f57a37fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb4b016890 0x55fb4b016c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:33.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.239+0000 7f57a2ffd700 1 -- 172.21.15.73:0/4173799835 learned_addr learned my addr 172.21.15.73:0/4173799835 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:33.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.239+0000 7f57a3fff700 1 --2- 172.21.15.73:0/4173799835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb4b008800 0x55fb4b008c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:33.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.240+0000 7f57a37fe700 1 -- 172.21.15.73:0/4173799835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb4b008800 msgr2=0x55fb4b008c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:33.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.240+0000 7f57a37fe700 1 --2- 172.21.15.73:0/4173799835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb4b008800 0x55fb4b008c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.240+0000 7f57a37fe700 1 -- 172.21.15.73:0/4173799835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fb4b0171b0 msgr2=0x55fb4b0082c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:33.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.240+0000 7f57a37fe700 1 --2- 172.21.15.73:0/4173799835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fb4b0171b0 0x55fb4b0082c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.240+0000 7f57a37fe700 1 -- 172.21.15.73:0/4173799835 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb4adda630 con 0x55fb4b016890 2023-08-10T11:53:33.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.240+0000 7f57a2ffd700 1 --2- 172.21.15.73:0/4173799835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fb4b0171b0 0x55fb4b0082c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:53:33.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.240+0000 7f57a37fe700 1 --2- 172.21.15.73:0/4173799835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb4b016890 0x55fb4b016c70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f57940117d0 tx=0x7f5794014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0e1aea7fda02d5f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:33.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.240+0000 7f5789ffb700 1 -- 172.21.15.73:0/4173799835 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57940119e0 con 0x55fb4b016890 2023-08-10T11:53:33.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.240+0000 7f5789ffb700 1 -- 172.21.15.73:0/4173799835 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f57940044e0 con 0x55fb4b016890 2023-08-10T11:53:33.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.240+0000 7f5789ffb700 1 -- 172.21.15.73:0/4173799835 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5794003ae0 con 0x55fb4b016890 2023-08-10T11:53:33.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.241+0000 7f57b6210b80 1 -- 172.21.15.73:0/4173799835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb4b016890 msgr2=0x55fb4b016c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:33.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.241+0000 7f57b6210b80 1 --2- 172.21.15.73:0/4173799835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb4b016890 0x55fb4b016c70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f57940117d0 tx=0x7f5794014000 comp rx=0 tx=0).stop 2023-08-10T11:53:33.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.241+0000 7f57b6210b80 1 -- 172.21.15.73:0/4173799835 shutdown_connections 2023-08-10T11:53:33.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.241+0000 7f57b6210b80 1 --2- 172.21.15.73:0/4173799835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb4b016890 0x55fb4b016c70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.241+0000 7f57b6210b80 1 --2- 172.21.15.73:0/4173799835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb4b008800 0x55fb4b008c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.241+0000 7f57b6210b80 1 --2- 172.21.15.73:0/4173799835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fb4b0171b0 0x55fb4b0082c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.241+0000 7f57b6210b80 1 -- 172.21.15.73:0/4173799835 >> 172.21.15.73:0/4173799835 conn(0x55fb4af65cd0 msgr2=0x55fb4b0036e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:33.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.241+0000 7f57b6210b80 1 -- 172.21.15.73:0/4173799835 shutdown_connections 2023-08-10T11:53:33.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.241+0000 7f57b6210b80 1 -- 172.21.15.73:0/4173799835 wait complete. 2023-08-10T11:53:33.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.242+0000 7f57b6210b80 1 -- start start 2023-08-10T11:53:33.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.242+0000 7f57b6210b80 1 Processor -- start 2023-08-10T11:53:33.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.242+0000 7f57b6210b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb4b008800 0x55fb4b01a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:33.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.242+0000 7f57b6210b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fb4b016890 0x55fb4b01a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:33.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.242+0000 7f57b6210b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb4b0171b0 0x55fb4b01aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:33.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.242+0000 7f57b6210b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb4af597a0 con 0x55fb4b016890 2023-08-10T11:53:33.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.242+0000 7f57b6210b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb4aef8ac0 con 0x55fb4b008800 2023-08-10T11:53:33.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.242+0000 7f57b6210b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb4aef87c0 con 0x55fb4b0171b0 2023-08-10T11:53:33.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.242+0000 7f57b6210b80 10 client.0 _ll_register_callbacks cb 0x55fb4aef6680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:33.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.243+0000 7f57a37fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb4b008800 0x55fb4b01a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:33.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.243+0000 7f57a37fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb4b008800 0x55fb4b01a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:48148/0 (socket says 172.21.15.73:48148) 2023-08-10T11:53:33.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.243+0000 7f57a2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fb4b016890 0x55fb4b01a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:33.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.243+0000 7f57a3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb4b0171b0 0x55fb4b01aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:33.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.243+0000 7f57a37fe700 1 -- 172.21.15.73:0/1698859242 learned_addr learned my addr 172.21.15.73:0/1698859242 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:33.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.243+0000 7f57a3fff700 1 -- 172.21.15.73:0/1698859242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb4b008800 msgr2=0x55fb4b01a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:33.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.243+0000 7f57a3fff700 1 --2- 172.21.15.73:0/1698859242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb4b008800 0x55fb4b01a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.243+0000 7f57a3fff700 1 -- 172.21.15.73:0/1698859242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fb4b016890 msgr2=0x55fb4b01a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:33.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.243+0000 7f57a3fff700 1 --2- 172.21.15.73:0/1698859242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fb4b016890 0x55fb4b01a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.243+0000 7f57a3fff700 1 -- 172.21.15.73:0/1698859242 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a41a36a0 con 0x55fb4b0171b0 2023-08-10T11:53:33.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.243+0000 7f57a37fe700 1 --2- 172.21.15.73:0/1698859242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb4b008800 0x55fb4b01a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:53:33.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.243+0000 7f57a2ffd700 1 --2- 172.21.15.73:0/1698859242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fb4b016890 0x55fb4b01a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:53:33.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.243+0000 7f57a3fff700 1 --2- 172.21.15.73:0/1698859242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb4b0171b0 0x55fb4b01aea0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f579c009fd0 tx=0x7f579c00bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acd37d62ae4e6470 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:33.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.243+0000 7f5782ffd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T11:53:33.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.244+0000 7f5782ffd700 1 -- 172.21.15.73:0/1698859242 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c00e040 con 0x55fb4b0171b0 2023-08-10T11:53:33.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.244+0000 7f57b6210b80 1 -- 172.21.15.73:0/1698859242 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fb4affb470 con 0x55fb4b0171b0 2023-08-10T11:53:33.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.244+0000 7f5782ffd700 1 -- 172.21.15.73:0/1698859242 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f579c0076e0 con 0x55fb4b0171b0 2023-08-10T11:53:33.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.244+0000 7f5782ffd700 1 -- 172.21.15.73:0/1698859242 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f579c006000 con 0x55fb4b0171b0 2023-08-10T11:53:33.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.244+0000 7f57b6210b80 10 client.25291 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:33.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.244+0000 7f57b6210b80 1 -- 172.21.15.73:0/1698859242 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f5794017070 con 0x55fb4b0171b0 2023-08-10T11:53:33.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.244+0000 7f5782ffd700 1 -- 172.21.15.73:0/1698859242 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fb4affb470 con 0x55fb4b0171b0 2023-08-10T11:53:33.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.244+0000 7f5782ffd700 1 -- 172.21.15.73:0/1698859242 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f579c025030 con 0x55fb4b0171b0 2023-08-10T11:53:33.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.244+0000 7f57b6210b80 10 client.25291 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:33.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.244+0000 7f57b6210b80 10 client.25291 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:53:33.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.244+0000 7f57b6210b80 20 client.25291 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:33.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.244+0000 7f57b6210b80 1 --2- 172.21.15.73:0/1698859242 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55fb4b03baa0 0x55fb4b03dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:33.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.244+0000 7f57b6210b80 4 client.25291 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:53:33.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.244+0000 7f57b6210b80 1 -- 172.21.15.73:0/1698859242 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fb4afd79d0 con 0x55fb4b03baa0 2023-08-10T11:53:33.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.245+0000 7f57a37fe700 1 --2- 172.21.15.73:0/1698859242 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55fb4b03baa0 0x55fb4b03dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:33.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.245+0000 7f5782ffd700 10 client.25291 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:33.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.245+0000 7f57a37fe700 1 --2- 172.21.15.73:0/1698859242 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55fb4b03baa0 0x55fb4b03dec0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=225e9fb55b146fdf server_cookie=1dfc235b30fa6b5c in_seq=0 out_seq=0 2023-08-10T11:53:33.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.246+0000 7f5782ffd700 1 -- 172.21.15.73:0/1698859242 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55fb4afd79d0 con 0x55fb4b03baa0 2023-08-10T11:53:33.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.246+0000 7f5782ffd700 10 client.25291 handle_command_reply: tid=0 2023-08-10T11:53:33.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.246+0000 7f57b6210b80 1 client.25291 shutdown 2023-08-10T11:53:33.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.246+0000 7f57b6210b80 1 -- 172.21.15.73:0/1698859242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb4b0171b0 msgr2=0x55fb4b01aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:33.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.246+0000 7f57b6210b80 1 --2- 172.21.15.73:0/1698859242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb4b0171b0 0x55fb4b01aea0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f579c009fd0 tx=0x7f579c00bf80 comp rx=0 tx=0).stop 2023-08-10T11:53:33.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.246+0000 7f57b6210b80 1 -- 172.21.15.73:0/1698859242 shutdown_connections 2023-08-10T11:53:33.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.246+0000 7f57b6210b80 1 --2- 172.21.15.73:0/1698859242 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55fb4b03baa0 0x55fb4b03dec0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.246+0000 7f57b6210b80 1 --2- 172.21.15.73:0/1698859242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb4b008800 0x55fb4b01a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.246+0000 7f57b6210b80 1 --2- 172.21.15.73:0/1698859242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb4b0171b0 0x55fb4b01aea0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.246+0000 7f57b6210b80 1 --2- 172.21.15.73:0/1698859242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fb4b016890 0x55fb4b01a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.246+0000 7f5782ffd700 0 client.25291 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:33.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.246+0000 7f57b6210b80 1 -- 172.21.15.73:0/1698859242 >> 172.21.15.73:0/1698859242 conn(0x55fb4af65cd0 msgr2=0x55fb4b0030b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:33.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.246+0000 7f57b6210b80 1 -- 172.21.15.73:0/1698859242 shutdown_connections 2023-08-10T11:53:33.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.246+0000 7f57b6210b80 1 -- 172.21.15.73:0/1698859242 wait complete. 2023-08-10T11:53:33.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.247+0000 7f57b6210b80 20 client.25291 trim_cache size 0 max 16384 2023-08-10T11:53:33.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.278+0000 7f57b6210b80 1 Processor -- start 2023-08-10T11:53:33.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.278+0000 7f57b6210b80 1 -- start start 2023-08-10T11:53:33.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.279+0000 7f57b6210b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb4b008800 0x55fb4b015e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:33.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.279+0000 7f57b6210b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb4b016890 0x55fb4b032bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:33.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.279+0000 7f57b6210b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fb4b0171b0 0x55fb4b017ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:33.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.279+0000 7f57b6210b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb4addc920 con 0x55fb4b0171b0 2023-08-10T11:53:33.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.279+0000 7f57b6210b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb4affff80 con 0x55fb4b016890 2023-08-10T11:53:33.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.279+0000 7f57b6210b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb4b0164c0 con 0x55fb4b008800 2023-08-10T11:53:33.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.279+0000 7f57a3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fb4b0171b0 0x55fb4b017ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:33.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.279+0000 7f57a3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fb4b0171b0 0x55fb4b017ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33508/0 (socket says 172.21.15.73:33508) 2023-08-10T11:53:33.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.279+0000 7f57a3fff700 1 -- 172.21.15.73:0/2919217770 learned_addr learned my addr 172.21.15.73:0/2919217770 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:33.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.279+0000 7f57a37fe700 1 --2- 172.21.15.73:0/2919217770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb4b008800 0x55fb4b015e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:33.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.279+0000 7f57a3fff700 1 -- 172.21.15.73:0/2919217770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb4b008800 msgr2=0x55fb4b015e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:33.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.279+0000 7f57a3fff700 1 --2- 172.21.15.73:0/2919217770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb4b008800 0x55fb4b015e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.279+0000 7f57a3fff700 1 -- 172.21.15.73:0/2919217770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb4b016890 msgr2=0x55fb4b032bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:33.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.279+0000 7f57a3fff700 1 --2- 172.21.15.73:0/2919217770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb4b016890 0x55fb4b032bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.279+0000 7f57a3fff700 1 -- 172.21.15.73:0/2919217770 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb4ad86de0 con 0x55fb4b0171b0 2023-08-10T11:53:33.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.279+0000 7f57a37fe700 1 --2- 172.21.15.73:0/2919217770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb4b008800 0x55fb4b015e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:53:33.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.280+0000 7f57a3fff700 1 --2- 172.21.15.73:0/2919217770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fb4b0171b0 0x55fb4b017ca0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f579c009cb0 tx=0x7f579c0050e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a41c5d15f3e11b4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:33.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.280+0000 7f578a7fc700 1 -- 172.21.15.73:0/2919217770 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c00e070 con 0x55fb4b0171b0 2023-08-10T11:53:33.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.280+0000 7f578a7fc700 1 -- 172.21.15.73:0/2919217770 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f579c00f040 con 0x55fb4b0171b0 2023-08-10T11:53:33.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.280+0000 7f578a7fc700 1 -- 172.21.15.73:0/2919217770 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c007700 con 0x55fb4b0171b0 2023-08-10T11:53:33.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.281+0000 7f57b6210b80 1 -- 172.21.15.73:0/2919217770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fb4b0171b0 msgr2=0x55fb4b017ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:33.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.281+0000 7f57b6210b80 1 --2- 172.21.15.73:0/2919217770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fb4b0171b0 0x55fb4b017ca0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f579c009cb0 tx=0x7f579c0050e0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.281+0000 7f57b6210b80 1 -- 172.21.15.73:0/2919217770 shutdown_connections 2023-08-10T11:53:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.281+0000 7f57b6210b80 1 --2- 172.21.15.73:0/2919217770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fb4b0171b0 0x55fb4b017ca0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.281+0000 7f57b6210b80 1 --2- 172.21.15.73:0/2919217770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb4b008800 0x55fb4b015e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.281+0000 7f57b6210b80 1 --2- 172.21.15.73:0/2919217770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb4b016890 0x55fb4b032bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.281+0000 7f57b6210b80 1 -- 172.21.15.73:0/2919217770 >> 172.21.15.73:0/2919217770 conn(0x55fb4af65cd0 msgr2=0x55fb4b017590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.281+0000 7f57b6210b80 1 -- 172.21.15.73:0/2919217770 shutdown_connections 2023-08-10T11:53:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.281+0000 7f57b6210b80 1 -- 172.21.15.73:0/2919217770 wait complete. 2023-08-10T11:53:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.281+0000 7f57b6210b80 1 -- start start 2023-08-10T11:53:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.282+0000 7f57b6210b80 1 Processor -- start 2023-08-10T11:53:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.282+0000 7f57b6210b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fb4b008800 0x55fb4b030ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.282+0000 7f57b6210b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb4b016890 0x55fb4b031410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.282+0000 7f57b6210b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb4b0171b0 0x55fb4b031950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.282+0000 7f57b6210b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb4b032f90 con 0x55fb4b008800 2023-08-10T11:53:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.282+0000 7f57b6210b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb4b08f760 con 0x55fb4b0171b0 2023-08-10T11:53:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.282+0000 7f57b6210b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb4b08f8d0 con 0x55fb4b016890 2023-08-10T11:53:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.282+0000 7f57b6210b80 10 client.0 _ll_register_callbacks cb 0x55fb4aef6680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.282+0000 7f57a37fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fb4b008800 0x55fb4b030ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.282+0000 7f57a37fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fb4b008800 0x55fb4b030ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33512/0 (socket says 172.21.15.73:33512) 2023-08-10T11:53:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.282+0000 7f57a37fe700 1 -- 172.21.15.73:0/267757872 learned_addr learned my addr 172.21.15.73:0/267757872 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.282+0000 7f57a2ffd700 1 --2- 172.21.15.73:0/267757872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb4b016890 0x55fb4b031410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.282+0000 7f57a37fe700 1 -- 172.21.15.73:0/267757872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb4b016890 msgr2=0x55fb4b031410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.282+0000 7f57a37fe700 1 --2- 172.21.15.73:0/267757872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb4b016890 0x55fb4b031410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.282+0000 7f57a37fe700 1 -- 172.21.15.73:0/267757872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb4b0171b0 msgr2=0x55fb4b031950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.282+0000 7f57a37fe700 1 --2- 172.21.15.73:0/267757872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb4b0171b0 0x55fb4b031950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.282+0000 7f57a37fe700 1 -- 172.21.15.73:0/267757872 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5794017070 con 0x55fb4b008800 2023-08-10T11:53:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.282+0000 7f57a2ffd700 1 --2- 172.21.15.73:0/267757872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb4b016890 0x55fb4b031410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.283+0000 7f57a37fe700 1 --2- 172.21.15.73:0/267757872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fb4b008800 0x55fb4b030ed0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f57940117d0 tx=0x7f579400e740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb84c4b52521501 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.283+0000 7f5782ffd700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.283+0000 7f5782ffd700 1 -- 172.21.15.73:0/267757872 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579402b040 con 0x55fb4b008800 2023-08-10T11:53:33.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.283+0000 7f5782ffd700 1 -- 172.21.15.73:0/267757872 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5794034930 con 0x55fb4b008800 2023-08-10T11:53:33.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.283+0000 7f57b6210b80 1 -- 172.21.15.73:0/267757872 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f57940044e0 con 0x55fb4b008800 2023-08-10T11:53:33.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.283+0000 7f5782ffd700 1 -- 172.21.15.73:0/267757872 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5794034af0 con 0x55fb4b008800 2023-08-10T11:53:33.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.283+0000 7f57b6210b80 10 client.15807 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:33.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.283+0000 7f57b6210b80 1 -- 172.21.15.73:0/267757872 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55fb4ad6fc60 con 0x55fb4b008800 2023-08-10T11:53:33.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.283+0000 7f5782ffd700 1 -- 172.21.15.73:0/267757872 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5794042020 con 0x55fb4b008800 2023-08-10T11:53:33.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.283+0000 7f5782ffd700 1 -- 172.21.15.73:0/267757872 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5794024030 con 0x55fb4b008800 2023-08-10T11:53:33.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.284+0000 7f57b6210b80 10 client.15807 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:33.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.284+0000 7f57b6210b80 10 client.15807 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:53:33.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.284+0000 7f57b6210b80 20 client.15807 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:33.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.284+0000 7f57b6210b80 1 --2- 172.21.15.73:0/267757872 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55fb4b090f90 0x55fb4b0933b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:33.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.284+0000 7f57b6210b80 4 client.15807 mds_command: new command op to 24503 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:53:33.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.284+0000 7f57b6210b80 1 -- 172.21.15.73:0/267757872 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fb4af52780 con 0x55fb4b090f90 2023-08-10T11:53:33.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.284+0000 7f57a2ffd700 1 --2- 172.21.15.73:0/267757872 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55fb4b090f90 0x55fb4b0933b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:33.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.284+0000 7f5782ffd700 10 client.15807 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:33.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.284+0000 7f57a2ffd700 1 --2- 172.21.15.73:0/267757872 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55fb4b090f90 0x55fb4b0933b0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfbbe4e512746cb4 server_cookie=efe7ea720605e32c in_seq=0 out_seq=0 2023-08-10T11:53:33.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.285+0000 7f5782ffd700 1 -- 172.21.15.73:0/267757872 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55fb4af52780 con 0x55fb4b090f90 2023-08-10T11:53:33.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.285+0000 7f5782ffd700 10 client.15807 handle_command_reply: tid=0 2023-08-10T11:53:33.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.285+0000 7f57b6210b80 1 client.15807 shutdown 2023-08-10T11:53:33.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.285+0000 7f57b6210b80 1 -- 172.21.15.73:0/267757872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fb4b008800 msgr2=0x55fb4b030ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:33.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.285+0000 7f57b6210b80 1 --2- 172.21.15.73:0/267757872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fb4b008800 0x55fb4b030ed0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f57940117d0 tx=0x7f579400e740 comp rx=0 tx=0).stop 2023-08-10T11:53:33.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.285+0000 7f57b6210b80 1 -- 172.21.15.73:0/267757872 shutdown_connections 2023-08-10T11:53:33.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.285+0000 7f57b6210b80 1 --2- 172.21.15.73:0/267757872 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55fb4b090f90 0x55fb4b0933b0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.285+0000 7f57b6210b80 1 --2- 172.21.15.73:0/267757872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fb4b0171b0 0x55fb4b031950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.285+0000 7f57b6210b80 1 --2- 172.21.15.73:0/267757872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fb4b008800 0x55fb4b030ed0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.285+0000 7f57b6210b80 1 --2- 172.21.15.73:0/267757872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb4b016890 0x55fb4b031410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.285+0000 7f57b6210b80 1 -- 172.21.15.73:0/267757872 >> 172.21.15.73:0/267757872 conn(0x55fb4af65cd0 msgr2=0x55fb4b017e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:33.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.285+0000 7f5782ffd700 0 client.15807 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:33.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.285+0000 7f57b6210b80 1 -- 172.21.15.73:0/267757872 shutdown_connections 2023-08-10T11:53:33.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.285+0000 7f57b6210b80 1 -- 172.21.15.73:0/267757872 wait complete. 2023-08-10T11:53:33.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.285+0000 7f57b6210b80 20 client.15807 trim_cache size 0 max 16384 2023-08-10T11:53:33.295 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:53:33.295 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "no active scrubs running", 2023-08-10T11:53:33.296 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": {} 2023-08-10T11:53:33.296 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:53:33.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.286+0000 7f57aa077700 1 -- 172.21.15.73:0/3907218160 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f578c0a1460 msgr2=0x7f578c0a3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:33.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.286+0000 7f57aa077700 1 --2- 172.21.15.73:0/3907218160 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f578c0a1460 0x7f578c0a3920 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5794009be0 tx=0x7f5794009260 comp rx=0 tx=0).stop 2023-08-10T11:53:33.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.286+0000 7f57aa077700 1 -- 172.21.15.73:0/3907218160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57a40fff90 msgr2=0x7f57a419cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:33.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.286+0000 7f57aa077700 1 --2- 172.21.15.73:0/3907218160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57a40fff90 0x7f57a419cbf0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f579800d980 tx=0x7f579800dc90 comp rx=0 tx=0).stop 2023-08-10T11:53:33.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.286+0000 7f57aa077700 1 -- 172.21.15.73:0/3907218160 shutdown_connections 2023-08-10T11:53:33.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.286+0000 7f57aa077700 1 --2- 172.21.15.73:0/3907218160 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f578c0a1460 0x7f578c0a3920 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.286+0000 7f57aa077700 1 --2- 172.21.15.73:0/3907218160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57a40ff5d0 0x7f57a419c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.286+0000 7f57aa077700 1 --2- 172.21.15.73:0/3907218160 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57a4105690 0x7f57a4196720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.286+0000 7f57aa077700 1 --2- 172.21.15.73:0/3907218160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57a40fff90 0x7f57a419cbf0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.286+0000 7f57aa077700 1 -- 172.21.15.73:0/3907218160 >> 172.21.15.73:0/3907218160 conn(0x7f57a40fb0c0 msgr2=0x7f57a40fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:33.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.286+0000 7f57aa077700 1 -- 172.21.15.73:0/3907218160 shutdown_connections 2023-08-10T11:53:33.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.286+0000 7f57aa077700 1 -- 172.21.15.73:0/3907218160 wait complete. 2023-08-10T11:53:33.304 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-08-10T11:53:33.304 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T11:53:33.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.489+0000 7f544ada4700 1 -- 172.21.15.73:0/3312160298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54440fff90 msgr2=0x7f544410c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:33.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.489+0000 7f544ada4700 1 --2- 172.21.15.73:0/3312160298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54440fff90 0x7f544410c450 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f543c00b0d0 tx=0x7f543c00b3e0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.489+0000 7f544ada4700 1 -- 172.21.15.73:0/3312160298 shutdown_connections 2023-08-10T11:53:33.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.489+0000 7f544ada4700 1 --2- 172.21.15.73:0/3312160298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5444105690 0x7f5444105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.489+0000 7f544ada4700 1 --2- 172.21.15.73:0/3312160298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54440fff90 0x7f544410c450 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.489+0000 7f544ada4700 1 --2- 172.21.15.73:0/3312160298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54440ff5d0 0x7f54440ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.489+0000 7f544ada4700 1 -- 172.21.15.73:0/3312160298 >> 172.21.15.73:0/3312160298 conn(0x7f54440fb080 msgr2=0x7f54440fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:33.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.489+0000 7f544ada4700 1 -- 172.21.15.73:0/3312160298 shutdown_connections 2023-08-10T11:53:33.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.489+0000 7f544ada4700 1 -- 172.21.15.73:0/3312160298 wait complete. 2023-08-10T11:53:33.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.490+0000 7f544ada4700 1 Processor -- start 2023-08-10T11:53:33.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.490+0000 7f544ada4700 1 -- start start 2023-08-10T11:53:33.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.490+0000 7f544ada4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54440ff5d0 0x7f54441976a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:33.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.490+0000 7f544ada4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54440fff90 0x7f5444197be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:33.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.490+0000 7f544ada4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5444105690 0x7f54441a2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:33.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.490+0000 7f544ada4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5444198520 con 0x7f5444105690 2023-08-10T11:53:33.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.490+0000 7f544ada4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54441a2c60 con 0x7f54440fff90 2023-08-10T11:53:33.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.490+0000 7f544ada4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54441a2e20 con 0x7f54440ff5d0 2023-08-10T11:53:33.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.491+0000 7f5449341700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5444105690 0x7f54441a2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:33.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.491+0000 7f5449341700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5444105690 0x7f54441a2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33528/0 (socket says 172.21.15.73:33528) 2023-08-10T11:53:33.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.491+0000 7f5449341700 1 -- 172.21.15.73:0/1809577132 learned_addr learned my addr 172.21.15.73:0/1809577132 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:33.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.491+0000 7f5448b40700 1 --2- 172.21.15.73:0/1809577132 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54440ff5d0 0x7f54441976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:33.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.491+0000 7f5443fff700 1 --2- 172.21.15.73:0/1809577132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54440fff90 0x7f5444197be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:33.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.491+0000 7f5449341700 1 -- 172.21.15.73:0/1809577132 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54440ff5d0 msgr2=0x7f54441976a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:33.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.491+0000 7f5449341700 1 --2- 172.21.15.73:0/1809577132 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54440ff5d0 0x7f54441976a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.491+0000 7f5449341700 1 -- 172.21.15.73:0/1809577132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54440fff90 msgr2=0x7f5444197be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:33.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.491+0000 7f5449341700 1 --2- 172.21.15.73:0/1809577132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54440fff90 0x7f5444197be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.491+0000 7f5449341700 1 -- 172.21.15.73:0/1809577132 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c009d00 con 0x7f5444105690 2023-08-10T11:53:33.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.491+0000 7f5443fff700 1 --2- 172.21.15.73:0/1809577132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54440fff90 0x7f5444197be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:53:33.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.491+0000 7f5449341700 1 --2- 172.21.15.73:0/1809577132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5444105690 0x7f54441a2720 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f543c007870 tx=0x7f543c0078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:33.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.491+0000 7f5441ffb700 1 -- 172.21.15.73:0/1809577132 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c00e040 con 0x7f5444105690 2023-08-10T11:53:33.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.491+0000 7f544ada4700 1 -- 172.21.15.73:0/1809577132 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54441a30a0 con 0x7f5444105690 2023-08-10T11:53:33.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.491+0000 7f5441ffb700 1 -- 172.21.15.73:0/1809577132 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f543c005070 con 0x7f5444105690 2023-08-10T11:53:33.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.491+0000 7f5441ffb700 1 -- 172.21.15.73:0/1809577132 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c01b6c0 con 0x7f5444105690 2023-08-10T11:53:33.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.492+0000 7f544ada4700 1 -- 172.21.15.73:0/1809577132 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54441a3520 con 0x7f5444105690 2023-08-10T11:53:33.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.494+0000 7f544ada4700 1 -- 172.21.15.73:0/1809577132 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5444067560 con 0x7f5444105690 2023-08-10T11:53:33.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.495+0000 7f5441ffb700 1 -- 172.21.15.73:0/1809577132 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f543c0051e0 con 0x7f5444105690 2023-08-10T11:53:33.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.496+0000 7f5441ffb700 1 --2- 172.21.15.73:0/1809577132 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f54340a1430 0x7f54340a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:33.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.496+0000 7f5448b40700 1 --2- 172.21.15.73:0/1809577132 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f54340a1430 0x7f54340a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:33.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.496+0000 7f5441ffb700 1 -- 172.21.15.73:0/1809577132 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f543c0ce0d0 con 0x7f5444105690 2023-08-10T11:53:33.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.497+0000 7f5448b40700 1 --2- 172.21.15.73:0/1809577132 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f54340a1430 0x7f54340a38f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5438009be0 tx=0x7f5438009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:33.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.504+0000 7f5441ffb700 1 -- 172.21.15.73:0/1809577132 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f543c097350 con 0x7f5444105690 2023-08-10T11:53:33.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.978+0000 7f544ada4700 1 -- 172.21.15.73:0/1809577132 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54441a3740 con 0x7f5444105690 2023-08-10T11:53:33.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.979+0000 7f5441ffb700 1 -- 172.21.15.73:0/1809577132 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10891 (secure 0 0 0) 0x7f543c09a970 con 0x7f5444105690 2023-08-10T11:53:33.981 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:53:33.981 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1319360725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1319360725},{"type":"v1","addr":"172.21.15.73:6835","nonce":1319360725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/431221951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":431221951},{"type":"v1","addr":"172.21.15.73:6837","nonce":431221951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-10T11:50:54.304447+0000","modified":"2023-08-10T11:51:01.523452+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24503,"mds_1":24479,"mds_2":24451,"mds_3":24443,"mds_4":24419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6839/1099539481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1099539481},{"type":"v1","addr":"172.21.15.73:6839","nonce":1099539481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6841/3067925859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":3067925859},{"type":"v1","addr":"172.21.15.73:6841","nonce":3067925859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24397":{"gid":24397,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6833/3028461815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3028461815},{"type":"v1","addr":"172.21.15.156:6833","nonce":3028461815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24419":{"gid":24419,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6833/4148407154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4148407154},{"type":"v1","addr":"172.21.15.152:6833","nonce":4148407154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24443":{"gid":24443,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.152:6835/1791572604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1791572604},{"type":"v1","addr":"172.21.15.152:6835","nonce":1791572604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.156:6835/904126790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":904126790},{"type":"v1","addr":"172.21.15.156:6835","nonce":904126790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24457":{"gid":24457,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/4284306352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":4284306352},{"type":"v1","addr":"172.21.15.156:6837","nonce":4284306352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6839/3361058731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":3361058731},{"type":"v1","addr":"172.21.15.156:6839","nonce":3361058731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6837/74214089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":74214089},{"type":"v1","addr":"172.21.15.152:6837","nonce":74214089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6839/3870202690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3870202690},{"type":"v1","addr":"172.21.15.152:6839","nonce":3870202690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T11:53:33.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.982+0000 7f544ada4700 1 -- 172.21.15.73:0/1809577132 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f54340a1430 msgr2=0x7f54340a38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:33.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.982+0000 7f544ada4700 1 --2- 172.21.15.73:0/1809577132 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f54340a1430 0x7f54340a38f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5438009be0 tx=0x7f5438009260 comp rx=0 tx=0).stop 2023-08-10T11:53:33.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.982+0000 7f544ada4700 1 -- 172.21.15.73:0/1809577132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5444105690 msgr2=0x7f54441a2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:33.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.982+0000 7f544ada4700 1 --2- 172.21.15.73:0/1809577132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5444105690 0x7f54441a2720 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f543c007870 tx=0x7f543c0078a0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.982+0000 7f544ada4700 1 -- 172.21.15.73:0/1809577132 shutdown_connections 2023-08-10T11:53:33.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.982+0000 7f544ada4700 1 --2- 172.21.15.73:0/1809577132 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f54340a1430 0x7f54340a38f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.982+0000 7f544ada4700 1 --2- 172.21.15.73:0/1809577132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5444105690 0x7f54441a2720 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.982+0000 7f544ada4700 1 --2- 172.21.15.73:0/1809577132 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54440ff5d0 0x7f54441976a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.982+0000 7f544ada4700 1 --2- 172.21.15.73:0/1809577132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54440fff90 0x7f5444197be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:33.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.982+0000 7f544ada4700 1 -- 172.21.15.73:0/1809577132 >> 172.21.15.73:0/1809577132 conn(0x7f54440fb080 msgr2=0x7f54440fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:33.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.983+0000 7f544ada4700 1 -- 172.21.15.73:0/1809577132 shutdown_connections 2023-08-10T11:53:33.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:33.983+0000 7f544ada4700 1 -- 172.21.15.73:0/1809577132 wait complete. 2023-08-10T11:53:33.987 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 27 2023-08-10T11:53:34.001 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-08-10T11:53:34.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.189+0000 7f0309200700 1 -- 172.21.15.73:0/821088784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03041001e0 msgr2=0x7f03041005c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.189+0000 7f0309200700 1 --2- 172.21.15.73:0/821088784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03041001e0 0x7f03041005c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f02f4009990 tx=0x7f02f4009ca0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.189+0000 7f0309200700 1 -- 172.21.15.73:0/821088784 shutdown_connections 2023-08-10T11:53:34.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.189+0000 7f0309200700 1 --2- 172.21.15.73:0/821088784 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0304104810 0x7f030410c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.189+0000 7f0309200700 1 --2- 172.21.15.73:0/821088784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03041001e0 0x7f03041005c0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.189+0000 7f0309200700 1 --2- 172.21.15.73:0/821088784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0304100b90 0x7f0304104130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.189+0000 7f0309200700 1 -- 172.21.15.73:0/821088784 >> 172.21.15.73:0/821088784 conn(0x7f0304074780 msgr2=0x7f0304074b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:34.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.189+0000 7f0309200700 1 -- 172.21.15.73:0/821088784 shutdown_connections 2023-08-10T11:53:34.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.189+0000 7f0309200700 1 -- 172.21.15.73:0/821088784 wait complete. 2023-08-10T11:53:34.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.190+0000 7f0309200700 1 Processor -- start 2023-08-10T11:53:34.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.190+0000 7f0309200700 1 -- start start 2023-08-10T11:53:34.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.191+0000 7f0309200700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03041001e0 0x7f03041973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.191+0000 7f0309200700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0304104810 0x7f03041978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.191+0000 7f0309200700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0304197ec0 0x7f03041a2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.191+0000 7f0309200700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03041a2ba0 con 0x7f03041001e0 2023-08-10T11:53:34.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.191+0000 7f0309200700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03041a2d10 con 0x7f0304197ec0 2023-08-10T11:53:34.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.191+0000 7f0309200700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03041a2ed0 con 0x7f0304104810 2023-08-10T11:53:34.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.191+0000 7f0302d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03041001e0 0x7f03041973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.191+0000 7f0302d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03041001e0 0x7f03041973a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33540/0 (socket says 172.21.15.73:33540) 2023-08-10T11:53:34.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.191+0000 7f0302d9d700 1 -- 172.21.15.73:0/4119372032 learned_addr learned my addr 172.21.15.73:0/4119372032 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:34.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.191+0000 7f030259c700 1 --2- 172.21.15.73:0/4119372032 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0304104810 0x7f03041978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.191+0000 7f0302d9d700 1 -- 172.21.15.73:0/4119372032 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0304104810 msgr2=0x7f03041978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.191+0000 7f0302d9d700 1 --2- 172.21.15.73:0/4119372032 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0304104810 0x7f03041978e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.191+0000 7f0302d9d700 1 -- 172.21.15.73:0/4119372032 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0304197ec0 msgr2=0x7f03041a2420 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-10T11:53:34.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.191+0000 7f0302d9d700 1 --2- 172.21.15.73:0/4119372032 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0304197ec0 0x7f03041a2420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.191+0000 7f0302d9d700 1 -- 172.21.15.73:0/4119372032 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f40095f0 con 0x7f03041001e0 2023-08-10T11:53:34.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.191+0000 7f0302d9d700 1 --2- 172.21.15.73:0/4119372032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03041001e0 0x7f03041973a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f02f40095c0 tx=0x7f02f400f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:34.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.192+0000 7f02ebfff700 1 -- 172.21.15.73:0/4119372032 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f401d070 con 0x7f03041001e0 2023-08-10T11:53:34.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.192+0000 7f02ebfff700 1 -- 172.21.15.73:0/4119372032 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f02f400fb50 con 0x7f03041001e0 2023-08-10T11:53:34.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.192+0000 7f0309200700 1 -- 172.21.15.73:0/4119372032 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03041a3150 con 0x7f03041001e0 2023-08-10T11:53:34.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.192+0000 7f02ebfff700 1 -- 172.21.15.73:0/4119372032 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f40173f0 con 0x7f03041001e0 2023-08-10T11:53:34.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.192+0000 7f0309200700 1 -- 172.21.15.73:0/4119372032 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03041a3600 con 0x7f03041001e0 2023-08-10T11:53:34.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.195+0000 7f02ebfff700 1 -- 172.21.15.73:0/4119372032 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f02f400fcc0 con 0x7f03041001e0 2023-08-10T11:53:34.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.196+0000 7f02ebfff700 1 --2- 172.21.15.73:0/4119372032 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f02ec0a1480 0x7f02ec0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.196+0000 7f02ebfff700 1 -- 172.21.15.73:0/4119372032 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f02f40ce010 con 0x7f03041001e0 2023-08-10T11:53:34.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.197+0000 7f030259c700 1 --2- 172.21.15.73:0/4119372032 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f02ec0a1480 0x7f02ec0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.197+0000 7f0315399b80 1 Processor -- start 2023-08-10T11:53:34.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.197+0000 7f030259c700 1 --2- 172.21.15.73:0/4119372032 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f02ec0a1480 0x7f02ec0a3940 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f03040ff710 tx=0x7f02f800b410 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:34.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.199+0000 7f0315399b80 1 -- start start 2023-08-10T11:53:34.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.199+0000 7f0315399b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654a71a24b0 0x5654a71a2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.199+0000 7f0315399b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5654a71a2dd0 0x5654a71a6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.199+0000 7f0315399b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654a71a7290 0x5654a71a76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.199+0000 7f0315399b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a711ddc0 con 0x5654a71a2dd0 2023-08-10T11:53:34.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.199+0000 7f0315399b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a70fa590 con 0x5654a71a7290 2023-08-10T11:53:34.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.199+0000 7f0315399b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a70f7eb0 con 0x5654a71a24b0 2023-08-10T11:53:34.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.199+0000 7f030259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5654a71a2dd0 0x5654a71a6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.199+0000 7f030259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5654a71a2dd0 0x5654a71a6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33550/0 (socket says 172.21.15.73:33550) 2023-08-10T11:53:34.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.199+0000 7f030259c700 1 -- 172.21.15.73:0/3560949704 learned_addr learned my addr 172.21.15.73:0/3560949704 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:34.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.199+0000 7f0302d9d700 1 --2- 172.21.15.73:0/3560949704 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654a71a24b0 0x5654a71a2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.199+0000 7f030359e700 1 --2- 172.21.15.73:0/3560949704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654a71a7290 0x5654a71a76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.200+0000 7f030259c700 1 -- 172.21.15.73:0/3560949704 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654a71a24b0 msgr2=0x5654a71a2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.200+0000 7f030259c700 1 --2- 172.21.15.73:0/3560949704 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654a71a24b0 0x5654a71a2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.200+0000 7f030259c700 1 -- 172.21.15.73:0/3560949704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654a71a7290 msgr2=0x5654a71a76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.200+0000 7f030259c700 1 --2- 172.21.15.73:0/3560949704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654a71a7290 0x5654a71a76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.200+0000 7f030259c700 1 -- 172.21.15.73:0/3560949704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654a6f74630 con 0x5654a71a2dd0 2023-08-10T11:53:34.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.200+0000 7f030259c700 1 --2- 172.21.15.73:0/3560949704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5654a71a2dd0 0x5654a71a6d50 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f02f8005d90 tx=0x7f02f8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf5b7c08c0ed9924 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:34.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.200+0000 7f02e97fa700 1 -- 172.21.15.73:0/3560949704 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f8011bb0 con 0x5654a71a2dd0 2023-08-10T11:53:34.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.200+0000 7f02e97fa700 1 -- 172.21.15.73:0/3560949704 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f02f8015070 con 0x5654a71a2dd0 2023-08-10T11:53:34.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.200+0000 7f02e97fa700 1 -- 172.21.15.73:0/3560949704 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f8005540 con 0x5654a71a2dd0 2023-08-10T11:53:34.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.201+0000 7f0315399b80 1 -- 172.21.15.73:0/3560949704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5654a71a2dd0 msgr2=0x5654a71a6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.201+0000 7f0315399b80 1 --2- 172.21.15.73:0/3560949704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5654a71a2dd0 0x5654a71a6d50 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f02f8005d90 tx=0x7f02f8013000 comp rx=0 tx=0).stop 2023-08-10T11:53:34.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.201+0000 7f0315399b80 1 -- 172.21.15.73:0/3560949704 shutdown_connections 2023-08-10T11:53:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.201+0000 7f0315399b80 1 --2- 172.21.15.73:0/3560949704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654a71a7290 0x5654a71a76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.201+0000 7f0315399b80 1 --2- 172.21.15.73:0/3560949704 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654a71a24b0 0x5654a71a2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.201+0000 7f0315399b80 1 --2- 172.21.15.73:0/3560949704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5654a71a2dd0 0x5654a71a6d50 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.201+0000 7f0315399b80 1 -- 172.21.15.73:0/3560949704 >> 172.21.15.73:0/3560949704 conn(0x5654a70ffcd0 msgr2=0x5654a719d750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.201+0000 7f0315399b80 1 -- 172.21.15.73:0/3560949704 shutdown_connections 2023-08-10T11:53:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.201+0000 7f0315399b80 1 -- 172.21.15.73:0/3560949704 wait complete. 2023-08-10T11:53:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.201+0000 7f0315399b80 1 -- start start 2023-08-10T11:53:34.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.202+0000 7f0315399b80 1 Processor -- start 2023-08-10T11:53:34.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.202+0000 7f0315399b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654a71a24b0 0x5654a71aea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.202+0000 7f0315399b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5654a71a2dd0 0x5654a71abcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.202+0000 7f0315399b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654a71a7290 0x5654a71ac350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.202+0000 7f0315399b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a70f37a0 con 0x5654a71a2dd0 2023-08-10T11:53:34.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.202+0000 7f0315399b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a7092ac0 con 0x5654a71a7290 2023-08-10T11:53:34.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.202+0000 7f0315399b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a70927c0 con 0x5654a71a24b0 2023-08-10T11:53:34.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.202+0000 7f0315399b80 10 client.0 _ll_register_callbacks cb 0x5654a7090680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:34.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.202+0000 7f030259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5654a71a2dd0 0x5654a71abcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.202+0000 7f030259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5654a71a2dd0 0x5654a71abcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33556/0 (socket says 172.21.15.73:33556) 2023-08-10T11:53:34.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.202+0000 7f030259c700 1 -- 172.21.15.73:0/2886141445 learned_addr learned my addr 172.21.15.73:0/2886141445 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:34.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.202+0000 7f0302d9d700 1 --2- 172.21.15.73:0/2886141445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654a71a24b0 0x5654a71aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.203+0000 7f030359e700 1 --2- 172.21.15.73:0/2886141445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654a71a7290 0x5654a71ac350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.203+0000 7f030259c700 1 -- 172.21.15.73:0/2886141445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654a71a24b0 msgr2=0x5654a71aea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.203+0000 7f030259c700 1 --2- 172.21.15.73:0/2886141445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654a71a24b0 0x5654a71aea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.203+0000 7f030259c700 1 -- 172.21.15.73:0/2886141445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654a71a7290 msgr2=0x5654a71ac350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.203+0000 7f030259c700 1 --2- 172.21.15.73:0/2886141445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654a71a7290 0x5654a71ac350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.203+0000 7f030259c700 1 -- 172.21.15.73:0/2886141445 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f8010c20 con 0x5654a71a2dd0 2023-08-10T11:53:34.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.203+0000 7f0302d9d700 1 --2- 172.21.15.73:0/2886141445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654a71a24b0 0x5654a71aea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:53:34.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.203+0000 7f030259c700 1 --2- 172.21.15.73:0/2886141445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5654a71a2dd0 0x5654a71abcd0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f02f8005060 tx=0x7f02f8011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6b478dc6a37a99 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:34.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.203+0000 7f02e6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:34.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.203+0000 7f02e6ff5700 1 -- 172.21.15.73:0/2886141445 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f802c070 con 0x5654a71a2dd0 2023-08-10T11:53:34.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.203+0000 7f0315399b80 1 -- 172.21.15.73:0/2886141445 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5654a7195470 con 0x5654a71a2dd0 2023-08-10T11:53:34.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.203+0000 7f02e6ff5700 1 -- 172.21.15.73:0/2886141445 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f02f8017070 con 0x5654a71a2dd0 2023-08-10T11:53:34.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.203+0000 7f02e6ff5700 1 -- 172.21.15.73:0/2886141445 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02f80049a0 con 0x5654a71a2dd0 2023-08-10T11:53:34.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.203+0000 7f0315399b80 10 client.15825 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:34.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.203+0000 7f0315399b80 1 -- 172.21.15.73:0/2886141445 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5654a6f20de0 con 0x5654a71a2dd0 2023-08-10T11:53:34.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.204+0000 7f02e6ff5700 1 -- 172.21.15.73:0/2886141445 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f02f803f020 con 0x5654a71a2dd0 2023-08-10T11:53:34.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.204+0000 7f02e6ff5700 1 -- 172.21.15.73:0/2886141445 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f02f8024070 con 0x5654a71a2dd0 2023-08-10T11:53:34.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.204+0000 7f0315399b80 10 client.15825 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:34.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.204+0000 7f0315399b80 10 client.15825 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2023-08-10T11:53:34.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.204+0000 7f0315399b80 20 client.15825 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:34.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.204+0000 7f0315399b80 1 --2- 172.21.15.73:0/2886141445 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x5654a71b1840 0x5654a71b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.204+0000 7f0315399b80 4 client.15825 mds_command: new command op to 24419 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:53:34.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.204+0000 7f0315399b80 1 -- 172.21.15.73:0/2886141445 --> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5654a71719d0 con 0x5654a71b1840 2023-08-10T11:53:34.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.205+0000 7f0302d9d700 1 --2- 172.21.15.73:0/2886141445 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x5654a71b1840 0x5654a71b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.205+0000 7f02e6ff5700 10 client.15825 ms_handle_connect on v2:172.21.15.152:6832/4148407154 2023-08-10T11:53:34.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.205+0000 7f0302d9d700 1 --2- 172.21.15.73:0/2886141445 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x5654a71b1840 0x5654a71b1c50 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f25232dc1bcd124a server_cookie=adfdb897a0cfa1f4 in_seq=0 out_seq=0 2023-08-10T11:53:34.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.206+0000 7f02e6ff5700 1 -- 172.21.15.73:0/2886141445 <== mds.4 v2:172.21.15.152:6832/4148407154 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5654a71719d0 con 0x5654a71b1840 2023-08-10T11:53:34.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.206+0000 7f02e6ff5700 10 client.15825 handle_command_reply: tid=0 2023-08-10T11:53:34.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.206+0000 7f0315399b80 1 client.15825 shutdown 2023-08-10T11:53:34.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.206+0000 7f0315399b80 1 -- 172.21.15.73:0/2886141445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5654a71a2dd0 msgr2=0x5654a71abcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.206+0000 7f0315399b80 1 --2- 172.21.15.73:0/2886141445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5654a71a2dd0 0x5654a71abcd0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f02f8005060 tx=0x7f02f8011e90 comp rx=0 tx=0).stop 2023-08-10T11:53:34.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.206+0000 7f0315399b80 1 -- 172.21.15.73:0/2886141445 shutdown_connections 2023-08-10T11:53:34.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.206+0000 7f0315399b80 1 --2- 172.21.15.73:0/2886141445 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x5654a71b1840 0x5654a71b1c50 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.206+0000 7f0315399b80 1 --2- 172.21.15.73:0/2886141445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654a71a7290 0x5654a71ac350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.206+0000 7f0315399b80 1 --2- 172.21.15.73:0/2886141445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654a71a24b0 0x5654a71aea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.206+0000 7f02e6ff5700 0 client.15825 ms_handle_reset on v2:172.21.15.152:6832/4148407154 2023-08-10T11:53:34.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.206+0000 7f0315399b80 1 --2- 172.21.15.73:0/2886141445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5654a71a2dd0 0x5654a71abcd0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.206+0000 7f0315399b80 1 -- 172.21.15.73:0/2886141445 >> 172.21.15.73:0/2886141445 conn(0x5654a70ffcd0 msgr2=0x5654a71a8740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:34.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.206+0000 7f0315399b80 1 -- 172.21.15.73:0/2886141445 shutdown_connections 2023-08-10T11:53:34.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.206+0000 7f0315399b80 1 -- 172.21.15.73:0/2886141445 wait complete. 2023-08-10T11:53:34.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.206+0000 7f0315399b80 20 client.15825 trim_cache size 0 max 16384 2023-08-10T11:53:34.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.231+0000 7f0315399b80 1 Processor -- start 2023-08-10T11:53:34.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.231+0000 7f0315399b80 1 -- start start 2023-08-10T11:53:34.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.231+0000 7f0315399b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654a71a24b0 0x5654a719e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.231+0000 7f0315399b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654a71a2dd0 0x5654a71cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.231+0000 7f0315399b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5654a71a7290 0x5654a719c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.231+0000 7f0315399b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a6f76920 con 0x5654a71a7290 2023-08-10T11:53:34.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.231+0000 7f0315399b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a719ccb0 con 0x5654a71a24b0 2023-08-10T11:53:34.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.231+0000 7f0315399b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a719e580 con 0x5654a71a2dd0 2023-08-10T11:53:34.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.231+0000 7f030359e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5654a71a7290 0x5654a719c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.231+0000 7f0302d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654a71a24b0 0x5654a719e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.231+0000 7f030359e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5654a71a7290 0x5654a719c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33566/0 (socket says 172.21.15.73:33566) 2023-08-10T11:53:34.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.231+0000 7f0302d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654a71a24b0 0x5654a719e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:48212/0 (socket says 172.21.15.73:48212) 2023-08-10T11:53:34.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.231+0000 7f030359e700 1 -- 172.21.15.73:0/2395698274 learned_addr learned my addr 172.21.15.73:0/2395698274 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:34.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.231+0000 7f030259c700 1 --2- 172.21.15.73:0/2395698274 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654a71a2dd0 0x5654a71cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.232+0000 7f0302d9d700 1 -- 172.21.15.73:0/2395698274 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654a71a2dd0 msgr2=0x5654a71cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.232+0000 7f0302d9d700 1 --2- 172.21.15.73:0/2395698274 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654a71a2dd0 0x5654a71cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.232+0000 7f0302d9d700 1 -- 172.21.15.73:0/2395698274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5654a71a7290 msgr2=0x5654a719c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.232+0000 7f0302d9d700 1 --2- 172.21.15.73:0/2395698274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5654a71a7290 0x5654a719c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.232+0000 7f0302d9d700 1 -- 172.21.15.73:0/2395698274 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654a6f09c60 con 0x5654a71a24b0 2023-08-10T11:53:34.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.232+0000 7f0302d9d700 1 --2- 172.21.15.73:0/2395698274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654a71a24b0 0x5654a719e970 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f02f40cb610 tx=0x7f02f401a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba90bd61fec2b0e3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:34.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.232+0000 7f02e9ffb700 1 -- 172.21.15.73:0/2395698274 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f40a3310 con 0x5654a71a24b0 2023-08-10T11:53:34.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.232+0000 7f02e9ffb700 1 -- 172.21.15.73:0/2395698274 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f02f40992f0 con 0x5654a71a24b0 2023-08-10T11:53:34.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.232+0000 7f02e9ffb700 1 -- 172.21.15.73:0/2395698274 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f40aebc0 con 0x5654a71a24b0 2023-08-10T11:53:34.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.233+0000 7f0315399b80 1 -- 172.21.15.73:0/2395698274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654a71a24b0 msgr2=0x5654a719e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.233+0000 7f0315399b80 1 --2- 172.21.15.73:0/2395698274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654a71a24b0 0x5654a719e970 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f02f40cb610 tx=0x7f02f401a040 comp rx=0 tx=0).stop 2023-08-10T11:53:34.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.233+0000 7f0315399b80 1 -- 172.21.15.73:0/2395698274 shutdown_connections 2023-08-10T11:53:34.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.233+0000 7f0315399b80 1 --2- 172.21.15.73:0/2395698274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654a71a24b0 0x5654a719e970 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.233+0000 7f0315399b80 1 --2- 172.21.15.73:0/2395698274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5654a71a7290 0x5654a719c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.233+0000 7f0315399b80 1 --2- 172.21.15.73:0/2395698274 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654a71a2dd0 0x5654a71cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.233+0000 7f0315399b80 1 -- 172.21.15.73:0/2395698274 >> 172.21.15.73:0/2395698274 conn(0x5654a70ffcd0 msgr2=0x5654a719d700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:34.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.233+0000 7f0315399b80 1 -- 172.21.15.73:0/2395698274 shutdown_connections 2023-08-10T11:53:34.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.233+0000 7f0315399b80 1 -- 172.21.15.73:0/2395698274 wait complete. 2023-08-10T11:53:34.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.234+0000 7f0315399b80 1 -- start start 2023-08-10T11:53:34.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.234+0000 7f0315399b80 1 Processor -- start 2023-08-10T11:53:34.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.234+0000 7f0315399b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654a71a24b0 0x5654a71bdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.234+0000 7f0315399b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5654a71a2dd0 0x5654a71be3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.234+0000 7f0315399b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654a71a7290 0x5654a71be930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.234+0000 7f0315399b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a71c90b0 con 0x5654a71a2dd0 2023-08-10T11:53:34.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.234+0000 7f0315399b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a71c9220 con 0x5654a71a7290 2023-08-10T11:53:34.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.234+0000 7f0315399b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654a71c93e0 con 0x5654a71a24b0 2023-08-10T11:53:34.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.234+0000 7f0315399b80 10 client.0 _ll_register_callbacks cb 0x5654a7090680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:34.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.234+0000 7f030259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5654a71a2dd0 0x5654a71be3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.234+0000 7f0302d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654a71a24b0 0x5654a71bdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.234+0000 7f030259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5654a71a2dd0 0x5654a71be3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33570/0 (socket says 172.21.15.73:33570) 2023-08-10T11:53:34.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.234+0000 7f030259c700 1 -- 172.21.15.73:0/1543772698 learned_addr learned my addr 172.21.15.73:0/1543772698 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:34.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.234+0000 7f030359e700 1 --2- 172.21.15.73:0/1543772698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654a71a7290 0x5654a71be930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.235+0000 7f030259c700 1 -- 172.21.15.73:0/1543772698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654a71a24b0 msgr2=0x5654a71bdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.235+0000 7f030259c700 1 --2- 172.21.15.73:0/1543772698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654a71a24b0 0x5654a71bdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.235+0000 7f030259c700 1 -- 172.21.15.73:0/1543772698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654a71a7290 msgr2=0x5654a71be930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.235+0000 7f030259c700 1 --2- 172.21.15.73:0/1543772698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654a71a7290 0x5654a71be930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.235+0000 7f030259c700 1 -- 172.21.15.73:0/1543772698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03041a3600 con 0x5654a71a2dd0 2023-08-10T11:53:34.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.235+0000 7f030259c700 1 --2- 172.21.15.73:0/1543772698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5654a71a2dd0 0x5654a71be3f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f02f8005d90 tx=0x7f02f803b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d17a6cb435a231 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:34.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.235+0000 7f02e6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:34.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.235+0000 7f02e6ff5700 1 -- 172.21.15.73:0/1543772698 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f802a020 con 0x5654a71a2dd0 2023-08-10T11:53:34.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.235+0000 7f02e6ff5700 1 -- 172.21.15.73:0/1543772698 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f02f8017040 con 0x5654a71a2dd0 2023-08-10T11:53:34.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.235+0000 7f0315399b80 1 -- 172.21.15.73:0/1543772698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f02f8015070 con 0x5654a71a2dd0 2023-08-10T11:53:34.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.235+0000 7f02e6ff5700 1 -- 172.21.15.73:0/1543772698 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02f802c070 con 0x5654a71a2dd0 2023-08-10T11:53:34.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.235+0000 7f0315399b80 10 client.15831 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:34.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.235+0000 7f0315399b80 1 -- 172.21.15.73:0/1543772698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5654a6f47250 con 0x5654a71a2dd0 2023-08-10T11:53:34.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.236+0000 7f02e6ff5700 1 -- 172.21.15.73:0/1543772698 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f02f8015070 con 0x5654a71a2dd0 2023-08-10T11:53:34.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.236+0000 7f02e6ff5700 1 -- 172.21.15.73:0/1543772698 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f02f8011720 con 0x5654a71a2dd0 2023-08-10T11:53:34.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.236+0000 7f0315399b80 10 client.15831 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:34.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.236+0000 7f0315399b80 10 client.15831 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2023-08-10T11:53:34.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.236+0000 7f0315399b80 20 client.15831 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:34.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.236+0000 7f0315399b80 1 --2- 172.21.15.73:0/1543772698 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x5654a71ca5f0 0x5654a72245f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.236+0000 7f0315399b80 4 client.15831 mds_command: new command op to 24419 tid=0[{"prefix": "damage ls"}] 2023-08-10T11:53:34.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.236+0000 7f0315399b80 1 -- 172.21.15.73:0/1543772698 --> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5654a70ec780 con 0x5654a71ca5f0 2023-08-10T11:53:34.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.236+0000 7f0302d9d700 1 --2- 172.21.15.73:0/1543772698 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x5654a71ca5f0 0x5654a72245f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.237+0000 7f02e6ff5700 10 client.15831 ms_handle_connect on v2:172.21.15.152:6832/4148407154 2023-08-10T11:53:34.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.237+0000 7f0302d9d700 1 --2- 172.21.15.73:0/1543772698 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x5654a71ca5f0 0x5654a72245f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ce382f74dc89fad7 server_cookie=feba6bef07229928 in_seq=0 out_seq=0 2023-08-10T11:53:34.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.237+0000 7f02e6ff5700 1 -- 172.21.15.73:0/1543772698 <== mds.4 v2:172.21.15.152:6832/4148407154 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5654a70ec780 con 0x5654a71ca5f0 2023-08-10T11:53:34.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.237+0000 7f02e6ff5700 10 client.15831 handle_command_reply: tid=0 2023-08-10T11:53:34.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.237+0000 7f0315399b80 1 client.15831 shutdown 2023-08-10T11:53:34.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.237+0000 7f0315399b80 1 -- 172.21.15.73:0/1543772698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5654a71a2dd0 msgr2=0x5654a71be3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.237+0000 7f0315399b80 1 --2- 172.21.15.73:0/1543772698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5654a71a2dd0 0x5654a71be3f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f02f8005d90 tx=0x7f02f803b730 comp rx=0 tx=0).stop 2023-08-10T11:53:34.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.237+0000 7f0315399b80 1 -- 172.21.15.73:0/1543772698 shutdown_connections 2023-08-10T11:53:34.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.237+0000 7f0315399b80 1 --2- 172.21.15.73:0/1543772698 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x5654a71ca5f0 0x5654a72245f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.237+0000 7f0315399b80 1 --2- 172.21.15.73:0/1543772698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654a71a7290 0x5654a71be930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.237+0000 7f0315399b80 1 --2- 172.21.15.73:0/1543772698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654a71a24b0 0x5654a71bdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.237+0000 7f0315399b80 1 --2- 172.21.15.73:0/1543772698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5654a71a2dd0 0x5654a71be3f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.237+0000 7f0315399b80 1 -- 172.21.15.73:0/1543772698 >> 172.21.15.73:0/1543772698 conn(0x5654a70ffcd0 msgr2=0x5654a71a12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:34.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.237+0000 7f02e6ff5700 0 client.15831 ms_handle_reset on v2:172.21.15.152:6832/4148407154 2023-08-10T11:53:34.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.237+0000 7f0315399b80 1 -- 172.21.15.73:0/1543772698 shutdown_connections 2023-08-10T11:53:34.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.237+0000 7f0315399b80 1 -- 172.21.15.73:0/1543772698 wait complete. 2023-08-10T11:53:34.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.237+0000 7f0315399b80 20 client.15831 trim_cache size 0 max 16384 2023-08-10T11:53:34.248 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2023-08-10T11:53:34.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.238+0000 7f0309200700 1 -- 172.21.15.73:0/4119372032 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f02ec0a1480 msgr2=0x7f02ec0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.238+0000 7f0309200700 1 --2- 172.21.15.73:0/4119372032 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f02ec0a1480 0x7f02ec0a3940 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f03040ff710 tx=0x7f02f800b410 comp rx=0 tx=0).stop 2023-08-10T11:53:34.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.238+0000 7f0309200700 1 -- 172.21.15.73:0/4119372032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03041001e0 msgr2=0x7f03041973a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.238+0000 7f0309200700 1 --2- 172.21.15.73:0/4119372032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03041001e0 0x7f03041973a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f02f40095c0 tx=0x7f02f400f710 comp rx=0 tx=0).stop 2023-08-10T11:53:34.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.238+0000 7f0309200700 1 -- 172.21.15.73:0/4119372032 shutdown_connections 2023-08-10T11:53:34.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.238+0000 7f0309200700 1 --2- 172.21.15.73:0/4119372032 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f02ec0a1480 0x7f02ec0a3940 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.238+0000 7f0309200700 1 --2- 172.21.15.73:0/4119372032 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0304197ec0 0x7f03041a2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.238+0000 7f0309200700 1 --2- 172.21.15.73:0/4119372032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03041001e0 0x7f03041973a0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.238+0000 7f0309200700 1 --2- 172.21.15.73:0/4119372032 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0304104810 0x7f03041978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.238+0000 7f0309200700 1 -- 172.21.15.73:0/4119372032 >> 172.21.15.73:0/4119372032 conn(0x7f0304074780 msgr2=0x7f03040fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:34.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.238+0000 7f0309200700 1 -- 172.21.15.73:0/4119372032 shutdown_connections 2023-08-10T11:53:34.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.238+0000 7f0309200700 1 -- 172.21.15.73:0/4119372032 wait complete. 2023-08-10T11:53:34.256 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-08-10T11:53:34.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.442+0000 7faf2ea9e700 1 -- 172.21.15.73:0/132906265 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf280ff9a0 msgr2=0x7faf281039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.442+0000 7faf2ea9e700 1 --2- 172.21.15.73:0/132906265 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf280ff9a0 0x7faf281039e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7faf14009990 tx=0x7faf14009ca0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.442+0000 7faf2ea9e700 1 -- 172.21.15.73:0/132906265 shutdown_connections 2023-08-10T11:53:34.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.442+0000 7faf2ea9e700 1 --2- 172.21.15.73:0/132906265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf28104110 0x7faf2810bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.442+0000 7faf2ea9e700 1 --2- 172.21.15.73:0/132906265 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf280feff0 0x7faf280ff3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.442+0000 7faf2ea9e700 1 --2- 172.21.15.73:0/132906265 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf280ff9a0 0x7faf281039e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.442+0000 7faf2ea9e700 1 -- 172.21.15.73:0/132906265 >> 172.21.15.73:0/132906265 conn(0x7faf28076be0 msgr2=0x7faf280fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:34.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.442+0000 7faf2ea9e700 1 -- 172.21.15.73:0/132906265 shutdown_connections 2023-08-10T11:53:34.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.442+0000 7faf2ea9e700 1 -- 172.21.15.73:0/132906265 wait complete. 2023-08-10T11:53:34.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.443+0000 7faf2ea9e700 1 Processor -- start 2023-08-10T11:53:34.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.443+0000 7faf2ea9e700 1 -- start start 2023-08-10T11:53:34.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.443+0000 7faf2ea9e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf280feff0 0x7faf28194640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.443+0000 7faf2ea9e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf28104110 0x7faf28194b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.444+0000 7faf2ea9e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf28198fe0 0x7faf28199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.444+0000 7faf2ea9e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf28199a60 con 0x7faf280feff0 2023-08-10T11:53:34.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.444+0000 7faf2ea9e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf28199bd0 con 0x7faf28104110 2023-08-10T11:53:34.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.444+0000 7faf2ea9e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf28199d90 con 0x7faf28198fe0 2023-08-10T11:53:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.444+0000 7faf2c83a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf280feff0 0x7faf28194640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.444+0000 7faf2c83a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf280feff0 0x7faf28194640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33582/0 (socket says 172.21.15.73:33582) 2023-08-10T11:53:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.444+0000 7faf2c83a700 1 -- 172.21.15.73:0/878399975 learned_addr learned my addr 172.21.15.73:0/878399975 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.444+0000 7faf2d03b700 1 --2- 172.21.15.73:0/878399975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf28198fe0 0x7faf28199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.444+0000 7faf27fff700 1 --2- 172.21.15.73:0/878399975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf28104110 0x7faf28194b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.444+0000 7faf2c83a700 1 -- 172.21.15.73:0/878399975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf28198fe0 msgr2=0x7faf28199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.444+0000 7faf2c83a700 1 --2- 172.21.15.73:0/878399975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf28198fe0 0x7faf28199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.444+0000 7faf2c83a700 1 -- 172.21.15.73:0/878399975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf28104110 msgr2=0x7faf28194b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.444+0000 7faf2c83a700 1 --2- 172.21.15.73:0/878399975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf28104110 0x7faf28194b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.444+0000 7faf2c83a700 1 -- 172.21.15.73:0/878399975 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf140095f0 con 0x7faf280feff0 2023-08-10T11:53:34.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.444+0000 7faf2c83a700 1 --2- 172.21.15.73:0/878399975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf280feff0 0x7faf28194640 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00edd0 tx=0x7faf1c00a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:34.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.444+0000 7faf25ffb700 1 -- 172.21.15.73:0/878399975 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c00ac50 con 0x7faf280feff0 2023-08-10T11:53:34.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.445+0000 7faf25ffb700 1 -- 172.21.15.73:0/878399975 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf1c012070 con 0x7faf280feff0 2023-08-10T11:53:34.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.445+0000 7faf25ffb700 1 -- 172.21.15.73:0/878399975 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c015670 con 0x7faf280feff0 2023-08-10T11:53:34.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.445+0000 7faf2ea9e700 1 -- 172.21.15.73:0/878399975 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf281a12f0 con 0x7faf280feff0 2023-08-10T11:53:34.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.445+0000 7faf2ea9e700 1 -- 172.21.15.73:0/878399975 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf281a1780 con 0x7faf280feff0 2023-08-10T11:53:34.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.448+0000 7faf25ffb700 1 -- 172.21.15.73:0/878399975 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7faf1c014030 con 0x7faf280feff0 2023-08-10T11:53:34.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.449+0000 7faf25ffb700 1 --2- 172.21.15.73:0/878399975 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7faf180a13e0 0x7faf180a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.449+0000 7faf27fff700 1 --2- 172.21.15.73:0/878399975 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7faf180a13e0 0x7faf180a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.449+0000 7faf25ffb700 1 -- 172.21.15.73:0/878399975 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7faf1c0cc630 con 0x7faf280feff0 2023-08-10T11:53:34.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.449+0000 7faf27fff700 1 --2- 172.21.15.73:0/878399975 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7faf180a13e0 0x7faf180a38a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faf1400b5c0 tx=0x7faf14005960 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:34.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.450+0000 7faf3ac37b80 1 Processor -- start 2023-08-10T11:53:34.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.450+0000 7faf3ac37b80 1 -- start start 2023-08-10T11:53:34.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.450+0000 7faf3ac37b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583b606f50 0x55583b607330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.450+0000 7faf3ac37b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55583b607870 0x55583b6012c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.450+0000 7faf3ac37b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55583b601800 0x55583b601c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.450+0000 7faf3ac37b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55583b57cdc0 con 0x55583b601800 2023-08-10T11:53:34.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.450+0000 7faf3ac37b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55583b559590 con 0x55583b606f50 2023-08-10T11:53:34.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.450+0000 7faf3ac37b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55583b556eb0 con 0x55583b607870 2023-08-10T11:53:34.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.450+0000 7faf2d03b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55583b601800 0x55583b601c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.450+0000 7faf2d03b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55583b601800 0x55583b601c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33592/0 (socket says 172.21.15.73:33592) 2023-08-10T11:53:34.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.450+0000 7faf2d03b700 1 -- 172.21.15.73:0/3244138935 learned_addr learned my addr 172.21.15.73:0/3244138935 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:34.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.450+0000 7faf2c83a700 1 --2- 172.21.15.73:0/3244138935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583b606f50 0x55583b607330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.451+0000 7faf2d03b700 1 -- 172.21.15.73:0/3244138935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55583b607870 msgr2=0x55583b6012c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T11:53:34.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.451+0000 7faf2d03b700 1 --2- 172.21.15.73:0/3244138935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55583b607870 0x55583b6012c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.451+0000 7faf2d03b700 1 -- 172.21.15.73:0/3244138935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583b606f50 msgr2=0x55583b607330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.451+0000 7faf2d03b700 1 --2- 172.21.15.73:0/3244138935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583b606f50 0x55583b607330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.451+0000 7faf2d03b700 1 -- 172.21.15.73:0/3244138935 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55583b3d3630 con 0x55583b601800 2023-08-10T11:53:34.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.451+0000 7faf2c83a700 1 --2- 172.21.15.73:0/3244138935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583b606f50 0x55583b607330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:53:34.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.451+0000 7faf2d03b700 1 --2- 172.21.15.73:0/3244138935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55583b601800 0x55583b601c80 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7faf20003f30 tx=0x7faf20009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2572cb1a111dad3a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:34.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.451+0000 7faf12ffd700 1 -- 172.21.15.73:0/3244138935 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf20004740 con 0x55583b601800 2023-08-10T11:53:34.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.451+0000 7faf12ffd700 1 -- 172.21.15.73:0/3244138935 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf2000f040 con 0x55583b601800 2023-08-10T11:53:34.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.451+0000 7faf12ffd700 1 -- 172.21.15.73:0/3244138935 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf200156e0 con 0x55583b601800 2023-08-10T11:53:34.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.452+0000 7faf3ac37b80 1 -- 172.21.15.73:0/3244138935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55583b601800 msgr2=0x55583b601c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.452+0000 7faf3ac37b80 1 --2- 172.21.15.73:0/3244138935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55583b601800 0x55583b601c80 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7faf20003f30 tx=0x7faf20009c20 comp rx=0 tx=0).stop 2023-08-10T11:53:34.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.452+0000 7faf3ac37b80 1 -- 172.21.15.73:0/3244138935 shutdown_connections 2023-08-10T11:53:34.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.452+0000 7faf3ac37b80 1 --2- 172.21.15.73:0/3244138935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583b606f50 0x55583b607330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.452+0000 7faf3ac37b80 1 --2- 172.21.15.73:0/3244138935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55583b601800 0x55583b601c80 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.452+0000 7faf3ac37b80 1 --2- 172.21.15.73:0/3244138935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55583b607870 0x55583b6012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.452+0000 7faf3ac37b80 1 -- 172.21.15.73:0/3244138935 >> 172.21.15.73:0/3244138935 conn(0x55583b55ecd0 msgr2=0x55583b5fc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:34.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.453+0000 7faf3ac37b80 1 -- 172.21.15.73:0/3244138935 shutdown_connections 2023-08-10T11:53:34.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.453+0000 7faf3ac37b80 1 -- 172.21.15.73:0/3244138935 wait complete. 2023-08-10T11:53:34.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.453+0000 7faf3ac37b80 1 -- start start 2023-08-10T11:53:34.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.453+0000 7faf3ac37b80 1 Processor -- start 2023-08-10T11:53:34.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.454+0000 7faf3ac37b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583b601800 0x55583b60d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.454+0000 7faf3ac37b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55583b606f50 0x55583b60ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.454+0000 7faf3ac37b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55583b60b2a0 0x55583b61b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.454+0000 7faf3ac37b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55583b5527a0 con 0x55583b60b2a0 2023-08-10T11:53:34.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.454+0000 7faf3ac37b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55583b4f1ac0 con 0x55583b601800 2023-08-10T11:53:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.454+0000 7faf3ac37b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55583b4f17c0 con 0x55583b606f50 2023-08-10T11:53:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.454+0000 7faf3ac37b80 10 client.0 _ll_register_callbacks cb 0x55583b4ef680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.454+0000 7faf2d03b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55583b60b2a0 0x55583b61b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.454+0000 7faf2d03b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55583b60b2a0 0x55583b61b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33598/0 (socket says 172.21.15.73:33598) 2023-08-10T11:53:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.454+0000 7faf2d03b700 1 -- 172.21.15.73:0/1438972389 learned_addr learned my addr 172.21.15.73:0/1438972389 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.454+0000 7faf2c83a700 1 --2- 172.21.15.73:0/1438972389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583b601800 0x55583b60d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.454+0000 7faf27fff700 1 --2- 172.21.15.73:0/1438972389 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55583b606f50 0x55583b60ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.454+0000 7faf2d03b700 1 -- 172.21.15.73:0/1438972389 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55583b606f50 msgr2=0x55583b60ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.454+0000 7faf2d03b700 1 --2- 172.21.15.73:0/1438972389 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55583b606f50 0x55583b60ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.454+0000 7faf2d03b700 1 -- 172.21.15.73:0/1438972389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583b601800 msgr2=0x55583b60d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.454+0000 7faf2d03b700 1 --2- 172.21.15.73:0/1438972389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583b601800 0x55583b60d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.454+0000 7faf2d03b700 1 -- 172.21.15.73:0/1438972389 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf20003b60 con 0x55583b60b2a0 2023-08-10T11:53:34.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.454+0000 7faf27fff700 1 --2- 172.21.15.73:0/1438972389 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55583b606f50 0x55583b60ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:34.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.454+0000 7faf2c83a700 1 --2- 172.21.15.73:0/1438972389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583b601800 0x55583b60d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:53:34.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.455+0000 7faf2d03b700 1 --2- 172.21.15.73:0/1438972389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55583b60b2a0 0x55583b61b830 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7faf200077b0 tx=0x7faf200077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9c9a877e5a5c6b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:34.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.455+0000 7faf07fff700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:34.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.455+0000 7faf07fff700 1 -- 172.21.15.73:0/1438972389 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf20007e40 con 0x55583b60b2a0 2023-08-10T11:53:34.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.455+0000 7faf07fff700 1 -- 172.21.15.73:0/1438972389 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7faf20005050 con 0x55583b60b2a0 2023-08-10T11:53:34.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.455+0000 7faf3ac37b80 1 -- 172.21.15.73:0/1438972389 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55583b5f4470 con 0x55583b60b2a0 2023-08-10T11:53:34.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.455+0000 7faf07fff700 1 -- 172.21.15.73:0/1438972389 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf20005210 con 0x55583b60b2a0 2023-08-10T11:53:34.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.455+0000 7faf3ac37b80 10 client.15843 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:34.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.455+0000 7faf3ac37b80 1 -- 172.21.15.73:0/1438972389 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55583b37fde0 con 0x55583b60b2a0 2023-08-10T11:53:34.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.455+0000 7faf07fff700 1 -- 172.21.15.73:0/1438972389 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55583b5f4470 con 0x55583b60b2a0 2023-08-10T11:53:34.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.455+0000 7faf07fff700 1 -- 172.21.15.73:0/1438972389 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7faf20024070 con 0x55583b60b2a0 2023-08-10T11:53:34.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.455+0000 7faf3ac37b80 10 client.15843 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:34.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.455+0000 7faf3ac37b80 10 client.15843 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-08-10T11:53:34.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.455+0000 7faf3ac37b80 20 client.15843 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:34.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.456+0000 7faf3ac37b80 1 --2- 172.21.15.73:0/1438972389 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x55583b61fa60 0x55583b621e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.456+0000 7faf3ac37b80 4 client.15843 mds_command: new command op to 24443 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:53:34.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.456+0000 7faf3ac37b80 1 -- 172.21.15.73:0/1438972389 --> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55583b5d09d0 con 0x55583b61fa60 2023-08-10T11:53:34.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.456+0000 7faf2c83a700 1 --2- 172.21.15.73:0/1438972389 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x55583b61fa60 0x55583b621e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.456+0000 7faf07fff700 10 client.15843 ms_handle_connect on v2:172.21.15.152:6834/1791572604 2023-08-10T11:53:34.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.456+0000 7faf2c83a700 1 --2- 172.21.15.73:0/1438972389 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x55583b61fa60 0x55583b621e80 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2b7d7ddbc9ae63db server_cookie=178d8b3e3d2b9561 in_seq=0 out_seq=0 2023-08-10T11:53:34.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.457+0000 7faf07fff700 1 -- 172.21.15.73:0/1438972389 <== mds.3 v2:172.21.15.152:6834/1791572604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55583b5d09d0 con 0x55583b61fa60 2023-08-10T11:53:34.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.457+0000 7faf07fff700 10 client.15843 handle_command_reply: tid=0 2023-08-10T11:53:34.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.457+0000 7faf3ac37b80 1 client.15843 shutdown 2023-08-10T11:53:34.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.457+0000 7faf3ac37b80 1 -- 172.21.15.73:0/1438972389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55583b60b2a0 msgr2=0x55583b61b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.457+0000 7faf3ac37b80 1 --2- 172.21.15.73:0/1438972389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55583b60b2a0 0x55583b61b830 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7faf200077b0 tx=0x7faf200077e0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.457+0000 7faf3ac37b80 1 -- 172.21.15.73:0/1438972389 shutdown_connections 2023-08-10T11:53:34.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.457+0000 7faf3ac37b80 1 --2- 172.21.15.73:0/1438972389 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x55583b61fa60 0x55583b621e80 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.457+0000 7faf3ac37b80 1 --2- 172.21.15.73:0/1438972389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583b601800 0x55583b60d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.457+0000 7faf3ac37b80 1 --2- 172.21.15.73:0/1438972389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55583b60b2a0 0x55583b61b830 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.457+0000 7faf3ac37b80 1 --2- 172.21.15.73:0/1438972389 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55583b606f50 0x55583b60ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.457+0000 7faf3ac37b80 1 -- 172.21.15.73:0/1438972389 >> 172.21.15.73:0/1438972389 conn(0x55583b55ecd0 msgr2=0x55583b5fb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:34.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.457+0000 7faf07fff700 0 client.15843 ms_handle_reset on v2:172.21.15.152:6834/1791572604 2023-08-10T11:53:34.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.457+0000 7faf3ac37b80 1 -- 172.21.15.73:0/1438972389 shutdown_connections 2023-08-10T11:53:34.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.458+0000 7faf3ac37b80 1 -- 172.21.15.73:0/1438972389 wait complete. 2023-08-10T11:53:34.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.458+0000 7faf3ac37b80 20 client.15843 trim_cache size 0 max 16384 2023-08-10T11:53:34.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.482+0000 7faf3ac37b80 1 Processor -- start 2023-08-10T11:53:34.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.482+0000 7faf3ac37b80 1 -- start start 2023-08-10T11:53:34.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.482+0000 7faf3ac37b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583b601800 0x55583b6064a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.482+0000 7faf3ac37b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55583b606f50 0x55583b616770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.482+0000 7faf3ac37b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55583b60b2a0 0x55583b60a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.482+0000 7faf3ac37b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55583b3d5920 con 0x55583b60b2a0 2023-08-10T11:53:34.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.482+0000 7faf3ac37b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55583b5d09d0 con 0x55583b601800 2023-08-10T11:53:34.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.482+0000 7faf3ac37b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55583b5f4370 con 0x55583b606f50 2023-08-10T11:53:34.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.483+0000 7faf27fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55583b606f50 0x55583b616770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.483+0000 7faf27fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55583b606f50 0x55583b616770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:59110/0 (socket says 172.21.15.73:59110) 2023-08-10T11:53:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.483+0000 7faf27fff700 1 -- 172.21.15.73:0/2906158964 learned_addr learned my addr 172.21.15.73:0/2906158964 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.483+0000 7faf2d03b700 1 --2- 172.21.15.73:0/2906158964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55583b60b2a0 0x55583b60a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.483+0000 7faf2c83a700 1 --2- 172.21.15.73:0/2906158964 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583b601800 0x55583b6064a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.483+0000 7faf27fff700 1 -- 172.21.15.73:0/2906158964 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583b601800 msgr2=0x55583b6064a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.483+0000 7faf27fff700 1 --2- 172.21.15.73:0/2906158964 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583b601800 0x55583b6064a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.483+0000 7faf27fff700 1 -- 172.21.15.73:0/2906158964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55583b60b2a0 msgr2=0x55583b60a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.483+0000 7faf27fff700 1 --2- 172.21.15.73:0/2906158964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55583b60b2a0 0x55583b60a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.483+0000 7faf27fff700 1 -- 172.21.15.73:0/2906158964 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55583b5f86a0 con 0x55583b606f50 2023-08-10T11:53:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.483+0000 7faf2c83a700 1 --2- 172.21.15.73:0/2906158964 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583b601800 0x55583b6064a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:53:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.483+0000 7faf27fff700 1 --2- 172.21.15.73:0/2906158964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55583b606f50 0x55583b616770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faf14009990 tx=0x7faf14025000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa2064d560fa38eb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.483+0000 7faf137fe700 1 -- 172.21.15.73:0/2906158964 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1402d070 con 0x55583b606f50 2023-08-10T11:53:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.483+0000 7faf137fe700 1 -- 172.21.15.73:0/2906158964 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf14020040 con 0x55583b606f50 2023-08-10T11:53:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.483+0000 7faf137fe700 1 -- 172.21.15.73:0/2906158964 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1401a850 con 0x55583b606f50 2023-08-10T11:53:34.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.484+0000 7faf3ac37b80 1 -- 172.21.15.73:0/2906158964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55583b606f50 msgr2=0x55583b616770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.484+0000 7faf3ac37b80 1 --2- 172.21.15.73:0/2906158964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55583b606f50 0x55583b616770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faf14009990 tx=0x7faf14025000 comp rx=0 tx=0).stop 2023-08-10T11:53:34.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.484+0000 7faf3ac37b80 1 -- 172.21.15.73:0/2906158964 shutdown_connections 2023-08-10T11:53:34.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.484+0000 7faf3ac37b80 1 --2- 172.21.15.73:0/2906158964 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583b601800 0x55583b6064a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.484+0000 7faf3ac37b80 1 --2- 172.21.15.73:0/2906158964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55583b60b2a0 0x55583b60a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.484+0000 7faf3ac37b80 1 --2- 172.21.15.73:0/2906158964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55583b606f50 0x55583b616770 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.484+0000 7faf3ac37b80 1 -- 172.21.15.73:0/2906158964 >> 172.21.15.73:0/2906158964 conn(0x55583b55ecd0 msgr2=0x55583b61ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:34.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.485+0000 7faf3ac37b80 1 -- 172.21.15.73:0/2906158964 shutdown_connections 2023-08-10T11:53:34.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.485+0000 7faf3ac37b80 1 -- 172.21.15.73:0/2906158964 wait complete. 2023-08-10T11:53:34.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.485+0000 7faf3ac37b80 1 -- start start 2023-08-10T11:53:34.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.485+0000 7faf3ac37b80 1 Processor -- start 2023-08-10T11:53:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.486+0000 7faf3ac37b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583b601800 0x55583b602970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.486+0000 7faf3ac37b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55583b606f50 0x55583b602eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.486+0000 7faf3ac37b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55583b60b2a0 0x55583b6033f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.486+0000 7faf3ac37b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55583b603930 con 0x55583b60b2a0 2023-08-10T11:53:34.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.486+0000 7faf3ac37b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55583b603a70 con 0x55583b601800 2023-08-10T11:53:34.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.486+0000 7faf3ac37b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55583b603c30 con 0x55583b606f50 2023-08-10T11:53:34.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.486+0000 7faf3ac37b80 10 client.0 _ll_register_callbacks cb 0x55583b4ef680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:34.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.486+0000 7faf2d03b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55583b60b2a0 0x55583b6033f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.486+0000 7faf2d03b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55583b60b2a0 0x55583b6033f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33612/0 (socket says 172.21.15.73:33612) 2023-08-10T11:53:34.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.486+0000 7faf2d03b700 1 -- 172.21.15.73:0/1690393369 learned_addr learned my addr 172.21.15.73:0/1690393369 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:34.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.486+0000 7faf2d03b700 1 -- 172.21.15.73:0/1690393369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55583b606f50 msgr2=0x55583b602eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T11:53:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.486+0000 7faf2d03b700 1 --2- 172.21.15.73:0/1690393369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55583b606f50 0x55583b602eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.486+0000 7faf2d03b700 1 -- 172.21.15.73:0/1690393369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583b601800 msgr2=0x55583b602970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.486+0000 7faf2d03b700 1 --2- 172.21.15.73:0/1690393369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583b601800 0x55583b602970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.486+0000 7faf2d03b700 1 -- 172.21.15.73:0/1690393369 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2810c500 con 0x55583b60b2a0 2023-08-10T11:53:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.486+0000 7faf2d03b700 1 --2- 172.21.15.73:0/1690393369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55583b60b2a0 0x55583b6033f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7faf20009c60 tx=0x7faf20003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d236e0e6d90916a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.486+0000 7faf07fff700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.487+0000 7faf07fff700 1 -- 172.21.15.73:0/1690393369 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf20015740 con 0x55583b60b2a0 2023-08-10T11:53:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.487+0000 7faf07fff700 1 -- 172.21.15.73:0/1690393369 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7faf2002f450 con 0x55583b60b2a0 2023-08-10T11:53:34.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.487+0000 7faf3ac37b80 1 -- 172.21.15.73:0/1690393369 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faf2000f040 con 0x55583b60b2a0 2023-08-10T11:53:34.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.487+0000 7faf07fff700 1 -- 172.21.15.73:0/1690393369 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf2002f610 con 0x55583b60b2a0 2023-08-10T11:53:34.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.487+0000 7faf3ac37b80 10 client.15849 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:34.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.487+0000 7faf3ac37b80 1 -- 172.21.15.73:0/1690393369 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55583b368c60 con 0x55583b60b2a0 2023-08-10T11:53:34.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.487+0000 7faf07fff700 1 -- 172.21.15.73:0/1690393369 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf2000f040 con 0x55583b60b2a0 2023-08-10T11:53:34.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.487+0000 7faf07fff700 1 -- 172.21.15.73:0/1690393369 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7faf20004040 con 0x55583b60b2a0 2023-08-10T11:53:34.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.487+0000 7faf3ac37b80 10 client.15849 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:34.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.487+0000 7faf3ac37b80 10 client.15849 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-08-10T11:53:34.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.487+0000 7faf3ac37b80 20 client.15849 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:34.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.487+0000 7faf3ac37b80 1 --2- 172.21.15.73:0/1690393369 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x55583b673c80 0x55583b6760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.487+0000 7faf3ac37b80 4 client.15849 mds_command: new command op to 24443 tid=0[{"prefix": "damage ls"}] 2023-08-10T11:53:34.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.487+0000 7faf3ac37b80 1 -- 172.21.15.73:0/1690393369 --> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55583b54b780 con 0x55583b673c80 2023-08-10T11:53:34.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.488+0000 7faf2c83a700 1 --2- 172.21.15.73:0/1690393369 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x55583b673c80 0x55583b6760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.488+0000 7faf07fff700 10 client.15849 ms_handle_connect on v2:172.21.15.152:6834/1791572604 2023-08-10T11:53:34.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.488+0000 7faf2c83a700 1 --2- 172.21.15.73:0/1690393369 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x55583b673c80 0x55583b6760a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b76bdc6cb6fc47d8 server_cookie=4c5e50fed6b73ba5 in_seq=0 out_seq=0 2023-08-10T11:53:34.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.488+0000 7faf07fff700 1 -- 172.21.15.73:0/1690393369 <== mds.3 v2:172.21.15.152:6834/1791572604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55583b54b780 con 0x55583b673c80 2023-08-10T11:53:34.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.488+0000 7faf07fff700 10 client.15849 handle_command_reply: tid=0 2023-08-10T11:53:34.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.488+0000 7faf3ac37b80 1 client.15849 shutdown 2023-08-10T11:53:34.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.488+0000 7faf3ac37b80 1 -- 172.21.15.73:0/1690393369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55583b60b2a0 msgr2=0x55583b6033f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.488+0000 7faf3ac37b80 1 --2- 172.21.15.73:0/1690393369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55583b60b2a0 0x55583b6033f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7faf20009c60 tx=0x7faf20003f30 comp rx=0 tx=0).stop 2023-08-10T11:53:34.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.489+0000 7faf3ac37b80 1 -- 172.21.15.73:0/1690393369 shutdown_connections 2023-08-10T11:53:34.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.489+0000 7faf3ac37b80 1 --2- 172.21.15.73:0/1690393369 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x55583b673c80 0x55583b6760a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.489+0000 7faf3ac37b80 1 --2- 172.21.15.73:0/1690393369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55583b601800 0x55583b602970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.489+0000 7faf07fff700 0 client.15849 ms_handle_reset on v2:172.21.15.152:6834/1791572604 2023-08-10T11:53:34.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.489+0000 7faf3ac37b80 1 --2- 172.21.15.73:0/1690393369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55583b60b2a0 0x55583b6033f0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.489+0000 7faf3ac37b80 1 --2- 172.21.15.73:0/1690393369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55583b606f50 0x55583b602eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.489+0000 7faf3ac37b80 1 -- 172.21.15.73:0/1690393369 >> 172.21.15.73:0/1690393369 conn(0x55583b55ecd0 msgr2=0x55583b61b510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:34.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.489+0000 7faf3ac37b80 1 -- 172.21.15.73:0/1690393369 shutdown_connections 2023-08-10T11:53:34.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.489+0000 7faf3ac37b80 1 -- 172.21.15.73:0/1690393369 wait complete. 2023-08-10T11:53:34.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.489+0000 7faf3ac37b80 20 client.15849 trim_cache size 0 max 16384 2023-08-10T11:53:34.499 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2023-08-10T11:53:34.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.490+0000 7faf2ea9e700 1 -- 172.21.15.73:0/878399975 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7faf180a13e0 msgr2=0x7faf180a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.490+0000 7faf2ea9e700 1 --2- 172.21.15.73:0/878399975 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7faf180a13e0 0x7faf180a38a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faf1400b5c0 tx=0x7faf14005960 comp rx=0 tx=0).stop 2023-08-10T11:53:34.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.490+0000 7faf2ea9e700 1 -- 172.21.15.73:0/878399975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf280feff0 msgr2=0x7faf28194640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.490+0000 7faf2ea9e700 1 --2- 172.21.15.73:0/878399975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf280feff0 0x7faf28194640 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00edd0 tx=0x7faf1c00a630 comp rx=0 tx=0).stop 2023-08-10T11:53:34.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.490+0000 7faf2ea9e700 1 -- 172.21.15.73:0/878399975 shutdown_connections 2023-08-10T11:53:34.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.490+0000 7faf2ea9e700 1 --2- 172.21.15.73:0/878399975 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7faf180a13e0 0x7faf180a38a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.490+0000 7faf2ea9e700 1 --2- 172.21.15.73:0/878399975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf28198fe0 0x7faf28199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.490+0000 7faf2ea9e700 1 --2- 172.21.15.73:0/878399975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf280feff0 0x7faf28194640 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.490+0000 7faf2ea9e700 1 --2- 172.21.15.73:0/878399975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf28104110 0x7faf28194b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.490+0000 7faf2ea9e700 1 -- 172.21.15.73:0/878399975 >> 172.21.15.73:0/878399975 conn(0x7faf28076be0 msgr2=0x7faf28103780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:34.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.490+0000 7faf2ea9e700 1 -- 172.21.15.73:0/878399975 shutdown_connections 2023-08-10T11:53:34.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.490+0000 7faf2ea9e700 1 -- 172.21.15.73:0/878399975 wait complete. 2023-08-10T11:53:34.507 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-08-10T11:53:34.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.685+0000 7f2baa3a1700 1 -- 172.21.15.73:0/1203250372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ba40feff0 msgr2=0x7f2ba40ff3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.685+0000 7f2baa3a1700 1 --2- 172.21.15.73:0/1203250372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ba40feff0 0x7f2ba40ff3d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009990 tx=0x7f2b94009ca0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.685+0000 7f2baa3a1700 1 -- 172.21.15.73:0/1203250372 shutdown_connections 2023-08-10T11:53:34.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.685+0000 7f2baa3a1700 1 --2- 172.21.15.73:0/1203250372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ba4104110 0x7f2ba410bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.685+0000 7f2baa3a1700 1 --2- 172.21.15.73:0/1203250372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ba40feff0 0x7f2ba40ff3d0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.685+0000 7f2baa3a1700 1 --2- 172.21.15.73:0/1203250372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ba40ff9a0 0x7f2ba41039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.685+0000 7f2baa3a1700 1 -- 172.21.15.73:0/1203250372 >> 172.21.15.73:0/1203250372 conn(0x7f2ba4076be0 msgr2=0x7f2ba40fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:34.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.685+0000 7f2baa3a1700 1 -- 172.21.15.73:0/1203250372 shutdown_connections 2023-08-10T11:53:34.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.686+0000 7f2baa3a1700 1 -- 172.21.15.73:0/1203250372 wait complete. 2023-08-10T11:53:34.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.686+0000 7f2baa3a1700 1 Processor -- start 2023-08-10T11:53:34.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.686+0000 7f2baa3a1700 1 -- start start 2023-08-10T11:53:34.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.687+0000 7f2baa3a1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ba40feff0 0x7f2ba4194610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.687+0000 7f2baa3a1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ba4104110 0x7f2ba4194b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.687+0000 7f2baa3a1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ba4198fb0 0x7f2ba4199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.687+0000 7f2baa3a1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba4199a30 con 0x7f2ba4104110 2023-08-10T11:53:34.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.687+0000 7f2baa3a1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba4199ba0 con 0x7f2ba40feff0 2023-08-10T11:53:34.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.687+0000 7f2baa3a1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba4199d60 con 0x7f2ba4198fb0 2023-08-10T11:53:34.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.687+0000 7f2ba3fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ba40feff0 0x7f2ba4194610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.687+0000 7f2ba37fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ba4104110 0x7f2ba4194b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.687+0000 7f2ba3fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ba40feff0 0x7f2ba4194610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:48272/0 (socket says 172.21.15.73:48272) 2023-08-10T11:53:34.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.687+0000 7f2ba3fff700 1 -- 172.21.15.73:0/1465171740 learned_addr learned my addr 172.21.15.73:0/1465171740 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:34.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.687+0000 7f2ba37fe700 1 -- 172.21.15.73:0/1465171740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ba4198fb0 msgr2=0x7f2ba4199430 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-10T11:53:34.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.687+0000 7f2ba37fe700 1 --2- 172.21.15.73:0/1465171740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ba4198fb0 0x7f2ba4199430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.687+0000 7f2ba37fe700 1 -- 172.21.15.73:0/1465171740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ba40feff0 msgr2=0x7f2ba4194610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.687+0000 7f2ba37fe700 1 --2- 172.21.15.73:0/1465171740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ba40feff0 0x7f2ba4194610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.687+0000 7f2ba37fe700 1 -- 172.21.15.73:0/1465171740 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b940095f0 con 0x7f2ba4104110 2023-08-10T11:53:34.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.687+0000 7f2ba3fff700 1 --2- 172.21.15.73:0/1465171740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ba40feff0 0x7f2ba4194610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:53:34.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.688+0000 7f2ba37fe700 1 --2- 172.21.15.73:0/1465171740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ba4104110 0x7f2ba4194b50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2b9800ea60 tx=0x7f2b9800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:34.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.688+0000 7f2ba17fa700 1 -- 172.21.15.73:0/1465171740 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9800ccd0 con 0x7f2ba4104110 2023-08-10T11:53:34.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.688+0000 7f2baa3a1700 1 -- 172.21.15.73:0/1465171740 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba41a12c0 con 0x7f2ba4104110 2023-08-10T11:53:34.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.688+0000 7f2ba17fa700 1 -- 172.21.15.73:0/1465171740 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b9800ce30 con 0x7f2ba4104110 2023-08-10T11:53:34.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.688+0000 7f2ba17fa700 1 -- 172.21.15.73:0/1465171740 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b98015790 con 0x7f2ba4104110 2023-08-10T11:53:34.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.688+0000 7f2baa3a1700 1 -- 172.21.15.73:0/1465171740 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba41a1820 con 0x7f2ba4104110 2023-08-10T11:53:34.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.693+0000 7f2bb653ab80 1 Processor -- start 2023-08-10T11:53:34.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.693+0000 7f2ba17fa700 1 -- 172.21.15.73:0/1465171740 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f2b980163e0 con 0x7f2ba4104110 2023-08-10T11:53:34.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.693+0000 7f2ba17fa700 1 --2- 172.21.15.73:0/1465171740 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f2b8c0a13e0 0x7f2b8c0a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.694+0000 7f2bb653ab80 1 -- start start 2023-08-10T11:53:34.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.694+0000 7f2ba17fa700 1 -- 172.21.15.73:0/1465171740 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f2b980cd1f0 con 0x7f2ba4104110 2023-08-10T11:53:34.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.694+0000 7f2bb653ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab29a58cc0 0x55ab29a590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.694+0000 7f2bb653ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab29a595e0 0x55ab29a5d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.694+0000 7f2ba893e700 1 --2- 172.21.15.73:0/1465171740 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f2b8c0a13e0 0x7f2b8c0a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.694+0000 7f2bb653ab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab29a5d910 0x55ab29a5dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.694+0000 7f2bb653ab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab299cbdc0 con 0x55ab29a5d910 2023-08-10T11:53:34.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.694+0000 7f2bb653ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab299a8590 con 0x55ab29a58cc0 2023-08-10T11:53:34.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.694+0000 7f2bb653ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab299a5eb0 con 0x55ab29a595e0 2023-08-10T11:53:34.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.694+0000 7f2ba893e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab29a5d910 0x55ab29a5dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.694+0000 7f2ba893e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab29a5d910 0x55ab29a5dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33634/0 (socket says 172.21.15.73:33634) 2023-08-10T11:53:34.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.694+0000 7f2ba893e700 1 -- 172.21.15.73:0/57969641 learned_addr learned my addr 172.21.15.73:0/57969641 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:34.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.694+0000 7f2ba3fff700 1 --2- 172.21.15.73:0/57969641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab29a58cc0 0x55ab29a590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.694+0000 7f2ba37fe700 1 --2- 172.21.15.73:0/57969641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab29a595e0 0x55ab29a5d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.695+0000 7f2ba3fff700 1 -- 172.21.15.73:0/57969641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab29a595e0 msgr2=0x55ab29a5d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.695+0000 7f2ba3fff700 1 --2- 172.21.15.73:0/57969641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab29a595e0 0x55ab29a5d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.695+0000 7f2ba3fff700 1 -- 172.21.15.73:0/57969641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab29a5d910 msgr2=0x55ab29a5dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.695+0000 7f2ba3fff700 1 --2- 172.21.15.73:0/57969641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab29a5d910 0x55ab29a5dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.695+0000 7f2ba893e700 1 --2- 172.21.15.73:0/1465171740 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f2b8c0a13e0 0x7f2b8c0a38a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c009fd0 tx=0x7f2b9c009ab0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:34.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.695+0000 7f2ba3fff700 1 -- 172.21.15.73:0/57969641 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab29822630 con 0x55ab29a58cc0 2023-08-10T11:53:34.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.695+0000 7f2ba3fff700 1 --2- 172.21.15.73:0/57969641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab29a58cc0 0x55ab29a590a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2b94006010 tx=0x7f2b94005bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3686b136af9f1a21 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:34.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.696+0000 7f2b8a7fc700 1 -- 172.21.15.73:0/57969641 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94027070 con 0x55ab29a58cc0 2023-08-10T11:53:34.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.696+0000 7f2b8a7fc700 1 -- 172.21.15.73:0/57969641 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b9401e040 con 0x55ab29a58cc0 2023-08-10T11:53:34.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.696+0000 7f2b8a7fc700 1 -- 172.21.15.73:0/57969641 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9401d050 con 0x55ab29a58cc0 2023-08-10T11:53:34.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.697+0000 7f2bb653ab80 1 -- 172.21.15.73:0/57969641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab29a58cc0 msgr2=0x55ab29a590a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.697+0000 7f2bb653ab80 1 --2- 172.21.15.73:0/57969641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab29a58cc0 0x55ab29a590a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2b94006010 tx=0x7f2b94005bc0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.697+0000 7f2bb653ab80 1 -- 172.21.15.73:0/57969641 shutdown_connections 2023-08-10T11:53:34.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.697+0000 7f2bb653ab80 1 --2- 172.21.15.73:0/57969641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab29a58cc0 0x55ab29a590a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.697+0000 7f2bb653ab80 1 --2- 172.21.15.73:0/57969641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab29a5d910 0x55ab29a5dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.697+0000 7f2bb653ab80 1 --2- 172.21.15.73:0/57969641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab29a595e0 0x55ab29a5d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.697+0000 7f2bb653ab80 1 -- 172.21.15.73:0/57969641 >> 172.21.15.73:0/57969641 conn(0x55ab299adcd0 msgr2=0x55ab29a4b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:34.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.697+0000 7f2bb653ab80 1 -- 172.21.15.73:0/57969641 shutdown_connections 2023-08-10T11:53:34.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.697+0000 7f2bb653ab80 1 -- 172.21.15.73:0/57969641 wait complete. 2023-08-10T11:53:34.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.697+0000 7f2bb653ab80 1 -- start start 2023-08-10T11:53:34.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.697+0000 7f2bb653ab80 1 Processor -- start 2023-08-10T11:53:34.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.698+0000 7f2bb653ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab29a58cc0 0x55ab29a650f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.698+0000 7f2bb653ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab29a595e0 0x55ab29a62370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.698+0000 7f2bb653ab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab29a5d910 0x55ab29a62ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.698+0000 7f2bb653ab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab299a17a0 con 0x55ab29a5d910 2023-08-10T11:53:34.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.698+0000 7f2bb653ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab29940ac0 con 0x55ab29a58cc0 2023-08-10T11:53:34.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.698+0000 7f2bb653ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab299407c0 con 0x55ab29a595e0 2023-08-10T11:53:34.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.698+0000 7f2bb653ab80 10 client.0 _ll_register_callbacks cb 0x55ab2993e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:34.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.698+0000 7f2ba893e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab29a5d910 0x55ab29a62ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.698+0000 7f2ba893e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab29a5d910 0x55ab29a62ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33640/0 (socket says 172.21.15.73:33640) 2023-08-10T11:53:34.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.698+0000 7f2ba893e700 1 -- 172.21.15.73:0/3242120673 learned_addr learned my addr 172.21.15.73:0/3242120673 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:34.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.698+0000 7f2ba893e700 1 -- 172.21.15.73:0/3242120673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab29a595e0 msgr2=0x55ab29a62370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T11:53:34.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.698+0000 7f2ba893e700 1 --2- 172.21.15.73:0/3242120673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab29a595e0 0x55ab29a62370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.698+0000 7f2ba893e700 1 -- 172.21.15.73:0/3242120673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab29a58cc0 msgr2=0x55ab29a650f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T11:53:34.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.698+0000 7f2ba893e700 1 --2- 172.21.15.73:0/3242120673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab29a58cc0 0x55ab29a650f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.698+0000 7f2ba893e700 1 -- 172.21.15.73:0/3242120673 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba410c500 con 0x55ab29a5d910 2023-08-10T11:53:34.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.699+0000 7f2ba893e700 1 --2- 172.21.15.73:0/3242120673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab29a5d910 0x55ab29a62ab0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c009400 tx=0x7f2b9c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9011a9d72f067c78 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:34.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.699+0000 7f2b837fe700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:34.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.699+0000 7f2b837fe700 1 -- 172.21.15.73:0/3242120673 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c00e050 con 0x55ab29a5d910 2023-08-10T11:53:34.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.699+0000 7f2b837fe700 1 -- 172.21.15.73:0/3242120673 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f2b9c004db0 con 0x55ab29a5d910 2023-08-10T11:53:34.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.699+0000 7f2bb653ab80 1 -- 172.21.15.73:0/3242120673 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ab29a43470 con 0x55ab29a5d910 2023-08-10T11:53:34.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.699+0000 7f2b837fe700 1 -- 172.21.15.73:0/3242120673 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b9c009d50 con 0x55ab29a5d910 2023-08-10T11:53:34.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.699+0000 7f2bb653ab80 10 client.15861 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:34.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.699+0000 7f2bb653ab80 1 -- 172.21.15.73:0/3242120673 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55ab297cede0 con 0x55ab29a5d910 2023-08-10T11:53:34.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.699+0000 7f2b837fe700 1 -- 172.21.15.73:0/3242120673 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ab29a43470 con 0x55ab29a5d910 2023-08-10T11:53:34.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.699+0000 7f2b837fe700 1 -- 172.21.15.73:0/3242120673 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2b9c023680 con 0x55ab29a5d910 2023-08-10T11:53:34.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.700+0000 7f2bb653ab80 10 client.15861 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:34.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.700+0000 7f2bb653ab80 10 client.15861 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-08-10T11:53:34.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.700+0000 7f2bb653ab80 20 client.15861 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:34.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.700+0000 7f2bb653ab80 1 --2- 172.21.15.73:0/3242120673 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55ab29a72aa0 0x55ab29a74ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.700+0000 7f2bb653ab80 4 client.15861 mds_command: new command op to 24451 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:53:34.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.700+0000 7f2bb653ab80 1 -- 172.21.15.73:0/3242120673 --> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ab29a1f9d0 con 0x55ab29a72aa0 2023-08-10T11:53:34.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.700+0000 7f2ba3fff700 1 --2- 172.21.15.73:0/3242120673 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55ab29a72aa0 0x55ab29a74ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.700+0000 7f2b837fe700 10 client.15861 ms_handle_connect on v2:172.21.15.156:6834/904126790 2023-08-10T11:53:34.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.700+0000 7f2ba3fff700 1 --2- 172.21.15.73:0/3242120673 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55ab29a72aa0 0x55ab29a74ec0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f791b94721f47f3 server_cookie=9582e3b2b25ccfa6 in_seq=0 out_seq=0 2023-08-10T11:53:34.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.701+0000 7f2b837fe700 1 -- 172.21.15.73:0/3242120673 <== mds.2 v2:172.21.15.156:6834/904126790 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55ab29a1f9d0 con 0x55ab29a72aa0 2023-08-10T11:53:34.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.701+0000 7f2b837fe700 10 client.15861 handle_command_reply: tid=0 2023-08-10T11:53:34.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.701+0000 7f2bb653ab80 1 client.15861 shutdown 2023-08-10T11:53:34.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.701+0000 7f2bb653ab80 1 -- 172.21.15.73:0/3242120673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab29a5d910 msgr2=0x55ab29a62ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.701+0000 7f2bb653ab80 1 --2- 172.21.15.73:0/3242120673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab29a5d910 0x55ab29a62ab0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c009400 tx=0x7f2b9c004ad0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.701+0000 7f2bb653ab80 1 -- 172.21.15.73:0/3242120673 shutdown_connections 2023-08-10T11:53:34.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.701+0000 7f2bb653ab80 1 --2- 172.21.15.73:0/3242120673 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55ab29a72aa0 0x55ab29a74ec0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.701+0000 7f2bb653ab80 1 --2- 172.21.15.73:0/3242120673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab29a58cc0 0x55ab29a650f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.701+0000 7f2b837fe700 0 client.15861 ms_handle_reset on v2:172.21.15.156:6834/904126790 2023-08-10T11:53:34.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.701+0000 7f2bb653ab80 1 --2- 172.21.15.73:0/3242120673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab29a5d910 0x55ab29a62ab0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.701+0000 7f2bb653ab80 1 --2- 172.21.15.73:0/3242120673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab29a595e0 0x55ab29a62370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.701+0000 7f2bb653ab80 1 -- 172.21.15.73:0/3242120673 >> 172.21.15.73:0/3242120673 conn(0x55ab299adcd0 msgr2=0x55ab29a4a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:34.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.704+0000 7f2bb653ab80 1 -- 172.21.15.73:0/3242120673 shutdown_connections 2023-08-10T11:53:34.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.704+0000 7f2bb653ab80 1 -- 172.21.15.73:0/3242120673 wait complete. 2023-08-10T11:53:34.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.704+0000 7f2bb653ab80 20 client.15861 trim_cache size 0 max 16384 2023-08-10T11:53:34.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.728+0000 7f2bb653ab80 1 Processor -- start 2023-08-10T11:53:34.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.728+0000 7f2bb653ab80 1 -- start start 2023-08-10T11:53:34.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.728+0000 7f2bb653ab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab29a58cc0 0x55ab29a5b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.728+0000 7f2bb653ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab29a595e0 0x55ab29a69ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.728+0000 7f2bb653ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab29a5d910 0x55ab29a64c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.728+0000 7f2bb653ab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab29824920 con 0x55ab29a58cc0 2023-08-10T11:53:34.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.728+0000 7f2bb653ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab29a632f0 con 0x55ab29a595e0 2023-08-10T11:53:34.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.728+0000 7f2bb653ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab29a72880 con 0x55ab29a5d910 2023-08-10T11:53:34.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.729+0000 7f2ba3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab29a58cc0 0x55ab29a5b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.729+0000 7f2ba3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab29a58cc0 0x55ab29a5b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33644/0 (socket says 172.21.15.73:33644) 2023-08-10T11:53:34.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.729+0000 7f2ba3fff700 1 -- 172.21.15.73:0/1477999692 learned_addr learned my addr 172.21.15.73:0/1477999692 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:34.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.729+0000 7f2ba37fe700 1 --2- 172.21.15.73:0/1477999692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab29a595e0 0x55ab29a69ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.729+0000 7f2ba893e700 1 --2- 172.21.15.73:0/1477999692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab29a5d910 0x55ab29a64c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.729+0000 7f2ba3fff700 1 -- 172.21.15.73:0/1477999692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab29a5d910 msgr2=0x55ab29a64c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.729+0000 7f2ba3fff700 1 --2- 172.21.15.73:0/1477999692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab29a5d910 0x55ab29a64c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.729+0000 7f2ba3fff700 1 -- 172.21.15.73:0/1477999692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab29a595e0 msgr2=0x55ab29a69ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.729+0000 7f2ba3fff700 1 --2- 172.21.15.73:0/1477999692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab29a595e0 0x55ab29a69ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.729+0000 7f2ba3fff700 1 -- 172.21.15.73:0/1477999692 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab297b7c60 con 0x55ab29a58cc0 2023-08-10T11:53:34.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.729+0000 7f2ba3fff700 1 --2- 172.21.15.73:0/1477999692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab29a58cc0 0x55ab29a5b200 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f2b940095c0 tx=0x7f2b94009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cfbc08cd44f87cb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:34.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.729+0000 7f2b8affd700 1 -- 172.21.15.73:0/1477999692 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94027050 con 0x55ab29a58cc0 2023-08-10T11:53:34.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.729+0000 7f2b8affd700 1 -- 172.21.15.73:0/1477999692 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b94028040 con 0x55ab29a58cc0 2023-08-10T11:53:34.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.729+0000 7f2b8affd700 1 -- 172.21.15.73:0/1477999692 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9401d040 con 0x55ab29a58cc0 2023-08-10T11:53:34.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.730+0000 7f2bb653ab80 1 -- 172.21.15.73:0/1477999692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab29a58cc0 msgr2=0x55ab29a5b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.730+0000 7f2bb653ab80 1 --2- 172.21.15.73:0/1477999692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab29a58cc0 0x55ab29a5b200 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f2b940095c0 tx=0x7f2b94009ca0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.731+0000 7f2bb653ab80 1 -- 172.21.15.73:0/1477999692 shutdown_connections 2023-08-10T11:53:34.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.731+0000 7f2bb653ab80 1 --2- 172.21.15.73:0/1477999692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab29a5d910 0x55ab29a64c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.731+0000 7f2bb653ab80 1 --2- 172.21.15.73:0/1477999692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab29a58cc0 0x55ab29a5b200 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.731+0000 7f2bb653ab80 1 --2- 172.21.15.73:0/1477999692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab29a595e0 0x55ab29a69ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.731+0000 7f2bb653ab80 1 -- 172.21.15.73:0/1477999692 >> 172.21.15.73:0/1477999692 conn(0x55ab299adcd0 msgr2=0x55ab29a5baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:34.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.731+0000 7f2bb653ab80 1 -- 172.21.15.73:0/1477999692 shutdown_connections 2023-08-10T11:53:34.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.731+0000 7f2bb653ab80 1 -- 172.21.15.73:0/1477999692 wait complete. 2023-08-10T11:53:34.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.731+0000 7f2bb653ab80 1 -- start start 2023-08-10T11:53:34.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.731+0000 7f2bb653ab80 1 Processor -- start 2023-08-10T11:53:34.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.732+0000 7f2bb653ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab29a58cc0 0x55ab29a60c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.732+0000 7f2bb653ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab29a595e0 0x55ab29a611d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.732+0000 7f2bb653ab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab29a5d910 0x55ab29a61710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.732+0000 7f2bb653ab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab29a61c50 con 0x55ab29a5d910 2023-08-10T11:53:34.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.732+0000 7f2bb653ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab29a61dc0 con 0x55ab29a58cc0 2023-08-10T11:53:34.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.732+0000 7f2bb653ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab29a61f80 con 0x55ab29a595e0 2023-08-10T11:53:34.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.732+0000 7f2bb653ab80 10 client.0 _ll_register_callbacks cb 0x55ab2993e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:34.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.732+0000 7f2ba3fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab29a58cc0 0x55ab29a60c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.732+0000 7f2ba37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab29a595e0 0x55ab29a611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.732+0000 7f2ba3fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab29a58cc0 0x55ab29a60c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:48300/0 (socket says 172.21.15.73:48300) 2023-08-10T11:53:34.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.732+0000 7f2ba3fff700 1 -- 172.21.15.73:0/2075777515 learned_addr learned my addr 172.21.15.73:0/2075777515 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:34.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.732+0000 7f2ba3fff700 1 -- 172.21.15.73:0/2075777515 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab29a595e0 msgr2=0x55ab29a611d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.732+0000 7f2ba3fff700 1 --2- 172.21.15.73:0/2075777515 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab29a595e0 0x55ab29a611d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.732+0000 7f2ba3fff700 1 -- 172.21.15.73:0/2075777515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab29a5d910 msgr2=0x55ab29a61710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.732+0000 7f2ba3fff700 1 --2- 172.21.15.73:0/2075777515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab29a5d910 0x55ab29a61710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.732+0000 7f2ba3fff700 1 -- 172.21.15.73:0/2075777515 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ab29822630 con 0x55ab29a58cc0 2023-08-10T11:53:34.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.733+0000 7f2ba3fff700 1 --2- 172.21.15.73:0/2075777515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab29a58cc0 0x55ab29a60c90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2b94005fe0 tx=0x7f2b9400bc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13e28b4f2cc607e2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:34.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.733+0000 7f2b837fe700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T11:53:34.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.733+0000 7f2b837fe700 1 -- 172.21.15.73:0/2075777515 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9401d070 con 0x55ab29a58cc0 2023-08-10T11:53:34.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.733+0000 7f2bb653ab80 1 -- 172.21.15.73:0/2075777515 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2b9401e040 con 0x55ab29a58cc0 2023-08-10T11:53:34.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.733+0000 7f2b837fe700 1 -- 172.21.15.73:0/2075777515 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f2b9402f9d0 con 0x55ab29a58cc0 2023-08-10T11:53:34.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.733+0000 7f2b837fe700 1 -- 172.21.15.73:0/2075777515 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b94027040 con 0x55ab29a58cc0 2023-08-10T11:53:34.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.733+0000 7f2bb653ab80 10 client.25286 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:34.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.733+0000 7f2bb653ab80 1 -- 172.21.15.73:0/2075777515 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55ab297f5250 con 0x55ab29a58cc0 2023-08-10T11:53:34.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.733+0000 7f2b837fe700 1 -- 172.21.15.73:0/2075777515 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b9401e040 con 0x55ab29a58cc0 2023-08-10T11:53:34.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.733+0000 7f2b837fe700 1 -- 172.21.15.73:0/2075777515 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2b94036070 con 0x55ab29a58cc0 2023-08-10T11:53:34.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.733+0000 7f2bb653ab80 10 client.25286 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:34.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.733+0000 7f2bb653ab80 10 client.25286 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-08-10T11:53:34.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.733+0000 7f2bb653ab80 20 client.25286 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:34.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.733+0000 7f2bb653ab80 1 --2- 172.21.15.73:0/2075777515 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55ab29ac7020 0x55ab29ac9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.733+0000 7f2bb653ab80 4 client.25286 mds_command: new command op to 24451 tid=0[{"prefix": "damage ls"}] 2023-08-10T11:53:34.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.733+0000 7f2bb653ab80 1 -- 172.21.15.73:0/2075777515 --> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ab2999a780 con 0x55ab29ac7020 2023-08-10T11:53:34.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.734+0000 7f2ba37fe700 1 --2- 172.21.15.73:0/2075777515 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55ab29ac7020 0x55ab29ac9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.734+0000 7f2b837fe700 10 client.25286 ms_handle_connect on v2:172.21.15.156:6834/904126790 2023-08-10T11:53:34.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.734+0000 7f2ba37fe700 1 --2- 172.21.15.73:0/2075777515 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55ab29ac7020 0x55ab29ac9440 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f6939a32ce967ace server_cookie=1cd53399ef0917be in_seq=0 out_seq=0 2023-08-10T11:53:34.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.734+0000 7f2b837fe700 1 -- 172.21.15.73:0/2075777515 <== mds.2 v2:172.21.15.156:6834/904126790 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ab2999a780 con 0x55ab29ac7020 2023-08-10T11:53:34.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.734+0000 7f2b837fe700 10 client.25286 handle_command_reply: tid=0 2023-08-10T11:53:34.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.734+0000 7f2bb653ab80 1 client.25286 shutdown 2023-08-10T11:53:34.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.735+0000 7f2bb653ab80 1 -- 172.21.15.73:0/2075777515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab29a58cc0 msgr2=0x55ab29a60c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.735+0000 7f2bb653ab80 1 --2- 172.21.15.73:0/2075777515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab29a58cc0 0x55ab29a60c90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2b94005fe0 tx=0x7f2b9400bc20 comp rx=0 tx=0).stop 2023-08-10T11:53:34.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.735+0000 7f2bb653ab80 1 -- 172.21.15.73:0/2075777515 shutdown_connections 2023-08-10T11:53:34.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.735+0000 7f2bb653ab80 1 --2- 172.21.15.73:0/2075777515 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x55ab29ac7020 0x55ab29ac9440 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.735+0000 7f2bb653ab80 1 --2- 172.21.15.73:0/2075777515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ab29a58cc0 0x55ab29a60c90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.735+0000 7f2bb653ab80 1 --2- 172.21.15.73:0/2075777515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab29a5d910 0x55ab29a61710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.735+0000 7f2bb653ab80 1 --2- 172.21.15.73:0/2075777515 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab29a595e0 0x55ab29a611d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.735+0000 7f2bb653ab80 1 -- 172.21.15.73:0/2075777515 >> 172.21.15.73:0/2075777515 conn(0x55ab299adcd0 msgr2=0x55ab29a5e350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:34.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.735+0000 7f2b837fe700 0 client.25286 ms_handle_reset on v2:172.21.15.156:6834/904126790 2023-08-10T11:53:34.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.735+0000 7f2bb653ab80 1 -- 172.21.15.73:0/2075777515 shutdown_connections 2023-08-10T11:53:34.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.735+0000 7f2bb653ab80 1 -- 172.21.15.73:0/2075777515 wait complete. 2023-08-10T11:53:34.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.735+0000 7f2bb653ab80 20 client.25286 trim_cache size 0 max 16384 2023-08-10T11:53:34.746 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2023-08-10T11:53:34.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.736+0000 7f2baa3a1700 1 -- 172.21.15.73:0/1465171740 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f2b8c0a13e0 msgr2=0x7f2b8c0a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.736+0000 7f2baa3a1700 1 --2- 172.21.15.73:0/1465171740 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f2b8c0a13e0 0x7f2b8c0a38a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c009fd0 tx=0x7f2b9c009ab0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.736+0000 7f2baa3a1700 1 -- 172.21.15.73:0/1465171740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ba4104110 msgr2=0x7f2ba4194b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.736+0000 7f2baa3a1700 1 --2- 172.21.15.73:0/1465171740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ba4104110 0x7f2ba4194b50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2b9800ea60 tx=0x7f2b9800ed70 comp rx=0 tx=0).stop 2023-08-10T11:53:34.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.736+0000 7f2baa3a1700 1 -- 172.21.15.73:0/1465171740 shutdown_connections 2023-08-10T11:53:34.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.736+0000 7f2baa3a1700 1 --2- 172.21.15.73:0/1465171740 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f2b8c0a13e0 0x7f2b8c0a38a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.736+0000 7f2baa3a1700 1 --2- 172.21.15.73:0/1465171740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ba40feff0 0x7f2ba4194610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.736+0000 7f2baa3a1700 1 --2- 172.21.15.73:0/1465171740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ba4198fb0 0x7f2ba4199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.736+0000 7f2baa3a1700 1 --2- 172.21.15.73:0/1465171740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ba4104110 0x7f2ba4194b50 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.736+0000 7f2baa3a1700 1 -- 172.21.15.73:0/1465171740 >> 172.21.15.73:0/1465171740 conn(0x7f2ba4076be0 msgr2=0x7f2ba41037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:34.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.736+0000 7f2baa3a1700 1 -- 172.21.15.73:0/1465171740 shutdown_connections 2023-08-10T11:53:34.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.736+0000 7f2baa3a1700 1 -- 172.21.15.73:0/1465171740 wait complete. 2023-08-10T11:53:34.753 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-08-10T11:53:34.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:34 smithi073 ceph-mon[128869]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-08-10T11:53:34.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:34 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1809577132' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:53:34.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.942+0000 7fe54c845700 1 -- 172.21.15.73:0/3247465857 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe548104100 msgr2=0x7fe54810bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.942+0000 7fe54c845700 1 --2- 172.21.15.73:0/3247465857 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe548104100 0x7fe54810bc80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe54000b0a0 tx=0x7fe54000b3b0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.942+0000 7fe54c845700 1 -- 172.21.15.73:0/3247465857 shutdown_connections 2023-08-10T11:53:34.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.942+0000 7fe54c845700 1 --2- 172.21.15.73:0/3247465857 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe548104100 0x7fe54810bc80 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.942+0000 7fe54c845700 1 --2- 172.21.15.73:0/3247465857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5480ff1c0 0x7fe5480ff5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.942+0000 7fe54c845700 1 --2- 172.21.15.73:0/3247465857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5480ffb70 0x7fe5481039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.942+0000 7fe54c845700 1 -- 172.21.15.73:0/3247465857 >> 172.21.15.73:0/3247465857 conn(0x7fe548074910 msgr2=0x7fe548074d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:34.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.942+0000 7fe54c845700 1 -- 172.21.15.73:0/3247465857 shutdown_connections 2023-08-10T11:53:34.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.942+0000 7fe54c845700 1 -- 172.21.15.73:0/3247465857 wait complete. 2023-08-10T11:53:34.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.943+0000 7fe54c845700 1 Processor -- start 2023-08-10T11:53:34.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.943+0000 7fe54c845700 1 -- start start 2023-08-10T11:53:34.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.943+0000 7fe54c845700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5480ff1c0 0x7fe5481a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.943+0000 7fe54c845700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe548104100 0x7fe5481a2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.943+0000 7fe54c845700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe54810a890 0x7fe54810ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.943+0000 7fe54c845700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54810b3b0 con 0x7fe548104100 2023-08-10T11:53:34.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.943+0000 7fe54c845700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54810b520 con 0x7fe5480ff1c0 2023-08-10T11:53:34.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.943+0000 7fe54c845700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54810b6e0 con 0x7fe54810a890 2023-08-10T11:53:34.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.944+0000 7fe545d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe548104100 0x7fe5481a2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.944+0000 7fe545d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe548104100 0x7fe5481a2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33666/0 (socket says 172.21.15.73:33666) 2023-08-10T11:53:34.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.944+0000 7fe545d9b700 1 -- 172.21.15.73:0/372445424 learned_addr learned my addr 172.21.15.73:0/372445424 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:34.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.944+0000 7fe54659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5480ff1c0 0x7fe5481a1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.944+0000 7fe546d9d700 1 --2- 172.21.15.73:0/372445424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe54810a890 0x7fe54810ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.944+0000 7fe54659c700 1 -- 172.21.15.73:0/372445424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe54810a890 msgr2=0x7fe54810ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.944+0000 7fe54659c700 1 --2- 172.21.15.73:0/372445424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe54810a890 0x7fe54810ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.944+0000 7fe54659c700 1 -- 172.21.15.73:0/372445424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe548104100 msgr2=0x7fe5481a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.944+0000 7fe54659c700 1 --2- 172.21.15.73:0/372445424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe548104100 0x7fe5481a2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.944+0000 7fe54659c700 1 -- 172.21.15.73:0/372445424 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe540009d00 con 0x7fe5480ff1c0 2023-08-10T11:53:34.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.944+0000 7fe54659c700 1 --2- 172.21.15.73:0/372445424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5480ff1c0 0x7fe5481a1bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe53800e9f0 tx=0x7fe53800edb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:34.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.945+0000 7fe5377fe700 1 -- 172.21.15.73:0/372445424 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53800cbd0 con 0x7fe5480ff1c0 2023-08-10T11:53:34.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.945+0000 7fe54c845700 1 -- 172.21.15.73:0/372445424 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5481a9c30 con 0x7fe5480ff1c0 2023-08-10T11:53:34.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.945+0000 7fe5377fe700 1 -- 172.21.15.73:0/372445424 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe53800cd30 con 0x7fe5480ff1c0 2023-08-10T11:53:34.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.945+0000 7fe5377fe700 1 -- 172.21.15.73:0/372445424 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe538018680 con 0x7fe5480ff1c0 2023-08-10T11:53:34.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.945+0000 7fe54c845700 1 -- 172.21.15.73:0/372445424 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5481aa190 con 0x7fe5480ff1c0 2023-08-10T11:53:34.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.948+0000 7fe5377fe700 1 -- 172.21.15.73:0/372445424 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7fe538010430 con 0x7fe5480ff1c0 2023-08-10T11:53:34.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.949+0000 7fe5377fe700 1 --2- 172.21.15.73:0/372445424 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe5300a1460 0x7fe5300a3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.949+0000 7fe545d9b700 1 --2- 172.21.15.73:0/372445424 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe5300a1460 0x7fe5300a3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.949+0000 7fe5377fe700 1 -- 172.21.15.73:0/372445424 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe538014070 con 0x7fe5480ff1c0 2023-08-10T11:53:34.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.949+0000 7fe545d9b700 1 --2- 172.21.15.73:0/372445424 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe5300a1460 0x7fe5300a3920 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe54819e5f0 tx=0x7fe53c009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:34.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.950+0000 7fe5589deb80 1 Processor -- start 2023-08-10T11:53:34.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.950+0000 7fe5589deb80 1 -- start start 2023-08-10T11:53:34.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.950+0000 7fe5589deb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f770dadf50 0x55f770dae330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.950+0000 7fe5589deb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f770dae870 0x55f770da82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.950+0000 7fe5589deb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 0x55f770da8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.950+0000 7fe5589deb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f770d23dc0 con 0x55f770da8800 2023-08-10T11:53:34.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.950+0000 7fe5589deb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f770d00590 con 0x55f770dadf50 2023-08-10T11:53:34.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.950+0000 7fe5589deb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f770cfdeb0 con 0x55f770dae870 2023-08-10T11:53:34.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.950+0000 7fe546d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 0x55f770da8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.950+0000 7fe546d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 0x55f770da8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33674/0 (socket says 172.21.15.73:33674) 2023-08-10T11:53:34.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.950+0000 7fe546d9d700 1 -- 172.21.15.73:0/2861077843 learned_addr learned my addr 172.21.15.73:0/2861077843 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:34.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.950+0000 7fe54659c700 1 --2- 172.21.15.73:0/2861077843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f770dadf50 0x55f770dae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.951+0000 7fe545d9b700 1 --2- 172.21.15.73:0/2861077843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f770dae870 0x55f770da82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.951+0000 7fe546d9d700 1 -- 172.21.15.73:0/2861077843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f770dae870 msgr2=0x55f770da82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.951+0000 7fe546d9d700 1 --2- 172.21.15.73:0/2861077843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f770dae870 0x55f770da82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.951+0000 7fe546d9d700 1 -- 172.21.15.73:0/2861077843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f770dadf50 msgr2=0x55f770dae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.951+0000 7fe546d9d700 1 --2- 172.21.15.73:0/2861077843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f770dadf50 0x55f770dae330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.951+0000 7fe546d9d700 1 -- 172.21.15.73:0/2861077843 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f770b7a630 con 0x55f770da8800 2023-08-10T11:53:34.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.951+0000 7fe54659c700 1 --2- 172.21.15.73:0/2861077843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f770dadf50 0x55f770dae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:53:34.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.951+0000 7fe546d9d700 1 --2- 172.21.15.73:0/2861077843 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 0x55f770da8c80 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe54000b070 tx=0x7fe540009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f2248e60b6f90c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:34.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.951+0000 7fe534ff9700 1 -- 172.21.15.73:0/2861077843 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54000e040 con 0x55f770da8800 2023-08-10T11:53:34.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.951+0000 7fe534ff9700 1 -- 172.21.15.73:0/2861077843 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe540009460 con 0x55f770da8800 2023-08-10T11:53:34.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.951+0000 7fe534ff9700 1 -- 172.21.15.73:0/2861077843 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe540007950 con 0x55f770da8800 2023-08-10T11:53:34.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.952+0000 7fe5589deb80 1 -- 172.21.15.73:0/2861077843 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 msgr2=0x55f770da8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.952+0000 7fe5589deb80 1 --2- 172.21.15.73:0/2861077843 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 0x55f770da8c80 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe54000b070 tx=0x7fe540009c60 comp rx=0 tx=0).stop 2023-08-10T11:53:34.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.952+0000 7fe5589deb80 1 -- 172.21.15.73:0/2861077843 shutdown_connections 2023-08-10T11:53:34.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.952+0000 7fe5589deb80 1 --2- 172.21.15.73:0/2861077843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f770dadf50 0x55f770dae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.952+0000 7fe5589deb80 1 --2- 172.21.15.73:0/2861077843 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 0x55f770da8c80 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.952+0000 7fe5589deb80 1 --2- 172.21.15.73:0/2861077843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f770dae870 0x55f770da82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.952+0000 7fe5589deb80 1 -- 172.21.15.73:0/2861077843 >> 172.21.15.73:0/2861077843 conn(0x55f770d05cd0 msgr2=0x55f770da34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:34.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.952+0000 7fe5589deb80 1 -- 172.21.15.73:0/2861077843 shutdown_connections 2023-08-10T11:53:34.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.952+0000 7fe5589deb80 1 -- 172.21.15.73:0/2861077843 wait complete. 2023-08-10T11:53:34.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.953+0000 7fe5589deb80 1 -- start start 2023-08-10T11:53:34.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.953+0000 7fe5589deb80 1 Processor -- start 2023-08-10T11:53:34.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.953+0000 7fe5589deb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 0x55f770db48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.953+0000 7fe5589deb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f770dadf50 0x55f770db1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.953+0000 7fe5589deb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f770dae870 0x55f770db2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.953+0000 7fe5589deb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f770cf97a0 con 0x55f770da8800 2023-08-10T11:53:34.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.953+0000 7fe5589deb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f770c98ac0 con 0x55f770dae870 2023-08-10T11:53:34.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.953+0000 7fe5589deb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f770c987c0 con 0x55f770dadf50 2023-08-10T11:53:34.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.953+0000 7fe5589deb80 10 client.0 _ll_register_callbacks cb 0x55f770c96680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:34.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.954+0000 7fe54659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 0x55f770db48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.954+0000 7fe54659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 0x55f770db48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33678/0 (socket says 172.21.15.73:33678) 2023-08-10T11:53:34.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.954+0000 7fe54659c700 1 -- 172.21.15.73:0/157683610 learned_addr learned my addr 172.21.15.73:0/157683610 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:34.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.954+0000 7fe546d9d700 1 --2- 172.21.15.73:0/157683610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f770dae870 0x55f770db2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.954+0000 7fe545d9b700 1 --2- 172.21.15.73:0/157683610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f770dadf50 0x55f770db1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.954+0000 7fe546d9d700 1 -- 172.21.15.73:0/157683610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f770dadf50 msgr2=0x55f770db1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.954+0000 7fe546d9d700 1 --2- 172.21.15.73:0/157683610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f770dadf50 0x55f770db1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.954+0000 7fe546d9d700 1 -- 172.21.15.73:0/157683610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 msgr2=0x55f770db48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.954+0000 7fe546d9d700 1 --2- 172.21.15.73:0/157683610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 0x55f770db48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.954+0000 7fe546d9d700 1 -- 172.21.15.73:0/157683610 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5480685b0 con 0x55f770dae870 2023-08-10T11:53:34.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.954+0000 7fe54659c700 1 --2- 172.21.15.73:0/157683610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 0x55f770db48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:53:34.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.954+0000 7fe546d9d700 1 --2- 172.21.15.73:0/157683610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f770dae870 0x55f770db2150 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe54000b780 tx=0x7fe54000bd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a951f955e44ee39 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:34.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.954+0000 7fe52dffb700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T11:53:34.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.954+0000 7fe52dffb700 1 -- 172.21.15.73:0/157683610 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54002d070 con 0x55f770dae870 2023-08-10T11:53:34.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.954+0000 7fe5589deb80 1 -- 172.21.15.73:0/157683610 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f770d9b470 con 0x55f770dae870 2023-08-10T11:53:34.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.955+0000 7fe52dffb700 1 -- 172.21.15.73:0/157683610 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe5400076b0 con 0x55f770dae870 2023-08-10T11:53:34.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.955+0000 7fe52dffb700 1 -- 172.21.15.73:0/157683610 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe54000e040 con 0x55f770dae870 2023-08-10T11:53:34.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.955+0000 7fe5589deb80 10 client.25298 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:34.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.955+0000 7fe5589deb80 1 -- 172.21.15.73:0/157683610 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f770b26de0 con 0x55f770dae870 2023-08-10T11:53:34.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.955+0000 7fe52dffb700 1 -- 172.21.15.73:0/157683610 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe540036020 con 0x55f770dae870 2023-08-10T11:53:34.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.955+0000 7fe52dffb700 1 -- 172.21.15.73:0/157683610 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe540030030 con 0x55f770dae870 2023-08-10T11:53:34.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.955+0000 7fe5589deb80 10 client.25298 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:34.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.955+0000 7fe5589deb80 10 client.25298 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-08-10T11:53:34.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.955+0000 7fe5589deb80 20 client.25298 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:34.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.955+0000 7fe5589deb80 1 --2- 172.21.15.73:0/157683610 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x55f770dc1e00 0x55f770dc41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.955+0000 7fe5589deb80 4 client.25298 mds_command: new command op to 24479 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:53:34.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.955+0000 7fe5589deb80 1 -- 172.21.15.73:0/157683610 --> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f770d779d0 con 0x55f770dc1e00 2023-08-10T11:53:34.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.955+0000 7fe54659c700 1 --2- 172.21.15.73:0/157683610 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x55f770dc1e00 0x55f770dc41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.956+0000 7fe52dffb700 10 client.25298 ms_handle_connect on v2:172.21.15.152:6836/74214089 2023-08-10T11:53:34.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.956+0000 7fe54659c700 1 --2- 172.21.15.73:0/157683610 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x55f770dc1e00 0x55f770dc41f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f63f4ea4938eb7c6 server_cookie=82411fbf7a147d02 in_seq=0 out_seq=0 2023-08-10T11:53:34.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.956+0000 7fe52dffb700 1 -- 172.21.15.73:0/157683610 <== mds.1 v2:172.21.15.152:6836/74214089 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55f770d779d0 con 0x55f770dc1e00 2023-08-10T11:53:34.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.956+0000 7fe52dffb700 10 client.25298 handle_command_reply: tid=0 2023-08-10T11:53:34.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.957+0000 7fe5589deb80 1 client.25298 shutdown 2023-08-10T11:53:34.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.957+0000 7fe5589deb80 1 -- 172.21.15.73:0/157683610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f770dae870 msgr2=0x55f770db2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.957+0000 7fe5589deb80 1 --2- 172.21.15.73:0/157683610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f770dae870 0x55f770db2150 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe54000b780 tx=0x7fe54000bd60 comp rx=0 tx=0).stop 2023-08-10T11:53:34.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.957+0000 7fe5589deb80 1 -- 172.21.15.73:0/157683610 shutdown_connections 2023-08-10T11:53:34.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.957+0000 7fe5589deb80 1 --2- 172.21.15.73:0/157683610 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x55f770dc1e00 0x55f770dc41f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.957+0000 7fe5589deb80 1 --2- 172.21.15.73:0/157683610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f770dae870 0x55f770db2150 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.957+0000 7fe5589deb80 1 --2- 172.21.15.73:0/157683610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 0x55f770db48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.957+0000 7fe52dffb700 0 client.25298 ms_handle_reset on v2:172.21.15.152:6836/74214089 2023-08-10T11:53:34.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.957+0000 7fe5589deb80 1 --2- 172.21.15.73:0/157683610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f770dadf50 0x55f770db1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.957+0000 7fe5589deb80 1 -- 172.21.15.73:0/157683610 >> 172.21.15.73:0/157683610 conn(0x55f770d05cd0 msgr2=0x55f770da29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:34.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.957+0000 7fe5589deb80 1 -- 172.21.15.73:0/157683610 shutdown_connections 2023-08-10T11:53:34.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.957+0000 7fe5589deb80 1 -- 172.21.15.73:0/157683610 wait complete. 2023-08-10T11:53:34.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.957+0000 7fe5589deb80 20 client.25298 trim_cache size 0 max 16384 2023-08-10T11:53:34.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.982+0000 7fe5589deb80 1 Processor -- start 2023-08-10T11:53:34.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.982+0000 7fe5589deb80 1 -- start start 2023-08-10T11:53:34.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.983+0000 7fe5589deb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 0x55f770da82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.983+0000 7fe5589deb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f770dadf50 0x55f770db9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.983+0000 7fe5589deb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f770dae870 0x55f770dad280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.983+0000 7fe5589deb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f770b7c920 con 0x55f770da8800 2023-08-10T11:53:34.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.983+0000 7fe5589deb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f770d9dae0 con 0x55f770dae870 2023-08-10T11:53:34.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.983+0000 7fe5589deb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f770da41b0 con 0x55f770dadf50 2023-08-10T11:53:34.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.983+0000 7fe54659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 0x55f770da82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.983+0000 7fe54659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 0x55f770da82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33686/0 (socket says 172.21.15.73:33686) 2023-08-10T11:53:34.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.983+0000 7fe54659c700 1 -- 172.21.15.73:0/2396713687 learned_addr learned my addr 172.21.15.73:0/2396713687 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:34.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.983+0000 7fe546d9d700 1 --2- 172.21.15.73:0/2396713687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f770dae870 0x55f770dad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.983+0000 7fe545d9b700 1 --2- 172.21.15.73:0/2396713687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f770dadf50 0x55f770db9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.983+0000 7fe54659c700 1 -- 172.21.15.73:0/2396713687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f770dadf50 msgr2=0x55f770db9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.983+0000 7fe54659c700 1 --2- 172.21.15.73:0/2396713687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f770dadf50 0x55f770db9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.983+0000 7fe54659c700 1 -- 172.21.15.73:0/2396713687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f770dae870 msgr2=0x55f770dad280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.983+0000 7fe54659c700 1 --2- 172.21.15.73:0/2396713687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f770dae870 0x55f770dad280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.983+0000 7fe54659c700 1 -- 172.21.15.73:0/2396713687 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f770b0fc60 con 0x55f770da8800 2023-08-10T11:53:34.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.983+0000 7fe546d9d700 1 --2- 172.21.15.73:0/2396713687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f770dae870 0x55f770dad280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:53:34.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.983+0000 7fe54659c700 1 --2- 172.21.15.73:0/2396713687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 0x55f770da82c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe538000c00 tx=0x7fe538096440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305941e0a683a149 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:34.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.984+0000 7fe5357fa700 1 -- 172.21.15.73:0/2396713687 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe538099ed0 con 0x55f770da8800 2023-08-10T11:53:34.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.984+0000 7fe5357fa700 1 -- 172.21.15.73:0/2396713687 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe53809e130 con 0x55f770da8800 2023-08-10T11:53:34.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.984+0000 7fe5357fa700 1 -- 172.21.15.73:0/2396713687 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5380a2320 con 0x55f770da8800 2023-08-10T11:53:34.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.985+0000 7fe5589deb80 1 -- 172.21.15.73:0/2396713687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 msgr2=0x55f770da82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.985+0000 7fe5589deb80 1 --2- 172.21.15.73:0/2396713687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 0x55f770da82c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe538000c00 tx=0x7fe538096440 comp rx=0 tx=0).stop 2023-08-10T11:53:34.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.985+0000 7fe5589deb80 1 -- 172.21.15.73:0/2396713687 shutdown_connections 2023-08-10T11:53:34.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.985+0000 7fe5589deb80 1 --2- 172.21.15.73:0/2396713687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f770dae870 0x55f770dad280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.985+0000 7fe5589deb80 1 --2- 172.21.15.73:0/2396713687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 0x55f770da82c0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.985+0000 7fe5589deb80 1 --2- 172.21.15.73:0/2396713687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f770dadf50 0x55f770db9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.985+0000 7fe5589deb80 1 -- 172.21.15.73:0/2396713687 >> 172.21.15.73:0/2396713687 conn(0x55f770d05cd0 msgr2=0x55f770dacb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:34.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.985+0000 7fe5589deb80 1 -- 172.21.15.73:0/2396713687 shutdown_connections 2023-08-10T11:53:34.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.985+0000 7fe5589deb80 1 -- 172.21.15.73:0/2396713687 wait complete. 2023-08-10T11:53:34.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.985+0000 7fe5589deb80 1 -- start start 2023-08-10T11:53:34.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.985+0000 7fe5589deb80 1 Processor -- start 2023-08-10T11:53:34.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.986+0000 7fe5589deb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 0x55f770db9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.986+0000 7fe5589deb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f770dadf50 0x55f770da9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.986+0000 7fe5589deb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f770dae870 0x55f770daa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.986+0000 7fe5589deb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f770daa770 con 0x55f770da8800 2023-08-10T11:53:34.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.986+0000 7fe5589deb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f770daa8e0 con 0x55f770dadf50 2023-08-10T11:53:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.986+0000 7fe5589deb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f770e26a60 con 0x55f770dae870 2023-08-10T11:53:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.986+0000 7fe5589deb80 10 client.0 _ll_register_callbacks cb 0x55f770c96680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.986+0000 7fe54659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 0x55f770db9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.986+0000 7fe54659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 0x55f770db9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33692/0 (socket says 172.21.15.73:33692) 2023-08-10T11:53:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.986+0000 7fe54659c700 1 -- 172.21.15.73:0/928106158 learned_addr learned my addr 172.21.15.73:0/928106158 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.986+0000 7fe545d9b700 1 --2- 172.21.15.73:0/928106158 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f770dadf50 0x55f770da9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.986+0000 7fe546d9d700 1 --2- 172.21.15.73:0/928106158 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f770dae870 0x55f770daa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.986+0000 7fe54659c700 1 -- 172.21.15.73:0/928106158 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f770dae870 msgr2=0x55f770daa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.986+0000 7fe54659c700 1 --2- 172.21.15.73:0/928106158 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f770dae870 0x55f770daa090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.986+0000 7fe54659c700 1 -- 172.21.15.73:0/928106158 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f770dadf50 msgr2=0x55f770da9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.986+0000 7fe54659c700 1 --2- 172.21.15.73:0/928106158 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f770dadf50 0x55f770da9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.986+0000 7fe54659c700 1 -- 172.21.15.73:0/928106158 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f770b26de0 con 0x55f770da8800 2023-08-10T11:53:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.986+0000 7fe546d9d700 1 --2- 172.21.15.73:0/928106158 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f770dae870 0x55f770daa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:53:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.986+0000 7fe54659c700 1 --2- 172.21.15.73:0/928106158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 0x55f770db9310 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe538096b20 tx=0x7fe5380092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac6a46f1b908d45a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.986+0000 7fe52dffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.987+0000 7fe52dffb700 1 -- 172.21.15.73:0/928106158 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5380b84c0 con 0x55f770da8800 2023-08-10T11:53:34.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.987+0000 7fe52dffb700 1 -- 172.21.15.73:0/928106158 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe5380cd040 con 0x55f770da8800 2023-08-10T11:53:34.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.987+0000 7fe5589deb80 1 -- 172.21.15.73:0/928106158 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe540009460 con 0x55f770da8800 2023-08-10T11:53:34.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.987+0000 7fe52dffb700 1 -- 172.21.15.73:0/928106158 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe538098240 con 0x55f770da8800 2023-08-10T11:53:34.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.987+0000 7fe5589deb80 10 client.15882 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:34.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.987+0000 7fe5589deb80 1 -- 172.21.15.73:0/928106158 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fe5481aa190 con 0x55f770da8800 2023-08-10T11:53:34.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.987+0000 7fe52dffb700 1 -- 172.21.15.73:0/928106158 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe540009460 con 0x55f770da8800 2023-08-10T11:53:34.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.987+0000 7fe52dffb700 1 -- 172.21.15.73:0/928106158 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe5380cab30 con 0x55f770da8800 2023-08-10T11:53:34.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.987+0000 7fe5589deb80 10 client.15882 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:34.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.987+0000 7fe5589deb80 10 client.15882 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-08-10T11:53:34.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.987+0000 7fe5589deb80 20 client.15882 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:34.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.987+0000 7fe5589deb80 1 --2- 172.21.15.73:0/928106158 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x55f770e15c30 0x55f770e18020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:34.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.987+0000 7fe5589deb80 4 client.15882 mds_command: new command op to 24479 tid=0[{"prefix": "damage ls"}] 2023-08-10T11:53:34.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.987+0000 7fe5589deb80 1 -- 172.21.15.73:0/928106158 --> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f770cf2780 con 0x55f770e15c30 2023-08-10T11:53:34.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.988+0000 7fe545d9b700 1 --2- 172.21.15.73:0/928106158 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x55f770e15c30 0x55f770e18020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:34.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.988+0000 7fe52dffb700 10 client.15882 ms_handle_connect on v2:172.21.15.152:6836/74214089 2023-08-10T11:53:34.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.988+0000 7fe545d9b700 1 --2- 172.21.15.73:0/928106158 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x55f770e15c30 0x55f770e18020 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f0d952b6d4295716 server_cookie=e15bb11690236d4d in_seq=0 out_seq=0 2023-08-10T11:53:34.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.989+0000 7fe52dffb700 1 -- 172.21.15.73:0/928106158 <== mds.1 v2:172.21.15.152:6836/74214089 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f770cf2780 con 0x55f770e15c30 2023-08-10T11:53:34.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.989+0000 7fe52dffb700 10 client.15882 handle_command_reply: tid=0 2023-08-10T11:53:34.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.989+0000 7fe5589deb80 1 client.15882 shutdown 2023-08-10T11:53:34.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.989+0000 7fe5589deb80 1 -- 172.21.15.73:0/928106158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 msgr2=0x55f770db9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:34.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.989+0000 7fe5589deb80 1 --2- 172.21.15.73:0/928106158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 0x55f770db9310 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe538096b20 tx=0x7fe5380092d0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.989+0000 7fe5589deb80 1 -- 172.21.15.73:0/928106158 shutdown_connections 2023-08-10T11:53:34.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.989+0000 7fe5589deb80 1 --2- 172.21.15.73:0/928106158 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x55f770e15c30 0x55f770e18020 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.989+0000 7fe5589deb80 1 --2- 172.21.15.73:0/928106158 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f770dae870 0x55f770daa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.989+0000 7fe5589deb80 1 --2- 172.21.15.73:0/928106158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f770da8800 0x55f770db9310 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.989+0000 7fe5589deb80 1 --2- 172.21.15.73:0/928106158 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f770dadf50 0x55f770da9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:34.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.989+0000 7fe5589deb80 1 -- 172.21.15.73:0/928106158 >> 172.21.15.73:0/928106158 conn(0x55f770d05cd0 msgr2=0x55f770dad400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:34.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.989+0000 7fe52dffb700 0 client.15882 ms_handle_reset on v2:172.21.15.152:6836/74214089 2023-08-10T11:53:34.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.989+0000 7fe5589deb80 1 -- 172.21.15.73:0/928106158 shutdown_connections 2023-08-10T11:53:34.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.989+0000 7fe5589deb80 1 -- 172.21.15.73:0/928106158 wait complete. 2023-08-10T11:53:34.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.989+0000 7fe5589deb80 20 client.15882 trim_cache size 0 max 16384 2023-08-10T11:53:35.000 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2023-08-10T11:53:35.000 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:34 smithi152 ceph-mon[130220]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-08-10T11:53:35.001 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:34 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1809577132' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:53:35.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.990+0000 7fe54c845700 1 -- 172.21.15.73:0/372445424 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe5300a1460 msgr2=0x7fe5300a3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:35.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.990+0000 7fe54c845700 1 --2- 172.21.15.73:0/372445424 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe5300a1460 0x7fe5300a3920 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe54819e5f0 tx=0x7fe53c009260 comp rx=0 tx=0).stop 2023-08-10T11:53:35.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.990+0000 7fe54c845700 1 -- 172.21.15.73:0/372445424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5480ff1c0 msgr2=0x7fe5481a1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:35.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.990+0000 7fe54c845700 1 --2- 172.21.15.73:0/372445424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5480ff1c0 0x7fe5481a1bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe53800e9f0 tx=0x7fe53800edb0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.990+0000 7fe54c845700 1 -- 172.21.15.73:0/372445424 shutdown_connections 2023-08-10T11:53:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.990+0000 7fe54c845700 1 --2- 172.21.15.73:0/372445424 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe5300a1460 0x7fe5300a3920 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.990+0000 7fe54c845700 1 --2- 172.21.15.73:0/372445424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5480ff1c0 0x7fe5481a1bf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.990+0000 7fe54c845700 1 --2- 172.21.15.73:0/372445424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe54810a890 0x7fe54810ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.990+0000 7fe54c845700 1 --2- 172.21.15.73:0/372445424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe548104100 0x7fe5481a2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.990+0000 7fe54c845700 1 -- 172.21.15.73:0/372445424 >> 172.21.15.73:0/372445424 conn(0x7fe548074910 msgr2=0x7fe5480fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:35.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.990+0000 7fe54c845700 1 -- 172.21.15.73:0/372445424 shutdown_connections 2023-08-10T11:53:35.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:34.990+0000 7fe54c845700 1 -- 172.21.15.73:0/372445424 wait complete. 2023-08-10T11:53:35.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:34 smithi156 ceph-mon[130574]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-08-10T11:53:35.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:34 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1809577132' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:53:35.008 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-08-10T11:53:35.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.236+0000 7f91716d4700 1 -- 172.21.15.73:0/1015790997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f916c1009a0 msgr2=0x7f916c104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:35.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.236+0000 7f91716d4700 1 --2- 172.21.15.73:0/1015790997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f916c1009a0 0x7f916c104210 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f9160009990 tx=0x7f9160009ca0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.236+0000 7f91716d4700 1 -- 172.21.15.73:0/1015790997 shutdown_connections 2023-08-10T11:53:35.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.236+0000 7f91716d4700 1 --2- 172.21.15.73:0/1015790997 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f916c104940 0x7f916c10c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.236+0000 7f91716d4700 1 --2- 172.21.15.73:0/1015790997 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f916c0ffff0 0x7f916c1003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.236+0000 7f91716d4700 1 --2- 172.21.15.73:0/1015790997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f916c1009a0 0x7f916c104210 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.236+0000 7f91716d4700 1 -- 172.21.15.73:0/1015790997 >> 172.21.15.73:0/1015790997 conn(0x7f916c076be0 msgr2=0x7f916c0fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:35.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.236+0000 7f91716d4700 1 -- 172.21.15.73:0/1015790997 shutdown_connections 2023-08-10T11:53:35.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.236+0000 7f91716d4700 1 -- 172.21.15.73:0/1015790997 wait complete. 2023-08-10T11:53:35.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.237+0000 7f91716d4700 1 Processor -- start 2023-08-10T11:53:35.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.237+0000 7f91716d4700 1 -- start start 2023-08-10T11:53:35.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.237+0000 7f91716d4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f916c0ffff0 0x7f916c19c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:35.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.237+0000 7f91716d4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f916c104940 0x7f916c19cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:35.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.237+0000 7f91716d4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f916c1965f0 0x7f916c196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:35.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.237+0000 7f91716d4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c1970f0 con 0x7f916c1965f0 2023-08-10T11:53:35.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.237+0000 7f91716d4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c197260 con 0x7f916c0ffff0 2023-08-10T11:53:35.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.237+0000 7f91716d4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c197420 con 0x7f916c104940 2023-08-10T11:53:35.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.237+0000 7f916b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f916c1965f0 0x7f916c196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:35.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.238+0000 7f916b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f916c1965f0 0x7f916c196aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33708/0 (socket says 172.21.15.73:33708) 2023-08-10T11:53:35.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.238+0000 7f916b7fe700 1 -- 172.21.15.73:0/2564758189 learned_addr learned my addr 172.21.15.73:0/2564758189 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:35.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.238+0000 7f916affd700 1 --2- 172.21.15.73:0/2564758189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f916c0ffff0 0x7f916c19c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:35.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.238+0000 7f916b7fe700 1 -- 172.21.15.73:0/2564758189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f916c104940 msgr2=0x7f916c19cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:35.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.238+0000 7f916b7fe700 1 --2- 172.21.15.73:0/2564758189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f916c104940 0x7f916c19cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.238+0000 7f916b7fe700 1 -- 172.21.15.73:0/2564758189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f916c0ffff0 msgr2=0x7f916c19c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:35.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.238+0000 7f916b7fe700 1 --2- 172.21.15.73:0/2564758189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f916c0ffff0 0x7f916c19c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.238+0000 7f916b7fe700 1 -- 172.21.15.73:0/2564758189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91600095f0 con 0x7f916c1965f0 2023-08-10T11:53:35.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.238+0000 7f916b7fe700 1 --2- 172.21.15.73:0/2564758189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f916c1965f0 0x7f916c196aa0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f916400ef30 tx=0x7f916400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:35.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.238+0000 7f9153fff700 1 -- 172.21.15.73:0/2564758189 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9164018070 con 0x7f916c1965f0 2023-08-10T11:53:35.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.238+0000 7f91716d4700 1 -- 172.21.15.73:0/2564758189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f916c10cc90 con 0x7f916c1965f0 2023-08-10T11:53:35.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.238+0000 7f9153fff700 1 -- 172.21.15.73:0/2564758189 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f916400f040 con 0x7f916c1965f0 2023-08-10T11:53:35.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.238+0000 7f9153fff700 1 -- 172.21.15.73:0/2564758189 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916400cd50 con 0x7f916c1965f0 2023-08-10T11:53:35.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.238+0000 7f91716d4700 1 -- 172.21.15.73:0/2564758189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916c10d1a0 con 0x7f916c1965f0 2023-08-10T11:53:35.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.242+0000 7f9153fff700 1 -- 172.21.15.73:0/2564758189 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f9164004ad0 con 0x7f916c1965f0 2023-08-10T11:53:35.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.243+0000 7f917d86db80 1 Processor -- start 2023-08-10T11:53:35.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.243+0000 7f9153fff700 1 --2- 172.21.15.73:0/2564758189 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f91540a13e0 0x7f91540a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:35.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.243+0000 7f917d86db80 1 -- start start 2023-08-10T11:53:35.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.243+0000 7f9153fff700 1 -- 172.21.15.73:0/2564758189 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f91640ccb30 con 0x7f916c1965f0 2023-08-10T11:53:35.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.243+0000 7f917d86db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd20c906d0 0x55cd20c90ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:35.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.243+0000 7f917d86db80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd20c90ff0 0x55cd20c8bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:35.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.243+0000 7f917d86db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd20c8c010 0x55cd20c8c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:35.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.243+0000 7f917d86db80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd20bfedc0 con 0x55cd20c90ff0 2023-08-10T11:53:35.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.243+0000 7f917d86db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd20bdb590 con 0x55cd20c8c010 2023-08-10T11:53:35.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.243+0000 7f917d86db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd20bd8eb0 con 0x55cd20c906d0 2023-08-10T11:53:35.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.244+0000 7f916affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd20c906d0 0x55cd20c90ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:35.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.244+0000 7f916affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd20c906d0 0x55cd20c90ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:59216/0 (socket says 172.21.15.73:59216) 2023-08-10T11:53:35.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.244+0000 7f916affd700 1 -- 172.21.15.73:0/984646518 learned_addr learned my addr 172.21.15.73:0/984646518 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:35.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.244+0000 7f916b7fe700 1 --2- 172.21.15.73:0/984646518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd20c8c010 0x55cd20c8c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:35.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.244+0000 7f916affd700 1 -- 172.21.15.73:0/984646518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd20c8c010 msgr2=0x55cd20c8c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:35.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.244+0000 7f916affd700 1 --2- 172.21.15.73:0/984646518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd20c8c010 0x55cd20c8c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.244+0000 7f916affd700 1 -- 172.21.15.73:0/984646518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd20c90ff0 msgr2=0x55cd20c8bad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T11:53:35.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.244+0000 7f916affd700 1 --2- 172.21.15.73:0/984646518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd20c90ff0 0x55cd20c8bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.244+0000 7f916affd700 1 -- 172.21.15.73:0/984646518 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd20a55630 con 0x55cd20c906d0 2023-08-10T11:53:35.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.244+0000 7f916b7fe700 1 --2- 172.21.15.73:0/984646518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd20c8c010 0x55cd20c8c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:53:35.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.244+0000 7f916affd700 1 --2- 172.21.15.73:0/984646518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd20c906d0 0x55cd20c90ab0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f915c00bd70 tx=0x7f915c0106b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba5e78a1b70c9130 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:35.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.245+0000 7f91517fa700 1 -- 172.21.15.73:0/984646518 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c010e10 con 0x55cd20c906d0 2023-08-10T11:53:35.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.245+0000 7f916a7fc700 1 --2- 172.21.15.73:0/2564758189 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f91540a13e0 0x7f91540a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:35.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.245+0000 7f91517fa700 1 -- 172.21.15.73:0/984646518 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f915c015070 con 0x55cd20c906d0 2023-08-10T11:53:35.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.245+0000 7f91517fa700 1 -- 172.21.15.73:0/984646518 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c01a670 con 0x55cd20c906d0 2023-08-10T11:53:35.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.246+0000 7f917d86db80 1 -- 172.21.15.73:0/984646518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd20c906d0 msgr2=0x55cd20c90ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:35.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.246+0000 7f916a7fc700 1 --2- 172.21.15.73:0/2564758189 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f91540a13e0 0x7f91540a38a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f916000b2e0 tx=0x7f9160009550 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:35.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.246+0000 7f917d86db80 1 --2- 172.21.15.73:0/984646518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd20c906d0 0x55cd20c90ab0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f915c00bd70 tx=0x7f915c0106b0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.246+0000 7f917d86db80 1 -- 172.21.15.73:0/984646518 shutdown_connections 2023-08-10T11:53:35.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.246+0000 7f917d86db80 1 --2- 172.21.15.73:0/984646518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd20c8c010 0x55cd20c8c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.246+0000 7f917d86db80 1 --2- 172.21.15.73:0/984646518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd20c906d0 0x55cd20c90ab0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.246+0000 7f917d86db80 1 --2- 172.21.15.73:0/984646518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd20c90ff0 0x55cd20c8bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.246+0000 7f917d86db80 1 -- 172.21.15.73:0/984646518 >> 172.21.15.73:0/984646518 conn(0x55cd20be0cd0 msgr2=0x55cd20c7e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:35.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.246+0000 7f917d86db80 1 -- 172.21.15.73:0/984646518 shutdown_connections 2023-08-10T11:53:35.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.246+0000 7f917d86db80 1 -- 172.21.15.73:0/984646518 wait complete. 2023-08-10T11:53:35.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.246+0000 7f917d86db80 1 -- start start 2023-08-10T11:53:35.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.246+0000 7f917d86db80 1 Processor -- start 2023-08-10T11:53:35.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.247+0000 7f917d86db80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd20c8c010 0x55cd20c95b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:35.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.247+0000 7f917d86db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd20c906d0 0x55cd20c96040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:35.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.247+0000 7f917d86db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd20c90ff0 0x55cd20c8a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:35.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.247+0000 7f917d86db80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd20bd47a0 con 0x55cd20c8c010 2023-08-10T11:53:35.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.247+0000 7f917d86db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd20b73ac0 con 0x55cd20c906d0 2023-08-10T11:53:35.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.247+0000 7f917d86db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd20b737c0 con 0x55cd20c90ff0 2023-08-10T11:53:35.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.247+0000 7f917d86db80 10 client.0 _ll_register_callbacks cb 0x55cd20b71680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:35.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.247+0000 7f916affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd20c8c010 0x55cd20c95b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:35.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.247+0000 7f916affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd20c8c010 0x55cd20c95b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33718/0 (socket says 172.21.15.73:33718) 2023-08-10T11:53:35.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.247+0000 7f916affd700 1 -- 172.21.15.73:0/1987612863 learned_addr learned my addr 172.21.15.73:0/1987612863 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:35.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.247+0000 7f916b7fe700 1 --2- 172.21.15.73:0/1987612863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd20c90ff0 0x55cd20c8a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:35.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.247+0000 7f916affd700 1 -- 172.21.15.73:0/1987612863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd20c90ff0 msgr2=0x55cd20c8a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:35.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.247+0000 7f916affd700 1 --2- 172.21.15.73:0/1987612863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd20c90ff0 0x55cd20c8a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.247+0000 7f916affd700 1 -- 172.21.15.73:0/1987612863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd20c906d0 msgr2=0x55cd20c96040 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T11:53:35.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.247+0000 7f916affd700 1 --2- 172.21.15.73:0/1987612863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd20c906d0 0x55cd20c96040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.247+0000 7f916affd700 1 -- 172.21.15.73:0/1987612863 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916c10d1a0 con 0x55cd20c8c010 2023-08-10T11:53:35.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.247+0000 7f916affd700 1 --2- 172.21.15.73:0/1987612863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd20c8c010 0x55cd20c95b00 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f915c00b6c0 tx=0x7f915c010ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eafc7f4da2253813 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:35.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.247+0000 7f914eff5700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:35.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.248+0000 7f914eff5700 1 -- 172.21.15.73:0/1987612863 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c020040 con 0x55cd20c8c010 2023-08-10T11:53:35.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.248+0000 7f917d86db80 1 -- 172.21.15.73:0/1987612863 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cd20c76470 con 0x55cd20c8c010 2023-08-10T11:53:35.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.248+0000 7f914eff5700 1 -- 172.21.15.73:0/1987612863 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f915c017070 con 0x55cd20c8c010 2023-08-10T11:53:35.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.248+0000 7f914eff5700 1 -- 172.21.15.73:0/1987612863 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f915c00bec0 con 0x55cd20c8c010 2023-08-10T11:53:35.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.248+0000 7f917d86db80 10 client.15891 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:35.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.248+0000 7f917d86db80 1 -- 172.21.15.73:0/1987612863 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f915c00b9a0 con 0x55cd20c8c010 2023-08-10T11:53:35.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.248+0000 7f914eff5700 1 -- 172.21.15.73:0/1987612863 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f915c033020 con 0x55cd20c8c010 2023-08-10T11:53:35.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.248+0000 7f914eff5700 1 -- 172.21.15.73:0/1987612863 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f915c01c480 con 0x55cd20c8c010 2023-08-10T11:53:35.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.248+0000 7f917d86db80 10 client.15891 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:35.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.248+0000 7f917d86db80 10 client.15891 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:53:35.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.248+0000 7f917d86db80 20 client.15891 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:35.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.248+0000 7f917d86db80 1 --2- 172.21.15.73:0/1987612863 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55cd20cae1d0 0x55cd20cb05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:35.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.248+0000 7f917d86db80 4 client.15891 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:53:35.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.248+0000 7f917d86db80 1 -- 172.21.15.73:0/1987612863 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cd20c529d0 con 0x55cd20cae1d0 2023-08-10T11:53:35.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.250+0000 7f916a7fc700 1 --2- 172.21.15.73:0/1987612863 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55cd20cae1d0 0x55cd20cb05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:35.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.250+0000 7f914eff5700 10 client.15891 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:35.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.250+0000 7f916a7fc700 1 --2- 172.21.15.73:0/1987612863 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55cd20cae1d0 0x55cd20cb05f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbf010c5abfcf934 server_cookie=3b106076f4198748 in_seq=0 out_seq=0 2023-08-10T11:53:35.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.251+0000 7f914eff5700 1 -- 172.21.15.73:0/1987612863 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55cd20c529d0 con 0x55cd20cae1d0 2023-08-10T11:53:35.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.251+0000 7f914eff5700 10 client.15891 handle_command_reply: tid=0 2023-08-10T11:53:35.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.251+0000 7f917d86db80 1 client.15891 shutdown 2023-08-10T11:53:35.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.251+0000 7f917d86db80 1 -- 172.21.15.73:0/1987612863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd20c8c010 msgr2=0x55cd20c95b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:35.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.251+0000 7f917d86db80 1 --2- 172.21.15.73:0/1987612863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd20c8c010 0x55cd20c95b00 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f915c00b6c0 tx=0x7f915c010ef0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.251+0000 7f917d86db80 1 -- 172.21.15.73:0/1987612863 shutdown_connections 2023-08-10T11:53:35.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.251+0000 7f917d86db80 1 --2- 172.21.15.73:0/1987612863 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55cd20cae1d0 0x55cd20cb05f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.251+0000 7f917d86db80 1 --2- 172.21.15.73:0/1987612863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd20c90ff0 0x55cd20c8a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.251+0000 7f914eff5700 0 client.15891 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:35.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.251+0000 7f917d86db80 1 --2- 172.21.15.73:0/1987612863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd20c8c010 0x55cd20c95b00 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.251+0000 7f917d86db80 1 --2- 172.21.15.73:0/1987612863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd20c906d0 0x55cd20c96040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.251+0000 7f917d86db80 1 -- 172.21.15.73:0/1987612863 >> 172.21.15.73:0/1987612863 conn(0x55cd20be0cd0 msgr2=0x55cd20c91e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:35.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.251+0000 7f917d86db80 1 -- 172.21.15.73:0/1987612863 shutdown_connections 2023-08-10T11:53:35.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.251+0000 7f917d86db80 1 -- 172.21.15.73:0/1987612863 wait complete. 2023-08-10T11:53:35.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.252+0000 7f917d86db80 20 client.15891 trim_cache size 0 max 16384 2023-08-10T11:53:35.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.276+0000 7f917d86db80 1 Processor -- start 2023-08-10T11:53:35.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.276+0000 7f917d86db80 1 -- start start 2023-08-10T11:53:35.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.276+0000 7f917d86db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd20c8c010 0x55cd20c8e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:35.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.276+0000 7f917d86db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd20c906d0 0x55cd20c87730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:35.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.276+0000 7f917d86db80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd20c90ff0 0x55cd20c8a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:35.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.276+0000 7f917d86db80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd20a57920 con 0x55cd20c90ff0 2023-08-10T11:53:35.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.276+0000 7f917d86db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd20c7fdf0 con 0x55cd20c8c010 2023-08-10T11:53:35.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.276+0000 7f917d86db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd20c7af80 con 0x55cd20c906d0 2023-08-10T11:53:35.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.276+0000 7f916b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd20c90ff0 0x55cd20c8a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:35.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.276+0000 7f916b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd20c90ff0 0x55cd20c8a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33730/0 (socket says 172.21.15.73:33730) 2023-08-10T11:53:35.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.276+0000 7f916b7fe700 1 -- 172.21.15.73:0/456287673 learned_addr learned my addr 172.21.15.73:0/456287673 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:35.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.276+0000 7f916a7fc700 1 --2- 172.21.15.73:0/456287673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd20c906d0 0x55cd20c87730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:35.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.276+0000 7f916affd700 1 --2- 172.21.15.73:0/456287673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd20c8c010 0x55cd20c8e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:35.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.277+0000 7f916b7fe700 1 -- 172.21.15.73:0/456287673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd20c906d0 msgr2=0x55cd20c87730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:35.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.277+0000 7f916b7fe700 1 --2- 172.21.15.73:0/456287673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd20c906d0 0x55cd20c87730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.277+0000 7f916b7fe700 1 -- 172.21.15.73:0/456287673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd20c8c010 msgr2=0x55cd20c8e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:35.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.277+0000 7f916b7fe700 1 --2- 172.21.15.73:0/456287673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd20c8c010 0x55cd20c8e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.277+0000 7f916b7fe700 1 -- 172.21.15.73:0/456287673 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd20a01de0 con 0x55cd20c90ff0 2023-08-10T11:53:35.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.277+0000 7f916b7fe700 1 --2- 172.21.15.73:0/456287673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd20c90ff0 0x55cd20c8a4d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f91640ca8b0 tx=0x7f916401b440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9422328651bfd1df server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:35.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.277+0000 7f9151ffb700 1 -- 172.21.15.73:0/456287673 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91640a1e30 con 0x55cd20c90ff0 2023-08-10T11:53:35.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.277+0000 7f9151ffb700 1 -- 172.21.15.73:0/456287673 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9164097e10 con 0x55cd20c90ff0 2023-08-10T11:53:35.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.277+0000 7f9151ffb700 1 -- 172.21.15.73:0/456287673 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91640a1c00 con 0x55cd20c90ff0 2023-08-10T11:53:35.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.278+0000 7f917d86db80 1 -- 172.21.15.73:0/456287673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd20c90ff0 msgr2=0x55cd20c8a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:35.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.278+0000 7f917d86db80 1 --2- 172.21.15.73:0/456287673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd20c90ff0 0x55cd20c8a4d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f91640ca8b0 tx=0x7f916401b440 comp rx=0 tx=0).stop 2023-08-10T11:53:35.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.278+0000 7f917d86db80 1 -- 172.21.15.73:0/456287673 shutdown_connections 2023-08-10T11:53:35.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.278+0000 7f917d86db80 1 --2- 172.21.15.73:0/456287673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd20c8c010 0x55cd20c8e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.278+0000 7f917d86db80 1 --2- 172.21.15.73:0/456287673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd20c90ff0 0x55cd20c8a4d0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.278+0000 7f917d86db80 1 --2- 172.21.15.73:0/456287673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd20c906d0 0x55cd20c87730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.278+0000 7f917d86db80 1 -- 172.21.15.73:0/456287673 >> 172.21.15.73:0/456287673 conn(0x55cd20be0cd0 msgr2=0x55cd20c89dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:35.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.278+0000 7f917d86db80 1 -- 172.21.15.73:0/456287673 shutdown_connections 2023-08-10T11:53:35.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.278+0000 7f917d86db80 1 -- 172.21.15.73:0/456287673 wait complete. 2023-08-10T11:53:35.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.279+0000 7f917d86db80 1 -- start start 2023-08-10T11:53:35.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.279+0000 7f917d86db80 1 Processor -- start 2023-08-10T11:53:35.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.279+0000 7f917d86db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd20c8c010 0x55cd20c875d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:35.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.279+0000 7f917d86db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd20c906d0 0x55cd20c858c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:35.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.279+0000 7f917d86db80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd20c90ff0 0x55cd20c85e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:35.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.279+0000 7f917d86db80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd20c864d0 con 0x55cd20c90ff0 2023-08-10T11:53:35.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.279+0000 7f917d86db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd20c86640 con 0x55cd20c8c010 2023-08-10T11:53:35.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.279+0000 7f917d86db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd20d01ed0 con 0x55cd20c906d0 2023-08-10T11:53:35.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.279+0000 7f917d86db80 10 client.0 _ll_register_callbacks cb 0x55cd20b71680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:35.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.279+0000 7f916affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd20c8c010 0x55cd20c875d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:35.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.279+0000 7f916affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd20c8c010 0x55cd20c875d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:48382/0 (socket says 172.21.15.73:48382) 2023-08-10T11:53:35.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.279+0000 7f916affd700 1 -- 172.21.15.73:0/1941262940 learned_addr learned my addr 172.21.15.73:0/1941262940 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:35.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.279+0000 7f916a7fc700 1 --2- 172.21.15.73:0/1941262940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd20c906d0 0x55cd20c858c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:35.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.280+0000 7f916affd700 1 -- 172.21.15.73:0/1941262940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd20c906d0 msgr2=0x55cd20c858c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:35.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.280+0000 7f916affd700 1 --2- 172.21.15.73:0/1941262940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd20c906d0 0x55cd20c858c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.280+0000 7f916affd700 1 -- 172.21.15.73:0/1941262940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd20c90ff0 msgr2=0x55cd20c85e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:35.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.280+0000 7f916affd700 1 --2- 172.21.15.73:0/1941262940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd20c90ff0 0x55cd20c85e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.280+0000 7f916affd700 1 -- 172.21.15.73:0/1941262940 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916c10cc90 con 0x55cd20c8c010 2023-08-10T11:53:35.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.280+0000 7f916affd700 1 --2- 172.21.15.73:0/1941262940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd20c8c010 0x55cd20c875d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f915c00b5a0 tx=0x7f915c00bec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fc5058a80cbe8f6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:35.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.280+0000 7f914eff5700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T11:53:35.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.280+0000 7f914eff5700 1 -- 172.21.15.73:0/1941262940 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c020040 con 0x55cd20c8c010 2023-08-10T11:53:35.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.280+0000 7f917d86db80 1 -- 172.21.15.73:0/1941262940 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f915c015070 con 0x55cd20c8c010 2023-08-10T11:53:35.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.280+0000 7f914eff5700 1 -- 172.21.15.73:0/1941262940 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f915c000e40 con 0x55cd20c8c010 2023-08-10T11:53:35.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.280+0000 7f914eff5700 1 -- 172.21.15.73:0/1941262940 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f915c011850 con 0x55cd20c8c010 2023-08-10T11:53:35.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.281+0000 7f917d86db80 10 client.25319 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:35.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.281+0000 7f917d86db80 1 -- 172.21.15.73:0/1941262940 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55cd209eac60 con 0x55cd20c8c010 2023-08-10T11:53:35.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.281+0000 7f914eff5700 1 -- 172.21.15.73:0/1941262940 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f915c015070 con 0x55cd20c8c010 2023-08-10T11:53:35.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.281+0000 7f914eff5700 1 -- 172.21.15.73:0/1941262940 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f915c01b710 con 0x55cd20c8c010 2023-08-10T11:53:35.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.281+0000 7f917d86db80 10 client.25319 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:35.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.281+0000 7f917d86db80 10 client.25319 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:53:35.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.281+0000 7f917d86db80 20 client.25319 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:35.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.281+0000 7f917d86db80 1 --2- 172.21.15.73:0/1941262940 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55cd20d031e0 0x55cd20d055d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:35.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.281+0000 7f917d86db80 4 client.25319 mds_command: new command op to 24503 tid=0[{"prefix": "damage ls"}] 2023-08-10T11:53:35.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.281+0000 7f917d86db80 1 -- 172.21.15.73:0/1941262940 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55cd20bcd780 con 0x55cd20d031e0 2023-08-10T11:53:35.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.281+0000 7f916a7fc700 1 --2- 172.21.15.73:0/1941262940 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55cd20d031e0 0x55cd20d055d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:35.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.282+0000 7f914eff5700 10 client.25319 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:35.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.282+0000 7f916a7fc700 1 --2- 172.21.15.73:0/1941262940 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55cd20d031e0 0x55cd20d055d0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e51d54a83cd1760 server_cookie=20734a52605c1649 in_seq=0 out_seq=0 2023-08-10T11:53:35.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.282+0000 7f914eff5700 1 -- 172.21.15.73:0/1941262940 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55cd20bcd780 con 0x55cd20d031e0 2023-08-10T11:53:35.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.282+0000 7f914eff5700 10 client.25319 handle_command_reply: tid=0 2023-08-10T11:53:35.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.282+0000 7f917d86db80 1 client.25319 shutdown 2023-08-10T11:53:35.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.282+0000 7f917d86db80 1 -- 172.21.15.73:0/1941262940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd20c8c010 msgr2=0x55cd20c875d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:35.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.282+0000 7f917d86db80 1 --2- 172.21.15.73:0/1941262940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd20c8c010 0x55cd20c875d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f915c00b5a0 tx=0x7f915c00bec0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.282+0000 7f917d86db80 1 -- 172.21.15.73:0/1941262940 shutdown_connections 2023-08-10T11:53:35.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.282+0000 7f917d86db80 1 --2- 172.21.15.73:0/1941262940 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55cd20d031e0 0x55cd20d055d0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.282+0000 7f917d86db80 1 --2- 172.21.15.73:0/1941262940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55cd20c8c010 0x55cd20c875d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.282+0000 7f914eff5700 0 client.25319 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:35.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.282+0000 7f917d86db80 1 --2- 172.21.15.73:0/1941262940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd20c90ff0 0x55cd20c85e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.282+0000 7f917d86db80 1 --2- 172.21.15.73:0/1941262940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd20c906d0 0x55cd20c858c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.282+0000 7f917d86db80 1 -- 172.21.15.73:0/1941262940 >> 172.21.15.73:0/1941262940 conn(0x55cd20be0cd0 msgr2=0x55cd20c822b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:35.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.282+0000 7f917d86db80 1 -- 172.21.15.73:0/1941262940 shutdown_connections 2023-08-10T11:53:35.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.282+0000 7f917d86db80 1 -- 172.21.15.73:0/1941262940 wait complete. 2023-08-10T11:53:35.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.283+0000 7f917d86db80 20 client.25319 trim_cache size 0 max 16384 2023-08-10T11:53:35.293 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2023-08-10T11:53:35.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.283+0000 7f91716d4700 1 -- 172.21.15.73:0/2564758189 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f91540a13e0 msgr2=0x7f91540a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:35.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.283+0000 7f91716d4700 1 --2- 172.21.15.73:0/2564758189 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f91540a13e0 0x7f91540a38a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f916000b2e0 tx=0x7f9160009550 comp rx=0 tx=0).stop 2023-08-10T11:53:35.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.283+0000 7f91716d4700 1 -- 172.21.15.73:0/2564758189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f916c1965f0 msgr2=0x7f916c196aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:35.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.283+0000 7f91716d4700 1 --2- 172.21.15.73:0/2564758189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f916c1965f0 0x7f916c196aa0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f916400ef30 tx=0x7f916400c3a0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.283+0000 7f91716d4700 1 -- 172.21.15.73:0/2564758189 shutdown_connections 2023-08-10T11:53:35.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.283+0000 7f91716d4700 1 --2- 172.21.15.73:0/2564758189 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f91540a13e0 0x7f91540a38a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.283+0000 7f91716d4700 1 --2- 172.21.15.73:0/2564758189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f916c0ffff0 0x7f916c19c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.283+0000 7f91716d4700 1 --2- 172.21.15.73:0/2564758189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f916c1965f0 0x7f916c196aa0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.283+0000 7f91716d4700 1 --2- 172.21.15.73:0/2564758189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f916c104940 0x7f916c19cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:35.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.283+0000 7f91716d4700 1 -- 172.21.15.73:0/2564758189 >> 172.21.15.73:0/2564758189 conn(0x7f916c076be0 msgr2=0x7f916c102090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:35.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.283+0000 7f91716d4700 1 -- 172.21.15.73:0/2564758189 shutdown_connections 2023-08-10T11:53:35.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:35.283+0000 7f91716d4700 1 -- 172.21.15.73:0/2564758189 wait complete. 2023-08-10T11:53:36.302 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-08-10T11:53:36.302 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-08-10T11:53:36.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.427+0000 7f4286181700 1 -- 172.21.15.73:0/1023569247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4280101090 msgr2=0x7f428010d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:36.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.427+0000 7f4286181700 1 --2- 172.21.15.73:0/1023569247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4280101090 0x7f428010d5a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f427800b0a0 tx=0x7f427800b3b0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.427+0000 7f4286181700 1 -- 172.21.15.73:0/1023569247 shutdown_connections 2023-08-10T11:53:36.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.427+0000 7f4286181700 1 --2- 172.21.15.73:0/1023569247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42801066e0 0x7f4280106ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.427+0000 7f4286181700 1 --2- 172.21.15.73:0/1023569247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4280101090 0x7f428010d5a0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.427+0000 7f4286181700 1 --2- 172.21.15.73:0/1023569247 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42801006d0 0x7f4280100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.427+0000 7f4286181700 1 -- 172.21.15.73:0/1023569247 >> 172.21.15.73:0/1023569247 conn(0x7f42800fc1e0 msgr2=0x7f42800fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:36.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.427+0000 7f4286181700 1 -- 172.21.15.73:0/1023569247 shutdown_connections 2023-08-10T11:53:36.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.427+0000 7f4286181700 1 -- 172.21.15.73:0/1023569247 wait complete. 2023-08-10T11:53:36.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.427+0000 7f4286181700 1 Processor -- start 2023-08-10T11:53:36.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.428+0000 7f4286181700 1 -- start start 2023-08-10T11:53:36.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.428+0000 7f4286181700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42801006d0 0x7f4280196650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.428+0000 7f4286181700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4280101090 0x7f4280196b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.428+0000 7f4286181700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42801066e0 0x7f428019aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.428+0000 7f4286181700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428019b630 con 0x7f42801006d0 2023-08-10T11:53:36.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.428+0000 7f4286181700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428019b7a0 con 0x7f42801066e0 2023-08-10T11:53:36.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.428+0000 7f4286181700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428019b960 con 0x7f4280101090 2023-08-10T11:53:36.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.428+0000 7f427f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42801006d0 0x7f4280196650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.428+0000 7f427f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42801006d0 0x7f4280196650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33746/0 (socket says 172.21.15.73:33746) 2023-08-10T11:53:36.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.428+0000 7f427f7fe700 1 -- 172.21.15.73:0/773970484 learned_addr learned my addr 172.21.15.73:0/773970484 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:36.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.428+0000 7f427effd700 1 --2- 172.21.15.73:0/773970484 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4280101090 0x7f4280196b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.428+0000 7f427ffff700 1 --2- 172.21.15.73:0/773970484 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42801066e0 0x7f428019aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.428+0000 7f427f7fe700 1 -- 172.21.15.73:0/773970484 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4280101090 msgr2=0x7f4280196b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:36.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.428+0000 7f427f7fe700 1 --2- 172.21.15.73:0/773970484 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4280101090 0x7f4280196b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.428+0000 7f427f7fe700 1 -- 172.21.15.73:0/773970484 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42801066e0 msgr2=0x7f428019aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:36.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.428+0000 7f427f7fe700 1 --2- 172.21.15.73:0/773970484 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42801066e0 0x7f428019aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.428+0000 7f427f7fe700 1 -- 172.21.15.73:0/773970484 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4278009d00 con 0x7f42801006d0 2023-08-10T11:53:36.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.428+0000 7f427f7fe700 1 --2- 172.21.15.73:0/773970484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42801006d0 0x7f4280196650 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f427400c9b0 tx=0x7f427400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:36.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.428+0000 7f427cff9700 1 -- 172.21.15.73:0/773970484 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4274007b00 con 0x7f42801006d0 2023-08-10T11:53:36.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.428+0000 7f4286181700 1 -- 172.21.15.73:0/773970484 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f428019bc40 con 0x7f42801006d0 2023-08-10T11:53:36.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.428+0000 7f427cff9700 1 -- 172.21.15.73:0/773970484 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4274007c60 con 0x7f42801006d0 2023-08-10T11:53:36.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.428+0000 7f427cff9700 1 -- 172.21.15.73:0/773970484 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4274018660 con 0x7f42801006d0 2023-08-10T11:53:36.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.428+0000 7f4286181700 1 -- 172.21.15.73:0/773970484 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42801a3480 con 0x7f42801006d0 2023-08-10T11:53:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.431+0000 7f427cff9700 1 -- 172.21.15.73:0/773970484 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f4274018880 con 0x7f42801006d0 2023-08-10T11:53:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.432+0000 7f427cff9700 1 --2- 172.21.15.73:0/773970484 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f42680a13e0 0x7f42680a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.432+0000 7f427effd700 1 --2- 172.21.15.73:0/773970484 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f42680a13e0 0x7f42680a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.432+0000 7f427cff9700 1 -- 172.21.15.73:0/773970484 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f42740ccfe0 con 0x7f42801006d0 2023-08-10T11:53:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.432+0000 7f427effd700 1 --2- 172.21.15.73:0/773970484 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f42680a13e0 0x7f42680a38a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4270005ea0 tx=0x7f4270005e30 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.432+0000 7f429231ab80 1 Processor -- start 2023-08-10T11:53:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.432+0000 7f429231ab80 1 -- start start 2023-08-10T11:53:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.433+0000 7f429231ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3333fc350 0x55b3333fc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.433+0000 7f429231ab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fcc70 0x55b3333f7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.433+0000 7f429231ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b3333f7c90 0x55b3333f80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.433+0000 7f429231ab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b33336ee40 con 0x55b3333fcc70 2023-08-10T11:53:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.433+0000 7f429231ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b33334b610 con 0x55b3333f7c90 2023-08-10T11:53:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.433+0000 7f429231ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b333348f30 con 0x55b3333fc350 2023-08-10T11:53:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.433+0000 7f427effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fcc70 0x55b3333f7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.433+0000 7f427effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fcc70 0x55b3333f7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33756/0 (socket says 172.21.15.73:33756) 2023-08-10T11:53:36.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.433+0000 7f427effd700 1 -- 172.21.15.73:0/4162275462 learned_addr learned my addr 172.21.15.73:0/4162275462 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:36.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.433+0000 7f427ffff700 1 --2- 172.21.15.73:0/4162275462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b3333f7c90 0x55b3333f80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.433+0000 7f427f7fe700 1 --2- 172.21.15.73:0/4162275462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3333fc350 0x55b3333fc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.433+0000 7f427effd700 1 -- 172.21.15.73:0/4162275462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3333fc350 msgr2=0x55b3333fc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:36.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.433+0000 7f427effd700 1 --2- 172.21.15.73:0/4162275462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3333fc350 0x55b3333fc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.433+0000 7f427effd700 1 -- 172.21.15.73:0/4162275462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b3333f7c90 msgr2=0x55b3333f80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:36.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.433+0000 7f427effd700 1 --2- 172.21.15.73:0/4162275462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b3333f7c90 0x55b3333f80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.433+0000 7f427effd700 1 -- 172.21.15.73:0/4162275462 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3331c56b0 con 0x55b3333fcc70 2023-08-10T11:53:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.433+0000 7f427effd700 1 --2- 172.21.15.73:0/4162275462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fcc70 0x55b3333f7750 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f427000a520 tx=0x7f427000af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8bf5491efa4527 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.433+0000 7f4265ffb700 1 -- 172.21.15.73:0/4162275462 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4270010d80 con 0x55b3333fcc70 2023-08-10T11:53:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.433+0000 7f4265ffb700 1 -- 172.21.15.73:0/4162275462 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f427001d910 con 0x55b3333fcc70 2023-08-10T11:53:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.433+0000 7f4265ffb700 1 -- 172.21.15.73:0/4162275462 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427000f7e0 con 0x55b3333fcc70 2023-08-10T11:53:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.434+0000 7f429231ab80 1 -- 172.21.15.73:0/4162275462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fcc70 msgr2=0x55b3333f7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.434+0000 7f429231ab80 1 --2- 172.21.15.73:0/4162275462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fcc70 0x55b3333f7750 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f427000a520 tx=0x7f427000af90 comp rx=0 tx=0).stop 2023-08-10T11:53:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.434+0000 7f429231ab80 1 -- 172.21.15.73:0/4162275462 shutdown_connections 2023-08-10T11:53:36.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.434+0000 7f429231ab80 1 --2- 172.21.15.73:0/4162275462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b3333f7c90 0x55b3333f80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.434+0000 7f429231ab80 1 --2- 172.21.15.73:0/4162275462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3333fc350 0x55b3333fc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.434+0000 7f429231ab80 1 --2- 172.21.15.73:0/4162275462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fcc70 0x55b3333f7750 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.434+0000 7f429231ab80 1 -- 172.21.15.73:0/4162275462 >> 172.21.15.73:0/4162275462 conn(0x55b333350d50 msgr2=0x55b3333ee550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:36.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.434+0000 7f429231ab80 1 -- 172.21.15.73:0/4162275462 shutdown_connections 2023-08-10T11:53:36.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.434+0000 7f429231ab80 1 -- 172.21.15.73:0/4162275462 wait complete. 2023-08-10T11:53:36.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.434+0000 7f429231ab80 1 -- start start 2023-08-10T11:53:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.435+0000 7f429231ab80 1 Processor -- start 2023-08-10T11:53:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.435+0000 7f429231ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3333f7c90 0x55b333401020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.435+0000 7f429231ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b3333fc350 0x55b333401560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.435+0000 7f429231ab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fcc70 0x55b333401aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.435+0000 7f429231ab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b333344820 con 0x55b3333fcc70 2023-08-10T11:53:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.435+0000 7f429231ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3332e3b40 con 0x55b3333fc350 2023-08-10T11:53:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.435+0000 7f429231ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3332e3840 con 0x55b3333f7c90 2023-08-10T11:53:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.435+0000 7f429231ab80 10 client.0 _ll_register_callbacks cb 0x55b3332e1700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:36.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.435+0000 7f427ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fcc70 0x55b333401aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.435+0000 7f427ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fcc70 0x55b333401aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33764/0 (socket says 172.21.15.73:33764) 2023-08-10T11:53:36.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.435+0000 7f427ffff700 1 -- 172.21.15.73:0/3187184008 learned_addr learned my addr 172.21.15.73:0/3187184008 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:36.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.435+0000 7f427ffff700 1 -- 172.21.15.73:0/3187184008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3333f7c90 msgr2=0x55b333401020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:36.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.435+0000 7f427effd700 1 --2- 172.21.15.73:0/3187184008 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b3333fc350 0x55b333401560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.435+0000 7f427ffff700 1 --2- 172.21.15.73:0/3187184008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3333f7c90 0x55b333401020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.435+0000 7f427ffff700 1 -- 172.21.15.73:0/3187184008 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b3333fc350 msgr2=0x55b333401560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:36.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.435+0000 7f427ffff700 1 --2- 172.21.15.73:0/3187184008 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b3333fc350 0x55b333401560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.435+0000 7f427ffff700 1 -- 172.21.15.73:0/3187184008 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427000e9a0 con 0x55b3333fcc70 2023-08-10T11:53:36.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.435+0000 7f427effd700 1 --2- 172.21.15.73:0/3187184008 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b3333fc350 0x55b333401560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:36.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.436+0000 7f427ffff700 1 --2- 172.21.15.73:0/3187184008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fcc70 0x55b333401aa0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4278009610 tx=0x7f4278004f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf980438cc23f08 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:36.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.436+0000 7f425effd700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:36.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.436+0000 7f425effd700 1 -- 172.21.15.73:0/3187184008 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427800e040 con 0x55b3333fcc70 2023-08-10T11:53:36.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.436+0000 7f425effd700 1 -- 172.21.15.73:0/3187184008 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f427801c440 con 0x55b3333fcc70 2023-08-10T11:53:36.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.436+0000 7f429231ab80 1 -- 172.21.15.73:0/3187184008 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b3333e64f0 con 0x55b3333fcc70 2023-08-10T11:53:36.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.436+0000 7f425effd700 1 -- 172.21.15.73:0/3187184008 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f427801c600 con 0x55b3333fcc70 2023-08-10T11:53:36.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.436+0000 7f429231ab80 10 client.15906 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:36.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.436+0000 7f429231ab80 1 -- 172.21.15.73:0/3187184008 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b333171e60 con 0x55b3333fcc70 2023-08-10T11:53:36.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.436+0000 7f425effd700 1 -- 172.21.15.73:0/3187184008 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b3333e64f0 con 0x55b3333fcc70 2023-08-10T11:53:36.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.436+0000 7f425effd700 1 -- 172.21.15.73:0/3187184008 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4278019050 con 0x55b3333fcc70 2023-08-10T11:53:36.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.436+0000 7f429231ab80 10 client.15906 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:36.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.436+0000 7f429231ab80 10 client.15906 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:53:36.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.436+0000 7f429231ab80 20 client.15906 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:36.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.436+0000 7f429231ab80 1 --2- 172.21.15.73:0/3187184008 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b333411800 0x55b333413c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.436+0000 7f429231ab80 4 client.15906 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:53:36.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.436+0000 7f429231ab80 1 -- 172.21.15.73:0/3187184008 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b3333c2a50 con 0x55b333411800 2023-08-10T11:53:36.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.437+0000 7f427f7fe700 1 --2- 172.21.15.73:0/3187184008 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b333411800 0x55b333413c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.437+0000 7f425effd700 10 client.15906 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:36.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.437+0000 7f427f7fe700 1 --2- 172.21.15.73:0/3187184008 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b333411800 0x55b333413c20 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f15e104de78c6a44 server_cookie=1183ccbf01df3fd4 in_seq=0 out_seq=0 2023-08-10T11:53:36.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.438+0000 7f425effd700 1 -- 172.21.15.73:0/3187184008 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55b3333c2a50 con 0x55b333411800 2023-08-10T11:53:36.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.438+0000 7f425effd700 10 client.15906 handle_command_reply: tid=0 2023-08-10T11:53:36.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.438+0000 7f429231ab80 1 client.15906 shutdown 2023-08-10T11:53:36.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.438+0000 7f429231ab80 1 -- 172.21.15.73:0/3187184008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fcc70 msgr2=0x55b333401aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:36.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.438+0000 7f429231ab80 1 --2- 172.21.15.73:0/3187184008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fcc70 0x55b333401aa0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4278009610 tx=0x7f4278004f00 comp rx=0 tx=0).stop 2023-08-10T11:53:36.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.438+0000 7f429231ab80 1 -- 172.21.15.73:0/3187184008 shutdown_connections 2023-08-10T11:53:36.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.438+0000 7f429231ab80 1 --2- 172.21.15.73:0/3187184008 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b333411800 0x55b333413c20 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.438+0000 7f429231ab80 1 --2- 172.21.15.73:0/3187184008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fcc70 0x55b333401aa0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.438+0000 7f425effd700 0 client.15906 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:36.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.438+0000 7f429231ab80 1 --2- 172.21.15.73:0/3187184008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3333f7c90 0x55b333401020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.438+0000 7f429231ab80 1 --2- 172.21.15.73:0/3187184008 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b3333fc350 0x55b333401560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.438+0000 7f429231ab80 1 -- 172.21.15.73:0/3187184008 >> 172.21.15.73:0/3187184008 conn(0x55b333350d50 msgr2=0x55b3333fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:36.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.438+0000 7f429231ab80 1 -- 172.21.15.73:0/3187184008 shutdown_connections 2023-08-10T11:53:36.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.438+0000 7f429231ab80 1 -- 172.21.15.73:0/3187184008 wait complete. 2023-08-10T11:53:36.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.438+0000 7f429231ab80 20 client.15906 trim_cache size 0 max 16384 2023-08-10T11:53:36.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.454+0000 7f429231ab80 1 Processor -- start 2023-08-10T11:53:36.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.455+0000 7f429231ab80 1 -- start start 2023-08-10T11:53:36.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.455+0000 7f429231ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b3333f7c90 0x55b3334087e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.455+0000 7f429231ab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fc350 0x55b3333f9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.455+0000 7f429231ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3333fcc70 0x55b3333fa390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.455+0000 7f429231ab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3331c79a0 con 0x55b3333fc350 2023-08-10T11:53:36.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.455+0000 7f429231ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3333c2a50 con 0x55b3333f7c90 2023-08-10T11:53:36.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.455+0000 7f429231ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3333efe60 con 0x55b3333fcc70 2023-08-10T11:53:36.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.455+0000 7f427effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fc350 0x55b3333f9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.455+0000 7f427effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fc350 0x55b3333f9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33770/0 (socket says 172.21.15.73:33770) 2023-08-10T11:53:36.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.455+0000 7f427effd700 1 -- 172.21.15.73:0/1304947910 learned_addr learned my addr 172.21.15.73:0/1304947910 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:36.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.455+0000 7f427f7fe700 1 --2- 172.21.15.73:0/1304947910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b3333f7c90 0x55b3334087e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.455+0000 7f427ffff700 1 --2- 172.21.15.73:0/1304947910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3333fcc70 0x55b3333fa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.455+0000 7f427effd700 1 -- 172.21.15.73:0/1304947910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3333fcc70 msgr2=0x55b3333fa390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:36.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.455+0000 7f427effd700 1 --2- 172.21.15.73:0/1304947910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3333fcc70 0x55b3333fa390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.455+0000 7f427effd700 1 -- 172.21.15.73:0/1304947910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b3333f7c90 msgr2=0x55b3334087e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:36.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.455+0000 7f427effd700 1 --2- 172.21.15.73:0/1304947910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b3333f7c90 0x55b3334087e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.455+0000 7f427effd700 1 -- 172.21.15.73:0/1304947910 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3333ea720 con 0x55b3333fc350 2023-08-10T11:53:36.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.455+0000 7f427effd700 1 --2- 172.21.15.73:0/1304947910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fc350 0x55b3333f9e50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f427000ec90 tx=0x7f427000e7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef39eee14c003935 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:36.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.455+0000 7f42667fc700 1 -- 172.21.15.73:0/1304947910 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427002c070 con 0x55b3333fc350 2023-08-10T11:53:36.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.455+0000 7f42667fc700 1 -- 172.21.15.73:0/1304947910 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4270010c40 con 0x55b3333fc350 2023-08-10T11:53:36.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.456+0000 7f42667fc700 1 -- 172.21.15.73:0/1304947910 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42700052a0 con 0x55b3333fc350 2023-08-10T11:53:36.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.456+0000 7f429231ab80 1 -- 172.21.15.73:0/1304947910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fc350 msgr2=0x55b3333f9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:36.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.456+0000 7f429231ab80 1 --2- 172.21.15.73:0/1304947910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fc350 0x55b3333f9e50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f427000ec90 tx=0x7f427000e7b0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.456+0000 7f429231ab80 1 -- 172.21.15.73:0/1304947910 shutdown_connections 2023-08-10T11:53:36.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.456+0000 7f429231ab80 1 --2- 172.21.15.73:0/1304947910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b3333f7c90 0x55b3334087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.456+0000 7f429231ab80 1 --2- 172.21.15.73:0/1304947910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3333fcc70 0x55b3333fa390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.456+0000 7f429231ab80 1 --2- 172.21.15.73:0/1304947910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fc350 0x55b3333f9e50 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.456+0000 7f429231ab80 1 -- 172.21.15.73:0/1304947910 >> 172.21.15.73:0/1304947910 conn(0x55b333350d50 msgr2=0x55b3333f2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:36.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.456+0000 7f429231ab80 1 -- 172.21.15.73:0/1304947910 shutdown_connections 2023-08-10T11:53:36.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.456+0000 7f429231ab80 1 -- 172.21.15.73:0/1304947910 wait complete. 2023-08-10T11:53:36.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.456+0000 7f429231ab80 1 -- start start 2023-08-10T11:53:36.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.457+0000 7f429231ab80 1 Processor -- start 2023-08-10T11:53:36.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.457+0000 7f429231ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b3333f7c90 0x55b333460140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.457+0000 7f429231ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3333fc350 0x55b333460680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.457+0000 7f429231ab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fcc70 0x55b33345a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.457+0000 7f429231ab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b33345aa80 con 0x55b3333fcc70 2023-08-10T11:53:36.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.457+0000 7f429231ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b33345abf0 con 0x55b3333f7c90 2023-08-10T11:53:36.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.457+0000 7f429231ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b33345adb0 con 0x55b3333fc350 2023-08-10T11:53:36.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.457+0000 7f429231ab80 10 client.0 _ll_register_callbacks cb 0x55b3332e1700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:36.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.457+0000 7f427ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fcc70 0x55b33345a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.457+0000 7f427ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fcc70 0x55b33345a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33778/0 (socket says 172.21.15.73:33778) 2023-08-10T11:53:36.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.457+0000 7f427ffff700 1 -- 172.21.15.73:0/532819420 learned_addr learned my addr 172.21.15.73:0/532819420 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:36.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.457+0000 7f427f7fe700 1 --2- 172.21.15.73:0/532819420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b3333f7c90 0x55b333460140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.457+0000 7f427effd700 1 --2- 172.21.15.73:0/532819420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3333fc350 0x55b333460680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.457+0000 7f427ffff700 1 -- 172.21.15.73:0/532819420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3333fc350 msgr2=0x55b333460680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:36.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.457+0000 7f427ffff700 1 --2- 172.21.15.73:0/532819420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3333fc350 0x55b333460680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.457+0000 7f427ffff700 1 -- 172.21.15.73:0/532819420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b3333f7c90 msgr2=0x55b333460140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:36.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.457+0000 7f427ffff700 1 --2- 172.21.15.73:0/532819420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b3333f7c90 0x55b333460140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.457+0000 7f427ffff700 1 -- 172.21.15.73:0/532819420 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b3331c56b0 con 0x55b3333fcc70 2023-08-10T11:53:36.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.457+0000 7f427ffff700 1 --2- 172.21.15.73:0/532819420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fcc70 0x55b33345a4a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4278002230 tx=0x7f427800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a019abc66a54aaa5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:36.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.457+0000 7f425effd700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:36.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.458+0000 7f425effd700 1 -- 172.21.15.73:0/532819420 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427800e070 con 0x55b3333fcc70 2023-08-10T11:53:36.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.458+0000 7f425effd700 1 -- 172.21.15.73:0/532819420 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f427801c440 con 0x55b3333fcc70 2023-08-10T11:53:36.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.458+0000 7f429231ab80 1 -- 172.21.15.73:0/532819420 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f427001d910 con 0x55b3333fcc70 2023-08-10T11:53:36.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.458+0000 7f425effd700 1 -- 172.21.15.73:0/532819420 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42780058a0 con 0x55b3333fcc70 2023-08-10T11:53:36.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.458+0000 7f429231ab80 10 client.15912 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:36.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.458+0000 7f429231ab80 1 -- 172.21.15.73:0/532819420 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b33315ace0 con 0x55b3333fcc70 2023-08-10T11:53:36.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.458+0000 7f425effd700 1 -- 172.21.15.73:0/532819420 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f427001d910 con 0x55b3333fcc70 2023-08-10T11:53:36.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.458+0000 7f425effd700 1 -- 172.21.15.73:0/532819420 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f427800b4d0 con 0x55b3333fcc70 2023-08-10T11:53:36.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.458+0000 7f429231ab80 10 client.15912 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:36.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.458+0000 7f429231ab80 10 client.15912 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:53:36.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.458+0000 7f429231ab80 20 client.15912 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:36.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.458+0000 7f429231ab80 1 --2- 172.21.15.73:0/532819420 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b333411800 0x55b333469b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.458+0000 7f429231ab80 4 client.15912 mds_command: new command op to 24503 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-08-10T11:53:36.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.458+0000 7f429231ab80 1 -- 172.21.15.73:0/532819420 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55b33333d800 con 0x55b333411800 2023-08-10T11:53:36.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.458+0000 7f427f7fe700 1 --2- 172.21.15.73:0/532819420 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b333411800 0x55b333469b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.459+0000 7f427f7fe700 1 --2- 172.21.15.73:0/532819420 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b333411800 0x55b333469b70 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60d5df02eef269cb server_cookie=e0576ad794f4e10c in_seq=0 out_seq=0 2023-08-10T11:53:36.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.459+0000 7f425effd700 10 client.15912 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:36.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.460+0000 7f425effd700 1 -- 172.21.15.73:0/532819420 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55b33333d800 con 0x55b333411800 2023-08-10T11:53:36.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.460+0000 7f425effd700 10 client.15912 handle_command_reply: tid=0 2023-08-10T11:53:36.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.460+0000 7f429231ab80 1 client.15912 shutdown 2023-08-10T11:53:36.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.460+0000 7f429231ab80 1 -- 172.21.15.73:0/532819420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fcc70 msgr2=0x55b33345a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:36.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.460+0000 7f429231ab80 1 --2- 172.21.15.73:0/532819420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fcc70 0x55b33345a4a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4278002230 tx=0x7f427800b8f0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.460+0000 7f429231ab80 1 -- 172.21.15.73:0/532819420 shutdown_connections 2023-08-10T11:53:36.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.460+0000 7f429231ab80 1 --2- 172.21.15.73:0/532819420 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b333411800 0x55b333469b70 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.460+0000 7f429231ab80 1 --2- 172.21.15.73:0/532819420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b3333f7c90 0x55b333460140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.460+0000 7f425effd700 0 client.15912 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:36.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.460+0000 7f429231ab80 1 --2- 172.21.15.73:0/532819420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b3333fcc70 0x55b33345a4a0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.460+0000 7f429231ab80 1 --2- 172.21.15.73:0/532819420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3333fc350 0x55b333460680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.460+0000 7f429231ab80 1 -- 172.21.15.73:0/532819420 >> 172.21.15.73:0/532819420 conn(0x55b333350d50 msgr2=0x55b333402930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:36.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.460+0000 7f429231ab80 1 -- 172.21.15.73:0/532819420 shutdown_connections 2023-08-10T11:53:36.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.460+0000 7f429231ab80 1 -- 172.21.15.73:0/532819420 wait complete. 2023-08-10T11:53:36.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.460+0000 7f429231ab80 20 client.15912 trim_cache size 0 max 16384 2023-08-10T11:53:36.485 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:53:36.486 INFO:teuthology.orchestra.run.smithi073.stdout: "return_code": 0, 2023-08-10T11:53:36.486 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_tag": "10dca991-d465-437f-a344-b6d042239dae", 2023-08-10T11:53:36.486 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": "asynchronous" 2023-08-10T11:53:36.486 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:53:36.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.461+0000 7f4286181700 1 -- 172.21.15.73:0/773970484 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f42680a13e0 msgr2=0x7f42680a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:36.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.461+0000 7f4286181700 1 --2- 172.21.15.73:0/773970484 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f42680a13e0 0x7f42680a38a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4270005ea0 tx=0x7f4270005e30 comp rx=0 tx=0).stop 2023-08-10T11:53:36.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.461+0000 7f4286181700 1 -- 172.21.15.73:0/773970484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42801006d0 msgr2=0x7f4280196650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:36.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.461+0000 7f4286181700 1 --2- 172.21.15.73:0/773970484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42801006d0 0x7f4280196650 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f427400c9b0 tx=0x7f427400cd70 comp rx=0 tx=0).stop 2023-08-10T11:53:36.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.461+0000 7f4286181700 1 -- 172.21.15.73:0/773970484 shutdown_connections 2023-08-10T11:53:36.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.461+0000 7f4286181700 1 --2- 172.21.15.73:0/773970484 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f42680a13e0 0x7f42680a38a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.461+0000 7f4286181700 1 --2- 172.21.15.73:0/773970484 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42801066e0 0x7f428019aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.461+0000 7f4286181700 1 --2- 172.21.15.73:0/773970484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42801006d0 0x7f4280196650 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.461+0000 7f4286181700 1 --2- 172.21.15.73:0/773970484 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4280101090 0x7f4280196b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.461+0000 7f4286181700 1 -- 172.21.15.73:0/773970484 >> 172.21.15.73:0/773970484 conn(0x7f42800fc1e0 msgr2=0x7f42800fc790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:36.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.461+0000 7f4286181700 1 -- 172.21.15.73:0/773970484 shutdown_connections 2023-08-10T11:53:36.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.461+0000 7f4286181700 1 -- 172.21.15.73:0/773970484 wait complete. 2023-08-10T11:53:36.489 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:53:36.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.613+0000 7f6c69ed9700 1 -- 172.21.15.73:0/2410712782 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c640ff5d0 msgr2=0x7f6c640ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:36.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.613+0000 7f6c69ed9700 1 --2- 172.21.15.73:0/2410712782 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c640ff5d0 0x7f6c640ffa50 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f6c580099c0 tx=0x7f6c58009cd0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.614+0000 7f6c69ed9700 1 -- 172.21.15.73:0/2410712782 shutdown_connections 2023-08-10T11:53:36.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.614+0000 7f6c69ed9700 1 --2- 172.21.15.73:0/2410712782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c64105690 0x7f6c64105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.614+0000 7f6c69ed9700 1 --2- 172.21.15.73:0/2410712782 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c640fff90 0x7f6c6410c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.614+0000 7f6c69ed9700 1 --2- 172.21.15.73:0/2410712782 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c640ff5d0 0x7f6c640ffa50 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.614+0000 7f6c69ed9700 1 -- 172.21.15.73:0/2410712782 >> 172.21.15.73:0/2410712782 conn(0x7f6c640fb0c0 msgr2=0x7f6c640fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.614+0000 7f6c69ed9700 1 -- 172.21.15.73:0/2410712782 shutdown_connections 2023-08-10T11:53:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.614+0000 7f6c69ed9700 1 -- 172.21.15.73:0/2410712782 wait complete. 2023-08-10T11:53:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.614+0000 7f6c69ed9700 1 Processor -- start 2023-08-10T11:53:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.614+0000 7f6c69ed9700 1 -- start start 2023-08-10T11:53:36.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.615+0000 7f6c69ed9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c640ff5d0 0x7f6c64195620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.615+0000 7f6c69ed9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c640fff90 0x7f6c64195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.615+0000 7f6c69ed9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c64105690 0x7f6c64199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.615+0000 7f6c69ed9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6419a600 con 0x7f6c640fff90 2023-08-10T11:53:36.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.615+0000 7f6c69ed9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6419a770 con 0x7f6c640ff5d0 2023-08-10T11:53:36.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.615+0000 7f6c69ed9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6419a930 con 0x7f6c64105690 2023-08-10T11:53:36.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.615+0000 7f6c62ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c640fff90 0x7f6c64195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.615+0000 7f6c62ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c640fff90 0x7f6c64195b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33790/0 (socket says 172.21.15.73:33790) 2023-08-10T11:53:36.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.615+0000 7f6c62ffd700 1 -- 172.21.15.73:0/61665141 learned_addr learned my addr 172.21.15.73:0/61665141 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:36.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.615+0000 7f6c637fe700 1 --2- 172.21.15.73:0/61665141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c640ff5d0 0x7f6c64195620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.615+0000 7f6c63fff700 1 --2- 172.21.15.73:0/61665141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c64105690 0x7f6c64199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.615+0000 7f6c62ffd700 1 -- 172.21.15.73:0/61665141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c64105690 msgr2=0x7f6c64199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:36.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.615+0000 7f6c62ffd700 1 --2- 172.21.15.73:0/61665141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c64105690 0x7f6c64199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.615+0000 7f6c62ffd700 1 -- 172.21.15.73:0/61665141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c640ff5d0 msgr2=0x7f6c64195620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:36.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.615+0000 7f6c62ffd700 1 --2- 172.21.15.73:0/61665141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c640ff5d0 0x7f6c64195620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.615+0000 7f6c62ffd700 1 -- 172.21.15.73:0/61665141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c580095f0 con 0x7f6c640fff90 2023-08-10T11:53:36.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.615+0000 7f6c62ffd700 1 --2- 172.21.15.73:0/61665141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c640fff90 0x7f6c64195b60 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800b580 tx=0x7f6c5800bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:36.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.615+0000 7f6c60ff9700 1 -- 172.21.15.73:0/61665141 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5801d070 con 0x7f6c640fff90 2023-08-10T11:53:36.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.615+0000 7f6c69ed9700 1 -- 172.21.15.73:0/61665141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c6419abb0 con 0x7f6c640fff90 2023-08-10T11:53:36.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.615+0000 7f6c60ff9700 1 -- 172.21.15.73:0/61665141 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c58022470 con 0x7f6c640fff90 2023-08-10T11:53:36.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.615+0000 7f6c60ff9700 1 -- 172.21.15.73:0/61665141 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c58017650 con 0x7f6c640fff90 2023-08-10T11:53:36.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.615+0000 7f6c69ed9700 1 -- 172.21.15.73:0/61665141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c641a2450 con 0x7f6c640fff90 2023-08-10T11:53:36.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.618+0000 7f6c60ff9700 1 -- 172.21.15.73:0/61665141 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f6c580225e0 con 0x7f6c640fff90 2023-08-10T11:53:36.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.618+0000 7f6c60ff9700 1 --2- 172.21.15.73:0/61665141 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f6c4c0a13e0 0x7f6c4c0a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.618+0000 7f6c637fe700 1 --2- 172.21.15.73:0/61665141 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f6c4c0a13e0 0x7f6c4c0a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.618+0000 7f6c60ff9700 1 -- 172.21.15.73:0/61665141 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f6c580cdf90 con 0x7f6c640fff90 2023-08-10T11:53:36.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.619+0000 7f6c637fe700 1 --2- 172.21.15.73:0/61665141 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f6c4c0a13e0 0x7f6c4c0a38a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6c54009c60 tx=0x7f6c54009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:36.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.619+0000 7f6c76072b80 1 Processor -- start 2023-08-10T11:53:36.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.619+0000 7f6c76072b80 1 -- start start 2023-08-10T11:53:36.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.619+0000 7f6c76072b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdc1788f50 0x55fdc1789330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.619+0000 7f6c76072b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1789870 0x55fdc17832c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.619+0000 7f6c76072b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdc1783800 0x55fdc1783c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.619+0000 7f6c76072b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdc16fedc0 con 0x55fdc1789870 2023-08-10T11:53:36.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.619+0000 7f6c76072b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdc16db590 con 0x55fdc1788f50 2023-08-10T11:53:36.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.619+0000 7f6c76072b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdc16d8eb0 con 0x55fdc1783800 2023-08-10T11:53:36.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.619+0000 7f6c62ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1789870 0x55fdc17832c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.619+0000 7f6c62ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1789870 0x55fdc17832c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33798/0 (socket says 172.21.15.73:33798) 2023-08-10T11:53:36.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.619+0000 7f6c62ffd700 1 -- 172.21.15.73:0/2864210191 learned_addr learned my addr 172.21.15.73:0/2864210191 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:36.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.620+0000 7f6c63fff700 1 --2- 172.21.15.73:0/2864210191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdc1783800 0x55fdc1783c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.620+0000 7f6c62ffd700 1 -- 172.21.15.73:0/2864210191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdc1783800 msgr2=0x55fdc1783c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:36.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.620+0000 7f6c62ffd700 1 --2- 172.21.15.73:0/2864210191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdc1783800 0x55fdc1783c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.620+0000 7f6c62ffd700 1 -- 172.21.15.73:0/2864210191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdc1788f50 msgr2=0x55fdc1789330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:36.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.620+0000 7f6c637fe700 1 --2- 172.21.15.73:0/2864210191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdc1788f50 0x55fdc1789330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.620+0000 7f6c62ffd700 1 --2- 172.21.15.73:0/2864210191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdc1788f50 0x55fdc1789330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.620+0000 7f6c62ffd700 1 -- 172.21.15.73:0/2864210191 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fdc1555630 con 0x55fdc1789870 2023-08-10T11:53:36.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.620+0000 7f6c62ffd700 1 --2- 172.21.15.73:0/2864210191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1789870 0x55fdc17832c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f6c58000c00 tx=0x7f6c5809ab10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a768dd470d96bc8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:36.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.620+0000 7f6c49ffb700 1 -- 172.21.15.73:0/2864210191 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c580a3290 con 0x55fdc1789870 2023-08-10T11:53:36.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.620+0000 7f6c49ffb700 1 -- 172.21.15.73:0/2864210191 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c5809b130 con 0x55fdc1789870 2023-08-10T11:53:36.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.620+0000 7f6c49ffb700 1 -- 172.21.15.73:0/2864210191 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c580a2e00 con 0x55fdc1789870 2023-08-10T11:53:36.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.621+0000 7f6c76072b80 1 -- 172.21.15.73:0/2864210191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1789870 msgr2=0x55fdc17832c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:36.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.621+0000 7f6c76072b80 1 --2- 172.21.15.73:0/2864210191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1789870 0x55fdc17832c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f6c58000c00 tx=0x7f6c5809ab10 comp rx=0 tx=0).stop 2023-08-10T11:53:36.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.621+0000 7f6c76072b80 1 -- 172.21.15.73:0/2864210191 shutdown_connections 2023-08-10T11:53:36.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.621+0000 7f6c76072b80 1 --2- 172.21.15.73:0/2864210191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdc1788f50 0x55fdc1789330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.621+0000 7f6c76072b80 1 --2- 172.21.15.73:0/2864210191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdc1783800 0x55fdc1783c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.621+0000 7f6c76072b80 1 --2- 172.21.15.73:0/2864210191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1789870 0x55fdc17832c0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.621+0000 7f6c76072b80 1 -- 172.21.15.73:0/2864210191 >> 172.21.15.73:0/2864210191 conn(0x55fdc16e0cd0 msgr2=0x55fdc177e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:36.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.621+0000 7f6c76072b80 1 -- 172.21.15.73:0/2864210191 shutdown_connections 2023-08-10T11:53:36.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.621+0000 7f6c76072b80 1 -- 172.21.15.73:0/2864210191 wait complete. 2023-08-10T11:53:36.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.621+0000 7f6c76072b80 1 -- start start 2023-08-10T11:53:36.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.621+0000 7f6c76072b80 1 Processor -- start 2023-08-10T11:53:36.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.622+0000 7f6c76072b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdc1783800 0x55fdc178f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.622+0000 7f6c76072b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdc1788f50 0x55fdc178cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.622+0000 7f6c76072b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1789870 0x55fdc178d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.622+0000 7f6c76072b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdc16d47a0 con 0x55fdc1789870 2023-08-10T11:53:36.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.622+0000 7f6c76072b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdc1673ac0 con 0x55fdc1788f50 2023-08-10T11:53:36.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.622+0000 7f6c76072b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdc16737c0 con 0x55fdc1783800 2023-08-10T11:53:36.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.622+0000 7f6c76072b80 10 client.0 _ll_register_callbacks cb 0x55fdc1671680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:36.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.622+0000 7f6c63fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1789870 0x55fdc178d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.622+0000 7f6c63fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1789870 0x55fdc178d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33806/0 (socket says 172.21.15.73:33806) 2023-08-10T11:53:36.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.622+0000 7f6c63fff700 1 -- 172.21.15.73:0/1345136835 learned_addr learned my addr 172.21.15.73:0/1345136835 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:36.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.622+0000 7f6c637fe700 1 --2- 172.21.15.73:0/1345136835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdc1783800 0x55fdc178f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.622+0000 7f6c62ffd700 1 --2- 172.21.15.73:0/1345136835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdc1788f50 0x55fdc178cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.622+0000 7f6c63fff700 1 -- 172.21.15.73:0/1345136835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdc1783800 msgr2=0x55fdc178f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:36.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.622+0000 7f6c63fff700 1 --2- 172.21.15.73:0/1345136835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdc1783800 0x55fdc178f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.622+0000 7f6c63fff700 1 -- 172.21.15.73:0/1345136835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdc1788f50 msgr2=0x55fdc178cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:36.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.622+0000 7f6c63fff700 1 --2- 172.21.15.73:0/1345136835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdc1788f50 0x55fdc178cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.622+0000 7f6c63fff700 1 -- 172.21.15.73:0/1345136835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c641a2450 con 0x55fdc1789870 2023-08-10T11:53:36.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.622+0000 7f6c63fff700 1 --2- 172.21.15.73:0/1345136835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1789870 0x55fdc178d180 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009790 tx=0x7f6c5c007c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c0f15551479ada server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:36.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.622+0000 7f6c42ffd700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:36.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.623+0000 7f6c42ffd700 1 -- 172.21.15.73:0/1345136835 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c00e040 con 0x55fdc1789870 2023-08-10T11:53:36.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.623+0000 7f6c42ffd700 1 -- 172.21.15.73:0/1345136835 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f6c5c0138c0 con 0x55fdc1789870 2023-08-10T11:53:36.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.623+0000 7f6c76072b80 1 -- 172.21.15.73:0/1345136835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fdc1776470 con 0x55fdc1789870 2023-08-10T11:53:36.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.623+0000 7f6c42ffd700 1 -- 172.21.15.73:0/1345136835 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c5c013a80 con 0x55fdc1789870 2023-08-10T11:53:36.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.623+0000 7f6c76072b80 10 client.15924 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:36.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.623+0000 7f6c76072b80 1 -- 172.21.15.73:0/1345136835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55fdc1501de0 con 0x55fdc1789870 2023-08-10T11:53:36.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.623+0000 7f6c42ffd700 1 -- 172.21.15.73:0/1345136835 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fdc1776470 con 0x55fdc1789870 2023-08-10T11:53:36.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.623+0000 7f6c42ffd700 1 -- 172.21.15.73:0/1345136835 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6c5c015390 con 0x55fdc1789870 2023-08-10T11:53:36.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.623+0000 7f6c76072b80 10 client.15924 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:36.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.623+0000 7f6c76072b80 10 client.15924 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:53:36.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.623+0000 7f6c76072b80 20 client.15924 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:36.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.623+0000 7f6c76072b80 1 --2- 172.21.15.73:0/1345136835 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55fdc179cf30 0x55fdc179f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.623+0000 7f6c76072b80 4 client.15924 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:53:36.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.623+0000 7f6c76072b80 1 -- 172.21.15.73:0/1345136835 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fdc17529d0 con 0x55fdc179cf30 2023-08-10T11:53:36.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.623+0000 7f6c637fe700 1 --2- 172.21.15.73:0/1345136835 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55fdc179cf30 0x55fdc179f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.624+0000 7f6c42ffd700 10 client.15924 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:36.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.624+0000 7f6c637fe700 1 --2- 172.21.15.73:0/1345136835 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55fdc179cf30 0x55fdc179f350 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=436c8d3789a5844d server_cookie=13648d680f6d6d9b in_seq=0 out_seq=0 2023-08-10T11:53:36.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.624+0000 7f6c42ffd700 1 -- 172.21.15.73:0/1345136835 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55fdc17529d0 con 0x55fdc179cf30 2023-08-10T11:53:36.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.624+0000 7f6c42ffd700 10 client.15924 handle_command_reply: tid=0 2023-08-10T11:53:36.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.624+0000 7f6c76072b80 1 client.15924 shutdown 2023-08-10T11:53:36.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.625+0000 7f6c76072b80 1 -- 172.21.15.73:0/1345136835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1789870 msgr2=0x55fdc178d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:36.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.625+0000 7f6c76072b80 1 --2- 172.21.15.73:0/1345136835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1789870 0x55fdc178d180 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009790 tx=0x7f6c5c007c30 comp rx=0 tx=0).stop 2023-08-10T11:53:36.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.625+0000 7f6c76072b80 1 -- 172.21.15.73:0/1345136835 shutdown_connections 2023-08-10T11:53:36.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.625+0000 7f6c76072b80 1 --2- 172.21.15.73:0/1345136835 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55fdc179cf30 0x55fdc179f350 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.625+0000 7f6c76072b80 1 --2- 172.21.15.73:0/1345136835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1789870 0x55fdc178d180 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.625+0000 7f6c42ffd700 0 client.15924 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:36.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.625+0000 7f6c76072b80 1 --2- 172.21.15.73:0/1345136835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdc1783800 0x55fdc178f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.625+0000 7f6c76072b80 1 --2- 172.21.15.73:0/1345136835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdc1788f50 0x55fdc178cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.625+0000 7f6c76072b80 1 -- 172.21.15.73:0/1345136835 >> 172.21.15.73:0/1345136835 conn(0x55fdc16e0cd0 msgr2=0x55fdc177d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:36.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.625+0000 7f6c76072b80 1 -- 172.21.15.73:0/1345136835 shutdown_connections 2023-08-10T11:53:36.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.625+0000 7f6c76072b80 1 -- 172.21.15.73:0/1345136835 wait complete. 2023-08-10T11:53:36.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.625+0000 7f6c76072b80 20 client.15924 trim_cache size 0 max 16384 2023-08-10T11:53:36.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.642+0000 7f6c76072b80 1 Processor -- start 2023-08-10T11:53:36.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.642+0000 7f6c76072b80 1 -- start start 2023-08-10T11:53:36.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.642+0000 7f6c76072b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdc1783800 0x55fdc1788240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.642+0000 7f6c76072b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1788f50 0x55fdc177e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.642+0000 7f6c76072b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdc1789870 0x55fdc177e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.642+0000 7f6c76072b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdc1557920 con 0x55fdc1788f50 2023-08-10T11:53:36.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.642+0000 7f6c76072b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdc17529d0 con 0x55fdc1789870 2023-08-10T11:53:36.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.642+0000 7f6c76072b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdc179a670 con 0x55fdc1783800 2023-08-10T11:53:36.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.642+0000 7f6c62ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1788f50 0x55fdc177e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.642+0000 7f6c62ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1788f50 0x55fdc177e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33810/0 (socket says 172.21.15.73:33810) 2023-08-10T11:53:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.642+0000 7f6c62ffd700 1 -- 172.21.15.73:0/1779309688 learned_addr learned my addr 172.21.15.73:0/1779309688 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.642+0000 7f6c63fff700 1 --2- 172.21.15.73:0/1779309688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdc1789870 0x55fdc177e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.642+0000 7f6c637fe700 1 --2- 172.21.15.73:0/1779309688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdc1783800 0x55fdc1788240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.642+0000 7f6c62ffd700 1 -- 172.21.15.73:0/1779309688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdc1783800 msgr2=0x55fdc1788240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.642+0000 7f6c62ffd700 1 --2- 172.21.15.73:0/1779309688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdc1783800 0x55fdc1788240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.642+0000 7f6c62ffd700 1 -- 172.21.15.73:0/1779309688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdc1789870 msgr2=0x55fdc177e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.642+0000 7f6c62ffd700 1 --2- 172.21.15.73:0/1779309688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdc1789870 0x55fdc177e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.642+0000 7f6c62ffd700 1 -- 172.21.15.73:0/1779309688 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fdc14eac60 con 0x55fdc1788f50 2023-08-10T11:53:36.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.642+0000 7f6c63fff700 1 --2- 172.21.15.73:0/1779309688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdc1789870 0x55fdc177e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:53:36.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.643+0000 7f6c62ffd700 1 --2- 172.21.15.73:0/1779309688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1788f50 0x55fdc177e130 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f6c580973d0 tx=0x7f6c580cd040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1892256a6364ab24 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:36.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.643+0000 7f6c4a7fc700 1 -- 172.21.15.73:0/1779309688 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c580cb4d0 con 0x55fdc1788f50 2023-08-10T11:53:36.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.643+0000 7f6c4a7fc700 1 -- 172.21.15.73:0/1779309688 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c580a3290 con 0x55fdc1788f50 2023-08-10T11:53:36.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.643+0000 7f6c4a7fc700 1 -- 172.21.15.73:0/1779309688 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c580cb870 con 0x55fdc1788f50 2023-08-10T11:53:36.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.643+0000 7f6c76072b80 1 -- 172.21.15.73:0/1779309688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1788f50 msgr2=0x55fdc177e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:36.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.643+0000 7f6c76072b80 1 --2- 172.21.15.73:0/1779309688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1788f50 0x55fdc177e130 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f6c580973d0 tx=0x7f6c580cd040 comp rx=0 tx=0).stop 2023-08-10T11:53:36.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.643+0000 7f6c76072b80 1 -- 172.21.15.73:0/1779309688 shutdown_connections 2023-08-10T11:53:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.643+0000 7f6c76072b80 1 --2- 172.21.15.73:0/1779309688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdc1789870 0x55fdc177e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.643+0000 7f6c76072b80 1 --2- 172.21.15.73:0/1779309688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdc1783800 0x55fdc1788240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.643+0000 7f6c76072b80 1 --2- 172.21.15.73:0/1779309688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1788f50 0x55fdc177e130 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.643+0000 7f6c76072b80 1 -- 172.21.15.73:0/1779309688 >> 172.21.15.73:0/1779309688 conn(0x55fdc16e0cd0 msgr2=0x55fdc1787b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.644+0000 7f6c76072b80 1 -- 172.21.15.73:0/1779309688 shutdown_connections 2023-08-10T11:53:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.644+0000 7f6c76072b80 1 -- 172.21.15.73:0/1779309688 wait complete. 2023-08-10T11:53:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.644+0000 7f6c76072b80 1 -- start start 2023-08-10T11:53:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.644+0000 7f6c76072b80 1 Processor -- start 2023-08-10T11:53:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.644+0000 7f6c76072b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdc1783800 0x55fdc1792700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.644+0000 7f6c76072b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1788f50 0x55fdc1792c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.644+0000 7f6c76072b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdc1789870 0x55fdc1793180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.644+0000 7f6c76072b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdc17f0bf0 con 0x55fdc1788f50 2023-08-10T11:53:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.644+0000 7f6c76072b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdc17f0d30 con 0x55fdc1783800 2023-08-10T11:53:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.644+0000 7f6c76072b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdc17f0e70 con 0x55fdc1789870 2023-08-10T11:53:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.644+0000 7f6c76072b80 10 client.0 _ll_register_callbacks cb 0x55fdc1671680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.644+0000 7f6c62ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1788f50 0x55fdc1792c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.644+0000 7f6c62ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1788f50 0x55fdc1792c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33818/0 (socket says 172.21.15.73:33818) 2023-08-10T11:53:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.645+0000 7f6c62ffd700 1 -- 172.21.15.73:0/3858484359 learned_addr learned my addr 172.21.15.73:0/3858484359 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.645+0000 7f6c63fff700 1 --2- 172.21.15.73:0/3858484359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdc1789870 0x55fdc1793180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.645+0000 7f6c637fe700 1 --2- 172.21.15.73:0/3858484359 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdc1783800 0x55fdc1792700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.645+0000 7f6c62ffd700 1 -- 172.21.15.73:0/3858484359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdc1789870 msgr2=0x55fdc1793180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.645+0000 7f6c62ffd700 1 --2- 172.21.15.73:0/3858484359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdc1789870 0x55fdc1793180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.645+0000 7f6c62ffd700 1 -- 172.21.15.73:0/3858484359 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdc1783800 msgr2=0x55fdc1792700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:36.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.645+0000 7f6c62ffd700 1 --2- 172.21.15.73:0/3858484359 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdc1783800 0x55fdc1792700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.645+0000 7f6c62ffd700 1 -- 172.21.15.73:0/3858484359 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fdc1555630 con 0x55fdc1788f50 2023-08-10T11:53:36.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.645+0000 7f6c637fe700 1 --2- 172.21.15.73:0/3858484359 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdc1783800 0x55fdc1792700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:36.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.645+0000 7f6c62ffd700 1 --2- 172.21.15.73:0/3858484359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1788f50 0x55fdc1792c40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6c58009fd0 tx=0x7f6c58009320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb70bae15e47099 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:36.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.645+0000 7f6c42ffd700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:36.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.645+0000 7f6c42ffd700 1 -- 172.21.15.73:0/3858484359 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c580cb170 con 0x55fdc1788f50 2023-08-10T11:53:36.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.645+0000 7f6c42ffd700 1 -- 172.21.15.73:0/3858484359 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f6c580b9030 con 0x55fdc1788f50 2023-08-10T11:53:36.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.645+0000 7f6c76072b80 1 -- 172.21.15.73:0/3858484359 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6c5809b130 con 0x55fdc1788f50 2023-08-10T11:53:36.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.645+0000 7f6c42ffd700 1 -- 172.21.15.73:0/3858484359 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c580b91f0 con 0x55fdc1788f50 2023-08-10T11:53:36.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.645+0000 7f6c76072b80 10 client.15930 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:36.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.645+0000 7f6c76072b80 1 -- 172.21.15.73:0/3858484359 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55fdc1528250 con 0x55fdc1788f50 2023-08-10T11:53:36.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.645+0000 7f6c42ffd700 1 -- 172.21.15.73:0/3858484359 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c5807d080 con 0x55fdc1788f50 2023-08-10T11:53:36.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.646+0000 7f6c42ffd700 1 -- 172.21.15.73:0/3858484359 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6c580cb970 con 0x55fdc1788f50 2023-08-10T11:53:36.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.646+0000 7f6c76072b80 10 client.15930 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:36.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.646+0000 7f6c76072b80 10 client.15930 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:53:36.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.646+0000 7f6c76072b80 20 client.15930 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:36.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.646+0000 7f6c76072b80 1 --2- 172.21.15.73:0/3858484359 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55fdc17f1fc0 0x55fdc17f43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:36.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.646+0000 7f6c76072b80 4 client.15930 mds_command: new command op to 24503 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:53:36.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.646+0000 7f6c76072b80 1 -- 172.21.15.73:0/3858484359 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fdc16cd780 con 0x55fdc17f1fc0 2023-08-10T11:53:36.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.646+0000 7f6c637fe700 1 --2- 172.21.15.73:0/3858484359 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55fdc17f1fc0 0x55fdc17f43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:36.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.646+0000 7f6c42ffd700 10 client.15930 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:36.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.646+0000 7f6c637fe700 1 --2- 172.21.15.73:0/3858484359 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55fdc17f1fc0 0x55fdc17f43b0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf301e69837cf10 server_cookie=1398d1945d6be82e in_seq=0 out_seq=0 2023-08-10T11:53:36.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.647+0000 7f6c42ffd700 1 -- 172.21.15.73:0/3858484359 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55fdc16cd780 con 0x55fdc17f1fc0 2023-08-10T11:53:36.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.647+0000 7f6c42ffd700 10 client.15930 handle_command_reply: tid=0 2023-08-10T11:53:36.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.647+0000 7f6c76072b80 1 client.15930 shutdown 2023-08-10T11:53:36.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.647+0000 7f6c76072b80 1 -- 172.21.15.73:0/3858484359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1788f50 msgr2=0x55fdc1792c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:36.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.647+0000 7f6c76072b80 1 --2- 172.21.15.73:0/3858484359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1788f50 0x55fdc1792c40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6c58009fd0 tx=0x7f6c58009320 comp rx=0 tx=0).stop 2023-08-10T11:53:36.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.647+0000 7f6c76072b80 1 -- 172.21.15.73:0/3858484359 shutdown_connections 2023-08-10T11:53:36.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.647+0000 7f6c76072b80 1 --2- 172.21.15.73:0/3858484359 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55fdc17f1fc0 0x55fdc17f43b0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.647+0000 7f6c76072b80 1 --2- 172.21.15.73:0/3858484359 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdc1783800 0x55fdc1792700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.647+0000 7f6c42ffd700 0 client.15930 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:36.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.647+0000 7f6c76072b80 1 --2- 172.21.15.73:0/3858484359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdc1789870 0x55fdc1793180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.647+0000 7f6c76072b80 1 --2- 172.21.15.73:0/3858484359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdc1788f50 0x55fdc1792c40 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.647+0000 7f6c76072b80 1 -- 172.21.15.73:0/3858484359 >> 172.21.15.73:0/3858484359 conn(0x55fdc16e0cd0 msgr2=0x55fdc178eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:36.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.647+0000 7f6c76072b80 1 -- 172.21.15.73:0/3858484359 shutdown_connections 2023-08-10T11:53:36.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.647+0000 7f6c76072b80 1 -- 172.21.15.73:0/3858484359 wait complete. 2023-08-10T11:53:36.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.647+0000 7f6c76072b80 20 client.15930 trim_cache size 0 max 16384 2023-08-10T11:53:36.659 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:53:36.659 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:53:36.659 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": { 2023-08-10T11:53:36.659 INFO:teuthology.orchestra.run.smithi073.stdout: "10dca991-d465-437f-a344-b6d042239dae": { 2023-08-10T11:53:36.659 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2023-08-10T11:53:36.659 INFO:teuthology.orchestra.run.smithi073.stdout: "tag": "10dca991-d465-437f-a344-b6d042239dae", 2023-08-10T11:53:36.660 INFO:teuthology.orchestra.run.smithi073.stdout: "options": "recursive,force" 2023-08-10T11:53:36.660 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:53:36.660 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:53:36.660 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:53:36.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.647+0000 7f6c69ed9700 1 -- 172.21.15.73:0/61665141 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f6c4c0a13e0 msgr2=0x7f6c4c0a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:36.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.647+0000 7f6c69ed9700 1 --2- 172.21.15.73:0/61665141 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f6c4c0a13e0 0x7f6c4c0a38a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6c54009c60 tx=0x7f6c54009260 comp rx=0 tx=0).stop 2023-08-10T11:53:36.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.647+0000 7f6c69ed9700 1 -- 172.21.15.73:0/61665141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c640fff90 msgr2=0x7f6c64195b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:36.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.647+0000 7f6c69ed9700 1 --2- 172.21.15.73:0/61665141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c640fff90 0x7f6c64195b60 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800b580 tx=0x7f6c5800bfd0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.648+0000 7f6c69ed9700 1 -- 172.21.15.73:0/61665141 shutdown_connections 2023-08-10T11:53:36.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.648+0000 7f6c69ed9700 1 --2- 172.21.15.73:0/61665141 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f6c4c0a13e0 0x7f6c4c0a38a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.648+0000 7f6c69ed9700 1 --2- 172.21.15.73:0/61665141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c640ff5d0 0x7f6c64195620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.648+0000 7f6c69ed9700 1 --2- 172.21.15.73:0/61665141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c64105690 0x7f6c64199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.648+0000 7f6c69ed9700 1 --2- 172.21.15.73:0/61665141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c640fff90 0x7f6c64195b60 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:36.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.648+0000 7f6c69ed9700 1 -- 172.21.15.73:0/61665141 >> 172.21.15.73:0/61665141 conn(0x7f6c640fb0c0 msgr2=0x7f6c640fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:36.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.648+0000 7f6c69ed9700 1 -- 172.21.15.73:0/61665141 shutdown_connections 2023-08-10T11:53:36.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:53:36.648+0000 7f6c69ed9700 1 -- 172.21.15.73:0/61665141 wait complete. 2023-08-10T11:53:36.663 INFO:tasks.cephfs.filesystem:scrub status for tag:10dca991-d465-437f-a344-b6d042239dae - {'path': '/', 'tag': '10dca991-d465-437f-a344-b6d042239dae', 'options': 'recursive,force'} 2023-08-10T11:53:36.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:36 smithi152 ceph-mon[130220]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2023-08-10T11:53:37.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:36 smithi156 ceph-mon[130574]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2023-08-10T11:53:37.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:36 smithi073 ceph-mon[128869]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2023-08-10T11:53:37.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:37 smithi152 ceph-mon[130220]: scrub queued for path: / 2023-08-10T11:53:37.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:37 smithi152 ceph-mon[130220]: scrub summary: idle+waiting paths [/] 2023-08-10T11:53:37.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:37 smithi152 ceph-mon[130220]: scrub summary: active paths [/] 2023-08-10T11:53:37.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:37 smithi152 ceph-mon[130220]: scrub summary: idle+waiting paths [/] 2023-08-10T11:53:38.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:37 smithi156 ceph-mon[130574]: scrub queued for path: / 2023-08-10T11:53:38.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:37 smithi156 ceph-mon[130574]: scrub summary: idle+waiting paths [/] 2023-08-10T11:53:38.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:37 smithi156 ceph-mon[130574]: scrub summary: active paths [/] 2023-08-10T11:53:38.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:37 smithi156 ceph-mon[130574]: scrub summary: idle+waiting paths [/] 2023-08-10T11:53:38.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:37 smithi073 ceph-mon[128869]: scrub queued for path: / 2023-08-10T11:53:38.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:37 smithi073 ceph-mon[128869]: scrub summary: idle+waiting paths [/] 2023-08-10T11:53:38.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:37 smithi073 ceph-mon[128869]: scrub summary: active paths [/] 2023-08-10T11:53:38.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:37 smithi073 ceph-mon[128869]: scrub summary: idle+waiting paths [/] 2023-08-10T11:53:38.301 INFO:tasks.workunit.client.0.smithi073.stderr:Note: switching to 'a8bf445f2d27d8e12e060dff0fd151d481b5290b'. 2023-08-10T11:53:38.302 INFO:tasks.workunit.client.0.smithi073.stderr: 2023-08-10T11:53:38.302 INFO:tasks.workunit.client.0.smithi073.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-08-10T11:53:38.302 INFO:tasks.workunit.client.0.smithi073.stderr:changes and commit them, and you can discard any commits you make in this 2023-08-10T11:53:38.303 INFO:tasks.workunit.client.0.smithi073.stderr:state without impacting any branches by switching back to a branch. 2023-08-10T11:53:38.303 INFO:tasks.workunit.client.0.smithi073.stderr: 2023-08-10T11:53:38.303 INFO:tasks.workunit.client.0.smithi073.stderr:If you want to create a new branch to retain commits you create, you may 2023-08-10T11:53:38.303 INFO:tasks.workunit.client.0.smithi073.stderr:do so (now or later) by using -c with the switch command. Example: 2023-08-10T11:53:38.304 INFO:tasks.workunit.client.0.smithi073.stderr: 2023-08-10T11:53:38.304 INFO:tasks.workunit.client.0.smithi073.stderr: git switch -c 2023-08-10T11:53:38.304 INFO:tasks.workunit.client.0.smithi073.stderr: 2023-08-10T11:53:38.304 INFO:tasks.workunit.client.0.smithi073.stderr:Or undo this operation with: 2023-08-10T11:53:38.305 INFO:tasks.workunit.client.0.smithi073.stderr: 2023-08-10T11:53:38.305 INFO:tasks.workunit.client.0.smithi073.stderr: git switch - 2023-08-10T11:53:38.305 INFO:tasks.workunit.client.0.smithi073.stderr: 2023-08-10T11:53:38.305 INFO:tasks.workunit.client.0.smithi073.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-08-10T11:53:38.305 INFO:tasks.workunit.client.0.smithi073.stderr: 2023-08-10T11:53:38.305 INFO:tasks.workunit.client.0.smithi073.stderr:HEAD is now at a8bf445f2d2 Merge remote-tracking branch 'rishabh/fs-auth-subcmd' into wip-rishabh-2023Aug1-3 2023-08-10T11:53:38.307 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-08-10T11:53:38.332 INFO:tasks.workunit.client.0.smithi073.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-08-10T11:53:38.334 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-08-10T11:53:38.334 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-08-10T11:53:38.868 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-08-10T11:53:38.922 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-08-10T11:53:38.959 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-08-10T11:53:38.961 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-08-10T11:53:38.961 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-08-10T11:53:38.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:38 smithi152 ceph-mon[130220]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-08-10T11:53:38.996 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-08-10T11:53:39.000 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-08-10T11:53:39.000 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-08-10T11:53:39.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:38 smithi156 ceph-mon[130574]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-08-10T11:53:39.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:38 smithi073 ceph-mon[128869]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-08-10T11:53:39.033 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2023-08-10T11:53:39.035 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2023-08-10T11:53:39.035 DEBUG:teuthology.orchestra.run.smithi073:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8bf445f2d27d8e12e060dff0fd151d481b5290b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2023-08-10T11:53:39.098 INFO:tasks.workunit.client.0.smithi073.stdout:getting blogbench 2023-08-10T11:53:39.098 INFO:tasks.workunit.client.0.smithi073.stderr:+ echo 'getting blogbench' 2023-08-10T11:53:39.098 INFO:tasks.workunit.client.0.smithi073.stderr:+ wget http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2023-08-10T11:53:39.122 INFO:tasks.workunit.client.0.smithi073.stderr:--2023-08-10 11:53:39-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2023-08-10T11:53:39.132 INFO:tasks.workunit.client.0.smithi073.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2023-08-10T11:53:39.168 INFO:tasks.workunit.client.0.smithi073.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2023-08-10T11:53:39.204 INFO:tasks.workunit.client.0.smithi073.stderr:HTTP request sent, awaiting response... 200 OK 2023-08-10T11:53:39.204 INFO:tasks.workunit.client.0.smithi073.stderr:Length: 103355 (101K) [application/octet-stream] 2023-08-10T11:53:39.205 INFO:tasks.workunit.client.0.smithi073.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2023-08-10T11:53:39.208 INFO:tasks.workunit.client.0.smithi073.stderr: 2023-08-10T11:53:39.277 INFO:tasks.workunit.client.0.smithi073.stderr: 0K .......... .......... .......... .......... .......... 49% 717K 0s 2023-08-10T11:53:39.311 INFO:tasks.workunit.client.0.smithi073.stderr: 50K .......... .......... .......... .......... .......... 99% 1.38M 0s 2023-08-10T11:53:39.311 INFO:tasks.workunit.client.0.smithi073.stderr: 100K 100% 1779G=0.1s 2023-08-10T11:53:39.311 INFO:tasks.workunit.client.0.smithi073.stderr: 2023-08-10T11:53:39.311 INFO:tasks.workunit.client.0.smithi073.stderr:2023-08-10 11:53:39 (960 KB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2023-08-10T11:53:39.312 INFO:tasks.workunit.client.0.smithi073.stderr: 2023-08-10T11:53:39.312 INFO:tasks.workunit.client.0.smithi073.stderr:+ tar -xvf blogbench-1.0.tar.bz2 2023-08-10T11:53:39.353 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/ 2023-08-10T11:53:39.354 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/m4/ 2023-08-10T11:53:39.355 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/m4/acx_pthread.m4 2023-08-10T11:53:39.356 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/man/ 2023-08-10T11:53:39.357 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/man/blogbench.8 2023-08-10T11:53:39.358 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/man/Makefile.am 2023-08-10T11:53:39.358 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/man/Makefile.in 2023-08-10T11:53:39.358 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/src/ 2023-08-10T11:53:39.360 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/src/mysnprintf.c 2023-08-10T11:53:39.362 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/src/mysnprintf.h 2023-08-10T11:53:39.362 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/src/blogbench.c 2023-08-10T11:53:39.362 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/src/blogbench.h 2023-08-10T11:53:39.363 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/src/fakesnprintf.c 2023-08-10T11:53:39.363 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/src/fakesnprintf.h 2023-08-10T11:53:39.363 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/src/blogbench_p.h 2023-08-10T11:53:39.363 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/src/bsd-getopt_long.c 2023-08-10T11:53:39.363 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/src/bsd-getopt_long.h 2023-08-10T11:53:39.363 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/src/Makefile.am 2023-08-10T11:53:39.363 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/src/Makefile.in 2023-08-10T11:53:39.363 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/src/process.c 2023-08-10T11:53:39.364 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/src/globals.h 2023-08-10T11:53:39.364 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/src/commenter.c 2023-08-10T11:53:39.364 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/src/rewriter.c 2023-08-10T11:53:39.364 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/src/reader.c 2023-08-10T11:53:39.364 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/src/writer.c 2023-08-10T11:53:39.364 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/src/helpers.c 2023-08-10T11:53:39.364 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/NEWS 2023-08-10T11:53:39.371 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/compile 2023-08-10T11:53:39.372 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/depcomp 2023-08-10T11:53:39.372 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/aclocal.m4 2023-08-10T11:53:39.372 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/README 2023-08-10T11:53:39.372 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/configure 2023-08-10T11:53:39.375 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/configure.ac 2023-08-10T11:53:39.375 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/config.guess 2023-08-10T11:53:39.376 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/install-sh 2023-08-10T11:53:39.376 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/config.sub 2023-08-10T11:53:39.377 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/missing 2023-08-10T11:53:39.377 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/mkinstalldirs 2023-08-10T11:53:39.377 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/Makefile.am 2023-08-10T11:53:39.377 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/Makefile.in 2023-08-10T11:53:39.377 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/config.h.in 2023-08-10T11:53:39.377 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/AUTHORS 2023-08-10T11:53:39.377 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/INSTALL 2023-08-10T11:53:39.378 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/ChangeLog 2023-08-10T11:53:39.378 INFO:tasks.workunit.client.0.smithi073.stdout:blogbench-1.0/COPYING 2023-08-10T11:53:39.378 INFO:tasks.workunit.client.0.smithi073.stderr:+ cd blogbench-1.0/ 2023-08-10T11:53:39.378 INFO:tasks.workunit.client.0.smithi073.stderr:+ echo 'making blogbench' 2023-08-10T11:53:39.379 INFO:tasks.workunit.client.0.smithi073.stdout:making blogbench 2023-08-10T11:53:39.379 INFO:tasks.workunit.client.0.smithi073.stderr:+ ./configure 2023-08-10T11:53:39.472 INFO:tasks.workunit.client.0.smithi073.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2023-08-10T11:53:40.478 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether build environment is sane... yes 2023-08-10T11:53:40.487 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gawk... gawk 2023-08-10T11:53:40.515 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether make sets $(MAKE)... yes 2023-08-10T11:53:40.531 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gcc... gcc 2023-08-10T11:53:40.608 INFO:tasks.workunit.client.0.smithi073.stdout:checking for C compiler default output file name... a.out 2023-08-10T11:53:40.610 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether the C compiler works... yes 2023-08-10T11:53:40.612 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether we are cross compiling... no 2023-08-10T11:53:40.648 INFO:tasks.workunit.client.0.smithi073.stdout:checking for suffix of executables... 2023-08-10T11:53:40.681 INFO:tasks.workunit.client.0.smithi073.stdout:checking for suffix of object files... o 2023-08-10T11:53:40.709 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether we are using the GNU C compiler... yes 2023-08-10T11:53:40.736 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether gcc accepts -g... yes 2023-08-10T11:53:40.772 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gcc option to accept ANSI C... none needed 2023-08-10T11:53:40.808 INFO:tasks.workunit.client.0.smithi073.stdout:checking for style of include used by make... GNU 2023-08-10T11:53:40.893 INFO:tasks.workunit.client.0.smithi073.stdout:checking dependency style of gcc... gcc3 2023-08-10T11:53:40.893 INFO:tasks.workunit.client.0.smithi073.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2023-08-10T11:53:40.932 INFO:tasks.workunit.client.0.smithi073.stdout:checking how to run the C preprocessor... gcc -E 2023-08-10T11:53:40.961 INFO:tasks.workunit.client.0.smithi073.stdout:checking for egrep... grep -E 2023-08-10T11:53:40.967 INFO:tasks.workunit.client.0.smithi073.stdout:checking for AIX... no 2023-08-10T11:53:40.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:40 smithi152 ceph-mon[130220]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 255 B/s wr, 13 op/s 2023-08-10T11:53:40.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:40 smithi152 ceph-mon[130220]: scrub summary: idle 2023-08-10T11:53:41.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:40 smithi156 ceph-mon[130574]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 255 B/s wr, 13 op/s 2023-08-10T11:53:41.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:40 smithi156 ceph-mon[130574]: scrub summary: idle 2023-08-10T11:53:41.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:40 smithi073 ceph-mon[128869]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 255 B/s wr, 13 op/s 2023-08-10T11:53:41.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:40 smithi073 ceph-mon[128869]: scrub summary: idle 2023-08-10T11:53:41.025 INFO:tasks.workunit.client.0.smithi073.stdout:checking for library containing strerror... none required 2023-08-10T11:53:41.146 INFO:tasks.workunit.client.0.smithi073.stdout:checking for ANSI C header files... yes 2023-08-10T11:53:41.182 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether time.h and sys/time.h may both be included... yes 2023-08-10T11:53:41.224 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/types.h... yes 2023-08-10T11:53:41.266 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/stat.h... yes 2023-08-10T11:53:41.310 INFO:tasks.workunit.client.0.smithi073.stdout:checking for stdlib.h... yes 2023-08-10T11:53:41.355 INFO:tasks.workunit.client.0.smithi073.stdout:checking for string.h... yes 2023-08-10T11:53:41.406 INFO:tasks.workunit.client.0.smithi073.stdout:checking for memory.h... yes 2023-08-10T11:53:41.450 INFO:tasks.workunit.client.0.smithi073.stdout:checking for strings.h... yes 2023-08-10T11:53:41.500 INFO:tasks.workunit.client.0.smithi073.stdout:checking for inttypes.h... yes 2023-08-10T11:53:41.571 INFO:tasks.workunit.client.0.smithi073.stdout:checking for stdint.h... yes 2023-08-10T11:53:41.618 INFO:tasks.workunit.client.0.smithi073.stdout:checking for unistd.h... yes 2023-08-10T11:53:41.631 INFO:tasks.workunit.client.0.smithi073.stdout:checking for memory.h... (cached) yes 2023-08-10T11:53:41.635 INFO:tasks.workunit.client.0.smithi073.stdout:checking for strings.h... (cached) yes 2023-08-10T11:53:41.640 INFO:tasks.workunit.client.0.smithi073.stdout:checking for unistd.h... (cached) yes 2023-08-10T11:53:41.686 INFO:tasks.workunit.client.0.smithi073.stdout:checking locale.h usability... yes 2023-08-10T11:53:41.700 INFO:tasks.workunit.client.0.smithi073.stdout:checking locale.h presence... yes 2023-08-10T11:53:41.701 INFO:tasks.workunit.client.0.smithi073.stdout:checking for locale.h... yes 2023-08-10T11:53:41.716 INFO:tasks.workunit.client.0.smithi073.stdout:checking for stdlib.h... (cached) yes 2023-08-10T11:53:41.721 INFO:tasks.workunit.client.0.smithi073.stdout:checking for string.h... (cached) yes 2023-08-10T11:53:41.762 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/socket.h usability... yes 2023-08-10T11:53:41.780 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/socket.h presence... yes 2023-08-10T11:53:41.780 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/socket.h... yes 2023-08-10T11:53:41.825 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/time.h usability... yes 2023-08-10T11:53:41.840 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/time.h presence... yes 2023-08-10T11:53:41.840 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/time.h... yes 2023-08-10T11:53:41.894 INFO:tasks.workunit.client.0.smithi073.stdout:checking fcntl.h usability... yes 2023-08-10T11:53:41.907 INFO:tasks.workunit.client.0.smithi073.stdout:checking fcntl.h presence... yes 2023-08-10T11:53:41.908 INFO:tasks.workunit.client.0.smithi073.stdout:checking for fcntl.h... yes 2023-08-10T11:53:41.956 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/fcntl.h usability... yes 2023-08-10T11:53:41.970 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/fcntl.h presence... yes 2023-08-10T11:53:41.971 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/fcntl.h... yes 2023-08-10T11:53:42.040 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/param.h usability... yes 2023-08-10T11:53:42.059 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/param.h presence... yes 2023-08-10T11:53:42.059 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/param.h... yes 2023-08-10T11:53:42.107 INFO:tasks.workunit.client.0.smithi073.stdout:checking ioctl.h usability... no 2023-08-10T11:53:42.122 INFO:tasks.workunit.client.0.smithi073.stdout:checking ioctl.h presence... no 2023-08-10T11:53:42.122 INFO:tasks.workunit.client.0.smithi073.stdout:checking for ioctl.h... no 2023-08-10T11:53:42.169 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/ioctl.h usability... yes 2023-08-10T11:53:42.183 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/ioctl.h presence... yes 2023-08-10T11:53:42.184 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/ioctl.h... yes 2023-08-10T11:53:42.232 INFO:tasks.workunit.client.0.smithi073.stdout:checking return type of signal handlers... void 2023-08-10T11:53:42.270 INFO:tasks.workunit.client.0.smithi073.stdout:checking for size_t... yes 2023-08-10T11:53:42.303 INFO:tasks.workunit.client.0.smithi073.stdout:checking for dev_t... yes 2023-08-10T11:53:42.339 INFO:tasks.workunit.client.0.smithi073.stdout:checking for short... yes 2023-08-10T11:53:42.435 INFO:tasks.workunit.client.0.smithi073.stdout:checking size of short... 2 2023-08-10T11:53:42.473 INFO:tasks.workunit.client.0.smithi073.stdout:checking for int... yes 2023-08-10T11:53:42.536 INFO:tasks.workunit.client.0.smithi073.stdout:checking size of int... 4 2023-08-10T11:53:42.578 INFO:tasks.workunit.client.0.smithi073.stdout:checking for long... yes 2023-08-10T11:53:42.646 INFO:tasks.workunit.client.0.smithi073.stdout:checking size of long... 8 2023-08-10T11:53:42.686 INFO:tasks.workunit.client.0.smithi073.stdout:checking for long long... yes 2023-08-10T11:53:42.750 INFO:tasks.workunit.client.0.smithi073.stdout:checking size of long long... 8 2023-08-10T11:53:42.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:42 smithi073 ceph-mon[128869]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 255 B/s wr, 9 op/s 2023-08-10T11:53:42.795 INFO:tasks.workunit.client.0.smithi073.stdout:checking for ssize_t... yes 2023-08-10T11:53:42.850 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sig_atomic_t... yes 2023-08-10T11:53:42.880 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether gcc needs -traditional... no 2023-08-10T11:53:42.915 INFO:tasks.workunit.client.0.smithi073.stdout:checking for an ANSI C-conforming const... yes 2023-08-10T11:53:42.951 INFO:tasks.workunit.client.0.smithi073.stdout:checking for inline... inline 2023-08-10T11:53:42.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:42 smithi152 ceph-mon[130220]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 255 B/s wr, 9 op/s 2023-08-10T11:53:43.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:42 smithi156 ceph-mon[130574]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 255 B/s wr, 9 op/s 2023-08-10T11:53:43.216 INFO:tasks.workunit.client.0.smithi073.stdout:checking for working alloca.h... yes 2023-08-10T11:53:43.261 INFO:tasks.workunit.client.0.smithi073.stdout:checking for alloca... yes 2023-08-10T11:53:43.326 INFO:tasks.workunit.client.0.smithi073.stdout:checking for working memcmp... yes 2023-08-10T11:53:43.376 INFO:tasks.workunit.client.0.smithi073.stdout:checking for strftime... yes 2023-08-10T11:53:43.441 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2023-08-10T11:53:43.499 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether stat accepts an empty string... no 2023-08-10T11:53:43.551 INFO:tasks.workunit.client.0.smithi073.stdout:checking for vprintf... yes 2023-08-10T11:53:43.605 INFO:tasks.workunit.client.0.smithi073.stdout:checking for _doprnt... no 2023-08-10T11:53:43.628 INFO:tasks.workunit.client.0.smithi073.stdout:checking build system type... x86_64-unknown-linux-gnu 2023-08-10T11:53:43.640 INFO:tasks.workunit.client.0.smithi073.stdout:checking host system type... x86_64-unknown-linux-gnu 2023-08-10T11:53:43.716 INFO:tasks.workunit.client.0.smithi073.stdout:checking for the pthreads library -lpthreads... no 2023-08-10T11:53:43.763 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether pthreads work without any flags... no 2023-08-10T11:53:43.777 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether pthreads work with -Kthread... no 2023-08-10T11:53:43.789 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether pthreads work with -kthread... no 2023-08-10T11:53:43.826 INFO:tasks.workunit.client.0.smithi073.stdout:checking for the pthreads library -llthread... no 2023-08-10T11:53:43.872 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether pthreads work with -pthread... yes 2023-08-10T11:53:43.912 INFO:tasks.workunit.client.0.smithi073.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2023-08-10T11:53:43.912 INFO:tasks.workunit.client.0.smithi073.stdout:checking if more special flags are required for pthreads... no 2023-08-10T11:53:43.912 INFO:tasks.workunit.client.0.smithi073.stdout:checking for cc_r... gcc 2023-08-10T11:53:43.988 INFO:tasks.workunit.client.0.smithi073.stdout:checking for setrlimit... yes 2023-08-10T11:53:43.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:43 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:53:43.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:43 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:53:43.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:43 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:53:43.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:43 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:53:44.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:43 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:53:44.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:43 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:53:44.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:43 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:53:44.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:43 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:53:44.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:43 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:53:44.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:43 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:53:44.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:43 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:53:44.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:43 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:53:44.042 INFO:tasks.workunit.client.0.smithi073.stdout:checking for setproctitle... no 2023-08-10T11:53:44.094 INFO:tasks.workunit.client.0.smithi073.stdout:checking for getopt_long... yes 2023-08-10T11:53:44.148 INFO:tasks.workunit.client.0.smithi073.stdout:checking for strtoull... yes 2023-08-10T11:53:44.202 INFO:tasks.workunit.client.0.smithi073.stdout:checking for strtoq... yes 2023-08-10T11:53:44.255 INFO:tasks.workunit.client.0.smithi073.stdout:checking for snprintf... yes 2023-08-10T11:53:44.309 INFO:tasks.workunit.client.0.smithi073.stdout:checking for vsnprintf... yes 2023-08-10T11:53:44.476 INFO:tasks.workunit.client.0.smithi073.stdout:checking for vfprintf... yes 2023-08-10T11:53:44.579 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gethostname... yes 2023-08-10T11:53:44.634 INFO:tasks.workunit.client.0.smithi073.stdout:checking for setlocale... yes 2023-08-10T11:53:44.689 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sync... yes 2023-08-10T11:53:44.760 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether snprintf is C99 conformant... done 2023-08-10T11:53:44.770 INFO:tasks.workunit.client.0.smithi073.stdout:configure: creating ./config.status 2023-08-10T11:53:44.899 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: creating Makefile 2023-08-10T11:53:44.913 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: creating src/Makefile 2023-08-10T11:53:44.930 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: creating man/Makefile 2023-08-10T11:53:44.940 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: creating config.h 2023-08-10T11:53:44.985 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: executing depfiles commands 2023-08-10T11:53:44.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:44 smithi152 ceph-mon[130220]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 255 B/s wr, 9 op/s 2023-08-10T11:53:45.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:44 smithi156 ceph-mon[130574]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 255 B/s wr, 9 op/s 2023-08-10T11:53:45.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:44 smithi073 ceph-mon[128869]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 255 B/s wr, 9 op/s 2023-08-10T11:53:45.128 INFO:tasks.workunit.client.0.smithi073.stderr:+ make 2023-08-10T11:53:45.140 INFO:tasks.workunit.client.0.smithi073.stdout:make all-recursive 2023-08-10T11:53:45.142 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2023-08-10T11:53:45.145 INFO:tasks.workunit.client.0.smithi073.stdout:Making all in src 2023-08-10T11:53:45.151 INFO:tasks.workunit.client.0.smithi073.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2023-08-10T11:53:45.151 INFO:tasks.workunit.client.0.smithi073.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2023-08-10T11:53:45.151 INFO:tasks.workunit.client.0.smithi073.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2023-08-10T11:53:45.226 INFO:tasks.workunit.client.0.smithi073.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2023-08-10T11:53:45.227 INFO:tasks.workunit.client.0.smithi073.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2023-08-10T11:53:45.311 INFO:tasks.workunit.client.0.smithi073.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2023-08-10T11:53:45.312 INFO:tasks.workunit.client.0.smithi073.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2023-08-10T11:53:45.410 INFO:tasks.workunit.client.0.smithi073.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2023-08-10T11:53:45.411 INFO:tasks.workunit.client.0.smithi073.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2023-08-10T11:53:45.495 INFO:tasks.workunit.client.0.smithi073.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2023-08-10T11:53:45.495 INFO:tasks.workunit.client.0.smithi073.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2023-08-10T11:53:45.570 INFO:tasks.workunit.client.0.smithi073.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2023-08-10T11:53:45.571 INFO:tasks.workunit.client.0.smithi073.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2023-08-10T11:53:45.640 INFO:tasks.workunit.client.0.smithi073.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2023-08-10T11:53:45.641 INFO:tasks.workunit.client.0.smithi073.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2023-08-10T11:53:45.732 INFO:tasks.workunit.client.0.smithi073.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2023-08-10T11:53:45.733 INFO:tasks.workunit.client.0.smithi073.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2023-08-10T11:53:45.790 INFO:tasks.workunit.client.0.smithi073.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2023-08-10T11:53:45.791 INFO:tasks.workunit.client.0.smithi073.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2023-08-10T11:53:45.848 INFO:tasks.workunit.client.0.smithi073.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2023-08-10T11:53:45.848 INFO:tasks.workunit.client.0.smithi073.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2023-08-10T11:53:45.898 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -g -O2 -pthread -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2023-08-10T11:53:45.922 INFO:tasks.workunit.client.0.smithi073.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2023-08-10T11:53:45.922 INFO:tasks.workunit.client.0.smithi073.stdout:Making all in man 2023-08-10T11:53:45.925 INFO:tasks.workunit.client.0.smithi073.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2023-08-10T11:53:45.926 INFO:tasks.workunit.client.0.smithi073.stdout:make[2]: Nothing to be done for 'all'. 2023-08-10T11:53:45.926 INFO:tasks.workunit.client.0.smithi073.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2023-08-10T11:53:45.927 INFO:tasks.workunit.client.0.smithi073.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2023-08-10T11:53:45.928 INFO:tasks.workunit.client.0.smithi073.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2023-08-10T11:53:45.928 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2023-08-10T11:53:45.929 INFO:tasks.workunit.client.0.smithi073.stderr:+ cd src 2023-08-10T11:53:45.929 INFO:tasks.workunit.client.0.smithi073.stderr:+ mkdir blogtest_in 2023-08-10T11:53:45.931 INFO:tasks.workunit.client.0.smithi073.stdout:running blogbench 2023-08-10T11:53:45.931 INFO:tasks.workunit.client.0.smithi073.stderr:+ echo 'running blogbench' 2023-08-10T11:53:45.932 INFO:tasks.workunit.client.0.smithi073.stderr:+ ./blogbench -d blogtest_in 2023-08-10T11:53:45.932 INFO:tasks.workunit.client.0.smithi073.stdout: 2023-08-10T11:53:45.932 INFO:tasks.workunit.client.0.smithi073.stdout:Frequency = 10 secs 2023-08-10T11:53:45.932 INFO:tasks.workunit.client.0.smithi073.stdout:Scratch dir = [blogtest_in] 2023-08-10T11:53:45.980 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.978+0000 7f606ce6f700 1 -- 172.21.15.73:0/2199661087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60680ff620 msgr2=0x7f60680ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:45.980 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.978+0000 7f606ce6f700 1 --2- 172.21.15.73:0/2199661087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60680ff620 0x7f60680ffaa0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f6058009990 tx=0x7f6058009ca0 comp rx=0 tx=0).stop 2023-08-10T11:53:45.980 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.978+0000 7f606ce6f700 1 -- 172.21.15.73:0/2199661087 shutdown_connections 2023-08-10T11:53:45.981 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.978+0000 7f606ce6f700 1 --2- 172.21.15.73:0/2199661087 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60680fffe0 0x7f606810c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:45.981 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.978+0000 7f606ce6f700 1 --2- 172.21.15.73:0/2199661087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60681056c0 0x7f6068105aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:45.981 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.978+0000 7f606ce6f700 1 --2- 172.21.15.73:0/2199661087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60680ff620 0x7f60680ffaa0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:45.981 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.978+0000 7f606ce6f700 1 -- 172.21.15.73:0/2199661087 >> 172.21.15.73:0/2199661087 conn(0x7f6068076770 msgr2=0x7f6068076b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:45.981 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.978+0000 7f606ce6f700 1 -- 172.21.15.73:0/2199661087 shutdown_connections 2023-08-10T11:53:45.981 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.978+0000 7f606ce6f700 1 -- 172.21.15.73:0/2199661087 wait complete. 2023-08-10T11:53:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.979+0000 7f606ce6f700 1 Processor -- start 2023-08-10T11:53:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.979+0000 7f606ce6f700 1 -- start start 2023-08-10T11:53:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.979+0000 7f606ce6f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60680ff620 0x7f6068106700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.979+0000 7f606ce6f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60680fffe0 0x7f6068106c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.979+0000 7f606ce6f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60681056c0 0x7f60681a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.979+0000 7f606ce6f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60681a4f50 con 0x7f60681056c0 2023-08-10T11:53:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.979+0000 7f606ce6f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60681a5090 con 0x7f60680fffe0 2023-08-10T11:53:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.979+0000 7f606ce6f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60681a5200 con 0x7f60680ff620 2023-08-10T11:53:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.979+0000 7f606659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60680ff620 0x7f6068106700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.979+0000 7f6066d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60681056c0 0x7f60681a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.979+0000 7f6065d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60680fffe0 0x7f6068106c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.979+0000 7f606659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60680ff620 0x7f6068106700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:59362/0 (socket says 172.21.15.73:59362) 2023-08-10T11:53:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.979+0000 7f606659c700 1 -- 172.21.15.73:0/2352989351 learned_addr learned my addr 172.21.15.73:0/2352989351 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.979+0000 7f6065d9b700 1 -- 172.21.15.73:0/2352989351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60680ff620 msgr2=0x7f6068106700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.979+0000 7f6065d9b700 1 --2- 172.21.15.73:0/2352989351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60680ff620 0x7f6068106700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.979+0000 7f6065d9b700 1 -- 172.21.15.73:0/2352989351 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60681056c0 msgr2=0x7f60681a4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.979+0000 7f6065d9b700 1 --2- 172.21.15.73:0/2352989351 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60681056c0 0x7f60681a4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.979+0000 7f6065d9b700 1 -- 172.21.15.73:0/2352989351 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60580095f0 con 0x7f60680fffe0 2023-08-10T11:53:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.979+0000 7f6066d9d700 1 --2- 172.21.15.73:0/2352989351 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60681056c0 0x7f60681a4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:53:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.979+0000 7f6065d9b700 1 --2- 172.21.15.73:0/2352989351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60680fffe0 0x7f6068106c40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f60580098e0 tx=0x7f6058004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.980+0000 7f60577fe700 1 -- 172.21.15.73:0/2352989351 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605801d070 con 0x7f60680fffe0 2023-08-10T11:53:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.980+0000 7f606ce6f700 1 -- 172.21.15.73:0/2352989351 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60681a5480 con 0x7f60680fffe0 2023-08-10T11:53:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.980+0000 7f60577fe700 1 -- 172.21.15.73:0/2352989351 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6058005030 con 0x7f60680fffe0 2023-08-10T11:53:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.980+0000 7f60577fe700 1 -- 172.21.15.73:0/2352989351 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6058004ab0 con 0x7f60680fffe0 2023-08-10T11:53:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.980+0000 7f606ce6f700 1 -- 172.21.15.73:0/2352989351 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60681a5920 con 0x7f60680fffe0 2023-08-10T11:53:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.983+0000 7f60577fe700 1 -- 172.21.15.73:0/2352989351 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f6058005410 con 0x7f60680fffe0 2023-08-10T11:53:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.983+0000 7f60577fe700 1 --2- 172.21.15.73:0/2352989351 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f60500a13e0 0x7f60500a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.983+0000 7f606659c700 1 --2- 172.21.15.73:0/2352989351 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f60500a13e0 0x7f60500a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.983+0000 7f60577fe700 1 -- 172.21.15.73:0/2352989351 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f60580ce050 con 0x7f60680fffe0 2023-08-10T11:53:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.984+0000 7f6079008b80 1 Processor -- start 2023-08-10T11:53:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.984+0000 7f606659c700 1 --2- 172.21.15.73:0/2352989351 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f60500a13e0 0x7f60500a38a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f605c005950 tx=0x7f605c00b500 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.984+0000 7f6079008b80 1 -- start start 2023-08-10T11:53:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.984+0000 7f6079008b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c1382c6a40 0x55c1382c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.984+0000 7f6079008b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1382c7360 0x55c1382c1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.984+0000 7f6079008b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1382c1550 0x55c1382c19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.984+0000 7f6079008b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c13823cd60 con 0x55c1382c1550 2023-08-10T11:53:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.984+0000 7f6079008b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c138219530 con 0x55c1382c7360 2023-08-10T11:53:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.984+0000 7f6079008b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c138216e50 con 0x55c1382c6a40 2023-08-10T11:53:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.984+0000 7f6066d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1382c1550 0x55c1382c19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.984+0000 7f6066d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1382c1550 0x55c1382c19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33870/0 (socket says 172.21.15.73:33870) 2023-08-10T11:53:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.984+0000 7f6066d9d700 1 -- 172.21.15.73:0/3036837867 learned_addr learned my addr 172.21.15.73:0/3036837867 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.984+0000 7f6065d9b700 1 --2- 172.21.15.73:0/3036837867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1382c7360 0x55c1382c1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.984+0000 7f606659c700 1 --2- 172.21.15.73:0/3036837867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c1382c6a40 0x55c1382c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.984+0000 7f6066d9d700 1 -- 172.21.15.73:0/3036837867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c1382c6a40 msgr2=0x55c1382c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.984+0000 7f6066d9d700 1 --2- 172.21.15.73:0/3036837867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c1382c6a40 0x55c1382c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.984+0000 7f6066d9d700 1 -- 172.21.15.73:0/3036837867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1382c7360 msgr2=0x55c1382c1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.984+0000 7f6066d9d700 1 --2- 172.21.15.73:0/3036837867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1382c7360 0x55c1382c1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.984+0000 7f6066d9d700 1 -- 172.21.15.73:0/3036837867 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1380935d0 con 0x55c1382c1550 2023-08-10T11:53:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.984+0000 7f606659c700 1 --2- 172.21.15.73:0/3036837867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c1382c6a40 0x55c1382c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.985+0000 7f6066d9d700 1 --2- 172.21.15.73:0/3036837867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1382c1550 0x55c1382c19d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6060003eb0 tx=0x7f6060009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122ee36b3fee13e1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.985+0000 7f6054ff9700 1 -- 172.21.15.73:0/3036837867 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60600092d0 con 0x55c1382c1550 2023-08-10T11:53:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.985+0000 7f6054ff9700 1 -- 172.21.15.73:0/3036837867 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f606000f040 con 0x55c1382c1550 2023-08-10T11:53:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.985+0000 7f6054ff9700 1 -- 172.21.15.73:0/3036837867 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606000e800 con 0x55c1382c1550 2023-08-10T11:53:46.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.985+0000 7f6079008b80 1 -- 172.21.15.73:0/3036837867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1382c1550 msgr2=0x55c1382c19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:46.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.985+0000 7f6079008b80 1 --2- 172.21.15.73:0/3036837867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1382c1550 0x55c1382c19d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6060003eb0 tx=0x7f6060009920 comp rx=0 tx=0).stop 2023-08-10T11:53:46.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.985+0000 7f6079008b80 1 -- 172.21.15.73:0/3036837867 shutdown_connections 2023-08-10T11:53:46.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.985+0000 7f6079008b80 1 --2- 172.21.15.73:0/3036837867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1382c1550 0x55c1382c19d0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:46.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.985+0000 7f6079008b80 1 --2- 172.21.15.73:0/3036837867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c1382c6a40 0x55c1382c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:46.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.985+0000 7f6079008b80 1 --2- 172.21.15.73:0/3036837867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1382c7360 0x55c1382c1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:46.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.985+0000 7f6079008b80 1 -- 172.21.15.73:0/3036837867 >> 172.21.15.73:0/3036837867 conn(0x55c13821ec70 msgr2=0x55c1382bbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.986+0000 7f6079008b80 1 -- 172.21.15.73:0/3036837867 shutdown_connections 2023-08-10T11:53:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.986+0000 7f6079008b80 1 -- 172.21.15.73:0/3036837867 wait complete. 2023-08-10T11:53:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.986+0000 7f6079008b80 1 -- start start 2023-08-10T11:53:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.986+0000 7f6079008b80 1 Processor -- start 2023-08-10T11:53:46.002 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.986+0000 7f6079008b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c1382c1550 0x55c1382cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:46.002 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.986+0000 7f6079008b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1382c6a40 0x55c1382ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:46.002 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.986+0000 7f6079008b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1382c7360 0x55c1382cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:46.002 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.986+0000 7f6079008b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c138212740 con 0x55c1382c7360 2023-08-10T11:53:46.002 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.986+0000 7f6079008b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1381b1a60 con 0x55c1382c6a40 2023-08-10T11:53:46.002 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.986+0000 7f6079008b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1381b1760 con 0x55c1382c1550 2023-08-10T11:53:46.003 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.986+0000 7f6079008b80 10 client.0 _ll_register_callbacks cb 0x55c1381af620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:46.003 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.986+0000 7f6066d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1382c7360 0x55c1382cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:46.003 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.986+0000 7f6066d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1382c7360 0x55c1382cabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33876/0 (socket says 172.21.15.73:33876) 2023-08-10T11:53:46.003 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.986+0000 7f6066d9d700 1 -- 172.21.15.73:0/21077489 learned_addr learned my addr 172.21.15.73:0/21077489 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:46.003 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.986+0000 7f6065d9b700 1 --2- 172.21.15.73:0/21077489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1382c6a40 0x55c1382ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:46.003 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.987+0000 7f606659c700 1 --2- 172.21.15.73:0/21077489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c1382c1550 0x55c1382cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:46.004 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.987+0000 7f6066d9d700 1 -- 172.21.15.73:0/21077489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c1382c1550 msgr2=0x55c1382cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:46.004 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.987+0000 7f6066d9d700 1 --2- 172.21.15.73:0/21077489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c1382c1550 0x55c1382cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:46.004 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.987+0000 7f6066d9d700 1 -- 172.21.15.73:0/21077489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1382c6a40 msgr2=0x55c1382ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:46.004 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.987+0000 7f6066d9d700 1 --2- 172.21.15.73:0/21077489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1382c6a40 0x55c1382ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:46.004 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.987+0000 7f6066d9d700 1 -- 172.21.15.73:0/21077489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6060003b90 con 0x55c1382c7360 2023-08-10T11:53:46.004 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.987+0000 7f6065d9b700 1 --2- 172.21.15.73:0/21077489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1382c6a40 0x55c1382ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:53:46.004 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.987+0000 7f6066d9d700 1 --2- 172.21.15.73:0/21077489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1382c7360 0x55c1382cabc0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6060009b30 tx=0x7f6060007730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acedf65fc1e1239 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:46.005 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.987+0000 7f604dffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:46.005 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.987+0000 7f604dffb700 1 -- 172.21.15.73:0/21077489 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6060004ad0 con 0x55c1382c7360 2023-08-10T11:53:46.005 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.987+0000 7f604dffb700 1 -- 172.21.15.73:0/21077489 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f6060004c30 con 0x55c1382c7360 2023-08-10T11:53:46.005 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.987+0000 7f6079008b80 1 -- 172.21.15.73:0/21077489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c1382b41c0 con 0x55c1382c7360 2023-08-10T11:53:46.006 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.987+0000 7f604dffb700 1 -- 172.21.15.73:0/21077489 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6060004df0 con 0x55c1382c7360 2023-08-10T11:53:46.006 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.987+0000 7f6079008b80 10 client.15942 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:46.006 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.987+0000 7f6079008b80 1 -- 172.21.15.73:0/21077489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55c13803fd80 con 0x55c1382c7360 2023-08-10T11:53:46.006 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.987+0000 7f604dffb700 1 -- 172.21.15.73:0/21077489 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c1382b41c0 con 0x55c1382c7360 2023-08-10T11:53:46.007 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.987+0000 7f604dffb700 1 -- 172.21.15.73:0/21077489 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f60600155c0 con 0x55c1382c7360 2023-08-10T11:53:46.007 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.987+0000 7f6079008b80 10 client.15942 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:46.007 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.987+0000 7f6079008b80 10 client.15942 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:53:46.008 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.987+0000 7f6079008b80 20 client.15942 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:46.008 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.987+0000 7f6079008b80 1 --2- 172.21.15.73:0/21077489 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c1382dab30 0x55c1382dcf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:46.008 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.987+0000 7f6079008b80 4 client.15942 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:53:46.008 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.987+0000 7f6079008b80 1 -- 172.21.15.73:0/21077489 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c138290970 con 0x55c1382dab30 2023-08-10T11:53:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.988+0000 7f606659c700 1 --2- 172.21.15.73:0/21077489 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c1382dab30 0x55c1382dcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.988+0000 7f606659c700 1 --2- 172.21.15.73:0/21077489 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c1382dab30 0x55c1382dcf20 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99ef5468f7628acb server_cookie=49ab7f6c8dc8ad07 in_seq=0 out_seq=0 2023-08-10T11:53:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.988+0000 7f604dffb700 10 client.15942 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.989+0000 7f604dffb700 1 -- 172.21.15.73:0/21077489 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55c138290970 con 0x55c1382dab30 2023-08-10T11:53:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.989+0000 7f604dffb700 10 client.15942 handle_command_reply: tid=0 2023-08-10T11:53:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.989+0000 7f6079008b80 1 client.15942 shutdown 2023-08-10T11:53:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.989+0000 7f6079008b80 1 -- 172.21.15.73:0/21077489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1382c7360 msgr2=0x55c1382cabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.989+0000 7f6079008b80 1 --2- 172.21.15.73:0/21077489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1382c7360 0x55c1382cabc0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6060009b30 tx=0x7f6060007730 comp rx=0 tx=0).stop 2023-08-10T11:53:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.989+0000 7f6079008b80 1 -- 172.21.15.73:0/21077489 shutdown_connections 2023-08-10T11:53:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.989+0000 7f6079008b80 1 --2- 172.21.15.73:0/21077489 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c1382dab30 0x55c1382dcf20 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.989+0000 7f6079008b80 1 --2- 172.21.15.73:0/21077489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1382c7360 0x55c1382cabc0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.989+0000 7f604dffb700 0 client.15942 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.989+0000 7f6079008b80 1 --2- 172.21.15.73:0/21077489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c1382c1550 0x55c1382cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.989+0000 7f6079008b80 1 --2- 172.21.15.73:0/21077489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1382c6a40 0x55c1382ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.989+0000 7f6079008b80 1 -- 172.21.15.73:0/21077489 >> 172.21.15.73:0/21077489 conn(0x55c13821ec70 msgr2=0x55c1382bb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.989+0000 7f6079008b80 1 -- 172.21.15.73:0/21077489 shutdown_connections 2023-08-10T11:53:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.989+0000 7f6079008b80 1 -- 172.21.15.73:0/21077489 wait complete. 2023-08-10T11:53:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:45.989+0000 7f6079008b80 20 client.15942 trim_cache size 0 max 16384 2023-08-10T11:53:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.006+0000 7f6079008b80 1 Processor -- start 2023-08-10T11:53:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.006+0000 7f6079008b80 1 -- start start 2023-08-10T11:53:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.006+0000 7f6079008b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c1382c1550 0x55c1382c1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.006+0000 7f6079008b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1382c6a40 0x55c1382e1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.006+0000 7f6079008b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1382c7360 0x55c1382c9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.006+0000 7f6079008b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1380958c0 con 0x55c1382c7360 2023-08-10T11:53:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.006+0000 7f6079008b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c138290970 con 0x55c1382c6a40 2023-08-10T11:53:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.006+0000 7f6079008b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1382bd560 con 0x55c1382c1550 2023-08-10T11:53:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.006+0000 7f606659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c1382c1550 0x55c1382c1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.006+0000 7f606659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c1382c1550 0x55c1382c1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:59384/0 (socket says 172.21.15.73:59384) 2023-08-10T11:53:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.006+0000 7f606659c700 1 -- 172.21.15.73:0/619404645 learned_addr learned my addr 172.21.15.73:0/619404645 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.007+0000 7f6066d9d700 1 --2- 172.21.15.73:0/619404645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1382c7360 0x55c1382c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.007+0000 7f6065d9b700 1 --2- 172.21.15.73:0/619404645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1382c6a40 0x55c1382e1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.007+0000 7f606659c700 1 -- 172.21.15.73:0/619404645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1382c6a40 msgr2=0x55c1382e1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.007+0000 7f606659c700 1 --2- 172.21.15.73:0/619404645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1382c6a40 0x55c1382e1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.007+0000 7f606659c700 1 -- 172.21.15.73:0/619404645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1382c7360 msgr2=0x55c1382c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.007+0000 7f606659c700 1 --2- 172.21.15.73:0/619404645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1382c7360 0x55c1382c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.007+0000 7f606659c700 1 -- 172.21.15.73:0/619404645 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c138028c00 con 0x55c1382c1550 2023-08-10T11:53:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.007+0000 7f6066d9d700 1 --2- 172.21.15.73:0/619404645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1382c7360 0x55c1382c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:53:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.007+0000 7f606659c700 1 --2- 172.21.15.73:0/619404645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c1382c1550 0x55c1382c1010 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f605c005e10 tx=0x7f605c013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b1df28d89c7d90d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.007+0000 7f60557fa700 1 -- 172.21.15.73:0/619404645 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c026450 con 0x55c1382c1550 2023-08-10T11:53:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.007+0000 7f60557fa700 1 -- 172.21.15.73:0/619404645 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f605c025040 con 0x55c1382c1550 2023-08-10T11:53:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.007+0000 7f60557fa700 1 -- 172.21.15.73:0/619404645 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c01e980 con 0x55c1382c1550 2023-08-10T11:53:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.008+0000 7f6079008b80 1 -- 172.21.15.73:0/619404645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c1382c1550 msgr2=0x55c1382c1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.008+0000 7f6079008b80 1 --2- 172.21.15.73:0/619404645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c1382c1550 0x55c1382c1010 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f605c005e10 tx=0x7f605c013000 comp rx=0 tx=0).stop 2023-08-10T11:53:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.008+0000 7f6079008b80 1 -- 172.21.15.73:0/619404645 shutdown_connections 2023-08-10T11:53:46.021 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.008+0000 7f6079008b80 1 --2- 172.21.15.73:0/619404645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1382c7360 0x55c1382c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:46.021 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.008+0000 7f6079008b80 1 --2- 172.21.15.73:0/619404645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c1382c1550 0x55c1382c1010 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:46.021 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.008+0000 7f6079008b80 1 --2- 172.21.15.73:0/619404645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1382c6a40 0x55c1382e1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:46.021 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.008+0000 7f6079008b80 1 -- 172.21.15.73:0/619404645 >> 172.21.15.73:0/619404645 conn(0x55c13821ec70 msgr2=0x55c1382c5780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:46.021 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.008+0000 7f6079008b80 1 -- 172.21.15.73:0/619404645 shutdown_connections 2023-08-10T11:53:46.021 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.008+0000 7f6079008b80 1 -- 172.21.15.73:0/619404645 wait complete. 2023-08-10T11:53:46.021 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.009+0000 7f6079008b80 1 -- start start 2023-08-10T11:53:46.022 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.009+0000 7f6079008b80 1 Processor -- start 2023-08-10T11:53:46.022 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.009+0000 7f6079008b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1382c1550 0x55c1382d1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:46.022 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.009+0000 7f6079008b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1382c6a40 0x55c1382d1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:46.022 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.009+0000 7f6079008b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c1382c7360 0x55c13832d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:46.022 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.009+0000 7f6079008b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1382d1ed0 con 0x55c1382c1550 2023-08-10T11:53:46.022 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.009+0000 7f6079008b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c13832dcf0 con 0x55c1382c6a40 2023-08-10T11:53:46.022 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.009+0000 7f6079008b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c13832deb0 con 0x55c1382c7360 2023-08-10T11:53:46.022 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.009+0000 7f6079008b80 10 client.0 _ll_register_callbacks cb 0x55c1381af620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.009+0000 7f6065d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1382c6a40 0x55c1382d1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.009+0000 7f6065d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1382c6a40 0x55c1382d1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:48536/0 (socket says 172.21.15.73:48536) 2023-08-10T11:53:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.009+0000 7f6065d9b700 1 -- 172.21.15.73:0/1666126620 learned_addr learned my addr 172.21.15.73:0/1666126620 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.010+0000 7f606659c700 1 --2- 172.21.15.73:0/1666126620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1382c1550 0x55c1382d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.010+0000 7f6066d9d700 1 --2- 172.21.15.73:0/1666126620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c1382c7360 0x55c13832d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.010+0000 7f6065d9b700 1 -- 172.21.15.73:0/1666126620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c1382c7360 msgr2=0x55c13832d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.010+0000 7f6065d9b700 1 --2- 172.21.15.73:0/1666126620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c1382c7360 0x55c13832d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.010+0000 7f6065d9b700 1 -- 172.21.15.73:0/1666126620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1382c1550 msgr2=0x55c1382d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.010+0000 7f6065d9b700 1 --2- 172.21.15.73:0/1666126620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1382c1550 0x55c1382d1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.010+0000 7f6065d9b700 1 -- 172.21.15.73:0/1666126620 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c13803fd80 con 0x55c1382c6a40 2023-08-10T11:53:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.010+0000 7f6065d9b700 1 --2- 172.21.15.73:0/1666126620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1382c6a40 0x55c1382d1770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f605809ac90 tx=0x7f605809b4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b5003f377276e9d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.010+0000 7f604dffb700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T11:53:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.011+0000 7f604dffb700 1 -- 172.21.15.73:0/1666126620 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60580a30c0 con 0x55c1382c6a40 2023-08-10T11:53:46.025 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.011+0000 7f604dffb700 1 -- 172.21.15.73:0/1666126620 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f60580b3070 con 0x55c1382c6a40 2023-08-10T11:53:46.025 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.011+0000 7f6079008b80 1 -- 172.21.15.73:0/1666126620 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f606000f040 con 0x55c1382c6a40 2023-08-10T11:53:46.025 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.011+0000 7f604dffb700 1 -- 172.21.15.73:0/1666126620 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f605809af90 con 0x55c1382c6a40 2023-08-10T11:53:46.025 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.011+0000 7f6079008b80 10 client.25361 fetch_fsmap learned FSMap version 27 2023-08-10T11:53:46.025 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.011+0000 7f6079008b80 1 -- 172.21.15.73:0/1666126620 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f605c011440 con 0x55c1382c6a40 2023-08-10T11:53:46.025 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.011+0000 7f604dffb700 1 -- 172.21.15.73:0/1666126620 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f606000f040 con 0x55c1382c6a40 2023-08-10T11:53:46.025 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.011+0000 7f604dffb700 1 -- 172.21.15.73:0/1666126620 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6058095ba0 con 0x55c1382c6a40 2023-08-10T11:53:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.011+0000 7f6079008b80 10 client.25361 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T11:53:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.011+0000 7f6079008b80 10 client.25361 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:53:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.011+0000 7f6079008b80 20 client.25361 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.011+0000 7f6079008b80 1 --2- 172.21.15.73:0/1666126620 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c13832f300 0x55c138331720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.011+0000 7f6079008b80 4 client.25361 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:53:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.011+0000 7f6079008b80 1 -- 172.21.15.73:0/1666126620 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c13820b720 con 0x55c13832f300 2023-08-10T11:53:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.012+0000 7f606659c700 1 --2- 172.21.15.73:0/1666126620 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c13832f300 0x55c138331720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.012+0000 7f604dffb700 10 client.25361 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:46.028 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.012+0000 7f606659c700 1 --2- 172.21.15.73:0/1666126620 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c13832f300 0x55c138331720 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21c345f62f3fc10a server_cookie=eba518e219789b2d in_seq=0 out_seq=0 2023-08-10T11:53:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.069+0000 7f604dffb700 1 -- 172.21.15.73:0/1666126620 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c13820b720 con 0x55c13832f300 2023-08-10T11:53:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.069+0000 7f604dffb700 10 client.25361 handle_command_reply: tid=0 2023-08-10T11:53:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.069+0000 7f6079008b80 1 client.25361 shutdown 2023-08-10T11:53:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.069+0000 7f6079008b80 1 -- 172.21.15.73:0/1666126620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1382c6a40 msgr2=0x55c1382d1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.069+0000 7f6079008b80 1 --2- 172.21.15.73:0/1666126620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1382c6a40 0x55c1382d1770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f605809ac90 tx=0x7f605809b4d0 comp rx=0 tx=0).stop 2023-08-10T11:53:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.069+0000 7f6079008b80 1 -- 172.21.15.73:0/1666126620 shutdown_connections 2023-08-10T11:53:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.069+0000 7f6079008b80 1 --2- 172.21.15.73:0/1666126620 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c13832f300 0x55c138331720 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.069+0000 7f6079008b80 1 --2- 172.21.15.73:0/1666126620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c1382c7360 0x55c13832d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.069+0000 7f604dffb700 0 client.25361 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.069+0000 7f6079008b80 1 --2- 172.21.15.73:0/1666126620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c1382c1550 0x55c1382d1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:46.073 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.069+0000 7f6079008b80 1 --2- 172.21.15.73:0/1666126620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1382c6a40 0x55c1382d1770 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:46.073 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.069+0000 7f6079008b80 1 -- 172.21.15.73:0/1666126620 >> 172.21.15.73:0/1666126620 conn(0x55c13821ec70 msgr2=0x55c1382c6010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:46.073 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.069+0000 7f6079008b80 1 -- 172.21.15.73:0/1666126620 shutdown_connections 2023-08-10T11:53:46.073 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.069+0000 7f6079008b80 1 -- 172.21.15.73:0/1666126620 wait complete. 2023-08-10T11:53:46.073 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.069+0000 7f6079008b80 20 client.25361 trim_cache size 0 max 16384 2023-08-10T11:53:46.073 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:53:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:53:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:53:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:53:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.070+0000 7f606ce6f700 1 -- 172.21.15.73:0/2352989351 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f60500a13e0 msgr2=0x7f60500a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.070+0000 7f606ce6f700 1 --2- 172.21.15.73:0/2352989351 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f60500a13e0 0x7f60500a38a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f605c005950 tx=0x7f605c00b500 comp rx=0 tx=0).stop 2023-08-10T11:53:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.070+0000 7f606ce6f700 1 -- 172.21.15.73:0/2352989351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60680fffe0 msgr2=0x7f6068106c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.070+0000 7f606ce6f700 1 --2- 172.21.15.73:0/2352989351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60680fffe0 0x7f6068106c40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f60580098e0 tx=0x7f6058004730 comp rx=0 tx=0).stop 2023-08-10T11:53:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.070+0000 7f606ce6f700 1 -- 172.21.15.73:0/2352989351 shutdown_connections 2023-08-10T11:53:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.070+0000 7f606ce6f700 1 --2- 172.21.15.73:0/2352989351 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f60500a13e0 0x7f60500a38a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.070+0000 7f606ce6f700 1 --2- 172.21.15.73:0/2352989351 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60681056c0 0x7f60681a4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.070+0000 7f606ce6f700 1 --2- 172.21.15.73:0/2352989351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60680ff620 0x7f6068106700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.070+0000 7f606ce6f700 1 --2- 172.21.15.73:0/2352989351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60680fffe0 0x7f6068106c40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.070+0000 7f606ce6f700 1 -- 172.21.15.73:0/2352989351 >> 172.21.15.73:0/2352989351 conn(0x7f6068076770 msgr2=0x7f60680fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:46.077 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.070+0000 7f606ce6f700 1 -- 172.21.15.73:0/2352989351 shutdown_connections 2023-08-10T11:53:46.077 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:46.070+0000 7f606ce6f700 1 -- 172.21.15.73:0/2352989351 wait complete. 2023-08-10T11:53:46.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:46 smithi152 ceph-mon[130220]: pgmap v37: 97 pgs: 97 active+clean; 2.8 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 134 KiB/s wr, 19 op/s 2023-08-10T11:53:47.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:46 smithi156 ceph-mon[130574]: pgmap v37: 97 pgs: 97 active+clean; 2.8 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 134 KiB/s wr, 19 op/s 2023-08-10T11:53:47.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:46 smithi073 ceph-mon[128869]: pgmap v37: 97 pgs: 97 active+clean; 2.8 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 134 KiB/s wr, 19 op/s 2023-08-10T11:53:48.088 INFO:tasks.workunit.client.0.smithi073.stdout:Spawning 3 writers... 2023-08-10T11:53:48.088 INFO:tasks.workunit.client.0.smithi073.stdout:Spawning 1 rewriters... 2023-08-10T11:53:48.089 INFO:tasks.workunit.client.0.smithi073.stdout:Spawning 5 commenters... 2023-08-10T11:53:48.089 INFO:tasks.workunit.client.0.smithi073.stdout:Spawning 100 readers... 2023-08-10T11:53:48.090 INFO:tasks.workunit.client.0.smithi073.stdout:Benchmarking for 30 iterations. 2023-08-10T11:53:48.091 INFO:tasks.workunit.client.0.smithi073.stdout:The test will run during 5 minutes. 2023-08-10T11:53:48.091 INFO:tasks.workunit.client.0.smithi073.stdout: 2023-08-10T11:53:48.091 INFO:tasks.workunit.client.0.smithi073.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2023-08-10T11:53:48.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:48 smithi152 ceph-mon[130220]: pgmap v38: 97 pgs: 97 active+clean; 2.8 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 134 KiB/s wr, 14 op/s 2023-08-10T11:53:49.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:48 smithi156 ceph-mon[130574]: pgmap v38: 97 pgs: 97 active+clean; 2.8 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 134 KiB/s wr, 14 op/s 2023-08-10T11:53:49.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:48 smithi073 ceph-mon[128869]: pgmap v38: 97 pgs: 97 active+clean; 2.8 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 134 KiB/s wr, 14 op/s 2023-08-10T11:53:50.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:50 smithi152 ceph-mon[130220]: pgmap v39: 97 pgs: 97 active+clean; 6.4 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 536 KiB/s wr, 92 op/s 2023-08-10T11:53:51.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:50 smithi156 ceph-mon[130574]: pgmap v39: 97 pgs: 97 active+clean; 6.4 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 536 KiB/s wr, 92 op/s 2023-08-10T11:53:51.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:50 smithi073 ceph-mon[128869]: pgmap v39: 97 pgs: 97 active+clean; 6.4 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 536 KiB/s wr, 92 op/s 2023-08-10T11:53:51.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:51 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:53:52.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:51 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:53:52.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:51 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:53:52.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:52 smithi152 ceph-mon[130220]: pgmap v40: 97 pgs: 97 active+clean; 6.4 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 536 KiB/s wr, 87 op/s 2023-08-10T11:53:53.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:52 smithi156 ceph-mon[130574]: pgmap v40: 97 pgs: 97 active+clean; 6.4 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 536 KiB/s wr, 87 op/s 2023-08-10T11:53:53.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:52 smithi073 ceph-mon[128869]: pgmap v40: 97 pgs: 97 active+clean; 6.4 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 536 KiB/s wr, 87 op/s 2023-08-10T11:53:54.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:54 smithi152 ceph-mon[130220]: pgmap v41: 97 pgs: 97 active+clean; 6.4 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 536 KiB/s wr, 87 op/s 2023-08-10T11:53:55.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:54 smithi156 ceph-mon[130574]: pgmap v41: 97 pgs: 97 active+clean; 6.4 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 536 KiB/s wr, 87 op/s 2023-08-10T11:53:55.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:54 smithi073 ceph-mon[128869]: pgmap v41: 97 pgs: 97 active+clean; 6.4 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 536 KiB/s wr, 87 op/s 2023-08-10T11:53:56.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:56 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:53:56.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:56 smithi152 ceph-mon[130220]: pgmap v42: 97 pgs: 97 active+clean; 18 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 144 op/s 2023-08-10T11:53:57.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:56 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:53:57.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:56 smithi156 ceph-mon[130574]: pgmap v42: 97 pgs: 97 active+clean; 18 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 144 op/s 2023-08-10T11:53:57.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:56 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:53:57.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:56 smithi073 ceph-mon[128869]: pgmap v42: 97 pgs: 97 active+clean; 18 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 144 op/s 2023-08-10T11:53:58.091 INFO:tasks.workunit.client.0.smithi073.stdout: 11 41142 653 27441 658 3889 421 2023-08-10T11:53:58.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:53:58 smithi152 ceph-mon[130220]: pgmap v43: 97 pgs: 97 active+clean; 18 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 134 op/s 2023-08-10T11:53:59.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:53:58 smithi156 ceph-mon[130574]: pgmap v43: 97 pgs: 97 active+clean; 18 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 134 op/s 2023-08-10T11:53:59.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:53:58 smithi073 ceph-mon[128869]: pgmap v43: 97 pgs: 97 active+clean; 18 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 134 op/s 2023-08-10T11:53:59.190 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.189+0000 7fbe861ce700 1 -- 172.21.15.73:0/3123311980 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe800fffe0 msgr2=0x7fbe8010c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:59.190 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.189+0000 7fbe861ce700 1 --2- 172.21.15.73:0/3123311980 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe800fffe0 0x7fbe8010c4f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800b0a0 tx=0x7fbe7800b3b0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.190 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.189+0000 7fbe861ce700 1 -- 172.21.15.73:0/3123311980 shutdown_connections 2023-08-10T11:53:59.190 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.189+0000 7fbe861ce700 1 --2- 172.21.15.73:0/3123311980 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe80105630 0x7fbe80105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.191 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.189+0000 7fbe861ce700 1 --2- 172.21.15.73:0/3123311980 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe800fffe0 0x7fbe8010c4f0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.191 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.189+0000 7fbe861ce700 1 --2- 172.21.15.73:0/3123311980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe800ff620 0x7fbe800ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.191 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.189+0000 7fbe861ce700 1 -- 172.21.15.73:0/3123311980 >> 172.21.15.73:0/3123311980 conn(0x7fbe800fb0b0 msgr2=0x7fbe800fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:59.191 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.189+0000 7fbe861ce700 1 -- 172.21.15.73:0/3123311980 shutdown_connections 2023-08-10T11:53:59.191 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.189+0000 7fbe861ce700 1 -- 172.21.15.73:0/3123311980 wait complete. 2023-08-10T11:53:59.191 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.189+0000 7fbe861ce700 1 Processor -- start 2023-08-10T11:53:59.193 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.190+0000 7fbe861ce700 1 -- start start 2023-08-10T11:53:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.190+0000 7fbe861ce700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe800ff620 0x7fbe801977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.190+0000 7fbe861ce700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe800fffe0 0x7fbe80197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.190+0000 7fbe861ce700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe80105630 0x7fbe801a2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.190+0000 7fbe861ce700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe801a2c30 con 0x7fbe800ff620 2023-08-10T11:53:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.190+0000 7fbe861ce700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe801a2da0 con 0x7fbe800fffe0 2023-08-10T11:53:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.190+0000 7fbe861ce700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe801a2f60 con 0x7fbe80105630 2023-08-10T11:53:59.195 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.190+0000 7fbe7f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe800ff620 0x7fbe801977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:59.195 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.190+0000 7fbe7f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe800ff620 0x7fbe801977c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33900/0 (socket says 172.21.15.73:33900) 2023-08-10T11:53:59.195 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.190+0000 7fbe7f7fe700 1 -- 172.21.15.73:0/3499168585 learned_addr learned my addr 172.21.15.73:0/3499168585 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:59.195 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.190+0000 7fbe7effd700 1 --2- 172.21.15.73:0/3499168585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe800fffe0 0x7fbe80197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.190+0000 7fbe7f7fe700 1 -- 172.21.15.73:0/3499168585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe80105630 msgr2=0x7fbe801a2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.190+0000 7fbe7ffff700 1 --2- 172.21.15.73:0/3499168585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe80105630 0x7fbe801a2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.190+0000 7fbe7f7fe700 1 --2- 172.21.15.73:0/3499168585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe80105630 0x7fbe801a2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.190+0000 7fbe7f7fe700 1 -- 172.21.15.73:0/3499168585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe800fffe0 msgr2=0x7fbe80197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.190+0000 7fbe7f7fe700 1 --2- 172.21.15.73:0/3499168585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe800fffe0 0x7fbe80197d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.190+0000 7fbe7f7fe700 1 -- 172.21.15.73:0/3499168585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe78009d00 con 0x7fbe800ff620 2023-08-10T11:53:59.197 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.191+0000 7fbe7f7fe700 1 --2- 172.21.15.73:0/3499168585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe800ff620 0x7fbe801977c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400e9a0 tx=0x7fbe7400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:59.197 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.191+0000 7fbe7cff9700 1 -- 172.21.15.73:0/3499168585 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe74009790 con 0x7fbe800ff620 2023-08-10T11:53:59.197 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.191+0000 7fbe861ce700 1 -- 172.21.15.73:0/3499168585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe801a3240 con 0x7fbe800ff620 2023-08-10T11:53:59.197 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.191+0000 7fbe861ce700 1 -- 172.21.15.73:0/3499168585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe801a37a0 con 0x7fbe800ff620 2023-08-10T11:53:59.197 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.191+0000 7fbe7cff9700 1 -- 172.21.15.73:0/3499168585 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe7400cbd0 con 0x7fbe800ff620 2023-08-10T11:53:59.197 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.191+0000 7fbe7cff9700 1 -- 172.21.15.73:0/3499168585 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe74018680 con 0x7fbe800ff620 2023-08-10T11:53:59.197 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.193+0000 7fbe7cff9700 1 -- 172.21.15.73:0/3499168585 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7fbe74010430 con 0x7fbe800ff620 2023-08-10T11:53:59.198 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.193+0000 7fbe7cff9700 1 --2- 172.21.15.73:0/3499168585 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fbe680a13e0 0x7fbe680a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:59.204 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.193+0000 7fbe7cff9700 1 -- 172.21.15.73:0/3499168585 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fbe74014070 con 0x7fbe800ff620 2023-08-10T11:53:59.205 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.193+0000 7fbe7effd700 1 --2- 172.21.15.73:0/3499168585 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fbe680a13e0 0x7fbe680a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:59.205 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.194+0000 7fbe7effd700 1 --2- 172.21.15.73:0/3499168585 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fbe680a13e0 0x7fbe680a38a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbe80069140 tx=0x7fbe7000a300 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:59.205 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.194+0000 7fbe92367b80 1 Processor -- start 2023-08-10T11:53:59.206 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.194+0000 7fbe92367b80 1 -- start start 2023-08-10T11:53:59.206 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.195+0000 7fbe92367b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3f282ba40 0x55a3f282be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:59.206 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.195+0000 7fbe92367b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f282c360 0x55a3f2826010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:59.207 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.195+0000 7fbe92367b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3f2826550 0x55a3f28269d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:59.207 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.195+0000 7fbe92367b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f27a1d60 con 0x55a3f282c360 2023-08-10T11:53:59.207 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.195+0000 7fbe92367b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f277e530 con 0x55a3f282ba40 2023-08-10T11:53:59.207 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.195+0000 7fbe92367b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f277be50 con 0x55a3f2826550 2023-08-10T11:53:59.207 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.195+0000 7fbe7effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f282c360 0x55a3f2826010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:59.207 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.195+0000 7fbe7f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3f282ba40 0x55a3f282be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:59.208 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.195+0000 7fbe7ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3f2826550 0x55a3f28269d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:59.208 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.195+0000 7fbe7f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3f282ba40 0x55a3f282be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:48558/0 (socket says 172.21.15.73:48558) 2023-08-10T11:53:59.208 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.195+0000 7fbe7effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f282c360 0x55a3f2826010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33910/0 (socket says 172.21.15.73:33910) 2023-08-10T11:53:59.208 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.195+0000 7fbe7f7fe700 1 -- 172.21.15.73:0/1131374950 learned_addr learned my addr 172.21.15.73:0/1131374950 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:59.208 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.195+0000 7fbe7f7fe700 1 -- 172.21.15.73:0/1131374950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3f2826550 msgr2=0x55a3f28269d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:59.208 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.195+0000 7fbe7f7fe700 1 --2- 172.21.15.73:0/1131374950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3f2826550 0x55a3f28269d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.208 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.195+0000 7fbe7f7fe700 1 -- 172.21.15.73:0/1131374950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f282c360 msgr2=0x55a3f2826010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:59.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.195+0000 7fbe7f7fe700 1 --2- 172.21.15.73:0/1131374950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f282c360 0x55a3f2826010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.195+0000 7fbe7f7fe700 1 -- 172.21.15.73:0/1131374950 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3f25f85d0 con 0x55a3f282ba40 2023-08-10T11:53:59.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.195+0000 7fbe7effd700 1 --2- 172.21.15.73:0/1131374950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f282c360 0x55a3f2826010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:53:59.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.195+0000 7fbe7f7fe700 1 --2- 172.21.15.73:0/1131374950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3f282ba40 0x55a3f282be20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbe74099fe0 tx=0x7fbe74099a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f98d02df4b57203 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:59.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.195+0000 7fbe65ffb700 1 -- 172.21.15.73:0/1131374950 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe740a24a0 con 0x55a3f282ba40 2023-08-10T11:53:59.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.195+0000 7fbe65ffb700 1 -- 172.21.15.73:0/1131374950 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe740983f0 con 0x55a3f282ba40 2023-08-10T11:53:59.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.195+0000 7fbe65ffb700 1 -- 172.21.15.73:0/1131374950 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe740106e0 con 0x55a3f282ba40 2023-08-10T11:53:59.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.196+0000 7fbe92367b80 1 -- 172.21.15.73:0/1131374950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3f282ba40 msgr2=0x55a3f282be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:59.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.196+0000 7fbe92367b80 1 --2- 172.21.15.73:0/1131374950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3f282ba40 0x55a3f282be20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbe74099fe0 tx=0x7fbe74099a80 comp rx=0 tx=0).stop 2023-08-10T11:53:59.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.196+0000 7fbe92367b80 1 -- 172.21.15.73:0/1131374950 shutdown_connections 2023-08-10T11:53:59.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.196+0000 7fbe92367b80 1 --2- 172.21.15.73:0/1131374950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3f282ba40 0x55a3f282be20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.196+0000 7fbe92367b80 1 --2- 172.21.15.73:0/1131374950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3f2826550 0x55a3f28269d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.196+0000 7fbe92367b80 1 --2- 172.21.15.73:0/1131374950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f282c360 0x55a3f2826010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.196+0000 7fbe92367b80 1 -- 172.21.15.73:0/1131374950 >> 172.21.15.73:0/1131374950 conn(0x55a3f2783c70 msgr2=0x55a3f2820d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:59.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.196+0000 7fbe92367b80 1 -- 172.21.15.73:0/1131374950 shutdown_connections 2023-08-10T11:53:59.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.196+0000 7fbe92367b80 1 -- 172.21.15.73:0/1131374950 wait complete. 2023-08-10T11:53:59.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.197+0000 7fbe92367b80 1 -- start start 2023-08-10T11:53:59.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.197+0000 7fbe92367b80 1 Processor -- start 2023-08-10T11:53:59.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.197+0000 7fbe92367b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3f2826550 0x55a3f2832340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.197+0000 7fbe92367b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f282ba40 0x55a3f282f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.197+0000 7fbe92367b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3f282c360 0x55a3f282fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.197+0000 7fbe92367b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f2777740 con 0x55a3f282ba40 2023-08-10T11:53:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.197+0000 7fbe92367b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f2716a60 con 0x55a3f282c360 2023-08-10T11:53:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.197+0000 7fbe92367b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f2716760 con 0x55a3f2826550 2023-08-10T11:53:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.197+0000 7fbe92367b80 10 client.0 _ll_register_callbacks cb 0x55a3f2714620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.197+0000 7fbe7effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f282ba40 0x55a3f282f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.197+0000 7fbe7effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f282ba40 0x55a3f282f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33916/0 (socket says 172.21.15.73:33916) 2023-08-10T11:53:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.197+0000 7fbe7effd700 1 -- 172.21.15.73:0/2280813155 learned_addr learned my addr 172.21.15.73:0/2280813155 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.197+0000 7fbe7ffff700 1 --2- 172.21.15.73:0/2280813155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3f282c360 0x55a3f282fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.198+0000 7fbe7f7fe700 1 --2- 172.21.15.73:0/2280813155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3f2826550 0x55a3f2832340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.198+0000 7fbe7effd700 1 -- 172.21.15.73:0/2280813155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3f2826550 msgr2=0x55a3f2832340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.198+0000 7fbe7effd700 1 --2- 172.21.15.73:0/2280813155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3f2826550 0x55a3f2832340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.198+0000 7fbe7effd700 1 -- 172.21.15.73:0/2280813155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3f282c360 msgr2=0x55a3f282fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.198+0000 7fbe7effd700 1 --2- 172.21.15.73:0/2280813155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3f282c360 0x55a3f282fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.198+0000 7fbe7effd700 1 -- 172.21.15.73:0/2280813155 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe7000f9b0 con 0x55a3f282ba40 2023-08-10T11:53:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.198+0000 7fbe7effd700 1 --2- 172.21.15.73:0/2280813155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f282ba40 0x55a3f282f630 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fbe7001de30 tx=0x7fbe700047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a189837e106467 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.198+0000 7fbe5effd700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.198+0000 7fbe5effd700 1 -- 172.21.15.73:0/2280813155 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe70010ac0 con 0x55a3f282ba40 2023-08-10T11:53:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.198+0000 7fbe5effd700 1 -- 172.21.15.73:0/2280813155 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fbe70010c20 con 0x55a3f282ba40 2023-08-10T11:53:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.198+0000 7fbe92367b80 1 -- 172.21.15.73:0/2280813155 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a3f28191c0 con 0x55a3f282ba40 2023-08-10T11:53:59.215 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.198+0000 7fbe5effd700 1 -- 172.21.15.73:0/2280813155 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe70010de0 con 0x55a3f282ba40 2023-08-10T11:53:59.215 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.198+0000 7fbe92367b80 10 client.15960 fetch_fsmap learned FSMap version 29 2023-08-10T11:53:59.215 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.198+0000 7fbe92367b80 1 -- 172.21.15.73:0/2280813155 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7fbe801a37a0 con 0x55a3f282ba40 2023-08-10T11:53:59.215 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.198+0000 7fbe5effd700 1 -- 172.21.15.73:0/2280813155 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a3f28191c0 con 0x55a3f282ba40 2023-08-10T11:53:59.215 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.199+0000 7fbe5effd700 1 -- 172.21.15.73:0/2280813155 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 29) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fbe700055c0 con 0x55a3f282ba40 2023-08-10T11:53:59.215 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.199+0000 7fbe92367b80 10 client.15960 fetch_fsmap finished waiting for FSMap version 29 2023-08-10T11:53:59.215 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.199+0000 7fbe92367b80 10 client.15960 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:53:59.216 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.199+0000 7fbe92367b80 20 client.15960 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:59.216 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.199+0000 7fbe92367b80 1 --2- 172.21.15.73:0/2280813155 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55a3f283fdf0 0x55a3f2842210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:59.216 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.199+0000 7fbe92367b80 4 client.15960 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:53:59.216 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.199+0000 7fbe92367b80 1 -- 172.21.15.73:0/2280813155 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a3f27f5970 con 0x55a3f283fdf0 2023-08-10T11:53:59.216 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.199+0000 7fbe7f7fe700 1 --2- 172.21.15.73:0/2280813155 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55a3f283fdf0 0x55a3f2842210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:59.217 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.199+0000 7fbe5effd700 10 client.15960 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:59.217 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.199+0000 7fbe7f7fe700 1 --2- 172.21.15.73:0/2280813155 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55a3f283fdf0 0x55a3f2842210 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b674e6ac8fed049 server_cookie=fb381d21d524a5a7 in_seq=0 out_seq=0 2023-08-10T11:53:59.217 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.200+0000 7fbe5effd700 1 -- 172.21.15.73:0/2280813155 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55a3f27f5970 con 0x55a3f283fdf0 2023-08-10T11:53:59.217 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.200+0000 7fbe5effd700 10 client.15960 handle_command_reply: tid=0 2023-08-10T11:53:59.217 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.200+0000 7fbe92367b80 1 client.15960 shutdown 2023-08-10T11:53:59.218 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.200+0000 7fbe92367b80 1 -- 172.21.15.73:0/2280813155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f282ba40 msgr2=0x55a3f282f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:59.218 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.200+0000 7fbe92367b80 1 --2- 172.21.15.73:0/2280813155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f282ba40 0x55a3f282f630 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fbe7001de30 tx=0x7fbe700047c0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.218 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.200+0000 7fbe92367b80 1 -- 172.21.15.73:0/2280813155 shutdown_connections 2023-08-10T11:53:59.218 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.200+0000 7fbe92367b80 1 --2- 172.21.15.73:0/2280813155 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55a3f283fdf0 0x55a3f2842210 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.218 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.200+0000 7fbe92367b80 1 --2- 172.21.15.73:0/2280813155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3f282c360 0x55a3f282fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.218 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.200+0000 7fbe5effd700 0 client.15960 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:59.218 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.200+0000 7fbe92367b80 1 --2- 172.21.15.73:0/2280813155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3f2826550 0x55a3f2832340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.200+0000 7fbe92367b80 1 --2- 172.21.15.73:0/2280813155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f282ba40 0x55a3f282f630 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.200+0000 7fbe92367b80 1 -- 172.21.15.73:0/2280813155 >> 172.21.15.73:0/2280813155 conn(0x55a3f2783c70 msgr2=0x55a3f28204b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:59.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.200+0000 7fbe92367b80 1 -- 172.21.15.73:0/2280813155 shutdown_connections 2023-08-10T11:53:59.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.200+0000 7fbe92367b80 1 -- 172.21.15.73:0/2280813155 wait complete. 2023-08-10T11:53:59.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.200+0000 7fbe92367b80 20 client.15960 trim_cache size 0 max 16384 2023-08-10T11:53:59.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.215+0000 7fbe92367b80 1 Processor -- start 2023-08-10T11:53:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.215+0000 7fbe92367b80 1 -- start start 2023-08-10T11:53:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.216+0000 7fbe92367b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f2826550 0x55a3f2826010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.216+0000 7fbe92367b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3f282ba40 0x55a3f2826930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.216+0000 7fbe92367b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3f282c360 0x55a3f282aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:59.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.216+0000 7fbe92367b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f25fa8c0 con 0x55a3f2826550 2023-08-10T11:53:59.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.216+0000 7fbe92367b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f281b730 con 0x55a3f282c360 2023-08-10T11:53:59.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.216+0000 7fbe92367b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f2821820 con 0x55a3f282ba40 2023-08-10T11:53:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.216+0000 7fbe7f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f2826550 0x55a3f2826010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.216+0000 7fbe7f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f2826550 0x55a3f2826010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33924/0 (socket says 172.21.15.73:33924) 2023-08-10T11:53:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.216+0000 7fbe7f7fe700 1 -- 172.21.15.73:0/632202089 learned_addr learned my addr 172.21.15.73:0/632202089 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.216+0000 7fbe7ffff700 1 --2- 172.21.15.73:0/632202089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3f282c360 0x55a3f282aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.216+0000 7fbe7effd700 1 --2- 172.21.15.73:0/632202089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3f282ba40 0x55a3f2826930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.216+0000 7fbe7f7fe700 1 -- 172.21.15.73:0/632202089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3f282ba40 msgr2=0x55a3f2826930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.216+0000 7fbe7f7fe700 1 --2- 172.21.15.73:0/632202089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3f282ba40 0x55a3f2826930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.216+0000 7fbe7f7fe700 1 -- 172.21.15.73:0/632202089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3f282c360 msgr2=0x55a3f282aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.216+0000 7fbe7f7fe700 1 --2- 172.21.15.73:0/632202089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3f282c360 0x55a3f282aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.216+0000 7fbe7f7fe700 1 -- 172.21.15.73:0/632202089 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3f25a4d80 con 0x55a3f2826550 2023-08-10T11:53:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.216+0000 7fbe7effd700 1 --2- 172.21.15.73:0/632202089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3f282ba40 0x55a3f2826930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:53:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.216+0000 7fbe7f7fe700 1 --2- 172.21.15.73:0/632202089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f2826550 0x55a3f2826010 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbe740ca860 tx=0x7fbe74095d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80f955aadf28de4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.216+0000 7fbe667fc700 1 -- 172.21.15.73:0/632202089 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe740a24a0 con 0x55a3f2826550 2023-08-10T11:53:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.216+0000 7fbe667fc700 1 -- 172.21.15.73:0/632202089 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe74099690 con 0x55a3f2826550 2023-08-10T11:53:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.216+0000 7fbe667fc700 1 -- 172.21.15.73:0/632202089 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe740a2270 con 0x55a3f2826550 2023-08-10T11:53:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.217+0000 7fbe92367b80 1 -- 172.21.15.73:0/632202089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f2826550 msgr2=0x55a3f2826010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.217+0000 7fbe92367b80 1 --2- 172.21.15.73:0/632202089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f2826550 0x55a3f2826010 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbe740ca860 tx=0x7fbe74095d60 comp rx=0 tx=0).stop 2023-08-10T11:53:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.217+0000 7fbe92367b80 1 -- 172.21.15.73:0/632202089 shutdown_connections 2023-08-10T11:53:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.217+0000 7fbe92367b80 1 --2- 172.21.15.73:0/632202089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3f282c360 0x55a3f282aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.217+0000 7fbe92367b80 1 --2- 172.21.15.73:0/632202089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f2826550 0x55a3f2826010 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.217+0000 7fbe92367b80 1 --2- 172.21.15.73:0/632202089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3f282ba40 0x55a3f2826930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.217+0000 7fbe92367b80 1 -- 172.21.15.73:0/632202089 >> 172.21.15.73:0/632202089 conn(0x55a3f2783c70 msgr2=0x55a3f282a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.217+0000 7fbe92367b80 1 -- 172.21.15.73:0/632202089 shutdown_connections 2023-08-10T11:53:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.217+0000 7fbe92367b80 1 -- 172.21.15.73:0/632202089 wait complete. 2023-08-10T11:53:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.217+0000 7fbe92367b80 1 -- start start 2023-08-10T11:53:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.218+0000 7fbe92367b80 1 Processor -- start 2023-08-10T11:53:59.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.218+0000 7fbe92367b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f2826550 0x55a3f2836a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:59.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.218+0000 7fbe92367b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3f282ba40 0x55a3f2834dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:59.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.218+0000 7fbe92367b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3f282c360 0x55a3f2835310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:59.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.218+0000 7fbe92367b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f2835850 con 0x55a3f2826550 2023-08-10T11:53:59.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.218+0000 7fbe92367b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f28359c0 con 0x55a3f282ba40 2023-08-10T11:53:59.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.218+0000 7fbe92367b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f2835b80 con 0x55a3f282c360 2023-08-10T11:53:59.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.218+0000 7fbe92367b80 10 client.0 _ll_register_callbacks cb 0x55a3f2714620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:53:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.218+0000 7fbe7f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f2826550 0x55a3f2836a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.218+0000 7fbe7f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f2826550 0x55a3f2836a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33928/0 (socket says 172.21.15.73:33928) 2023-08-10T11:53:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.218+0000 7fbe7effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3f282ba40 0x55a3f2834dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.218+0000 7fbe7f7fe700 1 -- 172.21.15.73:0/849571925 learned_addr learned my addr 172.21.15.73:0/849571925 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:53:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.218+0000 7fbe7ffff700 1 --2- 172.21.15.73:0/849571925 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3f282c360 0x55a3f2835310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.218+0000 7fbe7f7fe700 1 -- 172.21.15.73:0/849571925 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3f282c360 msgr2=0x55a3f2835310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.218+0000 7fbe7f7fe700 1 --2- 172.21.15.73:0/849571925 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3f282c360 0x55a3f2835310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.218+0000 7fbe7f7fe700 1 -- 172.21.15.73:0/849571925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3f282ba40 msgr2=0x55a3f2834dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:53:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.218+0000 7fbe7f7fe700 1 --2- 172.21.15.73:0/849571925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3f282ba40 0x55a3f2834dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.218+0000 7fbe7f7fe700 1 -- 172.21.15.73:0/849571925 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a3f25f85d0 con 0x55a3f2826550 2023-08-10T11:53:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.218+0000 7fbe7f7fe700 1 --2- 172.21.15.73:0/849571925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f2826550 0x55a3f2836a90 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fbe740caf20 tx=0x7fbe74098560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f491c7ff4cda94 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:53:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.218+0000 7fbe5effd700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:53:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.218+0000 7fbe5effd700 1 -- 172.21.15.73:0/849571925 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe740b8420 con 0x55a3f2826550 2023-08-10T11:53:59.239 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.219+0000 7fbe5effd700 1 -- 172.21.15.73:0/849571925 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fbe740a24a0 con 0x55a3f2826550 2023-08-10T11:53:59.239 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.219+0000 7fbe92367b80 1 -- 172.21.15.73:0/849571925 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbe740983f0 con 0x55a3f2826550 2023-08-10T11:53:59.239 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.219+0000 7fbe5effd700 1 -- 172.21.15.73:0/849571925 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe74099800 con 0x55a3f2826550 2023-08-10T11:53:59.239 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.219+0000 7fbe92367b80 10 client.15966 fetch_fsmap learned FSMap version 29 2023-08-10T11:53:59.239 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.219+0000 7fbe92367b80 1 -- 172.21.15.73:0/849571925 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55a3f258dc00 con 0x55a3f2826550 2023-08-10T11:53:59.239 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.219+0000 7fbe5effd700 1 -- 172.21.15.73:0/849571925 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe740983f0 con 0x55a3f2826550 2023-08-10T11:53:59.239 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.219+0000 7fbe5effd700 1 -- 172.21.15.73:0/849571925 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 29) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fbe740caa80 con 0x55a3f2826550 2023-08-10T11:53:59.240 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.219+0000 7fbe92367b80 10 client.15966 fetch_fsmap finished waiting for FSMap version 29 2023-08-10T11:53:59.240 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.219+0000 7fbe92367b80 10 client.15966 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:53:59.240 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.219+0000 7fbe92367b80 20 client.15966 populate_metadata read hostname 'smithi073' 2023-08-10T11:53:59.240 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.219+0000 7fbe92367b80 1 --2- 172.21.15.73:0/849571925 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55a3f2894940 0x55a3f2896d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:53:59.240 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.219+0000 7fbe92367b80 4 client.15966 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:53:59.240 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.219+0000 7fbe92367b80 1 -- 172.21.15.73:0/849571925 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a3f2770720 con 0x55a3f2894940 2023-08-10T11:53:59.240 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.219+0000 7fbe7effd700 1 --2- 172.21.15.73:0/849571925 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55a3f2894940 0x55a3f2896d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:53:59.241 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.220+0000 7fbe5effd700 10 client.15966 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:59.241 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.220+0000 7fbe7effd700 1 --2- 172.21.15.73:0/849571925 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55a3f2894940 0x55a3f2896d30 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3927123d83dec63 server_cookie=cb3653cb0a987a9d in_seq=0 out_seq=0 2023-08-10T11:53:59.255 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.254+0000 7fbe5effd700 1 -- 172.21.15.73:0/849571925 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a3f2770720 con 0x55a3f2894940 2023-08-10T11:53:59.255 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.254+0000 7fbe5effd700 10 client.15966 handle_command_reply: tid=0 2023-08-10T11:53:59.255 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.254+0000 7fbe92367b80 1 client.15966 shutdown 2023-08-10T11:53:59.256 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.254+0000 7fbe92367b80 1 -- 172.21.15.73:0/849571925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f2826550 msgr2=0x55a3f2836a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:59.256 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.254+0000 7fbe92367b80 1 --2- 172.21.15.73:0/849571925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f2826550 0x55a3f2836a90 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fbe740caf20 tx=0x7fbe74098560 comp rx=0 tx=0).stop 2023-08-10T11:53:59.256 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.254+0000 7fbe92367b80 1 -- 172.21.15.73:0/849571925 shutdown_connections 2023-08-10T11:53:59.256 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.254+0000 7fbe92367b80 1 --2- 172.21.15.73:0/849571925 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55a3f2894940 0x55a3f2896d30 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.256 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.254+0000 7fbe92367b80 1 --2- 172.21.15.73:0/849571925 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3f282c360 0x55a3f2835310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.256 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.254+0000 7fbe92367b80 1 --2- 172.21.15.73:0/849571925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a3f2826550 0x55a3f2836a90 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.254+0000 7fbe5effd700 0 client.15966 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:53:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.254+0000 7fbe92367b80 1 --2- 172.21.15.73:0/849571925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3f282ba40 0x55a3f2834dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.254+0000 7fbe92367b80 1 -- 172.21.15.73:0/849571925 >> 172.21.15.73:0/849571925 conn(0x55a3f2783c70 msgr2=0x55a3f282b050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.254+0000 7fbe92367b80 1 -- 172.21.15.73:0/849571925 shutdown_connections 2023-08-10T11:53:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.254+0000 7fbe92367b80 1 -- 172.21.15.73:0/849571925 wait complete. 2023-08-10T11:53:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.254+0000 7fbe92367b80 20 client.15966 trim_cache size 0 max 16384 2023-08-10T11:53:59.258 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:53:59.258 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:53:59.258 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:53:59.258 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:53:59.259 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.255+0000 7fbe861ce700 1 -- 172.21.15.73:0/3499168585 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fbe680a13e0 msgr2=0x7fbe680a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:59.259 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.255+0000 7fbe861ce700 1 --2- 172.21.15.73:0/3499168585 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fbe680a13e0 0x7fbe680a38a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbe80069140 tx=0x7fbe7000a300 comp rx=0 tx=0).stop 2023-08-10T11:53:59.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.255+0000 7fbe861ce700 1 -- 172.21.15.73:0/3499168585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe800ff620 msgr2=0x7fbe801977c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:53:59.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.255+0000 7fbe861ce700 1 --2- 172.21.15.73:0/3499168585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe800ff620 0x7fbe801977c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400e9a0 tx=0x7fbe7400ecb0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.255+0000 7fbe861ce700 1 -- 172.21.15.73:0/3499168585 shutdown_connections 2023-08-10T11:53:59.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.255+0000 7fbe861ce700 1 --2- 172.21.15.73:0/3499168585 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fbe680a13e0 0x7fbe680a38a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.255+0000 7fbe861ce700 1 --2- 172.21.15.73:0/3499168585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe80105630 0x7fbe801a2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.255+0000 7fbe861ce700 1 --2- 172.21.15.73:0/3499168585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe800ff620 0x7fbe801977c0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.255+0000 7fbe861ce700 1 --2- 172.21.15.73:0/3499168585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe800fffe0 0x7fbe80197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:53:59.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.255+0000 7fbe861ce700 1 -- 172.21.15.73:0/3499168585 >> 172.21.15.73:0/3499168585 conn(0x7fbe800fb0b0 msgr2=0x7fbe80103130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:53:59.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.255+0000 7fbe861ce700 1 -- 172.21.15.73:0/3499168585 shutdown_connections 2023-08-10T11:53:59.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:53:59.255+0000 7fbe861ce700 1 -- 172.21.15.73:0/3499168585 wait complete. 2023-08-10T11:54:00.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:00 smithi152 ceph-mon[130220]: pgmap v44: 97 pgs: 97 active+clean; 50 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.2 MiB/s wr, 303 op/s 2023-08-10T11:54:01.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:00 smithi156 ceph-mon[130574]: pgmap v44: 97 pgs: 97 active+clean; 50 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.2 MiB/s wr, 303 op/s 2023-08-10T11:54:01.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:00 smithi073 ceph-mon[128869]: pgmap v44: 97 pgs: 97 active+clean; 50 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.2 MiB/s wr, 303 op/s 2023-08-10T11:54:02.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:02 smithi152 ceph-mon[130220]: pgmap v45: 97 pgs: 97 active+clean; 50 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.8 MiB/s wr, 226 op/s 2023-08-10T11:54:02.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:02 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:54:03.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:02 smithi156 ceph-mon[130574]: pgmap v45: 97 pgs: 97 active+clean; 50 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.8 MiB/s wr, 226 op/s 2023-08-10T11:54:03.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:02 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:54:03.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:02 smithi073 ceph-mon[128869]: pgmap v45: 97 pgs: 97 active+clean; 50 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.8 MiB/s wr, 226 op/s 2023-08-10T11:54:03.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:02 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:54:04.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:04 smithi152 ceph-mon[130220]: pgmap v46: 97 pgs: 97 active+clean; 50 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.8 MiB/s wr, 226 op/s 2023-08-10T11:54:05.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:04 smithi156 ceph-mon[130574]: pgmap v46: 97 pgs: 97 active+clean; 50 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.8 MiB/s wr, 226 op/s 2023-08-10T11:54:05.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:04 smithi073 ceph-mon[128869]: pgmap v46: 97 pgs: 97 active+clean; 50 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.8 MiB/s wr, 226 op/s 2023-08-10T11:54:06.664 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:54:06.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.793+0000 7fb6b2dd0700 1 -- 172.21.15.73:0/2969254875 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6ac105690 msgr2=0x7fb6ac105a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:06.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.793+0000 7fb6b2dd0700 1 --2- 172.21.15.73:0/2969254875 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6ac105690 0x7fb6ac105a70 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fb6a00099c0 tx=0x7fb6a0009cd0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.793+0000 7fb6b2dd0700 1 -- 172.21.15.73:0/2969254875 shutdown_connections 2023-08-10T11:54:06.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.793+0000 7fb6b2dd0700 1 --2- 172.21.15.73:0/2969254875 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6ac0fff90 0x7fb6ac10c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.793+0000 7fb6b2dd0700 1 --2- 172.21.15.73:0/2969254875 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6ac105690 0x7fb6ac105a70 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.793+0000 7fb6b2dd0700 1 --2- 172.21.15.73:0/2969254875 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6ac0ff5d0 0x7fb6ac0ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.793+0000 7fb6b2dd0700 1 -- 172.21.15.73:0/2969254875 >> 172.21.15.73:0/2969254875 conn(0x7fb6ac0fb0c0 msgr2=0x7fb6ac0fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:06.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.793+0000 7fb6b2dd0700 1 -- 172.21.15.73:0/2969254875 shutdown_connections 2023-08-10T11:54:06.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.793+0000 7fb6b2dd0700 1 -- 172.21.15.73:0/2969254875 wait complete. 2023-08-10T11:54:06.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.794+0000 7fb6b2dd0700 1 Processor -- start 2023-08-10T11:54:06.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.794+0000 7fb6b2dd0700 1 -- start start 2023-08-10T11:54:06.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.794+0000 7fb6b2dd0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6ac0ff5d0 0x7fb6ac1975b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:06.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.794+0000 7fb6b2dd0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6ac0fff90 0x7fb6ac197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:06.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.794+0000 7fb6b2dd0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6ac105690 0x7fb6ac1a2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:06.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.794+0000 7fb6b2dd0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac1a2b70 con 0x7fb6ac105690 2023-08-10T11:54:06.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.794+0000 7fb6b2dd0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac1a2cb0 con 0x7fb6ac0fff90 2023-08-10T11:54:06.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.794+0000 7fb6b2dd0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac1a2df0 con 0x7fb6ac0ff5d0 2023-08-10T11:54:06.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.794+0000 7fb6b136d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6ac105690 0x7fb6ac1a2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:06.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.794+0000 7fb6b136d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6ac105690 0x7fb6ac1a2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33946/0 (socket says 172.21.15.73:33946) 2023-08-10T11:54:06.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.794+0000 7fb6b136d700 1 -- 172.21.15.73:0/363930360 learned_addr learned my addr 172.21.15.73:0/363930360 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:06.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.794+0000 7fb6abfff700 1 --2- 172.21.15.73:0/363930360 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6ac0fff90 0x7fb6ac197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:06.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.795+0000 7fb6b0b6c700 1 --2- 172.21.15.73:0/363930360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6ac0ff5d0 0x7fb6ac1975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:06.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.795+0000 7fb6b136d700 1 -- 172.21.15.73:0/363930360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6ac0ff5d0 msgr2=0x7fb6ac1975b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:06.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.795+0000 7fb6b136d700 1 --2- 172.21.15.73:0/363930360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6ac0ff5d0 0x7fb6ac1975b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.795+0000 7fb6b136d700 1 -- 172.21.15.73:0/363930360 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6ac0fff90 msgr2=0x7fb6ac197af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:06.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.795+0000 7fb6b136d700 1 --2- 172.21.15.73:0/363930360 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6ac0fff90 0x7fb6ac197af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.795+0000 7fb6b136d700 1 -- 172.21.15.73:0/363930360 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a00095f0 con 0x7fb6ac105690 2023-08-10T11:54:06.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.795+0000 7fb6b0b6c700 1 --2- 172.21.15.73:0/363930360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6ac0ff5d0 0x7fb6ac1975b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:54:06.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.795+0000 7fb6b136d700 1 --2- 172.21.15.73:0/363930360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6ac105690 0x7fb6ac1a2630 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400ada0 tx=0x7fb6a400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:06.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.795+0000 7fb6a9ffb700 1 -- 172.21.15.73:0/363930360 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a400f070 con 0x7fb6ac105690 2023-08-10T11:54:06.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.795+0000 7fb6a9ffb700 1 -- 172.21.15.73:0/363930360 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb6a4007b30 con 0x7fb6ac105690 2023-08-10T11:54:06.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.795+0000 7fb6b2dd0700 1 -- 172.21.15.73:0/363930360 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ac1a2ff0 con 0x7fb6ac105690 2023-08-10T11:54:06.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.795+0000 7fb6a9ffb700 1 -- 172.21.15.73:0/363930360 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a40053e0 con 0x7fb6ac105690 2023-08-10T11:54:06.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.795+0000 7fb6b2dd0700 1 -- 172.21.15.73:0/363930360 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ac1a3480 con 0x7fb6ac105690 2023-08-10T11:54:06.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.798+0000 7fb6a9ffb700 1 -- 172.21.15.73:0/363930360 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7fb6a400c980 con 0x7fb6ac105690 2023-08-10T11:54:06.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.798+0000 7fb6a9ffb700 1 --2- 172.21.15.73:0/363930360 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb69c0a13e0 0x7fb69c0a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:06.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.799+0000 7fb6a9ffb700 1 -- 172.21.15.73:0/363930360 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb6a40cc500 con 0x7fb6ac105690 2023-08-10T11:54:06.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.799+0000 7fb6b0b6c700 1 --2- 172.21.15.73:0/363930360 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb69c0a13e0 0x7fb69c0a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:06.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.799+0000 7fb6b0b6c700 1 --2- 172.21.15.73:0/363930360 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb69c0a13e0 0x7fb69c0a38a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0006010 tx=0x7fb6a0009f10 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:06.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.799+0000 7fb6bef69b80 1 Processor -- start 2023-08-10T11:54:06.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.799+0000 7fb6bef69b80 1 -- start start 2023-08-10T11:54:06.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.800+0000 7fb6bef69b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e177455f50 0x55e177456330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:06.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.800+0000 7fb6bef69b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e177456870 0x55e1774502c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:06.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.800+0000 7fb6bef69b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177450800 0x55e177450c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:06.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.800+0000 7fb6bef69b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1773cbdc0 con 0x55e177450800 2023-08-10T11:54:06.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.800+0000 7fb6bef69b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1773a8590 con 0x55e177456870 2023-08-10T11:54:06.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.800+0000 7fb6bef69b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1773a5eb0 con 0x55e177455f50 2023-08-10T11:54:06.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.800+0000 7fb6b136d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177450800 0x55e177450c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:06.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.800+0000 7fb6abfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e177456870 0x55e1774502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:06.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.800+0000 7fb6b136d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177450800 0x55e177450c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33954/0 (socket says 172.21.15.73:33954) 2023-08-10T11:54:06.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.800+0000 7fb6b136d700 1 -- 172.21.15.73:0/3902228435 learned_addr learned my addr 172.21.15.73:0/3902228435 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:06.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.800+0000 7fb6b0b6c700 1 --2- 172.21.15.73:0/3902228435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e177455f50 0x55e177456330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:06.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.800+0000 7fb6b136d700 1 -- 172.21.15.73:0/3902228435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e177455f50 msgr2=0x55e177456330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:06.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.800+0000 7fb6b136d700 1 --2- 172.21.15.73:0/3902228435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e177455f50 0x55e177456330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.800+0000 7fb6b136d700 1 -- 172.21.15.73:0/3902228435 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e177456870 msgr2=0x55e1774502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:06.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.800+0000 7fb6b136d700 1 --2- 172.21.15.73:0/3902228435 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e177456870 0x55e1774502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.800+0000 7fb6b136d700 1 -- 172.21.15.73:0/3902228435 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e177222630 con 0x55e177450800 2023-08-10T11:54:06.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.800+0000 7fb6b136d700 1 --2- 172.21.15.73:0/3902228435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177450800 0x55e177450c80 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4095940 tx=0x7fb6a4099070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b8de9b1f5c0197 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:06.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.800+0000 7fb696ffd700 1 -- 172.21.15.73:0/3902228435 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a40192b0 con 0x55e177450800 2023-08-10T11:54:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.800+0000 7fb696ffd700 1 -- 172.21.15.73:0/3902228435 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb6a4099440 con 0x55e177450800 2023-08-10T11:54:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.800+0000 7fb696ffd700 1 -- 172.21.15.73:0/3902228435 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a400cc30 con 0x55e177450800 2023-08-10T11:54:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.801+0000 7fb6bef69b80 1 -- 172.21.15.73:0/3902228435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177450800 msgr2=0x55e177450c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.801+0000 7fb6bef69b80 1 --2- 172.21.15.73:0/3902228435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177450800 0x55e177450c80 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4095940 tx=0x7fb6a4099070 comp rx=0 tx=0).stop 2023-08-10T11:54:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.801+0000 7fb6bef69b80 1 -- 172.21.15.73:0/3902228435 shutdown_connections 2023-08-10T11:54:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.801+0000 7fb6bef69b80 1 --2- 172.21.15.73:0/3902228435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177450800 0x55e177450c80 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.801+0000 7fb6bef69b80 1 --2- 172.21.15.73:0/3902228435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e177455f50 0x55e177456330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.801+0000 7fb6bef69b80 1 --2- 172.21.15.73:0/3902228435 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e177456870 0x55e1774502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.801+0000 7fb6bef69b80 1 -- 172.21.15.73:0/3902228435 >> 172.21.15.73:0/3902228435 conn(0x55e1773adcd0 msgr2=0x55e17744b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:06.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.801+0000 7fb6bef69b80 1 -- 172.21.15.73:0/3902228435 shutdown_connections 2023-08-10T11:54:06.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.801+0000 7fb6bef69b80 1 -- 172.21.15.73:0/3902228435 wait complete. 2023-08-10T11:54:06.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.802+0000 7fb6bef69b80 1 -- start start 2023-08-10T11:54:06.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.802+0000 7fb6bef69b80 1 Processor -- start 2023-08-10T11:54:06.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.802+0000 7fb6bef69b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e177450800 0x55e17745c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:06.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.802+0000 7fb6bef69b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e177455f50 0x55e177459b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.802+0000 7fb6bef69b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177456870 0x55e17745a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.802+0000 7fb6bef69b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1773a17a0 con 0x55e177456870 2023-08-10T11:54:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.802+0000 7fb6bef69b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e177340ac0 con 0x55e177450800 2023-08-10T11:54:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.802+0000 7fb6bef69b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1773407c0 con 0x55e177455f50 2023-08-10T11:54:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.802+0000 7fb6bef69b80 10 client.0 _ll_register_callbacks cb 0x55e17733e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:54:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.802+0000 7fb6b136d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177456870 0x55e17745a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.802+0000 7fb6b136d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177456870 0x55e17745a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33960/0 (socket says 172.21.15.73:33960) 2023-08-10T11:54:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.802+0000 7fb6b0b6c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e177450800 0x55e17745c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.802+0000 7fb6b136d700 1 -- 172.21.15.73:0/1851029336 learned_addr learned my addr 172.21.15.73:0/1851029336 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.803+0000 7fb6abfff700 1 --2- 172.21.15.73:0/1851029336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e177455f50 0x55e177459b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.803+0000 7fb6b136d700 1 -- 172.21.15.73:0/1851029336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e177455f50 msgr2=0x55e177459b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.803+0000 7fb6b136d700 1 --2- 172.21.15.73:0/1851029336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e177455f50 0x55e177459b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.803+0000 7fb6b136d700 1 -- 172.21.15.73:0/1851029336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e177450800 msgr2=0x55e17745c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.803+0000 7fb6b136d700 1 --2- 172.21.15.73:0/1851029336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e177450800 0x55e17745c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.803+0000 7fb6b136d700 1 -- 172.21.15.73:0/1851029336 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ac1a3480 con 0x55e177456870 2023-08-10T11:54:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.803+0000 7fb6abfff700 1 --2- 172.21.15.73:0/1851029336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e177455f50 0x55e177459b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:54:06.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.803+0000 7fb6b136d700 1 --2- 172.21.15.73:0/1851029336 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177456870 0x55e17745a200 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40a12d0 tx=0x7fb6a40c9b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a7a7ded55f166f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:06.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.803+0000 7fb68bfff700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:54:06.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.803+0000 7fb68bfff700 1 -- 172.21.15.73:0/1851029336 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a40a1800 con 0x55e177456870 2023-08-10T11:54:06.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.803+0000 7fb68bfff700 1 -- 172.21.15.73:0/1851029336 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb6a400a1d0 con 0x55e177456870 2023-08-10T11:54:06.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.803+0000 7fb6bef69b80 1 -- 172.21.15.73:0/1851029336 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e177443470 con 0x55e177456870 2023-08-10T11:54:06.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.803+0000 7fb68bfff700 1 -- 172.21.15.73:0/1851029336 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6a409f0d0 con 0x55e177456870 2023-08-10T11:54:06.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.803+0000 7fb6bef69b80 10 client.15978 fetch_fsmap learned FSMap version 31 2023-08-10T11:54:06.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.803+0000 7fb6bef69b80 1 -- 172.21.15.73:0/1851029336 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55e1771cede0 con 0x55e177456870 2023-08-10T11:54:06.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.803+0000 7fb68bfff700 1 -- 172.21.15.73:0/1851029336 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e177443470 con 0x55e177456870 2023-08-10T11:54:06.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.804+0000 7fb68bfff700 1 -- 172.21.15.73:0/1851029336 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 31) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fb6a4060080 con 0x55e177456870 2023-08-10T11:54:06.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.804+0000 7fb6bef69b80 10 client.15978 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T11:54:06.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.804+0000 7fb6bef69b80 10 client.15978 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:54:06.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.804+0000 7fb6bef69b80 20 client.15978 populate_metadata read hostname 'smithi073' 2023-08-10T11:54:06.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.804+0000 7fb6bef69b80 1 --2- 172.21.15.73:0/1851029336 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e177469e80 0x55e17746c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:06.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.804+0000 7fb6bef69b80 4 client.15978 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:54:06.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.804+0000 7fb6bef69b80 1 -- 172.21.15.73:0/1851029336 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e17741f9d0 con 0x55e177469e80 2023-08-10T11:54:06.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.804+0000 7fb6b0b6c700 1 --2- 172.21.15.73:0/1851029336 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e177469e80 0x55e17746c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:06.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.804+0000 7fb68bfff700 10 client.15978 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:06.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.804+0000 7fb6b0b6c700 1 --2- 172.21.15.73:0/1851029336 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e177469e80 0x55e17746c2a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7518fb71a20e8b7 server_cookie=499244231d28772 in_seq=0 out_seq=0 2023-08-10T11:54:06.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.805+0000 7fb68bfff700 1 -- 172.21.15.73:0/1851029336 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55e17741f9d0 con 0x55e177469e80 2023-08-10T11:54:06.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.805+0000 7fb68bfff700 10 client.15978 handle_command_reply: tid=0 2023-08-10T11:54:06.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.805+0000 7fb6bef69b80 1 client.15978 shutdown 2023-08-10T11:54:06.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.805+0000 7fb6bef69b80 1 -- 172.21.15.73:0/1851029336 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177456870 msgr2=0x55e17745a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:06.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.805+0000 7fb6bef69b80 1 --2- 172.21.15.73:0/1851029336 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177456870 0x55e17745a200 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40a12d0 tx=0x7fb6a40c9b20 comp rx=0 tx=0).stop 2023-08-10T11:54:06.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.805+0000 7fb6bef69b80 1 -- 172.21.15.73:0/1851029336 shutdown_connections 2023-08-10T11:54:06.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.805+0000 7fb6bef69b80 1 --2- 172.21.15.73:0/1851029336 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e177469e80 0x55e17746c2a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.805+0000 7fb6bef69b80 1 --2- 172.21.15.73:0/1851029336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e177450800 0x55e17745c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.805+0000 7fb68bfff700 0 client.15978 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:06.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.805+0000 7fb6bef69b80 1 --2- 172.21.15.73:0/1851029336 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177456870 0x55e17745a200 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.805+0000 7fb6bef69b80 1 --2- 172.21.15.73:0/1851029336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e177455f50 0x55e177459b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.805+0000 7fb6bef69b80 1 -- 172.21.15.73:0/1851029336 >> 172.21.15.73:0/1851029336 conn(0x55e1773adcd0 msgr2=0x55e17744a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:06.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.805+0000 7fb6bef69b80 1 -- 172.21.15.73:0/1851029336 shutdown_connections 2023-08-10T11:54:06.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.805+0000 7fb6bef69b80 1 -- 172.21.15.73:0/1851029336 wait complete. 2023-08-10T11:54:06.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.805+0000 7fb6bef69b80 20 client.15978 trim_cache size 0 max 16384 2023-08-10T11:54:06.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.822+0000 7fb6bef69b80 1 Processor -- start 2023-08-10T11:54:06.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.822+0000 7fb6bef69b80 1 -- start start 2023-08-10T11:54:06.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.822+0000 7fb6bef69b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e177450800 0x55e1774502c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:06.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.822+0000 7fb6bef69b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177455f50 0x55e177455490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:06.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.822+0000 7fb6bef69b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e177456870 0x55e177461370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:06.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.822+0000 7fb6bef69b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e177224920 con 0x55e177455f50 2023-08-10T11:54:06.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.822+0000 7fb6bef69b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17741f9d0 con 0x55e177456870 2023-08-10T11:54:06.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.822+0000 7fb6bef69b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1774662b0 con 0x55e177450800 2023-08-10T11:54:06.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.823+0000 7fb6abfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177455f50 0x55e177455490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:06.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.823+0000 7fb6abfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177455f50 0x55e177455490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33966/0 (socket says 172.21.15.73:33966) 2023-08-10T11:54:06.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.823+0000 7fb6abfff700 1 -- 172.21.15.73:0/2667741428 learned_addr learned my addr 172.21.15.73:0/2667741428 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:06.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.823+0000 7fb6b0b6c700 1 --2- 172.21.15.73:0/2667741428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e177450800 0x55e1774502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:06.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.823+0000 7fb6b136d700 1 --2- 172.21.15.73:0/2667741428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e177456870 0x55e177461370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:06.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.823+0000 7fb6abfff700 1 -- 172.21.15.73:0/2667741428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e177450800 msgr2=0x55e1774502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:06.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.823+0000 7fb6abfff700 1 --2- 172.21.15.73:0/2667741428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e177450800 0x55e1774502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.823+0000 7fb6abfff700 1 -- 172.21.15.73:0/2667741428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e177456870 msgr2=0x55e177461370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:06.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.823+0000 7fb6abfff700 1 --2- 172.21.15.73:0/2667741428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e177456870 0x55e177461370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.823+0000 7fb6abfff700 1 -- 172.21.15.73:0/2667741428 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1771b7c60 con 0x55e177455f50 2023-08-10T11:54:06.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.823+0000 7fb6b136d700 1 --2- 172.21.15.73:0/2667741428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e177456870 0x55e177461370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:54:06.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.823+0000 7fb6abfff700 1 --2- 172.21.15.73:0/2667741428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177455f50 0x55e177455490 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb698007ce0 tx=0x7fb698011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=747339379f97b03c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:06.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.823+0000 7fb6977fe700 1 -- 172.21.15.73:0/2667741428 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb698011c80 con 0x55e177455f50 2023-08-10T11:54:06.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.823+0000 7fb6977fe700 1 -- 172.21.15.73:0/2667741428 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb698017040 con 0x55e177455f50 2023-08-10T11:54:06.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.823+0000 7fb6977fe700 1 -- 172.21.15.73:0/2667741428 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb698003de0 con 0x55e177455f50 2023-08-10T11:54:06.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.824+0000 7fb6bef69b80 1 -- 172.21.15.73:0/2667741428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177455f50 msgr2=0x55e177455490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:06.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.824+0000 7fb6bef69b80 1 --2- 172.21.15.73:0/2667741428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177455f50 0x55e177455490 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb698007ce0 tx=0x7fb698011440 comp rx=0 tx=0).stop 2023-08-10T11:54:06.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.824+0000 7fb6bef69b80 1 -- 172.21.15.73:0/2667741428 shutdown_connections 2023-08-10T11:54:06.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.824+0000 7fb6bef69b80 1 --2- 172.21.15.73:0/2667741428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e177456870 0x55e177461370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.824+0000 7fb6bef69b80 1 --2- 172.21.15.73:0/2667741428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e177450800 0x55e1774502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.824+0000 7fb6bef69b80 1 --2- 172.21.15.73:0/2667741428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177455f50 0x55e177455490 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.824+0000 7fb6bef69b80 1 -- 172.21.15.73:0/2667741428 >> 172.21.15.73:0/2667741428 conn(0x55e1773adcd0 msgr2=0x55e177458d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:06.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.824+0000 7fb6bef69b80 1 -- 172.21.15.73:0/2667741428 shutdown_connections 2023-08-10T11:54:06.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.824+0000 7fb6bef69b80 1 -- 172.21.15.73:0/2667741428 wait complete. 2023-08-10T11:54:06.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.824+0000 7fb6bef69b80 1 -- start start 2023-08-10T11:54:06.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.824+0000 7fb6bef69b80 1 Processor -- start 2023-08-10T11:54:06.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.825+0000 7fb6bef69b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e177450800 0x55e1774612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:06.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.825+0000 7fb6bef69b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e177455f50 0x55e17745f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:06.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.825+0000 7fb6bef69b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177456870 0x55e17745fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:06.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.825+0000 7fb6bef69b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e177460200 con 0x55e177456870 2023-08-10T11:54:06.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.825+0000 7fb6bef69b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e177460370 con 0x55e177450800 2023-08-10T11:54:06.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.825+0000 7fb6bef69b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1774bdb00 con 0x55e177455f50 2023-08-10T11:54:06.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.825+0000 7fb6bef69b80 10 client.0 _ll_register_callbacks cb 0x55e17733e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:54:06.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.825+0000 7fb6b136d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177456870 0x55e17745fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:06.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.825+0000 7fb6b136d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177456870 0x55e17745fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33974/0 (socket says 172.21.15.73:33974) 2023-08-10T11:54:06.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.825+0000 7fb6b136d700 1 -- 172.21.15.73:0/460757112 learned_addr learned my addr 172.21.15.73:0/460757112 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:06.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.825+0000 7fb6b0b6c700 1 --2- 172.21.15.73:0/460757112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e177450800 0x55e1774612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:06.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.825+0000 7fb6abfff700 1 --2- 172.21.15.73:0/460757112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e177455f50 0x55e17745f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:06.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.825+0000 7fb6b136d700 1 -- 172.21.15.73:0/460757112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e177455f50 msgr2=0x55e17745f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:06.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.825+0000 7fb6b136d700 1 --2- 172.21.15.73:0/460757112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e177455f50 0x55e17745f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.825+0000 7fb6b136d700 1 -- 172.21.15.73:0/460757112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e177450800 msgr2=0x55e1774612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:06.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.825+0000 7fb6b136d700 1 --2- 172.21.15.73:0/460757112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e177450800 0x55e1774612a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.825+0000 7fb6b136d700 1 -- 172.21.15.73:0/460757112 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb698007990 con 0x55e177456870 2023-08-10T11:54:06.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.825+0000 7fb6abfff700 1 --2- 172.21.15.73:0/460757112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e177455f50 0x55e17745f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:54:06.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.825+0000 7fb6b136d700 1 --2- 172.21.15.73:0/460757112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177456870 0x55e17745fb30 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40c9940 tx=0x7fb6a40ca1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b25916eea47f7092 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:06.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.825+0000 7fb68bfff700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:54:06.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.825+0000 7fb68bfff700 1 -- 172.21.15.73:0/460757112 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a40c3de0 con 0x55e177456870 2023-08-10T11:54:06.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.825+0000 7fb6bef69b80 1 -- 172.21.15.73:0/460757112 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb6a4099440 con 0x55e177456870 2023-08-10T11:54:06.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.825+0000 7fb68bfff700 1 -- 172.21.15.73:0/460757112 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb6a400a1d0 con 0x55e177456870 2023-08-10T11:54:06.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.825+0000 7fb68bfff700 1 -- 172.21.15.73:0/460757112 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6a409d470 con 0x55e177456870 2023-08-10T11:54:06.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.825+0000 7fb6bef69b80 10 client.15984 fetch_fsmap learned FSMap version 31 2023-08-10T11:54:06.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.825+0000 7fb6bef69b80 1 -- 172.21.15.73:0/460757112 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55e1771f5250 con 0x55e177456870 2023-08-10T11:54:06.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.826+0000 7fb68bfff700 1 -- 172.21.15.73:0/460757112 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb6a4099440 con 0x55e177456870 2023-08-10T11:54:06.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.826+0000 7fb68bfff700 1 -- 172.21.15.73:0/460757112 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 31) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fb6a4060060 con 0x55e177456870 2023-08-10T11:54:06.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.826+0000 7fb6bef69b80 10 client.15984 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T11:54:06.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.826+0000 7fb6bef69b80 10 client.15984 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:54:06.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.826+0000 7fb6bef69b80 20 client.15984 populate_metadata read hostname 'smithi073' 2023-08-10T11:54:06.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.826+0000 7fb6bef69b80 1 --2- 172.21.15.73:0/460757112 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e1774bee60 0x55e1774c1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:06.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.826+0000 7fb6bef69b80 4 client.15984 mds_command: new command op to 24503 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:54:06.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.826+0000 7fb6bef69b80 1 -- 172.21.15.73:0/460757112 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e17739a780 con 0x55e1774bee60 2023-08-10T11:54:06.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.826+0000 7fb6b0b6c700 1 --2- 172.21.15.73:0/460757112 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e1774bee60 0x55e1774c1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:06.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.826+0000 7fb68bfff700 10 client.15984 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:06.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.826+0000 7fb6b0b6c700 1 --2- 172.21.15.73:0/460757112 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e1774bee60 0x55e1774c1280 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cadf4c96e8d9678 server_cookie=abdd97ba92b508e4 in_seq=0 out_seq=0 2023-08-10T11:54:06.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.826+0000 7fb68bfff700 1 -- 172.21.15.73:0/460757112 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55e17739a780 con 0x55e1774bee60 2023-08-10T11:54:06.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.826+0000 7fb68bfff700 10 client.15984 handle_command_reply: tid=0 2023-08-10T11:54:06.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.827+0000 7fb6bef69b80 1 client.15984 shutdown 2023-08-10T11:54:06.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.827+0000 7fb6bef69b80 1 -- 172.21.15.73:0/460757112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177456870 msgr2=0x55e17745fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:06.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.827+0000 7fb6bef69b80 1 --2- 172.21.15.73:0/460757112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177456870 0x55e17745fb30 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40c9940 tx=0x7fb6a40ca1c0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.827+0000 7fb6bef69b80 1 -- 172.21.15.73:0/460757112 shutdown_connections 2023-08-10T11:54:06.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.827+0000 7fb6bef69b80 1 --2- 172.21.15.73:0/460757112 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e1774bee60 0x55e1774c1280 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.827+0000 7fb6bef69b80 1 --2- 172.21.15.73:0/460757112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e177450800 0x55e1774612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.827+0000 7fb6bef69b80 1 --2- 172.21.15.73:0/460757112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e177456870 0x55e17745fb30 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.827+0000 7fb68bfff700 0 client.15984 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:06.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.827+0000 7fb6bef69b80 1 --2- 172.21.15.73:0/460757112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e177455f50 0x55e17745f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.827+0000 7fb6bef69b80 1 -- 172.21.15.73:0/460757112 >> 172.21.15.73:0/460757112 conn(0x55e1773adcd0 msgr2=0x55e177455300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:06.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.827+0000 7fb6bef69b80 1 -- 172.21.15.73:0/460757112 shutdown_connections 2023-08-10T11:54:06.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.827+0000 7fb6bef69b80 1 -- 172.21.15.73:0/460757112 wait complete. 2023-08-10T11:54:06.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.827+0000 7fb6bef69b80 20 client.15984 trim_cache size 0 max 16384 2023-08-10T11:54:06.838 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:54:06.839 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "no active scrubs running", 2023-08-10T11:54:06.839 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": {} 2023-08-10T11:54:06.839 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:54:06.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.827+0000 7fb6b2dd0700 1 -- 172.21.15.73:0/363930360 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb69c0a13e0 msgr2=0x7fb69c0a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:06.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.827+0000 7fb6b2dd0700 1 --2- 172.21.15.73:0/363930360 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb69c0a13e0 0x7fb69c0a38a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0006010 tx=0x7fb6a0009f10 comp rx=0 tx=0).stop 2023-08-10T11:54:06.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.827+0000 7fb6b2dd0700 1 -- 172.21.15.73:0/363930360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6ac105690 msgr2=0x7fb6ac1a2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:06.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.827+0000 7fb6b2dd0700 1 --2- 172.21.15.73:0/363930360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6ac105690 0x7fb6ac1a2630 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400ada0 tx=0x7fb6a400c330 comp rx=0 tx=0).stop 2023-08-10T11:54:06.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.827+0000 7fb6b2dd0700 1 -- 172.21.15.73:0/363930360 shutdown_connections 2023-08-10T11:54:06.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.827+0000 7fb6b2dd0700 1 --2- 172.21.15.73:0/363930360 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb69c0a13e0 0x7fb69c0a38a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.827+0000 7fb6b2dd0700 1 --2- 172.21.15.73:0/363930360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6ac105690 0x7fb6ac1a2630 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.827+0000 7fb6b2dd0700 1 --2- 172.21.15.73:0/363930360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6ac0ff5d0 0x7fb6ac1975b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.827+0000 7fb6b2dd0700 1 --2- 172.21.15.73:0/363930360 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6ac0fff90 0x7fb6ac197af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.827+0000 7fb6b2dd0700 1 -- 172.21.15.73:0/363930360 >> 172.21.15.73:0/363930360 conn(0x7fb6ac0fb0c0 msgr2=0x7fb6ac0fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:06.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.828+0000 7fb6b2dd0700 1 -- 172.21.15.73:0/363930360 shutdown_connections 2023-08-10T11:54:06.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.828+0000 7fb6b2dd0700 1 -- 172.21.15.73:0/363930360 wait complete. 2023-08-10T11:54:06.842 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-08-10T11:54:06.842 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T11:54:06.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.970+0000 7f56651e2700 1 -- 172.21.15.73:0/3941488177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56600ff5d0 msgr2=0x7f56600ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:06.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.970+0000 7f56651e2700 1 --2- 172.21.15.73:0/3941488177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56600ff5d0 0x7f56600ffa50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5654009920 tx=0x7f5654009c30 comp rx=0 tx=0).stop 2023-08-10T11:54:06.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.971+0000 7f56651e2700 1 -- 172.21.15.73:0/3941488177 shutdown_connections 2023-08-10T11:54:06.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.971+0000 7f56651e2700 1 --2- 172.21.15.73:0/3941488177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56600fff90 0x7f566010c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.971+0000 7f56651e2700 1 --2- 172.21.15.73:0/3941488177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5660105690 0x7f5660105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.971+0000 7f56651e2700 1 --2- 172.21.15.73:0/3941488177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56600ff5d0 0x7f56600ffa50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.971+0000 7f56651e2700 1 -- 172.21.15.73:0/3941488177 >> 172.21.15.73:0/3941488177 conn(0x7f56600fb080 msgr2=0x7f56600fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:06.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.971+0000 7f56651e2700 1 -- 172.21.15.73:0/3941488177 shutdown_connections 2023-08-10T11:54:06.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.971+0000 7f56651e2700 1 -- 172.21.15.73:0/3941488177 wait complete. 2023-08-10T11:54:06.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.972+0000 7f56651e2700 1 Processor -- start 2023-08-10T11:54:06.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.972+0000 7f56651e2700 1 -- start start 2023-08-10T11:54:06.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.972+0000 7f56651e2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56600ff5d0 0x7f566019c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:06.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.972+0000 7f56651e2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56600fff90 0x7f566019cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:06.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.972+0000 7f56651e2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5660105690 0x7f5660196640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:06.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.972+0000 7f56651e2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5660196cb0 con 0x7f56600ff5d0 2023-08-10T11:54:06.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.972+0000 7f56651e2700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5660196e20 con 0x7f5660105690 2023-08-10T11:54:06.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.972+0000 7f56651e2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5660196fe0 con 0x7f56600fff90 2023-08-10T11:54:06.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.972+0000 7f565ed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56600ff5d0 0x7f566019c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:06.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.972+0000 7f565ed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56600ff5d0 0x7f566019c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33984/0 (socket says 172.21.15.73:33984) 2023-08-10T11:54:06.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.972+0000 7f565ed9d700 1 -- 172.21.15.73:0/3528709037 learned_addr learned my addr 172.21.15.73:0/3528709037 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:06.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.972+0000 7f565e59c700 1 --2- 172.21.15.73:0/3528709037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56600fff90 0x7f566019cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:06.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.972+0000 7f565f59e700 1 --2- 172.21.15.73:0/3528709037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5660105690 0x7f5660196640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:06.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.972+0000 7f565ed9d700 1 -- 172.21.15.73:0/3528709037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56600fff90 msgr2=0x7f566019cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:06.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.973+0000 7f565ed9d700 1 --2- 172.21.15.73:0/3528709037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56600fff90 0x7f566019cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.973+0000 7f565ed9d700 1 -- 172.21.15.73:0/3528709037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5660105690 msgr2=0x7f5660196640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:06.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.973+0000 7f565ed9d700 1 --2- 172.21.15.73:0/3528709037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5660105690 0x7f5660196640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:06.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.973+0000 7f565ed9d700 1 -- 172.21.15.73:0/3528709037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56500095f0 con 0x7f56600ff5d0 2023-08-10T11:54:06.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.973+0000 7f565ed9d700 1 --2- 172.21.15.73:0/3528709037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56600ff5d0 0x7f566019c5d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f565000ec10 tx=0x7f565000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:06.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.973+0000 7f5647fff700 1 -- 172.21.15.73:0/3528709037 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565000cc10 con 0x7f56600ff5d0 2023-08-10T11:54:06.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.973+0000 7f56651e2700 1 -- 172.21.15.73:0/3528709037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5654009520 con 0x7f56600ff5d0 2023-08-10T11:54:06.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.973+0000 7f5647fff700 1 -- 172.21.15.73:0/3528709037 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f56500044e0 con 0x7f56600ff5d0 2023-08-10T11:54:06.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.973+0000 7f5647fff700 1 -- 172.21.15.73:0/3528709037 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5650010430 con 0x7f56600ff5d0 2023-08-10T11:54:06.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.973+0000 7f56651e2700 1 -- 172.21.15.73:0/3528709037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5660101580 con 0x7f56600ff5d0 2023-08-10T11:54:06.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.974+0000 7f56651e2700 1 -- 172.21.15.73:0/3528709037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56601974b0 con 0x7f56600ff5d0 2023-08-10T11:54:06.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.975+0000 7f5647fff700 1 -- 172.21.15.73:0/3528709037 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f5650003f00 con 0x7f56600ff5d0 2023-08-10T11:54:06.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.976+0000 7f5647fff700 1 --2- 172.21.15.73:0/3528709037 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f56480a1430 0x7f56480a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:06.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.976+0000 7f565e59c700 1 --2- 172.21.15.73:0/3528709037 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f56480a1430 0x7f56480a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:06.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.976+0000 7f5647fff700 1 -- 172.21.15.73:0/3528709037 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5650014070 con 0x7f56600ff5d0 2023-08-10T11:54:06.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.976+0000 7f565e59c700 1 --2- 172.21.15.73:0/3528709037 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f56480a1430 0x7f56480a38f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5660104f50 tx=0x7f5654019040 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:06.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:06.979+0000 7f5647fff700 1 -- 172.21.15.73:0/3528709037 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f5650096500 con 0x7f56600ff5d0 2023-08-10T11:54:06.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:06 smithi152 ceph-mon[130220]: pgmap v47: 97 pgs: 97 active+clean; 40 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.1 MiB/s wr, 277 op/s 2023-08-10T11:54:07.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:06 smithi156 ceph-mon[130574]: pgmap v47: 97 pgs: 97 active+clean; 40 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.1 MiB/s wr, 277 op/s 2023-08-10T11:54:07.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:06 smithi073 ceph-mon[128869]: pgmap v47: 97 pgs: 97 active+clean; 40 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.1 MiB/s wr, 277 op/s 2023-08-10T11:54:07.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.238+0000 7f56651e2700 1 -- 172.21.15.73:0/3528709037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56601974b0 con 0x7f56600ff5d0 2023-08-10T11:54:07.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.238+0000 7f5647fff700 1 -- 172.21.15.73:0/3528709037 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+10905 (secure 0 0 0) 0x7f56601974b0 con 0x7f56600ff5d0 2023-08-10T11:54:07.239 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T11:54:07.239 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1319360725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1319360725},{"type":"v1","addr":"172.21.15.73:6835","nonce":1319360725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/431221951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":431221951},{"type":"v1","addr":"172.21.15.73:6837","nonce":431221951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-10T11:50:54.304447+0000","modified":"2023-08-10T11:54:06.635988+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24503,"mds_1":24479,"mds_2":24451,"mds_3":24443,"mds_4":24419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6839/1099539481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1099539481},{"type":"v1","addr":"172.21.15.73:6839","nonce":1099539481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6841/3067925859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":3067925859},{"type":"v1","addr":"172.21.15.73:6841","nonce":3067925859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24397":{"gid":24397,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6833/3028461815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3028461815},{"type":"v1","addr":"172.21.15.156:6833","nonce":3028461815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24419":{"gid":24419,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6833/4148407154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4148407154},{"type":"v1","addr":"172.21.15.152:6833","nonce":4148407154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24443":{"gid":24443,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.152:6835/1791572604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1791572604},{"type":"v1","addr":"172.21.15.152:6835","nonce":1791572604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.156:6835/904126790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":904126790},{"type":"v1","addr":"172.21.15.156:6835","nonce":904126790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24457":{"gid":24457,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/4284306352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":4284306352},{"type":"v1","addr":"172.21.15.156:6837","nonce":4284306352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6839/3361058731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":3361058731},{"type":"v1","addr":"172.21.15.156:6839","nonce":3361058731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6837/74214089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":74214089},{"type":"v1","addr":"172.21.15.152:6837","nonce":74214089}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6839/3870202690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3870202690},{"type":"v1","addr":"172.21.15.152:6839","nonce":3870202690}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T11:54:07.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.240+0000 7f56651e2700 1 -- 172.21.15.73:0/3528709037 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f56480a1430 msgr2=0x7f56480a38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.240+0000 7f56651e2700 1 --2- 172.21.15.73:0/3528709037 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f56480a1430 0x7f56480a38f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5660104f50 tx=0x7f5654019040 comp rx=0 tx=0).stop 2023-08-10T11:54:07.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.240+0000 7f56651e2700 1 -- 172.21.15.73:0/3528709037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56600ff5d0 msgr2=0x7f566019c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.240+0000 7f56651e2700 1 --2- 172.21.15.73:0/3528709037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56600ff5d0 0x7f566019c5d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f565000ec10 tx=0x7f565000ef20 comp rx=0 tx=0).stop 2023-08-10T11:54:07.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.241+0000 7f56651e2700 1 -- 172.21.15.73:0/3528709037 shutdown_connections 2023-08-10T11:54:07.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.241+0000 7f56651e2700 1 --2- 172.21.15.73:0/3528709037 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f56480a1430 0x7f56480a38f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.241+0000 7f56651e2700 1 --2- 172.21.15.73:0/3528709037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5660105690 0x7f5660196640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.241+0000 7f56651e2700 1 --2- 172.21.15.73:0/3528709037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56600ff5d0 0x7f566019c5d0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.241+0000 7f56651e2700 1 --2- 172.21.15.73:0/3528709037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56600fff90 0x7f566019cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.241+0000 7f56651e2700 1 -- 172.21.15.73:0/3528709037 >> 172.21.15.73:0/3528709037 conn(0x7f56600fb080 msgr2=0x7f56601035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:07.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.241+0000 7f56651e2700 1 -- 172.21.15.73:0/3528709037 shutdown_connections 2023-08-10T11:54:07.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.241+0000 7f56651e2700 1 -- 172.21.15.73:0/3528709037 wait complete. 2023-08-10T11:54:07.243 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 31 2023-08-10T11:54:07.253 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-08-10T11:54:07.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.382+0000 7f98dc982700 1 -- 172.21.15.73:0/102793830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98d80ff5d0 msgr2=0x7f98d80ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.382+0000 7f98dc982700 1 --2- 172.21.15.73:0/102793830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98d80ff5d0 0x7f98d80ffa50 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f98cc009a40 tx=0x7f98cc009d50 comp rx=0 tx=0).stop 2023-08-10T11:54:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.382+0000 7f98dc982700 1 -- 172.21.15.73:0/102793830 shutdown_connections 2023-08-10T11:54:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.382+0000 7f98dc982700 1 --2- 172.21.15.73:0/102793830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98d8105690 0x7f98d8105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.382+0000 7f98dc982700 1 --2- 172.21.15.73:0/102793830 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98d80fff90 0x7f98d810c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.382+0000 7f98dc982700 1 --2- 172.21.15.73:0/102793830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98d80ff5d0 0x7f98d80ffa50 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.382+0000 7f98dc982700 1 -- 172.21.15.73:0/102793830 >> 172.21.15.73:0/102793830 conn(0x7f98d80fb0c0 msgr2=0x7f98d80fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.382+0000 7f98dc982700 1 -- 172.21.15.73:0/102793830 shutdown_connections 2023-08-10T11:54:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.382+0000 7f98dc982700 1 -- 172.21.15.73:0/102793830 wait complete. 2023-08-10T11:54:07.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.383+0000 7f98dc982700 1 Processor -- start 2023-08-10T11:54:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.383+0000 7f98dc982700 1 -- start start 2023-08-10T11:54:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.383+0000 7f98dc982700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98d80ff5d0 0x7f98d8194590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.383+0000 7f98dc982700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98d80fff90 0x7f98d8194ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.383+0000 7f98dc982700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98d8105690 0x7f98d8198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.383+0000 7f98dc982700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d8199570 con 0x7f98d80fff90 2023-08-10T11:54:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.383+0000 7f98dc982700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d81996e0 con 0x7f98d8105690 2023-08-10T11:54:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.383+0000 7f98dc982700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d81998a0 con 0x7f98d80ff5d0 2023-08-10T11:54:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.383+0000 7f98d5d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98d80fff90 0x7f98d8194ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.383+0000 7f98d5d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98d80fff90 0x7f98d8194ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33998/0 (socket says 172.21.15.73:33998) 2023-08-10T11:54:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.383+0000 7f98d5d9b700 1 -- 172.21.15.73:0/3793705293 learned_addr learned my addr 172.21.15.73:0/3793705293 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.383+0000 7f98d659c700 1 --2- 172.21.15.73:0/3793705293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98d80ff5d0 0x7f98d8194590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.383+0000 7f98d6d9d700 1 --2- 172.21.15.73:0/3793705293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98d8105690 0x7f98d8198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.384+0000 7f98d5d9b700 1 -- 172.21.15.73:0/3793705293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98d80ff5d0 msgr2=0x7f98d8194590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.384+0000 7f98d5d9b700 1 --2- 172.21.15.73:0/3793705293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98d80ff5d0 0x7f98d8194590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.384+0000 7f98d5d9b700 1 -- 172.21.15.73:0/3793705293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98d8105690 msgr2=0x7f98d8198f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.384+0000 7f98d5d9b700 1 --2- 172.21.15.73:0/3793705293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98d8105690 0x7f98d8198f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.384+0000 7f98d5d9b700 1 -- 172.21.15.73:0/3793705293 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98cc0095f0 con 0x7f98d80fff90 2023-08-10T11:54:07.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.384+0000 7f98d6d9d700 1 --2- 172.21.15.73:0/3793705293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98d8105690 0x7f98d8198f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:54:07.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.384+0000 7f98d5d9b700 1 --2- 172.21.15.73:0/3793705293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98d80fff90 0x7f98d8194ad0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f98cc00b540 tx=0x7f98cc00ba00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:07.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.384+0000 7f98c77fe700 1 -- 172.21.15.73:0/3793705293 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc018630 con 0x7f98d80fff90 2023-08-10T11:54:07.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.384+0000 7f98dc982700 1 -- 172.21.15.73:0/3793705293 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d8199b20 con 0x7f98d80fff90 2023-08-10T11:54:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.384+0000 7f98c77fe700 1 -- 172.21.15.73:0/3793705293 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98cc005da0 con 0x7f98d80fff90 2023-08-10T11:54:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.384+0000 7f98c77fe700 1 -- 172.21.15.73:0/3793705293 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc022b00 con 0x7f98d80fff90 2023-08-10T11:54:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.384+0000 7f98dc982700 1 -- 172.21.15.73:0/3793705293 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d81a13c0 con 0x7f98d80fff90 2023-08-10T11:54:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.386+0000 7f98c77fe700 1 -- 172.21.15.73:0/3793705293 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f98cc018790 con 0x7f98d80fff90 2023-08-10T11:54:07.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.387+0000 7f98c77fe700 1 --2- 172.21.15.73:0/3793705293 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f98c00a13e0 0x7f98c00a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.387+0000 7f98d659c700 1 --2- 172.21.15.73:0/3793705293 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f98c00a13e0 0x7f98c00a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.387+0000 7f98c77fe700 1 -- 172.21.15.73:0/3793705293 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f98cc0d2b40 con 0x7f98d80fff90 2023-08-10T11:54:07.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.387+0000 7f98d659c700 1 --2- 172.21.15.73:0/3793705293 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f98c00a13e0 0x7f98c00a38a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f98c8007be0 tx=0x7f98c80073d0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:07.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.387+0000 7f98e8b1bb80 1 Processor -- start 2023-08-10T11:54:07.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.388+0000 7f98e8b1bb80 1 -- start start 2023-08-10T11:54:07.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.388+0000 7f98e8b1bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55824f133f50 0x55824f134330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.388+0000 7f98e8b1bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55824f134870 0x55824f12e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.388+0000 7f98e8b1bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55824f12e800 0x55824f12ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.388+0000 7f98e8b1bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55824f0a9dc0 con 0x55824f134870 2023-08-10T11:54:07.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.388+0000 7f98e8b1bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55824f086590 con 0x55824f133f50 2023-08-10T11:54:07.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.388+0000 7f98e8b1bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55824f083eb0 con 0x55824f12e800 2023-08-10T11:54:07.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.388+0000 7f98d659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55824f133f50 0x55824f134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.388+0000 7f98d659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55824f133f50 0x55824f134330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:48654/0 (socket says 172.21.15.73:48654) 2023-08-10T11:54:07.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.388+0000 7f98d659c700 1 -- 172.21.15.73:0/3920298058 learned_addr learned my addr 172.21.15.73:0/3920298058 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:07.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.388+0000 7f98d5d9b700 1 --2- 172.21.15.73:0/3920298058 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55824f134870 0x55824f12e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.388+0000 7f98d6d9d700 1 --2- 172.21.15.73:0/3920298058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55824f12e800 0x55824f12ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.388+0000 7f98d5d9b700 1 -- 172.21.15.73:0/3920298058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55824f12e800 msgr2=0x55824f12ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.388+0000 7f98d5d9b700 1 --2- 172.21.15.73:0/3920298058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55824f12e800 0x55824f12ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.388+0000 7f98d5d9b700 1 -- 172.21.15.73:0/3920298058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55824f133f50 msgr2=0x55824f134330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.388+0000 7f98d5d9b700 1 --2- 172.21.15.73:0/3920298058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55824f133f50 0x55824f134330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.388+0000 7f98d5d9b700 1 -- 172.21.15.73:0/3920298058 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55824ef00630 con 0x55824f134870 2023-08-10T11:54:07.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.388+0000 7f98d659c700 1 --2- 172.21.15.73:0/3920298058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55824f133f50 0x55824f134330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:07.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.389+0000 7f98d5d9b700 1 --2- 172.21.15.73:0/3920298058 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55824f134870 0x55824f12e2c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f98cc0d01f0 tx=0x7f98cc09f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31424f7c2bd823ab server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:07.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.389+0000 7f98c4ff9700 1 -- 172.21.15.73:0/3920298058 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc0a3b60 con 0x55824f134870 2023-08-10T11:54:07.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.389+0000 7f98c4ff9700 1 -- 172.21.15.73:0/3920298058 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98cc0a7ef0 con 0x55824f134870 2023-08-10T11:54:07.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.389+0000 7f98c4ff9700 1 -- 172.21.15.73:0/3920298058 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc09fff0 con 0x55824f134870 2023-08-10T11:54:07.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.389+0000 7f98e8b1bb80 1 -- 172.21.15.73:0/3920298058 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55824f134870 msgr2=0x55824f12e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.389+0000 7f98e8b1bb80 1 --2- 172.21.15.73:0/3920298058 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55824f134870 0x55824f12e2c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f98cc0d01f0 tx=0x7f98cc09f740 comp rx=0 tx=0).stop 2023-08-10T11:54:07.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.389+0000 7f98e8b1bb80 1 -- 172.21.15.73:0/3920298058 shutdown_connections 2023-08-10T11:54:07.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.390+0000 7f98e8b1bb80 1 --2- 172.21.15.73:0/3920298058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55824f133f50 0x55824f134330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.390+0000 7f98e8b1bb80 1 --2- 172.21.15.73:0/3920298058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55824f12e800 0x55824f12ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.390+0000 7f98e8b1bb80 1 --2- 172.21.15.73:0/3920298058 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55824f134870 0x55824f12e2c0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.390+0000 7f98e8b1bb80 1 -- 172.21.15.73:0/3920298058 >> 172.21.15.73:0/3920298058 conn(0x55824f08bcd0 msgr2=0x55824f1294d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:07.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.390+0000 7f98e8b1bb80 1 -- 172.21.15.73:0/3920298058 shutdown_connections 2023-08-10T11:54:07.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.390+0000 7f98e8b1bb80 1 -- 172.21.15.73:0/3920298058 wait complete. 2023-08-10T11:54:07.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.390+0000 7f98e8b1bb80 1 -- start start 2023-08-10T11:54:07.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.390+0000 7f98e8b1bb80 1 Processor -- start 2023-08-10T11:54:07.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.390+0000 7f98e8b1bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55824f12e800 0x55824f13a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.390+0000 7f98e8b1bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55824f133f50 0x55824f137ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.390+0000 7f98e8b1bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55824f134870 0x55824f1380b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.390+0000 7f98e8b1bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55824f07f7a0 con 0x55824f12e800 2023-08-10T11:54:07.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.390+0000 7f98e8b1bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55824f01eac0 con 0x55824f134870 2023-08-10T11:54:07.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.390+0000 7f98e8b1bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55824f01e7c0 con 0x55824f133f50 2023-08-10T11:54:07.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.390+0000 7f98e8b1bb80 10 client.0 _ll_register_callbacks cb 0x55824f01c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:54:07.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.390+0000 7f98d6d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55824f134870 0x55824f1380b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.390+0000 7f98d5d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55824f133f50 0x55824f137ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.390+0000 7f98d6d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55824f134870 0x55824f1380b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:48664/0 (socket says 172.21.15.73:48664) 2023-08-10T11:54:07.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.390+0000 7f98d5d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55824f133f50 0x55824f137ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:59516/0 (socket says 172.21.15.73:59516) 2023-08-10T11:54:07.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.390+0000 7f98d6d9d700 1 -- 172.21.15.73:0/132892725 learned_addr learned my addr 172.21.15.73:0/132892725 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:07.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.391+0000 7f98d659c700 1 --2- 172.21.15.73:0/132892725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55824f12e800 0x55824f13a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.391+0000 7f98d5d9b700 1 -- 172.21.15.73:0/132892725 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55824f134870 msgr2=0x55824f1380b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.391+0000 7f98d5d9b700 1 --2- 172.21.15.73:0/132892725 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55824f134870 0x55824f1380b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.391+0000 7f98d5d9b700 1 -- 172.21.15.73:0/132892725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55824f12e800 msgr2=0x55824f13a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.391+0000 7f98d5d9b700 1 --2- 172.21.15.73:0/132892725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55824f12e800 0x55824f13a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.391+0000 7f98d5d9b700 1 -- 172.21.15.73:0/132892725 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c8010b60 con 0x55824f133f50 2023-08-10T11:54:07.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.391+0000 7f98d5d9b700 1 --2- 172.21.15.73:0/132892725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55824f133f50 0x55824f137ad0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f98cc0d0220 tx=0x7f98cc09f2b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c735b0528ec28c2d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:07.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.391+0000 7f98bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T11:54:07.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.391+0000 7f98bdffb700 1 -- 172.21.15.73:0/132892725 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc0a3b60 con 0x55824f133f50 2023-08-10T11:54:07.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.391+0000 7f98bdffb700 1 -- 172.21.15.73:0/132892725 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f98cc09ffa0 con 0x55824f133f50 2023-08-10T11:54:07.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.391+0000 7f98e8b1bb80 1 -- 172.21.15.73:0/132892725 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55824f121470 con 0x55824f133f50 2023-08-10T11:54:07.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.391+0000 7f98bdffb700 1 -- 172.21.15.73:0/132892725 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98cc0b8120 con 0x55824f133f50 2023-08-10T11:54:07.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.391+0000 7f98e8b1bb80 10 client.25447 fetch_fsmap learned FSMap version 31 2023-08-10T11:54:07.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.391+0000 7f98e8b1bb80 1 -- 172.21.15.73:0/132892725 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f98d81a13c0 con 0x55824f133f50 2023-08-10T11:54:07.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.391+0000 7f98bdffb700 1 -- 172.21.15.73:0/132892725 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55824f121470 con 0x55824f133f50 2023-08-10T11:54:07.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.392+0000 7f98bdffb700 1 -- 172.21.15.73:0/132892725 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 31) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f98cc0d04e0 con 0x55824f133f50 2023-08-10T11:54:07.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.392+0000 7f98e8b1bb80 10 client.25447 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T11:54:07.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.392+0000 7f98e8b1bb80 10 client.25447 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2023-08-10T11:54:07.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.392+0000 7f98e8b1bb80 20 client.25447 populate_metadata read hostname 'smithi073' 2023-08-10T11:54:07.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.392+0000 7f98e8b1bb80 1 --2- 172.21.15.73:0/132892725 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55824f1479d0 0x55824f149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.392+0000 7f98e8b1bb80 4 client.25447 mds_command: new command op to 24419 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:54:07.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.392+0000 7f98e8b1bb80 1 -- 172.21.15.73:0/132892725 --> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55824f0fd9d0 con 0x55824f1479d0 2023-08-10T11:54:07.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.392+0000 7f98d659c700 1 --2- 172.21.15.73:0/132892725 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55824f1479d0 0x55824f149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.392+0000 7f98bdffb700 10 client.25447 ms_handle_connect on v2:172.21.15.152:6832/4148407154 2023-08-10T11:54:07.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.392+0000 7f98d659c700 1 --2- 172.21.15.73:0/132892725 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55824f1479d0 0x55824f149dc0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b673cd887fa90b4c server_cookie=6371ef508c670d05 in_seq=0 out_seq=0 2023-08-10T11:54:07.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.393+0000 7f98bdffb700 1 -- 172.21.15.73:0/132892725 <== mds.4 v2:172.21.15.152:6832/4148407154 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55824f0fd9d0 con 0x55824f1479d0 2023-08-10T11:54:07.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.393+0000 7f98bdffb700 10 client.25447 handle_command_reply: tid=0 2023-08-10T11:54:07.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.393+0000 7f98e8b1bb80 1 client.25447 shutdown 2023-08-10T11:54:07.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.393+0000 7f98e8b1bb80 1 -- 172.21.15.73:0/132892725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55824f133f50 msgr2=0x55824f137ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.393+0000 7f98e8b1bb80 1 --2- 172.21.15.73:0/132892725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55824f133f50 0x55824f137ad0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f98cc0d0220 tx=0x7f98cc09f2b0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.393+0000 7f98e8b1bb80 1 -- 172.21.15.73:0/132892725 shutdown_connections 2023-08-10T11:54:07.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.393+0000 7f98e8b1bb80 1 --2- 172.21.15.73:0/132892725 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55824f1479d0 0x55824f149dc0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.393+0000 7f98e8b1bb80 1 --2- 172.21.15.73:0/132892725 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55824f134870 0x55824f1380b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.393+0000 7f98bdffb700 0 client.25447 ms_handle_reset on v2:172.21.15.152:6832/4148407154 2023-08-10T11:54:07.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.393+0000 7f98e8b1bb80 1 --2- 172.21.15.73:0/132892725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55824f12e800 0x55824f13a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.393+0000 7f98e8b1bb80 1 --2- 172.21.15.73:0/132892725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55824f133f50 0x55824f137ad0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.393+0000 7f98e8b1bb80 1 -- 172.21.15.73:0/132892725 >> 172.21.15.73:0/132892725 conn(0x55824f08bcd0 msgr2=0x55824f1289b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:07.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.393+0000 7f98e8b1bb80 1 -- 172.21.15.73:0/132892725 shutdown_connections 2023-08-10T11:54:07.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.393+0000 7f98e8b1bb80 1 -- 172.21.15.73:0/132892725 wait complete. 2023-08-10T11:54:07.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.393+0000 7f98e8b1bb80 20 client.25447 trim_cache size 0 max 16384 2023-08-10T11:54:07.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.407+0000 7f98e8b1bb80 1 Processor -- start 2023-08-10T11:54:07.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.407+0000 7f98e8b1bb80 1 -- start start 2023-08-10T11:54:07.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.407+0000 7f98e8b1bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55824f12e800 0x55824f14e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.407+0000 7f98e8b1bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55824f133f50 0x55824f13ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.407+0000 7f98e8b1bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55824f134870 0x55824f129130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.407+0000 7f98e8b1bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55824ef02920 con 0x55824f12e800 2023-08-10T11:54:07.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.407+0000 7f98e8b1bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55824f125f80 con 0x55824f133f50 2023-08-10T11:54:07.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.407+0000 7f98e8b1bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55824f132570 con 0x55824f134870 2023-08-10T11:54:07.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.407+0000 7f98d659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55824f12e800 0x55824f14e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.407+0000 7f98d659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55824f12e800 0x55824f14e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34018/0 (socket says 172.21.15.73:34018) 2023-08-10T11:54:07.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.407+0000 7f98d659c700 1 -- 172.21.15.73:0/3152788959 learned_addr learned my addr 172.21.15.73:0/3152788959 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:07.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.407+0000 7f98d5d9b700 1 --2- 172.21.15.73:0/3152788959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55824f133f50 0x55824f13ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.407+0000 7f98d6d9d700 1 --2- 172.21.15.73:0/3152788959 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55824f134870 0x55824f129130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.407+0000 7f98d659c700 1 -- 172.21.15.73:0/3152788959 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55824f134870 msgr2=0x55824f129130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.407+0000 7f98d659c700 1 --2- 172.21.15.73:0/3152788959 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55824f134870 0x55824f129130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.407+0000 7f98d659c700 1 -- 172.21.15.73:0/3152788959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55824f133f50 msgr2=0x55824f13ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.407+0000 7f98d659c700 1 --2- 172.21.15.73:0/3152788959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55824f133f50 0x55824f13ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.407+0000 7f98d659c700 1 -- 172.21.15.73:0/3152788959 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55824eeacde0 con 0x55824f12e800 2023-08-10T11:54:07.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.407+0000 7f98d659c700 1 --2- 172.21.15.73:0/3152788959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55824f12e800 0x55824f14e680 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f98c8010760 tx=0x7f98c8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26aaa96d02086b78 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:07.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.408+0000 7f98c57fa700 1 -- 172.21.15.73:0/3152788959 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c8026040 con 0x55824f12e800 2023-08-10T11:54:07.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.408+0000 7f98c57fa700 1 -- 172.21.15.73:0/3152788959 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98c80284c0 con 0x55824f12e800 2023-08-10T11:54:07.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.408+0000 7f98c57fa700 1 -- 172.21.15.73:0/3152788959 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c8028e20 con 0x55824f12e800 2023-08-10T11:54:07.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.408+0000 7f98e8b1bb80 1 -- 172.21.15.73:0/3152788959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55824f12e800 msgr2=0x55824f14e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.408+0000 7f98e8b1bb80 1 --2- 172.21.15.73:0/3152788959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55824f12e800 0x55824f14e680 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f98c8010760 tx=0x7f98c8016000 comp rx=0 tx=0).stop 2023-08-10T11:54:07.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.408+0000 7f98e8b1bb80 1 -- 172.21.15.73:0/3152788959 shutdown_connections 2023-08-10T11:54:07.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.408+0000 7f98e8b1bb80 1 --2- 172.21.15.73:0/3152788959 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55824f134870 0x55824f129130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.408+0000 7f98e8b1bb80 1 --2- 172.21.15.73:0/3152788959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55824f12e800 0x55824f14e680 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.408+0000 7f98e8b1bb80 1 --2- 172.21.15.73:0/3152788959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55824f133f50 0x55824f13ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.408+0000 7f98e8b1bb80 1 -- 172.21.15.73:0/3152788959 >> 172.21.15.73:0/3152788959 conn(0x55824f08bcd0 msgr2=0x55824f143510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:07.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.408+0000 7f98e8b1bb80 1 -- 172.21.15.73:0/3152788959 shutdown_connections 2023-08-10T11:54:07.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.408+0000 7f98e8b1bb80 1 -- 172.21.15.73:0/3152788959 wait complete. 2023-08-10T11:54:07.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.408+0000 7f98e8b1bb80 1 -- start start 2023-08-10T11:54:07.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.409+0000 7f98e8b1bb80 1 Processor -- start 2023-08-10T11:54:07.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.409+0000 7f98e8b1bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55824f12e800 0x55824f131010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.409+0000 7f98e8b1bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55824f133f50 0x55824f12f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.409+0000 7f98e8b1bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55824f134870 0x55824f12feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.409+0000 7f98e8b1bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55824f131720 con 0x55824f133f50 2023-08-10T11:54:07.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.409+0000 7f98e8b1bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55824f1303f0 con 0x55824f134870 2023-08-10T11:54:07.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.409+0000 7f98e8b1bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55824f130560 con 0x55824f12e800 2023-08-10T11:54:07.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.409+0000 7f98e8b1bb80 10 client.0 _ll_register_callbacks cb 0x55824f01c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:54:07.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.409+0000 7f98d5d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55824f133f50 0x55824f12f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.409+0000 7f98d5d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55824f133f50 0x55824f12f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34026/0 (socket says 172.21.15.73:34026) 2023-08-10T11:54:07.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.409+0000 7f98d5d9b700 1 -- 172.21.15.73:0/2337435558 learned_addr learned my addr 172.21.15.73:0/2337435558 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:07.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.409+0000 7f98d6d9d700 1 --2- 172.21.15.73:0/2337435558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55824f134870 0x55824f12feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.409+0000 7f98d659c700 1 --2- 172.21.15.73:0/2337435558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55824f12e800 0x55824f131010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.409+0000 7f98d5d9b700 1 -- 172.21.15.73:0/2337435558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55824f12e800 msgr2=0x55824f131010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.409+0000 7f98d5d9b700 1 --2- 172.21.15.73:0/2337435558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55824f12e800 0x55824f131010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.409+0000 7f98d5d9b700 1 -- 172.21.15.73:0/2337435558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55824f134870 msgr2=0x55824f12feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.409+0000 7f98d5d9b700 1 --2- 172.21.15.73:0/2337435558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55824f134870 0x55824f12feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.409+0000 7f98d5d9b700 1 -- 172.21.15.73:0/2337435558 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c8010dd0 con 0x55824f133f50 2023-08-10T11:54:07.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.409+0000 7f98d5d9b700 1 --2- 172.21.15.73:0/2337435558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55824f133f50 0x55824f12f970 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f98cc09c030 tx=0x7f98cc09bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bff6027c608af1f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:07.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.409+0000 7f98bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:54:07.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.410+0000 7f98bdffb700 1 -- 172.21.15.73:0/2337435558 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc0b6f10 con 0x55824f133f50 2023-08-10T11:54:07.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.410+0000 7f98e8b1bb80 1 -- 172.21.15.73:0/2337435558 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f98cc0a7ef0 con 0x55824f133f50 2023-08-10T11:54:07.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.410+0000 7f98bdffb700 1 -- 172.21.15.73:0/2337435558 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f98cc0a3b60 con 0x55824f133f50 2023-08-10T11:54:07.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.410+0000 7f98bdffb700 1 -- 172.21.15.73:0/2337435558 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98cc09f490 con 0x55824f133f50 2023-08-10T11:54:07.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.410+0000 7f98e8b1bb80 10 client.16008 fetch_fsmap learned FSMap version 31 2023-08-10T11:54:07.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.410+0000 7f98e8b1bb80 1 -- 172.21.15.73:0/2337435558 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55824ee95c60 con 0x55824f133f50 2023-08-10T11:54:07.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.410+0000 7f98bdffb700 1 -- 172.21.15.73:0/2337435558 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98cc0a7ef0 con 0x55824f133f50 2023-08-10T11:54:07.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.410+0000 7f98bdffb700 1 -- 172.21.15.73:0/2337435558 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 31) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f98cc0d0330 con 0x55824f133f50 2023-08-10T11:54:07.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.410+0000 7f98e8b1bb80 10 client.16008 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T11:54:07.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.410+0000 7f98e8b1bb80 10 client.16008 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2023-08-10T11:54:07.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.410+0000 7f98e8b1bb80 20 client.16008 populate_metadata read hostname 'smithi073' 2023-08-10T11:54:07.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.410+0000 7f98e8b1bb80 1 --2- 172.21.15.73:0/2337435558 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55824f19c3e0 0x55824f19e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.410+0000 7f98e8b1bb80 4 client.16008 mds_command: new command op to 24419 tid=0[{"prefix": "damage ls"}] 2023-08-10T11:54:07.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.410+0000 7f98e8b1bb80 1 -- 172.21.15.73:0/2337435558 --> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55824f078780 con 0x55824f19c3e0 2023-08-10T11:54:07.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.410+0000 7f98d659c700 1 --2- 172.21.15.73:0/2337435558 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55824f19c3e0 0x55824f19e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.411+0000 7f98bdffb700 10 client.16008 ms_handle_connect on v2:172.21.15.152:6832/4148407154 2023-08-10T11:54:07.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.411+0000 7f98d659c700 1 --2- 172.21.15.73:0/2337435558 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55824f19c3e0 0x55824f19e7d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=92a77112934588d2 server_cookie=41ce0477f1d7bb23 in_seq=0 out_seq=0 2023-08-10T11:54:07.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.411+0000 7f98bdffb700 1 -- 172.21.15.73:0/2337435558 <== mds.4 v2:172.21.15.152:6832/4148407154 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55824f078780 con 0x55824f19c3e0 2023-08-10T11:54:07.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.411+0000 7f98bdffb700 10 client.16008 handle_command_reply: tid=0 2023-08-10T11:54:07.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.411+0000 7f98e8b1bb80 1 client.16008 shutdown 2023-08-10T11:54:07.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.411+0000 7f98e8b1bb80 1 -- 172.21.15.73:0/2337435558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55824f133f50 msgr2=0x55824f12f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.411+0000 7f98e8b1bb80 1 --2- 172.21.15.73:0/2337435558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55824f133f50 0x55824f12f970 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f98cc09c030 tx=0x7f98cc09bfa0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.411+0000 7f98e8b1bb80 1 -- 172.21.15.73:0/2337435558 shutdown_connections 2023-08-10T11:54:07.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.411+0000 7f98e8b1bb80 1 --2- 172.21.15.73:0/2337435558 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55824f19c3e0 0x55824f19e7d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.411+0000 7f98e8b1bb80 1 --2- 172.21.15.73:0/2337435558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55824f134870 0x55824f12feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.411+0000 7f98bdffb700 0 client.16008 ms_handle_reset on v2:172.21.15.152:6832/4148407154 2023-08-10T11:54:07.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.411+0000 7f98e8b1bb80 1 --2- 172.21.15.73:0/2337435558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55824f12e800 0x55824f131010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.411+0000 7f98e8b1bb80 1 --2- 172.21.15.73:0/2337435558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55824f133f50 0x55824f12f970 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.411+0000 7f98e8b1bb80 1 -- 172.21.15.73:0/2337435558 >> 172.21.15.73:0/2337435558 conn(0x55824f08bcd0 msgr2=0x55824f132b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:07.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.411+0000 7f98e8b1bb80 1 -- 172.21.15.73:0/2337435558 shutdown_connections 2023-08-10T11:54:07.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.411+0000 7f98e8b1bb80 1 -- 172.21.15.73:0/2337435558 wait complete. 2023-08-10T11:54:07.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.411+0000 7f98e8b1bb80 20 client.16008 trim_cache size 0 max 16384 2023-08-10T11:54:07.423 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2023-08-10T11:54:07.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.411+0000 7f98dc982700 1 -- 172.21.15.73:0/3793705293 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f98c00a13e0 msgr2=0x7f98c00a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.411+0000 7f98dc982700 1 --2- 172.21.15.73:0/3793705293 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f98c00a13e0 0x7f98c00a38a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f98c8007be0 tx=0x7f98c80073d0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.411+0000 7f98dc982700 1 -- 172.21.15.73:0/3793705293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98d80fff90 msgr2=0x7f98d8194ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.411+0000 7f98dc982700 1 --2- 172.21.15.73:0/3793705293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98d80fff90 0x7f98d8194ad0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f98cc00b540 tx=0x7f98cc00ba00 comp rx=0 tx=0).stop 2023-08-10T11:54:07.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.412+0000 7f98dc982700 1 -- 172.21.15.73:0/3793705293 shutdown_connections 2023-08-10T11:54:07.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.412+0000 7f98dc982700 1 --2- 172.21.15.73:0/3793705293 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f98c00a13e0 0x7f98c00a38a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.412+0000 7f98dc982700 1 --2- 172.21.15.73:0/3793705293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98d8105690 0x7f98d8198f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.412+0000 7f98dc982700 1 --2- 172.21.15.73:0/3793705293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98d80ff5d0 0x7f98d8194590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.412+0000 7f98dc982700 1 --2- 172.21.15.73:0/3793705293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98d80fff90 0x7f98d8194ad0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.412+0000 7f98dc982700 1 -- 172.21.15.73:0/3793705293 >> 172.21.15.73:0/3793705293 conn(0x7f98d80fb0c0 msgr2=0x7f98d80fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:07.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.412+0000 7f98dc982700 1 -- 172.21.15.73:0/3793705293 shutdown_connections 2023-08-10T11:54:07.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.412+0000 7f98dc982700 1 -- 172.21.15.73:0/3793705293 wait complete. 2023-08-10T11:54:07.426 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-08-10T11:54:07.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.553+0000 7f3c01348700 1 -- 172.21.15.73:0/1719921313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bfc101080 msgr2=0x7f3bfc10d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.553+0000 7f3c01348700 1 --2- 172.21.15.73:0/1719921313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bfc101080 0x7f3bfc10d590 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400b0a0 tx=0x7f3bf400b3b0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.554+0000 7f3c01348700 1 -- 172.21.15.73:0/1719921313 shutdown_connections 2023-08-10T11:54:07.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.554+0000 7f3c01348700 1 --2- 172.21.15.73:0/1719921313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bfc101080 0x7f3bfc10d590 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.554+0000 7f3c01348700 1 --2- 172.21.15.73:0/1719921313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3bfc1066d0 0x7f3bfc106ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.554+0000 7f3c01348700 1 --2- 172.21.15.73:0/1719921313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bfc1006c0 0x7f3bfc100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.554+0000 7f3c01348700 1 -- 172.21.15.73:0/1719921313 >> 172.21.15.73:0/1719921313 conn(0x7f3bfc0fc1f0 msgr2=0x7f3bfc0fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:07.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.554+0000 7f3c01348700 1 -- 172.21.15.73:0/1719921313 shutdown_connections 2023-08-10T11:54:07.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.554+0000 7f3c01348700 1 -- 172.21.15.73:0/1719921313 wait complete. 2023-08-10T11:54:07.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.554+0000 7f3c01348700 1 Processor -- start 2023-08-10T11:54:07.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.554+0000 7f3c01348700 1 -- start start 2023-08-10T11:54:07.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.555+0000 7f3c01348700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bfc1006c0 0x7f3bfc072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.555+0000 7f3c01348700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bfc101080 0x7f3bfc072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.555+0000 7f3c01348700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3bfc1066d0 0x7f3bfc1a4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.555+0000 7f3c01348700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc0737e0 con 0x7f3bfc101080 2023-08-10T11:54:07.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.555+0000 7f3c01348700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc1a4e70 con 0x7f3bfc1006c0 2023-08-10T11:54:07.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.555+0000 7f3c01348700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc1a4fb0 con 0x7f3bfc1066d0 2023-08-10T11:54:07.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.555+0000 7f3bfa7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bfc101080 0x7f3bfc072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.555+0000 7f3bfa7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bfc101080 0x7f3bfc072fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34040/0 (socket says 172.21.15.73:34040) 2023-08-10T11:54:07.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.555+0000 7f3bfa7fc700 1 -- 172.21.15.73:0/1272713966 learned_addr learned my addr 172.21.15.73:0/1272713966 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:07.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.555+0000 7f3bfaffd700 1 --2- 172.21.15.73:0/1272713966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bfc1006c0 0x7f3bfc072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.555+0000 7f3bfb7fe700 1 --2- 172.21.15.73:0/1272713966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3bfc1066d0 0x7f3bfc1a4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.555+0000 7f3bfa7fc700 1 -- 172.21.15.73:0/1272713966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3bfc1066d0 msgr2=0x7f3bfc1a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.555+0000 7f3bfa7fc700 1 --2- 172.21.15.73:0/1272713966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3bfc1066d0 0x7f3bfc1a4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.555+0000 7f3bfa7fc700 1 -- 172.21.15.73:0/1272713966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bfc1006c0 msgr2=0x7f3bfc072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.555+0000 7f3bfa7fc700 1 --2- 172.21.15.73:0/1272713966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bfc1006c0 0x7f3bfc072a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.555+0000 7f3bfa7fc700 1 -- 172.21.15.73:0/1272713966 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf4009d00 con 0x7f3bfc101080 2023-08-10T11:54:07.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.555+0000 7f3bfb7fe700 1 --2- 172.21.15.73:0/1272713966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3bfc1066d0 0x7f3bfc1a4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:54:07.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.555+0000 7f3bfa7fc700 1 --2- 172.21.15.73:0/1272713966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bfc101080 0x7f3bfc072fb0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000e9a0 tx=0x7f3bf000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:07.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.555+0000 7f3be3fff700 1 -- 172.21.15.73:0/1272713966 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0009790 con 0x7f3bfc101080 2023-08-10T11:54:07.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.555+0000 7f3c01348700 1 -- 172.21.15.73:0/1272713966 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bfc1a5210 con 0x7f3bfc101080 2023-08-10T11:54:07.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.555+0000 7f3be3fff700 1 -- 172.21.15.73:0/1272713966 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bf000cbd0 con 0x7f3bfc101080 2023-08-10T11:54:07.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.555+0000 7f3be3fff700 1 -- 172.21.15.73:0/1272713966 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0018680 con 0x7f3bfc101080 2023-08-10T11:54:07.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.555+0000 7f3c01348700 1 -- 172.21.15.73:0/1272713966 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bfc1a56f0 con 0x7f3bfc101080 2023-08-10T11:54:07.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.558+0000 7f3be3fff700 1 -- 172.21.15.73:0/1272713966 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f3bf000cd40 con 0x7f3bfc101080 2023-08-10T11:54:07.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.559+0000 7f3be3fff700 1 --2- 172.21.15.73:0/1272713966 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f3be40a13e0 0x7f3be40a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.559+0000 7f3bfaffd700 1 --2- 172.21.15.73:0/1272713966 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f3be40a13e0 0x7f3be40a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.559+0000 7f3be3fff700 1 -- 172.21.15.73:0/1272713966 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f3bf0014070 con 0x7f3bfc101080 2023-08-10T11:54:07.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.559+0000 7f3bfaffd700 1 --2- 172.21.15.73:0/1272713966 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f3be40a13e0 0x7f3be40a38a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3bec009be0 tx=0x7f3bec009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:07.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.559+0000 7f3c0d4e1b80 1 Processor -- start 2023-08-10T11:54:07.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.560+0000 7f3c0d4e1b80 1 -- start start 2023-08-10T11:54:07.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.560+0000 7f3c0d4e1b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fe9374f50 0x561fe9375330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.560+0000 7f3c0d4e1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe9375870 0x561fe936f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.560+0000 7f3c0d4e1b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe936f800 0x561fe936fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.560+0000 7f3c0d4e1b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe92eadc0 con 0x561fe936f800 2023-08-10T11:54:07.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.560+0000 7f3c0d4e1b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe92c7590 con 0x561fe9374f50 2023-08-10T11:54:07.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.560+0000 7f3c0d4e1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe92c4eb0 con 0x561fe9375870 2023-08-10T11:54:07.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.560+0000 7f3bfb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe936f800 0x561fe936fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.560+0000 7f3bfaffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fe9374f50 0x561fe9375330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.560+0000 7f3bfaffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fe9374f50 0x561fe9375330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:48696/0 (socket says 172.21.15.73:48696) 2023-08-10T11:54:07.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.560+0000 7f3bfaffd700 1 -- 172.21.15.73:0/914934764 learned_addr learned my addr 172.21.15.73:0/914934764 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:07.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.560+0000 7f3bfb7fe700 1 --2- 172.21.15.73:0/914934764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe936f800 0x561fe936fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34050/0 (socket says 172.21.15.73:34050) 2023-08-10T11:54:07.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.560+0000 7f3bfa7fc700 1 --2- 172.21.15.73:0/914934764 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe9375870 0x561fe936f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.560+0000 7f3bfb7fe700 1 -- 172.21.15.73:0/914934764 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe9375870 msgr2=0x561fe936f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.560+0000 7f3bfb7fe700 1 --2- 172.21.15.73:0/914934764 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe9375870 0x561fe936f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.560+0000 7f3bfb7fe700 1 -- 172.21.15.73:0/914934764 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fe9374f50 msgr2=0x561fe9375330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.560+0000 7f3bfb7fe700 1 --2- 172.21.15.73:0/914934764 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fe9374f50 0x561fe9375330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.560+0000 7f3bfb7fe700 1 -- 172.21.15.73:0/914934764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fe9141630 con 0x561fe936f800 2023-08-10T11:54:07.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.560+0000 7f3bfa7fc700 1 --2- 172.21.15.73:0/914934764 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe9375870 0x561fe936f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:54:07.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.560+0000 7f3bfb7fe700 1 --2- 172.21.15.73:0/914934764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe936f800 0x561fe936fc80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc074b80 tx=0x7f3bf40094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb8e4a9407857c7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:07.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.560+0000 7f3be17fa700 1 -- 172.21.15.73:0/914934764 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf400e050 con 0x561fe936f800 2023-08-10T11:54:07.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.560+0000 7f3be17fa700 1 -- 172.21.15.73:0/914934764 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bf400bd30 con 0x561fe936f800 2023-08-10T11:54:07.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.560+0000 7f3be17fa700 1 -- 172.21.15.73:0/914934764 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4005240 con 0x561fe936f800 2023-08-10T11:54:07.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.561+0000 7f3c0d4e1b80 1 -- 172.21.15.73:0/914934764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe936f800 msgr2=0x561fe936fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.561+0000 7f3c0d4e1b80 1 --2- 172.21.15.73:0/914934764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe936f800 0x561fe936fc80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc074b80 tx=0x7f3bf40094c0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.561+0000 7f3c0d4e1b80 1 -- 172.21.15.73:0/914934764 shutdown_connections 2023-08-10T11:54:07.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.561+0000 7f3c0d4e1b80 1 --2- 172.21.15.73:0/914934764 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fe9374f50 0x561fe9375330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.561+0000 7f3c0d4e1b80 1 --2- 172.21.15.73:0/914934764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe936f800 0x561fe936fc80 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.561+0000 7f3c0d4e1b80 1 --2- 172.21.15.73:0/914934764 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe9375870 0x561fe936f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.561+0000 7f3c0d4e1b80 1 -- 172.21.15.73:0/914934764 >> 172.21.15.73:0/914934764 conn(0x561fe92cccd0 msgr2=0x561fe936a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:07.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.561+0000 7f3c0d4e1b80 1 -- 172.21.15.73:0/914934764 shutdown_connections 2023-08-10T11:54:07.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.561+0000 7f3c0d4e1b80 1 -- 172.21.15.73:0/914934764 wait complete. 2023-08-10T11:54:07.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.562+0000 7f3c0d4e1b80 1 -- start start 2023-08-10T11:54:07.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.562+0000 7f3c0d4e1b80 1 Processor -- start 2023-08-10T11:54:07.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.562+0000 7f3c0d4e1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe936f800 0x561fe937b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.562+0000 7f3c0d4e1b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe9374f50 0x561fe9378ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.562+0000 7f3c0d4e1b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fe9375870 0x561fe93790b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.562+0000 7f3c0d4e1b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe92c07a0 con 0x561fe9374f50 2023-08-10T11:54:07.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.562+0000 7f3c0d4e1b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe925fac0 con 0x561fe9375870 2023-08-10T11:54:07.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.562+0000 7f3c0d4e1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe925f7c0 con 0x561fe936f800 2023-08-10T11:54:07.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.562+0000 7f3c0d4e1b80 10 client.0 _ll_register_callbacks cb 0x561fe925d680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:54:07.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.562+0000 7f3bfa7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe9374f50 0x561fe9378ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.562+0000 7f3bfa7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe9374f50 0x561fe9378ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34054/0 (socket says 172.21.15.73:34054) 2023-08-10T11:54:07.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.562+0000 7f3bfa7fc700 1 -- 172.21.15.73:0/1349577612 learned_addr learned my addr 172.21.15.73:0/1349577612 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:07.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.562+0000 7f3bfb7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fe9375870 0x561fe93790b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.562+0000 7f3bfaffd700 1 --2- 172.21.15.73:0/1349577612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe936f800 0x561fe937b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.562+0000 7f3bfa7fc700 1 -- 172.21.15.73:0/1349577612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe936f800 msgr2=0x561fe937b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.562+0000 7f3bfa7fc700 1 --2- 172.21.15.73:0/1349577612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe936f800 0x561fe937b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.562+0000 7f3bfa7fc700 1 -- 172.21.15.73:0/1349577612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fe9375870 msgr2=0x561fe93790b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.562+0000 7f3bfa7fc700 1 --2- 172.21.15.73:0/1349577612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fe9375870 0x561fe93790b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.562+0000 7f3bfa7fc700 1 -- 172.21.15.73:0/1349577612 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bfc10de90 con 0x561fe9374f50 2023-08-10T11:54:07.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.562+0000 7f3bfaffd700 1 --2- 172.21.15.73:0/1349577612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe936f800 0x561fe937b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:54:07.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.562+0000 7f3bfa7fc700 1 --2- 172.21.15.73:0/1349577612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe9374f50 0x561fe9378ad0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0010bc0 tx=0x7f3bf009a720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1814cccd1ad0749c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:07.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.562+0000 7f3bdeff5700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:54:07.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.563+0000 7f3bdeff5700 1 -- 172.21.15.73:0/1349577612 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf00a23a0 con 0x561fe9374f50 2023-08-10T11:54:07.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.563+0000 7f3bdeff5700 1 -- 172.21.15.73:0/1349577612 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f3bf00cac10 con 0x561fe9374f50 2023-08-10T11:54:07.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.563+0000 7f3c0d4e1b80 1 -- 172.21.15.73:0/1349577612 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561fe9362470 con 0x561fe9374f50 2023-08-10T11:54:07.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.563+0000 7f3bdeff5700 1 -- 172.21.15.73:0/1349577612 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3bf00cadf0 con 0x561fe9374f50 2023-08-10T11:54:07.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.563+0000 7f3c0d4e1b80 10 client.16020 fetch_fsmap learned FSMap version 31 2023-08-10T11:54:07.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.563+0000 7f3c0d4e1b80 1 -- 172.21.15.73:0/1349577612 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x561fe90edde0 con 0x561fe9374f50 2023-08-10T11:54:07.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.563+0000 7f3bdeff5700 1 -- 172.21.15.73:0/1349577612 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bf00c8080 con 0x561fe9374f50 2023-08-10T11:54:07.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.563+0000 7f3bdeff5700 1 -- 172.21.15.73:0/1349577612 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 31) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f3bf00c4aa0 con 0x561fe9374f50 2023-08-10T11:54:07.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.563+0000 7f3c0d4e1b80 10 client.16020 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T11:54:07.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.563+0000 7f3c0d4e1b80 10 client.16020 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-08-10T11:54:07.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.563+0000 7f3c0d4e1b80 20 client.16020 populate_metadata read hostname 'smithi073' 2023-08-10T11:54:07.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.563+0000 7f3c0d4e1b80 1 --2- 172.21.15.73:0/1349577612 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x561fe9389080 0x561fe938b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.563+0000 7f3c0d4e1b80 4 client.16020 mds_command: new command op to 24443 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:54:07.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.563+0000 7f3c0d4e1b80 1 -- 172.21.15.73:0/1349577612 --> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561fe933e9d0 con 0x561fe9389080 2023-08-10T11:54:07.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.563+0000 7f3bfaffd700 1 --2- 172.21.15.73:0/1349577612 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x561fe9389080 0x561fe938b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.564+0000 7f3bdeff5700 10 client.16020 ms_handle_connect on v2:172.21.15.152:6834/1791572604 2023-08-10T11:54:07.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.564+0000 7f3bfaffd700 1 --2- 172.21.15.73:0/1349577612 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x561fe9389080 0x561fe938b4a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fb103017db4e029a server_cookie=2507e9fdc107cb in_seq=0 out_seq=0 2023-08-10T11:54:07.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.564+0000 7f3bdeff5700 1 -- 172.21.15.73:0/1349577612 <== mds.3 v2:172.21.15.152:6834/1791572604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x561fe933e9d0 con 0x561fe9389080 2023-08-10T11:54:07.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.564+0000 7f3bdeff5700 10 client.16020 handle_command_reply: tid=0 2023-08-10T11:54:07.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.564+0000 7f3c0d4e1b80 1 client.16020 shutdown 2023-08-10T11:54:07.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.564+0000 7f3c0d4e1b80 1 -- 172.21.15.73:0/1349577612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe9374f50 msgr2=0x561fe9378ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.564+0000 7f3c0d4e1b80 1 --2- 172.21.15.73:0/1349577612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe9374f50 0x561fe9378ad0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0010bc0 tx=0x7f3bf009a720 comp rx=0 tx=0).stop 2023-08-10T11:54:07.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.564+0000 7f3c0d4e1b80 1 -- 172.21.15.73:0/1349577612 shutdown_connections 2023-08-10T11:54:07.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.564+0000 7f3c0d4e1b80 1 --2- 172.21.15.73:0/1349577612 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x561fe9389080 0x561fe938b4a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.564+0000 7f3c0d4e1b80 1 --2- 172.21.15.73:0/1349577612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fe9375870 0x561fe93790b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.564+0000 7f3bdeff5700 0 client.16020 ms_handle_reset on v2:172.21.15.152:6834/1791572604 2023-08-10T11:54:07.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.564+0000 7f3c0d4e1b80 1 --2- 172.21.15.73:0/1349577612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe936f800 0x561fe937b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.564+0000 7f3c0d4e1b80 1 --2- 172.21.15.73:0/1349577612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe9374f50 0x561fe9378ad0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.564+0000 7f3c0d4e1b80 1 -- 172.21.15.73:0/1349577612 >> 172.21.15.73:0/1349577612 conn(0x561fe92cccd0 msgr2=0x561fe93699b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:07.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.564+0000 7f3c0d4e1b80 1 -- 172.21.15.73:0/1349577612 shutdown_connections 2023-08-10T11:54:07.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.565+0000 7f3c0d4e1b80 1 -- 172.21.15.73:0/1349577612 wait complete. 2023-08-10T11:54:07.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.565+0000 7f3c0d4e1b80 20 client.16020 trim_cache size 0 max 16384 2023-08-10T11:54:07.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.577+0000 7f3c0d4e1b80 1 Processor -- start 2023-08-10T11:54:07.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.577+0000 7f3c0d4e1b80 1 -- start start 2023-08-10T11:54:07.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.578+0000 7f3c0d4e1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe936f800 0x561fe9380300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.578+0000 7f3c0d4e1b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fe9374f50 0x561fe936a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.578+0000 7f3c0d4e1b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe9375870 0x561fe937b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.578+0000 7f3c0d4e1b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe9143920 con 0x561fe9375870 2023-08-10T11:54:07.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.578+0000 7f3c0d4e1b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe9366fe0 con 0x561fe9374f50 2023-08-10T11:54:07.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.578+0000 7f3c0d4e1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe936bdb0 con 0x561fe936f800 2023-08-10T11:54:07.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.578+0000 7f3bfb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe9375870 0x561fe937b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.578+0000 7f3bfa7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fe9374f50 0x561fe936a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.578+0000 7f3bfaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe936f800 0x561fe9380300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.578+0000 7f3bfb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe9375870 0x561fe937b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34064/0 (socket says 172.21.15.73:34064) 2023-08-10T11:54:07.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.578+0000 7f3bfaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe936f800 0x561fe9380300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:59564/0 (socket says 172.21.15.73:59564) 2023-08-10T11:54:07.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.578+0000 7f3bfb7fe700 1 -- 172.21.15.73:0/66153237 learned_addr learned my addr 172.21.15.73:0/66153237 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:07.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.578+0000 7f3bfb7fe700 1 -- 172.21.15.73:0/66153237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe936f800 msgr2=0x561fe9380300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.578+0000 7f3bfb7fe700 1 --2- 172.21.15.73:0/66153237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe936f800 0x561fe9380300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.578+0000 7f3bfb7fe700 1 -- 172.21.15.73:0/66153237 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fe9374f50 msgr2=0x561fe936a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.578+0000 7f3bfb7fe700 1 --2- 172.21.15.73:0/66153237 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fe9374f50 0x561fe936a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.578+0000 7f3bfb7fe700 1 -- 172.21.15.73:0/66153237 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fe90d6c60 con 0x561fe9375870 2023-08-10T11:54:07.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.578+0000 7f3bfa7fc700 1 --2- 172.21.15.73:0/66153237 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fe9374f50 0x561fe936a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:07.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.578+0000 7f3bfb7fe700 1 --2- 172.21.15.73:0/66153237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe9375870 0x561fe937b3f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4007960 tx=0x7f3bf400b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d00afebbc40f0c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:07.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.578+0000 7f3be1ffb700 1 -- 172.21.15.73:0/66153237 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf400bea0 con 0x561fe9375870 2023-08-10T11:54:07.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.578+0000 7f3be1ffb700 1 -- 172.21.15.73:0/66153237 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bf4029070 con 0x561fe9375870 2023-08-10T11:54:07.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.578+0000 7f3be1ffb700 1 -- 172.21.15.73:0/66153237 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf401bc00 con 0x561fe9375870 2023-08-10T11:54:07.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.579+0000 7f3c0d4e1b80 1 -- 172.21.15.73:0/66153237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe9375870 msgr2=0x561fe937b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.579+0000 7f3c0d4e1b80 1 --2- 172.21.15.73:0/66153237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe9375870 0x561fe937b3f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4007960 tx=0x7f3bf400b3b0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.579+0000 7f3c0d4e1b80 1 -- 172.21.15.73:0/66153237 shutdown_connections 2023-08-10T11:54:07.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.579+0000 7f3c0d4e1b80 1 --2- 172.21.15.73:0/66153237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe9375870 0x561fe937b3f0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.579+0000 7f3c0d4e1b80 1 --2- 172.21.15.73:0/66153237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe936f800 0x561fe9380300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.579+0000 7f3c0d4e1b80 1 --2- 172.21.15.73:0/66153237 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fe9374f50 0x561fe936a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.579+0000 7f3c0d4e1b80 1 -- 172.21.15.73:0/66153237 >> 172.21.15.73:0/66153237 conn(0x561fe92cccd0 msgr2=0x561fe93764e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:07.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.579+0000 7f3c0d4e1b80 1 -- 172.21.15.73:0/66153237 shutdown_connections 2023-08-10T11:54:07.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.579+0000 7f3c0d4e1b80 1 -- 172.21.15.73:0/66153237 wait complete. 2023-08-10T11:54:07.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.579+0000 7f3c0d4e1b80 1 -- start start 2023-08-10T11:54:07.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.579+0000 7f3c0d4e1b80 1 Processor -- start 2023-08-10T11:54:07.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.580+0000 7f3c0d4e1b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fe936f800 0x561fe9372050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.580+0000 7f3c0d4e1b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe9374f50 0x561fe9370970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.580+0000 7f3c0d4e1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe9375870 0x561fe9370eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.580+0000 7f3c0d4e1b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe93713f0 con 0x561fe9374f50 2023-08-10T11:54:07.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.580+0000 7f3c0d4e1b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe9371560 con 0x561fe936f800 2023-08-10T11:54:07.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.580+0000 7f3c0d4e1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe9371720 con 0x561fe9375870 2023-08-10T11:54:07.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.580+0000 7f3c0d4e1b80 10 client.0 _ll_register_callbacks cb 0x561fe925d680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:54:07.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.580+0000 7f3bfa7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe9374f50 0x561fe9370970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.580+0000 7f3bfa7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe9374f50 0x561fe9370970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34068/0 (socket says 172.21.15.73:34068) 2023-08-10T11:54:07.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.580+0000 7f3bfaffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fe936f800 0x561fe9372050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.580+0000 7f3bfa7fc700 1 -- 172.21.15.73:0/2524506155 learned_addr learned my addr 172.21.15.73:0/2524506155 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:07.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.580+0000 7f3bfb7fe700 1 --2- 172.21.15.73:0/2524506155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe9375870 0x561fe9370eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.580+0000 7f3bfa7fc700 1 -- 172.21.15.73:0/2524506155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe9375870 msgr2=0x561fe9370eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.580+0000 7f3bfa7fc700 1 --2- 172.21.15.73:0/2524506155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe9375870 0x561fe9370eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.580+0000 7f3bfa7fc700 1 -- 172.21.15.73:0/2524506155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fe936f800 msgr2=0x561fe9372050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.580+0000 7f3bfa7fc700 1 --2- 172.21.15.73:0/2524506155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fe936f800 0x561fe9372050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.580+0000 7f3bfa7fc700 1 -- 172.21.15.73:0/2524506155 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561fe90edde0 con 0x561fe9374f50 2023-08-10T11:54:07.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.580+0000 7f3bfa7fc700 1 --2- 172.21.15.73:0/2524506155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe9374f50 0x561fe9370970 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0096c50 tx=0x7f3bf00c4c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df778e3cc65bca58 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:07.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.580+0000 7f3bdeff5700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:54:07.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.580+0000 7f3bdeff5700 1 -- 172.21.15.73:0/2524506155 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf00b2bc0 con 0x561fe9374f50 2023-08-10T11:54:07.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.580+0000 7f3c0d4e1b80 1 -- 172.21.15.73:0/2524506155 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3bf400bd30 con 0x561fe9374f50 2023-08-10T11:54:07.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.580+0000 7f3bdeff5700 1 -- 172.21.15.73:0/2524506155 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f3bf0063020 con 0x561fe9374f50 2023-08-10T11:54:07.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.580+0000 7f3bdeff5700 1 -- 172.21.15.73:0/2524506155 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3bf00b2d20 con 0x561fe9374f50 2023-08-10T11:54:07.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.580+0000 7f3c0d4e1b80 10 client.16026 fetch_fsmap learned FSMap version 31 2023-08-10T11:54:07.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.580+0000 7f3c0d4e1b80 1 -- 172.21.15.73:0/2524506155 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x561fe9141630 con 0x561fe9374f50 2023-08-10T11:54:07.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.581+0000 7f3bdeff5700 1 -- 172.21.15.73:0/2524506155 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bf400bd30 con 0x561fe9374f50 2023-08-10T11:54:07.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.581+0000 7f3bdeff5700 1 -- 172.21.15.73:0/2524506155 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 31) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f3bf0099140 con 0x561fe9374f50 2023-08-10T11:54:07.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.581+0000 7f3c0d4e1b80 10 client.16026 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T11:54:07.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.581+0000 7f3c0d4e1b80 10 client.16026 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-08-10T11:54:07.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.581+0000 7f3c0d4e1b80 20 client.16026 populate_metadata read hostname 'smithi073' 2023-08-10T11:54:07.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.581+0000 7f3c0d4e1b80 1 --2- 172.21.15.73:0/2524506155 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x561fe93ddf90 0x561fe93e03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.581+0000 7f3c0d4e1b80 4 client.16026 mds_command: new command op to 24443 tid=0[{"prefix": "damage ls"}] 2023-08-10T11:54:07.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.581+0000 7f3c0d4e1b80 1 -- 172.21.15.73:0/2524506155 --> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561fe92b9780 con 0x561fe93ddf90 2023-08-10T11:54:07.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.581+0000 7f3bfaffd700 1 --2- 172.21.15.73:0/2524506155 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x561fe93ddf90 0x561fe93e03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.581+0000 7f3bdeff5700 10 client.16026 ms_handle_connect on v2:172.21.15.152:6834/1791572604 2023-08-10T11:54:07.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.581+0000 7f3bfaffd700 1 --2- 172.21.15.73:0/2524506155 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x561fe93ddf90 0x561fe93e03b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7293d91c46d81583 server_cookie=2916e86b998edf05 in_seq=0 out_seq=0 2023-08-10T11:54:07.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.581+0000 7f3bdeff5700 1 -- 172.21.15.73:0/2524506155 <== mds.3 v2:172.21.15.152:6834/1791572604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561fe92b9780 con 0x561fe93ddf90 2023-08-10T11:54:07.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.581+0000 7f3bdeff5700 10 client.16026 handle_command_reply: tid=0 2023-08-10T11:54:07.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.581+0000 7f3c0d4e1b80 1 client.16026 shutdown 2023-08-10T11:54:07.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.582+0000 7f3c0d4e1b80 1 -- 172.21.15.73:0/2524506155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe9374f50 msgr2=0x561fe9370970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.582+0000 7f3c0d4e1b80 1 --2- 172.21.15.73:0/2524506155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe9374f50 0x561fe9370970 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0096c50 tx=0x7f3bf00c4c20 comp rx=0 tx=0).stop 2023-08-10T11:54:07.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.582+0000 7f3c0d4e1b80 1 -- 172.21.15.73:0/2524506155 shutdown_connections 2023-08-10T11:54:07.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.582+0000 7f3c0d4e1b80 1 --2- 172.21.15.73:0/2524506155 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x561fe93ddf90 0x561fe93e03b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.582+0000 7f3c0d4e1b80 1 --2- 172.21.15.73:0/2524506155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fe936f800 0x561fe9372050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.582+0000 7f3bdeff5700 0 client.16026 ms_handle_reset on v2:172.21.15.152:6834/1791572604 2023-08-10T11:54:07.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.582+0000 7f3c0d4e1b80 1 --2- 172.21.15.73:0/2524506155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe9375870 0x561fe9370eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.582+0000 7f3c0d4e1b80 1 --2- 172.21.15.73:0/2524506155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fe9374f50 0x561fe9370970 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.582+0000 7f3c0d4e1b80 1 -- 172.21.15.73:0/2524506155 >> 172.21.15.73:0/2524506155 conn(0x561fe92cccd0 msgr2=0x561fe9373ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:07.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.582+0000 7f3c0d4e1b80 1 -- 172.21.15.73:0/2524506155 shutdown_connections 2023-08-10T11:54:07.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.582+0000 7f3c0d4e1b80 1 -- 172.21.15.73:0/2524506155 wait complete. 2023-08-10T11:54:07.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.582+0000 7f3c0d4e1b80 20 client.16026 trim_cache size 0 max 16384 2023-08-10T11:54:07.594 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2023-08-10T11:54:07.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.582+0000 7f3c01348700 1 -- 172.21.15.73:0/1272713966 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f3be40a13e0 msgr2=0x7f3be40a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.582+0000 7f3c01348700 1 --2- 172.21.15.73:0/1272713966 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f3be40a13e0 0x7f3be40a38a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3bec009be0 tx=0x7f3bec009260 comp rx=0 tx=0).stop 2023-08-10T11:54:07.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.582+0000 7f3c01348700 1 -- 172.21.15.73:0/1272713966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bfc101080 msgr2=0x7f3bfc072fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.582+0000 7f3c01348700 1 --2- 172.21.15.73:0/1272713966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bfc101080 0x7f3bfc072fb0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000e9a0 tx=0x7f3bf000ecb0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.582+0000 7f3c01348700 1 -- 172.21.15.73:0/1272713966 shutdown_connections 2023-08-10T11:54:07.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.582+0000 7f3c01348700 1 --2- 172.21.15.73:0/1272713966 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f3be40a13e0 0x7f3be40a38a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.582+0000 7f3c01348700 1 --2- 172.21.15.73:0/1272713966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bfc1006c0 0x7f3bfc072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.582+0000 7f3c01348700 1 --2- 172.21.15.73:0/1272713966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3bfc1066d0 0x7f3bfc1a4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.582+0000 7f3c01348700 1 --2- 172.21.15.73:0/1272713966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bfc101080 0x7f3bfc072fb0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.582+0000 7f3c01348700 1 -- 172.21.15.73:0/1272713966 >> 172.21.15.73:0/1272713966 conn(0x7f3bfc0fc1f0 msgr2=0x7f3bfc0fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:07.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.582+0000 7f3c01348700 1 -- 172.21.15.73:0/1272713966 shutdown_connections 2023-08-10T11:54:07.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.582+0000 7f3c01348700 1 -- 172.21.15.73:0/1272713966 wait complete. 2023-08-10T11:54:07.597 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-08-10T11:54:07.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.726+0000 7f9301331700 1 -- 172.21.15.73:0/798749497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92fc105660 msgr2=0x7f92fc105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.726+0000 7f9301331700 1 --2- 172.21.15.73:0/798749497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92fc105660 0x7f92fc105a40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f92ec0098f0 tx=0x7f92ec009c00 comp rx=0 tx=0).stop 2023-08-10T11:54:07.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.726+0000 7f9301331700 1 -- 172.21.15.73:0/798749497 shutdown_connections 2023-08-10T11:54:07.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.726+0000 7f9301331700 1 --2- 172.21.15.73:0/798749497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92fc0fff80 0x7f92fc10c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.726+0000 7f9301331700 1 --2- 172.21.15.73:0/798749497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92fc105660 0x7f92fc105a40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.726+0000 7f9301331700 1 --2- 172.21.15.73:0/798749497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92fc0ff5c0 0x7f92fc0ffa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.726+0000 7f9301331700 1 -- 172.21.15.73:0/798749497 >> 172.21.15.73:0/798749497 conn(0x7f92fc0fb0d0 msgr2=0x7f92fc0fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:07.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.727+0000 7f9301331700 1 -- 172.21.15.73:0/798749497 shutdown_connections 2023-08-10T11:54:07.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.727+0000 7f9301331700 1 -- 172.21.15.73:0/798749497 wait complete. 2023-08-10T11:54:07.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.727+0000 7f9301331700 1 Processor -- start 2023-08-10T11:54:07.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.727+0000 7f9301331700 1 -- start start 2023-08-10T11:54:07.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.727+0000 7f9301331700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92fc0ff5c0 0x7f92fc197610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.727+0000 7f9301331700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92fc0fff80 0x7f92fc197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.727+0000 7f9301331700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92fc105660 0x7f92fc1a2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.727+0000 7f9301331700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc1a2bd0 con 0x7f92fc105660 2023-08-10T11:54:07.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.728+0000 7f9301331700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc1a2d10 con 0x7f92fc0ff5c0 2023-08-10T11:54:07.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.728+0000 7f9301331700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc1a2e50 con 0x7f92fc0fff80 2023-08-10T11:54:07.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.728+0000 7f92fb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92fc105660 0x7f92fc1a2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.728+0000 7f92faffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92fc0ff5c0 0x7f92fc197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.728+0000 7f92fa7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92fc0fff80 0x7f92fc197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.728+0000 7f92fb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92fc105660 0x7f92fc1a2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34084/0 (socket says 172.21.15.73:34084) 2023-08-10T11:54:07.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.728+0000 7f92fb7fe700 1 -- 172.21.15.73:0/2696765120 learned_addr learned my addr 172.21.15.73:0/2696765120 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:07.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.728+0000 7f92faffd700 1 --2- 172.21.15.73:0/2696765120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92fc0ff5c0 0x7f92fc197610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:48730/0 (socket says 172.21.15.73:48730) 2023-08-10T11:54:07.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.728+0000 7f92fa7fc700 1 -- 172.21.15.73:0/2696765120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92fc0ff5c0 msgr2=0x7f92fc197610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.728+0000 7f92fa7fc700 1 --2- 172.21.15.73:0/2696765120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92fc0ff5c0 0x7f92fc197610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.728+0000 7f92fa7fc700 1 -- 172.21.15.73:0/2696765120 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92fc105660 msgr2=0x7f92fc1a2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.728+0000 7f92fa7fc700 1 --2- 172.21.15.73:0/2696765120 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92fc105660 0x7f92fc1a2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.728+0000 7f92fa7fc700 1 -- 172.21.15.73:0/2696765120 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f4009d00 con 0x7f92fc0fff80 2023-08-10T11:54:07.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.728+0000 7f92faffd700 1 --2- 172.21.15.73:0/2696765120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92fc0ff5c0 0x7f92fc197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:07.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.728+0000 7f92fa7fc700 1 --2- 172.21.15.73:0/2696765120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92fc0fff80 0x7f92fc197b50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f92f000e9f0 tx=0x7f92f000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:07.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.728+0000 7f92e3fff700 1 -- 172.21.15.73:0/2696765120 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f000c9c0 con 0x7f92fc0fff80 2023-08-10T11:54:07.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.728+0000 7f92e3fff700 1 -- 172.21.15.73:0/2696765120 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f92f0010430 con 0x7f92fc0fff80 2023-08-10T11:54:07.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.728+0000 7f9301331700 1 -- 172.21.15.73:0/2696765120 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92ec009520 con 0x7f92fc0fff80 2023-08-10T11:54:07.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.728+0000 7f92e3fff700 1 -- 172.21.15.73:0/2696765120 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f0018680 con 0x7f92fc0fff80 2023-08-10T11:54:07.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.728+0000 7f9301331700 1 -- 172.21.15.73:0/2696765120 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92fc1a3460 con 0x7f92fc0fff80 2023-08-10T11:54:07.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.730+0000 7f92e3fff700 1 -- 172.21.15.73:0/2696765120 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f92f0010860 con 0x7f92fc0fff80 2023-08-10T11:54:07.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.731+0000 7f92e3fff700 1 --2- 172.21.15.73:0/2696765120 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f92e40a13e0 0x7f92e40a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.731+0000 7f92faffd700 1 --2- 172.21.15.73:0/2696765120 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f92e40a13e0 0x7f92e40a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.731+0000 7f92e3fff700 1 -- 172.21.15.73:0/2696765120 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f92f0014070 con 0x7f92fc0fff80 2023-08-10T11:54:07.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.732+0000 7f92faffd700 1 --2- 172.21.15.73:0/2696765120 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f92e40a13e0 0x7f92e40a38a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f92ec0098c0 tx=0x7f92ec019040 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:07.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.732+0000 7f930d4cab80 1 Processor -- start 2023-08-10T11:54:07.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.732+0000 7f930d4cab80 1 -- start start 2023-08-10T11:54:07.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.732+0000 7f930d4cab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ad8e7d2d0 0x555ad8e7d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.732+0000 7f930d4cab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e7dbf0 0x555ad8e786d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.732+0000 7f930d4cab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ad8e78c10 0x555ad8e79050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.732+0000 7f930d4cab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ad8defdc0 con 0x555ad8e7dbf0 2023-08-10T11:54:07.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.732+0000 7f930d4cab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ad8dcc590 con 0x555ad8e7d2d0 2023-08-10T11:54:07.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.732+0000 7f930d4cab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ad8dc9eb0 con 0x555ad8e78c10 2023-08-10T11:54:07.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.733+0000 7f92fa7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e7dbf0 0x555ad8e786d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.733+0000 7f92fa7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e7dbf0 0x555ad8e786d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34090/0 (socket says 172.21.15.73:34090) 2023-08-10T11:54:07.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.733+0000 7f92fa7fc700 1 -- 172.21.15.73:0/3159770083 learned_addr learned my addr 172.21.15.73:0/3159770083 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:07.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.733+0000 7f92faffd700 1 --2- 172.21.15.73:0/3159770083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ad8e7d2d0 0x555ad8e7d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.733+0000 7f92fb7fe700 1 --2- 172.21.15.73:0/3159770083 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ad8e78c10 0x555ad8e79050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.733+0000 7f92fa7fc700 1 -- 172.21.15.73:0/3159770083 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ad8e78c10 msgr2=0x555ad8e79050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.733+0000 7f92fa7fc700 1 --2- 172.21.15.73:0/3159770083 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ad8e78c10 0x555ad8e79050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.733+0000 7f92fa7fc700 1 -- 172.21.15.73:0/3159770083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ad8e7d2d0 msgr2=0x555ad8e7d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.733+0000 7f92fa7fc700 1 --2- 172.21.15.73:0/3159770083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ad8e7d2d0 0x555ad8e7d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.733+0000 7f92fa7fc700 1 -- 172.21.15.73:0/3159770083 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ad8c46630 con 0x555ad8e7dbf0 2023-08-10T11:54:07.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.733+0000 7f92fb7fe700 1 --2- 172.21.15.73:0/3159770083 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ad8e78c10 0x555ad8e79050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:54:07.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.733+0000 7f92fa7fc700 1 --2- 172.21.15.73:0/3159770083 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e7dbf0 0x555ad8e786d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f92f0099f00 tx=0x7f92f0099950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e9e8263d6c3984 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:07.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.733+0000 7f92e17fa700 1 -- 172.21.15.73:0/3159770083 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f00a23c0 con 0x555ad8e7dbf0 2023-08-10T11:54:07.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.733+0000 7f92e17fa700 1 -- 172.21.15.73:0/3159770083 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f92f00105a0 con 0x555ad8e7dbf0 2023-08-10T11:54:07.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.733+0000 7f92e17fa700 1 -- 172.21.15.73:0/3159770083 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f00a21e0 con 0x555ad8e7dbf0 2023-08-10T11:54:07.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.734+0000 7f930d4cab80 1 -- 172.21.15.73:0/3159770083 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e7dbf0 msgr2=0x555ad8e786d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.734+0000 7f930d4cab80 1 --2- 172.21.15.73:0/3159770083 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e7dbf0 0x555ad8e786d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f92f0099f00 tx=0x7f92f0099950 comp rx=0 tx=0).stop 2023-08-10T11:54:07.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.734+0000 7f930d4cab80 1 -- 172.21.15.73:0/3159770083 shutdown_connections 2023-08-10T11:54:07.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.734+0000 7f930d4cab80 1 --2- 172.21.15.73:0/3159770083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ad8e7d2d0 0x555ad8e7d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.734+0000 7f930d4cab80 1 --2- 172.21.15.73:0/3159770083 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ad8e78c10 0x555ad8e79050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.734+0000 7f930d4cab80 1 --2- 172.21.15.73:0/3159770083 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e7dbf0 0x555ad8e786d0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.734+0000 7f930d4cab80 1 -- 172.21.15.73:0/3159770083 >> 172.21.15.73:0/3159770083 conn(0x555ad8dd1cd0 msgr2=0x555ad8e6f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:07.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.734+0000 7f930d4cab80 1 -- 172.21.15.73:0/3159770083 shutdown_connections 2023-08-10T11:54:07.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.734+0000 7f930d4cab80 1 -- 172.21.15.73:0/3159770083 wait complete. 2023-08-10T11:54:07.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.734+0000 7f930d4cab80 1 -- start start 2023-08-10T11:54:07.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.734+0000 7f930d4cab80 1 Processor -- start 2023-08-10T11:54:07.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.735+0000 7f930d4cab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ad8e78c10 0x555ad8e81ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.735+0000 7f930d4cab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ad8e7d2d0 0x555ad8e82530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.735+0000 7f930d4cab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e7dbf0 0x555ad8e82a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.735+0000 7f930d4cab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ad8dc57a0 con 0x555ad8e7dbf0 2023-08-10T11:54:07.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.735+0000 7f930d4cab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ad8d64ac0 con 0x555ad8e78c10 2023-08-10T11:54:07.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.735+0000 7f930d4cab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ad8d647c0 con 0x555ad8e7d2d0 2023-08-10T11:54:07.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.735+0000 7f930d4cab80 10 client.0 _ll_register_callbacks cb 0x555ad8d62680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:54:07.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.735+0000 7f92fb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e7dbf0 0x555ad8e82a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.735+0000 7f92faffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ad8e78c10 0x555ad8e81ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.735+0000 7f92fb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e7dbf0 0x555ad8e82a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34098/0 (socket says 172.21.15.73:34098) 2023-08-10T11:54:07.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.735+0000 7f92fb7fe700 1 -- 172.21.15.73:0/1817762651 learned_addr learned my addr 172.21.15.73:0/1817762651 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:07.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.735+0000 7f92fa7fc700 1 --2- 172.21.15.73:0/1817762651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ad8e7d2d0 0x555ad8e82530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.735+0000 7f92faffd700 1 -- 172.21.15.73:0/1817762651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ad8e7d2d0 msgr2=0x555ad8e82530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.735+0000 7f92faffd700 1 --2- 172.21.15.73:0/1817762651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ad8e7d2d0 0x555ad8e82530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.735+0000 7f92faffd700 1 -- 172.21.15.73:0/1817762651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e7dbf0 msgr2=0x555ad8e82a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.735+0000 7f92faffd700 1 --2- 172.21.15.73:0/1817762651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e7dbf0 0x555ad8e82a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.735+0000 7f92faffd700 1 -- 172.21.15.73:0/1817762651 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92fc1a3460 con 0x555ad8e78c10 2023-08-10T11:54:07.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.735+0000 7f92fb7fe700 1 --2- 172.21.15.73:0/1817762651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e7dbf0 0x555ad8e82a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:07.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.735+0000 7f92fa7fc700 1 --2- 172.21.15.73:0/1817762651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ad8e7d2d0 0x555ad8e82530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:07.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.735+0000 7f92faffd700 1 --2- 172.21.15.73:0/1817762651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ad8e78c10 0x555ad8e81ff0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009230 tx=0x7f92ec009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd0a2d941a46d8c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:07.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.735+0000 7f92deff5700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T11:54:07.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.736+0000 7f92deff5700 1 -- 172.21.15.73:0/1817762651 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec0054a0 con 0x555ad8e78c10 2023-08-10T11:54:07.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.736+0000 7f930d4cab80 1 -- 172.21.15.73:0/1817762651 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555ad8e67470 con 0x555ad8e78c10 2023-08-10T11:54:07.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.736+0000 7f92deff5700 1 -- 172.21.15.73:0/1817762651 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f92ec005600 con 0x555ad8e78c10 2023-08-10T11:54:07.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.736+0000 7f92deff5700 1 -- 172.21.15.73:0/1817762651 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92ec003680 con 0x555ad8e78c10 2023-08-10T11:54:07.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.736+0000 7f930d4cab80 10 client.25451 fetch_fsmap learned FSMap version 31 2023-08-10T11:54:07.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.736+0000 7f930d4cab80 1 -- 172.21.15.73:0/1817762651 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x555ad8bf2de0 con 0x555ad8e78c10 2023-08-10T11:54:07.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.736+0000 7f92deff5700 1 -- 172.21.15.73:0/1817762651 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555ad8e67470 con 0x555ad8e78c10 2023-08-10T11:54:07.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.736+0000 7f92deff5700 1 -- 172.21.15.73:0/1817762651 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 31) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f92ec02e6e0 con 0x555ad8e78c10 2023-08-10T11:54:07.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.736+0000 7f930d4cab80 10 client.25451 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T11:54:07.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.736+0000 7f930d4cab80 10 client.25451 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-08-10T11:54:07.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.736+0000 7f930d4cab80 20 client.25451 populate_metadata read hostname 'smithi073' 2023-08-10T11:54:07.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.736+0000 7f930d4cab80 1 --2- 172.21.15.73:0/1817762651 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x555ad8e92720 0x555ad8e94b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.736+0000 7f930d4cab80 4 client.25451 mds_command: new command op to 24451 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:54:07.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.736+0000 7f930d4cab80 1 -- 172.21.15.73:0/1817762651 --> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555ad8e439d0 con 0x555ad8e92720 2023-08-10T11:54:07.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.736+0000 7f92fa7fc700 1 --2- 172.21.15.73:0/1817762651 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x555ad8e92720 0x555ad8e94b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.737+0000 7f92deff5700 10 client.25451 ms_handle_connect on v2:172.21.15.156:6834/904126790 2023-08-10T11:54:07.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.737+0000 7f92fa7fc700 1 --2- 172.21.15.73:0/1817762651 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x555ad8e92720 0x555ad8e94b10 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2815fea6d7ab7c0b server_cookie=9b6249d536340325 in_seq=0 out_seq=0 2023-08-10T11:54:07.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.737+0000 7f92deff5700 1 -- 172.21.15.73:0/1817762651 <== mds.2 v2:172.21.15.156:6834/904126790 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x555ad8e439d0 con 0x555ad8e92720 2023-08-10T11:54:07.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.737+0000 7f92deff5700 10 client.25451 handle_command_reply: tid=0 2023-08-10T11:54:07.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.737+0000 7f930d4cab80 1 client.25451 shutdown 2023-08-10T11:54:07.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.737+0000 7f930d4cab80 1 -- 172.21.15.73:0/1817762651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ad8e78c10 msgr2=0x555ad8e81ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.737+0000 7f930d4cab80 1 --2- 172.21.15.73:0/1817762651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ad8e78c10 0x555ad8e81ff0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009230 tx=0x7f92ec009260 comp rx=0 tx=0).stop 2023-08-10T11:54:07.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.737+0000 7f930d4cab80 1 -- 172.21.15.73:0/1817762651 shutdown_connections 2023-08-10T11:54:07.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.737+0000 7f930d4cab80 1 --2- 172.21.15.73:0/1817762651 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x555ad8e92720 0x555ad8e94b10 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.737+0000 7f930d4cab80 1 --2- 172.21.15.73:0/1817762651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ad8e78c10 0x555ad8e81ff0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.737+0000 7f92deff5700 0 client.25451 ms_handle_reset on v2:172.21.15.156:6834/904126790 2023-08-10T11:54:07.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.737+0000 7f930d4cab80 1 --2- 172.21.15.73:0/1817762651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e7dbf0 0x555ad8e82a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.737+0000 7f930d4cab80 1 --2- 172.21.15.73:0/1817762651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ad8e7d2d0 0x555ad8e82530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.737+0000 7f930d4cab80 1 -- 172.21.15.73:0/1817762651 >> 172.21.15.73:0/1817762651 conn(0x555ad8dd1cd0 msgr2=0x555ad8e7ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:07.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.738+0000 7f930d4cab80 1 -- 172.21.15.73:0/1817762651 shutdown_connections 2023-08-10T11:54:07.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.738+0000 7f930d4cab80 1 -- 172.21.15.73:0/1817762651 wait complete. 2023-08-10T11:54:07.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.738+0000 7f930d4cab80 20 client.25451 trim_cache size 0 max 16384 2023-08-10T11:54:07.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.751+0000 7f930d4cab80 1 Processor -- start 2023-08-10T11:54:07.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.751+0000 7f930d4cab80 1 -- start start 2023-08-10T11:54:07.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.751+0000 7f930d4cab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e78c10 0x555ad8e6e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.751+0000 7f930d4cab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ad8e7d2d0 0x555ad8e99470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.751+0000 7f930d4cab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ad8e7dbf0 0x555ad8e89750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.751+0000 7f930d4cab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ad8c48920 con 0x555ad8e78c10 2023-08-10T11:54:07.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.751+0000 7f930d4cab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ad8e70de0 con 0x555ad8e7d2d0 2023-08-10T11:54:07.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.751+0000 7f930d4cab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ad8e7f030 con 0x555ad8e7dbf0 2023-08-10T11:54:07.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.751+0000 7f92faffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e78c10 0x555ad8e6e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.751+0000 7f92faffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e78c10 0x555ad8e6e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34102/0 (socket says 172.21.15.73:34102) 2023-08-10T11:54:07.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.751+0000 7f92fa7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ad8e7d2d0 0x555ad8e99470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.751+0000 7f92faffd700 1 -- 172.21.15.73:0/105915624 learned_addr learned my addr 172.21.15.73:0/105915624 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:07.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.752+0000 7f92fb7fe700 1 --2- 172.21.15.73:0/105915624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ad8e7dbf0 0x555ad8e89750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.752+0000 7f92faffd700 1 -- 172.21.15.73:0/105915624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ad8e7dbf0 msgr2=0x555ad8e89750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.752+0000 7f92faffd700 1 --2- 172.21.15.73:0/105915624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ad8e7dbf0 0x555ad8e89750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.752+0000 7f92faffd700 1 -- 172.21.15.73:0/105915624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ad8e7d2d0 msgr2=0x555ad8e99470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.752+0000 7f92faffd700 1 --2- 172.21.15.73:0/105915624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ad8e7d2d0 0x555ad8e99470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.752+0000 7f92faffd700 1 -- 172.21.15.73:0/105915624 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ad8bdbc60 con 0x555ad8e78c10 2023-08-10T11:54:07.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.752+0000 7f92fb7fe700 1 --2- 172.21.15.73:0/105915624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ad8e7dbf0 0x555ad8e89750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:54:07.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.752+0000 7f92fa7fc700 1 --2- 172.21.15.73:0/105915624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ad8e7d2d0 0x555ad8e99470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:07.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.752+0000 7f92faffd700 1 --2- 172.21.15.73:0/105915624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e78c10 0x555ad8e6e9b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f92ec0098f0 tx=0x7f92ec00bd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93cbd1eb855893b8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:07.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.752+0000 7f92e1ffb700 1 -- 172.21.15.73:0/105915624 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec00f860 con 0x555ad8e78c10 2023-08-10T11:54:07.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.752+0000 7f92e1ffb700 1 -- 172.21.15.73:0/105915624 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f92ec01d040 con 0x555ad8e78c10 2023-08-10T11:54:07.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.752+0000 7f92e1ffb700 1 -- 172.21.15.73:0/105915624 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec0038e0 con 0x555ad8e78c10 2023-08-10T11:54:07.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.753+0000 7f930d4cab80 1 -- 172.21.15.73:0/105915624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e78c10 msgr2=0x555ad8e6e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.753+0000 7f930d4cab80 1 --2- 172.21.15.73:0/105915624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e78c10 0x555ad8e6e9b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f92ec0098f0 tx=0x7f92ec00bd10 comp rx=0 tx=0).stop 2023-08-10T11:54:07.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.753+0000 7f930d4cab80 1 -- 172.21.15.73:0/105915624 shutdown_connections 2023-08-10T11:54:07.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.753+0000 7f930d4cab80 1 --2- 172.21.15.73:0/105915624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ad8e7dbf0 0x555ad8e89750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.753+0000 7f930d4cab80 1 --2- 172.21.15.73:0/105915624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e78c10 0x555ad8e6e9b0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.753+0000 7f930d4cab80 1 --2- 172.21.15.73:0/105915624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ad8e7d2d0 0x555ad8e99470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.753+0000 7f930d4cab80 1 -- 172.21.15.73:0/105915624 >> 172.21.15.73:0/105915624 conn(0x555ad8dd1cd0 msgr2=0x555ad8e7c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:07.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.753+0000 7f930d4cab80 1 -- 172.21.15.73:0/105915624 shutdown_connections 2023-08-10T11:54:07.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.753+0000 7f930d4cab80 1 -- 172.21.15.73:0/105915624 wait complete. 2023-08-10T11:54:07.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.753+0000 7f930d4cab80 1 -- start start 2023-08-10T11:54:07.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.753+0000 7f930d4cab80 1 Processor -- start 2023-08-10T11:54:07.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.753+0000 7f930d4cab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e78c10 0x555ad8e85920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.753+0000 7f930d4cab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ad8e7d2d0 0x555ad8e85e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.753+0000 7f930d4cab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ad8e7dbf0 0x555ad8ee5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.753+0000 7f930d4cab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ad8e86590 con 0x555ad8e78c10 2023-08-10T11:54:07.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.753+0000 7f930d4cab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ad8ee58d0 con 0x555ad8e7d2d0 2023-08-10T11:54:07.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.753+0000 7f930d4cab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ad8ee5a60 con 0x555ad8e7dbf0 2023-08-10T11:54:07.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.753+0000 7f930d4cab80 10 client.0 _ll_register_callbacks cb 0x555ad8d62680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:54:07.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.753+0000 7f92faffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e78c10 0x555ad8e85920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.753+0000 7f92faffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e78c10 0x555ad8e85920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34108/0 (socket says 172.21.15.73:34108) 2023-08-10T11:54:07.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.753+0000 7f92faffd700 1 -- 172.21.15.73:0/3622369735 learned_addr learned my addr 172.21.15.73:0/3622369735 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:07.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.753+0000 7f92fa7fc700 1 --2- 172.21.15.73:0/3622369735 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ad8e7d2d0 0x555ad8e85e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.753+0000 7f92fb7fe700 1 --2- 172.21.15.73:0/3622369735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ad8e7dbf0 0x555ad8ee5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.754+0000 7f92faffd700 1 -- 172.21.15.73:0/3622369735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ad8e7dbf0 msgr2=0x555ad8ee5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.754+0000 7f92faffd700 1 --2- 172.21.15.73:0/3622369735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ad8e7dbf0 0x555ad8ee5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.754+0000 7f92faffd700 1 -- 172.21.15.73:0/3622369735 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ad8e7d2d0 msgr2=0x555ad8e85e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.754+0000 7f92faffd700 1 --2- 172.21.15.73:0/3622369735 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ad8e7d2d0 0x555ad8e85e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.754+0000 7f92faffd700 1 -- 172.21.15.73:0/3622369735 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555ad8c46630 con 0x555ad8e78c10 2023-08-10T11:54:07.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.754+0000 7f92faffd700 1 --2- 172.21.15.73:0/3622369735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e78c10 0x555ad8e85920 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f92ec030000 tx=0x7f92ec00f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d6c02a006a5653 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:07.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.754+0000 7f92deff5700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:54:07.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.754+0000 7f92deff5700 1 -- 172.21.15.73:0/3622369735 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec02e820 con 0x555ad8e78c10 2023-08-10T11:54:07.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.754+0000 7f92deff5700 1 -- 172.21.15.73:0/3622369735 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f92ec005320 con 0x555ad8e78c10 2023-08-10T11:54:07.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.754+0000 7f930d4cab80 1 -- 172.21.15.73:0/3622369735 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f92f00105a0 con 0x555ad8e78c10 2023-08-10T11:54:07.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.754+0000 7f92deff5700 1 -- 172.21.15.73:0/3622369735 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92ec003680 con 0x555ad8e78c10 2023-08-10T11:54:07.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.754+0000 7f930d4cab80 10 client.16044 fetch_fsmap learned FSMap version 31 2023-08-10T11:54:07.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.754+0000 7f930d4cab80 1 -- 172.21.15.73:0/3622369735 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x555ad8bf2de0 con 0x555ad8e78c10 2023-08-10T11:54:07.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.754+0000 7f92deff5700 1 -- 172.21.15.73:0/3622369735 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f92ec057020 con 0x555ad8e78c10 2023-08-10T11:54:07.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.754+0000 7f92deff5700 1 -- 172.21.15.73:0/3622369735 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 31) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f92ec051070 con 0x555ad8e78c10 2023-08-10T11:54:07.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.754+0000 7f930d4cab80 10 client.16044 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T11:54:07.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.754+0000 7f930d4cab80 10 client.16044 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-08-10T11:54:07.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.754+0000 7f930d4cab80 20 client.16044 populate_metadata read hostname 'smithi073' 2023-08-10T11:54:07.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.754+0000 7f930d4cab80 1 --2- 172.21.15.73:0/3622369735 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x555ad8ee6d00 0x555ad8ee90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.754+0000 7f930d4cab80 4 client.16044 mds_command: new command op to 24451 tid=0[{"prefix": "damage ls"}] 2023-08-10T11:54:07.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.754+0000 7f930d4cab80 1 -- 172.21.15.73:0/3622369735 --> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555ad8dbe780 con 0x555ad8ee6d00 2023-08-10T11:54:07.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.755+0000 7f92fa7fc700 1 --2- 172.21.15.73:0/3622369735 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x555ad8ee6d00 0x555ad8ee90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.755+0000 7f92deff5700 10 client.16044 ms_handle_connect on v2:172.21.15.156:6834/904126790 2023-08-10T11:54:07.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.755+0000 7f92fa7fc700 1 --2- 172.21.15.73:0/3622369735 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x555ad8ee6d00 0x555ad8ee90f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1d872680b1c5843b server_cookie=df7614a684b6e2fb in_seq=0 out_seq=0 2023-08-10T11:54:07.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.755+0000 7f92deff5700 1 -- 172.21.15.73:0/3622369735 <== mds.2 v2:172.21.15.156:6834/904126790 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555ad8dbe780 con 0x555ad8ee6d00 2023-08-10T11:54:07.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.755+0000 7f92deff5700 10 client.16044 handle_command_reply: tid=0 2023-08-10T11:54:07.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.755+0000 7f930d4cab80 1 client.16044 shutdown 2023-08-10T11:54:07.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.755+0000 7f930d4cab80 1 -- 172.21.15.73:0/3622369735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e78c10 msgr2=0x555ad8e85920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.755+0000 7f930d4cab80 1 --2- 172.21.15.73:0/3622369735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e78c10 0x555ad8e85920 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f92ec030000 tx=0x7f92ec00f890 comp rx=0 tx=0).stop 2023-08-10T11:54:07.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.755+0000 7f930d4cab80 1 -- 172.21.15.73:0/3622369735 shutdown_connections 2023-08-10T11:54:07.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.755+0000 7f930d4cab80 1 --2- 172.21.15.73:0/3622369735 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x555ad8ee6d00 0x555ad8ee90f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.755+0000 7f930d4cab80 1 --2- 172.21.15.73:0/3622369735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ad8e7dbf0 0x555ad8ee5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.755+0000 7f930d4cab80 1 --2- 172.21.15.73:0/3622369735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ad8e78c10 0x555ad8e85920 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.755+0000 7f92deff5700 0 client.16044 ms_handle_reset on v2:172.21.15.156:6834/904126790 2023-08-10T11:54:07.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.755+0000 7f930d4cab80 1 --2- 172.21.15.73:0/3622369735 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555ad8e7d2d0 0x555ad8e85e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.755+0000 7f930d4cab80 1 -- 172.21.15.73:0/3622369735 >> 172.21.15.73:0/3622369735 conn(0x555ad8dd1cd0 msgr2=0x555ad8e7e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:07.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.755+0000 7f930d4cab80 1 -- 172.21.15.73:0/3622369735 shutdown_connections 2023-08-10T11:54:07.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.755+0000 7f930d4cab80 1 -- 172.21.15.73:0/3622369735 wait complete. 2023-08-10T11:54:07.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.755+0000 7f930d4cab80 20 client.16044 trim_cache size 0 max 16384 2023-08-10T11:54:07.767 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2023-08-10T11:54:07.768 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.756+0000 7f9301331700 1 -- 172.21.15.73:0/2696765120 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f92e40a13e0 msgr2=0x7f92e40a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.756+0000 7f9301331700 1 --2- 172.21.15.73:0/2696765120 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f92e40a13e0 0x7f92e40a38a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f92ec0098c0 tx=0x7f92ec019040 comp rx=0 tx=0).stop 2023-08-10T11:54:07.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.756+0000 7f9301331700 1 -- 172.21.15.73:0/2696765120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92fc0fff80 msgr2=0x7f92fc197b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.756+0000 7f9301331700 1 --2- 172.21.15.73:0/2696765120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92fc0fff80 0x7f92fc197b50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f92f000e9f0 tx=0x7f92f000ed00 comp rx=0 tx=0).stop 2023-08-10T11:54:07.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.756+0000 7f9301331700 1 -- 172.21.15.73:0/2696765120 shutdown_connections 2023-08-10T11:54:07.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.756+0000 7f9301331700 1 --2- 172.21.15.73:0/2696765120 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f92e40a13e0 0x7f92e40a38a0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f92ec0098c0 tx=0x7f92ec019040 comp rx=0 tx=0).stop 2023-08-10T11:54:07.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.756+0000 7f9301331700 1 --2- 172.21.15.73:0/2696765120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92fc0ff5c0 0x7f92fc197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.756+0000 7f9301331700 1 --2- 172.21.15.73:0/2696765120 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92fc105660 0x7f92fc1a2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.756+0000 7f9301331700 1 --2- 172.21.15.73:0/2696765120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92fc0fff80 0x7f92fc197b50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.756+0000 7f9301331700 1 -- 172.21.15.73:0/2696765120 >> 172.21.15.73:0/2696765120 conn(0x7f92fc0fb0d0 msgr2=0x7f92fc0fc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:07.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.756+0000 7f9301331700 1 -- 172.21.15.73:0/2696765120 shutdown_connections 2023-08-10T11:54:07.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.756+0000 7f9301331700 1 -- 172.21.15.73:0/2696765120 wait complete. 2023-08-10T11:54:07.770 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-08-10T11:54:07.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.898+0000 7f7122dd2700 1 -- 172.21.15.73:0/1601455451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f711c0ff5d0 msgr2=0x7f711c0ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.898+0000 7f7122dd2700 1 --2- 172.21.15.73:0/1601455451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f711c0ff5d0 0x7f711c0ffa50 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f71100099c0 tx=0x7f7110009cd0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.898+0000 7f7122dd2700 1 -- 172.21.15.73:0/1601455451 shutdown_connections 2023-08-10T11:54:07.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.898+0000 7f7122dd2700 1 --2- 172.21.15.73:0/1601455451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f711c105690 0x7f711c105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.898+0000 7f7122dd2700 1 --2- 172.21.15.73:0/1601455451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f711c0fff90 0x7f711c10c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.898+0000 7f7122dd2700 1 --2- 172.21.15.73:0/1601455451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f711c0ff5d0 0x7f711c0ffa50 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.898+0000 7f7122dd2700 1 -- 172.21.15.73:0/1601455451 >> 172.21.15.73:0/1601455451 conn(0x7f711c0fb0c0 msgr2=0x7f711c0fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:07.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.898+0000 7f7122dd2700 1 -- 172.21.15.73:0/1601455451 shutdown_connections 2023-08-10T11:54:07.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.898+0000 7f7122dd2700 1 -- 172.21.15.73:0/1601455451 wait complete. 2023-08-10T11:54:07.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.899+0000 7f7122dd2700 1 Processor -- start 2023-08-10T11:54:07.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.899+0000 7f7122dd2700 1 -- start start 2023-08-10T11:54:07.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.899+0000 7f7122dd2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f711c0ff5d0 0x7f711c1956a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.899+0000 7f7122dd2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f711c0fff90 0x7f711c195be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.899+0000 7f7122dd2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f711c105690 0x7f711c198f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.899+0000 7f7122dd2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c199590 con 0x7f711c0fff90 2023-08-10T11:54:07.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.899+0000 7f7122dd2700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c199700 con 0x7f711c0ff5d0 2023-08-10T11:54:07.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.899+0000 7f7122dd2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c1998c0 con 0x7f711c105690 2023-08-10T11:54:07.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.899+0000 7f711bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f711c0fff90 0x7f711c195be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.899+0000 7f7120b6e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f711c0ff5d0 0x7f711c1956a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.899+0000 7f711bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f711c0fff90 0x7f711c195be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34124/0 (socket says 172.21.15.73:34124) 2023-08-10T11:54:07.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.899+0000 7f711bfff700 1 -- 172.21.15.73:0/3746521434 learned_addr learned my addr 172.21.15.73:0/3746521434 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:07.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.899+0000 7f712136f700 1 --2- 172.21.15.73:0/3746521434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f711c105690 0x7f711c198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.900+0000 7f711bfff700 1 -- 172.21.15.73:0/3746521434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f711c105690 msgr2=0x7f711c198f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.900+0000 7f711bfff700 1 --2- 172.21.15.73:0/3746521434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f711c105690 0x7f711c198f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.900+0000 7f711bfff700 1 -- 172.21.15.73:0/3746521434 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f711c0ff5d0 msgr2=0x7f711c1956a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.900+0000 7f711bfff700 1 --2- 172.21.15.73:0/3746521434 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f711c0ff5d0 0x7f711c1956a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.900+0000 7f711bfff700 1 -- 172.21.15.73:0/3746521434 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71100095f0 con 0x7f711c0fff90 2023-08-10T11:54:07.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.900+0000 7f711bfff700 1 --2- 172.21.15.73:0/3746521434 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f711c0fff90 0x7f711c195be0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7110009990 tx=0x7f711000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:07.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.900+0000 7f7119ffb700 1 -- 172.21.15.73:0/3746521434 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711001d070 con 0x7f711c0fff90 2023-08-10T11:54:07.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.900+0000 7f7119ffb700 1 -- 172.21.15.73:0/3746521434 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7110005030 con 0x7f711c0fff90 2023-08-10T11:54:07.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.900+0000 7f7122dd2700 1 -- 172.21.15.73:0/3746521434 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711c199b40 con 0x7f711c0fff90 2023-08-10T11:54:07.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.900+0000 7f7119ffb700 1 -- 172.21.15.73:0/3746521434 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7110004a50 con 0x7f711c0fff90 2023-08-10T11:54:07.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.900+0000 7f7122dd2700 1 -- 172.21.15.73:0/3746521434 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f711c199e10 con 0x7f711c0fff90 2023-08-10T11:54:07.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.903+0000 7f7119ffb700 1 -- 172.21.15.73:0/3746521434 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f7110005430 con 0x7f711c0fff90 2023-08-10T11:54:07.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.903+0000 7f7119ffb700 1 --2- 172.21.15.73:0/3746521434 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f71040a13e0 0x7f71040a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.904+0000 7f7120b6e700 1 --2- 172.21.15.73:0/3746521434 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f71040a13e0 0x7f71040a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.904+0000 7f7119ffb700 1 -- 172.21.15.73:0/3746521434 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f71100cdd00 con 0x7f711c0fff90 2023-08-10T11:54:07.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.904+0000 7f7120b6e700 1 --2- 172.21.15.73:0/3746521434 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f71040a13e0 0x7f71040a38a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f710c009be0 tx=0x7f710c009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:07.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.904+0000 7f712ef6bb80 1 Processor -- start 2023-08-10T11:54:07.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.904+0000 7f712ef6bb80 1 -- start start 2023-08-10T11:54:07.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.904+0000 7f712ef6bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563321e8ff50 0x563321e90330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.904+0000 7f712ef6bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563321e90870 0x563321e8a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.904+0000 7f712ef6bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e8a800 0x563321e8ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.904+0000 7f712ef6bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563321e05dc0 con 0x563321e8a800 2023-08-10T11:54:07.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.904+0000 7f712ef6bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563321de2590 con 0x563321e90870 2023-08-10T11:54:07.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.904+0000 7f712ef6bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563321ddfeb0 con 0x563321e8ff50 2023-08-10T11:54:07.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.904+0000 7f712136f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e8a800 0x563321e8ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.904+0000 7f712136f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e8a800 0x563321e8ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34134/0 (socket says 172.21.15.73:34134) 2023-08-10T11:54:07.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.904+0000 7f712136f700 1 -- 172.21.15.73:0/4001034648 learned_addr learned my addr 172.21.15.73:0/4001034648 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:07.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.904+0000 7f711bfff700 1 --2- 172.21.15.73:0/4001034648 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563321e90870 0x563321e8a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.905+0000 7f7120b6e700 1 --2- 172.21.15.73:0/4001034648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563321e8ff50 0x563321e90330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.905+0000 7f712136f700 1 -- 172.21.15.73:0/4001034648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563321e8ff50 msgr2=0x563321e90330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.905+0000 7f712136f700 1 --2- 172.21.15.73:0/4001034648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563321e8ff50 0x563321e90330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.905+0000 7f712136f700 1 -- 172.21.15.73:0/4001034648 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563321e90870 msgr2=0x563321e8a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.905+0000 7f712136f700 1 --2- 172.21.15.73:0/4001034648 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563321e90870 0x563321e8a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.905+0000 7f712136f700 1 -- 172.21.15.73:0/4001034648 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563321c5c630 con 0x563321e8a800 2023-08-10T11:54:07.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.905+0000 7f712136f700 1 --2- 172.21.15.73:0/4001034648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e8a800 0x563321e8ac80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7114009970 tx=0x7f7114009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611a85cc2423bcd1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:07.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.905+0000 7f7102ffd700 1 -- 172.21.15.73:0/4001034648 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114004750 con 0x563321e8a800 2023-08-10T11:54:07.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.905+0000 7f7102ffd700 1 -- 172.21.15.73:0/4001034648 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f711400f040 con 0x563321e8a800 2023-08-10T11:54:07.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.905+0000 7f7102ffd700 1 -- 172.21.15.73:0/4001034648 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114015750 con 0x563321e8a800 2023-08-10T11:54:07.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.906+0000 7f712ef6bb80 1 -- 172.21.15.73:0/4001034648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e8a800 msgr2=0x563321e8ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.906+0000 7f712ef6bb80 1 --2- 172.21.15.73:0/4001034648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e8a800 0x563321e8ac80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7114009970 tx=0x7f7114009c80 comp rx=0 tx=0).stop 2023-08-10T11:54:07.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.906+0000 7f712ef6bb80 1 -- 172.21.15.73:0/4001034648 shutdown_connections 2023-08-10T11:54:07.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.906+0000 7f712ef6bb80 1 --2- 172.21.15.73:0/4001034648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e8a800 0x563321e8ac80 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.906+0000 7f712ef6bb80 1 --2- 172.21.15.73:0/4001034648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563321e8ff50 0x563321e90330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.906+0000 7f712ef6bb80 1 --2- 172.21.15.73:0/4001034648 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563321e90870 0x563321e8a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.906+0000 7f712ef6bb80 1 -- 172.21.15.73:0/4001034648 >> 172.21.15.73:0/4001034648 conn(0x563321de7cd0 msgr2=0x563321e854d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:07.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.906+0000 7f712ef6bb80 1 -- 172.21.15.73:0/4001034648 shutdown_connections 2023-08-10T11:54:07.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.906+0000 7f712ef6bb80 1 -- 172.21.15.73:0/4001034648 wait complete. 2023-08-10T11:54:07.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.906+0000 7f712ef6bb80 1 -- start start 2023-08-10T11:54:07.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.906+0000 7f712ef6bb80 1 Processor -- start 2023-08-10T11:54:07.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.907+0000 7f712ef6bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563321e8a800 0x563321e968c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.907+0000 7f712ef6bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563321e8ff50 0x563321e93bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.907+0000 7f712ef6bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e90870 0x563321e94230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.907+0000 7f712ef6bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563321ddb7a0 con 0x563321e90870 2023-08-10T11:54:07.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.907+0000 7f712ef6bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563321d7aac0 con 0x563321e8ff50 2023-08-10T11:54:07.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.907+0000 7f712ef6bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563321d7a7c0 con 0x563321e8a800 2023-08-10T11:54:07.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.907+0000 7f712ef6bb80 10 client.0 _ll_register_callbacks cb 0x563321d78680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:54:07.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.907+0000 7f712136f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e90870 0x563321e94230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.907+0000 7f711bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563321e8ff50 0x563321e93bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.907+0000 7f712136f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e90870 0x563321e94230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34140/0 (socket says 172.21.15.73:34140) 2023-08-10T11:54:07.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.907+0000 7f712136f700 1 -- 172.21.15.73:0/8316813 learned_addr learned my addr 172.21.15.73:0/8316813 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:07.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.907+0000 7f7120b6e700 1 --2- 172.21.15.73:0/8316813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563321e8a800 0x563321e968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.907+0000 7f711bfff700 1 -- 172.21.15.73:0/8316813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563321e8a800 msgr2=0x563321e968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.907+0000 7f711bfff700 1 --2- 172.21.15.73:0/8316813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563321e8a800 0x563321e968c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.907+0000 7f711bfff700 1 -- 172.21.15.73:0/8316813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e90870 msgr2=0x563321e94230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.907+0000 7f711bfff700 1 --2- 172.21.15.73:0/8316813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e90870 0x563321e94230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.907+0000 7f711bfff700 1 -- 172.21.15.73:0/8316813 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7114003c50 con 0x563321e8ff50 2023-08-10T11:54:07.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.907+0000 7f7120b6e700 1 --2- 172.21.15.73:0/8316813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563321e8a800 0x563321e968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:07.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.907+0000 7f712136f700 1 --2- 172.21.15.73:0/8316813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e90870 0x563321e94230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:07.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.907+0000 7f711bfff700 1 --2- 172.21.15.73:0/8316813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563321e8ff50 0x563321e93bb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f71100cb2a0 tx=0x7f711000fdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=869660abdaf209ab server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:07.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.907+0000 7f70fbfff700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T11:54:07.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.907+0000 7f70fbfff700 1 -- 172.21.15.73:0/8316813 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711009a2d0 con 0x563321e8ff50 2023-08-10T11:54:07.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.907+0000 7f712ef6bb80 1 -- 172.21.15.73:0/8316813 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563321e7d470 con 0x563321e8ff50 2023-08-10T11:54:07.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.908+0000 7f70fbfff700 1 -- 172.21.15.73:0/8316813 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f71100a2fa0 con 0x563321e8ff50 2023-08-10T11:54:07.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.908+0000 7f70fbfff700 1 -- 172.21.15.73:0/8316813 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71100a2b10 con 0x563321e8ff50 2023-08-10T11:54:07.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.908+0000 7f712ef6bb80 10 client.25469 fetch_fsmap learned FSMap version 31 2023-08-10T11:54:07.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.908+0000 7f712ef6bb80 1 -- 172.21.15.73:0/8316813 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x563321c08de0 con 0x563321e8ff50 2023-08-10T11:54:07.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.908+0000 7f70fbfff700 1 -- 172.21.15.73:0/8316813 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563321e7d470 con 0x563321e8ff50 2023-08-10T11:54:07.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.908+0000 7f70fbfff700 1 -- 172.21.15.73:0/8316813 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 31) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f7110004bb0 con 0x563321e8ff50 2023-08-10T11:54:07.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.908+0000 7f712ef6bb80 10 client.25469 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T11:54:07.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.908+0000 7f712ef6bb80 10 client.25469 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-08-10T11:54:07.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.908+0000 7f712ef6bb80 20 client.25469 populate_metadata read hostname 'smithi073' 2023-08-10T11:54:07.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.908+0000 7f712ef6bb80 1 --2- 172.21.15.73:0/8316813 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x563321ea3d50 0x563321ea6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.908+0000 7f712ef6bb80 4 client.25469 mds_command: new command op to 24479 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:54:07.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.908+0000 7f712ef6bb80 1 -- 172.21.15.73:0/8316813 --> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563321e599d0 con 0x563321ea3d50 2023-08-10T11:54:07.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.908+0000 7f7120b6e700 1 --2- 172.21.15.73:0/8316813 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x563321ea3d50 0x563321ea6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.909+0000 7f70fbfff700 10 client.25469 ms_handle_connect on v2:172.21.15.152:6836/74214089 2023-08-10T11:54:07.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.909+0000 7f7120b6e700 1 --2- 172.21.15.73:0/8316813 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x563321ea3d50 0x563321ea6170 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7bc9d04c8def22d5 server_cookie=670416f7def0fbf4 in_seq=0 out_seq=0 2023-08-10T11:54:07.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.910+0000 7f70fbfff700 1 -- 172.21.15.73:0/8316813 <== mds.1 v2:172.21.15.152:6836/74214089 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x563321e599d0 con 0x563321ea3d50 2023-08-10T11:54:07.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.910+0000 7f70fbfff700 10 client.25469 handle_command_reply: tid=0 2023-08-10T11:54:07.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.910+0000 7f712ef6bb80 1 client.25469 shutdown 2023-08-10T11:54:07.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.910+0000 7f712ef6bb80 1 -- 172.21.15.73:0/8316813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563321e8ff50 msgr2=0x563321e93bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.910+0000 7f712ef6bb80 1 --2- 172.21.15.73:0/8316813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563321e8ff50 0x563321e93bb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f71100cb2a0 tx=0x7f711000fdb0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.910+0000 7f712ef6bb80 1 -- 172.21.15.73:0/8316813 shutdown_connections 2023-08-10T11:54:07.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.910+0000 7f712ef6bb80 1 --2- 172.21.15.73:0/8316813 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x563321ea3d50 0x563321ea6170 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.910+0000 7f712ef6bb80 1 --2- 172.21.15.73:0/8316813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e90870 0x563321e94230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.910+0000 7f70fbfff700 0 client.25469 ms_handle_reset on v2:172.21.15.152:6836/74214089 2023-08-10T11:54:07.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.910+0000 7f712ef6bb80 1 --2- 172.21.15.73:0/8316813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563321e8a800 0x563321e968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.910+0000 7f712ef6bb80 1 --2- 172.21.15.73:0/8316813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563321e8ff50 0x563321e93bb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.910+0000 7f712ef6bb80 1 -- 172.21.15.73:0/8316813 >> 172.21.15.73:0/8316813 conn(0x563321de7cd0 msgr2=0x563321e849b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:07.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.911+0000 7f712ef6bb80 1 -- 172.21.15.73:0/8316813 shutdown_connections 2023-08-10T11:54:07.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.911+0000 7f712ef6bb80 1 -- 172.21.15.73:0/8316813 wait complete. 2023-08-10T11:54:07.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.911+0000 7f712ef6bb80 20 client.25469 trim_cache size 0 max 16384 2023-08-10T11:54:07.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.924+0000 7f712ef6bb80 1 Processor -- start 2023-08-10T11:54:07.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.924+0000 7f712ef6bb80 1 -- start start 2023-08-10T11:54:07.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.924+0000 7f712ef6bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e8a800 0x563321e8a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.924+0000 7f712ef6bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563321e8ff50 0x563321e8f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.924+0000 7f712ef6bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563321e90870 0x563321e85130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.924+0000 7f712ef6bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563321c5e920 con 0x563321e8a800 2023-08-10T11:54:07.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.924+0000 7f712ef6bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563321e81f80 con 0x563321e90870 2023-08-10T11:54:07.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.924+0000 7f712ef6bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563321e906b0 con 0x563321e8ff50 2023-08-10T11:54:07.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.925+0000 7f7120b6e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e8a800 0x563321e8a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.925+0000 7f7120b6e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e8a800 0x563321e8a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34144/0 (socket says 172.21.15.73:34144) 2023-08-10T11:54:07.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.925+0000 7f7120b6e700 1 -- 172.21.15.73:0/1262776933 learned_addr learned my addr 172.21.15.73:0/1262776933 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:07.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.925+0000 7f712136f700 1 --2- 172.21.15.73:0/1262776933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563321e90870 0x563321e85130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.925+0000 7f711bfff700 1 --2- 172.21.15.73:0/1262776933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563321e8ff50 0x563321e8f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.925+0000 7f7120b6e700 1 -- 172.21.15.73:0/1262776933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563321e8ff50 msgr2=0x563321e8f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.925+0000 7f7120b6e700 1 --2- 172.21.15.73:0/1262776933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563321e8ff50 0x563321e8f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.925+0000 7f7120b6e700 1 -- 172.21.15.73:0/1262776933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563321e90870 msgr2=0x563321e85130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.925+0000 7f7120b6e700 1 --2- 172.21.15.73:0/1262776933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563321e90870 0x563321e85130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.925+0000 7f7120b6e700 1 -- 172.21.15.73:0/1262776933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563321bf1c60 con 0x563321e8a800 2023-08-10T11:54:07.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.925+0000 7f7120b6e700 1 --2- 172.21.15.73:0/1262776933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e8a800 0x563321e8a2c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f710c0117d0 tx=0x7f710c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f438e0d1b3960b8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:07.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.925+0000 7f71037fe700 1 -- 172.21.15.73:0/1262776933 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c024040 con 0x563321e8a800 2023-08-10T11:54:07.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.925+0000 7f71037fe700 1 -- 172.21.15.73:0/1262776933 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f710c0044f0 con 0x563321e8a800 2023-08-10T11:54:07.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.925+0000 7f71037fe700 1 -- 172.21.15.73:0/1262776933 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c003680 con 0x563321e8a800 2023-08-10T11:54:07.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.926+0000 7f712ef6bb80 1 -- 172.21.15.73:0/1262776933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e8a800 msgr2=0x563321e8a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.926+0000 7f712ef6bb80 1 --2- 172.21.15.73:0/1262776933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e8a800 0x563321e8a2c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f710c0117d0 tx=0x7f710c014000 comp rx=0 tx=0).stop 2023-08-10T11:54:07.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.926+0000 7f712ef6bb80 1 -- 172.21.15.73:0/1262776933 shutdown_connections 2023-08-10T11:54:07.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.926+0000 7f712ef6bb80 1 --2- 172.21.15.73:0/1262776933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563321e90870 0x563321e85130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.926+0000 7f712ef6bb80 1 --2- 172.21.15.73:0/1262776933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e8a800 0x563321e8a2c0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.926+0000 7f712ef6bb80 1 --2- 172.21.15.73:0/1262776933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563321e8ff50 0x563321e8f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.926+0000 7f712ef6bb80 1 -- 172.21.15.73:0/1262776933 >> 172.21.15.73:0/1262776933 conn(0x563321de7cd0 msgr2=0x563321e8ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:07.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.926+0000 7f712ef6bb80 1 -- 172.21.15.73:0/1262776933 shutdown_connections 2023-08-10T11:54:07.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.926+0000 7f712ef6bb80 1 -- 172.21.15.73:0/1262776933 wait complete. 2023-08-10T11:54:07.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.926+0000 7f712ef6bb80 1 -- start start 2023-08-10T11:54:07.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.926+0000 7f712ef6bb80 1 Processor -- start 2023-08-10T11:54:07.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.926+0000 7f712ef6bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e8a800 0x563321e9b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.927+0000 7f712ef6bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563321e8ff50 0x563321e99530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.927+0000 7f712ef6bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563321e90870 0x563321e99a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.927+0000 7f712ef6bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563321e9a140 con 0x563321e8a800 2023-08-10T11:54:07.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.927+0000 7f712ef6bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563321e9a2b0 con 0x563321e8ff50 2023-08-10T11:54:07.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.927+0000 7f712ef6bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563321ef7a20 con 0x563321e90870 2023-08-10T11:54:07.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.927+0000 7f712ef6bb80 10 client.0 _ll_register_callbacks cb 0x563321d78680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:54:07.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.927+0000 7f7120b6e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e8a800 0x563321e9b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.927+0000 7f7120b6e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e8a800 0x563321e9b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34150/0 (socket says 172.21.15.73:34150) 2023-08-10T11:54:07.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.927+0000 7f7120b6e700 1 -- 172.21.15.73:0/3311192757 learned_addr learned my addr 172.21.15.73:0/3311192757 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:07.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.927+0000 7f711bfff700 1 --2- 172.21.15.73:0/3311192757 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563321e8ff50 0x563321e99530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.927+0000 7f712136f700 1 --2- 172.21.15.73:0/3311192757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563321e90870 0x563321e99a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.927+0000 7f7120b6e700 1 -- 172.21.15.73:0/3311192757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563321e90870 msgr2=0x563321e99a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.927+0000 7f7120b6e700 1 --2- 172.21.15.73:0/3311192757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563321e90870 0x563321e99a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.927+0000 7f7120b6e700 1 -- 172.21.15.73:0/3311192757 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563321e8ff50 msgr2=0x563321e99530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:07.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.927+0000 7f7120b6e700 1 --2- 172.21.15.73:0/3311192757 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563321e8ff50 0x563321e99530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.927+0000 7f7120b6e700 1 -- 172.21.15.73:0/3311192757 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710c017070 con 0x563321e8a800 2023-08-10T11:54:07.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.927+0000 7f7120b6e700 1 --2- 172.21.15.73:0/3311192757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e8a800 0x563321e9b210 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f710c0046e0 tx=0x7f710c01fa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef91027474646b6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:07.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.927+0000 7f70fbfff700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:54:07.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.927+0000 7f70fbfff700 1 -- 172.21.15.73:0/3311192757 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c024050 con 0x563321e8a800 2023-08-10T11:54:07.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.927+0000 7f712ef6bb80 1 -- 172.21.15.73:0/3311192757 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f711400f040 con 0x563321e8a800 2023-08-10T11:54:07.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.927+0000 7f70fbfff700 1 -- 172.21.15.73:0/3311192757 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f710c01fda0 con 0x563321e8a800 2023-08-10T11:54:07.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.927+0000 7f70fbfff700 1 -- 172.21.15.73:0/3311192757 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f710c02a4e0 con 0x563321e8a800 2023-08-10T11:54:07.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.927+0000 7f712ef6bb80 10 client.16062 fetch_fsmap learned FSMap version 31 2023-08-10T11:54:07.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.927+0000 7f712ef6bb80 1 -- 172.21.15.73:0/3311192757 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x563321c2f250 con 0x563321e8a800 2023-08-10T11:54:07.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.928+0000 7f70fbfff700 1 -- 172.21.15.73:0/3311192757 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f711400f040 con 0x563321e8a800 2023-08-10T11:54:07.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.928+0000 7f70fbfff700 1 -- 172.21.15.73:0/3311192757 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 31) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f710c034420 con 0x563321e8a800 2023-08-10T11:54:07.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.928+0000 7f712ef6bb80 10 client.16062 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T11:54:07.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.928+0000 7f712ef6bb80 10 client.16062 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-08-10T11:54:07.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.928+0000 7f712ef6bb80 20 client.16062 populate_metadata read hostname 'smithi073' 2023-08-10T11:54:07.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.928+0000 7f712ef6bb80 1 --2- 172.21.15.73:0/3311192757 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x563321ea3d50 0x563321efb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:07.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.928+0000 7f712ef6bb80 4 client.16062 mds_command: new command op to 24479 tid=0[{"prefix": "damage ls"}] 2023-08-10T11:54:07.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.928+0000 7f712ef6bb80 1 -- 172.21.15.73:0/3311192757 --> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563321dd4780 con 0x563321ea3d50 2023-08-10T11:54:07.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.928+0000 7f711bfff700 1 --2- 172.21.15.73:0/3311192757 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x563321ea3d50 0x563321efb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:07.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.928+0000 7f70fbfff700 10 client.16062 ms_handle_connect on v2:172.21.15.152:6836/74214089 2023-08-10T11:54:07.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.928+0000 7f711bfff700 1 --2- 172.21.15.73:0/3311192757 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x563321ea3d50 0x563321efb000 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b458a330fd240558 server_cookie=c74561aa1b0c196 in_seq=0 out_seq=0 2023-08-10T11:54:07.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.930+0000 7f70fbfff700 1 -- 172.21.15.73:0/3311192757 <== mds.1 v2:172.21.15.152:6836/74214089 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563321dd4780 con 0x563321ea3d50 2023-08-10T11:54:07.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.930+0000 7f70fbfff700 10 client.16062 handle_command_reply: tid=0 2023-08-10T11:54:07.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.930+0000 7f712ef6bb80 1 client.16062 shutdown 2023-08-10T11:54:07.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.930+0000 7f712ef6bb80 1 -- 172.21.15.73:0/3311192757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e8a800 msgr2=0x563321e9b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.930+0000 7f712ef6bb80 1 --2- 172.21.15.73:0/3311192757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e8a800 0x563321e9b210 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f710c0046e0 tx=0x7f710c01fa10 comp rx=0 tx=0).stop 2023-08-10T11:54:07.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.930+0000 7f712ef6bb80 1 -- 172.21.15.73:0/3311192757 shutdown_connections 2023-08-10T11:54:07.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.930+0000 7f712ef6bb80 1 --2- 172.21.15.73:0/3311192757 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x563321ea3d50 0x563321efb000 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.930+0000 7f712ef6bb80 1 --2- 172.21.15.73:0/3311192757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563321e90870 0x563321e99a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.930+0000 7f712ef6bb80 1 --2- 172.21.15.73:0/3311192757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563321e8a800 0x563321e9b210 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.930+0000 7f712ef6bb80 1 --2- 172.21.15.73:0/3311192757 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563321e8ff50 0x563321e99530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.930+0000 7f70fbfff700 0 client.16062 ms_handle_reset on v2:172.21.15.152:6836/74214089 2023-08-10T11:54:07.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.930+0000 7f712ef6bb80 1 -- 172.21.15.73:0/3311192757 >> 172.21.15.73:0/3311192757 conn(0x563321de7cd0 msgr2=0x563321e8f510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:07.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.930+0000 7f712ef6bb80 1 -- 172.21.15.73:0/3311192757 shutdown_connections 2023-08-10T11:54:07.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.930+0000 7f712ef6bb80 1 -- 172.21.15.73:0/3311192757 wait complete. 2023-08-10T11:54:07.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.930+0000 7f712ef6bb80 20 client.16062 trim_cache size 0 max 16384 2023-08-10T11:54:07.962 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2023-08-10T11:54:07.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.930+0000 7f7122dd2700 1 -- 172.21.15.73:0/3746521434 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f71040a13e0 msgr2=0x7f71040a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.930+0000 7f7122dd2700 1 --2- 172.21.15.73:0/3746521434 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f71040a13e0 0x7f71040a38a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f710c009be0 tx=0x7f710c009260 comp rx=0 tx=0).stop 2023-08-10T11:54:07.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.930+0000 7f7122dd2700 1 -- 172.21.15.73:0/3746521434 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f711c0fff90 msgr2=0x7f711c195be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:07.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.930+0000 7f7122dd2700 1 --2- 172.21.15.73:0/3746521434 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f711c0fff90 0x7f711c195be0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7110009990 tx=0x7f711000f690 comp rx=0 tx=0).stop 2023-08-10T11:54:07.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.931+0000 7f7122dd2700 1 -- 172.21.15.73:0/3746521434 shutdown_connections 2023-08-10T11:54:07.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.931+0000 7f7122dd2700 1 --2- 172.21.15.73:0/3746521434 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f71040a13e0 0x7f71040a38a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.931+0000 7f7122dd2700 1 --2- 172.21.15.73:0/3746521434 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f711c0ff5d0 0x7f711c1956a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.931+0000 7f7122dd2700 1 --2- 172.21.15.73:0/3746521434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f711c105690 0x7f711c198f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.931+0000 7f7122dd2700 1 --2- 172.21.15.73:0/3746521434 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f711c0fff90 0x7f711c195be0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:07.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.931+0000 7f7122dd2700 1 -- 172.21.15.73:0/3746521434 >> 172.21.15.73:0/3746521434 conn(0x7f711c0fb0c0 msgr2=0x7f711c0fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:07.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.931+0000 7f7122dd2700 1 -- 172.21.15.73:0/3746521434 shutdown_connections 2023-08-10T11:54:07.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:07.931+0000 7f7122dd2700 1 -- 172.21.15.73:0/3746521434 wait complete. 2023-08-10T11:54:07.965 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:07 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:54:07.965 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:07 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3528709037' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:54:07.966 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-08-10T11:54:07.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:07 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:54:07.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:07 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3528709037' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:54:08.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:07 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:54:08.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:07 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3528709037' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T11:54:08.091 INFO:tasks.workunit.client.0.smithi073.stdout: 13 49637 86 35712 163 7074 192 2023-08-10T11:54:08.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.097+0000 7f5904497700 1 -- 172.21.15.73:0/2065537700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58fc0fff90 msgr2=0x7f58fc10c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.097+0000 7f5904497700 1 --2- 172.21.15.73:0/2065537700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58fc0fff90 0x7f58fc10c450 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f58f400b0d0 tx=0x7f58f400b3e0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.097+0000 7f5904497700 1 -- 172.21.15.73:0/2065537700 shutdown_connections 2023-08-10T11:54:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.097+0000 7f5904497700 1 --2- 172.21.15.73:0/2065537700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58fc0fff90 0x7f58fc10c450 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.097+0000 7f5904497700 1 --2- 172.21.15.73:0/2065537700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58fc105690 0x7f58fc105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.097+0000 7f5904497700 1 --2- 172.21.15.73:0/2065537700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58fc0ff5d0 0x7f58fc0ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.097+0000 7f5904497700 1 -- 172.21.15.73:0/2065537700 >> 172.21.15.73:0/2065537700 conn(0x7f58fc0fb0c0 msgr2=0x7f58fc0fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:08.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.097+0000 7f5904497700 1 -- 172.21.15.73:0/2065537700 shutdown_connections 2023-08-10T11:54:08.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.097+0000 7f5904497700 1 -- 172.21.15.73:0/2065537700 wait complete. 2023-08-10T11:54:08.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.097+0000 7f5904497700 1 Processor -- start 2023-08-10T11:54:08.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.097+0000 7f5904497700 1 -- start start 2023-08-10T11:54:08.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.098+0000 7f5904497700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58fc0ff5d0 0x7f58fc19c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:08.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.098+0000 7f5904497700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58fc0fff90 0x7f58fc19cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:08.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.098+0000 7f5904497700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58fc105690 0x7f58fc1966f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:08.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.098+0000 7f5904497700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc196d60 con 0x7f58fc0ff5d0 2023-08-10T11:54:08.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.098+0000 7f5904497700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc196ed0 con 0x7f58fc0fff90 2023-08-10T11:54:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.098+0000 7f5904497700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc197090 con 0x7f58fc105690 2023-08-10T11:54:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.098+0000 7f5902233700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58fc0ff5d0 0x7f58fc19c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.098+0000 7f5902233700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58fc0ff5d0 0x7f58fc19c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34164/0 (socket says 172.21.15.73:34164) 2023-08-10T11:54:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.098+0000 7f5902233700 1 -- 172.21.15.73:0/3824359047 learned_addr learned my addr 172.21.15.73:0/3824359047 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.098+0000 7f5901a32700 1 --2- 172.21.15.73:0/3824359047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58fc0fff90 0x7f58fc19cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.098+0000 7f5902a34700 1 --2- 172.21.15.73:0/3824359047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58fc105690 0x7f58fc1966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.098+0000 7f5902233700 1 -- 172.21.15.73:0/3824359047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58fc105690 msgr2=0x7f58fc1966f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.098+0000 7f5902233700 1 --2- 172.21.15.73:0/3824359047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58fc105690 0x7f58fc1966f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.098+0000 7f5902233700 1 -- 172.21.15.73:0/3824359047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58fc0fff90 msgr2=0x7f58fc19cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.098+0000 7f5902233700 1 --2- 172.21.15.73:0/3824359047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58fc0fff90 0x7f58fc19cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.098+0000 7f5902233700 1 -- 172.21.15.73:0/3824359047 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f4009d00 con 0x7f58fc0ff5d0 2023-08-10T11:54:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.098+0000 7f5902a34700 1 --2- 172.21.15.73:0/3824359047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58fc105690 0x7f58fc1966f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:54:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.098+0000 7f5902233700 1 --2- 172.21.15.73:0/3824359047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58fc0ff5d0 0x7f58fc19c680 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f58f800e9a0 tx=0x7f58f800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:08.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.098+0000 7f58f37fe700 1 -- 172.21.15.73:0/3824359047 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f8009790 con 0x7f58fc0ff5d0 2023-08-10T11:54:08.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.098+0000 7f58f37fe700 1 -- 172.21.15.73:0/3824359047 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f58f800cbd0 con 0x7f58fc0ff5d0 2023-08-10T11:54:08.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.098+0000 7f5904497700 1 -- 172.21.15.73:0/3824359047 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58fc197370 con 0x7f58fc0ff5d0 2023-08-10T11:54:08.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.098+0000 7f58f37fe700 1 -- 172.21.15.73:0/3824359047 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f8018680 con 0x7f58fc0ff5d0 2023-08-10T11:54:08.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.098+0000 7f5904497700 1 -- 172.21.15.73:0/3824359047 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58fc1a3670 con 0x7f58fc0ff5d0 2023-08-10T11:54:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.100+0000 7f58f37fe700 1 -- 172.21.15.73:0/3824359047 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f58f800cd40 con 0x7f58fc0ff5d0 2023-08-10T11:54:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.101+0000 7f58f37fe700 1 --2- 172.21.15.73:0/3824359047 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f58e80a13e0 0x7f58e80a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.101+0000 7f5901a32700 1 --2- 172.21.15.73:0/3824359047 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f58e80a13e0 0x7f58e80a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.101+0000 7f58f37fe700 1 -- 172.21.15.73:0/3824359047 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f58f8014070 con 0x7f58fc0ff5d0 2023-08-10T11:54:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.101+0000 7f5901a32700 1 --2- 172.21.15.73:0/3824359047 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f58e80a13e0 0x7f58e80a38a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f58fc197b60 tx=0x7f58ec009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:08.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.102+0000 7f5910630b80 1 Processor -- start 2023-08-10T11:54:08.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.102+0000 7f5910630b80 1 -- start start 2023-08-10T11:54:08.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.102+0000 7f5910630b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda88f50 0x55deeda89330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:08.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.102+0000 7f5910630b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55deeda89870 0x55deeda832c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:08.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.102+0000 7f5910630b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55deeda83800 0x55deeda83c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:08.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.102+0000 7f5910630b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deed9fedc0 con 0x55deeda88f50 2023-08-10T11:54:08.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.102+0000 7f5910630b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deed9db590 con 0x55deeda89870 2023-08-10T11:54:08.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.102+0000 7f5910630b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deed9d8eb0 con 0x55deeda83800 2023-08-10T11:54:08.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.102+0000 7f5902233700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda88f50 0x55deeda89330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:08.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.102+0000 7f5901a32700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55deeda89870 0x55deeda832c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:08.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.103+0000 7f5902233700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda88f50 0x55deeda89330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34172/0 (socket says 172.21.15.73:34172) 2023-08-10T11:54:08.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.103+0000 7f5902233700 1 -- 172.21.15.73:0/1631930201 learned_addr learned my addr 172.21.15.73:0/1631930201 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:08.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.103+0000 7f5902a34700 1 --2- 172.21.15.73:0/1631930201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55deeda83800 0x55deeda83c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:08.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.103+0000 7f5902233700 1 -- 172.21.15.73:0/1631930201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55deeda83800 msgr2=0x55deeda83c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:08.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.103+0000 7f5902233700 1 --2- 172.21.15.73:0/1631930201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55deeda83800 0x55deeda83c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.103+0000 7f5902233700 1 -- 172.21.15.73:0/1631930201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55deeda89870 msgr2=0x55deeda832c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:08.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.103+0000 7f5902233700 1 --2- 172.21.15.73:0/1631930201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55deeda89870 0x55deeda832c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.103+0000 7f5902233700 1 -- 172.21.15.73:0/1631930201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55deed855630 con 0x55deeda88f50 2023-08-10T11:54:08.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.103+0000 7f5902233700 1 --2- 172.21.15.73:0/1631930201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda88f50 0x55deeda89330 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f58f809a030 tx=0x7f58f8099a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca2f0ed08633a1f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:08.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.103+0000 7f58f0daa700 1 -- 172.21.15.73:0/1631930201 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f80cd070 con 0x55deeda88f50 2023-08-10T11:54:08.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.103+0000 7f58f0daa700 1 -- 172.21.15.73:0/1631930201 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f58f809e0d0 con 0x55deeda88f50 2023-08-10T11:54:08.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.103+0000 7f58f0daa700 1 -- 172.21.15.73:0/1631930201 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f80caad0 con 0x55deeda88f50 2023-08-10T11:54:08.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.104+0000 7f5910630b80 1 -- 172.21.15.73:0/1631930201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda88f50 msgr2=0x55deeda89330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:08.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.104+0000 7f5910630b80 1 --2- 172.21.15.73:0/1631930201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda88f50 0x55deeda89330 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f58f809a030 tx=0x7f58f8099a80 comp rx=0 tx=0).stop 2023-08-10T11:54:08.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.104+0000 7f5910630b80 1 -- 172.21.15.73:0/1631930201 shutdown_connections 2023-08-10T11:54:08.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.104+0000 7f5910630b80 1 --2- 172.21.15.73:0/1631930201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55deeda83800 0x55deeda83c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.104+0000 7f5910630b80 1 --2- 172.21.15.73:0/1631930201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda88f50 0x55deeda89330 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.104+0000 7f5910630b80 1 --2- 172.21.15.73:0/1631930201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55deeda89870 0x55deeda832c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.104+0000 7f5910630b80 1 -- 172.21.15.73:0/1631930201 >> 172.21.15.73:0/1631930201 conn(0x55deed9e0cd0 msgr2=0x55deeda7e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:08.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.104+0000 7f5910630b80 1 -- 172.21.15.73:0/1631930201 shutdown_connections 2023-08-10T11:54:08.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.104+0000 7f5910630b80 1 -- 172.21.15.73:0/1631930201 wait complete. 2023-08-10T11:54:08.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.104+0000 7f5910630b80 1 -- start start 2023-08-10T11:54:08.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.104+0000 7f5910630b80 1 Processor -- start 2023-08-10T11:54:08.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.105+0000 7f5910630b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55deeda83800 0x55deeda8f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:08.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.105+0000 7f5910630b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55deeda88f50 0x55deeda8cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:08.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.105+0000 7f5910630b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda89870 0x55deeda8d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:08.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.105+0000 7f5910630b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deed9d47a0 con 0x55deeda89870 2023-08-10T11:54:08.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.105+0000 7f5910630b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deed973ac0 con 0x55deeda88f50 2023-08-10T11:54:08.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.105+0000 7f5910630b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deed9737c0 con 0x55deeda83800 2023-08-10T11:54:08.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.105+0000 7f5910630b80 10 client.0 _ll_register_callbacks cb 0x55deed971680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:54:08.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.105+0000 7f5902a34700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda89870 0x55deeda8d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:08.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.105+0000 7f5902a34700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda89870 0x55deeda8d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34182/0 (socket says 172.21.15.73:34182) 2023-08-10T11:54:08.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.105+0000 7f5901a32700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55deeda88f50 0x55deeda8cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:08.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.105+0000 7f5902a34700 1 -- 172.21.15.73:0/127977938 learned_addr learned my addr 172.21.15.73:0/127977938 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:08.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.105+0000 7f5902233700 1 --2- 172.21.15.73:0/127977938 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55deeda83800 0x55deeda8f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:08.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.105+0000 7f5902a34700 1 -- 172.21.15.73:0/127977938 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55deeda83800 msgr2=0x55deeda8f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:08.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.105+0000 7f5902a34700 1 --2- 172.21.15.73:0/127977938 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55deeda83800 0x55deeda8f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.105+0000 7f5902a34700 1 -- 172.21.15.73:0/127977938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55deeda88f50 msgr2=0x55deeda8cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:08.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.105+0000 7f5902a34700 1 --2- 172.21.15.73:0/127977938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55deeda88f50 0x55deeda8cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.105+0000 7f5902a34700 1 -- 172.21.15.73:0/127977938 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58fc1a3670 con 0x55deeda89870 2023-08-10T11:54:08.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.105+0000 7f5902a34700 1 --2- 172.21.15.73:0/127977938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda89870 0x55deeda8d1c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f58f400be10 tx=0x7f58f400be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780d9619a7be74e8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:08.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.105+0000 7f58e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:54:08.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.105+0000 7f58e5ffb700 1 -- 172.21.15.73:0/127977938 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f400e040 con 0x55deeda89870 2023-08-10T11:54:08.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.105+0000 7f58e5ffb700 1 -- 172.21.15.73:0/127977938 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f58f40074e0 con 0x55deeda89870 2023-08-10T11:54:08.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.105+0000 7f5910630b80 1 -- 172.21.15.73:0/127977938 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55deeda76470 con 0x55deeda89870 2023-08-10T11:54:08.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.105+0000 7f58e5ffb700 1 -- 172.21.15.73:0/127977938 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58f40076a0 con 0x55deeda89870 2023-08-10T11:54:08.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.105+0000 7f5910630b80 10 client.16074 fetch_fsmap learned FSMap version 31 2023-08-10T11:54:08.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.106+0000 7f5910630b80 1 -- 172.21.15.73:0/127977938 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55deed801de0 con 0x55deeda89870 2023-08-10T11:54:08.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.106+0000 7f58e5ffb700 1 -- 172.21.15.73:0/127977938 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55deeda76470 con 0x55deeda89870 2023-08-10T11:54:08.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.106+0000 7f58e5ffb700 1 -- 172.21.15.73:0/127977938 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 31) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f58f400b100 con 0x55deeda89870 2023-08-10T11:54:08.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.106+0000 7f5910630b80 10 client.16074 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T11:54:08.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.106+0000 7f5910630b80 10 client.16074 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:54:08.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.106+0000 7f5910630b80 20 client.16074 populate_metadata read hostname 'smithi073' 2023-08-10T11:54:08.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.106+0000 7f5910630b80 1 --2- 172.21.15.73:0/127977938 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55deeda9d300 0x55deeda9f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:08.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.106+0000 7f5910630b80 4 client.16074 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:54:08.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.106+0000 7f5910630b80 1 -- 172.21.15.73:0/127977938 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55deeda529d0 con 0x55deeda9d300 2023-08-10T11:54:08.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.106+0000 7f5902233700 1 --2- 172.21.15.73:0/127977938 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55deeda9d300 0x55deeda9f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:08.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.106+0000 7f58e5ffb700 10 client.16074 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:08.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.106+0000 7f5902233700 1 --2- 172.21.15.73:0/127977938 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55deeda9d300 0x55deeda9f720 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82cbca7817864065 server_cookie=7bd3ef2abea7eab1 in_seq=0 out_seq=0 2023-08-10T11:54:08.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.107+0000 7f58e5ffb700 1 -- 172.21.15.73:0/127977938 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55deeda529d0 con 0x55deeda9d300 2023-08-10T11:54:08.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.107+0000 7f58e5ffb700 10 client.16074 handle_command_reply: tid=0 2023-08-10T11:54:08.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.107+0000 7f5910630b80 1 client.16074 shutdown 2023-08-10T11:54:08.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.107+0000 7f5910630b80 1 -- 172.21.15.73:0/127977938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda89870 msgr2=0x55deeda8d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:08.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.107+0000 7f5910630b80 1 --2- 172.21.15.73:0/127977938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda89870 0x55deeda8d1c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f58f400be10 tx=0x7f58f400be40 comp rx=0 tx=0).stop 2023-08-10T11:54:08.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.107+0000 7f5910630b80 1 -- 172.21.15.73:0/127977938 shutdown_connections 2023-08-10T11:54:08.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.107+0000 7f5910630b80 1 --2- 172.21.15.73:0/127977938 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55deeda9d300 0x55deeda9f720 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.107+0000 7f5910630b80 1 --2- 172.21.15.73:0/127977938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda89870 0x55deeda8d1c0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.107+0000 7f58e5ffb700 0 client.16074 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:08.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.107+0000 7f5910630b80 1 --2- 172.21.15.73:0/127977938 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55deeda83800 0x55deeda8f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.107+0000 7f5910630b80 1 --2- 172.21.15.73:0/127977938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55deeda88f50 0x55deeda8cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.107+0000 7f5910630b80 1 -- 172.21.15.73:0/127977938 >> 172.21.15.73:0/127977938 conn(0x55deed9e0cd0 msgr2=0x55deeda7d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:08.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.108+0000 7f5910630b80 1 -- 172.21.15.73:0/127977938 shutdown_connections 2023-08-10T11:54:08.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.108+0000 7f5910630b80 1 -- 172.21.15.73:0/127977938 wait complete. 2023-08-10T11:54:08.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.108+0000 7f5910630b80 20 client.16074 trim_cache size 0 max 16384 2023-08-10T11:54:08.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.122+0000 7f5910630b80 1 Processor -- start 2023-08-10T11:54:08.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.122+0000 7f5910630b80 1 -- start start 2023-08-10T11:54:08.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.122+0000 7f5910630b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55deeda83800 0x55deeda94300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:08.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.122+0000 7f5910630b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda88f50 0x55deeda7e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:08.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.122+0000 7f5910630b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55deeda89870 0x55deeda7e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:08.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.122+0000 7f5910630b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deed857920 con 0x55deeda88f50 2023-08-10T11:54:08.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.122+0000 7f5910630b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deeda99230 con 0x55deeda89870 2023-08-10T11:54:08.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.122+0000 7f5910630b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deeda7fdb0 con 0x55deeda83800 2023-08-10T11:54:08.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.122+0000 7f5901a32700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda88f50 0x55deeda7e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:08.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.122+0000 7f5901a32700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda88f50 0x55deeda7e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34188/0 (socket says 172.21.15.73:34188) 2023-08-10T11:54:08.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.122+0000 7f5901a32700 1 -- 172.21.15.73:0/3895813846 learned_addr learned my addr 172.21.15.73:0/3895813846 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:08.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.122+0000 7f5902a34700 1 --2- 172.21.15.73:0/3895813846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55deeda89870 0x55deeda7e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:08.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.122+0000 7f5902233700 1 --2- 172.21.15.73:0/3895813846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55deeda83800 0x55deeda94300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:08.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.122+0000 7f5901a32700 1 -- 172.21.15.73:0/3895813846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55deeda83800 msgr2=0x55deeda94300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:08.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.122+0000 7f5901a32700 1 --2- 172.21.15.73:0/3895813846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55deeda83800 0x55deeda94300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.122+0000 7f5901a32700 1 -- 172.21.15.73:0/3895813846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55deeda89870 msgr2=0x55deeda7e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:08.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.122+0000 7f5901a32700 1 --2- 172.21.15.73:0/3895813846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55deeda89870 0x55deeda7e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.122+0000 7f5901a32700 1 -- 172.21.15.73:0/3895813846 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55deed7eac60 con 0x55deeda88f50 2023-08-10T11:54:08.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.122+0000 7f5902233700 1 --2- 172.21.15.73:0/3895813846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55deeda83800 0x55deeda94300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:54:08.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.122+0000 7f5901a32700 1 --2- 172.21.15.73:0/3895813846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda88f50 0x55deeda7e130 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0117d0 tx=0x7f58ec014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed96557b1b366c65 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:08.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.123+0000 7f58f15ab700 1 -- 172.21.15.73:0/3895813846 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec022030 con 0x55deeda88f50 2023-08-10T11:54:08.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.123+0000 7f58f15ab700 1 -- 172.21.15.73:0/3895813846 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f58ec023040 con 0x55deeda88f50 2023-08-10T11:54:08.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.123+0000 7f58f15ab700 1 -- 172.21.15.73:0/3895813846 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec01db90 con 0x55deeda88f50 2023-08-10T11:54:08.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.123+0000 7f5910630b80 1 -- 172.21.15.73:0/3895813846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda88f50 msgr2=0x55deeda7e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:08.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.123+0000 7f5910630b80 1 --2- 172.21.15.73:0/3895813846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda88f50 0x55deeda7e130 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0117d0 tx=0x7f58ec014000 comp rx=0 tx=0).stop 2023-08-10T11:54:08.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.123+0000 7f5910630b80 1 -- 172.21.15.73:0/3895813846 shutdown_connections 2023-08-10T11:54:08.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.123+0000 7f5910630b80 1 --2- 172.21.15.73:0/3895813846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55deeda89870 0x55deeda7e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.123+0000 7f5910630b80 1 --2- 172.21.15.73:0/3895813846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55deeda83800 0x55deeda94300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.123+0000 7f5910630b80 1 --2- 172.21.15.73:0/3895813846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda88f50 0x55deeda7e130 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.123+0000 7f5910630b80 1 -- 172.21.15.73:0/3895813846 >> 172.21.15.73:0/3895813846 conn(0x55deed9e0cd0 msgr2=0x55deeda86c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:08.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.123+0000 7f5910630b80 1 -- 172.21.15.73:0/3895813846 shutdown_connections 2023-08-10T11:54:08.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.123+0000 7f5910630b80 1 -- 172.21.15.73:0/3895813846 wait complete. 2023-08-10T11:54:08.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.123+0000 7f5910630b80 1 -- start start 2023-08-10T11:54:08.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.124+0000 7f5910630b80 1 Processor -- start 2023-08-10T11:54:08.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.124+0000 7f5910630b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda83800 0x55deeda86060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:08.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.124+0000 7f5910630b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55deeda88f50 0x55deeda84970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:08.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.124+0000 7f5910630b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55deeda89870 0x55deeda84eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:08.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.124+0000 7f5910630b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deeda853f0 con 0x55deeda83800 2023-08-10T11:54:08.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.124+0000 7f5910630b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deeda85560 con 0x55deeda89870 2023-08-10T11:54:08.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.124+0000 7f5910630b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deeda85720 con 0x55deeda88f50 2023-08-10T11:54:08.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.124+0000 7f5910630b80 10 client.0 _ll_register_callbacks cb 0x55deed971680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:54:08.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.124+0000 7f5902233700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda83800 0x55deeda86060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:08.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.124+0000 7f5902233700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda83800 0x55deeda86060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34192/0 (socket says 172.21.15.73:34192) 2023-08-10T11:54:08.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.124+0000 7f5902233700 1 -- 172.21.15.73:0/2687441991 learned_addr learned my addr 172.21.15.73:0/2687441991 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:08.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.124+0000 7f5902a34700 1 --2- 172.21.15.73:0/2687441991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55deeda89870 0x55deeda84eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:08.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.124+0000 7f5901a32700 1 --2- 172.21.15.73:0/2687441991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55deeda88f50 0x55deeda84970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:08.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.124+0000 7f5902233700 1 -- 172.21.15.73:0/2687441991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55deeda88f50 msgr2=0x55deeda84970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:08.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.124+0000 7f5902233700 1 --2- 172.21.15.73:0/2687441991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55deeda88f50 0x55deeda84970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.124+0000 7f5902233700 1 -- 172.21.15.73:0/2687441991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55deeda89870 msgr2=0x55deeda84eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:08.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.124+0000 7f5902233700 1 --2- 172.21.15.73:0/2687441991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55deeda89870 0x55deeda84eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.124+0000 7f5902233700 1 -- 172.21.15.73:0/2687441991 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58ec017070 con 0x55deeda83800 2023-08-10T11:54:08.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.124+0000 7f5902a34700 1 --2- 172.21.15.73:0/2687441991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55deeda89870 0x55deeda84eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:54:08.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.124+0000 7f5901a32700 1 --2- 172.21.15.73:0/2687441991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55deeda88f50 0x55deeda84970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:54:08.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.124+0000 7f5902233700 1 --2- 172.21.15.73:0/2687441991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda83800 0x55deeda86060 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f58f80a1fc0 tx=0x7f58f8010b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72bf0dd2ef865bb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:08.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.124+0000 7f58e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:54:08.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.124+0000 7f58e5ffb700 1 -- 172.21.15.73:0/2687441991 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f80cd040 con 0x55deeda83800 2023-08-10T11:54:08.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.124+0000 7f58e5ffb700 1 -- 172.21.15.73:0/2687441991 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f58f8099590 con 0x55deeda83800 2023-08-10T11:54:08.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.124+0000 7f5910630b80 1 -- 172.21.15.73:0/2687441991 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f58f809e0d0 con 0x55deeda83800 2023-08-10T11:54:08.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.125+0000 7f58e5ffb700 1 -- 172.21.15.73:0/2687441991 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58f8099750 con 0x55deeda83800 2023-08-10T11:54:08.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.125+0000 7f5910630b80 10 client.16080 fetch_fsmap learned FSMap version 31 2023-08-10T11:54:08.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.125+0000 7f5910630b80 1 -- 172.21.15.73:0/2687441991 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55deed828250 con 0x55deeda83800 2023-08-10T11:54:08.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.125+0000 7f58e5ffb700 1 -- 172.21.15.73:0/2687441991 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f58f809e0d0 con 0x55deeda83800 2023-08-10T11:54:08.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.125+0000 7f58e5ffb700 1 -- 172.21.15.73:0/2687441991 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 31) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f58f8099000 con 0x55deeda83800 2023-08-10T11:54:08.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.125+0000 7f5910630b80 10 client.16080 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T11:54:08.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.125+0000 7f5910630b80 10 client.16080 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:54:08.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.125+0000 7f5910630b80 20 client.16080 populate_metadata read hostname 'smithi073' 2023-08-10T11:54:08.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.125+0000 7f5910630b80 1 --2- 172.21.15.73:0/2687441991 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55deedaf2060 0x55deedaf4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:08.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.125+0000 7f5910630b80 4 client.16080 mds_command: new command op to 24503 tid=0[{"prefix": "damage ls"}] 2023-08-10T11:54:08.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.125+0000 7f5910630b80 1 -- 172.21.15.73:0/2687441991 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55deed9cd780 con 0x55deedaf2060 2023-08-10T11:54:08.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.125+0000 7f5901a32700 1 --2- 172.21.15.73:0/2687441991 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55deedaf2060 0x55deedaf4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:08.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.125+0000 7f58e5ffb700 10 client.16080 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:08.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.125+0000 7f5901a32700 1 --2- 172.21.15.73:0/2687441991 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55deedaf2060 0x55deedaf4480 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a841fdcbe7f57ac0 server_cookie=c26f7324bc264dfb in_seq=0 out_seq=0 2023-08-10T11:54:08.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.126+0000 7f58e5ffb700 1 -- 172.21.15.73:0/2687441991 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55deed9cd780 con 0x55deedaf2060 2023-08-10T11:54:08.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.126+0000 7f58e5ffb700 10 client.16080 handle_command_reply: tid=0 2023-08-10T11:54:08.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.126+0000 7f5910630b80 1 client.16080 shutdown 2023-08-10T11:54:08.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.126+0000 7f5910630b80 1 -- 172.21.15.73:0/2687441991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda83800 msgr2=0x55deeda86060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:08.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.126+0000 7f5910630b80 1 --2- 172.21.15.73:0/2687441991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda83800 0x55deeda86060 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f58f80a1fc0 tx=0x7f58f8010b50 comp rx=0 tx=0).stop 2023-08-10T11:54:08.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.126+0000 7f5910630b80 1 -- 172.21.15.73:0/2687441991 shutdown_connections 2023-08-10T11:54:08.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.126+0000 7f5910630b80 1 --2- 172.21.15.73:0/2687441991 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55deedaf2060 0x55deedaf4480 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.126+0000 7f5910630b80 1 --2- 172.21.15.73:0/2687441991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55deeda89870 0x55deeda84eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.126+0000 7f58e5ffb700 0 client.16080 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:08.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.126+0000 7f5910630b80 1 --2- 172.21.15.73:0/2687441991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55deeda83800 0x55deeda86060 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.126+0000 7f5910630b80 1 --2- 172.21.15.73:0/2687441991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55deeda88f50 0x55deeda84970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.126+0000 7f5910630b80 1 -- 172.21.15.73:0/2687441991 >> 172.21.15.73:0/2687441991 conn(0x55deed9e0cd0 msgr2=0x55deeda87ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:08.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.126+0000 7f5910630b80 1 -- 172.21.15.73:0/2687441991 shutdown_connections 2023-08-10T11:54:08.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.126+0000 7f5910630b80 1 -- 172.21.15.73:0/2687441991 wait complete. 2023-08-10T11:54:08.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.126+0000 7f5910630b80 20 client.16080 trim_cache size 0 max 16384 2023-08-10T11:54:08.141 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2023-08-10T11:54:08.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.126+0000 7f5904497700 1 -- 172.21.15.73:0/3824359047 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f58e80a13e0 msgr2=0x7f58e80a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:08.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.126+0000 7f5904497700 1 --2- 172.21.15.73:0/3824359047 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f58e80a13e0 0x7f58e80a38a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f58fc197b60 tx=0x7f58ec009260 comp rx=0 tx=0).stop 2023-08-10T11:54:08.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.126+0000 7f5904497700 1 -- 172.21.15.73:0/3824359047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58fc0ff5d0 msgr2=0x7f58fc19c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:08.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.126+0000 7f5904497700 1 --2- 172.21.15.73:0/3824359047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58fc0ff5d0 0x7f58fc19c680 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f58f800e9a0 tx=0x7f58f800ecb0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.126+0000 7f5904497700 1 -- 172.21.15.73:0/3824359047 shutdown_connections 2023-08-10T11:54:08.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.126+0000 7f5904497700 1 --2- 172.21.15.73:0/3824359047 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f58e80a13e0 0x7f58e80a38a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.126+0000 7f5904497700 1 --2- 172.21.15.73:0/3824359047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58fc105690 0x7f58fc1966f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.126+0000 7f5904497700 1 --2- 172.21.15.73:0/3824359047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58fc0ff5d0 0x7f58fc19c680 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.126+0000 7f5904497700 1 --2- 172.21.15.73:0/3824359047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58fc0fff90 0x7f58fc19cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:08.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.126+0000 7f5904497700 1 -- 172.21.15.73:0/3824359047 >> 172.21.15.73:0/3824359047 conn(0x7f58fc0fb0c0 msgr2=0x7f58fc0fcc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:08.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.127+0000 7f5904497700 1 -- 172.21.15.73:0/3824359047 shutdown_connections 2023-08-10T11:54:08.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:08.127+0000 7f5904497700 1 -- 172.21.15.73:0/3824359047 wait complete. 2023-08-10T11:54:08.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:08 smithi152 ceph-mon[130220]: pgmap v48: 97 pgs: 97 active+clean; 40 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 220 op/s 2023-08-10T11:54:09.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:08 smithi156 ceph-mon[130574]: pgmap v48: 97 pgs: 97 active+clean; 40 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 220 op/s 2023-08-10T11:54:09.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:08 smithi073 ceph-mon[128869]: pgmap v48: 97 pgs: 97 active+clean; 40 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 220 op/s 2023-08-10T11:54:09.145 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-08-10T11:54:09.145 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-08-10T11:54:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.277+0000 7f51e7381700 1 -- 172.21.15.73:0/3475875852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51e01006a0 msgr2=0x7f51e010c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.277+0000 7f51e7381700 1 --2- 172.21.15.73:0/3475875852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51e01006a0 0x7f51e010c550 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f51d800b0a0 tx=0x7f51d800b3b0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.277+0000 7f51e7381700 1 -- 172.21.15.73:0/3475875852 shutdown_connections 2023-08-10T11:54:09.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.277+0000 7f51e7381700 1 --2- 172.21.15.73:0/3475875852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51e01006a0 0x7f51e010c550 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.277+0000 7f51e7381700 1 --2- 172.21.15.73:0/3475875852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51e0105690 0x7f51e0105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.277+0000 7f51e7381700 1 --2- 172.21.15.73:0/3475875852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51e00ffce0 0x7f51e0100160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.277+0000 7f51e7381700 1 -- 172.21.15.73:0/3475875852 >> 172.21.15.73:0/3475875852 conn(0x7f51e0076be0 msgr2=0x7f51e00fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:09.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.277+0000 7f51e7381700 1 -- 172.21.15.73:0/3475875852 shutdown_connections 2023-08-10T11:54:09.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.277+0000 7f51e7381700 1 -- 172.21.15.73:0/3475875852 wait complete. 2023-08-10T11:54:09.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.278+0000 7f51e7381700 1 Processor -- start 2023-08-10T11:54:09.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.278+0000 7f51e7381700 1 -- start start 2023-08-10T11:54:09.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.278+0000 7f51e7381700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51e00ffce0 0x7f51e019c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.278+0000 7f51e7381700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51e01006a0 0x7f51e019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.278+0000 7f51e7381700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51e0105690 0x7f51e0196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.278+0000 7f51e7381700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e0196d70 con 0x7f51e01006a0 2023-08-10T11:54:09.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.278+0000 7f51e7381700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e0196ee0 con 0x7f51e00ffce0 2023-08-10T11:54:09.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.278+0000 7f51e7381700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e01970a0 con 0x7f51e0105690 2023-08-10T11:54:09.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.278+0000 7f51e491c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51e01006a0 0x7f51e019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.278+0000 7f51e491c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51e01006a0 0x7f51e019cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34208/0 (socket says 172.21.15.73:34208) 2023-08-10T11:54:09.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.278+0000 7f51e491c700 1 -- 172.21.15.73:0/3326849430 learned_addr learned my addr 172.21.15.73:0/3326849430 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:09.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.278+0000 7f51e511d700 1 --2- 172.21.15.73:0/3326849430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51e00ffce0 0x7f51e019c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.278+0000 7f51e591e700 1 --2- 172.21.15.73:0/3326849430 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51e0105690 0x7f51e0196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.278+0000 7f51e491c700 1 -- 172.21.15.73:0/3326849430 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51e0105690 msgr2=0x7f51e0196700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:09.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.278+0000 7f51e491c700 1 --2- 172.21.15.73:0/3326849430 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51e0105690 0x7f51e0196700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.278+0000 7f51e491c700 1 -- 172.21.15.73:0/3326849430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51e00ffce0 msgr2=0x7f51e019c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:09.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.278+0000 7f51e491c700 1 --2- 172.21.15.73:0/3326849430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51e00ffce0 0x7f51e019c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.278+0000 7f51e491c700 1 -- 172.21.15.73:0/3326849430 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d8009d00 con 0x7f51e01006a0 2023-08-10T11:54:09.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.278+0000 7f51e491c700 1 --2- 172.21.15.73:0/3326849430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51e01006a0 0x7f51e019cbd0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00d980 tx=0x7f51dc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:09.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.279+0000 7f51d67fc700 1 -- 172.21.15.73:0/3326849430 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc004220 con 0x7f51e01006a0 2023-08-10T11:54:09.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.279+0000 7f51e7381700 1 -- 172.21.15.73:0/3326849430 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e0197380 con 0x7f51e01006a0 2023-08-10T11:54:09.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.279+0000 7f51d67fc700 1 -- 172.21.15.73:0/3326849430 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f51dc007640 con 0x7f51e01006a0 2023-08-10T11:54:09.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.279+0000 7f51d67fc700 1 -- 172.21.15.73:0/3326849430 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc005610 con 0x7f51e01006a0 2023-08-10T11:54:09.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.279+0000 7f51e7381700 1 -- 172.21.15.73:0/3326849430 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e01a3680 con 0x7f51e01006a0 2023-08-10T11:54:09.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.281+0000 7f51d67fc700 1 -- 172.21.15.73:0/3326849430 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f51dc004750 con 0x7f51e01006a0 2023-08-10T11:54:09.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.281+0000 7f51d67fc700 1 --2- 172.21.15.73:0/3326849430 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f51cc0a12c0 0x7f51cc0a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.282+0000 7f51e511d700 1 --2- 172.21.15.73:0/3326849430 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f51cc0a12c0 0x7f51cc0a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.282+0000 7f51d67fc700 1 -- 172.21.15.73:0/3326849430 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f51dc0ccb80 con 0x7f51e01006a0 2023-08-10T11:54:09.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.282+0000 7f51e511d700 1 --2- 172.21.15.73:0/3326849430 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f51cc0a12c0 0x7f51cc0a3780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f51d0009a10 tx=0x7f51d0009190 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:09.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.282+0000 7f51f351ab80 1 Processor -- start 2023-08-10T11:54:09.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.282+0000 7f51f351ab80 1 -- start start 2023-08-10T11:54:09.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.283+0000 7f51f351ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604672eafd0 0x5604672eb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.283+0000 7f51f351ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604672eb8f0 0x5604672e5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.283+0000 7f51f351ab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672e5880 0x5604672e5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.283+0000 7f51f351ab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x560467260e40 con 0x5604672e5880 2023-08-10T11:54:09.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.283+0000 7f51f351ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56046723d610 con 0x5604672eafd0 2023-08-10T11:54:09.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.283+0000 7f51f351ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56046723af30 con 0x5604672eb8f0 2023-08-10T11:54:09.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.283+0000 7f51e511d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604672eafd0 0x5604672eb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.283+0000 7f51e591e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672e5880 0x5604672e5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.283+0000 7f51e511d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604672eafd0 0x5604672eb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:48864/0 (socket says 172.21.15.73:48864) 2023-08-10T11:54:09.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.283+0000 7f51e511d700 1 -- 172.21.15.73:0/1229786991 learned_addr learned my addr 172.21.15.73:0/1229786991 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:09.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.283+0000 7f51e591e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672e5880 0x5604672e5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34218/0 (socket says 172.21.15.73:34218) 2023-08-10T11:54:09.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.283+0000 7f51e491c700 1 --2- 172.21.15.73:0/1229786991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604672eb8f0 0x5604672e5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.283+0000 7f51e591e700 1 -- 172.21.15.73:0/1229786991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604672eb8f0 msgr2=0x5604672e5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:09.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.283+0000 7f51e591e700 1 --2- 172.21.15.73:0/1229786991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604672eb8f0 0x5604672e5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.283+0000 7f51e591e700 1 -- 172.21.15.73:0/1229786991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604672eafd0 msgr2=0x5604672eb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:09.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.283+0000 7f51e591e700 1 --2- 172.21.15.73:0/1229786991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604672eafd0 0x5604672eb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.283+0000 7f51e591e700 1 -- 172.21.15.73:0/1229786991 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604670b76b0 con 0x5604672e5880 2023-08-10T11:54:09.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.283+0000 7f51e511d700 1 --2- 172.21.15.73:0/1229786991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604672eafd0 0x5604672eb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:09.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.283+0000 7f51e591e700 1 --2- 172.21.15.73:0/1229786991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672e5880 0x5604672e5d00 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f51e019d390 tx=0x7f51d8009170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e93c04ed24406d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:09.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.283+0000 7f51cb7fe700 1 -- 172.21.15.73:0/1229786991 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d800e050 con 0x5604672e5880 2023-08-10T11:54:09.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.283+0000 7f51cb7fe700 1 -- 172.21.15.73:0/1229786991 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f51d80074e0 con 0x5604672e5880 2023-08-10T11:54:09.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.283+0000 7f51cb7fe700 1 -- 172.21.15.73:0/1229786991 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d8005420 con 0x5604672e5880 2023-08-10T11:54:09.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.284+0000 7f51f351ab80 1 -- 172.21.15.73:0/1229786991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672e5880 msgr2=0x5604672e5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:09.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.284+0000 7f51f351ab80 1 --2- 172.21.15.73:0/1229786991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672e5880 0x5604672e5d00 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f51e019d390 tx=0x7f51d8009170 comp rx=0 tx=0).stop 2023-08-10T11:54:09.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.284+0000 7f51f351ab80 1 -- 172.21.15.73:0/1229786991 shutdown_connections 2023-08-10T11:54:09.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.284+0000 7f51f351ab80 1 --2- 172.21.15.73:0/1229786991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604672eafd0 0x5604672eb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.284+0000 7f51f351ab80 1 --2- 172.21.15.73:0/1229786991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672e5880 0x5604672e5d00 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.284+0000 7f51f351ab80 1 --2- 172.21.15.73:0/1229786991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604672eb8f0 0x5604672e5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.284+0000 7f51f351ab80 1 -- 172.21.15.73:0/1229786991 >> 172.21.15.73:0/1229786991 conn(0x560467242d50 msgr2=0x5604672e0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:09.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.284+0000 7f51f351ab80 1 -- 172.21.15.73:0/1229786991 shutdown_connections 2023-08-10T11:54:09.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.284+0000 7f51f351ab80 1 -- 172.21.15.73:0/1229786991 wait complete. 2023-08-10T11:54:09.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.285+0000 7f51f351ab80 1 -- start start 2023-08-10T11:54:09.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.285+0000 7f51f351ab80 1 Processor -- start 2023-08-10T11:54:09.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.285+0000 7f51f351ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604672e5880 0x5604672f1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.285+0000 7f51f351ab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672eafd0 0x5604672eec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.285+0000 7f51f351ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604672eb8f0 0x5604672ef310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.285+0000 7f51f351ab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x560467236820 con 0x5604672eafd0 2023-08-10T11:54:09.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.285+0000 7f51f351ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604671d5b40 con 0x5604672eb8f0 2023-08-10T11:54:09.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.285+0000 7f51f351ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604671d5840 con 0x5604672e5880 2023-08-10T11:54:09.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.285+0000 7f51f351ab80 10 client.0 _ll_register_callbacks cb 0x5604671d3700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:54:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.285+0000 7f51e491c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672eafd0 0x5604672eec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.285+0000 7f51e491c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672eafd0 0x5604672eec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34222/0 (socket says 172.21.15.73:34222) 2023-08-10T11:54:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.285+0000 7f51e491c700 1 -- 172.21.15.73:0/20964179 learned_addr learned my addr 172.21.15.73:0/20964179 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.285+0000 7f51e591e700 1 --2- 172.21.15.73:0/20964179 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604672eb8f0 0x5604672ef310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.286+0000 7f51e511d700 1 --2- 172.21.15.73:0/20964179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604672e5880 0x5604672f1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.286+0000 7f51e491c700 1 -- 172.21.15.73:0/20964179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604672e5880 msgr2=0x5604672f1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.286+0000 7f51e491c700 1 --2- 172.21.15.73:0/20964179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604672e5880 0x5604672f1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.286+0000 7f51e491c700 1 -- 172.21.15.73:0/20964179 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604672eb8f0 msgr2=0x5604672ef310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:09.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.286+0000 7f51e491c700 1 --2- 172.21.15.73:0/20964179 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604672eb8f0 0x5604672ef310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.286+0000 7f51e491c700 1 -- 172.21.15.73:0/20964179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d000e6e0 con 0x5604672eafd0 2023-08-10T11:54:09.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.286+0000 7f51e511d700 1 --2- 172.21.15.73:0/20964179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604672e5880 0x5604672f1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:54:09.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.286+0000 7f51e491c700 1 --2- 172.21.15.73:0/20964179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672eafd0 0x5604672eec70 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f51dc099c10 tx=0x7f51dc00f500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544bd9022dfa1da4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:09.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.286+0000 7f51c8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:54:09.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.286+0000 7f51c8ff9700 1 -- 172.21.15.73:0/20964179 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc0a20d0 con 0x5604672eafd0 2023-08-10T11:54:09.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.286+0000 7f51c8ff9700 1 -- 172.21.15.73:0/20964179 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f51dc0b2220 con 0x5604672eafd0 2023-08-10T11:54:09.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.286+0000 7f51f351ab80 1 -- 172.21.15.73:0/20964179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604672d84f0 con 0x5604672eafd0 2023-08-10T11:54:09.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.286+0000 7f51c8ff9700 1 -- 172.21.15.73:0/20964179 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51dc0b23e0 con 0x5604672eafd0 2023-08-10T11:54:09.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.286+0000 7f51f351ab80 10 client.16092 fetch_fsmap learned FSMap version 31 2023-08-10T11:54:09.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.286+0000 7f51f351ab80 1 -- 172.21.15.73:0/20964179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f51e010ce50 con 0x5604672eafd0 2023-08-10T11:54:09.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.286+0000 7f51c8ff9700 1 -- 172.21.15.73:0/20964179 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5604672d84f0 con 0x5604672eafd0 2023-08-10T11:54:09.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.286+0000 7f51c8ff9700 1 -- 172.21.15.73:0/20964179 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 31) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f51dc099270 con 0x5604672eafd0 2023-08-10T11:54:09.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.286+0000 7f51f351ab80 10 client.16092 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T11:54:09.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.287+0000 7f51f351ab80 10 client.16092 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:54:09.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.287+0000 7f51f351ab80 20 client.16092 populate_metadata read hostname 'smithi073' 2023-08-10T11:54:09.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.287+0000 7f51f351ab80 1 --2- 172.21.15.73:0/20964179 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5604672ff2a0 0x5604673016c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.287+0000 7f51f351ab80 4 client.16092 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:54:09.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.287+0000 7f51f351ab80 1 -- 172.21.15.73:0/20964179 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5604672b4a50 con 0x5604672ff2a0 2023-08-10T11:54:09.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.287+0000 7f51e511d700 1 --2- 172.21.15.73:0/20964179 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5604672ff2a0 0x5604673016c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.287+0000 7f51e511d700 1 --2- 172.21.15.73:0/20964179 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5604672ff2a0 0x5604673016c0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e09c8c2709052a8 server_cookie=276d98727ab15457 in_seq=0 out_seq=0 2023-08-10T11:54:09.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.287+0000 7f51c8ff9700 10 client.16092 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:09.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.288+0000 7f51c8ff9700 1 -- 172.21.15.73:0/20964179 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5604672b4a50 con 0x5604672ff2a0 2023-08-10T11:54:09.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.288+0000 7f51c8ff9700 10 client.16092 handle_command_reply: tid=0 2023-08-10T11:54:09.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.288+0000 7f51f351ab80 1 client.16092 shutdown 2023-08-10T11:54:09.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.288+0000 7f51f351ab80 1 -- 172.21.15.73:0/20964179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672eafd0 msgr2=0x5604672eec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:09.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.288+0000 7f51f351ab80 1 --2- 172.21.15.73:0/20964179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672eafd0 0x5604672eec70 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f51dc099c10 tx=0x7f51dc00f500 comp rx=0 tx=0).stop 2023-08-10T11:54:09.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.288+0000 7f51f351ab80 1 -- 172.21.15.73:0/20964179 shutdown_connections 2023-08-10T11:54:09.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.288+0000 7f51f351ab80 1 --2- 172.21.15.73:0/20964179 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5604672ff2a0 0x5604673016c0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.288+0000 7f51f351ab80 1 --2- 172.21.15.73:0/20964179 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604672eb8f0 0x5604672ef310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.288+0000 7f51c8ff9700 0 client.16092 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:09.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.288+0000 7f51f351ab80 1 --2- 172.21.15.73:0/20964179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604672e5880 0x5604672f1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.288+0000 7f51f351ab80 1 --2- 172.21.15.73:0/20964179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672eafd0 0x5604672eec70 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.288+0000 7f51f351ab80 1 -- 172.21.15.73:0/20964179 >> 172.21.15.73:0/20964179 conn(0x560467242d50 msgr2=0x5604672dfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:09.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.288+0000 7f51f351ab80 1 -- 172.21.15.73:0/20964179 shutdown_connections 2023-08-10T11:54:09.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.288+0000 7f51f351ab80 1 -- 172.21.15.73:0/20964179 wait complete. 2023-08-10T11:54:09.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.288+0000 7f51f351ab80 20 client.16092 trim_cache size 0 max 16384 2023-08-10T11:54:09.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.305+0000 7f51f351ab80 1 Processor -- start 2023-08-10T11:54:09.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.305+0000 7f51f351ab80 1 -- start start 2023-08-10T11:54:09.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.306+0000 7f51f351ab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672e5880 0x5604672e5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.306+0000 7f51f351ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604672eafd0 0x5604672ea510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.306+0000 7f51f351ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604672eb8f0 0x5604672f6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.306+0000 7f51f351ab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604670b99a0 con 0x5604672e5880 2023-08-10T11:54:09.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.306+0000 7f51f351ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604672dd000 con 0x5604672eafd0 2023-08-10T11:54:09.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.306+0000 7f51f351ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604672f01e0 con 0x5604672eb8f0 2023-08-10T11:54:09.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.306+0000 7f51e511d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672e5880 0x5604672e5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.306+0000 7f51e511d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672e5880 0x5604672e5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34228/0 (socket says 172.21.15.73:34228) 2023-08-10T11:54:09.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.306+0000 7f51e511d700 1 -- 172.21.15.73:0/3686453554 learned_addr learned my addr 172.21.15.73:0/3686453554 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:09.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.306+0000 7f51e491c700 1 --2- 172.21.15.73:0/3686453554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604672eafd0 0x5604672ea510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.306+0000 7f51e591e700 1 --2- 172.21.15.73:0/3686453554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604672eb8f0 0x5604672f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.306+0000 7f51e511d700 1 -- 172.21.15.73:0/3686453554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604672eb8f0 msgr2=0x5604672f6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:09.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.306+0000 7f51e511d700 1 --2- 172.21.15.73:0/3686453554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604672eb8f0 0x5604672f6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.306+0000 7f51e511d700 1 -- 172.21.15.73:0/3686453554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604672eafd0 msgr2=0x5604672ea510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:09.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.306+0000 7f51e511d700 1 --2- 172.21.15.73:0/3686453554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604672eafd0 0x5604672ea510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.306+0000 7f51e511d700 1 -- 172.21.15.73:0/3686453554 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560467063e60 con 0x5604672e5880 2023-08-10T11:54:09.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.306+0000 7f51e511d700 1 --2- 172.21.15.73:0/3686453554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672e5880 0x5604672e5340 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x560467301ff0 tx=0x7f51d0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c326b51338253e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:09.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.306+0000 7f51cbfff700 1 -- 172.21.15.73:0/3686453554 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d000ee90 con 0x5604672e5880 2023-08-10T11:54:09.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.306+0000 7f51cbfff700 1 -- 172.21.15.73:0/3686453554 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f51d0025040 con 0x5604672e5880 2023-08-10T11:54:09.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.306+0000 7f51cbfff700 1 -- 172.21.15.73:0/3686453554 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d001fc60 con 0x5604672e5880 2023-08-10T11:54:09.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.307+0000 7f51f351ab80 1 -- 172.21.15.73:0/3686453554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672e5880 msgr2=0x5604672e5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:09.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.307+0000 7f51f351ab80 1 --2- 172.21.15.73:0/3686453554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672e5880 0x5604672e5340 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x560467301ff0 tx=0x7f51d0015000 comp rx=0 tx=0).stop 2023-08-10T11:54:09.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.307+0000 7f51f351ab80 1 -- 172.21.15.73:0/3686453554 shutdown_connections 2023-08-10T11:54:09.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.307+0000 7f51f351ab80 1 --2- 172.21.15.73:0/3686453554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604672eb8f0 0x5604672f6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.307+0000 7f51f351ab80 1 --2- 172.21.15.73:0/3686453554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672e5880 0x5604672e5340 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.307+0000 7f51f351ab80 1 --2- 172.21.15.73:0/3686453554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604672eafd0 0x5604672ea510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.307+0000 7f51f351ab80 1 -- 172.21.15.73:0/3686453554 >> 172.21.15.73:0/3686453554 conn(0x560467242d50 msgr2=0x5604672ebcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:09.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.307+0000 7f51f351ab80 1 -- 172.21.15.73:0/3686453554 shutdown_connections 2023-08-10T11:54:09.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.307+0000 7f51f351ab80 1 -- 172.21.15.73:0/3686453554 wait complete. 2023-08-10T11:54:09.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.307+0000 7f51f351ab80 1 -- start start 2023-08-10T11:54:09.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.308+0000 7f51f351ab80 1 Processor -- start 2023-08-10T11:54:09.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.308+0000 7f51f351ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604672e5880 0x5604672f5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.308+0000 7f51f351ab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672eafd0 0x5604672f5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.308+0000 7f51f351ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604672eb8f0 0x56046734bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.308+0000 7f51f351ab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56046734c4b0 con 0x5604672eafd0 2023-08-10T11:54:09.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.308+0000 7f51f351ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56046734c620 con 0x5604672eb8f0 2023-08-10T11:54:09.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.308+0000 7f51f351ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56046734c7e0 con 0x5604672e5880 2023-08-10T11:54:09.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.308+0000 7f51f351ab80 10 client.0 _ll_register_callbacks cb 0x5604671d3700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:54:09.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.308+0000 7f51e491c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672eafd0 0x5604672f5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.308+0000 7f51e491c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672eafd0 0x5604672f5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34236/0 (socket says 172.21.15.73:34236) 2023-08-10T11:54:09.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.308+0000 7f51e491c700 1 -- 172.21.15.73:0/2443746349 learned_addr learned my addr 172.21.15.73:0/2443746349 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:09.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.308+0000 7f51e591e700 1 --2- 172.21.15.73:0/2443746349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604672eb8f0 0x56046734bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.308+0000 7f51e511d700 1 --2- 172.21.15.73:0/2443746349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604672e5880 0x5604672f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.309+0000 7f51e491c700 1 -- 172.21.15.73:0/2443746349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604672e5880 msgr2=0x5604672f5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:09.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.309+0000 7f51e491c700 1 --2- 172.21.15.73:0/2443746349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604672e5880 0x5604672f5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.309+0000 7f51e491c700 1 -- 172.21.15.73:0/2443746349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604672eb8f0 msgr2=0x56046734bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:09.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.309+0000 7f51e491c700 1 --2- 172.21.15.73:0/2443746349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604672eb8f0 0x56046734bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.309+0000 7f51e491c700 1 -- 172.21.15.73:0/2443746349 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d001a040 con 0x5604672eafd0 2023-08-10T11:54:09.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.309+0000 7f51e511d700 1 --2- 172.21.15.73:0/2443746349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604672e5880 0x5604672f5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:54:09.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.309+0000 7f51e491c700 1 --2- 172.21.15.73:0/2443746349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672eafd0 0x5604672f5790 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f51dc097fd0 tx=0x7f51dc099690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733d11370f77dd59 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:09.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.309+0000 7f51c8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:54:09.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.309+0000 7f51c8ff9700 1 -- 172.21.15.73:0/2443746349 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc0b2420 con 0x5604672eafd0 2023-08-10T11:54:09.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.309+0000 7f51c8ff9700 1 -- 172.21.15.73:0/2443746349 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f51dc0a20d0 con 0x5604672eafd0 2023-08-10T11:54:09.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.309+0000 7f51f351ab80 1 -- 172.21.15.73:0/2443746349 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f51d80074e0 con 0x5604672eafd0 2023-08-10T11:54:09.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.309+0000 7f51c8ff9700 1 -- 172.21.15.73:0/2443746349 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51dc0a1f00 con 0x5604672eafd0 2023-08-10T11:54:09.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.309+0000 7f51f351ab80 10 client.16098 fetch_fsmap learned FSMap version 31 2023-08-10T11:54:09.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.309+0000 7f51f351ab80 1 -- 172.21.15.73:0/2443746349 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x56046704cce0 con 0x5604672eafd0 2023-08-10T11:54:09.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.309+0000 7f51c8ff9700 1 -- 172.21.15.73:0/2443746349 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f51d80074e0 con 0x5604672eafd0 2023-08-10T11:54:09.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.309+0000 7f51c8ff9700 1 -- 172.21.15.73:0/2443746349 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 31) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f51dc099200 con 0x5604672eafd0 2023-08-10T11:54:09.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.309+0000 7f51f351ab80 10 client.16098 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T11:54:09.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.309+0000 7f51f351ab80 10 client.16098 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:54:09.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.309+0000 7f51f351ab80 20 client.16098 populate_metadata read hostname 'smithi073' 2023-08-10T11:54:09.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.309+0000 7f51f351ab80 1 --2- 172.21.15.73:0/2443746349 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x560467354f20 0x560467357340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.309+0000 7f51f351ab80 4 client.16098 mds_command: new command op to 24503 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-08-10T11:54:09.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.309+0000 7f51f351ab80 1 -- 172.21.15.73:0/2443746349 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x56046722f800 con 0x560467354f20 2023-08-10T11:54:09.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.310+0000 7f51e511d700 1 --2- 172.21.15.73:0/2443746349 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x560467354f20 0x560467357340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.310+0000 7f51c8ff9700 10 client.16098 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:09.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.310+0000 7f51e511d700 1 --2- 172.21.15.73:0/2443746349 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x560467354f20 0x560467357340 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=291afa91b0059005 server_cookie=b6af1a26e9024cda in_seq=0 out_seq=0 2023-08-10T11:54:09.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.311+0000 7f51c8ff9700 1 -- 172.21.15.73:0/2443746349 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56046722f800 con 0x560467354f20 2023-08-10T11:54:09.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.311+0000 7f51c8ff9700 10 client.16098 handle_command_reply: tid=0 2023-08-10T11:54:09.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.311+0000 7f51f351ab80 1 client.16098 shutdown 2023-08-10T11:54:09.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.311+0000 7f51f351ab80 1 -- 172.21.15.73:0/2443746349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672eafd0 msgr2=0x5604672f5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:09.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.311+0000 7f51f351ab80 1 --2- 172.21.15.73:0/2443746349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672eafd0 0x5604672f5790 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f51dc097fd0 tx=0x7f51dc099690 comp rx=0 tx=0).stop 2023-08-10T11:54:09.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.311+0000 7f51f351ab80 1 -- 172.21.15.73:0/2443746349 shutdown_connections 2023-08-10T11:54:09.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.311+0000 7f51f351ab80 1 --2- 172.21.15.73:0/2443746349 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x560467354f20 0x560467357340 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.311+0000 7f51f351ab80 1 --2- 172.21.15.73:0/2443746349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5604672eb8f0 0x56046734bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.311+0000 7f51f351ab80 1 --2- 172.21.15.73:0/2443746349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604672e5880 0x5604672f5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.311+0000 7f51f351ab80 1 --2- 172.21.15.73:0/2443746349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5604672eafd0 0x5604672f5790 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.311+0000 7f51f351ab80 1 -- 172.21.15.73:0/2443746349 >> 172.21.15.73:0/2443746349 conn(0x560467242d50 msgr2=0x5604672ea380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:09.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.311+0000 7f51c8ff9700 0 client.16098 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:09.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.311+0000 7f51f351ab80 1 -- 172.21.15.73:0/2443746349 shutdown_connections 2023-08-10T11:54:09.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.311+0000 7f51f351ab80 1 -- 172.21.15.73:0/2443746349 wait complete. 2023-08-10T11:54:09.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.311+0000 7f51f351ab80 20 client.16098 trim_cache size 0 max 16384 2023-08-10T11:54:09.324 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:54:09.324 INFO:teuthology.orchestra.run.smithi073.stdout: "return_code": 0, 2023-08-10T11:54:09.324 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_tag": "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d", 2023-08-10T11:54:09.324 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": "asynchronous" 2023-08-10T11:54:09.325 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:54:09.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.311+0000 7f51e7381700 1 -- 172.21.15.73:0/3326849430 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f51cc0a12c0 msgr2=0x7f51cc0a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:09.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.311+0000 7f51e7381700 1 --2- 172.21.15.73:0/3326849430 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f51cc0a12c0 0x7f51cc0a3780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f51d0009a10 tx=0x7f51d0009190 comp rx=0 tx=0).stop 2023-08-10T11:54:09.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.311+0000 7f51e7381700 1 -- 172.21.15.73:0/3326849430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51e01006a0 msgr2=0x7f51e019cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:09.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.311+0000 7f51e7381700 1 --2- 172.21.15.73:0/3326849430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51e01006a0 0x7f51e019cbd0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00d980 tx=0x7f51dc00dc90 comp rx=0 tx=0).stop 2023-08-10T11:54:09.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.311+0000 7f51e7381700 1 -- 172.21.15.73:0/3326849430 shutdown_connections 2023-08-10T11:54:09.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.311+0000 7f51e7381700 1 --2- 172.21.15.73:0/3326849430 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f51cc0a12c0 0x7f51cc0a3780 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.311+0000 7f51e7381700 1 --2- 172.21.15.73:0/3326849430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51e00ffce0 0x7f51e019c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.311+0000 7f51e7381700 1 --2- 172.21.15.73:0/3326849430 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51e0105690 0x7f51e0196700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.311+0000 7f51e7381700 1 --2- 172.21.15.73:0/3326849430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51e01006a0 0x7f51e019cbd0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.312+0000 7f51e7381700 1 -- 172.21.15.73:0/3326849430 >> 172.21.15.73:0/3326849430 conn(0x7f51e0076be0 msgr2=0x7f51e00fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:09.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.312+0000 7f51e7381700 1 -- 172.21.15.73:0/3326849430 shutdown_connections 2023-08-10T11:54:09.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.312+0000 7f51e7381700 1 -- 172.21.15.73:0/3326849430 wait complete. 2023-08-10T11:54:09.331 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:54:09.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.461+0000 7f130c1ce700 1 -- 172.21.15.73:0/2847845646 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13040fff90 msgr2=0x7f130410c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:09.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.461+0000 7f130c1ce700 1 --2- 172.21.15.73:0/2847845646 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13040fff90 0x7f130410c450 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f12fc00b0d0 tx=0x7f12fc00b3e0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.461+0000 7f130c1ce700 1 -- 172.21.15.73:0/2847845646 shutdown_connections 2023-08-10T11:54:09.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.461+0000 7f130c1ce700 1 --2- 172.21.15.73:0/2847845646 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13040fff90 0x7f130410c450 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.461+0000 7f130c1ce700 1 --2- 172.21.15.73:0/2847845646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1304105690 0x7f1304105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.461+0000 7f130c1ce700 1 --2- 172.21.15.73:0/2847845646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13040ff5d0 0x7f13040ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.461+0000 7f130c1ce700 1 -- 172.21.15.73:0/2847845646 >> 172.21.15.73:0/2847845646 conn(0x7f13040fb0c0 msgr2=0x7f13040fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:09.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.461+0000 7f130c1ce700 1 -- 172.21.15.73:0/2847845646 shutdown_connections 2023-08-10T11:54:09.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.461+0000 7f130c1ce700 1 -- 172.21.15.73:0/2847845646 wait complete. 2023-08-10T11:54:09.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.462+0000 7f130c1ce700 1 Processor -- start 2023-08-10T11:54:09.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.462+0000 7f130c1ce700 1 -- start start 2023-08-10T11:54:09.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.462+0000 7f130c1ce700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13040ff5d0 0x7f13041976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.462+0000 7f130c1ce700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13040fff90 0x7f1304197bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.462+0000 7f130c1ce700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1304105690 0x7f13041a2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.462+0000 7f130c1ce700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1304198530 con 0x7f13040ff5d0 2023-08-10T11:54:09.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.462+0000 7f130c1ce700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13041a2c70 con 0x7f1304105690 2023-08-10T11:54:09.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.462+0000 7f130c1ce700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13041a2e30 con 0x7f13040fff90 2023-08-10T11:54:09.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.462+0000 7f1309f6a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13040ff5d0 0x7f13041976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.462+0000 7f1309f6a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13040ff5d0 0x7f13041976b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34252/0 (socket says 172.21.15.73:34252) 2023-08-10T11:54:09.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.462+0000 7f1309f6a700 1 -- 172.21.15.73:0/1804506189 learned_addr learned my addr 172.21.15.73:0/1804506189 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.462+0000 7f1309769700 1 --2- 172.21.15.73:0/1804506189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13040fff90 0x7f1304197bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.462+0000 7f130a76b700 1 --2- 172.21.15.73:0/1804506189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1304105690 0x7f13041a2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.462+0000 7f1309f6a700 1 -- 172.21.15.73:0/1804506189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13040fff90 msgr2=0x7f1304197bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.462+0000 7f1309f6a700 1 --2- 172.21.15.73:0/1804506189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13040fff90 0x7f1304197bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.462+0000 7f1309f6a700 1 -- 172.21.15.73:0/1804506189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1304105690 msgr2=0x7f13041a2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.462+0000 7f1309f6a700 1 --2- 172.21.15.73:0/1804506189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1304105690 0x7f13041a2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.462+0000 7f1309f6a700 1 -- 172.21.15.73:0/1804506189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12fc009d00 con 0x7f13040ff5d0 2023-08-10T11:54:09.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.463+0000 7f1309f6a700 1 --2- 172.21.15.73:0/1804506189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13040ff5d0 0x7f13041976b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f12f800c9b0 tx=0x7f12f800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:09.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.463+0000 7f12f6ffd700 1 -- 172.21.15.73:0/1804506189 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8007b00 con 0x7f13040ff5d0 2023-08-10T11:54:09.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.463+0000 7f12f6ffd700 1 -- 172.21.15.73:0/1804506189 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f12f800ce50 con 0x7f13040ff5d0 2023-08-10T11:54:09.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.463+0000 7f130c1ce700 1 -- 172.21.15.73:0/1804506189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13041a3110 con 0x7f13040ff5d0 2023-08-10T11:54:09.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.463+0000 7f12f6ffd700 1 -- 172.21.15.73:0/1804506189 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8018660 con 0x7f13040ff5d0 2023-08-10T11:54:09.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.463+0000 7f130c1ce700 1 -- 172.21.15.73:0/1804506189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13041a3670 con 0x7f13040ff5d0 2023-08-10T11:54:09.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.465+0000 7f12f6ffd700 1 -- 172.21.15.73:0/1804506189 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f12f800f450 con 0x7f13040ff5d0 2023-08-10T11:54:09.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.466+0000 7f12f6ffd700 1 --2- 172.21.15.73:0/1804506189 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f12f00a1340 0x7f12f00a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.466+0000 7f1309769700 1 --2- 172.21.15.73:0/1804506189 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f12f00a1340 0x7f12f00a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.466+0000 7f12f6ffd700 1 -- 172.21.15.73:0/1804506189 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f12f80ccb80 con 0x7f13040ff5d0 2023-08-10T11:54:09.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.466+0000 7f1309769700 1 --2- 172.21.15.73:0/1804506189 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f12f00a1340 0x7f12f00a3800 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f13040681a0 tx=0x7f1300009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:09.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.467+0000 7f1318367b80 1 Processor -- start 2023-08-10T11:54:09.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.467+0000 7f1318367b80 1 -- start start 2023-08-10T11:54:09.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.467+0000 7f1318367b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602eebedf50 0x5602eebee330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.467+0000 7f1318367b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602eebee870 0x5602eebe82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.467+0000 7f1318367b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebe8800 0x5602eebe8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.467+0000 7f1318367b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602eeb63dc0 con 0x5602eebe8800 2023-08-10T11:54:09.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.467+0000 7f1318367b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602eeb40590 con 0x5602eebedf50 2023-08-10T11:54:09.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.467+0000 7f1318367b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602eeb3deb0 con 0x5602eebee870 2023-08-10T11:54:09.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.467+0000 7f130a76b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebe8800 0x5602eebe8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.467+0000 7f1309f6a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602eebedf50 0x5602eebee330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.467+0000 7f130a76b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebe8800 0x5602eebe8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34260/0 (socket says 172.21.15.73:34260) 2023-08-10T11:54:09.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.467+0000 7f130a76b700 1 -- 172.21.15.73:0/1491502004 learned_addr learned my addr 172.21.15.73:0/1491502004 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:09.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.467+0000 7f1309769700 1 --2- 172.21.15.73:0/1491502004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602eebee870 0x5602eebe82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.468+0000 7f130a76b700 1 -- 172.21.15.73:0/1491502004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602eebee870 msgr2=0x5602eebe82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:09.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.468+0000 7f130a76b700 1 --2- 172.21.15.73:0/1491502004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602eebee870 0x5602eebe82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.468+0000 7f130a76b700 1 -- 172.21.15.73:0/1491502004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602eebedf50 msgr2=0x5602eebee330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:09.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.468+0000 7f130a76b700 1 --2- 172.21.15.73:0/1491502004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602eebedf50 0x5602eebee330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.468+0000 7f130a76b700 1 -- 172.21.15.73:0/1491502004 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602ee9ba630 con 0x5602eebe8800 2023-08-10T11:54:09.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.468+0000 7f1309769700 1 --2- 172.21.15.73:0/1491502004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602eebee870 0x5602eebe82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:54:09.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.468+0000 7f1309f6a700 1 --2- 172.21.15.73:0/1491502004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602eebedf50 0x5602eebee330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:09.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.468+0000 7f130a76b700 1 --2- 172.21.15.73:0/1491502004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebe8800 0x5602eebe8c80 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f12fc005b80 tx=0x7f12fc0092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9586c6c5338bd2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:09.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.468+0000 7f12effff700 1 -- 172.21.15.73:0/1491502004 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc00e040 con 0x5602eebe8800 2023-08-10T11:54:09.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.468+0000 7f12effff700 1 -- 172.21.15.73:0/1491502004 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f12fc009b80 con 0x5602eebe8800 2023-08-10T11:54:09.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.468+0000 7f12effff700 1 -- 172.21.15.73:0/1491502004 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc0052d0 con 0x5602eebe8800 2023-08-10T11:54:09.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.469+0000 7f1318367b80 1 -- 172.21.15.73:0/1491502004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebe8800 msgr2=0x5602eebe8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:09.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.469+0000 7f1318367b80 1 --2- 172.21.15.73:0/1491502004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebe8800 0x5602eebe8c80 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f12fc005b80 tx=0x7f12fc0092e0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.469+0000 7f1318367b80 1 -- 172.21.15.73:0/1491502004 shutdown_connections 2023-08-10T11:54:09.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.469+0000 7f1318367b80 1 --2- 172.21.15.73:0/1491502004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602eebedf50 0x5602eebee330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.469+0000 7f1318367b80 1 --2- 172.21.15.73:0/1491502004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebe8800 0x5602eebe8c80 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.469+0000 7f1318367b80 1 --2- 172.21.15.73:0/1491502004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602eebee870 0x5602eebe82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.469+0000 7f1318367b80 1 -- 172.21.15.73:0/1491502004 >> 172.21.15.73:0/1491502004 conn(0x5602eeb45cd0 msgr2=0x5602eebe34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:09.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.469+0000 7f1318367b80 1 -- 172.21.15.73:0/1491502004 shutdown_connections 2023-08-10T11:54:09.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.469+0000 7f1318367b80 1 -- 172.21.15.73:0/1491502004 wait complete. 2023-08-10T11:54:09.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.469+0000 7f1318367b80 1 -- start start 2023-08-10T11:54:09.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.469+0000 7f1318367b80 1 Processor -- start 2023-08-10T11:54:09.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.470+0000 7f1318367b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602eebe8800 0x5602eebf4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.470+0000 7f1318367b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebedf50 0x5602eebf1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.470+0000 7f1318367b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602eebee870 0x5602eebf2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.470+0000 7f1318367b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602eeb397a0 con 0x5602eebedf50 2023-08-10T11:54:09.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.470+0000 7f1318367b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602eead8ac0 con 0x5602eebe8800 2023-08-10T11:54:09.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.470+0000 7f1318367b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602eead87c0 con 0x5602eebee870 2023-08-10T11:54:09.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.470+0000 7f1318367b80 10 client.0 _ll_register_callbacks cb 0x5602eead6680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:54:09.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.470+0000 7f1309769700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebedf50 0x5602eebf1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.470+0000 7f1309f6a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602eebe8800 0x5602eebf4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.470+0000 7f1309f6a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602eebe8800 0x5602eebf4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:48912/0 (socket says 172.21.15.73:48912) 2023-08-10T11:54:09.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.470+0000 7f1309769700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebedf50 0x5602eebf1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34264/0 (socket says 172.21.15.73:34264) 2023-08-10T11:54:09.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.470+0000 7f1309f6a700 1 -- 172.21.15.73:0/2877241726 learned_addr learned my addr 172.21.15.73:0/2877241726 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:09.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.470+0000 7f1309769700 1 -- 172.21.15.73:0/2877241726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602eebee870 msgr2=0x5602eebf2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:09.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.470+0000 7f1309769700 1 --2- 172.21.15.73:0/2877241726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602eebee870 0x5602eebf2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.470+0000 7f1309769700 1 -- 172.21.15.73:0/2877241726 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602eebe8800 msgr2=0x5602eebf4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:09.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.470+0000 7f1309769700 1 --2- 172.21.15.73:0/2877241726 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602eebe8800 0x5602eebf4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.470+0000 7f1309769700 1 -- 172.21.15.73:0/2877241726 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13041a3670 con 0x5602eebedf50 2023-08-10T11:54:09.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.470+0000 7f1309f6a700 1 --2- 172.21.15.73:0/2877241726 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602eebe8800 0x5602eebf4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:09.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.471+0000 7f1309769700 1 --2- 172.21.15.73:0/2877241726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebedf50 0x5602eebf1ae0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f1304105100 tx=0x7f13000047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3beb3966b05f0d89 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:09.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.471+0000 7f12ed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:54:09.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.471+0000 7f12ed7fa700 1 -- 172.21.15.73:0/2877241726 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1300003e70 con 0x5602eebedf50 2023-08-10T11:54:09.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.471+0000 7f12ed7fa700 1 -- 172.21.15.73:0/2877241726 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f130001d410 con 0x5602eebedf50 2023-08-10T11:54:09.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.471+0000 7f1318367b80 1 -- 172.21.15.73:0/2877241726 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5602eebb79d0 con 0x5602eebedf50 2023-08-10T11:54:09.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.471+0000 7f12ed7fa700 1 -- 172.21.15.73:0/2877241726 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f130001d5d0 con 0x5602eebedf50 2023-08-10T11:54:09.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.471+0000 7f1318367b80 10 client.16110 fetch_fsmap learned FSMap version 31 2023-08-10T11:54:09.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.471+0000 7f1318367b80 1 -- 172.21.15.73:0/2877241726 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f130410cd50 con 0x5602eebedf50 2023-08-10T11:54:09.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.471+0000 7f12ed7fa700 1 -- 172.21.15.73:0/2877241726 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5602eebb79d0 con 0x5602eebedf50 2023-08-10T11:54:09.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.471+0000 7f12ed7fa700 1 -- 172.21.15.73:0/2877241726 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 31) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f1300030850 con 0x5602eebedf50 2023-08-10T11:54:09.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.471+0000 7f1318367b80 10 client.16110 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T11:54:09.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.471+0000 7f1318367b80 10 client.16110 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:54:09.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.471+0000 7f1318367b80 20 client.16110 populate_metadata read hostname 'smithi073' 2023-08-10T11:54:09.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.471+0000 7f1318367b80 1 --2- 172.21.15.73:0/2877241726 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5602eec022a0 0x5602eec046c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.471+0000 7f1318367b80 4 client.16110 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:54:09.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.471+0000 7f1318367b80 1 -- 172.21.15.73:0/2877241726 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5602eeb32780 con 0x5602eec022a0 2023-08-10T11:54:09.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.471+0000 7f1309f6a700 1 --2- 172.21.15.73:0/2877241726 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5602eec022a0 0x5602eec046c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.472+0000 7f1309f6a700 1 --2- 172.21.15.73:0/2877241726 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5602eec022a0 0x5602eec046c0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=643656ecc631d4e6 server_cookie=5ec88b198527eb57 in_seq=0 out_seq=0 2023-08-10T11:54:09.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.472+0000 7f12ed7fa700 10 client.16110 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:09.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.472+0000 7f12ed7fa700 1 -- 172.21.15.73:0/2877241726 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5602eeb32780 con 0x5602eec022a0 2023-08-10T11:54:09.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.472+0000 7f12ed7fa700 10 client.16110 handle_command_reply: tid=0 2023-08-10T11:54:09.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.472+0000 7f1318367b80 1 client.16110 shutdown 2023-08-10T11:54:09.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.472+0000 7f1318367b80 1 -- 172.21.15.73:0/2877241726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebedf50 msgr2=0x5602eebf1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:09.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.472+0000 7f1318367b80 1 --2- 172.21.15.73:0/2877241726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebedf50 0x5602eebf1ae0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f1304105100 tx=0x7f13000047c0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.473+0000 7f1318367b80 1 -- 172.21.15.73:0/2877241726 shutdown_connections 2023-08-10T11:54:09.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.473+0000 7f1318367b80 1 --2- 172.21.15.73:0/2877241726 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5602eec022a0 0x5602eec046c0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.473+0000 7f1318367b80 1 --2- 172.21.15.73:0/2877241726 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602eebe8800 0x5602eebf4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.473+0000 7f1318367b80 1 --2- 172.21.15.73:0/2877241726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602eebee870 0x5602eebf2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.473+0000 7f12ed7fa700 0 client.16110 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:09.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.473+0000 7f1318367b80 1 --2- 172.21.15.73:0/2877241726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebedf50 0x5602eebf1ae0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.473+0000 7f1318367b80 1 -- 172.21.15.73:0/2877241726 >> 172.21.15.73:0/2877241726 conn(0x5602eeb45cd0 msgr2=0x5602eebe29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:09.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.473+0000 7f1318367b80 1 -- 172.21.15.73:0/2877241726 shutdown_connections 2023-08-10T11:54:09.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.473+0000 7f1318367b80 1 -- 172.21.15.73:0/2877241726 wait complete. 2023-08-10T11:54:09.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.473+0000 7f1318367b80 20 client.16110 trim_cache size 0 max 16384 2023-08-10T11:54:09.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.491+0000 7f1318367b80 1 Processor -- start 2023-08-10T11:54:09.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.491+0000 7f1318367b80 1 -- start start 2023-08-10T11:54:09.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.491+0000 7f1318367b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebe8800 0x5602eebf9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.491+0000 7f1318367b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602eebedf50 0x5602eebef360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.491+0000 7f1318367b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602eebee870 0x5602eebe3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.491+0000 7f1318367b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602ee9bc920 con 0x5602eebe8800 2023-08-10T11:54:09.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.491+0000 7f1318367b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602eebdafb0 con 0x5602eebedf50 2023-08-10T11:54:09.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.491+0000 7f1318367b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602eebdff80 con 0x5602eebee870 2023-08-10T11:54:09.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.491+0000 7f1309f6a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebe8800 0x5602eebf9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.491+0000 7f1309f6a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebe8800 0x5602eebf9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34270/0 (socket says 172.21.15.73:34270) 2023-08-10T11:54:09.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.491+0000 7f1309f6a700 1 -- 172.21.15.73:0/3927208580 learned_addr learned my addr 172.21.15.73:0/3927208580 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:09.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.491+0000 7f1309769700 1 --2- 172.21.15.73:0/3927208580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602eebedf50 0x5602eebef360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.491+0000 7f130a76b700 1 --2- 172.21.15.73:0/3927208580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602eebee870 0x5602eebe3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.492+0000 7f1309f6a700 1 -- 172.21.15.73:0/3927208580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602eebee870 msgr2=0x5602eebe3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:09.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.492+0000 7f1309f6a700 1 --2- 172.21.15.73:0/3927208580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602eebee870 0x5602eebe3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.492+0000 7f1309f6a700 1 -- 172.21.15.73:0/3927208580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602eebedf50 msgr2=0x5602eebef360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:09.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.492+0000 7f1309f6a700 1 --2- 172.21.15.73:0/3927208580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602eebedf50 0x5602eebef360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.492+0000 7f1309f6a700 1 -- 172.21.15.73:0/3927208580 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602ee966de0 con 0x5602eebe8800 2023-08-10T11:54:09.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.492+0000 7f130a76b700 1 --2- 172.21.15.73:0/3927208580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602eebee870 0x5602eebe3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:54:09.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.492+0000 7f1309f6a700 1 --2- 172.21.15.73:0/3927208580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebe8800 0x5602eebf9300 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f12f801e000 tx=0x7f12f80cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5406b18eb6ccdd20 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:09.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.492+0000 7f12f4ff9700 1 -- 172.21.15.73:0/3927208580 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f80b2040 con 0x5602eebe8800 2023-08-10T11:54:09.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.492+0000 7f12f4ff9700 1 -- 172.21.15.73:0/3927208580 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f12f8007c60 con 0x5602eebe8800 2023-08-10T11:54:09.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.492+0000 7f12f4ff9700 1 -- 172.21.15.73:0/3927208580 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f800f700 con 0x5602eebe8800 2023-08-10T11:54:09.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.493+0000 7f1318367b80 1 -- 172.21.15.73:0/3927208580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebe8800 msgr2=0x5602eebf9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:09.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.493+0000 7f1318367b80 1 --2- 172.21.15.73:0/3927208580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebe8800 0x5602eebf9300 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f12f801e000 tx=0x7f12f80cc040 comp rx=0 tx=0).stop 2023-08-10T11:54:09.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.493+0000 7f1318367b80 1 -- 172.21.15.73:0/3927208580 shutdown_connections 2023-08-10T11:54:09.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.493+0000 7f1318367b80 1 --2- 172.21.15.73:0/3927208580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602eebee870 0x5602eebe3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.493+0000 7f1318367b80 1 --2- 172.21.15.73:0/3927208580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebe8800 0x5602eebf9300 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.493+0000 7f1318367b80 1 --2- 172.21.15.73:0/3927208580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602eebedf50 0x5602eebef360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.493+0000 7f1318367b80 1 -- 172.21.15.73:0/3927208580 >> 172.21.15.73:0/3927208580 conn(0x5602eeb45cd0 msgr2=0x5602eebeec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:09.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.493+0000 7f1318367b80 1 -- 172.21.15.73:0/3927208580 shutdown_connections 2023-08-10T11:54:09.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.493+0000 7f1318367b80 1 -- 172.21.15.73:0/3927208580 wait complete. 2023-08-10T11:54:09.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.493+0000 7f1318367b80 1 -- start start 2023-08-10T11:54:09.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.493+0000 7f1318367b80 1 Processor -- start 2023-08-10T11:54:09.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.493+0000 7f1318367b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602eebe8800 0x5602eebeac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.493+0000 7f1318367b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602eebedf50 0x5602eebeb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.493+0000 7f1318367b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebee870 0x5602eebe9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.493+0000 7f1318367b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602eebea070 con 0x5602eebee870 2023-08-10T11:54:09.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.493+0000 7f1318367b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602eebea1e0 con 0x5602eebedf50 2023-08-10T11:54:09.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.493+0000 7f1318367b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602eebea3a0 con 0x5602eebe8800 2023-08-10T11:54:09.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.494+0000 7f1318367b80 10 client.0 _ll_register_callbacks cb 0x5602eead6680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:54:09.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.494+0000 7f130a76b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebee870 0x5602eebe9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.494+0000 7f1309769700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602eebedf50 0x5602eebeb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.494+0000 7f1309f6a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602eebe8800 0x5602eebeac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.494+0000 7f1309769700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602eebedf50 0x5602eebeb1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:48926/0 (socket says 172.21.15.73:48926) 2023-08-10T11:54:09.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.494+0000 7f130a76b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebee870 0x5602eebe9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34280/0 (socket says 172.21.15.73:34280) 2023-08-10T11:54:09.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.494+0000 7f1309769700 1 -- 172.21.15.73:0/276513585 learned_addr learned my addr 172.21.15.73:0/276513585 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:09.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.494+0000 7f130a76b700 1 -- 172.21.15.73:0/276513585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602eebe8800 msgr2=0x5602eebeac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:09.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.494+0000 7f130a76b700 1 --2- 172.21.15.73:0/276513585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602eebe8800 0x5602eebeac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.494+0000 7f130a76b700 1 -- 172.21.15.73:0/276513585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602eebedf50 msgr2=0x5602eebeb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:09.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.494+0000 7f130a76b700 1 --2- 172.21.15.73:0/276513585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602eebedf50 0x5602eebeb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.494+0000 7f130a76b700 1 -- 172.21.15.73:0/276513585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13041a3110 con 0x5602eebee870 2023-08-10T11:54:09.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.494+0000 7f130a76b700 1 --2- 172.21.15.73:0/276513585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebee870 0x5602eebe9970 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f12fc005b50 tx=0x7f12fc00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ce492f7316ca00 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:09.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.494+0000 7f12ed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:54:09.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.494+0000 7f12ed7fa700 1 -- 172.21.15.73:0/276513585 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc00e040 con 0x5602eebee870 2023-08-10T11:54:09.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.494+0000 7f12ed7fa700 1 -- 172.21.15.73:0/276513585 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f12fc003a00 con 0x5602eebee870 2023-08-10T11:54:09.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.494+0000 7f1318367b80 1 -- 172.21.15.73:0/276513585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5602eebdb470 con 0x5602eebee870 2023-08-10T11:54:09.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.494+0000 7f12ed7fa700 1 -- 172.21.15.73:0/276513585 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12fc0078b0 con 0x5602eebee870 2023-08-10T11:54:09.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.494+0000 7f1318367b80 10 client.16116 fetch_fsmap learned FSMap version 31 2023-08-10T11:54:09.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.494+0000 7f1318367b80 1 -- 172.21.15.73:0/276513585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5602ee94fc60 con 0x5602eebee870 2023-08-10T11:54:09.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.495+0000 7f12ed7fa700 1 -- 172.21.15.73:0/276513585 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5602eebdb470 con 0x5602eebee870 2023-08-10T11:54:09.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.495+0000 7f12ed7fa700 1 -- 172.21.15.73:0/276513585 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 31) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f12fc00b100 con 0x5602eebee870 2023-08-10T11:54:09.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.495+0000 7f1318367b80 10 client.16116 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T11:54:09.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.495+0000 7f1318367b80 10 client.16116 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:54:09.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.495+0000 7f1318367b80 20 client.16116 populate_metadata read hostname 'smithi073' 2023-08-10T11:54:09.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.495+0000 7f1318367b80 1 --2- 172.21.15.73:0/276513585 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5602eec56b90 0x5602eec58fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:09.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.495+0000 7f1318367b80 4 client.16116 mds_command: new command op to 24503 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:54:09.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.495+0000 7f1318367b80 1 -- 172.21.15.73:0/276513585 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5602eeaf4050 con 0x5602eec56b90 2023-08-10T11:54:09.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.495+0000 7f1309f6a700 1 --2- 172.21.15.73:0/276513585 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5602eec56b90 0x5602eec58fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:09.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.495+0000 7f12ed7fa700 10 client.16116 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:09.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.495+0000 7f1309f6a700 1 --2- 172.21.15.73:0/276513585 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5602eec56b90 0x5602eec58fb0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b03c2a09bae9c535 server_cookie=e1725c5eb058d57 in_seq=0 out_seq=0 2023-08-10T11:54:09.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.495+0000 7f12ed7fa700 1 -- 172.21.15.73:0/276513585 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5602eeaf4050 con 0x5602eec56b90 2023-08-10T11:54:09.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.495+0000 7f12ed7fa700 10 client.16116 handle_command_reply: tid=0 2023-08-10T11:54:09.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.495+0000 7f1318367b80 1 client.16116 shutdown 2023-08-10T11:54:09.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.496+0000 7f1318367b80 1 -- 172.21.15.73:0/276513585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebee870 msgr2=0x5602eebe9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:09.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.496+0000 7f1318367b80 1 --2- 172.21.15.73:0/276513585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebee870 0x5602eebe9970 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f12fc005b50 tx=0x7f12fc00b7b0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.496+0000 7f1318367b80 1 -- 172.21.15.73:0/276513585 shutdown_connections 2023-08-10T11:54:09.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.496+0000 7f1318367b80 1 --2- 172.21.15.73:0/276513585 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5602eec56b90 0x5602eec58fb0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.496+0000 7f1318367b80 1 --2- 172.21.15.73:0/276513585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602eebee870 0x5602eebe9970 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.496+0000 7f12ed7fa700 0 client.16116 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:09.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.496+0000 7f1318367b80 1 --2- 172.21.15.73:0/276513585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602eebe8800 0x5602eebeac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.496+0000 7f1318367b80 1 --2- 172.21.15.73:0/276513585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5602eebedf50 0x5602eebeb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.496+0000 7f1318367b80 1 -- 172.21.15.73:0/276513585 >> 172.21.15.73:0/276513585 conn(0x5602eeb45cd0 msgr2=0x5602eebef4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:09.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.496+0000 7f1318367b80 1 -- 172.21.15.73:0/276513585 shutdown_connections 2023-08-10T11:54:09.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.496+0000 7f1318367b80 1 -- 172.21.15.73:0/276513585 wait complete. 2023-08-10T11:54:09.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.496+0000 7f1318367b80 20 client.16116 trim_cache size 0 max 16384 2023-08-10T11:54:09.508 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:54:09.509 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:54:09.509 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": { 2023-08-10T11:54:09.509 INFO:teuthology.orchestra.run.smithi073.stdout: "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d": { 2023-08-10T11:54:09.509 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2023-08-10T11:54:09.509 INFO:teuthology.orchestra.run.smithi073.stdout: "tag": "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d", 2023-08-10T11:54:09.509 INFO:teuthology.orchestra.run.smithi073.stdout: "options": "recursive,force" 2023-08-10T11:54:09.509 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:54:09.509 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:54:09.510 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:54:09.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.496+0000 7f130c1ce700 1 -- 172.21.15.73:0/1804506189 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f12f00a1340 msgr2=0x7f12f00a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:09.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.496+0000 7f130c1ce700 1 --2- 172.21.15.73:0/1804506189 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f12f00a1340 0x7f12f00a3800 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f13040681a0 tx=0x7f1300009260 comp rx=0 tx=0).stop 2023-08-10T11:54:09.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.496+0000 7f130c1ce700 1 -- 172.21.15.73:0/1804506189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13040ff5d0 msgr2=0x7f13041976b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:09.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.496+0000 7f130c1ce700 1 --2- 172.21.15.73:0/1804506189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13040ff5d0 0x7f13041976b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f12f800c9b0 tx=0x7f12f800ccc0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.496+0000 7f130c1ce700 1 -- 172.21.15.73:0/1804506189 shutdown_connections 2023-08-10T11:54:09.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.496+0000 7f130c1ce700 1 --2- 172.21.15.73:0/1804506189 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f12f00a1340 0x7f12f00a3800 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.496+0000 7f130c1ce700 1 --2- 172.21.15.73:0/1804506189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1304105690 0x7f13041a2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.496+0000 7f130c1ce700 1 --2- 172.21.15.73:0/1804506189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13040ff5d0 0x7f13041976b0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.496+0000 7f130c1ce700 1 --2- 172.21.15.73:0/1804506189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13040fff90 0x7f1304197bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:09.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.496+0000 7f130c1ce700 1 -- 172.21.15.73:0/1804506189 >> 172.21.15.73:0/1804506189 conn(0x7f13040fb0c0 msgr2=0x7f13040fc680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:09.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.496+0000 7f130c1ce700 1 -- 172.21.15.73:0/1804506189 shutdown_connections 2023-08-10T11:54:09.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:09.497+0000 7f130c1ce700 1 -- 172.21.15.73:0/1804506189 wait complete. 2023-08-10T11:54:09.513 INFO:tasks.cephfs.filesystem:scrub status for tag:9d39b3fa-9b62-42b4-b1a5-738cb3118a5d - {'path': '/', 'tag': '9d39b3fa-9b62-42b4-b1a5-738cb3118a5d', 'options': 'recursive,force'} 2023-08-10T11:54:09.658 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.320+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000356 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/reader.o auth{0=1} v204 ap=1 s=13216 n(v0 rc2023-08-10T11:53:45.558657+0000 b13216 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561c8527700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000356:[<0x10000000206/reader.o v204>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x10000000356:[<0x10000000206/reader.o v204>,<0x10000000201/src v1665>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.658 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.320+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000000b [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench.c auth v40 ap=1 s=2117 n(v0 rc2005-02-11T14:49:01.000000+0000 b2117 1=1+0) (iversion lock) caps={15318=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c8525b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000000b:[<0x10000000206/blogbench.c v40>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x1000000000b:[<0x10000000206/blogbench.c v40>,<0x10000000201/src v1665>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.658 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.321+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000034f [...3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/ auth{0=1,2=1,3=1,4=1} v244 ap=1 f(v0 m2023-08-10T11:53:45.893649+0000 10=10+0) n(v0 rc2023-08-10T11:53:45.893649+0000 b72805 11=10+1) (inest mix) (ifile excl) (iversion lock) caps={15318=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15318 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 dirwaiter=0 replicated=1 authpin=1 discoverbase=0 scrubqueue=0 0x5561c7be9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000034f:[<0x10000000206/.deps v244>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x1000000034f:[<0x10000000206/.deps v244>,<0x10000000201/src v1665>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-08-10T11:53:45.893649+0000 10=10+0)","ondisk_value.rstat":"n(v0 rc2023-08-10T11:53:45.893649+0000 b72805 11=10+1)","memory_value.dirstat":"f(v0 m2023-08-10T11:53:45.893649+0000 10=10+0)","memory_value.rstat":"n(v0 rc2023-08-10T11:53:45.893649+0000 b72805 11=10+1)","error_str":""},"return_code":0} 2023-08-10T11:54:09.658 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.322+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000355 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/rewriter.o auth{0=1} v242 ap=1 s=13104 n(v0 rc2023-08-10T11:53:45.476659+0000 b13104 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561c8525600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000355:[<0x10000000206/rewriter.o v242>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x10000000355:[<0x10000000206/rewriter.o v242>,<0x10000000201/src v1665>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.659 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.323+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000353 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/process.o auth{0=1} v212 ap=1 s=22296 n(v0 rc2023-08-10T11:53:45.300663+0000 b22296 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561c8525080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000353:[<0x10000000206/process.o v212>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x10000000353:[<0x10000000206/process.o v212>,<0x10000000201/src v1665>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.659 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.324+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000035b [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/mysnprintf.o auth{0=1} v222 ap=1 s=7912 n(v0 rc2023-08-10T11:53:45.886649+0000 b7912 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561c8524b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000035b:[<0x10000000206/mysnprintf.o v222>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x1000000035b:[<0x10000000206/mysnprintf.o v222>,<0x10000000201/src v1665>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.659 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.324+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000357 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/commenter.o auth{0=1} v214 ap=1 s=11656 n(v0 rc2023-08-10T11:53:45.629655+0000 b11656 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561c8680000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000357:[<0x10000000206/commenter.o v214>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x10000000357:[<0x10000000206/commenter.o v214>,<0x10000000201/src v1665>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.659 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.324+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000015 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/globals.h auth v62 ap=1 s=1419 n(v0 rc2005-02-11T13:50:02.000000+0000 b1419 1=1+0) (iversion lock) caps={15318=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c8680580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000015:[<0x10000000206/globals.h v62>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x10000000015:[<0x10000000206/globals.h v62>,<0x10000000201/src v1665>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.659 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.325+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000019 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/writer.c auth v48 ap=1 s=1910 n(v0 rc2005-02-11T14:29:28.000000+0000 b1910 1=1+0) (iversion lock) caps={15318=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c8680b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000019:[<0x10000000206/writer.c v48>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x10000000019:[<0x10000000206/writer.c v48>,<0x10000000201/src v1665>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.659 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.325+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000207 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/mysnprintf.c auth v54 ap=1 s=729 n(v0 rc2023-08-10T11:53:39.360804+0000 b729 1=1+0) (iversion lock) caps={15318=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c8681080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000207:[<0x10000000206/mysnprintf.c v54>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x10000000207:[<0x10000000206/mysnprintf.c v54>,<0x10000000201/src v1665>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.659 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.326+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000011 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.h auth v66 ap=1 s=4944 n(v0 rc2005-02-11T11:45:33.000000+0000 b4944 1=1+0) (iversion lock) caps={15318=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c8681600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000011:[<0x10000000206/bsd-getopt_long.h v66>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x10000000011:[<0x10000000206/bsd-getopt_long.h v66>,<0x10000000201/src v1665>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.660 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.326+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000016 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/commenter.c auth v58 ap=1 s=939 n(v0 rc2005-02-11T12:58:54.000000+0000 b939 1=1+0) (iversion lock) caps={15318=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c8681b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000016:[<0x10000000206/commenter.c v58>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x10000000016:[<0x10000000206/commenter.c v58>,<0x10000000201/src v1665>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.660 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.327+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001a [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/helpers.c auth v42 ap=1 s=4200 n(v0 rc2005-02-11T14:46:26.000000+0000 b4200 1=1+0) (iversion lock) caps={15318=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c8682100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000001a:[<0x10000000206/helpers.c v42>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x1000000001a:[<0x10000000206/helpers.c v42>,<0x10000000201/src v1665>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.660 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.328+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000000a [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/mysnprintf.h auth v50 ap=1 s=696 n(v0 rc2005-02-11T11:45:33.000000+0000 b696 1=1+0) (iversion lock) caps={15318=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c8682680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000000a:[<0x10000000206/mysnprintf.h v50>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x1000000000a:[<0x10000000206/mysnprintf.h v50>,<0x10000000201/src v1665>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.660 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.329+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000358 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/helpers.o auth{0=1} v210 ap=1 s=29104 n(v0 rc2023-08-10T11:53:45.721653+0000 b29104 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561c8682c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000358:[<0x10000000206/helpers.o v210>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x10000000358:[<0x10000000206/helpers.o v210>,<0x10000000201/src v1665>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.660 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.329+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000000f [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench_p.h auth v68 ap=1 s=460 n(v0 rc2005-02-11T13:43:53.000000+0000 b460 1=1+0) (iversion lock) caps={15318=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c8683180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000000f:[<0x10000000206/blogbench_p.h v68>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x1000000000f:[<0x10000000206/blogbench_p.h v68>,<0x10000000201/src v1665>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.661 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.330+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000035a [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/fakesnprintf.o auth{0=1} v232 ap=1 s=7904 n(v0 rc2023-08-10T11:53:45.836650+0000 b7904 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561c8683700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000035a:[<0x10000000206/fakesnprintf.o v232>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x1000000035a:[<0x10000000206/fakesnprintf.o v232>,<0x10000000201/src v1665>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.661 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.331+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000000c [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench.h auth v52 ap=1 s=3764 n(v0 rc2005-02-11T19:50:06.000000+0000 b3764 1=1+0) (iversion lock) caps={15318=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c868c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000000c:[<0x10000000206/blogbench.h v52>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x1000000000c:[<0x10000000206/blogbench.h v52>,<0x10000000201/src v1665>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.661 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.332+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000017 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/rewriter.c auth v56 ap=1 s=1581 n(v0 rc2005-02-11T12:50:44.000000+0000 b1581 1=1+0) (iversion lock) caps={15318=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c868c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000017:[<0x10000000206/rewriter.c v56>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x10000000017:[<0x10000000206/rewriter.c v56>,<0x10000000201/src v1665>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.661 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.332+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000352 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench.o auth{0=1} v208 ap=1 s=19280 n(v0 rc2023-08-10T11:53:45.216665+0000 b19280 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561c868cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000352:[<0x10000000206/blogbench.o v208>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x10000000352:[<0x10000000206/blogbench.o v208>,<0x10000000201/src v1667>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.662 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.333+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000133 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/Makefile auth{0=1} v236 ap=1 s=13322 n(v0 rc2023-08-10T11:53:44.918672+0000 b13322 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561c868d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000133:[<0x10000000206/Makefile v236>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x10000000133:[<0x10000000206/Makefile v236>,<0x10000000201/src v1667>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.662 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.333+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000013 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/Makefile.in auth v60 ap=1 s=13775 n(v0 rc2005-02-11T20:29:05.000000+0000 b13775 1=1+0) (iversion lock) caps={15318=pAsLsXsFscr/pFscr@1},l=15318 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c868d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000013:[<0x10000000206/Makefile.in v60>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x10000000013:[<0x10000000206/Makefile.in v60>,<0x10000000201/src v1667>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.662 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.334+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000000d [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/fakesnprintf.c auth v38 ap=1 s=10682 n(v0 rc2005-02-11T11:54:44.000000+0000 b10682 1=1+0) (iversion lock) caps={15318=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c868db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000000d:[<0x10000000206/fakesnprintf.c v38>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x1000000000d:[<0x10000000206/fakesnprintf.c v38>,<0x10000000201/src v1667>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.662 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.334+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000012 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/Makefile.am auth v72 ap=1 s=299 n(v0 rc2005-02-11T14:07:02.000000+0000 b299 1=1+0) (iversion lock) caps={15318=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c868e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000012:[<0x10000000206/Makefile.am v72>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x10000000012:[<0x10000000206/Makefile.am v72>,<0x10000000201/src v1667>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.663 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.335+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000010 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.c auth v46 ap=1 s=18847 n(v0 rc2005-02-11T11:48:28.000000+0000 b18847 1=1+0) (iversion lock) caps={15318=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c868e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000010:[<0x10000000206/bsd-getopt_long.c v46>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x10000000010:[<0x10000000206/bsd-getopt_long.c v46>,<0x10000000201/src v1667>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.663 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.336+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000035d [...4,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/ auth{0=1,2=1,3=1,4=1} v341 ap=1 f(v0 m2023-08-10T11:54:00.915292+0000 17=0+17) n(v1 rc2023-08-10T11:54:09.001100+0000 b41080686 2019=2001+18) old_inodes=1 (isnap sync r=16) (inest mix w=11 dirty) (ipolicy sync r=9) (ifile excl) (iversion lock) caps={15318=pAsLsXsFsx/pAsLsXsFsxcral@6},l=15318 | ptrwaiter=0 dirtyscattered=1 lock=3 importingcaps=0 dirfrag=1 caps=1 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x5561c7c1c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000035d:[<0x10000000206/blogtest_in v200>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x1000000035d:[<0x10000000206/blogtest_in v341>,<0x10000000201/src v1667>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-08-10T11:54:00.915292+0000 17=0+17)","ondisk_value.rstat":"n(v0 rc2023-08-10T11:54:09.001100+0000 b41080686 2019=2001+18)","memory_value.dirstat":"f(v0 m2023-08-10T11:54:00.915292+0000 17=0+17)","memory_value.rstat":"n(v1 rc2023-08-10T11:54:09.001100+0000 b41080686 2019=2001+18)","error_str":""},"return_code":0} 2023-08-10T11:54:09.663 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.336+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000359 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.o auth{0=1} v230 ap=1 s=7912 n(v0 rc2023-08-10T11:53:45.779651+0000 b7912 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561c868ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000359:[<0x10000000206/bsd-getopt_long.o v230>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x10000000359:[<0x10000000206/bsd-getopt_long.o v230>,<0x10000000201/src v1667>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.663 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.337+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000018 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/reader.c auth v44 ap=1 s=1605 n(v0 rc2005-02-11T10:45:16.000000+0000 b1605 1=1+0) (iversion lock) caps={15318=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c868f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000018:[<0x10000000206/reader.c v44>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x10000000018:[<0x10000000206/reader.c v44>,<0x10000000201/src v1667>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.663 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.338+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000014 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/process.c auth v70 ap=1 s=4649 n(v0 rc2005-02-11T21:32:46.000000+0000 b4649 1=1+0) (iversion lock) caps={15318=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c868f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000014:[<0x10000000206/process.c v70>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x10000000014:[<0x10000000206/process.c v70>,<0x10000000201/src v1667>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.664 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.338+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000354 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/writer.o auth{0=1} v216 ap=1 s=14040 n(v0 rc2023-08-10T11:53:45.371661+0000 b14040 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561c8694000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000354:[<0x10000000206/writer.o v216>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x10000000354:[<0x10000000206/writer.o v216>,<0x10000000201/src v1667>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.664 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.339+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000000e [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/fakesnprintf.h auth v64 ap=1 s=606 n(v0 rc2005-02-11T11:45:33.000000+0000 b606 1=1+0) (iversion lock) caps={15318=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c8694580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000000e:[<0x10000000206/fakesnprintf.h v64>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x1000000000e:[<0x10000000206/fakesnprintf.h v64>,<0x10000000201/src v1667>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.664 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.340+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000035c [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench auth{0=1} v238 ap=1 s=74456 n(v0 rc2023-08-10T11:53:45.916648+0000 b74456 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561c8694b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000035c:[<0x10000000206/blogbench v238>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x1000000035c:[<0x10000000206/blogbench v238>,<0x10000000201/src v1667>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.664 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.340+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000146 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/rewriter.Po auth v96 ap=1 s=7615 n(v0 rc2023-08-10T11:53:45.488658+0000 b7615 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15318 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c7c88580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000146:[<0x1000000034f/rewriter.Po v96>,<0x10000000206/.deps v244>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x10000000146:[<0x1000000034f/rewriter.Po v96>,<0x10000000206/.deps v244>,<0x10000000201/src v1667>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.664 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.341+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000145 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/writer.Po auth v98 ap=1 s=7611 n(v0 rc2023-08-10T11:53:45.377661+0000 b7611 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15318 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c7c88b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000145:[<0x1000000034f/writer.Po v98>,<0x10000000206/.deps v244>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x10000000145:[<0x1000000034f/writer.Po v98>,<0x10000000206/.deps v244>,<0x10000000201/src v1667>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.664 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.342+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000148 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/commenter.Po auth v104 ap=1 s=7617 n(v0 rc2023-08-10T11:53:45.634655+0000 b7617 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15318 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c7c89080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000148:[<0x1000000034f/commenter.Po v104>,<0x10000000206/.deps v244>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x10000000148:[<0x1000000034f/commenter.Po v104>,<0x10000000206/.deps v244>,<0x10000000201/src v1667>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.665 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.342+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000147 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/reader.Po auth v92 ap=1 s=7611 n(v0 rc2023-08-10T11:53:45.563656+0000 b7611 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15318 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c7c89600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000147:[<0x1000000034f/reader.Po v92>,<0x10000000206/.deps v244>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x10000000147:[<0x1000000034f/reader.Po v92>,<0x10000000206/.deps v244>,<0x10000000201/src v1667>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.665 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.343+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000351 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/blogbench.Po auth v102 ap=1 s=7760 n(v0 rc2023-08-10T11:53:45.221665+0000 b7760 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15318 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c7c89b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000351:[<0x1000000034f/blogbench.Po v102>,<0x10000000206/.deps v244>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x10000000351:[<0x1000000034f/blogbench.Po v102>,<0x10000000206/.deps v244>,<0x10000000201/src v1667>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.665 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.344+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000144 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/process.Po auth v100 ap=1 s=7613 n(v0 rc2023-08-10T11:53:45.306663+0000 b7613 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15318 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c7c8a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000144:[<0x1000000034f/process.Po v100>,<0x10000000206/.deps v244>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x10000000144:[<0x1000000034f/process.Po v100>,<0x10000000206/.deps v244>,<0x10000000201/src v1667>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.665 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.344+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000014c [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/mysnprintf.Po auth v110 ap=1 s=4110 n(v0 rc2023-08-10T11:53:45.893649+0000 b4110 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15318 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c7c8a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000014c:[<0x1000000034f/mysnprintf.Po v110>,<0x10000000206/.deps v244>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x1000000014c:[<0x1000000034f/mysnprintf.Po v110>,<0x10000000206/.deps v244>,<0x10000000201/src v1667>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.665 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.347+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000014b [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/fakesnprintf.Po auth v106 ap=1 s=7623 n(v0 rc2023-08-10T11:53:45.842650+0000 b7623 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15318 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c7c8ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000014b:[<0x1000000034f/fakesnprintf.Po v106>,<0x10000000206/.deps v244>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x1000000014b:[<0x1000000034f/fakesnprintf.Po v106>,<0x10000000206/.deps v244>,<0x10000000201/src v1667>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.665 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.351+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000149 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/helpers.Po auth v94 ap=1 s=7613 n(v0 rc2023-08-10T11:53:45.726653+0000 b7613 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15318 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c7c8b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000149:[<0x1000000034f/helpers.Po v94>,<0x10000000206/.deps v244>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x10000000149:[<0x1000000034f/helpers.Po v94>,<0x10000000206/.deps v244>,<0x10000000201/src v1667>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.665 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:54:09.357+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000014a [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/bsd-getopt_long.Po auth v108 ap=1 s=7632 n(v0 rc2023-08-10T11:53:45.785651+0000 b7632 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15318 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5561c7c8b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000014a:[<0x1000000034f/bsd-getopt_long.Po v108>,<0x10000000206/.deps v244>,<0x10000000201/src v1645>,<0x10000000006/blogbench-1.0 v1423>,<0x10000000005/tmp v23>,<0x100000001fb/client.0 v20>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v36>,<0x10000000001/sv_1 v60>,<0x10000000000/_nogroup v45>,<0x1/volumes v43>]//[]","memoryvalue":"(3)0x1000000014a:[<0x1000000034f/bsd-getopt_long.Po v108>,<0x10000000206/.deps v244>,<0x10000000201/src v1667>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v55>,<0x10000000001/sv_1 v78>,<0x10000000000/_nogroup v27>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:54:09.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:09 smithi073 ceph-mon[128869]: mgrmap e25: x(active, since 91s), standbys: z, y 2023-08-10T11:54:09.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:09 smithi152 ceph-mon[130220]: mgrmap e25: x(active, since 91s), standbys: z, y 2023-08-10T11:54:10.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:09 smithi156 ceph-mon[130574]: mgrmap e25: x(active, since 91s), standbys: z, y 2023-08-10T11:54:10.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: scrub queued for path: / 2023-08-10T11:54:10.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: scrub summary: idle+waiting paths [/] 2023-08-10T11:54:10.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: scrub summary: active paths [/] 2023-08-10T11:54:10.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: scrub summary: active paths [/] 2023-08-10T11:54:10.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000356 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/reader.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:10.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000000b (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:10.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000034f (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps) see mds.h log and `damage ls` output for details 2023-08-10T11:54:10.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000355 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/rewriter.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:10.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000353 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/process.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:10.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000035b (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/mysnprintf.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:10.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000357 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/commenter.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:10.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000015 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/globals.h) see mds.h log and `damage ls` output for details 2023-08-10T11:54:10.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000019 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/writer.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:10.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000207 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/mysnprintf.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:10.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000011 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.h) see mds.h log and `damage ls` output for details 2023-08-10T11:54:10.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000016 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/commenter.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:10.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000001a (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/helpers.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:10.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000000a (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/mysnprintf.h) see mds.h log and `damage ls` output for details 2023-08-10T11:54:10.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000358 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/helpers.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:10.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000000f (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench_p.h) see mds.h log and `damage ls` output for details 2023-08-10T11:54:10.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000035a (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/fakesnprintf.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:10.999 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: scrub summary: idle+waiting paths [/] 2023-08-10T11:54:10.999 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000000c (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench.h) see mds.h log and `damage ls` output for details 2023-08-10T11:54:10.999 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000017 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/rewriter.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:10.999 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000352 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:10.999 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000133 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/Makefile) see mds.h log and `damage ls` output for details 2023-08-10T11:54:10.999 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000013 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/Makefile.in) see mds.h log and `damage ls` output for details 2023-08-10T11:54:10.999 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000000d (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/fakesnprintf.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:10.999 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000012 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/Makefile.am) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.000 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000010 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.000 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000035d (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.000 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000359 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.000 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000018 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/reader.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.000 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000014 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/process.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.000 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000354 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/writer.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.001 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000000e (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/fakesnprintf.h) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.001 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000035c (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.001 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000146 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/rewriter.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.001 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000145 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/writer.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.001 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000148 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/commenter.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.001 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000147 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/reader.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.001 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000351 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/blogbench.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.002 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000144 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/process.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.002 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000014c (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/mysnprintf.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.002 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000014b (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/fakesnprintf.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.002 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000149 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/helpers.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.002 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000014a (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/bsd-getopt_long.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.002 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: scrub summary: active paths [/] 2023-08-10T11:54:11.002 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: scrub summary: idle+waiting paths [/] 2023-08-10T11:54:11.002 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: scrub summary: active paths [/] 2023-08-10T11:54:11.003 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: scrub summary: active paths [/] 2023-08-10T11:54:11.003 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: scrub summary: active paths [/] 2023-08-10T11:54:11.003 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: scrub summary: idle+waiting paths [/] 2023-08-10T11:54:11.003 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: scrub summary: idle+waiting paths [/] 2023-08-10T11:54:11.003 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: scrub summary: idle+waiting paths [/] 2023-08-10T11:54:11.003 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:10 smithi152 ceph-mon[130220]: pgmap v49: 97 pgs: 97 active+clean; 42 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 233 op/s 2023-08-10T11:54:11.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: scrub queued for path: / 2023-08-10T11:54:11.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: scrub summary: idle+waiting paths [/] 2023-08-10T11:54:11.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: scrub summary: active paths [/] 2023-08-10T11:54:11.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: scrub summary: active paths [/] 2023-08-10T11:54:11.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000356 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/reader.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000000b (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000034f (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000355 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/rewriter.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000353 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/process.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000035b (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/mysnprintf.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000357 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/commenter.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000015 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/globals.h) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000019 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/writer.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000207 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/mysnprintf.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000011 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.h) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000016 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/commenter.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000001a (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/helpers.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000000a (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/mysnprintf.h) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000358 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/helpers.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000000f (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench_p.h) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000035a (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/fakesnprintf.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: scrub summary: idle+waiting paths [/] 2023-08-10T11:54:11.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000000c (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench.h) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000017 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/rewriter.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000352 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.010 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000133 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/Makefile) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.010 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000013 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/Makefile.in) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.010 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000000d (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/fakesnprintf.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.010 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000012 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/Makefile.am) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.010 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000010 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.010 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000035d (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.010 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000359 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.011 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000018 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/reader.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.011 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000014 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/process.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.011 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000354 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/writer.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.011 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000000e (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/fakesnprintf.h) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.011 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000035c (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.011 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000146 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/rewriter.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.011 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000145 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/writer.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.011 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000148 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/commenter.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.012 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000147 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/reader.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.012 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000351 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/blogbench.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.012 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000144 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/process.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.012 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000014c (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/mysnprintf.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.012 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000014b (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/fakesnprintf.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.012 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000149 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/helpers.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.012 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000014a (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/bsd-getopt_long.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.013 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: scrub summary: active paths [/] 2023-08-10T11:54:11.013 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: scrub summary: idle+waiting paths [/] 2023-08-10T11:54:11.013 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: scrub summary: active paths [/] 2023-08-10T11:54:11.013 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: scrub summary: active paths [/] 2023-08-10T11:54:11.013 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: scrub summary: active paths [/] 2023-08-10T11:54:11.013 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: scrub summary: idle+waiting paths [/] 2023-08-10T11:54:11.013 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: scrub summary: idle+waiting paths [/] 2023-08-10T11:54:11.013 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: scrub summary: idle+waiting paths [/] 2023-08-10T11:54:11.014 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:10 smithi156 ceph-mon[130574]: pgmap v49: 97 pgs: 97 active+clean; 42 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 233 op/s 2023-08-10T11:54:11.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: scrub queued for path: / 2023-08-10T11:54:11.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: scrub summary: idle+waiting paths [/] 2023-08-10T11:54:11.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: scrub summary: active paths [/] 2023-08-10T11:54:11.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: scrub summary: active paths [/] 2023-08-10T11:54:11.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000356 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/reader.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000000b (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000034f (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000355 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/rewriter.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000353 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/process.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000035b (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/mysnprintf.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000357 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/commenter.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000015 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/globals.h) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000019 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/writer.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000207 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/mysnprintf.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000011 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.h) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000016 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/commenter.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000001a (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/helpers.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000000a (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/mysnprintf.h) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000358 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/helpers.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000000f (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench_p.h) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000035a (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/fakesnprintf.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: scrub summary: idle+waiting paths [/] 2023-08-10T11:54:11.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000000c (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench.h) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000017 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/rewriter.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000352 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000133 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/Makefile) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000013 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/Makefile.in) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.022 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000000d (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/fakesnprintf.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.022 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000012 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/Makefile.am) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.022 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000010 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.022 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000035d (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.022 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000359 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.022 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000018 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/reader.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.023 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000014 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/process.c) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.023 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000354 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/writer.o) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.023 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000000e (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/fakesnprintf.h) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.023 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000035c (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.023 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000146 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/rewriter.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.023 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000145 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/writer.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.023 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000148 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/commenter.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.024 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000147 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/reader.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.024 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000351 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/blogbench.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.024 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000144 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/process.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.024 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000014c (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/mysnprintf.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.024 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000014b (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/fakesnprintf.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.024 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000149 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/helpers.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.024 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000014a (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/bsd-getopt_long.Po) see mds.h log and `damage ls` output for details 2023-08-10T11:54:11.025 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: scrub summary: active paths [/] 2023-08-10T11:54:11.025 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: scrub summary: idle+waiting paths [/] 2023-08-10T11:54:11.025 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: scrub summary: active paths [/] 2023-08-10T11:54:11.025 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: scrub summary: active paths [/] 2023-08-10T11:54:11.025 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: scrub summary: active paths [/] 2023-08-10T11:54:11.025 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: scrub summary: idle+waiting paths [/] 2023-08-10T11:54:11.025 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: scrub summary: idle+waiting paths [/] 2023-08-10T11:54:11.025 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: scrub summary: idle+waiting paths [/] 2023-08-10T11:54:11.026 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:10 smithi073 ceph-mon[128869]: pgmap v49: 97 pgs: 97 active+clean; 42 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 233 op/s 2023-08-10T11:54:12.367 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.366+0000 7fd92e621700 1 -- 172.21.15.73:0/4115845467 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd928105640 msgr2=0x7fd928105a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:12.367 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.366+0000 7fd92e621700 1 --2- 172.21.15.73:0/4115845467 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd928105640 0x7fd928105a20 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd918009990 tx=0x7fd918009ca0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.368 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.366+0000 7fd92e621700 1 -- 172.21.15.73:0/4115845467 shutdown_connections 2023-08-10T11:54:12.368 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.366+0000 7fd92e621700 1 --2- 172.21.15.73:0/4115845467 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd928100640 0x7fd92810c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.368 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.366+0000 7fd92e621700 1 --2- 172.21.15.73:0/4115845467 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd928105640 0x7fd928105a20 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.368 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.366+0000 7fd92e621700 1 --2- 172.21.15.73:0/4115845467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9280ffc80 0x7fd928100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.368 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.366+0000 7fd92e621700 1 -- 172.21.15.73:0/4115845467 >> 172.21.15.73:0/4115845467 conn(0x7fd928076b40 msgr2=0x7fd9280fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:12.368 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.366+0000 7fd92e621700 1 -- 172.21.15.73:0/4115845467 shutdown_connections 2023-08-10T11:54:12.368 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.366+0000 7fd92e621700 1 -- 172.21.15.73:0/4115845467 wait complete. 2023-08-10T11:54:12.369 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.367+0000 7fd92e621700 1 Processor -- start 2023-08-10T11:54:12.369 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.367+0000 7fd92e621700 1 -- start start 2023-08-10T11:54:12.370 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.367+0000 7fd92e621700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9280ffc80 0x7fd92819b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:12.370 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.367+0000 7fd92e621700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd928100640 0x7fd92819bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:12.370 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.367+0000 7fd92e621700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd928105640 0x7fd928195510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:12.371 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.367+0000 7fd92e621700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd928195b80 con 0x7fd9280ffc80 2023-08-10T11:54:12.371 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.367+0000 7fd92e621700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd928195cf0 con 0x7fd928105640 2023-08-10T11:54:12.371 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.367+0000 7fd92e621700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd928195eb0 con 0x7fd928100640 2023-08-10T11:54:12.371 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.367+0000 7fd927fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9280ffc80 0x7fd92819b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:12.371 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.367+0000 7fd927fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9280ffc80 0x7fd92819b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34290/0 (socket says 172.21.15.73:34290) 2023-08-10T11:54:12.371 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.367+0000 7fd927fff700 1 -- 172.21.15.73:0/2427167920 learned_addr learned my addr 172.21.15.73:0/2427167920 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:12.371 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.367+0000 7fd92cbbe700 1 --2- 172.21.15.73:0/2427167920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd928105640 0x7fd928195510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.367+0000 7fd9277fe700 1 --2- 172.21.15.73:0/2427167920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd928100640 0x7fd92819bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.367+0000 7fd927fff700 1 -- 172.21.15.73:0/2427167920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd928100640 msgr2=0x7fd92819bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.367+0000 7fd927fff700 1 --2- 172.21.15.73:0/2427167920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd928100640 0x7fd92819bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.367+0000 7fd927fff700 1 -- 172.21.15.73:0/2427167920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd928105640 msgr2=0x7fd928195510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.367+0000 7fd927fff700 1 --2- 172.21.15.73:0/2427167920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd928105640 0x7fd928195510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.367+0000 7fd927fff700 1 -- 172.21.15.73:0/2427167920 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9180095f0 con 0x7fd9280ffc80 2023-08-10T11:54:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.367+0000 7fd927fff700 1 --2- 172.21.15.73:0/2427167920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9280ffc80 0x7fd92819b6b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd918000c00 tx=0x7fd918004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.368+0000 7fd9257fa700 1 -- 172.21.15.73:0/2427167920 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91801d070 con 0x7fd9280ffc80 2023-08-10T11:54:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.368+0000 7fd9257fa700 1 -- 172.21.15.73:0/2427167920 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd918021410 con 0x7fd9280ffc80 2023-08-10T11:54:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.368+0000 7fd9257fa700 1 -- 172.21.15.73:0/2427167920 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd918017650 con 0x7fd9280ffc80 2023-08-10T11:54:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.368+0000 7fd92e621700 1 -- 172.21.15.73:0/2427167920 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd928196130 con 0x7fd9280ffc80 2023-08-10T11:54:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.368+0000 7fd92e621700 1 -- 172.21.15.73:0/2427167920 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9281a26a0 con 0x7fd9280ffc80 2023-08-10T11:54:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.370+0000 7fd9257fa700 1 -- 172.21.15.73:0/2427167920 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fd918021580 con 0x7fd9280ffc80 2023-08-10T11:54:12.378 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.370+0000 7fd9257fa700 1 --2- 172.21.15.73:0/2427167920 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd9140a12c0 0x7fd9140a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:12.378 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.370+0000 7fd9277fe700 1 --2- 172.21.15.73:0/2427167920 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd9140a12c0 0x7fd9140a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:12.378 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.370+0000 7fd9257fa700 1 -- 172.21.15.73:0/2427167920 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd9180cdf70 con 0x7fd9280ffc80 2023-08-10T11:54:12.378 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.371+0000 7fd9277fe700 1 --2- 172.21.15.73:0/2427167920 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd9140a12c0 0x7fd9140a3780 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd928196980 tx=0x7fd910009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:12.378 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.371+0000 7fd93a7bab80 1 Processor -- start 2023-08-10T11:54:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.371+0000 7fd93a7bab80 1 -- start start 2023-08-10T11:54:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.371+0000 7fd93a7bab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e3ee26fa40 0x55e3ee26fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.371+0000 7fd93a7bab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee270360 0x55e3ee26a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.371+0000 7fd93a7bab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e3ee26a550 0x55e3ee26a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.371+0000 7fd93a7bab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3ee1e5d60 con 0x55e3ee270360 2023-08-10T11:54:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.371+0000 7fd93a7bab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3ee1c2530 con 0x55e3ee26fa40 2023-08-10T11:54:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.371+0000 7fd93a7bab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3ee1bfe50 con 0x55e3ee26a550 2023-08-10T11:54:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.372+0000 7fd9277fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee270360 0x55e3ee26a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.372+0000 7fd9277fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee270360 0x55e3ee26a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34300/0 (socket says 172.21.15.73:34300) 2023-08-10T11:54:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.372+0000 7fd9277fe700 1 -- 172.21.15.73:0/3269531321 learned_addr learned my addr 172.21.15.73:0/3269531321 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.372+0000 7fd927fff700 1 --2- 172.21.15.73:0/3269531321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e3ee26fa40 0x55e3ee26fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:12.381 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.372+0000 7fd92cbbe700 1 --2- 172.21.15.73:0/3269531321 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e3ee26a550 0x55e3ee26a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.372+0000 7fd9277fe700 1 -- 172.21.15.73:0/3269531321 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e3ee26a550 msgr2=0x55e3ee26a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.372+0000 7fd9277fe700 1 --2- 172.21.15.73:0/3269531321 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e3ee26a550 0x55e3ee26a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.372+0000 7fd9277fe700 1 -- 172.21.15.73:0/3269531321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e3ee26fa40 msgr2=0x55e3ee26fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.372+0000 7fd9277fe700 1 --2- 172.21.15.73:0/3269531321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e3ee26fa40 0x55e3ee26fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.372+0000 7fd9277fe700 1 -- 172.21.15.73:0/3269531321 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3ee03c5d0 con 0x55e3ee270360 2023-08-10T11:54:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.372+0000 7fd927fff700 1 --2- 172.21.15.73:0/3269531321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e3ee26fa40 0x55e3ee26fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.372+0000 7fd9277fe700 1 --2- 172.21.15.73:0/3269531321 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee270360 0x55e3ee26a010 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd910011d50 tx=0x7fd910014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e782d582e27d17 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.372+0000 7fd91e7fc700 1 -- 172.21.15.73:0/3269531321 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd910021070 con 0x55e3ee270360 2023-08-10T11:54:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.372+0000 7fd91e7fc700 1 -- 172.21.15.73:0/3269531321 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd91001cc20 con 0x55e3ee270360 2023-08-10T11:54:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.372+0000 7fd91e7fc700 1 -- 172.21.15.73:0/3269531321 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91000e610 con 0x55e3ee270360 2023-08-10T11:54:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.373+0000 7fd93a7bab80 1 -- 172.21.15.73:0/3269531321 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee270360 msgr2=0x55e3ee26a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.373+0000 7fd93a7bab80 1 --2- 172.21.15.73:0/3269531321 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee270360 0x55e3ee26a010 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd910011d50 tx=0x7fd910014000 comp rx=0 tx=0).stop 2023-08-10T11:54:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.373+0000 7fd93a7bab80 1 -- 172.21.15.73:0/3269531321 shutdown_connections 2023-08-10T11:54:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.373+0000 7fd93a7bab80 1 --2- 172.21.15.73:0/3269531321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e3ee26fa40 0x55e3ee26fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.373+0000 7fd93a7bab80 1 --2- 172.21.15.73:0/3269531321 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e3ee26a550 0x55e3ee26a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.373+0000 7fd93a7bab80 1 --2- 172.21.15.73:0/3269531321 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee270360 0x55e3ee26a010 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.373+0000 7fd93a7bab80 1 -- 172.21.15.73:0/3269531321 >> 172.21.15.73:0/3269531321 conn(0x55e3ee1c7c70 msgr2=0x55e3ee264d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.373+0000 7fd93a7bab80 1 -- 172.21.15.73:0/3269531321 shutdown_connections 2023-08-10T11:54:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.373+0000 7fd93a7bab80 1 -- 172.21.15.73:0/3269531321 wait complete. 2023-08-10T11:54:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.373+0000 7fd93a7bab80 1 -- start start 2023-08-10T11:54:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.374+0000 7fd93a7bab80 1 Processor -- start 2023-08-10T11:54:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.374+0000 7fd93a7bab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee26a550 0x55e3ee2763e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.374+0000 7fd93a7bab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e3ee26fa40 0x55e3ee2736d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.374+0000 7fd93a7bab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e3ee270360 0x55e3ee273e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.374+0000 7fd93a7bab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3ee1bb740 con 0x55e3ee26a550 2023-08-10T11:54:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.374+0000 7fd93a7bab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3ee15aa60 con 0x55e3ee270360 2023-08-10T11:54:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.374+0000 7fd93a7bab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3ee15a760 con 0x55e3ee26fa40 2023-08-10T11:54:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.374+0000 7fd93a7bab80 10 client.0 _ll_register_callbacks cb 0x55e3ee158620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:54:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.374+0000 7fd927fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee26a550 0x55e3ee2763e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.374+0000 7fd927fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee26a550 0x55e3ee2763e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34304/0 (socket says 172.21.15.73:34304) 2023-08-10T11:54:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.374+0000 7fd927fff700 1 -- 172.21.15.73:0/1401196789 learned_addr learned my addr 172.21.15.73:0/1401196789 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.374+0000 7fd9277fe700 1 --2- 172.21.15.73:0/1401196789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e3ee26fa40 0x55e3ee2736d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.374+0000 7fd92cbbe700 1 --2- 172.21.15.73:0/1401196789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e3ee270360 0x55e3ee273e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.374+0000 7fd927fff700 1 -- 172.21.15.73:0/1401196789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e3ee26fa40 msgr2=0x55e3ee2736d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.374+0000 7fd927fff700 1 --2- 172.21.15.73:0/1401196789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e3ee26fa40 0x55e3ee2736d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.374+0000 7fd927fff700 1 -- 172.21.15.73:0/1401196789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e3ee270360 msgr2=0x55e3ee273e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.374+0000 7fd927fff700 1 --2- 172.21.15.73:0/1401196789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e3ee270360 0x55e3ee273e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.374+0000 7fd927fff700 1 -- 172.21.15.73:0/1401196789 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9281a26a0 con 0x55e3ee26a550 2023-08-10T11:54:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.374+0000 7fd927fff700 1 --2- 172.21.15.73:0/1401196789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee26a550 0x55e3ee2763e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fd918005910 tx=0x7fd91809aae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c4271636b74a20 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.374+0000 7fd9077fe700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:54:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.375+0000 7fd9077fe700 1 -- 172.21.15.73:0/1401196789 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91809b100 con 0x55e3ee26a550 2023-08-10T11:54:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.375+0000 7fd9077fe700 1 -- 172.21.15.73:0/1401196789 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd9180cbe40 con 0x55e3ee26a550 2023-08-10T11:54:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.375+0000 7fd93a7bab80 1 -- 172.21.15.73:0/1401196789 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e3ee25d1c0 con 0x55e3ee26a550 2023-08-10T11:54:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.375+0000 7fd9077fe700 1 -- 172.21.15.73:0/1401196789 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd91809f130 con 0x55e3ee26a550 2023-08-10T11:54:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.375+0000 7fd93a7bab80 10 client.16128 fetch_fsmap learned FSMap version 31 2023-08-10T11:54:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.375+0000 7fd93a7bab80 1 -- 172.21.15.73:0/1401196789 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7fd910017070 con 0x55e3ee26a550 2023-08-10T11:54:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.375+0000 7fd9077fe700 1 -- 172.21.15.73:0/1401196789 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e3ee25d1c0 con 0x55e3ee26a550 2023-08-10T11:54:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.375+0000 7fd9077fe700 1 -- 172.21.15.73:0/1401196789 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 31) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fd918096ef0 con 0x55e3ee26a550 2023-08-10T11:54:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.375+0000 7fd93a7bab80 10 client.16128 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T11:54:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.375+0000 7fd93a7bab80 10 client.16128 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:54:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.375+0000 7fd93a7bab80 20 client.16128 populate_metadata read hostname 'smithi073' 2023-08-10T11:54:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.375+0000 7fd93a7bab80 1 --2- 172.21.15.73:0/1401196789 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e3ee283ac0 0x55e3ee285ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.375+0000 7fd93a7bab80 4 client.16128 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:54:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.375+0000 7fd93a7bab80 1 -- 172.21.15.73:0/1401196789 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e3ee239970 con 0x55e3ee283ac0 2023-08-10T11:54:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.375+0000 7fd9277fe700 1 --2- 172.21.15.73:0/1401196789 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e3ee283ac0 0x55e3ee285ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.376+0000 7fd9077fe700 10 client.16128 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.376+0000 7fd9277fe700 1 --2- 172.21.15.73:0/1401196789 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e3ee283ac0 0x55e3ee285ee0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a00957100a430bf9 server_cookie=3a8b77b4ca92f8ac in_seq=0 out_seq=0 2023-08-10T11:54:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.376+0000 7fd9077fe700 1 -- 172.21.15.73:0/1401196789 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55e3ee239970 con 0x55e3ee283ac0 2023-08-10T11:54:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.376+0000 7fd9077fe700 10 client.16128 handle_command_reply: tid=0 2023-08-10T11:54:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.376+0000 7fd93a7bab80 1 client.16128 shutdown 2023-08-10T11:54:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.377+0000 7fd93a7bab80 1 -- 172.21.15.73:0/1401196789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee26a550 msgr2=0x55e3ee2763e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.377+0000 7fd93a7bab80 1 --2- 172.21.15.73:0/1401196789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee26a550 0x55e3ee2763e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fd918005910 tx=0x7fd91809aae0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.377+0000 7fd93a7bab80 1 -- 172.21.15.73:0/1401196789 shutdown_connections 2023-08-10T11:54:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.377+0000 7fd93a7bab80 1 --2- 172.21.15.73:0/1401196789 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e3ee283ac0 0x55e3ee285ee0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.377+0000 7fd93a7bab80 1 --2- 172.21.15.73:0/1401196789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e3ee270360 0x55e3ee273e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.377+0000 7fd93a7bab80 1 --2- 172.21.15.73:0/1401196789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee26a550 0x55e3ee2763e0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.377+0000 7fd9077fe700 0 client.16128 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.377+0000 7fd93a7bab80 1 --2- 172.21.15.73:0/1401196789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e3ee26fa40 0x55e3ee2736d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.377+0000 7fd93a7bab80 1 -- 172.21.15.73:0/1401196789 >> 172.21.15.73:0/1401196789 conn(0x55e3ee1c7c70 msgr2=0x55e3ee2644b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.377+0000 7fd93a7bab80 1 -- 172.21.15.73:0/1401196789 shutdown_connections 2023-08-10T11:54:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.377+0000 7fd93a7bab80 1 -- 172.21.15.73:0/1401196789 wait complete. 2023-08-10T11:54:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.377+0000 7fd93a7bab80 20 client.16128 trim_cache size 0 max 16384 2023-08-10T11:54:12.398 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.392+0000 7fd93a7bab80 1 Processor -- start 2023-08-10T11:54:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.392+0000 7fd93a7bab80 1 -- start start 2023-08-10T11:54:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.392+0000 7fd93a7bab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee26a550 0x55e3ee28a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.392+0000 7fd93a7bab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e3ee26fa40 0x55e3ee264c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.392+0000 7fd93a7bab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e3ee270360 0x55e3ee26efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.392+0000 7fd93a7bab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3ee266b80 con 0x55e3ee26a550 2023-08-10T11:54:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.392+0000 7fd93a7bab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3ee03e8c0 con 0x55e3ee270360 2023-08-10T11:54:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.392+0000 7fd93a7bab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3ee25cd00 con 0x55e3ee26fa40 2023-08-10T11:54:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.392+0000 7fd927fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee26a550 0x55e3ee28a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.392+0000 7fd92cbbe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e3ee270360 0x55e3ee26efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.392+0000 7fd927fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee26a550 0x55e3ee28a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34312/0 (socket says 172.21.15.73:34312) 2023-08-10T11:54:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.392+0000 7fd9277fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e3ee26fa40 0x55e3ee264c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.392+0000 7fd927fff700 1 -- 172.21.15.73:0/3553951808 learned_addr learned my addr 172.21.15.73:0/3553951808 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.393+0000 7fd9277fe700 1 -- 172.21.15.73:0/3553951808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e3ee270360 msgr2=0x55e3ee26efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.393+0000 7fd9277fe700 1 --2- 172.21.15.73:0/3553951808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e3ee270360 0x55e3ee26efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.393+0000 7fd9277fe700 1 -- 172.21.15.73:0/3553951808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee26a550 msgr2=0x55e3ee28a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.393+0000 7fd9277fe700 1 --2- 172.21.15.73:0/3553951808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee26a550 0x55e3ee28a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.393+0000 7fd9277fe700 1 -- 172.21.15.73:0/3553951808 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3edfe8d80 con 0x55e3ee26fa40 2023-08-10T11:54:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.393+0000 7fd927fff700 1 --2- 172.21.15.73:0/3553951808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee26a550 0x55e3ee28a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.393+0000 7fd92cbbe700 1 --2- 172.21.15.73:0/3553951808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e3ee270360 0x55e3ee26efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.393+0000 7fd9277fe700 1 --2- 172.21.15.73:0/3553951808 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e3ee26fa40 0x55e3ee264c30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd9100117d0 tx=0x7fd910027d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18f5aca5ee5d353d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.393+0000 7fd91effd700 1 -- 172.21.15.73:0/3553951808 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd910021040 con 0x55e3ee26fa40 2023-08-10T11:54:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.393+0000 7fd91effd700 1 -- 172.21.15.73:0/3553951808 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd910011800 con 0x55e3ee26fa40 2023-08-10T11:54:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.393+0000 7fd91effd700 1 -- 172.21.15.73:0/3553951808 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd910033bf0 con 0x55e3ee26fa40 2023-08-10T11:54:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.394+0000 7fd93a7bab80 1 -- 172.21.15.73:0/3553951808 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e3ee26fa40 msgr2=0x55e3ee264c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.394+0000 7fd93a7bab80 1 --2- 172.21.15.73:0/3553951808 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e3ee26fa40 0x55e3ee264c30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd9100117d0 tx=0x7fd910027d30 comp rx=0 tx=0).stop 2023-08-10T11:54:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.394+0000 7fd93a7bab80 1 -- 172.21.15.73:0/3553951808 shutdown_connections 2023-08-10T11:54:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.394+0000 7fd93a7bab80 1 --2- 172.21.15.73:0/3553951808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e3ee270360 0x55e3ee26efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.394+0000 7fd93a7bab80 1 --2- 172.21.15.73:0/3553951808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee26a550 0x55e3ee28a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.394+0000 7fd93a7bab80 1 --2- 172.21.15.73:0/3553951808 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e3ee26fa40 0x55e3ee264c30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.394+0000 7fd93a7bab80 1 -- 172.21.15.73:0/3553951808 >> 172.21.15.73:0/3553951808 conn(0x55e3ee1c7c70 msgr2=0x55e3ee26e890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.394+0000 7fd93a7bab80 1 -- 172.21.15.73:0/3553951808 shutdown_connections 2023-08-10T11:54:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.394+0000 7fd93a7bab80 1 -- 172.21.15.73:0/3553951808 wait complete. 2023-08-10T11:54:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.394+0000 7fd93a7bab80 1 -- start start 2023-08-10T11:54:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.394+0000 7fd93a7bab80 1 Processor -- start 2023-08-10T11:54:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.394+0000 7fd93a7bab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee26a550 0x55e3ee27a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.394+0000 7fd93a7bab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e3ee26fa40 0x55e3ee27aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.394+0000 7fd93a7bab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e3ee270360 0x55e3ee278f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.394+0000 7fd93a7bab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3ee279630 con 0x55e3ee26a550 2023-08-10T11:54:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.394+0000 7fd93a7bab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3ee2797a0 con 0x55e3ee26fa40 2023-08-10T11:54:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.394+0000 7fd93a7bab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3ee279960 con 0x55e3ee270360 2023-08-10T11:54:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.395+0000 7fd93a7bab80 10 client.0 _ll_register_callbacks cb 0x55e3ee158620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:54:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.395+0000 7fd927fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee26a550 0x55e3ee27a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.395+0000 7fd927fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee26a550 0x55e3ee27a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34318/0 (socket says 172.21.15.73:34318) 2023-08-10T11:54:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.395+0000 7fd9277fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e3ee26fa40 0x55e3ee27aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.395+0000 7fd927fff700 1 -- 172.21.15.73:0/1321520713 learned_addr learned my addr 172.21.15.73:0/1321520713 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.395+0000 7fd92cbbe700 1 --2- 172.21.15.73:0/1321520713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e3ee270360 0x55e3ee278f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.395+0000 7fd927fff700 1 -- 172.21.15.73:0/1321520713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e3ee270360 msgr2=0x55e3ee278f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.395+0000 7fd927fff700 1 --2- 172.21.15.73:0/1321520713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e3ee270360 0x55e3ee278f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.395+0000 7fd927fff700 1 -- 172.21.15.73:0/1321520713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e3ee26fa40 msgr2=0x55e3ee27aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.395+0000 7fd927fff700 1 --2- 172.21.15.73:0/1321520713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e3ee26fa40 0x55e3ee27aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.395+0000 7fd927fff700 1 -- 172.21.15.73:0/1321520713 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd910017070 con 0x55e3ee26a550 2023-08-10T11:54:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.395+0000 7fd927fff700 1 --2- 172.21.15.73:0/1321520713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee26a550 0x55e3ee27a9a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd9180cb7a0 tx=0x7fd9180b2000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f46dfefef1645c3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.395+0000 7fd9077fe700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:54:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.395+0000 7fd9077fe700 1 -- 172.21.15.73:0/1321520713 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9180a3030 con 0x55e3ee26a550 2023-08-10T11:54:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.395+0000 7fd9077fe700 1 -- 172.21.15.73:0/1321520713 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd9180cbe40 con 0x55e3ee26a550 2023-08-10T11:54:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.395+0000 7fd93a7bab80 1 -- 172.21.15.73:0/1321520713 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e3ee1b4720 con 0x55e3ee26a550 2023-08-10T11:54:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.395+0000 7fd9077fe700 1 -- 172.21.15.73:0/1321520713 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd91809b100 con 0x55e3ee26a550 2023-08-10T11:54:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.395+0000 7fd93a7bab80 10 client.16134 fetch_fsmap learned FSMap version 31 2023-08-10T11:54:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.395+0000 7fd93a7bab80 1 -- 172.21.15.73:0/1321520713 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7fd9200115b0 con 0x55e3ee26a550 2023-08-10T11:54:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.396+0000 7fd9077fe700 1 -- 172.21.15.73:0/1321520713 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e3ee1b4720 con 0x55e3ee26a550 2023-08-10T11:54:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.396+0000 7fd9077fe700 1 -- 172.21.15.73:0/1321520713 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 31) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fd91809a060 con 0x55e3ee26a550 2023-08-10T11:54:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.396+0000 7fd93a7bab80 10 client.16134 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T11:54:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.396+0000 7fd93a7bab80 10 client.16134 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:54:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.396+0000 7fd93a7bab80 20 client.16134 populate_metadata read hostname 'smithi073' 2023-08-10T11:54:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.396+0000 7fd93a7bab80 1 --2- 172.21.15.73:0/1321520713 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e3ee2d86b0 0x55e3ee2daad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.396+0000 7fd93a7bab80 4 client.16134 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:54:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.396+0000 7fd93a7bab80 1 -- 172.21.15.73:0/1321520713 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e3ee175ff0 con 0x55e3ee2d86b0 2023-08-10T11:54:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.396+0000 7fd9277fe700 1 --2- 172.21.15.73:0/1321520713 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e3ee2d86b0 0x55e3ee2daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.396+0000 7fd9077fe700 10 client.16134 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.396+0000 7fd9277fe700 1 --2- 172.21.15.73:0/1321520713 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e3ee2d86b0 0x55e3ee2daad0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc52bf0047ab4602 server_cookie=d3fd5d7bee16e3c8 in_seq=0 out_seq=0 2023-08-10T11:54:12.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.423+0000 7fd9077fe700 1 -- 172.21.15.73:0/1321520713 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e3ee175ff0 con 0x55e3ee2d86b0 2023-08-10T11:54:12.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.423+0000 7fd9077fe700 10 client.16134 handle_command_reply: tid=0 2023-08-10T11:54:12.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.423+0000 7fd93a7bab80 1 client.16134 shutdown 2023-08-10T11:54:12.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.424+0000 7fd93a7bab80 1 -- 172.21.15.73:0/1321520713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee26a550 msgr2=0x55e3ee27a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:12.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.424+0000 7fd93a7bab80 1 --2- 172.21.15.73:0/1321520713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee26a550 0x55e3ee27a9a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd9180cb7a0 tx=0x7fd9180b2000 comp rx=0 tx=0).stop 2023-08-10T11:54:12.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.424+0000 7fd93a7bab80 1 -- 172.21.15.73:0/1321520713 shutdown_connections 2023-08-10T11:54:12.426 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.424+0000 7fd93a7bab80 1 --2- 172.21.15.73:0/1321520713 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e3ee2d86b0 0x55e3ee2daad0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.426 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.424+0000 7fd93a7bab80 1 --2- 172.21.15.73:0/1321520713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e3ee270360 0x55e3ee278f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.426 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.424+0000 7fd9077fe700 0 client.16134 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:12.426 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.424+0000 7fd93a7bab80 1 --2- 172.21.15.73:0/1321520713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e3ee26a550 0x55e3ee27a9a0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.426 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.424+0000 7fd93a7bab80 1 --2- 172.21.15.73:0/1321520713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e3ee26fa40 0x55e3ee27aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.426 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.424+0000 7fd93a7bab80 1 -- 172.21.15.73:0/1321520713 >> 172.21.15.73:0/1321520713 conn(0x55e3ee1c7c70 msgr2=0x55e3ee26f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:12.426 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.424+0000 7fd93a7bab80 1 -- 172.21.15.73:0/1321520713 shutdown_connections 2023-08-10T11:54:12.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.424+0000 7fd93a7bab80 1 -- 172.21.15.73:0/1321520713 wait complete. 2023-08-10T11:54:12.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.424+0000 7fd93a7bab80 20 client.16134 trim_cache size 0 max 16384 2023-08-10T11:54:12.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:54:12.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:54:12.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:54:12.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:54:12.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.424+0000 7fd92e621700 1 -- 172.21.15.73:0/2427167920 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd9140a12c0 msgr2=0x7fd9140a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:12.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.424+0000 7fd92e621700 1 --2- 172.21.15.73:0/2427167920 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd9140a12c0 0x7fd9140a3780 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd928196980 tx=0x7fd910009260 comp rx=0 tx=0).stop 2023-08-10T11:54:12.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.424+0000 7fd92e621700 1 -- 172.21.15.73:0/2427167920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9280ffc80 msgr2=0x7fd92819b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.424+0000 7fd92e621700 1 --2- 172.21.15.73:0/2427167920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9280ffc80 0x7fd92819b6b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd918000c00 tx=0x7fd918004790 comp rx=0 tx=0).stop 2023-08-10T11:54:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.425+0000 7fd92e621700 1 -- 172.21.15.73:0/2427167920 shutdown_connections 2023-08-10T11:54:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.425+0000 7fd92e621700 1 --2- 172.21.15.73:0/2427167920 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd9140a12c0 0x7fd9140a3780 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.425+0000 7fd92e621700 1 --2- 172.21.15.73:0/2427167920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd928105640 0x7fd928195510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.425+0000 7fd92e621700 1 --2- 172.21.15.73:0/2427167920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9280ffc80 0x7fd92819b6b0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.425+0000 7fd92e621700 1 --2- 172.21.15.73:0/2427167920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd928100640 0x7fd92819bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:12.430 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.425+0000 7fd92e621700 1 -- 172.21.15.73:0/2427167920 >> 172.21.15.73:0/2427167920 conn(0x7fd928076b40 msgr2=0x7fd928103280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:12.430 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.425+0000 7fd92e621700 1 -- 172.21.15.73:0/2427167920 shutdown_connections 2023-08-10T11:54:12.430 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:12.425+0000 7fd92e621700 1 -- 172.21.15.73:0/2427167920 wait complete. 2023-08-10T11:54:12.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:12 smithi152 ceph-mon[130220]: pgmap v50: 97 pgs: 97 active+clean; 42 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 421 KiB/s wr, 63 op/s 2023-08-10T11:54:13.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:12 smithi156 ceph-mon[130574]: pgmap v50: 97 pgs: 97 active+clean; 42 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 421 KiB/s wr, 63 op/s 2023-08-10T11:54:13.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:12 smithi073 ceph-mon[128869]: pgmap v50: 97 pgs: 97 active+clean; 42 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 421 KiB/s wr, 63 op/s 2023-08-10T11:54:14.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:14 smithi152 ceph-mon[130220]: pgmap v51: 97 pgs: 97 active+clean; 42 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 421 KiB/s wr, 63 op/s 2023-08-10T11:54:15.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:14 smithi156 ceph-mon[130574]: pgmap v51: 97 pgs: 97 active+clean; 42 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 421 KiB/s wr, 63 op/s 2023-08-10T11:54:15.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:14 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mon-a[128845]: 2023-08-10T11:54:14.545+0000 7f3dd78d8700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-08-10T11:54:15.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:14 smithi073 ceph-mon[128869]: pgmap v51: 97 pgs: 97 active+clean; 42 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 421 KiB/s wr, 63 op/s 2023-08-10T11:54:15.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:15 smithi152 ceph-mon[130220]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-08-10T11:54:15.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:15 smithi152 ceph-mon[130220]: mds.? [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] up:active 2023-08-10T11:54:15.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:15 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:54:16.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:15 smithi156 ceph-mon[130574]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-08-10T11:54:16.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:15 smithi156 ceph-mon[130574]: mds.? [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] up:active 2023-08-10T11:54:16.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:15 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:54:16.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:15 smithi073 ceph-mon[128869]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-08-10T11:54:16.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:15 smithi073 ceph-mon[128869]: mds.? [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] up:active 2023-08-10T11:54:16.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:15 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:54:16.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:16 smithi152 ceph-mon[130220]: pgmap v52: 97 pgs: 97 active+clean; 50 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 100 op/s 2023-08-10T11:54:17.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:16 smithi156 ceph-mon[130574]: pgmap v52: 97 pgs: 97 active+clean; 50 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 100 op/s 2023-08-10T11:54:17.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:16 smithi073 ceph-mon[128869]: pgmap v52: 97 pgs: 97 active+clean; 50 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 100 op/s 2023-08-10T11:54:17.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:17 smithi152 ceph-mon[130220]: scrub summary: active paths [/] 2023-08-10T11:54:17.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:17 smithi152 ceph-mon[130220]: scrub summary: idle+waiting paths [/] 2023-08-10T11:54:18.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:17 smithi156 ceph-mon[130574]: scrub summary: active paths [/] 2023-08-10T11:54:18.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:17 smithi156 ceph-mon[130574]: scrub summary: idle+waiting paths [/] 2023-08-10T11:54:18.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:17 smithi073 ceph-mon[128869]: scrub summary: active paths [/] 2023-08-10T11:54:18.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:17 smithi073 ceph-mon[128869]: scrub summary: idle+waiting paths [/] 2023-08-10T11:54:18.091 INFO:tasks.workunit.client.0.smithi073.stdout: 30 67640 764 48361 847 15338 855 2023-08-10T11:54:18.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:18 smithi152 ceph-mon[130220]: pgmap v53: 97 pgs: 97 active+clean; 50 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 904 KiB/s rd, 890 KiB/s wr, 49 op/s 2023-08-10T11:54:19.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:18 smithi156 ceph-mon[130574]: pgmap v53: 97 pgs: 97 active+clean; 50 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 904 KiB/s rd, 890 KiB/s wr, 49 op/s 2023-08-10T11:54:19.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:18 smithi073 ceph-mon[128869]: pgmap v53: 97 pgs: 97 active+clean; 50 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 904 KiB/s rd, 890 KiB/s wr, 49 op/s 2023-08-10T11:54:20.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:20 smithi152 ceph-mon[130220]: pgmap v54: 97 pgs: 97 active+clean; 60 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 82 op/s 2023-08-10T11:54:21.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:20 smithi156 ceph-mon[130574]: pgmap v54: 97 pgs: 97 active+clean; 60 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 82 op/s 2023-08-10T11:54:21.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:20 smithi073 ceph-mon[128869]: pgmap v54: 97 pgs: 97 active+clean; 60 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 82 op/s 2023-08-10T11:54:22.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:22 smithi152 ceph-mon[130220]: pgmap v55: 97 pgs: 97 active+clean; 60 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 69 op/s 2023-08-10T11:54:23.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:22 smithi156 ceph-mon[130574]: pgmap v55: 97 pgs: 97 active+clean; 60 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 69 op/s 2023-08-10T11:54:23.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:22 smithi073 ceph-mon[128869]: pgmap v55: 97 pgs: 97 active+clean; 60 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 69 op/s 2023-08-10T11:54:24.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:24 smithi152 ceph-mon[130220]: pgmap v56: 97 pgs: 97 active+clean; 67 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 107 op/s 2023-08-10T11:54:25.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:24 smithi156 ceph-mon[130574]: pgmap v56: 97 pgs: 97 active+clean; 67 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 107 op/s 2023-08-10T11:54:25.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:24 smithi073 ceph-mon[128869]: pgmap v56: 97 pgs: 97 active+clean; 67 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 107 op/s 2023-08-10T11:54:25.543 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.541+0000 7f1b8588f700 1 -- 172.21.15.73:0/1580072660 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b80106680 msgr2=0x7f1b80106a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:25.543 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.541+0000 7f1b8588f700 1 --2- 172.21.15.73:0/1580072660 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b80106680 0x7f1b80106a60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1b700098f0 tx=0x7f1b70009c00 comp rx=0 tx=0).stop 2023-08-10T11:54:25.543 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.541+0000 7f1b8588f700 1 -- 172.21.15.73:0/1580072660 shutdown_connections 2023-08-10T11:54:25.543 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.541+0000 7f1b8588f700 1 --2- 172.21.15.73:0/1580072660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b80101030 0x7f1b8010d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.544 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.541+0000 7f1b8588f700 1 --2- 172.21.15.73:0/1580072660 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b80106680 0x7f1b80106a60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.544 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.541+0000 7f1b8588f700 1 --2- 172.21.15.73:0/1580072660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b80100670 0x7f1b80100af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.544 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.541+0000 7f1b8588f700 1 -- 172.21.15.73:0/1580072660 >> 172.21.15.73:0/1580072660 conn(0x7f1b800fc1a0 msgr2=0x7f1b800fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:25.544 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.541+0000 7f1b8588f700 1 -- 172.21.15.73:0/1580072660 shutdown_connections 2023-08-10T11:54:25.544 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.541+0000 7f1b8588f700 1 -- 172.21.15.73:0/1580072660 wait complete. 2023-08-10T11:54:25.545 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.541+0000 7f1b8588f700 1 Processor -- start 2023-08-10T11:54:25.547 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.541+0000 7f1b8588f700 1 -- start start 2023-08-10T11:54:25.547 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.542+0000 7f1b8588f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b80100670 0x7f1b801945d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:25.548 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.542+0000 7f1b8588f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b80101030 0x7f1b80194b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:25.548 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.542+0000 7f1b8588f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b80106680 0x7f1b80198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:25.548 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.542+0000 7f1b8588f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b801995b0 con 0x7f1b80101030 2023-08-10T11:54:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.542+0000 7f1b8588f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b80199720 con 0x7f1b80106680 2023-08-10T11:54:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.542+0000 7f1b8588f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b801998e0 con 0x7f1b80100670 2023-08-10T11:54:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.542+0000 7f1b7e7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b80101030 0x7f1b80194b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.542+0000 7f1b7e7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b80101030 0x7f1b80194b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34334/0 (socket says 172.21.15.73:34334) 2023-08-10T11:54:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.542+0000 7f1b7effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b80100670 0x7f1b801945d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.542+0000 7f1b7f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b80106680 0x7f1b80198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.542+0000 7f1b7e7fc700 1 -- 172.21.15.73:0/3902474415 learned_addr learned my addr 172.21.15.73:0/3902474415 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.542+0000 7f1b7effd700 1 -- 172.21.15.73:0/3902474415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b80106680 msgr2=0x7f1b80198f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.542+0000 7f1b7effd700 1 --2- 172.21.15.73:0/3902474415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b80106680 0x7f1b80198f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.542+0000 7f1b7effd700 1 -- 172.21.15.73:0/3902474415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b80101030 msgr2=0x7f1b80194b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.542+0000 7f1b7effd700 1 --2- 172.21.15.73:0/3902474415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b80101030 0x7f1b80194b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.542+0000 7f1b7effd700 1 -- 172.21.15.73:0/3902474415 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b70009520 con 0x7f1b80100670 2023-08-10T11:54:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.542+0000 7f1b7e7fc700 1 --2- 172.21.15.73:0/3902474415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b80101030 0x7f1b80194b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.542+0000 7f1b7effd700 1 --2- 172.21.15.73:0/3902474415 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b80100670 0x7f1b801945d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1b7001b040 tx=0x7f1b7000bc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.543+0000 7f1b8488d700 1 -- 172.21.15.73:0/3902474415 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b70005240 con 0x7f1b80100670 2023-08-10T11:54:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.543+0000 7f1b8488d700 1 -- 172.21.15.73:0/3902474415 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b70018440 con 0x7f1b80100670 2023-08-10T11:54:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.543+0000 7f1b8488d700 1 -- 172.21.15.73:0/3902474415 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b700038c0 con 0x7f1b80100670 2023-08-10T11:54:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.543+0000 7f1b8588f700 1 -- 172.21.15.73:0/3902474415 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b80199b60 con 0x7f1b80100670 2023-08-10T11:54:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.543+0000 7f1b8588f700 1 -- 172.21.15.73:0/3902474415 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b801a1400 con 0x7f1b80100670 2023-08-10T11:54:25.559 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.546+0000 7f1b8488d700 1 -- 172.21.15.73:0/3902474415 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f1b7001f070 con 0x7f1b80100670 2023-08-10T11:54:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.547+0000 7f1b8488d700 1 --2- 172.21.15.73:0/3902474415 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f1b680a1340 0x7f1b680a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.547+0000 7f1b7e7fc700 1 --2- 172.21.15.73:0/3902474415 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f1b680a1340 0x7f1b680a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.547+0000 7f1b8488d700 1 -- 172.21.15.73:0/3902474415 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f1b700d2210 con 0x7f1b80100670 2023-08-10T11:54:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.547+0000 7f1b91a28b80 1 Processor -- start 2023-08-10T11:54:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.548+0000 7f1b91a28b80 1 -- start start 2023-08-10T11:54:25.561 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.548+0000 7f1b7e7fc700 1 --2- 172.21.15.73:0/3902474415 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f1b680a1340 0x7f1b680a3800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1b80195be0 tx=0x7f1b74009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:25.561 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.548+0000 7f1b91a28b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b034dd3a40 0x55b034dd3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:25.561 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.548+0000 7f1b91a28b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b034dd4360 0x55b034dce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:25.561 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.548+0000 7f1b91a28b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b034dce550 0x55b034dce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:25.561 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.548+0000 7f1b91a28b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b034d49d60 con 0x55b034dce550 2023-08-10T11:54:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.548+0000 7f1b91a28b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b034d26530 con 0x55b034dd4360 2023-08-10T11:54:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.548+0000 7f1b91a28b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b034d23e50 con 0x55b034dd3a40 2023-08-10T11:54:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.548+0000 7f1b7f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b034dce550 0x55b034dce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.548+0000 7f1b7e7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b034dd4360 0x55b034dce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.548+0000 7f1b7effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b034dd3a40 0x55b034dd3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:25.562 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.548+0000 7f1b7f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b034dce550 0x55b034dce9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34344/0 (socket says 172.21.15.73:34344) 2023-08-10T11:54:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.548+0000 7f1b7e7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b034dd4360 0x55b034dce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:48992/0 (socket says 172.21.15.73:48992) 2023-08-10T11:54:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.548+0000 7f1b7f7fe700 1 -- 172.21.15.73:0/2721527002 learned_addr learned my addr 172.21.15.73:0/2721527002 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.548+0000 7f1b7f7fe700 1 -- 172.21.15.73:0/2721527002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b034dd3a40 msgr2=0x55b034dd3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.548+0000 7f1b7f7fe700 1 --2- 172.21.15.73:0/2721527002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b034dd3a40 0x55b034dd3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.548+0000 7f1b7f7fe700 1 -- 172.21.15.73:0/2721527002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b034dd4360 msgr2=0x55b034dce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.548+0000 7f1b7f7fe700 1 --2- 172.21.15.73:0/2721527002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b034dd4360 0x55b034dce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.548+0000 7f1b7f7fe700 1 -- 172.21.15.73:0/2721527002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b034ba05d0 con 0x55b034dce550 2023-08-10T11:54:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.548+0000 7f1b7effd700 1 --2- 172.21.15.73:0/2721527002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b034dd3a40 0x55b034dd3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.548+0000 7f1b7e7fc700 1 --2- 172.21.15.73:0/2721527002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b034dd4360 0x55b034dce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.549+0000 7f1b7f7fe700 1 --2- 172.21.15.73:0/2721527002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b034dce550 0x55b034dce9d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1b78011670 tx=0x7f1b780099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac191c2598ac110f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.549+0000 7f1b65ffb700 1 -- 172.21.15.73:0/2721527002 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7800e040 con 0x55b034dce550 2023-08-10T11:54:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.549+0000 7f1b65ffb700 1 -- 172.21.15.73:0/2721527002 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b7800f040 con 0x55b034dce550 2023-08-10T11:54:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.549+0000 7f1b65ffb700 1 -- 172.21.15.73:0/2721527002 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b78004680 con 0x55b034dce550 2023-08-10T11:54:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.549+0000 7f1b91a28b80 1 -- 172.21.15.73:0/2721527002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b034dce550 msgr2=0x55b034dce9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.549+0000 7f1b91a28b80 1 --2- 172.21.15.73:0/2721527002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b034dce550 0x55b034dce9d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1b78011670 tx=0x7f1b780099e0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.550+0000 7f1b91a28b80 1 -- 172.21.15.73:0/2721527002 shutdown_connections 2023-08-10T11:54:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.550+0000 7f1b91a28b80 1 --2- 172.21.15.73:0/2721527002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b034dce550 0x55b034dce9d0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.550+0000 7f1b91a28b80 1 --2- 172.21.15.73:0/2721527002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b034dd3a40 0x55b034dd3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.550+0000 7f1b91a28b80 1 --2- 172.21.15.73:0/2721527002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b034dd4360 0x55b034dce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.550+0000 7f1b91a28b80 1 -- 172.21.15.73:0/2721527002 >> 172.21.15.73:0/2721527002 conn(0x55b034d2bc70 msgr2=0x55b034dc8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:25.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.550+0000 7f1b91a28b80 1 -- 172.21.15.73:0/2721527002 shutdown_connections 2023-08-10T11:54:25.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.550+0000 7f1b91a28b80 1 -- 172.21.15.73:0/2721527002 wait complete. 2023-08-10T11:54:25.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.550+0000 7f1b91a28b80 1 -- start start 2023-08-10T11:54:25.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.550+0000 7f1b91a28b80 1 Processor -- start 2023-08-10T11:54:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.550+0000 7f1b91a28b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b034dce550 0x55b034dd76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.550+0000 7f1b91a28b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b034dd3a40 0x55b034dd7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.550+0000 7f1b91a28b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b034dd4360 0x55b034dd8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.550+0000 7f1b91a28b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b034d1f740 con 0x55b034dd4360 2023-08-10T11:54:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.550+0000 7f1b91a28b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b034cbea60 con 0x55b034dce550 2023-08-10T11:54:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.550+0000 7f1b91a28b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b034cbe760 con 0x55b034dd3a40 2023-08-10T11:54:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.550+0000 7f1b91a28b80 10 client.0 _ll_register_callbacks cb 0x55b034cbc620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:54:25.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.551+0000 7f1b7f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b034dd4360 0x55b034dd8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:25.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.551+0000 7f1b7effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b034dce550 0x55b034dd76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:25.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.551+0000 7f1b7e7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b034dd3a40 0x55b034dd7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:25.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.551+0000 7f1b7f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b034dd4360 0x55b034dd8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34348/0 (socket says 172.21.15.73:34348) 2023-08-10T11:54:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.551+0000 7f1b7f7fe700 1 -- 172.21.15.73:0/1401532914 learned_addr learned my addr 172.21.15.73:0/1401532914 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.551+0000 7f1b7f7fe700 1 -- 172.21.15.73:0/1401532914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b034dd3a40 msgr2=0x55b034dd7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.551+0000 7f1b7f7fe700 1 --2- 172.21.15.73:0/1401532914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b034dd3a40 0x55b034dd7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.551+0000 7f1b7f7fe700 1 -- 172.21.15.73:0/1401532914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b034dce550 msgr2=0x55b034dd76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.551+0000 7f1b7f7fe700 1 --2- 172.21.15.73:0/1401532914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b034dce550 0x55b034dd76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.551+0000 7f1b7f7fe700 1 -- 172.21.15.73:0/1401532914 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b74017070 con 0x55b034dd4360 2023-08-10T11:54:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.551+0000 7f1b7f7fe700 1 --2- 172.21.15.73:0/1401532914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b034dd4360 0x55b034dd8140 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f1b780040e0 tx=0x7f1b78004110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae410ce52869a920 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.551+0000 7f1b5effd700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:54:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.551+0000 7f1b5effd700 1 -- 172.21.15.73:0/1401532914 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7800e030 con 0x55b034dd4360 2023-08-10T11:54:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.551+0000 7f1b5effd700 1 -- 172.21.15.73:0/1401532914 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f1b780092e0 con 0x55b034dd4360 2023-08-10T11:54:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.551+0000 7f1b91a28b80 1 -- 172.21.15.73:0/1401532914 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b034dc11c0 con 0x55b034dd4360 2023-08-10T11:54:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.551+0000 7f1b5effd700 1 -- 172.21.15.73:0/1401532914 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b78004ce0 con 0x55b034dd4360 2023-08-10T11:54:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.551+0000 7f1b91a28b80 10 client.16146 fetch_fsmap learned FSMap version 32 2023-08-10T11:54:25.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.551+0000 7f1b91a28b80 1 -- 172.21.15.73:0/1401532914 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f1b78011350 con 0x55b034dd4360 2023-08-10T11:54:25.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.552+0000 7f1b5effd700 1 -- 172.21.15.73:0/1401532914 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b034dc11c0 con 0x55b034dd4360 2023-08-10T11:54:25.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.552+0000 7f1b5effd700 1 -- 172.21.15.73:0/1401532914 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 32) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f1b78024020 con 0x55b034dd4360 2023-08-10T11:54:25.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.552+0000 7f1b91a28b80 10 client.16146 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T11:54:25.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.552+0000 7f1b91a28b80 10 client.16146 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:54:25.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.552+0000 7f1b91a28b80 20 client.16146 populate_metadata read hostname 'smithi073' 2023-08-10T11:54:25.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.552+0000 7f1b91a28b80 1 --2- 172.21.15.73:0/1401532914 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b034de7db0 0x55b034dea1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:25.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.552+0000 7f1b91a28b80 4 client.16146 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:54:25.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.552+0000 7f1b91a28b80 1 -- 172.21.15.73:0/1401532914 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b034d9d970 con 0x55b034de7db0 2023-08-10T11:54:25.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.552+0000 7f1b7effd700 1 --2- 172.21.15.73:0/1401532914 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b034de7db0 0x55b034dea1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:25.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.552+0000 7f1b7effd700 1 --2- 172.21.15.73:0/1401532914 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b034de7db0 0x55b034dea1d0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c791405703f5b6b server_cookie=43fc26f82ed57805 in_seq=0 out_seq=0 2023-08-10T11:54:25.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.552+0000 7f1b5effd700 10 client.16146 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:25.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.553+0000 7f1b5effd700 1 -- 172.21.15.73:0/1401532914 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x7f1b700b7e90 con 0x55b034de7db0 2023-08-10T11:54:25.573 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.553+0000 7f1b5effd700 10 client.16146 handle_command_reply: tid=0 2023-08-10T11:54:25.573 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.553+0000 7f1b91a28b80 1 client.16146 shutdown 2023-08-10T11:54:25.573 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.553+0000 7f1b91a28b80 1 -- 172.21.15.73:0/1401532914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b034dd4360 msgr2=0x55b034dd8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:25.573 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.553+0000 7f1b91a28b80 1 --2- 172.21.15.73:0/1401532914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b034dd4360 0x55b034dd8140 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f1b780040e0 tx=0x7f1b78004110 comp rx=0 tx=0).stop 2023-08-10T11:54:25.573 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.553+0000 7f1b91a28b80 1 -- 172.21.15.73:0/1401532914 shutdown_connections 2023-08-10T11:54:25.573 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.553+0000 7f1b91a28b80 1 --2- 172.21.15.73:0/1401532914 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b034de7db0 0x55b034dea1d0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.573 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.553+0000 7f1b91a28b80 1 --2- 172.21.15.73:0/1401532914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b034dce550 0x55b034dd76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.573 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.553+0000 7f1b5effd700 0 client.16146 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:25.574 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.553+0000 7f1b91a28b80 1 --2- 172.21.15.73:0/1401532914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b034dd4360 0x55b034dd8140 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.574 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.553+0000 7f1b91a28b80 1 --2- 172.21.15.73:0/1401532914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b034dd3a40 0x55b034dd7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.574 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.553+0000 7f1b91a28b80 1 -- 172.21.15.73:0/1401532914 >> 172.21.15.73:0/1401532914 conn(0x55b034d2bc70 msgr2=0x55b034dc84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:25.574 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.553+0000 7f1b91a28b80 1 -- 172.21.15.73:0/1401532914 shutdown_connections 2023-08-10T11:54:25.574 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.553+0000 7f1b91a28b80 1 -- 172.21.15.73:0/1401532914 wait complete. 2023-08-10T11:54:25.574 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.554+0000 7f1b91a28b80 20 client.16146 trim_cache size 0 max 16384 2023-08-10T11:54:25.578 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.569+0000 7f1b91a28b80 1 Processor -- start 2023-08-10T11:54:25.578 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.569+0000 7f1b91a28b80 1 -- start start 2023-08-10T11:54:25.578 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.569+0000 7f1b91a28b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b034dce550 0x55b034dce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:25.578 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.569+0000 7f1b91a28b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b034dd3a40 0x55b034ddee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:25.579 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.569+0000 7f1b91a28b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b034dd4360 0x55b034dc8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:25.579 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.569+0000 7f1b91a28b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b034ba28c0 con 0x55b034dce550 2023-08-10T11:54:25.579 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.569+0000 7f1b91a28b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b034ddf350 con 0x55b034dd4360 2023-08-10T11:54:25.579 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.569+0000 7f1b91a28b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b034dc5cd0 con 0x55b034dd3a40 2023-08-10T11:54:25.579 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.569+0000 7f1b7effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b034dce550 0x55b034dce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:25.579 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.569+0000 7f1b7effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b034dce550 0x55b034dce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34354/0 (socket says 172.21.15.73:34354) 2023-08-10T11:54:25.579 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.569+0000 7f1b7effd700 1 -- 172.21.15.73:0/3732874729 learned_addr learned my addr 172.21.15.73:0/3732874729 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.569+0000 7f1b7e7fc700 1 --2- 172.21.15.73:0/3732874729 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b034dd3a40 0x55b034ddee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.569+0000 7f1b7f7fe700 1 --2- 172.21.15.73:0/3732874729 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b034dd4360 0x55b034dc8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.570+0000 7f1b7e7fc700 1 -- 172.21.15.73:0/3732874729 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b034dd4360 msgr2=0x55b034dc8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.570+0000 7f1b7e7fc700 1 --2- 172.21.15.73:0/3732874729 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b034dd4360 0x55b034dc8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.570+0000 7f1b7e7fc700 1 -- 172.21.15.73:0/3732874729 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b034dce550 msgr2=0x55b034dce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.570+0000 7f1b7e7fc700 1 --2- 172.21.15.73:0/3732874729 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b034dce550 0x55b034dce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.570+0000 7f1b7e7fc700 1 -- 172.21.15.73:0/3732874729 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b034dc53f0 con 0x55b034dd3a40 2023-08-10T11:54:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.570+0000 7f1b7effd700 1 --2- 172.21.15.73:0/3732874729 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b034dce550 0x55b034dce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.570+0000 7f1b7e7fc700 1 --2- 172.21.15.73:0/3732874729 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b034dd3a40 0x55b034ddee10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400e460 tx=0x7f1b74014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c7739ba7d042fa server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.570+0000 7f1b667fc700 1 -- 172.21.15.73:0/3732874729 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7402b070 con 0x55b034dd3a40 2023-08-10T11:54:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.570+0000 7f1b667fc700 1 -- 172.21.15.73:0/3732874729 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b74023040 con 0x55b034dd3a40 2023-08-10T11:54:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.570+0000 7f1b667fc700 1 -- 172.21.15.73:0/3732874729 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b74022070 con 0x55b034dd3a40 2023-08-10T11:54:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.571+0000 7f1b91a28b80 1 -- 172.21.15.73:0/3732874729 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b034dd3a40 msgr2=0x55b034ddee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.571+0000 7f1b91a28b80 1 --2- 172.21.15.73:0/3732874729 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b034dd3a40 0x55b034ddee10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400e460 tx=0x7f1b74014000 comp rx=0 tx=0).stop 2023-08-10T11:54:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.571+0000 7f1b91a28b80 1 -- 172.21.15.73:0/3732874729 shutdown_connections 2023-08-10T11:54:25.582 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.571+0000 7f1b91a28b80 1 --2- 172.21.15.73:0/3732874729 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b034dd4360 0x55b034dc8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.582 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.571+0000 7f1b91a28b80 1 --2- 172.21.15.73:0/3732874729 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b034dce550 0x55b034dce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.582 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.571+0000 7f1b91a28b80 1 --2- 172.21.15.73:0/3732874729 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b034dd3a40 0x55b034ddee10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.582 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.571+0000 7f1b91a28b80 1 -- 172.21.15.73:0/3732874729 >> 172.21.15.73:0/3732874729 conn(0x55b034d2bc70 msgr2=0x55b034dd3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:25.582 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.571+0000 7f1b91a28b80 1 -- 172.21.15.73:0/3732874729 shutdown_connections 2023-08-10T11:54:25.582 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.571+0000 7f1b91a28b80 1 -- 172.21.15.73:0/3732874729 wait complete. 2023-08-10T11:54:25.582 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.571+0000 7f1b91a28b80 1 -- start start 2023-08-10T11:54:25.583 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.571+0000 7f1b91a28b80 1 Processor -- start 2023-08-10T11:54:25.583 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.572+0000 7f1b91a28b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b034dce550 0x55b034dde910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:25.583 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.572+0000 7f1b91a28b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b034dd3a40 0x55b034ddcc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:25.583 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.572+0000 7f1b91a28b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b034dd4360 0x55b034ddd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:25.583 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.572+0000 7f1b91a28b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b034ddd6c0 con 0x55b034dd3a40 2023-08-10T11:54:25.583 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.572+0000 7f1b91a28b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b034ddd830 con 0x55b034dce550 2023-08-10T11:54:25.583 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.572+0000 7f1b91a28b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b034ddd9f0 con 0x55b034dd4360 2023-08-10T11:54:25.583 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.572+0000 7f1b91a28b80 10 client.0 _ll_register_callbacks cb 0x55b034cbc620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:54:25.584 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.572+0000 7f1b7effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b034dce550 0x55b034dde910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:25.584 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.572+0000 7f1b7effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b034dce550 0x55b034dde910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49010/0 (socket says 172.21.15.73:49010) 2023-08-10T11:54:25.584 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.572+0000 7f1b7effd700 1 -- 172.21.15.73:0/2261142189 learned_addr learned my addr 172.21.15.73:0/2261142189 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:25.584 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.572+0000 7f1b7f7fe700 1 --2- 172.21.15.73:0/2261142189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b034dd4360 0x55b034ddd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:25.584 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.572+0000 7f1b7effd700 1 -- 172.21.15.73:0/2261142189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b034dd4360 msgr2=0x55b034ddd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:25.584 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.572+0000 7f1b7effd700 1 --2- 172.21.15.73:0/2261142189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b034dd4360 0x55b034ddd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.584 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.572+0000 7f1b7effd700 1 -- 172.21.15.73:0/2261142189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b034dd3a40 msgr2=0x55b034ddcc40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T11:54:25.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.572+0000 7f1b7effd700 1 --2- 172.21.15.73:0/2261142189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b034dd3a40 0x55b034ddcc40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.572+0000 7f1b7effd700 1 -- 172.21.15.73:0/2261142189 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b80199b60 con 0x55b034dce550 2023-08-10T11:54:25.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.572+0000 7f1b7effd700 1 --2- 172.21.15.73:0/2261142189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b034dce550 0x55b034dde910 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1b700cff90 tx=0x7f1b7008a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=289d2cd72b61a81b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:25.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.572+0000 7f1b5effd700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T11:54:25.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.573+0000 7f1b5effd700 1 -- 172.21.15.73:0/2261142189 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b700cfbe0 con 0x55b034dce550 2023-08-10T11:54:25.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.573+0000 7f1b5effd700 1 -- 172.21.15.73:0/2261142189 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f1b700cfd40 con 0x55b034dce550 2023-08-10T11:54:25.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.573+0000 7f1b91a28b80 1 -- 172.21.15.73:0/2261142189 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1b7800f040 con 0x55b034dce550 2023-08-10T11:54:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.573+0000 7f1b5effd700 1 -- 172.21.15.73:0/2261142189 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b70018890 con 0x55b034dce550 2023-08-10T11:54:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.573+0000 7f1b91a28b80 10 client.25565 fetch_fsmap learned FSMap version 32 2023-08-10T11:54:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.573+0000 7f1b91a28b80 1 -- 172.21.15.73:0/2261142189 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f1b7400e5c0 con 0x55b034dce550 2023-08-10T11:54:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.573+0000 7f1b5effd700 1 -- 172.21.15.73:0/2261142189 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b70082080 con 0x55b034dce550 2023-08-10T11:54:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.573+0000 7f1b5effd700 1 -- 172.21.15.73:0/2261142189 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 32) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f1b700b6070 con 0x55b034dce550 2023-08-10T11:54:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.573+0000 7f1b91a28b80 10 client.25565 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T11:54:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.573+0000 7f1b91a28b80 10 client.25565 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:54:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.573+0000 7f1b91a28b80 20 client.25565 populate_metadata read hostname 'smithi073' 2023-08-10T11:54:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.573+0000 7f1b91a28b80 1 --2- 172.21.15.73:0/2261142189 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b034de7db0 0x55b034e3eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.573+0000 7f1b91a28b80 4 client.25565 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:54:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.573+0000 7f1b91a28b80 1 -- 172.21.15.73:0/2261142189 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b034d18720 con 0x55b034de7db0 2023-08-10T11:54:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.573+0000 7f1b7e7fc700 1 --2- 172.21.15.73:0/2261142189 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b034de7db0 0x55b034e3eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.574+0000 7f1b5effd700 10 client.25565 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.574+0000 7f1b7e7fc700 1 --2- 172.21.15.73:0/2261142189 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b034de7db0 0x55b034e3eb90 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d1cd22da9e4b800 server_cookie=9b01ad6eaa3e59a1 in_seq=0 out_seq=0 2023-08-10T11:54:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.704+0000 7f1b5effd700 1 -- 172.21.15.73:0/2261142189 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b034d18720 con 0x55b034de7db0 2023-08-10T11:54:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.704+0000 7f1b5effd700 10 client.25565 handle_command_reply: tid=0 2023-08-10T11:54:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.704+0000 7f1b91a28b80 1 client.25565 shutdown 2023-08-10T11:54:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.704+0000 7f1b91a28b80 1 -- 172.21.15.73:0/2261142189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b034dce550 msgr2=0x55b034dde910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.704+0000 7f1b91a28b80 1 --2- 172.21.15.73:0/2261142189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b034dce550 0x55b034dde910 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1b700cff90 tx=0x7f1b7008a040 comp rx=0 tx=0).stop 2023-08-10T11:54:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.704+0000 7f1b91a28b80 1 -- 172.21.15.73:0/2261142189 shutdown_connections 2023-08-10T11:54:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.704+0000 7f1b91a28b80 1 --2- 172.21.15.73:0/2261142189 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b034de7db0 0x55b034e3eb90 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.704+0000 7f1b91a28b80 1 --2- 172.21.15.73:0/2261142189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b034dce550 0x55b034dde910 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.704+0000 7f1b5effd700 0 client.25565 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.704+0000 7f1b91a28b80 1 --2- 172.21.15.73:0/2261142189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b034dd4360 0x55b034ddd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.704+0000 7f1b91a28b80 1 --2- 172.21.15.73:0/2261142189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b034dd3a40 0x55b034ddcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.704+0000 7f1b91a28b80 1 -- 172.21.15.73:0/2261142189 >> 172.21.15.73:0/2261142189 conn(0x55b034d2bc70 msgr2=0x55b034dd7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.704+0000 7f1b91a28b80 1 -- 172.21.15.73:0/2261142189 shutdown_connections 2023-08-10T11:54:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.704+0000 7f1b91a28b80 1 -- 172.21.15.73:0/2261142189 wait complete. 2023-08-10T11:54:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.704+0000 7f1b91a28b80 20 client.25565 trim_cache size 0 max 16384 2023-08-10T11:54:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:54:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:54:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:54:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:54:25.710 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.705+0000 7f1b8588f700 1 -- 172.21.15.73:0/3902474415 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f1b680a1340 msgr2=0x7f1b680a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:25.710 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.705+0000 7f1b8588f700 1 --2- 172.21.15.73:0/3902474415 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f1b680a1340 0x7f1b680a3800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1b80195be0 tx=0x7f1b74009260 comp rx=0 tx=0).stop 2023-08-10T11:54:25.710 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.705+0000 7f1b8588f700 1 -- 172.21.15.73:0/3902474415 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b80100670 msgr2=0x7f1b801945d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:25.710 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.705+0000 7f1b8588f700 1 --2- 172.21.15.73:0/3902474415 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b80100670 0x7f1b801945d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1b7001b040 tx=0x7f1b7000bc20 comp rx=0 tx=0).stop 2023-08-10T11:54:25.711 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.705+0000 7f1b8588f700 1 -- 172.21.15.73:0/3902474415 shutdown_connections 2023-08-10T11:54:25.711 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.705+0000 7f1b8588f700 1 --2- 172.21.15.73:0/3902474415 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f1b680a1340 0x7f1b680a3800 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.711 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.705+0000 7f1b8588f700 1 --2- 172.21.15.73:0/3902474415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b80106680 0x7f1b80198f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.711 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.705+0000 7f1b8588f700 1 --2- 172.21.15.73:0/3902474415 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b80100670 0x7f1b801945d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.711 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.705+0000 7f1b8588f700 1 --2- 172.21.15.73:0/3902474415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b80101030 0x7f1b80194b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:25.711 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.705+0000 7f1b8588f700 1 -- 172.21.15.73:0/3902474415 >> 172.21.15.73:0/3902474415 conn(0x7f1b800fc1a0 msgr2=0x7f1b80104180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:25.711 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.705+0000 7f1b8588f700 1 -- 172.21.15.73:0/3902474415 shutdown_connections 2023-08-10T11:54:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:25.705+0000 7f1b8588f700 1 -- 172.21.15.73:0/3902474415 wait complete. 2023-08-10T11:54:26.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:26 smithi152 ceph-mon[130220]: pgmap v57: 97 pgs: 97 active+clean; 128 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.7 MiB/s wr, 411 op/s 2023-08-10T11:54:27.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:26 smithi156 ceph-mon[130574]: pgmap v57: 97 pgs: 97 active+clean; 128 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.7 MiB/s wr, 411 op/s 2023-08-10T11:54:27.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:26 smithi073 ceph-mon[128869]: pgmap v57: 97 pgs: 97 active+clean; 128 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.7 MiB/s wr, 411 op/s 2023-08-10T11:54:28.091 INFO:tasks.workunit.client.0.smithi073.stdout: 39 330831 573 216172 317 94221 538 2023-08-10T11:54:28.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:28 smithi152 ceph-mon[130220]: pgmap v58: 97 pgs: 97 active+clean; 128 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 7.0 MiB/s wr, 374 op/s 2023-08-10T11:54:29.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:28 smithi156 ceph-mon[130574]: pgmap v58: 97 pgs: 97 active+clean; 128 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 7.0 MiB/s wr, 374 op/s 2023-08-10T11:54:29.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:28 smithi073 ceph-mon[128869]: pgmap v58: 97 pgs: 97 active+clean; 128 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 7.0 MiB/s wr, 374 op/s 2023-08-10T11:54:30.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:30 smithi152 ceph-mon[130220]: pgmap v59: 97 pgs: 97 active+clean; 136 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.8 MiB/s wr, 555 op/s 2023-08-10T11:54:31.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:30 smithi156 ceph-mon[130574]: pgmap v59: 97 pgs: 97 active+clean; 136 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.8 MiB/s wr, 555 op/s 2023-08-10T11:54:31.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:30 smithi073 ceph-mon[128869]: pgmap v59: 97 pgs: 97 active+clean; 136 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.8 MiB/s wr, 555 op/s 2023-08-10T11:54:32.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:32 smithi152 ceph-mon[130220]: pgmap v60: 97 pgs: 97 active+clean; 136 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.9 MiB/s wr, 522 op/s 2023-08-10T11:54:33.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:32 smithi156 ceph-mon[130574]: pgmap v60: 97 pgs: 97 active+clean; 136 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.9 MiB/s wr, 522 op/s 2023-08-10T11:54:33.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:32 smithi073 ceph-mon[128869]: pgmap v60: 97 pgs: 97 active+clean; 136 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.9 MiB/s wr, 522 op/s 2023-08-10T11:54:34.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:34 smithi152 ceph-mon[130220]: pgmap v61: 97 pgs: 97 active+clean; 142 MiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.5 MiB/s wr, 543 op/s 2023-08-10T11:54:35.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:34 smithi156 ceph-mon[130574]: pgmap v61: 97 pgs: 97 active+clean; 142 MiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.5 MiB/s wr, 543 op/s 2023-08-10T11:54:35.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:34 smithi073 ceph-mon[128869]: pgmap v61: 97 pgs: 97 active+clean; 142 MiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.5 MiB/s wr, 543 op/s 2023-08-10T11:54:36.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:36 smithi152 ceph-mon[130220]: pgmap v62: 97 pgs: 97 active+clean; 144 MiB data, 830 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.1 MiB/s wr, 548 op/s 2023-08-10T11:54:37.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:36 smithi156 ceph-mon[130574]: pgmap v62: 97 pgs: 97 active+clean; 144 MiB data, 830 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.1 MiB/s wr, 548 op/s 2023-08-10T11:54:37.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:36 smithi073 ceph-mon[128869]: pgmap v62: 97 pgs: 97 active+clean; 144 MiB data, 830 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.1 MiB/s wr, 548 op/s 2023-08-10T11:54:38.091 INFO:tasks.workunit.client.0.smithi073.stdout: 54 956183 972 559345 794 260267 655 2023-08-10T11:54:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.864+0000 7f0b634ae700 1 -- 172.21.15.73:0/2756139468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b5c0fede0 msgr2=0x7f0b5c0ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.864+0000 7f0b634ae700 1 --2- 172.21.15.73:0/2756139468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b5c0fede0 0x7f0b5c0ff1c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f0b580099c0 tx=0x7f0b58009cd0 comp rx=0 tx=0).stop 2023-08-10T11:54:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.864+0000 7f0b634ae700 1 -- 172.21.15.73:0/2756139468 shutdown_connections 2023-08-10T11:54:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.864+0000 7f0b634ae700 1 --2- 172.21.15.73:0/2756139468 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b5c105a40 0x7f0b5c10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.864+0000 7f0b634ae700 1 --2- 172.21.15.73:0/2756139468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b5c0fede0 0x7f0b5c0ff1c0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.864+0000 7f0b634ae700 1 --2- 172.21.15.73:0/2756139468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b5c0ff790 0x7f0b5c105310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.864+0000 7f0b634ae700 1 -- 172.21.15.73:0/2756139468 >> 172.21.15.73:0/2756139468 conn(0x7f0b5c076b40 msgr2=0x7f0b5c0fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.864+0000 7f0b634ae700 1 -- 172.21.15.73:0/2756139468 shutdown_connections 2023-08-10T11:54:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.864+0000 7f0b634ae700 1 -- 172.21.15.73:0/2756139468 wait complete. 2023-08-10T11:54:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.865+0000 7f0b634ae700 1 Processor -- start 2023-08-10T11:54:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.865+0000 7f0b634ae700 1 -- start start 2023-08-10T11:54:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.865+0000 7f0b634ae700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b5c0fede0 0x7f0b5c19c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:38.869 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.865+0000 7f0b634ae700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b5c105a40 0x7f0b5c19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:38.869 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.865+0000 7f0b634ae700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b5c196620 0x7f0b5c196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:38.869 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.865+0000 7f0b634ae700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c1970a0 con 0x7f0b5c0fede0 2023-08-10T11:54:38.869 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.865+0000 7f0b634ae700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c1971e0 con 0x7f0b5c105a40 2023-08-10T11:54:38.869 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.865+0000 7f0b634ae700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c1973a0 con 0x7f0b5c196620 2023-08-10T11:54:38.869 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.865+0000 7f0b6124a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b5c0fede0 0x7f0b5c19c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:38.869 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.865+0000 7f0b60a49700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b5c105a40 0x7f0b5c19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:38.870 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.865+0000 7f0b60a49700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b5c105a40 0x7f0b5c19cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49022/0 (socket says 172.21.15.73:49022) 2023-08-10T11:54:38.870 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.865+0000 7f0b6124a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b5c0fede0 0x7f0b5c19c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34370/0 (socket says 172.21.15.73:34370) 2023-08-10T11:54:38.870 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.866+0000 7f0b60a49700 1 -- 172.21.15.73:0/3147720344 learned_addr learned my addr 172.21.15.73:0/3147720344 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:38.870 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.866+0000 7f0b61a4b700 1 --2- 172.21.15.73:0/3147720344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b5c196620 0x7f0b5c196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:38.870 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.866+0000 7f0b60a49700 1 -- 172.21.15.73:0/3147720344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b5c196620 msgr2=0x7f0b5c196ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:38.870 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.866+0000 7f0b60a49700 1 --2- 172.21.15.73:0/3147720344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b5c196620 0x7f0b5c196ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:38.870 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.866+0000 7f0b60a49700 1 -- 172.21.15.73:0/3147720344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b5c0fede0 msgr2=0x7f0b5c19c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:38.871 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.866+0000 7f0b60a49700 1 --2- 172.21.15.73:0/3147720344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b5c0fede0 0x7f0b5c19c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:38.871 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.866+0000 7f0b60a49700 1 -- 172.21.15.73:0/3147720344 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b580095f0 con 0x7f0b5c105a40 2023-08-10T11:54:38.871 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.866+0000 7f0b61a4b700 1 --2- 172.21.15.73:0/3147720344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b5c196620 0x7f0b5c196ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:38.871 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.866+0000 7f0b60a49700 1 --2- 172.21.15.73:0/3147720344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b5c105a40 0x7f0b5c19cd00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00e970 tx=0x7f0b4c00ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:38.871 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.866+0000 7f0b527fc700 1 -- 172.21.15.73:0/3147720344 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c009790 con 0x7f0b5c105a40 2023-08-10T11:54:38.871 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.866+0000 7f0b527fc700 1 -- 172.21.15.73:0/3147720344 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b4c00c7e0 con 0x7f0b5c105a40 2023-08-10T11:54:38.871 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.866+0000 7f0b634ae700 1 -- 172.21.15.73:0/3147720344 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5c1a3630 con 0x7f0b5c105a40 2023-08-10T11:54:38.871 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.866+0000 7f0b527fc700 1 -- 172.21.15.73:0/3147720344 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c0054e0 con 0x7f0b5c105a40 2023-08-10T11:54:38.872 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.866+0000 7f0b634ae700 1 -- 172.21.15.73:0/3147720344 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5c1a3b40 con 0x7f0b5c105a40 2023-08-10T11:54:38.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.869+0000 7f0b527fc700 1 -- 172.21.15.73:0/3147720344 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f0b4c00c950 con 0x7f0b5c105a40 2023-08-10T11:54:38.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.870+0000 7f0b527fc700 1 --2- 172.21.15.73:0/3147720344 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0b480a12c0 0x7f0b480a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:38.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.870+0000 7f0b527fc700 1 -- 172.21.15.73:0/3147720344 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f0b4c014070 con 0x7f0b5c105a40 2023-08-10T11:54:38.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.870+0000 7f0b6124a700 1 --2- 172.21.15.73:0/3147720344 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0b480a12c0 0x7f0b480a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:38.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.871+0000 7f0b6f647b80 1 Processor -- start 2023-08-10T11:54:38.874 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.871+0000 7f0b6f647b80 1 -- start start 2023-08-10T11:54:38.875 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.871+0000 7f0b6124a700 1 --2- 172.21.15.73:0/3147720344 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0b480a12c0 0x7f0b480a3780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0b58006010 tx=0x7f0b58005c20 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:38.875 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.871+0000 7f0b6f647b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f19a77ab0 0x558f19a77e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:38.875 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.871+0000 7f0b6f647b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558f19a74010 0x558f19a74470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:38.875 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.871+0000 7f0b6f647b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a749b0 0x558f19a88c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:38.875 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.871+0000 7f0b6f647b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f199efd60 con 0x558f19a749b0 2023-08-10T11:54:38.875 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.871+0000 7f0b6f647b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f199cc530 con 0x558f19a74010 2023-08-10T11:54:38.875 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.871+0000 7f0b6f647b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f199c9e50 con 0x558f19a77ab0 2023-08-10T11:54:38.875 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.871+0000 7f0b61a4b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a749b0 0x558f19a88c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:38.876 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.871+0000 7f0b60a49700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558f19a74010 0x558f19a74470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:38.876 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.871+0000 7f0b61a4b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a749b0 0x558f19a88c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34382/0 (socket says 172.21.15.73:34382) 2023-08-10T11:54:38.876 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.871+0000 7f0b61a4b700 1 -- 172.21.15.73:0/543042140 learned_addr learned my addr 172.21.15.73:0/543042140 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:38.876 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.871+0000 7f0b6124a700 1 --2- 172.21.15.73:0/543042140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f19a77ab0 0x558f19a77e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:38.876 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.872+0000 7f0b61a4b700 1 -- 172.21.15.73:0/543042140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f19a77ab0 msgr2=0x558f19a77e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:38.876 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.872+0000 7f0b61a4b700 1 --2- 172.21.15.73:0/543042140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f19a77ab0 0x558f19a77e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:38.876 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.872+0000 7f0b61a4b700 1 -- 172.21.15.73:0/543042140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558f19a74010 msgr2=0x558f19a74470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:38.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.872+0000 7f0b61a4b700 1 --2- 172.21.15.73:0/543042140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558f19a74010 0x558f19a74470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:38.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.872+0000 7f0b61a4b700 1 -- 172.21.15.73:0/543042140 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f198465d0 con 0x558f19a749b0 2023-08-10T11:54:38.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.872+0000 7f0b60a49700 1 --2- 172.21.15.73:0/543042140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558f19a74010 0x558f19a74470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:38.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.872+0000 7f0b61a4b700 1 --2- 172.21.15.73:0/543042140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a749b0 0x558f19a88c80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f0b54003eb0 tx=0x7f0b54009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d24e4098da316 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:38.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.872+0000 7f0b477fe700 1 -- 172.21.15.73:0/543042140 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b540092d0 con 0x558f19a749b0 2023-08-10T11:54:38.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.872+0000 7f0b477fe700 1 -- 172.21.15.73:0/543042140 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b5400f040 con 0x558f19a749b0 2023-08-10T11:54:38.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.872+0000 7f0b477fe700 1 -- 172.21.15.73:0/543042140 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5400e7e0 con 0x558f19a749b0 2023-08-10T11:54:38.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.873+0000 7f0b6f647b80 1 -- 172.21.15.73:0/543042140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a749b0 msgr2=0x558f19a88c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:38.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.873+0000 7f0b6f647b80 1 --2- 172.21.15.73:0/543042140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a749b0 0x558f19a88c80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f0b54003eb0 tx=0x7f0b54009920 comp rx=0 tx=0).stop 2023-08-10T11:54:38.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.873+0000 7f0b6f647b80 1 -- 172.21.15.73:0/543042140 shutdown_connections 2023-08-10T11:54:38.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.873+0000 7f0b6f647b80 1 --2- 172.21.15.73:0/543042140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a749b0 0x558f19a88c80 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:38.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.873+0000 7f0b6f647b80 1 --2- 172.21.15.73:0/543042140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f19a77ab0 0x558f19a77e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:38.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.873+0000 7f0b6f647b80 1 --2- 172.21.15.73:0/543042140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558f19a74010 0x558f19a74470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:38.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.873+0000 7f0b6f647b80 1 -- 172.21.15.73:0/543042140 >> 172.21.15.73:0/543042140 conn(0x558f199d1c70 msgr2=0x558f19a6ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:38.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.873+0000 7f0b6f647b80 1 -- 172.21.15.73:0/543042140 shutdown_connections 2023-08-10T11:54:38.879 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.873+0000 7f0b6f647b80 1 -- 172.21.15.73:0/543042140 wait complete. 2023-08-10T11:54:38.879 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.873+0000 7f0b6f647b80 1 -- start start 2023-08-10T11:54:38.881 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.874+0000 7f0b6f647b80 1 Processor -- start 2023-08-10T11:54:38.882 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.874+0000 7f0b6f647b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a74010 0x558f19a88bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:38.882 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.874+0000 7f0b6f647b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558f19a749b0 0x558f19a85de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:38.882 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.874+0000 7f0b6f647b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f19a77ab0 0x558f19a86410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:38.882 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.874+0000 7f0b6f647b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f199c5740 con 0x558f19a74010 2023-08-10T11:54:38.882 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.874+0000 7f0b6f647b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f19964a60 con 0x558f19a749b0 2023-08-10T11:54:38.882 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.874+0000 7f0b6f647b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f19964760 con 0x558f19a77ab0 2023-08-10T11:54:38.882 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.874+0000 7f0b6f647b80 10 client.0 _ll_register_callbacks cb 0x558f19962620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:54:38.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.874+0000 7f0b6124a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a74010 0x558f19a88bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:38.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.874+0000 7f0b6124a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a74010 0x558f19a88bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34384/0 (socket says 172.21.15.73:34384) 2023-08-10T11:54:38.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.874+0000 7f0b6124a700 1 -- 172.21.15.73:0/1774037343 learned_addr learned my addr 172.21.15.73:0/1774037343 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:38.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.874+0000 7f0b61a4b700 1 --2- 172.21.15.73:0/1774037343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f19a77ab0 0x558f19a86410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:38.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.875+0000 7f0b61a4b700 1 -- 172.21.15.73:0/1774037343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558f19a749b0 msgr2=0x558f19a85de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:38.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.875+0000 7f0b61a4b700 1 --2- 172.21.15.73:0/1774037343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558f19a749b0 0x558f19a85de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:38.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.875+0000 7f0b61a4b700 1 -- 172.21.15.73:0/1774037343 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a74010 msgr2=0x558f19a88bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:38.884 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.875+0000 7f0b61a4b700 1 --2- 172.21.15.73:0/1774037343 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a74010 0x558f19a88bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:38.884 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.875+0000 7f0b61a4b700 1 -- 172.21.15.73:0/1774037343 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5c1a3b40 con 0x558f19a77ab0 2023-08-10T11:54:38.884 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.875+0000 7f0b6124a700 1 --2- 172.21.15.73:0/1774037343 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a74010 0x558f19a88bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:38.884 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.875+0000 7f0b61a4b700 1 --2- 172.21.15.73:0/1774037343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f19a77ab0 0x558f19a86410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0b54007e70 tx=0x7f0b54004d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f70061a21815ee53 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:38.884 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.875+0000 7f0b44ff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T11:54:38.884 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.875+0000 7f0b44ff9700 1 -- 172.21.15.73:0/1774037343 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b54007910 con 0x558f19a77ab0 2023-08-10T11:54:38.884 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.875+0000 7f0b6f647b80 1 -- 172.21.15.73:0/1774037343 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558f19a671c0 con 0x558f19a77ab0 2023-08-10T11:54:38.885 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.875+0000 7f0b44ff9700 1 -- 172.21.15.73:0/1774037343 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f0b54007a70 con 0x558f19a77ab0 2023-08-10T11:54:38.885 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.876+0000 7f0b44ff9700 1 -- 172.21.15.73:0/1774037343 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b54007c90 con 0x558f19a77ab0 2023-08-10T11:54:38.885 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.876+0000 7f0b6f647b80 10 client.25588 fetch_fsmap learned FSMap version 32 2023-08-10T11:54:38.885 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.876+0000 7f0b6f647b80 1 -- 172.21.15.73:0/1774037343 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f0b54003b90 con 0x558f19a77ab0 2023-08-10T11:54:38.885 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.876+0000 7f0b44ff9700 1 -- 172.21.15.73:0/1774037343 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558f19a671c0 con 0x558f19a77ab0 2023-08-10T11:54:38.885 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.876+0000 7f0b44ff9700 1 -- 172.21.15.73:0/1774037343 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 32) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f0b54015630 con 0x558f19a77ab0 2023-08-10T11:54:38.885 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.876+0000 7f0b6f647b80 10 client.25588 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T11:54:38.886 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.876+0000 7f0b6f647b80 10 client.25588 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:54:38.886 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.876+0000 7f0b6f647b80 20 client.25588 populate_metadata read hostname 'smithi073' 2023-08-10T11:54:38.886 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.876+0000 7f0b6f647b80 1 --2- 172.21.15.73:0/1774037343 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x558f19a964c0 0x558f19a988e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:38.886 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.876+0000 7f0b6f647b80 4 client.25588 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:54:38.886 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.876+0000 7f0b6f647b80 1 -- 172.21.15.73:0/1774037343 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558f19a43970 con 0x558f19a964c0 2023-08-10T11:54:38.886 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.877+0000 7f0b6124a700 1 --2- 172.21.15.73:0/1774037343 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x558f19a964c0 0x558f19a988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:38.886 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.877+0000 7f0b6124a700 1 --2- 172.21.15.73:0/1774037343 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x558f19a964c0 0x558f19a988e0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7680306fd9d9122c server_cookie=26ee23db1d301989 in_seq=0 out_seq=0 2023-08-10T11:54:38.886 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.877+0000 7f0b44ff9700 10 client.25588 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:38.887 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.878+0000 7f0b44ff9700 1 -- 172.21.15.73:0/1774037343 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x558f19a43970 con 0x558f19a964c0 2023-08-10T11:54:38.887 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.878+0000 7f0b44ff9700 10 client.25588 handle_command_reply: tid=0 2023-08-10T11:54:38.887 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.878+0000 7f0b6f647b80 1 client.25588 shutdown 2023-08-10T11:54:38.887 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.878+0000 7f0b6f647b80 1 -- 172.21.15.73:0/1774037343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f19a77ab0 msgr2=0x558f19a86410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:38.887 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.878+0000 7f0b6f647b80 1 --2- 172.21.15.73:0/1774037343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f19a77ab0 0x558f19a86410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0b54007e70 tx=0x7f0b54004d80 comp rx=0 tx=0).stop 2023-08-10T11:54:38.887 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.878+0000 7f0b6f647b80 1 -- 172.21.15.73:0/1774037343 shutdown_connections 2023-08-10T11:54:38.887 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.878+0000 7f0b6f647b80 1 --2- 172.21.15.73:0/1774037343 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x558f19a964c0 0x558f19a988e0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:38.888 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.878+0000 7f0b6f647b80 1 --2- 172.21.15.73:0/1774037343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f19a77ab0 0x558f19a86410 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:38.888 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.878+0000 7f0b44ff9700 0 client.25588 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:38.888 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.878+0000 7f0b6f647b80 1 --2- 172.21.15.73:0/1774037343 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a74010 0x558f19a88bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:38.888 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.878+0000 7f0b6f647b80 1 --2- 172.21.15.73:0/1774037343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558f19a749b0 0x558f19a85de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:38.888 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.878+0000 7f0b6f647b80 1 -- 172.21.15.73:0/1774037343 >> 172.21.15.73:0/1774037343 conn(0x558f199d1c70 msgr2=0x558f19a6e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:38.888 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.878+0000 7f0b6f647b80 1 -- 172.21.15.73:0/1774037343 shutdown_connections 2023-08-10T11:54:38.888 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.878+0000 7f0b6f647b80 1 -- 172.21.15.73:0/1774037343 wait complete. 2023-08-10T11:54:38.888 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.878+0000 7f0b6f647b80 20 client.25588 trim_cache size 0 max 16384 2023-08-10T11:54:38.895 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.893+0000 7f0b6f647b80 1 Processor -- start 2023-08-10T11:54:38.895 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.893+0000 7f0b6f647b80 1 -- start start 2023-08-10T11:54:38.895 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.893+0000 7f0b6f647b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f19a74010 0x558f19a8d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:38.895 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.893+0000 7f0b6f647b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a749b0 0x558f19a6ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:38.895 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.894+0000 7f0b6f647b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558f19a77ab0 0x558f19a73710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:38.895 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.894+0000 7f0b6f647b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f198488c0 con 0x558f19a749b0 2023-08-10T11:54:38.896 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.894+0000 7f0b6f647b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f19a69760 con 0x558f19a77ab0 2023-08-10T11:54:38.896 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.894+0000 7f0b6f647b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f19a6fc50 con 0x558f19a74010 2023-08-10T11:54:38.896 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.894+0000 7f0b60a49700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a749b0 0x558f19a6ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:38.896 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.894+0000 7f0b6124a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f19a74010 0x558f19a8d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:38.896 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.894+0000 7f0b60a49700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a749b0 0x558f19a6ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34392/0 (socket says 172.21.15.73:34392) 2023-08-10T11:54:38.896 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.894+0000 7f0b60a49700 1 -- 172.21.15.73:0/3933926184 learned_addr learned my addr 172.21.15.73:0/3933926184 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:38.896 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.894+0000 7f0b61a4b700 1 --2- 172.21.15.73:0/3933926184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558f19a77ab0 0x558f19a73710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.894+0000 7f0b60a49700 1 -- 172.21.15.73:0/3933926184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f19a74010 msgr2=0x558f19a8d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.894+0000 7f0b60a49700 1 --2- 172.21.15.73:0/3933926184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f19a74010 0x558f19a8d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.894+0000 7f0b60a49700 1 -- 172.21.15.73:0/3933926184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558f19a77ab0 msgr2=0x558f19a73710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.894+0000 7f0b60a49700 1 --2- 172.21.15.73:0/3933926184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558f19a77ab0 0x558f19a73710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.894+0000 7f0b60a49700 1 -- 172.21.15.73:0/3933926184 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f197f2d80 con 0x558f19a749b0 2023-08-10T11:54:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.894+0000 7f0b6124a700 1 --2- 172.21.15.73:0/3933926184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f19a74010 0x558f19a8d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.894+0000 7f0b60a49700 1 --2- 172.21.15.73:0/3933926184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a749b0 0x558f19a6ec30 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c096580 tx=0x7f0b4c099cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df48d66ed0cc3e9c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:38.898 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.894+0000 7f0b47fff700 1 -- 172.21.15.73:0/3933926184 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c09a080 con 0x558f19a749b0 2023-08-10T11:54:38.898 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.894+0000 7f0b47fff700 1 -- 172.21.15.73:0/3933926184 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b4c09e0b0 con 0x558f19a749b0 2023-08-10T11:54:38.898 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.894+0000 7f0b47fff700 1 -- 172.21.15.73:0/3933926184 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c09a540 con 0x558f19a749b0 2023-08-10T11:54:38.900 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.895+0000 7f0b6f647b80 1 -- 172.21.15.73:0/3933926184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a749b0 msgr2=0x558f19a6ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:38.901 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.895+0000 7f0b6f647b80 1 --2- 172.21.15.73:0/3933926184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a749b0 0x558f19a6ec30 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c096580 tx=0x7f0b4c099cf0 comp rx=0 tx=0).stop 2023-08-10T11:54:38.901 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.895+0000 7f0b6f647b80 1 -- 172.21.15.73:0/3933926184 shutdown_connections 2023-08-10T11:54:38.901 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.895+0000 7f0b6f647b80 1 --2- 172.21.15.73:0/3933926184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558f19a77ab0 0x558f19a73710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:38.901 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.895+0000 7f0b6f647b80 1 --2- 172.21.15.73:0/3933926184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f19a74010 0x558f19a8d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:38.901 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.895+0000 7f0b6f647b80 1 --2- 172.21.15.73:0/3933926184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a749b0 0x558f19a6ec30 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:38.901 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.895+0000 7f0b6f647b80 1 -- 172.21.15.73:0/3933926184 >> 172.21.15.73:0/3933926184 conn(0x558f199d1c70 msgr2=0x558f19a73000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:38.902 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.895+0000 7f0b6f647b80 1 -- 172.21.15.73:0/3933926184 shutdown_connections 2023-08-10T11:54:38.902 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.895+0000 7f0b6f647b80 1 -- 172.21.15.73:0/3933926184 wait complete. 2023-08-10T11:54:38.902 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.895+0000 7f0b6f647b80 1 -- start start 2023-08-10T11:54:38.902 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.895+0000 7f0b6f647b80 1 Processor -- start 2023-08-10T11:54:38.902 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.896+0000 7f0b6f647b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a74010 0x558f19ae3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:38.902 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.896+0000 7f0b6f647b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558f19a749b0 0x558f19ae3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:38.902 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.896+0000 7f0b6f647b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f19a77ab0 0x558f19ade100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:38.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.896+0000 7f0b6f647b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f19ade6e0 con 0x558f19a74010 2023-08-10T11:54:38.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.896+0000 7f0b6f647b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f19ade850 con 0x558f19a749b0 2023-08-10T11:54:38.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.896+0000 7f0b6f647b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f19adea10 con 0x558f19a77ab0 2023-08-10T11:54:38.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.896+0000 7f0b6f647b80 10 client.0 _ll_register_callbacks cb 0x558f19962620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:54:38.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.896+0000 7f0b6124a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a74010 0x558f19ae3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:38.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.896+0000 7f0b60a49700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558f19a749b0 0x558f19ae3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:38.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.896+0000 7f0b6124a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a74010 0x558f19ae3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34398/0 (socket says 172.21.15.73:34398) 2023-08-10T11:54:38.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.896+0000 7f0b6124a700 1 -- 172.21.15.73:0/1549939489 learned_addr learned my addr 172.21.15.73:0/1549939489 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:38.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.896+0000 7f0b61a4b700 1 --2- 172.21.15.73:0/1549939489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f19a77ab0 0x558f19ade100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:38.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.896+0000 7f0b6124a700 1 -- 172.21.15.73:0/1549939489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f19a77ab0 msgr2=0x558f19ade100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:38.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.896+0000 7f0b6124a700 1 --2- 172.21.15.73:0/1549939489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f19a77ab0 0x558f19ade100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:38.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.896+0000 7f0b6124a700 1 -- 172.21.15.73:0/1549939489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558f19a749b0 msgr2=0x558f19ae3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:38.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.896+0000 7f0b6124a700 1 --2- 172.21.15.73:0/1549939489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558f19a749b0 0x558f19ae3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:38.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.896+0000 7f0b6124a700 1 -- 172.21.15.73:0/1549939489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5c10de60 con 0x558f19a74010 2023-08-10T11:54:38.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.896+0000 7f0b61a4b700 1 --2- 172.21.15.73:0/1549939489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f19a77ab0 0x558f19ade100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.896+0000 7f0b6124a700 1 --2- 172.21.15.73:0/1549939489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a74010 0x558f19ae3650 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009990 tx=0x7f0b58009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6935e06afb98b7e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.896+0000 7f0b44ff9700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:54:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.897+0000 7f0b44ff9700 1 -- 172.21.15.73:0/1549939489 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5802a040 con 0x558f19a74010 2023-08-10T11:54:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.897+0000 7f0b44ff9700 1 -- 172.21.15.73:0/1549939489 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f0b58034c70 con 0x558f19a74010 2023-08-10T11:54:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.897+0000 7f0b6f647b80 1 -- 172.21.15.73:0/1549939489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0b5400f040 con 0x558f19a74010 2023-08-10T11:54:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.897+0000 7f0b44ff9700 1 -- 172.21.15.73:0/1549939489 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b5801d040 con 0x558f19a74010 2023-08-10T11:54:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.897+0000 7f0b6f647b80 10 client.16167 fetch_fsmap learned FSMap version 32 2023-08-10T11:54:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.897+0000 7f0b6f647b80 1 -- 172.21.15.73:0/1549939489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f0b5c1a3630 con 0x558f19a74010 2023-08-10T11:54:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.897+0000 7f0b44ff9700 1 -- 172.21.15.73:0/1549939489 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b5400f040 con 0x558f19a74010 2023-08-10T11:54:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.897+0000 7f0b44ff9700 1 -- 172.21.15.73:0/1549939489 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 32) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f0b5800f620 con 0x558f19a74010 2023-08-10T11:54:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.897+0000 7f0b6f647b80 10 client.16167 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T11:54:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.897+0000 7f0b6f647b80 10 client.16167 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:54:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.897+0000 7f0b6f647b80 20 client.16167 populate_metadata read hostname 'smithi073' 2023-08-10T11:54:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.897+0000 7f0b6f647b80 1 --2- 172.21.15.73:0/1549939489 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x558f19aeb5d0 0x558f19aed9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.897+0000 7f0b6f647b80 4 client.16167 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:54:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.897+0000 7f0b6f647b80 1 -- 172.21.15.73:0/1549939489 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558f199be720 con 0x558f19aeb5d0 2023-08-10T11:54:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.897+0000 7f0b60a49700 1 --2- 172.21.15.73:0/1549939489 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x558f19aeb5d0 0x558f19aed9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.898+0000 7f0b44ff9700 10 client.16167 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:38.898+0000 7f0b60a49700 1 --2- 172.21.15.73:0/1549939489 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x558f19aeb5d0 0x558f19aed9f0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f22369801d3f186 server_cookie=7fa2ad66a3c39ff1 in_seq=0 out_seq=0 2023-08-10T11:54:38.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:38 smithi152 ceph-mon[130220]: pgmap v63: 97 pgs: 97 active+clean; 144 MiB data, 830 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.6 MiB/s wr, 245 op/s 2023-08-10T11:54:39.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:38 smithi156 ceph-mon[130574]: pgmap v63: 97 pgs: 97 active+clean; 144 MiB data, 830 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.6 MiB/s wr, 245 op/s 2023-08-10T11:54:39.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:38 smithi073 ceph-mon[128869]: pgmap v63: 97 pgs: 97 active+clean; 144 MiB data, 830 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.6 MiB/s wr, 245 op/s 2023-08-10T11:54:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:39.386+0000 7f0b44ff9700 1 -- 172.21.15.73:0/1549939489 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558f199be720 con 0x558f19aeb5d0 2023-08-10T11:54:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:39.386+0000 7f0b44ff9700 10 client.16167 handle_command_reply: tid=0 2023-08-10T11:54:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:39.386+0000 7f0b6f647b80 1 client.16167 shutdown 2023-08-10T11:54:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:39.386+0000 7f0b6f647b80 1 -- 172.21.15.73:0/1549939489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a74010 msgr2=0x558f19ae3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:39.386+0000 7f0b6f647b80 1 --2- 172.21.15.73:0/1549939489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a74010 0x558f19ae3650 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009990 tx=0x7f0b58009cd0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:39.386+0000 7f0b6f647b80 1 -- 172.21.15.73:0/1549939489 shutdown_connections 2023-08-10T11:54:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:39.386+0000 7f0b6f647b80 1 --2- 172.21.15.73:0/1549939489 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x558f19aeb5d0 0x558f19aed9f0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:39.386+0000 7f0b6f647b80 1 --2- 172.21.15.73:0/1549939489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f19a77ab0 0x558f19ade100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:39.386+0000 7f0b6f647b80 1 --2- 172.21.15.73:0/1549939489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558f19a74010 0x558f19ae3650 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:39.386+0000 7f0b44ff9700 0 client.16167 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:39.386+0000 7f0b6f647b80 1 --2- 172.21.15.73:0/1549939489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558f19a749b0 0x558f19ae3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:39.386+0000 7f0b6f647b80 1 -- 172.21.15.73:0/1549939489 >> 172.21.15.73:0/1549939489 conn(0x558f199d1c70 msgr2=0x558f19a73890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:39.386+0000 7f0b6f647b80 1 -- 172.21.15.73:0/1549939489 shutdown_connections 2023-08-10T11:54:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:39.386+0000 7f0b6f647b80 1 -- 172.21.15.73:0/1549939489 wait complete. 2023-08-10T11:54:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:39.386+0000 7f0b6f647b80 20 client.16167 trim_cache size 0 max 16384 2023-08-10T11:54:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:54:39.390 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:54:39.390 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:54:39.390 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:54:39.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:39.387+0000 7f0b634ae700 1 -- 172.21.15.73:0/3147720344 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0b480a12c0 msgr2=0x7f0b480a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:39.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:39.387+0000 7f0b634ae700 1 --2- 172.21.15.73:0/3147720344 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0b480a12c0 0x7f0b480a3780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0b58006010 tx=0x7f0b58005c20 comp rx=0 tx=0).stop 2023-08-10T11:54:39.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:39.387+0000 7f0b634ae700 1 -- 172.21.15.73:0/3147720344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b5c105a40 msgr2=0x7f0b5c19cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:39.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:39.387+0000 7f0b634ae700 1 --2- 172.21.15.73:0/3147720344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b5c105a40 0x7f0b5c19cd00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00e970 tx=0x7f0b4c00ec80 comp rx=0 tx=0).stop 2023-08-10T11:54:39.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:39.387+0000 7f0b634ae700 1 -- 172.21.15.73:0/3147720344 shutdown_connections 2023-08-10T11:54:39.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:39.387+0000 7f0b634ae700 1 --2- 172.21.15.73:0/3147720344 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0b480a12c0 0x7f0b480a3780 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:39.387+0000 7f0b634ae700 1 --2- 172.21.15.73:0/3147720344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b5c196620 0x7f0b5c196ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:39.387+0000 7f0b634ae700 1 --2- 172.21.15.73:0/3147720344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b5c0fede0 0x7f0b5c19c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:39.387+0000 7f0b634ae700 1 --2- 172.21.15.73:0/3147720344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b5c105a40 0x7f0b5c19cd00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:39.387+0000 7f0b634ae700 1 -- 172.21.15.73:0/3147720344 >> 172.21.15.73:0/3147720344 conn(0x7f0b5c076b40 msgr2=0x7f0b5c1042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:39.387+0000 7f0b634ae700 1 -- 172.21.15.73:0/3147720344 shutdown_connections 2023-08-10T11:54:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:39.387+0000 7f0b634ae700 1 -- 172.21.15.73:0/3147720344 wait complete. 2023-08-10T11:54:39.514 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:54:39.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.693+0000 7f6b76abb700 1 -- 172.21.15.73:0/3929994353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b7010d510 msgr2=0x7f6b7010d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:39.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.693+0000 7f6b76abb700 1 --2- 172.21.15.73:0/3929994353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b7010d510 0x7f6b7010d8f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009990 tx=0x7f6b60009ca0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.693+0000 7f6b76abb700 1 -- 172.21.15.73:0/3929994353 shutdown_connections 2023-08-10T11:54:39.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.693+0000 7f6b76abb700 1 --2- 172.21.15.73:0/3929994353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b7010d510 0x7f6b7010d8f0 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009990 tx=0x7f6b60009ca0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.693+0000 7f6b76abb700 1 --2- 172.21.15.73:0/3929994353 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b7010cb80 0x7f6b70114400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.693+0000 7f6b76abb700 1 --2- 172.21.15.73:0/3929994353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b7010c1c0 0x7f6b7010c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.693+0000 7f6b76abb700 1 -- 172.21.15.73:0/3929994353 >> 172.21.15.73:0/3929994353 conn(0x7f6b7006ca30 msgr2=0x7f6b7006ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:39.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.693+0000 7f6b76abb700 1 -- 172.21.15.73:0/3929994353 shutdown_connections 2023-08-10T11:54:39.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.693+0000 7f6b76abb700 1 -- 172.21.15.73:0/3929994353 wait complete. 2023-08-10T11:54:39.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.694+0000 7f6b76abb700 1 Processor -- start 2023-08-10T11:54:39.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.694+0000 7f6b76abb700 1 -- start start 2023-08-10T11:54:39.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.695+0000 7f6b76abb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b7010c1c0 0x7f6b7019f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:39.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.695+0000 7f6b76abb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b7010cb80 0x7f6b7019f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:39.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.695+0000 7f6b76abb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b701a3cc0 0x7f6b701a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:39.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.695+0000 7f6b76abb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b701a4740 con 0x7f6b7010c1c0 2023-08-10T11:54:39.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.695+0000 7f6b76abb700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b701a48b0 con 0x7f6b7010cb80 2023-08-10T11:54:39.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.695+0000 7f6b76abb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b701a4a70 con 0x7f6b701a3cc0 2023-08-10T11:54:39.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.695+0000 7f6b6ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b7010cb80 0x7f6b7019f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:39.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.695+0000 7f6b6ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b7010cb80 0x7f6b7019f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49064/0 (socket says 172.21.15.73:49064) 2023-08-10T11:54:39.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.695+0000 7f6b75058700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b701a3cc0 0x7f6b701a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:39.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.695+0000 7f6b6ffff700 1 -- 172.21.15.73:0/1358918554 learned_addr learned my addr 172.21.15.73:0/1358918554 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:39.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.695+0000 7f6b74857700 1 --2- 172.21.15.73:0/1358918554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b7010c1c0 0x7f6b7019f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:39.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.695+0000 7f6b6ffff700 1 -- 172.21.15.73:0/1358918554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b701a3cc0 msgr2=0x7f6b701a4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:39.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.695+0000 7f6b6ffff700 1 --2- 172.21.15.73:0/1358918554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b701a3cc0 0x7f6b701a4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.695+0000 7f6b6ffff700 1 -- 172.21.15.73:0/1358918554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b7010c1c0 msgr2=0x7f6b7019f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:39.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.695+0000 7f6b6ffff700 1 --2- 172.21.15.73:0/1358918554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b7010c1c0 0x7f6b7019f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.695+0000 7f6b6ffff700 1 -- 172.21.15.73:0/1358918554 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b600095f0 con 0x7f6b7010cb80 2023-08-10T11:54:39.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.695+0000 7f6b6ffff700 1 --2- 172.21.15.73:0/1358918554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b7010cb80 0x7f6b7019f860 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400e9a0 tx=0x7f6b6400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:39.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.697+0000 7f6b6dffb700 1 -- 172.21.15.73:0/1358918554 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64009790 con 0x7f6b7010cb80 2023-08-10T11:54:39.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.697+0000 7f6b6dffb700 1 -- 172.21.15.73:0/1358918554 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b6400cbd0 con 0x7f6b7010cb80 2023-08-10T11:54:39.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.697+0000 7f6b6dffb700 1 -- 172.21.15.73:0/1358918554 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64018680 con 0x7f6b7010cb80 2023-08-10T11:54:39.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.697+0000 7f6b76abb700 1 -- 172.21.15.73:0/1358918554 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b70115b90 con 0x7f6b7010cb80 2023-08-10T11:54:39.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.697+0000 7f6b76abb700 1 -- 172.21.15.73:0/1358918554 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b70116050 con 0x7f6b7010cb80 2023-08-10T11:54:39.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.701+0000 7f6b6dffb700 1 -- 172.21.15.73:0/1358918554 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f6b6400cd40 con 0x7f6b7010cb80 2023-08-10T11:54:39.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.701+0000 7f6b6dffb700 1 --2- 172.21.15.73:0/1358918554 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f6b580a1410 0x7f6b580a38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:39.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.702+0000 7f6b74857700 1 --2- 172.21.15.73:0/1358918554 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f6b580a1410 0x7f6b580a38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:39.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.702+0000 7f6b6dffb700 1 -- 172.21.15.73:0/1358918554 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f6b64014070 con 0x7f6b7010cb80 2023-08-10T11:54:39.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.702+0000 7f6b82c54b80 1 Processor -- start 2023-08-10T11:54:39.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.702+0000 7f6b82c54b80 1 -- start start 2023-08-10T11:54:39.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.702+0000 7f6b82c54b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ad8c95f50 0x563ad8c96330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:39.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.702+0000 7f6b82c54b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ad8c96870 0x563ad8c902c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:39.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.702+0000 7f6b82c54b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ad8c90800 0x563ad8c90c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:39.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.702+0000 7f6b82c54b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ad8c0bdc0 con 0x563ad8c96870 2023-08-10T11:54:39.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.702+0000 7f6b82c54b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ad8be8590 con 0x563ad8c90800 2023-08-10T11:54:39.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.702+0000 7f6b82c54b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ad8be5eb0 con 0x563ad8c95f50 2023-08-10T11:54:39.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.702+0000 7f6b74857700 1 --2- 172.21.15.73:0/1358918554 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f6b580a1410 0x7f6b580a38d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6b60000c00 tx=0x7f6b60005fb0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:39.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.702+0000 7f6b74857700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ad8c95f50 0x563ad8c96330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:39.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.702+0000 7f6b6ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ad8c96870 0x563ad8c902c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:39.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.702+0000 7f6b74857700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ad8c95f50 0x563ad8c96330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:59924/0 (socket says 172.21.15.73:59924) 2023-08-10T11:54:39.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.702+0000 7f6b74857700 1 -- 172.21.15.73:0/1257823578 learned_addr learned my addr 172.21.15.73:0/1257823578 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:39.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.702+0000 7f6b75058700 1 --2- 172.21.15.73:0/1257823578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ad8c90800 0x563ad8c90c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:39.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.703+0000 7f6b74857700 1 -- 172.21.15.73:0/1257823578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ad8c90800 msgr2=0x563ad8c90c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:39.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.703+0000 7f6b74857700 1 --2- 172.21.15.73:0/1257823578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ad8c90800 0x563ad8c90c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.703+0000 7f6b74857700 1 -- 172.21.15.73:0/1257823578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ad8c96870 msgr2=0x563ad8c902c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:39.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.703+0000 7f6b74857700 1 --2- 172.21.15.73:0/1257823578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ad8c96870 0x563ad8c902c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.703+0000 7f6b74857700 1 -- 172.21.15.73:0/1257823578 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ad8a62630 con 0x563ad8c95f50 2023-08-10T11:54:39.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.703+0000 7f6b74857700 1 --2- 172.21.15.73:0/1257823578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ad8c95f50 0x563ad8c96330 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6b60015000 tx=0x7f6b6001f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fccad6d9de977e74 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:39.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.703+0000 7f6b56ffd700 1 -- 172.21.15.73:0/1257823578 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6002b070 con 0x563ad8c95f50 2023-08-10T11:54:39.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.703+0000 7f6b56ffd700 1 -- 172.21.15.73:0/1257823578 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b6001e040 con 0x563ad8c95f50 2023-08-10T11:54:39.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.703+0000 7f6b56ffd700 1 -- 172.21.15.73:0/1257823578 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b60004c20 con 0x563ad8c95f50 2023-08-10T11:54:39.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.704+0000 7f6b82c54b80 1 -- 172.21.15.73:0/1257823578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ad8c95f50 msgr2=0x563ad8c96330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:39.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.704+0000 7f6b82c54b80 1 --2- 172.21.15.73:0/1257823578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ad8c95f50 0x563ad8c96330 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6b60015000 tx=0x7f6b6001f000 comp rx=0 tx=0).stop 2023-08-10T11:54:39.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.704+0000 7f6b82c54b80 1 -- 172.21.15.73:0/1257823578 shutdown_connections 2023-08-10T11:54:39.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.704+0000 7f6b82c54b80 1 --2- 172.21.15.73:0/1257823578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ad8c90800 0x563ad8c90c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.704+0000 7f6b82c54b80 1 --2- 172.21.15.73:0/1257823578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ad8c95f50 0x563ad8c96330 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.704+0000 7f6b82c54b80 1 --2- 172.21.15.73:0/1257823578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ad8c96870 0x563ad8c902c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.704+0000 7f6b82c54b80 1 -- 172.21.15.73:0/1257823578 >> 172.21.15.73:0/1257823578 conn(0x563ad8bedcd0 msgr2=0x563ad8c8b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:39.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.704+0000 7f6b82c54b80 1 -- 172.21.15.73:0/1257823578 shutdown_connections 2023-08-10T11:54:39.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.704+0000 7f6b82c54b80 1 -- 172.21.15.73:0/1257823578 wait complete. 2023-08-10T11:54:39.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.705+0000 7f6b82c54b80 1 -- start start 2023-08-10T11:54:39.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.705+0000 7f6b82c54b80 1 Processor -- start 2023-08-10T11:54:39.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.705+0000 7f6b82c54b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ad8c90800 0x563ad8c9c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:39.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.705+0000 7f6b82c54b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ad8c95f50 0x563ad8c99b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:39.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.705+0000 7f6b82c54b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ad8c96870 0x563ad8c9a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:39.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.705+0000 7f6b82c54b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ad8be17a0 con 0x563ad8c96870 2023-08-10T11:54:39.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.706+0000 7f6b82c54b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ad8b80ac0 con 0x563ad8c90800 2023-08-10T11:54:39.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.706+0000 7f6b82c54b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ad8b807c0 con 0x563ad8c95f50 2023-08-10T11:54:39.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.706+0000 7f6b82c54b80 10 client.0 _ll_register_callbacks cb 0x563ad8b7e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:54:39.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.706+0000 7f6b74857700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ad8c90800 0x563ad8c9c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:39.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.706+0000 7f6b74857700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ad8c90800 0x563ad8c9c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49076/0 (socket says 172.21.15.73:49076) 2023-08-10T11:54:39.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.706+0000 7f6b74857700 1 -- 172.21.15.73:0/2402500797 learned_addr learned my addr 172.21.15.73:0/2402500797 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:39.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.706+0000 7f6b75058700 1 --2- 172.21.15.73:0/2402500797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ad8c96870 0x563ad8c9a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:39.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.706+0000 7f6b6ffff700 1 --2- 172.21.15.73:0/2402500797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ad8c95f50 0x563ad8c99b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:39.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.706+0000 7f6b74857700 1 -- 172.21.15.73:0/2402500797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ad8c95f50 msgr2=0x563ad8c99b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:39.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.706+0000 7f6b74857700 1 --2- 172.21.15.73:0/2402500797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ad8c95f50 0x563ad8c99b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.706+0000 7f6b74857700 1 -- 172.21.15.73:0/2402500797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ad8c96870 msgr2=0x563ad8c9a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:39.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.706+0000 7f6b74857700 1 --2- 172.21.15.73:0/2402500797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ad8c96870 0x563ad8c9a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.706+0000 7f6b74857700 1 -- 172.21.15.73:0/2402500797 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b70107af0 con 0x563ad8c90800 2023-08-10T11:54:39.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.706+0000 7f6b74857700 1 --2- 172.21.15.73:0/2402500797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ad8c90800 0x563ad8c9c8a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009ce0 tx=0x7f6b60004c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac091a2e630a1a99 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:39.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.706+0000 7f6b4ffff700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T11:54:39.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.706+0000 7f6b4ffff700 1 -- 172.21.15.73:0/2402500797 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6002b050 con 0x563ad8c90800 2023-08-10T11:54:39.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.706+0000 7f6b4ffff700 1 -- 172.21.15.73:0/2402500797 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f6b6000bd70 con 0x563ad8c90800 2023-08-10T11:54:39.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.706+0000 7f6b82c54b80 1 -- 172.21.15.73:0/2402500797 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563ad8c83470 con 0x563ad8c90800 2023-08-10T11:54:39.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.707+0000 7f6b4ffff700 1 -- 172.21.15.73:0/2402500797 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b60005a00 con 0x563ad8c90800 2023-08-10T11:54:39.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.707+0000 7f6b82c54b80 10 client.25592 fetch_fsmap learned FSMap version 32 2023-08-10T11:54:39.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.707+0000 7f6b82c54b80 1 -- 172.21.15.73:0/2402500797 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x563ad8a0ede0 con 0x563ad8c90800 2023-08-10T11:54:39.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.707+0000 7f6b4ffff700 1 -- 172.21.15.73:0/2402500797 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563ad8c83470 con 0x563ad8c90800 2023-08-10T11:54:39.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.707+0000 7f6b4ffff700 1 -- 172.21.15.73:0/2402500797 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 32) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f6b6000f460 con 0x563ad8c90800 2023-08-10T11:54:39.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.707+0000 7f6b82c54b80 10 client.25592 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T11:54:39.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.707+0000 7f6b82c54b80 10 client.25592 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:54:39.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.707+0000 7f6b82c54b80 20 client.25592 populate_metadata read hostname 'smithi073' 2023-08-10T11:54:39.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.707+0000 7f6b82c54b80 1 --2- 172.21.15.73:0/2402500797 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563ad8ca9d90 0x563ad8cac180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:39.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.707+0000 7f6b82c54b80 4 client.25592 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:54:39.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.707+0000 7f6b82c54b80 1 -- 172.21.15.73:0/2402500797 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563ad8c5f9d0 con 0x563ad8ca9d90 2023-08-10T11:54:39.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.708+0000 7f6b6ffff700 1 --2- 172.21.15.73:0/2402500797 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563ad8ca9d90 0x563ad8cac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:39.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.708+0000 7f6b4ffff700 10 client.25592 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:39.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.708+0000 7f6b6ffff700 1 --2- 172.21.15.73:0/2402500797 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563ad8ca9d90 0x563ad8cac180 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28ddad35bfb71f2e server_cookie=a44389670ad82275 in_seq=0 out_seq=0 2023-08-10T11:54:39.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.709+0000 7f6b4ffff700 1 -- 172.21.15.73:0/2402500797 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x563ad8c5f9d0 con 0x563ad8ca9d90 2023-08-10T11:54:39.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.709+0000 7f6b4ffff700 10 client.25592 handle_command_reply: tid=0 2023-08-10T11:54:39.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.709+0000 7f6b82c54b80 1 client.25592 shutdown 2023-08-10T11:54:39.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.709+0000 7f6b82c54b80 1 -- 172.21.15.73:0/2402500797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ad8c90800 msgr2=0x563ad8c9c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:39.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.709+0000 7f6b82c54b80 1 --2- 172.21.15.73:0/2402500797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ad8c90800 0x563ad8c9c8a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009ce0 tx=0x7f6b60004c90 comp rx=0 tx=0).stop 2023-08-10T11:54:39.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.709+0000 7f6b82c54b80 1 -- 172.21.15.73:0/2402500797 shutdown_connections 2023-08-10T11:54:39.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.709+0000 7f6b82c54b80 1 --2- 172.21.15.73:0/2402500797 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563ad8ca9d90 0x563ad8cac180 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.709+0000 7f6b82c54b80 1 --2- 172.21.15.73:0/2402500797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ad8c90800 0x563ad8c9c8a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.709+0000 7f6b82c54b80 1 --2- 172.21.15.73:0/2402500797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ad8c96870 0x563ad8c9a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.709+0000 7f6b82c54b80 1 --2- 172.21.15.73:0/2402500797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ad8c95f50 0x563ad8c99b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.709+0000 7f6b82c54b80 1 -- 172.21.15.73:0/2402500797 >> 172.21.15.73:0/2402500797 conn(0x563ad8bedcd0 msgr2=0x563ad8c8a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:39.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.709+0000 7f6b4ffff700 0 client.25592 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:39.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.709+0000 7f6b82c54b80 1 -- 172.21.15.73:0/2402500797 shutdown_connections 2023-08-10T11:54:39.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.709+0000 7f6b82c54b80 1 -- 172.21.15.73:0/2402500797 wait complete. 2023-08-10T11:54:39.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.709+0000 7f6b82c54b80 20 client.25592 trim_cache size 0 max 16384 2023-08-10T11:54:39.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.726+0000 7f6b82c54b80 1 Processor -- start 2023-08-10T11:54:39.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.726+0000 7f6b82c54b80 1 -- start start 2023-08-10T11:54:39.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.726+0000 7f6b82c54b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ad8c90800 0x563ad8ca1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:39.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.726+0000 7f6b82c54b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ad8c95f50 0x563ad8c9c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:39.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.726+0000 7f6b82c54b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ad8c96870 0x563ad8c8b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:39.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.726+0000 7f6b82c54b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ad8a64920 con 0x563ad8c95f50 2023-08-10T11:54:39.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.726+0000 7f6b82c54b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ad8c85860 con 0x563ad8c96870 2023-08-10T11:54:39.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.726+0000 7f6b82c54b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ad8c8ce00 con 0x563ad8c90800 2023-08-10T11:54:39.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.726+0000 7f6b6ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ad8c95f50 0x563ad8c9c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:39.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.726+0000 7f6b6ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ad8c95f50 0x563ad8c9c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34434/0 (socket says 172.21.15.73:34434) 2023-08-10T11:54:39.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.726+0000 7f6b6ffff700 1 -- 172.21.15.73:0/456414602 learned_addr learned my addr 172.21.15.73:0/456414602 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:39.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.726+0000 7f6b75058700 1 --2- 172.21.15.73:0/456414602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ad8c96870 0x563ad8c8b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:39.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.726+0000 7f6b74857700 1 --2- 172.21.15.73:0/456414602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ad8c90800 0x563ad8ca1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:39.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.726+0000 7f6b6ffff700 1 -- 172.21.15.73:0/456414602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ad8c90800 msgr2=0x563ad8ca1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:39.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.726+0000 7f6b6ffff700 1 --2- 172.21.15.73:0/456414602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ad8c90800 0x563ad8ca1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.726+0000 7f6b6ffff700 1 -- 172.21.15.73:0/456414602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ad8c96870 msgr2=0x563ad8c8b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:39.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.727+0000 7f6b6ffff700 1 --2- 172.21.15.73:0/456414602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ad8c96870 0x563ad8c8b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.727+0000 7f6b6ffff700 1 -- 172.21.15.73:0/456414602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ad89f7c60 con 0x563ad8c95f50 2023-08-10T11:54:39.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.727+0000 7f6b6ffff700 1 --2- 172.21.15.73:0/456414602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ad8c95f50 0x563ad8c9c440 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6b640969b0 tx=0x7f6b640cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e969af34906ff4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:39.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.727+0000 7f6b577fe700 1 -- 172.21.15.73:0/456414602 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b640a2390 con 0x563ad8c95f50 2023-08-10T11:54:39.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.727+0000 7f6b577fe700 1 -- 172.21.15.73:0/456414602 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b640982e0 con 0x563ad8c95f50 2023-08-10T11:54:39.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.727+0000 7f6b577fe700 1 -- 172.21.15.73:0/456414602 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b640a1f00 con 0x563ad8c95f50 2023-08-10T11:54:39.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.728+0000 7f6b82c54b80 1 -- 172.21.15.73:0/456414602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ad8c95f50 msgr2=0x563ad8c9c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:39.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.728+0000 7f6b82c54b80 1 --2- 172.21.15.73:0/456414602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ad8c95f50 0x563ad8c9c440 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6b640969b0 tx=0x7f6b640cc040 comp rx=0 tx=0).stop 2023-08-10T11:54:39.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.728+0000 7f6b82c54b80 1 -- 172.21.15.73:0/456414602 shutdown_connections 2023-08-10T11:54:39.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.728+0000 7f6b82c54b80 1 --2- 172.21.15.73:0/456414602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ad8c96870 0x563ad8c8b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.728+0000 7f6b82c54b80 1 --2- 172.21.15.73:0/456414602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ad8c90800 0x563ad8ca1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.728+0000 7f6b82c54b80 1 --2- 172.21.15.73:0/456414602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ad8c95f50 0x563ad8c9c440 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.728+0000 7f6b82c54b80 1 -- 172.21.15.73:0/456414602 >> 172.21.15.73:0/456414602 conn(0x563ad8bedcd0 msgr2=0x563ad8c93c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:39.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.728+0000 7f6b82c54b80 1 -- 172.21.15.73:0/456414602 shutdown_connections 2023-08-10T11:54:39.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.728+0000 7f6b82c54b80 1 -- 172.21.15.73:0/456414602 wait complete. 2023-08-10T11:54:39.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.728+0000 7f6b82c54b80 1 -- start start 2023-08-10T11:54:39.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.728+0000 7f6b82c54b80 1 Processor -- start 2023-08-10T11:54:39.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.729+0000 7f6b82c54b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ad8c90800 0x563ad8c92c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:39.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.729+0000 7f6b82c54b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ad8c95f50 0x563ad8c93150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:39.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.729+0000 7f6b82c54b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ad8c96870 0x563ad8c91970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:39.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.729+0000 7f6b82c54b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ad8c91eb0 con 0x563ad8c95f50 2023-08-10T11:54:39.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.729+0000 7f6b82c54b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ad8c92020 con 0x563ad8c90800 2023-08-10T11:54:39.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.729+0000 7f6b82c54b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ad8c921e0 con 0x563ad8c96870 2023-08-10T11:54:39.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.729+0000 7f6b82c54b80 10 client.0 _ll_register_callbacks cb 0x563ad8b7e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:54:39.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.729+0000 7f6b6ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ad8c95f50 0x563ad8c93150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:39.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.729+0000 7f6b6ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ad8c95f50 0x563ad8c93150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34442/0 (socket says 172.21.15.73:34442) 2023-08-10T11:54:39.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.729+0000 7f6b74857700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ad8c90800 0x563ad8c92c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:39.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.729+0000 7f6b6ffff700 1 -- 172.21.15.73:0/3432280078 learned_addr learned my addr 172.21.15.73:0/3432280078 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:39.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.729+0000 7f6b75058700 1 --2- 172.21.15.73:0/3432280078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ad8c96870 0x563ad8c91970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:39.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.729+0000 7f6b6ffff700 1 -- 172.21.15.73:0/3432280078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ad8c96870 msgr2=0x563ad8c91970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:39.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.729+0000 7f6b6ffff700 1 --2- 172.21.15.73:0/3432280078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ad8c96870 0x563ad8c91970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.729+0000 7f6b6ffff700 1 -- 172.21.15.73:0/3432280078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ad8c90800 msgr2=0x563ad8c92c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:39.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.729+0000 7f6b6ffff700 1 --2- 172.21.15.73:0/3432280078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ad8c90800 0x563ad8c92c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.729+0000 7f6b6ffff700 1 -- 172.21.15.73:0/3432280078 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b70116050 con 0x563ad8c95f50 2023-08-10T11:54:39.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.729+0000 7f6b74857700 1 --2- 172.21.15.73:0/3432280078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ad8c90800 0x563ad8c92c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:39.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.729+0000 7f6b75058700 1 --2- 172.21.15.73:0/3432280078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ad8c96870 0x563ad8c91970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:39.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.730+0000 7f6b6ffff700 1 --2- 172.21.15.73:0/3432280078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ad8c95f50 0x563ad8c93150 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f6b64096440 tx=0x7f6b6409e0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37bccef5baae317 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:39.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.730+0000 7f6b4ffff700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:54:39.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.730+0000 7f6b4ffff700 1 -- 172.21.15.73:0/3432280078 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b640a2390 con 0x563ad8c95f50 2023-08-10T11:54:39.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.730+0000 7f6b4ffff700 1 -- 172.21.15.73:0/3432280078 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f6b64099430 con 0x563ad8c95f50 2023-08-10T11:54:39.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.730+0000 7f6b82c54b80 1 -- 172.21.15.73:0/3432280078 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6b6001e040 con 0x563ad8c95f50 2023-08-10T11:54:39.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.730+0000 7f6b4ffff700 1 -- 172.21.15.73:0/3432280078 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b64099630 con 0x563ad8c95f50 2023-08-10T11:54:39.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.730+0000 7f6b82c54b80 10 client.16185 fetch_fsmap learned FSMap version 32 2023-08-10T11:54:39.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.730+0000 7f6b82c54b80 1 -- 172.21.15.73:0/3432280078 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x563ad8a35250 con 0x563ad8c95f50 2023-08-10T11:54:39.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.730+0000 7f6b4ffff700 1 -- 172.21.15.73:0/3432280078 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b6001e040 con 0x563ad8c95f50 2023-08-10T11:54:39.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.730+0000 7f6b4ffff700 1 -- 172.21.15.73:0/3432280078 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 32) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f6b64094b50 con 0x563ad8c95f50 2023-08-10T11:54:39.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.730+0000 7f6b82c54b80 10 client.16185 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T11:54:39.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.730+0000 7f6b82c54b80 10 client.16185 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:54:39.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.730+0000 7f6b82c54b80 20 client.16185 populate_metadata read hostname 'smithi073' 2023-08-10T11:54:39.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.730+0000 7f6b82c54b80 1 --2- 172.21.15.73:0/3432280078 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563ad8cfe4f0 0x563ad8d00910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:39.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.730+0000 7f6b82c54b80 4 client.16185 mds_command: new command op to 24503 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:54:39.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.730+0000 7f6b82c54b80 1 -- 172.21.15.73:0/3432280078 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563ad8bda780 con 0x563ad8cfe4f0 2023-08-10T11:54:39.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.730+0000 7f6b74857700 1 --2- 172.21.15.73:0/3432280078 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563ad8cfe4f0 0x563ad8d00910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:39.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.731+0000 7f6b74857700 1 --2- 172.21.15.73:0/3432280078 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563ad8cfe4f0 0x563ad8d00910 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f045aca19b7e53c7 server_cookie=752ebd204a4c0d57 in_seq=0 out_seq=0 2023-08-10T11:54:39.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.731+0000 7f6b4ffff700 10 client.16185 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:39.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.731+0000 7f6b4ffff700 1 -- 172.21.15.73:0/3432280078 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x563ad8bda780 con 0x563ad8cfe4f0 2023-08-10T11:54:39.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.731+0000 7f6b4ffff700 10 client.16185 handle_command_reply: tid=0 2023-08-10T11:54:39.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.731+0000 7f6b82c54b80 1 client.16185 shutdown 2023-08-10T11:54:39.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.731+0000 7f6b82c54b80 1 -- 172.21.15.73:0/3432280078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ad8c95f50 msgr2=0x563ad8c93150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:39.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.731+0000 7f6b82c54b80 1 --2- 172.21.15.73:0/3432280078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ad8c95f50 0x563ad8c93150 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f6b64096440 tx=0x7f6b6409e0a0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.731+0000 7f6b82c54b80 1 -- 172.21.15.73:0/3432280078 shutdown_connections 2023-08-10T11:54:39.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.731+0000 7f6b82c54b80 1 --2- 172.21.15.73:0/3432280078 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563ad8cfe4f0 0x563ad8d00910 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.731+0000 7f6b82c54b80 1 --2- 172.21.15.73:0/3432280078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ad8c90800 0x563ad8c92c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.731+0000 7f6b4ffff700 0 client.16185 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:39.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.731+0000 7f6b82c54b80 1 --2- 172.21.15.73:0/3432280078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ad8c96870 0x563ad8c91970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.731+0000 7f6b82c54b80 1 --2- 172.21.15.73:0/3432280078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ad8c95f50 0x563ad8c93150 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.731+0000 7f6b82c54b80 1 -- 172.21.15.73:0/3432280078 >> 172.21.15.73:0/3432280078 conn(0x563ad8bedcd0 msgr2=0x563ad8c94ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:39.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.731+0000 7f6b82c54b80 1 -- 172.21.15.73:0/3432280078 shutdown_connections 2023-08-10T11:54:39.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.732+0000 7f6b82c54b80 1 -- 172.21.15.73:0/3432280078 wait complete. 2023-08-10T11:54:39.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.732+0000 7f6b82c54b80 20 client.16185 trim_cache size 0 max 16384 2023-08-10T11:54:39.744 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:54:39.744 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:54:39.744 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": { 2023-08-10T11:54:39.745 INFO:teuthology.orchestra.run.smithi073.stdout: "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d": { 2023-08-10T11:54:39.745 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2023-08-10T11:54:39.745 INFO:teuthology.orchestra.run.smithi073.stdout: "tag": "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d", 2023-08-10T11:54:39.745 INFO:teuthology.orchestra.run.smithi073.stdout: "options": "recursive,force" 2023-08-10T11:54:39.745 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:54:39.745 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:54:39.746 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:54:39.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.732+0000 7f6b76abb700 1 -- 172.21.15.73:0/1358918554 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f6b580a1410 msgr2=0x7f6b580a38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:39.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.732+0000 7f6b76abb700 1 --2- 172.21.15.73:0/1358918554 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f6b580a1410 0x7f6b580a38d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6b60000c00 tx=0x7f6b60005fb0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.732+0000 7f6b76abb700 1 -- 172.21.15.73:0/1358918554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b7010cb80 msgr2=0x7f6b7019f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:39.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.732+0000 7f6b76abb700 1 --2- 172.21.15.73:0/1358918554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b7010cb80 0x7f6b7019f860 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400e9a0 tx=0x7f6b6400ecb0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.732+0000 7f6b76abb700 1 -- 172.21.15.73:0/1358918554 shutdown_connections 2023-08-10T11:54:39.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.732+0000 7f6b76abb700 1 --2- 172.21.15.73:0/1358918554 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f6b580a1410 0x7f6b580a38d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.732+0000 7f6b76abb700 1 --2- 172.21.15.73:0/1358918554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b701a3cc0 0x7f6b701a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.732+0000 7f6b76abb700 1 --2- 172.21.15.73:0/1358918554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b7010c1c0 0x7f6b7019f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.732+0000 7f6b76abb700 1 --2- 172.21.15.73:0/1358918554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b7010cb80 0x7f6b7019f860 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:39.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.732+0000 7f6b76abb700 1 -- 172.21.15.73:0/1358918554 >> 172.21.15.73:0/1358918554 conn(0x7f6b7006ca30 msgr2=0x7f6b70109f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:39.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.732+0000 7f6b76abb700 1 -- 172.21.15.73:0/1358918554 shutdown_connections 2023-08-10T11:54:39.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:54:39.732+0000 7f6b76abb700 1 -- 172.21.15.73:0/1358918554 wait complete. 2023-08-10T11:54:39.749 INFO:tasks.cephfs.filesystem:scrub status for tag:9d39b3fa-9b62-42b4-b1a5-738cb3118a5d - {'path': '/', 'tag': '9d39b3fa-9b62-42b4-b1a5-738cb3118a5d', 'options': 'recursive,force'} 2023-08-10T11:54:40.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:40 smithi152 ceph-mon[130220]: pgmap v64: 97 pgs: 97 active+clean; 152 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.3 MiB/s wr, 272 op/s 2023-08-10T11:54:41.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:40 smithi156 ceph-mon[130574]: pgmap v64: 97 pgs: 97 active+clean; 152 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.3 MiB/s wr, 272 op/s 2023-08-10T11:54:41.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:40 smithi073 ceph-mon[128869]: pgmap v64: 97 pgs: 97 active+clean; 152 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.3 MiB/s wr, 272 op/s 2023-08-10T11:54:42.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:42 smithi152 ceph-mon[130220]: pgmap v65: 97 pgs: 97 active+clean; 152 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 91 op/s 2023-08-10T11:54:43.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:42 smithi156 ceph-mon[130574]: pgmap v65: 97 pgs: 97 active+clean; 152 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 91 op/s 2023-08-10T11:54:43.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:42 smithi073 ceph-mon[128869]: pgmap v65: 97 pgs: 97 active+clean; 152 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 91 op/s 2023-08-10T11:54:44.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:44 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:54:44.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:44 smithi152 ceph-mon[130220]: pgmap v66: 97 pgs: 97 active+clean; 153 MiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.6 MiB/s wr, 117 op/s 2023-08-10T11:54:44.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:44 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:54:44.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:44 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:54:45.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:44 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:54:45.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:44 smithi156 ceph-mon[130574]: pgmap v66: 97 pgs: 97 active+clean; 153 MiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.6 MiB/s wr, 117 op/s 2023-08-10T11:54:45.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:44 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:54:45.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:44 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:54:45.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:44 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:54:45.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:44 smithi073 ceph-mon[128869]: pgmap v66: 97 pgs: 97 active+clean; 153 MiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.6 MiB/s wr, 117 op/s 2023-08-10T11:54:45.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:44 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:54:45.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:44 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:54:45.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:45 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:54:45.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:45 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:54:45.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:45 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:54:46.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:45 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:54:46.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:45 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:54:46.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:45 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:54:46.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:45 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:54:46.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:45 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:54:46.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:45 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:54:46.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:46 smithi152 ceph-mon[130220]: pgmap v67: 97 pgs: 97 active+clean; 161 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.7 MiB/s wr, 160 op/s 2023-08-10T11:54:47.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:46 smithi156 ceph-mon[130574]: pgmap v67: 97 pgs: 97 active+clean; 161 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.7 MiB/s wr, 160 op/s 2023-08-10T11:54:47.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:46 smithi073 ceph-mon[128869]: pgmap v67: 97 pgs: 97 active+clean; 161 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.7 MiB/s wr, 160 op/s 2023-08-10T11:54:48.092 INFO:tasks.workunit.client.0.smithi073.stdout: 71 997797 828 614070 850 239800 198 2023-08-10T11:54:48.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:48 smithi152 ceph-mon[130220]: pgmap v68: 97 pgs: 97 active+clean; 161 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.5 MiB/s wr, 116 op/s 2023-08-10T11:54:49.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:48 smithi156 ceph-mon[130574]: pgmap v68: 97 pgs: 97 active+clean; 161 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.5 MiB/s wr, 116 op/s 2023-08-10T11:54:49.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:48 smithi073 ceph-mon[128869]: pgmap v68: 97 pgs: 97 active+clean; 161 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.5 MiB/s wr, 116 op/s 2023-08-10T11:54:50.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:50 smithi152 ceph-mon[130220]: pgmap v69: 97 pgs: 97 active+clean; 265 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 11 MiB/s wr, 574 op/s 2023-08-10T11:54:51.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:50 smithi156 ceph-mon[130574]: pgmap v69: 97 pgs: 97 active+clean; 265 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 11 MiB/s wr, 574 op/s 2023-08-10T11:54:51.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:50 smithi073 ceph-mon[128869]: pgmap v69: 97 pgs: 97 active+clean; 265 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 11 MiB/s wr, 574 op/s 2023-08-10T11:54:52.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.533+0000 7fc57db04700 1 -- 172.21.15.73:0/1971379989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc578106720 msgr2=0x7fc578106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:52.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.533+0000 7fc57db04700 1 --2- 172.21.15.73:0/1971379989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc578106720 0x7fc578106b00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc5700099c0 tx=0x7fc570009cd0 comp rx=0 tx=0).stop 2023-08-10T11:54:52.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.533+0000 7fc57db04700 1 -- 172.21.15.73:0/1971379989 shutdown_connections 2023-08-10T11:54:52.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.533+0000 7fc57db04700 1 --2- 172.21.15.73:0/1971379989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc578068520 0x7fc57810d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:52.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.533+0000 7fc57db04700 1 --2- 172.21.15.73:0/1971379989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc578106720 0x7fc578106b00 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:52.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.533+0000 7fc57db04700 1 --2- 172.21.15.73:0/1971379989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc578067b60 0x7fc578067fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:52.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.533+0000 7fc57db04700 1 -- 172.21.15.73:0/1971379989 >> 172.21.15.73:0/1971379989 conn(0x7fc5780750a0 msgr2=0x7fc5780754b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:52.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.533+0000 7fc57db04700 1 -- 172.21.15.73:0/1971379989 shutdown_connections 2023-08-10T11:54:52.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.533+0000 7fc57db04700 1 -- 172.21.15.73:0/1971379989 wait complete. 2023-08-10T11:54:52.537 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.534+0000 7fc57db04700 1 Processor -- start 2023-08-10T11:54:52.537 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.534+0000 7fc57db04700 1 -- start start 2023-08-10T11:54:52.537 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.534+0000 7fc57db04700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc578067b60 0x7fc57819c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:52.537 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.534+0000 7fc57db04700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc578068520 0x7fc57819cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:52.537 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.534+0000 7fc57db04700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc578106720 0x7fc578196770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.534+0000 7fc57db04700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc578196f40 con 0x7fc578067b60 2023-08-10T11:54:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.534+0000 7fc57db04700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5781970b0 con 0x7fc578068520 2023-08-10T11:54:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.534+0000 7fc57db04700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc578197270 con 0x7fc578106720 2023-08-10T11:54:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.534+0000 7fc5777fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc578067b60 0x7fc57819c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.534+0000 7fc5777fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc578067b60 0x7fc57819c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34454/0 (socket says 172.21.15.73:34454) 2023-08-10T11:54:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.534+0000 7fc5777fe700 1 -- 172.21.15.73:0/1004912406 learned_addr learned my addr 172.21.15.73:0/1004912406 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.534+0000 7fc576ffd700 1 --2- 172.21.15.73:0/1004912406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc578068520 0x7fc57819cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.535+0000 7fc577fff700 1 --2- 172.21.15.73:0/1004912406 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc578106720 0x7fc578196770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.535+0000 7fc5777fe700 1 -- 172.21.15.73:0/1004912406 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc578106720 msgr2=0x7fc578196770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.535+0000 7fc5777fe700 1 --2- 172.21.15.73:0/1004912406 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc578106720 0x7fc578196770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.535+0000 7fc5777fe700 1 -- 172.21.15.73:0/1004912406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc578068520 msgr2=0x7fc57819cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.535+0000 7fc5777fe700 1 --2- 172.21.15.73:0/1004912406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc578068520 0x7fc57819cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.535+0000 7fc5777fe700 1 -- 172.21.15.73:0/1004912406 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5700095f0 con 0x7fc578067b60 2023-08-10T11:54:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.535+0000 7fc5777fe700 1 --2- 172.21.15.73:0/1004912406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc578067b60 0x7fc57819c9a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fc57000f690 tx=0x7fc57000f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.535+0000 7fc574ff9700 1 -- 172.21.15.73:0/1004912406 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57001d070 con 0x7fc578067b60 2023-08-10T11:54:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.535+0000 7fc57db04700 1 -- 172.21.15.73:0/1004912406 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5781974f0 con 0x7fc578067b60 2023-08-10T11:54:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.535+0000 7fc574ff9700 1 -- 172.21.15.73:0/1004912406 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc570022470 con 0x7fc578067b60 2023-08-10T11:54:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.535+0000 7fc574ff9700 1 -- 172.21.15.73:0/1004912406 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc570017650 con 0x7fc578067b60 2023-08-10T11:54:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.535+0000 7fc57db04700 1 -- 172.21.15.73:0/1004912406 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5781a3920 con 0x7fc578067b60 2023-08-10T11:54:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.537+0000 7fc574ff9700 1 -- 172.21.15.73:0/1004912406 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fc5700225e0 con 0x7fc578067b60 2023-08-10T11:54:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.538+0000 7fc574ff9700 1 --2- 172.21.15.73:0/1004912406 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fc5640a12c0 0x7fc5640a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.538+0000 7fc574ff9700 1 -- 172.21.15.73:0/1004912406 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc5700cde60 con 0x7fc578067b60 2023-08-10T11:54:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.538+0000 7fc576ffd700 1 --2- 172.21.15.73:0/1004912406 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fc5640a12c0 0x7fc5640a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.538+0000 7fc576ffd700 1 --2- 172.21.15.73:0/1004912406 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fc5640a12c0 0x7fc5640a3780 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc5781981b0 tx=0x7fc560009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.538+0000 7fc589c9db80 1 Processor -- start 2023-08-10T11:54:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.539+0000 7fc589c9db80 1 -- start start 2023-08-10T11:54:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.539+0000 7fc589c9db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9189dee80 0x55d9189df260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.539+0000 7fc589c9db80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9189df7a0 0x55d9189d9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.539+0000 7fc589c9db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d9189d99b0 0x55d9189d9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.539+0000 7fc589c9db80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d918950d60 con 0x55d9189df7a0 2023-08-10T11:54:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.539+0000 7fc589c9db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d91892d530 con 0x55d9189dee80 2023-08-10T11:54:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.539+0000 7fc589c9db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d91892ae50 con 0x55d9189d99b0 2023-08-10T11:54:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.539+0000 7fc576ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9189df7a0 0x55d9189d9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.539+0000 7fc576ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9189df7a0 0x55d9189d9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34462/0 (socket says 172.21.15.73:34462) 2023-08-10T11:54:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.539+0000 7fc576ffd700 1 -- 172.21.15.73:0/2870157769 learned_addr learned my addr 172.21.15.73:0/2870157769 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.539+0000 7fc5777fe700 1 --2- 172.21.15.73:0/2870157769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9189dee80 0x55d9189df260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.539+0000 7fc577fff700 1 --2- 172.21.15.73:0/2870157769 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d9189d99b0 0x55d9189d9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.539+0000 7fc576ffd700 1 -- 172.21.15.73:0/2870157769 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d9189d99b0 msgr2=0x55d9189d9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.539+0000 7fc576ffd700 1 --2- 172.21.15.73:0/2870157769 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d9189d99b0 0x55d9189d9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.539+0000 7fc576ffd700 1 -- 172.21.15.73:0/2870157769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9189dee80 msgr2=0x55d9189df260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.539+0000 7fc576ffd700 1 --2- 172.21.15.73:0/2870157769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9189dee80 0x55d9189df260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.539+0000 7fc576ffd700 1 -- 172.21.15.73:0/2870157769 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9187a75d0 con 0x55d9189df7a0 2023-08-10T11:54:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.539+0000 7fc577fff700 1 --2- 172.21.15.73:0/2870157769 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d9189d99b0 0x55d9189d9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.539+0000 7fc5777fe700 1 --2- 172.21.15.73:0/2870157769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9189dee80 0x55d9189df260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.539+0000 7fc576ffd700 1 --2- 172.21.15.73:0/2870157769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9189df7a0 0x55d9189d9420 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc560011d20 tx=0x7fc560014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171f9651d90dc313 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.540+0000 7fc56dffb700 1 -- 172.21.15.73:0/2870157769 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56000eb20 con 0x55d9189df7a0 2023-08-10T11:54:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.540+0000 7fc56dffb700 1 -- 172.21.15.73:0/2870157769 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc560021070 con 0x55d9189df7a0 2023-08-10T11:54:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.540+0000 7fc56dffb700 1 -- 172.21.15.73:0/2870157769 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56001d670 con 0x55d9189df7a0 2023-08-10T11:54:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.540+0000 7fc589c9db80 1 -- 172.21.15.73:0/2870157769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9189df7a0 msgr2=0x55d9189d9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.540+0000 7fc589c9db80 1 --2- 172.21.15.73:0/2870157769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9189df7a0 0x55d9189d9420 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc560011d20 tx=0x7fc560014000 comp rx=0 tx=0).stop 2023-08-10T11:54:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.540+0000 7fc589c9db80 1 -- 172.21.15.73:0/2870157769 shutdown_connections 2023-08-10T11:54:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.540+0000 7fc589c9db80 1 --2- 172.21.15.73:0/2870157769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9189dee80 0x55d9189df260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.540+0000 7fc589c9db80 1 --2- 172.21.15.73:0/2870157769 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d9189d99b0 0x55d9189d9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.540+0000 7fc589c9db80 1 --2- 172.21.15.73:0/2870157769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9189df7a0 0x55d9189d9420 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.541+0000 7fc589c9db80 1 -- 172.21.15.73:0/2870157769 >> 172.21.15.73:0/2870157769 conn(0x55d918932c70 msgr2=0x55d9189cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.541+0000 7fc589c9db80 1 -- 172.21.15.73:0/2870157769 shutdown_connections 2023-08-10T11:54:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.541+0000 7fc589c9db80 1 -- 172.21.15.73:0/2870157769 wait complete. 2023-08-10T11:54:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.541+0000 7fc589c9db80 1 -- start start 2023-08-10T11:54:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.541+0000 7fc589c9db80 1 Processor -- start 2023-08-10T11:54:52.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.542+0000 7fc589c9db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9189d99b0 0x55d9189e5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:52.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.542+0000 7fc589c9db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d9189dee80 0x55d9189e2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:52.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.542+0000 7fc589c9db80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9189df7a0 0x55d9189e31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:52.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.542+0000 7fc589c9db80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d918926740 con 0x55d9189df7a0 2023-08-10T11:54:52.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.542+0000 7fc589c9db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9188c5a60 con 0x55d9189d99b0 2023-08-10T11:54:52.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.542+0000 7fc589c9db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9188c5760 con 0x55d9189dee80 2023-08-10T11:54:52.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.542+0000 7fc589c9db80 10 client.0 _ll_register_callbacks cb 0x55d9188c3620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:54:52.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.542+0000 7fc576ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d9189dee80 0x55d9189e2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:52.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.542+0000 7fc5777fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9189d99b0 0x55d9189e5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:52.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.542+0000 7fc5777fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9189d99b0 0x55d9189e5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49118/0 (socket says 172.21.15.73:49118) 2023-08-10T11:54:52.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.542+0000 7fc576ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d9189dee80 0x55d9189e2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:59974/0 (socket says 172.21.15.73:59974) 2023-08-10T11:54:52.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.542+0000 7fc5777fe700 1 -- 172.21.15.73:0/1136033419 learned_addr learned my addr 172.21.15.73:0/1136033419 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:52.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.542+0000 7fc577fff700 1 --2- 172.21.15.73:0/1136033419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9189df7a0 0x55d9189e31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:52.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.542+0000 7fc5777fe700 1 -- 172.21.15.73:0/1136033419 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d9189dee80 msgr2=0x55d9189e2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:52.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.542+0000 7fc5777fe700 1 --2- 172.21.15.73:0/1136033419 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d9189dee80 0x55d9189e2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:52.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.542+0000 7fc5777fe700 1 -- 172.21.15.73:0/1136033419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9189df7a0 msgr2=0x55d9189e31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.542+0000 7fc5777fe700 1 --2- 172.21.15.73:0/1136033419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9189df7a0 0x55d9189e31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.542+0000 7fc5777fe700 1 -- 172.21.15.73:0/1136033419 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5781a3920 con 0x55d9189d99b0 2023-08-10T11:54:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.542+0000 7fc576ffd700 1 --2- 172.21.15.73:0/1136033419 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d9189dee80 0x55d9189e2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:54:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.542+0000 7fc577fff700 1 --2- 172.21.15.73:0/1136033419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9189df7a0 0x55d9189e31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:54:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.542+0000 7fc5777fe700 1 --2- 172.21.15.73:0/1136033419 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9189d99b0 0x55d9189e5800 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc5700cb640 tx=0x7fc57009aaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f361331e97452e19 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.542+0000 7fc556ffd700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T11:54:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.542+0000 7fc556ffd700 1 -- 172.21.15.73:0/1136033419 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57009b570 con 0x55d9189d99b0 2023-08-10T11:54:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.542+0000 7fc556ffd700 1 -- 172.21.15.73:0/1136033419 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc5700a34d0 con 0x55d9189d99b0 2023-08-10T11:54:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.542+0000 7fc589c9db80 1 -- 172.21.15.73:0/1136033419 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d9189c81c0 con 0x55d9189d99b0 2023-08-10T11:54:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.543+0000 7fc556ffd700 1 -- 172.21.15.73:0/1136033419 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc570022ad0 con 0x55d9189d99b0 2023-08-10T11:54:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.543+0000 7fc589c9db80 10 client.25610 fetch_fsmap learned FSMap version 32 2023-08-10T11:54:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.543+0000 7fc589c9db80 1 -- 172.21.15.73:0/1136033419 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7fc560017070 con 0x55d9189d99b0 2023-08-10T11:54:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.543+0000 7fc556ffd700 1 -- 172.21.15.73:0/1136033419 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d9189c81c0 con 0x55d9189d99b0 2023-08-10T11:54:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.543+0000 7fc556ffd700 1 -- 172.21.15.73:0/1136033419 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 32) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fc5700a3040 con 0x55d9189d99b0 2023-08-10T11:54:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.543+0000 7fc589c9db80 10 client.25610 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T11:54:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.543+0000 7fc589c9db80 10 client.25610 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:54:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.543+0000 7fc589c9db80 20 client.25610 populate_metadata read hostname 'smithi073' 2023-08-10T11:54:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.543+0000 7fc589c9db80 1 --2- 172.21.15.73:0/1136033419 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55d9189f2de0 0x55d9189f5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.543+0000 7fc589c9db80 4 client.25610 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:54:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.543+0000 7fc589c9db80 1 -- 172.21.15.73:0/1136033419 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d9189a4970 con 0x55d9189f2de0 2023-08-10T11:54:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.543+0000 7fc576ffd700 1 --2- 172.21.15.73:0/1136033419 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55d9189f2de0 0x55d9189f5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.544+0000 7fc556ffd700 10 client.25610 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.544+0000 7fc576ffd700 1 --2- 172.21.15.73:0/1136033419 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55d9189f2de0 0x55d9189f5200 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47aed754b0bbcc0d server_cookie=28420b946f050305 in_seq=0 out_seq=0 2023-08-10T11:54:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.544+0000 7fc556ffd700 1 -- 172.21.15.73:0/1136033419 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55d9189a4970 con 0x55d9189f2de0 2023-08-10T11:54:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.544+0000 7fc556ffd700 10 client.25610 handle_command_reply: tid=0 2023-08-10T11:54:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.545+0000 7fc589c9db80 1 client.25610 shutdown 2023-08-10T11:54:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.545+0000 7fc589c9db80 1 -- 172.21.15.73:0/1136033419 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9189d99b0 msgr2=0x55d9189e5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.545+0000 7fc589c9db80 1 --2- 172.21.15.73:0/1136033419 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9189d99b0 0x55d9189e5800 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc5700cb640 tx=0x7fc57009aaf0 comp rx=0 tx=0).stop 2023-08-10T11:54:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.545+0000 7fc589c9db80 1 -- 172.21.15.73:0/1136033419 shutdown_connections 2023-08-10T11:54:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.545+0000 7fc589c9db80 1 --2- 172.21.15.73:0/1136033419 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55d9189f2de0 0x55d9189f5200 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.545+0000 7fc589c9db80 1 --2- 172.21.15.73:0/1136033419 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9189d99b0 0x55d9189e5800 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.545+0000 7fc556ffd700 0 client.25610 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.545+0000 7fc589c9db80 1 --2- 172.21.15.73:0/1136033419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9189df7a0 0x55d9189e31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.545+0000 7fc589c9db80 1 --2- 172.21.15.73:0/1136033419 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d9189dee80 0x55d9189e2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.545+0000 7fc589c9db80 1 -- 172.21.15.73:0/1136033419 >> 172.21.15.73:0/1136033419 conn(0x55d918932c70 msgr2=0x55d9189cf4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.545+0000 7fc589c9db80 1 -- 172.21.15.73:0/1136033419 shutdown_connections 2023-08-10T11:54:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.545+0000 7fc589c9db80 1 -- 172.21.15.73:0/1136033419 wait complete. 2023-08-10T11:54:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.545+0000 7fc589c9db80 20 client.25610 trim_cache size 0 max 16384 2023-08-10T11:54:52.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.561+0000 7fc589c9db80 1 Processor -- start 2023-08-10T11:54:52.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.561+0000 7fc589c9db80 1 -- start start 2023-08-10T11:54:52.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.561+0000 7fc589c9db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d9189d99b0 0x55d9189e2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:52.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.561+0000 7fc589c9db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9189dee80 0x55d9189f9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:52.566 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.562+0000 7fc589c9db80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9189df7a0 0x55d9189ea210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:52.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.562+0000 7fc589c9db80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9187a98c0 con 0x55d9189df7a0 2023-08-10T11:54:52.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.562+0000 7fc589c9db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9189deb20 con 0x55d9189dee80 2023-08-10T11:54:52.567 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.562+0000 7fc589c9db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9189c80f0 con 0x55d9189d99b0 2023-08-10T11:54:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.562+0000 7fc5777fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d9189d99b0 0x55d9189e2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.562+0000 7fc576ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9189dee80 0x55d9189f9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.562+0000 7fc5777fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d9189d99b0 0x55d9189e2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:59980/0 (socket says 172.21.15.73:59980) 2023-08-10T11:54:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.562+0000 7fc5777fe700 1 -- 172.21.15.73:0/164517742 learned_addr learned my addr 172.21.15.73:0/164517742 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.562+0000 7fc577fff700 1 --2- 172.21.15.73:0/164517742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9189df7a0 0x55d9189ea210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.562+0000 7fc5777fe700 1 -- 172.21.15.73:0/164517742 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9189dee80 msgr2=0x55d9189f9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.562+0000 7fc5777fe700 1 --2- 172.21.15.73:0/164517742 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9189dee80 0x55d9189f9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.562+0000 7fc5777fe700 1 -- 172.21.15.73:0/164517742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9189df7a0 msgr2=0x55d9189ea210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.562+0000 7fc5777fe700 1 --2- 172.21.15.73:0/164517742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9189df7a0 0x55d9189ea210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.562+0000 7fc5777fe700 1 -- 172.21.15.73:0/164517742 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d918753d80 con 0x55d9189d99b0 2023-08-10T11:54:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.562+0000 7fc5777fe700 1 --2- 172.21.15.73:0/164517742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d9189d99b0 0x55d9189e2a40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc570000c00 tx=0x7fc57009f2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c19ee7d64894dcf4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.562+0000 7fc56e7fc700 1 -- 172.21.15.73:0/164517742 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc570022ad0 con 0x55d9189d99b0 2023-08-10T11:54:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.562+0000 7fc56e7fc700 1 -- 172.21.15.73:0/164517742 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc57009b190 con 0x55d9189d99b0 2023-08-10T11:54:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.562+0000 7fc56e7fc700 1 -- 172.21.15.73:0/164517742 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5700b92d0 con 0x55d9189d99b0 2023-08-10T11:54:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.563+0000 7fc589c9db80 1 -- 172.21.15.73:0/164517742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d9189d99b0 msgr2=0x55d9189e2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.563+0000 7fc589c9db80 1 --2- 172.21.15.73:0/164517742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d9189d99b0 0x55d9189e2a40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc570000c00 tx=0x7fc57009f2c0 comp rx=0 tx=0).stop 2023-08-10T11:54:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.563+0000 7fc589c9db80 1 -- 172.21.15.73:0/164517742 shutdown_connections 2023-08-10T11:54:52.573 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.563+0000 7fc589c9db80 1 --2- 172.21.15.73:0/164517742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9189df7a0 0x55d9189ea210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:52.573 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.563+0000 7fc589c9db80 1 --2- 172.21.15.73:0/164517742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d9189d99b0 0x55d9189e2a40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:52.573 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.563+0000 7fc589c9db80 1 --2- 172.21.15.73:0/164517742 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9189dee80 0x55d9189f9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:52.574 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.563+0000 7fc589c9db80 1 -- 172.21.15.73:0/164517742 >> 172.21.15.73:0/164517742 conn(0x55d918932c70 msgr2=0x55d9189dcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:52.574 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.563+0000 7fc589c9db80 1 -- 172.21.15.73:0/164517742 shutdown_connections 2023-08-10T11:54:52.574 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.563+0000 7fc589c9db80 1 -- 172.21.15.73:0/164517742 wait complete. 2023-08-10T11:54:52.574 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.563+0000 7fc589c9db80 1 -- start start 2023-08-10T11:54:52.575 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.564+0000 7fc589c9db80 1 Processor -- start 2023-08-10T11:54:52.575 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.564+0000 7fc589c9db80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9189d99b0 0x55d9189ea220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:52.575 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.564+0000 7fc589c9db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d9189dee80 0x55d9189da890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:52.576 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.564+0000 7fc589c9db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9189df7a0 0x55d9189dae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:52.576 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.564+0000 7fc589c9db80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9189db500 con 0x55d9189d99b0 2023-08-10T11:54:52.576 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.564+0000 7fc589c9db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9189db670 con 0x55d9189df7a0 2023-08-10T11:54:52.576 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.564+0000 7fc589c9db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9189db830 con 0x55d9189dee80 2023-08-10T11:54:52.577 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.564+0000 7fc589c9db80 10 client.0 _ll_register_callbacks cb 0x55d9188c3620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:54:52.577 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.564+0000 7fc576ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d9189dee80 0x55d9189da890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:52.577 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.564+0000 7fc576ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d9189dee80 0x55d9189da890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:59988/0 (socket says 172.21.15.73:59988) 2023-08-10T11:54:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.564+0000 7fc576ffd700 1 -- 172.21.15.73:0/1348276487 learned_addr learned my addr 172.21.15.73:0/1348276487 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:54:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.564+0000 7fc577fff700 1 --2- 172.21.15.73:0/1348276487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9189df7a0 0x55d9189dae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.564+0000 7fc576ffd700 1 -- 172.21.15.73:0/1348276487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9189df7a0 msgr2=0x55d9189dae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.564+0000 7fc576ffd700 1 --2- 172.21.15.73:0/1348276487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9189df7a0 0x55d9189dae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.565+0000 7fc576ffd700 1 -- 172.21.15.73:0/1348276487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9189d99b0 msgr2=0x55d9189ea220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:54:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.565+0000 7fc576ffd700 1 --2- 172.21.15.73:0/1348276487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9189d99b0 0x55d9189ea220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.565+0000 7fc576ffd700 1 -- 172.21.15.73:0/1348276487 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc560017070 con 0x55d9189dee80 2023-08-10T11:54:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.565+0000 7fc576ffd700 1 --2- 172.21.15.73:0/1348276487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d9189dee80 0x55d9189da890 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55d9189d1680 tx=0x7fc5600118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bf420d0816064e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:54:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.565+0000 7fc556ffd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T11:54:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.565+0000 7fc556ffd700 1 -- 172.21.15.73:0/1348276487 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56000eb20 con 0x55d9189dee80 2023-08-10T11:54:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.565+0000 7fc556ffd700 1 -- 172.21.15.73:0/1348276487 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc56000ec80 con 0x55d9189dee80 2023-08-10T11:54:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.565+0000 7fc589c9db80 1 -- 172.21.15.73:0/1348276487 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc560021070 con 0x55d9189dee80 2023-08-10T11:54:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.565+0000 7fc556ffd700 1 -- 172.21.15.73:0/1348276487 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc56000ee40 con 0x55d9189dee80 2023-08-10T11:54:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.565+0000 7fc589c9db80 10 client.25627 fetch_fsmap learned FSMap version 32 2023-08-10T11:54:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.565+0000 7fc589c9db80 1 -- 172.21.15.73:0/1348276487 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55d91873cc00 con 0x55d9189dee80 2023-08-10T11:54:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.565+0000 7fc556ffd700 1 -- 172.21.15.73:0/1348276487 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc560021070 con 0x55d9189dee80 2023-08-10T11:54:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.566+0000 7fc556ffd700 1 -- 172.21.15.73:0/1348276487 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 32) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fc560039060 con 0x55d9189dee80 2023-08-10T11:54:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.566+0000 7fc589c9db80 10 client.25627 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T11:54:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.566+0000 7fc589c9db80 10 client.25627 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:54:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.566+0000 7fc589c9db80 20 client.25627 populate_metadata read hostname 'smithi073' 2023-08-10T11:54:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.566+0000 7fc589c9db80 1 --2- 172.21.15.73:0/1348276487 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55d9189f2de0 0x55d918a49380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:54:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.566+0000 7fc589c9db80 4 client.25627 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:54:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.566+0000 7fc589c9db80 1 -- 172.21.15.73:0/1348276487 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d91891f720 con 0x55d9189f2de0 2023-08-10T11:54:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.566+0000 7fc5777fe700 1 --2- 172.21.15.73:0/1348276487 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55d9189f2de0 0x55d918a49380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:54:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.566+0000 7fc556ffd700 10 client.25627 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:52.566+0000 7fc5777fe700 1 --2- 172.21.15.73:0/1348276487 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55d9189f2de0 0x55d918a49380 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9353b128e9db9384 server_cookie=f60e112bd2de493f in_seq=0 out_seq=0 2023-08-10T11:54:52.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:52 smithi152 ceph-mon[130220]: pgmap v70: 97 pgs: 97 active+clean; 265 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.9 MiB/s wr, 547 op/s 2023-08-10T11:54:53.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:52 smithi156 ceph-mon[130574]: pgmap v70: 97 pgs: 97 active+clean; 265 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.9 MiB/s wr, 547 op/s 2023-08-10T11:54:53.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:52 smithi073 ceph-mon[128869]: pgmap v70: 97 pgs: 97 active+clean; 265 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.9 MiB/s wr, 547 op/s 2023-08-10T11:54:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:54.704+0000 7fc556ffd700 1 -- 172.21.15.73:0/1348276487 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d91891f720 con 0x55d9189f2de0 2023-08-10T11:54:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:54.704+0000 7fc556ffd700 10 client.25627 handle_command_reply: tid=0 2023-08-10T11:54:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:54.704+0000 7fc589c9db80 1 client.25627 shutdown 2023-08-10T11:54:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:54.704+0000 7fc589c9db80 1 -- 172.21.15.73:0/1348276487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d9189dee80 msgr2=0x55d9189da890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:54.704+0000 7fc589c9db80 1 --2- 172.21.15.73:0/1348276487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d9189dee80 0x55d9189da890 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55d9189d1680 tx=0x7fc5600118d0 comp rx=0 tx=0).stop 2023-08-10T11:54:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:54.705+0000 7fc589c9db80 1 -- 172.21.15.73:0/1348276487 shutdown_connections 2023-08-10T11:54:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:54.705+0000 7fc589c9db80 1 --2- 172.21.15.73:0/1348276487 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55d9189f2de0 0x55d918a49380 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:54.705+0000 7fc589c9db80 1 --2- 172.21.15.73:0/1348276487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d9189df7a0 0x55d9189dae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:54.708 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:54.705+0000 7fc556ffd700 0 client.25627 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:54:54.708 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:54.705+0000 7fc589c9db80 1 --2- 172.21.15.73:0/1348276487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9189d99b0 0x55d9189ea220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:54.708 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:54.705+0000 7fc589c9db80 1 --2- 172.21.15.73:0/1348276487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d9189dee80 0x55d9189da890 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:54.708 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:54.705+0000 7fc589c9db80 1 -- 172.21.15.73:0/1348276487 >> 172.21.15.73:0/1348276487 conn(0x55d918932c70 msgr2=0x55d9189d4000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:54.708 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:54.705+0000 7fc589c9db80 1 -- 172.21.15.73:0/1348276487 shutdown_connections 2023-08-10T11:54:54.708 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:54.705+0000 7fc589c9db80 1 -- 172.21.15.73:0/1348276487 wait complete. 2023-08-10T11:54:54.708 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:54.705+0000 7fc589c9db80 20 client.25627 trim_cache size 0 max 16384 2023-08-10T11:54:54.709 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:54:54.709 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:54:54.709 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:54:54.709 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:54:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:54.705+0000 7fc57db04700 1 -- 172.21.15.73:0/1004912406 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fc5640a12c0 msgr2=0x7fc5640a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:54.705+0000 7fc57db04700 1 --2- 172.21.15.73:0/1004912406 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fc5640a12c0 0x7fc5640a3780 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc5781981b0 tx=0x7fc560009260 comp rx=0 tx=0).stop 2023-08-10T11:54:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:54.705+0000 7fc57db04700 1 -- 172.21.15.73:0/1004912406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc578067b60 msgr2=0x7fc57819c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:54:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:54.705+0000 7fc57db04700 1 --2- 172.21.15.73:0/1004912406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc578067b60 0x7fc57819c9a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fc57000f690 tx=0x7fc57000f6c0 comp rx=0 tx=0).stop 2023-08-10T11:54:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:54.705+0000 7fc57db04700 1 -- 172.21.15.73:0/1004912406 shutdown_connections 2023-08-10T11:54:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:54.705+0000 7fc57db04700 1 --2- 172.21.15.73:0/1004912406 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fc5640a12c0 0x7fc5640a3780 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:54.705+0000 7fc57db04700 1 --2- 172.21.15.73:0/1004912406 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc578106720 0x7fc578196770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:54.705+0000 7fc57db04700 1 --2- 172.21.15.73:0/1004912406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc578067b60 0x7fc57819c9a0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:54.705+0000 7fc57db04700 1 --2- 172.21.15.73:0/1004912406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc578068520 0x7fc57819cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:54:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:54.705+0000 7fc57db04700 1 -- 172.21.15.73:0/1004912406 >> 172.21.15.73:0/1004912406 conn(0x7fc5780750a0 msgr2=0x7fc5780fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:54:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:54.706+0000 7fc57db04700 1 -- 172.21.15.73:0/1004912406 shutdown_connections 2023-08-10T11:54:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:54:54.706+0000 7fc57db04700 1 -- 172.21.15.73:0/1004912406 wait complete. 2023-08-10T11:54:54.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:54 smithi152 ceph-mon[130220]: pgmap v71: 97 pgs: 97 active+clean; 272 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 11 MiB/s wr, 632 op/s 2023-08-10T11:54:55.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:54 smithi156 ceph-mon[130574]: pgmap v71: 97 pgs: 97 active+clean; 272 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 11 MiB/s wr, 632 op/s 2023-08-10T11:54:55.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:54 smithi073 ceph-mon[128869]: pgmap v71: 97 pgs: 97 active+clean; 272 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 11 MiB/s wr, 632 op/s 2023-08-10T11:54:56.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:56 smithi152 ceph-mon[130220]: pgmap v72: 97 pgs: 97 active+clean; 281 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 704 op/s 2023-08-10T11:54:57.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:56 smithi156 ceph-mon[130574]: pgmap v72: 97 pgs: 97 active+clean; 281 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 704 op/s 2023-08-10T11:54:57.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:56 smithi073 ceph-mon[128869]: pgmap v72: 97 pgs: 97 active+clean; 281 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 704 op/s 2023-08-10T11:54:58.091 INFO:tasks.workunit.client.0.smithi073.stdout: 87 1346660 808 840186 768 326200 934 2023-08-10T11:54:58.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:54:58 smithi152 ceph-mon[130220]: pgmap v73: 97 pgs: 97 active+clean; 281 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 11 MiB/s wr, 640 op/s 2023-08-10T11:54:59.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:54:58 smithi156 ceph-mon[130574]: pgmap v73: 97 pgs: 97 active+clean; 281 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 11 MiB/s wr, 640 op/s 2023-08-10T11:54:59.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:54:58 smithi073 ceph-mon[128869]: pgmap v73: 97 pgs: 97 active+clean; 281 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 11 MiB/s wr, 640 op/s 2023-08-10T11:55:00.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:00 smithi152 ceph-mon[130220]: pgmap v74: 97 pgs: 97 active+clean; 290 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 12 MiB/s wr, 737 op/s 2023-08-10T11:55:01.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:00 smithi156 ceph-mon[130574]: pgmap v74: 97 pgs: 97 active+clean; 290 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 12 MiB/s wr, 737 op/s 2023-08-10T11:55:01.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:00 smithi073 ceph-mon[128869]: pgmap v74: 97 pgs: 97 active+clean; 290 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 12 MiB/s wr, 737 op/s 2023-08-10T11:55:02.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:02 smithi152 ceph-mon[130220]: pgmap v75: 97 pgs: 97 active+clean; 290 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.5 MiB/s wr, 279 op/s 2023-08-10T11:55:03.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:02 smithi156 ceph-mon[130574]: pgmap v75: 97 pgs: 97 active+clean; 290 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.5 MiB/s wr, 279 op/s 2023-08-10T11:55:03.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:02 smithi073 ceph-mon[128869]: pgmap v75: 97 pgs: 97 active+clean; 290 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.5 MiB/s wr, 279 op/s 2023-08-10T11:55:04.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:04 smithi152 ceph-mon[130220]: pgmap v76: 97 pgs: 97 active+clean; 291 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.6 MiB/s wr, 293 op/s 2023-08-10T11:55:05.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:04 smithi156 ceph-mon[130574]: pgmap v76: 97 pgs: 97 active+clean; 291 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.6 MiB/s wr, 293 op/s 2023-08-10T11:55:05.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:04 smithi073 ceph-mon[128869]: pgmap v76: 97 pgs: 97 active+clean; 291 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.6 MiB/s wr, 293 op/s 2023-08-10T11:55:06.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:06 smithi152 ceph-mon[130220]: pgmap v77: 97 pgs: 97 active+clean; 301 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.8 MiB/s wr, 261 op/s 2023-08-10T11:55:07.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:06 smithi156 ceph-mon[130574]: pgmap v77: 97 pgs: 97 active+clean; 301 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.8 MiB/s wr, 261 op/s 2023-08-10T11:55:07.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:06 smithi073 ceph-mon[128869]: pgmap v77: 97 pgs: 97 active+clean; 301 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.8 MiB/s wr, 261 op/s 2023-08-10T11:55:07.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.814+0000 7f6b0cf3c700 1 -- 172.21.15.73:0/2566799069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b080fff90 msgr2=0x7f6b08100370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:07.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.814+0000 7f6b0cf3c700 1 --2- 172.21.15.73:0/2566799069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b080fff90 0x7f6b08100370 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f6afc0099c0 tx=0x7f6afc009cd0 comp rx=0 tx=0).stop 2023-08-10T11:55:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.814+0000 7f6b0cf3c700 1 -- 172.21.15.73:0/2566799069 shutdown_connections 2023-08-10T11:55:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.814+0000 7f6b0cf3c700 1 --2- 172.21.15.73:0/2566799069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b08104940 0x7f6b0810c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.814+0000 7f6b0cf3c700 1 --2- 172.21.15.73:0/2566799069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b080fff90 0x7f6b08100370 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.814+0000 7f6b0cf3c700 1 --2- 172.21.15.73:0/2566799069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b08100940 0x7f6b08104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.814+0000 7f6b0cf3c700 1 -- 172.21.15.73:0/2566799069 >> 172.21.15.73:0/2566799069 conn(0x7f6b08076b40 msgr2=0x7f6b080fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.814+0000 7f6b0cf3c700 1 -- 172.21.15.73:0/2566799069 shutdown_connections 2023-08-10T11:55:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.814+0000 7f6b0cf3c700 1 -- 172.21.15.73:0/2566799069 wait complete. 2023-08-10T11:55:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.815+0000 7f6b0cf3c700 1 Processor -- start 2023-08-10T11:55:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.815+0000 7f6b0cf3c700 1 -- start start 2023-08-10T11:55:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.816+0000 7f6b0cf3c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b080fff90 0x7f6b0819b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.816+0000 7f6b0cf3c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b08104940 0x7f6b0819bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.816+0000 7f6b0cf3c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b08195520 0x7f6b081959d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.816+0000 7f6b0cf3c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b08195fa0 con 0x7f6b08195520 2023-08-10T11:55:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.816+0000 7f6b0cf3c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b081960e0 con 0x7f6b080fff90 2023-08-10T11:55:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.816+0000 7f6b0cf3c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b081962a0 con 0x7f6b08104940 2023-08-10T11:55:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.816+0000 7f6b06d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b08195520 0x7f6b081959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.816+0000 7f6b06d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b08195520 0x7f6b081959d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34500/0 (socket says 172.21.15.73:34500) 2023-08-10T11:55:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.816+0000 7f6b0659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b080fff90 0x7f6b0819b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.816+0000 7f6b06d9d700 1 -- 172.21.15.73:0/2411233977 learned_addr learned my addr 172.21.15.73:0/2411233977 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.816+0000 7f6b05d9b700 1 --2- 172.21.15.73:0/2411233977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b08104940 0x7f6b0819bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.816+0000 7f6b06d9d700 1 -- 172.21.15.73:0/2411233977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b08104940 msgr2=0x7f6b0819bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.816+0000 7f6b06d9d700 1 --2- 172.21.15.73:0/2411233977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b08104940 0x7f6b0819bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.816+0000 7f6b06d9d700 1 -- 172.21.15.73:0/2411233977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b080fff90 msgr2=0x7f6b0819b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.816+0000 7f6b06d9d700 1 --2- 172.21.15.73:0/2411233977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b080fff90 0x7f6b0819b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.816+0000 7f6b06d9d700 1 -- 172.21.15.73:0/2411233977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6afc0095f0 con 0x7f6b08195520 2023-08-10T11:55:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.816+0000 7f6b06d9d700 1 --2- 172.21.15.73:0/2411233977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b08195520 0x7f6b081959d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000ada0 tx=0x7f6b0000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.816+0000 7f6af77fe700 1 -- 172.21.15.73:0/2411233977 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0000f070 con 0x7f6b08195520 2023-08-10T11:55:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.816+0000 7f6af77fe700 1 -- 172.21.15.73:0/2411233977 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b0000ce40 con 0x7f6b08195520 2023-08-10T11:55:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.816+0000 7f6b0cf3c700 1 -- 172.21.15.73:0/2411233977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b081a2530 con 0x7f6b08195520 2023-08-10T11:55:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.816+0000 7f6af77fe700 1 -- 172.21.15.73:0/2411233977 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b00005440 con 0x7f6b08195520 2023-08-10T11:55:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.816+0000 7f6b0cf3c700 1 -- 172.21.15.73:0/2411233977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b081a2a40 con 0x7f6b08195520 2023-08-10T11:55:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.818+0000 7f6af77fe700 1 -- 172.21.15.73:0/2411233977 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f6b0000c980 con 0x7f6b08195520 2023-08-10T11:55:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.819+0000 7f6af77fe700 1 --2- 172.21.15.73:0/2411233977 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f6af00a12c0 0x7f6af00a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.819+0000 7f6b0659c700 1 --2- 172.21.15.73:0/2411233977 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f6af00a12c0 0x7f6af00a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.819+0000 7f6af77fe700 1 -- 172.21.15.73:0/2411233977 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f6b000cc2b0 con 0x7f6b08195520 2023-08-10T11:55:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.820+0000 7f6b0659c700 1 --2- 172.21.15.73:0/2411233977 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f6af00a12c0 0x7f6af00a3780 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6afc006010 tx=0x7f6afc005c20 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.820+0000 7f6b190d5b80 1 Processor -- start 2023-08-10T11:55:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.820+0000 7f6b190d5b80 1 -- start start 2023-08-10T11:55:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.821+0000 7f6b190d5b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561079df2a40 0x561079df2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.821+0000 7f6b190d5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561079df3360 0x561079ded010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.821+0000 7f6b190d5b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079ded550 0x561079ded9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.821+0000 7f6b190d5b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561079d68d60 con 0x561079ded550 2023-08-10T11:55:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.821+0000 7f6b190d5b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561079d45530 con 0x561079df2a40 2023-08-10T11:55:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.821+0000 7f6b190d5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561079d42e50 con 0x561079df3360 2023-08-10T11:55:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.821+0000 7f6b0659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561079df2a40 0x561079df2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.821+0000 7f6b06d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079ded550 0x561079ded9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.821+0000 7f6b0659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561079df2a40 0x561079df2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49154/0 (socket says 172.21.15.73:49154) 2023-08-10T11:55:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.821+0000 7f6b06d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079ded550 0x561079ded9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34508/0 (socket says 172.21.15.73:34508) 2023-08-10T11:55:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.821+0000 7f6b0659c700 1 -- 172.21.15.73:0/3663844090 learned_addr learned my addr 172.21.15.73:0/3663844090 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.821+0000 7f6b05d9b700 1 --2- 172.21.15.73:0/3663844090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561079df3360 0x561079ded010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.821+0000 7f6b06d9d700 1 -- 172.21.15.73:0/3663844090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561079df3360 msgr2=0x561079ded010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.821+0000 7f6b06d9d700 1 --2- 172.21.15.73:0/3663844090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561079df3360 0x561079ded010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.821+0000 7f6b06d9d700 1 -- 172.21.15.73:0/3663844090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561079df2a40 msgr2=0x561079df2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.821+0000 7f6b06d9d700 1 --2- 172.21.15.73:0/3663844090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561079df2a40 0x561079df2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.821+0000 7f6b06d9d700 1 -- 172.21.15.73:0/3663844090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561079bbf5d0 con 0x561079ded550 2023-08-10T11:55:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.821+0000 7f6b05d9b700 1 --2- 172.21.15.73:0/3663844090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561079df3360 0x561079ded010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:55:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.821+0000 7f6b06d9d700 1 --2- 172.21.15.73:0/3663844090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079ded550 0x561079ded9d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6b000c9a30 tx=0x7f6b00099310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5272143835882bb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.821+0000 7f6af4ff9700 1 -- 172.21.15.73:0/3663844090 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b00099440 con 0x561079ded550 2023-08-10T11:55:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.821+0000 7f6af4ff9700 1 -- 172.21.15.73:0/3663844090 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b0009d470 con 0x561079ded550 2023-08-10T11:55:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.821+0000 7f6af4ff9700 1 -- 172.21.15.73:0/3663844090 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0009d120 con 0x561079ded550 2023-08-10T11:55:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.822+0000 7f6b190d5b80 1 -- 172.21.15.73:0/3663844090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079ded550 msgr2=0x561079ded9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.822+0000 7f6b190d5b80 1 --2- 172.21.15.73:0/3663844090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079ded550 0x561079ded9d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6b000c9a30 tx=0x7f6b00099310 comp rx=0 tx=0).stop 2023-08-10T11:55:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.822+0000 7f6b190d5b80 1 -- 172.21.15.73:0/3663844090 shutdown_connections 2023-08-10T11:55:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.822+0000 7f6b190d5b80 1 --2- 172.21.15.73:0/3663844090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561079df2a40 0x561079df2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.822+0000 7f6b190d5b80 1 --2- 172.21.15.73:0/3663844090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079ded550 0x561079ded9d0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.822+0000 7f6b190d5b80 1 --2- 172.21.15.73:0/3663844090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561079df3360 0x561079ded010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.822+0000 7f6b190d5b80 1 -- 172.21.15.73:0/3663844090 >> 172.21.15.73:0/3663844090 conn(0x561079d4ac70 msgr2=0x561079de7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.822+0000 7f6b190d5b80 1 -- 172.21.15.73:0/3663844090 shutdown_connections 2023-08-10T11:55:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.822+0000 7f6b190d5b80 1 -- 172.21.15.73:0/3663844090 wait complete. 2023-08-10T11:55:07.838 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.822+0000 7f6b190d5b80 1 -- start start 2023-08-10T11:55:07.838 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.823+0000 7f6b190d5b80 1 Processor -- start 2023-08-10T11:55:07.838 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.823+0000 7f6b190d5b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079ded550 0x561079df6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:07.838 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.823+0000 7f6b190d5b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561079df2a40 0x561079df6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:07.838 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.823+0000 7f6b190d5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561079df3360 0x561079df7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:07.838 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.823+0000 7f6b190d5b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561079d3e740 con 0x561079ded550 2023-08-10T11:55:07.838 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.823+0000 7f6b190d5b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561079cdda60 con 0x561079df2a40 2023-08-10T11:55:07.838 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.823+0000 7f6b190d5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561079cdd760 con 0x561079df3360 2023-08-10T11:55:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.823+0000 7f6b190d5b80 10 client.0 _ll_register_callbacks cb 0x561079cdb620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:55:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.823+0000 7f6b0659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079ded550 0x561079df6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.823+0000 7f6b0659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079ded550 0x561079df6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34510/0 (socket says 172.21.15.73:34510) 2023-08-10T11:55:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.823+0000 7f6b0659c700 1 -- 172.21.15.73:0/3785452075 learned_addr learned my addr 172.21.15.73:0/3785452075 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.823+0000 7f6b05d9b700 1 --2- 172.21.15.73:0/3785452075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561079df2a40 0x561079df6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.823+0000 7f6b06d9d700 1 --2- 172.21.15.73:0/3785452075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561079df3360 0x561079df7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.823+0000 7f6b0659c700 1 -- 172.21.15.73:0/3785452075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561079df3360 msgr2=0x561079df7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.823+0000 7f6b0659c700 1 --2- 172.21.15.73:0/3785452075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561079df3360 0x561079df7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.823+0000 7f6b0659c700 1 -- 172.21.15.73:0/3785452075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561079df2a40 msgr2=0x561079df6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.823+0000 7f6b0659c700 1 --2- 172.21.15.73:0/3785452075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561079df2a40 0x561079df6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.823+0000 7f6b0659c700 1 -- 172.21.15.73:0/3785452075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b081a2a40 con 0x561079ded550 2023-08-10T11:55:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.823+0000 7f6b0659c700 1 --2- 172.21.15.73:0/3785452075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079ded550 0x561079df6680 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f6afc0036c0 tx=0x7f6afc009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341f253a810e6b2c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.823+0000 7f6aedffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:55:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.823+0000 7f6aedffb700 1 -- 172.21.15.73:0/3785452075 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc02e040 con 0x561079ded550 2023-08-10T11:55:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.824+0000 7f6aedffb700 1 -- 172.21.15.73:0/3785452075 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f6afc00f840 con 0x561079ded550 2023-08-10T11:55:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.824+0000 7f6b190d5b80 1 -- 172.21.15.73:0/3785452075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561079de01c0 con 0x561079ded550 2023-08-10T11:55:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.824+0000 7f6aedffb700 1 -- 172.21.15.73:0/3785452075 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6afc01d040 con 0x561079ded550 2023-08-10T11:55:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.824+0000 7f6b190d5b80 10 client.16212 fetch_fsmap learned FSMap version 32 2023-08-10T11:55:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.824+0000 7f6b190d5b80 1 -- 172.21.15.73:0/3785452075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x561079b6bd80 con 0x561079ded550 2023-08-10T11:55:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.824+0000 7f6aedffb700 1 -- 172.21.15.73:0/3785452075 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6afc041020 con 0x561079ded550 2023-08-10T11:55:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.824+0000 7f6aedffb700 1 -- 172.21.15.73:0/3785452075 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 32) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f6afc03db50 con 0x561079ded550 2023-08-10T11:55:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.824+0000 7f6b190d5b80 10 client.16212 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T11:55:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.824+0000 7f6b190d5b80 10 client.16212 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:55:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.824+0000 7f6b190d5b80 20 client.16212 populate_metadata read hostname 'smithi073' 2023-08-10T11:55:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.824+0000 7f6b190d5b80 1 --2- 172.21.15.73:0/3785452075 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561079e06ed0 0x561079e092f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.824+0000 7f6b190d5b80 4 client.16212 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:55:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.824+0000 7f6b190d5b80 1 -- 172.21.15.73:0/3785452075 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561079dbc970 con 0x561079e06ed0 2023-08-10T11:55:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.824+0000 7f6b05d9b700 1 --2- 172.21.15.73:0/3785452075 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561079e06ed0 0x561079e092f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.825+0000 7f6aedffb700 10 client.16212 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:55:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.825+0000 7f6b05d9b700 1 --2- 172.21.15.73:0/3785452075 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561079e06ed0 0x561079e092f0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7c2c717ca319e9f server_cookie=d9c7f635c6ce3d7d in_seq=0 out_seq=0 2023-08-10T11:55:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.825+0000 7f6aedffb700 1 -- 172.21.15.73:0/3785452075 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x561079dbc970 con 0x561079e06ed0 2023-08-10T11:55:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.825+0000 7f6aedffb700 10 client.16212 handle_command_reply: tid=0 2023-08-10T11:55:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.825+0000 7f6b190d5b80 1 client.16212 shutdown 2023-08-10T11:55:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.825+0000 7f6b190d5b80 1 -- 172.21.15.73:0/3785452075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079ded550 msgr2=0x561079df6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.825+0000 7f6b190d5b80 1 --2- 172.21.15.73:0/3785452075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079ded550 0x561079df6680 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f6afc0036c0 tx=0x7f6afc009cd0 comp rx=0 tx=0).stop 2023-08-10T11:55:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.825+0000 7f6b190d5b80 1 -- 172.21.15.73:0/3785452075 shutdown_connections 2023-08-10T11:55:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.825+0000 7f6b190d5b80 1 --2- 172.21.15.73:0/3785452075 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561079e06ed0 0x561079e092f0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.825+0000 7f6b190d5b80 1 --2- 172.21.15.73:0/3785452075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561079df3360 0x561079df7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:07.846 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.825+0000 7f6b190d5b80 1 --2- 172.21.15.73:0/3785452075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079ded550 0x561079df6680 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:07.846 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.825+0000 7f6aedffb700 0 client.16212 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:55:07.846 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.825+0000 7f6b190d5b80 1 --2- 172.21.15.73:0/3785452075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561079df2a40 0x561079df6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:07.846 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.825+0000 7f6b190d5b80 1 -- 172.21.15.73:0/3785452075 >> 172.21.15.73:0/3785452075 conn(0x561079d4ac70 msgr2=0x561079de74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.825+0000 7f6b190d5b80 1 -- 172.21.15.73:0/3785452075 shutdown_connections 2023-08-10T11:55:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.825+0000 7f6b190d5b80 1 -- 172.21.15.73:0/3785452075 wait complete. 2023-08-10T11:55:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.826+0000 7f6b190d5b80 20 client.16212 trim_cache size 0 max 16384 2023-08-10T11:55:07.852 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.840+0000 7f6b190d5b80 1 Processor -- start 2023-08-10T11:55:07.852 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.840+0000 7f6b190d5b80 1 -- start start 2023-08-10T11:55:07.852 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.840+0000 7f6b190d5b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079ded550 0x561079ded010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:07.852 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.840+0000 7f6b190d5b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561079df2a40 0x561079dfde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:07.853 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.840+0000 7f6b190d5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561079df3360 0x561079de7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:07.853 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.840+0000 7f6b190d5b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561079bc18c0 con 0x561079ded550 2023-08-10T11:55:07.853 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.840+0000 7f6b190d5b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561079de8c10 con 0x561079df2a40 2023-08-10T11:55:07.853 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.840+0000 7f6b190d5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561079de89b0 con 0x561079df3360 2023-08-10T11:55:07.853 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.840+0000 7f6b0659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079ded550 0x561079ded010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:07.854 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.840+0000 7f6b0659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079ded550 0x561079ded010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34518/0 (socket says 172.21.15.73:34518) 2023-08-10T11:55:07.854 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.840+0000 7f6b0659c700 1 -- 172.21.15.73:0/3210476956 learned_addr learned my addr 172.21.15.73:0/3210476956 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:07.854 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.840+0000 7f6b05d9b700 1 --2- 172.21.15.73:0/3210476956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561079df2a40 0x561079dfde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:07.854 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.840+0000 7f6b06d9d700 1 --2- 172.21.15.73:0/3210476956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561079df3360 0x561079de7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:07.854 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.840+0000 7f6b0659c700 1 -- 172.21.15.73:0/3210476956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561079df3360 msgr2=0x561079de7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:07.854 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.840+0000 7f6b0659c700 1 --2- 172.21.15.73:0/3210476956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561079df3360 0x561079de7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:07.854 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.840+0000 7f6b0659c700 1 -- 172.21.15.73:0/3210476956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561079df2a40 msgr2=0x561079dfde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:07.855 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.840+0000 7f6b0659c700 1 --2- 172.21.15.73:0/3210476956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561079df2a40 0x561079dfde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:07.855 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.841+0000 7f6b0659c700 1 -- 172.21.15.73:0/3210476956 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561079b54c00 con 0x561079ded550 2023-08-10T11:55:07.855 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.841+0000 7f6b06d9d700 1 --2- 172.21.15.73:0/3210476956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561079df3360 0x561079de7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:55:07.855 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.841+0000 7f6b0659c700 1 --2- 172.21.15.73:0/3210476956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079ded550 0x561079ded010 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f6afc005f50 tx=0x7f6afc005960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd1b951b077579a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:07.855 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.841+0000 7f6af57fa700 1 -- 172.21.15.73:0/3210476956 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc02e070 con 0x561079ded550 2023-08-10T11:55:07.855 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.841+0000 7f6af57fa700 1 -- 172.21.15.73:0/3210476956 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6afc041070 con 0x561079ded550 2023-08-10T11:55:07.855 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.841+0000 7f6af57fa700 1 -- 172.21.15.73:0/3210476956 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc01d040 con 0x561079ded550 2023-08-10T11:55:07.855 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.841+0000 7f6b190d5b80 1 -- 172.21.15.73:0/3210476956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079ded550 msgr2=0x561079ded010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:07.856 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.841+0000 7f6b190d5b80 1 --2- 172.21.15.73:0/3210476956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079ded550 0x561079ded010 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f6afc005f50 tx=0x7f6afc005960 comp rx=0 tx=0).stop 2023-08-10T11:55:07.856 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.841+0000 7f6b190d5b80 1 -- 172.21.15.73:0/3210476956 shutdown_connections 2023-08-10T11:55:07.856 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.841+0000 7f6b190d5b80 1 --2- 172.21.15.73:0/3210476956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561079df3360 0x561079de7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:07.856 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.841+0000 7f6b190d5b80 1 --2- 172.21.15.73:0/3210476956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079ded550 0x561079ded010 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:07.856 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.841+0000 7f6b190d5b80 1 --2- 172.21.15.73:0/3210476956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561079df2a40 0x561079dfde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:07.856 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.841+0000 7f6b190d5b80 1 -- 172.21.15.73:0/3210476956 >> 172.21.15.73:0/3210476956 conn(0x561079d4ac70 msgr2=0x561079df6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:07.856 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.841+0000 7f6b190d5b80 1 -- 172.21.15.73:0/3210476956 shutdown_connections 2023-08-10T11:55:07.857 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.841+0000 7f6b190d5b80 1 -- 172.21.15.73:0/3210476956 wait complete. 2023-08-10T11:55:07.857 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.842+0000 7f6b190d5b80 1 -- start start 2023-08-10T11:55:07.857 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.842+0000 7f6b190d5b80 1 Processor -- start 2023-08-10T11:55:07.857 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.842+0000 7f6b190d5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561079ded550 0x561079e4ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:07.857 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.842+0000 7f6b190d5b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561079df2a40 0x561079e4f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:07.857 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.842+0000 7f6b190d5b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079df3360 0x561079e59b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:07.857 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.842+0000 7f6b190d5b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561079e5a0d0 con 0x561079df3360 2023-08-10T11:55:07.857 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.842+0000 7f6b190d5b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561079e5a210 con 0x561079df2a40 2023-08-10T11:55:07.858 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.842+0000 7f6b190d5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561079e5a350 con 0x561079ded550 2023-08-10T11:55:07.858 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.842+0000 7f6b190d5b80 10 client.0 _ll_register_callbacks cb 0x561079cdb620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:55:07.858 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.842+0000 7f6b06d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079df3360 0x561079e59b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:07.858 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.842+0000 7f6b06d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079df3360 0x561079e59b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34528/0 (socket says 172.21.15.73:34528) 2023-08-10T11:55:07.858 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.842+0000 7f6b06d9d700 1 -- 172.21.15.73:0/3636263069 learned_addr learned my addr 172.21.15.73:0/3636263069 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:07.858 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.842+0000 7f6b05d9b700 1 --2- 172.21.15.73:0/3636263069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561079df2a40 0x561079e4f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:07.858 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.842+0000 7f6b0659c700 1 --2- 172.21.15.73:0/3636263069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561079ded550 0x561079e4ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:07.859 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.843+0000 7f6b06d9d700 1 -- 172.21.15.73:0/3636263069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561079ded550 msgr2=0x561079e4ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:07.859 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.843+0000 7f6b06d9d700 1 --2- 172.21.15.73:0/3636263069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561079ded550 0x561079e4ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:07.859 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.843+0000 7f6b06d9d700 1 -- 172.21.15.73:0/3636263069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561079df2a40 msgr2=0x561079e4f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:07.859 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.843+0000 7f6b06d9d700 1 --2- 172.21.15.73:0/3636263069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561079df2a40 0x561079e4f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:07.859 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.843+0000 7f6b06d9d700 1 -- 172.21.15.73:0/3636263069 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561079b6bd80 con 0x561079df3360 2023-08-10T11:55:07.859 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.843+0000 7f6b06d9d700 1 --2- 172.21.15.73:0/3636263069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079df3360 0x561079e59b90 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f6b000c9a90 tx=0x7f6b0000a1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811860e7caa4c961 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:07.859 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.843+0000 7f6aedffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:55:07.859 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.843+0000 7f6aedffb700 1 -- 172.21.15.73:0/3636263069 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b000b5070 con 0x561079df3360 2023-08-10T11:55:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.843+0000 7f6aedffb700 1 -- 172.21.15.73:0/3636263069 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f6b00099440 con 0x561079df3360 2023-08-10T11:55:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.843+0000 7f6b190d5b80 1 -- 172.21.15.73:0/3636263069 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6b0009d470 con 0x561079df3360 2023-08-10T11:55:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.843+0000 7f6aedffb700 1 -- 172.21.15.73:0/3636263069 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b000a1800 con 0x561079df3360 2023-08-10T11:55:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.843+0000 7f6b190d5b80 10 client.16218 fetch_fsmap learned FSMap version 32 2023-08-10T11:55:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.843+0000 7f6b190d5b80 1 -- 172.21.15.73:0/3636263069 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x561079b921f0 con 0x561079df3360 2023-08-10T11:55:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.843+0000 7f6aedffb700 1 -- 172.21.15.73:0/3636263069 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b000c9020 con 0x561079df3360 2023-08-10T11:55:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.843+0000 7f6aedffb700 1 -- 172.21.15.73:0/3636263069 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 32) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f6b00060020 con 0x561079df3360 2023-08-10T11:55:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.843+0000 7f6b190d5b80 10 client.16218 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T11:55:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.843+0000 7f6b190d5b80 10 client.16218 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:55:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.843+0000 7f6b190d5b80 20 client.16218 populate_metadata read hostname 'smithi073' 2023-08-10T11:55:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.843+0000 7f6b190d5b80 1 --2- 172.21.15.73:0/3636263069 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561079e5b630 0x561079e5da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.843+0000 7f6b190d5b80 4 client.16218 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:55:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.843+0000 7f6b190d5b80 1 -- 172.21.15.73:0/3636263069 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561079d37720 con 0x561079e5b630 2023-08-10T11:55:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.844+0000 7f6b0659c700 1 --2- 172.21.15.73:0/3636263069 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561079e5b630 0x561079e5da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.844+0000 7f6b0659c700 1 --2- 172.21.15.73:0/3636263069 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561079e5b630 0x561079e5da50 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4012011dbc0688 server_cookie=66b250286e9196cb in_seq=0 out_seq=0 2023-08-10T11:55:07.862 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:07.844+0000 7f6aedffb700 10 client.16218 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:55:08.091 INFO:tasks.workunit.client.0.smithi073.stdout: 108 430444 980 267694 976 110154 976 2023-08-10T11:55:08.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:08 smithi152 ceph-mon[130220]: pgmap v78: 97 pgs: 97 active+clean; 301 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 1.9 MiB/s wr, 163 op/s 2023-08-10T11:55:09.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:08 smithi156 ceph-mon[130574]: pgmap v78: 97 pgs: 97 active+clean; 301 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 1.9 MiB/s wr, 163 op/s 2023-08-10T11:55:09.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:08 smithi073 ceph-mon[128869]: pgmap v78: 97 pgs: 97 active+clean; 301 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 1.9 MiB/s wr, 163 op/s 2023-08-10T11:55:09.750 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:55:09.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.882+0000 7f00d56d2700 1 -- 172.21.15.73:0/703262479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00d00ff5d0 msgr2=0x7f00d00ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:09.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.882+0000 7f00d56d2700 1 --2- 172.21.15.73:0/703262479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00d00ff5d0 0x7f00d00ffa50 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f00c00099c0 tx=0x7f00c0009cd0 comp rx=0 tx=0).stop 2023-08-10T11:55:09.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.882+0000 7f00d56d2700 1 -- 172.21.15.73:0/703262479 shutdown_connections 2023-08-10T11:55:09.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.882+0000 7f00d56d2700 1 --2- 172.21.15.73:0/703262479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00d00fff90 0x7f00d010c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:09.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.882+0000 7f00d56d2700 1 --2- 172.21.15.73:0/703262479 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00d0105690 0x7f00d0105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:09.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.882+0000 7f00d56d2700 1 --2- 172.21.15.73:0/703262479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00d00ff5d0 0x7f00d00ffa50 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:09.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.882+0000 7f00d56d2700 1 -- 172.21.15.73:0/703262479 >> 172.21.15.73:0/703262479 conn(0x7f00d00fb0c0 msgr2=0x7f00d00fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:09.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.882+0000 7f00d56d2700 1 -- 172.21.15.73:0/703262479 shutdown_connections 2023-08-10T11:55:09.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.882+0000 7f00d56d2700 1 -- 172.21.15.73:0/703262479 wait complete. 2023-08-10T11:55:09.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.882+0000 7f00d56d2700 1 Processor -- start 2023-08-10T11:55:09.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.882+0000 7f00d56d2700 1 -- start start 2023-08-10T11:55:09.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.883+0000 7f00d56d2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00d00ff5d0 0x7f00d01956a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:09.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.883+0000 7f00d56d2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00d00fff90 0x7f00d0195be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:09.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.883+0000 7f00d56d2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00d0105690 0x7f00d0198f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:09.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.883+0000 7f00d56d2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0199590 con 0x7f00d0105690 2023-08-10T11:55:09.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.883+0000 7f00d56d2700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0199700 con 0x7f00d00fff90 2023-08-10T11:55:09.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.883+0000 7f00d56d2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d01998c0 con 0x7f00d00ff5d0 2023-08-10T11:55:09.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.883+0000 7f00cf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00d0105690 0x7f00d0198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:09.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.883+0000 7f00cf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00d0105690 0x7f00d0198f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34544/0 (socket says 172.21.15.73:34544) 2023-08-10T11:55:09.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.883+0000 7f00cf7fe700 1 -- 172.21.15.73:0/3551341708 learned_addr learned my addr 172.21.15.73:0/3551341708 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:09.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.883+0000 7f00ceffd700 1 --2- 172.21.15.73:0/3551341708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00d00ff5d0 0x7f00d01956a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:09.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.883+0000 7f00ce7fc700 1 --2- 172.21.15.73:0/3551341708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00d00fff90 0x7f00d0195be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:09.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.883+0000 7f00cf7fe700 1 -- 172.21.15.73:0/3551341708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00d00ff5d0 msgr2=0x7f00d01956a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:09.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.883+0000 7f00cf7fe700 1 --2- 172.21.15.73:0/3551341708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00d00ff5d0 0x7f00d01956a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:09.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.883+0000 7f00cf7fe700 1 -- 172.21.15.73:0/3551341708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00d00fff90 msgr2=0x7f00d0195be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:09.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.883+0000 7f00cf7fe700 1 --2- 172.21.15.73:0/3551341708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00d00fff90 0x7f00d0195be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:09.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.883+0000 7f00cf7fe700 1 -- 172.21.15.73:0/3551341708 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c00095f0 con 0x7f00d0105690 2023-08-10T11:55:09.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.883+0000 7f00ce7fc700 1 --2- 172.21.15.73:0/3551341708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00d00fff90 0x7f00d0195be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:55:09.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.883+0000 7f00cf7fe700 1 --2- 172.21.15.73:0/3551341708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00d0105690 0x7f00d0198f90 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f00c800b970 tx=0x7f00c800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:09.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.883+0000 7f00b7fff700 1 -- 172.21.15.73:0/3551341708 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c800c930 con 0x7f00d0105690 2023-08-10T11:55:09.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.883+0000 7f00d56d2700 1 -- 172.21.15.73:0/3551341708 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d0199ba0 con 0x7f00d0105690 2023-08-10T11:55:09.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.883+0000 7f00b7fff700 1 -- 172.21.15.73:0/3551341708 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f00c8014440 con 0x7f00d0105690 2023-08-10T11:55:09.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.883+0000 7f00b7fff700 1 -- 172.21.15.73:0/3551341708 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c80075d0 con 0x7f00d0105690 2023-08-10T11:55:09.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.883+0000 7f00d56d2700 1 -- 172.21.15.73:0/3551341708 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d01a2500 con 0x7f00d0105690 2023-08-10T11:55:09.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.886+0000 7f00b7fff700 1 -- 172.21.15.73:0/3551341708 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f00c80145b0 con 0x7f00d0105690 2023-08-10T11:55:09.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.886+0000 7f00b7fff700 1 --2- 172.21.15.73:0/3551341708 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f00b80a12c0 0x7f00b80a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:09.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.886+0000 7f00ceffd700 1 --2- 172.21.15.73:0/3551341708 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f00b80a12c0 0x7f00b80a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:09.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.887+0000 7f00b7fff700 1 -- 172.21.15.73:0/3551341708 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f00c8006e40 con 0x7f00d0105690 2023-08-10T11:55:09.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.887+0000 7f00ceffd700 1 --2- 172.21.15.73:0/3551341708 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f00b80a12c0 0x7f00b80a3780 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f00c4005950 tx=0x7f00c400b410 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:09.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.887+0000 7f00e186bb80 1 Processor -- start 2023-08-10T11:55:09.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.887+0000 7f00e186bb80 1 -- start start 2023-08-10T11:55:09.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.887+0000 7f00e186bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622a5ec1040 0x5622a5ebf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:09.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.887+0000 7f00e186bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622a5ebf800 0x5622a5ebfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:09.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.887+0000 7f00e186bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ecd940 0x5622a5ecfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:09.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.887+0000 7f00e186bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622a5e3adc0 con 0x5622a5ecd940 2023-08-10T11:55:09.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.887+0000 7f00e186bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622a5e17590 con 0x5622a5ec1040 2023-08-10T11:55:09.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.887+0000 7f00e186bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622a5e14eb0 con 0x5622a5ebf800 2023-08-10T11:55:09.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.888+0000 7f00cf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ecd940 0x5622a5ecfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:09.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.888+0000 7f00cf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ecd940 0x5622a5ecfd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34552/0 (socket says 172.21.15.73:34552) 2023-08-10T11:55:09.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.888+0000 7f00cf7fe700 1 -- 172.21.15.73:0/1585990213 learned_addr learned my addr 172.21.15.73:0/1585990213 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:09.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.888+0000 7f00ce7fc700 1 --2- 172.21.15.73:0/1585990213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622a5ebf800 0x5622a5ebfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:09.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.888+0000 7f00ceffd700 1 --2- 172.21.15.73:0/1585990213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622a5ec1040 0x5622a5ebf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:09.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.888+0000 7f00cf7fe700 1 -- 172.21.15.73:0/1585990213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622a5ebf800 msgr2=0x5622a5ebfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:09.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.888+0000 7f00cf7fe700 1 --2- 172.21.15.73:0/1585990213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622a5ebf800 0x5622a5ebfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:09.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.888+0000 7f00cf7fe700 1 -- 172.21.15.73:0/1585990213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622a5ec1040 msgr2=0x5622a5ebf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:09.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.888+0000 7f00cf7fe700 1 --2- 172.21.15.73:0/1585990213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622a5ec1040 0x5622a5ebf2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:09.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.888+0000 7f00cf7fe700 1 -- 172.21.15.73:0/1585990213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622a5c91630 con 0x5622a5ecd940 2023-08-10T11:55:09.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.888+0000 7f00cf7fe700 1 --2- 172.21.15.73:0/1585990213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ecd940 0x5622a5ecfd30 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f00c8095990 tx=0x7f00c8098df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3ecf79245393a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:09.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.888+0000 7f00b57fa700 1 -- 172.21.15.73:0/1585990213 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c80a18e0 con 0x5622a5ecd940 2023-08-10T11:55:09.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.888+0000 7f00b57fa700 1 -- 172.21.15.73:0/1585990213 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f00c8097830 con 0x5622a5ecd940 2023-08-10T11:55:09.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.888+0000 7f00b57fa700 1 -- 172.21.15.73:0/1585990213 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c8099950 con 0x5622a5ecd940 2023-08-10T11:55:09.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.889+0000 7f00e186bb80 1 -- 172.21.15.73:0/1585990213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ecd940 msgr2=0x5622a5ecfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:09.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.889+0000 7f00e186bb80 1 --2- 172.21.15.73:0/1585990213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ecd940 0x5622a5ecfd30 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f00c8095990 tx=0x7f00c8098df0 comp rx=0 tx=0).stop 2023-08-10T11:55:09.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.889+0000 7f00e186bb80 1 -- 172.21.15.73:0/1585990213 shutdown_connections 2023-08-10T11:55:09.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.889+0000 7f00e186bb80 1 --2- 172.21.15.73:0/1585990213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622a5ec1040 0x5622a5ebf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:09.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.889+0000 7f00e186bb80 1 --2- 172.21.15.73:0/1585990213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ecd940 0x5622a5ecfd30 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:09.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.889+0000 7f00e186bb80 1 --2- 172.21.15.73:0/1585990213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622a5ebf800 0x5622a5ebfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:09.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.889+0000 7f00e186bb80 1 -- 172.21.15.73:0/1585990213 >> 172.21.15.73:0/1585990213 conn(0x5622a5e1ccd0 msgr2=0x5622a5eba4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:09.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.889+0000 7f00e186bb80 1 -- 172.21.15.73:0/1585990213 shutdown_connections 2023-08-10T11:55:09.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.889+0000 7f00e186bb80 1 -- 172.21.15.73:0/1585990213 wait complete. 2023-08-10T11:55:09.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.889+0000 7f00e186bb80 1 -- start start 2023-08-10T11:55:09.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.889+0000 7f00e186bb80 1 Processor -- start 2023-08-10T11:55:09.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.890+0000 7f00e186bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622a5ebf800 0x5622a5eca650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:09.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.890+0000 7f00e186bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622a5ec1040 0x5622a5ecab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:09.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.890+0000 7f00e186bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ecd940 0x5622a5ecb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:09.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.890+0000 7f00e186bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622a5e107a0 con 0x5622a5ecd940 2023-08-10T11:55:09.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.890+0000 7f00e186bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622a5dafac0 con 0x5622a5ebf800 2023-08-10T11:55:09.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.890+0000 7f00e186bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622a5daf7c0 con 0x5622a5ec1040 2023-08-10T11:55:09.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.890+0000 7f00e186bb80 10 client.0 _ll_register_callbacks cb 0x5622a5dad680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:55:09.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.890+0000 7f00cf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ecd940 0x5622a5ecb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:09.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.890+0000 7f00cf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ecd940 0x5622a5ecb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34558/0 (socket says 172.21.15.73:34558) 2023-08-10T11:55:09.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.890+0000 7f00cf7fe700 1 -- 172.21.15.73:0/3393831257 learned_addr learned my addr 172.21.15.73:0/3393831257 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:09.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.890+0000 7f00ce7fc700 1 --2- 172.21.15.73:0/3393831257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622a5ec1040 0x5622a5ecab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:09.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.890+0000 7f00ceffd700 1 --2- 172.21.15.73:0/3393831257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622a5ebf800 0x5622a5eca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:09.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.890+0000 7f00cf7fe700 1 -- 172.21.15.73:0/3393831257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622a5ec1040 msgr2=0x5622a5ecab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:09.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.890+0000 7f00cf7fe700 1 --2- 172.21.15.73:0/3393831257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622a5ec1040 0x5622a5ecab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:09.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.890+0000 7f00cf7fe700 1 -- 172.21.15.73:0/3393831257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622a5ebf800 msgr2=0x5622a5eca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:09.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.890+0000 7f00cf7fe700 1 --2- 172.21.15.73:0/3393831257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622a5ebf800 0x5622a5eca650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:09.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.890+0000 7f00cf7fe700 1 -- 172.21.15.73:0/3393831257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d01a2500 con 0x5622a5ecd940 2023-08-10T11:55:09.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.890+0000 7f00ceffd700 1 --2- 172.21.15.73:0/3393831257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622a5ebf800 0x5622a5eca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:55:09.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.890+0000 7f00cf7fe700 1 --2- 172.21.15.73:0/3393831257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ecd940 0x5622a5ecb0d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f00c8095210 tx=0x7f00c8014b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4414098ceeaef48a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:09.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.890+0000 7f00b2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:55:09.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.890+0000 7f00b2ff5700 1 -- 172.21.15.73:0/3393831257 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c80b5070 con 0x5622a5ecd940 2023-08-10T11:55:09.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.890+0000 7f00b2ff5700 1 -- 172.21.15.73:0/3393831257 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f00c80ae070 con 0x5622a5ecd940 2023-08-10T11:55:09.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.890+0000 7f00e186bb80 1 -- 172.21.15.73:0/3393831257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5622a5eb2470 con 0x5622a5ecd940 2023-08-10T11:55:09.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.890+0000 7f00b2ff5700 1 -- 172.21.15.73:0/3393831257 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00c8084140 con 0x5622a5ecd940 2023-08-10T11:55:09.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.890+0000 7f00e186bb80 10 client.16230 fetch_fsmap learned FSMap version 32 2023-08-10T11:55:09.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.890+0000 7f00e186bb80 1 -- 172.21.15.73:0/3393831257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5622a5c3dde0 con 0x5622a5ecd940 2023-08-10T11:55:09.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.891+0000 7f00b2ff5700 1 -- 172.21.15.73:0/3393831257 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5622a5eb2470 con 0x5622a5ecd940 2023-08-10T11:55:09.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.891+0000 7f00b2ff5700 1 -- 172.21.15.73:0/3393831257 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 32) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f00c8095280 con 0x5622a5ecd940 2023-08-10T11:55:09.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.891+0000 7f00e186bb80 10 client.16230 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T11:55:09.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.891+0000 7f00e186bb80 10 client.16230 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:55:09.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.891+0000 7f00e186bb80 20 client.16230 populate_metadata read hostname 'smithi073' 2023-08-10T11:55:09.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.891+0000 7f00e186bb80 1 --2- 172.21.15.73:0/3393831257 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5622a5edd280 0x5622a5edf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:09.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.891+0000 7f00e186bb80 4 client.16230 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:55:09.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.891+0000 7f00e186bb80 1 -- 172.21.15.73:0/3393831257 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5622a5e8e9d0 con 0x5622a5edd280 2023-08-10T11:55:09.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.891+0000 7f00ceffd700 1 --2- 172.21.15.73:0/3393831257 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5622a5edd280 0x5622a5edf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:09.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.892+0000 7f00b2ff5700 10 client.16230 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:55:09.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:09.892+0000 7f00ceffd700 1 --2- 172.21.15.73:0/3393831257 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5622a5edd280 0x5622a5edf670 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf728cf2153ff93b server_cookie=934bea15ecbd4efe in_seq=0 out_seq=0 2023-08-10T11:55:10.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:10 smithi152 ceph-mon[130220]: pgmap v79: 97 pgs: 97 active+clean; 314 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.2 MiB/s wr, 364 op/s 2023-08-10T11:55:11.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:10 smithi156 ceph-mon[130574]: pgmap v79: 97 pgs: 97 active+clean; 314 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.2 MiB/s wr, 364 op/s 2023-08-10T11:55:11.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:10 smithi073 ceph-mon[128869]: pgmap v79: 97 pgs: 97 active+clean; 314 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.2 MiB/s wr, 364 op/s 2023-08-10T11:55:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f6aedffb700 1 -- 172.21.15.73:0/3636263069 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561079d37720 con 0x561079e5b630 2023-08-10T11:55:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f6aedffb700 10 client.16218 handle_command_reply: tid=0 2023-08-10T11:55:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f6b190d5b80 1 client.16218 shutdown 2023-08-10T11:55:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f6b190d5b80 1 -- 172.21.15.73:0/3636263069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079df3360 msgr2=0x561079e59b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f6b190d5b80 1 --2- 172.21.15.73:0/3636263069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079df3360 0x561079e59b90 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f6b000c9a90 tx=0x7f6b0000a1d0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f6b190d5b80 1 -- 172.21.15.73:0/3636263069 shutdown_connections 2023-08-10T11:55:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f6b190d5b80 1 --2- 172.21.15.73:0/3636263069 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561079e5b630 0x561079e5da50 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f6b190d5b80 1 --2- 172.21.15.73:0/3636263069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561079df3360 0x561079e59b90 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f6aedffb700 0 client.16218 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:55:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f6b190d5b80 1 --2- 172.21.15.73:0/3636263069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561079ded550 0x561079e4ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f6b190d5b80 1 --2- 172.21.15.73:0/3636263069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561079df2a40 0x561079e4f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f6b190d5b80 1 -- 172.21.15.73:0/3636263069 >> 172.21.15.73:0/3636263069 conn(0x561079d4ac70 msgr2=0x561079df1850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:11.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f00b2ff5700 1 -- 172.21.15.73:0/3393831257 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5622a5e8e9d0 con 0x5622a5edd280 2023-08-10T11:55:11.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f00b2ff5700 10 client.16230 handle_command_reply: tid=0 2023-08-10T11:55:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f6b190d5b80 1 -- 172.21.15.73:0/3636263069 shutdown_connections 2023-08-10T11:55:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f6b190d5b80 1 -- 172.21.15.73:0/3636263069 wait complete. 2023-08-10T11:55:11.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f00e186bb80 1 client.16230 shutdown 2023-08-10T11:55:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f6b190d5b80 20 client.16218 trim_cache size 0 max 16384 2023-08-10T11:55:11.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f00e186bb80 1 -- 172.21.15.73:0/3393831257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ecd940 msgr2=0x5622a5ecb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:11.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f00e186bb80 1 --2- 172.21.15.73:0/3393831257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ecd940 0x5622a5ecb0d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f00c8095210 tx=0x7f00c8014b00 comp rx=0 tx=0).stop 2023-08-10T11:55:11.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f00e186bb80 1 -- 172.21.15.73:0/3393831257 shutdown_connections 2023-08-10T11:55:11.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f00e186bb80 1 --2- 172.21.15.73:0/3393831257 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5622a5edd280 0x5622a5edf670 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f00e186bb80 1 --2- 172.21.15.73:0/3393831257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622a5ebf800 0x5622a5eca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f00e186bb80 1 --2- 172.21.15.73:0/3393831257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ecd940 0x5622a5ecb0d0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f00e186bb80 1 --2- 172.21.15.73:0/3393831257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622a5ec1040 0x5622a5ecab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f00e186bb80 1 -- 172.21.15.73:0/3393831257 >> 172.21.15.73:0/3393831257 conn(0x5622a5e1ccd0 msgr2=0x5622a5eb99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:11.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f00b2ff5700 0 client.16230 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:55:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:55:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:55:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:55:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:55:11.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f00e186bb80 1 -- 172.21.15.73:0/3393831257 shutdown_connections 2023-08-10T11:55:11.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f00e186bb80 1 -- 172.21.15.73:0/3393831257 wait complete. 2023-08-10T11:55:11.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f00e186bb80 20 client.16230 trim_cache size 0 max 16384 2023-08-10T11:55:11.464 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f6b0cf3c700 1 -- 172.21.15.73:0/2411233977 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f6af00a12c0 msgr2=0x7f6af00a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:11.464 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f6b0cf3c700 1 --2- 172.21.15.73:0/2411233977 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f6af00a12c0 0x7f6af00a3780 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6afc006010 tx=0x7f6afc005c20 comp rx=0 tx=0).stop 2023-08-10T11:55:11.464 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f6b0cf3c700 1 -- 172.21.15.73:0/2411233977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b08195520 msgr2=0x7f6b081959d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:11.464 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f6b0cf3c700 1 --2- 172.21.15.73:0/2411233977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b08195520 0x7f6b081959d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000ada0 tx=0x7f6b0000c330 comp rx=0 tx=0).stop 2023-08-10T11:55:11.464 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f6b0cf3c700 1 -- 172.21.15.73:0/2411233977 shutdown_connections 2023-08-10T11:55:11.465 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f6b0cf3c700 1 --2- 172.21.15.73:0/2411233977 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f6af00a12c0 0x7f6af00a3780 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.465 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f6b0cf3c700 1 --2- 172.21.15.73:0/2411233977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b080fff90 0x7f6b0819b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.465 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f6b0cf3c700 1 --2- 172.21.15.73:0/2411233977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b08195520 0x7f6b081959d0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.465 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f6b0cf3c700 1 --2- 172.21.15.73:0/2411233977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b08104940 0x7f6b0819bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.465 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f6b0cf3c700 1 -- 172.21.15.73:0/2411233977 >> 172.21.15.73:0/2411233977 conn(0x7f6b08076b40 msgr2=0x7f6b081031b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:11.465 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f6b0cf3c700 1 -- 172.21.15.73:0/2411233977 shutdown_connections 2023-08-10T11:55:11.465 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:11.455+0000 7f6b0cf3c700 1 -- 172.21.15.73:0/2411233977 wait complete. 2023-08-10T11:55:11.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00e186bb80 1 Processor -- start 2023-08-10T11:55:11.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00e186bb80 1 -- start start 2023-08-10T11:55:11.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00e186bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ebf800 0x5622a5ebf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:11.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00e186bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622a5ec1040 0x5622a5ed4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:11.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00e186bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622a5ecd940 0x5622a5eba130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:11.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00e186bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622a5c93920 con 0x5622a5ebf800 2023-08-10T11:55:11.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00e186bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622a5ecfd30 con 0x5622a5ecd940 2023-08-10T11:55:11.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00e186bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622a5ed9540 con 0x5622a5ec1040 2023-08-10T11:55:11.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00ceffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ebf800 0x5622a5ebf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:11.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00ceffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ebf800 0x5622a5ebf2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34562/0 (socket says 172.21.15.73:34562) 2023-08-10T11:55:11.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00ceffd700 1 -- 172.21.15.73:0/2478719378 learned_addr learned my addr 172.21.15.73:0/2478719378 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:11.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00cf7fe700 1 --2- 172.21.15.73:0/2478719378 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622a5ecd940 0x5622a5eba130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:11.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00ce7fc700 1 --2- 172.21.15.73:0/2478719378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622a5ec1040 0x5622a5ed4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:11.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00ceffd700 1 -- 172.21.15.73:0/2478719378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622a5ec1040 msgr2=0x5622a5ed4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:11.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00ceffd700 1 --2- 172.21.15.73:0/2478719378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622a5ec1040 0x5622a5ed4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00ceffd700 1 -- 172.21.15.73:0/2478719378 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622a5ecd940 msgr2=0x5622a5eba130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:11.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00ceffd700 1 --2- 172.21.15.73:0/2478719378 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622a5ecd940 0x5622a5eba130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00ceffd700 1 -- 172.21.15.73:0/2478719378 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622a5c26c60 con 0x5622a5ebf800 2023-08-10T11:55:11.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00ceffd700 1 --2- 172.21.15.73:0/2478719378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ebf800 0x5622a5ebf2c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f00c4010a40 tx=0x7f00c4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cbea1bf5be01efe server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:11.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00b5ffb700 1 -- 172.21.15.73:0/2478719378 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c4023040 con 0x5622a5ebf800 2023-08-10T11:55:11.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00b5ffb700 1 -- 172.21.15.73:0/2478719378 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f00c4015070 con 0x5622a5ebf800 2023-08-10T11:55:11.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00b5ffb700 1 -- 172.21.15.73:0/2478719378 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c401d410 con 0x5622a5ebf800 2023-08-10T11:55:11.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00e186bb80 1 -- 172.21.15.73:0/2478719378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ebf800 msgr2=0x5622a5ebf2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:11.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00e186bb80 1 --2- 172.21.15.73:0/2478719378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ebf800 0x5622a5ebf2c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f00c4010a40 tx=0x7f00c4016000 comp rx=0 tx=0).stop 2023-08-10T11:55:11.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00e186bb80 1 -- 172.21.15.73:0/2478719378 shutdown_connections 2023-08-10T11:55:11.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00e186bb80 1 --2- 172.21.15.73:0/2478719378 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622a5ecd940 0x5622a5eba130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00e186bb80 1 --2- 172.21.15.73:0/2478719378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ebf800 0x5622a5ebf2c0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00e186bb80 1 --2- 172.21.15.73:0/2478719378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622a5ec1040 0x5622a5ed4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.473+0000 7f00e186bb80 1 -- 172.21.15.73:0/2478719378 >> 172.21.15.73:0/2478719378 conn(0x5622a5e1ccd0 msgr2=0x5622a5ed8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:11.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.474+0000 7f00e186bb80 1 -- 172.21.15.73:0/2478719378 shutdown_connections 2023-08-10T11:55:11.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.474+0000 7f00e186bb80 1 -- 172.21.15.73:0/2478719378 wait complete. 2023-08-10T11:55:11.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.474+0000 7f00e186bb80 1 -- start start 2023-08-10T11:55:11.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.474+0000 7f00e186bb80 1 Processor -- start 2023-08-10T11:55:11.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.474+0000 7f00e186bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622a5ebf800 0x5622a5ed3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:11.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.474+0000 7f00e186bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622a5ec1040 0x5622a5ed40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:11.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.474+0000 7f00e186bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ecd940 0x5622a5f2fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:11.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.474+0000 7f00e186bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622a5f30410 con 0x5622a5ecd940 2023-08-10T11:55:11.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.474+0000 7f00e186bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622a5f30550 con 0x5622a5ebf800 2023-08-10T11:55:11.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.474+0000 7f00e186bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622a5f30710 con 0x5622a5ec1040 2023-08-10T11:55:11.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.474+0000 7f00e186bb80 10 client.0 _ll_register_callbacks cb 0x5622a5dad680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:55:11.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.474+0000 7f00cf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ecd940 0x5622a5f2fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:11.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.474+0000 7f00cf7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ecd940 0x5622a5f2fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34572/0 (socket says 172.21.15.73:34572) 2023-08-10T11:55:11.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.474+0000 7f00cf7fe700 1 -- 172.21.15.73:0/2889572095 learned_addr learned my addr 172.21.15.73:0/2889572095 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:11.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.474+0000 7f00ceffd700 1 --2- 172.21.15.73:0/2889572095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622a5ebf800 0x5622a5ed3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:11.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.474+0000 7f00ce7fc700 1 --2- 172.21.15.73:0/2889572095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622a5ec1040 0x5622a5ed40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:11.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.474+0000 7f00cf7fe700 1 -- 172.21.15.73:0/2889572095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622a5ec1040 msgr2=0x5622a5ed40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:11.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.474+0000 7f00cf7fe700 1 --2- 172.21.15.73:0/2889572095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622a5ec1040 0x5622a5ed40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.474+0000 7f00cf7fe700 1 -- 172.21.15.73:0/2889572095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622a5ebf800 msgr2=0x5622a5ed3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:11.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.475+0000 7f00cf7fe700 1 --2- 172.21.15.73:0/2889572095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622a5ebf800 0x5622a5ed3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.475+0000 7f00cf7fe700 1 -- 172.21.15.73:0/2889572095 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c4010eb0 con 0x5622a5ecd940 2023-08-10T11:55:11.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.475+0000 7f00ceffd700 1 --2- 172.21.15.73:0/2889572095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622a5ebf800 0x5622a5ed3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:55:11.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.475+0000 7f00cf7fe700 1 --2- 172.21.15.73:0/2889572095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ecd940 0x5622a5f2fed0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f00c8004c20 tx=0x7f00c8014ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46cf8d88ada120e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:11.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.475+0000 7f00b2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:55:11.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.475+0000 7f00b2ff5700 1 -- 172.21.15.73:0/2889572095 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c80b5070 con 0x5622a5ecd940 2023-08-10T11:55:11.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.475+0000 7f00e186bb80 1 -- 172.21.15.73:0/2889572095 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f00c8097830 con 0x5622a5ecd940 2023-08-10T11:55:11.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.475+0000 7f00b2ff5700 1 -- 172.21.15.73:0/2889572095 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f00c80ae070 con 0x5622a5ecd940 2023-08-10T11:55:11.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.475+0000 7f00b2ff5700 1 -- 172.21.15.73:0/2889572095 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00c80a16d0 con 0x5622a5ecd940 2023-08-10T11:55:11.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.475+0000 7f00e186bb80 10 client.16236 fetch_fsmap learned FSMap version 32 2023-08-10T11:55:11.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.475+0000 7f00e186bb80 1 -- 172.21.15.73:0/2889572095 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5622a5c64250 con 0x5622a5ecd940 2023-08-10T11:55:11.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.475+0000 7f00b2ff5700 1 -- 172.21.15.73:0/2889572095 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f00c8097830 con 0x5622a5ecd940 2023-08-10T11:55:11.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.475+0000 7f00b2ff5700 1 -- 172.21.15.73:0/2889572095 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 32) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f00c8099810 con 0x5622a5ecd940 2023-08-10T11:55:11.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.475+0000 7f00e186bb80 10 client.16236 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T11:55:11.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.475+0000 7f00e186bb80 10 client.16236 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:55:11.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.475+0000 7f00e186bb80 20 client.16236 populate_metadata read hostname 'smithi073' 2023-08-10T11:55:11.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.475+0000 7f00e186bb80 1 --2- 172.21.15.73:0/2889572095 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5622a5f31950 0x5622a5f33d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:11.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.475+0000 7f00e186bb80 4 client.16236 mds_command: new command op to 24503 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:55:11.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.475+0000 7f00e186bb80 1 -- 172.21.15.73:0/2889572095 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5622a5e09780 con 0x5622a5f31950 2023-08-10T11:55:11.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.476+0000 7f00ceffd700 1 --2- 172.21.15.73:0/2889572095 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5622a5f31950 0x5622a5f33d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:11.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.476+0000 7f00b2ff5700 10 client.16236 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:55:11.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.476+0000 7f00ceffd700 1 --2- 172.21.15.73:0/2889572095 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5622a5f31950 0x5622a5f33d40 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd17c071505b8b0e server_cookie=5758f22d43a4a9d9 in_seq=0 out_seq=0 2023-08-10T11:55:11.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.476+0000 7f00b2ff5700 1 -- 172.21.15.73:0/2889572095 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5622a5e09780 con 0x5622a5f31950 2023-08-10T11:55:11.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.476+0000 7f00b2ff5700 10 client.16236 handle_command_reply: tid=0 2023-08-10T11:55:11.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.476+0000 7f00e186bb80 1 client.16236 shutdown 2023-08-10T11:55:11.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.476+0000 7f00e186bb80 1 -- 172.21.15.73:0/2889572095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ecd940 msgr2=0x5622a5f2fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:11.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.476+0000 7f00e186bb80 1 --2- 172.21.15.73:0/2889572095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ecd940 0x5622a5f2fed0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f00c8004c20 tx=0x7f00c8014ca0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.476+0000 7f00e186bb80 1 -- 172.21.15.73:0/2889572095 shutdown_connections 2023-08-10T11:55:11.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.476+0000 7f00e186bb80 1 --2- 172.21.15.73:0/2889572095 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5622a5f31950 0x5622a5f33d40 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.476+0000 7f00e186bb80 1 --2- 172.21.15.73:0/2889572095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622a5ebf800 0x5622a5ed3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.476+0000 7f00e186bb80 1 --2- 172.21.15.73:0/2889572095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622a5ecd940 0x5622a5f2fed0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.476+0000 7f00e186bb80 1 --2- 172.21.15.73:0/2889572095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622a5ec1040 0x5622a5ed40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.476+0000 7f00b2ff5700 0 client.16236 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:55:11.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.476+0000 7f00e186bb80 1 -- 172.21.15.73:0/2889572095 >> 172.21.15.73:0/2889572095 conn(0x5622a5e1ccd0 msgr2=0x5622a5ec8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:11.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.476+0000 7f00e186bb80 1 -- 172.21.15.73:0/2889572095 shutdown_connections 2023-08-10T11:55:11.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.476+0000 7f00e186bb80 1 -- 172.21.15.73:0/2889572095 wait complete. 2023-08-10T11:55:11.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.476+0000 7f00e186bb80 20 client.16236 trim_cache size 0 max 16384 2023-08-10T11:55:11.489 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:55:11.489 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:55:11.489 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": { 2023-08-10T11:55:11.490 INFO:teuthology.orchestra.run.smithi073.stdout: "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d": { 2023-08-10T11:55:11.490 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2023-08-10T11:55:11.490 INFO:teuthology.orchestra.run.smithi073.stdout: "tag": "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d", 2023-08-10T11:55:11.490 INFO:teuthology.orchestra.run.smithi073.stdout: "options": "recursive,force" 2023-08-10T11:55:11.490 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:55:11.490 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:55:11.490 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:55:11.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.477+0000 7f00d56d2700 1 -- 172.21.15.73:0/3551341708 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f00b80a12c0 msgr2=0x7f00b80a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:11.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.477+0000 7f00d56d2700 1 --2- 172.21.15.73:0/3551341708 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f00b80a12c0 0x7f00b80a3780 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f00c4005950 tx=0x7f00c400b410 comp rx=0 tx=0).stop 2023-08-10T11:55:11.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.477+0000 7f00d56d2700 1 -- 172.21.15.73:0/3551341708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00d0105690 msgr2=0x7f00d0198f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:11.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.477+0000 7f00d56d2700 1 --2- 172.21.15.73:0/3551341708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00d0105690 0x7f00d0198f90 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f00c800b970 tx=0x7f00c800bc80 comp rx=0 tx=0).stop 2023-08-10T11:55:11.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.477+0000 7f00d56d2700 1 -- 172.21.15.73:0/3551341708 shutdown_connections 2023-08-10T11:55:11.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.477+0000 7f00d56d2700 1 --2- 172.21.15.73:0/3551341708 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f00b80a12c0 0x7f00b80a3780 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.477+0000 7f00d56d2700 1 --2- 172.21.15.73:0/3551341708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00d0105690 0x7f00d0198f90 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.477+0000 7f00d56d2700 1 --2- 172.21.15.73:0/3551341708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00d00ff5d0 0x7f00d01956a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.477+0000 7f00d56d2700 1 --2- 172.21.15.73:0/3551341708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00d00fff90 0x7f00d0195be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:11.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.477+0000 7f00d56d2700 1 -- 172.21.15.73:0/3551341708 >> 172.21.15.73:0/3551341708 conn(0x7f00d00fb0c0 msgr2=0x7f00d00fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:11.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.477+0000 7f00d56d2700 1 -- 172.21.15.73:0/3551341708 shutdown_connections 2023-08-10T11:55:11.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:11.477+0000 7f00d56d2700 1 -- 172.21.15.73:0/3551341708 wait complete. 2023-08-10T11:55:11.493 INFO:tasks.cephfs.filesystem:scrub status for tag:9d39b3fa-9b62-42b4-b1a5-738cb3118a5d - {'path': '/', 'tag': '9d39b3fa-9b62-42b4-b1a5-738cb3118a5d', 'options': 'recursive,force'} 2023-08-10T11:55:12.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:12 smithi152 ceph-mon[130220]: pgmap v80: 97 pgs: 97 active+clean; 314 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 267 op/s 2023-08-10T11:55:13.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:12 smithi156 ceph-mon[130574]: pgmap v80: 97 pgs: 97 active+clean; 314 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 267 op/s 2023-08-10T11:55:13.029 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:12 smithi073 ceph-mon[128869]: pgmap v80: 97 pgs: 97 active+clean; 314 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 267 op/s 2023-08-10T11:55:14.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:14 smithi152 ceph-mon[130220]: pgmap v81: 97 pgs: 97 active+clean; 355 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.0 MiB/s wr, 467 op/s 2023-08-10T11:55:15.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:14 smithi156 ceph-mon[130574]: pgmap v81: 97 pgs: 97 active+clean; 355 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.0 MiB/s wr, 467 op/s 2023-08-10T11:55:15.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:14 smithi073 ceph-mon[128869]: pgmap v81: 97 pgs: 97 active+clean; 355 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.0 MiB/s wr, 467 op/s 2023-08-10T11:55:16.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:16 smithi152 ceph-mon[130220]: pgmap v82: 97 pgs: 97 active+clean; 391 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 9.3 MiB/s wr, 644 op/s 2023-08-10T11:55:17.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:16 smithi156 ceph-mon[130574]: pgmap v82: 97 pgs: 97 active+clean; 391 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 9.3 MiB/s wr, 644 op/s 2023-08-10T11:55:17.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:16 smithi073 ceph-mon[128869]: pgmap v82: 97 pgs: 97 active+clean; 391 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 9.3 MiB/s wr, 644 op/s 2023-08-10T11:55:18.102 INFO:tasks.workunit.client.0.smithi073.stdout: 115 627211 498 399304 432 172154 448 2023-08-10T11:55:18.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:18 smithi152 ceph-mon[130220]: pgmap v83: 97 pgs: 97 active+clean; 391 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.4 MiB/s wr, 591 op/s 2023-08-10T11:55:19.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:18 smithi156 ceph-mon[130574]: pgmap v83: 97 pgs: 97 active+clean; 391 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.4 MiB/s wr, 591 op/s 2023-08-10T11:55:19.030 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:18 smithi073 ceph-mon[128869]: pgmap v83: 97 pgs: 97 active+clean; 391 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.4 MiB/s wr, 591 op/s 2023-08-10T11:55:20.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:20 smithi152 ceph-mon[130220]: pgmap v84: 97 pgs: 97 active+clean; 448 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 835 op/s 2023-08-10T11:55:21.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:20 smithi156 ceph-mon[130574]: pgmap v84: 97 pgs: 97 active+clean; 448 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 835 op/s 2023-08-10T11:55:21.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:20 smithi073 ceph-mon[128869]: pgmap v84: 97 pgs: 97 active+clean; 448 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 835 op/s 2023-08-10T11:55:23.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:22 smithi156 ceph-mon[130574]: pgmap v85: 97 pgs: 97 active+clean; 448 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 12 MiB/s wr, 635 op/s 2023-08-10T11:55:23.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:22 smithi073 ceph-mon[128869]: pgmap v85: 97 pgs: 97 active+clean; 448 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 12 MiB/s wr, 635 op/s 2023-08-10T11:55:23.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:22 smithi152 ceph-mon[130220]: pgmap v85: 97 pgs: 97 active+clean; 448 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 12 MiB/s wr, 635 op/s 2023-08-10T11:55:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.599+0000 7f55a5621700 1 -- 172.21.15.73:0/4292539436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55a00ff790 msgr2=0x7f55a0105310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.599+0000 7f55a5621700 1 --2- 172.21.15.73:0/4292539436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55a00ff790 0x7f55a0105310 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f55940099c0 tx=0x7f5594009cd0 comp rx=0 tx=0).stop 2023-08-10T11:55:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.599+0000 7f55a5621700 1 -- 172.21.15.73:0/4292539436 shutdown_connections 2023-08-10T11:55:24.601 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.599+0000 7f55a5621700 1 --2- 172.21.15.73:0/4292539436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55a00fede0 0x7f55a00ff1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:24.601 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.599+0000 7f55a5621700 1 --2- 172.21.15.73:0/4292539436 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55a0105a40 0x7f55a010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:24.601 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.599+0000 7f55a5621700 1 --2- 172.21.15.73:0/4292539436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55a00ff790 0x7f55a0105310 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:24.602 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.599+0000 7f55a5621700 1 -- 172.21.15.73:0/4292539436 >> 172.21.15.73:0/4292539436 conn(0x7f55a0076b40 msgr2=0x7f55a00fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:24.602 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.599+0000 7f55a5621700 1 -- 172.21.15.73:0/4292539436 shutdown_connections 2023-08-10T11:55:24.602 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.599+0000 7f55a5621700 1 -- 172.21.15.73:0/4292539436 wait complete. 2023-08-10T11:55:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.600+0000 7f55a5621700 1 Processor -- start 2023-08-10T11:55:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.600+0000 7f55a5621700 1 -- start start 2023-08-10T11:55:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.600+0000 7f55a5621700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55a00fede0 0x7f55a019c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.600+0000 7f55a5621700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55a0105a40 0x7f55a019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.600+0000 7f55a5621700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55a01966d0 0x7f55a0196b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.600+0000 7f55a5621700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a0197150 con 0x7f55a01966d0 2023-08-10T11:55:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.600+0000 7f55a5621700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a0197290 con 0x7f55a0105a40 2023-08-10T11:55:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.600+0000 7f55a5621700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a0197450 con 0x7f55a00fede0 2023-08-10T11:55:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.600+0000 7f559f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55a01966d0 0x7f55a0196b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.600+0000 7f559effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55a00fede0 0x7f55a019c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.600+0000 7f559f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55a01966d0 0x7f55a0196b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34586/0 (socket says 172.21.15.73:34586) 2023-08-10T11:55:24.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.600+0000 7f559f7fe700 1 -- 172.21.15.73:0/3331273111 learned_addr learned my addr 172.21.15.73:0/3331273111 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:24.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.601+0000 7f559e7fc700 1 --2- 172.21.15.73:0/3331273111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55a0105a40 0x7f55a019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:24.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.601+0000 7f559effd700 1 -- 172.21.15.73:0/3331273111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55a0105a40 msgr2=0x7f55a019cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:24.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.601+0000 7f559effd700 1 --2- 172.21.15.73:0/3331273111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55a0105a40 0x7f55a019cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:24.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.601+0000 7f559effd700 1 -- 172.21.15.73:0/3331273111 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55a01966d0 msgr2=0x7f55a0196b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:24.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.601+0000 7f559effd700 1 --2- 172.21.15.73:0/3331273111 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55a01966d0 0x7f55a0196b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:24.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.601+0000 7f559effd700 1 -- 172.21.15.73:0/3331273111 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55940095f0 con 0x7f55a00fede0 2023-08-10T11:55:24.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.601+0000 7f559f7fe700 1 --2- 172.21.15.73:0/3331273111 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55a01966d0 0x7f55a0196b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:55:24.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.601+0000 7f559e7fc700 1 --2- 172.21.15.73:0/3331273111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55a0105a40 0x7f55a019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:55:24.608 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.601+0000 7f559effd700 1 --2- 172.21.15.73:0/3331273111 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55a00fede0 0x7f55a019c870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f559000b450 tx=0x7f559000b760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:24.608 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.601+0000 7f5587fff700 1 -- 172.21.15.73:0/3331273111 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590011830 con 0x7f55a00fede0 2023-08-10T11:55:24.608 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.601+0000 7f5587fff700 1 -- 172.21.15.73:0/3331273111 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5590011e50 con 0x7f55a00fede0 2023-08-10T11:55:24.608 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.601+0000 7f5587fff700 1 -- 172.21.15.73:0/3331273111 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590010de0 con 0x7f55a00fede0 2023-08-10T11:55:24.608 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.601+0000 7f55a5621700 1 -- 172.21.15.73:0/3331273111 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a01a36e0 con 0x7f55a00fede0 2023-08-10T11:55:24.608 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.601+0000 7f55a5621700 1 -- 172.21.15.73:0/3331273111 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a01a3bf0 con 0x7f55a00fede0 2023-08-10T11:55:24.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.603+0000 7f5587fff700 1 -- 172.21.15.73:0/3331273111 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f5590010480 con 0x7f55a00fede0 2023-08-10T11:55:24.610 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.604+0000 7f5587fff700 1 --2- 172.21.15.73:0/3331273111 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f55880a1340 0x7f55880a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.604+0000 7f559e7fc700 1 --2- 172.21.15.73:0/3331273111 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f55880a1340 0x7f55880a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.604+0000 7f5587fff700 1 -- 172.21.15.73:0/3331273111 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f55900cc610 con 0x7f55a00fede0 2023-08-10T11:55:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.604+0000 7f559e7fc700 1 --2- 172.21.15.73:0/3331273111 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f55880a1340 0x7f55880a3800 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f55940098e0 tx=0x7f5594000bc0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.605+0000 7f55b17bab80 1 Processor -- start 2023-08-10T11:55:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.605+0000 7f55b17bab80 1 -- start start 2023-08-10T11:55:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.605+0000 7f55b17bab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43aa40 0x56104f43ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:24.612 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.605+0000 7f55b17bab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56104f43b360 0x56104f435010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:24.612 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.605+0000 7f55b17bab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56104f435550 0x56104f4359d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:24.612 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.605+0000 7f55b17bab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104f3b0d60 con 0x56104f43aa40 2023-08-10T11:55:24.612 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.605+0000 7f55b17bab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104f38d530 con 0x56104f435550 2023-08-10T11:55:24.612 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.605+0000 7f55b17bab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104f38ae50 con 0x56104f43b360 2023-08-10T11:55:24.612 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.605+0000 7f559effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43aa40 0x56104f43ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:24.613 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.605+0000 7f559effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43aa40 0x56104f43ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34590/0 (socket says 172.21.15.73:34590) 2023-08-10T11:55:24.613 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.605+0000 7f559effd700 1 -- 172.21.15.73:0/2154096972 learned_addr learned my addr 172.21.15.73:0/2154096972 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:24.613 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.605+0000 7f559e7fc700 1 --2- 172.21.15.73:0/2154096972 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56104f43b360 0x56104f435010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:24.613 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.605+0000 7f559f7fe700 1 --2- 172.21.15.73:0/2154096972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56104f435550 0x56104f4359d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:24.613 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.606+0000 7f559effd700 1 -- 172.21.15.73:0/2154096972 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56104f43b360 msgr2=0x56104f435010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:24.613 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.606+0000 7f559effd700 1 --2- 172.21.15.73:0/2154096972 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56104f43b360 0x56104f435010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:24.613 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.606+0000 7f559effd700 1 -- 172.21.15.73:0/2154096972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56104f435550 msgr2=0x56104f4359d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:24.614 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.606+0000 7f559effd700 1 --2- 172.21.15.73:0/2154096972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56104f435550 0x56104f4359d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.606+0000 7f559effd700 1 -- 172.21.15.73:0/2154096972 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56104f2075d0 con 0x56104f43aa40 2023-08-10T11:55:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.606+0000 7f559e7fc700 1 --2- 172.21.15.73:0/2154096972 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56104f43b360 0x56104f435010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:55:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.606+0000 7f559effd700 1 --2- 172.21.15.73:0/2154096972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43aa40 0x56104f43ae20 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f55900997b0 tx=0x7f559000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a644332af7d45d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:24.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.606+0000 7f55857fa700 1 -- 172.21.15.73:0/2154096972 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559009d850 con 0x56104f43aa40 2023-08-10T11:55:24.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.606+0000 7f55857fa700 1 -- 172.21.15.73:0/2154096972 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f55900a1c70 con 0x56104f43aa40 2023-08-10T11:55:24.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.606+0000 7f55857fa700 1 -- 172.21.15.73:0/2154096972 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590098d10 con 0x56104f43aa40 2023-08-10T11:55:24.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.607+0000 7f55b17bab80 1 -- 172.21.15.73:0/2154096972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43aa40 msgr2=0x56104f43ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:24.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.607+0000 7f55b17bab80 1 --2- 172.21.15.73:0/2154096972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43aa40 0x56104f43ae20 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f55900997b0 tx=0x7f559000bf10 comp rx=0 tx=0).stop 2023-08-10T11:55:24.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.607+0000 7f55b17bab80 1 -- 172.21.15.73:0/2154096972 shutdown_connections 2023-08-10T11:55:24.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.607+0000 7f55b17bab80 1 --2- 172.21.15.73:0/2154096972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56104f435550 0x56104f4359d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:24.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.607+0000 7f55b17bab80 1 --2- 172.21.15.73:0/2154096972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43aa40 0x56104f43ae20 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.607+0000 7f55b17bab80 1 --2- 172.21.15.73:0/2154096972 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56104f43b360 0x56104f435010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.607+0000 7f55b17bab80 1 -- 172.21.15.73:0/2154096972 >> 172.21.15.73:0/2154096972 conn(0x56104f392c70 msgr2=0x56104f42fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.607+0000 7f55b17bab80 1 -- 172.21.15.73:0/2154096972 shutdown_connections 2023-08-10T11:55:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.607+0000 7f55b17bab80 1 -- 172.21.15.73:0/2154096972 wait complete. 2023-08-10T11:55:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.607+0000 7f55b17bab80 1 -- start start 2023-08-10T11:55:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.607+0000 7f55b17bab80 1 Processor -- start 2023-08-10T11:55:24.621 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.607+0000 7f55b17bab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56104f435550 0x56104f43e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:24.621 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.607+0000 7f55b17bab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56104f43aa40 0x56104f43ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:24.621 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.607+0000 7f55b17bab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43b360 0x56104f43f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:24.621 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.607+0000 7f55b17bab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104f386740 con 0x56104f43b360 2023-08-10T11:55:24.621 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.607+0000 7f55b17bab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104f325a60 con 0x56104f435550 2023-08-10T11:55:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.607+0000 7f55b17bab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104f325760 con 0x56104f43aa40 2023-08-10T11:55:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.607+0000 7f55b17bab80 10 client.0 _ll_register_callbacks cb 0x56104f323620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:55:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.607+0000 7f559f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43b360 0x56104f43f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.608+0000 7f559e7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56104f43aa40 0x56104f43ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.608+0000 7f559e7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56104f43aa40 0x56104f43ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60102/0 (socket says 172.21.15.73:60102) 2023-08-10T11:55:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.608+0000 7f559f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43b360 0x56104f43f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34600/0 (socket says 172.21.15.73:34600) 2023-08-10T11:55:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.608+0000 7f559e7fc700 1 -- 172.21.15.73:0/120677470 learned_addr learned my addr 172.21.15.73:0/120677470 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.608+0000 7f559effd700 1 --2- 172.21.15.73:0/120677470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56104f435550 0x56104f43e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.608+0000 7f559e7fc700 1 -- 172.21.15.73:0/120677470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56104f435550 msgr2=0x56104f43e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.608+0000 7f559e7fc700 1 --2- 172.21.15.73:0/120677470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56104f435550 0x56104f43e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.608+0000 7f559e7fc700 1 -- 172.21.15.73:0/120677470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43b360 msgr2=0x56104f43f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.608+0000 7f559e7fc700 1 --2- 172.21.15.73:0/120677470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43b360 0x56104f43f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.608+0000 7f559e7fc700 1 -- 172.21.15.73:0/120677470 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a010de60 con 0x56104f43aa40 2023-08-10T11:55:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.608+0000 7f559f7fe700 1 --2- 172.21.15.73:0/120677470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43b360 0x56104f43f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:55:24.624 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.608+0000 7f559e7fc700 1 --2- 172.21.15.73:0/120677470 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56104f43aa40 0x56104f43ebe0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f55940099c0 tx=0x7f5594019050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce8b4c8dfc742f66 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:24.624 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.608+0000 7f5582ff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T11:55:24.624 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.608+0000 7f5582ff5700 1 -- 172.21.15.73:0/120677470 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559402c040 con 0x56104f43aa40 2023-08-10T11:55:24.624 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.608+0000 7f5582ff5700 1 -- 172.21.15.73:0/120677470 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5594004830 con 0x56104f43aa40 2023-08-10T11:55:24.624 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.608+0000 7f55b17bab80 1 -- 172.21.15.73:0/120677470 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56104f4281c0 con 0x56104f43aa40 2023-08-10T11:55:24.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.608+0000 7f5582ff5700 1 -- 172.21.15.73:0/120677470 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55940049f0 con 0x56104f43aa40 2023-08-10T11:55:24.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.608+0000 7f55b17bab80 10 client.25669 fetch_fsmap learned FSMap version 32 2023-08-10T11:55:24.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.608+0000 7f55b17bab80 1 -- 172.21.15.73:0/120677470 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f55a01a3bf0 con 0x56104f43aa40 2023-08-10T11:55:24.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.609+0000 7f5582ff5700 1 -- 172.21.15.73:0/120677470 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56104f4281c0 con 0x56104f43aa40 2023-08-10T11:55:24.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.609+0000 7f5582ff5700 1 -- 172.21.15.73:0/120677470 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 32) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f5594031480 con 0x56104f43aa40 2023-08-10T11:55:24.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.609+0000 7f55b17bab80 10 client.25669 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T11:55:24.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.609+0000 7f55b17bab80 10 client.25669 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:55:24.626 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.609+0000 7f55b17bab80 20 client.25669 populate_metadata read hostname 'smithi073' 2023-08-10T11:55:24.626 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.609+0000 7f55b17bab80 1 --2- 172.21.15.73:0/120677470 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56104f44edf0 0x56104f451210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:24.626 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.609+0000 7f55b17bab80 4 client.25669 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:55:24.626 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.609+0000 7f55b17bab80 1 -- 172.21.15.73:0/120677470 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56104f404970 con 0x56104f44edf0 2023-08-10T11:55:24.626 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.610+0000 7f559effd700 1 --2- 172.21.15.73:0/120677470 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56104f44edf0 0x56104f451210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:24.626 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.610+0000 7f559effd700 1 --2- 172.21.15.73:0/120677470 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56104f44edf0 0x56104f451210 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b720d67ebd4c7ed server_cookie=7f11c101d0e79b2a in_seq=0 out_seq=0 2023-08-10T11:55:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.610+0000 7f5582ff5700 10 client.25669 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:55:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.612+0000 7f5582ff5700 1 -- 172.21.15.73:0/120677470 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x56104f404970 con 0x56104f44edf0 2023-08-10T11:55:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.612+0000 7f5582ff5700 10 client.25669 handle_command_reply: tid=0 2023-08-10T11:55:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.612+0000 7f55b17bab80 1 client.25669 shutdown 2023-08-10T11:55:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.612+0000 7f55b17bab80 1 -- 172.21.15.73:0/120677470 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56104f43aa40 msgr2=0x56104f43ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.612+0000 7f55b17bab80 1 --2- 172.21.15.73:0/120677470 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56104f43aa40 0x56104f43ebe0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f55940099c0 tx=0x7f5594019050 comp rx=0 tx=0).stop 2023-08-10T11:55:24.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.612+0000 7f55b17bab80 1 -- 172.21.15.73:0/120677470 shutdown_connections 2023-08-10T11:55:24.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.612+0000 7f55b17bab80 1 --2- 172.21.15.73:0/120677470 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56104f44edf0 0x56104f451210 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:24.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.612+0000 7f55b17bab80 1 --2- 172.21.15.73:0/120677470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56104f435550 0x56104f43e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:24.629 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.612+0000 7f5582ff5700 0 client.25669 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:55:24.629 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.612+0000 7f55b17bab80 1 --2- 172.21.15.73:0/120677470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43b360 0x56104f43f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:24.629 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.612+0000 7f55b17bab80 1 --2- 172.21.15.73:0/120677470 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56104f43aa40 0x56104f43ebe0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:24.629 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.612+0000 7f55b17bab80 1 -- 172.21.15.73:0/120677470 >> 172.21.15.73:0/120677470 conn(0x56104f392c70 msgr2=0x56104f42f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.612+0000 7f55b17bab80 1 -- 172.21.15.73:0/120677470 shutdown_connections 2023-08-10T11:55:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.613+0000 7f55b17bab80 1 -- 172.21.15.73:0/120677470 wait complete. 2023-08-10T11:55:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.613+0000 7f55b17bab80 20 client.25669 trim_cache size 0 max 16384 2023-08-10T11:55:24.634 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.627+0000 7f55b17bab80 1 Processor -- start 2023-08-10T11:55:24.634 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.627+0000 7f55b17bab80 1 -- start start 2023-08-10T11:55:24.634 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.627+0000 7f55b17bab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56104f435550 0x56104f445e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:24.634 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.627+0000 7f55b17bab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43aa40 0x56104f42fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:24.635 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.627+0000 7f55b17bab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56104f43b360 0x56104f43dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:24.635 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.627+0000 7f55b17bab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104f2098c0 con 0x56104f43aa40 2023-08-10T11:55:24.635 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.627+0000 7f55b17bab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104f42ccd0 con 0x56104f435550 2023-08-10T11:55:24.635 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.627+0000 7f55b17bab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104f44ad60 con 0x56104f43b360 2023-08-10T11:55:24.635 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.628+0000 7f559e7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43aa40 0x56104f42fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:24.635 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.628+0000 7f559e7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43aa40 0x56104f42fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34606/0 (socket says 172.21.15.73:34606) 2023-08-10T11:55:24.635 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.628+0000 7f559f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56104f43b360 0x56104f43dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:24.635 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.628+0000 7f559e7fc700 1 -- 172.21.15.73:0/3534658747 learned_addr learned my addr 172.21.15.73:0/3534658747 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:24.636 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.628+0000 7f559effd700 1 --2- 172.21.15.73:0/3534658747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56104f435550 0x56104f445e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:24.636 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.628+0000 7f559e7fc700 1 -- 172.21.15.73:0/3534658747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56104f43b360 msgr2=0x56104f43dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:24.636 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.628+0000 7f559e7fc700 1 --2- 172.21.15.73:0/3534658747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56104f43b360 0x56104f43dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:24.636 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.628+0000 7f559e7fc700 1 -- 172.21.15.73:0/3534658747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56104f435550 msgr2=0x56104f445e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:24.636 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.628+0000 7f559e7fc700 1 --2- 172.21.15.73:0/3534658747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56104f435550 0x56104f445e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:24.636 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.628+0000 7f559e7fc700 1 -- 172.21.15.73:0/3534658747 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56104f1b3d80 con 0x56104f43aa40 2023-08-10T11:55:24.636 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.628+0000 7f559effd700 1 --2- 172.21.15.73:0/3534658747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56104f435550 0x56104f445e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:55:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.628+0000 7f559e7fc700 1 --2- 172.21.15.73:0/3534658747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43aa40 0x56104f42fc30 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f5594005f50 tx=0x7f559400f9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b48925665f2684 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.628+0000 7f5585ffb700 1 -- 172.21.15.73:0/3534658747 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5594040070 con 0x56104f43aa40 2023-08-10T11:55:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.628+0000 7f5585ffb700 1 -- 172.21.15.73:0/3534658747 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f559401d040 con 0x56104f43aa40 2023-08-10T11:55:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.628+0000 7f5585ffb700 1 -- 172.21.15.73:0/3534658747 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559402c050 con 0x56104f43aa40 2023-08-10T11:55:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.629+0000 7f55b17bab80 1 -- 172.21.15.73:0/3534658747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43aa40 msgr2=0x56104f42fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.629+0000 7f55b17bab80 1 --2- 172.21.15.73:0/3534658747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43aa40 0x56104f42fc30 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f5594005f50 tx=0x7f559400f9c0 comp rx=0 tx=0).stop 2023-08-10T11:55:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.629+0000 7f55b17bab80 1 -- 172.21.15.73:0/3534658747 shutdown_connections 2023-08-10T11:55:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.629+0000 7f55b17bab80 1 --2- 172.21.15.73:0/3534658747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56104f435550 0x56104f445e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.629+0000 7f55b17bab80 1 --2- 172.21.15.73:0/3534658747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56104f43b360 0x56104f43dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.629+0000 7f55b17bab80 1 --2- 172.21.15.73:0/3534658747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43aa40 0x56104f42fc30 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.629+0000 7f55b17bab80 1 -- 172.21.15.73:0/3534658747 >> 172.21.15.73:0/3534658747 conn(0x56104f392c70 msgr2=0x56104f43a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.629+0000 7f55b17bab80 1 -- 172.21.15.73:0/3534658747 shutdown_connections 2023-08-10T11:55:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.629+0000 7f55b17bab80 1 -- 172.21.15.73:0/3534658747 wait complete. 2023-08-10T11:55:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.629+0000 7f55b17bab80 1 -- start start 2023-08-10T11:55:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.629+0000 7f55b17bab80 1 Processor -- start 2023-08-10T11:55:24.639 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.630+0000 7f55b17bab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56104f435550 0x56104f445740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:24.639 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.630+0000 7f55b17bab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56104f43aa40 0x56104f445c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:24.639 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.630+0000 7f55b17bab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43b360 0x56104f443b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:24.639 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.630+0000 7f55b17bab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104f444210 con 0x56104f43b360 2023-08-10T11:55:24.639 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.630+0000 7f55b17bab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104f444380 con 0x56104f43aa40 2023-08-10T11:55:24.639 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.630+0000 7f55b17bab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104f444540 con 0x56104f435550 2023-08-10T11:55:24.639 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.630+0000 7f55b17bab80 10 client.0 _ll_register_callbacks cb 0x56104f323620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:55:24.639 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.630+0000 7f559f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43b360 0x56104f443b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.630+0000 7f559f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43b360 0x56104f443b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34614/0 (socket says 172.21.15.73:34614) 2023-08-10T11:55:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.630+0000 7f559effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56104f435550 0x56104f445740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.630+0000 7f559f7fe700 1 -- 172.21.15.73:0/2382872500 learned_addr learned my addr 172.21.15.73:0/2382872500 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.630+0000 7f559e7fc700 1 --2- 172.21.15.73:0/2382872500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56104f43aa40 0x56104f445c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.630+0000 7f559f7fe700 1 -- 172.21.15.73:0/2382872500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56104f435550 msgr2=0x56104f445740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.630+0000 7f559f7fe700 1 --2- 172.21.15.73:0/2382872500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56104f435550 0x56104f445740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.630+0000 7f559f7fe700 1 -- 172.21.15.73:0/2382872500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56104f43aa40 msgr2=0x56104f445c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.630+0000 7f559f7fe700 1 --2- 172.21.15.73:0/2382872500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56104f43aa40 0x56104f445c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.630+0000 7f559f7fe700 1 -- 172.21.15.73:0/2382872500 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a01a3bf0 con 0x56104f43b360 2023-08-10T11:55:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.630+0000 7f559effd700 1 --2- 172.21.15.73:0/2382872500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56104f435550 0x56104f445740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:55:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.630+0000 7f559f7fe700 1 --2- 172.21.15.73:0/2382872500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43b360 0x56104f443b20 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f559800e870 tx=0x7f559800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f1fd457a908948 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.630+0000 7f5582ff5700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:55:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.630+0000 7f5582ff5700 1 -- 172.21.15.73:0/2382872500 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559801c070 con 0x56104f43b360 2023-08-10T11:55:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.630+0000 7f5582ff5700 1 -- 172.21.15.73:0/2382872500 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f55980177a0 con 0x56104f43b360 2023-08-10T11:55:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.630+0000 7f55b17bab80 1 -- 172.21.15.73:0/2382872500 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f55900a1c70 con 0x56104f43b360 2023-08-10T11:55:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.631+0000 7f5582ff5700 1 -- 172.21.15.73:0/2382872500 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5598017960 con 0x56104f43b360 2023-08-10T11:55:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.631+0000 7f55b17bab80 10 client.16254 fetch_fsmap learned FSMap version 32 2023-08-10T11:55:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.631+0000 7f55b17bab80 1 -- 172.21.15.73:0/2382872500 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x56104f19cc00 con 0x56104f43b360 2023-08-10T11:55:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.631+0000 7f5582ff5700 1 -- 172.21.15.73:0/2382872500 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f55900a1c70 con 0x56104f43b360 2023-08-10T11:55:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.631+0000 7f5582ff5700 1 -- 172.21.15.73:0/2382872500 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 32) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f5598020c30 con 0x56104f43b360 2023-08-10T11:55:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.631+0000 7f55b17bab80 10 client.16254 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T11:55:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.631+0000 7f55b17bab80 10 client.16254 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:55:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.631+0000 7f55b17bab80 20 client.16254 populate_metadata read hostname 'smithi073' 2023-08-10T11:55:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.631+0000 7f55b17bab80 1 --2- 172.21.15.73:0/2382872500 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56104f4a8180 0x56104f4aa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.631+0000 7f55b17bab80 4 client.16254 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:55:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.631+0000 7f55b17bab80 1 -- 172.21.15.73:0/2382872500 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56104f37f720 con 0x56104f4a8180 2023-08-10T11:55:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.631+0000 7f559effd700 1 --2- 172.21.15.73:0/2382872500 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56104f4a8180 0x56104f4aa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.632+0000 7f559effd700 1 --2- 172.21.15.73:0/2382872500 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56104f4a8180 0x56104f4aa5a0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a67f2a8cb38aea16 server_cookie=6df6ca8a92fd2493 in_seq=0 out_seq=0 2023-08-10T11:55:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:24.632+0000 7f5582ff5700 10 client.16254 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:55:24.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:24 smithi152 ceph-mon[130220]: pgmap v86: 97 pgs: 97 active+clean; 448 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 12 MiB/s wr, 707 op/s 2023-08-10T11:55:25.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:24 smithi156 ceph-mon[130574]: pgmap v86: 97 pgs: 97 active+clean; 448 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 12 MiB/s wr, 707 op/s 2023-08-10T11:55:25.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:24 smithi073 ceph-mon[128869]: pgmap v86: 97 pgs: 97 active+clean; 448 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 12 MiB/s wr, 707 op/s 2023-08-10T11:55:25.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:25.422+0000 7f5582ff5700 1 -- 172.21.15.73:0/2382872500 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56104f37f720 con 0x56104f4a8180 2023-08-10T11:55:25.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:25.422+0000 7f5582ff5700 10 client.16254 handle_command_reply: tid=0 2023-08-10T11:55:25.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:25.422+0000 7f55b17bab80 1 client.16254 shutdown 2023-08-10T11:55:25.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:25.422+0000 7f55b17bab80 1 -- 172.21.15.73:0/2382872500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43b360 msgr2=0x56104f443b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:25.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:25.422+0000 7f55b17bab80 1 --2- 172.21.15.73:0/2382872500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43b360 0x56104f443b20 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f559800e870 tx=0x7f559800eb80 comp rx=0 tx=0).stop 2023-08-10T11:55:25.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:25.422+0000 7f55b17bab80 1 -- 172.21.15.73:0/2382872500 shutdown_connections 2023-08-10T11:55:25.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:25.422+0000 7f55b17bab80 1 --2- 172.21.15.73:0/2382872500 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56104f4a8180 0x56104f4aa5a0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:25.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:25.422+0000 7f55b17bab80 1 --2- 172.21.15.73:0/2382872500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56104f43b360 0x56104f443b20 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:25.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:25.422+0000 7f55b17bab80 1 --2- 172.21.15.73:0/2382872500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56104f435550 0x56104f445740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:25.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:25.422+0000 7f55b17bab80 1 --2- 172.21.15.73:0/2382872500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56104f43aa40 0x56104f445c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:25.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:25.422+0000 7f55b17bab80 1 -- 172.21.15.73:0/2382872500 >> 172.21.15.73:0/2382872500 conn(0x56104f392c70 msgr2=0x56104f43ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:25.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:25.422+0000 7f5582ff5700 0 client.16254 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:55:25.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:25.422+0000 7f55b17bab80 1 -- 172.21.15.73:0/2382872500 shutdown_connections 2023-08-10T11:55:25.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:25.422+0000 7f55b17bab80 1 -- 172.21.15.73:0/2382872500 wait complete. 2023-08-10T11:55:25.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:25.422+0000 7f55b17bab80 20 client.16254 trim_cache size 0 max 16384 2023-08-10T11:55:25.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:55:25.426 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:55:25.426 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:55:25.426 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:55:25.426 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:25.423+0000 7f55a5621700 1 -- 172.21.15.73:0/3331273111 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f55880a1340 msgr2=0x7f55880a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:25.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:25.423+0000 7f55a5621700 1 --2- 172.21.15.73:0/3331273111 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f55880a1340 0x7f55880a3800 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f55940098e0 tx=0x7f5594000bc0 comp rx=0 tx=0).stop 2023-08-10T11:55:25.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:25.423+0000 7f55a5621700 1 -- 172.21.15.73:0/3331273111 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55a00fede0 msgr2=0x7f55a019c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:25.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:25.423+0000 7f55a5621700 1 --2- 172.21.15.73:0/3331273111 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55a00fede0 0x7f55a019c870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f559000b450 tx=0x7f559000b760 comp rx=0 tx=0).stop 2023-08-10T11:55:25.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:25.423+0000 7f55a5621700 1 -- 172.21.15.73:0/3331273111 shutdown_connections 2023-08-10T11:55:25.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:25.423+0000 7f55a5621700 1 --2- 172.21.15.73:0/3331273111 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f55880a1340 0x7f55880a3800 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:25.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:25.423+0000 7f55a5621700 1 --2- 172.21.15.73:0/3331273111 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55a01966d0 0x7f55a0196b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:25.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:25.423+0000 7f55a5621700 1 --2- 172.21.15.73:0/3331273111 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55a00fede0 0x7f55a019c870 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:25.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:25.423+0000 7f55a5621700 1 --2- 172.21.15.73:0/3331273111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55a0105a40 0x7f55a019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:25.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:25.423+0000 7f55a5621700 1 -- 172.21.15.73:0/3331273111 >> 172.21.15.73:0/3331273111 conn(0x7f55a0076b40 msgr2=0x7f55a0104290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:25.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:25.423+0000 7f55a5621700 1 -- 172.21.15.73:0/3331273111 shutdown_connections 2023-08-10T11:55:25.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:25.423+0000 7f55a5621700 1 -- 172.21.15.73:0/3331273111 wait complete. 2023-08-10T11:55:26.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:26 smithi152 ceph-mon[130220]: pgmap v87: 97 pgs: 97 active+clean; 459 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 9.5 MiB/s wr, 590 op/s 2023-08-10T11:55:27.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:26 smithi156 ceph-mon[130574]: pgmap v87: 97 pgs: 97 active+clean; 459 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 9.5 MiB/s wr, 590 op/s 2023-08-10T11:55:27.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:26 smithi073 ceph-mon[128869]: pgmap v87: 97 pgs: 97 active+clean; 459 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 9.5 MiB/s wr, 590 op/s 2023-08-10T11:55:28.102 INFO:tasks.workunit.client.0.smithi073.stdout: 129 1336153 775 864012 836 385524 1107 2023-08-10T11:55:28.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:28 smithi152 ceph-mon[130220]: pgmap v88: 97 pgs: 97 active+clean; 459 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.0 MiB/s wr, 399 op/s 2023-08-10T11:55:29.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:28 smithi156 ceph-mon[130574]: pgmap v88: 97 pgs: 97 active+clean; 459 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.0 MiB/s wr, 399 op/s 2023-08-10T11:55:29.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:28 smithi073 ceph-mon[128869]: pgmap v88: 97 pgs: 97 active+clean; 459 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.0 MiB/s wr, 399 op/s 2023-08-10T11:55:30.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:30 smithi152 ceph-mon[130220]: pgmap v89: 97 pgs: 97 active+clean; 467 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.3 MiB/s wr, 771 op/s 2023-08-10T11:55:31.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:30 smithi156 ceph-mon[130574]: pgmap v89: 97 pgs: 97 active+clean; 467 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.3 MiB/s wr, 771 op/s 2023-08-10T11:55:31.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:30 smithi073 ceph-mon[128869]: pgmap v89: 97 pgs: 97 active+clean; 467 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.3 MiB/s wr, 771 op/s 2023-08-10T11:55:32.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:32 smithi152 ceph-mon[130220]: pgmap v90: 97 pgs: 97 active+clean; 467 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 527 op/s 2023-08-10T11:55:33.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:32 smithi156 ceph-mon[130574]: pgmap v90: 97 pgs: 97 active+clean; 467 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 527 op/s 2023-08-10T11:55:33.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:32 smithi073 ceph-mon[128869]: pgmap v90: 97 pgs: 97 active+clean; 467 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 527 op/s 2023-08-10T11:55:34.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:34 smithi152 ceph-mon[130220]: pgmap v91: 97 pgs: 97 active+clean; 470 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 551 op/s 2023-08-10T11:55:35.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:34 smithi156 ceph-mon[130574]: pgmap v91: 97 pgs: 97 active+clean; 470 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 551 op/s 2023-08-10T11:55:35.027 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:34 smithi073 ceph-mon[128869]: pgmap v91: 97 pgs: 97 active+clean; 470 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 551 op/s 2023-08-10T11:55:36.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:36 smithi152 ceph-mon[130220]: pgmap v92: 97 pgs: 97 active+clean; 477 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 510 op/s 2023-08-10T11:55:37.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:36 smithi156 ceph-mon[130574]: pgmap v92: 97 pgs: 97 active+clean; 477 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 510 op/s 2023-08-10T11:55:37.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:36 smithi073 ceph-mon[128869]: pgmap v92: 97 pgs: 97 active+clean; 477 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 510 op/s 2023-08-10T11:55:38.102 INFO:tasks.workunit.client.0.smithi073.stdout: 146 1860124 1003 1219432 889 538552 1119 2023-08-10T11:55:38.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:38 smithi152 ceph-mon[130220]: pgmap v93: 97 pgs: 97 active+clean; 477 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 426 op/s 2023-08-10T11:55:39.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:38 smithi156 ceph-mon[130574]: pgmap v93: 97 pgs: 97 active+clean; 477 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 426 op/s 2023-08-10T11:55:39.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:38 smithi073 ceph-mon[128869]: pgmap v93: 97 pgs: 97 active+clean; 477 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 426 op/s 2023-08-10T11:55:40.253 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.242+0000 7f856c51f700 1 -- 172.21.15.73:0/504086025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85641077d0 msgr2=0x7f8564107bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:40.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.242+0000 7f856c51f700 1 --2- 172.21.15.73:0/504086025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85641077d0 0x7f8564107bb0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f8554009990 tx=0x7f8554009ca0 comp rx=0 tx=0).stop 2023-08-10T11:55:40.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.251+0000 7f856c51f700 1 -- 172.21.15.73:0/504086025 shutdown_connections 2023-08-10T11:55:40.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.251+0000 7f856c51f700 1 --2- 172.21.15.73:0/504086025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8564103470 0x7f856410f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:40.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.251+0000 7f856c51f700 1 --2- 172.21.15.73:0/504086025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85641077d0 0x7f8564107bb0 secure :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f8554009990 tx=0x7f8554009ca0 comp rx=0 tx=0).stop 2023-08-10T11:55:40.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.251+0000 7f856c51f700 1 --2- 172.21.15.73:0/504086025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8564102ab0 0x7f8564102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:40.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.251+0000 7f856c51f700 1 -- 172.21.15.73:0/504086025 >> 172.21.15.73:0/504086025 conn(0x7f8564076610 msgr2=0x7f8564100dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:40.274 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.271+0000 7f856c51f700 1 -- 172.21.15.73:0/504086025 shutdown_connections 2023-08-10T11:55:40.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.273+0000 7f856c51f700 1 -- 172.21.15.73:0/504086025 wait complete. 2023-08-10T11:55:40.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.274+0000 7f856c51f700 1 Processor -- start 2023-08-10T11:55:40.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.274+0000 7f856c51f700 1 -- start start 2023-08-10T11:55:40.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.274+0000 7f856c51f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8564102ab0 0x7f8564118a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:40.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.274+0000 7f856c51f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8564103470 0x7f8564118f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:40.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.274+0000 7f856c51f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f856410e6d0 0x7f856410eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:40.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.274+0000 7f856c51f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856410f190 con 0x7f856410e6d0 2023-08-10T11:55:40.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.274+0000 7f856c51f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856410f300 con 0x7f8564103470 2023-08-10T11:55:40.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.274+0000 7f856c51f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856410f4c0 con 0x7f8564102ab0 2023-08-10T11:55:40.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.275+0000 7f856a2bb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8564102ab0 0x7f8564118a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:40.278 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.275+0000 7f856a2bb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8564102ab0 0x7f8564118a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60132/0 (socket says 172.21.15.73:60132) 2023-08-10T11:55:40.278 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.275+0000 7f856a2bb700 1 -- 172.21.15.73:0/126151 learned_addr learned my addr 172.21.15.73:0/126151 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:40.286 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.284+0000 7f856a2bb700 1 -- 172.21.15.73:0/126151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8564103470 msgr2=0x7f8564118f60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-10T11:55:40.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.284+0000 7f856a2bb700 1 --2- 172.21.15.73:0/126151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8564103470 0x7f8564118f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:40.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.285+0000 7f856a2bb700 1 -- 172.21.15.73:0/126151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f856410e6d0 msgr2=0x7f856410eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:40.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.285+0000 7f856a2bb700 1 --2- 172.21.15.73:0/126151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f856410e6d0 0x7f856410eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:40.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.285+0000 7f856a2bb700 1 -- 172.21.15.73:0/126151 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85540095f0 con 0x7f8564102ab0 2023-08-10T11:55:40.295 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.293+0000 7f856a2bb700 1 --2- 172.21.15.73:0/126151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8564102ab0 0x7f8564118a20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8554015000 tx=0x7f855400bfb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:40.296 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.294+0000 7f855b7fe700 1 -- 172.21.15.73:0/126151 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855401d070 con 0x7f8564102ab0 2023-08-10T11:55:40.296 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.294+0000 7f855b7fe700 1 -- 172.21.15.73:0/126151 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8554003d50 con 0x7f8564102ab0 2023-08-10T11:55:40.296 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.294+0000 7f855b7fe700 1 -- 172.21.15.73:0/126151 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855400fe10 con 0x7f8564102ab0 2023-08-10T11:55:40.296 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.294+0000 7f856c51f700 1 -- 172.21.15.73:0/126151 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8564114590 con 0x7f8564102ab0 2023-08-10T11:55:40.297 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.294+0000 7f856c51f700 1 -- 172.21.15.73:0/126151 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8564114990 con 0x7f8564102ab0 2023-08-10T11:55:40.307 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.306+0000 7f85786b8b80 1 Processor -- start 2023-08-10T11:55:40.308 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.306+0000 7f85786b8b80 1 -- start start 2023-08-10T11:55:40.309 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.307+0000 7f85786b8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e135559a40 0x55e135559e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:40.309 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.307+0000 7f85786b8b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e13555a360 0x55e135554010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:40.309 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.307+0000 7f85786b8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e135554550 0x55e1355549d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:40.309 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.307+0000 7f85786b8b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1354cfd60 con 0x55e13555a360 2023-08-10T11:55:40.309 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.307+0000 7f85786b8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1354ac530 con 0x55e135554550 2023-08-10T11:55:40.309 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.307+0000 7f85786b8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1354a9e50 con 0x55e135559a40 2023-08-10T11:55:40.310 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.308+0000 7f856aabc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e135559a40 0x55e135559e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:40.310 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.308+0000 7f856aabc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e135559a40 0x55e135559e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60136/0 (socket says 172.21.15.73:60136) 2023-08-10T11:55:40.310 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.308+0000 7f856aabc700 1 -- 172.21.15.73:0/2652285161 learned_addr learned my addr 172.21.15.73:0/2652285161 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:40.311 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.308+0000 7f856aabc700 1 -- 172.21.15.73:0/2652285161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e135554550 msgr2=0x55e1355549d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T11:55:40.311 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.308+0000 7f856aabc700 1 --2- 172.21.15.73:0/2652285161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e135554550 0x55e1355549d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:40.311 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.308+0000 7f856aabc700 1 -- 172.21.15.73:0/2652285161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e13555a360 msgr2=0x55e135554010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T11:55:40.311 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.308+0000 7f856aabc700 1 --2- 172.21.15.73:0/2652285161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e13555a360 0x55e135554010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:40.311 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.308+0000 7f856aabc700 1 -- 172.21.15.73:0/2652285161 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1353265d0 con 0x55e135559a40 2023-08-10T11:55:40.311 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.308+0000 7f856aabc700 1 --2- 172.21.15.73:0/2652285161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e135559a40 0x55e135559e20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f855c00e410 tx=0x7f855c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54e0b74f06c3c77f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:40.311 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.309+0000 7f855b7fe700 1 -- 172.21.15.73:0/126151 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f855400f460 con 0x7f8564102ab0 2023-08-10T11:55:40.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.310+0000 7f855b7fe700 1 --2- 172.21.15.73:0/126151 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f85500a1450 0x7f85500a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:40.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.310+0000 7f855b7fe700 1 -- 172.21.15.73:0/126151 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f85540cdd50 con 0x7f8564102ab0 2023-08-10T11:55:40.321 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.319+0000 7f856a2bb700 1 --2- 172.21.15.73:0/126151 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f85500a1450 0x7f85500a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:40.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.325+0000 7f8558ff9700 1 -- 172.21.15.73:0/2652285161 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c018070 con 0x55e135559a40 2023-08-10T11:55:40.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.325+0000 7f8558ff9700 1 -- 172.21.15.73:0/2652285161 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f855c004bb0 con 0x55e135559a40 2023-08-10T11:55:40.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.325+0000 7f8558ff9700 1 -- 172.21.15.73:0/2652285161 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c010040 con 0x55e135559a40 2023-08-10T11:55:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.326+0000 7f85786b8b80 1 -- 172.21.15.73:0/2652285161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e135559a40 msgr2=0x55e135559e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.326+0000 7f85786b8b80 1 --2- 172.21.15.73:0/2652285161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e135559a40 0x55e135559e20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f855c00e410 tx=0x7f855c00b040 comp rx=0 tx=0).stop 2023-08-10T11:55:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.329+0000 7f85786b8b80 1 -- 172.21.15.73:0/2652285161 shutdown_connections 2023-08-10T11:55:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.329+0000 7f85786b8b80 1 --2- 172.21.15.73:0/2652285161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e135554550 0x55e1355549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.329+0000 7f85786b8b80 1 --2- 172.21.15.73:0/2652285161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e135559a40 0x55e135559e20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.329+0000 7f85786b8b80 1 --2- 172.21.15.73:0/2652285161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e13555a360 0x55e135554010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.329+0000 7f85786b8b80 1 -- 172.21.15.73:0/2652285161 >> 172.21.15.73:0/2652285161 conn(0x55e1354b1c70 msgr2=0x55e13554ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.340+0000 7f856a2bb700 1 --2- 172.21.15.73:0/126151 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f85500a1450 0x7f85500a3910 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55e135550680 tx=0x7f855401a040 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.350+0000 7f85786b8b80 1 -- 172.21.15.73:0/2652285161 shutdown_connections 2023-08-10T11:55:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.359+0000 7f85786b8b80 1 -- 172.21.15.73:0/2652285161 wait complete. 2023-08-10T11:55:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.360+0000 7f85786b8b80 1 -- start start 2023-08-10T11:55:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.360+0000 7f85786b8b80 1 Processor -- start 2023-08-10T11:55:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.360+0000 7f85786b8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e135554550 0x55e135560410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:40.364 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.360+0000 7f85786b8b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e135559a40 0x55e13555d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:40.364 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.360+0000 7f85786b8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e13555a360 0x55e13555dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:40.364 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.360+0000 7f85786b8b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1354a5740 con 0x55e135559a40 2023-08-10T11:55:40.364 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.360+0000 7f85786b8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e135444a60 con 0x55e135554550 2023-08-10T11:55:40.364 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.360+0000 7f85786b8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e135444760 con 0x55e13555a360 2023-08-10T11:55:40.365 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.361+0000 7f85786b8b80 10 client.0 _ll_register_callbacks cb 0x55e135442620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:55:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.372+0000 7f856aabc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e13555a360 0x55e13555dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.372+0000 7f856aabc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e13555a360 0x55e13555dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60142/0 (socket says 172.21.15.73:60142) 2023-08-10T11:55:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.372+0000 7f856aabc700 1 -- 172.21.15.73:0/684729527 learned_addr learned my addr 172.21.15.73:0/684729527 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.372+0000 7f856aabc700 1 --2- 172.21.15.73:0/684729527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e135554550 0x55e135560410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.372+0000 7f856aabc700 1 -- 172.21.15.73:0/684729527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e135554550 msgr2=0x55e135560410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.372+0000 7f856aabc700 1 --2- 172.21.15.73:0/684729527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e135554550 0x55e135560410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.372+0000 7f856aabc700 1 -- 172.21.15.73:0/684729527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e135559a40 msgr2=0x55e13555d690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T11:55:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.372+0000 7f856aabc700 1 --2- 172.21.15.73:0/684729527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e135559a40 0x55e13555d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.372+0000 7f856aabc700 1 -- 172.21.15.73:0/684729527 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855c00e0c0 con 0x55e13555a360 2023-08-10T11:55:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.374+0000 7f856aabc700 1 --2- 172.21.15.73:0/684729527 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e13555a360 0x55e13555dd80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f855c00eab0 tx=0x7f855c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a03164fb94fcfdf server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.548+0000 7f854dffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T11:55:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.548+0000 7f854dffb700 1 -- 172.21.15.73:0/684729527 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c018040 con 0x55e13555a360 2023-08-10T11:55:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.548+0000 7f854dffb700 1 -- 172.21.15.73:0/684729527 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f855c007500 con 0x55e13555a360 2023-08-10T11:55:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.550+0000 7f85786b8b80 1 -- 172.21.15.73:0/684729527 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e1355471c0 con 0x55e13555a360 2023-08-10T11:55:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.570+0000 7f854dffb700 1 -- 172.21.15.73:0/684729527 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f855c007700 con 0x55e13555a360 2023-08-10T11:55:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.570+0000 7f85786b8b80 10 client.25687 fetch_fsmap learned FSMap version 32 2023-08-10T11:55:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.570+0000 7f85786b8b80 1 -- 172.21.15.73:0/684729527 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55e1352d2d80 con 0x55e13555a360 2023-08-10T11:55:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.574+0000 7f854dffb700 1 -- 172.21.15.73:0/684729527 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e1355471c0 con 0x55e13555a360 2023-08-10T11:55:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.574+0000 7f854dffb700 1 -- 172.21.15.73:0/684729527 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 32) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f855c01e070 con 0x55e13555a360 2023-08-10T11:55:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.576+0000 7f85786b8b80 10 client.25687 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T11:55:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.576+0000 7f85786b8b80 10 client.25687 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:55:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.576+0000 7f85786b8b80 20 client.25687 populate_metadata read hostname 'smithi073' 2023-08-10T11:55:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.576+0000 7f85786b8b80 1 --2- 172.21.15.73:0/684729527 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e13556dd00 0x55e135570120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.576+0000 7f85786b8b80 4 client.25687 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:55:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.576+0000 7f85786b8b80 1 -- 172.21.15.73:0/684729527 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e135523970 con 0x55e13556dd00 2023-08-10T11:55:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.586+0000 7f8569aba700 1 --2- 172.21.15.73:0/684729527 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e13556dd00 0x55e135570120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.587+0000 7f8569aba700 1 --2- 172.21.15.73:0/684729527 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e13556dd00 0x55e135570120 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd047adc8e2dbc06 server_cookie=842a50bedb8f25ad in_seq=0 out_seq=0 2023-08-10T11:55:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.587+0000 7f854dffb700 10 client.25687 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:55:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.589+0000 7f854dffb700 1 -- 172.21.15.73:0/684729527 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55e135523970 con 0x55e13556dd00 2023-08-10T11:55:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.589+0000 7f854dffb700 10 client.25687 handle_command_reply: tid=0 2023-08-10T11:55:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.589+0000 7f85786b8b80 1 client.25687 shutdown 2023-08-10T11:55:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.593+0000 7f85786b8b80 1 -- 172.21.15.73:0/684729527 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e13555a360 msgr2=0x55e13555dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.593+0000 7f85786b8b80 1 --2- 172.21.15.73:0/684729527 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e13555a360 0x55e13555dd80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f855c00eab0 tx=0x7f855c004ad0 comp rx=0 tx=0).stop 2023-08-10T11:55:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.593+0000 7f85786b8b80 1 -- 172.21.15.73:0/684729527 shutdown_connections 2023-08-10T11:55:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.593+0000 7f85786b8b80 1 --2- 172.21.15.73:0/684729527 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e13556dd00 0x55e135570120 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.593+0000 7f85786b8b80 1 --2- 172.21.15.73:0/684729527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e135554550 0x55e135560410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.593+0000 7f85786b8b80 1 --2- 172.21.15.73:0/684729527 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e13555a360 0x55e13555dd80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.593+0000 7f85786b8b80 1 --2- 172.21.15.73:0/684729527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e135559a40 0x55e13555d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.593+0000 7f85786b8b80 1 -- 172.21.15.73:0/684729527 >> 172.21.15.73:0/684729527 conn(0x55e1354b1c70 msgr2=0x55e13554e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.593+0000 7f854dffb700 0 client.25687 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:55:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.593+0000 7f85786b8b80 1 -- 172.21.15.73:0/684729527 shutdown_connections 2023-08-10T11:55:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.594+0000 7f85786b8b80 1 -- 172.21.15.73:0/684729527 wait complete. 2023-08-10T11:55:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.594+0000 7f85786b8b80 20 client.25687 trim_cache size 0 max 16384 2023-08-10T11:55:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.626+0000 7f85786b8b80 1 Processor -- start 2023-08-10T11:55:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.626+0000 7f85786b8b80 1 -- start start 2023-08-10T11:55:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.626+0000 7f85786b8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e135554550 0x55e135574a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.626+0000 7f85786b8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e135559a40 0x55e13554ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.626+0000 7f85786b8b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e13555a360 0x55e13555cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.626+0000 7f85786b8b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1353288c0 con 0x55e13555a360 2023-08-10T11:55:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.626+0000 7f85786b8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e13555a070 con 0x55e135559a40 2023-08-10T11:55:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.626+0000 7f85786b8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e13554fe90 con 0x55e135554550 2023-08-10T11:55:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.627+0000 7f856aabc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e13555a360 0x55e13555cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.627+0000 7f856aabc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e135554550 0x55e135574a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.627+0000 7f8569aba700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e135559a40 0x55e13554ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.627+0000 7f8569aba700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e135559a40 0x55e13554ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49298/0 (socket says 172.21.15.73:49298) 2023-08-10T11:55:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.627+0000 7f8569aba700 1 -- 172.21.15.73:0/2907858349 learned_addr learned my addr 172.21.15.73:0/2907858349 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.628+0000 7f856aabc700 1 -- 172.21.15.73:0/2907858349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e135559a40 msgr2=0x55e13554ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.628+0000 7f856aabc700 1 --2- 172.21.15.73:0/2907858349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e135559a40 0x55e13554ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.628+0000 7f856aabc700 1 -- 172.21.15.73:0/2907858349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e13555a360 msgr2=0x55e13555cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.628+0000 7f856aabc700 1 --2- 172.21.15.73:0/2907858349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e13555a360 0x55e13555cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.628+0000 7f856aabc700 1 -- 172.21.15.73:0/2907858349 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1352bbc00 con 0x55e135554550 2023-08-10T11:55:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.629+0000 7f856aabc700 1 --2- 172.21.15.73:0/2907858349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e135554550 0x55e135574a80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f855c0092b0 tx=0x7f855c009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d9dac4f1ec298a4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.705+0000 7f85597fa700 1 -- 172.21.15.73:0/2907858349 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c018030 con 0x55e135554550 2023-08-10T11:55:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.705+0000 7f85597fa700 1 -- 172.21.15.73:0/2907858349 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f855c009990 con 0x55e135554550 2023-08-10T11:55:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.705+0000 7f85597fa700 1 -- 172.21.15.73:0/2907858349 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c01fcc0 con 0x55e135554550 2023-08-10T11:55:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.708+0000 7f85786b8b80 1 -- 172.21.15.73:0/2907858349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e135554550 msgr2=0x55e135574a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.708+0000 7f85786b8b80 1 --2- 172.21.15.73:0/2907858349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e135554550 0x55e135574a80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f855c0092b0 tx=0x7f855c009920 comp rx=0 tx=0).stop 2023-08-10T11:55:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.708+0000 7f85786b8b80 1 -- 172.21.15.73:0/2907858349 shutdown_connections 2023-08-10T11:55:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.708+0000 7f85786b8b80 1 --2- 172.21.15.73:0/2907858349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e13555a360 0x55e13555cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.708+0000 7f85786b8b80 1 --2- 172.21.15.73:0/2907858349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e135554550 0x55e135574a80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.708+0000 7f85786b8b80 1 --2- 172.21.15.73:0/2907858349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e135559a40 0x55e13554ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.708+0000 7f85786b8b80 1 -- 172.21.15.73:0/2907858349 >> 172.21.15.73:0/2907858349 conn(0x55e1354b1c70 msgr2=0x55e1355578d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:40.712 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.708+0000 7f85786b8b80 1 -- 172.21.15.73:0/2907858349 shutdown_connections 2023-08-10T11:55:40.712 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.709+0000 7f85786b8b80 1 -- 172.21.15.73:0/2907858349 wait complete. 2023-08-10T11:55:40.712 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.709+0000 7f85786b8b80 1 -- start start 2023-08-10T11:55:40.713 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.709+0000 7f85786b8b80 1 Processor -- start 2023-08-10T11:55:40.733 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.710+0000 7f85786b8b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e135554550 0x55e135562e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:40.734 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.710+0000 7f85786b8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e135559a40 0x55e135563340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:40.734 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.710+0000 7f85786b8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e13555a360 0x55e135563880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:40.734 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.710+0000 7f85786b8b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1355c0a50 con 0x55e135554550 2023-08-10T11:55:40.734 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.710+0000 7f85786b8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1355c0b90 con 0x55e13555a360 2023-08-10T11:55:40.734 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.710+0000 7f85786b8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1355c0d20 con 0x55e135559a40 2023-08-10T11:55:40.734 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.710+0000 7f85786b8b80 10 client.0 _ll_register_callbacks cb 0x55e135442620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:55:40.734 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.731+0000 7f8569aba700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e135559a40 0x55e135563340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:40.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.731+0000 7f8569aba700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e135559a40 0x55e135563340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60154/0 (socket says 172.21.15.73:60154) 2023-08-10T11:55:40.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.731+0000 7f8569aba700 1 -- 172.21.15.73:0/1393329917 learned_addr learned my addr 172.21.15.73:0/1393329917 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:40.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.731+0000 7f856aabc700 1 --2- 172.21.15.73:0/1393329917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e13555a360 0x55e135563880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:40.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.732+0000 7f8569aba700 1 -- 172.21.15.73:0/1393329917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e13555a360 msgr2=0x55e135563880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:40.736 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.732+0000 7f8569aba700 1 --2- 172.21.15.73:0/1393329917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e13555a360 0x55e135563880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:40.736 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.732+0000 7f8569aba700 1 -- 172.21.15.73:0/1393329917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e135554550 msgr2=0x55e135562e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:40.736 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.732+0000 7f8569aba700 1 --2- 172.21.15.73:0/1393329917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e135554550 0x55e135562e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:40.736 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.732+0000 7f8569aba700 1 -- 172.21.15.73:0/1393329917 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e1352d2d80 con 0x55e135559a40 2023-08-10T11:55:40.741 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.739+0000 7f8569aba700 1 --2- 172.21.15.73:0/1393329917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e135559a40 0x55e135563340 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f856410f9d0 tx=0x7f8560017500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b0c9447e1846445 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:40.901 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.898+0000 7f854dffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T11:55:40.901 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.898+0000 7f854dffb700 1 -- 172.21.15.73:0/1393329917 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8560015040 con 0x55e135559a40 2023-08-10T11:55:40.901 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.898+0000 7f854dffb700 1 -- 172.21.15.73:0/1393329917 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8560004500 con 0x55e135559a40 2023-08-10T11:55:40.901 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.898+0000 7f85786b8b80 1 -- 172.21.15.73:0/1393329917 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f855c004bb0 con 0x55e135559a40 2023-08-10T11:55:40.901 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.899+0000 7f854dffb700 1 -- 172.21.15.73:0/1393329917 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8560017810 con 0x55e135559a40 2023-08-10T11:55:40.902 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.899+0000 7f85786b8b80 10 client.25693 fetch_fsmap learned FSMap version 32 2023-08-10T11:55:40.902 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.899+0000 7f85786b8b80 1 -- 172.21.15.73:0/1393329917 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55e1352f91f0 con 0x55e135559a40 2023-08-10T11:55:40.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.902+0000 7f854dffb700 1 -- 172.21.15.73:0/1393329917 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f855c004bb0 con 0x55e135559a40 2023-08-10T11:55:40.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.902+0000 7f854dffb700 1 -- 172.21.15.73:0/1393329917 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 32) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f8560020470 con 0x55e135559a40 2023-08-10T11:55:40.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.902+0000 7f85786b8b80 10 client.25693 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T11:55:40.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.902+0000 7f85786b8b80 10 client.25693 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:55:40.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.902+0000 7f85786b8b80 20 client.25693 populate_metadata read hostname 'smithi073' 2023-08-10T11:55:40.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.902+0000 7f85786b8b80 1 --2- 172.21.15.73:0/1393329917 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e1355c2590 0x55e1355c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:40.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.902+0000 7f85786b8b80 4 client.25693 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:55:40.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.902+0000 7f85786b8b80 1 -- 172.21.15.73:0/1393329917 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e13549e720 con 0x55e1355c2590 2023-08-10T11:55:40.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.904+0000 7f856aabc700 1 --2- 172.21.15.73:0/1393329917 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e1355c2590 0x55e1355c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:40.933 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.927+0000 7f856aabc700 1 --2- 172.21.15.73:0/1393329917 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e1355c2590 0x55e1355c49b0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56ddf4953052936b server_cookie=2281789d3a25db13 in_seq=0 out_seq=0 2023-08-10T11:55:40.934 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:40.927+0000 7f854dffb700 10 client.25693 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:55:40.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:40 smithi152 ceph-mon[130220]: pgmap v94: 97 pgs: 97 active+clean; 489 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.4 MiB/s wr, 492 op/s 2023-08-10T11:55:41.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:40 smithi156 ceph-mon[130574]: pgmap v94: 97 pgs: 97 active+clean; 489 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.4 MiB/s wr, 492 op/s 2023-08-10T11:55:41.024 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:40 smithi073 ceph-mon[128869]: pgmap v94: 97 pgs: 97 active+clean; 489 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.4 MiB/s wr, 492 op/s 2023-08-10T11:55:41.495 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:55:42.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.012+0000 7f11f6d62700 1 -- 172.21.15.73:0/2165446451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11f010cc80 msgr2=0x7f11f010d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:42.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.012+0000 7f11f6d62700 1 --2- 172.21.15.73:0/2165446451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11f010cc80 0x7f11f010d060 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f11e0009d40 tx=0x7f11e000b540 comp rx=0 tx=0).stop 2023-08-10T11:55:42.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.013+0000 7f11f6d62700 1 -- 172.21.15.73:0/2165446451 shutdown_connections 2023-08-10T11:55:42.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.013+0000 7f11f6d62700 1 --2- 172.21.15.73:0/2165446451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11f010cc80 0x7f11f010d060 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:42.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.013+0000 7f11f6d62700 1 --2- 172.21.15.73:0/2165446451 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11f010c2f0 0x7f11f00789f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:42.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.013+0000 7f11f6d62700 1 --2- 172.21.15.73:0/2165446451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11f010b930 0x7f11f010bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:42.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.013+0000 7f11f6d62700 1 -- 172.21.15.73:0/2165446451 >> 172.21.15.73:0/2165446451 conn(0x7f11f006ca30 msgr2=0x7f11f006ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:42.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.013+0000 7f11f6d62700 1 -- 172.21.15.73:0/2165446451 shutdown_connections 2023-08-10T11:55:42.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.013+0000 7f11f6d62700 1 -- 172.21.15.73:0/2165446451 wait complete. 2023-08-10T11:55:42.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.014+0000 7f11f6d62700 1 Processor -- start 2023-08-10T11:55:42.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.014+0000 7f11f6d62700 1 -- start start 2023-08-10T11:55:42.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.014+0000 7f11f6d62700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11f010b930 0x7f11f00785b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:42.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.014+0000 7f11f6d62700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11f010c2f0 0x7f11f00745b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:42.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.014+0000 7f11f6d62700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11f010cc80 0x7f11f0074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:42.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.014+0000 7f11f6d62700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f00750f0 con 0x7f11f010c2f0 2023-08-10T11:55:42.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.014+0000 7f11f6d62700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f0075260 con 0x7f11f010b930 2023-08-10T11:55:42.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.014+0000 7f11f6d62700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f0075420 con 0x7f11f010cc80 2023-08-10T11:55:42.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.019+0000 7f11effff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11f010c2f0 0x7f11f00745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:42.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.019+0000 7f11effff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11f010c2f0 0x7f11f00745b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34664/0 (socket says 172.21.15.73:34664) 2023-08-10T11:55:42.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.019+0000 7f11effff700 1 -- 172.21.15.73:0/4230255885 learned_addr learned my addr 172.21.15.73:0/4230255885 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:42.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.019+0000 7f11f52ff700 1 --2- 172.21.15.73:0/4230255885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11f010cc80 0x7f11f0074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:42.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.019+0000 7f11f4afe700 1 --2- 172.21.15.73:0/4230255885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11f010b930 0x7f11f00785b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:42.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.033+0000 7f11f52ff700 1 -- 172.21.15.73:0/4230255885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11f010b930 msgr2=0x7f11f00785b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:42.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.033+0000 7f11f52ff700 1 --2- 172.21.15.73:0/4230255885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11f010b930 0x7f11f00785b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:42.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.033+0000 7f11f52ff700 1 -- 172.21.15.73:0/4230255885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11f010c2f0 msgr2=0x7f11f00745b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:42.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.033+0000 7f11f52ff700 1 --2- 172.21.15.73:0/4230255885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11f010c2f0 0x7f11f00745b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:42.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.033+0000 7f11f52ff700 1 -- 172.21.15.73:0/4230255885 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e0009520 con 0x7f11f010cc80 2023-08-10T11:55:42.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.046+0000 7f11f52ff700 1 --2- 172.21.15.73:0/4230255885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11f010cc80 0x7f11f0074af0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f11e800efc0 tx=0x7f11e800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:42.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.047+0000 7f11edffb700 1 -- 172.21.15.73:0/4230255885 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e8018070 con 0x7f11f010cc80 2023-08-10T11:55:42.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.047+0000 7f11edffb700 1 -- 172.21.15.73:0/4230255885 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f11e800f040 con 0x7f11f010cc80 2023-08-10T11:55:42.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.047+0000 7f11edffb700 1 -- 172.21.15.73:0/4230255885 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e800cdb0 con 0x7f11f010cc80 2023-08-10T11:55:42.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.052+0000 7f11f6d62700 1 -- 172.21.15.73:0/4230255885 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f01bc8f0 con 0x7f11f010cc80 2023-08-10T11:55:42.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.052+0000 7f11f6d62700 1 -- 172.21.15.73:0/4230255885 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f01bcdb0 con 0x7f11f010cc80 2023-08-10T11:55:42.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.059+0000 7f1202efbb80 1 Processor -- start 2023-08-10T11:55:42.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.068+0000 7f1202efbb80 1 -- start start 2023-08-10T11:55:42.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.068+0000 7f1202efbb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ea1f5a890 0x556ea1f5ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:42.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.068+0000 7f1202efbb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea1f5b1b0 0x556ea1f4c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:42.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.068+0000 7f1202efbb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ea1f4c800 0x556ea1f4cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:42.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.068+0000 7f1202efbb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ea1ec7dc0 con 0x556ea1f5a890 2023-08-10T11:55:42.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.068+0000 7f1202efbb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ea1ea4590 con 0x556ea1f5b1b0 2023-08-10T11:55:42.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.068+0000 7f1202efbb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ea1ea1eb0 con 0x556ea1f4c800 2023-08-10T11:55:42.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.069+0000 7f11f4afe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea1f5b1b0 0x556ea1f4c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:42.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.069+0000 7f11f4afe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea1f5b1b0 0x556ea1f4c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49324/0 (socket says 172.21.15.73:49324) 2023-08-10T11:55:42.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.069+0000 7f11f4afe700 1 -- 172.21.15.73:0/2274869856 learned_addr learned my addr 172.21.15.73:0/2274869856 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:42.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.069+0000 7f11effff700 1 --2- 172.21.15.73:0/2274869856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ea1f4c800 0x556ea1f4cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:42.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.093+0000 7f11effff700 1 -- 172.21.15.73:0/2274869856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea1f5b1b0 msgr2=0x556ea1f4c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:42.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.093+0000 7f11effff700 1 --2- 172.21.15.73:0/2274869856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea1f5b1b0 0x556ea1f4c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:42.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.093+0000 7f11effff700 1 -- 172.21.15.73:0/2274869856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ea1f5a890 msgr2=0x556ea1f5ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:42.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.093+0000 7f11effff700 1 --2- 172.21.15.73:0/2274869856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ea1f5a890 0x556ea1f5ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:42.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.093+0000 7f11effff700 1 -- 172.21.15.73:0/2274869856 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ea1d1e630 con 0x556ea1f4c800 2023-08-10T11:55:42.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.093+0000 7f11edffb700 1 -- 172.21.15.73:0/4230255885 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f11e8007500 con 0x7f11f010cc80 2023-08-10T11:55:42.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.094+0000 7f11edffb700 1 --2- 172.21.15.73:0/4230255885 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f11d80a14d0 0x7f11d80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:42.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.095+0000 7f11edffb700 1 -- 172.21.15.73:0/4230255885 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f11e80cbe70 con 0x7f11f010cc80 2023-08-10T11:55:42.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.095+0000 7f11effff700 1 --2- 172.21.15.73:0/2274869856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ea1f4c800 0x556ea1f4cc60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f11f007cab0 tx=0x7f11e4012730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba98f058b335d152 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:42.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.326+0000 7f11f4afe700 1 --2- 172.21.15.73:0/4230255885 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f11d80a14d0 0x7f11d80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:42.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.336+0000 7f11d6ffd700 1 -- 172.21.15.73:0/2274869856 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e4012e60 con 0x556ea1f4c800 2023-08-10T11:55:42.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.336+0000 7f11d6ffd700 1 -- 172.21.15.73:0/2274869856 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f11e4009e70 con 0x556ea1f4c800 2023-08-10T11:55:42.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.336+0000 7f11d6ffd700 1 -- 172.21.15.73:0/2274869856 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e400f430 con 0x556ea1f4c800 2023-08-10T11:55:42.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.337+0000 7f1202efbb80 1 -- 172.21.15.73:0/2274869856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ea1f4c800 msgr2=0x556ea1f4cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:42.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.337+0000 7f1202efbb80 1 --2- 172.21.15.73:0/2274869856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ea1f4c800 0x556ea1f4cc60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f11f007cab0 tx=0x7f11e4012730 comp rx=0 tx=0).stop 2023-08-10T11:55:42.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.340+0000 7f1202efbb80 1 -- 172.21.15.73:0/2274869856 shutdown_connections 2023-08-10T11:55:42.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.340+0000 7f1202efbb80 1 --2- 172.21.15.73:0/2274869856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ea1f4c800 0x556ea1f4cc60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:42.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.340+0000 7f1202efbb80 1 --2- 172.21.15.73:0/2274869856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ea1f5a890 0x556ea1f5ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:42.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.340+0000 7f1202efbb80 1 --2- 172.21.15.73:0/2274869856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea1f5b1b0 0x556ea1f4c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:42.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.340+0000 7f1202efbb80 1 -- 172.21.15.73:0/2274869856 >> 172.21.15.73:0/2274869856 conn(0x556ea1ea9cd0 msgr2=0x556ea1f476e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:42.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.375+0000 7f1202efbb80 1 -- 172.21.15.73:0/2274869856 shutdown_connections 2023-08-10T11:55:42.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.412+0000 7f11f4afe700 1 --2- 172.21.15.73:0/4230255885 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f11d80a14d0 0x7f11d80a3990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x556ea1f487b0 tx=0x7f11e0019040 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:42.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.423+0000 7f1202efbb80 1 -- 172.21.15.73:0/2274869856 wait complete. 2023-08-10T11:55:42.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.423+0000 7f1202efbb80 1 -- start start 2023-08-10T11:55:42.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.423+0000 7f1202efbb80 1 Processor -- start 2023-08-10T11:55:42.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.424+0000 7f1202efbb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ea1f4c800 0x556ea1f5e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:42.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.424+0000 7f1202efbb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea1f5a890 0x556ea1f5ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:42.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.424+0000 7f1202efbb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ea1f5b1b0 0x556ea1f5ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:42.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.424+0000 7f1202efbb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ea1e9d7a0 con 0x556ea1f4c800 2023-08-10T11:55:42.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.424+0000 7f1202efbb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ea1e3cac0 con 0x556ea1f5a890 2023-08-10T11:55:42.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.424+0000 7f1202efbb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ea1e3c7c0 con 0x556ea1f5b1b0 2023-08-10T11:55:42.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.424+0000 7f1202efbb80 10 client.0 _ll_register_callbacks cb 0x556ea1e3a680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:55:42.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.425+0000 7f11effff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea1f5a890 0x556ea1f5ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:42.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.425+0000 7f11f52ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ea1f5b1b0 0x556ea1f5ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:42.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.425+0000 7f11f52ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ea1f5b1b0 0x556ea1f5ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60184/0 (socket says 172.21.15.73:60184) 2023-08-10T11:55:42.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.425+0000 7f11f52ff700 1 -- 172.21.15.73:0/2636751022 learned_addr learned my addr 172.21.15.73:0/2636751022 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:42.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.425+0000 7f11f52ff700 1 -- 172.21.15.73:0/2636751022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea1f5a890 msgr2=0x556ea1f5ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:42.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.425+0000 7f11f52ff700 1 --2- 172.21.15.73:0/2636751022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea1f5a890 0x556ea1f5ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:42.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.425+0000 7f11f52ff700 1 -- 172.21.15.73:0/2636751022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ea1f4c800 msgr2=0x556ea1f5e500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T11:55:42.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.425+0000 7f11f52ff700 1 --2- 172.21.15.73:0/2636751022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ea1f4c800 0x556ea1f5e500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:42.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.425+0000 7f11f52ff700 1 -- 172.21.15.73:0/2636751022 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e4009a30 con 0x556ea1f5b1b0 2023-08-10T11:55:42.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.430+0000 7f11f52ff700 1 --2- 172.21.15.73:0/2636751022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ea1f5b1b0 0x556ea1f5ef80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f11e800ef90 tx=0x7f11e80c9af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8989c961c3e3734e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:42.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.576+0000 7f11cffff700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T11:55:42.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.576+0000 7f11cffff700 1 -- 172.21.15.73:0/2636751022 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e8098600 con 0x556ea1f5b1b0 2023-08-10T11:55:42.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.576+0000 7f11cffff700 1 -- 172.21.15.73:0/2636751022 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f11e809cf40 con 0x556ea1f5b1b0 2023-08-10T11:55:42.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.576+0000 7f1202efbb80 1 -- 172.21.15.73:0/2636751022 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556ea1f3f470 con 0x556ea1f5b1b0 2023-08-10T11:55:42.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.587+0000 7f11cffff700 1 -- 172.21.15.73:0/2636751022 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11e80a1360 con 0x556ea1f5b1b0 2023-08-10T11:55:42.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.587+0000 7f1202efbb80 10 client.25705 fetch_fsmap learned FSMap version 32 2023-08-10T11:55:42.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.587+0000 7f1202efbb80 1 -- 172.21.15.73:0/2636751022 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x556ea1ccade0 con 0x556ea1f5b1b0 2023-08-10T11:55:42.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.588+0000 7f11cffff700 1 -- 172.21.15.73:0/2636751022 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556ea1f3f470 con 0x556ea1f5b1b0 2023-08-10T11:55:42.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.590+0000 7f11cffff700 1 -- 172.21.15.73:0/2636751022 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 32) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f11e8094d00 con 0x556ea1f5b1b0 2023-08-10T11:55:42.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.595+0000 7f1202efbb80 10 client.25705 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T11:55:42.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.595+0000 7f1202efbb80 10 client.25705 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:55:42.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.595+0000 7f1202efbb80 20 client.25705 populate_metadata read hostname 'smithi073' 2023-08-10T11:55:42.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.595+0000 7f1202efbb80 1 --2- 172.21.15.73:0/2636751022 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x556ea1f6ecb0 0x556ea1f710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:42.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.595+0000 7f1202efbb80 4 client.25705 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:55:42.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.595+0000 7f1202efbb80 1 -- 172.21.15.73:0/2636751022 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556ea1f1b9d0 con 0x556ea1f6ecb0 2023-08-10T11:55:42.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.597+0000 7f11f4afe700 1 --2- 172.21.15.73:0/2636751022 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x556ea1f6ecb0 0x556ea1f710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:42.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.615+0000 7f11f4afe700 1 --2- 172.21.15.73:0/2636751022 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x556ea1f6ecb0 0x556ea1f710d0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8394c8d62bc9e25f server_cookie=3440260b6e039ab8 in_seq=0 out_seq=0 2023-08-10T11:55:42.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:42.615+0000 7f11cffff700 10 client.25705 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:55:43.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:42 smithi152 ceph-mon[130220]: pgmap v95: 97 pgs: 97 active+clean; 489 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 121 op/s 2023-08-10T11:55:43.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:42 smithi156 ceph-mon[130574]: pgmap v95: 97 pgs: 97 active+clean; 489 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 121 op/s 2023-08-10T11:55:43.317 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:42 smithi073 ceph-mon[128869]: pgmap v95: 97 pgs: 97 active+clean; 489 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 121 op/s 2023-08-10T11:55:44.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:43 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:55:44.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:43 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:55:44.287 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:43 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:55:44.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:44.955+0000 7f11cffff700 1 -- 172.21.15.73:0/2636751022 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x556ea1f1b9d0 con 0x556ea1f6ecb0 2023-08-10T11:55:44.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:44.955+0000 7f11cffff700 10 client.25705 handle_command_reply: tid=0 2023-08-10T11:55:44.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:44.955+0000 7f1202efbb80 1 client.25705 shutdown 2023-08-10T11:55:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:44.963+0000 7f854dffb700 1 -- 172.21.15.73:0/1393329917 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e13549e720 con 0x55e1355c2590 2023-08-10T11:55:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:44.963+0000 7f854dffb700 10 client.25693 handle_command_reply: tid=0 2023-08-10T11:55:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:44.963+0000 7f85786b8b80 1 client.25693 shutdown 2023-08-10T11:55:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:44.964+0000 7f85786b8b80 1 -- 172.21.15.73:0/1393329917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e135559a40 msgr2=0x55e135563340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:44.964+0000 7f85786b8b80 1 --2- 172.21.15.73:0/1393329917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e135559a40 0x55e135563340 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f856410f9d0 tx=0x7f8560017500 comp rx=0 tx=0).stop 2023-08-10T11:55:44.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:44.964+0000 7f1202efbb80 1 -- 172.21.15.73:0/2636751022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ea1f5b1b0 msgr2=0x556ea1f5ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:44.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:44.964+0000 7f1202efbb80 1 --2- 172.21.15.73:0/2636751022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ea1f5b1b0 0x556ea1f5ef80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f11e800ef90 tx=0x7f11e80c9af0 comp rx=0 tx=0).stop 2023-08-10T11:55:44.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:44.964+0000 7f1202efbb80 1 -- 172.21.15.73:0/2636751022 shutdown_connections 2023-08-10T11:55:44.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:44.964+0000 7f1202efbb80 1 --2- 172.21.15.73:0/2636751022 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x556ea1f6ecb0 0x556ea1f710d0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:44.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:44.964+0000 7f1202efbb80 1 --2- 172.21.15.73:0/2636751022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ea1f5b1b0 0x556ea1f5ef80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:44.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:44.964+0000 7f1202efbb80 1 --2- 172.21.15.73:0/2636751022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ea1f4c800 0x556ea1f5e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:44.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:44.964+0000 7f1202efbb80 1 --2- 172.21.15.73:0/2636751022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea1f5a890 0x556ea1f5ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:44.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:44.964+0000 7f1202efbb80 1 -- 172.21.15.73:0/2636751022 >> 172.21.15.73:0/2636751022 conn(0x556ea1ea9cd0 msgr2=0x556ea1f470b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:44.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:44.964+0000 7f11cffff700 0 client.25705 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:55:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:44.964+0000 7f85786b8b80 1 -- 172.21.15.73:0/1393329917 shutdown_connections 2023-08-10T11:55:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:44.964+0000 7f85786b8b80 1 --2- 172.21.15.73:0/1393329917 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55e1355c2590 0x55e1355c49b0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:44.964+0000 7f85786b8b80 1 --2- 172.21.15.73:0/1393329917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e13555a360 0x55e135563880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:44.964+0000 7f85786b8b80 1 --2- 172.21.15.73:0/1393329917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e135554550 0x55e135562e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:44.964+0000 7f85786b8b80 1 --2- 172.21.15.73:0/1393329917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e135559a40 0x55e135563340 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:44.964+0000 7f85786b8b80 1 -- 172.21.15.73:0/1393329917 >> 172.21.15.73:0/1393329917 conn(0x55e1354b1c70 msgr2=0x55e135558850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:44.964+0000 7f854dffb700 0 client.25693 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:55:44.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:44.965+0000 7f1202efbb80 1 -- 172.21.15.73:0/2636751022 shutdown_connections 2023-08-10T11:55:44.973 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:44.965+0000 7f85786b8b80 1 -- 172.21.15.73:0/1393329917 shutdown_connections 2023-08-10T11:55:44.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:44.965+0000 7f1202efbb80 1 -- 172.21.15.73:0/2636751022 wait complete. 2023-08-10T11:55:44.975 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:44.965+0000 7f85786b8b80 1 -- 172.21.15.73:0/1393329917 wait complete. 2023-08-10T11:55:44.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:44.965+0000 7f1202efbb80 20 client.25705 trim_cache size 0 max 16384 2023-08-10T11:55:44.976 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:44.966+0000 7f85786b8b80 20 client.25693 trim_cache size 0 max 16384 2023-08-10T11:55:44.976 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:55:44.977 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:55:44.977 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:55:44.977 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:55:45.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:44 smithi152 ceph-mon[130220]: pgmap v96: 97 pgs: 97 active+clean; 541 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.6 MiB/s wr, 507 op/s 2023-08-10T11:55:45.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:44 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:55:45.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:44 smithi156 ceph-mon[130574]: pgmap v96: 97 pgs: 97 active+clean; 541 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.6 MiB/s wr, 507 op/s 2023-08-10T11:55:45.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:44 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:55:45.289 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:44 smithi073 ceph-mon[128869]: pgmap v96: 97 pgs: 97 active+clean; 541 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.6 MiB/s wr, 507 op/s 2023-08-10T11:55:45.290 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:44 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:55:45.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.368+0000 7f1202efbb80 1 Processor -- start 2023-08-10T11:55:45.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.368+0000 7f1202efbb80 1 -- start start 2023-08-10T11:55:45.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.368+0000 7f1202efbb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ea1f4c800 0x556ea1f65ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:45.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.368+0000 7f1202efbb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea1f5a890 0x556ea1f5bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:45.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.368+0000 7f1202efbb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ea1f5b1b0 0x556ea1f47130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:45.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.369+0000 7f1202efbb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ea1d20920 con 0x556ea1f4c800 2023-08-10T11:55:45.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.369+0000 7f1202efbb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ea1f4d240 con 0x556ea1f5a890 2023-08-10T11:55:45.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.369+0000 7f1202efbb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ea1f48600 con 0x556ea1f5b1b0 2023-08-10T11:55:45.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.369+0000 7f11effff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea1f5a890 0x556ea1f5bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:45.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.369+0000 7f11effff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea1f5a890 0x556ea1f5bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49338/0 (socket says 172.21.15.73:49338) 2023-08-10T11:55:45.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.369+0000 7f11effff700 1 -- 172.21.15.73:0/3584406525 learned_addr learned my addr 172.21.15.73:0/3584406525 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:45.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.369+0000 7f11effff700 1 -- 172.21.15.73:0/3584406525 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ea1f5b1b0 msgr2=0x556ea1f47130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T11:55:45.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.369+0000 7f11effff700 1 --2- 172.21.15.73:0/3584406525 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ea1f5b1b0 0x556ea1f47130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:45.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.369+0000 7f11effff700 1 -- 172.21.15.73:0/3584406525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ea1f4c800 msgr2=0x556ea1f65ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:45.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.369+0000 7f11effff700 1 --2- 172.21.15.73:0/3584406525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ea1f4c800 0x556ea1f65ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:45.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.369+0000 7f11effff700 1 -- 172.21.15.73:0/3584406525 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ea1f436a0 con 0x556ea1f5a890 2023-08-10T11:55:45.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.370+0000 7f11effff700 1 --2- 172.21.15.73:0/3584406525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea1f5a890 0x556ea1f5bca0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f11e4003bc0 tx=0x7f11e4009690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f30401414bd1303 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:45.654 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:45.642+0000 7f856c51f700 1 -- 172.21.15.73:0/126151 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f85500a1450 msgr2=0x7f85500a3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:45.655 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:45.642+0000 7f856c51f700 1 --2- 172.21.15.73:0/126151 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f85500a1450 0x7f85500a3910 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55e135550680 tx=0x7f855401a040 comp rx=0 tx=0).stop 2023-08-10T11:55:45.655 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:45.642+0000 7f856c51f700 1 -- 172.21.15.73:0/126151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8564102ab0 msgr2=0x7f8564118a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:45.655 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:45.642+0000 7f856c51f700 1 --2- 172.21.15.73:0/126151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8564102ab0 0x7f8564118a20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8554015000 tx=0x7f855400bfb0 comp rx=0 tx=0).stop 2023-08-10T11:55:45.655 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:45.653+0000 7f856c51f700 1 -- 172.21.15.73:0/126151 shutdown_connections 2023-08-10T11:55:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:45.653+0000 7f856c51f700 1 --2- 172.21.15.73:0/126151 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f85500a1450 0x7f85500a3910 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55e135550680 tx=0x7f855401a040 comp rx=0 tx=0).stop 2023-08-10T11:55:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:45.653+0000 7f856c51f700 1 --2- 172.21.15.73:0/126151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f856410e6d0 0x7f856410eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:45.653+0000 7f856c51f700 1 --2- 172.21.15.73:0/126151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8564102ab0 0x7f8564118a20 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8554015000 tx=0x7f855400bfb0 comp rx=0 tx=0).stop 2023-08-10T11:55:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:45.653+0000 7f856c51f700 1 --2- 172.21.15.73:0/126151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8564103470 0x7f8564118f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:45.653+0000 7f856c51f700 1 -- 172.21.15.73:0/126151 >> 172.21.15.73:0/126151 conn(0x7f8564076610 msgr2=0x7f85640769f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:45.653+0000 7f856c51f700 1 -- 172.21.15.73:0/126151 shutdown_connections 2023-08-10T11:55:45.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.689+0000 7f11d77fe700 1 -- 172.21.15.73:0/3584406525 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e4003740 con 0x556ea1f5a890 2023-08-10T11:55:45.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.689+0000 7f11d77fe700 1 -- 172.21.15.73:0/3584406525 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f11e4005580 con 0x556ea1f5a890 2023-08-10T11:55:45.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.689+0000 7f11d77fe700 1 -- 172.21.15.73:0/3584406525 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e400fa00 con 0x556ea1f5a890 2023-08-10T11:55:45.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.690+0000 7f1202efbb80 1 -- 172.21.15.73:0/3584406525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea1f5a890 msgr2=0x556ea1f5bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:45.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.690+0000 7f1202efbb80 1 --2- 172.21.15.73:0/3584406525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea1f5a890 0x556ea1f5bca0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f11e4003bc0 tx=0x7f11e4009690 comp rx=0 tx=0).stop 2023-08-10T11:55:45.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.690+0000 7f1202efbb80 1 -- 172.21.15.73:0/3584406525 shutdown_connections 2023-08-10T11:55:45.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.690+0000 7f1202efbb80 1 --2- 172.21.15.73:0/3584406525 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ea1f5b1b0 0x556ea1f47130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:45.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.690+0000 7f1202efbb80 1 --2- 172.21.15.73:0/3584406525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ea1f4c800 0x556ea1f65ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:45.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.690+0000 7f1202efbb80 1 --2- 172.21.15.73:0/3584406525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea1f5a890 0x556ea1f5bca0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:45.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.690+0000 7f1202efbb80 1 -- 172.21.15.73:0/3584406525 >> 172.21.15.73:0/3584406525 conn(0x556ea1ea9cd0 msgr2=0x556ea1f5b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:45.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.690+0000 7f1202efbb80 1 -- 172.21.15.73:0/3584406525 shutdown_connections 2023-08-10T11:55:45.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.690+0000 7f1202efbb80 1 -- 172.21.15.73:0/3584406525 wait complete. 2023-08-10T11:55:45.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.691+0000 7f1202efbb80 1 -- start start 2023-08-10T11:55:45.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.691+0000 7f1202efbb80 1 Processor -- start 2023-08-10T11:55:45.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.692+0000 7f1202efbb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ea1f4c800 0x556ea1fbce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:45.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.692+0000 7f1202efbb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ea1f5a890 0x556ea1fbd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:45.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.692+0000 7f1202efbb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea1f5b1b0 0x556ea1fb7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:45.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.692+0000 7f1202efbb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ea1fb7710 con 0x556ea1f4c800 2023-08-10T11:55:45.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.692+0000 7f1202efbb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ea1fb7880 con 0x556ea1f5b1b0 2023-08-10T11:55:45.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.692+0000 7f1202efbb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ea1fb7a40 con 0x556ea1f5a890 2023-08-10T11:55:45.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.692+0000 7f1202efbb80 10 client.0 _ll_register_callbacks cb 0x556ea1e3a680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:55:45.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.692+0000 7f11f52ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea1f5b1b0 0x556ea1fb7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:45.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.692+0000 7f11f52ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea1f5b1b0 0x556ea1fb7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49344/0 (socket says 172.21.15.73:49344) 2023-08-10T11:55:45.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.692+0000 7f11f52ff700 1 -- 172.21.15.73:0/1384163168 learned_addr learned my addr 172.21.15.73:0/1384163168 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:45.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.692+0000 7f11effff700 1 --2- 172.21.15.73:0/1384163168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ea1f5a890 0x556ea1fbd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:45.698 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:45.696+0000 7f856c51f700 1 -- 172.21.15.73:0/126151 wait complete. 2023-08-10T11:55:45.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.697+0000 7f11effff700 1 -- 172.21.15.73:0/1384163168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea1f5b1b0 msgr2=0x556ea1fb7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:45.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.697+0000 7f11effff700 1 --2- 172.21.15.73:0/1384163168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea1f5b1b0 0x556ea1fb7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:45.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.697+0000 7f11effff700 1 -- 172.21.15.73:0/1384163168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ea1f4c800 msgr2=0x556ea1fbce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:45.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.697+0000 7f11effff700 1 --2- 172.21.15.73:0/1384163168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ea1f4c800 0x556ea1fbce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:45.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.697+0000 7f11effff700 1 -- 172.21.15.73:0/1384163168 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e401e040 con 0x556ea1f5a890 2023-08-10T11:55:45.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.706+0000 7f11effff700 1 --2- 172.21.15.73:0/1384163168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ea1f5a890 0x556ea1fbd340 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x556ea1f619b0 tx=0x7f11e4012b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f611e339c8762b4f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:45.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.917+0000 7f11cffff700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T11:55:45.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.917+0000 7f11cffff700 1 -- 172.21.15.73:0/1384163168 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e40053f0 con 0x556ea1f5a890 2023-08-10T11:55:45.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.917+0000 7f11cffff700 1 -- 172.21.15.73:0/1384163168 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f11e400f750 con 0x556ea1f5a890 2023-08-10T11:55:45.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.918+0000 7f1202efbb80 1 -- 172.21.15.73:0/1384163168 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f11e4009e70 con 0x556ea1f5a890 2023-08-10T11:55:45.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.935+0000 7f11cffff700 1 -- 172.21.15.73:0/1384163168 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11e400f910 con 0x556ea1f5a890 2023-08-10T11:55:45.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.935+0000 7f1202efbb80 10 client.25708 fetch_fsmap learned FSMap version 33 2023-08-10T11:55:45.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.935+0000 7f1202efbb80 1 -- 172.21.15.73:0/1384163168 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x556ea1cb3c60 con 0x556ea1f5a890 2023-08-10T11:55:45.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.941+0000 7f11cffff700 1 -- 172.21.15.73:0/1384163168 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f11e4009e70 con 0x556ea1f5a890 2023-08-10T11:55:45.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.941+0000 7f11cffff700 1 -- 172.21.15.73:0/1384163168 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 33) v1 ==== 7498+0+0 (secure 0 0 0) 0x7f11e4021070 con 0x556ea1f5a890 2023-08-10T11:55:45.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.942+0000 7f1202efbb80 10 client.25708 fetch_fsmap finished waiting for FSMap version 33 2023-08-10T11:55:45.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.942+0000 7f1202efbb80 10 client.25708 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:55:45.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.942+0000 7f1202efbb80 20 client.25708 populate_metadata read hostname 'smithi073' 2023-08-10T11:55:45.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.942+0000 7f1202efbb80 1 --2- 172.21.15.73:0/1384163168 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x556ea1fc4790 0x556ea1fc6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:45.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.942+0000 7f1202efbb80 4 client.25708 mds_command: new command op to 24503 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:55:45.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.942+0000 7f1202efbb80 1 -- 172.21.15.73:0/1384163168 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556ea1e96780 con 0x556ea1fc4790 2023-08-10T11:55:45.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.947+0000 7f11f4afe700 1 --2- 172.21.15.73:0/1384163168 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x556ea1fc4790 0x556ea1fc6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:45.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.947+0000 7f11f4afe700 1 --2- 172.21.15.73:0/1384163168 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x556ea1fc4790 0x556ea1fc6b80 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86f749630e0b359a server_cookie=fce0416fda54583 in_seq=0 out_seq=0 2023-08-10T11:55:45.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.949+0000 7f11cffff700 10 client.25708 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:55:45.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.956+0000 7f11cffff700 1 -- 172.21.15.73:0/1384163168 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x556ea1e96780 con 0x556ea1fc4790 2023-08-10T11:55:45.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.956+0000 7f11cffff700 10 client.25708 handle_command_reply: tid=0 2023-08-10T11:55:45.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.956+0000 7f1202efbb80 1 client.25708 shutdown 2023-08-10T11:55:45.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.956+0000 7f1202efbb80 1 -- 172.21.15.73:0/1384163168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ea1f5a890 msgr2=0x556ea1fbd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:45.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.956+0000 7f1202efbb80 1 --2- 172.21.15.73:0/1384163168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ea1f5a890 0x556ea1fbd340 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x556ea1f619b0 tx=0x7f11e4012b90 comp rx=0 tx=0).stop 2023-08-10T11:55:45.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.959+0000 7f1202efbb80 1 -- 172.21.15.73:0/1384163168 shutdown_connections 2023-08-10T11:55:45.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.959+0000 7f1202efbb80 1 --2- 172.21.15.73:0/1384163168 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x556ea1fc4790 0x556ea1fc6b80 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:45.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.959+0000 7f1202efbb80 1 --2- 172.21.15.73:0/1384163168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556ea1f5b1b0 0x556ea1fb7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:45.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.959+0000 7f1202efbb80 1 --2- 172.21.15.73:0/1384163168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ea1f4c800 0x556ea1fbce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:45.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.959+0000 7f1202efbb80 1 --2- 172.21.15.73:0/1384163168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ea1f5a890 0x556ea1fbd340 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:45.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.959+0000 7f1202efbb80 1 -- 172.21.15.73:0/1384163168 >> 172.21.15.73:0/1384163168 conn(0x556ea1ea9cd0 msgr2=0x556ea1f5be20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:45.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.970+0000 7f11cffff700 0 client.25708 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:55:45.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.973+0000 7f1202efbb80 1 -- 172.21.15.73:0/1384163168 shutdown_connections 2023-08-10T11:55:45.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.973+0000 7f1202efbb80 1 -- 172.21.15.73:0/1384163168 wait complete. 2023-08-10T11:55:45.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:45.973+0000 7f1202efbb80 20 client.25708 trim_cache size 0 max 16384 2023-08-10T11:55:45.975 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:55:45.976 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:55:45.976 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": { 2023-08-10T11:55:45.976 INFO:teuthology.orchestra.run.smithi073.stdout: "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d": { 2023-08-10T11:55:45.976 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2023-08-10T11:55:45.976 INFO:teuthology.orchestra.run.smithi073.stdout: "tag": "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d", 2023-08-10T11:55:45.976 INFO:teuthology.orchestra.run.smithi073.stdout: "options": "recursive,force" 2023-08-10T11:55:45.977 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:55:45.977 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:55:45.977 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:55:46.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:46.124+0000 7f11f6d62700 1 -- 172.21.15.73:0/4230255885 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f11d80a14d0 msgr2=0x7f11d80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:46.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:46.124+0000 7f11f6d62700 1 --2- 172.21.15.73:0/4230255885 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f11d80a14d0 0x7f11d80a3990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x556ea1f487b0 tx=0x7f11e0019040 comp rx=0 tx=0).stop 2023-08-10T11:55:46.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:46.124+0000 7f11f6d62700 1 -- 172.21.15.73:0/4230255885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11f010cc80 msgr2=0x7f11f0074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:46.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:46.124+0000 7f11f6d62700 1 --2- 172.21.15.73:0/4230255885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11f010cc80 0x7f11f0074af0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f11e800efc0 tx=0x7f11e800c3a0 comp rx=0 tx=0).stop 2023-08-10T11:55:46.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:46.125+0000 7f11f6d62700 1 -- 172.21.15.73:0/4230255885 shutdown_connections 2023-08-10T11:55:46.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:46.125+0000 7f11f6d62700 1 --2- 172.21.15.73:0/4230255885 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f11d80a14d0 0x7f11d80a3990 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:46.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:46.125+0000 7f11f6d62700 1 --2- 172.21.15.73:0/4230255885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11f010b930 0x7f11f00785b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:46.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:46.125+0000 7f11f6d62700 1 --2- 172.21.15.73:0/4230255885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11f010cc80 0x7f11f0074af0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:46.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:46.125+0000 7f11f6d62700 1 --2- 172.21.15.73:0/4230255885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11f010c2f0 0x7f11f00745b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:46.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:46.125+0000 7f11f6d62700 1 -- 172.21.15.73:0/4230255885 >> 172.21.15.73:0/4230255885 conn(0x7f11f006ca30 msgr2=0x7f11f010b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:46.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:46.221+0000 7f11f6d62700 1 -- 172.21.15.73:0/4230255885 shutdown_connections 2023-08-10T11:55:46.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:55:46.221+0000 7f11f6d62700 1 -- 172.21.15.73:0/4230255885 wait complete. 2023-08-10T11:55:46.304 INFO:tasks.cephfs.filesystem:scrub status for tag:9d39b3fa-9b62-42b4-b1a5-738cb3118a5d - {'path': '/', 'tag': '9d39b3fa-9b62-42b4-b1a5-738cb3118a5d', 'options': 'recursive,force'} 2023-08-10T11:55:46.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:46 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:55:46.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:46 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:55:46.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:46 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:55:46.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:46 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:55:46.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:46 smithi152 ceph-mon[130220]: pgmap v97: 97 pgs: 97 active+clean; 623 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 13 MiB/s wr, 1.11k op/s 2023-08-10T11:55:46.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:46 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:55:46.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:46 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:55:46.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:46 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:55:46.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:46 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:55:46.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:46 smithi156 ceph-mon[130574]: pgmap v97: 97 pgs: 97 active+clean; 623 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 13 MiB/s wr, 1.11k op/s 2023-08-10T11:55:46.781 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:46 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:55:46.781 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:46 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:55:46.781 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:46 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:55:46.782 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:46 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:55:46.782 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:46 smithi073 ceph-mon[128869]: pgmap v97: 97 pgs: 97 active+clean; 623 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 13 MiB/s wr, 1.11k op/s 2023-08-10T11:55:47.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:47 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:55:47.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:47 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:55:47.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:47 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:55:47.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:47 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:55:47.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:47 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:55:47.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:47 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:55:47.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:47 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:55:47.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:47 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:55:47.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:47 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:55:48.102 INFO:tasks.workunit.client.0.smithi073.stdout: 156 2173117 675 1434592 551 628425 857 2023-08-10T11:55:48.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:48 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:55:48.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:48 smithi152 ceph-mon[130220]: pgmap v98: 97 pgs: 97 active+clean; 623 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 13 MiB/s wr, 1.08k op/s 2023-08-10T11:55:48.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:48 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:55:48.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:48 smithi156 ceph-mon[130574]: pgmap v98: 97 pgs: 97 active+clean; 623 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 13 MiB/s wr, 1.08k op/s 2023-08-10T11:55:48.780 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:48 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:55:48.780 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:48 smithi073 ceph-mon[128869]: pgmap v98: 97 pgs: 97 active+clean; 623 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 13 MiB/s wr, 1.08k op/s 2023-08-10T11:55:51.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:50 smithi156 ceph-mon[130574]: pgmap v99: 97 pgs: 97 active+clean; 644 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 15 MiB/s wr, 1.25k op/s 2023-08-10T11:55:51.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:50 smithi073 ceph-mon[128869]: pgmap v99: 97 pgs: 97 active+clean; 644 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 15 MiB/s wr, 1.25k op/s 2023-08-10T11:55:51.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:50 smithi152 ceph-mon[130220]: pgmap v99: 97 pgs: 97 active+clean; 644 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 15 MiB/s wr, 1.25k op/s 2023-08-10T11:55:53.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:52 smithi073 ceph-mon[128869]: pgmap v100: 97 pgs: 97 active+clean; 641 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 14 MiB/s wr, 1.20k op/s 2023-08-10T11:55:53.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:52 smithi152 ceph-mon[130220]: pgmap v100: 97 pgs: 97 active+clean; 641 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 14 MiB/s wr, 1.20k op/s 2023-08-10T11:55:53.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:52 smithi156 ceph-mon[130574]: pgmap v100: 97 pgs: 97 active+clean; 641 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 14 MiB/s wr, 1.20k op/s 2023-08-10T11:55:54.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:54 smithi152 ceph-mon[130220]: pgmap v101: 97 pgs: 97 active+clean; 651 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 15 MiB/s wr, 1.24k op/s 2023-08-10T11:55:55.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:54 smithi156 ceph-mon[130574]: pgmap v101: 97 pgs: 97 active+clean; 651 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 15 MiB/s wr, 1.24k op/s 2023-08-10T11:55:55.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:54 smithi073 ceph-mon[128869]: pgmap v101: 97 pgs: 97 active+clean; 651 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 15 MiB/s wr, 1.24k op/s 2023-08-10T11:55:57.022 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:56 smithi073 ceph-mon[128869]: pgmap v102: 97 pgs: 97 active+clean; 654 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 11 MiB/s wr, 903 op/s 2023-08-10T11:55:57.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:56 smithi152 ceph-mon[130220]: pgmap v102: 97 pgs: 97 active+clean; 654 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 11 MiB/s wr, 903 op/s 2023-08-10T11:55:57.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:56 smithi156 ceph-mon[130574]: pgmap v102: 97 pgs: 97 active+clean; 654 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 11 MiB/s wr, 903 op/s 2023-08-10T11:55:58.103 INFO:tasks.workunit.client.0.smithi073.stdout: 167 2043935 624 1337029 486 663127 1960 2023-08-10T11:55:59.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:55:58 smithi152 ceph-mon[130220]: pgmap v103: 97 pgs: 97 active+clean; 654 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.6 MiB/s wr, 278 op/s 2023-08-10T11:55:59.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:55:58 smithi156 ceph-mon[130574]: pgmap v103: 97 pgs: 97 active+clean; 654 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.6 MiB/s wr, 278 op/s 2023-08-10T11:55:59.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:55:58 smithi073 ceph-mon[128869]: pgmap v103: 97 pgs: 97 active+clean; 654 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.6 MiB/s wr, 278 op/s 2023-08-10T11:55:59.605 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.605+0000 7f3007a15700 1 -- 172.21.15.73:0/866491833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30001056c0 msgr2=0x7f3000105aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:59.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.605+0000 7f3007a15700 1 --2- 172.21.15.73:0/866491833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30001056c0 0x7f3000105aa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009990 tx=0x7f2ffc009ca0 comp rx=0 tx=0).stop 2023-08-10T11:55:59.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.605+0000 7f3007a15700 1 -- 172.21.15.73:0/866491833 shutdown_connections 2023-08-10T11:55:59.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.605+0000 7f3007a15700 1 --2- 172.21.15.73:0/866491833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30000fffe0 0x7f300010c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:59.606 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.605+0000 7f3007a15700 1 --2- 172.21.15.73:0/866491833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30001056c0 0x7f3000105aa0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:59.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.605+0000 7f3007a15700 1 --2- 172.21.15.73:0/866491833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30000ff620 0x7f30000ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:59.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.605+0000 7f3007a15700 1 -- 172.21.15.73:0/866491833 >> 172.21.15.73:0/866491833 conn(0x7f3000076770 msgr2=0x7f3000076b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:59.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.605+0000 7f3007a15700 1 -- 172.21.15.73:0/866491833 shutdown_connections 2023-08-10T11:55:59.607 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.605+0000 7f3007a15700 1 -- 172.21.15.73:0/866491833 wait complete. 2023-08-10T11:55:59.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.606+0000 7f3007a15700 1 Processor -- start 2023-08-10T11:55:59.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.606+0000 7f3007a15700 1 -- start start 2023-08-10T11:55:59.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.606+0000 7f3007a15700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30000ff620 0x7f300019ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:59.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.606+0000 7f3007a15700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30000fffe0 0x7f300019f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:59.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.606+0000 7f3007a15700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30001056c0 0x7f30001989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:59.609 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.606+0000 7f3007a15700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3000199190 con 0x7f30001056c0 2023-08-10T11:55:59.610 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.606+0000 7f3007a15700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3000199300 con 0x7f30000fffe0 2023-08-10T11:55:59.610 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.606+0000 7f3007a15700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30001994c0 con 0x7f30000ff620 2023-08-10T11:55:59.610 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.606+0000 7f3005fb2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30001056c0 0x7f30001989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:59.610 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.606+0000 7f30057b1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30000ff620 0x7f300019ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:59.610 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.606+0000 7f3004fb0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30000fffe0 0x7f300019f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:59.610 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.606+0000 7f3005fb2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30001056c0 0x7f30001989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34708/0 (socket says 172.21.15.73:34708) 2023-08-10T11:55:59.610 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.606+0000 7f30057b1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30000ff620 0x7f300019ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60208/0 (socket says 172.21.15.73:60208) 2023-08-10T11:55:59.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.606+0000 7f3005fb2700 1 -- 172.21.15.73:0/2452682479 learned_addr learned my addr 172.21.15.73:0/2452682479 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:59.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.607+0000 7f30057b1700 1 -- 172.21.15.73:0/2452682479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30000fffe0 msgr2=0x7f300019f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:59.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.607+0000 7f30057b1700 1 --2- 172.21.15.73:0/2452682479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30000fffe0 0x7f300019f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:59.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.607+0000 7f30057b1700 1 -- 172.21.15.73:0/2452682479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30001056c0 msgr2=0x7f30001989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:59.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.607+0000 7f30057b1700 1 --2- 172.21.15.73:0/2452682479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30001056c0 0x7f30001989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:59.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.607+0000 7f30057b1700 1 -- 172.21.15.73:0/2452682479 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff0009520 con 0x7f30000ff620 2023-08-10T11:55:59.611 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.607+0000 7f3004fb0700 1 --2- 172.21.15.73:0/2452682479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30000fffe0 0x7f300019f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:55:59.612 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.607+0000 7f30057b1700 1 --2- 172.21.15.73:0/2452682479 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30000ff620 0x7f300019ebf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009990 tx=0x7f2ffc009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:59.612 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.607+0000 7f2ff67fc700 1 -- 172.21.15.73:0/2452682479 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc01d070 con 0x7f30000ff620 2023-08-10T11:55:59.612 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.607+0000 7f2ff67fc700 1 -- 172.21.15.73:0/2452682479 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ffc021410 con 0x7f30000ff620 2023-08-10T11:55:59.612 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.607+0000 7f2ff67fc700 1 -- 172.21.15.73:0/2452682479 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc017650 con 0x7f30000ff620 2023-08-10T11:55:59.612 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.607+0000 7f3007a15700 1 -- 172.21.15.73:0/2452682479 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ffc0095f0 con 0x7f30000ff620 2023-08-10T11:55:59.612 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.607+0000 7f3007a15700 1 -- 172.21.15.73:0/2452682479 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3000199880 con 0x7f30000ff620 2023-08-10T11:55:59.622 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.613+0000 7f3013baeb80 1 Processor -- start 2023-08-10T11:55:59.622 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.614+0000 7f3013baeb80 1 -- start start 2023-08-10T11:55:59.622 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.614+0000 7f3013baeb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a35700b250 0x55a35700b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:59.623 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.614+0000 7f3013baeb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a35700bb70 0x55a357005820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:59.623 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.614+0000 7f3013baeb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a357005d60 0x55a3570061e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:59.623 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.614+0000 7f3013baeb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a356f78d60 con 0x55a357005d60 2023-08-10T11:55:59.623 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.614+0000 7f3013baeb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a356f55530 con 0x55a35700b250 2023-08-10T11:55:59.623 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.614+0000 7f3013baeb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a356f52e50 con 0x55a35700bb70 2023-08-10T11:55:59.623 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.614+0000 7f3005fb2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a35700b250 0x55a35700b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:59.623 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.614+0000 7f3005fb2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a35700b250 0x55a35700b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49360/0 (socket says 172.21.15.73:49360) 2023-08-10T11:55:59.623 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.614+0000 7f3005fb2700 1 -- 172.21.15.73:0/244918868 learned_addr learned my addr 172.21.15.73:0/244918868 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.614+0000 7f30057b1700 1 --2- 172.21.15.73:0/244918868 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a35700bb70 0x55a357005820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.615+0000 7f3005fb2700 1 -- 172.21.15.73:0/244918868 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a35700bb70 msgr2=0x55a357005820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.615+0000 7f3005fb2700 1 --2- 172.21.15.73:0/244918868 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a35700bb70 0x55a357005820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.615+0000 7f3005fb2700 1 -- 172.21.15.73:0/244918868 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a357005d60 msgr2=0x55a3570061e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T11:55:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.615+0000 7f3005fb2700 1 --2- 172.21.15.73:0/244918868 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a357005d60 0x55a3570061e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.615+0000 7f3005fb2700 1 -- 172.21.15.73:0/244918868 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a356dcf5d0 con 0x55a35700b250 2023-08-10T11:55:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.615+0000 7f3005fb2700 1 --2- 172.21.15.73:0/244918868 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a35700b250 0x55a35700b630 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80075a0 tx=0x7f2ff800bb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a72117f03ee6f15 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.616+0000 7f2ff67fc700 1 -- 172.21.15.73:0/2452682479 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f2ffc021810 con 0x7f30000ff620 2023-08-10T11:55:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.616+0000 7f2ff67fc700 1 --2- 172.21.15.73:0/2452682479 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f2fec0a13c0 0x7f2fec0a3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.616+0000 7f2ff67fc700 1 -- 172.21.15.73:0/2452682479 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f2ffc0cdde0 con 0x7f30000ff620 2023-08-10T11:55:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.617+0000 7f30057b1700 1 --2- 172.21.15.73:0/2452682479 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f2fec0a13c0 0x7f2fec0a3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.617+0000 7f30057b1700 1 --2- 172.21.15.73:0/2452682479 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f2fec0a13c0 0x7f2fec0a3880 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55a356ff9680 tx=0x7f2ffc0d1890 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:59.634 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.624+0000 7f2feb7fe700 1 -- 172.21.15.73:0/244918868 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff801a070 con 0x55a35700b250 2023-08-10T11:55:59.634 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.624+0000 7f2feb7fe700 1 -- 172.21.15.73:0/244918868 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ff800b0d0 con 0x55a35700b250 2023-08-10T11:55:59.634 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.624+0000 7f2feb7fe700 1 -- 172.21.15.73:0/244918868 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff8010040 con 0x55a35700b250 2023-08-10T11:55:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.625+0000 7f3013baeb80 1 -- 172.21.15.73:0/244918868 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a35700b250 msgr2=0x55a35700b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.625+0000 7f3013baeb80 1 --2- 172.21.15.73:0/244918868 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a35700b250 0x55a35700b630 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80075a0 tx=0x7f2ff800bb30 comp rx=0 tx=0).stop 2023-08-10T11:55:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.625+0000 7f3013baeb80 1 -- 172.21.15.73:0/244918868 shutdown_connections 2023-08-10T11:55:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.625+0000 7f3013baeb80 1 --2- 172.21.15.73:0/244918868 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a35700b250 0x55a35700b630 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.625+0000 7f3013baeb80 1 --2- 172.21.15.73:0/244918868 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a357005d60 0x55a3570061e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.625+0000 7f3013baeb80 1 --2- 172.21.15.73:0/244918868 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a35700bb70 0x55a357005820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.625+0000 7f3013baeb80 1 -- 172.21.15.73:0/244918868 >> 172.21.15.73:0/244918868 conn(0x55a356f5ac70 msgr2=0x55a356ff7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.628+0000 7f3013baeb80 1 -- 172.21.15.73:0/244918868 shutdown_connections 2023-08-10T11:55:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.639+0000 7f3013baeb80 1 -- 172.21.15.73:0/244918868 wait complete. 2023-08-10T11:55:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.639+0000 7f3013baeb80 1 -- start start 2023-08-10T11:55:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.639+0000 7f3013baeb80 1 Processor -- start 2023-08-10T11:55:59.641 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.640+0000 7f3013baeb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a357005d60 0x55a357011c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:59.641 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.640+0000 7f3013baeb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a35700b250 0x55a35700ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:59.641 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.640+0000 7f3013baeb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a35700bb70 0x55a35700f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.640+0000 7f3013baeb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a356f4e740 con 0x55a357005d60 2023-08-10T11:55:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.640+0000 7f3013baeb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a356eeda60 con 0x55a35700b250 2023-08-10T11:55:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.640+0000 7f3013baeb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a356eed760 con 0x55a35700bb70 2023-08-10T11:55:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.640+0000 7f3013baeb80 10 client.0 _ll_register_callbacks cb 0x55a356eeb620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:55:59.643 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.641+0000 7f3005fb2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a35700bb70 0x55a35700f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:59.643 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.641+0000 7f3005fb2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a357005d60 0x55a357011c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:59.643 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.641+0000 7f3005fb2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a357005d60 0x55a357011c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34716/0 (socket says 172.21.15.73:34716) 2023-08-10T11:55:59.643 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.641+0000 7f3005fb2700 1 -- 172.21.15.73:0/882996939 learned_addr learned my addr 172.21.15.73:0/882996939 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:59.643 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.641+0000 7f3005fb2700 1 -- 172.21.15.73:0/882996939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a35700bb70 msgr2=0x55a35700f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:59.643 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.641+0000 7f3005fb2700 1 --2- 172.21.15.73:0/882996939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a35700bb70 0x55a35700f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:59.643 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.641+0000 7f3005fb2700 1 -- 172.21.15.73:0/882996939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a35700b250 msgr2=0x55a35700ee40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T11:55:59.644 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.641+0000 7f3005fb2700 1 --2- 172.21.15.73:0/882996939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a35700b250 0x55a35700ee40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:59.644 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.641+0000 7f3005fb2700 1 -- 172.21.15.73:0/882996939 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff8009220 con 0x55a357005d60 2023-08-10T11:55:59.644 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.642+0000 7f3005fb2700 1 --2- 172.21.15.73:0/882996939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a357005d60 0x55a357011c30 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f2ff800b6d0 tx=0x7f2ff8000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca1df007beb1a09 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.653+0000 7f2fe8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:55:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.653+0000 7f2fe8ff9700 1 -- 172.21.15.73:0/882996939 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff801a070 con 0x55a357005d60 2023-08-10T11:55:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.653+0000 7f2fe8ff9700 1 -- 172.21.15.73:0/882996939 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f2ff80052f0 con 0x55a357005d60 2023-08-10T11:55:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.658+0000 7f3013baeb80 1 -- 172.21.15.73:0/882996939 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a356ff01c0 con 0x55a357005d60 2023-08-10T11:55:59.664 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.664+0000 7f2fe8ff9700 1 -- 172.21.15.73:0/882996939 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ff8010040 con 0x55a357005d60 2023-08-10T11:55:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.664+0000 7f3013baeb80 10 client.16275 fetch_fsmap learned FSMap version 34 2023-08-10T11:55:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.664+0000 7f3013baeb80 1 -- 172.21.15.73:0/882996939 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55a356d7bd80 con 0x55a357005d60 2023-08-10T11:55:59.679 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.678+0000 7f2fe8ff9700 1 -- 172.21.15.73:0/882996939 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a356ff01c0 con 0x55a357005d60 2023-08-10T11:55:59.679 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.678+0000 7f2fe8ff9700 1 -- 172.21.15.73:0/882996939 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 34) v1 ==== 7510+0+0 (secure 0 0 0) 0x7f2ff8023810 con 0x55a357005d60 2023-08-10T11:55:59.679 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.678+0000 7f3013baeb80 10 client.16275 fetch_fsmap finished waiting for FSMap version 34 2023-08-10T11:55:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.678+0000 7f3013baeb80 10 client.16275 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:55:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.678+0000 7f3013baeb80 20 client.16275 populate_metadata read hostname 'smithi073' 2023-08-10T11:55:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.678+0000 7f3013baeb80 1 --2- 172.21.15.73:0/882996939 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55a357030530 0x55a357032950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.678+0000 7f3013baeb80 4 client.16275 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:55:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.678+0000 7f3013baeb80 1 -- 172.21.15.73:0/882996939 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a356fcc970 con 0x55a357030530 2023-08-10T11:55:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.687+0000 7f3004fb0700 1 --2- 172.21.15.73:0/882996939 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55a357030530 0x55a357032950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.687+0000 7f3004fb0700 1 --2- 172.21.15.73:0/882996939 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55a357030530 0x55a357032950 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=842694fc71669996 server_cookie=7b6545787dd715b in_seq=0 out_seq=0 2023-08-10T11:55:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.687+0000 7f2fe8ff9700 10 client.16275 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:55:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.688+0000 7f2fe8ff9700 1 -- 172.21.15.73:0/882996939 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55a356fcc970 con 0x55a357030530 2023-08-10T11:55:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.688+0000 7f2fe8ff9700 10 client.16275 handle_command_reply: tid=0 2023-08-10T11:55:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.688+0000 7f3013baeb80 1 client.16275 shutdown 2023-08-10T11:55:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.693+0000 7f3013baeb80 1 -- 172.21.15.73:0/882996939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a357005d60 msgr2=0x55a357011c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.693+0000 7f3013baeb80 1 --2- 172.21.15.73:0/882996939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a357005d60 0x55a357011c30 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f2ff800b6d0 tx=0x7f2ff8000f40 comp rx=0 tx=0).stop 2023-08-10T11:55:59.696 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.696+0000 7f3013baeb80 1 -- 172.21.15.73:0/882996939 shutdown_connections 2023-08-10T11:55:59.696 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.696+0000 7f3013baeb80 1 --2- 172.21.15.73:0/882996939 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55a357030530 0x55a357032950 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:59.697 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.696+0000 7f3013baeb80 1 --2- 172.21.15.73:0/882996939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a35700bb70 0x55a35700f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:59.697 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.696+0000 7f3013baeb80 1 --2- 172.21.15.73:0/882996939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a357005d60 0x55a357011c30 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:59.697 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.696+0000 7f3013baeb80 1 --2- 172.21.15.73:0/882996939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a35700b250 0x55a35700ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:59.697 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.696+0000 7f3013baeb80 1 -- 172.21.15.73:0/882996939 >> 172.21.15.73:0/882996939 conn(0x55a356f5ac70 msgr2=0x55a356ff74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:59.697 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.696+0000 7f2fe8ff9700 0 client.16275 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:55:59.698 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.696+0000 7f3013baeb80 1 -- 172.21.15.73:0/882996939 shutdown_connections 2023-08-10T11:55:59.698 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.696+0000 7f3013baeb80 1 -- 172.21.15.73:0/882996939 wait complete. 2023-08-10T11:55:59.705 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.699+0000 7f3013baeb80 20 client.16275 trim_cache size 0 max 16384 2023-08-10T11:55:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.755+0000 7f3013baeb80 1 Processor -- start 2023-08-10T11:55:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.755+0000 7f3013baeb80 1 -- start start 2023-08-10T11:55:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.755+0000 7f3013baeb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a357005d60 0x55a357005820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.755+0000 7f3013baeb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a35700b250 0x55a356ff96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.755+0000 7f3013baeb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a35700bb70 0x55a357027630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.755+0000 7f3013baeb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a356dd18c0 con 0x55a35700bb70 2023-08-10T11:55:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.755+0000 7f3013baeb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a35700fb30 con 0x55a35700b250 2023-08-10T11:55:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.755+0000 7f3013baeb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a35700b9b0 con 0x55a357005d60 2023-08-10T11:55:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.756+0000 7f3005fb2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a357005d60 0x55a357005820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.756+0000 7f3005fb2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a357005d60 0x55a357005820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60226/0 (socket says 172.21.15.73:60226) 2023-08-10T11:55:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.756+0000 7f3005fb2700 1 -- 172.21.15.73:0/3940026437 learned_addr learned my addr 172.21.15.73:0/3940026437 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.756+0000 7f3005fb2700 1 --2- 172.21.15.73:0/3940026437 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a35700bb70 0x55a357027630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.756+0000 7f3004fb0700 1 --2- 172.21.15.73:0/3940026437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a35700b250 0x55a356ff96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.757+0000 7f3005fb2700 1 -- 172.21.15.73:0/3940026437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a35700b250 msgr2=0x55a356ff96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.757+0000 7f3005fb2700 1 --2- 172.21.15.73:0/3940026437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a35700b250 0x55a356ff96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.757+0000 7f3005fb2700 1 -- 172.21.15.73:0/3940026437 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a35700bb70 msgr2=0x55a357027630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.757+0000 7f3005fb2700 1 --2- 172.21.15.73:0/3940026437 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a35700bb70 0x55a357027630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:59.760 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.757+0000 7f3005fb2700 1 -- 172.21.15.73:0/3940026437 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a356d64c00 con 0x55a357005d60 2023-08-10T11:55:59.760 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.757+0000 7f3005fb2700 1 --2- 172.21.15.73:0/3940026437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a357005d60 0x55a357005820 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8002230 tx=0x7f2ff8006180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8176de41c01a13c6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:59.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.781+0000 7f2febfff700 1 -- 172.21.15.73:0/3940026437 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff801a040 con 0x55a357005d60 2023-08-10T11:55:59.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.781+0000 7f2febfff700 1 -- 172.21.15.73:0/3940026437 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ff801b040 con 0x55a357005d60 2023-08-10T11:55:59.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.781+0000 7f2febfff700 1 -- 172.21.15.73:0/3940026437 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff802d3c0 con 0x55a357005d60 2023-08-10T11:55:59.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.785+0000 7f3013baeb80 1 -- 172.21.15.73:0/3940026437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a357005d60 msgr2=0x55a357005820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:55:59.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.785+0000 7f3013baeb80 1 --2- 172.21.15.73:0/3940026437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a357005d60 0x55a357005820 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8002230 tx=0x7f2ff8006180 comp rx=0 tx=0).stop 2023-08-10T11:55:59.834 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.833+0000 7f3013baeb80 1 -- 172.21.15.73:0/3940026437 shutdown_connections 2023-08-10T11:55:59.834 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.833+0000 7f3013baeb80 1 --2- 172.21.15.73:0/3940026437 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a35700bb70 0x55a357027630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:59.835 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.833+0000 7f3013baeb80 1 --2- 172.21.15.73:0/3940026437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a357005d60 0x55a357005820 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:59.835 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.833+0000 7f3013baeb80 1 --2- 172.21.15.73:0/3940026437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a35700b250 0x55a356ff96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:59.835 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.833+0000 7f3013baeb80 1 -- 172.21.15.73:0/3940026437 >> 172.21.15.73:0/3940026437 conn(0x55a356f5ac70 msgr2=0x55a356ff4120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:55:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.849+0000 7f3013baeb80 1 -- 172.21.15.73:0/3940026437 shutdown_connections 2023-08-10T11:55:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.849+0000 7f3013baeb80 1 -- 172.21.15.73:0/3940026437 wait complete. 2023-08-10T11:55:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.850+0000 7f3013baeb80 1 -- start start 2023-08-10T11:55:59.851 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.850+0000 7f3013baeb80 1 Processor -- start 2023-08-10T11:55:59.852 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.851+0000 7f3013baeb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a357005d60 0x55a357025810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:59.852 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.851+0000 7f3013baeb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a35700b250 0x55a357025d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:59.852 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.851+0000 7f3013baeb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a35700bb70 0x55a3570831e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:59.852 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.851+0000 7f3013baeb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a357083720 con 0x55a35700b250 2023-08-10T11:55:59.853 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.851+0000 7f3013baeb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a357083890 con 0x55a357005d60 2023-08-10T11:55:59.853 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.851+0000 7f3013baeb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a356ffa070 con 0x55a35700bb70 2023-08-10T11:55:59.853 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.851+0000 7f3013baeb80 10 client.0 _ll_register_callbacks cb 0x55a356eeb620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:55:59.853 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.851+0000 7f3004fb0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a35700b250 0x55a357025d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:59.853 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.851+0000 7f3004fb0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a35700b250 0x55a357025d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34728/0 (socket says 172.21.15.73:34728) 2023-08-10T11:55:59.853 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.851+0000 7f3004fb0700 1 -- 172.21.15.73:0/2307847509 learned_addr learned my addr 172.21.15.73:0/2307847509 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:55:59.853 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.851+0000 7f3005fb2700 1 --2- 172.21.15.73:0/2307847509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a357005d60 0x55a357025810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:59.861 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.860+0000 7f3005fb2700 1 --2- 172.21.15.73:0/2307847509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a35700bb70 0x55a3570831e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:59.861 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.860+0000 7f3004fb0700 1 -- 172.21.15.73:0/2307847509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a35700bb70 msgr2=0x55a3570831e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:59.861 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.860+0000 7f3004fb0700 1 --2- 172.21.15.73:0/2307847509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a35700bb70 0x55a3570831e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:59.862 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.860+0000 7f3004fb0700 1 -- 172.21.15.73:0/2307847509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a357005d60 msgr2=0x55a357025810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:55:59.862 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.860+0000 7f3004fb0700 1 --2- 172.21.15.73:0/2307847509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a357005d60 0x55a357025810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:55:59.862 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.860+0000 7f3004fb0700 1 -- 172.21.15.73:0/2307847509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a356d7bd80 con 0x55a35700b250 2023-08-10T11:55:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.865+0000 7f3004fb0700 1 --2- 172.21.15.73:0/2307847509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a35700b250 0x55a357025d50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x55a357033260 tx=0x7f2ff00053d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200e9135b884fe25 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:55:59.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.910+0000 7f2fe8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:55:59.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.910+0000 7f2fe8ff9700 1 -- 172.21.15.73:0/2307847509 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0016040 con 0x55a35700b250 2023-08-10T11:55:59.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.910+0000 7f2fe8ff9700 1 -- 172.21.15.73:0/2307847509 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f2ff00049d0 con 0x55a35700b250 2023-08-10T11:55:59.917 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.910+0000 7f3013baeb80 1 -- 172.21.15.73:0/2307847509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2ff800b0d0 con 0x55a35700b250 2023-08-10T11:55:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.920+0000 7f2fe8ff9700 1 -- 172.21.15.73:0/2307847509 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ff0004b90 con 0x55a35700b250 2023-08-10T11:55:59.921 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.920+0000 7f3013baeb80 10 client.16281 fetch_fsmap learned FSMap version 34 2023-08-10T11:55:59.921 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.920+0000 7f3013baeb80 1 -- 172.21.15.73:0/2307847509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55a356da21f0 con 0x55a35700b250 2023-08-10T11:55:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.928+0000 7f2fe8ff9700 1 -- 172.21.15.73:0/2307847509 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ff800b0d0 con 0x55a35700b250 2023-08-10T11:55:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.928+0000 7f2fe8ff9700 1 -- 172.21.15.73:0/2307847509 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 34) v1 ==== 7510+0+0 (secure 0 0 0) 0x7f2ff0011760 con 0x55a35700b250 2023-08-10T11:55:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.929+0000 7f3013baeb80 10 client.16281 fetch_fsmap finished waiting for FSMap version 34 2023-08-10T11:55:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.929+0000 7f3013baeb80 10 client.16281 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:55:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.929+0000 7f3013baeb80 20 client.16281 populate_metadata read hostname 'smithi073' 2023-08-10T11:55:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.929+0000 7f3013baeb80 1 --2- 172.21.15.73:0/2307847509 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55a356ffb8d0 0x55a356ffdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:55:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.929+0000 7f3013baeb80 4 client.16281 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:55:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.929+0000 7f3013baeb80 1 -- 172.21.15.73:0/2307847509 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a356f47720 con 0x55a356ffb8d0 2023-08-10T11:55:59.935 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.935+0000 7f3005fb2700 1 --2- 172.21.15.73:0/2307847509 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55a356ffb8d0 0x55a356ffdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:55:59.961 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.960+0000 7f3005fb2700 1 --2- 172.21.15.73:0/2307847509 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55a356ffb8d0 0x55a356ffdcf0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6547faea9c36376b server_cookie=5af46eeddf6d3eb1 in_seq=0 out_seq=0 2023-08-10T11:55:59.961 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:55:59.961+0000 7f2fe8ff9700 10 client.16281 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:56:00.708 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:00.707+0000 7f2fe8ff9700 1 -- 172.21.15.73:0/2307847509 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a356f47720 con 0x55a356ffb8d0 2023-08-10T11:56:00.708 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:00.707+0000 7f2fe8ff9700 10 client.16281 handle_command_reply: tid=0 2023-08-10T11:56:00.709 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:00.707+0000 7f3013baeb80 1 client.16281 shutdown 2023-08-10T11:56:00.715 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:00.714+0000 7f3013baeb80 1 -- 172.21.15.73:0/2307847509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a35700b250 msgr2=0x55a357025d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:00.715 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:00.714+0000 7f3013baeb80 1 --2- 172.21.15.73:0/2307847509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a35700b250 0x55a357025d50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x55a357033260 tx=0x7f2ff00053d0 comp rx=0 tx=0).stop 2023-08-10T11:56:00.716 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:00.715+0000 7f3013baeb80 1 -- 172.21.15.73:0/2307847509 shutdown_connections 2023-08-10T11:56:00.716 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:00.715+0000 7f3013baeb80 1 --2- 172.21.15.73:0/2307847509 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55a356ffb8d0 0x55a356ffdcf0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:00.716 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:00.715+0000 7f3013baeb80 1 --2- 172.21.15.73:0/2307847509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a357005d60 0x55a357025810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:00.716 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:00.715+0000 7f3013baeb80 1 --2- 172.21.15.73:0/2307847509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a35700bb70 0x55a3570831e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:00.716 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:00.715+0000 7f3013baeb80 1 --2- 172.21.15.73:0/2307847509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a35700b250 0x55a357025d50 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:00.716 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:00.715+0000 7f3013baeb80 1 -- 172.21.15.73:0/2307847509 >> 172.21.15.73:0/2307847509 conn(0x55a356f5ac70 msgr2=0x55a357009020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:00.716 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:00.715+0000 7f2fe8ff9700 0 client.16281 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:56:00.720 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:00.720+0000 7f3013baeb80 1 -- 172.21.15.73:0/2307847509 shutdown_connections 2023-08-10T11:56:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:00.724+0000 7f3013baeb80 1 -- 172.21.15.73:0/2307847509 wait complete. 2023-08-10T11:56:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:00.725+0000 7f3013baeb80 20 client.16281 trim_cache size 0 max 16384 2023-08-10T11:56:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:56:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:56:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:56:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:56:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:00.770+0000 7f3007a15700 1 -- 172.21.15.73:0/2452682479 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f2fec0a13c0 msgr2=0x7f2fec0a3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:00.770+0000 7f3007a15700 1 --2- 172.21.15.73:0/2452682479 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f2fec0a13c0 0x7f2fec0a3880 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55a356ff9680 tx=0x7f2ffc0d1890 comp rx=0 tx=0).stop 2023-08-10T11:56:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:00.770+0000 7f3007a15700 1 -- 172.21.15.73:0/2452682479 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30000ff620 msgr2=0x7f300019ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:00.770+0000 7f3007a15700 1 --2- 172.21.15.73:0/2452682479 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30000ff620 0x7f300019ebf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009990 tx=0x7f2ffc009580 comp rx=0 tx=0).stop 2023-08-10T11:56:00.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:00.775+0000 7f3007a15700 1 -- 172.21.15.73:0/2452682479 shutdown_connections 2023-08-10T11:56:00.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:00.775+0000 7f3007a15700 1 --2- 172.21.15.73:0/2452682479 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f2fec0a13c0 0x7f2fec0a3880 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:00.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:00.775+0000 7f3007a15700 1 --2- 172.21.15.73:0/2452682479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30001056c0 0x7f30001989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:00.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:00.775+0000 7f3007a15700 1 --2- 172.21.15.73:0/2452682479 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30000ff620 0x7f300019ebf0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:00.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:00.775+0000 7f3007a15700 1 --2- 172.21.15.73:0/2452682479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30000fffe0 0x7f300019f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:00.775+0000 7f3007a15700 1 -- 172.21.15.73:0/2452682479 >> 172.21.15.73:0/2452682479 conn(0x7f3000076770 msgr2=0x7f30000fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:00.788+0000 7f3007a15700 1 -- 172.21.15.73:0/2452682479 shutdown_connections 2023-08-10T11:56:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:00.797+0000 7f3007a15700 1 -- 172.21.15.73:0/2452682479 wait complete. 2023-08-10T11:56:01.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:00 smithi152 ceph-mon[130220]: pgmap v104: 97 pgs: 97 active+clean; 664 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.6 MiB/s wr, 361 op/s 2023-08-10T11:56:01.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:00 smithi156 ceph-mon[130574]: pgmap v104: 97 pgs: 97 active+clean; 664 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.6 MiB/s wr, 361 op/s 2023-08-10T11:56:01.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:00 smithi073 ceph-mon[128869]: pgmap v104: 97 pgs: 97 active+clean; 664 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.6 MiB/s wr, 361 op/s 2023-08-10T11:56:03.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:02 smithi152 ceph-mon[130220]: pgmap v105: 97 pgs: 97 active+clean; 664 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 189 op/s 2023-08-10T11:56:03.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:02 smithi156 ceph-mon[130574]: pgmap v105: 97 pgs: 97 active+clean; 664 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 189 op/s 2023-08-10T11:56:03.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:02 smithi073 ceph-mon[128869]: pgmap v105: 97 pgs: 97 active+clean; 664 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 189 op/s 2023-08-10T11:56:04.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:04 smithi152 ceph-mon[130220]: pgmap v106: 97 pgs: 97 active+clean; 661 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.8 MiB/s wr, 329 op/s 2023-08-10T11:56:05.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:04 smithi156 ceph-mon[130574]: pgmap v106: 97 pgs: 97 active+clean; 661 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.8 MiB/s wr, 329 op/s 2023-08-10T11:56:05.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:04 smithi073 ceph-mon[128869]: pgmap v106: 97 pgs: 97 active+clean; 661 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.8 MiB/s wr, 329 op/s 2023-08-10T11:56:06.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:06 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:56:06.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:06 smithi152 ceph-mon[130220]: pgmap v107: 97 pgs: 97 active+clean; 663 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.1 MiB/s wr, 363 op/s 2023-08-10T11:56:07.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:06 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:56:07.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:06 smithi156 ceph-mon[130574]: pgmap v107: 97 pgs: 97 active+clean; 663 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.1 MiB/s wr, 363 op/s 2023-08-10T11:56:07.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:06 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:56:07.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:06 smithi073 ceph-mon[128869]: pgmap v107: 97 pgs: 97 active+clean; 663 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.1 MiB/s wr, 363 op/s 2023-08-10T11:56:08.103 INFO:tasks.workunit.client.0.smithi073.stdout: 176 2101007 525 1386310 682 738836 497 2023-08-10T11:56:09.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:08 smithi152 ceph-mon[130220]: pgmap v108: 97 pgs: 97 active+clean; 663 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 318 op/s 2023-08-10T11:56:09.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:08 smithi156 ceph-mon[130574]: pgmap v108: 97 pgs: 97 active+clean; 663 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 318 op/s 2023-08-10T11:56:09.270 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:08 smithi073 ceph-mon[128869]: pgmap v108: 97 pgs: 97 active+clean; 663 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 318 op/s 2023-08-10T11:56:11.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:10 smithi152 ceph-mon[130220]: pgmap v109: 97 pgs: 97 active+clean; 674 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.7 MiB/s wr, 384 op/s 2023-08-10T11:56:11.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:10 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:56:11.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:10 smithi156 ceph-mon[130574]: pgmap v109: 97 pgs: 97 active+clean; 674 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.7 MiB/s wr, 384 op/s 2023-08-10T11:56:11.304 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:10 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:56:11.305 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:10 smithi073 ceph-mon[128869]: pgmap v109: 97 pgs: 97 active+clean; 674 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.7 MiB/s wr, 384 op/s 2023-08-10T11:56:11.305 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:10 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:56:13.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:12 smithi152 ceph-mon[130220]: pgmap v110: 97 pgs: 97 active+clean; 674 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 303 op/s 2023-08-10T11:56:13.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:12 smithi156 ceph-mon[130574]: pgmap v110: 97 pgs: 97 active+clean; 674 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 303 op/s 2023-08-10T11:56:13.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:12 smithi073 ceph-mon[128869]: pgmap v110: 97 pgs: 97 active+clean; 674 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 303 op/s 2023-08-10T11:56:14.078 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.074+0000 7fd798d17700 1 -- 172.21.15.73:0/3762093842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd794119f50 msgr2=0x7fd79411c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:14.079 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.074+0000 7fd798d17700 1 --2- 172.21.15.73:0/3762093842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd794119f50 0x7fd79411c340 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd78c01c0d0 tx=0x7fd78c01c3e0 comp rx=0 tx=0).stop 2023-08-10T11:56:14.080 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.079+0000 7fd798d17700 1 -- 172.21.15.73:0/3762093842 shutdown_connections 2023-08-10T11:56:14.080 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.079+0000 7fd798d17700 1 --2- 172.21.15.73:0/3762093842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd794119f50 0x7fd79411c340 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:14.080 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.079+0000 7fd798d17700 1 --2- 172.21.15.73:0/3762093842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd79410eec0 0x7fd794107770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:14.080 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.079+0000 7fd798d17700 1 --2- 172.21.15.73:0/3762093842 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd79410f330 0x7fd794107cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:14.080 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.079+0000 7fd798d17700 1 -- 172.21.15.73:0/3762093842 >> 172.21.15.73:0/3762093842 conn(0x7fd79406c830 msgr2=0x7fd79406cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:14.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.080+0000 7fd798d17700 1 -- 172.21.15.73:0/3762093842 shutdown_connections 2023-08-10T11:56:14.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.081+0000 7fd798d17700 1 -- 172.21.15.73:0/3762093842 wait complete. 2023-08-10T11:56:14.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.082+0000 7fd798d17700 1 Processor -- start 2023-08-10T11:56:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.084+0000 7fd798d17700 1 -- start start 2023-08-10T11:56:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.084+0000 7fd798d17700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd79410eec0 0x7fd7941154b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.084+0000 7fd798d17700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd79410f330 0x7fd7941159f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.084+0000 7fd798d17700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd794119f50 0x7fd7941a1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:14.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.084+0000 7fd798d17700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7941a2360 con 0x7fd794119f50 2023-08-10T11:56:14.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.084+0000 7fd798d17700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7941a24d0 con 0x7fd79410eec0 2023-08-10T11:56:14.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.084+0000 7fd798d17700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7941a2690 con 0x7fd79410f330 2023-08-10T11:56:14.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.084+0000 7fd791d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd79410f330 0x7fd7941159f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:14.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.084+0000 7fd791d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd79410f330 0x7fd7941159f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60246/0 (socket says 172.21.15.73:60246) 2023-08-10T11:56:14.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.084+0000 7fd791d9b700 1 -- 172.21.15.73:0/645752381 learned_addr learned my addr 172.21.15.73:0/645752381 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.085+0000 7fd79259c700 1 --2- 172.21.15.73:0/645752381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd79410eec0 0x7fd7941154b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.085+0000 7fd791d9b700 1 -- 172.21.15.73:0/645752381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd79410eec0 msgr2=0x7fd7941154b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.085+0000 7fd791d9b700 1 --2- 172.21.15.73:0/645752381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd79410eec0 0x7fd7941154b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.085+0000 7fd791d9b700 1 -- 172.21.15.73:0/645752381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd794119f50 msgr2=0x7fd7941a1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.085+0000 7fd791d9b700 1 --2- 172.21.15.73:0/645752381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd794119f50 0x7fd7941a1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.085+0000 7fd791d9b700 1 -- 172.21.15.73:0/645752381 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c01ad10 con 0x7fd79410f330 2023-08-10T11:56:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.085+0000 7fd791d9b700 1 --2- 172.21.15.73:0/645752381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd79410f330 0x7fd7941159f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd78800e970 tx=0x7fd78800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.086+0000 7fd7837fe700 1 -- 172.21.15.73:0/645752381 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd788009790 con 0x7fd79410f330 2023-08-10T11:56:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.086+0000 7fd7837fe700 1 -- 172.21.15.73:0/645752381 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd788004cf0 con 0x7fd79410f330 2023-08-10T11:56:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.086+0000 7fd7837fe700 1 -- 172.21.15.73:0/645752381 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd788005620 con 0x7fd79410f330 2023-08-10T11:56:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.086+0000 7fd798d17700 1 -- 172.21.15.73:0/645752381 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7941a2970 con 0x7fd79410f330 2023-08-10T11:56:14.089 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.086+0000 7fd798d17700 1 -- 172.21.15.73:0/645752381 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7941aa010 con 0x7fd79410f330 2023-08-10T11:56:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.092+0000 7fd7a4eb0b80 1 Processor -- start 2023-08-10T11:56:14.093 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.092+0000 7fd7a4eb0b80 1 -- start start 2023-08-10T11:56:14.094 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.092+0000 7fd7a4eb0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fda08a40 0x5618fda08e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:14.094 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.093+0000 7fd7a4eb0b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618fda09360 0x5618fda03010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:14.094 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.093+0000 7fd7a4eb0b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618fda03550 0x5618fda039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:14.094 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.093+0000 7fd7a4eb0b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618fd97ed60 con 0x5618fda09360 2023-08-10T11:56:14.094 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.093+0000 7fd7a4eb0b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618fd95b530 con 0x5618fda03550 2023-08-10T11:56:14.094 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.093+0000 7fd7a4eb0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618fd958e50 con 0x5618fda08a40 2023-08-10T11:56:14.095 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.093+0000 7fd7837fe700 1 -- 172.21.15.73:0/645752381 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fd78800cc60 con 0x7fd79410f330 2023-08-10T11:56:14.095 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.093+0000 7fd79259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618fda09360 0x5618fda03010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:14.095 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.093+0000 7fd79259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618fda09360 0x5618fda03010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34748/0 (socket says 172.21.15.73:34748) 2023-08-10T11:56:14.095 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.093+0000 7fd79259c700 1 -- 172.21.15.73:0/2554070123 learned_addr learned my addr 172.21.15.73:0/2554070123 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:14.095 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.093+0000 7fd791d9b700 1 --2- 172.21.15.73:0/2554070123 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618fda03550 0x5618fda039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:14.096 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.093+0000 7fd792d9d700 1 --2- 172.21.15.73:0/2554070123 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fda08a40 0x5618fda08e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:14.096 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.094+0000 7fd7837fe700 1 --2- 172.21.15.73:0/645752381 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd77c0a1400 0x7fd77c0a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:14.096 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.094+0000 7fd7837fe700 1 -- 172.21.15.73:0/645752381 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd788014070 con 0x7fd79410f330 2023-08-10T11:56:14.097 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.094+0000 7fd792d9d700 1 --2- 172.21.15.73:0/645752381 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd77c0a1400 0x7fd77c0a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:14.097 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.094+0000 7fd791d9b700 1 -- 172.21.15.73:0/2554070123 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fda08a40 msgr2=0x5618fda08e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:14.097 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.094+0000 7fd791d9b700 1 --2- 172.21.15.73:0/2554070123 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fda08a40 0x5618fda08e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:14.097 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.094+0000 7fd791d9b700 1 -- 172.21.15.73:0/2554070123 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618fda09360 msgr2=0x5618fda03010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:14.097 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.094+0000 7fd791d9b700 1 --2- 172.21.15.73:0/2554070123 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618fda09360 0x5618fda03010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:14.097 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.094+0000 7fd791d9b700 1 -- 172.21.15.73:0/2554070123 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5618fd7d55d0 con 0x5618fda03550 2023-08-10T11:56:14.098 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.095+0000 7fd791d9b700 1 --2- 172.21.15.73:0/2554070123 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618fda03550 0x5618fda039d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd7880ca6d0 tx=0x7fd78800ef70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cad616b9af86deab server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:14.098 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.095+0000 7fd792d9d700 1 --2- 172.21.15.73:0/645752381 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd77c0a1400 0x7fd77c0a38c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd78c01a620 tx=0x7fd78c01a9f0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:14.098 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.095+0000 7fd780ff9700 1 -- 172.21.15.73:0/2554070123 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd788099b90 con 0x5618fda03550 2023-08-10T11:56:14.098 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.095+0000 7fd780ff9700 1 -- 172.21.15.73:0/2554070123 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd7880999b0 con 0x5618fda03550 2023-08-10T11:56:14.098 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.095+0000 7fd780ff9700 1 -- 172.21.15.73:0/2554070123 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7880a2230 con 0x5618fda03550 2023-08-10T11:56:14.099 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.096+0000 7fd7a4eb0b80 1 -- 172.21.15.73:0/2554070123 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618fda03550 msgr2=0x5618fda039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:14.099 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.096+0000 7fd7a4eb0b80 1 --2- 172.21.15.73:0/2554070123 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618fda03550 0x5618fda039d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd7880ca6d0 tx=0x7fd78800ef70 comp rx=0 tx=0).stop 2023-08-10T11:56:14.099 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.096+0000 7fd7a4eb0b80 1 -- 172.21.15.73:0/2554070123 shutdown_connections 2023-08-10T11:56:14.099 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.096+0000 7fd7a4eb0b80 1 --2- 172.21.15.73:0/2554070123 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618fda03550 0x5618fda039d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:14.099 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.096+0000 7fd7a4eb0b80 1 --2- 172.21.15.73:0/2554070123 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fda08a40 0x5618fda08e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:14.099 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.096+0000 7fd7a4eb0b80 1 --2- 172.21.15.73:0/2554070123 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618fda09360 0x5618fda03010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:14.100 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.096+0000 7fd7a4eb0b80 1 -- 172.21.15.73:0/2554070123 >> 172.21.15.73:0/2554070123 conn(0x5618fd960c70 msgr2=0x5618fd9fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:14.102 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.100+0000 7fd7a4eb0b80 1 -- 172.21.15.73:0/2554070123 shutdown_connections 2023-08-10T11:56:14.105 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.104+0000 7fd7a4eb0b80 1 -- 172.21.15.73:0/2554070123 wait complete. 2023-08-10T11:56:14.105 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.104+0000 7fd7a4eb0b80 1 -- start start 2023-08-10T11:56:14.105 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.104+0000 7fd7a4eb0b80 1 Processor -- start 2023-08-10T11:56:14.106 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.105+0000 7fd7a4eb0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fda03550 0x5618fda0f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:14.106 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.105+0000 7fd7a4eb0b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618fda08a40 0x5618fda0c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:14.106 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.105+0000 7fd7a4eb0b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618fda09360 0x5618fda0cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:14.106 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.105+0000 7fd7a4eb0b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618fd954740 con 0x5618fda09360 2023-08-10T11:56:14.106 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.105+0000 7fd7a4eb0b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618fd8f3a60 con 0x5618fda08a40 2023-08-10T11:56:14.107 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.105+0000 7fd7a4eb0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618fd8f3760 con 0x5618fda03550 2023-08-10T11:56:14.107 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.105+0000 7fd7a4eb0b80 10 client.0 _ll_register_callbacks cb 0x5618fd8f1620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:56:14.107 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.105+0000 7fd79259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fda03550 0x5618fda0f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:14.107 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.105+0000 7fd79259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fda03550 0x5618fda0f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60260/0 (socket says 172.21.15.73:60260) 2023-08-10T11:56:14.107 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.105+0000 7fd79259c700 1 -- 172.21.15.73:0/1426984024 learned_addr learned my addr 172.21.15.73:0/1426984024 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:14.108 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.106+0000 7fd79259c700 1 -- 172.21.15.73:0/1426984024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618fda08a40 msgr2=0x5618fda0c610 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T11:56:14.108 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.106+0000 7fd79259c700 1 --2- 172.21.15.73:0/1426984024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618fda08a40 0x5618fda0c610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:14.108 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.106+0000 7fd79259c700 1 -- 172.21.15.73:0/1426984024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618fda09360 msgr2=0x5618fda0cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:14.108 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.106+0000 7fd79259c700 1 --2- 172.21.15.73:0/1426984024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618fda09360 0x5618fda0cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:14.108 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.106+0000 7fd79259c700 1 -- 172.21.15.73:0/1426984024 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7941aa010 con 0x5618fda03550 2023-08-10T11:56:14.108 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.107+0000 7fd79259c700 1 --2- 172.21.15.73:0/1426984024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fda03550 0x5618fda0f390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd78400f4f0 tx=0x7fd78400f8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d71031db744550f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:14.109 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.107+0000 7fd779ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T11:56:14.110 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.110+0000 7fd779ffb700 1 -- 172.21.15.73:0/1426984024 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78400a5e0 con 0x5618fda03550 2023-08-10T11:56:14.110 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.110+0000 7fd779ffb700 1 -- 172.21.15.73:0/1426984024 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd784013850 con 0x5618fda03550 2023-08-10T11:56:14.116 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.111+0000 7fd7a4eb0b80 1 -- 172.21.15.73:0/1426984024 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5618fd9f61c0 con 0x5618fda03550 2023-08-10T11:56:14.116 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.115+0000 7fd779ffb700 1 -- 172.21.15.73:0/1426984024 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd784013a10 con 0x5618fda03550 2023-08-10T11:56:14.116 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.115+0000 7fd7a4eb0b80 10 client.25738 fetch_fsmap learned FSMap version 36 2023-08-10T11:56:14.116 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.115+0000 7fd7a4eb0b80 1 -- 172.21.15.73:0/1426984024 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5618fd781d80 con 0x5618fda03550 2023-08-10T11:56:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.116+0000 7fd779ffb700 1 -- 172.21.15.73:0/1426984024 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5618fd9f61c0 con 0x5618fda03550 2023-08-10T11:56:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.116+0000 7fd779ffb700 1 -- 172.21.15.73:0/1426984024 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 36) v1 ==== 7510+0+0 (secure 0 0 0) 0x7fd784019020 con 0x5618fda03550 2023-08-10T11:56:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.116+0000 7fd7a4eb0b80 10 client.25738 fetch_fsmap finished waiting for FSMap version 36 2023-08-10T11:56:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.116+0000 7fd7a4eb0b80 10 client.25738 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:56:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.116+0000 7fd7a4eb0b80 20 client.25738 populate_metadata read hostname 'smithi073' 2023-08-10T11:56:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.116+0000 7fd7a4eb0b80 1 --2- 172.21.15.73:0/1426984024 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5618fda1cd80 0x5618fda1f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.116+0000 7fd7a4eb0b80 4 client.25738 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:56:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.116+0000 7fd7a4eb0b80 1 -- 172.21.15.73:0/1426984024 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5618fd9d2970 con 0x5618fda1cd80 2023-08-10T11:56:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.117+0000 7fd791d9b700 1 --2- 172.21.15.73:0/1426984024 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5618fda1cd80 0x5618fda1f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.119+0000 7fd791d9b700 1 --2- 172.21.15.73:0/1426984024 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5618fda1cd80 0x5618fda1f1a0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb80bf0c74fe62d1 server_cookie=260520ec9d553429 in_seq=0 out_seq=0 2023-08-10T11:56:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.119+0000 7fd779ffb700 10 client.25738 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:56:14.124 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.122+0000 7fd779ffb700 1 -- 172.21.15.73:0/1426984024 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5618fd9d2970 con 0x5618fda1cd80 2023-08-10T11:56:14.124 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.122+0000 7fd779ffb700 10 client.25738 handle_command_reply: tid=0 2023-08-10T11:56:14.124 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.124+0000 7fd7a4eb0b80 1 client.25738 shutdown 2023-08-10T11:56:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.127+0000 7fd7a4eb0b80 1 -- 172.21.15.73:0/1426984024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fda03550 msgr2=0x5618fda0f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.127+0000 7fd7a4eb0b80 1 --2- 172.21.15.73:0/1426984024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fda03550 0x5618fda0f390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd78400f4f0 tx=0x7fd78400f8b0 comp rx=0 tx=0).stop 2023-08-10T11:56:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.127+0000 7fd7a4eb0b80 1 -- 172.21.15.73:0/1426984024 shutdown_connections 2023-08-10T11:56:14.129 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.127+0000 7fd7a4eb0b80 1 --2- 172.21.15.73:0/1426984024 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5618fda1cd80 0x5618fda1f1a0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:14.129 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.127+0000 7fd7a4eb0b80 1 --2- 172.21.15.73:0/1426984024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618fda09360 0x5618fda0cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:14.129 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.127+0000 7fd7a4eb0b80 1 --2- 172.21.15.73:0/1426984024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fda03550 0x5618fda0f390 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:14.129 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.127+0000 7fd7a4eb0b80 1 --2- 172.21.15.73:0/1426984024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618fda08a40 0x5618fda0c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:14.129 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.127+0000 7fd7a4eb0b80 1 -- 172.21.15.73:0/1426984024 >> 172.21.15.73:0/1426984024 conn(0x5618fd960c70 msgr2=0x5618fd9fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:14.129 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.127+0000 7fd779ffb700 0 client.25738 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:56:14.130 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.128+0000 7fd7a4eb0b80 1 -- 172.21.15.73:0/1426984024 shutdown_connections 2023-08-10T11:56:14.130 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.128+0000 7fd7a4eb0b80 1 -- 172.21.15.73:0/1426984024 wait complete. 2023-08-10T11:56:14.130 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.128+0000 7fd7a4eb0b80 20 client.25738 trim_cache size 0 max 16384 2023-08-10T11:56:14.156 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.156+0000 7fd7a4eb0b80 1 Processor -- start 2023-08-10T11:56:14.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.156+0000 7fd7a4eb0b80 1 -- start start 2023-08-10T11:56:14.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.156+0000 7fd7a4eb0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fda03550 0x5618fda0c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:14.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.156+0000 7fd7a4eb0b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618fda08a40 0x5618fda0bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:14.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.156+0000 7fd7a4eb0b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618fda09360 0x5618fd9fdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:14.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.156+0000 7fd7a4eb0b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618fd7d78c0 con 0x5618fda08a40 2023-08-10T11:56:14.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.156+0000 7fd7a4eb0b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618fda086c0 con 0x5618fda09360 2023-08-10T11:56:14.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.156+0000 7fd7a4eb0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618fda18d10 con 0x5618fda03550 2023-08-10T11:56:14.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.157+0000 7fd79259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fda03550 0x5618fda0c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:14.159 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.157+0000 7fd79259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fda03550 0x5618fda0c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60268/0 (socket says 172.21.15.73:60268) 2023-08-10T11:56:14.159 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.157+0000 7fd79259c700 1 -- 172.21.15.73:0/1381284071 learned_addr learned my addr 172.21.15.73:0/1381284071 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:14.160 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.157+0000 7fd792d9d700 1 --2- 172.21.15.73:0/1381284071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618fda09360 0x5618fd9fdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:14.161 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.158+0000 7fd79259c700 1 -- 172.21.15.73:0/1381284071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618fda09360 msgr2=0x5618fd9fdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:14.161 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.158+0000 7fd79259c700 1 --2- 172.21.15.73:0/1381284071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618fda09360 0x5618fd9fdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:14.161 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.158+0000 7fd79259c700 1 -- 172.21.15.73:0/1381284071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618fda08a40 msgr2=0x5618fda0bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:14.161 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.158+0000 7fd79259c700 1 --2- 172.21.15.73:0/1381284071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618fda08a40 0x5618fda0bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:14.161 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.158+0000 7fd79259c700 1 -- 172.21.15.73:0/1381284071 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5618fd76ac00 con 0x5618fda03550 2023-08-10T11:56:14.163 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.163+0000 7fd79259c700 1 --2- 172.21.15.73:0/1381284071 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fda03550 0x5618fda0c5d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd7840048a0 tx=0x7fd784006ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63fd3512795b7da8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:14.164 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.163+0000 7fd7817fa700 1 -- 172.21.15.73:0/1381284071 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78402b030 con 0x5618fda03550 2023-08-10T11:56:14.164 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.163+0000 7fd7817fa700 1 -- 172.21.15.73:0/1381284071 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd78400c040 con 0x5618fda03550 2023-08-10T11:56:14.164 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.163+0000 7fd7817fa700 1 -- 172.21.15.73:0/1381284071 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd784013650 con 0x5618fda03550 2023-08-10T11:56:14.165 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.164+0000 7fd7a4eb0b80 1 -- 172.21.15.73:0/1381284071 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fda03550 msgr2=0x5618fda0c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:14.165 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.164+0000 7fd7a4eb0b80 1 --2- 172.21.15.73:0/1381284071 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fda03550 0x5618fda0c5d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd7840048a0 tx=0x7fd784006ef0 comp rx=0 tx=0).stop 2023-08-10T11:56:14.165 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.164+0000 7fd7a4eb0b80 1 -- 172.21.15.73:0/1381284071 shutdown_connections 2023-08-10T11:56:14.165 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.164+0000 7fd7a4eb0b80 1 --2- 172.21.15.73:0/1381284071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618fda09360 0x5618fd9fdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:14.166 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.164+0000 7fd7a4eb0b80 1 --2- 172.21.15.73:0/1381284071 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fda03550 0x5618fda0c5d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:14.166 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.164+0000 7fd7a4eb0b80 1 --2- 172.21.15.73:0/1381284071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618fda08a40 0x5618fda0bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:14.166 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.164+0000 7fd7a4eb0b80 1 -- 172.21.15.73:0/1381284071 >> 172.21.15.73:0/1381284071 conn(0x5618fd960c70 msgr2=0x5618fda06830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:14.166 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.165+0000 7fd7a4eb0b80 1 -- 172.21.15.73:0/1381284071 shutdown_connections 2023-08-10T11:56:14.167 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.165+0000 7fd7a4eb0b80 1 -- 172.21.15.73:0/1381284071 wait complete. 2023-08-10T11:56:14.167 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.165+0000 7fd7a4eb0b80 1 -- start start 2023-08-10T11:56:14.167 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.166+0000 7fd7a4eb0b80 1 Processor -- start 2023-08-10T11:56:14.167 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.166+0000 7fd7a4eb0b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618fda03550 0x5618fda11fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:14.168 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.166+0000 7fd7a4eb0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fda08a40 0x5618fda12500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:14.168 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.166+0000 7fd7a4eb0b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618fda09360 0x5618fda6fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:14.168 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.166+0000 7fd7a4eb0b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618fda6ffb0 con 0x5618fda03550 2023-08-10T11:56:14.168 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.166+0000 7fd7a4eb0b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618fda700f0 con 0x5618fda09360 2023-08-10T11:56:14.168 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.166+0000 7fd7a4eb0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618fda70260 con 0x5618fda08a40 2023-08-10T11:56:14.168 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.166+0000 7fd7a4eb0b80 10 client.0 _ll_register_callbacks cb 0x5618fd8f1620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:56:14.168 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.166+0000 7fd792d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618fda09360 0x5618fda6fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:14.169 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.167+0000 7fd792d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618fda09360 0x5618fda6fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49422/0 (socket says 172.21.15.73:49422) 2023-08-10T11:56:14.169 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.167+0000 7fd792d9d700 1 -- 172.21.15.73:0/3721150095 learned_addr learned my addr 172.21.15.73:0/3721150095 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.170+0000 7fd79259c700 1 --2- 172.21.15.73:0/3721150095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618fda03550 0x5618fda11fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.170+0000 7fd792d9d700 1 -- 172.21.15.73:0/3721150095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fda08a40 msgr2=0x5618fda12500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.170+0000 7fd792d9d700 1 --2- 172.21.15.73:0/3721150095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fda08a40 0x5618fda12500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.170+0000 7fd792d9d700 1 -- 172.21.15.73:0/3721150095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618fda03550 msgr2=0x5618fda11fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.170+0000 7fd792d9d700 1 --2- 172.21.15.73:0/3721150095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618fda03550 0x5618fda11fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.170+0000 7fd792d9d700 1 -- 172.21.15.73:0/3721150095 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5618fd781d80 con 0x5618fda09360 2023-08-10T11:56:14.172 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.171+0000 7fd792d9d700 1 --2- 172.21.15.73:0/3721150095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618fda09360 0x5618fda6fa70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd78c01c0d0 tx=0x7fd78c005a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d55f23155c779012 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:14.173 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.171+0000 7fd779ffb700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T11:56:14.174 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.172+0000 7fd779ffb700 1 -- 172.21.15.73:0/3721150095 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c01f030 con 0x5618fda09360 2023-08-10T11:56:14.174 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.173+0000 7fd7a4eb0b80 1 -- 172.21.15.73:0/3721150095 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd7880999b0 con 0x5618fda09360 2023-08-10T11:56:14.175 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.173+0000 7fd779ffb700 1 -- 172.21.15.73:0/3721150095 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd78c005310 con 0x5618fda09360 2023-08-10T11:56:14.175 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.175+0000 7fd779ffb700 1 -- 172.21.15.73:0/3721150095 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd78c0054d0 con 0x5618fda09360 2023-08-10T11:56:14.176 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.176+0000 7fd7a4eb0b80 10 client.25706 fetch_fsmap learned FSMap version 36 2023-08-10T11:56:14.177 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.176+0000 7fd7a4eb0b80 1 -- 172.21.15.73:0/3721150095 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5618fd7a81f0 con 0x5618fda09360 2023-08-10T11:56:14.178 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.177+0000 7fd779ffb700 1 -- 172.21.15.73:0/3721150095 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd7880999b0 con 0x5618fda09360 2023-08-10T11:56:14.180 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.179+0000 7fd779ffb700 1 -- 172.21.15.73:0/3721150095 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 36) v1 ==== 7510+0+0 (secure 0 0 0) 0x7fd78c03acc0 con 0x5618fda09360 2023-08-10T11:56:14.180 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.180+0000 7fd7a4eb0b80 10 client.25706 fetch_fsmap finished waiting for FSMap version 36 2023-08-10T11:56:14.180 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.180+0000 7fd7a4eb0b80 10 client.25706 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:56:14.181 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.180+0000 7fd7a4eb0b80 20 client.25706 populate_metadata read hostname 'smithi073' 2023-08-10T11:56:14.181 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.180+0000 7fd7a4eb0b80 1 --2- 172.21.15.73:0/3721150095 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5618fda71ad0 0x5618fda73ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:14.181 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.180+0000 7fd7a4eb0b80 4 client.25706 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:56:14.181 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.180+0000 7fd7a4eb0b80 1 -- 172.21.15.73:0/3721150095 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5618fd94d720 con 0x5618fda71ad0 2023-08-10T11:56:14.185 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.185+0000 7fd79259c700 1 --2- 172.21.15.73:0/3721150095 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5618fda71ad0 0x5618fda73ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:14.197 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.188+0000 7fd79259c700 1 --2- 172.21.15.73:0/3721150095 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5618fda71ad0 0x5618fda73ef0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d33a5a9deb64def server_cookie=62f962ad3996bac6 in_seq=0 out_seq=0 2023-08-10T11:56:14.198 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:14.188+0000 7fd779ffb700 10 client.25706 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:56:14.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:14 smithi152 ceph-mon[130220]: pgmap v111: 97 pgs: 97 active+clean; 735 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.0 MiB/s wr, 601 op/s 2023-08-10T11:56:15.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:14 smithi156 ceph-mon[130574]: pgmap v111: 97 pgs: 97 active+clean; 735 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.0 MiB/s wr, 601 op/s 2023-08-10T11:56:15.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:14 smithi073 ceph-mon[128869]: pgmap v111: 97 pgs: 97 active+clean; 735 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.0 MiB/s wr, 601 op/s 2023-08-10T11:56:15.385 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:15.382+0000 7fd779ffb700 1 -- 172.21.15.73:0/3721150095 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5618fd94d720 con 0x5618fda71ad0 2023-08-10T11:56:15.386 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:15.382+0000 7fd779ffb700 10 client.25706 handle_command_reply: tid=0 2023-08-10T11:56:15.386 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:15.384+0000 7fd7a4eb0b80 1 client.25706 shutdown 2023-08-10T11:56:15.386 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:15.384+0000 7fd7a4eb0b80 1 -- 172.21.15.73:0/3721150095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618fda09360 msgr2=0x5618fda6fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:15.386 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:15.384+0000 7fd7a4eb0b80 1 --2- 172.21.15.73:0/3721150095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618fda09360 0x5618fda6fa70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd78c01c0d0 tx=0x7fd78c005a20 comp rx=0 tx=0).stop 2023-08-10T11:56:15.398 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:15.394+0000 7fd7a4eb0b80 1 -- 172.21.15.73:0/3721150095 shutdown_connections 2023-08-10T11:56:15.398 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:15.394+0000 7fd7a4eb0b80 1 --2- 172.21.15.73:0/3721150095 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5618fda71ad0 0x5618fda73ef0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:15.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:15.394+0000 7fd7a4eb0b80 1 --2- 172.21.15.73:0/3721150095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618fda09360 0x5618fda6fa70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:15.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:15.394+0000 7fd7a4eb0b80 1 --2- 172.21.15.73:0/3721150095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5618fda03550 0x5618fda11fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:15.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:15.394+0000 7fd7a4eb0b80 1 --2- 172.21.15.73:0/3721150095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fda08a40 0x5618fda12500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:15.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:15.394+0000 7fd7a4eb0b80 1 -- 172.21.15.73:0/3721150095 >> 172.21.15.73:0/3721150095 conn(0x5618fd960c70 msgr2=0x5618fda077b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:15.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:15.394+0000 7fd779ffb700 0 client.25706 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:56:15.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:15.402+0000 7fd7a4eb0b80 1 -- 172.21.15.73:0/3721150095 shutdown_connections 2023-08-10T11:56:15.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:15.402+0000 7fd7a4eb0b80 1 -- 172.21.15.73:0/3721150095 wait complete. 2023-08-10T11:56:15.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:56:15.409 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:56:15.409 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:56:15.409 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:56:15.409 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:15.408+0000 7fd7a4eb0b80 20 client.25706 trim_cache size 0 max 16384 2023-08-10T11:56:15.436 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:15.429+0000 7fd798d17700 1 -- 172.21.15.73:0/645752381 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd77c0a1400 msgr2=0x7fd77c0a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:15.437 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:15.429+0000 7fd798d17700 1 --2- 172.21.15.73:0/645752381 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd77c0a1400 0x7fd77c0a38c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd78c01a620 tx=0x7fd78c01a9f0 comp rx=0 tx=0).stop 2023-08-10T11:56:15.437 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:15.429+0000 7fd798d17700 1 -- 172.21.15.73:0/645752381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd79410f330 msgr2=0x7fd7941159f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:15.437 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:15.429+0000 7fd798d17700 1 --2- 172.21.15.73:0/645752381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd79410f330 0x7fd7941159f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd78800e970 tx=0x7fd78800ed30 comp rx=0 tx=0).stop 2023-08-10T11:56:15.445 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:15.444+0000 7fd798d17700 1 -- 172.21.15.73:0/645752381 shutdown_connections 2023-08-10T11:56:15.445 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:15.444+0000 7fd798d17700 1 --2- 172.21.15.73:0/645752381 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd77c0a1400 0x7fd77c0a38c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:15.446 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:15.444+0000 7fd798d17700 1 --2- 172.21.15.73:0/645752381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd79410eec0 0x7fd7941154b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:15.446 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:15.444+0000 7fd798d17700 1 --2- 172.21.15.73:0/645752381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd794119f50 0x7fd7941a1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:15.446 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:15.444+0000 7fd798d17700 1 --2- 172.21.15.73:0/645752381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd79410f330 0x7fd7941159f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:15.446 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:15.444+0000 7fd798d17700 1 -- 172.21.15.73:0/645752381 >> 172.21.15.73:0/645752381 conn(0x7fd79406c830 msgr2=0x7fd79411b490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:15.446 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:15.445+0000 7fd798d17700 1 -- 172.21.15.73:0/645752381 shutdown_connections 2023-08-10T11:56:15.447 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:15.445+0000 7fd798d17700 1 -- 172.21.15.73:0/645752381 wait complete. 2023-08-10T11:56:16.305 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:56:16.748 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:16 smithi073 ceph-mon[128869]: pgmap v112: 97 pgs: 97 active+clean; 795 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 12 MiB/s wr, 745 op/s 2023-08-10T11:56:16.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:16 smithi152 ceph-mon[130220]: pgmap v112: 97 pgs: 97 active+clean; 795 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 12 MiB/s wr, 745 op/s 2023-08-10T11:56:17.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:16 smithi156 ceph-mon[130574]: pgmap v112: 97 pgs: 97 active+clean; 795 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 12 MiB/s wr, 745 op/s 2023-08-10T11:56:18.112 INFO:tasks.workunit.client.0.smithi073.stdout: 191 2271607 819 1506672 668 787872 419 2023-08-10T11:56:18.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.151+0000 7f2d3d53d700 1 -- 172.21.15.73:0/1821869885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d38119f50 msgr2=0x7f2d3811c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:18.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.151+0000 7f2d3d53d700 1 --2- 172.21.15.73:0/1821869885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d38119f50 0x7f2d3811c340 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009f90 tx=0x7f2d3000b330 comp rx=0 tx=0).stop 2023-08-10T11:56:18.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.151+0000 7f2d3d53d700 1 -- 172.21.15.73:0/1821869885 shutdown_connections 2023-08-10T11:56:18.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.151+0000 7f2d3d53d700 1 --2- 172.21.15.73:0/1821869885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d38119f50 0x7f2d3811c340 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.151+0000 7f2d3d53d700 1 --2- 172.21.15.73:0/1821869885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d3810ee20 0x7f2d3810c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.151+0000 7f2d3d53d700 1 --2- 172.21.15.73:0/1821869885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d3810f290 0x7f2d3810cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.151+0000 7f2d3d53d700 1 -- 172.21.15.73:0/1821869885 >> 172.21.15.73:0/1821869885 conn(0x7f2d3806ca30 msgr2=0x7f2d3806ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:18.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.151+0000 7f2d3d53d700 1 -- 172.21.15.73:0/1821869885 shutdown_connections 2023-08-10T11:56:18.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.151+0000 7f2d3d53d700 1 -- 172.21.15.73:0/1821869885 wait complete. 2023-08-10T11:56:18.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.152+0000 7f2d3d53d700 1 Processor -- start 2023-08-10T11:56:18.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.153+0000 7f2d3d53d700 1 -- start start 2023-08-10T11:56:18.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.153+0000 7f2d3d53d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d3810ee20 0x7f2d380783d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:18.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.153+0000 7f2d3d53d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d3810f290 0x7f2d38078930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:18.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.153+0000 7f2d3d53d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d38119f50 0x7f2d380734e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:18.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.153+0000 7f2d3d53d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d38073cb0 con 0x7f2d3810f290 2023-08-10T11:56:18.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.153+0000 7f2d3d53d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d38073e20 con 0x7f2d3810ee20 2023-08-10T11:56:18.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.153+0000 7f2d3d53d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d38073fe0 con 0x7f2d38119f50 2023-08-10T11:56:18.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.154+0000 7f2d36ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d3810ee20 0x7f2d380783d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:18.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.154+0000 7f2d36ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d3810ee20 0x7f2d380783d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49436/0 (socket says 172.21.15.73:49436) 2023-08-10T11:56:18.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.154+0000 7f2d36ffd700 1 -- 172.21.15.73:0/2402547381 learned_addr learned my addr 172.21.15.73:0/2402547381 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:18.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.154+0000 7f2d377fe700 1 --2- 172.21.15.73:0/2402547381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d38119f50 0x7f2d380734e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:18.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.157+0000 7f2d367fc700 1 --2- 172.21.15.73:0/2402547381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d3810f290 0x7f2d38078930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:18.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.163+0000 7f2d36ffd700 1 -- 172.21.15.73:0/2402547381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d38119f50 msgr2=0x7f2d380734e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:18.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.163+0000 7f2d36ffd700 1 --2- 172.21.15.73:0/2402547381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d38119f50 0x7f2d380734e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.163+0000 7f2d36ffd700 1 -- 172.21.15.73:0/2402547381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d3810f290 msgr2=0x7f2d38078930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:18.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.163+0000 7f2d36ffd700 1 --2- 172.21.15.73:0/2402547381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d3810f290 0x7f2d38078930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.163+0000 7f2d36ffd700 1 -- 172.21.15.73:0/2402547381 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d30009c40 con 0x7f2d3810ee20 2023-08-10T11:56:18.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.164+0000 7f2d36ffd700 1 --2- 172.21.15.73:0/2402547381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d3810ee20 0x7f2d380783d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2d280529d0 tx=0x7f2d28052ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:18.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.246+0000 7f2d27fff700 1 -- 172.21.15.73:0/2402547381 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d28004a30 con 0x7f2d3810ee20 2023-08-10T11:56:18.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.246+0000 7f2d27fff700 1 -- 172.21.15.73:0/2402547381 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d28050c90 con 0x7f2d3810ee20 2023-08-10T11:56:18.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.246+0000 7f2d27fff700 1 -- 172.21.15.73:0/2402547381 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d280054e0 con 0x7f2d3810ee20 2023-08-10T11:56:18.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.246+0000 7f2d3d53d700 1 -- 172.21.15.73:0/2402547381 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d380742c0 con 0x7f2d3810ee20 2023-08-10T11:56:18.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.246+0000 7f2d3d53d700 1 -- 172.21.15.73:0/2402547381 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d38080430 con 0x7f2d3810ee20 2023-08-10T11:56:18.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.252+0000 7f2d496d6b80 1 Processor -- start 2023-08-10T11:56:18.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.256+0000 7f2d496d6b80 1 -- start start 2023-08-10T11:56:18.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.256+0000 7f2d496d6b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634cd27bf50 0x5634cd27c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:18.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.256+0000 7f2d496d6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634cd27c870 0x5634cd2762c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:18.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.256+0000 7f2d496d6b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634cd276800 0x5634cd276c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:18.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.256+0000 7f2d496d6b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634cd1f1dc0 con 0x5634cd276800 2023-08-10T11:56:18.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.256+0000 7f2d496d6b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634cd1ce590 con 0x5634cd27bf50 2023-08-10T11:56:18.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.256+0000 7f2d496d6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634cd1cbeb0 con 0x5634cd27c870 2023-08-10T11:56:18.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.257+0000 7f2d377fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634cd27bf50 0x5634cd27c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:18.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.257+0000 7f2d377fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634cd27bf50 0x5634cd27c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49442/0 (socket says 172.21.15.73:49442) 2023-08-10T11:56:18.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.257+0000 7f2d377fe700 1 -- 172.21.15.73:0/2993545952 learned_addr learned my addr 172.21.15.73:0/2993545952 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:18.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.257+0000 7f2d27fff700 1 -- 172.21.15.73:0/2402547381 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f2d280507d0 con 0x7f2d3810ee20 2023-08-10T11:56:18.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.258+0000 7f2d27fff700 1 --2- 172.21.15.73:0/2402547381 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f2d200a14d0 0x7f2d200a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:18.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.259+0000 7f2d27fff700 1 -- 172.21.15.73:0/2402547381 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f2d28058070 con 0x7f2d3810ee20 2023-08-10T11:56:18.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.259+0000 7f2d377fe700 1 -- 172.21.15.73:0/2993545952 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634cd27c870 msgr2=0x5634cd2762c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T11:56:18.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.259+0000 7f2d377fe700 1 --2- 172.21.15.73:0/2993545952 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634cd27c870 0x5634cd2762c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.259+0000 7f2d377fe700 1 -- 172.21.15.73:0/2993545952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634cd276800 msgr2=0x5634cd276c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:18.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.259+0000 7f2d377fe700 1 --2- 172.21.15.73:0/2993545952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634cd276800 0x5634cd276c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.259+0000 7f2d377fe700 1 -- 172.21.15.73:0/2993545952 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634cd048630 con 0x5634cd27bf50 2023-08-10T11:56:18.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.260+0000 7f2d377fe700 1 --2- 172.21.15.73:0/2402547381 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f2d200a14d0 0x7f2d200a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:18.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.260+0000 7f2d377fe700 1 --2- 172.21.15.73:0/2993545952 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634cd27bf50 0x5634cd27c330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009ac0 tx=0x7f2d30009af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3531d5e860de8892 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:18.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.273+0000 7f2d257fa700 1 -- 172.21.15.73:0/2993545952 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3000e040 con 0x5634cd27bf50 2023-08-10T11:56:18.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.273+0000 7f2d257fa700 1 -- 172.21.15.73:0/2993545952 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d30007e10 con 0x5634cd27bf50 2023-08-10T11:56:18.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.273+0000 7f2d257fa700 1 -- 172.21.15.73:0/2993545952 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3000bdf0 con 0x5634cd27bf50 2023-08-10T11:56:18.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.274+0000 7f2d496d6b80 1 -- 172.21.15.73:0/2993545952 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634cd27bf50 msgr2=0x5634cd27c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:18.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.274+0000 7f2d496d6b80 1 --2- 172.21.15.73:0/2993545952 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634cd27bf50 0x5634cd27c330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009ac0 tx=0x7f2d30009af0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.275+0000 7f2d496d6b80 1 -- 172.21.15.73:0/2993545952 shutdown_connections 2023-08-10T11:56:18.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.275+0000 7f2d496d6b80 1 --2- 172.21.15.73:0/2993545952 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634cd27bf50 0x5634cd27c330 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.275+0000 7f2d496d6b80 1 --2- 172.21.15.73:0/2993545952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634cd276800 0x5634cd276c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.275+0000 7f2d496d6b80 1 --2- 172.21.15.73:0/2993545952 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634cd27c870 0x5634cd2762c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.275+0000 7f2d496d6b80 1 -- 172.21.15.73:0/2993545952 >> 172.21.15.73:0/2993545952 conn(0x5634cd1d3cd0 msgr2=0x5634cd2714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:18.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.275+0000 7f2d496d6b80 1 -- 172.21.15.73:0/2993545952 shutdown_connections 2023-08-10T11:56:18.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.275+0000 7f2d496d6b80 1 -- 172.21.15.73:0/2993545952 wait complete. 2023-08-10T11:56:18.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.276+0000 7f2d496d6b80 1 -- start start 2023-08-10T11:56:18.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.276+0000 7f2d496d6b80 1 Processor -- start 2023-08-10T11:56:18.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.276+0000 7f2d496d6b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634cd276800 0x5634cd27fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:18.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.276+0000 7f2d496d6b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634cd27bf50 0x5634cd2801a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:18.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.276+0000 7f2d496d6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634cd27c870 0x5634cd2806e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:18.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.276+0000 7f2d496d6b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634cd1c77a0 con 0x5634cd276800 2023-08-10T11:56:18.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.276+0000 7f2d496d6b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634cd166ac0 con 0x5634cd27bf50 2023-08-10T11:56:18.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.276+0000 7f2d496d6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634cd1667c0 con 0x5634cd27c870 2023-08-10T11:56:18.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.276+0000 7f2d496d6b80 10 client.0 _ll_register_callbacks cb 0x5634cd164680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:56:18.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.280+0000 7f2d36ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634cd276800 0x5634cd27fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:18.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.280+0000 7f2d36ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634cd276800 0x5634cd27fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34798/0 (socket says 172.21.15.73:34798) 2023-08-10T11:56:18.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.280+0000 7f2d36ffd700 1 -- 172.21.15.73:0/2121977906 learned_addr learned my addr 172.21.15.73:0/2121977906 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:18.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.285+0000 7f2d367fc700 1 --2- 172.21.15.73:0/2121977906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634cd27bf50 0x5634cd2801a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:18.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.285+0000 7f2d377fe700 1 --2- 172.21.15.73:0/2121977906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634cd27c870 0x5634cd2806e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:18.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.292+0000 7f2d36ffd700 1 -- 172.21.15.73:0/2121977906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634cd27c870 msgr2=0x5634cd2806e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:18.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.292+0000 7f2d36ffd700 1 --2- 172.21.15.73:0/2121977906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634cd27c870 0x5634cd2806e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.292+0000 7f2d36ffd700 1 -- 172.21.15.73:0/2121977906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634cd27bf50 msgr2=0x5634cd2801a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:18.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.292+0000 7f2d36ffd700 1 --2- 172.21.15.73:0/2121977906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634cd27bf50 0x5634cd2801a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.292+0000 7f2d36ffd700 1 -- 172.21.15.73:0/2121977906 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d3811cc40 con 0x5634cd276800 2023-08-10T11:56:18.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.292+0000 7f2d377fe700 1 --2- 172.21.15.73:0/2402547381 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f2d200a14d0 0x7f2d200a3990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009ac0 tx=0x7f2d30009af0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:18.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.301+0000 7f2d36ffd700 1 --2- 172.21.15.73:0/2121977906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634cd276800 0x5634cd27fc60 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2d280da330 tx=0x7f2d280dda20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8680f4e45e99cb6a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:18.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.303+0000 7f2d1a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:56:18.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.313+0000 7f2d1a7fc700 1 -- 172.21.15.73:0/2121977906 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d280e1e60 con 0x5634cd276800 2023-08-10T11:56:18.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.313+0000 7f2d1a7fc700 1 -- 172.21.15.73:0/2121977906 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f2d280e6280 con 0x5634cd276800 2023-08-10T11:56:18.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.313+0000 7f2d496d6b80 1 -- 172.21.15.73:0/2121977906 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5634cd269470 con 0x5634cd276800 2023-08-10T11:56:18.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.332+0000 7f2d1a7fc700 1 -- 172.21.15.73:0/2121977906 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d28005640 con 0x5634cd276800 2023-08-10T11:56:18.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.341+0000 7f2d496d6b80 10 client.16296 fetch_fsmap learned FSMap version 36 2023-08-10T11:56:18.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.341+0000 7f2d496d6b80 1 -- 172.21.15.73:0/2121977906 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5634ccff4de0 con 0x5634cd276800 2023-08-10T11:56:18.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.352+0000 7f2d1a7fc700 1 -- 172.21.15.73:0/2121977906 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5634cd269470 con 0x5634cd276800 2023-08-10T11:56:18.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.352+0000 7f2d1a7fc700 1 -- 172.21.15.73:0/2121977906 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 36) v1 ==== 7510+0+0 (secure 0 0 0) 0x7f2d280de090 con 0x5634cd276800 2023-08-10T11:56:18.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.353+0000 7f2d496d6b80 10 client.16296 fetch_fsmap finished waiting for FSMap version 36 2023-08-10T11:56:18.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.353+0000 7f2d496d6b80 10 client.16296 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:56:18.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.353+0000 7f2d496d6b80 20 client.16296 populate_metadata read hostname 'smithi073' 2023-08-10T11:56:18.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.353+0000 7f2d496d6b80 1 --2- 172.21.15.73:0/2121977906 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5634cd290240 0x5634cd292660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:18.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.353+0000 7f2d496d6b80 4 client.16296 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:56:18.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.353+0000 7f2d496d6b80 1 -- 172.21.15.73:0/2121977906 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5634cd2459d0 con 0x5634cd290240 2023-08-10T11:56:18.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.353+0000 7f2d367fc700 1 --2- 172.21.15.73:0/2121977906 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5634cd290240 0x5634cd292660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:18.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.362+0000 7f2d367fc700 1 --2- 172.21.15.73:0/2121977906 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5634cd290240 0x5634cd292660 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de1f2842269f1f0e server_cookie=d9f020f2e0494f48 in_seq=0 out_seq=0 2023-08-10T11:56:18.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.362+0000 7f2d1a7fc700 10 client.16296 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:56:18.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.373+0000 7f2d1a7fc700 1 -- 172.21.15.73:0/2121977906 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5634cd2459d0 con 0x5634cd290240 2023-08-10T11:56:18.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.373+0000 7f2d1a7fc700 10 client.16296 handle_command_reply: tid=0 2023-08-10T11:56:18.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.374+0000 7f2d496d6b80 1 client.16296 shutdown 2023-08-10T11:56:18.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.374+0000 7f2d496d6b80 1 -- 172.21.15.73:0/2121977906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634cd276800 msgr2=0x5634cd27fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:18.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.374+0000 7f2d496d6b80 1 --2- 172.21.15.73:0/2121977906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634cd276800 0x5634cd27fc60 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2d280da330 tx=0x7f2d280dda20 comp rx=0 tx=0).stop 2023-08-10T11:56:18.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.401+0000 7f2d496d6b80 1 -- 172.21.15.73:0/2121977906 shutdown_connections 2023-08-10T11:56:18.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.401+0000 7f2d496d6b80 1 --2- 172.21.15.73:0/2121977906 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5634cd290240 0x5634cd292660 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.401+0000 7f2d496d6b80 1 --2- 172.21.15.73:0/2121977906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634cd27c870 0x5634cd2806e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.401+0000 7f2d496d6b80 1 --2- 172.21.15.73:0/2121977906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634cd276800 0x5634cd27fc60 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.401+0000 7f2d496d6b80 1 --2- 172.21.15.73:0/2121977906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634cd27bf50 0x5634cd2801a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.402+0000 7f2d496d6b80 1 -- 172.21.15.73:0/2121977906 >> 172.21.15.73:0/2121977906 conn(0x5634cd1d3cd0 msgr2=0x5634cd2709b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:18.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.402+0000 7f2d1a7fc700 0 client.16296 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:56:18.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.412+0000 7f2d496d6b80 1 -- 172.21.15.73:0/2121977906 shutdown_connections 2023-08-10T11:56:18.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.412+0000 7f2d496d6b80 1 -- 172.21.15.73:0/2121977906 wait complete. 2023-08-10T11:56:18.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.412+0000 7f2d496d6b80 20 client.16296 trim_cache size 0 max 16384 2023-08-10T11:56:18.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.623+0000 7f2d496d6b80 1 Processor -- start 2023-08-10T11:56:18.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.624+0000 7f2d496d6b80 1 -- start start 2023-08-10T11:56:18.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.624+0000 7f2d496d6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634cd276800 0x5634cd2762c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:18.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.624+0000 7f2d496d6b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634cd27bf50 0x5634cd287360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:18.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.624+0000 7f2d496d6b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634cd27c870 0x5634cd27b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:18.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.624+0000 7f2d496d6b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634cd04a920 con 0x5634cd27c870 2023-08-10T11:56:18.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.624+0000 7f2d496d6b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634cd297430 con 0x5634cd27bf50 2023-08-10T11:56:18.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.624+0000 7f2d496d6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634cd26df80 con 0x5634cd276800 2023-08-10T11:56:18.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.638+0000 7f2d377fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634cd27c870 0x5634cd27b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:18.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.638+0000 7f2d377fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634cd27c870 0x5634cd27b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34810/0 (socket says 172.21.15.73:34810) 2023-08-10T11:56:18.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.638+0000 7f2d377fe700 1 -- 172.21.15.73:0/3908935632 learned_addr learned my addr 172.21.15.73:0/3908935632 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:18.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.639+0000 7f2d367fc700 1 --2- 172.21.15.73:0/3908935632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634cd27bf50 0x5634cd287360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:18.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.639+0000 7f2d36ffd700 1 --2- 172.21.15.73:0/3908935632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634cd276800 0x5634cd2762c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:18.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.651+0000 7f2d377fe700 1 -- 172.21.15.73:0/3908935632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634cd276800 msgr2=0x5634cd2762c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:18.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.651+0000 7f2d377fe700 1 --2- 172.21.15.73:0/3908935632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634cd276800 0x5634cd2762c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.651+0000 7f2d377fe700 1 -- 172.21.15.73:0/3908935632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634cd27bf50 msgr2=0x5634cd287360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:18.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.651+0000 7f2d377fe700 1 --2- 172.21.15.73:0/3908935632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634cd27bf50 0x5634cd287360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.652+0000 7f2d377fe700 1 -- 172.21.15.73:0/3908935632 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634cd26d6a0 con 0x5634cd27c870 2023-08-10T11:56:18.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.673+0000 7f2d377fe700 1 --2- 172.21.15.73:0/3908935632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634cd27c870 0x5634cd27b390 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2d3000bfa0 tx=0x7f2d3001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f39e2e8c615463 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:18.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.779+0000 7f2d25ffb700 1 -- 172.21.15.73:0/3908935632 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3000e040 con 0x5634cd27c870 2023-08-10T11:56:18.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.779+0000 7f2d25ffb700 1 -- 172.21.15.73:0/3908935632 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d30034070 con 0x5634cd27c870 2023-08-10T11:56:18.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.779+0000 7f2d25ffb700 1 -- 172.21.15.73:0/3908935632 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3000bc90 con 0x5634cd27c870 2023-08-10T11:56:18.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.780+0000 7f2d496d6b80 1 -- 172.21.15.73:0/3908935632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634cd27c870 msgr2=0x5634cd27b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:18.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.780+0000 7f2d496d6b80 1 --2- 172.21.15.73:0/3908935632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634cd27c870 0x5634cd27b390 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2d3000bfa0 tx=0x7f2d3001c000 comp rx=0 tx=0).stop 2023-08-10T11:56:18.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.792+0000 7f2d496d6b80 1 -- 172.21.15.73:0/3908935632 shutdown_connections 2023-08-10T11:56:18.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.792+0000 7f2d496d6b80 1 --2- 172.21.15.73:0/3908935632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634cd27c870 0x5634cd27b390 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.792+0000 7f2d496d6b80 1 --2- 172.21.15.73:0/3908935632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634cd276800 0x5634cd2762c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.792+0000 7f2d496d6b80 1 --2- 172.21.15.73:0/3908935632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634cd27bf50 0x5634cd287360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.792+0000 7f2d496d6b80 1 -- 172.21.15.73:0/3908935632 >> 172.21.15.73:0/3908935632 conn(0x5634cd1d3cd0 msgr2=0x5634cd27ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:18.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.800+0000 7f2d496d6b80 1 -- 172.21.15.73:0/3908935632 shutdown_connections 2023-08-10T11:56:18.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.800+0000 7f2d496d6b80 1 -- 172.21.15.73:0/3908935632 wait complete. 2023-08-10T11:56:18.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.801+0000 7f2d496d6b80 1 -- start start 2023-08-10T11:56:18.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.801+0000 7f2d496d6b80 1 Processor -- start 2023-08-10T11:56:18.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.801+0000 7f2d496d6b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634cd276800 0x5634cd2dd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:18.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.801+0000 7f2d496d6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634cd27bf50 0x5634cd2dd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:18.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.801+0000 7f2d496d6b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634cd27c870 0x5634cd2dbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:18.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.801+0000 7f2d496d6b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634cd2dc410 con 0x5634cd27c870 2023-08-10T11:56:18.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.802+0000 7f2d496d6b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634cd2dc580 con 0x5634cd276800 2023-08-10T11:56:18.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.802+0000 7f2d496d6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634cd2dc740 con 0x5634cd27bf50 2023-08-10T11:56:18.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.802+0000 7f2d496d6b80 10 client.0 _ll_register_callbacks cb 0x5634cd164680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:56:18.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.802+0000 7f2d367fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634cd27bf50 0x5634cd2dd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:18.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.802+0000 7f2d367fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634cd27bf50 0x5634cd2dd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60318/0 (socket says 172.21.15.73:60318) 2023-08-10T11:56:18.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.802+0000 7f2d367fc700 1 -- 172.21.15.73:0/837926372 learned_addr learned my addr 172.21.15.73:0/837926372 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:18.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.802+0000 7f2d36ffd700 1 --2- 172.21.15.73:0/837926372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634cd276800 0x5634cd2dd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:18.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.807+0000 7f2d377fe700 1 --2- 172.21.15.73:0/837926372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634cd27c870 0x5634cd2dbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:18.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.807+0000 7f2d367fc700 1 -- 172.21.15.73:0/837926372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634cd276800 msgr2=0x5634cd2dd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:18.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.807+0000 7f2d367fc700 1 --2- 172.21.15.73:0/837926372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634cd276800 0x5634cd2dd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.807+0000 7f2d367fc700 1 -- 172.21.15.73:0/837926372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634cd27c870 msgr2=0x5634cd2dbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:18.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.807+0000 7f2d367fc700 1 --2- 172.21.15.73:0/837926372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634cd27c870 0x5634cd2dbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.807+0000 7f2d367fc700 1 -- 172.21.15.73:0/837926372 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d3002b040 con 0x5634cd27bf50 2023-08-10T11:56:18.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.813+0000 7f2d367fc700 1 --2- 172.21.15.73:0/837926372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634cd27bf50 0x5634cd2dd720 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0092a0 tx=0x7f2d2c01a580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df6bde4247edbc63 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:18.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.930+0000 7f2d1a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T11:56:18.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.930+0000 7f2d1a7fc700 1 -- 172.21.15.73:0/837926372 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c016040 con 0x5634cd27bf50 2023-08-10T11:56:18.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.930+0000 7f2d1a7fc700 1 -- 172.21.15.73:0/837926372 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f2d2c010cc0 con 0x5634cd27bf50 2023-08-10T11:56:18.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.930+0000 7f2d496d6b80 1 -- 172.21.15.73:0/837926372 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2d30007e10 con 0x5634cd27bf50 2023-08-10T11:56:18.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.942+0000 7f2d1a7fc700 1 -- 172.21.15.73:0/837926372 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d2c01a670 con 0x5634cd27bf50 2023-08-10T11:56:18.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.942+0000 7f2d496d6b80 10 client.25753 fetch_fsmap learned FSMap version 36 2023-08-10T11:56:18.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.942+0000 7f2d496d6b80 1 -- 172.21.15.73:0/837926372 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5634ccfddc60 con 0x5634cd27bf50 2023-08-10T11:56:18.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.953+0000 7f2d1a7fc700 1 -- 172.21.15.73:0/837926372 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d30007e10 con 0x5634cd27bf50 2023-08-10T11:56:18.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.953+0000 7f2d1a7fc700 1 -- 172.21.15.73:0/837926372 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 36) v1 ==== 7510+0+0 (secure 0 0 0) 0x7f2d2c003680 con 0x5634cd27bf50 2023-08-10T11:56:18.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.953+0000 7f2d496d6b80 10 client.25753 fetch_fsmap finished waiting for FSMap version 36 2023-08-10T11:56:18.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.953+0000 7f2d496d6b80 10 client.25753 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:56:18.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.953+0000 7f2d496d6b80 20 client.25753 populate_metadata read hostname 'smithi073' 2023-08-10T11:56:18.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.954+0000 7f2d496d6b80 1 --2- 172.21.15.73:0/837926372 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5634cd2f5ff0 0x5634cd2f8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:18.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.954+0000 7f2d496d6b80 4 client.25753 mds_command: new command op to 24503 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:56:18.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.954+0000 7f2d496d6b80 1 -- 172.21.15.73:0/837926372 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5634cd1c0780 con 0x5634cd2f5ff0 2023-08-10T11:56:18.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.955+0000 7f2d36ffd700 1 --2- 172.21.15.73:0/837926372 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5634cd2f5ff0 0x5634cd2f8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:18.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.971+0000 7f2d36ffd700 1 --2- 172.21.15.73:0/837926372 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5634cd2f5ff0 0x5634cd2f8410 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8d348160af9e9ba server_cookie=b7163dce4e11522f in_seq=0 out_seq=0 2023-08-10T11:56:18.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.971+0000 7f2d1a7fc700 10 client.25753 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:56:18.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.974+0000 7f2d1a7fc700 1 -- 172.21.15.73:0/837926372 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5634cd1c0780 con 0x5634cd2f5ff0 2023-08-10T11:56:18.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.974+0000 7f2d1a7fc700 10 client.25753 handle_command_reply: tid=0 2023-08-10T11:56:18.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.974+0000 7f2d496d6b80 1 client.25753 shutdown 2023-08-10T11:56:18.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.976+0000 7f2d496d6b80 1 -- 172.21.15.73:0/837926372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634cd27bf50 msgr2=0x5634cd2dd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:18.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.976+0000 7f2d496d6b80 1 --2- 172.21.15.73:0/837926372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634cd27bf50 0x5634cd2dd720 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0092a0 tx=0x7f2d2c01a580 comp rx=0 tx=0).stop 2023-08-10T11:56:18.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.976+0000 7f2d496d6b80 1 -- 172.21.15.73:0/837926372 shutdown_connections 2023-08-10T11:56:18.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.976+0000 7f2d496d6b80 1 --2- 172.21.15.73:0/837926372 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5634cd2f5ff0 0x5634cd2f8410 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.976+0000 7f2d496d6b80 1 --2- 172.21.15.73:0/837926372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5634cd276800 0x5634cd2dd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.977+0000 7f2d496d6b80 1 --2- 172.21.15.73:0/837926372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634cd27c870 0x5634cd2dbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.977+0000 7f2d496d6b80 1 --2- 172.21.15.73:0/837926372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634cd27bf50 0x5634cd2dd720 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:18.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.977+0000 7f2d496d6b80 1 -- 172.21.15.73:0/837926372 >> 172.21.15.73:0/837926372 conn(0x5634cd1d3cd0 msgr2=0x5634cd27cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:18.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.977+0000 7f2d1a7fc700 0 client.25753 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:56:18.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.977+0000 7f2d496d6b80 1 -- 172.21.15.73:0/837926372 shutdown_connections 2023-08-10T11:56:18.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.977+0000 7f2d496d6b80 1 -- 172.21.15.73:0/837926372 wait complete. 2023-08-10T11:56:18.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:18.977+0000 7f2d496d6b80 20 client.25753 trim_cache size 0 max 16384 2023-08-10T11:56:18.979 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:56:18.980 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:56:18.980 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": { 2023-08-10T11:56:18.980 INFO:teuthology.orchestra.run.smithi073.stdout: "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d": { 2023-08-10T11:56:18.980 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2023-08-10T11:56:18.980 INFO:teuthology.orchestra.run.smithi073.stdout: "tag": "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d", 2023-08-10T11:56:18.980 INFO:teuthology.orchestra.run.smithi073.stdout: "options": "recursive,force" 2023-08-10T11:56:18.980 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:56:18.980 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:56:18.981 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:56:19.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:18 smithi073 ceph-mon[128869]: pgmap v113: 97 pgs: 97 active+clean; 795 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 11 MiB/s wr, 669 op/s 2023-08-10T11:56:19.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:19.240+0000 7f2d3d53d700 1 -- 172.21.15.73:0/2402547381 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f2d200a14d0 msgr2=0x7f2d200a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:19.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:19.240+0000 7f2d3d53d700 1 --2- 172.21.15.73:0/2402547381 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f2d200a14d0 0x7f2d200a3990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009ac0 tx=0x7f2d30009af0 comp rx=0 tx=0).stop 2023-08-10T11:56:19.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:19.240+0000 7f2d3d53d700 1 -- 172.21.15.73:0/2402547381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d3810ee20 msgr2=0x7f2d380783d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:19.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:19.240+0000 7f2d3d53d700 1 --2- 172.21.15.73:0/2402547381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d3810ee20 0x7f2d380783d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2d280529d0 tx=0x7f2d28052ce0 comp rx=0 tx=0).stop 2023-08-10T11:56:19.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:19.241+0000 7f2d3d53d700 1 -- 172.21.15.73:0/2402547381 shutdown_connections 2023-08-10T11:56:19.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:19.241+0000 7f2d3d53d700 1 --2- 172.21.15.73:0/2402547381 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f2d200a14d0 0x7f2d200a3990 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:19.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:19.241+0000 7f2d3d53d700 1 --2- 172.21.15.73:0/2402547381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d3810ee20 0x7f2d380783d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:19.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:19.241+0000 7f2d3d53d700 1 --2- 172.21.15.73:0/2402547381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d38119f50 0x7f2d380734e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:19.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:19.241+0000 7f2d3d53d700 1 --2- 172.21.15.73:0/2402547381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d3810f290 0x7f2d38078930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:19.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:19.241+0000 7f2d3d53d700 1 -- 172.21.15.73:0/2402547381 >> 172.21.15.73:0/2402547381 conn(0x7f2d3806ca30 msgr2=0x7f2d38117f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:19.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:19.242+0000 7f2d3d53d700 1 -- 172.21.15.73:0/2402547381 shutdown_connections 2023-08-10T11:56:19.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:19.242+0000 7f2d3d53d700 1 -- 172.21.15.73:0/2402547381 wait complete. 2023-08-10T11:56:19.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:18 smithi152 ceph-mon[130220]: pgmap v113: 97 pgs: 97 active+clean; 795 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 11 MiB/s wr, 669 op/s 2023-08-10T11:56:19.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:18 smithi156 ceph-mon[130574]: pgmap v113: 97 pgs: 97 active+clean; 795 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 11 MiB/s wr, 669 op/s 2023-08-10T11:56:19.286 INFO:tasks.cephfs.filesystem:scrub status for tag:9d39b3fa-9b62-42b4-b1a5-738cb3118a5d - {'path': '/', 'tag': '9d39b3fa-9b62-42b4-b1a5-738cb3118a5d', 'options': 'recursive,force'} 2023-08-10T11:56:21.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:20 smithi152 ceph-mon[130220]: pgmap v114: 97 pgs: 97 active+clean; 806 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 13 MiB/s wr, 886 op/s 2023-08-10T11:56:21.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:20 smithi156 ceph-mon[130574]: pgmap v114: 97 pgs: 97 active+clean; 806 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 13 MiB/s wr, 886 op/s 2023-08-10T11:56:21.282 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:20 smithi073 ceph-mon[128869]: pgmap v114: 97 pgs: 97 active+clean; 806 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 13 MiB/s wr, 886 op/s 2023-08-10T11:56:23.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:22 smithi152 ceph-mon[130220]: pgmap v115: 97 pgs: 97 active+clean; 806 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 12 MiB/s wr, 824 op/s 2023-08-10T11:56:23.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:22 smithi156 ceph-mon[130574]: pgmap v115: 97 pgs: 97 active+clean; 806 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 12 MiB/s wr, 824 op/s 2023-08-10T11:56:23.358 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:22 smithi073 ceph-mon[128869]: pgmap v115: 97 pgs: 97 active+clean; 806 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 12 MiB/s wr, 824 op/s 2023-08-10T11:56:24.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:24 smithi152 ceph-mon[130220]: pgmap v116: 97 pgs: 97 active+clean; 816 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 13 MiB/s wr, 894 op/s 2023-08-10T11:56:25.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:24 smithi156 ceph-mon[130574]: pgmap v116: 97 pgs: 97 active+clean; 816 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 13 MiB/s wr, 894 op/s 2023-08-10T11:56:25.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:24 smithi073 ceph-mon[128869]: pgmap v116: 97 pgs: 97 active+clean; 816 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 13 MiB/s wr, 894 op/s 2023-08-10T11:56:27.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:26 smithi152 ceph-mon[130220]: pgmap v117: 97 pgs: 97 active+clean; 820 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 8.4 MiB/s wr, 619 op/s 2023-08-10T11:56:27.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:26 smithi156 ceph-mon[130574]: pgmap v117: 97 pgs: 97 active+clean; 820 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 8.4 MiB/s wr, 619 op/s 2023-08-10T11:56:27.277 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:26 smithi073 ceph-mon[128869]: pgmap v117: 97 pgs: 97 active+clean; 820 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 8.4 MiB/s wr, 619 op/s 2023-08-10T11:56:28.112 INFO:tasks.workunit.client.0.smithi073.stdout: 206 2624751 859 1716485 900 860593 842 2023-08-10T11:56:28.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.789+0000 7f300da4b700 1 -- 172.21.15.73:0/971399868 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3008119f50 msgr2=0x7f300811c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:28.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.789+0000 7f300da4b700 1 --2- 172.21.15.73:0/971399868 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3008119f50 0x7f300811c340 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f300000b0a0 tx=0x7f300000b3b0 comp rx=0 tx=0).stop 2023-08-10T11:56:28.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.789+0000 7f300da4b700 1 -- 172.21.15.73:0/971399868 shutdown_connections 2023-08-10T11:56:28.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.789+0000 7f300da4b700 1 --2- 172.21.15.73:0/971399868 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f300810eec0 0x7f3008107770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:28.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.789+0000 7f300da4b700 1 --2- 172.21.15.73:0/971399868 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3008119f50 0x7f300811c340 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:28.792 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.789+0000 7f300da4b700 1 --2- 172.21.15.73:0/971399868 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f300810f330 0x7f3008107cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:28.792 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.789+0000 7f300da4b700 1 -- 172.21.15.73:0/971399868 >> 172.21.15.73:0/971399868 conn(0x7f300806c830 msgr2=0x7f300806cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:28.792 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.791+0000 7f30067fc700 1 --2- 172.21.15.73:0/971399868 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f300810f330 0x7f3008107cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:56:28.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.791+0000 7f300da4b700 1 -- 172.21.15.73:0/971399868 shutdown_connections 2023-08-10T11:56:28.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.791+0000 7f300da4b700 1 -- 172.21.15.73:0/971399868 wait complete. 2023-08-10T11:56:28.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.792+0000 7f300da4b700 1 Processor -- start 2023-08-10T11:56:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.792+0000 7f300da4b700 1 -- start start 2023-08-10T11:56:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.792+0000 7f300da4b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f300810eec0 0x7f30081ab700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.792+0000 7f300da4b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3008119f50 0x7f30081abc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.792+0000 7f300da4b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30081a5560 0x7f30081a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.792+0000 7f300da4b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30081a5fe0 con 0x7f300810eec0 2023-08-10T11:56:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.792+0000 7f300da4b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30081a6120 con 0x7f3008119f50 2023-08-10T11:56:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.792+0000 7f300da4b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30081a62e0 con 0x7f30081a5560 2023-08-10T11:56:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.793+0000 7f3006ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f300810eec0 0x7f30081ab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:28.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.793+0000 7f30077fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30081a5560 0x7f30081a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:28.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.793+0000 7f3006ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f300810eec0 0x7f30081ab700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34828/0 (socket says 172.21.15.73:34828) 2023-08-10T11:56:28.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.793+0000 7f30077fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30081a5560 0x7f30081a5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60334/0 (socket says 172.21.15.73:60334) 2023-08-10T11:56:28.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.793+0000 7f3006ffd700 1 -- 172.21.15.73:0/3568856351 learned_addr learned my addr 172.21.15.73:0/3568856351 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:28.797 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.794+0000 7f3006ffd700 1 -- 172.21.15.73:0/3568856351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30081a5560 msgr2=0x7f30081a5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:28.797 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.794+0000 7f3006ffd700 1 --2- 172.21.15.73:0/3568856351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30081a5560 0x7f30081a5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:28.797 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.794+0000 7f3006ffd700 1 -- 172.21.15.73:0/3568856351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3008119f50 msgr2=0x7f30081abc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:28.797 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.794+0000 7f3006ffd700 1 --2- 172.21.15.73:0/3568856351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3008119f50 0x7f30081abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:28.797 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.794+0000 7f3006ffd700 1 -- 172.21.15.73:0/3568856351 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3000009d00 con 0x7f300810eec0 2023-08-10T11:56:28.798 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.794+0000 7f3006ffd700 1 --2- 172.21.15.73:0/3568856351 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f300810eec0 0x7f30081ab700 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc00d950 tx=0x7f2ffc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:28.798 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.795+0000 7f300ca49700 1 -- 172.21.15.73:0/3568856351 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc009b40 con 0x7f300810eec0 2023-08-10T11:56:28.798 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.795+0000 7f300ca49700 1 -- 172.21.15.73:0/3568856351 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ffc009ca0 con 0x7f300810eec0 2023-08-10T11:56:28.798 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.795+0000 7f300ca49700 1 -- 172.21.15.73:0/3568856351 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc00f620 con 0x7f300810eec0 2023-08-10T11:56:28.799 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.795+0000 7f300da4b700 1 -- 172.21.15.73:0/3568856351 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f300810f790 con 0x7f300810eec0 2023-08-10T11:56:28.799 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.795+0000 7f300da4b700 1 -- 172.21.15.73:0/3568856351 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f300810fcd0 con 0x7f300810eec0 2023-08-10T11:56:28.804 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.800+0000 7f3019be4b80 1 Processor -- start 2023-08-10T11:56:28.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.803+0000 7f3019be4b80 1 -- start start 2023-08-10T11:56:28.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.804+0000 7f3019be4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55811d517a40 0x55811d517e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:28.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.804+0000 7f3019be4b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55811d518360 0x55811d512010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:28.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.804+0000 7f3019be4b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55811d512550 0x55811d5129d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:28.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.804+0000 7f3019be4b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55811d48dd60 con 0x55811d512550 2023-08-10T11:56:28.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.804+0000 7f3019be4b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55811d46a530 con 0x55811d518360 2023-08-10T11:56:28.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.804+0000 7f3019be4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55811d467e50 con 0x55811d517a40 2023-08-10T11:56:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.805+0000 7f30077fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55811d517a40 0x55811d517e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.805+0000 7f30077fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55811d517a40 0x55811d517e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60338/0 (socket says 172.21.15.73:60338) 2023-08-10T11:56:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.805+0000 7f30077fe700 1 -- 172.21.15.73:0/687466495 learned_addr learned my addr 172.21.15.73:0/687466495 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.805+0000 7f300ca49700 1 -- 172.21.15.73:0/3568856351 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f2ffc010460 con 0x7f300810eec0 2023-08-10T11:56:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.805+0000 7f30067fc700 1 --2- 172.21.15.73:0/687466495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55811d512550 0x55811d5129d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.805+0000 7f30077fe700 1 -- 172.21.15.73:0/687466495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55811d518360 msgr2=0x55811d512010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T11:56:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.805+0000 7f30077fe700 1 --2- 172.21.15.73:0/687466495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55811d518360 0x55811d512010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:28.809 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.805+0000 7f30077fe700 1 -- 172.21.15.73:0/687466495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55811d512550 msgr2=0x55811d5129d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:28.809 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.805+0000 7f30077fe700 1 --2- 172.21.15.73:0/687466495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55811d512550 0x55811d5129d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:28.809 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.805+0000 7f30077fe700 1 -- 172.21.15.73:0/687466495 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55811d2e45d0 con 0x55811d517a40 2023-08-10T11:56:28.809 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.806+0000 7f30077fe700 1 --2- 172.21.15.73:0/687466495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55811d517a40 0x55811d517e20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3000015000 tx=0x7f3000009130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3a08eda9586e6b2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:28.809 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.806+0000 7f300ca49700 1 --2- 172.21.15.73:0/3568856351 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f2ff00a1490 0x7f2ff00a3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:28.809 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.806+0000 7f2fedffb700 1 -- 172.21.15.73:0/687466495 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300000e070 con 0x55811d517a40 2023-08-10T11:56:28.809 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.806+0000 7f2fedffb700 1 -- 172.21.15.73:0/687466495 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f30000074e0 con 0x55811d517a40 2023-08-10T11:56:28.810 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.806+0000 7f2fedffb700 1 -- 172.21.15.73:0/687466495 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3000005540 con 0x55811d517a40 2023-08-10T11:56:28.810 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.806+0000 7f300ca49700 1 -- 172.21.15.73:0/3568856351 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f2ffc0cc830 con 0x7f300810eec0 2023-08-10T11:56:28.810 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.807+0000 7f3019be4b80 1 -- 172.21.15.73:0/687466495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55811d517a40 msgr2=0x55811d517e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:28.810 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.807+0000 7f3019be4b80 1 --2- 172.21.15.73:0/687466495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55811d517a40 0x55811d517e20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3000015000 tx=0x7f3000009130 comp rx=0 tx=0).stop 2023-08-10T11:56:28.810 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.807+0000 7f3019be4b80 1 -- 172.21.15.73:0/687466495 shutdown_connections 2023-08-10T11:56:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.807+0000 7f3019be4b80 1 --2- 172.21.15.73:0/687466495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55811d512550 0x55811d5129d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.807+0000 7f3019be4b80 1 --2- 172.21.15.73:0/687466495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55811d517a40 0x55811d517e20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.807+0000 7f3019be4b80 1 --2- 172.21.15.73:0/687466495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55811d518360 0x55811d512010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.807+0000 7f3019be4b80 1 -- 172.21.15.73:0/687466495 >> 172.21.15.73:0/687466495 conn(0x55811d46fc70 msgr2=0x55811d50cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.810+0000 7f3006ffd700 1 --2- 172.21.15.73:0/3568856351 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f2ff00a1490 0x7f2ff00a3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.810+0000 7f3019be4b80 1 -- 172.21.15.73:0/687466495 shutdown_connections 2023-08-10T11:56:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.810+0000 7f3019be4b80 1 -- 172.21.15.73:0/687466495 wait complete. 2023-08-10T11:56:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.810+0000 7f3019be4b80 1 -- start start 2023-08-10T11:56:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.811+0000 7f3019be4b80 1 Processor -- start 2023-08-10T11:56:28.813 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.811+0000 7f3019be4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55811d512550 0x55811d51b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:28.813 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.811+0000 7f3019be4b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55811d517a40 0x55811d51bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:28.813 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.811+0000 7f3019be4b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55811d51c1d0 0x55811d527ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:28.813 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.811+0000 7f3019be4b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55811d463740 con 0x55811d51c1d0 2023-08-10T11:56:28.814 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.811+0000 7f3019be4b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55811d402a60 con 0x55811d517a40 2023-08-10T11:56:28.814 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.811+0000 7f3019be4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55811d402760 con 0x55811d512550 2023-08-10T11:56:28.814 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.811+0000 7f3019be4b80 10 client.0 _ll_register_callbacks cb 0x55811d400620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:56:28.815 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.812+0000 7f3006ffd700 1 --2- 172.21.15.73:0/3568856351 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f2ff00a1490 0x7f2ff00a3950 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55811d50e680 tx=0x7f2ffc010c40 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:28.815 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.812+0000 7f30077fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55811d512550 0x55811d51b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:28.816 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.812+0000 7f30067fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55811d517a40 0x55811d51bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:28.816 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.812+0000 7f30077fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55811d51c1d0 0x55811d527ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:28.816 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.812+0000 7f30067fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55811d517a40 0x55811d51bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49496/0 (socket says 172.21.15.73:49496) 2023-08-10T11:56:28.816 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.812+0000 7f30067fc700 1 -- 172.21.15.73:0/2205260563 learned_addr learned my addr 172.21.15.73:0/2205260563 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:28.816 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.812+0000 7f30077fe700 1 -- 172.21.15.73:0/2205260563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55811d512550 msgr2=0x55811d51b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:28.816 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.812+0000 7f30077fe700 1 --2- 172.21.15.73:0/2205260563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55811d512550 0x55811d51b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:28.816 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.812+0000 7f30077fe700 1 -- 172.21.15.73:0/2205260563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55811d517a40 msgr2=0x55811d51bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.812+0000 7f30077fe700 1 --2- 172.21.15.73:0/2205260563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55811d517a40 0x55811d51bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.812+0000 7f30077fe700 1 -- 172.21.15.73:0/2205260563 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f300811cc70 con 0x55811d51c1d0 2023-08-10T11:56:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.812+0000 7f30077fe700 1 --2- 172.21.15.73:0/2205260563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55811d51c1d0 0x55811d527ea0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f3000009850 tx=0x7f300000b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=415f416123fed2b1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.812+0000 7f2fe6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:56:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.813+0000 7f2fe6ffd700 1 -- 172.21.15.73:0/2205260563 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300000e040 con 0x55811d51c1d0 2023-08-10T11:56:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.813+0000 7f2fe6ffd700 1 -- 172.21.15.73:0/2205260563 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f3000007650 con 0x55811d51c1d0 2023-08-10T11:56:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.813+0000 7f3019be4b80 1 -- 172.21.15.73:0/2205260563 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55811d5051c0 con 0x55811d51c1d0 2023-08-10T11:56:28.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.813+0000 7f2fe6ffd700 1 -- 172.21.15.73:0/2205260563 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3000004dd0 con 0x55811d51c1d0 2023-08-10T11:56:28.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.813+0000 7f3019be4b80 10 client.16314 fetch_fsmap learned FSMap version 36 2023-08-10T11:56:28.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.813+0000 7f3019be4b80 1 -- 172.21.15.73:0/2205260563 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55811d290d80 con 0x55811d51c1d0 2023-08-10T11:56:28.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.813+0000 7f2fe6ffd700 1 -- 172.21.15.73:0/2205260563 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3000036030 con 0x55811d51c1d0 2023-08-10T11:56:28.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.813+0000 7f2fe6ffd700 1 -- 172.21.15.73:0/2205260563 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 36) v1 ==== 7510+0+0 (secure 0 0 0) 0x7f300000b0d0 con 0x55811d51c1d0 2023-08-10T11:56:28.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.814+0000 7f3019be4b80 10 client.16314 fetch_fsmap finished waiting for FSMap version 36 2023-08-10T11:56:28.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.814+0000 7f3019be4b80 10 client.16314 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:56:28.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.814+0000 7f3019be4b80 20 client.16314 populate_metadata read hostname 'smithi073' 2023-08-10T11:56:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.814+0000 7f3019be4b80 1 --2- 172.21.15.73:0/2205260563 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55811d52bf70 0x55811d52e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.814+0000 7f3019be4b80 4 client.16314 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:56:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.814+0000 7f3019be4b80 1 -- 172.21.15.73:0/2205260563 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55811d4e1970 con 0x55811d52bf70 2023-08-10T11:56:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.815+0000 7f30067fc700 1 --2- 172.21.15.73:0/2205260563 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55811d52bf70 0x55811d52e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.816+0000 7f30067fc700 1 --2- 172.21.15.73:0/2205260563 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55811d52bf70 0x55811d52e390 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bec3838730d52c89 server_cookie=4f34bcd361e0277b in_seq=0 out_seq=0 2023-08-10T11:56:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.818+0000 7f2fe6ffd700 10 client.16314 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:56:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.818+0000 7f2fe6ffd700 1 -- 172.21.15.73:0/2205260563 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55811d4e1970 con 0x55811d52bf70 2023-08-10T11:56:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.818+0000 7f2fe6ffd700 10 client.16314 handle_command_reply: tid=0 2023-08-10T11:56:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.818+0000 7f3019be4b80 1 client.16314 shutdown 2023-08-10T11:56:28.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.822+0000 7f3019be4b80 1 -- 172.21.15.73:0/2205260563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55811d51c1d0 msgr2=0x55811d527ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:28.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.822+0000 7f3019be4b80 1 --2- 172.21.15.73:0/2205260563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55811d51c1d0 0x55811d527ea0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f3000009850 tx=0x7f300000b3b0 comp rx=0 tx=0).stop 2023-08-10T11:56:28.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.822+0000 7f3019be4b80 1 -- 172.21.15.73:0/2205260563 shutdown_connections 2023-08-10T11:56:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.822+0000 7f3019be4b80 1 --2- 172.21.15.73:0/2205260563 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55811d52bf70 0x55811d52e390 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.822+0000 7f3019be4b80 1 --2- 172.21.15.73:0/2205260563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55811d51c1d0 0x55811d527ea0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.822+0000 7f3019be4b80 1 --2- 172.21.15.73:0/2205260563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55811d512550 0x55811d51b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.822+0000 7f2fe6ffd700 0 client.16314 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:56:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.822+0000 7f3019be4b80 1 --2- 172.21.15.73:0/2205260563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55811d517a40 0x55811d51bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.822+0000 7f3019be4b80 1 -- 172.21.15.73:0/2205260563 >> 172.21.15.73:0/2205260563 conn(0x55811d46fc70 msgr2=0x55811d50c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.822+0000 7f3019be4b80 1 -- 172.21.15.73:0/2205260563 shutdown_connections 2023-08-10T11:56:28.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.822+0000 7f3019be4b80 1 -- 172.21.15.73:0/2205260563 wait complete. 2023-08-10T11:56:28.828 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.823+0000 7f3019be4b80 20 client.16314 trim_cache size 0 max 16384 2023-08-10T11:56:28.859 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.852+0000 7f3019be4b80 1 Processor -- start 2023-08-10T11:56:28.859 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.853+0000 7f3019be4b80 1 -- start start 2023-08-10T11:56:28.859 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.853+0000 7f3019be4b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55811d512550 0x55811d512010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:28.860 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.853+0000 7f3019be4b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55811d517a40 0x55811d50cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:28.860 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.853+0000 7f3019be4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55811d51c1d0 0x55811d527b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:28.860 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.853+0000 7f3019be4b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55811d2e68c0 con 0x55811d512550 2023-08-10T11:56:28.860 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.853+0000 7f3019be4b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55811d504d00 con 0x55811d517a40 2023-08-10T11:56:28.860 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.853+0000 7f3019be4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55811d50e160 con 0x55811d51c1d0 2023-08-10T11:56:28.860 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.853+0000 7f30067fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55811d517a40 0x55811d50cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:28.860 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.853+0000 7f30077fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55811d512550 0x55811d512010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:28.861 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.853+0000 7f30067fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55811d517a40 0x55811d50cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49500/0 (socket says 172.21.15.73:49500) 2023-08-10T11:56:28.861 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.853+0000 7f30067fc700 1 -- 172.21.15.73:0/3642096700 learned_addr learned my addr 172.21.15.73:0/3642096700 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:28.861 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.853+0000 7f30077fe700 1 --2- 172.21.15.73:0/3642096700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55811d51c1d0 0x55811d527b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:28.861 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.854+0000 7f30067fc700 1 -- 172.21.15.73:0/3642096700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55811d51c1d0 msgr2=0x55811d527b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:28.861 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.854+0000 7f30067fc700 1 --2- 172.21.15.73:0/3642096700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55811d51c1d0 0x55811d527b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.854+0000 7f30067fc700 1 -- 172.21.15.73:0/3642096700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55811d512550 msgr2=0x55811d512010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.854+0000 7f30067fc700 1 --2- 172.21.15.73:0/3642096700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55811d512550 0x55811d512010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.854+0000 7f30067fc700 1 -- 172.21.15.73:0/3642096700 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55811d279c00 con 0x55811d517a40 2023-08-10T11:56:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.854+0000 7f30077fe700 1 --2- 172.21.15.73:0/3642096700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55811d51c1d0 0x55811d527b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:56:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.854+0000 7f30067fc700 1 --2- 172.21.15.73:0/3642096700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55811d517a40 0x55811d50cc30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55811d52ec60 tx=0x7f2ff800a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cd8bfb700c72db server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:28.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.854+0000 7f2fee7fc700 1 -- 172.21.15.73:0/3642096700 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff8017040 con 0x55811d517a40 2023-08-10T11:56:28.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.854+0000 7f2fee7fc700 1 -- 172.21.15.73:0/3642096700 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ff80194b0 con 0x55811d517a40 2023-08-10T11:56:28.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.854+0000 7f2fee7fc700 1 -- 172.21.15.73:0/3642096700 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff8010430 con 0x55811d517a40 2023-08-10T11:56:28.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.855+0000 7f3019be4b80 1 -- 172.21.15.73:0/3642096700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55811d517a40 msgr2=0x55811d50cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:28.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.855+0000 7f3019be4b80 1 --2- 172.21.15.73:0/3642096700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55811d517a40 0x55811d50cc30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55811d52ec60 tx=0x7f2ff800a250 comp rx=0 tx=0).stop 2023-08-10T11:56:28.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.855+0000 7f3019be4b80 1 -- 172.21.15.73:0/3642096700 shutdown_connections 2023-08-10T11:56:28.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.855+0000 7f3019be4b80 1 --2- 172.21.15.73:0/3642096700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55811d51c1d0 0x55811d527b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:28.863 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.855+0000 7f3019be4b80 1 --2- 172.21.15.73:0/3642096700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55811d512550 0x55811d512010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.855+0000 7f3019be4b80 1 --2- 172.21.15.73:0/3642096700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55811d517a40 0x55811d50cc30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.855+0000 7f3019be4b80 1 -- 172.21.15.73:0/3642096700 >> 172.21.15.73:0/3642096700 conn(0x55811d46fc70 msgr2=0x55811d527480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.856+0000 7f3019be4b80 1 -- 172.21.15.73:0/3642096700 shutdown_connections 2023-08-10T11:56:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.856+0000 7f3019be4b80 1 -- 172.21.15.73:0/3642096700 wait complete. 2023-08-10T11:56:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.857+0000 7f3019be4b80 1 -- start start 2023-08-10T11:56:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.857+0000 7f3019be4b80 1 Processor -- start 2023-08-10T11:56:28.864 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.857+0000 7f3019be4b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55811d512550 0x55811d522960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:28.865 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.857+0000 7f3019be4b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55811d517a40 0x55811d522ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:28.866 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.858+0000 7f3019be4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55811d51c1d0 0x55811d520fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:28.866 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.858+0000 7f3019be4b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55811d5216b0 con 0x55811d512550 2023-08-10T11:56:28.866 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.858+0000 7f3019be4b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55811d521820 con 0x55811d517a40 2023-08-10T11:56:28.867 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.858+0000 7f3019be4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55811d5219e0 con 0x55811d51c1d0 2023-08-10T11:56:28.867 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.858+0000 7f3019be4b80 10 client.0 _ll_register_callbacks cb 0x55811d400620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:56:28.867 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.858+0000 7f30067fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55811d517a40 0x55811d522ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:28.867 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.858+0000 7f30077fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55811d51c1d0 0x55811d520fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:28.867 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.858+0000 7f30067fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55811d517a40 0x55811d522ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49508/0 (socket says 172.21.15.73:49508) 2023-08-10T11:56:28.867 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.858+0000 7f30067fc700 1 -- 172.21.15.73:0/434116636 learned_addr learned my addr 172.21.15.73:0/434116636 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:28.867 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.858+0000 7f30077fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55811d51c1d0 0x55811d520fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60364/0 (socket says 172.21.15.73:60364) 2023-08-10T11:56:28.867 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.858+0000 7f30077fe700 1 --2- 172.21.15.73:0/434116636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55811d512550 0x55811d522960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:28.868 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.858+0000 7f30077fe700 1 -- 172.21.15.73:0/434116636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55811d517a40 msgr2=0x55811d522ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:28.868 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.858+0000 7f30077fe700 1 --2- 172.21.15.73:0/434116636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55811d517a40 0x55811d522ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:28.868 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.858+0000 7f30077fe700 1 -- 172.21.15.73:0/434116636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55811d512550 msgr2=0x55811d522960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:28.868 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.858+0000 7f30077fe700 1 --2- 172.21.15.73:0/434116636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55811d512550 0x55811d522960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:28.868 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.858+0000 7f30077fe700 1 -- 172.21.15.73:0/434116636 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff800a830 con 0x55811d51c1d0 2023-08-10T11:56:28.868 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.859+0000 7f30067fc700 1 --2- 172.21.15.73:0/434116636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55811d517a40 0x55811d522ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:56:28.868 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.859+0000 7f30077fe700 1 --2- 172.21.15.73:0/434116636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55811d51c1d0 0x55811d520fd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3000030db0 tx=0x7f3000024da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d70dfd15d290d771 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:28.869 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.859+0000 7f2fe6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T11:56:28.869 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.859+0000 7f2fe6ffd700 1 -- 172.21.15.73:0/434116636 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300000e030 con 0x55811d51c1d0 2023-08-10T11:56:28.869 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.859+0000 7f3019be4b80 1 -- 172.21.15.73:0/434116636 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f30000074e0 con 0x55811d51c1d0 2023-08-10T11:56:28.869 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.859+0000 7f2fe6ffd700 1 -- 172.21.15.73:0/434116636 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f3000009070 con 0x55811d51c1d0 2023-08-10T11:56:28.869 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.859+0000 7f2fe6ffd700 1 -- 172.21.15.73:0/434116636 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3000009410 con 0x55811d51c1d0 2023-08-10T11:56:28.869 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.860+0000 7f3019be4b80 10 client.25768 fetch_fsmap learned FSMap version 36 2023-08-10T11:56:28.869 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.860+0000 7f3019be4b80 1 -- 172.21.15.73:0/434116636 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55811d2b71f0 con 0x55811d51c1d0 2023-08-10T11:56:28.869 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.860+0000 7f2fe6ffd700 1 -- 172.21.15.73:0/434116636 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f30000074e0 con 0x55811d51c1d0 2023-08-10T11:56:28.870 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.861+0000 7f2fe6ffd700 1 -- 172.21.15.73:0/434116636 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 36) v1 ==== 7510+0+0 (secure 0 0 0) 0x7f30000248a0 con 0x55811d51c1d0 2023-08-10T11:56:28.870 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.861+0000 7f3019be4b80 10 client.25768 fetch_fsmap finished waiting for FSMap version 36 2023-08-10T11:56:28.870 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.861+0000 7f3019be4b80 10 client.25768 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:56:28.870 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.861+0000 7f3019be4b80 20 client.25768 populate_metadata read hostname 'smithi073' 2023-08-10T11:56:28.870 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.861+0000 7f3019be4b80 1 --2- 172.21.15.73:0/434116636 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55811d580a90 0x55811d582eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:28.870 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.861+0000 7f3019be4b80 4 client.25768 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:56:28.870 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.861+0000 7f3019be4b80 1 -- 172.21.15.73:0/434116636 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55811d45c720 con 0x55811d580a90 2023-08-10T11:56:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.861+0000 7f30067fc700 1 --2- 172.21.15.73:0/434116636 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55811d580a90 0x55811d582eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.861+0000 7f2fe6ffd700 10 client.25768 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:56:28.871 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:28.861+0000 7f30067fc700 1 --2- 172.21.15.73:0/434116636 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55811d580a90 0x55811d582eb0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb6756728d1e6204 server_cookie=1b0b38f48f63f191 in_seq=0 out_seq=0 2023-08-10T11:56:29.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:28 smithi152 ceph-mon[130220]: pgmap v118: 97 pgs: 97 active+clean; 820 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 317 op/s 2023-08-10T11:56:29.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:28 smithi156 ceph-mon[130574]: pgmap v118: 97 pgs: 97 active+clean; 820 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 317 op/s 2023-08-10T11:56:29.277 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:28 smithi073 ceph-mon[128869]: pgmap v118: 97 pgs: 97 active+clean; 820 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 317 op/s 2023-08-10T11:56:30.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:30.515+0000 7f2fe6ffd700 1 -- 172.21.15.73:0/434116636 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55811d45c720 con 0x55811d580a90 2023-08-10T11:56:30.517 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:30.515+0000 7f2fe6ffd700 10 client.25768 handle_command_reply: tid=0 2023-08-10T11:56:30.517 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:30.515+0000 7f3019be4b80 1 client.25768 shutdown 2023-08-10T11:56:30.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:30.545+0000 7f3019be4b80 1 -- 172.21.15.73:0/434116636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55811d51c1d0 msgr2=0x55811d520fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:30.553 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:30.545+0000 7f3019be4b80 1 --2- 172.21.15.73:0/434116636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55811d51c1d0 0x55811d520fd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3000030db0 tx=0x7f3000024da0 comp rx=0 tx=0).stop 2023-08-10T11:56:30.584 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:30.582+0000 7f3019be4b80 1 -- 172.21.15.73:0/434116636 shutdown_connections 2023-08-10T11:56:30.584 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:30.582+0000 7f3019be4b80 1 --2- 172.21.15.73:0/434116636 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55811d580a90 0x55811d582eb0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:30.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:30.582+0000 7f3019be4b80 1 --2- 172.21.15.73:0/434116636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55811d51c1d0 0x55811d520fd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:30.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:30.582+0000 7f3019be4b80 1 --2- 172.21.15.73:0/434116636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55811d512550 0x55811d522960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:30.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:30.582+0000 7f3019be4b80 1 --2- 172.21.15.73:0/434116636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55811d517a40 0x55811d522ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:30.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:30.582+0000 7f3019be4b80 1 -- 172.21.15.73:0/434116636 >> 172.21.15.73:0/434116636 conn(0x55811d46fc70 msgr2=0x55811d527480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:30.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:30.582+0000 7f2fe6ffd700 0 client.25768 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:56:30.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:30.582+0000 7f3019be4b80 1 -- 172.21.15.73:0/434116636 shutdown_connections 2023-08-10T11:56:30.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:30.582+0000 7f3019be4b80 1 -- 172.21.15.73:0/434116636 wait complete. 2023-08-10T11:56:30.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:30.583+0000 7f3019be4b80 20 client.25768 trim_cache size 0 max 16384 2023-08-10T11:56:30.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:56:30.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:56:30.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:56:30.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:56:30.836 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:30.834+0000 7f300da4b700 1 -- 172.21.15.73:0/3568856351 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f2ff00a1490 msgr2=0x7f2ff00a3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:30.836 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:30.834+0000 7f300da4b700 1 --2- 172.21.15.73:0/3568856351 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f2ff00a1490 0x7f2ff00a3950 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55811d50e680 tx=0x7f2ffc010c40 comp rx=0 tx=0).stop 2023-08-10T11:56:30.837 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:30.834+0000 7f300da4b700 1 -- 172.21.15.73:0/3568856351 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f300810eec0 msgr2=0x7f30081ab700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:30.837 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:30.834+0000 7f300da4b700 1 --2- 172.21.15.73:0/3568856351 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f300810eec0 0x7f30081ab700 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc00d950 tx=0x7f2ffc00dd10 comp rx=0 tx=0).stop 2023-08-10T11:56:30.837 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:30.834+0000 7f300da4b700 1 -- 172.21.15.73:0/3568856351 shutdown_connections 2023-08-10T11:56:30.837 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:30.834+0000 7f300da4b700 1 --2- 172.21.15.73:0/3568856351 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f2ff00a1490 0x7f2ff00a3950 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:30.837 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:30.834+0000 7f300da4b700 1 --2- 172.21.15.73:0/3568856351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30081a5560 0x7f30081a5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:30.837 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:30.834+0000 7f300da4b700 1 --2- 172.21.15.73:0/3568856351 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f300810eec0 0x7f30081ab700 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:30.837 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:30.834+0000 7f300da4b700 1 --2- 172.21.15.73:0/3568856351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3008119f50 0x7f30081abc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:30.838 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:30.834+0000 7f300da4b700 1 -- 172.21.15.73:0/3568856351 >> 172.21.15.73:0/3568856351 conn(0x7f300806c830 msgr2=0x7f300810cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:30.838 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:30.835+0000 7f300da4b700 1 -- 172.21.15.73:0/3568856351 shutdown_connections 2023-08-10T11:56:30.838 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:30.835+0000 7f300da4b700 1 -- 172.21.15.73:0/3568856351 wait complete. 2023-08-10T11:56:31.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:30 smithi152 ceph-mon[130220]: pgmap v119: 97 pgs: 97 active+clean; 829 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.1 MiB/s wr, 385 op/s 2023-08-10T11:56:31.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:30 smithi156 ceph-mon[130574]: pgmap v119: 97 pgs: 97 active+clean; 829 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.1 MiB/s wr, 385 op/s 2023-08-10T11:56:31.291 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:30 smithi073 ceph-mon[128869]: pgmap v119: 97 pgs: 97 active+clean; 829 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.1 MiB/s wr, 385 op/s 2023-08-10T11:56:33.274 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:33 smithi073 ceph-mon[128869]: pgmap v120: 97 pgs: 97 active+clean; 829 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 191 op/s 2023-08-10T11:56:33.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:33 smithi152 ceph-mon[130220]: pgmap v120: 97 pgs: 97 active+clean; 829 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 191 op/s 2023-08-10T11:56:33.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:33 smithi156 ceph-mon[130574]: pgmap v120: 97 pgs: 97 active+clean; 829 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 191 op/s 2023-08-10T11:56:34.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:34 smithi152 ceph-mon[130220]: pgmap v121: 97 pgs: 97 active+clean; 823 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.7 MiB/s wr, 393 op/s 2023-08-10T11:56:35.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:34 smithi156 ceph-mon[130574]: pgmap v121: 97 pgs: 97 active+clean; 823 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.7 MiB/s wr, 393 op/s 2023-08-10T11:56:35.026 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:34 smithi073 ceph-mon[128869]: pgmap v121: 97 pgs: 97 active+clean; 823 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.7 MiB/s wr, 393 op/s 2023-08-10T11:56:35.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:35 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:56:36.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:35 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:56:36.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:35 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:56:37.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:36 smithi152 ceph-mon[130220]: pgmap v122: 97 pgs: 97 active+clean; 826 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 411 op/s 2023-08-10T11:56:37.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:36 smithi156 ceph-mon[130574]: pgmap v122: 97 pgs: 97 active+clean; 826 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 411 op/s 2023-08-10T11:56:37.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:36 smithi073 ceph-mon[128869]: pgmap v122: 97 pgs: 97 active+clean; 826 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 411 op/s 2023-08-10T11:56:38.112 INFO:tasks.workunit.client.0.smithi073.stdout: 222 2678412 673 1771015 772 866438 452 2023-08-10T11:56:39.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:38 smithi152 ceph-mon[130220]: pgmap v123: 97 pgs: 97 active+clean; 826 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 388 op/s 2023-08-10T11:56:39.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:38 smithi156 ceph-mon[130574]: pgmap v123: 97 pgs: 97 active+clean; 826 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 388 op/s 2023-08-10T11:56:39.276 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:38 smithi073 ceph-mon[128869]: pgmap v123: 97 pgs: 97 active+clean; 826 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 388 op/s 2023-08-10T11:56:40.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:40 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:56:40.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:40 smithi152 ceph-mon[130220]: pgmap v124: 97 pgs: 97 active+clean; 890 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.3 MiB/s wr, 721 op/s 2023-08-10T11:56:41.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:40 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:56:41.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:40 smithi156 ceph-mon[130574]: pgmap v124: 97 pgs: 97 active+clean; 890 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.3 MiB/s wr, 721 op/s 2023-08-10T11:56:41.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:40 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:56:41.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:40 smithi073 ceph-mon[128869]: pgmap v124: 97 pgs: 97 active+clean; 890 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.3 MiB/s wr, 721 op/s 2023-08-10T11:56:43.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:42 smithi152 ceph-mon[130220]: pgmap v125: 97 pgs: 97 active+clean; 901 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.4 MiB/s wr, 716 op/s 2023-08-10T11:56:43.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:42 smithi156 ceph-mon[130574]: pgmap v125: 97 pgs: 97 active+clean; 901 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.4 MiB/s wr, 716 op/s 2023-08-10T11:56:43.278 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:42 smithi073 ceph-mon[128869]: pgmap v125: 97 pgs: 97 active+clean; 901 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.4 MiB/s wr, 716 op/s 2023-08-10T11:56:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.258+0000 7f3e5c37e700 1 -- 172.21.15.73:0/1615719878 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e5410c360 msgr2=0x7f3e54072a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.258+0000 7f3e5c37e700 1 --2- 172.21.15.73:0/1615719878 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e5410c360 0x7f3e54072a30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c009f90 tx=0x7f3e4c00b330 comp rx=0 tx=0).stop 2023-08-10T11:56:44.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.269+0000 7f3e5c37e700 1 -- 172.21.15.73:0/1615719878 shutdown_connections 2023-08-10T11:56:44.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.269+0000 7f3e5c37e700 1 --2- 172.21.15.73:0/1615719878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e54107e30 0x7f3e54108210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.269+0000 7f3e5c37e700 1 --2- 172.21.15.73:0/1615719878 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e5410c360 0x7f3e54072a30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.269+0000 7f3e5c37e700 1 --2- 172.21.15.73:0/1615719878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e5410b9a0 0x7f3e5410be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.269+0000 7f3e5c37e700 1 -- 172.21.15.73:0/1615719878 >> 172.21.15.73:0/1615719878 conn(0x7f3e5406c830 msgr2=0x7f3e5406cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:44.271 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.270+0000 7f3e5c37e700 1 -- 172.21.15.73:0/1615719878 shutdown_connections 2023-08-10T11:56:44.271 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.270+0000 7f3e5c37e700 1 -- 172.21.15.73:0/1615719878 wait complete. 2023-08-10T11:56:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.271+0000 7f3e5c37e700 1 Processor -- start 2023-08-10T11:56:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.271+0000 7f3e5c37e700 1 -- start start 2023-08-10T11:56:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.271+0000 7f3e5c37e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e54107e30 0x7f3e540831b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.271+0000 7f3e5c37e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e5410b9a0 0x7f3e5407cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.271+0000 7f3e5c37e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e5410c360 0x7f3e5407d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.271+0000 7f3e5c37e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5407db80 con 0x7f3e5410b9a0 2023-08-10T11:56:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.271+0000 7f3e5c37e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5407dcf0 con 0x7f3e5410c360 2023-08-10T11:56:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.271+0000 7f3e5c37e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e541c3110 con 0x7f3e54107e30 2023-08-10T11:56:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.272+0000 7f3e5a11a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e54107e30 0x7f3e540831b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.272+0000 7f3e5a11a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e54107e30 0x7f3e540831b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60376/0 (socket says 172.21.15.73:60376) 2023-08-10T11:56:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.272+0000 7f3e5a11a700 1 -- 172.21.15.73:0/986721160 learned_addr learned my addr 172.21.15.73:0/986721160 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.272+0000 7f3e59919700 1 --2- 172.21.15.73:0/986721160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e5410b9a0 0x7f3e5407cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.272+0000 7f3e5a11a700 1 -- 172.21.15.73:0/986721160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e5410c360 msgr2=0x7f3e5407d470 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-10T11:56:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.272+0000 7f3e5a11a700 1 --2- 172.21.15.73:0/986721160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e5410c360 0x7f3e5407d470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.272+0000 7f3e5a11a700 1 -- 172.21.15.73:0/986721160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e5410b9a0 msgr2=0x7f3e5407cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.272+0000 7f3e5a11a700 1 --2- 172.21.15.73:0/986721160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e5410b9a0 0x7f3e5407cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.272+0000 7f3e5a11a700 1 -- 172.21.15.73:0/986721160 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c009c40 con 0x7f3e54107e30 2023-08-10T11:56:44.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.272+0000 7f3e5a11a700 1 --2- 172.21.15.73:0/986721160 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e54107e30 0x7f3e540831b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000e9c0 tx=0x7f3e5000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:44.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.272+0000 7f3e4b7fe700 1 -- 172.21.15.73:0/986721160 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5000cbd0 con 0x7f3e54107e30 2023-08-10T11:56:44.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.272+0000 7f3e4b7fe700 1 -- 172.21.15.73:0/986721160 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e5000eeb0 con 0x7f3e54107e30 2023-08-10T11:56:44.276 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.272+0000 7f3e4b7fe700 1 -- 172.21.15.73:0/986721160 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e50005560 con 0x7f3e54107e30 2023-08-10T11:56:44.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.272+0000 7f3e5c37e700 1 -- 172.21.15.73:0/986721160 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e541c3370 con 0x7f3e54107e30 2023-08-10T11:56:44.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.272+0000 7f3e5c37e700 1 -- 172.21.15.73:0/986721160 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e541c3830 con 0x7f3e54107e30 2023-08-10T11:56:44.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.276+0000 7f3e4b7fe700 1 -- 172.21.15.73:0/986721160 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f3e50004750 con 0x7f3e54107e30 2023-08-10T11:56:44.277 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.277+0000 7f3e68517b80 1 Processor -- start 2023-08-10T11:56:44.278 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.277+0000 7f3e4b7fe700 1 --2- 172.21.15.73:0/986721160 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f3e400a1380 0x7f3e400a3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:44.278 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.277+0000 7f3e4b7fe700 1 -- 172.21.15.73:0/986721160 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f3e50014070 con 0x7f3e54107e30 2023-08-10T11:56:44.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.280+0000 7f3e68517b80 1 -- start start 2023-08-10T11:56:44.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.280+0000 7f3e68517b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624aeb9ea40 0x5624aeb9ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:44.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.280+0000 7f3e68517b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624aeb9f360 0x5624aeb99010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:44.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.280+0000 7f3e68517b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5624aeb99550 0x5624aeb999d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:44.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.280+0000 7f3e68517b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624aeb14d60 con 0x5624aeb99550 2023-08-10T11:56:44.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.280+0000 7f3e68517b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624aeaf1530 con 0x5624aeb9f360 2023-08-10T11:56:44.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.280+0000 7f3e68517b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624aeaeee50 con 0x5624aeb9ea40 2023-08-10T11:56:44.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.280+0000 7f3e5a11a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624aeb9ea40 0x5624aeb9ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:44.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.280+0000 7f3e5a91b700 1 --2- 172.21.15.73:0/986721160 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f3e400a1380 0x7f3e400a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:44.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.280+0000 7f3e5a11a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624aeb9ea40 0x5624aeb9ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60384/0 (socket says 172.21.15.73:60384) 2023-08-10T11:56:44.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.280+0000 7f3e5a11a700 1 -- 172.21.15.73:0/1180414624 learned_addr learned my addr 172.21.15.73:0/1180414624 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:44.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.281+0000 7f3e5a91b700 1 --2- 172.21.15.73:0/1180414624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5624aeb99550 0x5624aeb999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:44.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.281+0000 7f3e5a11a700 1 -- 172.21.15.73:0/1180414624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624aeb9f360 msgr2=0x5624aeb99010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T11:56:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.281+0000 7f3e5a11a700 1 --2- 172.21.15.73:0/1180414624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624aeb9f360 0x5624aeb99010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.281+0000 7f3e5a11a700 1 -- 172.21.15.73:0/1180414624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5624aeb99550 msgr2=0x5624aeb999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.281+0000 7f3e5a11a700 1 --2- 172.21.15.73:0/1180414624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5624aeb99550 0x5624aeb999d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.281+0000 7f3e5a11a700 1 -- 172.21.15.73:0/1180414624 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624ae96b5d0 con 0x5624aeb9ea40 2023-08-10T11:56:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.281+0000 7f3e5a91b700 1 --2- 172.21.15.73:0/1180414624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5624aeb99550 0x5624aeb999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:56:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.281+0000 7f3e5a11a700 1 --2- 172.21.15.73:0/1180414624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624aeb9ea40 0x5624aeb9ee20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3e500969a0 tx=0x7f3e50099910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d24f01c538c5d49 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:44.286 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.281+0000 7f3e48daa700 1 -- 172.21.15.73:0/1180414624 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e500a2380 con 0x5624aeb9ea40 2023-08-10T11:56:44.286 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.281+0000 7f3e48daa700 1 -- 172.21.15.73:0/1180414624 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e50016e20 con 0x5624aeb9ea40 2023-08-10T11:56:44.286 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.282+0000 7f3e48daa700 1 -- 172.21.15.73:0/1180414624 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5009a3f0 con 0x5624aeb9ea40 2023-08-10T11:56:44.286 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.282+0000 7f3e5a91b700 1 --2- 172.21.15.73:0/986721160 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f3e400a1380 0x7f3e400a3840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c009c10 tx=0x7f3e4c009ac0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:44.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.282+0000 7f3e68517b80 1 -- 172.21.15.73:0/1180414624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624aeb9ea40 msgr2=0x5624aeb9ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:44.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.282+0000 7f3e68517b80 1 --2- 172.21.15.73:0/1180414624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624aeb9ea40 0x5624aeb9ee20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3e500969a0 tx=0x7f3e50099910 comp rx=0 tx=0).stop 2023-08-10T11:56:44.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.284+0000 7f3e68517b80 1 -- 172.21.15.73:0/1180414624 shutdown_connections 2023-08-10T11:56:44.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.284+0000 7f3e68517b80 1 --2- 172.21.15.73:0/1180414624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5624aeb99550 0x5624aeb999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.284+0000 7f3e68517b80 1 --2- 172.21.15.73:0/1180414624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624aeb9ea40 0x5624aeb9ee20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.284+0000 7f3e68517b80 1 --2- 172.21.15.73:0/1180414624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624aeb9f360 0x5624aeb99010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.284+0000 7f3e68517b80 1 -- 172.21.15.73:0/1180414624 >> 172.21.15.73:0/1180414624 conn(0x5624aeaf6c70 msgr2=0x5624aeb93d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:44.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.284+0000 7f3e68517b80 1 -- 172.21.15.73:0/1180414624 shutdown_connections 2023-08-10T11:56:44.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.284+0000 7f3e68517b80 1 -- 172.21.15.73:0/1180414624 wait complete. 2023-08-10T11:56:44.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.285+0000 7f3e68517b80 1 -- start start 2023-08-10T11:56:44.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.285+0000 7f3e68517b80 1 Processor -- start 2023-08-10T11:56:44.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.285+0000 7f3e68517b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5624aeb99550 0x5624aeba27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:44.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.285+0000 7f3e68517b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624aeb9ea40 0x5624aeba2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:44.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.285+0000 7f3e68517b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624aeb9f360 0x5624aeba3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:44.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.285+0000 7f3e68517b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624aeaea740 con 0x5624aeb99550 2023-08-10T11:56:44.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.285+0000 7f3e68517b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624aea89a60 con 0x5624aeb9f360 2023-08-10T11:56:44.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.285+0000 7f3e68517b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624aea89760 con 0x5624aeb9ea40 2023-08-10T11:56:44.291 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.285+0000 7f3e68517b80 10 client.0 _ll_register_callbacks cb 0x5624aea87620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:56:44.291 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.285+0000 7f3e5a11a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5624aeb99550 0x5624aeba27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:44.291 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.285+0000 7f3e5a11a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5624aeb99550 0x5624aeba27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34886/0 (socket says 172.21.15.73:34886) 2023-08-10T11:56:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.285+0000 7f3e5a11a700 1 -- 172.21.15.73:0/70439701 learned_addr learned my addr 172.21.15.73:0/70439701 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.285+0000 7f3e5a91b700 1 --2- 172.21.15.73:0/70439701 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624aeb9f360 0x5624aeba3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.285+0000 7f3e59919700 1 --2- 172.21.15.73:0/70439701 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624aeb9ea40 0x5624aeba2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:44.296 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.286+0000 7f3e5a11a700 1 -- 172.21.15.73:0/70439701 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624aeb9ea40 msgr2=0x5624aeba2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:44.296 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.286+0000 7f3e5a11a700 1 --2- 172.21.15.73:0/70439701 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624aeb9ea40 0x5624aeba2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.296 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.286+0000 7f3e5a11a700 1 -- 172.21.15.73:0/70439701 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624aeb9f360 msgr2=0x5624aeba3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:44.296 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.286+0000 7f3e5a11a700 1 --2- 172.21.15.73:0/70439701 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624aeb9f360 0x5624aeba3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.296 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.286+0000 7f3e5a11a700 1 -- 172.21.15.73:0/70439701 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e541c3830 con 0x5624aeb99550 2023-08-10T11:56:44.296 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.286+0000 7f3e59919700 1 --2- 172.21.15.73:0/70439701 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624aeb9ea40 0x5624aeba2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:56:44.297 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.286+0000 7f3e5a11a700 1 --2- 172.21.15.73:0/70439701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5624aeb99550 0x5624aeba27e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f3e500a1e50 tx=0x7f3e5009e020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc63ecb3b705a887 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:44.297 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.286+0000 7f3e3dffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:56:44.297 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.286+0000 7f3e3dffb700 1 -- 172.21.15.73:0/70439701 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e500c8070 con 0x5624aeb99550 2023-08-10T11:56:44.297 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.286+0000 7f3e3dffb700 1 -- 172.21.15.73:0/70439701 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f3e50099420 con 0x5624aeb99550 2023-08-10T11:56:44.297 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.286+0000 7f3e68517b80 1 -- 172.21.15.73:0/70439701 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5624aeb8c1c0 con 0x5624aeb99550 2023-08-10T11:56:44.297 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.286+0000 7f3e3dffb700 1 -- 172.21.15.73:0/70439701 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e500ca2b0 con 0x5624aeb99550 2023-08-10T11:56:44.297 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.286+0000 7f3e68517b80 10 client.16326 fetch_fsmap learned FSMap version 38 2023-08-10T11:56:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.286+0000 7f3e68517b80 1 -- 172.21.15.73:0/70439701 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x5624ae917d80 con 0x5624aeb99550 2023-08-10T11:56:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.287+0000 7f3e3dffb700 1 -- 172.21.15.73:0/70439701 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e5007e020 con 0x5624aeb99550 2023-08-10T11:56:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.287+0000 7f3e3dffb700 1 -- 172.21.15.73:0/70439701 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 38) v1 ==== 7526+0+0 (secure 0 0 0) 0x7f3e500a1ef0 con 0x5624aeb99550 2023-08-10T11:56:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.287+0000 7f3e68517b80 10 client.16326 fetch_fsmap finished waiting for FSMap version 38 2023-08-10T11:56:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.287+0000 7f3e68517b80 10 client.16326 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:56:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.287+0000 7f3e68517b80 20 client.16326 populate_metadata read hostname 'smithi073' 2023-08-10T11:56:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.287+0000 7f3e68517b80 1 --2- 172.21.15.73:0/70439701 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5624aebc39f0 0x5624aebc5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.287+0000 7f3e68517b80 4 client.16326 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:56:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.287+0000 7f3e68517b80 1 -- 172.21.15.73:0/70439701 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5624aeb68970 con 0x5624aebc39f0 2023-08-10T11:56:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.288+0000 7f3e59919700 1 --2- 172.21.15.73:0/70439701 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5624aebc39f0 0x5624aebc5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.288+0000 7f3e3dffb700 10 client.16326 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:56:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.288+0000 7f3e59919700 1 --2- 172.21.15.73:0/70439701 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5624aebc39f0 0x5624aebc5e10 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10a9655dffd6b9ea server_cookie=e25a1cee0adde11d in_seq=0 out_seq=0 2023-08-10T11:56:44.300 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.289+0000 7f3e3dffb700 1 -- 172.21.15.73:0/70439701 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5624aeb68970 con 0x5624aebc39f0 2023-08-10T11:56:44.300 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.289+0000 7f3e3dffb700 10 client.16326 handle_command_reply: tid=0 2023-08-10T11:56:44.300 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.289+0000 7f3e68517b80 1 client.16326 shutdown 2023-08-10T11:56:44.300 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.290+0000 7f3e68517b80 1 -- 172.21.15.73:0/70439701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5624aeb99550 msgr2=0x5624aeba27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:44.300 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.290+0000 7f3e68517b80 1 --2- 172.21.15.73:0/70439701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5624aeb99550 0x5624aeba27e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f3e500a1e50 tx=0x7f3e5009e020 comp rx=0 tx=0).stop 2023-08-10T11:56:44.301 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.290+0000 7f3e68517b80 1 -- 172.21.15.73:0/70439701 shutdown_connections 2023-08-10T11:56:44.301 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.290+0000 7f3e68517b80 1 --2- 172.21.15.73:0/70439701 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5624aebc39f0 0x5624aebc5e10 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.301 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.290+0000 7f3e68517b80 1 --2- 172.21.15.73:0/70439701 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624aeb9f360 0x5624aeba3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.301 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.290+0000 7f3e68517b80 1 --2- 172.21.15.73:0/70439701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5624aeb99550 0x5624aeba27e0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.301 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.290+0000 7f3e3dffb700 0 client.16326 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:56:44.301 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.290+0000 7f3e68517b80 1 --2- 172.21.15.73:0/70439701 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624aeb9ea40 0x5624aeba2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.302 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.290+0000 7f3e68517b80 1 -- 172.21.15.73:0/70439701 >> 172.21.15.73:0/70439701 conn(0x5624aeaf6c70 msgr2=0x5624aeb934b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:44.302 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.290+0000 7f3e68517b80 1 -- 172.21.15.73:0/70439701 shutdown_connections 2023-08-10T11:56:44.302 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.290+0000 7f3e68517b80 1 -- 172.21.15.73:0/70439701 wait complete. 2023-08-10T11:56:44.302 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.290+0000 7f3e68517b80 20 client.16326 trim_cache size 0 max 16384 2023-08-10T11:56:44.321 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.319+0000 7f3e68517b80 1 Processor -- start 2023-08-10T11:56:44.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.320+0000 7f3e68517b80 1 -- start start 2023-08-10T11:56:44.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.320+0000 7f3e68517b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624aeb99550 0x5624aebca790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:44.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.320+0000 7f3e68517b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5624aeb9ea40 0x5624aebbae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:44.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.320+0000 7f3e68517b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624aeb9f360 0x5624aeb93c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:44.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.320+0000 7f3e68517b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624ae96d8c0 con 0x5624aeb9ea40 2023-08-10T11:56:44.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.320+0000 7f3e68517b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624aeb8e730 con 0x5624aeb99550 2023-08-10T11:56:44.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.320+0000 7f3e68517b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624aeb94c10 con 0x5624aeb9f360 2023-08-10T11:56:44.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.320+0000 7f3e59919700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5624aeb9ea40 0x5624aebbae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:44.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.320+0000 7f3e5a11a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624aeb99550 0x5624aebca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:44.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.320+0000 7f3e59919700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5624aeb9ea40 0x5624aebbae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34896/0 (socket says 172.21.15.73:34896) 2023-08-10T11:56:44.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.320+0000 7f3e59919700 1 -- 172.21.15.73:0/935862364 learned_addr learned my addr 172.21.15.73:0/935862364 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:44.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.320+0000 7f3e5a91b700 1 --2- 172.21.15.73:0/935862364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624aeb9f360 0x5624aeb93c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.320+0000 7f3e5a11a700 1 -- 172.21.15.73:0/935862364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624aeb9f360 msgr2=0x5624aeb93c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.320+0000 7f3e5a11a700 1 --2- 172.21.15.73:0/935862364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624aeb9f360 0x5624aeb93c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.320+0000 7f3e5a11a700 1 -- 172.21.15.73:0/935862364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5624aeb9ea40 msgr2=0x5624aebbae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.320+0000 7f3e5a11a700 1 --2- 172.21.15.73:0/935862364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5624aeb9ea40 0x5624aebbae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.321+0000 7f3e5a11a700 1 -- 172.21.15.73:0/935862364 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624ae900c00 con 0x5624aeb99550 2023-08-10T11:56:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.321+0000 7f3e59919700 1 --2- 172.21.15.73:0/935862364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5624aeb9ea40 0x5624aebbae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:56:44.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.321+0000 7f3e5a11a700 1 --2- 172.21.15.73:0/935862364 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624aeb99550 0x5624aebca790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3e500cabb0 tx=0x7f3e50099910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9542b9514a20aab5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:44.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.321+0000 7f3e495ab700 1 -- 172.21.15.73:0/935862364 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e50004b70 con 0x5624aeb99550 2023-08-10T11:56:44.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.321+0000 7f3e495ab700 1 -- 172.21.15.73:0/935862364 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e5007e070 con 0x5624aeb99550 2023-08-10T11:56:44.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.321+0000 7f3e495ab700 1 -- 172.21.15.73:0/935862364 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5009a3f0 con 0x5624aeb99550 2023-08-10T11:56:44.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.322+0000 7f3e68517b80 1 -- 172.21.15.73:0/935862364 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624aeb99550 msgr2=0x5624aebca790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:44.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.322+0000 7f3e68517b80 1 --2- 172.21.15.73:0/935862364 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624aeb99550 0x5624aebca790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3e500cabb0 tx=0x7f3e50099910 comp rx=0 tx=0).stop 2023-08-10T11:56:44.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.322+0000 7f3e68517b80 1 -- 172.21.15.73:0/935862364 shutdown_connections 2023-08-10T11:56:44.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.322+0000 7f3e68517b80 1 --2- 172.21.15.73:0/935862364 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624aeb99550 0x5624aebca790 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.322+0000 7f3e68517b80 1 --2- 172.21.15.73:0/935862364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624aeb9f360 0x5624aeb93c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.322+0000 7f3e68517b80 1 --2- 172.21.15.73:0/935862364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5624aeb9ea40 0x5624aebbae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.322+0000 7f3e68517b80 1 -- 172.21.15.73:0/935862364 >> 172.21.15.73:0/935862364 conn(0x5624aeaf6c70 msgr2=0x5624aeb9d930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:44.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.322+0000 7f3e68517b80 1 -- 172.21.15.73:0/935862364 shutdown_connections 2023-08-10T11:56:44.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.322+0000 7f3e68517b80 1 -- 172.21.15.73:0/935862364 wait complete. 2023-08-10T11:56:44.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.323+0000 7f3e68517b80 1 -- start start 2023-08-10T11:56:44.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.323+0000 7f3e68517b80 1 Processor -- start 2023-08-10T11:56:44.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.323+0000 7f3e68517b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5624aeb99550 0x5624aec0b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:44.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.323+0000 7f3e68517b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624aeb9ea40 0x5624aec0bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:44.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.323+0000 7f3e68517b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624aeb9f360 0x5624aec166d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:44.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.323+0000 7f3e68517b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624aec0c430 con 0x5624aeb99550 2023-08-10T11:56:44.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.323+0000 7f3e68517b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624aec16c10 con 0x5624aeb9ea40 2023-08-10T11:56:44.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.323+0000 7f3e68517b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624aec16d50 con 0x5624aeb9f360 2023-08-10T11:56:44.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.323+0000 7f3e68517b80 10 client.0 _ll_register_callbacks cb 0x5624aea87620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:56:44.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.323+0000 7f3e59919700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624aeb9ea40 0x5624aec0bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:44.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.323+0000 7f3e5a91b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624aeb9f360 0x5624aec166d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:44.331 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.323+0000 7f3e59919700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624aeb9ea40 0x5624aec0bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49552/0 (socket says 172.21.15.73:49552) 2023-08-10T11:56:44.331 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.323+0000 7f3e59919700 1 -- 172.21.15.73:0/2796880247 learned_addr learned my addr 172.21.15.73:0/2796880247 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:44.331 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.323+0000 7f3e5a91b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624aeb9f360 0x5624aec166d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60408/0 (socket says 172.21.15.73:60408) 2023-08-10T11:56:44.331 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.323+0000 7f3e5a11a700 1 --2- 172.21.15.73:0/2796880247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5624aeb99550 0x5624aec0b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:44.331 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.324+0000 7f3e59919700 1 -- 172.21.15.73:0/2796880247 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624aeb9f360 msgr2=0x5624aec166d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:44.331 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.324+0000 7f3e59919700 1 --2- 172.21.15.73:0/2796880247 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624aeb9f360 0x5624aec166d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.332 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.324+0000 7f3e59919700 1 -- 172.21.15.73:0/2796880247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5624aeb99550 msgr2=0x5624aec0b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:44.332 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.324+0000 7f3e59919700 1 --2- 172.21.15.73:0/2796880247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5624aeb99550 0x5624aec0b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.332 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.324+0000 7f3e59919700 1 -- 172.21.15.73:0/2796880247 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e44009d90 con 0x5624aeb9ea40 2023-08-10T11:56:44.332 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.324+0000 7f3e59919700 1 --2- 172.21.15.73:0/2796880247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624aeb9ea40 0x5624aec0bd80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3e5407e9e0 tx=0x7f3e44016720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88a5ac07c6ede860 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:44.332 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.324+0000 7f3e3dffb700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T11:56:44.332 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.324+0000 7f3e3dffb700 1 -- 172.21.15.73:0/2796880247 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4401d040 con 0x5624aeb9ea40 2023-08-10T11:56:44.333 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.324+0000 7f3e3dffb700 1 -- 172.21.15.73:0/2796880247 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f3e44021420 con 0x5624aeb9ea40 2023-08-10T11:56:44.333 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.324+0000 7f3e68517b80 1 -- 172.21.15.73:0/2796880247 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3e50016e20 con 0x5624aeb9ea40 2023-08-10T11:56:44.333 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.324+0000 7f3e3dffb700 1 -- 172.21.15.73:0/2796880247 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e44021600 con 0x5624aeb9ea40 2023-08-10T11:56:44.333 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.324+0000 7f3e68517b80 10 client.25748 fetch_fsmap learned FSMap version 38 2023-08-10T11:56:44.333 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.324+0000 7f3e68517b80 1 -- 172.21.15.73:0/2796880247 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x5624ae917d80 con 0x5624aeb9ea40 2023-08-10T11:56:44.333 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.325+0000 7f3e3dffb700 1 -- 172.21.15.73:0/2796880247 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e50016e20 con 0x5624aeb9ea40 2023-08-10T11:56:44.333 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.325+0000 7f3e3dffb700 1 -- 172.21.15.73:0/2796880247 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 38) v1 ==== 7526+0+0 (secure 0 0 0) 0x7f3e44020520 con 0x5624aeb9ea40 2023-08-10T11:56:44.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.325+0000 7f3e68517b80 10 client.25748 fetch_fsmap finished waiting for FSMap version 38 2023-08-10T11:56:44.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.325+0000 7f3e68517b80 10 client.25748 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:56:44.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.325+0000 7f3e68517b80 20 client.25748 populate_metadata read hostname 'smithi073' 2023-08-10T11:56:44.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.325+0000 7f3e68517b80 1 --2- 172.21.15.73:0/2796880247 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5624aec185b0 0x5624aec1a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:44.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.325+0000 7f3e68517b80 4 client.25748 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:56:44.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.325+0000 7f3e68517b80 1 -- 172.21.15.73:0/2796880247 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5624aeae3720 con 0x5624aec185b0 2023-08-10T11:56:44.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.325+0000 7f3e5a11a700 1 --2- 172.21.15.73:0/2796880247 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5624aec185b0 0x5624aec1a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:44.335 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.326+0000 7f3e3dffb700 10 client.25748 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:56:44.335 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.326+0000 7f3e5a11a700 1 --2- 172.21.15.73:0/2796880247 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5624aec185b0 0x5624aec1a9d0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b29fc32ce311366c server_cookie=16ef089cf2812d8f in_seq=0 out_seq=0 2023-08-10T11:56:44.822 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.822+0000 7f3e3dffb700 1 -- 172.21.15.73:0/2796880247 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5624aeae3720 con 0x5624aec185b0 2023-08-10T11:56:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.822+0000 7f3e3dffb700 10 client.25748 handle_command_reply: tid=0 2023-08-10T11:56:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.822+0000 7f3e68517b80 1 client.25748 shutdown 2023-08-10T11:56:44.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.822+0000 7f3e68517b80 1 -- 172.21.15.73:0/2796880247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624aeb9ea40 msgr2=0x5624aec0bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.822+0000 7f3e68517b80 1 --2- 172.21.15.73:0/2796880247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624aeb9ea40 0x5624aec0bd80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3e5407e9e0 tx=0x7f3e44016720 comp rx=0 tx=0).stop 2023-08-10T11:56:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.822+0000 7f3e68517b80 1 -- 172.21.15.73:0/2796880247 shutdown_connections 2023-08-10T11:56:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.822+0000 7f3e68517b80 1 --2- 172.21.15.73:0/2796880247 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5624aec185b0 0x5624aec1a9d0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.822+0000 7f3e68517b80 1 --2- 172.21.15.73:0/2796880247 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624aeb9f360 0x5624aec166d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.822+0000 7f3e68517b80 1 --2- 172.21.15.73:0/2796880247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5624aeb99550 0x5624aec0b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.822+0000 7f3e68517b80 1 --2- 172.21.15.73:0/2796880247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5624aeb9ea40 0x5624aec0bd80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.822+0000 7f3e68517b80 1 -- 172.21.15.73:0/2796880247 >> 172.21.15.73:0/2796880247 conn(0x5624aeaf6c70 msgr2=0x5624aeb9f740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:44.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.822+0000 7f3e3dffb700 0 client.25748 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:56:44.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.823+0000 7f3e68517b80 1 -- 172.21.15.73:0/2796880247 shutdown_connections 2023-08-10T11:56:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.823+0000 7f3e68517b80 1 -- 172.21.15.73:0/2796880247 wait complete. 2023-08-10T11:56:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.824+0000 7f3e68517b80 20 client.25748 trim_cache size 0 max 16384 2023-08-10T11:56:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:56:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:56:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:56:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:56:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.984+0000 7f3e5c37e700 1 -- 172.21.15.73:0/986721160 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f3e400a1380 msgr2=0x7f3e400a3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.984+0000 7f3e5c37e700 1 --2- 172.21.15.73:0/986721160 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f3e400a1380 0x7f3e400a3840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c009c10 tx=0x7f3e4c009ac0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.984+0000 7f3e5c37e700 1 -- 172.21.15.73:0/986721160 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e54107e30 msgr2=0x7f3e540831b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:44.984+0000 7f3e5c37e700 1 --2- 172.21.15.73:0/986721160 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e54107e30 0x7f3e540831b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000e9c0 tx=0x7f3e5000ecd0 comp rx=0 tx=0).stop 2023-08-10T11:56:44.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:44 smithi152 ceph-mon[130220]: pgmap v126: 97 pgs: 97 active+clean; 935 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 10 MiB/s wr, 852 op/s 2023-08-10T11:56:45.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:44 smithi156 ceph-mon[130574]: pgmap v126: 97 pgs: 97 active+clean; 935 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 10 MiB/s wr, 852 op/s 2023-08-10T11:56:45.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:44 smithi073 ceph-mon[128869]: pgmap v126: 97 pgs: 97 active+clean; 935 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 10 MiB/s wr, 852 op/s 2023-08-10T11:56:45.035 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:45.032+0000 7f3e5c37e700 1 -- 172.21.15.73:0/986721160 shutdown_connections 2023-08-10T11:56:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:45.032+0000 7f3e5c37e700 1 --2- 172.21.15.73:0/986721160 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f3e400a1380 0x7f3e400a3840 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:45.032+0000 7f3e5c37e700 1 --2- 172.21.15.73:0/986721160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e5410c360 0x7f3e5407d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:45.032+0000 7f3e5c37e700 1 --2- 172.21.15.73:0/986721160 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e54107e30 0x7f3e540831b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:45.032+0000 7f3e5c37e700 1 --2- 172.21.15.73:0/986721160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e5410b9a0 0x7f3e5407cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:45.032+0000 7f3e5c37e700 1 -- 172.21.15.73:0/986721160 >> 172.21.15.73:0/986721160 conn(0x7f3e5406c830 msgr2=0x7f3e5410a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:45.032+0000 7f3e5c37e700 1 -- 172.21.15.73:0/986721160 shutdown_connections 2023-08-10T11:56:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:45.032+0000 7f3e5c37e700 1 -- 172.21.15.73:0/986721160 wait complete. 2023-08-10T11:56:47.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:46 smithi152 ceph-mon[130220]: pgmap v127: 97 pgs: 97 active+clean; 963 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 12 MiB/s wr, 764 op/s 2023-08-10T11:56:47.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:46 smithi156 ceph-mon[130574]: pgmap v127: 97 pgs: 97 active+clean; 963 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 12 MiB/s wr, 764 op/s 2023-08-10T11:56:47.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:46 smithi073 ceph-mon[128869]: pgmap v127: 97 pgs: 97 active+clean; 963 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 12 MiB/s wr, 764 op/s 2023-08-10T11:56:48.119 INFO:tasks.workunit.client.0.smithi073.stdout: 232 2345268 726 1556897 505 751127 825 2023-08-10T11:56:48.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:47 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:56:48.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:47 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:56:48.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:47 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:56:49.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:48 smithi152 ceph-mon[130220]: pgmap v128: 97 pgs: 97 active+clean; 963 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 12 MiB/s wr, 671 op/s 2023-08-10T11:56:49.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:48 smithi156 ceph-mon[130574]: pgmap v128: 97 pgs: 97 active+clean; 963 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 12 MiB/s wr, 671 op/s 2023-08-10T11:56:49.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:48 smithi073 ceph-mon[128869]: pgmap v128: 97 pgs: 97 active+clean; 963 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 12 MiB/s wr, 671 op/s 2023-08-10T11:56:49.288 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:56:49.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.428+0000 7f0a284a4700 1 -- 172.21.15.73:0/4228619042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a201002c0 msgr2=0x7f0a201006a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:49.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.428+0000 7f0a284a4700 1 --2- 172.21.15.73:0/4228619042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a201002c0 0x7f0a201006a0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c009990 tx=0x7f0a1c009ca0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.428+0000 7f0a284a4700 1 -- 172.21.15.73:0/4228619042 shutdown_connections 2023-08-10T11:56:49.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.428+0000 7f0a284a4700 1 --2- 172.21.15.73:0/4228619042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a20104960 0x7f0a2010c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.428+0000 7f0a284a4700 1 --2- 172.21.15.73:0/4228619042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a201002c0 0x7f0a201006a0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.428+0000 7f0a284a4700 1 --2- 172.21.15.73:0/4228619042 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a20100c70 0x7f0a20104280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.428+0000 7f0a284a4700 1 -- 172.21.15.73:0/4228619042 >> 172.21.15.73:0/4228619042 conn(0x7f0a200758b0 msgr2=0x7f0a20075cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:49.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.428+0000 7f0a284a4700 1 -- 172.21.15.73:0/4228619042 shutdown_connections 2023-08-10T11:56:49.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.428+0000 7f0a284a4700 1 -- 172.21.15.73:0/4228619042 wait complete. 2023-08-10T11:56:49.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.429+0000 7f0a284a4700 1 Processor -- start 2023-08-10T11:56:49.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.429+0000 7f0a284a4700 1 -- start start 2023-08-10T11:56:49.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.429+0000 7f0a284a4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a201002c0 0x7f0a20194440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:49.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.429+0000 7f0a284a4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a20104960 0x7f0a20194980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:49.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.429+0000 7f0a284a4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a20194ec0 0x7f0a201a8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:49.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.429+0000 7f0a284a4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a201a9520 con 0x7f0a201002c0 2023-08-10T11:56:49.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.429+0000 7f0a284a4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a201a9660 con 0x7f0a20104960 2023-08-10T11:56:49.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.429+0000 7f0a284a4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a201a97d0 con 0x7f0a20194ec0 2023-08-10T11:56:49.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.429+0000 7f0a26240700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a201002c0 0x7f0a20194440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:49.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.429+0000 7f0a26240700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a201002c0 0x7f0a20194440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34914/0 (socket says 172.21.15.73:34914) 2023-08-10T11:56:49.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.429+0000 7f0a26240700 1 -- 172.21.15.73:0/2889359605 learned_addr learned my addr 172.21.15.73:0/2889359605 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:49.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.429+0000 7f0a26a41700 1 --2- 172.21.15.73:0/2889359605 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a20194ec0 0x7f0a201a8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:49.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.429+0000 7f0a25a3f700 1 --2- 172.21.15.73:0/2889359605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a20104960 0x7f0a20194980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:49.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.430+0000 7f0a26240700 1 -- 172.21.15.73:0/2889359605 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a20194ec0 msgr2=0x7f0a201a8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:49.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.430+0000 7f0a26240700 1 --2- 172.21.15.73:0/2889359605 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a20194ec0 0x7f0a201a8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.430+0000 7f0a26240700 1 -- 172.21.15.73:0/2889359605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a20104960 msgr2=0x7f0a20194980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:49.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.430+0000 7f0a26240700 1 --2- 172.21.15.73:0/2889359605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a20104960 0x7f0a20194980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.430+0000 7f0a26240700 1 -- 172.21.15.73:0/2889359605 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1c0095f0 con 0x7f0a201002c0 2023-08-10T11:56:49.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.430+0000 7f0a26240700 1 --2- 172.21.15.73:0/2889359605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a201002c0 0x7f0a20194440 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c000c00 tx=0x7f0a1c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:49.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.430+0000 7f0a177fe700 1 -- 172.21.15.73:0/2889359605 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c01d070 con 0x7f0a201002c0 2023-08-10T11:56:49.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.430+0000 7f0a284a4700 1 -- 172.21.15.73:0/2889359605 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a201a9a50 con 0x7f0a201002c0 2023-08-10T11:56:49.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.430+0000 7f0a177fe700 1 -- 172.21.15.73:0/2889359605 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a1c021410 con 0x7f0a201002c0 2023-08-10T11:56:49.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.430+0000 7f0a177fe700 1 -- 172.21.15.73:0/2889359605 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c017650 con 0x7f0a201002c0 2023-08-10T11:56:49.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.430+0000 7f0a284a4700 1 -- 172.21.15.73:0/2889359605 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a201a9f50 con 0x7f0a201002c0 2023-08-10T11:56:49.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.433+0000 7f0a177fe700 1 -- 172.21.15.73:0/2889359605 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f0a1c00fad0 con 0x7f0a201002c0 2023-08-10T11:56:49.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.434+0000 7f0a177fe700 1 --2- 172.21.15.73:0/2889359605 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0a0c0a12b0 0x7f0a0c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:49.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.434+0000 7f0a177fe700 1 -- 172.21.15.73:0/2889359605 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f0a1c0cdff0 con 0x7f0a201002c0 2023-08-10T11:56:49.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.434+0000 7f0a25a3f700 1 --2- 172.21.15.73:0/2889359605 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0a0c0a12b0 0x7f0a0c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:49.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.435+0000 7f0a3463db80 1 Processor -- start 2023-08-10T11:56:49.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.435+0000 7f0a25a3f700 1 --2- 172.21.15.73:0/2889359605 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0a0c0a12b0 0x7f0a0c0a3770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0a20195ce0 tx=0x7f0a10009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:49.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.435+0000 7f0a3463db80 1 -- start start 2023-08-10T11:56:49.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.435+0000 7f0a3463db80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5d3626f50 0x55c5d3627330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:49.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.435+0000 7f0a3463db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5d3627870 0x55c5d36212c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:49.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.435+0000 7f0a3463db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5d3621800 0x55c5d3621c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:49.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.435+0000 7f0a3463db80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5d359cdc0 con 0x55c5d3626f50 2023-08-10T11:56:49.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.435+0000 7f0a3463db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5d3579590 con 0x55c5d3621800 2023-08-10T11:56:49.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.435+0000 7f0a3463db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5d3576eb0 con 0x55c5d3627870 2023-08-10T11:56:49.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.436+0000 7f0a25a3f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5d3627870 0x55c5d36212c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:49.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.436+0000 7f0a26240700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5d3626f50 0x55c5d3627330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:49.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.436+0000 7f0a26a41700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5d3621800 0x55c5d3621c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:49.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.436+0000 7f0a25a3f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5d3627870 0x55c5d36212c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60428/0 (socket says 172.21.15.73:60428) 2023-08-10T11:56:49.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.436+0000 7f0a25a3f700 1 -- 172.21.15.73:0/2987365897 learned_addr learned my addr 172.21.15.73:0/2987365897 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:49.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.436+0000 7f0a25a3f700 1 -- 172.21.15.73:0/2987365897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5d3621800 msgr2=0x55c5d3621c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:49.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.436+0000 7f0a25a3f700 1 --2- 172.21.15.73:0/2987365897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5d3621800 0x55c5d3621c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.436+0000 7f0a25a3f700 1 -- 172.21.15.73:0/2987365897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5d3626f50 msgr2=0x55c5d3627330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:49.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.436+0000 7f0a25a3f700 1 --2- 172.21.15.73:0/2987365897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5d3626f50 0x55c5d3627330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.436+0000 7f0a25a3f700 1 -- 172.21.15.73:0/2987365897 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5d33f3630 con 0x55c5d3627870 2023-08-10T11:56:49.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.436+0000 7f0a25a3f700 1 --2- 172.21.15.73:0/2987365897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5d3627870 0x55c5d36212c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0a10011ca0 tx=0x7f0a10014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e6bb821ca5df6de server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:49.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.436+0000 7f0a14daa700 1 -- 172.21.15.73:0/2987365897 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a10004220 con 0x55c5d3627870 2023-08-10T11:56:49.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.436+0000 7f0a14daa700 1 -- 172.21.15.73:0/2987365897 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a10021070 con 0x55c5d3627870 2023-08-10T11:56:49.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.436+0000 7f0a14daa700 1 -- 172.21.15.73:0/2987365897 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a10003be0 con 0x55c5d3627870 2023-08-10T11:56:49.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.437+0000 7f0a3463db80 1 -- 172.21.15.73:0/2987365897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5d3627870 msgr2=0x55c5d36212c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:49.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.437+0000 7f0a3463db80 1 --2- 172.21.15.73:0/2987365897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5d3627870 0x55c5d36212c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0a10011ca0 tx=0x7f0a10014000 comp rx=0 tx=0).stop 2023-08-10T11:56:49.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.437+0000 7f0a3463db80 1 -- 172.21.15.73:0/2987365897 shutdown_connections 2023-08-10T11:56:49.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.437+0000 7f0a3463db80 1 --2- 172.21.15.73:0/2987365897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5d3621800 0x55c5d3621c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.437+0000 7f0a3463db80 1 --2- 172.21.15.73:0/2987365897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5d3626f50 0x55c5d3627330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.437+0000 7f0a3463db80 1 --2- 172.21.15.73:0/2987365897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5d3627870 0x55c5d36212c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.437+0000 7f0a3463db80 1 -- 172.21.15.73:0/2987365897 >> 172.21.15.73:0/2987365897 conn(0x55c5d357ecd0 msgr2=0x55c5d361c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:49.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.437+0000 7f0a3463db80 1 -- 172.21.15.73:0/2987365897 shutdown_connections 2023-08-10T11:56:49.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.437+0000 7f0a3463db80 1 -- 172.21.15.73:0/2987365897 wait complete. 2023-08-10T11:56:49.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.438+0000 7f0a3463db80 1 -- start start 2023-08-10T11:56:49.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.438+0000 7f0a3463db80 1 Processor -- start 2023-08-10T11:56:49.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.438+0000 7f0a3463db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5d3621800 0x55c5d362d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:49.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.438+0000 7f0a3463db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5d3626f50 0x55c5d362ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:49.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.438+0000 7f0a3463db80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5d3627870 0x55c5d362b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:49.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.438+0000 7f0a3463db80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5d35727a0 con 0x55c5d3627870 2023-08-10T11:56:49.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.438+0000 7f0a3463db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5d3511ac0 con 0x55c5d3621800 2023-08-10T11:56:49.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.438+0000 7f0a3463db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5d35117c0 con 0x55c5d3626f50 2023-08-10T11:56:49.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.438+0000 7f0a3463db80 10 client.0 _ll_register_callbacks cb 0x55c5d350f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:56:49.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.439+0000 7f0a25a3f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5d3626f50 0x55c5d362ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:49.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.439+0000 7f0a26240700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5d3621800 0x55c5d362d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:49.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.439+0000 7f0a26a41700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5d3627870 0x55c5d362b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:49.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.439+0000 7f0a26240700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5d3621800 0x55c5d362d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49578/0 (socket says 172.21.15.73:49578) 2023-08-10T11:56:49.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.439+0000 7f0a26240700 1 -- 172.21.15.73:0/3400556499 learned_addr learned my addr 172.21.15.73:0/3400556499 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:49.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.439+0000 7f0a25a3f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5d3626f50 0x55c5d362ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60434/0 (socket says 172.21.15.73:60434) 2023-08-10T11:56:49.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.439+0000 7f0a25a3f700 1 -- 172.21.15.73:0/3400556499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5d3621800 msgr2=0x55c5d362d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:49.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.439+0000 7f0a25a3f700 1 --2- 172.21.15.73:0/3400556499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5d3621800 0x55c5d362d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.439+0000 7f0a25a3f700 1 -- 172.21.15.73:0/3400556499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5d3627870 msgr2=0x55c5d362b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:49.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.439+0000 7f0a25a3f700 1 --2- 172.21.15.73:0/3400556499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5d3627870 0x55c5d362b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.439+0000 7f0a25a3f700 1 -- 172.21.15.73:0/3400556499 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a10017070 con 0x55c5d3626f50 2023-08-10T11:56:49.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.439+0000 7f0a25a3f700 1 --2- 172.21.15.73:0/3400556499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5d3626f50 0x55c5d362ab90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000e690 tx=0x7f0a1000e8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dcaaa4251b7ac1f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:49.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.439+0000 7f0a09ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T11:56:49.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.439+0000 7f0a09ffb700 1 -- 172.21.15.73:0/3400556499 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a10026480 con 0x55c5d3626f50 2023-08-10T11:56:49.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.439+0000 7f0a3463db80 1 -- 172.21.15.73:0/3400556499 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c5d3614470 con 0x55c5d3626f50 2023-08-10T11:56:49.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.439+0000 7f0a09ffb700 1 -- 172.21.15.73:0/3400556499 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f0a100265e0 con 0x55c5d3626f50 2023-08-10T11:56:49.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.439+0000 7f0a09ffb700 1 -- 172.21.15.73:0/3400556499 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a100267a0 con 0x55c5d3626f50 2023-08-10T11:56:49.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.439+0000 7f0a3463db80 10 client.25798 fetch_fsmap learned FSMap version 38 2023-08-10T11:56:49.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.439+0000 7f0a3463db80 1 -- 172.21.15.73:0/3400556499 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x55c5d339fde0 con 0x55c5d3626f50 2023-08-10T11:56:49.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.440+0000 7f0a09ffb700 1 -- 172.21.15.73:0/3400556499 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c5d3614470 con 0x55c5d3626f50 2023-08-10T11:56:49.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.440+0000 7f0a09ffb700 1 -- 172.21.15.73:0/3400556499 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 38) v1 ==== 7526+0+0 (secure 0 0 0) 0x7f0a100399e0 con 0x55c5d3626f50 2023-08-10T11:56:49.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.440+0000 7f0a3463db80 10 client.25798 fetch_fsmap finished waiting for FSMap version 38 2023-08-10T11:56:49.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.440+0000 7f0a3463db80 10 client.25798 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:56:49.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.440+0000 7f0a3463db80 20 client.25798 populate_metadata read hostname 'smithi073' 2023-08-10T11:56:49.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.440+0000 7f0a3463db80 1 --2- 172.21.15.73:0/3400556499 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c5d363b250 0x55c5d363d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:49.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.440+0000 7f0a3463db80 4 client.25798 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:56:49.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.440+0000 7f0a3463db80 1 -- 172.21.15.73:0/3400556499 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c5d35f09d0 con 0x55c5d363b250 2023-08-10T11:56:49.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.440+0000 7f0a26240700 1 --2- 172.21.15.73:0/3400556499 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c5d363b250 0x55c5d363d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:49.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.440+0000 7f0a09ffb700 10 client.25798 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:56:49.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.440+0000 7f0a26240700 1 --2- 172.21.15.73:0/3400556499 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c5d363b250 0x55c5d363d670 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccb08d0e033a527f server_cookie=5452ceab3fb2dd2b in_seq=0 out_seq=0 2023-08-10T11:56:49.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.441+0000 7f0a09ffb700 1 -- 172.21.15.73:0/3400556499 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55c5d35f09d0 con 0x55c5d363b250 2023-08-10T11:56:49.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.441+0000 7f0a09ffb700 10 client.25798 handle_command_reply: tid=0 2023-08-10T11:56:49.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.441+0000 7f0a3463db80 1 client.25798 shutdown 2023-08-10T11:56:49.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.441+0000 7f0a3463db80 1 -- 172.21.15.73:0/3400556499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5d3626f50 msgr2=0x55c5d362ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:49.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.441+0000 7f0a3463db80 1 --2- 172.21.15.73:0/3400556499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5d3626f50 0x55c5d362ab90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000e690 tx=0x7f0a1000e8c0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.441+0000 7f0a3463db80 1 -- 172.21.15.73:0/3400556499 shutdown_connections 2023-08-10T11:56:49.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.441+0000 7f0a3463db80 1 --2- 172.21.15.73:0/3400556499 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c5d363b250 0x55c5d363d670 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.441+0000 7f0a3463db80 1 --2- 172.21.15.73:0/3400556499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5d3621800 0x55c5d362d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.441+0000 7f0a09ffb700 0 client.25798 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:56:49.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.441+0000 7f0a3463db80 1 --2- 172.21.15.73:0/3400556499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5d3627870 0x55c5d362b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.441+0000 7f0a3463db80 1 --2- 172.21.15.73:0/3400556499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5d3626f50 0x55c5d362ab90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.441+0000 7f0a3463db80 1 -- 172.21.15.73:0/3400556499 >> 172.21.15.73:0/3400556499 conn(0x55c5d357ecd0 msgr2=0x55c5d361b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:49.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.441+0000 7f0a3463db80 1 -- 172.21.15.73:0/3400556499 shutdown_connections 2023-08-10T11:56:49.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.441+0000 7f0a3463db80 1 -- 172.21.15.73:0/3400556499 wait complete. 2023-08-10T11:56:49.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.441+0000 7f0a3463db80 20 client.25798 trim_cache size 0 max 16384 2023-08-10T11:56:49.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.459+0000 7f0a3463db80 1 Processor -- start 2023-08-10T11:56:49.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.459+0000 7f0a3463db80 1 -- start start 2023-08-10T11:56:49.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.459+0000 7f0a3463db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5d3621800 0x55c5d361c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:49.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.459+0000 7f0a3463db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5d3626f50 0x55c5d361c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:49.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.459+0000 7f0a3463db80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5d3627870 0x55c5d3625ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:49.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.459+0000 7f0a3463db80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5d33f5920 con 0x55c5d3627870 2023-08-10T11:56:49.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.459+0000 7f0a3463db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5d3637290 con 0x55c5d3621800 2023-08-10T11:56:49.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.459+0000 7f0a3463db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5d361ddb0 con 0x55c5d3626f50 2023-08-10T11:56:49.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.459+0000 7f0a26a41700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5d3627870 0x55c5d3625ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:49.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.459+0000 7f0a26a41700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5d3627870 0x55c5d3625ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34940/0 (socket says 172.21.15.73:34940) 2023-08-10T11:56:49.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.459+0000 7f0a26a41700 1 -- 172.21.15.73:0/1665992851 learned_addr learned my addr 172.21.15.73:0/1665992851 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:49.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.459+0000 7f0a25a3f700 1 --2- 172.21.15.73:0/1665992851 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5d3626f50 0x55c5d361c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:49.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.459+0000 7f0a26240700 1 --2- 172.21.15.73:0/1665992851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5d3621800 0x55c5d361c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:49.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.460+0000 7f0a26a41700 1 -- 172.21.15.73:0/1665992851 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5d3626f50 msgr2=0x55c5d361c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:49.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.460+0000 7f0a26a41700 1 --2- 172.21.15.73:0/1665992851 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5d3626f50 0x55c5d361c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.460+0000 7f0a26a41700 1 -- 172.21.15.73:0/1665992851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5d3621800 msgr2=0x55c5d361c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:49.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.460+0000 7f0a26a41700 1 --2- 172.21.15.73:0/1665992851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5d3621800 0x55c5d361c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.460+0000 7f0a26a41700 1 -- 172.21.15.73:0/1665992851 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5d3388c60 con 0x55c5d3627870 2023-08-10T11:56:49.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.460+0000 7f0a25a3f700 1 --2- 172.21.15.73:0/1665992851 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5d3626f50 0x55c5d361c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:56:49.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.460+0000 7f0a26a41700 1 --2- 172.21.15.73:0/1665992851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5d3627870 0x55c5d3625ba0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009fc0 tx=0x7f0a18007500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e465cfde21f8fb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:49.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.460+0000 7f0a155ab700 1 -- 172.21.15.73:0/1665992851 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a18009b10 con 0x55c5d3627870 2023-08-10T11:56:49.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.460+0000 7f0a155ab700 1 -- 172.21.15.73:0/1665992851 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a1800f040 con 0x55c5d3627870 2023-08-10T11:56:49.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.460+0000 7f0a155ab700 1 -- 172.21.15.73:0/1665992851 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a18005280 con 0x55c5d3627870 2023-08-10T11:56:49.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.461+0000 7f0a3463db80 1 -- 172.21.15.73:0/1665992851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5d3627870 msgr2=0x55c5d3625ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:49.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.461+0000 7f0a3463db80 1 --2- 172.21.15.73:0/1665992851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5d3627870 0x55c5d3625ba0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009fc0 tx=0x7f0a18007500 comp rx=0 tx=0).stop 2023-08-10T11:56:49.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.461+0000 7f0a3463db80 1 -- 172.21.15.73:0/1665992851 shutdown_connections 2023-08-10T11:56:49.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.461+0000 7f0a3463db80 1 --2- 172.21.15.73:0/1665992851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5d3621800 0x55c5d361c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.461+0000 7f0a3463db80 1 --2- 172.21.15.73:0/1665992851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5d3627870 0x55c5d3625ba0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.461+0000 7f0a3463db80 1 --2- 172.21.15.73:0/1665992851 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5d3626f50 0x55c5d361c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.461+0000 7f0a3463db80 1 -- 172.21.15.73:0/1665992851 >> 172.21.15.73:0/1665992851 conn(0x55c5d357ecd0 msgr2=0x55c5d3624c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:49.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.461+0000 7f0a3463db80 1 -- 172.21.15.73:0/1665992851 shutdown_connections 2023-08-10T11:56:49.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.461+0000 7f0a3463db80 1 -- 172.21.15.73:0/1665992851 wait complete. 2023-08-10T11:56:49.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.461+0000 7f0a3463db80 1 -- start start 2023-08-10T11:56:49.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.461+0000 7f0a3463db80 1 Processor -- start 2023-08-10T11:56:49.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.461+0000 7f0a3463db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5d3621800 0x55c5d36322b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:49.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.461+0000 7f0a3463db80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5d3626f50 0x55c5d3630760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:49.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.461+0000 7f0a3463db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5d3627870 0x55c5d3630ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:49.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.461+0000 7f0a3463db80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5d36313b0 con 0x55c5d3626f50 2023-08-10T11:56:49.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.461+0000 7f0a3463db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5d3631520 con 0x55c5d3621800 2023-08-10T11:56:49.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.461+0000 7f0a3463db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5d368eed0 con 0x55c5d3627870 2023-08-10T11:56:49.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.461+0000 7f0a3463db80 10 client.0 _ll_register_callbacks cb 0x55c5d350f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:56:49.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.462+0000 7f0a25a3f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5d3626f50 0x55c5d3630760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:49.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.462+0000 7f0a26240700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5d3621800 0x55c5d36322b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:49.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.462+0000 7f0a25a3f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5d3626f50 0x55c5d3630760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34944/0 (socket says 172.21.15.73:34944) 2023-08-10T11:56:49.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.462+0000 7f0a25a3f700 1 -- 172.21.15.73:0/903757876 learned_addr learned my addr 172.21.15.73:0/903757876 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:49.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.462+0000 7f0a26a41700 1 --2- 172.21.15.73:0/903757876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5d3627870 0x55c5d3630ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:49.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.462+0000 7f0a25a3f700 1 -- 172.21.15.73:0/903757876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5d3627870 msgr2=0x55c5d3630ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:49.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.462+0000 7f0a25a3f700 1 --2- 172.21.15.73:0/903757876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5d3627870 0x55c5d3630ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.462+0000 7f0a25a3f700 1 -- 172.21.15.73:0/903757876 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5d3621800 msgr2=0x55c5d36322b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:49.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.462+0000 7f0a25a3f700 1 --2- 172.21.15.73:0/903757876 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5d3621800 0x55c5d36322b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.462+0000 7f0a25a3f700 1 -- 172.21.15.73:0/903757876 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c5d339fde0 con 0x55c5d3626f50 2023-08-10T11:56:49.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.462+0000 7f0a25a3f700 1 --2- 172.21.15.73:0/903757876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5d3626f50 0x55c5d3630760 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f0a10039da0 tx=0x7f0a10024f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ef5db562285dc5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:49.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.462+0000 7f0a09ffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:56:49.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.462+0000 7f0a09ffb700 1 -- 172.21.15.73:0/903757876 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1000e930 con 0x55c5d3626f50 2023-08-10T11:56:49.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.462+0000 7f0a09ffb700 1 -- 172.21.15.73:0/903757876 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f0a10034020 con 0x55c5d3626f50 2023-08-10T11:56:49.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.462+0000 7f0a3463db80 1 -- 172.21.15.73:0/903757876 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0a10021070 con 0x55c5d3626f50 2023-08-10T11:56:49.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.462+0000 7f0a09ffb700 1 -- 172.21.15.73:0/903757876 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a1001d460 con 0x55c5d3626f50 2023-08-10T11:56:49.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.462+0000 7f0a3463db80 10 client.16350 fetch_fsmap learned FSMap version 38 2023-08-10T11:56:49.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.462+0000 7f0a3463db80 1 -- 172.21.15.73:0/903757876 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x7f0a18009c70 con 0x55c5d3626f50 2023-08-10T11:56:49.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.462+0000 7f0a09ffb700 1 -- 172.21.15.73:0/903757876 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a10047020 con 0x55c5d3626f50 2023-08-10T11:56:49.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.463+0000 7f0a09ffb700 1 -- 172.21.15.73:0/903757876 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 38) v1 ==== 7526+0+0 (secure 0 0 0) 0x7f0a10003c40 con 0x55c5d3626f50 2023-08-10T11:56:49.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.463+0000 7f0a3463db80 10 client.16350 fetch_fsmap finished waiting for FSMap version 38 2023-08-10T11:56:49.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.463+0000 7f0a3463db80 10 client.16350 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:56:49.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.463+0000 7f0a3463db80 20 client.16350 populate_metadata read hostname 'smithi073' 2023-08-10T11:56:49.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.463+0000 7f0a3463db80 1 --2- 172.21.15.73:0/903757876 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c5d3690250 0x55c5d3692670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:49.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.463+0000 7f0a3463db80 4 client.16350 mds_command: new command op to 24503 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:56:49.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.463+0000 7f0a3463db80 1 -- 172.21.15.73:0/903757876 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c5d356b780 con 0x55c5d3690250 2023-08-10T11:56:49.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.463+0000 7f0a26240700 1 --2- 172.21.15.73:0/903757876 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c5d3690250 0x55c5d3692670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:49.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.463+0000 7f0a09ffb700 10 client.16350 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:56:49.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.463+0000 7f0a26240700 1 --2- 172.21.15.73:0/903757876 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c5d3690250 0x55c5d3692670 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d22fea7bc6daa3ef server_cookie=6acb5e52700f3123 in_seq=0 out_seq=0 2023-08-10T11:56:49.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.463+0000 7f0a09ffb700 1 -- 172.21.15.73:0/903757876 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55c5d356b780 con 0x55c5d3690250 2023-08-10T11:56:49.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.463+0000 7f0a09ffb700 10 client.16350 handle_command_reply: tid=0 2023-08-10T11:56:49.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.463+0000 7f0a3463db80 1 client.16350 shutdown 2023-08-10T11:56:49.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.463+0000 7f0a3463db80 1 -- 172.21.15.73:0/903757876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5d3626f50 msgr2=0x55c5d3630760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:49.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.464+0000 7f0a3463db80 1 --2- 172.21.15.73:0/903757876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5d3626f50 0x55c5d3630760 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f0a10039da0 tx=0x7f0a10024f90 comp rx=0 tx=0).stop 2023-08-10T11:56:49.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.464+0000 7f0a3463db80 1 -- 172.21.15.73:0/903757876 shutdown_connections 2023-08-10T11:56:49.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.464+0000 7f0a3463db80 1 --2- 172.21.15.73:0/903757876 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c5d3690250 0x55c5d3692670 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.464+0000 7f0a3463db80 1 --2- 172.21.15.73:0/903757876 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5d3621800 0x55c5d36322b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.464+0000 7f0a09ffb700 0 client.16350 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:56:49.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.464+0000 7f0a3463db80 1 --2- 172.21.15.73:0/903757876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5d3627870 0x55c5d3630ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.464+0000 7f0a3463db80 1 --2- 172.21.15.73:0/903757876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5d3626f50 0x55c5d3630760 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.464+0000 7f0a3463db80 1 -- 172.21.15.73:0/903757876 >> 172.21.15.73:0/903757876 conn(0x55c5d357ecd0 msgr2=0x55c5d3625ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:49.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.464+0000 7f0a3463db80 1 -- 172.21.15.73:0/903757876 shutdown_connections 2023-08-10T11:56:49.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.464+0000 7f0a3463db80 1 -- 172.21.15.73:0/903757876 wait complete. 2023-08-10T11:56:49.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.464+0000 7f0a3463db80 20 client.16350 trim_cache size 0 max 16384 2023-08-10T11:56:49.479 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:56:49.480 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:56:49.480 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": { 2023-08-10T11:56:49.480 INFO:teuthology.orchestra.run.smithi073.stdout: "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d": { 2023-08-10T11:56:49.480 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2023-08-10T11:56:49.480 INFO:teuthology.orchestra.run.smithi073.stdout: "tag": "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d", 2023-08-10T11:56:49.480 INFO:teuthology.orchestra.run.smithi073.stdout: "options": "recursive,force" 2023-08-10T11:56:49.480 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:56:49.481 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:56:49.481 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:56:49.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.464+0000 7f0a284a4700 1 -- 172.21.15.73:0/2889359605 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0a0c0a12b0 msgr2=0x7f0a0c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:49.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.464+0000 7f0a284a4700 1 --2- 172.21.15.73:0/2889359605 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0a0c0a12b0 0x7f0a0c0a3770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0a20195ce0 tx=0x7f0a10009260 comp rx=0 tx=0).stop 2023-08-10T11:56:49.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.464+0000 7f0a284a4700 1 -- 172.21.15.73:0/2889359605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a201002c0 msgr2=0x7f0a20194440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:49.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.464+0000 7f0a284a4700 1 --2- 172.21.15.73:0/2889359605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a201002c0 0x7f0a20194440 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c000c00 tx=0x7f0a1c0047b0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.464+0000 7f0a284a4700 1 -- 172.21.15.73:0/2889359605 shutdown_connections 2023-08-10T11:56:49.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.464+0000 7f0a284a4700 1 --2- 172.21.15.73:0/2889359605 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0a0c0a12b0 0x7f0a0c0a3770 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.464+0000 7f0a284a4700 1 --2- 172.21.15.73:0/2889359605 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a20194ec0 0x7f0a201a8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.464+0000 7f0a284a4700 1 --2- 172.21.15.73:0/2889359605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a201002c0 0x7f0a20194440 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.464+0000 7f0a284a4700 1 --2- 172.21.15.73:0/2889359605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a20104960 0x7f0a20194980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:49.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.464+0000 7f0a284a4700 1 -- 172.21.15.73:0/2889359605 >> 172.21.15.73:0/2889359605 conn(0x7f0a200758b0 msgr2=0x7f0a200fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:49.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.464+0000 7f0a284a4700 1 -- 172.21.15.73:0/2889359605 shutdown_connections 2023-08-10T11:56:49.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:56:49.464+0000 7f0a284a4700 1 -- 172.21.15.73:0/2889359605 wait complete. 2023-08-10T11:56:49.484 INFO:tasks.cephfs.filesystem:scrub status for tag:9d39b3fa-9b62-42b4-b1a5-738cb3118a5d - {'path': '/', 'tag': '9d39b3fa-9b62-42b4-b1a5-738cb3118a5d', 'options': 'recursive,force'} 2023-08-10T11:56:50.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:49 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:56:50.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:49 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:56:50.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:49 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:56:50.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:49 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:56:50.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:49 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:56:50.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:49 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:56:50.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:49 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:56:50.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:49 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:56:50.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:49 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:56:51.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:51 smithi152 ceph-mon[130220]: pgmap v129: 97 pgs: 97 active+clean; 966 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 13 MiB/s wr, 881 op/s 2023-08-10T11:56:51.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:51 smithi156 ceph-mon[130574]: pgmap v129: 97 pgs: 97 active+clean; 966 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 13 MiB/s wr, 881 op/s 2023-08-10T11:56:51.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:51 smithi073 ceph-mon[128869]: pgmap v129: 97 pgs: 97 active+clean; 966 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 13 MiB/s wr, 881 op/s 2023-08-10T11:56:53.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:53 smithi073 ceph-mon[128869]: pgmap v130: 97 pgs: 97 active+clean; 966 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.5 MiB/s wr, 553 op/s 2023-08-10T11:56:53.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:53 smithi152 ceph-mon[130220]: pgmap v130: 97 pgs: 97 active+clean; 966 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.5 MiB/s wr, 553 op/s 2023-08-10T11:56:53.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:53 smithi156 ceph-mon[130574]: pgmap v130: 97 pgs: 97 active+clean; 966 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.5 MiB/s wr, 553 op/s 2023-08-10T11:56:54.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:54 smithi152 ceph-mon[130220]: pgmap v131: 97 pgs: 97 active+clean; 974 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.3 MiB/s wr, 544 op/s 2023-08-10T11:56:55.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:54 smithi156 ceph-mon[130574]: pgmap v131: 97 pgs: 97 active+clean; 974 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.3 MiB/s wr, 544 op/s 2023-08-10T11:56:55.024 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:54 smithi073 ceph-mon[128869]: pgmap v131: 97 pgs: 97 active+clean; 974 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.3 MiB/s wr, 544 op/s 2023-08-10T11:56:57.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:56 smithi152 ceph-mon[130220]: pgmap v132: 97 pgs: 97 active+clean; 976 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.4 MiB/s wr, 411 op/s 2023-08-10T11:56:57.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:56 smithi156 ceph-mon[130574]: pgmap v132: 97 pgs: 97 active+clean; 976 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.4 MiB/s wr, 411 op/s 2023-08-10T11:56:57.277 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:56 smithi073 ceph-mon[128869]: pgmap v132: 97 pgs: 97 active+clean; 976 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.4 MiB/s wr, 411 op/s 2023-08-10T11:56:58.119 INFO:tasks.workunit.client.0.smithi073.stdout: 245 2449499 729 1626759 657 800749 673 2023-08-10T11:56:58.741 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.741+0000 7f68acd23700 1 -- 172.21.15.73:0/263829324 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68a8119f50 msgr2=0x7f68a811c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:58.742 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.741+0000 7f68acd23700 1 --2- 172.21.15.73:0/263829324 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68a8119f50 0x7f68a811c340 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f68a0009f90 tx=0x7f68a000b330 comp rx=0 tx=0).stop 2023-08-10T11:56:58.742 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.741+0000 7f68acd23700 1 -- 172.21.15.73:0/263829324 shutdown_connections 2023-08-10T11:56:58.742 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.741+0000 7f68acd23700 1 --2- 172.21.15.73:0/263829324 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68a8119f50 0x7f68a811c340 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.741+0000 7f68acd23700 1 --2- 172.21.15.73:0/263829324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68a810eec0 0x7f68a8107770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.741+0000 7f68acd23700 1 --2- 172.21.15.73:0/263829324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68a810f330 0x7f68a8107cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.741+0000 7f68acd23700 1 -- 172.21.15.73:0/263829324 >> 172.21.15.73:0/263829324 conn(0x7f68a806c830 msgr2=0x7f68a806cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.741+0000 7f68acd23700 1 -- 172.21.15.73:0/263829324 shutdown_connections 2023-08-10T11:56:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.742+0000 7f68acd23700 1 -- 172.21.15.73:0/263829324 wait complete. 2023-08-10T11:56:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.743+0000 7f68acd23700 1 Processor -- start 2023-08-10T11:56:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.743+0000 7f68acd23700 1 -- start start 2023-08-10T11:56:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.743+0000 7f68acd23700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68a810eec0 0x7f68a81ab500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.743+0000 7f68acd23700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68a810f330 0x7f68a81aba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.743+0000 7f68acd23700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68a8119f50 0x7f68a81a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.743+0000 7f68acd23700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a81a59d0 con 0x7f68a810eec0 2023-08-10T11:56:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.743+0000 7f68acd23700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a81a5b40 con 0x7f68a810f330 2023-08-10T11:56:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.743+0000 7f68acd23700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a81a5d00 con 0x7f68a8119f50 2023-08-10T11:56:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.744+0000 7f68a5d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68a810f330 0x7f68a81aba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.744+0000 7f68a5d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68a810f330 0x7f68a81aba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49606/0 (socket says 172.21.15.73:49606) 2023-08-10T11:56:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.744+0000 7f68a5d9b700 1 -- 172.21.15.73:0/3312812700 learned_addr learned my addr 172.21.15.73:0/3312812700 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.744+0000 7f68a6d9d700 1 --2- 172.21.15.73:0/3312812700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68a8119f50 0x7f68a81a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.745+0000 7f68a659c700 1 --2- 172.21.15.73:0/3312812700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68a810eec0 0x7f68a81ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.746+0000 7f68a659c700 1 -- 172.21.15.73:0/3312812700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68a8119f50 msgr2=0x7f68a81a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.746+0000 7f68a659c700 1 --2- 172.21.15.73:0/3312812700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68a8119f50 0x7f68a81a5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.746+0000 7f68a659c700 1 -- 172.21.15.73:0/3312812700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68a810f330 msgr2=0x7f68a81aba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.746+0000 7f68a659c700 1 --2- 172.21.15.73:0/3312812700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68a810f330 0x7f68a81aba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.746+0000 7f68a659c700 1 -- 172.21.15.73:0/3312812700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a0009c40 con 0x7f68a810eec0 2023-08-10T11:56:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.747+0000 7f68a659c700 1 --2- 172.21.15.73:0/3312812700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68a810eec0 0x7f68a81ab500 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f689800d950 tx=0x7f689800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.747+0000 7f68977fe700 1 -- 172.21.15.73:0/3312812700 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6898009930 con 0x7f68a810eec0 2023-08-10T11:56:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.747+0000 7f68977fe700 1 -- 172.21.15.73:0/3312812700 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f689800be70 con 0x7f68a810eec0 2023-08-10T11:56:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.747+0000 7f68977fe700 1 -- 172.21.15.73:0/3312812700 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689800f3c0 con 0x7f68a810eec0 2023-08-10T11:56:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.748+0000 7f68acd23700 1 -- 172.21.15.73:0/3312812700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a81a5fe0 con 0x7f68a810eec0 2023-08-10T11:56:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.748+0000 7f68acd23700 1 -- 172.21.15.73:0/3312812700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a810f910 con 0x7f68a810eec0 2023-08-10T11:56:58.754 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.753+0000 7f68977fe700 1 -- 172.21.15.73:0/3312812700 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f6898010460 con 0x7f68a810eec0 2023-08-10T11:56:58.754 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.753+0000 7f68b8ebcb80 1 Processor -- start 2023-08-10T11:56:58.755 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.754+0000 7f68977fe700 1 --2- 172.21.15.73:0/3312812700 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f68900a14d0 0x7f68900a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:58.755 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.754+0000 7f68977fe700 1 -- 172.21.15.73:0/3312812700 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f68980cc210 con 0x7f68a810eec0 2023-08-10T11:56:58.756 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.755+0000 7f68b8ebcb80 1 -- start start 2023-08-10T11:56:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.755+0000 7f68b8ebcb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56399845ea40 0x56399845ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.755+0000 7f68b8ebcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56399845f360 0x563998459010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.755+0000 7f68b8ebcb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563998459550 0x5639984599d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.755+0000 7f68b8ebcb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639983d4d60 con 0x56399845ea40 2023-08-10T11:56:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.755+0000 7f68b8ebcb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639983b1530 con 0x563998459550 2023-08-10T11:56:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.755+0000 7f68b8ebcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639983aee50 con 0x56399845f360 2023-08-10T11:56:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.756+0000 7f68a6d9d700 1 --2- 172.21.15.73:0/3312812700 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f68900a14d0 0x7f68900a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.756+0000 7f68a5d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56399845f360 0x563998459010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.756+0000 7f68a5d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56399845f360 0x563998459010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60472/0 (socket says 172.21.15.73:60472) 2023-08-10T11:56:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.756+0000 7f68a5d9b700 1 -- 172.21.15.73:0/4228555805 learned_addr learned my addr 172.21.15.73:0/4228555805 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.758+0000 7f68a5d9b700 1 -- 172.21.15.73:0/4228555805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563998459550 msgr2=0x5639984599d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T11:56:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.758+0000 7f68a5d9b700 1 --2- 172.21.15.73:0/4228555805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563998459550 0x5639984599d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.758+0000 7f68a5d9b700 1 -- 172.21.15.73:0/4228555805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56399845ea40 msgr2=0x56399845ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.758+0000 7f68a5d9b700 1 --2- 172.21.15.73:0/4228555805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56399845ea40 0x56399845ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.758+0000 7f68a5d9b700 1 -- 172.21.15.73:0/4228555805 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56399822b5d0 con 0x56399845f360 2023-08-10T11:56:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.758+0000 7f68a5d9b700 1 --2- 172.21.15.73:0/4228555805 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56399845f360 0x563998459010 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f689c009dd0 tx=0x7f689c011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0cc00985f48a610 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.763+0000 7f6894ff9700 1 -- 172.21.15.73:0/4228555805 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c019630 con 0x56399845f360 2023-08-10T11:56:58.764 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.763+0000 7f6894ff9700 1 -- 172.21.15.73:0/4228555805 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f689c019c50 con 0x56399845f360 2023-08-10T11:56:58.764 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.763+0000 7f6894ff9700 1 -- 172.21.15.73:0/4228555805 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c00ec10 con 0x56399845f360 2023-08-10T11:56:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.766+0000 7f68b8ebcb80 1 -- 172.21.15.73:0/4228555805 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56399845f360 msgr2=0x563998459010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.766+0000 7f68b8ebcb80 1 --2- 172.21.15.73:0/4228555805 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56399845f360 0x563998459010 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f689c009dd0 tx=0x7f689c011720 comp rx=0 tx=0).stop 2023-08-10T11:56:58.772 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.770+0000 7f68a6d9d700 1 --2- 172.21.15.73:0/3312812700 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f68900a14d0 0x7f68900a3990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f68a0009c10 tx=0x7f68a0009b20 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:58.772 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.770+0000 7f68b8ebcb80 1 -- 172.21.15.73:0/4228555805 shutdown_connections 2023-08-10T11:56:58.772 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.770+0000 7f68b8ebcb80 1 --2- 172.21.15.73:0/4228555805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563998459550 0x5639984599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:58.773 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.770+0000 7f68b8ebcb80 1 --2- 172.21.15.73:0/4228555805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56399845ea40 0x56399845ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:58.773 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.770+0000 7f68b8ebcb80 1 --2- 172.21.15.73:0/4228555805 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56399845f360 0x563998459010 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:58.773 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.770+0000 7f68b8ebcb80 1 -- 172.21.15.73:0/4228555805 >> 172.21.15.73:0/4228555805 conn(0x5639983b6c70 msgr2=0x563998453d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:58.773 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.772+0000 7f68b8ebcb80 1 -- 172.21.15.73:0/4228555805 shutdown_connections 2023-08-10T11:56:58.779 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.777+0000 7f68b8ebcb80 1 -- 172.21.15.73:0/4228555805 wait complete. 2023-08-10T11:56:58.779 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.778+0000 7f68b8ebcb80 1 -- start start 2023-08-10T11:56:58.779 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.778+0000 7f68b8ebcb80 1 Processor -- start 2023-08-10T11:56:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.779+0000 7f68b8ebcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563998459550 0x563998462780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.779+0000 7f68b8ebcb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56399845ea40 0x563998462cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.779+0000 7f68b8ebcb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56399845f360 0x563998463200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.779+0000 7f68b8ebcb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639983aa740 con 0x56399845f360 2023-08-10T11:56:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.779+0000 7f68b8ebcb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563998349a60 con 0x56399845ea40 2023-08-10T11:56:58.781 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.779+0000 7f68b8ebcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563998349760 con 0x563998459550 2023-08-10T11:56:58.781 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.779+0000 7f68b8ebcb80 10 client.0 _ll_register_callbacks cb 0x563998347620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:56:58.781 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.779+0000 7f68a659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563998459550 0x563998462780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:58.781 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.779+0000 7f68a659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563998459550 0x563998462780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60474/0 (socket says 172.21.15.73:60474) 2023-08-10T11:56:58.781 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.779+0000 7f68a659c700 1 -- 172.21.15.73:0/263331463 learned_addr learned my addr 172.21.15.73:0/263331463 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:58.781 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.779+0000 7f68a5d9b700 1 --2- 172.21.15.73:0/263331463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56399845ea40 0x563998462cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.780+0000 7f68a5d9b700 1 -- 172.21.15.73:0/263331463 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563998459550 msgr2=0x563998462780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.780+0000 7f68a5d9b700 1 --2- 172.21.15.73:0/263331463 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563998459550 0x563998462780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.780+0000 7f68a5d9b700 1 -- 172.21.15.73:0/263331463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56399845f360 msgr2=0x563998463200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.780+0000 7f68a5d9b700 1 --2- 172.21.15.73:0/263331463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56399845f360 0x563998463200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.780+0000 7f68a5d9b700 1 -- 172.21.15.73:0/263331463 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f689c009a30 con 0x56399845ea40 2023-08-10T11:56:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.781+0000 7f68a5d9b700 1 --2- 172.21.15.73:0/263331463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56399845ea40 0x563998462cc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f689c00e790 tx=0x7f689c00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ec28e64531cf488 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.782+0000 7f688dffb700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T11:56:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.782+0000 7f688dffb700 1 -- 172.21.15.73:0/263331463 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c004230 con 0x56399845ea40 2023-08-10T11:56:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.782+0000 7f688dffb700 1 -- 172.21.15.73:0/263331463 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f689c019dc0 con 0x56399845ea40 2023-08-10T11:56:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.782+0000 7f68b8ebcb80 1 -- 172.21.15.73:0/263331463 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56399844c1c0 con 0x56399845ea40 2023-08-10T11:56:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.783+0000 7f688dffb700 1 -- 172.21.15.73:0/263331463 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f689c004390 con 0x56399845ea40 2023-08-10T11:56:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.783+0000 7f68b8ebcb80 10 client.25775 fetch_fsmap learned FSMap version 38 2023-08-10T11:56:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.783+0000 7f68b8ebcb80 1 -- 172.21.15.73:0/263331463 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x5639981d7d80 con 0x56399845ea40 2023-08-10T11:56:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.783+0000 7f688dffb700 1 -- 172.21.15.73:0/263331463 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56399844c1c0 con 0x56399845ea40 2023-08-10T11:56:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.785+0000 7f688dffb700 1 -- 172.21.15.73:0/263331463 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 38) v1 ==== 7526+0+0 (secure 0 0 0) 0x7f689c0052b0 con 0x56399845ea40 2023-08-10T11:56:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.785+0000 7f68b8ebcb80 10 client.25775 fetch_fsmap finished waiting for FSMap version 38 2023-08-10T11:56:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.785+0000 7f68b8ebcb80 10 client.25775 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:56:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.785+0000 7f68b8ebcb80 20 client.25775 populate_metadata read hostname 'smithi073' 2023-08-10T11:56:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.785+0000 7f68b8ebcb80 1 --2- 172.21.15.73:0/263331463 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563998472d50 0x563998475170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.785+0000 7f68b8ebcb80 4 client.25775 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:56:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.785+0000 7f68b8ebcb80 1 -- 172.21.15.73:0/263331463 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563998428970 con 0x563998472d50 2023-08-10T11:56:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.785+0000 7f68a659c700 1 --2- 172.21.15.73:0/263331463 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563998472d50 0x563998475170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.786+0000 7f68a659c700 1 --2- 172.21.15.73:0/263331463 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563998472d50 0x563998475170 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec329f2cae198cc7 server_cookie=4938d7c240d7f5c8 in_seq=0 out_seq=0 2023-08-10T11:56:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.786+0000 7f688dffb700 10 client.25775 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:56:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.787+0000 7f688dffb700 1 -- 172.21.15.73:0/263331463 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x563998428970 con 0x563998472d50 2023-08-10T11:56:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.787+0000 7f688dffb700 10 client.25775 handle_command_reply: tid=0 2023-08-10T11:56:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.787+0000 7f68b8ebcb80 1 client.25775 shutdown 2023-08-10T11:56:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.788+0000 7f68b8ebcb80 1 -- 172.21.15.73:0/263331463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56399845ea40 msgr2=0x563998462cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.788+0000 7f68b8ebcb80 1 --2- 172.21.15.73:0/263331463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56399845ea40 0x563998462cc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f689c00e790 tx=0x7f689c00ee50 comp rx=0 tx=0).stop 2023-08-10T11:56:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.788+0000 7f68b8ebcb80 1 -- 172.21.15.73:0/263331463 shutdown_connections 2023-08-10T11:56:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.788+0000 7f68b8ebcb80 1 --2- 172.21.15.73:0/263331463 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563998472d50 0x563998475170 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.788+0000 7f68b8ebcb80 1 --2- 172.21.15.73:0/263331463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56399845f360 0x563998463200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.788+0000 7f68b8ebcb80 1 --2- 172.21.15.73:0/263331463 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563998459550 0x563998462780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.788+0000 7f68b8ebcb80 1 --2- 172.21.15.73:0/263331463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56399845ea40 0x563998462cc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.788+0000 7f68b8ebcb80 1 -- 172.21.15.73:0/263331463 >> 172.21.15.73:0/263331463 conn(0x5639983b6c70 msgr2=0x5639984534b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.788+0000 7f688dffb700 0 client.25775 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:56:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.788+0000 7f68b8ebcb80 1 -- 172.21.15.73:0/263331463 shutdown_connections 2023-08-10T11:56:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.788+0000 7f68b8ebcb80 1 -- 172.21.15.73:0/263331463 wait complete. 2023-08-10T11:56:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.788+0000 7f68b8ebcb80 20 client.25775 trim_cache size 0 max 16384 2023-08-10T11:56:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.819+0000 7f68b8ebcb80 1 Processor -- start 2023-08-10T11:56:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.819+0000 7f68b8ebcb80 1 -- start start 2023-08-10T11:56:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.819+0000 7f68b8ebcb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639983b6c70 0x563998459010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.819+0000 7f68b8ebcb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563998459550 0x563998469e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.819+0000 7f68b8ebcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56399845ea40 0x563998453c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.819+0000 7f68b8ebcb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56399822d8c0 con 0x5639983b6c70 2023-08-10T11:56:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.819+0000 7f68b8ebcb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563998479fa0 con 0x563998459550 2023-08-10T11:56:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.819+0000 7f68b8ebcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56399844e7b0 con 0x56399845ea40 2023-08-10T11:56:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.820+0000 7f68a6d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56399845ea40 0x563998453c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.820+0000 7f68a6d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56399845ea40 0x563998453c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60486/0 (socket says 172.21.15.73:60486) 2023-08-10T11:56:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.820+0000 7f68a6d9d700 1 -- 172.21.15.73:0/2448648406 learned_addr learned my addr 172.21.15.73:0/2448648406 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.820+0000 7f68a659c700 1 --2- 172.21.15.73:0/2448648406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639983b6c70 0x563998459010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.820+0000 7f68a5d9b700 1 --2- 172.21.15.73:0/2448648406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563998459550 0x563998469e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.822+0000 7f68a6d9d700 1 -- 172.21.15.73:0/2448648406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563998459550 msgr2=0x563998469e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.822+0000 7f68a6d9d700 1 --2- 172.21.15.73:0/2448648406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563998459550 0x563998469e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.822+0000 7f68a6d9d700 1 -- 172.21.15.73:0/2448648406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639983b6c70 msgr2=0x563998459010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.822+0000 7f68a6d9d700 1 --2- 172.21.15.73:0/2448648406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639983b6c70 0x563998459010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.822+0000 7f68a6d9d700 1 -- 172.21.15.73:0/2448648406 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639981c0c00 con 0x56399845ea40 2023-08-10T11:56:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.823+0000 7f68a6d9d700 1 --2- 172.21.15.73:0/2448648406 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56399845ea40 0x563998453c30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f68a0015000 tx=0x7f68a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27006402f94b1d2c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:58.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.827+0000 7f68957fa700 1 -- 172.21.15.73:0/2448648406 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a000e040 con 0x56399845ea40 2023-08-10T11:56:58.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.827+0000 7f68957fa700 1 -- 172.21.15.73:0/2448648406 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68a0004e60 con 0x56399845ea40 2023-08-10T11:56:58.828 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.827+0000 7f68957fa700 1 -- 172.21.15.73:0/2448648406 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a001cdb0 con 0x56399845ea40 2023-08-10T11:56:58.828 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.828+0000 7f68b8ebcb80 1 -- 172.21.15.73:0/2448648406 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56399845ea40 msgr2=0x563998453c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:58.828 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.828+0000 7f68b8ebcb80 1 --2- 172.21.15.73:0/2448648406 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56399845ea40 0x563998453c30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f68a0015000 tx=0x7f68a000b330 comp rx=0 tx=0).stop 2023-08-10T11:56:58.829 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.828+0000 7f68b8ebcb80 1 -- 172.21.15.73:0/2448648406 shutdown_connections 2023-08-10T11:56:58.829 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.828+0000 7f68b8ebcb80 1 --2- 172.21.15.73:0/2448648406 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56399845ea40 0x563998453c30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:58.829 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.828+0000 7f68b8ebcb80 1 --2- 172.21.15.73:0/2448648406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5639983b6c70 0x563998459010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:58.829 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.828+0000 7f68b8ebcb80 1 --2- 172.21.15.73:0/2448648406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563998459550 0x563998469e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:58.830 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.828+0000 7f68b8ebcb80 1 -- 172.21.15.73:0/2448648406 >> 172.21.15.73:0/2448648406 conn(0x56399846f640 msgr2=0x56399845d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:58.830 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.828+0000 7f68b8ebcb80 1 -- 172.21.15.73:0/2448648406 shutdown_connections 2023-08-10T11:56:58.830 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.828+0000 7f68b8ebcb80 1 -- 172.21.15.73:0/2448648406 wait complete. 2023-08-10T11:56:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.829+0000 7f68b8ebcb80 1 -- start start 2023-08-10T11:56:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.829+0000 7f68b8ebcb80 1 Processor -- start 2023-08-10T11:56:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.829+0000 7f68b8ebcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639983b6c70 0x5639984beec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.829+0000 7f68b8ebcb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563998459550 0x5639984bf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.829+0000 7f68b8ebcb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56399845ea40 0x5639984ba990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.829+0000 7f68b8ebcb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639984bb0a0 con 0x563998459550 2023-08-10T11:56:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.829+0000 7f68b8ebcb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639984bb210 con 0x56399845ea40 2023-08-10T11:56:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.829+0000 7f68b8ebcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639984bb3d0 con 0x5639983b6c70 2023-08-10T11:56:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.829+0000 7f68b8ebcb80 10 client.0 _ll_register_callbacks cb 0x563998347620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:56:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.830+0000 7f68a659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639983b6c70 0x5639984beec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.830+0000 7f68a659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639983b6c70 0x5639984beec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60488/0 (socket says 172.21.15.73:60488) 2023-08-10T11:56:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.830+0000 7f68a659c700 1 -- 172.21.15.73:0/3420506068 learned_addr learned my addr 172.21.15.73:0/3420506068 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:56:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.830+0000 7f68a5d9b700 1 --2- 172.21.15.73:0/3420506068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563998459550 0x5639984bf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.830+0000 7f68a6d9d700 1 --2- 172.21.15.73:0/3420506068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56399845ea40 0x5639984ba990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.830+0000 7f68a5d9b700 1 -- 172.21.15.73:0/3420506068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639983b6c70 msgr2=0x5639984beec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.830+0000 7f68a5d9b700 1 --2- 172.21.15.73:0/3420506068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639983b6c70 0x5639984beec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.830+0000 7f68a5d9b700 1 -- 172.21.15.73:0/3420506068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56399845ea40 msgr2=0x5639984ba990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:56:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.830+0000 7f68a5d9b700 1 --2- 172.21.15.73:0/3420506068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56399845ea40 0x5639984ba990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.830+0000 7f68a5d9b700 1 -- 172.21.15.73:0/3420506068 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a811cc70 con 0x563998459550 2023-08-10T11:56:58.834 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.830+0000 7f68a6d9d700 1 --2- 172.21.15.73:0/3420506068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56399845ea40 0x5639984ba990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:56:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.831+0000 7f68a5d9b700 1 --2- 172.21.15.73:0/3420506068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563998459550 0x5639984bf400 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f689c011b20 tx=0x7f689c005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c24ef05a934bb2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:56:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.831+0000 7f688dffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:56:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.831+0000 7f688dffb700 1 -- 172.21.15.73:0/3420506068 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c019840 con 0x563998459550 2023-08-10T11:56:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.831+0000 7f688dffb700 1 -- 172.21.15.73:0/3420506068 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f689c0199a0 con 0x563998459550 2023-08-10T11:56:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.831+0000 7f68b8ebcb80 1 -- 172.21.15.73:0/3420506068 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f689c019c50 con 0x563998459550 2023-08-10T11:56:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.831+0000 7f688dffb700 1 -- 172.21.15.73:0/3420506068 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f689c003680 con 0x563998459550 2023-08-10T11:56:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.831+0000 7f68b8ebcb80 10 client.16362 fetch_fsmap learned FSMap version 38 2023-08-10T11:56:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.831+0000 7f68b8ebcb80 1 -- 172.21.15.73:0/3420506068 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x5639981fe1f0 con 0x563998459550 2023-08-10T11:56:58.836 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.832+0000 7f688dffb700 1 -- 172.21.15.73:0/3420506068 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f689c019c50 con 0x563998459550 2023-08-10T11:56:58.836 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.832+0000 7f688dffb700 1 -- 172.21.15.73:0/3420506068 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 38) v1 ==== 7526+0+0 (secure 0 0 0) 0x7f689c03f070 con 0x563998459550 2023-08-10T11:56:58.836 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.832+0000 7f68b8ebcb80 10 client.16362 fetch_fsmap finished waiting for FSMap version 38 2023-08-10T11:56:58.836 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.832+0000 7f68b8ebcb80 10 client.16362 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:56:58.836 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.832+0000 7f68b8ebcb80 20 client.16362 populate_metadata read hostname 'smithi073' 2023-08-10T11:56:58.836 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.832+0000 7f68b8ebcb80 1 --2- 172.21.15.73:0/3420506068 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56399845f360 0x5639984c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:56:58.836 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.832+0000 7f68b8ebcb80 4 client.16362 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:56:58.837 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.832+0000 7f68b8ebcb80 1 -- 172.21.15.73:0/3420506068 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5639983a3720 con 0x56399845f360 2023-08-10T11:56:58.837 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.833+0000 7f68a659c700 1 --2- 172.21.15.73:0/3420506068 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56399845f360 0x5639984c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:56:58.837 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.833+0000 7f68a659c700 1 --2- 172.21.15.73:0/3420506068 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56399845f360 0x5639984c9b80 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e77548e26c36b887 server_cookie=14a150e4030664b8 in_seq=0 out_seq=0 2023-08-10T11:56:58.837 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:58.833+0000 7f688dffb700 10 client.16362 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:56:59.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:56:58 smithi152 ceph-mon[130220]: pgmap v133: 97 pgs: 97 active+clean; 976 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 293 op/s 2023-08-10T11:56:59.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:56:58 smithi156 ceph-mon[130574]: pgmap v133: 97 pgs: 97 active+clean; 976 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 293 op/s 2023-08-10T11:56:59.316 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:56:58 smithi073 ceph-mon[128869]: pgmap v133: 97 pgs: 97 active+clean; 976 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 293 op/s 2023-08-10T11:56:59.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:59.822+0000 7f688dffb700 1 -- 172.21.15.73:0/3420506068 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5639983a3720 con 0x56399845f360 2023-08-10T11:56:59.823 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:59.822+0000 7f688dffb700 10 client.16362 handle_command_reply: tid=0 2023-08-10T11:56:59.858 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:59.828+0000 7f68b8ebcb80 1 client.16362 shutdown 2023-08-10T11:56:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:56:59.868 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:56:59.868 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:56:59.868 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:56:59.869 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:59.863+0000 7f68b8ebcb80 1 -- 172.21.15.73:0/3420506068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563998459550 msgr2=0x5639984bf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:59.869 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:59.863+0000 7f68b8ebcb80 1 --2- 172.21.15.73:0/3420506068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563998459550 0x5639984bf400 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f689c011b20 tx=0x7f689c005550 comp rx=0 tx=0).stop 2023-08-10T11:56:59.869 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:59.863+0000 7f68b8ebcb80 1 -- 172.21.15.73:0/3420506068 shutdown_connections 2023-08-10T11:56:59.869 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:59.863+0000 7f68b8ebcb80 1 --2- 172.21.15.73:0/3420506068 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56399845f360 0x5639984c9b80 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:59.870 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:59.863+0000 7f68b8ebcb80 1 --2- 172.21.15.73:0/3420506068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56399845ea40 0x5639984ba990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:59.870 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:59.863+0000 7f68b8ebcb80 1 --2- 172.21.15.73:0/3420506068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639983b6c70 0x5639984beec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:59.870 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:59.863+0000 7f68b8ebcb80 1 --2- 172.21.15.73:0/3420506068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563998459550 0x5639984bf400 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:59.871 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:59.863+0000 7f68b8ebcb80 1 -- 172.21.15.73:0/3420506068 >> 172.21.15.73:0/3420506068 conn(0x56399846f640 msgr2=0x563998464020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:59.871 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:59.863+0000 7f688dffb700 0 client.16362 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:56:59.871 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:59.864+0000 7f68b8ebcb80 1 -- 172.21.15.73:0/3420506068 shutdown_connections 2023-08-10T11:56:59.871 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:59.864+0000 7f68b8ebcb80 1 -- 172.21.15.73:0/3420506068 wait complete. 2023-08-10T11:56:59.872 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:59.864+0000 7f68b8ebcb80 20 client.16362 trim_cache size 0 max 16384 2023-08-10T11:56:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:59.938+0000 7f68acd23700 1 -- 172.21.15.73:0/3312812700 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f68900a14d0 msgr2=0x7f68900a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:59.938+0000 7f68acd23700 1 --2- 172.21.15.73:0/3312812700 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f68900a14d0 0x7f68900a3990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f68a0009c10 tx=0x7f68a0009b20 comp rx=0 tx=0).stop 2023-08-10T11:56:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:59.938+0000 7f68acd23700 1 -- 172.21.15.73:0/3312812700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68a810eec0 msgr2=0x7f68a81ab500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:56:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:59.938+0000 7f68acd23700 1 --2- 172.21.15.73:0/3312812700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68a810eec0 0x7f68a81ab500 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f689800d950 tx=0x7f689800dc60 comp rx=0 tx=0).stop 2023-08-10T11:56:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:59.945+0000 7f68acd23700 1 -- 172.21.15.73:0/3312812700 shutdown_connections 2023-08-10T11:56:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:59.945+0000 7f68acd23700 1 --2- 172.21.15.73:0/3312812700 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f68900a14d0 0x7f68900a3990 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:59.945+0000 7f68acd23700 1 --2- 172.21.15.73:0/3312812700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68a8119f50 0x7f68a81a5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:59.945+0000 7f68acd23700 1 --2- 172.21.15.73:0/3312812700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68a810eec0 0x7f68a81ab500 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:59.945+0000 7f68acd23700 1 --2- 172.21.15.73:0/3312812700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68a810f330 0x7f68a81aba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:56:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:59.945+0000 7f68acd23700 1 -- 172.21.15.73:0/3312812700 >> 172.21.15.73:0/3312812700 conn(0x7f68a806c830 msgr2=0x7f68a8117f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:56:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:59.946+0000 7f68acd23700 1 -- 172.21.15.73:0/3312812700 shutdown_connections 2023-08-10T11:56:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:56:59.946+0000 7f68acd23700 1 -- 172.21.15.73:0/3312812700 wait complete. 2023-08-10T11:57:01.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:00 smithi152 ceph-mon[130220]: pgmap v134: 97 pgs: 97 active+clean; 983 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.7 MiB/s wr, 397 op/s 2023-08-10T11:57:01.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:00 smithi156 ceph-mon[130574]: pgmap v134: 97 pgs: 97 active+clean; 983 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.7 MiB/s wr, 397 op/s 2023-08-10T11:57:01.282 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:00 smithi073 ceph-mon[128869]: pgmap v134: 97 pgs: 97 active+clean; 983 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.7 MiB/s wr, 397 op/s 2023-08-10T11:57:03.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:02 smithi152 ceph-mon[130220]: pgmap v135: 97 pgs: 97 active+clean; 983 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 207 op/s 2023-08-10T11:57:03.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:02 smithi156 ceph-mon[130574]: pgmap v135: 97 pgs: 97 active+clean; 983 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 207 op/s 2023-08-10T11:57:03.271 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:02 smithi073 ceph-mon[128869]: pgmap v135: 97 pgs: 97 active+clean; 983 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 207 op/s 2023-08-10T11:57:04.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:04 smithi152 ceph-mon[130220]: pgmap v136: 97 pgs: 97 active+clean; 984 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 369 op/s 2023-08-10T11:57:05.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:04 smithi156 ceph-mon[130574]: pgmap v136: 97 pgs: 97 active+clean; 984 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 369 op/s 2023-08-10T11:57:05.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:04 smithi073 ceph-mon[128869]: pgmap v136: 97 pgs: 97 active+clean; 984 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 369 op/s 2023-08-10T11:57:07.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:06 smithi152 ceph-mon[130220]: pgmap v137: 97 pgs: 97 active+clean; 985 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 383 op/s 2023-08-10T11:57:07.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:06 smithi156 ceph-mon[130574]: pgmap v137: 97 pgs: 97 active+clean; 985 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 383 op/s 2023-08-10T11:57:07.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:06 smithi073 ceph-mon[128869]: pgmap v137: 97 pgs: 97 active+clean; 985 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 383 op/s 2023-08-10T11:57:08.119 INFO:tasks.workunit.client.0.smithi073.stdout: 261 2116580 1120 1400233 840 656700 584 2023-08-10T11:57:09.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:08 smithi152 ceph-mon[130220]: pgmap v138: 97 pgs: 97 active+clean; 985 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 358 op/s 2023-08-10T11:57:09.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:08 smithi156 ceph-mon[130574]: pgmap v138: 97 pgs: 97 active+clean; 985 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 358 op/s 2023-08-10T11:57:09.270 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:08 smithi073 ceph-mon[128869]: pgmap v138: 97 pgs: 97 active+clean; 985 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 358 op/s 2023-08-10T11:57:11.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:10 smithi152 ceph-mon[130220]: pgmap v139: 97 pgs: 97 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.2 MiB/s wr, 555 op/s 2023-08-10T11:57:11.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:10 smithi156 ceph-mon[130574]: pgmap v139: 97 pgs: 97 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.2 MiB/s wr, 555 op/s 2023-08-10T11:57:11.274 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:10 smithi073 ceph-mon[128869]: pgmap v139: 97 pgs: 97 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.2 MiB/s wr, 555 op/s 2023-08-10T11:57:13.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:12 smithi152 ceph-mon[130220]: pgmap v140: 97 pgs: 97 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 492 op/s 2023-08-10T11:57:13.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:12 smithi156 ceph-mon[130574]: pgmap v140: 97 pgs: 97 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 492 op/s 2023-08-10T11:57:13.307 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:12 smithi073 ceph-mon[128869]: pgmap v140: 97 pgs: 97 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 492 op/s 2023-08-10T11:57:14.939 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:14.930+0000 7f7818bd6700 1 -- 172.21.15.73:0/724934661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f781410cae0 msgr2=0x7f781410cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:14.940 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:14.930+0000 7f7818bd6700 1 --2- 172.21.15.73:0/724934661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f781410cae0 0x7f781410cec0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7804009990 tx=0x7f7804009ca0 comp rx=0 tx=0).stop 2023-08-10T11:57:14.940 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:14.930+0000 7f7818bd6700 1 -- 172.21.15.73:0/724934661 shutdown_connections 2023-08-10T11:57:14.940 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:14.930+0000 7f7818bd6700 1 --2- 172.21.15.73:0/724934661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f781410be90 0x7f7814078a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:14.941 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:14.930+0000 7f7818bd6700 1 --2- 172.21.15.73:0/724934661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f781410cae0 0x7f781410cec0 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7804009990 tx=0x7f7804009ca0 comp rx=0 tx=0).stop 2023-08-10T11:57:14.941 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:14.930+0000 7f7818bd6700 1 --2- 172.21.15.73:0/724934661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f781410d490 0x7f781410b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:14.941 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:14.930+0000 7f7818bd6700 1 -- 172.21.15.73:0/724934661 >> 172.21.15.73:0/724934661 conn(0x7f7814071a60 msgr2=0x7f7814071e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:14.988+0000 7f7818bd6700 1 -- 172.21.15.73:0/724934661 shutdown_connections 2023-08-10T11:57:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:14.994+0000 7f7818bd6700 1 -- 172.21.15.73:0/724934661 wait complete. 2023-08-10T11:57:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:14.995+0000 7f7818bd6700 1 Processor -- start 2023-08-10T11:57:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:14.995+0000 7f7818bd6700 1 -- start start 2023-08-10T11:57:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:14.995+0000 7f7818bd6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f781410be90 0x7f7814081f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:14.995+0000 7f7818bd6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78140824c0 0x7f781407bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:14.995+0000 7f7818bd6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f781407c4a0 0x7f781407c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:14.995+0000 7f7818bd6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78141cbac0 con 0x7f781410be90 2023-08-10T11:57:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:14.995+0000 7f7818bd6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78141cbc30 con 0x7f78140824c0 2023-08-10T11:57:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:14.995+0000 7f7818bd6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78141cbdf0 con 0x7f781407c4a0 2023-08-10T11:57:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:14.996+0000 7f7812ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78140824c0 0x7f781407bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:15.002 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:14.996+0000 7f7813fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f781407c4a0 0x7f781407c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:15.002 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:14.996+0000 7f7813fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f781407c4a0 0x7f781407c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60504/0 (socket says 172.21.15.73:60504) 2023-08-10T11:57:15.002 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:14.996+0000 7f7813fff700 1 -- 172.21.15.73:0/2580533102 learned_addr learned my addr 172.21.15.73:0/2580533102 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:57:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.002+0000 7f7812ffd700 1 -- 172.21.15.73:0/2580533102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f781407c4a0 msgr2=0x7f781407c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.002+0000 7f7812ffd700 1 --2- 172.21.15.73:0/2580533102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f781407c4a0 0x7f781407c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.002+0000 7f7812ffd700 1 -- 172.21.15.73:0/2580533102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f781410be90 msgr2=0x7f7814081f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.002+0000 7f7812ffd700 1 --2- 172.21.15.73:0/2580533102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f781410be90 0x7f7814081f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.002+0000 7f7812ffd700 1 -- 172.21.15.73:0/2580533102 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78040095f0 con 0x7f78140824c0 2023-08-10T11:57:15.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:14 smithi073 ceph-mon[128869]: pgmap v141: 97 pgs: 97 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.9 MiB/s wr, 652 op/s 2023-08-10T11:57:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.027+0000 7f7812ffd700 1 --2- 172.21.15.73:0/2580533102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78140824c0 0x7f781407bf60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f781410d970 tx=0x7f7808009ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:15.181 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.178+0000 7f7810ff9700 1 -- 172.21.15.73:0/2580533102 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780800c940 con 0x7f78140824c0 2023-08-10T11:57:15.181 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.178+0000 7f7810ff9700 1 -- 172.21.15.73:0/2580533102 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7808017400 con 0x7f78140824c0 2023-08-10T11:57:15.181 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.178+0000 7f7810ff9700 1 -- 172.21.15.73:0/2580533102 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78080165c0 con 0x7f78140824c0 2023-08-10T11:57:15.198 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.178+0000 7f7818bd6700 1 -- 172.21.15.73:0/2580533102 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78141cc0d0 con 0x7f78140824c0 2023-08-10T11:57:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.178+0000 7f7818bd6700 1 -- 172.21.15.73:0/2580533102 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78141cc590 con 0x7f78140824c0 2023-08-10T11:57:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.184+0000 7f7825fd1b80 1 Processor -- start 2023-08-10T11:57:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.199+0000 7f7825fd1b80 1 -- start start 2023-08-10T11:57:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.199+0000 7f7825fd1b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f928e1cc0 0x556f928e20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.199+0000 7f7825fd1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556f928dc010 0x556f928dc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.199+0000 7f7825fd1b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f928dc9d0 0x556f928e8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.199+0000 7f7825fd1b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f92857d60 con 0x556f928dc9d0 2023-08-10T11:57:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.199+0000 7f7825fd1b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f92834530 con 0x556f928e1cc0 2023-08-10T11:57:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.199+0000 7f7825fd1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f92831e50 con 0x556f928dc010 2023-08-10T11:57:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.200+0000 7f78137fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556f928dc010 0x556f928dc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.200+0000 7f78137fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556f928dc010 0x556f928dc490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60508/0 (socket says 172.21.15.73:60508) 2023-08-10T11:57:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.200+0000 7f78137fe700 1 -- 172.21.15.73:0/4124941387 learned_addr learned my addr 172.21.15.73:0/4124941387 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:57:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.200+0000 7f7813fff700 1 --2- 172.21.15.73:0/4124941387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f928e1cc0 0x556f928e20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.200+0000 7f7813fff700 1 -- 172.21.15.73:0/4124941387 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556f928dc010 msgr2=0x556f928dc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.200+0000 7f7813fff700 1 --2- 172.21.15.73:0/4124941387 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556f928dc010 0x556f928dc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.200+0000 7f7813fff700 1 -- 172.21.15.73:0/4124941387 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f928dc9d0 msgr2=0x556f928e8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.200+0000 7f7813fff700 1 --2- 172.21.15.73:0/4124941387 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f928dc9d0 0x556f928e8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.200+0000 7f7813fff700 1 -- 172.21.15.73:0/4124941387 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f926ae5d0 con 0x556f928e1cc0 2023-08-10T11:57:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.201+0000 7f7810ff9700 1 -- 172.21.15.73:0/2580533102 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f780800caa0 con 0x7f78140824c0 2023-08-10T11:57:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.202+0000 7f7810ff9700 1 --2- 172.21.15.73:0/2580533102 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f77fc0a14d0 0x7f77fc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.202+0000 7f7810ff9700 1 -- 172.21.15.73:0/2580533102 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f78080cc8f0 con 0x7f78140824c0 2023-08-10T11:57:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.203+0000 7f7813fff700 1 --2- 172.21.15.73:0/4124941387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f928e1cc0 0x556f928e20a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f780c0060b0 tx=0x7f780c010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d599ec13825fcba server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:15.223 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.222+0000 7f78137fe700 1 --2- 172.21.15.73:0/2580533102 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f77fc0a14d0 0x7f77fc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:15.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:14 smithi152 ceph-mon[130220]: pgmap v141: 97 pgs: 97 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.9 MiB/s wr, 652 op/s 2023-08-10T11:57:15.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:14 smithi156 ceph-mon[130574]: pgmap v141: 97 pgs: 97 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.9 MiB/s wr, 652 op/s 2023-08-10T11:57:15.306 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.304+0000 7f78137fe700 1 --2- 172.21.15.73:0/2580533102 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f77fc0a14d0 0x7f77fc0a3990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f780400d4f0 tx=0x7f7804017040 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:15.333 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.330+0000 7f77f9ffb700 1 -- 172.21.15.73:0/4124941387 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c003c00 con 0x556f928e1cc0 2023-08-10T11:57:15.333 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.330+0000 7f77f9ffb700 1 -- 172.21.15.73:0/4124941387 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f780c003d60 con 0x556f928e1cc0 2023-08-10T11:57:15.333 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.330+0000 7f77f9ffb700 1 -- 172.21.15.73:0/4124941387 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c011880 con 0x556f928e1cc0 2023-08-10T11:57:15.333 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.331+0000 7f7825fd1b80 1 -- 172.21.15.73:0/4124941387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f928e1cc0 msgr2=0x556f928e20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.331+0000 7f7825fd1b80 1 --2- 172.21.15.73:0/4124941387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f928e1cc0 0x556f928e20a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f780c0060b0 tx=0x7f780c010740 comp rx=0 tx=0).stop 2023-08-10T11:57:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.332+0000 7f7825fd1b80 1 -- 172.21.15.73:0/4124941387 shutdown_connections 2023-08-10T11:57:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.332+0000 7f7825fd1b80 1 --2- 172.21.15.73:0/4124941387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f928e1cc0 0x556f928e20a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:15.335 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.332+0000 7f7825fd1b80 1 --2- 172.21.15.73:0/4124941387 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f928dc9d0 0x556f928e8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:15.335 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.332+0000 7f7825fd1b80 1 --2- 172.21.15.73:0/4124941387 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556f928dc010 0x556f928dc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:15.335 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.332+0000 7f7825fd1b80 1 -- 172.21.15.73:0/4124941387 >> 172.21.15.73:0/4124941387 conn(0x556f92839c70 msgr2=0x556f928d6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:15.335 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.332+0000 7f7825fd1b80 1 -- 172.21.15.73:0/4124941387 shutdown_connections 2023-08-10T11:57:15.336 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.332+0000 7f7825fd1b80 1 -- 172.21.15.73:0/4124941387 wait complete. 2023-08-10T11:57:15.336 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.333+0000 7f7825fd1b80 1 -- start start 2023-08-10T11:57:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.333+0000 7f7825fd1b80 1 Processor -- start 2023-08-10T11:57:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.334+0000 7f7825fd1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556f928dc010 0x556f928e5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:15.337 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.334+0000 7f7825fd1b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f928dc9d0 0x556f928e62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:15.338 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.334+0000 7f7825fd1b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f928e1cc0 0x556f928e6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:15.338 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.334+0000 7f7825fd1b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f9282d740 con 0x556f928dc9d0 2023-08-10T11:57:15.338 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.334+0000 7f7825fd1b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f927cca60 con 0x556f928e1cc0 2023-08-10T11:57:15.338 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.334+0000 7f7825fd1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f927cc760 con 0x556f928dc010 2023-08-10T11:57:15.339 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.334+0000 7f7825fd1b80 10 client.0 _ll_register_callbacks cb 0x556f927ca620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:57:15.339 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.334+0000 7f78137fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556f928dc010 0x556f928e5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:15.339 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.334+0000 7f78137fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556f928dc010 0x556f928e5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60516/0 (socket says 172.21.15.73:60516) 2023-08-10T11:57:15.340 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.334+0000 7f78137fe700 1 -- 172.21.15.73:0/1535278303 learned_addr learned my addr 172.21.15.73:0/1535278303 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:57:15.340 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.334+0000 7f7813fff700 1 --2- 172.21.15.73:0/1535278303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f928e1cc0 0x556f928e6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.336+0000 7f7813fff700 1 -- 172.21.15.73:0/1535278303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556f928dc010 msgr2=0x556f928e5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.336+0000 7f7813fff700 1 --2- 172.21.15.73:0/1535278303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556f928dc010 0x556f928e5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.336+0000 7f7813fff700 1 -- 172.21.15.73:0/1535278303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f928dc9d0 msgr2=0x556f928e62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.336+0000 7f7813fff700 1 --2- 172.21.15.73:0/1535278303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f928dc9d0 0x556f928e62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.336+0000 7f7813fff700 1 -- 172.21.15.73:0/1535278303 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780c0103a0 con 0x556f928e1cc0 2023-08-10T11:57:15.350 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.348+0000 7f7813fff700 1 --2- 172.21.15.73:0/1535278303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f928e1cc0 0x556f928e6810 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f780c000f80 tx=0x7f780c004470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcb7d574df6205b6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:15.387 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.385+0000 7f77f2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T11:57:15.387 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.385+0000 7f77f2ffd700 1 -- 172.21.15.73:0/1535278303 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c0047e0 con 0x556f928e1cc0 2023-08-10T11:57:15.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.385+0000 7f77f2ffd700 1 -- 172.21.15.73:0/1535278303 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f780c004ce0 con 0x556f928e1cc0 2023-08-10T11:57:15.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.385+0000 7f7825fd1b80 1 -- 172.21.15.73:0/1535278303 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556f928cf1c0 con 0x556f928e1cc0 2023-08-10T11:57:15.396 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.394+0000 7f77f2ffd700 1 -- 172.21.15.73:0/1535278303 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f780c005030 con 0x556f928e1cc0 2023-08-10T11:57:15.398 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.397+0000 7f7825fd1b80 10 client.25793 fetch_fsmap learned FSMap version 38 2023-08-10T11:57:15.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.397+0000 7f7825fd1b80 1 -- 172.21.15.73:0/1535278303 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x556f9265ad80 con 0x556f928e1cc0 2023-08-10T11:57:15.413 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.410+0000 7f77f2ffd700 1 -- 172.21.15.73:0/1535278303 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556f928cf1c0 con 0x556f928e1cc0 2023-08-10T11:57:15.413 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.410+0000 7f77f2ffd700 1 -- 172.21.15.73:0/1535278303 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 38) v1 ==== 7526+0+0 (secure 0 0 0) 0x7f780c02c7c0 con 0x556f928e1cc0 2023-08-10T11:57:15.413 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.410+0000 7f7825fd1b80 10 client.25793 fetch_fsmap finished waiting for FSMap version 38 2023-08-10T11:57:15.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.410+0000 7f7825fd1b80 10 client.25793 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:57:15.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.410+0000 7f7825fd1b80 20 client.25793 populate_metadata read hostname 'smithi073' 2023-08-10T11:57:15.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.410+0000 7f7825fd1b80 1 --2- 172.21.15.73:0/1535278303 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x556f928f5fb0 0x556f928f83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:15.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.410+0000 7f7825fd1b80 4 client.25793 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:57:15.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.410+0000 7f7825fd1b80 1 -- 172.21.15.73:0/1535278303 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556f928ab970 con 0x556f928f5fb0 2023-08-10T11:57:15.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.411+0000 7f78137fe700 1 --2- 172.21.15.73:0/1535278303 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x556f928f5fb0 0x556f928f83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.436+0000 7f78137fe700 1 --2- 172.21.15.73:0/1535278303 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x556f928f5fb0 0x556f928f83d0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7ac11d524e031cf server_cookie=b2052ed41c78c913 in_seq=0 out_seq=0 2023-08-10T11:57:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.436+0000 7f77f2ffd700 10 client.25793 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:57:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.447+0000 7f77f2ffd700 1 -- 172.21.15.73:0/1535278303 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x556f928ab970 con 0x556f928f5fb0 2023-08-10T11:57:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.447+0000 7f77f2ffd700 10 client.25793 handle_command_reply: tid=0 2023-08-10T11:57:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.447+0000 7f7825fd1b80 1 client.25793 shutdown 2023-08-10T11:57:15.456 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.454+0000 7f7825fd1b80 1 -- 172.21.15.73:0/1535278303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f928e1cc0 msgr2=0x556f928e6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:15.456 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.454+0000 7f7825fd1b80 1 --2- 172.21.15.73:0/1535278303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f928e1cc0 0x556f928e6810 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f780c000f80 tx=0x7f780c004470 comp rx=0 tx=0).stop 2023-08-10T11:57:15.458 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.454+0000 7f7825fd1b80 1 -- 172.21.15.73:0/1535278303 shutdown_connections 2023-08-10T11:57:15.458 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.454+0000 7f7825fd1b80 1 --2- 172.21.15.73:0/1535278303 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x556f928f5fb0 0x556f928f83d0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:15.458 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.454+0000 7f7825fd1b80 1 --2- 172.21.15.73:0/1535278303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f928e1cc0 0x556f928e6810 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:15.459 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.454+0000 7f7825fd1b80 1 --2- 172.21.15.73:0/1535278303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556f928dc010 0x556f928e5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:15.459 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.454+0000 7f7825fd1b80 1 --2- 172.21.15.73:0/1535278303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f928dc9d0 0x556f928e62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:15.459 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.454+0000 7f7825fd1b80 1 -- 172.21.15.73:0/1535278303 >> 172.21.15.73:0/1535278303 conn(0x556f92839c70 msgr2=0x556f928d64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:15.459 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.454+0000 7f77f2ffd700 0 client.25793 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:57:15.460 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.455+0000 7f7825fd1b80 1 -- 172.21.15.73:0/1535278303 shutdown_connections 2023-08-10T11:57:15.460 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.455+0000 7f7825fd1b80 1 -- 172.21.15.73:0/1535278303 wait complete. 2023-08-10T11:57:15.460 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.455+0000 7f7825fd1b80 20 client.25793 trim_cache size 0 max 16384 2023-08-10T11:57:15.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.807+0000 7f7825fd1b80 1 Processor -- start 2023-08-10T11:57:15.877 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.875+0000 7f7825fd1b80 1 -- start start 2023-08-10T11:57:15.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.875+0000 7f7825fd1b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f928dc010 0x556f928ed060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:15.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.875+0000 7f7825fd1b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f928dc9d0 0x556f928e3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:15.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.875+0000 7f7825fd1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556f928e1cc0 0x556f928e5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:15.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.875+0000 7f7825fd1b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f926b08c0 con 0x556f928dc010 2023-08-10T11:57:15.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.875+0000 7f7825fd1b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f928e3dd0 con 0x556f928dc9d0 2023-08-10T11:57:15.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.875+0000 7f7825fd1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f928d19c0 con 0x556f928e1cc0 2023-08-10T11:57:15.882 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.880+0000 7f7812ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f928dc9d0 0x556f928e3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:15.882 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.880+0000 7f7812ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f928dc9d0 0x556f928e3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49672/0 (socket says 172.21.15.73:49672) 2023-08-10T11:57:15.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.880+0000 7f7812ffd700 1 -- 172.21.15.73:0/2140849970 learned_addr learned my addr 172.21.15.73:0/2140849970 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:57:15.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.880+0000 7f7813fff700 1 --2- 172.21.15.73:0/2140849970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556f928e1cc0 0x556f928e5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:15.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.881+0000 7f78137fe700 1 --2- 172.21.15.73:0/2140849970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f928dc010 0x556f928ed060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.887+0000 7f7813fff700 1 -- 172.21.15.73:0/2140849970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f928dc9d0 msgr2=0x556f928e3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:15.890 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.887+0000 7f7813fff700 1 --2- 172.21.15.73:0/2140849970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f928dc9d0 0x556f928e3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:15.890 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.887+0000 7f7813fff700 1 -- 172.21.15.73:0/2140849970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f928dc010 msgr2=0x556f928ed060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:15.890 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.887+0000 7f7813fff700 1 --2- 172.21.15.73:0/2140849970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f928dc010 0x556f928ed060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.887+0000 7f7813fff700 1 -- 172.21.15.73:0/2140849970 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f92643c00 con 0x556f928e1cc0 2023-08-10T11:57:15.892 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.890+0000 7f7813fff700 1 --2- 172.21.15.73:0/2140849970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556f928e1cc0 0x556f928e5570 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f780c007b60 tx=0x7f780c006070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cdf8e987e980352 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.983+0000 7f77fa7fc700 1 -- 172.21.15.73:0/2140849970 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c010b40 con 0x556f928e1cc0 2023-08-10T11:57:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.983+0000 7f77fa7fc700 1 -- 172.21.15.73:0/2140849970 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f780c00b040 con 0x556f928e1cc0 2023-08-10T11:57:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.983+0000 7f77fa7fc700 1 -- 172.21.15.73:0/2140849970 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c0216f0 con 0x556f928e1cc0 2023-08-10T11:57:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.984+0000 7f7825fd1b80 1 -- 172.21.15.73:0/2140849970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556f928e1cc0 msgr2=0x556f928e5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.984+0000 7f7825fd1b80 1 --2- 172.21.15.73:0/2140849970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556f928e1cc0 0x556f928e5570 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f780c007b60 tx=0x7f780c006070 comp rx=0 tx=0).stop 2023-08-10T11:57:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.985+0000 7f7825fd1b80 1 -- 172.21.15.73:0/2140849970 shutdown_connections 2023-08-10T11:57:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.985+0000 7f7825fd1b80 1 --2- 172.21.15.73:0/2140849970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556f928e1cc0 0x556f928e5570 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.985+0000 7f7825fd1b80 1 --2- 172.21.15.73:0/2140849970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f928dc010 0x556f928ed060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.985+0000 7f7825fd1b80 1 --2- 172.21.15.73:0/2140849970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f928dc9d0 0x556f928e3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.985+0000 7f7825fd1b80 1 -- 172.21.15.73:0/2140849970 >> 172.21.15.73:0/2140849970 conn(0x556f92839c70 msgr2=0x556f928dff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.986+0000 7f7825fd1b80 1 -- 172.21.15.73:0/2140849970 shutdown_connections 2023-08-10T11:57:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.986+0000 7f7825fd1b80 1 -- 172.21.15.73:0/2140849970 wait complete. 2023-08-10T11:57:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.986+0000 7f7825fd1b80 1 -- start start 2023-08-10T11:57:15.989 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.987+0000 7f7825fd1b80 1 Processor -- start 2023-08-10T11:57:15.989 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.987+0000 7f7825fd1b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f928dc010 0x556f928ecf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:15.989 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.987+0000 7f7825fd1b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f928dc9d0 0x556f928eb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:15.989 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.987+0000 7f7825fd1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556f928e1cc0 0x556f928eb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:15.989 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.987+0000 7f7825fd1b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f928ebe20 con 0x556f928dc9d0 2023-08-10T11:57:15.990 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.987+0000 7f7825fd1b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f928ebf90 con 0x556f928dc010 2023-08-10T11:57:15.990 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.987+0000 7f7825fd1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f92949c30 con 0x556f928e1cc0 2023-08-10T11:57:15.990 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:15.987+0000 7f7825fd1b80 10 client.0 _ll_register_callbacks cb 0x556f927ca620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:57:16.002 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.000+0000 7f78137fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f928dc010 0x556f928ecf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:16.002 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.000+0000 7f7813fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556f928e1cc0 0x556f928eb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:16.002 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.000+0000 7f7813fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556f928e1cc0 0x556f928eb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60534/0 (socket says 172.21.15.73:60534) 2023-08-10T11:57:16.002 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.000+0000 7f7813fff700 1 -- 172.21.15.73:0/2236429583 learned_addr learned my addr 172.21.15.73:0/2236429583 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:57:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.015+0000 7f7813fff700 1 -- 172.21.15.73:0/2236429583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f928dc010 msgr2=0x556f928ecf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.015+0000 7f7813fff700 1 --2- 172.21.15.73:0/2236429583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f928dc010 0x556f928ecf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.015+0000 7f7813fff700 1 -- 172.21.15.73:0/2236429583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f928dc9d0 msgr2=0x556f928eb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.015+0000 7f7813fff700 1 --2- 172.21.15.73:0/2236429583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f928dc9d0 0x556f928eb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.015+0000 7f7813fff700 1 -- 172.21.15.73:0/2236429583 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556f9265ad80 con 0x556f928e1cc0 2023-08-10T11:57:16.027 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.026+0000 7f7813fff700 1 --2- 172.21.15.73:0/2236429583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556f928e1cc0 0x556f928eb750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f780c004a30 tx=0x7f780c02c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd03489d111f0939 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:16.028 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.026+0000 7f77f2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T11:57:16.028 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.026+0000 7f77f2ffd700 1 -- 172.21.15.73:0/2236429583 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c010b40 con 0x556f928e1cc0 2023-08-10T11:57:16.029 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.026+0000 7f77f2ffd700 1 -- 172.21.15.73:0/2236429583 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f780c035680 con 0x556f928e1cc0 2023-08-10T11:57:16.029 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.026+0000 7f7825fd1b80 1 -- 172.21.15.73:0/2236429583 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556f928f2a60 con 0x556f928e1cc0 2023-08-10T11:57:16.039 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.037+0000 7f77f2ffd700 1 -- 172.21.15.73:0/2236429583 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f780c035840 con 0x556f928e1cc0 2023-08-10T11:57:16.039 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.037+0000 7f7825fd1b80 10 client.25840 fetch_fsmap learned FSMap version 38 2023-08-10T11:57:16.039 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.037+0000 7f7825fd1b80 1 -- 172.21.15.73:0/2236429583 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x556f926811f0 con 0x556f928e1cc0 2023-08-10T11:57:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.049+0000 7f77f2ffd700 1 -- 172.21.15.73:0/2236429583 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556f928f2a60 con 0x556f928e1cc0 2023-08-10T11:57:16.051 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.049+0000 7f77f2ffd700 1 -- 172.21.15.73:0/2236429583 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 38) v1 ==== 7526+0+0 (secure 0 0 0) 0x7f780c03e050 con 0x556f928e1cc0 2023-08-10T11:57:16.051 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.049+0000 7f7825fd1b80 10 client.25840 fetch_fsmap finished waiting for FSMap version 38 2023-08-10T11:57:16.051 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.049+0000 7f7825fd1b80 10 client.25840 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:57:16.051 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.049+0000 7f7825fd1b80 20 client.25840 populate_metadata read hostname 'smithi073' 2023-08-10T11:57:16.051 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.049+0000 7f7825fd1b80 1 --2- 172.21.15.73:0/2236429583 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x556f9294ad90 0x556f9294d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:16.051 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.049+0000 7f7825fd1b80 4 client.25840 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:57:16.052 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.049+0000 7f7825fd1b80 1 -- 172.21.15.73:0/2236429583 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7f780c003d60 con 0x556f9294ad90 2023-08-10T11:57:16.053 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.050+0000 7f78137fe700 1 --2- 172.21.15.73:0/2236429583 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x556f9294ad90 0x556f9294d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:16.063 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.061+0000 7f78137fe700 1 --2- 172.21.15.73:0/2236429583 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x556f9294ad90 0x556f9294d180 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62f1a2d1c02bf2cb server_cookie=24c92c0793af39b3 in_seq=0 out_seq=0 2023-08-10T11:57:16.063 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:16.061+0000 7f77f2ffd700 10 client.25840 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:57:16.248 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.927+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008ba [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-13.jpg auth{0=1} v734 ap=1 s=27811 n(v0 rc2023-08-10T11:53:53.274473+0000 b27811 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cbfac100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008ba:[<0x10000000861/picture-13.jpg v734>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008ba:[<0x10000000861/picture-13.jpg v734>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2258>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.248 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.928+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000867 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-74.xml auth{0=1} v650 ap=1 s=12856 n(v0 rc2023-08-10T11:53:53.091478+0000 b12856 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cbfad180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000867:[<0x10000000861/article-74.xml v650>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000867:[<0x10000000861/article-74.xml v650>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2258>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.248 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.928+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000876 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-59.xml auth{0=1} v714 ap=1 s=5665 n(v0 rc2023-08-10T11:53:53.126477+0000 b5665 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cbfabb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000876:[<0x10000000861/article-59.xml v714>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000876:[<0x10000000861/article-59.xml v714>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2258>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.249 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.929+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000089f [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-18.xml auth{0=1} v658 ap=1 s=28731 n(v0 rc2023-08-10T11:53:53.208475+0000 b28731 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cbfad700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000089f:[<0x10000000861/article-18.xml v658>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000089f:[<0x10000000861/article-18.xml v658>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2258>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.249 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.930+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008b5 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-18.jpg auth{0=1} v738 ap=1 s=28760 n(v0 rc2023-08-10T11:53:53.258474+0000 b28760 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cbfacc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008b5:[<0x10000000861/picture-18.jpg v738>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008b5:[<0x10000000861/picture-18.jpg v738>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2258>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.249 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.931+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000087e [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-51.xml auth{0=1} v656 ap=1 s=27307 n(v0 rc2023-08-10T11:53:53.140477+0000 b27307 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc663080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000087e:[<0x10000000861/article-51.xml v656>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000087e:[<0x10000000861/article-51.xml v656>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2258>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.249 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.931+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008c3 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-4.jpg auth{0=1} v626 ap=1 s=16638 n(v0 rc2023-08-10T11:53:53.295473+0000 b16638 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc664100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008c3:[<0x10000000861/picture-4.jpg v626>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008c3:[<0x10000000861/picture-4.jpg v626>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2258>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.249 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.932+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008b4 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-19.jpg auth{0=1} v794 ap=1 s=28977 n(v0 rc2023-08-10T11:53:53.255474+0000 b28977 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc662b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008b4:[<0x10000000861/picture-19.jpg v794>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008b4:[<0x10000000861/picture-19.jpg v794>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2258>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.249 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.932+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000896 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-27.xml auth{0=1} v762 ap=1 s=5668 n(v0 rc2023-08-10T11:53:53.192475+0000 b5668 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc663b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000896:[<0x10000000861/article-27.xml v762>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000896:[<0x10000000861/article-27.xml v762>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2258>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.249 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.934+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008c5 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-2.jpg auth{0=1} v652 ap=1 s=18178 n(v0 rc2023-08-10T11:53:53.299473+0000 b18178 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc664680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008c5:[<0x10000000861/picture-2.jpg v652>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008c5:[<0x10000000861/picture-2.jpg v652>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2258>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.250 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.934+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000086b [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-70.xml auth{0=1} v632 ap=1 s=20279 n(v0 rc2023-08-10T11:53:53.103477+0000 b20279 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc664c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000086b:[<0x10000000861/article-70.xml v632>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000086b:[<0x10000000861/article-70.xml v632>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2258>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.250 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.936+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000089d [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-20.xml auth{0=1} v610 ap=1 s=31325 n(v0 rc2023-08-10T11:53:53.205475+0000 b31325 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc665180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000089d:[<0x10000000861/article-20.xml v610>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000089d:[<0x10000000861/article-20.xml v610>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2258>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.250 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.937+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008b9 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-14.jpg auth{0=1} v618 ap=1 s=40227 n(v0 rc2023-08-10T11:53:53.271473+0000 b40227 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc665700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008b9:[<0x10000000861/picture-14.jpg v618>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008b9:[<0x10000000861/picture-14.jpg v618>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2258>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.250 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.939+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000874 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-61.xml auth{0=1} v662 ap=1 s=17986 n(v0 rc2023-08-10T11:53:53.118477+0000 b17986 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cce54580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000874:[<0x10000000861/article-61.xml v662>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000874:[<0x10000000861/article-61.xml v662>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2258>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.250 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.940+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000888 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-41.xml auth{0=1} v620 ap=1 s=28322 n(v0 rc2023-08-10T11:53:53.162476+0000 b28322 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cce54b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000888:[<0x10000000861/article-41.xml v620>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000888:[<0x10000000861/article-41.xml v620>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2258>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.250 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.943+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000086c [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-69.xml auth{0=1} v696 ap=1 s=15750 n(v0 rc2023-08-10T11:53:53.105477+0000 b15750 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cce55b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000086c:[<0x10000000861/article-69.xml v696>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000086c:[<0x10000000861/article-69.xml v696>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2258>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.251 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.944+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d46 [5,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-7.jpg auth{0=1} v879 ap=1 s=27280 n(v0 rc2023-08-10T11:55:28.155224+0000 b27280 1=1+0) (ifile excl) (iversion lock) cr={15318=0-4194304@4} caps={15318=pAsLsXsFsxcrwb/pFscr@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cce56680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d46:[<0x10000000861/picture-7.jpg v874>,<0x1000000035d/blog-11 v120293>,<0x10000000206/blogtest_in v1621>,<0x10000000201/src v1687>,<0x10000000006/blogbench-1.0 v1466>,<0x10000000005/tmp v69>,<0x100000001fb/client.0 v67>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v88>,<0x10000000001/sv_1 v105>,<0x10000000000/_nogroup v89>,<0x1/volumes v87>]//[]","memoryvalue":"(3)0x10000000d46:[<0x10000000861/picture-7.jpg v879>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2258>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.251 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.944+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000892 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-31.xml auth{0=1} v616 ap=1 s=28162 n(v0 rc2023-08-10T11:53:53.183476+0000 b28162 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cce56c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000892:[<0x10000000861/article-31.xml v616>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000892:[<0x10000000861/article-31.xml v616>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2258>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.251 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.947+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008be [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-9.jpg auth{0=1} v744 ap=1 s=9782 n(v0 rc2023-08-10T11:53:53.285473+0000 b9782 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cce57180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008be:[<0x10000000861/picture-9.jpg v744>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008be:[<0x10000000861/picture-9.jpg v744>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2258>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.251 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.966+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008bd [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-10.jpg auth{0=1} v712 ap=1 s=32133 n(v0 rc2023-08-10T11:53:53.282473+0000 b32133 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc47bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008bd:[<0x10000000861/picture-10.jpg v712>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008bd:[<0x10000000861/picture-10.jpg v712>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2261>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.251 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.967+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008c6 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-1.jpg auth{0=1} v758 ap=1 s=11059 n(v0 rc2023-08-10T11:53:53.301473+0000 b11059 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc47c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008c6:[<0x10000000861/picture-1.jpg v758>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008c6:[<0x10000000861/picture-1.jpg v758>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2261>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.251 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.970+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008a8 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-9.xml auth{0=1} v792 ap=1 s=21231 n(v0 rc2023-08-10T11:53:53.226475+0000 b21231 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc47d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008a8:[<0x10000000861/article-9.xml v792>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008a8:[<0x10000000861/article-9.xml v792>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2261>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.251 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.970+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008c1 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-6.jpg auth{0=1} v674 ap=1 s=26905 n(v0 rc2023-08-10T11:53:53.291473+0000 b26905 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc3f4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008c1:[<0x10000000861/picture-6.jpg v674>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008c1:[<0x10000000861/picture-6.jpg v674>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2261>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.252 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.971+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000885 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-44.xml auth{0=1} v742 ap=1 s=20682 n(v0 rc2023-08-10T11:53:53.155476+0000 b20682 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc47d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000885:[<0x10000000861/article-44.xml v742>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000885:[<0x10000000861/article-44.xml v742>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2261>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.252 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.974+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000873 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-62.xml auth{0=1} v654 ap=1 s=32094 n(v0 rc2023-08-10T11:53:53.117477+0000 b32094 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc3f5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000873:[<0x10000000861/article-62.xml v654>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000873:[<0x10000000861/article-62.xml v654>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2261>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.252 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.975+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000899 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-24.xml auth{0=1} v666 ap=1 s=16198 n(v0 rc2023-08-10T11:53:53.197475+0000 b16198 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc3f5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000899:[<0x10000000861/article-24.xml v666>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000899:[<0x10000000861/article-24.xml v666>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2261>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.252 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.976+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000870 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-65.xml auth{0=1} v764 ap=1 s=1429 n(v0 rc2023-08-10T11:53:53.112477+0000 b1429 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc3f4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000870:[<0x10000000861/article-65.xml v764>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000870:[<0x10000000861/article-65.xml v764>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2261>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.252 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.983+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008b6 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-17.jpg auth{0=1} v684 ap=1 s=56480 n(v0 rc2023-08-10T11:53:53.262474+0000 b56480 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc01a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008b6:[<0x10000000861/picture-17.jpg v684>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008b6:[<0x10000000861/picture-17.jpg v684>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2261>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.252 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.984+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000086e [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-67.xml auth{0=1} v750 ap=1 s=11542 n(v0 rc2023-08-10T11:53:53.108477+0000 b11542 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc3f7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000086e:[<0x10000000861/article-67.xml v750>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000086e:[<0x10000000861/article-67.xml v750>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2261>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.252 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.985+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008ae [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-3.xml auth{0=1} v622 ap=1 s=20018 n(v0 rc2023-08-10T11:53:53.238474+0000 b20018 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc01a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008ae:[<0x10000000861/article-3.xml v622>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008ae:[<0x10000000861/article-3.xml v622>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2261>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.253 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.989+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000951 [5,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-24.jpg auth{0=1} v871 ap=1 s=46149 n(v0 rc2023-08-10T11:54:47.863179+0000 b46149 1=1+0) (iversion lock) caps={15318=pAsLsXsFscr/pFscr@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc01b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000951:[<0x10000000861/picture-24.jpg v865>,<0x1000000035d/blog-11 v58625>,<0x10000000206/blogtest_in v861>,<0x10000000201/src v1677>,<0x10000000006/blogbench-1.0 v1456>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v57>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v78>,<0x10000000001/sv_1 v95>,<0x10000000000/_nogroup v79>,<0x1/volumes v77>]//[]","memoryvalue":"(3)0x10000000951:[<0x10000000861/picture-24.jpg v871>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2261>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.253 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.989+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008aa [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-7.xml auth{0=1} v740 ap=1 s=30668 n(v0 rc2023-08-10T11:53:53.230474+0000 b30668 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc01b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008aa:[<0x10000000861/article-7.xml v740>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008aa:[<0x10000000861/article-7.xml v740>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2261>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.253 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.995+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009a2 [5,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-68.jpg auth{0=1} v883 ap=1 s=46482 n(v0 rc2023-08-10T11:55:13.007583+0000 b46482 1=1+0) (ifile excl) (iversion lock) cr={15318=0-4194304@4} caps={15318=pAsLsXsFsxcrwb/pFscr@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc01bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009a2:[<0x10000000861/picture-68.jpg v873>,<0x1000000035d/blog-11 v115821>,<0x10000000206/blogtest_in v1433>,<0x10000000201/src v1683>,<0x10000000006/blogbench-1.0 v1462>,<0x10000000005/tmp v65>,<0x100000001fb/client.0 v63>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v84>,<0x10000000001/sv_1 v101>,<0x10000000000/_nogroup v85>,<0x1/volumes v83>]//[]","memoryvalue":"(3)0x100000009a2:[<0x10000000861/picture-68.jpg v883>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2261>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.253 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.996+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008ca [4,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-55.xml auth{0=1} v851 ap=1 s=25498 n(v0 rc2023-08-10T11:54:03.530230+0000 b25498 1=1+0) (ifile excl) (iversion lock) cr={15318=0-4194304@3} caps={15318=pAsLsXsFsxcrwb/pFscr@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc01d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008ca:[<0x10000000861/article-55.xml v827>,<0x1000000035d/blog-11 v17422>,<0x10000000206/blogtest_in v358>,<0x10000000201/src v1667>,<0x10000000006/blogbench-1.0 v1446>,<0x10000000005/tmp v49>,<0x100000001fb/client.0 v46>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v63>,<0x10000000001/sv_1 v80>,<0x10000000000/_nogroup v65>,<0x1/volumes v63>]//[]","memoryvalue":"(3)0x100000008ca:[<0x10000000861/article-55.xml v851>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2261>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.253 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.997+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008a9 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-8.xml auth{0=1} v694 ap=1 s=8185 n(v0 rc2023-08-10T11:53:53.228475+0000 b8185 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc01d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008a9:[<0x10000000861/article-8.xml v694>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008a9:[<0x10000000861/article-8.xml v694>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2261>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.253 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:15 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.998+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008c9 [4,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-31.jpg auth{0=1} v849 ap=1 s=9687 n(v0 rc2023-08-10T11:54:03.426232+0000 b9687 1=1+0) (ifile excl) (iversion lock) cr={15318=0-4194304@3} caps={15318=pAsLsXsFsxcrwb/pFscr@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cbe3eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008c9:[<0x10000000861/picture-31.jpg v825>,<0x1000000035d/blog-11 v17422>,<0x10000000206/blogtest_in v358>,<0x10000000201/src v1667>,<0x10000000006/blogbench-1.0 v1446>,<0x10000000005/tmp v49>,<0x100000001fb/client.0 v46>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v63>,<0x10000000001/sv_1 v80>,<0x10000000000/_nogroup v65>,<0x1/volumes v63>]//[]","memoryvalue":"(3)0x100000008c9:[<0x10000000861/picture-31.jpg v849>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2261>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.254 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:15.999+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000086d [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-68.xml auth{0=1} v668 ap=1 s=18597 n(v0 rc2023-08-10T11:53:53.106477+0000 b18597 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cbe3f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000086d:[<0x10000000861/article-68.xml v668>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000086d:[<0x10000000861/article-68.xml v668>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2261>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.254 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.004+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000865 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-76.xml auth{0=1} v718 ap=1 s=27339 n(v0 rc2023-08-10T11:53:53.088478+0000 b27339 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cbe3fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000865:[<0x10000000861/article-76.xml v718>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000865:[<0x10000000861/article-76.xml v718>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.254 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.004+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008bf [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-8.jpg auth{0=1} v752 ap=1 s=43259 n(v0 rc2023-08-10T11:53:53.287473+0000 b43259 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cbe40100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008bf:[<0x10000000861/picture-8.jpg v752>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008bf:[<0x10000000861/picture-8.jpg v752>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.254 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.004+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000891 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-32.xml auth{0=1} v664 ap=1 s=31294 n(v0 rc2023-08-10T11:53:53.181476+0000 b31294 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cbe40680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000891:[<0x10000000861/article-32.xml v664>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000891:[<0x10000000861/article-32.xml v664>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.254 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.005+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d47 [5,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-21.xml auth{0=1} v893 ap=1 s=14296 n(v0 rc2023-08-10T11:55:28.159224+0000 b14296 1=1+0) (ifile excl) (iversion lock) cr={15318=0-4194304@4} caps={15318=pAsLsXsFsxcrwb/pFscr@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561ccf14000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d47:[<0x10000000861/article-21.xml v888>,<0x1000000035d/blog-11 v120293>,<0x10000000206/blogtest_in v1621>,<0x10000000201/src v1687>,<0x10000000006/blogbench-1.0 v1466>,<0x10000000005/tmp v69>,<0x100000001fb/client.0 v67>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v88>,<0x10000000001/sv_1 v105>,<0x10000000000/_nogroup v89>,<0x1/volumes v87>]//[]","memoryvalue":"(3)0x10000000d47:[<0x10000000861/article-21.xml v893>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.254 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.006+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000893 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-30.xml auth{0=1} v686 ap=1 s=17911 n(v0 rc2023-08-10T11:53:53.185476+0000 b17911 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561ccf14580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000893:[<0x10000000861/article-30.xml v686>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000893:[<0x10000000861/article-30.xml v686>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.254 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.011+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008a4 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-13.xml auth{0=1} v806 ap=1 s=29795 n(v0 rc2023-08-10T11:53:53.218475+0000 b29795 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561ccf15b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008a4:[<0x10000000861/article-13.xml v806>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008a4:[<0x10000000861/article-13.xml v806>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.255 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.015+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000087f [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-50.xml auth{0=1} v614 ap=1 s=1130 n(v0 rc2023-08-10T11:53:53.142477+0000 b1130 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561ccf17700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000087f:[<0x10000000861/article-50.xml v614>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000087f:[<0x10000000861/article-50.xml v614>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.255 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.015+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008ab [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-6.xml auth{0=1} v730 ap=1 s=21492 n(v0 rc2023-08-10T11:53:53.232474+0000 b21492 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561ccf0a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008ab:[<0x10000000861/article-6.xml v730>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008ab:[<0x10000000861/article-6.xml v730>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.255 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.017+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009a3 [5,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-56.xml auth{0=1} v895 ap=1 s=1892 n(v0 rc2023-08-10T11:55:13.030583+0000 b1892 1=1+0) (ifile excl) (iversion lock) cr={15318=0-4194304@4} caps={15318=pAsLsXsFsxcrwb/pFscr@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561ccf0cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009a3:[<0x10000000861/article-56.xml v879>,<0x1000000035d/blog-11 v115821>,<0x10000000206/blogtest_in v1433>,<0x10000000201/src v1683>,<0x10000000006/blogbench-1.0 v1462>,<0x10000000005/tmp v65>,<0x100000001fb/client.0 v63>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v84>,<0x10000000001/sv_1 v101>,<0x10000000000/_nogroup v85>,<0x1/volumes v83>]//[]","memoryvalue":"(3)0x100000009a3:[<0x10000000861/article-56.xml v895>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.255 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.017+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008af [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-2.xml auth{0=1} v724 ap=1 s=30729 n(v0 rc2023-08-10T11:53:53.240474+0000 b30729 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561ccf0a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008af:[<0x10000000861/article-2.xml v724>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008af:[<0x10000000861/article-2.xml v724>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.255 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.018+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000886 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-43.xml auth{0=1} v768 ap=1 s=16996 n(v0 rc2023-08-10T11:53:53.156476+0000 b16996 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561ccee5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000886:[<0x10000000861/article-43.xml v768>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000886:[<0x10000000861/article-43.xml v768>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.255 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.018+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000890 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-33.xml auth{0=1} v648 ap=1 s=9786 n(v0 rc2023-08-10T11:53:53.179476+0000 b9786 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561ccee5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000890:[<0x10000000861/article-33.xml v648>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000890:[<0x10000000861/article-33.xml v648>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.255 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.019+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008c2 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-5.jpg auth{0=1} v774 ap=1 s=15661 n(v0 rc2023-08-10T11:53:53.293473+0000 b15661 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561ccee6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008c2:[<0x10000000861/picture-5.jpg v774>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008c2:[<0x10000000861/picture-5.jpg v774>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.256 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.023+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000878 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-57.xml auth{0=1} v702 ap=1 s=28736 n(v0 rc2023-08-10T11:53:53.129477+0000 b28736 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561ccee7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000878:[<0x10000000861/article-57.xml v702>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000878:[<0x10000000861/article-57.xml v702>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.256 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.025+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000877 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-58.xml auth{0=1} v636 ap=1 s=8253 n(v0 rc2023-08-10T11:53:53.127477+0000 b8253 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cceaa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000877:[<0x10000000861/article-58.xml v636>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000877:[<0x10000000861/article-58.xml v636>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.256 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.025+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000087c [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-53.xml auth{0=1} v800 ap=1 s=11554 n(v0 rc2023-08-10T11:53:53.136477+0000 b11554 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cceaac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000087c:[<0x10000000861/article-53.xml v800>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000087c:[<0x10000000861/article-53.xml v800>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.256 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.026+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000895 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-28.xml auth{0=1} v640 ap=1 s=22083 n(v0 rc2023-08-10T11:53:53.190475+0000 b22083 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cceb4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000895:[<0x10000000861/article-28.xml v640>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000895:[<0x10000000861/article-28.xml v640>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.256 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.027+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000087d [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-52.xml auth{0=1} v634 ap=1 s=10821 n(v0 rc2023-08-10T11:53:53.138477+0000 b10821 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cceb5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000087d:[<0x10000000861/article-52.xml v634>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000087d:[<0x10000000861/article-52.xml v634>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.256 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.029+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000862 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-79.xml auth{0=1} v706 ap=1 s=30353 n(v0 rc2023-08-10T11:53:53.079478+0000 b30353 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561ccea9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000862:[<0x10000000861/article-79.xml v706>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000862:[<0x10000000861/article-79.xml v706>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.256 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.031+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008c4 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-3.jpg auth{0=1} v704 ap=1 s=55820 n(v0 rc2023-08-10T11:53:53.297473+0000 b55820 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cceb7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008c4:[<0x10000000861/picture-3.jpg v704>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008c4:[<0x10000000861/picture-3.jpg v704>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.257 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.033+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008ac [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-5.xml auth{0=1} v660 ap=1 s=5638 n(v0 rc2023-08-10T11:53:53.234474+0000 b5638 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cce85b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008ac:[<0x10000000861/article-5.xml v660>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008ac:[<0x10000000861/article-5.xml v660>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.257 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.033+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000088f [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-34.xml auth{0=1} v720 ap=1 s=16379 n(v0 rc2023-08-10T11:53:53.177476+0000 b16379 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cce86100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000088f:[<0x10000000861/article-34.xml v720>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000088f:[<0x10000000861/article-34.xml v720>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.257 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.039+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000863 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-78.xml auth{0=1} v778 ap=1 s=28338 n(v0 rc2023-08-10T11:53:53.083478+0000 b28338 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cce87700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000863:[<0x10000000861/article-78.xml v778>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000863:[<0x10000000861/article-78.xml v778>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.257 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.040+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000894 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-29.xml auth{0=1} v756 ap=1 s=6779 n(v0 rc2023-08-10T11:53:53.188475+0000 b6779 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561ccc00000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000894:[<0x10000000861/article-29.xml v756>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000894:[<0x10000000861/article-29.xml v756>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.257 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.041+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008bc [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-11.jpg auth{0=1} v708 ap=1 s=34817 n(v0 rc2023-08-10T11:53:53.279473+0000 b34817 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cce85600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008bc:[<0x10000000861/picture-11.jpg v708>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008bc:[<0x10000000861/picture-11.jpg v708>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.257 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.041+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000952 [5,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-81.xml auth v874 ap=1 s=24878 n(v0 rc2023-08-10T11:54:47.867179+0000 b24878 1=1+0) (iversion lock) | authpin=1 scrubqueue=0 0x5561c80cac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000952:[<0x10000000861/article-81.xml v868>,<0x1000000035d/blog-11 v58625>,<0x10000000206/blogtest_in v861>,<0x10000000201/src v1677>,<0x10000000006/blogbench-1.0 v1456>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v57>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v78>,<0x10000000001/sv_1 v95>,<0x10000000000/_nogroup v79>,<0x1/volumes v77>]//[]","memoryvalue":"(3)0x10000000952:[<0x10000000861/article-81.xml v874>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.257 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.042+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000089b [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-22.xml auth{0=1} v728 ap=1 s=32144 n(v0 rc2023-08-10T11:53:53.201475+0000 b32144 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561ccc01080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000089b:[<0x10000000861/article-22.xml v728>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000089b:[<0x10000000861/article-22.xml v728>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.258 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.043+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000880 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-49.xml auth{0=1} v746 ap=1 s=3553 n(v0 rc2023-08-10T11:53:53.145476+0000 b3553 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561ccc02100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000880:[<0x10000000861/article-49.xml v746>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000880:[<0x10000000861/article-49.xml v746>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.259 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.045+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000942 [4,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-14.xml auth{0=1} v865 ap=1 s=5552 n(v0 rc2023-08-10T11:54:26.458686+0000 b5552 1=1+0) (ifile excl) (iversion lock) cr={15318=0-4194304@3} caps={15318=pAsLsXsFsxcrwb/pFscr@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561ccc03700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000942:[<0x10000000861/article-14.xml v860>,<0x1000000035d/blog-11 v58625>,<0x10000000206/blogtest_in v552>,<0x10000000201/src v1675>,<0x10000000006/blogbench-1.0 v1454>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v55>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v76>,<0x10000000001/sv_1 v93>,<0x10000000000/_nogroup v77>,<0x1/volumes v75>]//[]","memoryvalue":"(3)0x10000000942:[<0x10000000861/article-14.xml v865>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.259 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.049+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000875 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-60.xml auth{0=1} v682 ap=1 s=19400 n(v0 rc2023-08-10T11:53:53.123477+0000 b19400 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561ccc00580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000875:[<0x10000000861/article-60.xml v682>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000875:[<0x10000000861/article-60.xml v682>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.259 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.049+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008c8 [4,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-84.xml auth v840 ap=1 s=17939 n(v0 rc2023-08-10T11:53:56.942386+0000 b17939 1=1+0) (iversion lock) | authpin=1 scrubqueue=0 0x5561c7def080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008c8:[<0x10000000861/article-84.xml v818>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008c8:[<0x10000000861/article-84.xml v840>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.259 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.050+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009a4 [5,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-60.jpg auth{0=1} v895 ap=1 s=49925 n(v0 rc2023-08-10T11:55:13.387574+0000 b49925 1=1+0) (ifile excl) (iversion lock) cr={15318=0-4194304@4} caps={15318=pAsLsXsFsxcrwb/pFscr@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc278580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009a4:[<0x10000000861/picture-60.jpg v876>,<0x1000000035d/blog-11 v115821>,<0x10000000206/blogtest_in v1433>,<0x10000000201/src v1683>,<0x10000000006/blogbench-1.0 v1462>,<0x10000000005/tmp v65>,<0x100000001fb/client.0 v63>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v84>,<0x10000000001/sv_1 v101>,<0x10000000000/_nogroup v85>,<0x1/volumes v83>]//[]","memoryvalue":"(3)0x100000009a4:[<0x10000000861/picture-60.jpg v895>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.259 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.051+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009a5 [5,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-46.xml auth{0=1} v893 ap=1 s=19292 n(v0 rc2023-08-10T11:55:13.420573+0000 b19292 1=1+0) (ifile excl) (iversion lock) cr={15318=0-4194304@4} caps={15318=pAsLsXsFsxcrwb/pFscr@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc278b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009a5:[<0x10000000861/article-46.xml v880>,<0x1000000035d/blog-11 v115821>,<0x10000000206/blogtest_in v1433>,<0x10000000201/src v1683>,<0x10000000006/blogbench-1.0 v1462>,<0x10000000005/tmp v65>,<0x100000001fb/client.0 v63>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v84>,<0x10000000001/sv_1 v101>,<0x10000000000/_nogroup v85>,<0x1/volumes v83>]//[]","memoryvalue":"(3)0x100000009a5:[<0x10000000861/article-46.xml v893>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.260 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.051+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000882 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-47.xml auth{0=1} v710 ap=1 s=15499 n(v0 rc2023-08-10T11:53:53.150476+0000 b15499 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc279080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000882:[<0x10000000861/article-47.xml v710>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000882:[<0x10000000861/article-47.xml v710>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.260 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.052+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008b1 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-22.jpg auth{0=1} v736 ap=1 s=24140 n(v0 rc2023-08-10T11:53:53.245474+0000 b24140 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc279b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008b1:[<0x10000000861/picture-22.jpg v736>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008b1:[<0x10000000861/picture-22.jpg v736>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.260 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.052+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008a6 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-11.xml auth{0=1} v700 ap=1 s=2560 n(v0 rc2023-08-10T11:53:53.222475+0000 b2560 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc27a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008a6:[<0x10000000861/article-11.xml v700>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008a6:[<0x10000000861/article-11.xml v700>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.260 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.053+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008a1 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-16.xml auth{0=1} v642 ap=1 s=2895 n(v0 rc2023-08-10T11:53:53.212475+0000 b2895 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc27ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008a1:[<0x10000000861/article-16.xml v642>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008a1:[<0x10000000861/article-16.xml v642>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.260 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.054+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000087b [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-54.xml auth{0=1} v776 ap=1 s=16546 n(v0 rc2023-08-10T11:53:53.135477+0000 b16546 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc27b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000087b:[<0x10000000861/article-54.xml v776>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000087b:[<0x10000000861/article-54.xml v776>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.260 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.054+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008b8 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-15.jpg auth{0=1} v732 ap=1 s=54419 n(v0 rc2023-08-10T11:53:53.268474+0000 b54419 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561ccdba580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008b8:[<0x10000000861/picture-15.jpg v732>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008b8:[<0x10000000861/picture-15.jpg v732>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.260 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.055+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008a7 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-10.xml auth{0=1} v748 ap=1 s=5886 n(v0 rc2023-08-10T11:53:53.224475+0000 b5886 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561ccdbab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008a7:[<0x10000000861/article-10.xml v748>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008a7:[<0x10000000861/article-10.xml v748>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.261 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.056+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008bb [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-12.jpg auth{0=1} v672 ap=1 s=35903 n(v0 rc2023-08-10T11:53:53.276473+0000 b35903 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561ccdbb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008bb:[<0x10000000861/picture-12.jpg v672>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008bb:[<0x10000000861/picture-12.jpg v672>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.261 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.057+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000881 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-48.xml auth{0=1} v808 ap=1 s=25732 n(v0 rc2023-08-10T11:53:53.148476+0000 b25732 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561ccdbbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000881:[<0x10000000861/article-48.xml v808>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000881:[<0x10000000861/article-48.xml v808>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.261 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.058+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000897 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-26.xml auth{0=1} v680 ap=1 s=18998 n(v0 rc2023-08-10T11:53:53.193475+0000 b18998 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561ccdba000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000897:[<0x10000000861/article-26.xml v680>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000897:[<0x10000000861/article-26.xml v680>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.261 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.059+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000898 [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-25.xml auth{0=1} v786 ap=1 s=5861 n(v0 rc2023-08-10T11:53:53.195475+0000 b5861 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561ccdbcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000898:[<0x10000000861/article-25.xml v786>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000898:[<0x10000000861/article-25.xml v786>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.261 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.059+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008ad [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-4.xml auth{0=1} v798 ap=1 s=27545 n(v0 rc2023-08-10T11:53:53.236474+0000 b27545 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561ccdbc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008ad:[<0x10000000861/article-4.xml v798>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000008ad:[<0x10000000861/article-4.xml v798>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.262 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.059+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000086a [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-71.xml auth{0=1} v790 ap=1 s=8663 n(v0 rc2023-08-10T11:53:53.101478+0000 b8663 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561cc279600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000086a:[<0x10000000861/article-71.xml v790>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000086a:[<0x10000000861/article-71.xml v790>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:16.262 INFO:journalctl@ceph.mds.h.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mds-h[155291]: 2023-08-10T11:57:16.059+0000 7f7baab14700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000088b [3,head] /volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-38.xml auth{0=1} v638 ap=1 s=10929 n(v0 rc2023-08-10T11:53:53.170476+0000 b10929 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15318=0-4194304@2} caps={15318=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15318 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5561ccdbd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000088b:[<0x10000000861/article-38.xml v638>,<0x1000000035d/blog-11 v11628>,<0x10000000206/blogtest_in v281>,<0x10000000201/src v1663>,<0x10000000006/blogbench-1.0 v1441>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v36>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v51>,<0x10000000001/sv_1 v72>,<0x10000000000/_nogroup v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000088b:[<0x10000000861/article-38.xml v638>,<0x1000000035d/blog-11 v138477>,<0x10000000206/blogtest_in v2263>,<0x10000000201/src v1707>,<0x10000000006/blogbench-1.0 v1439>,<0x10000000005/tmp v44>,<0x100000001fb/client.0 v44>,<0x100000001fa/0b107504-3b45-4e9e-bf20-13a87924d8c8 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/_nogroup v75>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-10T11:57:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:17.038+0000 7f77f2ffd700 1 -- 172.21.15.73:0/2236429583 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7f780c003d60 con 0x556f9294ad90 2023-08-10T11:57:17.040 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:17.038+0000 7f77f2ffd700 10 client.25840 handle_command_reply: tid=0 2023-08-10T11:57:17.040 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:17.038+0000 7f7825fd1b80 1 client.25840 shutdown 2023-08-10T11:57:17.051 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:17.050+0000 7f7825fd1b80 1 -- 172.21.15.73:0/2236429583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556f928e1cc0 msgr2=0x556f928eb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:17.052 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:17.050+0000 7f7825fd1b80 1 --2- 172.21.15.73:0/2236429583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556f928e1cc0 0x556f928eb750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f780c004a30 tx=0x7f780c02c750 comp rx=0 tx=0).stop 2023-08-10T11:57:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:17.051+0000 7f7825fd1b80 1 -- 172.21.15.73:0/2236429583 shutdown_connections 2023-08-10T11:57:17.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:17.051+0000 7f7825fd1b80 1 --2- 172.21.15.73:0/2236429583 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x556f9294ad90 0x556f9294d180 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:17.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:17.051+0000 7f7825fd1b80 1 --2- 172.21.15.73:0/2236429583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f928dc010 0x556f928ecf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:17.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:17.051+0000 7f7825fd1b80 1 --2- 172.21.15.73:0/2236429583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556f928e1cc0 0x556f928eb750 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:17.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:17.051+0000 7f7825fd1b80 1 --2- 172.21.15.73:0/2236429583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556f928dc9d0 0x556f928eb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:17.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:17.051+0000 7f7825fd1b80 1 -- 172.21.15.73:0/2236429583 >> 172.21.15.73:0/2236429583 conn(0x556f92839c70 msgr2=0x556f928e6570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:17.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:17.051+0000 7f77f2ffd700 0 client.25840 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:57:17.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:17.052+0000 7f7825fd1b80 1 -- 172.21.15.73:0/2236429583 shutdown_connections 2023-08-10T11:57:17.057 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:17.052+0000 7f7825fd1b80 1 -- 172.21.15.73:0/2236429583 wait complete. 2023-08-10T11:57:17.057 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:17.052+0000 7f7825fd1b80 20 client.25840 trim_cache size 0 max 16384 2023-08-10T11:57:17.057 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:57:17.057 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:57:17.057 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:57:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:57:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:17.053+0000 7f7818bd6700 1 -- 172.21.15.73:0/2580533102 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f77fc0a14d0 msgr2=0x7f77fc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:17.053+0000 7f7818bd6700 1 --2- 172.21.15.73:0/2580533102 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f77fc0a14d0 0x7f77fc0a3990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f780400d4f0 tx=0x7f7804017040 comp rx=0 tx=0).stop 2023-08-10T11:57:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:17.053+0000 7f7818bd6700 1 -- 172.21.15.73:0/2580533102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78140824c0 msgr2=0x7f781407bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:17.060 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:17.053+0000 7f7818bd6700 1 --2- 172.21.15.73:0/2580533102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78140824c0 0x7f781407bf60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f781410d970 tx=0x7f7808009ad0 comp rx=0 tx=0).stop 2023-08-10T11:57:17.060 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:17.053+0000 7f7818bd6700 1 -- 172.21.15.73:0/2580533102 shutdown_connections 2023-08-10T11:57:17.060 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:17.053+0000 7f7818bd6700 1 --2- 172.21.15.73:0/2580533102 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f77fc0a14d0 0x7f77fc0a3990 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:17.061 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:17.053+0000 7f7818bd6700 1 --2- 172.21.15.73:0/2580533102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f781407c4a0 0x7f781407c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:17.061 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:17.053+0000 7f7818bd6700 1 --2- 172.21.15.73:0/2580533102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f781410be90 0x7f7814081f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:17.061 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:17.053+0000 7f7818bd6700 1 --2- 172.21.15.73:0/2580533102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78140824c0 0x7f781407bf60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:17.053+0000 7f7818bd6700 1 -- 172.21.15.73:0/2580533102 >> 172.21.15.73:0/2580533102 conn(0x7f7814071a60 msgr2=0x7f781410a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:17.053+0000 7f7818bd6700 1 -- 172.21.15.73:0/2580533102 shutdown_connections 2023-08-10T11:57:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:17.053+0000 7f7818bd6700 1 -- 172.21.15.73:0/2580533102 wait complete. 2023-08-10T11:57:17.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: pgmap v142: 97 pgs: 97 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 717 op/s 2023-08-10T11:57:17.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008ba (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-13.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000867 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-74.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000876 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-59.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000089f (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-18.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008b5 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-18.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000087e (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-51.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008c3 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-4.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008b4 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-19.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000896 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-27.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008c5 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-2.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000086b (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-70.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.248 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000089d (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-20.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.248 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008b9 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-14.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.248 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000874 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-61.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.248 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000888 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-41.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.248 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000086c (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-69.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.248 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000d46 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-7.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.248 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000892 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-31.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.249 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008be (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-9.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.249 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008bd (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-10.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.249 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008c6 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-1.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.249 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008a8 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-9.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.250 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008c1 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-6.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.250 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000885 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-44.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.250 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000873 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-62.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.250 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000899 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-24.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.250 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000870 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-65.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.251 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008b6 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-17.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.251 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000086e (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-67.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.251 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008ae (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-3.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.251 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000951 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-24.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.251 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008aa (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-7.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.251 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000009a2 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-68.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.251 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008ca (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-55.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.252 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008a9 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-8.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.252 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008c9 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-31.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.252 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000086d (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-68.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.252 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000865 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-76.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.252 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008bf (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-8.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.252 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000891 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-32.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.252 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000d47 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-21.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.253 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000893 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-30.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.253 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008a4 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-13.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.253 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000087f (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-50.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.253 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008ab (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-6.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.253 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000009a3 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-56.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.253 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008af (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-2.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.253 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000886 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-43.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.254 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000890 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-33.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.254 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008c2 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-5.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.254 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000878 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-57.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.254 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000877 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-58.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.254 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000087c (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-53.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.254 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000895 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-28.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.254 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000087d (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-52.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.255 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000862 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-79.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.255 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008c4 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-3.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.255 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008ac (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-5.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.255 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000088f (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-34.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.256 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000863 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-78.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.256 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000894 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-29.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.256 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008bc (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-11.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.256 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000952 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-81.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.257 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000089b (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-22.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.257 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000880 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-49.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.257 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000942 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-14.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.257 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000875 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-60.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.257 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008c8 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-84.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.257 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000009a4 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-60.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.257 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000009a5 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-46.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.258 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000882 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-47.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.258 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008b1 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-22.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.258 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008a6 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-11.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.258 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008a1 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-16.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.258 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000087b (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-54.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.258 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008b8 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-15.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.258 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008a7 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-10.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.259 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008bb (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-12.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.259 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000881 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-48.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.259 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000897 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-26.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.259 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x10000000898 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-25.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.259 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x100000008ad (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-4.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.259 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000086a (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-71.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.260 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:16 smithi152 ceph-mon[130220]: Scrub error on inode 0x1000000088b (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-38.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.261 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: pgmap v142: 97 pgs: 97 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 717 op/s 2023-08-10T11:57:17.261 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008ba (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-13.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.261 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000867 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-74.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.261 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000876 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-59.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.261 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000089f (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-18.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.261 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008b5 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-18.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.262 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000087e (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-51.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.262 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008c3 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-4.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.262 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008b4 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-19.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.262 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000896 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-27.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.262 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008c5 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-2.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.262 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000086b (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-70.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.262 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000089d (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-20.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.263 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008b9 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-14.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.263 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000874 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-61.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.263 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000888 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-41.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.263 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000086c (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-69.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.263 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000d46 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-7.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.263 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000892 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-31.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.263 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008be (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-9.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.264 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008bd (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-10.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.264 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008c6 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-1.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.264 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008a8 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-9.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.264 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008c1 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-6.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.264 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000885 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-44.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.265 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000873 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-62.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.265 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000899 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-24.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.265 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000870 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-65.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.265 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008b6 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-17.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.265 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000086e (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-67.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.265 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008ae (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-3.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.265 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000951 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-24.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.266 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008aa (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-7.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.266 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000009a2 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-68.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.266 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008ca (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-55.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.266 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008a9 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-8.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.266 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008c9 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-31.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.266 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000086d (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-68.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.267 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000865 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-76.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.267 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008bf (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-8.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.267 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000891 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-32.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.267 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000d47 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-21.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.267 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000893 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-30.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.267 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008a4 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-13.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.267 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000087f (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-50.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.268 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008ab (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-6.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.268 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000009a3 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-56.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.268 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008af (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-2.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.268 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000886 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-43.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.268 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000890 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-33.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.268 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008c2 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-5.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.268 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000878 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-57.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.269 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000877 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-58.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.269 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000087c (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-53.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.269 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000895 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-28.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.269 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000087d (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-52.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.269 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000862 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-79.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.269 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008c4 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-3.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.269 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008ac (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-5.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.269 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000088f (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-34.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.270 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000863 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-78.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.270 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000894 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-29.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.270 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008bc (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-11.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.270 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000952 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-81.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.270 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000089b (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-22.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.270 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000880 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-49.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.270 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000942 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-14.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.271 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000875 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-60.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.271 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008c8 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-84.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.271 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000009a4 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-60.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.271 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000009a5 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-46.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.271 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000882 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-47.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.271 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008b1 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-22.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.271 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008a6 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-11.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.271 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008a1 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-16.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.272 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000087b (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-54.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.272 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008b8 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-15.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.272 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008a7 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-10.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.272 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008bb (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-12.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.272 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000881 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-48.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.272 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000897 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-26.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.272 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x10000000898 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-25.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.273 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x100000008ad (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-4.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.273 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000086a (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-71.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.273 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:16 smithi156 ceph-mon[130574]: Scrub error on inode 0x1000000088b (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-38.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.274 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: pgmap v142: 97 pgs: 97 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 717 op/s 2023-08-10T11:57:17.274 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008ba (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-13.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.274 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000867 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-74.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.274 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000876 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-59.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.274 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000089f (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-18.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.274 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008b5 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-18.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.275 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000087e (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-51.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.275 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008c3 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-4.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.275 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008b4 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-19.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.275 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000896 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-27.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.275 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008c5 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-2.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.275 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000086b (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-70.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.275 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000089d (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-20.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.276 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008b9 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-14.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.276 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000874 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-61.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.276 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000888 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-41.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.276 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000086c (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-69.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.276 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000d46 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-7.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.276 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000892 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-31.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.276 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008be (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-9.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.277 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008bd (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-10.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.277 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008c6 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-1.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.277 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008a8 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-9.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.277 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008c1 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-6.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.277 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000885 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-44.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.277 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000873 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-62.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.278 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000899 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-24.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.278 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000870 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-65.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.278 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008b6 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-17.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.278 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000086e (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-67.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.278 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008ae (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-3.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.278 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000951 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-24.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.278 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008aa (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-7.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.279 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000009a2 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-68.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.279 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008ca (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-55.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.279 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008a9 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-8.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.279 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008c9 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-31.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.279 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000086d (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-68.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.279 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000865 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-76.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.279 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008bf (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-8.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.280 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000891 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-32.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.280 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000d47 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-21.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.280 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000893 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-30.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.280 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008a4 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-13.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.280 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000087f (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-50.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.280 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008ab (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-6.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.281 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000009a3 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-56.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.281 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008af (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-2.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.281 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000886 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-43.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.281 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000890 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-33.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.281 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008c2 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-5.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.282 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000878 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-57.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.282 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000877 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-58.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.282 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000087c (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-53.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.282 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000895 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-28.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.282 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000087d (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-52.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.282 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000862 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-79.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.282 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008c4 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-3.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.283 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008ac (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-5.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.283 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000088f (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-34.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.283 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000863 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-78.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.283 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000894 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-29.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.283 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008bc (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-11.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.284 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000952 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-81.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.284 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000089b (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-22.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.284 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000880 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-49.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.284 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000942 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-14.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.284 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000875 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-60.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.284 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008c8 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-84.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.285 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000009a4 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-60.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.285 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000009a5 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-46.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.285 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000882 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-47.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.285 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008b1 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-22.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.285 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008a6 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-11.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.285 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008a1 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-16.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.285 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000087b (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-54.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.285 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008b8 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-15.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.286 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008a7 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-10.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.286 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008bb (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-12.jpg) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.286 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000881 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-48.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.286 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000897 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-26.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.286 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x10000000898 (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-25.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.286 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x100000008ad (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-4.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.286 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000086a (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-71.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:17.287 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:16 smithi073 ceph-mon[128869]: Scrub error on inode 0x1000000088b (/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-38.xml) see mds.h log and `damage ls` output for details 2023-08-10T11:57:18.123 INFO:tasks.workunit.client.0.smithi073.stdout: 272 2107617 652 1372819 400 656572 680 2023-08-10T11:57:19.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:18 smithi152 ceph-mon[130220]: pgmap v143: 97 pgs: 97 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 648 op/s 2023-08-10T11:57:19.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:18 smithi156 ceph-mon[130574]: pgmap v143: 97 pgs: 97 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 648 op/s 2023-08-10T11:57:19.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:18 smithi073 ceph-mon[128869]: pgmap v143: 97 pgs: 97 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 648 op/s 2023-08-10T11:57:19.485 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:57:21.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:20 smithi152 ceph-mon[130220]: pgmap v144: 97 pgs: 97 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 15 MiB/s wr, 972 op/s 2023-08-10T11:57:21.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:20 smithi156 ceph-mon[130574]: pgmap v144: 97 pgs: 97 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 15 MiB/s wr, 972 op/s 2023-08-10T11:57:21.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.255+0000 7ff111c14700 1 -- 172.21.15.73:0/2043633150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff10c10ee20 msgr2=0x7ff10c10c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:21.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.255+0000 7ff111c14700 1 --2- 172.21.15.73:0/2043633150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff10c10ee20 0x7ff10c10c9b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc009990 tx=0x7ff0fc009ca0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.258+0000 7ff111c14700 1 -- 172.21.15.73:0/2043633150 shutdown_connections 2023-08-10T11:57:21.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.258+0000 7ff111c14700 1 --2- 172.21.15.73:0/2043633150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff10c119f50 0x7ff10c11c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.258+0000 7ff111c14700 1 --2- 172.21.15.73:0/2043633150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff10c10ee20 0x7ff10c10c9b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.258+0000 7ff111c14700 1 --2- 172.21.15.73:0/2043633150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff10c10f290 0x7ff10c10cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.258+0000 7ff111c14700 1 -- 172.21.15.73:0/2043633150 >> 172.21.15.73:0/2043633150 conn(0x7ff10c06ca30 msgr2=0x7ff10c06ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:21.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.259+0000 7ff111c14700 1 -- 172.21.15.73:0/2043633150 shutdown_connections 2023-08-10T11:57:21.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.259+0000 7ff111c14700 1 -- 172.21.15.73:0/2043633150 wait complete. 2023-08-10T11:57:21.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.260+0000 7ff111c14700 1 Processor -- start 2023-08-10T11:57:21.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.261+0000 7ff111c14700 1 -- start start 2023-08-10T11:57:21.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.261+0000 7ff111c14700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff10c10ee20 0x7ff10c113310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:21.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.261+0000 7ff111c14700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff10c10f290 0x7ff10c113850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:21.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.261+0000 7ff111c14700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff10c119f50 0x7ff10c117cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:21.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.261+0000 7ff111c14700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c1182f0 con 0x7ff10c119f50 2023-08-10T11:57:21.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.261+0000 7ff111c14700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c118460 con 0x7ff10c10ee20 2023-08-10T11:57:21.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.261+0000 7ff111c14700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c118620 con 0x7ff10c10f290 2023-08-10T11:57:21.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.261+0000 7ff10b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff10c10ee20 0x7ff10c113310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:21.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.261+0000 7ff10b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff10c10ee20 0x7ff10c113310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49692/0 (socket says 172.21.15.73:49692) 2023-08-10T11:57:21.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.261+0000 7ff10b7fe700 1 -- 172.21.15.73:0/998501328 learned_addr learned my addr 172.21.15.73:0/998501328 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:57:21.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.262+0000 7ff10affd700 1 --2- 172.21.15.73:0/998501328 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff10c10f290 0x7ff10c113850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:21.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.262+0000 7ff10b7fe700 1 -- 172.21.15.73:0/998501328 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff10c10f290 msgr2=0x7ff10c113850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:21.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.262+0000 7ff10b7fe700 1 --2- 172.21.15.73:0/998501328 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff10c10f290 0x7ff10c113850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.262+0000 7ff10b7fe700 1 -- 172.21.15.73:0/998501328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff10c119f50 msgr2=0x7ff10c117cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:21.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.262+0000 7ff10b7fe700 1 --2- 172.21.15.73:0/998501328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff10c119f50 0x7ff10c117cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.262+0000 7ff10b7fe700 1 -- 172.21.15.73:0/998501328 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc0095f0 con 0x7ff10c10ee20 2023-08-10T11:57:21.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.264+0000 7ff10b7fe700 1 --2- 172.21.15.73:0/998501328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff10c10ee20 0x7ff10c113310 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0098e0 tx=0x7ff0fc00f740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:21.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.264+0000 7ff108ff9700 1 -- 172.21.15.73:0/998501328 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc01d070 con 0x7ff10c10ee20 2023-08-10T11:57:21.279 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:20 smithi073 ceph-mon[128869]: pgmap v144: 97 pgs: 97 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 15 MiB/s wr, 972 op/s 2023-08-10T11:57:21.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.265+0000 7ff111c14700 1 -- 172.21.15.73:0/998501328 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff10c1188a0 con 0x7ff10c10ee20 2023-08-10T11:57:21.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.265+0000 7ff111c14700 1 -- 172.21.15.73:0/998501328 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff10c1baca0 con 0x7ff10c10ee20 2023-08-10T11:57:21.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.271+0000 7ff11ddadb80 1 Processor -- start 2023-08-10T11:57:21.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.279+0000 7ff11ddadb80 1 -- start start 2023-08-10T11:57:21.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.279+0000 7ff108ff9700 1 -- 172.21.15.73:0/998501328 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff0fc0054f0 con 0x7ff10c10ee20 2023-08-10T11:57:21.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.279+0000 7ff108ff9700 1 -- 172.21.15.73:0/998501328 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc017880 con 0x7ff10c10ee20 2023-08-10T11:57:21.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.280+0000 7ff11ddadb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5191c3f50 0x55c5191c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:21.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.280+0000 7ff11ddadb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5191c4870 0x55c5191be2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:21.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.280+0000 7ff11ddadb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5191be800 0x55c5191bec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:21.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.280+0000 7ff11ddadb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c519139dc0 con 0x55c5191be800 2023-08-10T11:57:21.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.280+0000 7ff11ddadb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c519116590 con 0x55c5191c4870 2023-08-10T11:57:21.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.280+0000 7ff11ddadb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c519113eb0 con 0x55c5191c3f50 2023-08-10T11:57:21.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.280+0000 7ff10bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5191c3f50 0x55c5191c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:21.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.280+0000 7ff10bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5191c3f50 0x55c5191c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60552/0 (socket says 172.21.15.73:60552) 2023-08-10T11:57:21.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.280+0000 7ff10bfff700 1 -- 172.21.15.73:0/1270518923 learned_addr learned my addr 172.21.15.73:0/1270518923 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:57:21.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.281+0000 7ff10bfff700 1 -- 172.21.15.73:0/1270518923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5191c4870 msgr2=0x55c5191be2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T11:57:21.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.281+0000 7ff10bfff700 1 --2- 172.21.15.73:0/1270518923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5191c4870 0x55c5191be2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.281+0000 7ff10bfff700 1 -- 172.21.15.73:0/1270518923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5191be800 msgr2=0x55c5191bec80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T11:57:21.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.281+0000 7ff10bfff700 1 --2- 172.21.15.73:0/1270518923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5191be800 0x55c5191bec80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.281+0000 7ff10bfff700 1 -- 172.21.15.73:0/1270518923 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c518f90630 con 0x55c5191c3f50 2023-08-10T11:57:21.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.281+0000 7ff10bfff700 1 --2- 172.21.15.73:0/1270518923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5191c3f50 0x55c5191c4330 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff104009ce0 tx=0x7ff1040094a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b276315f9170e85a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:21.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.281+0000 7ff0f1ffb700 1 -- 172.21.15.73:0/1270518923 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff104004bb0 con 0x55c5191c3f50 2023-08-10T11:57:21.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.281+0000 7ff0f1ffb700 1 -- 172.21.15.73:0/1270518923 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff10400f040 con 0x55c5191c3f50 2023-08-10T11:57:21.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.281+0000 7ff0f1ffb700 1 -- 172.21.15.73:0/1270518923 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff104013650 con 0x55c5191c3f50 2023-08-10T11:57:21.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.282+0000 7ff108ff9700 1 -- 172.21.15.73:0/998501328 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7ff0fc00fba0 con 0x7ff10c10ee20 2023-08-10T11:57:21.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.282+0000 7ff108ff9700 1 --2- 172.21.15.73:0/998501328 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ff0f40a1380 0x7ff0f40a3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:21.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.282+0000 7ff11ddadb80 1 -- 172.21.15.73:0/1270518923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5191c3f50 msgr2=0x55c5191c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:21.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.282+0000 7ff11ddadb80 1 --2- 172.21.15.73:0/1270518923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5191c3f50 0x55c5191c4330 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff104009ce0 tx=0x7ff1040094a0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.283+0000 7ff108ff9700 1 -- 172.21.15.73:0/998501328 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ff0fc0cde30 con 0x7ff10c10ee20 2023-08-10T11:57:21.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.283+0000 7ff11ddadb80 1 -- 172.21.15.73:0/1270518923 shutdown_connections 2023-08-10T11:57:21.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.283+0000 7ff11ddadb80 1 --2- 172.21.15.73:0/1270518923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5191be800 0x55c5191bec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.283+0000 7ff11ddadb80 1 --2- 172.21.15.73:0/1270518923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5191c3f50 0x55c5191c4330 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.283+0000 7ff11ddadb80 1 --2- 172.21.15.73:0/1270518923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5191c4870 0x55c5191be2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.283+0000 7ff11ddadb80 1 -- 172.21.15.73:0/1270518923 >> 172.21.15.73:0/1270518923 conn(0x55c51911bcd0 msgr2=0x55c5191b94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:21.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.285+0000 7ff10b7fe700 1 --2- 172.21.15.73:0/998501328 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ff0f40a1380 0x7ff0f40a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:21.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.289+0000 7ff11ddadb80 1 -- 172.21.15.73:0/1270518923 shutdown_connections 2023-08-10T11:57:21.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.289+0000 7ff11ddadb80 1 -- 172.21.15.73:0/1270518923 wait complete. 2023-08-10T11:57:21.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.290+0000 7ff10b7fe700 1 --2- 172.21.15.73:0/998501328 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ff0f40a1380 0x7ff0f40a3840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x55c5191c4cf0 tx=0x7ff0fc016f30 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:21.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.290+0000 7ff11ddadb80 1 -- start start 2023-08-10T11:57:21.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.290+0000 7ff11ddadb80 1 Processor -- start 2023-08-10T11:57:21.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.290+0000 7ff11ddadb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5191be800 0x55c5191ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:21.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.291+0000 7ff11ddadb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5191c3f50 0x55c5191c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:21.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.291+0000 7ff11ddadb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5191c4870 0x55c5191c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:21.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.291+0000 7ff11ddadb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c51910f7a0 con 0x55c5191c3f50 2023-08-10T11:57:21.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.291+0000 7ff11ddadb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5190aeac0 con 0x55c5191c4870 2023-08-10T11:57:21.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.291+0000 7ff11ddadb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5190ae7c0 con 0x55c5191be800 2023-08-10T11:57:21.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.291+0000 7ff11ddadb80 10 client.0 _ll_register_callbacks cb 0x55c5190ac680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:57:21.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.291+0000 7ff10bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5191be800 0x55c5191ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:21.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.291+0000 7ff10bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5191be800 0x55c5191ca8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60558/0 (socket says 172.21.15.73:60558) 2023-08-10T11:57:21.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.291+0000 7ff10bfff700 1 -- 172.21.15.73:0/330341642 learned_addr learned my addr 172.21.15.73:0/330341642 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:57:21.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.291+0000 7ff10bfff700 1 --2- 172.21.15.73:0/330341642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5191c4870 0x55c5191c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:21.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.291+0000 7ff10affd700 1 --2- 172.21.15.73:0/330341642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5191c3f50 0x55c5191c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:21.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.291+0000 7ff10bfff700 1 -- 172.21.15.73:0/330341642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5191c4870 msgr2=0x55c5191c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:21.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.291+0000 7ff10bfff700 1 --2- 172.21.15.73:0/330341642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5191c4870 0x55c5191c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.291+0000 7ff10bfff700 1 -- 172.21.15.73:0/330341642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5191c3f50 msgr2=0x55c5191c7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:21.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.291+0000 7ff10bfff700 1 --2- 172.21.15.73:0/330341642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5191c3f50 0x55c5191c7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.291+0000 7ff10bfff700 1 -- 172.21.15.73:0/330341642 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff104009910 con 0x55c5191be800 2023-08-10T11:57:21.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.292+0000 7ff10bfff700 1 --2- 172.21.15.73:0/330341642 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5191be800 0x55c5191ca8b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff104005880 tx=0x7ff104005ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fad28fd64094c93 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:21.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.292+0000 7ff0eaffd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T11:57:21.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.292+0000 7ff0eaffd700 1 -- 172.21.15.73:0/330341642 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff104003a00 con 0x55c5191be800 2023-08-10T11:57:21.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.292+0000 7ff0eaffd700 1 -- 172.21.15.73:0/330341642 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ff104003b60 con 0x55c5191be800 2023-08-10T11:57:21.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.292+0000 7ff11ddadb80 1 -- 172.21.15.73:0/330341642 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c5191b1470 con 0x55c5191be800 2023-08-10T11:57:21.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.292+0000 7ff0eaffd700 1 -- 172.21.15.73:0/330341642 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff104003d20 con 0x55c5191be800 2023-08-10T11:57:21.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.292+0000 7ff11ddadb80 10 client.25852 fetch_fsmap learned FSMap version 38 2023-08-10T11:57:21.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.292+0000 7ff11ddadb80 1 -- 172.21.15.73:0/330341642 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x55c518f3cde0 con 0x55c5191be800 2023-08-10T11:57:21.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.292+0000 7ff0eaffd700 1 -- 172.21.15.73:0/330341642 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff10402f080 con 0x55c5191be800 2023-08-10T11:57:21.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.292+0000 7ff0eaffd700 1 -- 172.21.15.73:0/330341642 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 38) v1 ==== 7526+0+0 (secure 0 0 0) 0x7ff10401e410 con 0x55c5191be800 2023-08-10T11:57:21.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.292+0000 7ff11ddadb80 10 client.25852 fetch_fsmap finished waiting for FSMap version 38 2023-08-10T11:57:21.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.292+0000 7ff11ddadb80 10 client.25852 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:57:21.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.292+0000 7ff11ddadb80 20 client.25852 populate_metadata read hostname 'smithi073' 2023-08-10T11:57:21.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.292+0000 7ff11ddadb80 1 --2- 172.21.15.73:0/330341642 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c5191d82d0 0x55c5191da6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:21.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.292+0000 7ff11ddadb80 4 client.25852 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:57:21.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.292+0000 7ff11ddadb80 1 -- 172.21.15.73:0/330341642 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c51918d9d0 con 0x55c5191d82d0 2023-08-10T11:57:21.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.293+0000 7ff10affd700 1 --2- 172.21.15.73:0/330341642 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c5191d82d0 0x55c5191da6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:21.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.293+0000 7ff0eaffd700 10 client.25852 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:57:21.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.293+0000 7ff10affd700 1 --2- 172.21.15.73:0/330341642 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c5191d82d0 0x55c5191da6f0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0ccf14d7abb2b72 server_cookie=5dfb3381b5f9d094 in_seq=0 out_seq=0 2023-08-10T11:57:21.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.294+0000 7ff0eaffd700 1 -- 172.21.15.73:0/330341642 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55c51918d9d0 con 0x55c5191d82d0 2023-08-10T11:57:21.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.294+0000 7ff0eaffd700 10 client.25852 handle_command_reply: tid=0 2023-08-10T11:57:21.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.294+0000 7ff11ddadb80 1 client.25852 shutdown 2023-08-10T11:57:21.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.295+0000 7ff11ddadb80 1 -- 172.21.15.73:0/330341642 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5191be800 msgr2=0x55c5191ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:21.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.295+0000 7ff11ddadb80 1 --2- 172.21.15.73:0/330341642 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5191be800 0x55c5191ca8b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff104005880 tx=0x7ff104005ab0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.295+0000 7ff11ddadb80 1 -- 172.21.15.73:0/330341642 shutdown_connections 2023-08-10T11:57:21.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.295+0000 7ff11ddadb80 1 --2- 172.21.15.73:0/330341642 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c5191d82d0 0x55c5191da6f0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.295+0000 7ff0eaffd700 0 client.25852 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:57:21.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.295+0000 7ff11ddadb80 1 --2- 172.21.15.73:0/330341642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5191c4870 0x55c5191c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.295+0000 7ff11ddadb80 1 --2- 172.21.15.73:0/330341642 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5191be800 0x55c5191ca8b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.295+0000 7ff11ddadb80 1 --2- 172.21.15.73:0/330341642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5191c3f50 0x55c5191c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.295+0000 7ff11ddadb80 1 -- 172.21.15.73:0/330341642 >> 172.21.15.73:0/330341642 conn(0x55c51911bcd0 msgr2=0x55c5191b89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:21.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.295+0000 7ff11ddadb80 1 -- 172.21.15.73:0/330341642 shutdown_connections 2023-08-10T11:57:21.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.295+0000 7ff11ddadb80 1 -- 172.21.15.73:0/330341642 wait complete. 2023-08-10T11:57:21.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.295+0000 7ff11ddadb80 20 client.25852 trim_cache size 0 max 16384 2023-08-10T11:57:21.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.331+0000 7ff11ddadb80 1 Processor -- start 2023-08-10T11:57:21.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.331+0000 7ff11ddadb80 1 -- start start 2023-08-10T11:57:21.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.331+0000 7ff11ddadb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5191be800 0x55c5191be2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:21.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.331+0000 7ff11ddadb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5191c3f50 0x55c5191c3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:21.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.331+0000 7ff11ddadb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5191c4870 0x55c5191c5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:21.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.331+0000 7ff11ddadb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c518f92920 con 0x55c5191be800 2023-08-10T11:57:21.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.331+0000 7ff11ddadb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5191d4340 con 0x55c5191c3f50 2023-08-10T11:57:21.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.331+0000 7ff11ddadb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5191b0fb0 con 0x55c5191c4870 2023-08-10T11:57:21.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.332+0000 7ff10bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5191c4870 0x55c5191c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:21.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.332+0000 7ff10bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5191c4870 0x55c5191c5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60568/0 (socket says 172.21.15.73:60568) 2023-08-10T11:57:21.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.332+0000 7ff10bfff700 1 -- 172.21.15.73:0/2704480370 learned_addr learned my addr 172.21.15.73:0/2704480370 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:57:21.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.332+0000 7ff10bfff700 1 --2- 172.21.15.73:0/2704480370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5191be800 0x55c5191be2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:21.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.332+0000 7ff10affd700 1 --2- 172.21.15.73:0/2704480370 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5191c3f50 0x55c5191c3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:21.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.391+0000 7ff10bfff700 1 -- 172.21.15.73:0/2704480370 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5191c3f50 msgr2=0x55c5191c3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:21.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.391+0000 7ff10bfff700 1 --2- 172.21.15.73:0/2704480370 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5191c3f50 0x55c5191c3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.391+0000 7ff10bfff700 1 -- 172.21.15.73:0/2704480370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5191be800 msgr2=0x55c5191be2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:21.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.391+0000 7ff10bfff700 1 --2- 172.21.15.73:0/2704480370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5191be800 0x55c5191be2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.391+0000 7ff10bfff700 1 -- 172.21.15.73:0/2704480370 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c518f25c60 con 0x55c5191c4870 2023-08-10T11:57:21.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.391+0000 7ff10bfff700 1 --2- 172.21.15.73:0/2704480370 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5191c4870 0x55c5191c5430 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff1040059f0 tx=0x7ff104006160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42a5e3f5279b8ec8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:21.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.391+0000 7ff0f27fc700 1 -- 172.21.15.73:0/2704480370 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff104004c70 con 0x55c5191c4870 2023-08-10T11:57:21.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.391+0000 7ff0f27fc700 1 -- 172.21.15.73:0/2704480370 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c5191b1470 con 0x55c5191c4870 2023-08-10T11:57:21.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.391+0000 7ff0f27fc700 1 -- 172.21.15.73:0/2704480370 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10401e410 con 0x55c5191c4870 2023-08-10T11:57:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.496+0000 7ff11ddadb80 1 -- 172.21.15.73:0/2704480370 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5191c4870 msgr2=0x55c5191c5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.496+0000 7ff11ddadb80 1 --2- 172.21.15.73:0/2704480370 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5191c4870 0x55c5191c5430 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff1040059f0 tx=0x7ff104006160 comp rx=0 tx=0).stop 2023-08-10T11:57:21.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.501+0000 7ff11ddadb80 1 -- 172.21.15.73:0/2704480370 shutdown_connections 2023-08-10T11:57:21.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.501+0000 7ff11ddadb80 1 --2- 172.21.15.73:0/2704480370 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5191c4870 0x55c5191c5430 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.501+0000 7ff11ddadb80 1 --2- 172.21.15.73:0/2704480370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5191be800 0x55c5191be2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.501+0000 7ff11ddadb80 1 --2- 172.21.15.73:0/2704480370 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5191c3f50 0x55c5191c3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.501+0000 7ff11ddadb80 1 -- 172.21.15.73:0/2704480370 >> 172.21.15.73:0/2704480370 conn(0x55c51911bcd0 msgr2=0x55c5191c4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:21.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.501+0000 7ff11ddadb80 1 -- 172.21.15.73:0/2704480370 shutdown_connections 2023-08-10T11:57:21.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.501+0000 7ff11ddadb80 1 -- 172.21.15.73:0/2704480370 wait complete. 2023-08-10T11:57:21.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.502+0000 7ff11ddadb80 1 -- start start 2023-08-10T11:57:21.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.502+0000 7ff11ddadb80 1 Processor -- start 2023-08-10T11:57:21.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.503+0000 7ff11ddadb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5191be800 0x55c5191c0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:21.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.503+0000 7ff11ddadb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5191c3f50 0x55c5191bf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:21.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.503+0000 7ff11ddadb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5191c4870 0x55c5191bfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:21.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.503+0000 7ff11ddadb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5191c16e0 con 0x55c5191be800 2023-08-10T11:57:21.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.503+0000 7ff11ddadb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5191c03f0 con 0x55c5191c3f50 2023-08-10T11:57:21.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.503+0000 7ff11ddadb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5191c05b0 con 0x55c5191c4870 2023-08-10T11:57:21.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.503+0000 7ff11ddadb80 10 client.0 _ll_register_callbacks cb 0x55c5190ac680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:57:21.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.503+0000 7ff10affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5191c3f50 0x55c5191bf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:21.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.503+0000 7ff10affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5191c3f50 0x55c5191bf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49718/0 (socket says 172.21.15.73:49718) 2023-08-10T11:57:21.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.503+0000 7ff10affd700 1 -- 172.21.15.73:0/165735723 learned_addr learned my addr 172.21.15.73:0/165735723 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:57:21.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.503+0000 7ff10bfff700 1 --2- 172.21.15.73:0/165735723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5191c4870 0x55c5191bfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:21.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.504+0000 7ff10affd700 1 -- 172.21.15.73:0/165735723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5191c4870 msgr2=0x55c5191bfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:21.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.504+0000 7ff10affd700 1 --2- 172.21.15.73:0/165735723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5191c4870 0x55c5191bfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.504+0000 7ff10affd700 1 -- 172.21.15.73:0/165735723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5191be800 msgr2=0x55c5191c0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:21.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.504+0000 7ff10affd700 1 --2- 172.21.15.73:0/165735723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5191be800 0x55c5191c0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.504+0000 7ff10affd700 1 -- 172.21.15.73:0/165735723 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c518f3cde0 con 0x55c5191c3f50 2023-08-10T11:57:21.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.506+0000 7ff10affd700 1 --2- 172.21.15.73:0/165735723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5191c3f50 0x55c5191bf970 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff1000043b0 tx=0x7ff100019c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16c0daf4c3cb02d0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:21.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.521+0000 7ff0eaffd700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T11:57:21.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.521+0000 7ff0eaffd700 1 -- 172.21.15.73:0/165735723 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff100017050 con 0x55c5191c3f50 2023-08-10T11:57:21.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.521+0000 7ff0eaffd700 1 -- 172.21.15.73:0/165735723 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ff10000da40 con 0x55c5191c3f50 2023-08-10T11:57:21.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.521+0000 7ff11ddadb80 1 -- 172.21.15.73:0/165735723 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff10400f040 con 0x55c5191c3f50 2023-08-10T11:57:21.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.521+0000 7ff0eaffd700 1 -- 172.21.15.73:0/165735723 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff100019e60 con 0x55c5191c3f50 2023-08-10T11:57:21.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.521+0000 7ff11ddadb80 10 client.25811 fetch_fsmap learned FSMap version 38 2023-08-10T11:57:21.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.521+0000 7ff11ddadb80 1 -- 172.21.15.73:0/165735723 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x55c518f63250 con 0x55c5191c3f50 2023-08-10T11:57:21.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.522+0000 7ff0eaffd700 1 -- 172.21.15.73:0/165735723 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff10400f040 con 0x55c5191c3f50 2023-08-10T11:57:21.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.522+0000 7ff0eaffd700 1 -- 172.21.15.73:0/165735723 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 38) v1 ==== 7526+0+0 (secure 0 0 0) 0x7ff100022470 con 0x55c5191c3f50 2023-08-10T11:57:21.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.523+0000 7ff11ddadb80 10 client.25811 fetch_fsmap finished waiting for FSMap version 38 2023-08-10T11:57:21.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.523+0000 7ff11ddadb80 10 client.25811 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:57:21.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.523+0000 7ff11ddadb80 20 client.25811 populate_metadata read hostname 'smithi073' 2023-08-10T11:57:21.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.523+0000 7ff11ddadb80 1 --2- 172.21.15.73:0/165735723 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c5191d82d0 0x55c51922f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:21.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.523+0000 7ff11ddadb80 4 client.25811 mds_command: new command op to 24503 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:57:21.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.523+0000 7ff11ddadb80 1 -- 172.21.15.73:0/165735723 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c519108780 con 0x55c5191d82d0 2023-08-10T11:57:21.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.524+0000 7ff10bfff700 1 --2- 172.21.15.73:0/165735723 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c5191d82d0 0x55c51922f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:21.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.524+0000 7ff10bfff700 1 --2- 172.21.15.73:0/165735723 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c5191d82d0 0x55c51922f200 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=401c4a850250e1ce server_cookie=e9b9794578af6078 in_seq=0 out_seq=0 2023-08-10T11:57:21.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.524+0000 7ff0eaffd700 10 client.25811 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:57:21.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.524+0000 7ff0eaffd700 1 -- 172.21.15.73:0/165735723 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55c519108780 con 0x55c5191d82d0 2023-08-10T11:57:21.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.524+0000 7ff0eaffd700 10 client.25811 handle_command_reply: tid=0 2023-08-10T11:57:21.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.525+0000 7ff11ddadb80 1 client.25811 shutdown 2023-08-10T11:57:21.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.525+0000 7ff11ddadb80 1 -- 172.21.15.73:0/165735723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5191c3f50 msgr2=0x55c5191bf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:21.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.525+0000 7ff11ddadb80 1 --2- 172.21.15.73:0/165735723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5191c3f50 0x55c5191bf970 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff1000043b0 tx=0x7ff100019c20 comp rx=0 tx=0).stop 2023-08-10T11:57:21.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.525+0000 7ff11ddadb80 1 -- 172.21.15.73:0/165735723 shutdown_connections 2023-08-10T11:57:21.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.525+0000 7ff11ddadb80 1 --2- 172.21.15.73:0/165735723 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c5191d82d0 0x55c51922f200 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.525+0000 7ff11ddadb80 1 --2- 172.21.15.73:0/165735723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5191c4870 0x55c5191bfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.525+0000 7ff11ddadb80 1 --2- 172.21.15.73:0/165735723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c5191be800 0x55c5191c0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.525+0000 7ff11ddadb80 1 --2- 172.21.15.73:0/165735723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c5191c3f50 0x55c5191bf970 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.525+0000 7ff11ddadb80 1 -- 172.21.15.73:0/165735723 >> 172.21.15.73:0/165735723 conn(0x55c51911bcd0 msgr2=0x55c5191c32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:21.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.525+0000 7ff0eaffd700 0 client.25811 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:57:21.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.525+0000 7ff11ddadb80 1 -- 172.21.15.73:0/165735723 shutdown_connections 2023-08-10T11:57:21.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.526+0000 7ff11ddadb80 1 -- 172.21.15.73:0/165735723 wait complete. 2023-08-10T11:57:21.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.526+0000 7ff11ddadb80 20 client.25811 trim_cache size 0 max 16384 2023-08-10T11:57:21.531 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:57:21.531 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:57:21.531 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": { 2023-08-10T11:57:21.531 INFO:teuthology.orchestra.run.smithi073.stdout: "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d": { 2023-08-10T11:57:21.531 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2023-08-10T11:57:21.531 INFO:teuthology.orchestra.run.smithi073.stdout: "tag": "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d", 2023-08-10T11:57:21.532 INFO:teuthology.orchestra.run.smithi073.stdout: "options": "recursive,force" 2023-08-10T11:57:21.532 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:57:21.532 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:57:21.532 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:57:21.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.527+0000 7ff111c14700 1 -- 172.21.15.73:0/998501328 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ff0f40a1380 msgr2=0x7ff0f40a3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:21.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.527+0000 7ff111c14700 1 --2- 172.21.15.73:0/998501328 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ff0f40a1380 0x7ff0f40a3840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x55c5191c4cf0 tx=0x7ff0fc016f30 comp rx=0 tx=0).stop 2023-08-10T11:57:21.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.527+0000 7ff111c14700 1 -- 172.21.15.73:0/998501328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff10c10ee20 msgr2=0x7ff10c113310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:21.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.527+0000 7ff111c14700 1 --2- 172.21.15.73:0/998501328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff10c10ee20 0x7ff10c113310 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0098e0 tx=0x7ff0fc00f740 comp rx=0 tx=0).stop 2023-08-10T11:57:21.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.527+0000 7ff111c14700 1 -- 172.21.15.73:0/998501328 shutdown_connections 2023-08-10T11:57:21.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.527+0000 7ff111c14700 1 --2- 172.21.15.73:0/998501328 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ff0f40a1380 0x7ff0f40a3840 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.527+0000 7ff111c14700 1 --2- 172.21.15.73:0/998501328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff10c10ee20 0x7ff10c113310 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.527+0000 7ff111c14700 1 --2- 172.21.15.73:0/998501328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff10c119f50 0x7ff10c117cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.527+0000 7ff111c14700 1 --2- 172.21.15.73:0/998501328 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff10c10f290 0x7ff10c113850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:21.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.527+0000 7ff111c14700 1 -- 172.21.15.73:0/998501328 >> 172.21.15.73:0/998501328 conn(0x7ff10c06ca30 msgr2=0x7ff10c11a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:21.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.528+0000 7ff111c14700 1 -- 172.21.15.73:0/998501328 shutdown_connections 2023-08-10T11:57:21.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:21.528+0000 7ff111c14700 1 -- 172.21.15.73:0/998501328 wait complete. 2023-08-10T11:57:21.577 INFO:tasks.cephfs.filesystem:scrub status for tag:9d39b3fa-9b62-42b4-b1a5-738cb3118a5d - {'path': '/', 'tag': '9d39b3fa-9b62-42b4-b1a5-738cb3118a5d', 'options': 'recursive,force'} 2023-08-10T11:57:23.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:23 smithi073 ceph-mon[128869]: pgmap v145: 97 pgs: 97 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 12 MiB/s wr, 873 op/s 2023-08-10T11:57:23.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:23 smithi152 ceph-mon[130220]: pgmap v145: 97 pgs: 97 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 12 MiB/s wr, 873 op/s 2023-08-10T11:57:23.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:23 smithi156 ceph-mon[130574]: pgmap v145: 97 pgs: 97 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 12 MiB/s wr, 873 op/s 2023-08-10T11:57:25.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:24 smithi156 ceph-mon[130574]: pgmap v146: 97 pgs: 97 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 903 op/s 2023-08-10T11:57:25.033 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:24 smithi073 ceph-mon[128869]: pgmap v146: 97 pgs: 97 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 903 op/s 2023-08-10T11:57:25.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:24 smithi152 ceph-mon[130220]: pgmap v146: 97 pgs: 97 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 903 op/s 2023-08-10T11:57:27.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:26 smithi152 ceph-mon[130220]: pgmap v147: 97 pgs: 97 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.8 MiB/s wr, 793 op/s 2023-08-10T11:57:27.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:26 smithi156 ceph-mon[130574]: pgmap v147: 97 pgs: 97 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.8 MiB/s wr, 793 op/s 2023-08-10T11:57:27.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:26 smithi073 ceph-mon[128869]: pgmap v147: 97 pgs: 97 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.8 MiB/s wr, 793 op/s 2023-08-10T11:57:28.126 INFO:tasks.workunit.client.0.smithi073.stdout: 283 2784747 835 1828736 544 871162 614 2023-08-10T11:57:29.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:28 smithi156 ceph-mon[130574]: pgmap v148: 97 pgs: 97 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.6 MiB/s wr, 562 op/s 2023-08-10T11:57:29.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:28 smithi073 ceph-mon[128869]: pgmap v148: 97 pgs: 97 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.6 MiB/s wr, 562 op/s 2023-08-10T11:57:29.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:28 smithi152 ceph-mon[130220]: pgmap v148: 97 pgs: 97 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.6 MiB/s wr, 562 op/s 2023-08-10T11:57:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.464+0000 7f06b89be700 1 -- 172.21.15.73:0/3708727636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06b4105690 msgr2=0x7f06b4105a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.464+0000 7f06b89be700 1 --2- 172.21.15.73:0/3708727636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06b4105690 0x7f06b4105a70 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009990 tx=0x7f06a4009ca0 comp rx=0 tx=0).stop 2023-08-10T11:57:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.465+0000 7f06b89be700 1 -- 172.21.15.73:0/3708727636 shutdown_connections 2023-08-10T11:57:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.465+0000 7f06b89be700 1 --2- 172.21.15.73:0/3708727636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06b40fffb0 0x7f06b410c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.465+0000 7f06b89be700 1 --2- 172.21.15.73:0/3708727636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06b4105690 0x7f06b4105a70 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.465+0000 7f06b89be700 1 --2- 172.21.15.73:0/3708727636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06b40ff5f0 0x7f06b40ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.465+0000 7f06b89be700 1 -- 172.21.15.73:0/3708727636 >> 172.21.15.73:0/3708727636 conn(0x7f06b40fb0a0 msgr2=0x7f06b40fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.465+0000 7f06b89be700 1 -- 172.21.15.73:0/3708727636 shutdown_connections 2023-08-10T11:57:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.465+0000 7f06b89be700 1 -- 172.21.15.73:0/3708727636 wait complete. 2023-08-10T11:57:30.469 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.465+0000 7f06b89be700 1 Processor -- start 2023-08-10T11:57:30.469 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.465+0000 7f06b89be700 1 -- start start 2023-08-10T11:57:30.469 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.466+0000 7f06b89be700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06b40ff5f0 0x7f06b4106740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:30.469 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.466+0000 7f06b89be700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06b40fffb0 0x7f06b4106c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:30.469 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.466+0000 7f06b89be700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06b4105690 0x7f06b41a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.466+0000 7f06b89be700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b41a4f50 con 0x7f06b40fffb0 2023-08-10T11:57:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.466+0000 7f06b89be700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b41a50c0 con 0x7f06b40ff5f0 2023-08-10T11:57:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.466+0000 7f06b89be700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b41a5280 con 0x7f06b4105690 2023-08-10T11:57:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.466+0000 7f06b1d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06b40fffb0 0x7f06b4106c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.466+0000 7f06b1d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06b40fffb0 0x7f06b4106c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35084/0 (socket says 172.21.15.73:35084) 2023-08-10T11:57:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.466+0000 7f06b1d9b700 1 -- 172.21.15.73:0/94847178 learned_addr learned my addr 172.21.15.73:0/94847178 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:57:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.466+0000 7f06b2d9d700 1 --2- 172.21.15.73:0/94847178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06b4105690 0x7f06b41a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.466+0000 7f06b1d9b700 1 -- 172.21.15.73:0/94847178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06b4105690 msgr2=0x7f06b41a4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.466+0000 7f06b1d9b700 1 --2- 172.21.15.73:0/94847178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06b4105690 0x7f06b41a4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.466+0000 7f06b1d9b700 1 -- 172.21.15.73:0/94847178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06b40ff5f0 msgr2=0x7f06b4106740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.466+0000 7f06b1d9b700 1 --2- 172.21.15.73:0/94847178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06b40ff5f0 0x7f06b4106740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.466+0000 7f06b1d9b700 1 -- 172.21.15.73:0/94847178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a40095f0 con 0x7f06b40fffb0 2023-08-10T11:57:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.466+0000 7f06b1d9b700 1 --2- 172.21.15.73:0/94847178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06b40fffb0 0x7f06b4106c80 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f069c00d980 tx=0x7f069c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.466+0000 7f06ab7fe700 1 -- 172.21.15.73:0/94847178 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c004220 con 0x7f06b40fffb0 2023-08-10T11:57:30.472 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.466+0000 7f06ab7fe700 1 -- 172.21.15.73:0/94847178 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f069c007640 con 0x7f06b40fffb0 2023-08-10T11:57:30.472 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.466+0000 7f06b89be700 1 -- 172.21.15.73:0/94847178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b41a5560 con 0x7f06b40fffb0 2023-08-10T11:57:30.472 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.466+0000 7f06ab7fe700 1 -- 172.21.15.73:0/94847178 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c005610 con 0x7f06b40fffb0 2023-08-10T11:57:30.472 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.466+0000 7f06b89be700 1 -- 172.21.15.73:0/94847178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b41a5a70 con 0x7f06b40fffb0 2023-08-10T11:57:30.476 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.469+0000 7f06ab7fe700 1 -- 172.21.15.73:0/94847178 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f069c004750 con 0x7f06b40fffb0 2023-08-10T11:57:30.476 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.469+0000 7f06ab7fe700 1 --2- 172.21.15.73:0/94847178 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f06a00a12c0 0x7f06a00a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.470+0000 7f06b259c700 1 --2- 172.21.15.73:0/94847178 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f06a00a12c0 0x7f06a00a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.470+0000 7f06ab7fe700 1 -- 172.21.15.73:0/94847178 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f069c0ccb80 con 0x7f06b40fffb0 2023-08-10T11:57:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.470+0000 7f06b259c700 1 --2- 172.21.15.73:0/94847178 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f06a00a12c0 0x7f06a00a3780 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f06a40095c0 tx=0x7f06a4009530 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.470+0000 7f06c4b57b80 1 Processor -- start 2023-08-10T11:57:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.471+0000 7f06c4b57b80 1 -- start start 2023-08-10T11:57:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.471+0000 7f06c4b57b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621fcc22a40 0x5621fcc22e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.471+0000 7f06c4b57b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5621fcc23360 0x5621fcc1d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.471+0000 7f06c4b57b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621fcc1d550 0x5621fcc1d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.471+0000 7f06c4b57b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fcb98d60 con 0x5621fcc23360 2023-08-10T11:57:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.471+0000 7f06c4b57b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fcb75530 con 0x5621fcc1d550 2023-08-10T11:57:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.471+0000 7f06c4b57b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fcb72e50 con 0x5621fcc22a40 2023-08-10T11:57:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.471+0000 7f06b1d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5621fcc23360 0x5621fcc1d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.471+0000 7f06b1d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5621fcc23360 0x5621fcc1d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35092/0 (socket says 172.21.15.73:35092) 2023-08-10T11:57:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.471+0000 7f06b1d9b700 1 -- 172.21.15.73:0/3099286894 learned_addr learned my addr 172.21.15.73:0/3099286894 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:57:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.471+0000 7f06b259c700 1 --2- 172.21.15.73:0/3099286894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621fcc22a40 0x5621fcc22e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.471+0000 7f06b1d9b700 1 -- 172.21.15.73:0/3099286894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621fcc22a40 msgr2=0x5621fcc22e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.471+0000 7f06b1d9b700 1 --2- 172.21.15.73:0/3099286894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621fcc22a40 0x5621fcc22e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.471+0000 7f06b1d9b700 1 -- 172.21.15.73:0/3099286894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621fcc1d550 msgr2=0x5621fcc1d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.471+0000 7f06b1d9b700 1 --2- 172.21.15.73:0/3099286894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621fcc1d550 0x5621fcc1d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:30.480 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.471+0000 7f06b1d9b700 1 -- 172.21.15.73:0/3099286894 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621fc9ef5d0 con 0x5621fcc23360 2023-08-10T11:57:30.480 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.471+0000 7f06b1d9b700 1 --2- 172.21.15.73:0/3099286894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5621fcc23360 0x5621fcc1d010 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f069c096180 tx=0x7f069c00f440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35aeb989ed73fa41 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:30.480 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.471+0000 7f06a8ff9700 1 -- 172.21.15.73:0/3099286894 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c09dcb0 con 0x5621fcc23360 2023-08-10T11:57:30.480 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.471+0000 7f06a8ff9700 1 -- 172.21.15.73:0/3099286894 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f069c0a20d0 con 0x5621fcc23360 2023-08-10T11:57:30.480 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.471+0000 7f06a8ff9700 1 -- 172.21.15.73:0/3099286894 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c09a140 con 0x5621fcc23360 2023-08-10T11:57:30.480 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.472+0000 7f06c4b57b80 1 -- 172.21.15.73:0/3099286894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5621fcc23360 msgr2=0x5621fcc1d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:30.480 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.472+0000 7f06c4b57b80 1 --2- 172.21.15.73:0/3099286894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5621fcc23360 0x5621fcc1d010 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f069c096180 tx=0x7f069c00f440 comp rx=0 tx=0).stop 2023-08-10T11:57:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.472+0000 7f06c4b57b80 1 -- 172.21.15.73:0/3099286894 shutdown_connections 2023-08-10T11:57:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.472+0000 7f06c4b57b80 1 --2- 172.21.15.73:0/3099286894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621fcc1d550 0x5621fcc1d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.472+0000 7f06c4b57b80 1 --2- 172.21.15.73:0/3099286894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621fcc22a40 0x5621fcc22e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.472+0000 7f06c4b57b80 1 --2- 172.21.15.73:0/3099286894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5621fcc23360 0x5621fcc1d010 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.472+0000 7f06c4b57b80 1 -- 172.21.15.73:0/3099286894 >> 172.21.15.73:0/3099286894 conn(0x5621fcb7ac70 msgr2=0x5621fcc17d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.472+0000 7f06c4b57b80 1 -- 172.21.15.73:0/3099286894 shutdown_connections 2023-08-10T11:57:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.472+0000 7f06c4b57b80 1 -- 172.21.15.73:0/3099286894 wait complete. 2023-08-10T11:57:30.482 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.473+0000 7f06c4b57b80 1 -- start start 2023-08-10T11:57:30.482 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.473+0000 7f06c4b57b80 1 Processor -- start 2023-08-10T11:57:30.482 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.473+0000 7f06c4b57b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621fcc1d550 0x5621fcc26690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:30.482 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.473+0000 7f06c4b57b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5621fcc22a40 0x5621fcc26bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:30.482 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.473+0000 7f06c4b57b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621fcc23360 0x5621fcc27110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:30.482 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.473+0000 7f06c4b57b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fcb6e740 con 0x5621fcc22a40 2023-08-10T11:57:30.482 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.473+0000 7f06c4b57b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fcb0da60 con 0x5621fcc1d550 2023-08-10T11:57:30.483 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.473+0000 7f06c4b57b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fcb0d760 con 0x5621fcc23360 2023-08-10T11:57:30.483 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.473+0000 7f06c4b57b80 10 client.0 _ll_register_callbacks cb 0x5621fcb0b620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:57:30.483 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.473+0000 7f06b1d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5621fcc22a40 0x5621fcc26bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:30.483 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.473+0000 7f06b1d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5621fcc22a40 0x5621fcc26bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35098/0 (socket says 172.21.15.73:35098) 2023-08-10T11:57:30.483 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.473+0000 7f06b1d9b700 1 -- 172.21.15.73:0/3397494937 learned_addr learned my addr 172.21.15.73:0/3397494937 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:57:30.483 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.473+0000 7f06b259c700 1 --2- 172.21.15.73:0/3397494937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621fcc1d550 0x5621fcc26690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:30.483 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.473+0000 7f06b2d9d700 1 --2- 172.21.15.73:0/3397494937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621fcc23360 0x5621fcc27110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.474+0000 7f06b1d9b700 1 -- 172.21.15.73:0/3397494937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621fcc23360 msgr2=0x5621fcc27110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.474+0000 7f06b1d9b700 1 --2- 172.21.15.73:0/3397494937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621fcc23360 0x5621fcc27110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.474+0000 7f06b1d9b700 1 -- 172.21.15.73:0/3397494937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621fcc1d550 msgr2=0x5621fcc26690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.474+0000 7f06b1d9b700 1 --2- 172.21.15.73:0/3397494937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621fcc1d550 0x5621fcc26690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.474+0000 7f06b1d9b700 1 -- 172.21.15.73:0/3397494937 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b41a5a70 con 0x5621fcc22a40 2023-08-10T11:57:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.474+0000 7f06b1d9b700 1 --2- 172.21.15.73:0/3397494937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5621fcc22a40 0x5621fcc26bd0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f069c0966f0 tx=0x7f069c0050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7aa6e56cdbd33bc server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.474+0000 7f0699ffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:57:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.474+0000 7f0699ffb700 1 -- 172.21.15.73:0/3397494937 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c099370 con 0x5621fcc22a40 2023-08-10T11:57:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.474+0000 7f0699ffb700 1 -- 172.21.15.73:0/3397494937 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f069c0b2420 con 0x5621fcc22a40 2023-08-10T11:57:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.474+0000 7f06c4b57b80 1 -- 172.21.15.73:0/3397494937 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5621fcc101c0 con 0x5621fcc22a40 2023-08-10T11:57:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.474+0000 7f0699ffb700 1 -- 172.21.15.73:0/3397494937 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f069c0980a0 con 0x5621fcc22a40 2023-08-10T11:57:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.474+0000 7f06c4b57b80 10 client.16389 fetch_fsmap learned FSMap version 38 2023-08-10T11:57:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.474+0000 7f06c4b57b80 1 -- 172.21.15.73:0/3397494937 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x5621fc99bd80 con 0x5621fcc22a40 2023-08-10T11:57:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.474+0000 7f0699ffb700 1 -- 172.21.15.73:0/3397494937 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5621fcc101c0 con 0x5621fcc22a40 2023-08-10T11:57:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.474+0000 7f0699ffb700 1 -- 172.21.15.73:0/3397494937 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 38) v1 ==== 7526+0+0 (secure 0 0 0) 0x7f069c0b9050 con 0x5621fcc22a40 2023-08-10T11:57:30.486 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.475+0000 7f06c4b57b80 10 client.16389 fetch_fsmap finished waiting for FSMap version 38 2023-08-10T11:57:30.486 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.475+0000 7f06c4b57b80 10 client.16389 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:57:30.486 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.475+0000 7f06c4b57b80 20 client.16389 populate_metadata read hostname 'smithi073' 2023-08-10T11:57:30.486 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.475+0000 7f06c4b57b80 1 --2- 172.21.15.73:0/3397494937 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5621fcc36aa0 0x5621fcc38ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:30.486 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.475+0000 7f06c4b57b80 4 client.16389 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:57:30.486 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.475+0000 7f06c4b57b80 1 -- 172.21.15.73:0/3397494937 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5621fcbec970 con 0x5621fcc36aa0 2023-08-10T11:57:30.486 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.475+0000 7f06b259c700 1 --2- 172.21.15.73:0/3397494937 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5621fcc36aa0 0x5621fcc38ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:30.488 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.477+0000 7f0699ffb700 10 client.16389 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:57:30.488 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.477+0000 7f06b259c700 1 --2- 172.21.15.73:0/3397494937 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5621fcc36aa0 0x5621fcc38ec0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d5ddc55a4e2230c server_cookie=edb25566f74e2c in_seq=0 out_seq=0 2023-08-10T11:57:30.488 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.483+0000 7f0699ffb700 1 -- 172.21.15.73:0/3397494937 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5621fcbec970 con 0x5621fcc36aa0 2023-08-10T11:57:30.488 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.483+0000 7f0699ffb700 10 client.16389 handle_command_reply: tid=0 2023-08-10T11:57:30.488 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.483+0000 7f06c4b57b80 1 client.16389 shutdown 2023-08-10T11:57:30.488 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.483+0000 7f06c4b57b80 1 -- 172.21.15.73:0/3397494937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5621fcc22a40 msgr2=0x5621fcc26bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:30.489 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.483+0000 7f06c4b57b80 1 --2- 172.21.15.73:0/3397494937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5621fcc22a40 0x5621fcc26bd0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f069c0966f0 tx=0x7f069c0050b0 comp rx=0 tx=0).stop 2023-08-10T11:57:30.489 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.483+0000 7f06c4b57b80 1 -- 172.21.15.73:0/3397494937 shutdown_connections 2023-08-10T11:57:30.489 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.483+0000 7f06c4b57b80 1 --2- 172.21.15.73:0/3397494937 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5621fcc36aa0 0x5621fcc38ec0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:30.489 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.483+0000 7f06c4b57b80 1 --2- 172.21.15.73:0/3397494937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621fcc1d550 0x5621fcc26690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:30.489 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.483+0000 7f0699ffb700 0 client.16389 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:57:30.489 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.483+0000 7f06c4b57b80 1 --2- 172.21.15.73:0/3397494937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621fcc23360 0x5621fcc27110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:30.489 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.483+0000 7f06c4b57b80 1 --2- 172.21.15.73:0/3397494937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5621fcc22a40 0x5621fcc26bd0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:30.489 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.483+0000 7f06c4b57b80 1 -- 172.21.15.73:0/3397494937 >> 172.21.15.73:0/3397494937 conn(0x5621fcb7ac70 msgr2=0x5621fcc174b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:30.490 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.483+0000 7f06c4b57b80 1 -- 172.21.15.73:0/3397494937 shutdown_connections 2023-08-10T11:57:30.490 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.483+0000 7f06c4b57b80 1 -- 172.21.15.73:0/3397494937 wait complete. 2023-08-10T11:57:30.490 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.483+0000 7f06c4b57b80 20 client.16389 trim_cache size 0 max 16384 2023-08-10T11:57:30.506 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.499+0000 7f06c4b57b80 1 Processor -- start 2023-08-10T11:57:30.507 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.500+0000 7f06c4b57b80 1 -- start start 2023-08-10T11:57:30.508 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.500+0000 7f06c4b57b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5621fcc1d550 0x5621fcc2de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:30.508 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.500+0000 7f06c4b57b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621fcc22a40 0x5621fcc17c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:30.508 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.500+0000 7f06c4b57b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621fcc23360 0x5621fcc21850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:30.508 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.500+0000 7f06c4b57b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fc9f18c0 con 0x5621fcc1d550 2023-08-10T11:57:30.508 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.500+0000 7f06c4b57b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fcc12730 con 0x5621fcc23360 2023-08-10T11:57:30.508 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.500+0000 7f06c4b57b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fcc32d40 con 0x5621fcc22a40 2023-08-10T11:57:30.509 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.500+0000 7f06b1d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621fcc22a40 0x5621fcc17c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:30.509 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.500+0000 7f06b259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5621fcc1d550 0x5621fcc2de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:30.509 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.500+0000 7f06b1d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621fcc22a40 0x5621fcc17c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60610/0 (socket says 172.21.15.73:60610) 2023-08-10T11:57:30.509 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.500+0000 7f06b1d9b700 1 -- 172.21.15.73:0/416180805 learned_addr learned my addr 172.21.15.73:0/416180805 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:57:30.509 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.500+0000 7f06b2d9d700 1 --2- 172.21.15.73:0/416180805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621fcc23360 0x5621fcc21850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:30.509 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.500+0000 7f06b1d9b700 1 -- 172.21.15.73:0/416180805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621fcc23360 msgr2=0x5621fcc21850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:30.510 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.500+0000 7f06b1d9b700 1 --2- 172.21.15.73:0/416180805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621fcc23360 0x5621fcc21850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:30.510 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.500+0000 7f06b1d9b700 1 -- 172.21.15.73:0/416180805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5621fcc1d550 msgr2=0x5621fcc2de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:30.510 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.500+0000 7f06b1d9b700 1 --2- 172.21.15.73:0/416180805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5621fcc1d550 0x5621fcc2de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:30.510 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.500+0000 7f06b1d9b700 1 -- 172.21.15.73:0/416180805 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621fcc143f0 con 0x5621fcc22a40 2023-08-10T11:57:30.510 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.500+0000 7f06b259c700 1 --2- 172.21.15.73:0/416180805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5621fcc1d550 0x5621fcc2de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:57:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.501+0000 7f06b1d9b700 1 --2- 172.21.15.73:0/416180805 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621fcc22a40 0x5621fcc17c30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f069c0ca900 tx=0x7f069c095a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1178d325e0f9ce8f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.501+0000 7f06a97fa700 1 -- 172.21.15.73:0/416180805 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c095bc0 con 0x5621fcc22a40 2023-08-10T11:57:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.501+0000 7f06a97fa700 1 -- 172.21.15.73:0/416180805 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f069c0ca1d0 con 0x5621fcc22a40 2023-08-10T11:57:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.501+0000 7f06a97fa700 1 -- 172.21.15.73:0/416180805 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c0a1c40 con 0x5621fcc22a40 2023-08-10T11:57:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.501+0000 7f06c4b57b80 1 -- 172.21.15.73:0/416180805 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621fcc22a40 msgr2=0x5621fcc17c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.501+0000 7f06c4b57b80 1 --2- 172.21.15.73:0/416180805 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621fcc22a40 0x5621fcc17c30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f069c0ca900 tx=0x7f069c095a70 comp rx=0 tx=0).stop 2023-08-10T11:57:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.501+0000 7f06c4b57b80 1 -- 172.21.15.73:0/416180805 shutdown_connections 2023-08-10T11:57:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.501+0000 7f06c4b57b80 1 --2- 172.21.15.73:0/416180805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621fcc23360 0x5621fcc21850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.501+0000 7f06c4b57b80 1 --2- 172.21.15.73:0/416180805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5621fcc1d550 0x5621fcc2de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.501+0000 7f06c4b57b80 1 --2- 172.21.15.73:0/416180805 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621fcc22a40 0x5621fcc17c30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:30.513 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.501+0000 7f06c4b57b80 1 -- 172.21.15.73:0/416180805 >> 172.21.15.73:0/416180805 conn(0x5621fcb7ac70 msgr2=0x5621fcc208d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:30.513 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.502+0000 7f06c4b57b80 1 -- 172.21.15.73:0/416180805 shutdown_connections 2023-08-10T11:57:30.513 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.502+0000 7f06c4b57b80 1 -- 172.21.15.73:0/416180805 wait complete. 2023-08-10T11:57:30.513 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.502+0000 7f06c4b57b80 1 -- start start 2023-08-10T11:57:30.513 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.502+0000 7f06c4b57b80 1 Processor -- start 2023-08-10T11:57:30.514 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.502+0000 7f06c4b57b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621fcc1d550 0x5621fcc7e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:30.514 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.502+0000 7f06c4b57b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621fcc22a40 0x5621fcc7ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:30.514 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.502+0000 7f06c4b57b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5621fcc23360 0x5621fcc89760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:30.514 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.502+0000 7f06c4b57b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fcc7f520 con 0x5621fcc23360 2023-08-10T11:57:30.514 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.502+0000 7f06c4b57b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fcc89ca0 con 0x5621fcc1d550 2023-08-10T11:57:30.515 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.502+0000 7f06c4b57b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fcc89e10 con 0x5621fcc22a40 2023-08-10T11:57:30.515 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.502+0000 7f06c4b57b80 10 client.0 _ll_register_callbacks cb 0x5621fcb0b620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:57:30.515 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.502+0000 7f06b2d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5621fcc23360 0x5621fcc89760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:30.515 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.502+0000 7f06b2d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5621fcc23360 0x5621fcc89760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35114/0 (socket says 172.21.15.73:35114) 2023-08-10T11:57:30.515 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.502+0000 7f06b2d9d700 1 -- 172.21.15.73:0/3596903662 learned_addr learned my addr 172.21.15.73:0/3596903662 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:57:30.515 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.502+0000 7f06b1d9b700 1 --2- 172.21.15.73:0/3596903662 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621fcc22a40 0x5621fcc7ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:30.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.502+0000 7f06b259c700 1 --2- 172.21.15.73:0/3596903662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621fcc1d550 0x5621fcc7e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:30.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.503+0000 7f06b2d9d700 1 -- 172.21.15.73:0/3596903662 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621fcc22a40 msgr2=0x5621fcc7ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:30.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.503+0000 7f06b2d9d700 1 --2- 172.21.15.73:0/3596903662 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621fcc22a40 0x5621fcc7ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:30.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.503+0000 7f06b2d9d700 1 -- 172.21.15.73:0/3596903662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621fcc1d550 msgr2=0x5621fcc7e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:30.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.503+0000 7f06b2d9d700 1 --2- 172.21.15.73:0/3596903662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621fcc1d550 0x5621fcc7e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:30.516 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.503+0000 7f06b2d9d700 1 -- 172.21.15.73:0/3596903662 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b410cdc0 con 0x5621fcc23360 2023-08-10T11:57:30.517 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.503+0000 7f06b1d9b700 1 --2- 172.21.15.73:0/3596903662 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621fcc22a40 0x5621fcc7ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:57:30.517 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.503+0000 7f06b2d9d700 1 --2- 172.21.15.73:0/3596903662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5621fcc23360 0x5621fcc89760 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f06ac007bf0 tx=0x7f06ac007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce916ae81fd2f6e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:30.517 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.503+0000 7f0699ffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:57:30.517 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.503+0000 7f0699ffb700 1 -- 172.21.15.73:0/3596903662 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac00e040 con 0x5621fcc23360 2023-08-10T11:57:30.518 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.503+0000 7f0699ffb700 1 -- 172.21.15.73:0/3596903662 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f06ac004db0 con 0x5621fcc23360 2023-08-10T11:57:30.518 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.503+0000 7f06c4b57b80 1 -- 172.21.15.73:0/3596903662 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f069c0a20d0 con 0x5621fcc23360 2023-08-10T11:57:30.518 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.503+0000 7f0699ffb700 1 -- 172.21.15.73:0/3596903662 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06ac016870 con 0x5621fcc23360 2023-08-10T11:57:30.518 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.503+0000 7f06c4b57b80 10 client.16395 fetch_fsmap learned FSMap version 38 2023-08-10T11:57:30.519 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.503+0000 7f06c4b57b80 1 -- 172.21.15.73:0/3596903662 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x5621fc99bd80 con 0x5621fcc23360 2023-08-10T11:57:30.519 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.503+0000 7f0699ffb700 1 -- 172.21.15.73:0/3596903662 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f069c0a20d0 con 0x5621fcc23360 2023-08-10T11:57:30.519 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.503+0000 7f0699ffb700 1 -- 172.21.15.73:0/3596903662 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 38) v1 ==== 7526+0+0 (secure 0 0 0) 0x7f06ac020cc0 con 0x5621fcc23360 2023-08-10T11:57:30.519 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.503+0000 7f06c4b57b80 10 client.16395 fetch_fsmap finished waiting for FSMap version 38 2023-08-10T11:57:30.519 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.503+0000 7f06c4b57b80 10 client.16395 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:57:30.520 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.503+0000 7f06c4b57b80 20 client.16395 populate_metadata read hostname 'smithi073' 2023-08-10T11:57:30.520 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.503+0000 7f06c4b57b80 1 --2- 172.21.15.73:0/3596903662 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5621fcc8b6e0 0x5621fcc8db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:30.520 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.503+0000 7f06c4b57b80 4 client.16395 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:57:30.520 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.503+0000 7f06c4b57b80 1 -- 172.21.15.73:0/3596903662 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5621fcb67720 con 0x5621fcc8b6e0 2023-08-10T11:57:30.520 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.504+0000 7f06b259c700 1 --2- 172.21.15.73:0/3596903662 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5621fcc8b6e0 0x5621fcc8db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:30.521 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.504+0000 7f0699ffb700 10 client.16395 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:57:30.521 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:30.504+0000 7f06b259c700 1 --2- 172.21.15.73:0/3596903662 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5621fcc8b6e0 0x5621fcc8db00 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ef14d1b0c36d4d9 server_cookie=891fb74addf8b4e1 in_seq=0 out_seq=0 2023-08-10T11:57:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:31.038+0000 7f0699ffb700 1 -- 172.21.15.73:0/3596903662 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5621fcb67720 con 0x5621fcc8b6e0 2023-08-10T11:57:31.040 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:31.038+0000 7f0699ffb700 10 client.16395 handle_command_reply: tid=0 2023-08-10T11:57:31.040 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:31.038+0000 7f06c4b57b80 1 client.16395 shutdown 2023-08-10T11:57:31.040 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:31.038+0000 7f06c4b57b80 1 -- 172.21.15.73:0/3596903662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5621fcc23360 msgr2=0x5621fcc89760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:31.040 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:31.038+0000 7f06c4b57b80 1 --2- 172.21.15.73:0/3596903662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5621fcc23360 0x5621fcc89760 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f06ac007bf0 tx=0x7f06ac007f00 comp rx=0 tx=0).stop 2023-08-10T11:57:31.040 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:31.039+0000 7f06c4b57b80 1 -- 172.21.15.73:0/3596903662 shutdown_connections 2023-08-10T11:57:31.041 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:31.039+0000 7f06c4b57b80 1 --2- 172.21.15.73:0/3596903662 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5621fcc8b6e0 0x5621fcc8db00 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:31.041 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:31.039+0000 7f06c4b57b80 1 --2- 172.21.15.73:0/3596903662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5621fcc1d550 0x5621fcc7e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:31.041 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:31.039+0000 7f06c4b57b80 1 --2- 172.21.15.73:0/3596903662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5621fcc23360 0x5621fcc89760 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:31.041 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:31.039+0000 7f06c4b57b80 1 --2- 172.21.15.73:0/3596903662 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621fcc22a40 0x5621fcc7ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:31.041 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:31.039+0000 7f0699ffb700 0 client.16395 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:57:31.041 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:31.039+0000 7f06c4b57b80 1 -- 172.21.15.73:0/3596903662 >> 172.21.15.73:0/3596903662 conn(0x5621fcb7ac70 msgr2=0x5621fcc21850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:31.041 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:31.039+0000 7f06c4b57b80 1 -- 172.21.15.73:0/3596903662 shutdown_connections 2023-08-10T11:57:31.042 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:31.039+0000 7f06c4b57b80 1 -- 172.21.15.73:0/3596903662 wait complete. 2023-08-10T11:57:31.051 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:31.050+0000 7f06c4b57b80 20 client.16395 trim_cache size 0 max 16384 2023-08-10T11:57:31.051 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:57:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:57:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:57:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:57:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:31.051+0000 7f06b89be700 1 -- 172.21.15.73:0/94847178 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f06a00a12c0 msgr2=0x7f06a00a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:31.051+0000 7f06b89be700 1 --2- 172.21.15.73:0/94847178 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f06a00a12c0 0x7f06a00a3780 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f06a40095c0 tx=0x7f06a4009530 comp rx=0 tx=0).stop 2023-08-10T11:57:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:31.051+0000 7f06b89be700 1 -- 172.21.15.73:0/94847178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06b40fffb0 msgr2=0x7f06b4106c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:31.051+0000 7f06b89be700 1 --2- 172.21.15.73:0/94847178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06b40fffb0 0x7f06b4106c80 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f069c00d980 tx=0x7f069c00dc90 comp rx=0 tx=0).stop 2023-08-10T11:57:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:31.055+0000 7f06b89be700 1 -- 172.21.15.73:0/94847178 shutdown_connections 2023-08-10T11:57:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:31.055+0000 7f06b89be700 1 --2- 172.21.15.73:0/94847178 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f06a00a12c0 0x7f06a00a3780 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:31.055+0000 7f06b89be700 1 --2- 172.21.15.73:0/94847178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06b40ff5f0 0x7f06b4106740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:31.055+0000 7f06b89be700 1 --2- 172.21.15.73:0/94847178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06b4105690 0x7f06b41a4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:31.055+0000 7f06b89be700 1 --2- 172.21.15.73:0/94847178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06b40fffb0 0x7f06b4106c80 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:31.055+0000 7f06b89be700 1 -- 172.21.15.73:0/94847178 >> 172.21.15.73:0/94847178 conn(0x7f06b40fb0a0 msgr2=0x7f06b40fcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:31.056+0000 7f06b89be700 1 -- 172.21.15.73:0/94847178 shutdown_connections 2023-08-10T11:57:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:31.056+0000 7f06b89be700 1 -- 172.21.15.73:0/94847178 wait complete. 2023-08-10T11:57:31.272 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:31 smithi073 ceph-mon[128869]: pgmap v149: 97 pgs: 97 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 612 op/s 2023-08-10T11:57:31.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:31 smithi152 ceph-mon[130220]: pgmap v149: 97 pgs: 97 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 612 op/s 2023-08-10T11:57:31.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:31 smithi156 ceph-mon[130574]: pgmap v149: 97 pgs: 97 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 612 op/s 2023-08-10T11:57:33.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:33 smithi152 ceph-mon[130220]: pgmap v150: 97 pgs: 97 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 309 op/s 2023-08-10T11:57:33.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:33 smithi156 ceph-mon[130574]: pgmap v150: 97 pgs: 97 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 309 op/s 2023-08-10T11:57:33.524 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:33 smithi073 ceph-mon[128869]: pgmap v150: 97 pgs: 97 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 309 op/s 2023-08-10T11:57:34.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:34 smithi152 ceph-mon[130220]: MDS daemon mds.i is removed because it is dead or otherwise unavailable. 2023-08-10T11:57:34.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:34 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T11:57:34.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:34 smithi156 ceph-mon[130574]: MDS daemon mds.i is removed because it is dead or otherwise unavailable. 2023-08-10T11:57:34.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:34 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T11:57:34.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:34 smithi073 ceph-mon[128869]: MDS daemon mds.i is removed because it is dead or otherwise unavailable. 2023-08-10T11:57:34.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:34 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T11:57:35.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:35 smithi152 ceph-mon[130220]: pgmap v151: 97 pgs: 97 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 296 op/s 2023-08-10T11:57:35.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:35 smithi156 ceph-mon[130574]: pgmap v151: 97 pgs: 97 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 296 op/s 2023-08-10T11:57:35.523 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:35 smithi073 ceph-mon[128869]: pgmap v151: 97 pgs: 97 active+clean; 1.1 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 296 op/s 2023-08-10T11:57:37.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:37 smithi152 ceph-mon[130220]: pgmap v152: 97 pgs: 97 active+clean; 1.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 362 op/s 2023-08-10T11:57:37.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:37 smithi156 ceph-mon[130574]: pgmap v152: 97 pgs: 97 active+clean; 1.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 362 op/s 2023-08-10T11:57:37.525 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:37 smithi073 ceph-mon[128869]: pgmap v152: 97 pgs: 97 active+clean; 1.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 362 op/s 2023-08-10T11:57:38.126 INFO:tasks.workunit.client.0.smithi073.stdout: 296 2573963 629 1677153 750 804566 960 2023-08-10T11:57:39.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:39 smithi152 ceph-mon[130220]: pgmap v153: 97 pgs: 97 active+clean; 1.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 293 op/s 2023-08-10T11:57:39.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:39 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-08-10T11:57:39.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:39 smithi156 ceph-mon[130574]: pgmap v153: 97 pgs: 97 active+clean; 1.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 293 op/s 2023-08-10T11:57:39.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:39 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-08-10T11:57:39.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:39 smithi073 ceph-mon[128869]: pgmap v153: 97 pgs: 97 active+clean; 1.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 293 op/s 2023-08-10T11:57:39.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:39 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-08-10T11:57:41.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:41 smithi152 ceph-mon[130220]: pgmap v154: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 352 op/s 2023-08-10T11:57:41.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:41 smithi156 ceph-mon[130574]: pgmap v154: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 352 op/s 2023-08-10T11:57:41.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:41 smithi073 ceph-mon[128869]: pgmap v154: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 352 op/s 2023-08-10T11:57:43.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:43 smithi152 ceph-mon[130220]: pgmap v155: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 319 op/s 2023-08-10T11:57:43.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:43 smithi156 ceph-mon[130574]: pgmap v155: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 319 op/s 2023-08-10T11:57:43.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:43 smithi073 ceph-mon[128869]: pgmap v155: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 319 op/s 2023-08-10T11:57:45.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:44 smithi152 ceph-mon[130220]: pgmap v156: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 315 op/s 2023-08-10T11:57:45.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:44 smithi156 ceph-mon[130574]: pgmap v156: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 315 op/s 2023-08-10T11:57:45.271 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:44 smithi073 ceph-mon[128869]: pgmap v156: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 315 op/s 2023-08-10T11:57:45.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.797+0000 7f92df756700 1 -- 172.21.15.73:0/4284001773 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92d810f330 msgr2=0x7f92d8107cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.797+0000 7f92df756700 1 --2- 172.21.15.73:0/4284001773 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92d810f330 0x7f92d8107cb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f92d000b0a0 tx=0x7f92d000b3b0 comp rx=0 tx=0).stop 2023-08-10T11:57:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.802+0000 7f92df756700 1 -- 172.21.15.73:0/4284001773 shutdown_connections 2023-08-10T11:57:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.802+0000 7f92df756700 1 --2- 172.21.15.73:0/4284001773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92d8119f50 0x7f92d811c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.802+0000 7f92df756700 1 --2- 172.21.15.73:0/4284001773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92d810eec0 0x7f92d8107770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.802+0000 7f92df756700 1 --2- 172.21.15.73:0/4284001773 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92d810f330 0x7f92d8107cb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.802+0000 7f92df756700 1 -- 172.21.15.73:0/4284001773 >> 172.21.15.73:0/4284001773 conn(0x7f92d806c830 msgr2=0x7f92d806cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.802+0000 7f92df756700 1 -- 172.21.15.73:0/4284001773 shutdown_connections 2023-08-10T11:57:45.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.802+0000 7f92df756700 1 -- 172.21.15.73:0/4284001773 wait complete. 2023-08-10T11:57:45.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.804+0000 7f92df756700 1 Processor -- start 2023-08-10T11:57:45.838 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.804+0000 7f92df756700 1 -- start start 2023-08-10T11:57:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.829+0000 7f92df756700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92d810eec0 0x7f92d8118290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.829+0000 7f92df756700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92d810f330 0x7f92d8118810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.829+0000 7f92df756700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92d8119f50 0x7f92d8111120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.829+0000 7f92df756700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d81118f0 con 0x7f92d810f330 2023-08-10T11:57:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.829+0000 7f92df756700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d8111a60 con 0x7f92d8119f50 2023-08-10T11:57:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.829+0000 7f92df756700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d8111c20 con 0x7f92d810eec0 2023-08-10T11:57:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.830+0000 7f92ddcf3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92d8119f50 0x7f92d8111120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.830+0000 7f92dd4f2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92d810eec0 0x7f92d8118290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.830+0000 7f92dd4f2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92d810eec0 0x7f92d8118290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60640/0 (socket says 172.21.15.73:60640) 2023-08-10T11:57:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.830+0000 7f92dd4f2700 1 -- 172.21.15.73:0/1369404728 learned_addr learned my addr 172.21.15.73:0/1369404728 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:57:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.833+0000 7f92dccf1700 1 --2- 172.21.15.73:0/1369404728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92d810f330 0x7f92d8118810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.846+0000 7f92ddcf3700 1 -- 172.21.15.73:0/1369404728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92d810eec0 msgr2=0x7f92d8118290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.846+0000 7f92ddcf3700 1 --2- 172.21.15.73:0/1369404728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92d810eec0 0x7f92d8118290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.846+0000 7f92ddcf3700 1 -- 172.21.15.73:0/1369404728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92d810f330 msgr2=0x7f92d8118810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.846+0000 7f92ddcf3700 1 --2- 172.21.15.73:0/1369404728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92d810f330 0x7f92d8118810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.846+0000 7f92ddcf3700 1 -- 172.21.15.73:0/1369404728 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d0009d00 con 0x7f92d8119f50 2023-08-10T11:57:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.849+0000 7f92ddcf3700 1 --2- 172.21.15.73:0/1369404728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92d8119f50 0x7f92d8111120 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f92d8069ae0 tx=0x7f92c800da00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.873+0000 7f92ce7fc700 1 -- 172.21.15.73:0/1369404728 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8004220 con 0x7f92d8119f50 2023-08-10T11:57:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.873+0000 7f92ce7fc700 1 -- 172.21.15.73:0/1369404728 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f92c8004380 con 0x7f92d8119f50 2023-08-10T11:57:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.873+0000 7f92ce7fc700 1 -- 172.21.15.73:0/1369404728 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8003b40 con 0x7f92d8119f50 2023-08-10T11:57:45.900 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.884+0000 7f92df756700 1 -- 172.21.15.73:0/1369404728 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d8111f00 con 0x7f92d8119f50 2023-08-10T11:57:45.900 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.884+0000 7f92df756700 1 -- 172.21.15.73:0/1369404728 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d81160f0 con 0x7f92d8119f50 2023-08-10T11:57:45.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.900+0000 7f92ce7fc700 1 -- 172.21.15.73:0/1369404728 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f92c8003ca0 con 0x7f92d8119f50 2023-08-10T11:57:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.901+0000 7f92ce7fc700 1 --2- 172.21.15.73:0/1369404728 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f92c40a14d0 0x7f92c40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.902+0000 7f92ce7fc700 1 -- 172.21.15.73:0/1369404728 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f92c80cbf30 con 0x7f92d8119f50 2023-08-10T11:57:45.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.905+0000 7f92dd4f2700 1 --2- 172.21.15.73:0/1369404728 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f92c40a14d0 0x7f92c40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.907+0000 7f92eb8efb80 1 Processor -- start 2023-08-10T11:57:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.909+0000 7f92eb8efb80 1 -- start start 2023-08-10T11:57:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.909+0000 7f92eb8efb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b391354a40 0x55b391354e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.909+0000 7f92eb8efb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b391355360 0x55b39134f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.910+0000 7f92eb8efb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b39134f550 0x55b39134f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.910+0000 7f92eb8efb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3912cad60 con 0x55b39134f550 2023-08-10T11:57:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.910+0000 7f92eb8efb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3912a7530 con 0x55b391354a40 2023-08-10T11:57:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.910+0000 7f92eb8efb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3912a4e50 con 0x55b391355360 2023-08-10T11:57:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.913+0000 7f92dccf1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b391355360 0x55b39134f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.913+0000 7f92dccf1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b391355360 0x55b39134f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60648/0 (socket says 172.21.15.73:60648) 2023-08-10T11:57:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.913+0000 7f92dccf1700 1 -- 172.21.15.73:0/3034017943 learned_addr learned my addr 172.21.15.73:0/3034017943 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:57:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.913+0000 7f92dd4f2700 1 --2- 172.21.15.73:0/3034017943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b391354a40 0x55b391354e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.914+0000 7f92ddcf3700 1 --2- 172.21.15.73:0/3034017943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b39134f550 0x55b39134f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.914+0000 7f92dccf1700 1 -- 172.21.15.73:0/3034017943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b391354a40 msgr2=0x55b391354e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.914+0000 7f92dccf1700 1 --2- 172.21.15.73:0/3034017943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b391354a40 0x55b391354e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.914+0000 7f92dccf1700 1 -- 172.21.15.73:0/3034017943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b39134f550 msgr2=0x55b39134f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.914+0000 7f92dccf1700 1 --2- 172.21.15.73:0/3034017943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b39134f550 0x55b39134f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.914+0000 7f92dccf1700 1 -- 172.21.15.73:0/3034017943 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3911215d0 con 0x55b391355360 2023-08-10T11:57:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.954+0000 7f92dccf1700 1 --2- 172.21.15.73:0/3034017943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b391355360 0x55b39134f010 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f92d000b0a0 tx=0x7f92d0009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb0fb9417e5bd4af server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.954+0000 7f92dd4f2700 1 --2- 172.21.15.73:0/1369404728 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f92c40a14d0 0x7f92c40a3990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f92d4011630 tx=0x7f92d40119f0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.954+0000 7f92c37fe700 1 -- 172.21.15.73:0/3034017943 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d000e040 con 0x55b391355360 2023-08-10T11:57:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.954+0000 7f92c37fe700 1 -- 172.21.15.73:0/3034017943 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f92d00074e0 con 0x55b391355360 2023-08-10T11:57:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.954+0000 7f92c37fe700 1 -- 172.21.15.73:0/3034017943 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d001c6a0 con 0x55b391355360 2023-08-10T11:57:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.955+0000 7f92eb8efb80 1 -- 172.21.15.73:0/3034017943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b391355360 msgr2=0x55b39134f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.955+0000 7f92eb8efb80 1 --2- 172.21.15.73:0/3034017943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b391355360 0x55b39134f010 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f92d000b0a0 tx=0x7f92d0009500 comp rx=0 tx=0).stop 2023-08-10T11:57:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.956+0000 7f92eb8efb80 1 -- 172.21.15.73:0/3034017943 shutdown_connections 2023-08-10T11:57:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.956+0000 7f92eb8efb80 1 --2- 172.21.15.73:0/3034017943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b391354a40 0x55b391354e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.956+0000 7f92eb8efb80 1 --2- 172.21.15.73:0/3034017943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b39134f550 0x55b39134f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.956+0000 7f92eb8efb80 1 --2- 172.21.15.73:0/3034017943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b391355360 0x55b39134f010 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.956+0000 7f92eb8efb80 1 -- 172.21.15.73:0/3034017943 >> 172.21.15.73:0/3034017943 conn(0x55b3912acc70 msgr2=0x55b391349d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.956+0000 7f92eb8efb80 1 -- 172.21.15.73:0/3034017943 shutdown_connections 2023-08-10T11:57:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.956+0000 7f92eb8efb80 1 -- 172.21.15.73:0/3034017943 wait complete. 2023-08-10T11:57:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.957+0000 7f92eb8efb80 1 -- start start 2023-08-10T11:57:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.957+0000 7f92eb8efb80 1 Processor -- start 2023-08-10T11:57:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.957+0000 7f92eb8efb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b39134f550 0x55b3913586b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.957+0000 7f92eb8efb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b391354a40 0x55b391358bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.957+0000 7f92eb8efb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b391355360 0x55b391359130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.957+0000 7f92eb8efb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3912a0740 con 0x55b391354a40 2023-08-10T11:57:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.957+0000 7f92eb8efb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b39123fa60 con 0x55b391355360 2023-08-10T11:57:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.957+0000 7f92eb8efb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b39123f760 con 0x55b39134f550 2023-08-10T11:57:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.957+0000 7f92eb8efb80 10 client.0 _ll_register_callbacks cb 0x55b39123d620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:57:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.958+0000 7f92dd4f2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b39134f550 0x55b3913586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.958+0000 7f92dd4f2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b39134f550 0x55b3913586b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60654/0 (socket says 172.21.15.73:60654) 2023-08-10T11:57:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.958+0000 7f92dd4f2700 1 -- 172.21.15.73:0/3886889013 learned_addr learned my addr 172.21.15.73:0/3886889013 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:57:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.975+0000 7f92dccf1700 1 --2- 172.21.15.73:0/3886889013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b391354a40 0x55b391358bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.985+0000 7f92dd4f2700 1 -- 172.21.15.73:0/3886889013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b391355360 msgr2=0x55b391359130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T11:57:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.985+0000 7f92dd4f2700 1 --2- 172.21.15.73:0/3886889013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b391355360 0x55b391359130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.985+0000 7f92dd4f2700 1 -- 172.21.15.73:0/3886889013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b391354a40 msgr2=0x55b391358bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.985+0000 7f92dd4f2700 1 --2- 172.21.15.73:0/3886889013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b391354a40 0x55b391358bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.985+0000 7f92dd4f2700 1 -- 172.21.15.73:0/3886889013 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d811cc70 con 0x55b39134f550 2023-08-10T11:57:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:45.985+0000 7f92dd4f2700 1 --2- 172.21.15.73:0/3886889013 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b39134f550 0x55b3913586b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f92d400f6f0 tx=0x7f92d40047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35848451c804efe6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.053+0000 7f92c0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T11:57:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.053+0000 7f92c0ff9700 1 -- 172.21.15.73:0/3886889013 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d4020830 con 0x55b39134f550 2023-08-10T11:57:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.054+0000 7f92c0ff9700 1 -- 172.21.15.73:0/3886889013 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f92d4020990 con 0x55b39134f550 2023-08-10T11:57:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.103+0000 7f92eb8efb80 1 -- 172.21.15.73:0/3886889013 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b3913421c0 con 0x55b39134f550 2023-08-10T11:57:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.114+0000 7f92c0ff9700 1 -- 172.21.15.73:0/3886889013 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92d4020b50 con 0x55b39134f550 2023-08-10T11:57:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.114+0000 7f92eb8efb80 10 client.25888 fetch_fsmap learned FSMap version 39 2023-08-10T11:57:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.114+0000 7f92eb8efb80 1 -- 172.21.15.73:0/3886889013 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55b3910cdd80 con 0x55b39134f550 2023-08-10T11:57:46.172 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.169+0000 7f92c0ff9700 1 -- 172.21.15.73:0/3886889013 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b3913421c0 con 0x55b39134f550 2023-08-10T11:57:46.172 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.169+0000 7f92c0ff9700 1 -- 172.21.15.73:0/3886889013 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 39) v1 ==== 6981+0+0 (secure 0 0 0) 0x7f92d4033420 con 0x55b39134f550 2023-08-10T11:57:46.172 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.170+0000 7f92eb8efb80 10 client.25888 fetch_fsmap finished waiting for FSMap version 39 2023-08-10T11:57:46.172 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.170+0000 7f92eb8efb80 10 client.25888 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:57:46.173 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.170+0000 7f92eb8efb80 20 client.25888 populate_metadata read hostname 'smithi073' 2023-08-10T11:57:46.173 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.170+0000 7f92eb8efb80 1 --2- 172.21.15.73:0/3886889013 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b391368d90 0x55b39136b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:46.173 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.170+0000 7f92eb8efb80 4 client.25888 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:57:46.173 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.170+0000 7f92eb8efb80 1 -- 172.21.15.73:0/3886889013 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b39131e970 con 0x55b391368d90 2023-08-10T11:57:46.197 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.195+0000 7f92dccf1700 1 --2- 172.21.15.73:0/3886889013 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b391368d90 0x55b39136b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:46.432 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.430+0000 7f92dccf1700 1 --2- 172.21.15.73:0/3886889013 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b391368d90 0x55b39136b1b0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=142dda0b4bd5402d server_cookie=8738cf75a8976eb6 in_seq=0 out_seq=0 2023-08-10T11:57:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.437+0000 7f92c0ff9700 10 client.25888 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:57:46.486 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.484+0000 7f92c0ff9700 1 -- 172.21.15.73:0/3886889013 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55b39131e970 con 0x55b391368d90 2023-08-10T11:57:46.486 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.484+0000 7f92c0ff9700 10 client.25888 handle_command_reply: tid=0 2023-08-10T11:57:46.487 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.484+0000 7f92eb8efb80 1 client.25888 shutdown 2023-08-10T11:57:46.488 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.486+0000 7f92eb8efb80 1 -- 172.21.15.73:0/3886889013 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b39134f550 msgr2=0x55b3913586b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:46.488 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.486+0000 7f92eb8efb80 1 --2- 172.21.15.73:0/3886889013 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b39134f550 0x55b3913586b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f92d400f6f0 tx=0x7f92d40047c0 comp rx=0 tx=0).stop 2023-08-10T11:57:46.488 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.486+0000 7f92eb8efb80 1 -- 172.21.15.73:0/3886889013 shutdown_connections 2023-08-10T11:57:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.486+0000 7f92eb8efb80 1 --2- 172.21.15.73:0/3886889013 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b391368d90 0x55b39136b1b0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.486+0000 7f92eb8efb80 1 --2- 172.21.15.73:0/3886889013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b391355360 0x55b391359130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.486+0000 7f92eb8efb80 1 --2- 172.21.15.73:0/3886889013 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b39134f550 0x55b3913586b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.486+0000 7f92eb8efb80 1 --2- 172.21.15.73:0/3886889013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b391354a40 0x55b391358bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.487+0000 7f92eb8efb80 1 -- 172.21.15.73:0/3886889013 >> 172.21.15.73:0/3886889013 conn(0x55b3912acc70 msgr2=0x55b3913494b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.487+0000 7f92c0ff9700 0 client.25888 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:57:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.488+0000 7f92eb8efb80 1 -- 172.21.15.73:0/3886889013 shutdown_connections 2023-08-10T11:57:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.488+0000 7f92eb8efb80 1 -- 172.21.15.73:0/3886889013 wait complete. 2023-08-10T11:57:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.490+0000 7f92eb8efb80 20 client.25888 trim_cache size 0 max 16384 2023-08-10T11:57:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.552+0000 7f92eb8efb80 1 Processor -- start 2023-08-10T11:57:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.552+0000 7f92eb8efb80 1 -- start start 2023-08-10T11:57:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.553+0000 7f92eb8efb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b39134f550 0x55b39134f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.553+0000 7f92eb8efb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b391354a40 0x55b39135fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.553+0000 7f92eb8efb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b391355360 0x55b391349c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.553+0000 7f92dd4f2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b39134f550 0x55b39134f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.553+0000 7f92dd4f2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b39134f550 0x55b39134f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35158/0 (socket says 172.21.15.73:35158) 2023-08-10T11:57:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.553+0000 7f92dccf1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b391354a40 0x55b39135fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.554+0000 7f92dccf1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b391354a40 0x55b39135fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49810/0 (socket says 172.21.15.73:49810) 2023-08-10T11:57:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.554+0000 7f92dd4f2700 1 -- 172.21.15.73:0/1963905028 learned_addr learned my addr 172.21.15.73:0/1963905028 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:57:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.554+0000 7f92eb8efb80 1 -- 172.21.15.73:0/1963905028 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3911238c0 con 0x55b39134f550 2023-08-10T11:57:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.554+0000 7f92ddcf3700 1 --2- 172.21.15.73:0/1963905028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b391355360 0x55b391349c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.554+0000 7f92eb8efb80 1 -- 172.21.15.73:0/1963905028 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b391346cd0 con 0x55b391354a40 2023-08-10T11:57:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.554+0000 7f92eb8efb80 1 -- 172.21.15.73:0/1963905028 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3913420c0 con 0x55b391355360 2023-08-10T11:57:46.564 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.562+0000 7f92dccf1700 1 -- 172.21.15.73:0/1963905028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b391355360 msgr2=0x55b391349c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.562+0000 7f92dccf1700 1 --2- 172.21.15.73:0/1963905028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b391355360 0x55b391349c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.562+0000 7f92dccf1700 1 -- 172.21.15.73:0/1963905028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b39134f550 msgr2=0x55b39134f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.562+0000 7f92dccf1700 1 --2- 172.21.15.73:0/1963905028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b39134f550 0x55b39134f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.562+0000 7f92dccf1700 1 -- 172.21.15.73:0/1963905028 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3913463f0 con 0x55b391354a40 2023-08-10T11:57:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.563+0000 7f92dccf1700 1 --2- 172.21.15.73:0/1963905028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b391354a40 0x55b39135fdb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f92d000b3f0 tx=0x7f92d0009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=497ae02f1e41c3b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.578+0000 7f92c3fff700 1 -- 172.21.15.73:0/1963905028 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d000e040 con 0x55b391354a40 2023-08-10T11:57:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.578+0000 7f92c3fff700 1 -- 172.21.15.73:0/1963905028 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f92d0007710 con 0x55b391354a40 2023-08-10T11:57:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.578+0000 7f92c3fff700 1 -- 172.21.15.73:0/1963905028 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d001cae0 con 0x55b391354a40 2023-08-10T11:57:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.584+0000 7f92eb8efb80 1 -- 172.21.15.73:0/1963905028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b391354a40 msgr2=0x55b39135fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.584+0000 7f92eb8efb80 1 --2- 172.21.15.73:0/1963905028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b391354a40 0x55b39135fdb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f92d000b3f0 tx=0x7f92d0009c60 comp rx=0 tx=0).stop 2023-08-10T11:57:46.677 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.675+0000 7f92eb8efb80 1 -- 172.21.15.73:0/1963905028 shutdown_connections 2023-08-10T11:57:46.677 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.675+0000 7f92eb8efb80 1 --2- 172.21.15.73:0/1963905028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b391355360 0x55b391349c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:46.678 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.675+0000 7f92eb8efb80 1 --2- 172.21.15.73:0/1963905028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b39134f550 0x55b39134f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:46.678 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.675+0000 7f92eb8efb80 1 --2- 172.21.15.73:0/1963905028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b391354a40 0x55b39135fdb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:46.678 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.675+0000 7f92eb8efb80 1 -- 172.21.15.73:0/1963905028 >> 172.21.15.73:0/1963905028 conn(0x55b3912acc70 msgr2=0x55b391354120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:46.678 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.677+0000 7f92eb8efb80 1 -- 172.21.15.73:0/1963905028 shutdown_connections 2023-08-10T11:57:46.679 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.677+0000 7f92eb8efb80 1 -- 172.21.15.73:0/1963905028 wait complete. 2023-08-10T11:57:46.679 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.677+0000 7f92eb8efb80 1 -- start start 2023-08-10T11:57:46.679 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.677+0000 7f92eb8efb80 1 Processor -- start 2023-08-10T11:57:46.680 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.678+0000 7f92eb8efb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b39134f550 0x55b39135dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:46.680 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.678+0000 7f92eb8efb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b391354a40 0x55b39135e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:46.680 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.678+0000 7f92eb8efb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b391355360 0x55b3913b5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:46.681 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.678+0000 7f92eb8efb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3913b5f70 con 0x55b391354a40 2023-08-10T11:57:46.681 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.678+0000 7f92eb8efb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3913b60e0 con 0x55b391355360 2023-08-10T11:57:46.681 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.678+0000 7f92eb8efb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3913b62a0 con 0x55b39134f550 2023-08-10T11:57:46.681 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.678+0000 7f92eb8efb80 10 client.0 _ll_register_callbacks cb 0x55b39123d620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:57:46.681 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.679+0000 7f92ddcf3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b391355360 0x55b3913b5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:46.682 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.679+0000 7f92ddcf3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b391355360 0x55b3913b5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49818/0 (socket says 172.21.15.73:49818) 2023-08-10T11:57:46.682 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.679+0000 7f92ddcf3700 1 -- 172.21.15.73:0/2428218197 learned_addr learned my addr 172.21.15.73:0/2428218197 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:57:46.682 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.679+0000 7f92dd4f2700 1 --2- 172.21.15.73:0/2428218197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b39134f550 0x55b39135dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.690+0000 7f92ddcf3700 1 -- 172.21.15.73:0/2428218197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b39134f550 msgr2=0x55b39135dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.690+0000 7f92ddcf3700 1 --2- 172.21.15.73:0/2428218197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b39134f550 0x55b39135dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.690+0000 7f92ddcf3700 1 -- 172.21.15.73:0/2428218197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b391354a40 msgr2=0x55b39135e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.690+0000 7f92ddcf3700 1 --2- 172.21.15.73:0/2428218197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b391354a40 0x55b39135e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.690+0000 7f92ddcf3700 1 -- 172.21.15.73:0/2428218197 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b3911215d0 con 0x55b391355360 2023-08-10T11:57:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.696+0000 7f92ddcf3700 1 --2- 172.21.15.73:0/2428218197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b391355360 0x55b3913b5a30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f92c800fed0 tx=0x7f92c8098b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3487dd9035a7b674 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.728+0000 7f92c0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T11:57:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.728+0000 7f92c0ff9700 1 -- 172.21.15.73:0/2428218197 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8014040 con 0x55b391355360 2023-08-10T11:57:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.728+0000 7f92c0ff9700 1 -- 172.21.15.73:0/2428218197 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f92c8098fd0 con 0x55b391355360 2023-08-10T11:57:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.733+0000 7f92eb8efb80 1 -- 172.21.15.73:0/2428218197 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f92d00074e0 con 0x55b391355360 2023-08-10T11:57:46.765 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.763+0000 7f92c0ff9700 1 -- 172.21.15.73:0/2428218197 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92c809d000 con 0x55b391355360 2023-08-10T11:57:46.765 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.763+0000 7f92eb8efb80 10 client.25838 fetch_fsmap learned FSMap version 39 2023-08-10T11:57:46.765 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.763+0000 7f92eb8efb80 1 -- 172.21.15.73:0/2428218197 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55b3910b6c00 con 0x55b391355360 2023-08-10T11:57:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.789+0000 7f92c0ff9700 1 -- 172.21.15.73:0/2428218197 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f92d00074e0 con 0x55b391355360 2023-08-10T11:57:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.789+0000 7f92c0ff9700 1 -- 172.21.15.73:0/2428218197 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 39) v1 ==== 6981+0+0 (secure 0 0 0) 0x7f92c80b0be0 con 0x55b391355360 2023-08-10T11:57:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.789+0000 7f92eb8efb80 10 client.25838 fetch_fsmap finished waiting for FSMap version 39 2023-08-10T11:57:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.789+0000 7f92eb8efb80 10 client.25838 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:57:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.789+0000 7f92eb8efb80 20 client.25838 populate_metadata read hostname 'smithi073' 2023-08-10T11:57:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.789+0000 7f92eb8efb80 1 --2- 172.21.15.73:0/2428218197 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b3913bd960 0x55b3913bfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.789+0000 7f92eb8efb80 4 client.25838 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:57:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.789+0000 7f92eb8efb80 1 -- 172.21.15.73:0/2428218197 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b391299720 con 0x55b3913bd960 2023-08-10T11:57:46.807 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.806+0000 7f92dd4f2700 1 --2- 172.21.15.73:0/2428218197 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b3913bd960 0x55b3913bfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:46.813 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.806+0000 7f92dd4f2700 1 --2- 172.21.15.73:0/2428218197 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b3913bd960 0x55b3913bfd80 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae81765db100cfb7 server_cookie=e95c8e3fd18f5e5c in_seq=0 out_seq=0 2023-08-10T11:57:46.814 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:46.812+0000 7f92c0ff9700 10 client.25838 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:57:47.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:47 smithi152 ceph-mon[130220]: pgmap v157: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 253 op/s 2023-08-10T11:57:47.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:47 smithi156 ceph-mon[130574]: pgmap v157: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 253 op/s 2023-08-10T11:57:47.535 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:47 smithi073 ceph-mon[128869]: pgmap v157: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 253 op/s 2023-08-10T11:57:48.160 INFO:tasks.workunit.client.0.smithi073.stdout: 302 2580684 499 1676358 422 831174 841 2023-08-10T11:57:49.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:49 smithi152 ceph-mon[130220]: pgmap v158: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 152 op/s 2023-08-10T11:57:49.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:49 smithi156 ceph-mon[130574]: pgmap v158: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 152 op/s 2023-08-10T11:57:49.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:49 smithi073 ceph-mon[128869]: pgmap v158: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 152 op/s 2023-08-10T11:57:50.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:50.245+0000 7f92c0ff9700 1 -- 172.21.15.73:0/2428218197 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b391299720 con 0x55b3913bd960 2023-08-10T11:57:50.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:50.245+0000 7f92c0ff9700 10 client.25838 handle_command_reply: tid=0 2023-08-10T11:57:50.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:50.245+0000 7f92eb8efb80 1 client.25838 shutdown 2023-08-10T11:57:50.250 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:50.246+0000 7f92eb8efb80 1 -- 172.21.15.73:0/2428218197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b391355360 msgr2=0x55b3913b5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:50.250 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:50.246+0000 7f92eb8efb80 1 --2- 172.21.15.73:0/2428218197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b391355360 0x55b3913b5a30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f92c800fed0 tx=0x7f92c8098b90 comp rx=0 tx=0).stop 2023-08-10T11:57:50.250 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:50.246+0000 7f92eb8efb80 1 -- 172.21.15.73:0/2428218197 shutdown_connections 2023-08-10T11:57:50.250 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:50.246+0000 7f92eb8efb80 1 --2- 172.21.15.73:0/2428218197 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b3913bd960 0x55b3913bfd80 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:50.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:50.246+0000 7f92eb8efb80 1 --2- 172.21.15.73:0/2428218197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b391355360 0x55b3913b5a30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:50.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:50.246+0000 7f92eb8efb80 1 --2- 172.21.15.73:0/2428218197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b39134f550 0x55b39135dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:50.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:50.246+0000 7f92eb8efb80 1 --2- 172.21.15.73:0/2428218197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b391354a40 0x55b39135e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:50.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:50.246+0000 7f92eb8efb80 1 -- 172.21.15.73:0/2428218197 >> 172.21.15.73:0/2428218197 conn(0x55b3912acc70 msgr2=0x55b391355740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:50.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:50.246+0000 7f92c0ff9700 0 client.25838 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:57:50.257 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:50.255+0000 7f92eb8efb80 1 -- 172.21.15.73:0/2428218197 shutdown_connections 2023-08-10T11:57:50.257 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:50.255+0000 7f92eb8efb80 1 -- 172.21.15.73:0/2428218197 wait complete. 2023-08-10T11:57:50.257 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:50.255+0000 7f92eb8efb80 20 client.25838 trim_cache size 0 max 16384 2023-08-10T11:57:50.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:57:50.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:57:50.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:57:50.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:57:50.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:50.262+0000 7f92df756700 1 -- 172.21.15.73:0/1369404728 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f92c40a14d0 msgr2=0x7f92c40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:50.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:50.262+0000 7f92df756700 1 --2- 172.21.15.73:0/1369404728 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f92c40a14d0 0x7f92c40a3990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f92d4011630 tx=0x7f92d40119f0 comp rx=0 tx=0).stop 2023-08-10T11:57:50.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:50.262+0000 7f92df756700 1 -- 172.21.15.73:0/1369404728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92d8119f50 msgr2=0x7f92d8111120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:50.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:50.262+0000 7f92df756700 1 --2- 172.21.15.73:0/1369404728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92d8119f50 0x7f92d8111120 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f92d8069ae0 tx=0x7f92c800da00 comp rx=0 tx=0).stop 2023-08-10T11:57:50.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:50.280+0000 7f92df756700 1 -- 172.21.15.73:0/1369404728 shutdown_connections 2023-08-10T11:57:50.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:50.280+0000 7f92df756700 1 --2- 172.21.15.73:0/1369404728 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f92c40a14d0 0x7f92c40a3990 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:50.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:50.280+0000 7f92df756700 1 --2- 172.21.15.73:0/1369404728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92d8119f50 0x7f92d8111120 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:50.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:50.280+0000 7f92df756700 1 --2- 172.21.15.73:0/1369404728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92d810eec0 0x7f92d8118290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:50.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:50.280+0000 7f92df756700 1 --2- 172.21.15.73:0/1369404728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92d810f330 0x7f92d8118810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:50.282 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:50.280+0000 7f92df756700 1 -- 172.21.15.73:0/1369404728 >> 172.21.15.73:0/1369404728 conn(0x7f92d806c830 msgr2=0x7f92d806f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:50.284 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:50.283+0000 7f92df756700 1 -- 172.21.15.73:0/1369404728 shutdown_connections 2023-08-10T11:57:50.285 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:57:50.284+0000 7f92df756700 1 -- 172.21.15.73:0/1369404728 wait complete. 2023-08-10T11:57:50.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:50 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:57:50.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:50 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:57:50.523 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:50 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:57:51.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:51 smithi152 ceph-mon[130220]: pgmap v159: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 11 MiB/s wr, 668 op/s 2023-08-10T11:57:51.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:51 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:57:51.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:51 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:57:51.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:51 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:57:51.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:51 smithi156 ceph-mon[130574]: pgmap v159: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 11 MiB/s wr, 668 op/s 2023-08-10T11:57:51.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:51 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:57:51.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:51 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:57:51.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:51 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:57:51.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:51 smithi073 ceph-mon[128869]: pgmap v159: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 11 MiB/s wr, 668 op/s 2023-08-10T11:57:51.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:51 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:57:51.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:51 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:57:51.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:51 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:57:51.578 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:57:52.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.074+0000 7fded1713700 1 -- 172.21.15.73:0/1042885917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdecc1006a0 msgr2=0x7fdecc10c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:52.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.074+0000 7fded1713700 1 --2- 172.21.15.73:0/1042885917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdecc1006a0 0x7fdecc10c550 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdec400b0a0 tx=0x7fdec400b3b0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.074+0000 7fded1713700 1 -- 172.21.15.73:0/1042885917 shutdown_connections 2023-08-10T11:57:52.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.074+0000 7fded1713700 1 --2- 172.21.15.73:0/1042885917 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdecc1006a0 0x7fdecc10c550 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.074+0000 7fded1713700 1 --2- 172.21.15.73:0/1042885917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdecc105690 0x7fdecc105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.074+0000 7fded1713700 1 --2- 172.21.15.73:0/1042885917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdecc0ffce0 0x7fdecc100160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.074+0000 7fded1713700 1 -- 172.21.15.73:0/1042885917 >> 172.21.15.73:0/1042885917 conn(0x7fdecc076be0 msgr2=0x7fdecc0fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:52.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.074+0000 7fded1713700 1 -- 172.21.15.73:0/1042885917 shutdown_connections 2023-08-10T11:57:52.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.074+0000 7fded1713700 1 -- 172.21.15.73:0/1042885917 wait complete. 2023-08-10T11:57:52.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.075+0000 7fded1713700 1 Processor -- start 2023-08-10T11:57:52.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.076+0000 7fded1713700 1 -- start start 2023-08-10T11:57:52.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.076+0000 7fded1713700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdecc0ffce0 0x7fdecc19c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:52.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.076+0000 7fded1713700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdecc1006a0 0x7fdecc19ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:52.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.076+0000 7fded1713700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdecc105690 0x7fdecc1968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:52.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.076+0000 7fded1713700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc197000 con 0x7fdecc1006a0 2023-08-10T11:57:52.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.076+0000 7fded1713700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc197170 con 0x7fdecc105690 2023-08-10T11:57:52.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.076+0000 7fded1713700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc197330 con 0x7fdecc0ffce0 2023-08-10T11:57:52.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.076+0000 7fdecb7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdecc105690 0x7fdecc1968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:52.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.076+0000 7fdecb7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdecc105690 0x7fdecc1968f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49832/0 (socket says 172.21.15.73:49832) 2023-08-10T11:57:52.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.076+0000 7fdecb7fe700 1 -- 172.21.15.73:0/2133241218 learned_addr learned my addr 172.21.15.73:0/2133241218 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:57:52.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.076+0000 7fdeca7fc700 1 --2- 172.21.15.73:0/2133241218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdecc1006a0 0x7fdecc19ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:52.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.076+0000 7fdecaffd700 1 --2- 172.21.15.73:0/2133241218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdecc0ffce0 0x7fdecc19c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:52.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.077+0000 7fdecb7fe700 1 -- 172.21.15.73:0/2133241218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdecc0ffce0 msgr2=0x7fdecc19c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:52.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.077+0000 7fdecb7fe700 1 --2- 172.21.15.73:0/2133241218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdecc0ffce0 0x7fdecc19c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.077+0000 7fdecb7fe700 1 -- 172.21.15.73:0/2133241218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdecc1006a0 msgr2=0x7fdecc19ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:52.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.077+0000 7fdecb7fe700 1 --2- 172.21.15.73:0/2133241218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdecc1006a0 0x7fdecc19ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.077+0000 7fdecb7fe700 1 -- 172.21.15.73:0/2133241218 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec4009d00 con 0x7fdecc105690 2023-08-10T11:57:52.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.077+0000 7fdecb7fe700 1 --2- 172.21.15.73:0/2133241218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdecc105690 0x7fdecc1968f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdec4009fd0 tx=0x7fdec400bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:52.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.077+0000 7fdeb3fff700 1 -- 172.21.15.73:0/2133241218 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec400e040 con 0x7fdecc105690 2023-08-10T11:57:52.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.077+0000 7fdeb3fff700 1 -- 172.21.15.73:0/2133241218 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdec4004e60 con 0x7fdecc105690 2023-08-10T11:57:52.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.077+0000 7fded1713700 1 -- 172.21.15.73:0/2133241218 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdecc1975b0 con 0x7fdecc105690 2023-08-10T11:57:52.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.077+0000 7fdeb3fff700 1 -- 172.21.15.73:0/2133241218 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec4005280 con 0x7fdecc105690 2023-08-10T11:57:52.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.077+0000 7fded1713700 1 -- 172.21.15.73:0/2133241218 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdecc10cef0 con 0x7fdecc105690 2023-08-10T11:57:52.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.081+0000 7fdeb3fff700 1 -- 172.21.15.73:0/2133241218 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fdec401d470 con 0x7fdecc105690 2023-08-10T11:57:52.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.082+0000 7fdeb3fff700 1 --2- 172.21.15.73:0/2133241218 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fdeb40a1340 0x7fdeb40a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:52.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.082+0000 7fdecaffd700 1 --2- 172.21.15.73:0/2133241218 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fdeb40a1340 0x7fdeb40a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:52.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.082+0000 7fdeb3fff700 1 -- 172.21.15.73:0/2133241218 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fdec40cddb0 con 0x7fdecc105690 2023-08-10T11:57:52.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.083+0000 7fdecaffd700 1 --2- 172.21.15.73:0/2133241218 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fdeb40a1340 0x7fdeb40a3800 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdec0009a10 tx=0x7fdec0009190 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:52.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.083+0000 7fdedd8acb80 1 Processor -- start 2023-08-10T11:57:52.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.083+0000 7fdedd8acb80 1 -- start start 2023-08-10T11:57:52.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.083+0000 7fdedd8acb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac1823df50 0x55ac1823e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:52.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.083+0000 7fdedd8acb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac1823e870 0x55ac182382c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:52.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.083+0000 7fdedd8acb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac18238800 0x55ac18238c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:52.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.083+0000 7fdedd8acb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac181b3dc0 con 0x55ac1823df50 2023-08-10T11:57:52.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.083+0000 7fdedd8acb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac18190590 con 0x55ac1823e870 2023-08-10T11:57:52.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.083+0000 7fdedd8acb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac1818deb0 con 0x55ac18238800 2023-08-10T11:57:52.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.083+0000 7fdecaffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac1823df50 0x55ac1823e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:52.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.084+0000 7fdecaffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac1823df50 0x55ac1823e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35188/0 (socket says 172.21.15.73:35188) 2023-08-10T11:57:52.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.084+0000 7fdecaffd700 1 -- 172.21.15.73:0/2442168380 learned_addr learned my addr 172.21.15.73:0/2442168380 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:57:52.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.084+0000 7fdecb7fe700 1 --2- 172.21.15.73:0/2442168380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac18238800 0x55ac18238c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:52.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.084+0000 7fdeca7fc700 1 --2- 172.21.15.73:0/2442168380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac1823e870 0x55ac182382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:52.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.084+0000 7fdecb7fe700 1 -- 172.21.15.73:0/2442168380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac1823e870 msgr2=0x55ac182382c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:52.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.084+0000 7fdecb7fe700 1 --2- 172.21.15.73:0/2442168380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac1823e870 0x55ac182382c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.084+0000 7fdecb7fe700 1 -- 172.21.15.73:0/2442168380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac1823df50 msgr2=0x55ac1823e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:52.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.084+0000 7fdecb7fe700 1 --2- 172.21.15.73:0/2442168380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac1823df50 0x55ac1823e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.084+0000 7fdecb7fe700 1 -- 172.21.15.73:0/2442168380 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac1800a630 con 0x55ac18238800 2023-08-10T11:57:52.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.084+0000 7fdeca7fc700 1 --2- 172.21.15.73:0/2442168380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac1823e870 0x55ac182382c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:57:52.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.084+0000 7fdecaffd700 1 --2- 172.21.15.73:0/2442168380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac1823df50 0x55ac1823e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:57:52.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.084+0000 7fdecb7fe700 1 --2- 172.21.15.73:0/2442168380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac18238800 0x55ac18238c80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdec40cb530 tx=0x7fdec40099e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac1e1f2caaab861a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:52.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.084+0000 7fdeb17fa700 1 -- 172.21.15.73:0/2442168380 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec409af40 con 0x55ac18238800 2023-08-10T11:57:52.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.084+0000 7fdeb17fa700 1 -- 172.21.15.73:0/2442168380 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdec409ef70 con 0x55ac18238800 2023-08-10T11:57:52.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.084+0000 7fdeb17fa700 1 -- 172.21.15.73:0/2442168380 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec409b400 con 0x55ac18238800 2023-08-10T11:57:52.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.085+0000 7fdedd8acb80 1 -- 172.21.15.73:0/2442168380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac18238800 msgr2=0x55ac18238c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:52.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.085+0000 7fdedd8acb80 1 --2- 172.21.15.73:0/2442168380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac18238800 0x55ac18238c80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdec40cb530 tx=0x7fdec40099e0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.086+0000 7fdedd8acb80 1 -- 172.21.15.73:0/2442168380 shutdown_connections 2023-08-10T11:57:52.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.086+0000 7fdedd8acb80 1 --2- 172.21.15.73:0/2442168380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac18238800 0x55ac18238c80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.086+0000 7fdedd8acb80 1 --2- 172.21.15.73:0/2442168380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac1823df50 0x55ac1823e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.086+0000 7fdedd8acb80 1 --2- 172.21.15.73:0/2442168380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac1823e870 0x55ac182382c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.086+0000 7fdedd8acb80 1 -- 172.21.15.73:0/2442168380 >> 172.21.15.73:0/2442168380 conn(0x55ac18195cd0 msgr2=0x55ac182334d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:52.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.086+0000 7fdedd8acb80 1 -- 172.21.15.73:0/2442168380 shutdown_connections 2023-08-10T11:57:52.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.086+0000 7fdedd8acb80 1 -- 172.21.15.73:0/2442168380 wait complete. 2023-08-10T11:57:52.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.087+0000 7fdedd8acb80 1 -- start start 2023-08-10T11:57:52.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.087+0000 7fdedd8acb80 1 Processor -- start 2023-08-10T11:57:52.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.087+0000 7fdedd8acb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac18238800 0x55ac182448e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:52.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.087+0000 7fdedd8acb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac1823df50 0x55ac18241b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:52.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.087+0000 7fdedd8acb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac1823e870 0x55ac182422a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:52.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.087+0000 7fdedd8acb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac181897a0 con 0x55ac1823df50 2023-08-10T11:57:52.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.087+0000 7fdedd8acb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac18128ac0 con 0x55ac18238800 2023-08-10T11:57:52.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.087+0000 7fdedd8acb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac181287c0 con 0x55ac1823e870 2023-08-10T11:57:52.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.087+0000 7fdedd8acb80 10 client.0 _ll_register_callbacks cb 0x55ac18126680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:57:52.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.087+0000 7fdecaffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac18238800 0x55ac182448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:52.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.087+0000 7fdecaffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac18238800 0x55ac182448e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49844/0 (socket says 172.21.15.73:49844) 2023-08-10T11:57:52.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.087+0000 7fdecaffd700 1 -- 172.21.15.73:0/98672214 learned_addr learned my addr 172.21.15.73:0/98672214 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:57:52.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.088+0000 7fdecb7fe700 1 --2- 172.21.15.73:0/98672214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac1823e870 0x55ac182422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:52.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.088+0000 7fdeca7fc700 1 --2- 172.21.15.73:0/98672214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac1823df50 0x55ac18241b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:52.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.088+0000 7fdecaffd700 1 -- 172.21.15.73:0/98672214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac1823e870 msgr2=0x55ac182422a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:52.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.088+0000 7fdecaffd700 1 --2- 172.21.15.73:0/98672214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac1823e870 0x55ac182422a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.088+0000 7fdecaffd700 1 -- 172.21.15.73:0/98672214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac1823df50 msgr2=0x55ac18241b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:52.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.088+0000 7fdecaffd700 1 --2- 172.21.15.73:0/98672214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac1823df50 0x55ac18241b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.088+0000 7fdecaffd700 1 -- 172.21.15.73:0/98672214 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec000e6e0 con 0x55ac18238800 2023-08-10T11:57:52.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.088+0000 7fdeca7fc700 1 --2- 172.21.15.73:0/98672214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac1823df50 0x55ac18241b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:57:52.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.088+0000 7fdecaffd700 1 --2- 172.21.15.73:0/98672214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac18238800 0x55ac182448e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdec0015730 tx=0x7fdec0004860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ca8f6fa1f3aa77f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:52.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.088+0000 7fdeaeff5700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T11:57:52.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.088+0000 7fdeaeff5700 1 -- 172.21.15.73:0/98672214 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec0013450 con 0x55ac18238800 2023-08-10T11:57:52.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.088+0000 7fdeaeff5700 1 -- 172.21.15.73:0/98672214 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fdec00135b0 con 0x55ac18238800 2023-08-10T11:57:52.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.088+0000 7fdedd8acb80 1 -- 172.21.15.73:0/98672214 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ac1822b470 con 0x55ac18238800 2023-08-10T11:57:52.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.089+0000 7fdeaeff5700 1 -- 172.21.15.73:0/98672214 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdec0005a50 con 0x55ac18238800 2023-08-10T11:57:52.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.089+0000 7fdedd8acb80 10 client.25850 fetch_fsmap learned FSMap version 39 2023-08-10T11:57:52.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.089+0000 7fdedd8acb80 1 -- 172.21.15.73:0/98672214 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7fdecc10cef0 con 0x55ac18238800 2023-08-10T11:57:52.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.089+0000 7fdeaeff5700 1 -- 172.21.15.73:0/98672214 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ac1822b470 con 0x55ac18238800 2023-08-10T11:57:52.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.089+0000 7fdeaeff5700 1 -- 172.21.15.73:0/98672214 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 39) v1 ==== 6981+0+0 (secure 0 0 0) 0x7fdec0006020 con 0x55ac18238800 2023-08-10T11:57:52.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.089+0000 7fdedd8acb80 10 client.25850 fetch_fsmap finished waiting for FSMap version 39 2023-08-10T11:57:52.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.089+0000 7fdedd8acb80 10 client.25850 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:57:52.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.089+0000 7fdedd8acb80 20 client.25850 populate_metadata read hostname 'smithi073' 2023-08-10T11:57:52.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.089+0000 7fdedd8acb80 1 --2- 172.21.15.73:0/98672214 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55ac18252130 0x55ac18254550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:52.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.089+0000 7fdedd8acb80 4 client.25850 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:57:52.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.089+0000 7fdedd8acb80 1 -- 172.21.15.73:0/98672214 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ac182079d0 con 0x55ac18252130 2023-08-10T11:57:52.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.090+0000 7fdeca7fc700 1 --2- 172.21.15.73:0/98672214 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55ac18252130 0x55ac18254550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:52.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.090+0000 7fdeaeff5700 10 client.25850 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:57:52.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.090+0000 7fdeca7fc700 1 --2- 172.21.15.73:0/98672214 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55ac18252130 0x55ac18254550 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e35466dfe720d07 server_cookie=2b23ca4fc8e3b1d in_seq=0 out_seq=0 2023-08-10T11:57:52.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.095+0000 7fdeaeff5700 1 -- 172.21.15.73:0/98672214 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55ac182079d0 con 0x55ac18252130 2023-08-10T11:57:52.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.095+0000 7fdeaeff5700 10 client.25850 handle_command_reply: tid=0 2023-08-10T11:57:52.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.095+0000 7fdedd8acb80 1 client.25850 shutdown 2023-08-10T11:57:52.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.095+0000 7fdedd8acb80 1 -- 172.21.15.73:0/98672214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac18238800 msgr2=0x55ac182448e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:52.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.095+0000 7fdedd8acb80 1 --2- 172.21.15.73:0/98672214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac18238800 0x55ac182448e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdec0015730 tx=0x7fdec0004860 comp rx=0 tx=0).stop 2023-08-10T11:57:52.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.095+0000 7fdedd8acb80 1 -- 172.21.15.73:0/98672214 shutdown_connections 2023-08-10T11:57:52.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.096+0000 7fdedd8acb80 1 --2- 172.21.15.73:0/98672214 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55ac18252130 0x55ac18254550 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.096+0000 7fdedd8acb80 1 --2- 172.21.15.73:0/98672214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac18238800 0x55ac182448e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.096+0000 7fdedd8acb80 1 --2- 172.21.15.73:0/98672214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac1823e870 0x55ac182422a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.096+0000 7fdedd8acb80 1 --2- 172.21.15.73:0/98672214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac1823df50 0x55ac18241b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.096+0000 7fdedd8acb80 1 -- 172.21.15.73:0/98672214 >> 172.21.15.73:0/98672214 conn(0x55ac18195cd0 msgr2=0x55ac182329b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:52.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.096+0000 7fdeaeff5700 0 client.25850 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:57:52.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.096+0000 7fdedd8acb80 1 -- 172.21.15.73:0/98672214 shutdown_connections 2023-08-10T11:57:52.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.096+0000 7fdedd8acb80 1 -- 172.21.15.73:0/98672214 wait complete. 2023-08-10T11:57:52.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.102+0000 7fdedd8acb80 20 client.25850 trim_cache size 0 max 16384 2023-08-10T11:57:52.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.127+0000 7fdedd8acb80 1 Processor -- start 2023-08-10T11:57:52.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.127+0000 7fdedd8acb80 1 -- start start 2023-08-10T11:57:52.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.127+0000 7fdedd8acb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac18238800 0x55ac18249160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:52.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.127+0000 7fdedd8acb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac1823df50 0x55ac18244480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:52.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.127+0000 7fdedd8acb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac1823e870 0x55ac18233130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:52.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.127+0000 7fdedd8acb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac1800c920 con 0x55ac1823e870 2023-08-10T11:57:52.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.127+0000 7fdedd8acb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac1824f780 con 0x55ac1823df50 2023-08-10T11:57:52.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.127+0000 7fdedd8acb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac182400e0 con 0x55ac18238800 2023-08-10T11:57:52.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.127+0000 7fdecb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac1823e870 0x55ac18233130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.127+0000 7fdecaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac18238800 0x55ac18249160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.127+0000 7fdecb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac1823e870 0x55ac18233130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35206/0 (socket says 172.21.15.73:35206) 2023-08-10T11:57:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.127+0000 7fdecb7fe700 1 -- 172.21.15.73:0/2782198096 learned_addr learned my addr 172.21.15.73:0/2782198096 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:57:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.127+0000 7fdeca7fc700 1 --2- 172.21.15.73:0/2782198096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac1823df50 0x55ac18244480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.127+0000 7fdecb7fe700 1 -- 172.21.15.73:0/2782198096 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac18238800 msgr2=0x55ac18249160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.127+0000 7fdecb7fe700 1 --2- 172.21.15.73:0/2782198096 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac18238800 0x55ac18249160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.127+0000 7fdecb7fe700 1 -- 172.21.15.73:0/2782198096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac1823df50 msgr2=0x55ac18244480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.127+0000 7fdecb7fe700 1 --2- 172.21.15.73:0/2782198096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac1823df50 0x55ac18244480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.127+0000 7fdecb7fe700 1 -- 172.21.15.73:0/2782198096 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac17fb6de0 con 0x55ac1823e870 2023-08-10T11:57:52.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.127+0000 7fdecaffd700 1 --2- 172.21.15.73:0/2782198096 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac18238800 0x55ac18249160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:57:52.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.128+0000 7fdecb7fe700 1 --2- 172.21.15.73:0/2782198096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac1823e870 0x55ac18233130 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fdec409ac40 tx=0x7fdec401dd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d143b162217b29d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:52.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.128+0000 7fdeb1ffb700 1 -- 172.21.15.73:0/2782198096 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec409af40 con 0x55ac1823e870 2023-08-10T11:57:52.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.128+0000 7fdeb1ffb700 1 -- 172.21.15.73:0/2782198096 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdec40b2070 con 0x55ac1823e870 2023-08-10T11:57:52.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.128+0000 7fdeb1ffb700 1 -- 172.21.15.73:0/2782198096 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec409b1a0 con 0x55ac1823e870 2023-08-10T11:57:52.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.129+0000 7fdedd8acb80 1 -- 172.21.15.73:0/2782198096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac1823e870 msgr2=0x55ac18233130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:52.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.129+0000 7fdedd8acb80 1 --2- 172.21.15.73:0/2782198096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac1823e870 0x55ac18233130 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fdec409ac40 tx=0x7fdec401dd00 comp rx=0 tx=0).stop 2023-08-10T11:57:52.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.129+0000 7fdedd8acb80 1 -- 172.21.15.73:0/2782198096 shutdown_connections 2023-08-10T11:57:52.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.129+0000 7fdedd8acb80 1 --2- 172.21.15.73:0/2782198096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac1823e870 0x55ac18233130 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.129+0000 7fdedd8acb80 1 --2- 172.21.15.73:0/2782198096 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac18238800 0x55ac18249160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.129+0000 7fdedd8acb80 1 --2- 172.21.15.73:0/2782198096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac1823df50 0x55ac18244480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.129+0000 7fdedd8acb80 1 -- 172.21.15.73:0/2782198096 >> 172.21.15.73:0/2782198096 conn(0x55ac18195cd0 msgr2=0x55ac1823bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:52.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.129+0000 7fdedd8acb80 1 -- 172.21.15.73:0/2782198096 shutdown_connections 2023-08-10T11:57:52.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.129+0000 7fdedd8acb80 1 -- 172.21.15.73:0/2782198096 wait complete. 2023-08-10T11:57:52.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.130+0000 7fdedd8acb80 1 -- start start 2023-08-10T11:57:52.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.130+0000 7fdedd8acb80 1 Processor -- start 2023-08-10T11:57:52.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.130+0000 7fdedd8acb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac18238800 0x55ac1823aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:52.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.130+0000 7fdedd8acb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac1823df50 0x55ac1823b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:52.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.130+0000 7fdedd8acb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac1823e870 0x55ac18239970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:52.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.130+0000 7fdedd8acb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac18239eb0 con 0x55ac18238800 2023-08-10T11:57:52.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.130+0000 7fdedd8acb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac1823a020 con 0x55ac1823e870 2023-08-10T11:57:52.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.130+0000 7fdedd8acb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac1823a1e0 con 0x55ac1823df50 2023-08-10T11:57:52.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.130+0000 7fdedd8acb80 10 client.0 _ll_register_callbacks cb 0x55ac18126680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:57:52.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.130+0000 7fdecaffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac18238800 0x55ac1823aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:52.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.130+0000 7fdeca7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac1823df50 0x55ac1823b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:52.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.130+0000 7fdeca7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac1823df50 0x55ac1823b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60714/0 (socket says 172.21.15.73:60714) 2023-08-10T11:57:52.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.130+0000 7fdeca7fc700 1 -- 172.21.15.73:0/1012907949 learned_addr learned my addr 172.21.15.73:0/1012907949 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:57:52.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.130+0000 7fdecb7fe700 1 --2- 172.21.15.73:0/1012907949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac1823e870 0x55ac18239970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:52.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.130+0000 7fdeca7fc700 1 -- 172.21.15.73:0/1012907949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac1823e870 msgr2=0x55ac18239970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:52.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.130+0000 7fdeca7fc700 1 --2- 172.21.15.73:0/1012907949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac1823e870 0x55ac18239970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.130+0000 7fdeca7fc700 1 -- 172.21.15.73:0/1012907949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac18238800 msgr2=0x55ac1823aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:57:52.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.130+0000 7fdeca7fc700 1 --2- 172.21.15.73:0/1012907949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac18238800 0x55ac1823aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.130+0000 7fdeca7fc700 1 -- 172.21.15.73:0/1012907949 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdecc10cef0 con 0x55ac1823df50 2023-08-10T11:57:52.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.131+0000 7fdeca7fc700 1 --2- 172.21.15.73:0/1012907949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac1823df50 0x55ac1823b010 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdecc198120 tx=0x7fdebc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f33558e719edb361 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:57:52.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.131+0000 7fdeaeff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T11:57:52.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.131+0000 7fdeaeff5700 1 -- 172.21.15.73:0/1012907949 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc004440 con 0x55ac1823df50 2023-08-10T11:57:52.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.131+0000 7fdedd8acb80 1 -- 172.21.15.73:0/1012907949 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdec409ef70 con 0x55ac1823df50 2023-08-10T11:57:52.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.131+0000 7fdeaeff5700 1 -- 172.21.15.73:0/1012907949 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fdebc003680 con 0x55ac1823df50 2023-08-10T11:57:52.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.131+0000 7fdeaeff5700 1 -- 172.21.15.73:0/1012907949 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdebc0045a0 con 0x55ac1823df50 2023-08-10T11:57:52.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.131+0000 7fdedd8acb80 10 client.25912 fetch_fsmap learned FSMap version 39 2023-08-10T11:57:52.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.131+0000 7fdedd8acb80 1 -- 172.21.15.73:0/1012907949 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55ac1800a630 con 0x55ac1823df50 2023-08-10T11:57:52.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.131+0000 7fdeaeff5700 1 -- 172.21.15.73:0/1012907949 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdec409ef70 con 0x55ac1823df50 2023-08-10T11:57:52.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.132+0000 7fdeaeff5700 1 -- 172.21.15.73:0/1012907949 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 39) v1 ==== 6981+0+0 (secure 0 0 0) 0x7fdebc010a00 con 0x55ac1823df50 2023-08-10T11:57:52.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.132+0000 7fdedd8acb80 10 client.25912 fetch_fsmap finished waiting for FSMap version 39 2023-08-10T11:57:52.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.132+0000 7fdedd8acb80 10 client.25912 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:57:52.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.132+0000 7fdedd8acb80 20 client.25912 populate_metadata read hostname 'smithi073' 2023-08-10T11:57:52.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.132+0000 7fdedd8acb80 1 --2- 172.21.15.73:0/1012907949 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55ac182a6e50 0x55ac182a9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:57:52.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.132+0000 7fdedd8acb80 4 client.25912 mds_command: new command op to 24503 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:57:52.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.132+0000 7fdedd8acb80 1 -- 172.21.15.73:0/1012907949 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ac18182780 con 0x55ac182a6e50 2023-08-10T11:57:52.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.132+0000 7fdecaffd700 1 --2- 172.21.15.73:0/1012907949 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55ac182a6e50 0x55ac182a9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:57:52.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.132+0000 7fdeaeff5700 10 client.25912 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:57:52.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.132+0000 7fdecaffd700 1 --2- 172.21.15.73:0/1012907949 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55ac182a6e50 0x55ac182a9270 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a067c9777a33f4b server_cookie=dafa56d4e6cf89ad in_seq=0 out_seq=0 2023-08-10T11:57:52.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.138+0000 7fdeaeff5700 1 -- 172.21.15.73:0/1012907949 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55ac18182780 con 0x55ac182a6e50 2023-08-10T11:57:52.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.138+0000 7fdeaeff5700 10 client.25912 handle_command_reply: tid=0 2023-08-10T11:57:52.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.138+0000 7fdedd8acb80 1 client.25912 shutdown 2023-08-10T11:57:52.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.138+0000 7fdedd8acb80 1 -- 172.21.15.73:0/1012907949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac1823df50 msgr2=0x55ac1823b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:52.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.138+0000 7fdedd8acb80 1 --2- 172.21.15.73:0/1012907949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac1823df50 0x55ac1823b010 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdecc198120 tx=0x7fdebc009780 comp rx=0 tx=0).stop 2023-08-10T11:57:52.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.138+0000 7fdedd8acb80 1 -- 172.21.15.73:0/1012907949 shutdown_connections 2023-08-10T11:57:52.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.138+0000 7fdedd8acb80 1 --2- 172.21.15.73:0/1012907949 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55ac182a6e50 0x55ac182a9270 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.138+0000 7fdedd8acb80 1 --2- 172.21.15.73:0/1012907949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ac1823e870 0x55ac18239970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.138+0000 7fdedd8acb80 1 --2- 172.21.15.73:0/1012907949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ac18238800 0x55ac1823aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.138+0000 7fdedd8acb80 1 --2- 172.21.15.73:0/1012907949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac1823df50 0x55ac1823b010 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.138+0000 7fdedd8acb80 1 -- 172.21.15.73:0/1012907949 >> 172.21.15.73:0/1012907949 conn(0x55ac18195cd0 msgr2=0x55ac1823cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:52.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.138+0000 7fdeaeff5700 0 client.25912 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:57:52.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.138+0000 7fdedd8acb80 1 -- 172.21.15.73:0/1012907949 shutdown_connections 2023-08-10T11:57:52.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.138+0000 7fdedd8acb80 1 -- 172.21.15.73:0/1012907949 wait complete. 2023-08-10T11:57:52.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.138+0000 7fdedd8acb80 20 client.25912 trim_cache size 0 max 16384 2023-08-10T11:57:52.146 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:57:52.147 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:57:52.147 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": { 2023-08-10T11:57:52.147 INFO:teuthology.orchestra.run.smithi073.stdout: "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d": { 2023-08-10T11:57:52.147 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2023-08-10T11:57:52.147 INFO:teuthology.orchestra.run.smithi073.stdout: "tag": "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d", 2023-08-10T11:57:52.147 INFO:teuthology.orchestra.run.smithi073.stdout: "options": "recursive,force" 2023-08-10T11:57:52.148 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:57:52.148 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:57:52.148 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:57:52.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.139+0000 7fded1713700 1 -- 172.21.15.73:0/2133241218 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fdeb40a1340 msgr2=0x7fdeb40a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:52.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.139+0000 7fded1713700 1 --2- 172.21.15.73:0/2133241218 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fdeb40a1340 0x7fdeb40a3800 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdec0009a10 tx=0x7fdec0009190 comp rx=0 tx=0).stop 2023-08-10T11:57:52.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.139+0000 7fded1713700 1 -- 172.21.15.73:0/2133241218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdecc105690 msgr2=0x7fdecc1968f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:57:52.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.139+0000 7fded1713700 1 --2- 172.21.15.73:0/2133241218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdecc105690 0x7fdecc1968f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdec4009fd0 tx=0x7fdec400bce0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.139+0000 7fded1713700 1 -- 172.21.15.73:0/2133241218 shutdown_connections 2023-08-10T11:57:52.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.139+0000 7fded1713700 1 --2- 172.21.15.73:0/2133241218 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fdeb40a1340 0x7fdeb40a3800 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.139+0000 7fded1713700 1 --2- 172.21.15.73:0/2133241218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdecc105690 0x7fdecc1968f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.139+0000 7fded1713700 1 --2- 172.21.15.73:0/2133241218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdecc0ffce0 0x7fdecc19c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.139+0000 7fded1713700 1 --2- 172.21.15.73:0/2133241218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdecc1006a0 0x7fdecc19ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:57:52.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.139+0000 7fded1713700 1 -- 172.21.15.73:0/2133241218 >> 172.21.15.73:0/2133241218 conn(0x7fdecc076be0 msgr2=0x7fdecc102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:57:52.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.139+0000 7fded1713700 1 -- 172.21.15.73:0/2133241218 shutdown_connections 2023-08-10T11:57:52.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:57:52.139+0000 7fded1713700 1 -- 172.21.15.73:0/2133241218 wait complete. 2023-08-10T11:57:52.155 INFO:tasks.cephfs.filesystem:scrub status for tag:9d39b3fa-9b62-42b4-b1a5-738cb3118a5d - {'path': '/', 'tag': '9d39b3fa-9b62-42b4-b1a5-738cb3118a5d', 'options': 'recursive,force'} 2023-08-10T11:57:53.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:53 smithi152 ceph-mon[130220]: pgmap v160: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 11 MiB/s wr, 718 op/s 2023-08-10T11:57:53.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:53 smithi156 ceph-mon[130574]: pgmap v160: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 11 MiB/s wr, 718 op/s 2023-08-10T11:57:53.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:53 smithi073 ceph-mon[128869]: pgmap v160: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 11 MiB/s wr, 718 op/s 2023-08-10T11:57:55.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:54 smithi073 ceph-mon[128869]: pgmap v161: 97 pgs: 97 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 12 MiB/s wr, 808 op/s 2023-08-10T11:57:55.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:54 smithi152 ceph-mon[130220]: pgmap v161: 97 pgs: 97 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 12 MiB/s wr, 808 op/s 2023-08-10T11:57:55.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:54 smithi156 ceph-mon[130574]: pgmap v161: 97 pgs: 97 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 12 MiB/s wr, 808 op/s 2023-08-10T11:57:57.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:57 smithi156 ceph-mon[130574]: pgmap v162: 97 pgs: 97 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 878 op/s 2023-08-10T11:57:57.280 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:57 smithi073 ceph-mon[128869]: pgmap v162: 97 pgs: 97 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 878 op/s 2023-08-10T11:57:57.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:57 smithi152 ceph-mon[130220]: pgmap v162: 97 pgs: 97 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 878 op/s 2023-08-10T11:57:58.154 INFO:tasks.workunit.client.0.smithi073.stdout: 313 1953586 742 1279287 559 643849 816 2023-08-10T11:57:59.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:57:59 smithi152 ceph-mon[130220]: pgmap v163: 97 pgs: 97 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 13 MiB/s wr, 863 op/s 2023-08-10T11:57:59.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:57:59 smithi156 ceph-mon[130574]: pgmap v163: 97 pgs: 97 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 13 MiB/s wr, 863 op/s 2023-08-10T11:57:59.522 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:57:59 smithi073 ceph-mon[128869]: pgmap v163: 97 pgs: 97 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 13 MiB/s wr, 863 op/s 2023-08-10T11:58:01.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:01 smithi152 ceph-mon[130220]: pgmap v164: 97 pgs: 97 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 866 op/s 2023-08-10T11:58:01.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:01 smithi156 ceph-mon[130574]: pgmap v164: 97 pgs: 97 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 866 op/s 2023-08-10T11:58:01.530 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:01 smithi073 ceph-mon[128869]: pgmap v164: 97 pgs: 97 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 866 op/s 2023-08-10T11:58:03.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:03 smithi152 ceph-mon[130220]: pgmap v165: 97 pgs: 97 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.3 MiB/s wr, 356 op/s 2023-08-10T11:58:03.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:03 smithi156 ceph-mon[130574]: pgmap v165: 97 pgs: 97 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.3 MiB/s wr, 356 op/s 2023-08-10T11:58:03.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:03 smithi073 ceph-mon[128869]: pgmap v165: 97 pgs: 97 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.3 MiB/s wr, 356 op/s 2023-08-10T11:58:04.055 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.054+0000 7ffbcaba3700 1 -- 172.21.15.73:0/1279654425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbc410f330 msgr2=0x7ffbc4107cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:04.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.054+0000 7ffbcaba3700 1 --2- 172.21.15.73:0/1279654425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbc410f330 0x7ffbc4107cb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009990 tx=0x7ffbb8009ca0 comp rx=0 tx=0).stop 2023-08-10T11:58:04.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.055+0000 7ffbcaba3700 1 -- 172.21.15.73:0/1279654425 shutdown_connections 2023-08-10T11:58:04.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.055+0000 7ffbcaba3700 1 --2- 172.21.15.73:0/1279654425 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc4119f50 0x7ffbc411c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:04.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.055+0000 7ffbcaba3700 1 --2- 172.21.15.73:0/1279654425 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbc410eec0 0x7ffbc4107770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:04.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.055+0000 7ffbcaba3700 1 --2- 172.21.15.73:0/1279654425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbc410f330 0x7ffbc4107cb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:04.056 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.055+0000 7ffbcaba3700 1 -- 172.21.15.73:0/1279654425 >> 172.21.15.73:0/1279654425 conn(0x7ffbc406c830 msgr2=0x7ffbc406cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:04.057 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.055+0000 7ffbcaba3700 1 -- 172.21.15.73:0/1279654425 shutdown_connections 2023-08-10T11:58:04.057 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.055+0000 7ffbcaba3700 1 -- 172.21.15.73:0/1279654425 wait complete. 2023-08-10T11:58:04.057 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.056+0000 7ffbcaba3700 1 Processor -- start 2023-08-10T11:58:04.058 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.056+0000 7ffbcaba3700 1 -- start start 2023-08-10T11:58:04.058 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.056+0000 7ffbcaba3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbc410eec0 0x7ffbc4118230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:04.058 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.056+0000 7ffbcaba3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbc410f330 0x7ffbc41187b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:04.058 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.056+0000 7ffbcaba3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc4119f50 0x7ffbc4111030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:04.058 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.056+0000 7ffbcaba3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc41117d0 con 0x7ffbc410eec0 2023-08-10T11:58:04.058 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.056+0000 7ffbcaba3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc4111940 con 0x7ffbc410f330 2023-08-10T11:58:04.058 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.056+0000 7ffbcaba3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc4111b00 con 0x7ffbc4119f50 2023-08-10T11:58:04.065 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.064+0000 7ffbc9140700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc4119f50 0x7ffbc4111030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:04.065 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.064+0000 7ffbc9140700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc4119f50 0x7ffbc4111030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60730/0 (socket says 172.21.15.73:60730) 2023-08-10T11:58:04.065 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.064+0000 7ffbc9140700 1 -- 172.21.15.73:0/3412811805 learned_addr learned my addr 172.21.15.73:0/3412811805 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:04.065 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.064+0000 7ffbc893f700 1 --2- 172.21.15.73:0/3412811805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbc410eec0 0x7ffbc4118230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:04.065 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.064+0000 7ffbc3fff700 1 --2- 172.21.15.73:0/3412811805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbc410f330 0x7ffbc41187b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.065+0000 7ffbc9140700 1 -- 172.21.15.73:0/3412811805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbc410f330 msgr2=0x7ffbc41187b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.065+0000 7ffbc9140700 1 --2- 172.21.15.73:0/3412811805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbc410f330 0x7ffbc41187b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.065+0000 7ffbc9140700 1 -- 172.21.15.73:0/3412811805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbc410eec0 msgr2=0x7ffbc4118230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.065+0000 7ffbc9140700 1 --2- 172.21.15.73:0/3412811805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbc410eec0 0x7ffbc4118230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.065+0000 7ffbc9140700 1 -- 172.21.15.73:0/3412811805 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb80095f0 con 0x7ffbc4119f50 2023-08-10T11:58:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.070+0000 7ffbc9140700 1 --2- 172.21.15.73:0/3412811805 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc4119f50 0x7ffbc4111030 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc00ef90 tx=0x7ffbbc00c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.071+0000 7ffbc1ffb700 1 -- 172.21.15.73:0/3412811805 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc018070 con 0x7ffbc4119f50 2023-08-10T11:58:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.072+0000 7ffbc1ffb700 1 -- 172.21.15.73:0/3412811805 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffbbc00f040 con 0x7ffbc4119f50 2023-08-10T11:58:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.072+0000 7ffbc1ffb700 1 -- 172.21.15.73:0/3412811805 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc003ea0 con 0x7ffbc4119f50 2023-08-10T11:58:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.072+0000 7ffbcaba3700 1 -- 172.21.15.73:0/3412811805 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc4111d80 con 0x7ffbc4119f50 2023-08-10T11:58:04.080 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.072+0000 7ffbcaba3700 1 -- 172.21.15.73:0/3412811805 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc4116000 con 0x7ffbc4119f50 2023-08-10T11:58:04.080 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.079+0000 7ffbd6d3cb80 1 Processor -- start 2023-08-10T11:58:04.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.079+0000 7ffbd6d3cb80 1 -- start start 2023-08-10T11:58:04.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.079+0000 7ffbd6d3cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f612c6ea40 0x55f612c6ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:04.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.079+0000 7ffbd6d3cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f612c6f360 0x55f612c69010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:04.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.079+0000 7ffbd6d3cb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f612c69550 0x55f612c699d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:04.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.079+0000 7ffbd6d3cb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f612be4d60 con 0x55f612c69550 2023-08-10T11:58:04.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.079+0000 7ffbd6d3cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f612bc1530 con 0x55f612c6f360 2023-08-10T11:58:04.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.079+0000 7ffbd6d3cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f612bbee50 con 0x55f612c6ea40 2023-08-10T11:58:04.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.080+0000 7ffbc893f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f612c6f360 0x55f612c69010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:04.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.080+0000 7ffbc893f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f612c6f360 0x55f612c69010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49884/0 (socket says 172.21.15.73:49884) 2023-08-10T11:58:04.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.080+0000 7ffbc893f700 1 -- 172.21.15.73:0/1350701660 learned_addr learned my addr 172.21.15.73:0/1350701660 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:04.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.080+0000 7ffbc3fff700 1 --2- 172.21.15.73:0/1350701660 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f612c6ea40 0x55f612c6ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:04.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.081+0000 7ffbc893f700 1 -- 172.21.15.73:0/1350701660 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f612c6ea40 msgr2=0x55f612c6ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:04.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.081+0000 7ffbc893f700 1 --2- 172.21.15.73:0/1350701660 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f612c6ea40 0x55f612c6ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:04.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.081+0000 7ffbc893f700 1 -- 172.21.15.73:0/1350701660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f612c69550 msgr2=0x55f612c699d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:04.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.081+0000 7ffbc893f700 1 --2- 172.21.15.73:0/1350701660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f612c69550 0x55f612c699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:04.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.081+0000 7ffbc893f700 1 -- 172.21.15.73:0/1350701660 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f612a3b5d0 con 0x55f612c6f360 2023-08-10T11:58:04.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.087+0000 7ffbc893f700 1 --2- 172.21.15.73:0/1350701660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f612c6f360 0x55f612c69010 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffbb400bd70 tx=0x7ffbb400f640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c31cc6549fd1ea8d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:04.089 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.087+0000 7ffbc1ffb700 1 -- 172.21.15.73:0/3412811805 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7ffbbc004000 con 0x7ffbc4119f50 2023-08-10T11:58:04.089 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.088+0000 7ffbc1ffb700 1 --2- 172.21.15.73:0/3412811805 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ffbac0a14d0 0x7ffbac0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:04.089 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.088+0000 7ffbc1ffb700 1 -- 172.21.15.73:0/3412811805 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ffbbc0cd7a0 con 0x7ffbc4119f50 2023-08-10T11:58:04.094 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.094+0000 7ffbc3fff700 1 --2- 172.21.15.73:0/3412811805 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ffbac0a14d0 0x7ffbac0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:04.096 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.094+0000 7ffbaaffd700 1 -- 172.21.15.73:0/1350701660 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb400fda0 con 0x55f612c6f360 2023-08-10T11:58:04.096 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.094+0000 7ffbaaffd700 1 -- 172.21.15.73:0/1350701660 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffbb401a920 con 0x55f612c6f360 2023-08-10T11:58:04.096 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.094+0000 7ffbaaffd700 1 -- 172.21.15.73:0/1350701660 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb4011750 con 0x55f612c6f360 2023-08-10T11:58:04.096 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.095+0000 7ffbd6d3cb80 1 -- 172.21.15.73:0/1350701660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f612c6f360 msgr2=0x55f612c69010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:04.097 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.095+0000 7ffbd6d3cb80 1 --2- 172.21.15.73:0/1350701660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f612c6f360 0x55f612c69010 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffbb400bd70 tx=0x7ffbb400f640 comp rx=0 tx=0).stop 2023-08-10T11:58:04.097 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.097+0000 7ffbd6d3cb80 1 -- 172.21.15.73:0/1350701660 shutdown_connections 2023-08-10T11:58:04.097 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.097+0000 7ffbd6d3cb80 1 --2- 172.21.15.73:0/1350701660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f612c69550 0x55f612c699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:04.098 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.097+0000 7ffbd6d3cb80 1 --2- 172.21.15.73:0/1350701660 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f612c6ea40 0x55f612c6ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:04.098 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.097+0000 7ffbd6d3cb80 1 --2- 172.21.15.73:0/1350701660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f612c6f360 0x55f612c69010 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:04.098 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.097+0000 7ffbd6d3cb80 1 -- 172.21.15.73:0/1350701660 >> 172.21.15.73:0/1350701660 conn(0x55f612bc6c70 msgr2=0x55f612c63d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:04.098 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.098+0000 7ffbc3fff700 1 --2- 172.21.15.73:0/3412811805 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ffbac0a14d0 0x7ffbac0a3990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8006010 tx=0x7ffbb800b5b0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:04.128 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.127+0000 7ffbd6d3cb80 1 -- 172.21.15.73:0/1350701660 shutdown_connections 2023-08-10T11:58:04.128 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.127+0000 7ffbd6d3cb80 1 -- 172.21.15.73:0/1350701660 wait complete. 2023-08-10T11:58:04.129 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.127+0000 7ffbd6d3cb80 1 -- start start 2023-08-10T11:58:04.129 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.128+0000 7ffbd6d3cb80 1 Processor -- start 2023-08-10T11:58:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.128+0000 7ffbd6d3cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f612c69550 0x55f612c75420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.128+0000 7ffbd6d3cb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f612c6ea40 0x55f612c72630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.128+0000 7ffbd6d3cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f612c6f360 0x55f612c72d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.128+0000 7ffbd6d3cb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f612bba740 con 0x55f612c6ea40 2023-08-10T11:58:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.128+0000 7ffbd6d3cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f612b59a60 con 0x55f612c6f360 2023-08-10T11:58:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.128+0000 7ffbd6d3cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f612b59760 con 0x55f612c69550 2023-08-10T11:58:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.128+0000 7ffbd6d3cb80 10 client.0 _ll_register_callbacks cb 0x55f612b57620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:58:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.129+0000 7ffbc893f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f612c69550 0x55f612c75420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.129+0000 7ffbc893f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f612c69550 0x55f612c75420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60742/0 (socket says 172.21.15.73:60742) 2023-08-10T11:58:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.129+0000 7ffbc893f700 1 -- 172.21.15.73:0/891617425 learned_addr learned my addr 172.21.15.73:0/891617425 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.129+0000 7ffbc9140700 1 --2- 172.21.15.73:0/891617425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f612c6f360 0x55f612c72d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:04.133 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.130+0000 7ffbc3fff700 1 --2- 172.21.15.73:0/891617425 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f612c6ea40 0x55f612c72630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:04.149 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.136+0000 7ffbc9140700 1 -- 172.21.15.73:0/891617425 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f612c69550 msgr2=0x55f612c75420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:04.149 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.136+0000 7ffbc9140700 1 --2- 172.21.15.73:0/891617425 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f612c69550 0x55f612c75420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:04.149 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.136+0000 7ffbc9140700 1 -- 172.21.15.73:0/891617425 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f612c6ea40 msgr2=0x55f612c72630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:04.149 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.136+0000 7ffbc9140700 1 --2- 172.21.15.73:0/891617425 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f612c6ea40 0x55f612c72630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:04.149 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.136+0000 7ffbc9140700 1 -- 172.21.15.73:0/891617425 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb400b9a0 con 0x55f612c6f360 2023-08-10T11:58:04.150 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.148+0000 7ffbc9140700 1 --2- 172.21.15.73:0/891617425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f612c6f360 0x55f612c72d20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc0caec0 tx=0x7ffbbc0cb420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a2a8497f225d115 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:04.169 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.168+0000 7ffba3fff700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T11:58:04.169 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.168+0000 7ffba3fff700 1 -- 172.21.15.73:0/891617425 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc09a8d0 con 0x55f612c6f360 2023-08-10T11:58:04.169 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.168+0000 7ffba3fff700 1 -- 172.21.15.73:0/891617425 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ffbbc09e900 con 0x55f612c6f360 2023-08-10T11:58:04.170 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.168+0000 7ffbd6d3cb80 1 -- 172.21.15.73:0/891617425 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f612c5c1c0 con 0x55f612c6f360 2023-08-10T11:58:04.178 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.177+0000 7ffba3fff700 1 -- 172.21.15.73:0/891617425 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffbbc0a2c90 con 0x55f612c6f360 2023-08-10T11:58:04.180 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.179+0000 7ffbd6d3cb80 10 client.25868 fetch_fsmap learned FSMap version 39 2023-08-10T11:58:04.180 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.179+0000 7ffbd6d3cb80 1 -- 172.21.15.73:0/891617425 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55f6129e7d80 con 0x55f612c6f360 2023-08-10T11:58:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.189+0000 7ffba3fff700 1 -- 172.21.15.73:0/891617425 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f612c5c1c0 con 0x55f612c6f360 2023-08-10T11:58:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.189+0000 7ffba3fff700 1 -- 172.21.15.73:0/891617425 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 39) v1 ==== 6981+0+0 (secure 0 0 0) 0x7ffbbc0a2800 con 0x55f612c6f360 2023-08-10T11:58:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.190+0000 7ffbd6d3cb80 10 client.25868 fetch_fsmap finished waiting for FSMap version 39 2023-08-10T11:58:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.190+0000 7ffbd6d3cb80 10 client.25868 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:58:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.190+0000 7ffbd6d3cb80 20 client.25868 populate_metadata read hostname 'smithi073' 2023-08-10T11:58:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.190+0000 7ffbd6d3cb80 1 --2- 172.21.15.73:0/891617425 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f612c82dc0 0x55f612c851e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.190+0000 7ffbd6d3cb80 4 client.25868 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:58:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.190+0000 7ffbd6d3cb80 1 -- 172.21.15.73:0/891617425 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f612c38970 con 0x55f612c82dc0 2023-08-10T11:58:04.200 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.199+0000 7ffbc893f700 1 --2- 172.21.15.73:0/891617425 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f612c82dc0 0x55f612c851e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:04.225 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.224+0000 7ffba3fff700 10 client.25868 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:58:04.225 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.224+0000 7ffbc893f700 1 --2- 172.21.15.73:0/891617425 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f612c82dc0 0x55f612c851e0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2bd0bcf27b3bf7d server_cookie=a399fc9916c8043b in_seq=0 out_seq=0 2023-08-10T11:58:04.227 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.226+0000 7ffba3fff700 1 -- 172.21.15.73:0/891617425 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55f612c38970 con 0x55f612c82dc0 2023-08-10T11:58:04.227 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.226+0000 7ffba3fff700 10 client.25868 handle_command_reply: tid=0 2023-08-10T11:58:04.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.227+0000 7ffbd6d3cb80 1 client.25868 shutdown 2023-08-10T11:58:04.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.227+0000 7ffbd6d3cb80 1 -- 172.21.15.73:0/891617425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f612c6f360 msgr2=0x55f612c72d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:04.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.227+0000 7ffbd6d3cb80 1 --2- 172.21.15.73:0/891617425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f612c6f360 0x55f612c72d20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc0caec0 tx=0x7ffbbc0cb420 comp rx=0 tx=0).stop 2023-08-10T11:58:04.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.227+0000 7ffbd6d3cb80 1 -- 172.21.15.73:0/891617425 shutdown_connections 2023-08-10T11:58:04.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.227+0000 7ffbd6d3cb80 1 --2- 172.21.15.73:0/891617425 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f612c82dc0 0x55f612c851e0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:04.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.227+0000 7ffbd6d3cb80 1 --2- 172.21.15.73:0/891617425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f612c6f360 0x55f612c72d20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:04.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.227+0000 7ffbd6d3cb80 1 --2- 172.21.15.73:0/891617425 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f612c69550 0x55f612c75420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:04.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.227+0000 7ffbd6d3cb80 1 --2- 172.21.15.73:0/891617425 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f612c6ea40 0x55f612c72630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:04.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.227+0000 7ffbd6d3cb80 1 -- 172.21.15.73:0/891617425 >> 172.21.15.73:0/891617425 conn(0x55f612bc6c70 msgr2=0x55f612c634b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:04.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.227+0000 7ffba3fff700 0 client.25868 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:58:04.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.228+0000 7ffbd6d3cb80 1 -- 172.21.15.73:0/891617425 shutdown_connections 2023-08-10T11:58:04.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.228+0000 7ffbd6d3cb80 1 -- 172.21.15.73:0/891617425 wait complete. 2023-08-10T11:58:04.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.228+0000 7ffbd6d3cb80 20 client.25868 trim_cache size 0 max 16384 2023-08-10T11:58:04.294 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.294+0000 7ffbd6d3cb80 1 Processor -- start 2023-08-10T11:58:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.299+0000 7ffbd6d3cb80 1 -- start start 2023-08-10T11:58:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.299+0000 7ffbd6d3cb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f612c69550 0x55f612c69010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.299+0000 7ffbd6d3cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f612c6ea40 0x55f612c72c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.299+0000 7ffbd6d3cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f612c6f360 0x55f612c79ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.300+0000 7ffbd6d3cb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f612a3d8c0 con 0x55f612c69550 2023-08-10T11:58:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.300+0000 7ffbd6d3cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f612c60cd0 con 0x55f612c6ea40 2023-08-10T11:58:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.300+0000 7ffbd6d3cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f612c7edd0 con 0x55f612c6f360 2023-08-10T11:58:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.300+0000 7ffbc9140700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f612c6f360 0x55f612c79ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.300+0000 7ffbc3fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f612c6ea40 0x55f612c72c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.300+0000 7ffbc3fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f612c6ea40 0x55f612c72c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49898/0 (socket says 172.21.15.73:49898) 2023-08-10T11:58:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.300+0000 7ffbc3fff700 1 -- 172.21.15.73:0/1042307773 learned_addr learned my addr 172.21.15.73:0/1042307773 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:04.304 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.303+0000 7ffbc3fff700 1 -- 172.21.15.73:0/1042307773 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f612c6f360 msgr2=0x55f612c79ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:04.304 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.303+0000 7ffbc3fff700 1 --2- 172.21.15.73:0/1042307773 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f612c6f360 0x55f612c79ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:04.304 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.303+0000 7ffbc3fff700 1 -- 172.21.15.73:0/1042307773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f612c69550 msgr2=0x55f612c69010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:04.304 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.303+0000 7ffbc3fff700 1 --2- 172.21.15.73:0/1042307773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f612c69550 0x55f612c69010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:04.305 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.303+0000 7ffbc3fff700 1 -- 172.21.15.73:0/1042307773 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6129d0c00 con 0x55f612c6ea40 2023-08-10T11:58:04.307 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.306+0000 7ffbc3fff700 1 --2- 172.21.15.73:0/1042307773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f612c6ea40 0x55f612c72c80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffbc406dfb0 tx=0x7ffbb8020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16422f85cd73a738 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:04.317 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.317+0000 7ffbab7fe700 1 -- 172.21.15.73:0/1042307773 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb800f8c0 con 0x55f612c6ea40 2023-08-10T11:58:04.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.317+0000 7ffbab7fe700 1 -- 172.21.15.73:0/1042307773 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffbb801e070 con 0x55f612c6ea40 2023-08-10T11:58:04.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.317+0000 7ffbab7fe700 1 -- 172.21.15.73:0/1042307773 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8023bf0 con 0x55f612c6ea40 2023-08-10T11:58:04.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.318+0000 7ffbd6d3cb80 1 -- 172.21.15.73:0/1042307773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f612c6ea40 msgr2=0x55f612c72c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:04.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.318+0000 7ffbd6d3cb80 1 --2- 172.21.15.73:0/1042307773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f612c6ea40 0x55f612c72c80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffbc406dfb0 tx=0x7ffbb8020000 comp rx=0 tx=0).stop 2023-08-10T11:58:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.328+0000 7ffbd6d3cb80 1 -- 172.21.15.73:0/1042307773 shutdown_connections 2023-08-10T11:58:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.328+0000 7ffbd6d3cb80 1 --2- 172.21.15.73:0/1042307773 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f612c6f360 0x55f612c79ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.328+0000 7ffbd6d3cb80 1 --2- 172.21.15.73:0/1042307773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f612c69550 0x55f612c69010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.328+0000 7ffbd6d3cb80 1 --2- 172.21.15.73:0/1042307773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f612c6ea40 0x55f612c72c80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.328+0000 7ffbd6d3cb80 1 -- 172.21.15.73:0/1042307773 >> 172.21.15.73:0/1042307773 conn(0x55f612bc6c70 msgr2=0x55f612c6c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.328+0000 7ffbd6d3cb80 1 -- 172.21.15.73:0/1042307773 shutdown_connections 2023-08-10T11:58:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.328+0000 7ffbd6d3cb80 1 -- 172.21.15.73:0/1042307773 wait complete. 2023-08-10T11:58:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.328+0000 7ffbd6d3cb80 1 -- start start 2023-08-10T11:58:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.329+0000 7ffbd6d3cb80 1 Processor -- start 2023-08-10T11:58:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.329+0000 7ffbd6d3cb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f612c69550 0x55f612c79ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.329+0000 7ffbd6d3cb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f612c6ea40 0x55f612c77e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:04.332 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.329+0000 7ffbd6d3cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f612c6f360 0x55f612c783d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:04.332 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.329+0000 7ffbd6d3cb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f612c78910 con 0x55f612c6ea40 2023-08-10T11:58:04.332 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.329+0000 7ffbd6d3cb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f612c78a80 con 0x55f612c69550 2023-08-10T11:58:04.332 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.329+0000 7ffbd6d3cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f612c78c40 con 0x55f612c6f360 2023-08-10T11:58:04.332 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.329+0000 7ffbd6d3cb80 10 client.0 _ll_register_callbacks cb 0x55f612b57620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:58:04.332 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.330+0000 7ffbc9140700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f612c6f360 0x55f612c783d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:04.332 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.330+0000 7ffbc9140700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f612c6f360 0x55f612c783d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60760/0 (socket says 172.21.15.73:60760) 2023-08-10T11:58:04.333 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.330+0000 7ffbc9140700 1 -- 172.21.15.73:0/665661352 learned_addr learned my addr 172.21.15.73:0/665661352 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:04.333 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.330+0000 7ffbc893f700 1 --2- 172.21.15.73:0/665661352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f612c69550 0x55f612c79ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.336+0000 7ffbc9140700 1 -- 172.21.15.73:0/665661352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f612c69550 msgr2=0x55f612c79ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.336+0000 7ffbc9140700 1 --2- 172.21.15.73:0/665661352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f612c69550 0x55f612c79ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.336+0000 7ffbc9140700 1 -- 172.21.15.73:0/665661352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f612c6ea40 msgr2=0x55f612c77e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.336+0000 7ffbc9140700 1 --2- 172.21.15.73:0/665661352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f612c6ea40 0x55f612c77e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.336+0000 7ffbc9140700 1 -- 172.21.15.73:0/665661352 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc411cc70 con 0x55f612c6f360 2023-08-10T11:58:04.341 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.341+0000 7ffbc9140700 1 --2- 172.21.15.73:0/665661352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f612c6f360 0x55f612c783d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc097340 tx=0x7ffbbc098e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a53ed6ed6c285fd8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.363+0000 7ffba3fff700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T11:58:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.363+0000 7ffba3fff700 1 -- 172.21.15.73:0/665661352 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc0995f0 con 0x55f612c6f360 2023-08-10T11:58:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.363+0000 7ffba3fff700 1 -- 172.21.15.73:0/665661352 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ffbbc09e900 con 0x55f612c6f360 2023-08-10T11:58:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.363+0000 7ffbd6d3cb80 1 -- 172.21.15.73:0/665661352 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffbb401a920 con 0x55f612c6f360 2023-08-10T11:58:04.382 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.381+0000 7ffba3fff700 1 -- 172.21.15.73:0/665661352 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffbbc09a8d0 con 0x55f612c6f360 2023-08-10T11:58:04.384 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.383+0000 7ffbd6d3cb80 10 client.25930 fetch_fsmap learned FSMap version 39 2023-08-10T11:58:04.384 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.383+0000 7ffbd6d3cb80 1 -- 172.21.15.73:0/665661352 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55f612a0e1f0 con 0x55f612c6f360 2023-08-10T11:58:04.387 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.385+0000 7ffba3fff700 1 -- 172.21.15.73:0/665661352 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffbb401a920 con 0x55f612c6f360 2023-08-10T11:58:04.387 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.385+0000 7ffba3fff700 1 -- 172.21.15.73:0/665661352 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 39) v1 ==== 6981+0+0 (secure 0 0 0) 0x7ffbbc09ec70 con 0x55f612c6f360 2023-08-10T11:58:04.387 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.386+0000 7ffbd6d3cb80 10 client.25930 fetch_fsmap finished waiting for FSMap version 39 2023-08-10T11:58:04.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.386+0000 7ffbd6d3cb80 10 client.25930 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:58:04.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.386+0000 7ffbd6d3cb80 20 client.25930 populate_metadata read hostname 'smithi073' 2023-08-10T11:58:04.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.386+0000 7ffbd6d3cb80 1 --2- 172.21.15.73:0/665661352 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f612cd78f0 0x55f612cd9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:04.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.386+0000 7ffbd6d3cb80 4 client.25930 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:58:04.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.386+0000 7ffbd6d3cb80 1 -- 172.21.15.73:0/665661352 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f612bb3720 con 0x55f612cd78f0 2023-08-10T11:58:04.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.390+0000 7ffbc893f700 1 --2- 172.21.15.73:0/665661352 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f612cd78f0 0x55f612cd9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:04.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.421+0000 7ffbc893f700 1 --2- 172.21.15.73:0/665661352 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f612cd78f0 0x55f612cd9d10 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbd5a90aa1464c0b server_cookie=cfcdc6ca5e38bd6 in_seq=0 out_seq=0 2023-08-10T11:58:04.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:04.421+0000 7ffba3fff700 10 client.25930 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:58:05.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:04 smithi152 ceph-mon[130220]: pgmap v166: 97 pgs: 97 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.8 MiB/s wr, 254 op/s 2023-08-10T11:58:05.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:04 smithi156 ceph-mon[130574]: pgmap v166: 97 pgs: 97 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.8 MiB/s wr, 254 op/s 2023-08-10T11:58:05.290 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:04 smithi073 ceph-mon[128869]: pgmap v166: 97 pgs: 97 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.8 MiB/s wr, 254 op/s 2023-08-10T11:58:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:06.122+0000 7ffba3fff700 1 -- 172.21.15.73:0/665661352 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f612bb3720 con 0x55f612cd78f0 2023-08-10T11:58:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:06.122+0000 7ffba3fff700 10 client.25930 handle_command_reply: tid=0 2023-08-10T11:58:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:06.122+0000 7ffbd6d3cb80 1 client.25930 shutdown 2023-08-10T11:58:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:06.122+0000 7ffbd6d3cb80 1 -- 172.21.15.73:0/665661352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f612c6f360 msgr2=0x55f612c783d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:06.122+0000 7ffbd6d3cb80 1 --2- 172.21.15.73:0/665661352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f612c6f360 0x55f612c783d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc097340 tx=0x7ffbbc098e80 comp rx=0 tx=0).stop 2023-08-10T11:58:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:06.123+0000 7ffbd6d3cb80 1 -- 172.21.15.73:0/665661352 shutdown_connections 2023-08-10T11:58:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:06.123+0000 7ffbd6d3cb80 1 --2- 172.21.15.73:0/665661352 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f612cd78f0 0x55f612cd9d10 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:06.123+0000 7ffbd6d3cb80 1 --2- 172.21.15.73:0/665661352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f612c69550 0x55f612c79ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:06.123+0000 7ffbd6d3cb80 1 --2- 172.21.15.73:0/665661352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f612c6f360 0x55f612c783d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:06.123+0000 7ffbd6d3cb80 1 --2- 172.21.15.73:0/665661352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f612c6ea40 0x55f612c77e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:06.123+0000 7ffba3fff700 0 client.25930 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:58:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:06.123+0000 7ffbd6d3cb80 1 -- 172.21.15.73:0/665661352 >> 172.21.15.73:0/665661352 conn(0x55f612bc6c70 msgr2=0x55f612c6d830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:06.123+0000 7ffbd6d3cb80 1 -- 172.21.15.73:0/665661352 shutdown_connections 2023-08-10T11:58:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:06.123+0000 7ffbd6d3cb80 1 -- 172.21.15.73:0/665661352 wait complete. 2023-08-10T11:58:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:06.124+0000 7ffbd6d3cb80 20 client.25930 trim_cache size 0 max 16384 2023-08-10T11:58:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:58:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:58:06.129 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:58:06.130 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:58:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:06.125+0000 7ffbcaba3700 1 -- 172.21.15.73:0/3412811805 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ffbac0a14d0 msgr2=0x7ffbac0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:06.125+0000 7ffbcaba3700 1 --2- 172.21.15.73:0/3412811805 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ffbac0a14d0 0x7ffbac0a3990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8006010 tx=0x7ffbb800b5b0 comp rx=0 tx=0).stop 2023-08-10T11:58:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:06.125+0000 7ffbcaba3700 1 -- 172.21.15.73:0/3412811805 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc4119f50 msgr2=0x7ffbc4111030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:06.125+0000 7ffbcaba3700 1 --2- 172.21.15.73:0/3412811805 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc4119f50 0x7ffbc4111030 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc00ef90 tx=0x7ffbbc00c450 comp rx=0 tx=0).stop 2023-08-10T11:58:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:06.127+0000 7ffbcaba3700 1 -- 172.21.15.73:0/3412811805 shutdown_connections 2023-08-10T11:58:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:06.127+0000 7ffbcaba3700 1 --2- 172.21.15.73:0/3412811805 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ffbac0a14d0 0x7ffbac0a3990 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:06.127+0000 7ffbcaba3700 1 --2- 172.21.15.73:0/3412811805 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc4119f50 0x7ffbc4111030 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:06.127+0000 7ffbcaba3700 1 --2- 172.21.15.73:0/3412811805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbc410eec0 0x7ffbc4118230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:06.127+0000 7ffbcaba3700 1 --2- 172.21.15.73:0/3412811805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbc410f330 0x7ffbc41187b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:06.127+0000 7ffbcaba3700 1 -- 172.21.15.73:0/3412811805 >> 172.21.15.73:0/3412811805 conn(0x7ffbc406c830 msgr2=0x7ffbc406f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:06.127+0000 7ffbcaba3700 1 -- 172.21.15.73:0/3412811805 shutdown_connections 2023-08-10T11:58:06.133 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:06.127+0000 7ffbcaba3700 1 -- 172.21.15.73:0/3412811805 wait complete. 2023-08-10T11:58:07.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:07 smithi156 ceph-mon[130574]: pgmap v167: 97 pgs: 97 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.2 MiB/s wr, 183 op/s 2023-08-10T11:58:07.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:07 smithi073 ceph-mon[128869]: pgmap v167: 97 pgs: 97 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.2 MiB/s wr, 183 op/s 2023-08-10T11:58:07.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:07 smithi152 ceph-mon[130220]: pgmap v167: 97 pgs: 97 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.2 MiB/s wr, 183 op/s 2023-08-10T11:58:08.158 INFO:tasks.workunit.client.0.smithi073.stdout: 324 2715767 607 1761638 484 897274 675 2023-08-10T11:58:09.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:09 smithi152 ceph-mon[130220]: pgmap v168: 97 pgs: 97 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 154 op/s 2023-08-10T11:58:09.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:09 smithi156 ceph-mon[130574]: pgmap v168: 97 pgs: 97 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 154 op/s 2023-08-10T11:58:09.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:09 smithi073 ceph-mon[128869]: pgmap v168: 97 pgs: 97 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 154 op/s 2023-08-10T11:58:11.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:11 smithi152 ceph-mon[130220]: pgmap v169: 97 pgs: 97 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 359 op/s 2023-08-10T11:58:11.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:11 smithi156 ceph-mon[130574]: pgmap v169: 97 pgs: 97 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 359 op/s 2023-08-10T11:58:11.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:11 smithi073 ceph-mon[128869]: pgmap v169: 97 pgs: 97 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 359 op/s 2023-08-10T11:58:13.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:13 smithi152 ceph-mon[130220]: pgmap v170: 97 pgs: 97 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 327 op/s 2023-08-10T11:58:13.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:13 smithi156 ceph-mon[130574]: pgmap v170: 97 pgs: 97 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 327 op/s 2023-08-10T11:58:13.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:13 smithi073 ceph-mon[128869]: pgmap v170: 97 pgs: 97 active+clean; 1.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 327 op/s 2023-08-10T11:58:15.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:14 smithi073 ceph-mon[128869]: pgmap v171: 97 pgs: 97 active+clean; 1.3 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 339 op/s 2023-08-10T11:58:15.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:14 smithi152 ceph-mon[130220]: pgmap v171: 97 pgs: 97 active+clean; 1.3 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 339 op/s 2023-08-10T11:58:15.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:14 smithi156 ceph-mon[130574]: pgmap v171: 97 pgs: 97 active+clean; 1.3 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 339 op/s 2023-08-10T11:58:17.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:17 smithi073 ceph-mon[128869]: pgmap v172: 97 pgs: 97 active+clean; 1.3 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 348 op/s 2023-08-10T11:58:17.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:17 smithi152 ceph-mon[130220]: pgmap v172: 97 pgs: 97 active+clean; 1.3 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 348 op/s 2023-08-10T11:58:17.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:17 smithi156 ceph-mon[130574]: pgmap v172: 97 pgs: 97 active+clean; 1.3 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 348 op/s 2023-08-10T11:58:18.158 INFO:tasks.workunit.client.0.smithi073.stdout: 361 825091 2234 533425 1691 271497 153 2023-08-10T11:58:19.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:19 smithi073 ceph-mon[128869]: pgmap v173: 97 pgs: 97 active+clean; 1.3 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 391 op/s 2023-08-10T11:58:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.404+0000 7fa1554a9700 1 -- 172.21.15.73:0/3389526176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa150105670 msgr2=0x7fa150105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.404+0000 7fa1554a9700 1 --2- 172.21.15.73:0/3389526176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa150105670 0x7fa150105a50 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fa140009990 tx=0x7fa140009ca0 comp rx=0 tx=0).stop 2023-08-10T11:58:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.404+0000 7fa1554a9700 1 -- 172.21.15.73:0/3389526176 shutdown_connections 2023-08-10T11:58:19.409 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.404+0000 7fa1554a9700 1 --2- 172.21.15.73:0/3389526176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa150100290 0x7fa15010c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:19.409 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.404+0000 7fa1554a9700 1 --2- 172.21.15.73:0/3389526176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa150105670 0x7fa150105a50 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:19.409 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.404+0000 7fa1554a9700 1 --2- 172.21.15.73:0/3389526176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1500ff8d0 0x7fa1500ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:19.409 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.404+0000 7fa1554a9700 1 -- 172.21.15.73:0/3389526176 >> 172.21.15.73:0/3389526176 conn(0x7fa1500750a0 msgr2=0x7fa1500754b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:19.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.404+0000 7fa1554a9700 1 -- 172.21.15.73:0/3389526176 shutdown_connections 2023-08-10T11:58:19.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.404+0000 7fa1554a9700 1 -- 172.21.15.73:0/3389526176 wait complete. 2023-08-10T11:58:19.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.405+0000 7fa1554a9700 1 Processor -- start 2023-08-10T11:58:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.405+0000 7fa1554a9700 1 -- start start 2023-08-10T11:58:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.405+0000 7fa1554a9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1500ff8d0 0x7fa150101450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.405+0000 7fa1554a9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa150100290 0x7fa150101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.405+0000 7fa1554a9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa150105670 0x7fa1501a4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:19.412 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.405+0000 7fa1554a9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1501a4e50 con 0x7fa150100290 2023-08-10T11:58:19.412 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.405+0000 7fa1554a9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1501a4f90 con 0x7fa1500ff8d0 2023-08-10T11:58:19.412 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.405+0000 7fa1554a9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1501a5100 con 0x7fa150105670 2023-08-10T11:58:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.405+0000 7fa14e7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa150100290 0x7fa150101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.405+0000 7fa14e7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa150100290 0x7fa150101990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35270/0 (socket says 172.21.15.73:35270) 2023-08-10T11:58:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.405+0000 7fa14e7fc700 1 -- 172.21.15.73:0/4232473525 learned_addr learned my addr 172.21.15.73:0/4232473525 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.405+0000 7fa14effd700 1 --2- 172.21.15.73:0/4232473525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1500ff8d0 0x7fa150101450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.405+0000 7fa14f7fe700 1 --2- 172.21.15.73:0/4232473525 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa150105670 0x7fa1501a4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.405+0000 7fa14e7fc700 1 -- 172.21.15.73:0/4232473525 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa150105670 msgr2=0x7fa1501a4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.405+0000 7fa14e7fc700 1 --2- 172.21.15.73:0/4232473525 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa150105670 0x7fa1501a4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.405+0000 7fa14e7fc700 1 -- 172.21.15.73:0/4232473525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1500ff8d0 msgr2=0x7fa150101450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.405+0000 7fa14e7fc700 1 --2- 172.21.15.73:0/4232473525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1500ff8d0 0x7fa150101450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.405+0000 7fa14e7fc700 1 -- 172.21.15.73:0/4232473525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1400095f0 con 0x7fa150100290 2023-08-10T11:58:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.406+0000 7fa14e7fc700 1 --2- 172.21.15.73:0/4232473525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa150100290 0x7fa150101990 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fa14400e9a0 tx=0x7fa14400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.406+0000 7fa137fff700 1 -- 172.21.15.73:0/4232473525 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa144009790 con 0x7fa150100290 2023-08-10T11:58:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.406+0000 7fa137fff700 1 -- 172.21.15.73:0/4232473525 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa144010430 con 0x7fa150100290 2023-08-10T11:58:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.406+0000 7fa1554a9700 1 -- 172.21.15.73:0/4232473525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1501a53e0 con 0x7fa150100290 2023-08-10T11:58:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.406+0000 7fa137fff700 1 -- 172.21.15.73:0/4232473525 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa144018680 con 0x7fa150100290 2023-08-10T11:58:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.406+0000 7fa1554a9700 1 -- 172.21.15.73:0/4232473525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1501a58f0 con 0x7fa150100290 2023-08-10T11:58:19.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.408+0000 7fa137fff700 1 -- 172.21.15.73:0/4232473525 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fa1440105a0 con 0x7fa150100290 2023-08-10T11:58:19.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.408+0000 7fa137fff700 1 --2- 172.21.15.73:0/4232473525 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa1380a12c0 0x7fa1380a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:19.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.409+0000 7fa14effd700 1 --2- 172.21.15.73:0/4232473525 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa1380a12c0 0x7fa1380a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:19.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.409+0000 7fa137fff700 1 -- 172.21.15.73:0/4232473525 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fa144014070 con 0x7fa150100290 2023-08-10T11:58:19.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.409+0000 7fa14effd700 1 --2- 172.21.15.73:0/4232473525 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa1380a12c0 0x7fa1380a3780 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa14000b2e0 tx=0x7fa140005fd0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:19.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.409+0000 7fa161642b80 1 Processor -- start 2023-08-10T11:58:19.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.409+0000 7fa161642b80 1 -- start start 2023-08-10T11:58:19.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.410+0000 7fa161642b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2b5d4ca40 0x55f2b5d4ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:19.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.410+0000 7fa161642b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2b5d4d360 0x55f2b5d47010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:19.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.410+0000 7fa161642b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f2b5d47550 0x55f2b5d479d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:19.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.410+0000 7fa161642b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2b5cc2d60 con 0x55f2b5d4ca40 2023-08-10T11:58:19.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.410+0000 7fa161642b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2b5c9f530 con 0x55f2b5d4d360 2023-08-10T11:58:19.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.410+0000 7fa161642b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2b5c9ce50 con 0x55f2b5d47550 2023-08-10T11:58:19.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.410+0000 7fa14effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2b5d4ca40 0x55f2b5d4ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:19.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.410+0000 7fa14effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2b5d4ca40 0x55f2b5d4ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35276/0 (socket says 172.21.15.73:35276) 2023-08-10T11:58:19.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.410+0000 7fa14effd700 1 -- 172.21.15.73:0/817966649 learned_addr learned my addr 172.21.15.73:0/817966649 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:19.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.410+0000 7fa14f7fe700 1 --2- 172.21.15.73:0/817966649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f2b5d47550 0x55f2b5d479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:19.426 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.410+0000 7fa14e7fc700 1 --2- 172.21.15.73:0/817966649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2b5d4d360 0x55f2b5d47010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:19.426 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.410+0000 7fa14effd700 1 -- 172.21.15.73:0/817966649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f2b5d47550 msgr2=0x55f2b5d479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:19.426 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.410+0000 7fa14effd700 1 --2- 172.21.15.73:0/817966649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f2b5d47550 0x55f2b5d479d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:19.426 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.410+0000 7fa14effd700 1 -- 172.21.15.73:0/817966649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2b5d4d360 msgr2=0x55f2b5d47010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:19.426 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.410+0000 7fa14effd700 1 --2- 172.21.15.73:0/817966649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2b5d4d360 0x55f2b5d47010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:19.426 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.410+0000 7fa14effd700 1 -- 172.21.15.73:0/817966649 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2b5b195d0 con 0x55f2b5d4ca40 2023-08-10T11:58:19.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.410+0000 7fa14effd700 1 --2- 172.21.15.73:0/817966649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2b5d4ca40 0x55f2b5d4ce20 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fa1500766a0 tx=0x7fa140020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2261f53e90d08622 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:19.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.410+0000 7fa1357fa700 1 -- 172.21.15.73:0/817966649 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14002b070 con 0x55f2b5d4ca40 2023-08-10T11:58:19.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.410+0000 7fa1357fa700 1 -- 172.21.15.73:0/817966649 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa14001e040 con 0x55f2b5d4ca40 2023-08-10T11:58:19.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.410+0000 7fa1357fa700 1 -- 172.21.15.73:0/817966649 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14000f6c0 con 0x55f2b5d4ca40 2023-08-10T11:58:19.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.411+0000 7fa161642b80 1 -- 172.21.15.73:0/817966649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2b5d4ca40 msgr2=0x55f2b5d4ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:19.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.411+0000 7fa161642b80 1 --2- 172.21.15.73:0/817966649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2b5d4ca40 0x55f2b5d4ce20 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fa1500766a0 tx=0x7fa140020000 comp rx=0 tx=0).stop 2023-08-10T11:58:19.427 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.411+0000 7fa161642b80 1 -- 172.21.15.73:0/817966649 shutdown_connections 2023-08-10T11:58:19.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.411+0000 7fa161642b80 1 --2- 172.21.15.73:0/817966649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f2b5d47550 0x55f2b5d479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:19.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.411+0000 7fa161642b80 1 --2- 172.21.15.73:0/817966649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2b5d4ca40 0x55f2b5d4ce20 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:19.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.411+0000 7fa161642b80 1 --2- 172.21.15.73:0/817966649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2b5d4d360 0x55f2b5d47010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:19.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.411+0000 7fa161642b80 1 -- 172.21.15.73:0/817966649 >> 172.21.15.73:0/817966649 conn(0x55f2b5ca4c70 msgr2=0x55f2b5d41d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:19.428 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.411+0000 7fa161642b80 1 -- 172.21.15.73:0/817966649 shutdown_connections 2023-08-10T11:58:19.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.411+0000 7fa161642b80 1 -- 172.21.15.73:0/817966649 wait complete. 2023-08-10T11:58:19.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.411+0000 7fa161642b80 1 -- start start 2023-08-10T11:58:19.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.412+0000 7fa161642b80 1 Processor -- start 2023-08-10T11:58:19.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.412+0000 7fa161642b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2b5d47550 0x55f2b5d533a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:19.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.412+0000 7fa161642b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f2b5d4ca40 0x55f2b5d50690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:19.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.412+0000 7fa161642b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2b5d4d360 0x55f2b5d50d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:19.429 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.412+0000 7fa161642b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2b5c98740 con 0x55f2b5d47550 2023-08-10T11:58:19.430 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.412+0000 7fa161642b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2b5c37a60 con 0x55f2b5d4d360 2023-08-10T11:58:19.430 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.412+0000 7fa161642b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2b5c37760 con 0x55f2b5d4ca40 2023-08-10T11:58:19.430 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.412+0000 7fa161642b80 10 client.0 _ll_register_callbacks cb 0x55f2b5c35620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:58:19.430 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.412+0000 7fa14effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2b5d47550 0x55f2b5d533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:19.430 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.412+0000 7fa14effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2b5d47550 0x55f2b5d533a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35282/0 (socket says 172.21.15.73:35282) 2023-08-10T11:58:19.430 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.412+0000 7fa14effd700 1 -- 172.21.15.73:0/3879178885 learned_addr learned my addr 172.21.15.73:0/3879178885 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:19.430 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.412+0000 7fa14e7fc700 1 --2- 172.21.15.73:0/3879178885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f2b5d4ca40 0x55f2b5d50690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.412+0000 7fa14f7fe700 1 --2- 172.21.15.73:0/3879178885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2b5d4d360 0x55f2b5d50d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.412+0000 7fa14effd700 1 -- 172.21.15.73:0/3879178885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f2b5d4ca40 msgr2=0x55f2b5d50690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.412+0000 7fa14effd700 1 --2- 172.21.15.73:0/3879178885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f2b5d4ca40 0x55f2b5d50690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.412+0000 7fa14effd700 1 -- 172.21.15.73:0/3879178885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2b5d4d360 msgr2=0x55f2b5d50d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.412+0000 7fa14effd700 1 --2- 172.21.15.73:0/3879178885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2b5d4d360 0x55f2b5d50d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.412+0000 7fa14effd700 1 -- 172.21.15.73:0/3879178885 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15010cda0 con 0x55f2b5d47550 2023-08-10T11:58:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.413+0000 7fa14effd700 1 --2- 172.21.15.73:0/3879178885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2b5d47550 0x55f2b5d533a0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fa140004bf0 tx=0x7fa14000bc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8063f199c187b21c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.413+0000 7fa132ff5700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:58:19.432 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.413+0000 7fa132ff5700 1 -- 172.21.15.73:0/3879178885 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14002b040 con 0x55f2b5d47550 2023-08-10T11:58:19.432 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.413+0000 7fa132ff5700 1 -- 172.21.15.73:0/3879178885 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fa14000fb80 con 0x55f2b5d47550 2023-08-10T11:58:19.432 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.413+0000 7fa161642b80 1 -- 172.21.15.73:0/3879178885 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f2b5d3a1c0 con 0x55f2b5d47550 2023-08-10T11:58:19.432 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.413+0000 7fa132ff5700 1 -- 172.21.15.73:0/3879178885 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa14000fd40 con 0x55f2b5d47550 2023-08-10T11:58:19.432 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.413+0000 7fa161642b80 10 client.16446 fetch_fsmap learned FSMap version 39 2023-08-10T11:58:19.433 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.413+0000 7fa161642b80 1 -- 172.21.15.73:0/3879178885 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55f2b5ac5d80 con 0x55f2b5d47550 2023-08-10T11:58:19.433 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.413+0000 7fa132ff5700 1 -- 172.21.15.73:0/3879178885 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f2b5d3a1c0 con 0x55f2b5d47550 2023-08-10T11:58:19.433 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.413+0000 7fa132ff5700 1 -- 172.21.15.73:0/3879178885 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 39) v1 ==== 6981+0+0 (secure 0 0 0) 0x7fa140036030 con 0x55f2b5d47550 2023-08-10T11:58:19.433 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.413+0000 7fa161642b80 10 client.16446 fetch_fsmap finished waiting for FSMap version 39 2023-08-10T11:58:19.433 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.413+0000 7fa161642b80 10 client.16446 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:58:19.433 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.413+0000 7fa161642b80 20 client.16446 populate_metadata read hostname 'smithi073' 2023-08-10T11:58:19.433 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.413+0000 7fa161642b80 1 --2- 172.21.15.73:0/3879178885 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f2b5d607d0 0x55f2b5d62bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:19.434 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.413+0000 7fa161642b80 4 client.16446 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:58:19.434 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.413+0000 7fa161642b80 1 -- 172.21.15.73:0/3879178885 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f2b5d16970 con 0x55f2b5d607d0 2023-08-10T11:58:19.434 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.413+0000 7fa14e7fc700 1 --2- 172.21.15.73:0/3879178885 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f2b5d607d0 0x55f2b5d62bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:19.434 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.414+0000 7fa132ff5700 10 client.16446 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:58:19.434 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.414+0000 7fa14e7fc700 1 --2- 172.21.15.73:0/3879178885 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f2b5d607d0 0x55f2b5d62bc0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8aa6edc78019b70 server_cookie=622b5cc09100fe16 in_seq=0 out_seq=0 2023-08-10T11:58:19.434 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.418+0000 7fa132ff5700 1 -- 172.21.15.73:0/3879178885 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55f2b5d16970 con 0x55f2b5d607d0 2023-08-10T11:58:19.434 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.418+0000 7fa132ff5700 10 client.16446 handle_command_reply: tid=0 2023-08-10T11:58:19.435 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.418+0000 7fa161642b80 1 client.16446 shutdown 2023-08-10T11:58:19.435 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.418+0000 7fa161642b80 1 -- 172.21.15.73:0/3879178885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2b5d47550 msgr2=0x55f2b5d533a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:19.435 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.418+0000 7fa161642b80 1 --2- 172.21.15.73:0/3879178885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2b5d47550 0x55f2b5d533a0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fa140004bf0 tx=0x7fa14000bc60 comp rx=0 tx=0).stop 2023-08-10T11:58:19.435 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.418+0000 7fa161642b80 1 -- 172.21.15.73:0/3879178885 shutdown_connections 2023-08-10T11:58:19.435 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.418+0000 7fa161642b80 1 --2- 172.21.15.73:0/3879178885 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f2b5d607d0 0x55f2b5d62bc0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:19.435 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.418+0000 7fa161642b80 1 --2- 172.21.15.73:0/3879178885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2b5d4d360 0x55f2b5d50d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:19.435 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.418+0000 7fa132ff5700 0 client.16446 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:58:19.435 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.418+0000 7fa161642b80 1 --2- 172.21.15.73:0/3879178885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2b5d47550 0x55f2b5d533a0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:19.436 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.418+0000 7fa161642b80 1 --2- 172.21.15.73:0/3879178885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f2b5d4ca40 0x55f2b5d50690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:19.436 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.418+0000 7fa161642b80 1 -- 172.21.15.73:0/3879178885 >> 172.21.15.73:0/3879178885 conn(0x55f2b5ca4c70 msgr2=0x55f2b5d414b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:19.436 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.418+0000 7fa161642b80 1 -- 172.21.15.73:0/3879178885 shutdown_connections 2023-08-10T11:58:19.436 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.418+0000 7fa161642b80 1 -- 172.21.15.73:0/3879178885 wait complete. 2023-08-10T11:58:19.436 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.419+0000 7fa161642b80 20 client.16446 trim_cache size 0 max 16384 2023-08-10T11:58:19.443 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.435+0000 7fa161642b80 1 Processor -- start 2023-08-10T11:58:19.443 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.435+0000 7fa161642b80 1 -- start start 2023-08-10T11:58:19.443 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.435+0000 7fa161642b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f2b5d47550 0x55f2b5d41c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:19.444 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.435+0000 7fa161642b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2b5d4ca40 0x55f2b5d4bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:19.444 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.435+0000 7fa161642b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2b5d4d360 0x55f2b5d52f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:19.444 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.435+0000 7fa161642b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2b5b1b8c0 con 0x55f2b5d4ca40 2023-08-10T11:58:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.435+0000 7fa161642b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2b5d51c00 con 0x55f2b5d4d360 2023-08-10T11:58:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.435+0000 7fa161642b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2b5d3c730 con 0x55f2b5d47550 2023-08-10T11:58:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.435+0000 7fa14e7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2b5d4ca40 0x55f2b5d4bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.435+0000 7fa14effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f2b5d47550 0x55f2b5d41c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.435+0000 7fa14effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f2b5d47550 0x55f2b5d41c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60794/0 (socket says 172.21.15.73:60794) 2023-08-10T11:58:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.435+0000 7fa14e7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2b5d4ca40 0x55f2b5d4bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35292/0 (socket says 172.21.15.73:35292) 2023-08-10T11:58:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.435+0000 7fa14effd700 1 -- 172.21.15.73:0/3691444546 learned_addr learned my addr 172.21.15.73:0/3691444546 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.435+0000 7fa14f7fe700 1 --2- 172.21.15.73:0/3691444546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2b5d4d360 0x55f2b5d52f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.436+0000 7fa14effd700 1 -- 172.21.15.73:0/3691444546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2b5d4d360 msgr2=0x55f2b5d52f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.436+0000 7fa14effd700 1 --2- 172.21.15.73:0/3691444546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2b5d4d360 0x55f2b5d52f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.436+0000 7fa14effd700 1 -- 172.21.15.73:0/3691444546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2b5d4ca40 msgr2=0x55f2b5d4bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.436+0000 7fa14effd700 1 --2- 172.21.15.73:0/3691444546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2b5d4ca40 0x55f2b5d4bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:19.447 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.436+0000 7fa14effd700 1 -- 172.21.15.73:0/3691444546 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2b5d3e3f0 con 0x55f2b5d47550 2023-08-10T11:58:19.447 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.436+0000 7fa14effd700 1 --2- 172.21.15.73:0/3691444546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f2b5d47550 0x55f2b5d41c30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa1400057b0 tx=0x7fa140038000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b9f319ff26ba36c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:19.447 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.436+0000 7fa135ffb700 1 -- 172.21.15.73:0/3691444546 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14002b040 con 0x55f2b5d47550 2023-08-10T11:58:19.447 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.436+0000 7fa135ffb700 1 -- 172.21.15.73:0/3691444546 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa14000f460 con 0x55f2b5d47550 2023-08-10T11:58:19.447 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.436+0000 7fa135ffb700 1 -- 172.21.15.73:0/3691444546 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa140004a90 con 0x55f2b5d47550 2023-08-10T11:58:19.447 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.437+0000 7fa161642b80 1 -- 172.21.15.73:0/3691444546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f2b5d47550 msgr2=0x55f2b5d41c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:19.447 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.437+0000 7fa161642b80 1 --2- 172.21.15.73:0/3691444546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f2b5d47550 0x55f2b5d41c30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa1400057b0 tx=0x7fa140038000 comp rx=0 tx=0).stop 2023-08-10T11:58:19.447 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.437+0000 7fa161642b80 1 -- 172.21.15.73:0/3691444546 shutdown_connections 2023-08-10T11:58:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.437+0000 7fa161642b80 1 --2- 172.21.15.73:0/3691444546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2b5d4d360 0x55f2b5d52f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.437+0000 7fa161642b80 1 --2- 172.21.15.73:0/3691444546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f2b5d47550 0x55f2b5d41c30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.437+0000 7fa161642b80 1 --2- 172.21.15.73:0/3691444546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2b5d4ca40 0x55f2b5d4bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.437+0000 7fa161642b80 1 -- 172.21.15.73:0/3691444546 >> 172.21.15.73:0/3691444546 conn(0x55f2b5ca4c70 msgr2=0x55f2b5d4b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.437+0000 7fa161642b80 1 -- 172.21.15.73:0/3691444546 shutdown_connections 2023-08-10T11:58:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.437+0000 7fa161642b80 1 -- 172.21.15.73:0/3691444546 wait complete. 2023-08-10T11:58:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.437+0000 7fa161642b80 1 -- start start 2023-08-10T11:58:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.437+0000 7fa161642b80 1 Processor -- start 2023-08-10T11:58:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.437+0000 7fa161642b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2b5d47550 0x55f2b5d55f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.437+0000 7fa161642b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2b5d4ca40 0x55f2b5d564d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.437+0000 7fa161642b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f2b5d4d360 0x55f2b5dad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.437+0000 7fa161642b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2b5dad930 con 0x55f2b5d47550 2023-08-10T11:58:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.437+0000 7fa161642b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2b5dadaa0 con 0x55f2b5d4ca40 2023-08-10T11:58:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.437+0000 7fa161642b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2b5dadc60 con 0x55f2b5d4d360 2023-08-10T11:58:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.437+0000 7fa161642b80 10 client.0 _ll_register_callbacks cb 0x55f2b5c35620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:58:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.437+0000 7fa14effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2b5d47550 0x55f2b5d55f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.437+0000 7fa14f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f2b5d4d360 0x55f2b5dad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.437+0000 7fa14effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2b5d47550 0x55f2b5d55f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35296/0 (socket says 172.21.15.73:35296) 2023-08-10T11:58:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.438+0000 7fa14effd700 1 -- 172.21.15.73:0/4224000792 learned_addr learned my addr 172.21.15.73:0/4224000792 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.438+0000 7fa14e7fc700 1 --2- 172.21.15.73:0/4224000792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2b5d4ca40 0x55f2b5d564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.438+0000 7fa14f7fe700 1 -- 172.21.15.73:0/4224000792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2b5d4ca40 msgr2=0x55f2b5d564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.438+0000 7fa14f7fe700 1 --2- 172.21.15.73:0/4224000792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2b5d4ca40 0x55f2b5d564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.438+0000 7fa14f7fe700 1 -- 172.21.15.73:0/4224000792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2b5d47550 msgr2=0x55f2b5d55f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.438+0000 7fa14f7fe700 1 --2- 172.21.15.73:0/4224000792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2b5d47550 0x55f2b5d55f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.438+0000 7fa14f7fe700 1 -- 172.21.15.73:0/4224000792 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f2b5ac5d80 con 0x55f2b5d4d360 2023-08-10T11:58:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.438+0000 7fa14effd700 1 --2- 172.21.15.73:0/4224000792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2b5d47550 0x55f2b5d55f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:58:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.438+0000 7fa14f7fe700 1 --2- 172.21.15.73:0/4224000792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f2b5d4d360 0x55f2b5dad3f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa148011f90 tx=0x7fa148018700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b51b5e8bdb4dbf6e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.438+0000 7fa132ff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T11:58:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.438+0000 7fa132ff5700 1 -- 172.21.15.73:0/4224000792 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14801d070 con 0x55f2b5d4d360 2023-08-10T11:58:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.438+0000 7fa161642b80 1 -- 172.21.15.73:0/4224000792 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f2b5c91720 con 0x55f2b5d4d360 2023-08-10T11:58:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.438+0000 7fa132ff5700 1 -- 172.21.15.73:0/4224000792 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fa148003a00 con 0x55f2b5d4d360 2023-08-10T11:58:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.438+0000 7fa132ff5700 1 -- 172.21.15.73:0/4224000792 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa14800e040 con 0x55f2b5d4d360 2023-08-10T11:58:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.438+0000 7fa161642b80 10 client.25948 fetch_fsmap learned FSMap version 39 2023-08-10T11:58:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.438+0000 7fa161642b80 1 -- 172.21.15.73:0/4224000792 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55f2b5aaec00 con 0x55f2b5d4d360 2023-08-10T11:58:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.438+0000 7fa132ff5700 1 -- 172.21.15.73:0/4224000792 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f2b5c91720 con 0x55f2b5d4d360 2023-08-10T11:58:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.439+0000 7fa132ff5700 1 -- 172.21.15.73:0/4224000792 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 39) v1 ==== 6981+0+0 (secure 0 0 0) 0x7fa148022420 con 0x55f2b5d4d360 2023-08-10T11:58:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.439+0000 7fa161642b80 10 client.25948 fetch_fsmap finished waiting for FSMap version 39 2023-08-10T11:58:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.439+0000 7fa161642b80 10 client.25948 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:58:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.439+0000 7fa161642b80 20 client.25948 populate_metadata read hostname 'smithi073' 2023-08-10T11:58:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.439+0000 7fa161642b80 1 --2- 172.21.15.73:0/4224000792 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f2b5db55f0 0x55f2b5db7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.439+0000 7fa161642b80 4 client.25948 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:58:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.439+0000 7fa161642b80 1 -- 172.21.15.73:0/4224000792 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f2b5c52ff0 con 0x55f2b5db55f0 2023-08-10T11:58:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.439+0000 7fa14effd700 1 --2- 172.21.15.73:0/4224000792 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f2b5db55f0 0x55f2b5db7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.439+0000 7fa132ff5700 10 client.25948 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:58:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:19.439+0000 7fa14effd700 1 --2- 172.21.15.73:0/4224000792 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f2b5db55f0 0x55f2b5db7a10 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=528c2b0a168bea29 server_cookie=12a7096c5e1b93a6 in_seq=0 out_seq=0 2023-08-10T11:58:19.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:19 smithi152 ceph-mon[130220]: pgmap v173: 97 pgs: 97 active+clean; 1.3 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 391 op/s 2023-08-10T11:58:19.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:19 smithi156 ceph-mon[130574]: pgmap v173: 97 pgs: 97 active+clean; 1.3 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 391 op/s 2023-08-10T11:58:21.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:21 smithi152 ceph-mon[130220]: pgmap v174: 97 pgs: 97 active+clean; 1.4 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.6 MiB/s wr, 623 op/s 2023-08-10T11:58:21.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:21 smithi156 ceph-mon[130574]: pgmap v174: 97 pgs: 97 active+clean; 1.4 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.6 MiB/s wr, 623 op/s 2023-08-10T11:58:21.528 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:21 smithi073 ceph-mon[128869]: pgmap v174: 97 pgs: 97 active+clean; 1.4 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.6 MiB/s wr, 623 op/s 2023-08-10T11:58:22.157 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:58:22.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.682+0000 7f71a012b700 1 -- 172.21.15.73:0/2164053153 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71981056a0 msgr2=0x7f7198105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:22.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.682+0000 7f71a012b700 1 --2- 172.21.15.73:0/2164053153 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71981056a0 0x7f7198105a80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f71940098f0 tx=0x7f7194009c00 comp rx=0 tx=0).stop 2023-08-10T11:58:22.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.684+0000 7f71a012b700 1 -- 172.21.15.73:0/2164053153 shutdown_connections 2023-08-10T11:58:22.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.684+0000 7f71a012b700 1 --2- 172.21.15.73:0/2164053153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71980fffc0 0x7f719810c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:22.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.684+0000 7f71a012b700 1 --2- 172.21.15.73:0/2164053153 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71981056a0 0x7f7198105a80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:22.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.684+0000 7f71a012b700 1 --2- 172.21.15.73:0/2164053153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71980ff600 0x7f71980ffa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:22.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.684+0000 7f71a012b700 1 -- 172.21.15.73:0/2164053153 >> 172.21.15.73:0/2164053153 conn(0x7f71980fb110 msgr2=0x7f71980fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:22.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.689+0000 7f71a012b700 1 -- 172.21.15.73:0/2164053153 shutdown_connections 2023-08-10T11:58:22.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.689+0000 7f71a012b700 1 -- 172.21.15.73:0/2164053153 wait complete. 2023-08-10T11:58:22.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.690+0000 7f71a012b700 1 Processor -- start 2023-08-10T11:58:22.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.691+0000 7f71a012b700 1 -- start start 2023-08-10T11:58:22.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.691+0000 7f71a012b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71980ff600 0x7f719806f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:22.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.691+0000 7f71a012b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71980fffc0 0x7f719806fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:22.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.691+0000 7f71a012b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71981056a0 0x7f719806ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:22.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.691+0000 7f71a012b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719806b100 con 0x7f71981056a0 2023-08-10T11:58:22.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.691+0000 7f71a012b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719806b270 con 0x7f71980fffc0 2023-08-10T11:58:22.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.691+0000 7f71a012b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719806b430 con 0x7f71980ff600 2023-08-10T11:58:22.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.692+0000 7f719dec7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71980ff600 0x7f719806f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:22.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.692+0000 7f719dec7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71980ff600 0x7f719806f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60814/0 (socket says 172.21.15.73:60814) 2023-08-10T11:58:22.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.692+0000 7f719dec7700 1 -- 172.21.15.73:0/3405184735 learned_addr learned my addr 172.21.15.73:0/3405184735 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:22.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.692+0000 7f719d6c6700 1 --2- 172.21.15.73:0/3405184735 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71980fffc0 0x7f719806fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:22.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.692+0000 7f719e6c8700 1 --2- 172.21.15.73:0/3405184735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71981056a0 0x7f719806ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:22.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.692+0000 7f719e6c8700 1 -- 172.21.15.73:0/3405184735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71980ff600 msgr2=0x7f719806f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:22.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.692+0000 7f719e6c8700 1 --2- 172.21.15.73:0/3405184735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71980ff600 0x7f719806f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:22.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.692+0000 7f719e6c8700 1 -- 172.21.15.73:0/3405184735 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71980fffc0 msgr2=0x7f719806fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:22.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.692+0000 7f719e6c8700 1 --2- 172.21.15.73:0/3405184735 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71980fffc0 0x7f719806fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:22.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.692+0000 7f719e6c8700 1 -- 172.21.15.73:0/3405184735 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7194009520 con 0x7f71981056a0 2023-08-10T11:58:22.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.693+0000 7f719e6c8700 1 --2- 172.21.15.73:0/3405184735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71981056a0 0x7f719806ab30 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f719000be00 tx=0x7f7190009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:22.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.694+0000 7f718effd700 1 -- 172.21.15.73:0/3405184735 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719000cc10 con 0x7f71981056a0 2023-08-10T11:58:22.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.694+0000 7f71a012b700 1 -- 172.21.15.73:0/3405184735 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719806b710 con 0x7f71981056a0 2023-08-10T11:58:22.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.694+0000 7f71a012b700 1 -- 172.21.15.73:0/3405184735 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719806e900 con 0x7f71981056a0 2023-08-10T11:58:22.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.694+0000 7f718effd700 1 -- 172.21.15.73:0/3405184735 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f719000cd70 con 0x7f71981056a0 2023-08-10T11:58:22.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.697+0000 7f718effd700 1 -- 172.21.15.73:0/3405184735 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7190012720 con 0x7f71981056a0 2023-08-10T11:58:22.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.701+0000 7f71ac2c4b80 1 Processor -- start 2023-08-10T11:58:22.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.702+0000 7f718effd700 1 -- 172.21.15.73:0/3405184735 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f7190012960 con 0x7f71981056a0 2023-08-10T11:58:22.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.703+0000 7f71ac2c4b80 1 -- start start 2023-08-10T11:58:22.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.703+0000 7f71ac2c4b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565bbb48f50 0x5565bbb49330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:22.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.703+0000 7f71ac2c4b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565bbb49870 0x5565bbb432c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:22.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.703+0000 7f71ac2c4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5565bbb43800 0x5565bbb43c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:22.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.703+0000 7f71ac2c4b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bbabedc0 con 0x5565bbb49870 2023-08-10T11:58:22.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.703+0000 7f71ac2c4b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bba9b590 con 0x5565bbb48f50 2023-08-10T11:58:22.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.703+0000 7f71ac2c4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bba98eb0 con 0x5565bbb43800 2023-08-10T11:58:22.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.704+0000 7f718effd700 1 --2- 172.21.15.73:0/3405184735 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f71840a1440 0x7f71840a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:22.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.704+0000 7f719e6c8700 1 --2- 172.21.15.73:0/3405184735 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f71840a1440 0x7f71840a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:22.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.704+0000 7f718effd700 1 -- 172.21.15.73:0/3405184735 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f71900cc770 con 0x7f71981056a0 2023-08-10T11:58:22.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.704+0000 7f719e6c8700 1 --2- 172.21.15.73:0/3405184735 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f71840a1440 0x7f71840a3900 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f719000bdd0 tx=0x7f7190018b00 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:22.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.708+0000 7f719d6c6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565bbb48f50 0x5565bbb49330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:22.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.708+0000 7f719d6c6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5565bbb43800 0x5565bbb43c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:22.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.708+0000 7f719dec7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565bbb49870 0x5565bbb432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:22.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.709+0000 7f719dec7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565bbb49870 0x5565bbb432c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35320/0 (socket says 172.21.15.73:35320) 2023-08-10T11:58:22.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.709+0000 7f719dec7700 1 -- 172.21.15.73:0/2548040592 learned_addr learned my addr 172.21.15.73:0/2548040592 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:22.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.709+0000 7f719dec7700 1 -- 172.21.15.73:0/2548040592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5565bbb43800 msgr2=0x5565bbb43c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:22.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.709+0000 7f719dec7700 1 --2- 172.21.15.73:0/2548040592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5565bbb43800 0x5565bbb43c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:22.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.709+0000 7f719dec7700 1 -- 172.21.15.73:0/2548040592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565bbb48f50 msgr2=0x5565bbb49330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:22.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.709+0000 7f719dec7700 1 --2- 172.21.15.73:0/2548040592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565bbb48f50 0x5565bbb49330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:22.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.709+0000 7f719dec7700 1 -- 172.21.15.73:0/2548040592 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565bb915630 con 0x5565bbb49870 2023-08-10T11:58:22.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.710+0000 7f719dec7700 1 --2- 172.21.15.73:0/2548040592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565bbb49870 0x5565bbb432c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f71940057f0 tx=0x7f71940058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc5da31f9d95ab4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:22.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.710+0000 7f7183fff700 1 -- 172.21.15.73:0/2548040592 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719401c050 con 0x5565bbb49870 2023-08-10T11:58:22.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.710+0000 7f7183fff700 1 -- 172.21.15.73:0/2548040592 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f719401d040 con 0x5565bbb49870 2023-08-10T11:58:22.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.710+0000 7f7183fff700 1 -- 172.21.15.73:0/2548040592 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719400b920 con 0x5565bbb49870 2023-08-10T11:58:22.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.711+0000 7f71ac2c4b80 1 -- 172.21.15.73:0/2548040592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565bbb49870 msgr2=0x5565bbb432c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:22.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.711+0000 7f71ac2c4b80 1 --2- 172.21.15.73:0/2548040592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565bbb49870 0x5565bbb432c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f71940057f0 tx=0x7f71940058e0 comp rx=0 tx=0).stop 2023-08-10T11:58:22.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.711+0000 7f71ac2c4b80 1 -- 172.21.15.73:0/2548040592 shutdown_connections 2023-08-10T11:58:22.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.711+0000 7f71ac2c4b80 1 --2- 172.21.15.73:0/2548040592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565bbb48f50 0x5565bbb49330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:22.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.711+0000 7f71ac2c4b80 1 --2- 172.21.15.73:0/2548040592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5565bbb43800 0x5565bbb43c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:22.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.711+0000 7f71ac2c4b80 1 --2- 172.21.15.73:0/2548040592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565bbb49870 0x5565bbb432c0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:22.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.711+0000 7f71ac2c4b80 1 -- 172.21.15.73:0/2548040592 >> 172.21.15.73:0/2548040592 conn(0x5565bbaa0cd0 msgr2=0x5565bbb3e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:22.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.712+0000 7f71ac2c4b80 1 -- 172.21.15.73:0/2548040592 shutdown_connections 2023-08-10T11:58:22.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.712+0000 7f71ac2c4b80 1 -- 172.21.15.73:0/2548040592 wait complete. 2023-08-10T11:58:22.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.712+0000 7f71ac2c4b80 1 -- start start 2023-08-10T11:58:22.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.712+0000 7f71ac2c4b80 1 Processor -- start 2023-08-10T11:58:22.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.713+0000 7f71ac2c4b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565bbb43800 0x5565bbb4f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:22.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.713+0000 7f71ac2c4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5565bbb48f50 0x5565bbb4cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:22.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.713+0000 7f71ac2c4b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565bbb49870 0x5565bbb4d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:22.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.713+0000 7f71ac2c4b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bba947a0 con 0x5565bbb43800 2023-08-10T11:58:22.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.713+0000 7f71ac2c4b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bba33ac0 con 0x5565bbb49870 2023-08-10T11:58:22.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.713+0000 7f71ac2c4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bba337c0 con 0x5565bbb48f50 2023-08-10T11:58:22.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.713+0000 7f71ac2c4b80 10 client.0 _ll_register_callbacks cb 0x5565bba31680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:58:22.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.713+0000 7f719dec7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5565bbb48f50 0x5565bbb4cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:22.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.713+0000 7f719d6c6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565bbb49870 0x5565bbb4d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:22.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.713+0000 7f719d6c6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565bbb49870 0x5565bbb4d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49974/0 (socket says 172.21.15.73:49974) 2023-08-10T11:58:22.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.713+0000 7f719d6c6700 1 -- 172.21.15.73:0/4140627613 learned_addr learned my addr 172.21.15.73:0/4140627613 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:22.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.713+0000 7f719d6c6700 1 --2- 172.21.15.73:0/4140627613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565bbb43800 0x5565bbb4f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:22.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.714+0000 7f719d6c6700 1 -- 172.21.15.73:0/4140627613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5565bbb48f50 msgr2=0x5565bbb4cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:22.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.714+0000 7f719d6c6700 1 --2- 172.21.15.73:0/4140627613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5565bbb48f50 0x5565bbb4cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:22.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.714+0000 7f719d6c6700 1 -- 172.21.15.73:0/4140627613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565bbb43800 msgr2=0x5565bbb4f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:22.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.714+0000 7f719d6c6700 1 --2- 172.21.15.73:0/4140627613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565bbb43800 0x5565bbb4f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:22.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.714+0000 7f719d6c6700 1 -- 172.21.15.73:0/4140627613 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719810cdd0 con 0x5565bbb49870 2023-08-10T11:58:22.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.715+0000 7f719d6c6700 1 --2- 172.21.15.73:0/4140627613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565bbb49870 0x5565bbb4d0e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f71880137a0 tx=0x7f718800b530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8637514b1ac6166 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:22.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.717+0000 7f71817fa700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T11:58:22.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.717+0000 7f71817fa700 1 -- 172.21.15.73:0/4140627613 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71880118d0 con 0x5565bbb49870 2023-08-10T11:58:22.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.717+0000 7f71817fa700 1 -- 172.21.15.73:0/4140627613 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7188011a30 con 0x5565bbb49870 2023-08-10T11:58:22.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.717+0000 7f71ac2c4b80 1 -- 172.21.15.73:0/4140627613 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5565bbb36470 con 0x5565bbb49870 2023-08-10T11:58:22.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.726+0000 7f71817fa700 1 -- 172.21.15.73:0/4140627613 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7188011bf0 con 0x5565bbb49870 2023-08-10T11:58:22.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.726+0000 7f71ac2c4b80 10 client.25898 fetch_fsmap learned FSMap version 39 2023-08-10T11:58:22.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.726+0000 7f71ac2c4b80 1 -- 172.21.15.73:0/4140627613 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5565bb8c1de0 con 0x5565bbb49870 2023-08-10T11:58:22.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.727+0000 7f71817fa700 1 -- 172.21.15.73:0/4140627613 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5565bbb36470 con 0x5565bbb49870 2023-08-10T11:58:22.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.728+0000 7f71817fa700 1 -- 172.21.15.73:0/4140627613 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 39) v1 ==== 6981+0+0 (secure 0 0 0) 0x7f7188029420 con 0x5565bbb49870 2023-08-10T11:58:22.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.728+0000 7f71ac2c4b80 10 client.25898 fetch_fsmap finished waiting for FSMap version 39 2023-08-10T11:58:22.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.728+0000 7f71ac2c4b80 10 client.25898 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:58:22.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.728+0000 7f71ac2c4b80 20 client.25898 populate_metadata read hostname 'smithi073' 2023-08-10T11:58:22.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.728+0000 7f71ac2c4b80 1 --2- 172.21.15.73:0/4140627613 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5565bbb5d230 0x5565bbb5f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:22.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.728+0000 7f71ac2c4b80 4 client.25898 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:58:22.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.728+0000 7f71ac2c4b80 1 -- 172.21.15.73:0/4140627613 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5565bbb129d0 con 0x5565bbb5d230 2023-08-10T11:58:22.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.728+0000 7f719dec7700 1 --2- 172.21.15.73:0/4140627613 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5565bbb5d230 0x5565bbb5f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:22.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.729+0000 7f719dec7700 1 --2- 172.21.15.73:0/4140627613 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5565bbb5d230 0x5565bbb5f650 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=385b4b8d820dfc82 server_cookie=6e5b3d6416cba459 in_seq=0 out_seq=0 2023-08-10T11:58:22.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.729+0000 7f71817fa700 10 client.25898 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:58:22.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:22.998+0000 7fa132ff5700 1 -- 172.21.15.73:0/4224000792 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f2b5c52ff0 con 0x55f2b5db55f0 2023-08-10T11:58:22.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:22.998+0000 7fa132ff5700 10 client.25948 handle_command_reply: tid=0 2023-08-10T11:58:23.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.999+0000 7f71817fa700 1 -- 172.21.15.73:0/4140627613 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5565bbb129d0 con 0x5565bbb5d230 2023-08-10T11:58:23.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.999+0000 7f71817fa700 10 client.25898 handle_command_reply: tid=0 2023-08-10T11:58:23.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:22.999+0000 7f71ac2c4b80 1 client.25898 shutdown 2023-08-10T11:58:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:23.002+0000 7fa161642b80 1 client.25948 shutdown 2023-08-10T11:58:23.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.002+0000 7f71ac2c4b80 1 -- 172.21.15.73:0/4140627613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565bbb49870 msgr2=0x5565bbb4d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:23.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.002+0000 7f71ac2c4b80 1 --2- 172.21.15.73:0/4140627613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565bbb49870 0x5565bbb4d0e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f71880137a0 tx=0x7f718800b530 comp rx=0 tx=0).stop 2023-08-10T11:58:23.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.002+0000 7f71ac2c4b80 1 -- 172.21.15.73:0/4140627613 shutdown_connections 2023-08-10T11:58:23.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.002+0000 7f71ac2c4b80 1 --2- 172.21.15.73:0/4140627613 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5565bbb5d230 0x5565bbb5f650 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.002+0000 7f71ac2c4b80 1 --2- 172.21.15.73:0/4140627613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565bbb49870 0x5565bbb4d0e0 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f71880137a0 tx=0x7f718800b530 comp rx=0 tx=0).stop 2023-08-10T11:58:23.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.002+0000 7f71ac2c4b80 1 --2- 172.21.15.73:0/4140627613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565bbb43800 0x5565bbb4f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.002+0000 7f71ac2c4b80 1 --2- 172.21.15.73:0/4140627613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5565bbb48f50 0x5565bbb4cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.002+0000 7f71ac2c4b80 1 -- 172.21.15.73:0/4140627613 >> 172.21.15.73:0/4140627613 conn(0x5565bbaa0cd0 msgr2=0x5565bbb3d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:23.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.002+0000 7f71817fa700 0 client.25898 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:58:23.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.004+0000 7f71ac2c4b80 1 -- 172.21.15.73:0/4140627613 shutdown_connections 2023-08-10T11:58:23.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.004+0000 7f71ac2c4b80 1 -- 172.21.15.73:0/4140627613 wait complete. 2023-08-10T11:58:23.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.005+0000 7f71ac2c4b80 20 client.25898 trim_cache size 0 max 16384 2023-08-10T11:58:23.006 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:23.006+0000 7fa161642b80 1 -- 172.21.15.73:0/4224000792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f2b5d4d360 msgr2=0x55f2b5dad3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:23.006+0000 7fa161642b80 1 --2- 172.21.15.73:0/4224000792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f2b5d4d360 0x55f2b5dad3f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa148011f90 tx=0x7fa148018700 comp rx=0 tx=0).stop 2023-08-10T11:58:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:23.006+0000 7fa161642b80 1 -- 172.21.15.73:0/4224000792 shutdown_connections 2023-08-10T11:58:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:23.006+0000 7fa161642b80 1 --2- 172.21.15.73:0/4224000792 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f2b5db55f0 0x55f2b5db7a10 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:23.006+0000 7fa161642b80 1 --2- 172.21.15.73:0/4224000792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f2b5d4d360 0x55f2b5dad3f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:23.006+0000 7fa161642b80 1 --2- 172.21.15.73:0/4224000792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2b5d47550 0x55f2b5d55f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:23.006+0000 7fa161642b80 1 --2- 172.21.15.73:0/4224000792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f2b5d4ca40 0x55f2b5d564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:23.006+0000 7fa161642b80 1 -- 172.21.15.73:0/4224000792 >> 172.21.15.73:0/4224000792 conn(0x55f2b5ca4c70 msgr2=0x55f2b5d4c120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:23.008 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:23.007+0000 7fa132ff5700 0 client.25948 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:58:23.008 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:23.007+0000 7fa161642b80 1 -- 172.21.15.73:0/4224000792 shutdown_connections 2023-08-10T11:58:23.008 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:23.007+0000 7fa161642b80 1 -- 172.21.15.73:0/4224000792 wait complete. 2023-08-10T11:58:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:23.013+0000 7fa161642b80 20 client.25948 trim_cache size 0 max 16384 2023-08-10T11:58:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:58:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:58:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:58:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:58:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:23.013+0000 7fa1554a9700 1 -- 172.21.15.73:0/4232473525 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa1380a12c0 msgr2=0x7fa1380a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:23.013+0000 7fa1554a9700 1 --2- 172.21.15.73:0/4232473525 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa1380a12c0 0x7fa1380a3780 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa14000b2e0 tx=0x7fa140005fd0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:23.013+0000 7fa1554a9700 1 -- 172.21.15.73:0/4232473525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa150100290 msgr2=0x7fa150101990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:23.013+0000 7fa1554a9700 1 --2- 172.21.15.73:0/4232473525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa150100290 0x7fa150101990 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fa14400e9a0 tx=0x7fa14400ecb0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:23.014+0000 7fa1554a9700 1 -- 172.21.15.73:0/4232473525 shutdown_connections 2023-08-10T11:58:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:23.014+0000 7fa1554a9700 1 --2- 172.21.15.73:0/4232473525 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa1380a12c0 0x7fa1380a3780 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:23.014+0000 7fa1554a9700 1 --2- 172.21.15.73:0/4232473525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1500ff8d0 0x7fa150101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:23.014+0000 7fa1554a9700 1 --2- 172.21.15.73:0/4232473525 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa150105670 0x7fa1501a4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:23.014+0000 7fa1554a9700 1 --2- 172.21.15.73:0/4232473525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa150100290 0x7fa150101990 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:23.014+0000 7fa1554a9700 1 -- 172.21.15.73:0/4232473525 >> 172.21.15.73:0/4232473525 conn(0x7fa1500750a0 msgr2=0x7fa1500fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:23.014+0000 7fa1554a9700 1 -- 172.21.15.73:0/4232473525 shutdown_connections 2023-08-10T11:58:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:23.014+0000 7fa1554a9700 1 -- 172.21.15.73:0/4232473525 wait complete. 2023-08-10T11:58:23.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.030+0000 7f71ac2c4b80 1 Processor -- start 2023-08-10T11:58:23.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.031+0000 7f71ac2c4b80 1 -- start start 2023-08-10T11:58:23.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.031+0000 7f71ac2c4b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565bbb43800 0x5565bbb4c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:23.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.031+0000 7f71ac2c4b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565bbb48f50 0x5565bbb54390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:23.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.031+0000 7f71ac2c4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5565bbb482b0 0x5565bbb4f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:23.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.031+0000 7f71ac2c4b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bbb3f720 con 0x5565bbb48f50 2023-08-10T11:58:23.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.031+0000 7f71ac2c4b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bb917920 con 0x5565bbb43800 2023-08-10T11:58:23.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.031+0000 7f71ac2c4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bbb548d0 con 0x5565bbb482b0 2023-08-10T11:58:23.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.031+0000 7f719d6c6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5565bbb482b0 0x5565bbb4f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:23.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.031+0000 7f719d6c6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5565bbb482b0 0x5565bbb4f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60836/0 (socket says 172.21.15.73:60836) 2023-08-10T11:58:23.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.031+0000 7f719d6c6700 1 -- 172.21.15.73:0/1214775190 learned_addr learned my addr 172.21.15.73:0/1214775190 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:23.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.031+0000 7f719d6c6700 1 --2- 172.21.15.73:0/1214775190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565bbb43800 0x5565bbb4c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:23.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.032+0000 7f719d6c6700 1 -- 172.21.15.73:0/1214775190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565bbb43800 msgr2=0x5565bbb4c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:23.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.032+0000 7f719d6c6700 1 --2- 172.21.15.73:0/1214775190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565bbb43800 0x5565bbb4c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.032+0000 7f719d6c6700 1 -- 172.21.15.73:0/1214775190 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565bbb48f50 msgr2=0x5565bbb54390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:23.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.032+0000 7f719d6c6700 1 --2- 172.21.15.73:0/1214775190 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565bbb48f50 0x5565bbb54390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.032+0000 7f719d6c6700 1 -- 172.21.15.73:0/1214775190 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565bbb3fb80 con 0x5565bbb482b0 2023-08-10T11:58:23.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.032+0000 7f719d6c6700 1 --2- 172.21.15.73:0/1214775190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5565bbb482b0 0x5565bbb4f440 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7188001eb0 tx=0x7f718800b530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e83601b6c293195 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:23.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.033+0000 7f718cff9700 1 -- 172.21.15.73:0/1214775190 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7188029420 con 0x5565bbb482b0 2023-08-10T11:58:23.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.033+0000 7f718cff9700 1 -- 172.21.15.73:0/1214775190 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7188029580 con 0x5565bbb482b0 2023-08-10T11:58:23.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.033+0000 7f718cff9700 1 -- 172.21.15.73:0/1214775190 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718801f6a0 con 0x5565bbb482b0 2023-08-10T11:58:23.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.034+0000 7f71ac2c4b80 1 -- 172.21.15.73:0/1214775190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5565bbb482b0 msgr2=0x5565bbb4f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:23.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.034+0000 7f71ac2c4b80 1 --2- 172.21.15.73:0/1214775190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5565bbb482b0 0x5565bbb4f440 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7188001eb0 tx=0x7f718800b530 comp rx=0 tx=0).stop 2023-08-10T11:58:23.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.034+0000 7f71ac2c4b80 1 -- 172.21.15.73:0/1214775190 shutdown_connections 2023-08-10T11:58:23.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.034+0000 7f71ac2c4b80 1 --2- 172.21.15.73:0/1214775190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565bbb43800 0x5565bbb4c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.034+0000 7f71ac2c4b80 1 --2- 172.21.15.73:0/1214775190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5565bbb482b0 0x5565bbb4f440 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.034+0000 7f71ac2c4b80 1 --2- 172.21.15.73:0/1214775190 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565bbb48f50 0x5565bbb54390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.034+0000 7f71ac2c4b80 1 -- 172.21.15.73:0/1214775190 >> 172.21.15.73:0/1214775190 conn(0x5565bbaa0cd0 msgr2=0x5565bbb47ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:23.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.051+0000 7f71ac2c4b80 1 -- 172.21.15.73:0/1214775190 shutdown_connections 2023-08-10T11:58:23.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.051+0000 7f71ac2c4b80 1 -- 172.21.15.73:0/1214775190 wait complete. 2023-08-10T11:58:23.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.051+0000 7f71ac2c4b80 1 -- start start 2023-08-10T11:58:23.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.051+0000 7f71ac2c4b80 1 Processor -- start 2023-08-10T11:58:23.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.052+0000 7f71ac2c4b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565bbb43800 0x5565bbb50b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:23.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.052+0000 7f71ac2c4b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565bbb482b0 0x5565bbb51050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:23.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.052+0000 7f71ac2c4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5565bbb48f50 0x5565bbbb0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:23.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.052+0000 7f71ac2c4b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bbb51830 con 0x5565bbb482b0 2023-08-10T11:58:23.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.052+0000 7f71ac2c4b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bbb519a0 con 0x5565bbb43800 2023-08-10T11:58:23.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.052+0000 7f71ac2c4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bbbb1470 con 0x5565bbb48f50 2023-08-10T11:58:23.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.052+0000 7f71ac2c4b80 10 client.0 _ll_register_callbacks cb 0x5565bba31680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:58:23.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.053+0000 7f719d6c6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565bbb43800 0x5565bbb50b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:23.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.053+0000 7f719d6c6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565bbb43800 0x5565bbb50b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:49988/0 (socket says 172.21.15.73:49988) 2023-08-10T11:58:23.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.053+0000 7f719d6c6700 1 -- 172.21.15.73:0/3705419906 learned_addr learned my addr 172.21.15.73:0/3705419906 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:23.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.053+0000 7f719d6c6700 1 --2- 172.21.15.73:0/3705419906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5565bbb48f50 0x5565bbbb0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:23.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.053+0000 7f719d6c6700 1 -- 172.21.15.73:0/3705419906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5565bbb48f50 msgr2=0x5565bbbb0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:23.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.053+0000 7f719d6c6700 1 --2- 172.21.15.73:0/3705419906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5565bbb48f50 0x5565bbbb0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.053+0000 7f719d6c6700 1 -- 172.21.15.73:0/3705419906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565bbb482b0 msgr2=0x5565bbb51050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:23.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.053+0000 7f719d6c6700 1 --2- 172.21.15.73:0/3705419906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565bbb482b0 0x5565bbb51050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.053+0000 7f719d6c6700 1 -- 172.21.15.73:0/3705419906 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5565bb8c1de0 con 0x5565bbb43800 2023-08-10T11:58:23.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.054+0000 7f719d6c6700 1 --2- 172.21.15.73:0/3705419906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565bbb43800 0x5565bbb50b10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7188013510 tx=0x7f7188029a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=855d812e662435a3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:23.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.057+0000 7f71817fa700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T11:58:23.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.057+0000 7f71817fa700 1 -- 172.21.15.73:0/3705419906 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7188060040 con 0x5565bbb43800 2023-08-10T11:58:23.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.057+0000 7f71817fa700 1 -- 172.21.15.73:0/3705419906 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7188000e40 con 0x5565bbb43800 2023-08-10T11:58:23.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.057+0000 7f71ac2c4b80 1 -- 172.21.15.73:0/3705419906 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f719401d040 con 0x5565bbb43800 2023-08-10T11:58:23.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.057+0000 7f71817fa700 1 -- 172.21.15.73:0/3705419906 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f718800b340 con 0x5565bbb43800 2023-08-10T11:58:23.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.057+0000 7f71ac2c4b80 10 client.25904 fetch_fsmap learned FSMap version 39 2023-08-10T11:58:23.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.057+0000 7f71ac2c4b80 1 -- 172.21.15.73:0/3705419906 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5565bb8aac60 con 0x5565bbb43800 2023-08-10T11:58:23.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.057+0000 7f71817fa700 1 -- 172.21.15.73:0/3705419906 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f719401d040 con 0x5565bbb43800 2023-08-10T11:58:23.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.058+0000 7f71817fa700 1 -- 172.21.15.73:0/3705419906 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 39) v1 ==== 6981+0+0 (secure 0 0 0) 0x7f7188011ca0 con 0x5565bbb43800 2023-08-10T11:58:23.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.058+0000 7f71ac2c4b80 10 client.25904 fetch_fsmap finished waiting for FSMap version 39 2023-08-10T11:58:23.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.058+0000 7f71ac2c4b80 10 client.25904 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:58:23.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.058+0000 7f71ac2c4b80 20 client.25904 populate_metadata read hostname 'smithi073' 2023-08-10T11:58:23.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.058+0000 7f71ac2c4b80 1 --2- 172.21.15.73:0/3705419906 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5565bbbb27c0 0x5565bbbb4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:23.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.058+0000 7f71ac2c4b80 4 client.25904 mds_command: new command op to 24503 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:58:23.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.058+0000 7f71ac2c4b80 1 -- 172.21.15.73:0/3705419906 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5565bba8d780 con 0x5565bbbb27c0 2023-08-10T11:58:23.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.058+0000 7f719dec7700 1 --2- 172.21.15.73:0/3705419906 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5565bbbb27c0 0x5565bbbb4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:23.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.058+0000 7f71817fa700 10 client.25904 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:58:23.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.058+0000 7f719dec7700 1 --2- 172.21.15.73:0/3705419906 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5565bbbb27c0 0x5565bbbb4bb0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7999a11243d6cbd3 server_cookie=b4ef4470bd326273 in_seq=0 out_seq=0 2023-08-10T11:58:23.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.085+0000 7f71817fa700 1 -- 172.21.15.73:0/3705419906 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5565bba8d780 con 0x5565bbbb27c0 2023-08-10T11:58:23.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.085+0000 7f71817fa700 10 client.25904 handle_command_reply: tid=0 2023-08-10T11:58:23.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.085+0000 7f71ac2c4b80 1 client.25904 shutdown 2023-08-10T11:58:23.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.085+0000 7f71ac2c4b80 1 -- 172.21.15.73:0/3705419906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565bbb43800 msgr2=0x5565bbb50b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:23.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.085+0000 7f71ac2c4b80 1 --2- 172.21.15.73:0/3705419906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565bbb43800 0x5565bbb50b10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7188013510 tx=0x7f7188029a50 comp rx=0 tx=0).stop 2023-08-10T11:58:23.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.086+0000 7f71ac2c4b80 1 -- 172.21.15.73:0/3705419906 shutdown_connections 2023-08-10T11:58:23.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.086+0000 7f71ac2c4b80 1 --2- 172.21.15.73:0/3705419906 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5565bbbb27c0 0x5565bbbb4bb0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.086+0000 7f71ac2c4b80 1 --2- 172.21.15.73:0/3705419906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5565bbb43800 0x5565bbb50b10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.086+0000 7f71ac2c4b80 1 --2- 172.21.15.73:0/3705419906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5565bbb48f50 0x5565bbbb0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.086+0000 7f71ac2c4b80 1 --2- 172.21.15.73:0/3705419906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5565bbb482b0 0x5565bbb51050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.086+0000 7f71ac2c4b80 1 -- 172.21.15.73:0/3705419906 >> 172.21.15.73:0/3705419906 conn(0x5565bbaa0cd0 msgr2=0x5565bbb42b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:23.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.086+0000 7f71817fa700 0 client.25904 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:58:23.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.094+0000 7f71ac2c4b80 1 -- 172.21.15.73:0/3705419906 shutdown_connections 2023-08-10T11:58:23.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.094+0000 7f71ac2c4b80 1 -- 172.21.15.73:0/3705419906 wait complete. 2023-08-10T11:58:23.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.117+0000 7f71ac2c4b80 20 client.25904 trim_cache size 0 max 16384 2023-08-10T11:58:23.127 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:58:23.128 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:58:23.128 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": { 2023-08-10T11:58:23.128 INFO:teuthology.orchestra.run.smithi073.stdout: "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d": { 2023-08-10T11:58:23.128 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2023-08-10T11:58:23.128 INFO:teuthology.orchestra.run.smithi073.stdout: "tag": "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d", 2023-08-10T11:58:23.128 INFO:teuthology.orchestra.run.smithi073.stdout: "options": "recursive,force" 2023-08-10T11:58:23.129 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:58:23.129 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:58:23.129 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:58:23.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.127+0000 7f71a012b700 1 -- 172.21.15.73:0/3405184735 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f71840a1440 msgr2=0x7f71840a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:23.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.127+0000 7f71a012b700 1 --2- 172.21.15.73:0/3405184735 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f71840a1440 0x7f71840a3900 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f719000bdd0 tx=0x7f7190018b00 comp rx=0 tx=0).stop 2023-08-10T11:58:23.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.127+0000 7f71a012b700 1 -- 172.21.15.73:0/3405184735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71981056a0 msgr2=0x7f719806ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:23.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.127+0000 7f71a012b700 1 --2- 172.21.15.73:0/3405184735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71981056a0 0x7f719806ab30 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f719000be00 tx=0x7f7190009ed0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.127+0000 7f71a012b700 1 -- 172.21.15.73:0/3405184735 shutdown_connections 2023-08-10T11:58:23.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.127+0000 7f71a012b700 1 --2- 172.21.15.73:0/3405184735 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f71840a1440 0x7f71840a3900 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.127+0000 7f71a012b700 1 --2- 172.21.15.73:0/3405184735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71981056a0 0x7f719806ab30 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.127+0000 7f71a012b700 1 --2- 172.21.15.73:0/3405184735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71980ff600 0x7f719806f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.127+0000 7f71a012b700 1 --2- 172.21.15.73:0/3405184735 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71980fffc0 0x7f719806fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:23.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.127+0000 7f71a012b700 1 -- 172.21.15.73:0/3405184735 >> 172.21.15.73:0/3405184735 conn(0x7f71980fb110 msgr2=0x7f71980fc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:23.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.141+0000 7f71a012b700 1 -- 172.21.15.73:0/3405184735 shutdown_connections 2023-08-10T11:58:23.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:23.143+0000 7f71a012b700 1 -- 172.21.15.73:0/3405184735 wait complete. 2023-08-10T11:58:23.189 INFO:tasks.cephfs.filesystem:scrub status for tag:9d39b3fa-9b62-42b4-b1a5-738cb3118a5d - {'path': '/', 'tag': '9d39b3fa-9b62-42b4-b1a5-738cb3118a5d', 'options': 'recursive,force'} 2023-08-10T11:58:23.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:23 smithi152 ceph-mon[130220]: pgmap v175: 97 pgs: 97 active+clean; 1.4 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 9.8 MiB/s wr, 483 op/s 2023-08-10T11:58:23.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:23 smithi156 ceph-mon[130574]: pgmap v175: 97 pgs: 97 active+clean; 1.4 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 9.8 MiB/s wr, 483 op/s 2023-08-10T11:58:23.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:23 smithi073 ceph-mon[128869]: pgmap v175: 97 pgs: 97 active+clean; 1.4 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 9.8 MiB/s wr, 483 op/s 2023-08-10T11:58:25.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:24 smithi073 ceph-mon[128869]: pgmap v176: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 14 MiB/s wr, 820 op/s 2023-08-10T11:58:25.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:24 smithi152 ceph-mon[130220]: pgmap v176: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 14 MiB/s wr, 820 op/s 2023-08-10T11:58:25.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:24 smithi156 ceph-mon[130574]: pgmap v176: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 14 MiB/s wr, 820 op/s 2023-08-10T11:58:27.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:26 smithi152 ceph-mon[130220]: pgmap v177: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 17 MiB/s wr, 1.12k op/s 2023-08-10T11:58:27.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:26 smithi156 ceph-mon[130574]: pgmap v177: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 17 MiB/s wr, 1.12k op/s 2023-08-10T11:58:27.293 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:26 smithi073 ceph-mon[128869]: pgmap v177: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 17 MiB/s wr, 1.12k op/s 2023-08-10T11:58:28.162 INFO:tasks.workunit.client.0.smithi073.stdout: 384 1104641 1188 702656 947 329728 746 2023-08-10T11:58:29.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:29 smithi152 ceph-mon[130220]: pgmap v178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 17 MiB/s wr, 1.15k op/s 2023-08-10T11:58:29.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:29 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T11:58:29.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:29 smithi156 ceph-mon[130574]: pgmap v178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 17 MiB/s wr, 1.15k op/s 2023-08-10T11:58:29.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:29 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T11:58:29.541 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:29 smithi073 ceph-mon[128869]: pgmap v178: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 17 MiB/s wr, 1.15k op/s 2023-08-10T11:58:29.541 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:29 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T11:58:31.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:31 smithi152 ceph-mon[130220]: pgmap v179: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 17 MiB/s wr, 1.14k op/s 2023-08-10T11:58:31.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:31 smithi156 ceph-mon[130574]: pgmap v179: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 17 MiB/s wr, 1.14k op/s 2023-08-10T11:58:31.524 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:31 smithi073 ceph-mon[128869]: pgmap v179: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 17 MiB/s wr, 1.14k op/s 2023-08-10T11:58:33.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:33 smithi152 ceph-mon[130220]: pgmap v180: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 858 op/s 2023-08-10T11:58:33.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:33 smithi156 ceph-mon[130574]: pgmap v180: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 858 op/s 2023-08-10T11:58:33.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:33 smithi073 ceph-mon[128869]: pgmap v180: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 858 op/s 2023-08-10T11:58:35.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:34 smithi152 ceph-mon[130220]: pgmap v181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 11 MiB/s wr, 830 op/s 2023-08-10T11:58:35.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:34 smithi156 ceph-mon[130574]: pgmap v181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 11 MiB/s wr, 830 op/s 2023-08-10T11:58:35.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:34 smithi073 ceph-mon[128869]: pgmap v181: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 11 MiB/s wr, 830 op/s 2023-08-10T11:58:36.576 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.571+0000 7f4607190700 1 -- 172.21.15.73:0/3166018616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f460010d490 msgr2=0x7f460010b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:36.576 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.571+0000 7f4607190700 1 --2- 172.21.15.73:0/3166018616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f460010d490 0x7f460010b7b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f45f800b0a0 tx=0x7f45f800b3b0 comp rx=0 tx=0).stop 2023-08-10T11:58:36.576 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.572+0000 7f4607190700 1 -- 172.21.15.73:0/3166018616 shutdown_connections 2023-08-10T11:58:36.576 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.572+0000 7f4607190700 1 --2- 172.21.15.73:0/3166018616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f460010be90 0x7f4600078a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:36.576 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.572+0000 7f4607190700 1 --2- 172.21.15.73:0/3166018616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f460010cae0 0x7f460010cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:36.577 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.572+0000 7f4607190700 1 --2- 172.21.15.73:0/3166018616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f460010d490 0x7f460010b7b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:36.577 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.572+0000 7f4607190700 1 -- 172.21.15.73:0/3166018616 >> 172.21.15.73:0/3166018616 conn(0x7f4600071a60 msgr2=0x7f4600071e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:36.577 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.572+0000 7f4607190700 1 -- 172.21.15.73:0/3166018616 shutdown_connections 2023-08-10T11:58:36.577 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.572+0000 7f4607190700 1 -- 172.21.15.73:0/3166018616 wait complete. 2023-08-10T11:58:36.577 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.573+0000 7f4607190700 1 Processor -- start 2023-08-10T11:58:36.577 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.573+0000 7f4607190700 1 -- start start 2023-08-10T11:58:36.577 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.573+0000 7f4607190700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f460010be90 0x7f460007bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:36.577 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.573+0000 7f4607190700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f460010cae0 0x7f460007c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:36.578 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.573+0000 7f4607190700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4600080900 0x7f4600080db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:36.578 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.573+0000 7f4607190700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46000813b0 con 0x7f460010be90 2023-08-10T11:58:36.578 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.573+0000 7f4607190700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4600081520 con 0x7f460010cae0 2023-08-10T11:58:36.578 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.573+0000 7f4607190700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46000816e0 con 0x7f4600080900 2023-08-10T11:58:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.574+0000 7f460618e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f460010be90 0x7f460007bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.574+0000 7f460618e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f460010be90 0x7f460007bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35354/0 (socket says 172.21.15.73:35354) 2023-08-10T11:58:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.574+0000 7f460618e700 1 -- 172.21.15.73:0/4095127923 learned_addr learned my addr 172.21.15.73:0/4095127923 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.584+0000 7f460618e700 1 -- 172.21.15.73:0/4095127923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4600080900 msgr2=0x7f4600080db0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-10T11:58:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.584+0000 7f460618e700 1 --2- 172.21.15.73:0/4095127923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4600080900 0x7f4600080db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.584+0000 7f460618e700 1 -- 172.21.15.73:0/4095127923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f460010cae0 msgr2=0x7f460007c470 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-10T11:58:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.584+0000 7f460618e700 1 --2- 172.21.15.73:0/4095127923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f460010cae0 0x7f460007c470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.584+0000 7f460618e700 1 -- 172.21.15.73:0/4095127923 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f8009d00 con 0x7f460010be90 2023-08-10T11:58:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.592+0000 7f460618e700 1 --2- 172.21.15.73:0/4095127923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f460010be90 0x7f460007bef0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f45f000d950 tx=0x7f45f000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:36.627 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.613+0000 7f45f77fe700 1 -- 172.21.15.73:0/4095127923 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f0009b40 con 0x7f460010be90 2023-08-10T11:58:36.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.613+0000 7f45f77fe700 1 -- 172.21.15.73:0/4095127923 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f45f0009ca0 con 0x7f460010be90 2023-08-10T11:58:36.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.613+0000 7f45f77fe700 1 -- 172.21.15.73:0/4095127923 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f000f620 con 0x7f460010be90 2023-08-10T11:58:36.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.613+0000 7f4607190700 1 -- 172.21.15.73:0/4095127923 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46001cbab0 con 0x7f460010be90 2023-08-10T11:58:36.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.613+0000 7f4607190700 1 -- 172.21.15.73:0/4095127923 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46001cbf40 con 0x7f460010be90 2023-08-10T11:58:36.628 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.618+0000 7f461458bb80 1 Processor -- start 2023-08-10T11:58:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.620+0000 7f461458bb80 1 -- start start 2023-08-10T11:58:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.620+0000 7f461458bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a72c0ecc0 0x563a72c0f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.620+0000 7f461458bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a72c09010 0x563a72c09490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.620+0000 7f461458bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563a72c099d0 0x563a72c37a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.620+0000 7f461458bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a72b84d60 con 0x563a72c09010 2023-08-10T11:58:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.620+0000 7f461458bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a72b61530 con 0x563a72c0ecc0 2023-08-10T11:58:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.620+0000 7f461458bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a72b5ee50 con 0x563a72c099d0 2023-08-10T11:58:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.633+0000 7f460698f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a72c0ecc0 0x563a72c0f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.633+0000 7f460698f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a72c0ecc0 0x563a72c0f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:50012/0 (socket says 172.21.15.73:50012) 2023-08-10T11:58:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.633+0000 7f460698f700 1 -- 172.21.15.73:0/3842163202 learned_addr learned my addr 172.21.15.73:0/3842163202 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.633+0000 7f45f77fe700 1 -- 172.21.15.73:0/4095127923 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f45f0005030 con 0x7f460010be90 2023-08-10T11:58:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.633+0000 7f460598d700 1 --2- 172.21.15.73:0/3842163202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563a72c099d0 0x563a72c37a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.634+0000 7f460598d700 1 -- 172.21.15.73:0/3842163202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a72c0ecc0 msgr2=0x563a72c0f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:36.637 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.634+0000 7f460598d700 1 --2- 172.21.15.73:0/3842163202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a72c0ecc0 0x563a72c0f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:36.637 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.634+0000 7f460598d700 1 -- 172.21.15.73:0/3842163202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a72c09010 msgr2=0x563a72c09490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:36.637 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.634+0000 7f460598d700 1 --2- 172.21.15.73:0/3842163202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a72c09010 0x563a72c09490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:36.637 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.634+0000 7f460598d700 1 -- 172.21.15.73:0/3842163202 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a729db5d0 con 0x563a72c099d0 2023-08-10T11:58:36.637 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.634+0000 7f460598d700 1 --2- 172.21.15.73:0/3842163202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563a72c099d0 0x563a72c37a80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4600069bf0 tx=0x7f45f8006230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42039ae66d4fc2cb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:36.637 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.635+0000 7f45f77fe700 1 --2- 172.21.15.73:0/4095127923 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f45ec0a14d0 0x7f45ec0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.636+0000 7f45f77fe700 1 -- 172.21.15.73:0/4095127923 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f45f00ce670 con 0x7f460010be90 2023-08-10T11:58:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.636+0000 7f45f4daa700 1 -- 172.21.15.73:0/3842163202 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f800e070 con 0x563a72c099d0 2023-08-10T11:58:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.636+0000 7f45f4daa700 1 -- 172.21.15.73:0/3842163202 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f45f8003a00 con 0x563a72c099d0 2023-08-10T11:58:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.636+0000 7f45f4daa700 1 -- 172.21.15.73:0/3842163202 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f80050b0 con 0x563a72c099d0 2023-08-10T11:58:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.637+0000 7f461458bb80 1 -- 172.21.15.73:0/3842163202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563a72c099d0 msgr2=0x563a72c37a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.637+0000 7f461458bb80 1 --2- 172.21.15.73:0/3842163202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563a72c099d0 0x563a72c37a80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4600069bf0 tx=0x7f45f8006230 comp rx=0 tx=0).stop 2023-08-10T11:58:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.640+0000 7f460698f700 1 --2- 172.21.15.73:0/4095127923 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f45ec0a14d0 0x7f45ec0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.642+0000 7f461458bb80 1 -- 172.21.15.73:0/3842163202 shutdown_connections 2023-08-10T11:58:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.642+0000 7f461458bb80 1 --2- 172.21.15.73:0/3842163202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a72c0ecc0 0x563a72c0f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.642+0000 7f461458bb80 1 --2- 172.21.15.73:0/3842163202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563a72c099d0 0x563a72c37a80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.642+0000 7f461458bb80 1 --2- 172.21.15.73:0/3842163202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a72c09010 0x563a72c09490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.642+0000 7f461458bb80 1 -- 172.21.15.73:0/3842163202 >> 172.21.15.73:0/3842163202 conn(0x563a72b66c70 msgr2=0x563a72c03e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:36.645 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.642+0000 7f461458bb80 1 -- 172.21.15.73:0/3842163202 shutdown_connections 2023-08-10T11:58:36.645 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.642+0000 7f461458bb80 1 -- 172.21.15.73:0/3842163202 wait complete. 2023-08-10T11:58:36.645 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.643+0000 7f461458bb80 1 -- start start 2023-08-10T11:58:36.645 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.643+0000 7f461458bb80 1 Processor -- start 2023-08-10T11:58:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.645+0000 7f461458bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563a72c09010 0x563a72c37920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.645+0000 7f461458bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a72c099d0 0x563a72c34bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.645+0000 7f461458bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a72c0ecc0 0x563a72c35150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.645+0000 7f461458bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a72b5a740 con 0x563a72c0ecc0 2023-08-10T11:58:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.645+0000 7f461458bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a72af9a60 con 0x563a72c099d0 2023-08-10T11:58:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.645+0000 7f461458bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a72af9760 con 0x563a72c09010 2023-08-10T11:58:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.645+0000 7f461458bb80 10 client.0 _ll_register_callbacks cb 0x563a72af7620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:58:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.646+0000 7f460618e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563a72c09010 0x563a72c37920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:36.648 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.646+0000 7f460618e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563a72c09010 0x563a72c37920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60872/0 (socket says 172.21.15.73:60872) 2023-08-10T11:58:36.649 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.646+0000 7f460618e700 1 -- 172.21.15.73:0/2326638288 learned_addr learned my addr 172.21.15.73:0/2326638288 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:36.649 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.646+0000 7f460598d700 1 --2- 172.21.15.73:0/2326638288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a72c099d0 0x563a72c34bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.656+0000 7f460698f700 1 --2- 172.21.15.73:0/4095127923 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f45ec0a14d0 0x7f45ec0a3990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f45fc007aa0 tx=0x7f45fc0072d0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.656+0000 7f460698f700 1 --2- 172.21.15.73:0/2326638288 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a72c0ecc0 0x563a72c35150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.656+0000 7f460598d700 1 -- 172.21.15.73:0/2326638288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563a72c09010 msgr2=0x563a72c37920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.656+0000 7f460598d700 1 --2- 172.21.15.73:0/2326638288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563a72c09010 0x563a72c37920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:36.659 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.656+0000 7f460598d700 1 -- 172.21.15.73:0/2326638288 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a72c0ecc0 msgr2=0x563a72c35150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.656+0000 7f460598d700 1 --2- 172.21.15.73:0/2326638288 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a72c0ecc0 0x563a72c35150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.656+0000 7f460598d700 1 -- 172.21.15.73:0/2326638288 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4600079340 con 0x563a72c099d0 2023-08-10T11:58:36.660 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.656+0000 7f460698f700 1 --2- 172.21.15.73:0/2326638288 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a72c0ecc0 0x563a72c35150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:58:36.669 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.668+0000 7f460598d700 1 --2- 172.21.15.73:0/2326638288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a72c099d0 0x563a72c34bd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4600069bf0 tx=0x7f45f8007d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe2abd7bd75510b1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.688+0000 7f45e9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T11:58:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.688+0000 7f45e9ffb700 1 -- 172.21.15.73:0/2326638288 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f800e070 con 0x563a72c099d0 2023-08-10T11:58:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.688+0000 7f45e9ffb700 1 -- 172.21.15.73:0/2326638288 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f45f80090d0 con 0x563a72c099d0 2023-08-10T11:58:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.688+0000 7f461458bb80 1 -- 172.21.15.73:0/2326638288 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563a72bfc1c0 con 0x563a72c099d0 2023-08-10T11:58:36.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.705+0000 7f45e9ffb700 1 -- 172.21.15.73:0/2326638288 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45f8009290 con 0x563a72c099d0 2023-08-10T11:58:36.707 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.705+0000 7f461458bb80 10 client.25913 fetch_fsmap learned FSMap version 40 2023-08-10T11:58:36.708 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.705+0000 7f461458bb80 1 -- 172.21.15.73:0/2326638288 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x563a72987d80 con 0x563a72c099d0 2023-08-10T11:58:36.720 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.716+0000 7f45e9ffb700 1 -- 172.21.15.73:0/2326638288 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563a72bfc1c0 con 0x563a72c099d0 2023-08-10T11:58:36.720 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.716+0000 7f45e9ffb700 1 -- 172.21.15.73:0/2326638288 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 40) v1 ==== 6977+0+0 (secure 0 0 0) 0x7f45f8020040 con 0x563a72c099d0 2023-08-10T11:58:36.720 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.718+0000 7f461458bb80 10 client.25913 fetch_fsmap finished waiting for FSMap version 40 2023-08-10T11:58:36.720 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.718+0000 7f461458bb80 10 client.25913 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:58:36.721 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.718+0000 7f461458bb80 20 client.25913 populate_metadata read hostname 'smithi073' 2023-08-10T11:58:36.721 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.718+0000 7f461458bb80 1 --2- 172.21.15.73:0/2326638288 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563a72c44a80 0x563a72c46ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:36.721 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.718+0000 7f461458bb80 4 client.25913 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:58:36.721 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.718+0000 7f461458bb80 1 -- 172.21.15.73:0/2326638288 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563a72bd8970 con 0x563a72c44a80 2023-08-10T11:58:36.726 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.724+0000 7f460618e700 1 --2- 172.21.15.73:0/2326638288 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563a72c44a80 0x563a72c46ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:36.739 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.737+0000 7f460618e700 1 --2- 172.21.15.73:0/2326638288 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563a72c44a80 0x563a72c46ea0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef96d2d6ef80bf0b server_cookie=f929b8e65fb137d8 in_seq=0 out_seq=0 2023-08-10T11:58:36.739 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.737+0000 7f45e9ffb700 10 client.25913 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:58:36.749 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.748+0000 7f45e9ffb700 1 -- 172.21.15.73:0/2326638288 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x563a72bd8970 con 0x563a72c44a80 2023-08-10T11:58:36.750 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.748+0000 7f45e9ffb700 10 client.25913 handle_command_reply: tid=0 2023-08-10T11:58:36.750 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.748+0000 7f461458bb80 1 client.25913 shutdown 2023-08-10T11:58:36.750 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.748+0000 7f461458bb80 1 -- 172.21.15.73:0/2326638288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a72c099d0 msgr2=0x563a72c34bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.748+0000 7f461458bb80 1 --2- 172.21.15.73:0/2326638288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a72c099d0 0x563a72c34bd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4600069bf0 tx=0x7f45f8007d70 comp rx=0 tx=0).stop 2023-08-10T11:58:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.748+0000 7f461458bb80 1 -- 172.21.15.73:0/2326638288 shutdown_connections 2023-08-10T11:58:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.748+0000 7f461458bb80 1 --2- 172.21.15.73:0/2326638288 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563a72c44a80 0x563a72c46ea0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:36.751 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.748+0000 7f461458bb80 1 --2- 172.21.15.73:0/2326638288 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a72c0ecc0 0x563a72c35150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:36.752 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.748+0000 7f461458bb80 1 --2- 172.21.15.73:0/2326638288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563a72c09010 0x563a72c37920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:36.752 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.748+0000 7f461458bb80 1 --2- 172.21.15.73:0/2326638288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a72c099d0 0x563a72c34bd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:36.752 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.748+0000 7f461458bb80 1 -- 172.21.15.73:0/2326638288 >> 172.21.15.73:0/2326638288 conn(0x563a72b66c70 msgr2=0x563a72c034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:36.753 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.748+0000 7f45e9ffb700 0 client.25913 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:58:36.756 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.754+0000 7f461458bb80 1 -- 172.21.15.73:0/2326638288 shutdown_connections 2023-08-10T11:58:36.756 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.754+0000 7f461458bb80 1 -- 172.21.15.73:0/2326638288 wait complete. 2023-08-10T11:58:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.755+0000 7f461458bb80 20 client.25913 trim_cache size 0 max 16384 2023-08-10T11:58:36.841 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.839+0000 7f461458bb80 1 Processor -- start 2023-08-10T11:58:36.842 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.840+0000 7f461458bb80 1 -- start start 2023-08-10T11:58:36.843 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.840+0000 7f461458bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a72c09010 0x563a72c4b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:36.843 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.840+0000 7f461458bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a72c099d0 0x563a72c3c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:36.843 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.840+0000 7f461458bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563a72c0ecc0 0x563a72c03c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:36.843 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.840+0000 7f461458bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a729dd8c0 con 0x563a72c099d0 2023-08-10T11:58:36.844 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.840+0000 7f461458bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a72c0d7f0 con 0x563a72c09010 2023-08-10T11:58:36.844 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.840+0000 7f461458bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a72c0d510 con 0x563a72c0ecc0 2023-08-10T11:58:36.844 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.841+0000 7f460598d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a72c099d0 0x563a72c3c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:36.845 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.841+0000 7f460698f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563a72c0ecc0 0x563a72c03c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:36.845 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.841+0000 7f460698f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563a72c0ecc0 0x563a72c03c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60884/0 (socket says 172.21.15.73:60884) 2023-08-10T11:58:36.845 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.841+0000 7f460698f700 1 -- 172.21.15.73:0/914330429 learned_addr learned my addr 172.21.15.73:0/914330429 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:36.845 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.841+0000 7f460618e700 1 --2- 172.21.15.73:0/914330429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a72c09010 0x563a72c4b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:36.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.845+0000 7f460698f700 1 -- 172.21.15.73:0/914330429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a72c09010 msgr2=0x563a72c4b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:36.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.845+0000 7f460698f700 1 --2- 172.21.15.73:0/914330429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a72c09010 0x563a72c4b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:36.847 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.845+0000 7f460698f700 1 -- 172.21.15.73:0/914330429 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a72c099d0 msgr2=0x563a72c3c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:36.848 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.845+0000 7f460698f700 1 --2- 172.21.15.73:0/914330429 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a72c099d0 0x563a72c3c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:36.848 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.845+0000 7f460698f700 1 -- 172.21.15.73:0/914330429 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a72970c00 con 0x563a72c0ecc0 2023-08-10T11:58:36.850 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.848+0000 7f460698f700 1 --2- 172.21.15.73:0/914330429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563a72c0ecc0 0x563a72c03c30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f45fc010c50 tx=0x7f45fc013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3428f565096a56ff server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:36.894 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.883+0000 7f45f55ab700 1 -- 172.21.15.73:0/914330429 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc011ad0 con 0x563a72c0ecc0 2023-08-10T11:58:36.894 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.883+0000 7f45f55ab700 1 -- 172.21.15.73:0/914330429 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f45fc015070 con 0x563a72c0ecc0 2023-08-10T11:58:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.883+0000 7f45f55ab700 1 -- 172.21.15.73:0/914330429 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc01e420 con 0x563a72c0ecc0 2023-08-10T11:58:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.892+0000 7f461458bb80 1 -- 172.21.15.73:0/914330429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563a72c0ecc0 msgr2=0x563a72c03c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.892+0000 7f461458bb80 1 --2- 172.21.15.73:0/914330429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563a72c0ecc0 0x563a72c03c30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f45fc010c50 tx=0x7f45fc013000 comp rx=0 tx=0).stop 2023-08-10T11:58:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.893+0000 7f461458bb80 1 -- 172.21.15.73:0/914330429 shutdown_connections 2023-08-10T11:58:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.893+0000 7f461458bb80 1 --2- 172.21.15.73:0/914330429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a72c09010 0x563a72c4b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.893+0000 7f461458bb80 1 --2- 172.21.15.73:0/914330429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563a72c0ecc0 0x563a72c03c30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:36.896 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.893+0000 7f461458bb80 1 --2- 172.21.15.73:0/914330429 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a72c099d0 0x563a72c3c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:36.896 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.893+0000 7f461458bb80 1 -- 172.21.15.73:0/914330429 >> 172.21.15.73:0/914330429 conn(0x563a72b66c70 msgr2=0x563a72c00120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:36.897 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.893+0000 7f461458bb80 1 -- 172.21.15.73:0/914330429 shutdown_connections 2023-08-10T11:58:36.897 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.893+0000 7f461458bb80 1 -- 172.21.15.73:0/914330429 wait complete. 2023-08-10T11:58:36.898 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.893+0000 7f461458bb80 1 -- start start 2023-08-10T11:58:36.898 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.894+0000 7f461458bb80 1 Processor -- start 2023-08-10T11:58:36.898 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.894+0000 7f461458bb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a72c09010 0x563a72c3bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:36.898 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.894+0000 7f461458bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a72c099d0 0x563a72c3c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:36.898 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.894+0000 7f461458bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563a72c0ecc0 0x563a72c38250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:36.898 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.894+0000 7f461458bb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a72c38930 con 0x563a72c09010 2023-08-10T11:58:36.898 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.894+0000 7f461458bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a72c38aa0 con 0x563a72c099d0 2023-08-10T11:58:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.894+0000 7f461458bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a72c38c60 con 0x563a72c0ecc0 2023-08-10T11:58:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.894+0000 7f461458bb80 10 client.0 _ll_register_callbacks cb 0x563a72af7620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:58:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.895+0000 7f460598d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a72c099d0 0x563a72c3c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.895+0000 7f460598d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a72c099d0 0x563a72c3c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:50034/0 (socket says 172.21.15.73:50034) 2023-08-10T11:58:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.895+0000 7f460598d700 1 -- 172.21.15.73:0/2215005309 learned_addr learned my addr 172.21.15.73:0/2215005309 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.895+0000 7f460698f700 1 --2- 172.21.15.73:0/2215005309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563a72c0ecc0 0x563a72c38250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.896+0000 7f460598d700 1 -- 172.21.15.73:0/2215005309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563a72c0ecc0 msgr2=0x563a72c38250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.896+0000 7f460598d700 1 --2- 172.21.15.73:0/2215005309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563a72c0ecc0 0x563a72c38250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.896+0000 7f460598d700 1 -- 172.21.15.73:0/2215005309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a72c09010 msgr2=0x563a72c3bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:36.901 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.896+0000 7f460598d700 1 --2- 172.21.15.73:0/2215005309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a72c09010 0x563a72c3bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:36.901 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.896+0000 7f460598d700 1 -- 172.21.15.73:0/2215005309 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45fc010900 con 0x563a72c099d0 2023-08-10T11:58:36.901 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.898+0000 7f460598d700 1 --2- 172.21.15.73:0/2215005309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a72c099d0 0x563a72c3c090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f45f8002230 tx=0x7f45f8006000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49744a0d3d8360b3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.916+0000 7f45e9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T11:58:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.916+0000 7f45e9ffb700 1 -- 172.21.15.73:0/2215005309 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f800e030 con 0x563a72c099d0 2023-08-10T11:58:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.916+0000 7f45e9ffb700 1 -- 172.21.15.73:0/2215005309 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f45f8005570 con 0x563a72c099d0 2023-08-10T11:58:36.919 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.916+0000 7f461458bb80 1 -- 172.21.15.73:0/2215005309 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f45f8003a00 con 0x563a72c099d0 2023-08-10T11:58:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.931+0000 7f45e9ffb700 1 -- 172.21.15.73:0/2215005309 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45f80094e0 con 0x563a72c099d0 2023-08-10T11:58:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.932+0000 7f461458bb80 10 client.25919 fetch_fsmap learned FSMap version 40 2023-08-10T11:58:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.932+0000 7f461458bb80 1 -- 172.21.15.73:0/2215005309 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x563a729ae1f0 con 0x563a72c099d0 2023-08-10T11:58:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.943+0000 7f45e9ffb700 1 -- 172.21.15.73:0/2215005309 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f45f8003a00 con 0x563a72c099d0 2023-08-10T11:58:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.943+0000 7f45e9ffb700 1 -- 172.21.15.73:0/2215005309 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 40) v1 ==== 6977+0+0 (secure 0 0 0) 0x7f45f803b070 con 0x563a72c099d0 2023-08-10T11:58:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.961+0000 7f461458bb80 10 client.25919 fetch_fsmap finished waiting for FSMap version 40 2023-08-10T11:58:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.961+0000 7f461458bb80 10 client.25919 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:58:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.961+0000 7f461458bb80 20 client.25919 populate_metadata read hostname 'smithi073' 2023-08-10T11:58:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.961+0000 7f461458bb80 1 --2- 172.21.15.73:0/2215005309 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563a72c994c0 0x563a72c9b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.961+0000 7f461458bb80 4 client.25919 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:58:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.961+0000 7f461458bb80 1 -- 172.21.15.73:0/2215005309 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563a72b53720 con 0x563a72c994c0 2023-08-10T11:58:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.961+0000 7f460618e700 1 --2- 172.21.15.73:0/2215005309 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563a72c994c0 0x563a72c9b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:36.991 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.988+0000 7f460618e700 1 --2- 172.21.15.73:0/2215005309 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563a72c994c0 0x563a72c9b8e0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e10553f2c583148c server_cookie=101bb57a55e07716 in_seq=0 out_seq=0 2023-08-10T11:58:36.991 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:36.988+0000 7f45e9ffb700 10 client.25919 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:58:37.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:37 smithi073 ceph-mon[128869]: pgmap v182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.3 MiB/s wr, 525 op/s 2023-08-10T11:58:37.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:37 smithi152 ceph-mon[130220]: pgmap v182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.3 MiB/s wr, 525 op/s 2023-08-10T11:58:37.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:37 smithi156 ceph-mon[130574]: pgmap v182: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.3 MiB/s wr, 525 op/s 2023-08-10T11:58:38.167 INFO:tasks.workunit.client.0.smithi073.stdout: 398 2402954 747 1540183 723 755897 1148 2023-08-10T11:58:38.728 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:38.726+0000 7f45e9ffb700 1 -- 172.21.15.73:0/2215005309 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563a72b53720 con 0x563a72c994c0 2023-08-10T11:58:38.728 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:38.726+0000 7f45e9ffb700 10 client.25919 handle_command_reply: tid=0 2023-08-10T11:58:38.728 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:38.726+0000 7f461458bb80 1 client.25919 shutdown 2023-08-10T11:58:38.734 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:38.732+0000 7f461458bb80 1 -- 172.21.15.73:0/2215005309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a72c099d0 msgr2=0x563a72c3c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:38.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:38.732+0000 7f461458bb80 1 --2- 172.21.15.73:0/2215005309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a72c099d0 0x563a72c3c090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f45f8002230 tx=0x7f45f8006000 comp rx=0 tx=0).stop 2023-08-10T11:58:38.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:38.732+0000 7f461458bb80 1 -- 172.21.15.73:0/2215005309 shutdown_connections 2023-08-10T11:58:38.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:38.732+0000 7f461458bb80 1 --2- 172.21.15.73:0/2215005309 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563a72c994c0 0x563a72c9b8e0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:38.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:38.732+0000 7f461458bb80 1 --2- 172.21.15.73:0/2215005309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563a72c0ecc0 0x563a72c38250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:38.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:38.732+0000 7f461458bb80 1 --2- 172.21.15.73:0/2215005309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563a72c09010 0x563a72c3bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:38.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:38.732+0000 7f461458bb80 1 --2- 172.21.15.73:0/2215005309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a72c099d0 0x563a72c3c090 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:38.736 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:38.732+0000 7f461458bb80 1 -- 172.21.15.73:0/2215005309 >> 172.21.15.73:0/2215005309 conn(0x563a72b66c70 msgr2=0x563a72c0dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:38.732+0000 7f45e9ffb700 0 client.25919 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:58:38.739 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:38.732+0000 7f461458bb80 1 -- 172.21.15.73:0/2215005309 shutdown_connections 2023-08-10T11:58:38.739 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:38.732+0000 7f461458bb80 1 -- 172.21.15.73:0/2215005309 wait complete. 2023-08-10T11:58:38.742 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:58:38.742 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:58:38.742 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:58:38.742 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:58:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:38.732+0000 7f461458bb80 20 client.25919 trim_cache size 0 max 16384 2023-08-10T11:58:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:38.735+0000 7f4607190700 1 -- 172.21.15.73:0/4095127923 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f45ec0a14d0 msgr2=0x7f45ec0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:38.735+0000 7f4607190700 1 --2- 172.21.15.73:0/4095127923 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f45ec0a14d0 0x7f45ec0a3990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f45fc007aa0 tx=0x7f45fc0072d0 comp rx=0 tx=0).stop 2023-08-10T11:58:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:38.735+0000 7f4607190700 1 -- 172.21.15.73:0/4095127923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f460010be90 msgr2=0x7f460007bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:38.735+0000 7f4607190700 1 --2- 172.21.15.73:0/4095127923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f460010be90 0x7f460007bef0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f45f000d950 tx=0x7f45f000dd10 comp rx=0 tx=0).stop 2023-08-10T11:58:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:38.736+0000 7f4607190700 1 -- 172.21.15.73:0/4095127923 shutdown_connections 2023-08-10T11:58:38.744 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:38.736+0000 7f4607190700 1 --2- 172.21.15.73:0/4095127923 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f45ec0a14d0 0x7f45ec0a3990 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:38.744 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:38.736+0000 7f4607190700 1 --2- 172.21.15.73:0/4095127923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4600080900 0x7f4600080db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:38.744 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:38.736+0000 7f4607190700 1 --2- 172.21.15.73:0/4095127923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f460010be90 0x7f460007bef0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:38.744 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:38.736+0000 7f4607190700 1 --2- 172.21.15.73:0/4095127923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f460010cae0 0x7f460007c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:38.744 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:38.736+0000 7f4607190700 1 -- 172.21.15.73:0/4095127923 >> 172.21.15.73:0/4095127923 conn(0x7f4600071a60 msgr2=0x7f4600109780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:38.744 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:38.737+0000 7f4607190700 1 -- 172.21.15.73:0/4095127923 shutdown_connections 2023-08-10T11:58:38.744 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:38.737+0000 7f4607190700 1 -- 172.21.15.73:0/4095127923 wait complete. 2023-08-10T11:58:39.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:39 smithi152 ceph-mon[130220]: pgmap v183: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 228 op/s 2023-08-10T11:58:39.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:39 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T11:58:39.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:39 smithi156 ceph-mon[130574]: pgmap v183: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 228 op/s 2023-08-10T11:58:39.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:39 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T11:58:39.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:39 smithi073 ceph-mon[128869]: pgmap v183: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 228 op/s 2023-08-10T11:58:39.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:39 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T11:58:41.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:41 smithi152 ceph-mon[130220]: pgmap v184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.3 MiB/s wr, 542 op/s 2023-08-10T11:58:41.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:41 smithi156 ceph-mon[130574]: pgmap v184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.3 MiB/s wr, 542 op/s 2023-08-10T11:58:41.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:41 smithi073 ceph-mon[128869]: pgmap v184: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.3 MiB/s wr, 542 op/s 2023-08-10T11:58:43.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:43 smithi152 ceph-mon[130220]: pgmap v185: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.0 MiB/s wr, 555 op/s 2023-08-10T11:58:43.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:43 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T11:58:43.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:43 smithi156 ceph-mon[130574]: pgmap v185: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.0 MiB/s wr, 555 op/s 2023-08-10T11:58:43.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:43 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T11:58:43.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:43 smithi073 ceph-mon[128869]: pgmap v185: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.0 MiB/s wr, 555 op/s 2023-08-10T11:58:43.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:43 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T11:58:45.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:44 smithi152 ceph-mon[130220]: pgmap v186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.3 MiB/s wr, 614 op/s 2023-08-10T11:58:45.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:44 smithi156 ceph-mon[130574]: pgmap v186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.3 MiB/s wr, 614 op/s 2023-08-10T11:58:45.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:44 smithi073 ceph-mon[128869]: pgmap v186: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.3 MiB/s wr, 614 op/s 2023-08-10T11:58:47.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:47 smithi152 ceph-mon[130220]: pgmap v187: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.1 MiB/s wr, 605 op/s 2023-08-10T11:58:47.511 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:47 smithi156 ceph-mon[130574]: pgmap v187: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.1 MiB/s wr, 605 op/s 2023-08-10T11:58:47.528 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:47 smithi073 ceph-mon[128869]: pgmap v187: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.1 MiB/s wr, 605 op/s 2023-08-10T11:58:48.177 INFO:tasks.workunit.client.0.smithi073.stdout: 421 1291984 1319 829417 1180 395403 1299 2023-08-10T11:58:49.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:49 smithi152 ceph-mon[130220]: pgmap v188: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 571 op/s 2023-08-10T11:58:49.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:49 smithi156 ceph-mon[130574]: pgmap v188: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 571 op/s 2023-08-10T11:58:49.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:49 smithi073 ceph-mon[128869]: pgmap v188: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 571 op/s 2023-08-10T11:58:51.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:51 smithi152 ceph-mon[130220]: pgmap v189: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.6 MiB/s wr, 872 op/s 2023-08-10T11:58:51.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:51 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:58:51.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:51 smithi156 ceph-mon[130574]: pgmap v189: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.6 MiB/s wr, 872 op/s 2023-08-10T11:58:51.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:51 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:58:51.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:51 smithi073 ceph-mon[128869]: pgmap v189: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.6 MiB/s wr, 872 op/s 2023-08-10T11:58:51.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:51 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:58:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.877+0000 7fb87c57d700 1 -- 172.21.15.73:0/3315280966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8740ff800 msgr2=0x7fb8740ffc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.877+0000 7fb87c57d700 1 --2- 172.21.15.73:0/3315280966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8740ff800 0x7fb8740ffc80 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb870009990 tx=0x7fb870009ca0 comp rx=0 tx=0).stop 2023-08-10T11:58:51.879 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.877+0000 7fb87c57d700 1 -- 172.21.15.73:0/3315280966 shutdown_connections 2023-08-10T11:58:51.879 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.877+0000 7fb87c57d700 1 --2- 172.21.15.73:0/3315280966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb874105690 0x7fb874105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:51.879 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.877+0000 7fb87c57d700 1 --2- 172.21.15.73:0/3315280966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8741001c0 0x7fb87410c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:51.879 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.877+0000 7fb87c57d700 1 --2- 172.21.15.73:0/3315280966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8740ff800 0x7fb8740ffc80 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:51.879 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.877+0000 7fb87c57d700 1 -- 172.21.15.73:0/3315280966 >> 172.21.15.73:0/3315280966 conn(0x7fb874077540 msgr2=0x7fb874077950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:51.879 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.877+0000 7fb87c57d700 1 -- 172.21.15.73:0/3315280966 shutdown_connections 2023-08-10T11:58:51.880 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.877+0000 7fb87c57d700 1 -- 172.21.15.73:0/3315280966 wait complete. 2023-08-10T11:58:51.880 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.878+0000 7fb87c57d700 1 Processor -- start 2023-08-10T11:58:51.880 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.878+0000 7fb87c57d700 1 -- start start 2023-08-10T11:58:51.881 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.878+0000 7fb87c57d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8740ff800 0x7fb874197790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.878+0000 7fb87c57d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8741001c0 0x7fb874197cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.878+0000 7fb87c57d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb874105690 0x7fb8741a2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.878+0000 7fb87c57d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8741a2c00 con 0x7fb874105690 2023-08-10T11:58:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.878+0000 7fb87c57d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8741a2d70 con 0x7fb8741001c0 2023-08-10T11:58:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.878+0000 7fb87c57d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8741a2f30 con 0x7fb8740ff800 2023-08-10T11:58:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.878+0000 7fb87ab1a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb874105690 0x7fb8741a2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.878+0000 7fb87a319700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8740ff800 0x7fb874197790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:51.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.878+0000 7fb87a319700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8740ff800 0x7fb874197790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60900/0 (socket says 172.21.15.73:60900) 2023-08-10T11:58:51.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.878+0000 7fb87ab1a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb874105690 0x7fb8741a2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35400/0 (socket says 172.21.15.73:35400) 2023-08-10T11:58:51.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.878+0000 7fb87a319700 1 -- 172.21.15.73:0/4086696802 learned_addr learned my addr 172.21.15.73:0/4086696802 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:51.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.878+0000 7fb879b18700 1 --2- 172.21.15.73:0/4086696802 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8741001c0 0x7fb874197cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:51.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.878+0000 7fb87ab1a700 1 -- 172.21.15.73:0/4086696802 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8740ff800 msgr2=0x7fb874197790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:51.883 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.878+0000 7fb87ab1a700 1 --2- 172.21.15.73:0/4086696802 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8740ff800 0x7fb874197790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:51.884 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.878+0000 7fb87ab1a700 1 -- 172.21.15.73:0/4086696802 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8741001c0 msgr2=0x7fb874197cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:51.884 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.878+0000 7fb87ab1a700 1 --2- 172.21.15.73:0/4086696802 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8741001c0 0x7fb874197cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:51.884 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.878+0000 7fb87ab1a700 1 -- 172.21.15.73:0/4086696802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8700095f0 con 0x7fb874105690 2023-08-10T11:58:51.884 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.878+0000 7fb87ab1a700 1 --2- 172.21.15.73:0/4086696802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb874105690 0x7fb8741a2630 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fb86c00efc0 tx=0x7fb86c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:51.884 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.879+0000 7fb86b7fe700 1 -- 172.21.15.73:0/4086696802 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c018070 con 0x7fb874105690 2023-08-10T11:58:51.884 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.879+0000 7fb86b7fe700 1 -- 172.21.15.73:0/4086696802 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb86c00f040 con 0x7fb874105690 2023-08-10T11:58:51.884 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.879+0000 7fb87c57d700 1 -- 172.21.15.73:0/4086696802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8741a31b0 con 0x7fb874105690 2023-08-10T11:58:51.884 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.879+0000 7fb86b7fe700 1 -- 172.21.15.73:0/4086696802 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c00cc80 con 0x7fb874105690 2023-08-10T11:58:51.885 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.879+0000 7fb87c57d700 1 -- 172.21.15.73:0/4086696802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8741a3670 con 0x7fb874105690 2023-08-10T11:58:51.885 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.881+0000 7fb86b7fe700 1 -- 172.21.15.73:0/4086696802 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fb86c003a00 con 0x7fb874105690 2023-08-10T11:58:51.889 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.881+0000 7fb86b7fe700 1 --2- 172.21.15.73:0/4086696802 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb8600a12c0 0x7fb8600a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:51.889 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.881+0000 7fb87a319700 1 --2- 172.21.15.73:0/4086696802 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb8600a12c0 0x7fb8600a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.881+0000 7fb86b7fe700 1 -- 172.21.15.73:0/4086696802 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb86c0cc920 con 0x7fb874105690 2023-08-10T11:58:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.882+0000 7fb87a319700 1 --2- 172.21.15.73:0/4086696802 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb8600a12c0 0x7fb8600a3780 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb864005950 tx=0x7fb864009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.882+0000 7fb888716b80 1 Processor -- start 2023-08-10T11:58:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.882+0000 7fb888716b80 1 -- start start 2023-08-10T11:58:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.882+0000 7fb888716b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5ea40 0x560003d5ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.882+0000 7fb888716b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560003d5f360 0x560003d59010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.882+0000 7fb888716b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560003d59550 0x560003d599d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.883+0000 7fb888716b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x560003cd4d60 con 0x560003d5ea40 2023-08-10T11:58:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.883+0000 7fb888716b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x560003cb1530 con 0x560003d59550 2023-08-10T11:58:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.883+0000 7fb888716b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560003caee50 con 0x560003d5f360 2023-08-10T11:58:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.883+0000 7fb87a319700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5ea40 0x560003d5ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.883+0000 7fb87a319700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5ea40 0x560003d5ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35404/0 (socket says 172.21.15.73:35404) 2023-08-10T11:58:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.883+0000 7fb87a319700 1 -- 172.21.15.73:0/2380244929 learned_addr learned my addr 172.21.15.73:0/2380244929 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.883+0000 7fb879b18700 1 --2- 172.21.15.73:0/2380244929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560003d5f360 0x560003d59010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.883+0000 7fb87ab1a700 1 --2- 172.21.15.73:0/2380244929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560003d59550 0x560003d599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:51.892 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.883+0000 7fb87a319700 1 -- 172.21.15.73:0/2380244929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560003d5f360 msgr2=0x560003d59010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:51.892 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.883+0000 7fb87a319700 1 --2- 172.21.15.73:0/2380244929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560003d5f360 0x560003d59010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:51.892 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.883+0000 7fb87a319700 1 -- 172.21.15.73:0/2380244929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560003d59550 msgr2=0x560003d599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:51.892 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.883+0000 7fb87a319700 1 --2- 172.21.15.73:0/2380244929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560003d59550 0x560003d599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:51.892 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.883+0000 7fb87a319700 1 -- 172.21.15.73:0/2380244929 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560003b2b5d0 con 0x560003d5ea40 2023-08-10T11:58:51.892 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.883+0000 7fb87a319700 1 --2- 172.21.15.73:0/2380244929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5ea40 0x560003d5ee20 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb864009800 tx=0x7fb864014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e6b3c00aaea580 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:51.892 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.883+0000 7fb868ff9700 1 -- 172.21.15.73:0/2380244929 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb864026430 con 0x560003d5ea40 2023-08-10T11:58:51.893 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.883+0000 7fb868ff9700 1 -- 172.21.15.73:0/2380244929 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb864021070 con 0x560003d5ea40 2023-08-10T11:58:51.893 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.883+0000 7fb868ff9700 1 -- 172.21.15.73:0/2380244929 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86401d670 con 0x560003d5ea40 2023-08-10T11:58:51.893 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.884+0000 7fb888716b80 1 -- 172.21.15.73:0/2380244929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5ea40 msgr2=0x560003d5ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:51.893 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.884+0000 7fb888716b80 1 --2- 172.21.15.73:0/2380244929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5ea40 0x560003d5ee20 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb864009800 tx=0x7fb864014000 comp rx=0 tx=0).stop 2023-08-10T11:58:51.893 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.884+0000 7fb888716b80 1 -- 172.21.15.73:0/2380244929 shutdown_connections 2023-08-10T11:58:51.893 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.884+0000 7fb888716b80 1 --2- 172.21.15.73:0/2380244929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560003d59550 0x560003d599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:51.893 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.884+0000 7fb888716b80 1 --2- 172.21.15.73:0/2380244929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5ea40 0x560003d5ee20 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.884+0000 7fb888716b80 1 --2- 172.21.15.73:0/2380244929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560003d5f360 0x560003d59010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.884+0000 7fb888716b80 1 -- 172.21.15.73:0/2380244929 >> 172.21.15.73:0/2380244929 conn(0x560003cb6c70 msgr2=0x560003d53d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.884+0000 7fb888716b80 1 -- 172.21.15.73:0/2380244929 shutdown_connections 2023-08-10T11:58:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.884+0000 7fb888716b80 1 -- 172.21.15.73:0/2380244929 wait complete. 2023-08-10T11:58:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.884+0000 7fb888716b80 1 -- start start 2023-08-10T11:58:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.884+0000 7fb888716b80 1 Processor -- start 2023-08-10T11:58:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.885+0000 7fb888716b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560003d59550 0x560003d62690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:51.895 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.885+0000 7fb888716b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560003d5ea40 0x560003d62bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:51.895 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.885+0000 7fb888716b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5f360 0x560003d63110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:51.895 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.885+0000 7fb888716b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x560003caa740 con 0x560003d5f360 2023-08-10T11:58:51.895 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.885+0000 7fb888716b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x560003c49a60 con 0x560003d5ea40 2023-08-10T11:58:51.895 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.885+0000 7fb888716b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560003c49760 con 0x560003d59550 2023-08-10T11:58:51.895 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.885+0000 7fb888716b80 10 client.0 _ll_register_callbacks cb 0x560003c47620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:58:51.895 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.885+0000 7fb87ab1a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5f360 0x560003d63110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.885+0000 7fb87ab1a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5f360 0x560003d63110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35414/0 (socket says 172.21.15.73:35414) 2023-08-10T11:58:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.885+0000 7fb87ab1a700 1 -- 172.21.15.73:0/2032608432 learned_addr learned my addr 172.21.15.73:0/2032608432 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.885+0000 7fb879b18700 1 --2- 172.21.15.73:0/2032608432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560003d5ea40 0x560003d62bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.885+0000 7fb87a319700 1 --2- 172.21.15.73:0/2032608432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560003d59550 0x560003d62690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.885+0000 7fb87ab1a700 1 -- 172.21.15.73:0/2032608432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560003d59550 msgr2=0x560003d62690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.885+0000 7fb87ab1a700 1 --2- 172.21.15.73:0/2032608432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560003d59550 0x560003d62690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.885+0000 7fb87ab1a700 1 -- 172.21.15.73:0/2032608432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560003d5ea40 msgr2=0x560003d62bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:51.897 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.885+0000 7fb87ab1a700 1 --2- 172.21.15.73:0/2032608432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560003d5ea40 0x560003d62bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:51.897 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.885+0000 7fb87ab1a700 1 -- 172.21.15.73:0/2032608432 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb864017070 con 0x560003d5f360 2023-08-10T11:58:51.897 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.885+0000 7fb87ab1a700 1 --2- 172.21.15.73:0/2032608432 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5f360 0x560003d63110 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb86c099940 tx=0x7fb86c0993e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75cbda465da0ecf4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:51.897 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.885+0000 7fb85dffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:58:51.897 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.885+0000 7fb85dffb700 1 -- 172.21.15.73:0/2032608432 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c099e10 con 0x560003d5f360 2023-08-10T11:58:51.897 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.885+0000 7fb85dffb700 1 -- 172.21.15.73:0/2032608432 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb86c0999b0 con 0x560003d5f360 2023-08-10T11:58:51.897 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.885+0000 7fb888716b80 1 -- 172.21.15.73:0/2032608432 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560003d4c1c0 con 0x560003d5f360 2023-08-10T11:58:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.886+0000 7fb85dffb700 1 -- 172.21.15.73:0/2032608432 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb86c09d9e0 con 0x560003d5f360 2023-08-10T11:58:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.886+0000 7fb888716b80 10 client.16485 fetch_fsmap learned FSMap version 42 2023-08-10T11:58:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.886+0000 7fb888716b80 1 -- 172.21.15.73:0/2032608432 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x560003ad7d80 con 0x560003d5f360 2023-08-10T11:58:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.886+0000 7fb85dffb700 1 -- 172.21.15.73:0/2032608432 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560003d4c1c0 con 0x560003d5f360 2023-08-10T11:58:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.886+0000 7fb85dffb700 1 -- 172.21.15.73:0/2032608432 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 42) v1 ==== 6969+0+0 (secure 0 0 0) 0x7fb86c0a18e0 con 0x560003d5f360 2023-08-10T11:58:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.886+0000 7fb888716b80 10 client.16485 fetch_fsmap finished waiting for FSMap version 42 2023-08-10T11:58:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.886+0000 7fb888716b80 10 client.16485 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:58:51.899 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.886+0000 7fb888716b80 20 client.16485 populate_metadata read hostname 'smithi073' 2023-08-10T11:58:51.899 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.886+0000 7fb888716b80 1 --2- 172.21.15.73:0/2032608432 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x560003d72ec0 0x560003d752e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:51.899 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.886+0000 7fb888716b80 4 client.16485 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:58:51.899 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.886+0000 7fb888716b80 1 -- 172.21.15.73:0/2032608432 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560003d28970 con 0x560003d72ec0 2023-08-10T11:58:51.899 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.886+0000 7fb87a319700 1 --2- 172.21.15.73:0/2032608432 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x560003d72ec0 0x560003d752e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:51.899 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.886+0000 7fb85dffb700 10 client.16485 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:58:51.899 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.886+0000 7fb87a319700 1 --2- 172.21.15.73:0/2032608432 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x560003d72ec0 0x560003d752e0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23a6567c6c571bb5 server_cookie=6c845eba1abe4752 in_seq=0 out_seq=0 2023-08-10T11:58:51.899 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.887+0000 7fb85dffb700 1 -- 172.21.15.73:0/2032608432 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x560003d28970 con 0x560003d72ec0 2023-08-10T11:58:51.900 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.887+0000 7fb85dffb700 10 client.16485 handle_command_reply: tid=0 2023-08-10T11:58:51.900 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.887+0000 7fb888716b80 1 client.16485 shutdown 2023-08-10T11:58:51.900 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.887+0000 7fb888716b80 1 -- 172.21.15.73:0/2032608432 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5f360 msgr2=0x560003d63110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:51.900 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.887+0000 7fb888716b80 1 --2- 172.21.15.73:0/2032608432 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5f360 0x560003d63110 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb86c099940 tx=0x7fb86c0993e0 comp rx=0 tx=0).stop 2023-08-10T11:58:51.900 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.887+0000 7fb888716b80 1 -- 172.21.15.73:0/2032608432 shutdown_connections 2023-08-10T11:58:51.900 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.887+0000 7fb888716b80 1 --2- 172.21.15.73:0/2032608432 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x560003d72ec0 0x560003d752e0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:51.900 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.887+0000 7fb888716b80 1 --2- 172.21.15.73:0/2032608432 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5f360 0x560003d63110 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:51.901 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.887+0000 7fb888716b80 1 --2- 172.21.15.73:0/2032608432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560003d59550 0x560003d62690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:51.901 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.887+0000 7fb85dffb700 0 client.16485 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:58:51.901 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.887+0000 7fb888716b80 1 --2- 172.21.15.73:0/2032608432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560003d5ea40 0x560003d62bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:51.901 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.887+0000 7fb888716b80 1 -- 172.21.15.73:0/2032608432 >> 172.21.15.73:0/2032608432 conn(0x560003cb6c70 msgr2=0x560003d534b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:51.901 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.887+0000 7fb888716b80 1 -- 172.21.15.73:0/2032608432 shutdown_connections 2023-08-10T11:58:51.901 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.887+0000 7fb888716b80 1 -- 172.21.15.73:0/2032608432 wait complete. 2023-08-10T11:58:51.901 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.888+0000 7fb888716b80 20 client.16485 trim_cache size 0 max 16384 2023-08-10T11:58:51.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.902+0000 7fb888716b80 1 Processor -- start 2023-08-10T11:58:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.902+0000 7fb888716b80 1 -- start start 2023-08-10T11:58:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.902+0000 7fb888716b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560003d59550 0x560003d69e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.902+0000 7fb888716b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560003d5ea40 0x560003d53c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.902+0000 7fb888716b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5f360 0x560003d5d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.902+0000 7fb888716b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x560003b2d8c0 con 0x560003d5f360 2023-08-10T11:58:51.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.902+0000 7fb888716b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x560003d55490 con 0x560003d5ea40 2023-08-10T11:58:51.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.902+0000 7fb888716b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560003d6ed40 con 0x560003d59550 2023-08-10T11:58:51.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.902+0000 7fb87ab1a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5f360 0x560003d5d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:51.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.902+0000 7fb87ab1a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5f360 0x560003d5d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35422/0 (socket says 172.21.15.73:35422) 2023-08-10T11:58:51.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.902+0000 7fb87ab1a700 1 -- 172.21.15.73:0/1292029388 learned_addr learned my addr 172.21.15.73:0/1292029388 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:51.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.902+0000 7fb879b18700 1 --2- 172.21.15.73:0/1292029388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560003d5ea40 0x560003d53c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:51.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.902+0000 7fb87a319700 1 --2- 172.21.15.73:0/1292029388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560003d59550 0x560003d69e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:51.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.902+0000 7fb87ab1a700 1 -- 172.21.15.73:0/1292029388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560003d59550 msgr2=0x560003d69e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:51.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.902+0000 7fb87ab1a700 1 --2- 172.21.15.73:0/1292029388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560003d59550 0x560003d69e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:51.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.903+0000 7fb87ab1a700 1 -- 172.21.15.73:0/1292029388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560003d5ea40 msgr2=0x560003d53c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:51.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.903+0000 7fb87ab1a700 1 --2- 172.21.15.73:0/1292029388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560003d5ea40 0x560003d53c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:51.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.903+0000 7fb87ab1a700 1 -- 172.21.15.73:0/1292029388 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560003ac0c00 con 0x560003d5f360 2023-08-10T11:58:51.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.903+0000 7fb87ab1a700 1 --2- 172.21.15.73:0/1292029388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5f360 0x560003d5d890 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fb86c00c6f0 tx=0x7fb86c095d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11984209ffce8897 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:51.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.903+0000 7fb8697fa700 1 -- 172.21.15.73:0/1292029388 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c004ad0 con 0x560003d5f360 2023-08-10T11:58:51.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.903+0000 7fb8697fa700 1 -- 172.21.15.73:0/1292029388 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb86c0999b0 con 0x560003d5f360 2023-08-10T11:58:51.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.903+0000 7fb8697fa700 1 -- 172.21.15.73:0/1292029388 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c098ea0 con 0x560003d5f360 2023-08-10T11:58:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.903+0000 7fb888716b80 1 -- 172.21.15.73:0/1292029388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5f360 msgr2=0x560003d5d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.903+0000 7fb888716b80 1 --2- 172.21.15.73:0/1292029388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5f360 0x560003d5d890 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fb86c00c6f0 tx=0x7fb86c095d80 comp rx=0 tx=0).stop 2023-08-10T11:58:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.903+0000 7fb888716b80 1 -- 172.21.15.73:0/1292029388 shutdown_connections 2023-08-10T11:58:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.903+0000 7fb888716b80 1 --2- 172.21.15.73:0/1292029388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5f360 0x560003d5d890 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.903+0000 7fb888716b80 1 --2- 172.21.15.73:0/1292029388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560003d59550 0x560003d69e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.903+0000 7fb888716b80 1 --2- 172.21.15.73:0/1292029388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560003d5ea40 0x560003d53c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.903+0000 7fb888716b80 1 -- 172.21.15.73:0/1292029388 >> 172.21.15.73:0/1292029388 conn(0x560003cb6c70 msgr2=0x560003d5c910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.903+0000 7fb888716b80 1 -- 172.21.15.73:0/1292029388 shutdown_connections 2023-08-10T11:58:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.903+0000 7fb888716b80 1 -- 172.21.15.73:0/1292029388 wait complete. 2023-08-10T11:58:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.904+0000 7fb888716b80 1 -- start start 2023-08-10T11:58:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.904+0000 7fb888716b80 1 Processor -- start 2023-08-10T11:58:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.904+0000 7fb888716b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560003d59550 0x560003dbab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:51.913 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.904+0000 7fb888716b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560003d5ea40 0x560003dbb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:51.913 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.904+0000 7fb888716b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5f360 0x560003dc5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:51.913 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.904+0000 7fb888716b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x560003dbb810 con 0x560003d5f360 2023-08-10T11:58:51.913 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.904+0000 7fb888716b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x560003dbb980 con 0x560003d59550 2023-08-10T11:58:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.904+0000 7fb888716b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560003dc60f0 con 0x560003d5ea40 2023-08-10T11:58:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.904+0000 7fb888716b80 10 client.0 _ll_register_callbacks cb 0x560003c47620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:58:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.904+0000 7fb87ab1a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5f360 0x560003dc5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.904+0000 7fb87a319700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560003d59550 0x560003dbab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.904+0000 7fb87a319700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560003d59550 0x560003dbab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:50074/0 (socket says 172.21.15.73:50074) 2023-08-10T11:58:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.904+0000 7fb87ab1a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5f360 0x560003dc5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35428/0 (socket says 172.21.15.73:35428) 2023-08-10T11:58:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.904+0000 7fb87a319700 1 -- 172.21.15.73:0/2587167391 learned_addr learned my addr 172.21.15.73:0/2587167391 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.904+0000 7fb879b18700 1 --2- 172.21.15.73:0/2587167391 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560003d5ea40 0x560003dbb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.904+0000 7fb87ab1a700 1 -- 172.21.15.73:0/2587167391 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560003d5ea40 msgr2=0x560003dbb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.904+0000 7fb87ab1a700 1 --2- 172.21.15.73:0/2587167391 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560003d5ea40 0x560003dbb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.904+0000 7fb87ab1a700 1 -- 172.21.15.73:0/2587167391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560003d59550 msgr2=0x560003dbab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.904+0000 7fb87ab1a700 1 --2- 172.21.15.73:0/2587167391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560003d59550 0x560003dbab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.904+0000 7fb87ab1a700 1 -- 172.21.15.73:0/2587167391 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560003ad7d80 con 0x560003d5f360 2023-08-10T11:58:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.904+0000 7fb87ab1a700 1 --2- 172.21.15.73:0/2587167391 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5f360 0x560003dc5b80 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fb86c00ef90 tx=0x7fb86c0a1b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ba2d0c4ce02c1e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:51.916 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.904+0000 7fb85dffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:58:51.916 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.905+0000 7fb85dffb700 1 -- 172.21.15.73:0/2587167391 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c07c070 con 0x560003d5f360 2023-08-10T11:58:51.917 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.905+0000 7fb85dffb700 1 -- 172.21.15.73:0/2587167391 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb86c004ad0 con 0x560003d5f360 2023-08-10T11:58:51.917 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.905+0000 7fb888716b80 1 -- 172.21.15.73:0/2587167391 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb864021070 con 0x560003d5f360 2023-08-10T11:58:51.917 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.905+0000 7fb85dffb700 1 -- 172.21.15.73:0/2587167391 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb86c0990b0 con 0x560003d5f360 2023-08-10T11:58:51.917 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.905+0000 7fb888716b80 10 client.16491 fetch_fsmap learned FSMap version 42 2023-08-10T11:58:51.917 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.905+0000 7fb888716b80 1 -- 172.21.15.73:0/2587167391 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x560003afe1f0 con 0x560003d5f360 2023-08-10T11:58:51.917 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.905+0000 7fb85dffb700 1 -- 172.21.15.73:0/2587167391 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb864021070 con 0x560003d5f360 2023-08-10T11:58:51.917 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.905+0000 7fb85dffb700 1 -- 172.21.15.73:0/2587167391 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 42) v1 ==== 6969+0+0 (secure 0 0 0) 0x7fb86c07f030 con 0x560003d5f360 2023-08-10T11:58:51.918 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.905+0000 7fb888716b80 10 client.16491 fetch_fsmap finished waiting for FSMap version 42 2023-08-10T11:58:51.918 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.905+0000 7fb888716b80 10 client.16491 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:58:51.918 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.905+0000 7fb888716b80 20 client.16491 populate_metadata read hostname 'smithi073' 2023-08-10T11:58:51.918 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.905+0000 7fb888716b80 1 --2- 172.21.15.73:0/2587167391 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x560003dc73f0 0x560003dc97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:51.918 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.905+0000 7fb888716b80 4 client.16491 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:58:51.918 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.905+0000 7fb888716b80 1 -- 172.21.15.73:0/2587167391 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560003ca3720 con 0x560003dc73f0 2023-08-10T11:58:51.918 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.905+0000 7fb87a319700 1 --2- 172.21.15.73:0/2587167391 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x560003dc73f0 0x560003dc97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:51.919 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.906+0000 7fb85dffb700 10 client.16491 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:58:51.919 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:51.906+0000 7fb87a319700 1 --2- 172.21.15.73:0/2587167391 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x560003dc73f0 0x560003dc97e0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd4812beb870499f server_cookie=e6997298ae02e841 in_seq=0 out_seq=0 2023-08-10T11:58:52.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:52 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:58:52.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:52 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:58:52.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:52 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:58:52.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:52 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:58:52.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:52 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:58:52.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:52 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:58:52.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:52 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:58:52.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:52 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:58:52.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:52 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:58:53.191 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:58:53.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.417+0000 7feab36bf700 1 -- 172.21.15.73:0/3515351195 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaac0ff5c0 msgr2=0x7feaac0ffa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:53.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.417+0000 7feab36bf700 1 --2- 172.21.15.73:0/3515351195 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaac0ff5c0 0x7feaac0ffa40 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0098f0 tx=0x7fea9c009c00 comp rx=0 tx=0).stop 2023-08-10T11:58:53.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.417+0000 7feab36bf700 1 -- 172.21.15.73:0/3515351195 shutdown_connections 2023-08-10T11:58:53.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.417+0000 7feab36bf700 1 --2- 172.21.15.73:0/3515351195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feaac105660 0x7feaac105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.417+0000 7feab36bf700 1 --2- 172.21.15.73:0/3515351195 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feaac0fff80 0x7feaac068a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.417+0000 7feab36bf700 1 --2- 172.21.15.73:0/3515351195 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaac0ff5c0 0x7feaac0ffa40 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.417+0000 7feab36bf700 1 -- 172.21.15.73:0/3515351195 >> 172.21.15.73:0/3515351195 conn(0x7feaac0fb0d0 msgr2=0x7feaac0fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:53.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.418+0000 7feab36bf700 1 -- 172.21.15.73:0/3515351195 shutdown_connections 2023-08-10T11:58:53.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.420+0000 7feab36bf700 1 -- 172.21.15.73:0/3515351195 wait complete. 2023-08-10T11:58:53.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.420+0000 7feab36bf700 1 Processor -- start 2023-08-10T11:58:53.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.421+0000 7feab36bf700 1 -- start start 2023-08-10T11:58:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.421+0000 7feab36bf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaac0ff5c0 0x7feaac101ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.421+0000 7feab36bf700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feaac0fff80 0x7feaac1023e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.421+0000 7feab36bf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feaac105660 0x7feaac102920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.421+0000 7feab36bf700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0712e0 con 0x7feaac0ff5c0 2023-08-10T11:58:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.421+0000 7feab36bf700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac071450 con 0x7feaac0fff80 2023-08-10T11:58:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.421+0000 7feab36bf700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac071610 con 0x7feaac105660 2023-08-10T11:58:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.421+0000 7feab145b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaac0ff5c0 0x7feaac101ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:53.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.421+0000 7feab145b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaac0ff5c0 0x7feaac101ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35438/0 (socket says 172.21.15.73:35438) 2023-08-10T11:58:53.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.421+0000 7feab145b700 1 -- 172.21.15.73:0/2179720678 learned_addr learned my addr 172.21.15.73:0/2179720678 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:53.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.421+0000 7feab145b700 1 -- 172.21.15.73:0/2179720678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feaac105660 msgr2=0x7feaac102920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:53.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.421+0000 7feab145b700 1 --2- 172.21.15.73:0/2179720678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feaac105660 0x7feaac102920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.421+0000 7feab145b700 1 -- 172.21.15.73:0/2179720678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feaac0fff80 msgr2=0x7feaac1023e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:53.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.421+0000 7feab145b700 1 --2- 172.21.15.73:0/2179720678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feaac0fff80 0x7feaac1023e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.421+0000 7feab145b700 1 -- 172.21.15.73:0/2179720678 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c009520 con 0x7feaac0ff5c0 2023-08-10T11:58:53.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.422+0000 7feab145b700 1 --2- 172.21.15.73:0/2179720678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaac0ff5c0 0x7feaac101ea0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7feaa800e9f0 tx=0x7feaa800edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:53.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.422+0000 7feaa27fc700 1 -- 172.21.15.73:0/2179720678 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa800cbd0 con 0x7feaac0ff5c0 2023-08-10T11:58:53.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.422+0000 7feaa27fc700 1 -- 172.21.15.73:0/2179720678 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feaa8009e90 con 0x7feaac0ff5c0 2023-08-10T11:58:53.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.422+0000 7feaa27fc700 1 -- 172.21.15.73:0/2179720678 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8003dc0 con 0x7feaac0ff5c0 2023-08-10T11:58:53.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.422+0000 7feab36bf700 1 -- 172.21.15.73:0/2179720678 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaac0718f0 con 0x7feaac0ff5c0 2023-08-10T11:58:53.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.422+0000 7feab36bf700 1 -- 172.21.15.73:0/2179720678 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaac071db0 con 0x7feaac0ff5c0 2023-08-10T11:58:53.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.426+0000 7feaa27fc700 1 -- 172.21.15.73:0/2179720678 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7feaa800cd30 con 0x7feaac0ff5c0 2023-08-10T11:58:53.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.427+0000 7feaa27fc700 1 --2- 172.21.15.73:0/2179720678 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fea980a13c0 0x7fea980a3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:53.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.427+0000 7feaa27fc700 1 -- 172.21.15.73:0/2179720678 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7feaa8014070 con 0x7feaac0ff5c0 2023-08-10T11:58:53.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.427+0000 7feabf858b80 1 Processor -- start 2023-08-10T11:58:53.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.428+0000 7feabf858b80 1 -- start start 2023-08-10T11:58:53.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.428+0000 7feabf858b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b5758ff50 0x558b57590330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:53.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.428+0000 7feabf858b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b57590870 0x558b5758a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:53.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.428+0000 7feabf858b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558b5758a800 0x558b5758ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:53.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.428+0000 7feabf858b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b57505dc0 con 0x558b57590870 2023-08-10T11:58:53.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.428+0000 7feabf858b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b574e2590 con 0x558b5758ff50 2023-08-10T11:58:53.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.428+0000 7feabf858b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b574dfeb0 con 0x558b5758a800 2023-08-10T11:58:53.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.428+0000 7feab0c5a700 1 --2- 172.21.15.73:0/2179720678 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fea980a13c0 0x7fea980a3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:53.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.429+0000 7feab0c5a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b57590870 0x558b5758a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:53.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.429+0000 7feab0c5a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b57590870 0x558b5758a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35450/0 (socket says 172.21.15.73:35450) 2023-08-10T11:58:53.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.429+0000 7feab0c5a700 1 -- 172.21.15.73:0/108608229 learned_addr learned my addr 172.21.15.73:0/108608229 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.429+0000 7feab0c5a700 1 --2- 172.21.15.73:0/2179720678 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fea980a13c0 0x7fea980a3880 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009810 tx=0x7fea9c010e60 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.429+0000 7feab0c5a700 1 -- 172.21.15.73:0/108608229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558b5758a800 msgr2=0x558b5758ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.429+0000 7feab0c5a700 1 --2- 172.21.15.73:0/108608229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558b5758a800 0x558b5758ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.429+0000 7feab0c5a700 1 -- 172.21.15.73:0/108608229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b5758ff50 msgr2=0x558b57590330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.429+0000 7feab0c5a700 1 --2- 172.21.15.73:0/108608229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b5758ff50 0x558b57590330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.429+0000 7feab0c5a700 1 -- 172.21.15.73:0/108608229 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b5735c630 con 0x558b57590870 2023-08-10T11:58:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.429+0000 7feab0c5a700 1 --2- 172.21.15.73:0/108608229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b57590870 0x558b5758a2c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0098f0 tx=0x7fea9c024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18d73588ce9aefbc server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.429+0000 7fea977fe700 1 -- 172.21.15.73:0/108608229 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c00b620 con 0x558b57590870 2023-08-10T11:58:53.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.430+0000 7fea977fe700 1 -- 172.21.15.73:0/108608229 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea9c005040 con 0x558b57590870 2023-08-10T11:58:53.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.430+0000 7fea977fe700 1 -- 172.21.15.73:0/108608229 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c0038e0 con 0x558b57590870 2023-08-10T11:58:53.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.430+0000 7feabf858b80 1 -- 172.21.15.73:0/108608229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b57590870 msgr2=0x558b5758a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:53.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.430+0000 7feabf858b80 1 --2- 172.21.15.73:0/108608229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b57590870 0x558b5758a2c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0098f0 tx=0x7fea9c024000 comp rx=0 tx=0).stop 2023-08-10T11:58:53.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.430+0000 7feabf858b80 1 -- 172.21.15.73:0/108608229 shutdown_connections 2023-08-10T11:58:53.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.430+0000 7feabf858b80 1 --2- 172.21.15.73:0/108608229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b5758ff50 0x558b57590330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.430+0000 7feabf858b80 1 --2- 172.21.15.73:0/108608229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558b5758a800 0x558b5758ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.430+0000 7feabf858b80 1 --2- 172.21.15.73:0/108608229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b57590870 0x558b5758a2c0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.430+0000 7feabf858b80 1 -- 172.21.15.73:0/108608229 >> 172.21.15.73:0/108608229 conn(0x558b574e7cd0 msgr2=0x558b575854d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.431+0000 7feabf858b80 1 -- 172.21.15.73:0/108608229 shutdown_connections 2023-08-10T11:58:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.431+0000 7feabf858b80 1 -- 172.21.15.73:0/108608229 wait complete. 2023-08-10T11:58:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.431+0000 7feabf858b80 1 -- start start 2023-08-10T11:58:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.431+0000 7feabf858b80 1 Processor -- start 2023-08-10T11:58:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.432+0000 7feabf858b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558b5758a800 0x558b57593c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.432+0000 7feabf858b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b5758ff50 0x558b57594140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.432+0000 7feabf858b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b57590870 0x558b57594680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.432+0000 7feabf858b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b574db7a0 con 0x558b57590870 2023-08-10T11:58:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.432+0000 7feabf858b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b5747aac0 con 0x558b5758ff50 2023-08-10T11:58:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.432+0000 7feabf858b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b5747a7c0 con 0x558b5758a800 2023-08-10T11:58:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.432+0000 7feabf858b80 10 client.0 _ll_register_callbacks cb 0x558b57478680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:58:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.432+0000 7feab1c5c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b57590870 0x558b57594680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:53.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.432+0000 7feab1c5c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b57590870 0x558b57594680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35454/0 (socket says 172.21.15.73:35454) 2023-08-10T11:58:53.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.432+0000 7feab1c5c700 1 -- 172.21.15.73:0/2241345368 learned_addr learned my addr 172.21.15.73:0/2241345368 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:53.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.432+0000 7feab1c5c700 1 -- 172.21.15.73:0/2241345368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558b5758a800 msgr2=0x558b57593c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:53.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.432+0000 7feab1c5c700 1 --2- 172.21.15.73:0/2241345368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558b5758a800 0x558b57593c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.432+0000 7feab1c5c700 1 -- 172.21.15.73:0/2241345368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b5758ff50 msgr2=0x558b57594140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:53.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.432+0000 7feab1c5c700 1 --2- 172.21.15.73:0/2241345368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b5758ff50 0x558b57594140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.432+0000 7feab1c5c700 1 -- 172.21.15.73:0/2241345368 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9c01f040 con 0x558b57590870 2023-08-10T11:58:53.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.433+0000 7feab1c5c700 1 --2- 172.21.15.73:0/2241345368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b57590870 0x558b57594680 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7feaa4009fd0 tx=0x7feaa4007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838031ec1c9c84a6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:53.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.433+0000 7fea94ff9700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:58:53.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.433+0000 7fea94ff9700 1 -- 172.21.15.73:0/2241345368 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa400d950 con 0x558b57590870 2023-08-10T11:58:53.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.433+0000 7fea94ff9700 1 -- 172.21.15.73:0/2241345368 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7feaa400dab0 con 0x558b57590870 2023-08-10T11:58:53.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.433+0000 7feabf858b80 1 -- 172.21.15.73:0/2241345368 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558b5757d470 con 0x558b57590870 2023-08-10T11:58:53.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.433+0000 7fea94ff9700 1 -- 172.21.15.73:0/2241345368 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7feaa4007e90 con 0x558b57590870 2023-08-10T11:58:53.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.433+0000 7feabf858b80 10 client.16503 fetch_fsmap learned FSMap version 42 2023-08-10T11:58:53.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.433+0000 7feabf858b80 1 -- 172.21.15.73:0/2241345368 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x558b57308de0 con 0x558b57590870 2023-08-10T11:58:53.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.433+0000 7fea94ff9700 1 -- 172.21.15.73:0/2241345368 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558b5757d470 con 0x558b57590870 2023-08-10T11:58:53.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.433+0000 7fea94ff9700 1 -- 172.21.15.73:0/2241345368 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 42) v1 ==== 6969+0+0 (secure 0 0 0) 0x7feaa4012070 con 0x558b57590870 2023-08-10T11:58:53.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.434+0000 7feabf858b80 10 client.16503 fetch_fsmap finished waiting for FSMap version 42 2023-08-10T11:58:53.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.434+0000 7feabf858b80 10 client.16503 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:58:53.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.434+0000 7feabf858b80 20 client.16503 populate_metadata read hostname 'smithi073' 2023-08-10T11:58:53.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.434+0000 7feabf858b80 1 --2- 172.21.15.73:0/2241345368 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x558b575b5410 0x558b575b7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:53.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.434+0000 7feabf858b80 4 client.16503 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:58:53.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.434+0000 7feabf858b80 1 -- 172.21.15.73:0/2241345368 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558b575599d0 con 0x558b575b5410 2023-08-10T11:58:53.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.443+0000 7feab145b700 1 --2- 172.21.15.73:0/2241345368 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x558b575b5410 0x558b575b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:53.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.447+0000 7fea94ff9700 10 client.16503 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:58:53.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.447+0000 7feab145b700 1 --2- 172.21.15.73:0/2241345368 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x558b575b5410 0x558b575b7830 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4642361bb0d5051d server_cookie=804033636cdcd2b6 in_seq=0 out_seq=0 2023-08-10T11:58:53.513 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:53 smithi073 ceph-mon[128869]: pgmap v190: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 9.6 MiB/s wr, 579 op/s 2023-08-10T11:58:53.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:53.905+0000 7fb85dffb700 1 -- 172.21.15.73:0/2587167391 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560003ca3720 con 0x560003dc73f0 2023-08-10T11:58:53.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:53.905+0000 7fb85dffb700 10 client.16491 handle_command_reply: tid=0 2023-08-10T11:58:53.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:53.905+0000 7fb888716b80 1 client.16491 shutdown 2023-08-10T11:58:53.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.905+0000 7fea94ff9700 1 -- 172.21.15.73:0/2241345368 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x558b575599d0 con 0x558b575b5410 2023-08-10T11:58:53.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.905+0000 7fea94ff9700 10 client.16503 handle_command_reply: tid=0 2023-08-10T11:58:53.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.905+0000 7feabf858b80 1 client.16503 shutdown 2023-08-10T11:58:53.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.905+0000 7feabf858b80 1 -- 172.21.15.73:0/2241345368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b57590870 msgr2=0x558b57594680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:53.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.905+0000 7feabf858b80 1 --2- 172.21.15.73:0/2241345368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b57590870 0x558b57594680 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7feaa4009fd0 tx=0x7feaa4007c50 comp rx=0 tx=0).stop 2023-08-10T11:58:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:53.905+0000 7fb888716b80 1 -- 172.21.15.73:0/2587167391 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5f360 msgr2=0x560003dc5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:53.909 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:53.905+0000 7fb888716b80 1 --2- 172.21.15.73:0/2587167391 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5f360 0x560003dc5b80 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fb86c00ef90 tx=0x7fb86c0a1b10 comp rx=0 tx=0).stop 2023-08-10T11:58:53.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.905+0000 7feabf858b80 1 -- 172.21.15.73:0/2241345368 shutdown_connections 2023-08-10T11:58:53.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.905+0000 7feabf858b80 1 --2- 172.21.15.73:0/2241345368 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x558b575b5410 0x558b575b7830 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.905+0000 7feabf858b80 1 --2- 172.21.15.73:0/2241345368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b57590870 0x558b57594680 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.905+0000 7feabf858b80 1 --2- 172.21.15.73:0/2241345368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558b5758a800 0x558b57593c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.905+0000 7feabf858b80 1 --2- 172.21.15.73:0/2241345368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b5758ff50 0x558b57594140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.905+0000 7feabf858b80 1 -- 172.21.15.73:0/2241345368 >> 172.21.15.73:0/2241345368 conn(0x558b574e7cd0 msgr2=0x558b575849b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:53.905+0000 7fb888716b80 1 -- 172.21.15.73:0/2587167391 shutdown_connections 2023-08-10T11:58:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:53.905+0000 7fb888716b80 1 --2- 172.21.15.73:0/2587167391 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x560003dc73f0 0x560003dc97e0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:53.905+0000 7fb888716b80 1 --2- 172.21.15.73:0/2587167391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560003d59550 0x560003dbab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.905+0000 7fea94ff9700 0 client.16503 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:58:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:53.905+0000 7fb888716b80 1 --2- 172.21.15.73:0/2587167391 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560003d5f360 0x560003dc5b80 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:53.905+0000 7fb888716b80 1 --2- 172.21.15.73:0/2587167391 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560003d5ea40 0x560003dbb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:53.905+0000 7fb888716b80 1 -- 172.21.15.73:0/2587167391 >> 172.21.15.73:0/2587167391 conn(0x560003cb6c70 msgr2=0x560003d5d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:53.905+0000 7fb85dffb700 0 client.16491 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:58:53.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.905+0000 7feabf858b80 1 -- 172.21.15.73:0/2241345368 shutdown_connections 2023-08-10T11:58:53.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.905+0000 7feabf858b80 1 -- 172.21.15.73:0/2241345368 wait complete. 2023-08-10T11:58:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:53.906+0000 7fb888716b80 1 -- 172.21.15.73:0/2587167391 shutdown_connections 2023-08-10T11:58:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:53.906+0000 7fb888716b80 1 -- 172.21.15.73:0/2587167391 wait complete. 2023-08-10T11:58:53.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.906+0000 7feabf858b80 20 client.16503 trim_cache size 0 max 16384 2023-08-10T11:58:53.916 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:53.906+0000 7fb888716b80 20 client.16491 trim_cache size 0 max 16384 2023-08-10T11:58:53.916 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:58:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:58:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:58:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:58:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:53.906+0000 7fb87c57d700 1 -- 172.21.15.73:0/4086696802 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb8600a12c0 msgr2=0x7fb8600a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:53.906+0000 7fb87c57d700 1 --2- 172.21.15.73:0/4086696802 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb8600a12c0 0x7fb8600a3780 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb864005950 tx=0x7fb864009260 comp rx=0 tx=0).stop 2023-08-10T11:58:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:53.906+0000 7fb87c57d700 1 -- 172.21.15.73:0/4086696802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb874105690 msgr2=0x7fb8741a2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:53.906+0000 7fb87c57d700 1 --2- 172.21.15.73:0/4086696802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb874105690 0x7fb8741a2630 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fb86c00efc0 tx=0x7fb86c00c3a0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:53.906+0000 7fb87c57d700 1 -- 172.21.15.73:0/4086696802 shutdown_connections 2023-08-10T11:58:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:53.906+0000 7fb87c57d700 1 --2- 172.21.15.73:0/4086696802 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb8600a12c0 0x7fb8600a3780 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:53.906+0000 7fb87c57d700 1 --2- 172.21.15.73:0/4086696802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb874105690 0x7fb8741a2630 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:53.906+0000 7fb87c57d700 1 --2- 172.21.15.73:0/4086696802 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8740ff800 0x7fb874197790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:53.906+0000 7fb87c57d700 1 --2- 172.21.15.73:0/4086696802 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8741001c0 0x7fb874197cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:53.906+0000 7fb87c57d700 1 -- 172.21.15.73:0/4086696802 >> 172.21.15.73:0/4086696802 conn(0x7fb874077540 msgr2=0x7fb874103320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:53.907+0000 7fb87c57d700 1 -- 172.21.15.73:0/4086696802 shutdown_connections 2023-08-10T11:58:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:58:53.907+0000 7fb87c57d700 1 -- 172.21.15.73:0/4086696802 wait complete. 2023-08-10T11:58:53.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.923+0000 7feabf858b80 1 Processor -- start 2023-08-10T11:58:53.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.923+0000 7feabf858b80 1 -- start start 2023-08-10T11:58:53.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.924+0000 7feabf858b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b5758a800 0x558b57585130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:53.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.924+0000 7feabf858b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b5758ff50 0x558b57585670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:53.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.924+0000 7feabf858b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558b57590870 0x558b5758ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:53.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.924+0000 7feabf858b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b5735e920 con 0x558b5758a800 2023-08-10T11:58:53.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.924+0000 7feabf858b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b5757cfb0 con 0x558b5758ff50 2023-08-10T11:58:53.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.924+0000 7feabf858b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b57581f80 con 0x558b57590870 2023-08-10T11:58:53.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.924+0000 7feab145b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b5758a800 0x558b57585130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:53.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.924+0000 7feab145b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b5758a800 0x558b57585130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35460/0 (socket says 172.21.15.73:35460) 2023-08-10T11:58:53.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.924+0000 7feab145b700 1 -- 172.21.15.73:0/3444360807 learned_addr learned my addr 172.21.15.73:0/3444360807 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:53.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.924+0000 7feab0c5a700 1 --2- 172.21.15.73:0/3444360807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b5758ff50 0x558b57585670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:53.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.924+0000 7feab1c5c700 1 --2- 172.21.15.73:0/3444360807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558b57590870 0x558b5758ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:53.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.924+0000 7feab145b700 1 -- 172.21.15.73:0/3444360807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558b57590870 msgr2=0x558b5758ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:53.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.924+0000 7feab145b700 1 --2- 172.21.15.73:0/3444360807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558b57590870 0x558b5758ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.924+0000 7feab145b700 1 -- 172.21.15.73:0/3444360807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b5758ff50 msgr2=0x558b57585670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:53.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.924+0000 7feab145b700 1 --2- 172.21.15.73:0/3444360807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b5758ff50 0x558b57585670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.924+0000 7feab145b700 1 -- 172.21.15.73:0/3444360807 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b575816a0 con 0x558b5758a800 2023-08-10T11:58:53.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.924+0000 7feab145b700 1 --2- 172.21.15.73:0/3444360807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b5758a800 0x558b57585130 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7feaa8005910 tx=0x7feaa809a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e2a510b9fcc68f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:53.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.924+0000 7fea97fff700 1 -- 172.21.15.73:0/3444360807 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8098460 con 0x558b5758a800 2023-08-10T11:58:53.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.925+0000 7fea97fff700 1 -- 172.21.15.73:0/3444360807 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feaa80cae90 con 0x558b5758a800 2023-08-10T11:58:53.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.925+0000 7fea97fff700 1 -- 172.21.15.73:0/3444360807 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8099810 con 0x558b5758a800 2023-08-10T11:58:53.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.925+0000 7feabf858b80 1 -- 172.21.15.73:0/3444360807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b5758a800 msgr2=0x558b57585130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:53.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.925+0000 7feabf858b80 1 --2- 172.21.15.73:0/3444360807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b5758a800 0x558b57585130 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7feaa8005910 tx=0x7feaa809a1e0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.925+0000 7feabf858b80 1 -- 172.21.15.73:0/3444360807 shutdown_connections 2023-08-10T11:58:53.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.925+0000 7feabf858b80 1 --2- 172.21.15.73:0/3444360807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558b57590870 0x558b5758ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.925+0000 7feabf858b80 1 --2- 172.21.15.73:0/3444360807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b5758a800 0x558b57585130 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.925+0000 7feabf858b80 1 --2- 172.21.15.73:0/3444360807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b5758ff50 0x558b57585670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.925+0000 7feabf858b80 1 -- 172.21.15.73:0/3444360807 >> 172.21.15.73:0/3444360807 conn(0x558b574e7cd0 msgr2=0x558b5758dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:53.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.925+0000 7feabf858b80 1 -- 172.21.15.73:0/3444360807 shutdown_connections 2023-08-10T11:58:53.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.925+0000 7feabf858b80 1 -- 172.21.15.73:0/3444360807 wait complete. 2023-08-10T11:58:53.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.926+0000 7feabf858b80 1 -- start start 2023-08-10T11:58:53.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.926+0000 7feabf858b80 1 Processor -- start 2023-08-10T11:58:53.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.926+0000 7feabf858b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558b5758a800 0x558b575fd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:53.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.926+0000 7feabf858b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b5758ff50 0x558b575fd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:53.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.926+0000 7feabf858b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b57590870 0x558b576080d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:53.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.926+0000 7feabf858b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b57608610 con 0x558b5758ff50 2023-08-10T11:58:53.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.926+0000 7feabf858b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b57608750 con 0x558b57590870 2023-08-10T11:58:53.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.926+0000 7feabf858b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b57608890 con 0x558b5758a800 2023-08-10T11:58:53.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.926+0000 7feabf858b80 10 client.0 _ll_register_callbacks cb 0x558b57478680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:58:53.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.926+0000 7feab0c5a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b5758ff50 0x558b575fd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:53.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.926+0000 7feab0c5a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b5758ff50 0x558b575fd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35468/0 (socket says 172.21.15.73:35468) 2023-08-10T11:58:53.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.926+0000 7feab0c5a700 1 -- 172.21.15.73:0/1660276380 learned_addr learned my addr 172.21.15.73:0/1660276380 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:58:53.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.926+0000 7feab1c5c700 1 --2- 172.21.15.73:0/1660276380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b57590870 0x558b576080d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:53.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.927+0000 7feab145b700 1 --2- 172.21.15.73:0/1660276380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558b5758a800 0x558b575fd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:53.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.927+0000 7feab0c5a700 1 -- 172.21.15.73:0/1660276380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558b5758a800 msgr2=0x558b575fd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:53.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.927+0000 7feab0c5a700 1 --2- 172.21.15.73:0/1660276380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558b5758a800 0x558b575fd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.927+0000 7feab0c5a700 1 -- 172.21.15.73:0/1660276380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b57590870 msgr2=0x558b576080d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:58:53.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.927+0000 7feab0c5a700 1 --2- 172.21.15.73:0/1660276380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b57590870 0x558b576080d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.927+0000 7feab0c5a700 1 -- 172.21.15.73:0/1660276380 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaac071db0 con 0x558b5758ff50 2023-08-10T11:58:53.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.927+0000 7feab1c5c700 1 --2- 172.21.15.73:0/1660276380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b57590870 0x558b576080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:58:53.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.927+0000 7feab0c5a700 1 --2- 172.21.15.73:0/1660276380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b5758ff50 0x558b575fd780 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0098f0 tx=0x7fea9c009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=968b8b2bec9024af server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:58:53.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.927+0000 7fea94ff9700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:58:53.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.927+0000 7fea94ff9700 1 -- 172.21.15.73:0/1660276380 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c00bc00 con 0x558b5758ff50 2023-08-10T11:58:53.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.927+0000 7feabf858b80 1 -- 172.21.15.73:0/1660276380 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fea9c005040 con 0x558b5758ff50 2023-08-10T11:58:53.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.927+0000 7fea94ff9700 1 -- 172.21.15.73:0/1660276380 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fea9c035040 con 0x558b5758ff50 2023-08-10T11:58:53.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.927+0000 7fea94ff9700 1 -- 172.21.15.73:0/1660276380 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea9c0051b0 con 0x558b5758ff50 2023-08-10T11:58:53.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.927+0000 7feabf858b80 10 client.16509 fetch_fsmap learned FSMap version 42 2023-08-10T11:58:53.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.927+0000 7feabf858b80 1 -- 172.21.15.73:0/1660276380 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x558b572f1c60 con 0x558b5758ff50 2023-08-10T11:58:53.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.927+0000 7fea94ff9700 1 -- 172.21.15.73:0/1660276380 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea9c005040 con 0x558b5758ff50 2023-08-10T11:58:53.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.928+0000 7fea94ff9700 1 -- 172.21.15.73:0/1660276380 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 42) v1 ==== 6969+0+0 (secure 0 0 0) 0x7fea9c003cc0 con 0x558b5758ff50 2023-08-10T11:58:53.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.928+0000 7feabf858b80 10 client.16509 fetch_fsmap finished waiting for FSMap version 42 2023-08-10T11:58:53.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.928+0000 7feabf858b80 10 client.16509 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:58:53.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.928+0000 7feabf858b80 20 client.16509 populate_metadata read hostname 'smithi073' 2023-08-10T11:58:53.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.928+0000 7feabf858b80 1 --2- 172.21.15.73:0/1660276380 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x558b57609b40 0x558b5760bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:58:53.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.928+0000 7feabf858b80 4 client.16509 mds_command: new command op to 24503 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:58:53.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.928+0000 7feabf858b80 1 -- 172.21.15.73:0/1660276380 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558b574d4780 con 0x558b57609b40 2023-08-10T11:58:53.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.928+0000 7feab145b700 1 --2- 172.21.15.73:0/1660276380 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x558b57609b40 0x558b5760bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:58:53.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.929+0000 7fea94ff9700 10 client.16509 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:58:53.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.929+0000 7feab145b700 1 --2- 172.21.15.73:0/1660276380 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x558b57609b40 0x558b5760bf30 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce7336eea26d50b2 server_cookie=ee444ca552fa9ee1 in_seq=0 out_seq=0 2023-08-10T11:58:53.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.929+0000 7fea94ff9700 1 -- 172.21.15.73:0/1660276380 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x558b574d4780 con 0x558b57609b40 2023-08-10T11:58:53.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.929+0000 7fea94ff9700 10 client.16509 handle_command_reply: tid=0 2023-08-10T11:58:53.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.929+0000 7feabf858b80 1 client.16509 shutdown 2023-08-10T11:58:53.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.929+0000 7feabf858b80 1 -- 172.21.15.73:0/1660276380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b5758ff50 msgr2=0x558b575fd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:53.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.929+0000 7feabf858b80 1 --2- 172.21.15.73:0/1660276380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b5758ff50 0x558b575fd780 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0098f0 tx=0x7fea9c009fd0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.929+0000 7feabf858b80 1 -- 172.21.15.73:0/1660276380 shutdown_connections 2023-08-10T11:58:53.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.929+0000 7feabf858b80 1 --2- 172.21.15.73:0/1660276380 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x558b57609b40 0x558b5760bf30 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.929+0000 7feabf858b80 1 --2- 172.21.15.73:0/1660276380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558b57590870 0x558b576080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.929+0000 7feabf858b80 1 --2- 172.21.15.73:0/1660276380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558b5758a800 0x558b575fd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.929+0000 7fea94ff9700 0 client.16509 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:58:53.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.929+0000 7feabf858b80 1 --2- 172.21.15.73:0/1660276380 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558b5758ff50 0x558b575fd780 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.929+0000 7feabf858b80 1 -- 172.21.15.73:0/1660276380 >> 172.21.15.73:0/1660276380 conn(0x558b574e7cd0 msgr2=0x558b5758ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:53.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.930+0000 7feabf858b80 1 -- 172.21.15.73:0/1660276380 shutdown_connections 2023-08-10T11:58:53.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.930+0000 7feabf858b80 1 -- 172.21.15.73:0/1660276380 wait complete. 2023-08-10T11:58:53.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.930+0000 7feabf858b80 20 client.16509 trim_cache size 0 max 16384 2023-08-10T11:58:53.941 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:58:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:58:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": { 2023-08-10T11:58:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d": { 2023-08-10T11:58:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2023-08-10T11:58:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "tag": "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d", 2023-08-10T11:58:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "options": "recursive,force" 2023-08-10T11:58:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:58:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:58:53.942 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:58:53.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.930+0000 7feab36bf700 1 -- 172.21.15.73:0/2179720678 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fea980a13c0 msgr2=0x7fea980a3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:53.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.930+0000 7feab36bf700 1 --2- 172.21.15.73:0/2179720678 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fea980a13c0 0x7fea980a3880 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009810 tx=0x7fea9c010e60 comp rx=0 tx=0).stop 2023-08-10T11:58:53.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.930+0000 7feab36bf700 1 -- 172.21.15.73:0/2179720678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaac0ff5c0 msgr2=0x7feaac101ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:58:53.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.930+0000 7feab36bf700 1 --2- 172.21.15.73:0/2179720678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaac0ff5c0 0x7feaac101ea0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7feaa800e9f0 tx=0x7feaa800edb0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.930+0000 7feab36bf700 1 -- 172.21.15.73:0/2179720678 shutdown_connections 2023-08-10T11:58:53.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.930+0000 7feab36bf700 1 --2- 172.21.15.73:0/2179720678 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fea980a13c0 0x7fea980a3880 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.930+0000 7feab36bf700 1 --2- 172.21.15.73:0/2179720678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feaac105660 0x7feaac102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.930+0000 7feab36bf700 1 --2- 172.21.15.73:0/2179720678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaac0ff5c0 0x7feaac101ea0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.930+0000 7feab36bf700 1 --2- 172.21.15.73:0/2179720678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feaac0fff80 0x7feaac1023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:58:53.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.930+0000 7feab36bf700 1 -- 172.21.15.73:0/2179720678 >> 172.21.15.73:0/2179720678 conn(0x7feaac0fb0d0 msgr2=0x7feaac10ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:58:53.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.930+0000 7feab36bf700 1 -- 172.21.15.73:0/2179720678 shutdown_connections 2023-08-10T11:58:53.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:58:53.930+0000 7feab36bf700 1 -- 172.21.15.73:0/2179720678 wait complete. 2023-08-10T11:58:53.945 INFO:tasks.cephfs.filesystem:scrub status for tag:9d39b3fa-9b62-42b4-b1a5-738cb3118a5d - {'path': '/', 'tag': '9d39b3fa-9b62-42b4-b1a5-738cb3118a5d', 'options': 'recursive,force'} 2023-08-10T11:58:53.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:53 smithi152 ceph-mon[130220]: pgmap v190: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 9.6 MiB/s wr, 579 op/s 2023-08-10T11:58:54.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:53 smithi156 ceph-mon[130574]: pgmap v190: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 9.6 MiB/s wr, 579 op/s 2023-08-10T11:58:55.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:54 smithi152 ceph-mon[130220]: pgmap v191: 97 pgs: 97 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 14 MiB/s wr, 845 op/s 2023-08-10T11:58:55.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:54 smithi156 ceph-mon[130574]: pgmap v191: 97 pgs: 97 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 14 MiB/s wr, 845 op/s 2023-08-10T11:58:55.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:54 smithi073 ceph-mon[128869]: pgmap v191: 97 pgs: 97 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 14 MiB/s wr, 845 op/s 2023-08-10T11:58:57.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:57 smithi073 ceph-mon[128869]: pgmap v192: 97 pgs: 97 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 18 MiB/s wr, 1.06k op/s 2023-08-10T11:58:57.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:57 smithi152 ceph-mon[130220]: pgmap v192: 97 pgs: 97 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 18 MiB/s wr, 1.06k op/s 2023-08-10T11:58:57.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:57 smithi156 ceph-mon[130574]: pgmap v192: 97 pgs: 97 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 18 MiB/s wr, 1.06k op/s 2023-08-10T11:58:59.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:59 smithi073 ceph-mon[128869]: pgmap v193: 97 pgs: 97 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 17 MiB/s wr, 1.10k op/s 2023-08-10T11:58:59.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:58:59 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T11:58:59.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:59 smithi152 ceph-mon[130220]: pgmap v193: 97 pgs: 97 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 17 MiB/s wr, 1.10k op/s 2023-08-10T11:58:59.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:58:59 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T11:58:59.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:59 smithi156 ceph-mon[130574]: pgmap v193: 97 pgs: 97 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 17 MiB/s wr, 1.10k op/s 2023-08-10T11:58:59.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:58:59 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T11:59:01.277 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:01 smithi073 ceph-mon[128869]: pgmap v194: 97 pgs: 97 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 18 MiB/s wr, 1.15k op/s 2023-08-10T11:59:01.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:01 smithi152 ceph-mon[130220]: pgmap v194: 97 pgs: 97 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 18 MiB/s wr, 1.15k op/s 2023-08-10T11:59:01.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:01 smithi156 ceph-mon[130574]: pgmap v194: 97 pgs: 97 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 18 MiB/s wr, 1.15k op/s 2023-08-10T11:59:03.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:03 smithi152 ceph-mon[130220]: pgmap v195: 97 pgs: 97 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 12 MiB/s wr, 834 op/s 2023-08-10T11:59:03.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:03 smithi156 ceph-mon[130574]: pgmap v195: 97 pgs: 97 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 12 MiB/s wr, 834 op/s 2023-08-10T11:59:03.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:03 smithi073 ceph-mon[128869]: pgmap v195: 97 pgs: 97 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 12 MiB/s wr, 834 op/s 2023-08-10T11:59:05.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:04 smithi152 ceph-mon[130220]: pgmap v196: 97 pgs: 97 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 10 MiB/s wr, 770 op/s 2023-08-10T11:59:05.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:04 smithi156 ceph-mon[130574]: pgmap v196: 97 pgs: 97 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 10 MiB/s wr, 770 op/s 2023-08-10T11:59:05.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:04 smithi073 ceph-mon[128869]: pgmap v196: 97 pgs: 97 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 10 MiB/s wr, 770 op/s 2023-08-10T11:59:06.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:05 smithi152 ceph-mon[130220]: osdmap e87: 12 total, 12 up, 12 in 2023-08-10T11:59:06.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:05 smithi156 ceph-mon[130574]: osdmap e87: 12 total, 12 up, 12 in 2023-08-10T11:59:06.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:05 smithi073 ceph-mon[128869]: osdmap e87: 12 total, 12 up, 12 in 2023-08-10T11:59:07.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.080+0000 7fb3d2db4700 1 -- 172.21.15.73:0/2872643597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3cc106740 msgr2=0x7fb3cc106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:07.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.080+0000 7fb3d2db4700 1 --2- 172.21.15.73:0/2872643597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3cc106740 0x7fb3cc106b20 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc009990 tx=0x7fb3bc009ca0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.081+0000 7fb3d2db4700 1 -- 172.21.15.73:0/2872643597 shutdown_connections 2023-08-10T11:59:07.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.081+0000 7fb3d2db4700 1 --2- 172.21.15.73:0/2872643597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3cc1010f0 0x7fb3cc10d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.081+0000 7fb3d2db4700 1 --2- 172.21.15.73:0/2872643597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3cc106740 0x7fb3cc106b20 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.081+0000 7fb3d2db4700 1 --2- 172.21.15.73:0/2872643597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3cc100730 0x7fb3cc100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.081+0000 7fb3d2db4700 1 -- 172.21.15.73:0/2872643597 >> 172.21.15.73:0/2872643597 conn(0x7fb3cc0763b0 msgr2=0x7fb3cc0fea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:07.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.081+0000 7fb3d2db4700 1 -- 172.21.15.73:0/2872643597 shutdown_connections 2023-08-10T11:59:07.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.081+0000 7fb3d2db4700 1 -- 172.21.15.73:0/2872643597 wait complete. 2023-08-10T11:59:07.084 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.081+0000 7fb3d2db4700 1 Processor -- start 2023-08-10T11:59:07.084 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.082+0000 7fb3d2db4700 1 -- start start 2023-08-10T11:59:07.084 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.082+0000 7fb3d2db4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3cc100730 0x7fb3cc198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:07.084 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.082+0000 7fb3d2db4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3cc1010f0 0x7fb3cc198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:07.084 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.082+0000 7fb3d2db4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3cc106740 0x7fb3cc19c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:07.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.082+0000 7fb3d2db4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc19cb70 con 0x7fb3cc1010f0 2023-08-10T11:59:07.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.082+0000 7fb3d2db4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc19cce0 con 0x7fb3cc100730 2023-08-10T11:59:07.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.082+0000 7fb3d2db4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc19cea0 con 0x7fb3cc106740 2023-08-10T11:59:07.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.082+0000 7fb3cbfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3cc1010f0 0x7fb3cc198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:07.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.082+0000 7fb3cbfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3cc1010f0 0x7fb3cc198fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35482/0 (socket says 172.21.15.73:35482) 2023-08-10T11:59:07.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.082+0000 7fb3cbfff700 1 -- 172.21.15.73:0/2997604188 learned_addr learned my addr 172.21.15.73:0/2997604188 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:07.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.082+0000 7fb3cbfff700 1 -- 172.21.15.73:0/2997604188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3cc106740 msgr2=0x7fb3cc19c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:07.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.082+0000 7fb3cbfff700 1 --2- 172.21.15.73:0/2997604188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3cc106740 0x7fb3cc19c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.082+0000 7fb3cbfff700 1 -- 172.21.15.73:0/2997604188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3cc100730 msgr2=0x7fb3cc198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:07.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.082+0000 7fb3cbfff700 1 --2- 172.21.15.73:0/2997604188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3cc100730 0x7fb3cc198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.082+0000 7fb3cbfff700 1 -- 172.21.15.73:0/2997604188 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3bc0095f0 con 0x7fb3cc1010f0 2023-08-10T11:59:07.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.083+0000 7fb3cbfff700 1 --2- 172.21.15.73:0/2997604188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3cc1010f0 0x7fb3cc198fb0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb3c000b530 tx=0x7fb3c000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:07.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.083+0000 7fb3c9ffb700 1 -- 172.21.15.73:0/2997604188 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0011830 con 0x7fb3cc1010f0 2023-08-10T11:59:07.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.083+0000 7fb3c9ffb700 1 -- 172.21.15.73:0/2997604188 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb3c0011e50 con 0x7fb3cc1010f0 2023-08-10T11:59:07.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.083+0000 7fb3d2db4700 1 -- 172.21.15.73:0/2997604188 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3cc19d180 con 0x7fb3cc1010f0 2023-08-10T11:59:07.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.083+0000 7fb3c9ffb700 1 -- 172.21.15.73:0/2997604188 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0010e70 con 0x7fb3cc1010f0 2023-08-10T11:59:07.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.083+0000 7fb3d2db4700 1 -- 172.21.15.73:0/2997604188 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3cc1a5ae0 con 0x7fb3cc1010f0 2023-08-10T11:59:07.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.086+0000 7fb3c9ffb700 1 -- 172.21.15.73:0/2997604188 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fb3c0010510 con 0x7fb3cc1010f0 2023-08-10T11:59:07.088 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.086+0000 7fb3c9ffb700 1 --2- 172.21.15.73:0/2997604188 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb3b40a1300 0x7fb3b40a37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:07.088 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.086+0000 7fb3c9ffb700 1 -- 172.21.15.73:0/2997604188 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fb3c00cc6b0 con 0x7fb3cc1010f0 2023-08-10T11:59:07.088 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.087+0000 7fb3d0b50700 1 --2- 172.21.15.73:0/2997604188 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb3b40a1300 0x7fb3b40a37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:07.088 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.088+0000 7fb3def4db80 1 Processor -- start 2023-08-10T11:59:07.089 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.088+0000 7fb3def4db80 1 -- start start 2023-08-10T11:59:07.089 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.088+0000 7fb3def4db80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563069f20a40 0x563069f20e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:07.089 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.088+0000 7fb3def4db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563069f21360 0x563069f1b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:07.089 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.088+0000 7fb3def4db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563069f1b550 0x563069f1b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:07.089 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.088+0000 7fb3def4db80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563069e96d60 con 0x563069f20a40 2023-08-10T11:59:07.089 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.088+0000 7fb3def4db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563069e73530 con 0x563069f1b550 2023-08-10T11:59:07.090 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.088+0000 7fb3def4db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563069e70e50 con 0x563069f21360 2023-08-10T11:59:07.090 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.089+0000 7fb3d0b50700 1 --2- 172.21.15.73:0/2997604188 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb3b40a1300 0x7fb3b40a37c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc0098e0 tx=0x7fb3bc00b690 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:07.090 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.089+0000 7fb3cbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563069f21360 0x563069f1b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:07.091 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.089+0000 7fb3cbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563069f21360 0x563069f1b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60992/0 (socket says 172.21.15.73:60992) 2023-08-10T11:59:07.091 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.089+0000 7fb3cbfff700 1 -- 172.21.15.73:0/3285591161 learned_addr learned my addr 172.21.15.73:0/3285591161 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:07.091 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.089+0000 7fb3d1351700 1 --2- 172.21.15.73:0/3285591161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563069f1b550 0x563069f1b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:07.091 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.089+0000 7fb3d1351700 1 -- 172.21.15.73:0/3285591161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563069f21360 msgr2=0x563069f1b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:07.091 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.089+0000 7fb3d1351700 1 --2- 172.21.15.73:0/3285591161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563069f21360 0x563069f1b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.091 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.089+0000 7fb3d1351700 1 -- 172.21.15.73:0/3285591161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563069f20a40 msgr2=0x563069f20e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:07.091 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.089+0000 7fb3d1351700 1 --2- 172.21.15.73:0/3285591161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563069f20a40 0x563069f20e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.092 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.089+0000 7fb3d1351700 1 -- 172.21.15.73:0/3285591161 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563069ced5d0 con 0x563069f1b550 2023-08-10T11:59:07.092 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.089+0000 7fb3d1351700 1 --2- 172.21.15.73:0/3285591161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563069f1b550 0x563069f1b9d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb3c400e490 tx=0x7fb3c400e7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be0d8f30e034474d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:07.092 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.090+0000 7fb3b2ffd700 1 -- 172.21.15.73:0/3285591161 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4004db0 con 0x563069f1b550 2023-08-10T11:59:07.093 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.091+0000 7fb3b2ffd700 1 -- 172.21.15.73:0/3285591161 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb3c400f040 con 0x563069f1b550 2023-08-10T11:59:07.093 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.091+0000 7fb3b2ffd700 1 -- 172.21.15.73:0/3285591161 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c40044d0 con 0x563069f1b550 2023-08-10T11:59:07.093 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.092+0000 7fb3def4db80 1 -- 172.21.15.73:0/3285591161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563069f1b550 msgr2=0x563069f1b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:07.093 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.092+0000 7fb3def4db80 1 --2- 172.21.15.73:0/3285591161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563069f1b550 0x563069f1b9d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb3c400e490 tx=0x7fb3c400e7a0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.093 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.092+0000 7fb3def4db80 1 -- 172.21.15.73:0/3285591161 shutdown_connections 2023-08-10T11:59:07.093 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.092+0000 7fb3def4db80 1 --2- 172.21.15.73:0/3285591161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563069f1b550 0x563069f1b9d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.093 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.092+0000 7fb3def4db80 1 --2- 172.21.15.73:0/3285591161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563069f20a40 0x563069f20e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.094 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.092+0000 7fb3def4db80 1 --2- 172.21.15.73:0/3285591161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563069f21360 0x563069f1b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.094 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.092+0000 7fb3def4db80 1 -- 172.21.15.73:0/3285591161 >> 172.21.15.73:0/3285591161 conn(0x563069e78c70 msgr2=0x563069f15d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:07.097 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.092+0000 7fb3def4db80 1 -- 172.21.15.73:0/3285591161 shutdown_connections 2023-08-10T11:59:07.097 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.093+0000 7fb3def4db80 1 -- 172.21.15.73:0/3285591161 wait complete. 2023-08-10T11:59:07.097 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.093+0000 7fb3def4db80 1 -- start start 2023-08-10T11:59:07.098 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.093+0000 7fb3def4db80 1 Processor -- start 2023-08-10T11:59:07.098 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.094+0000 7fb3def4db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563069f1b550 0x563069f273a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:07.098 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.094+0000 7fb3def4db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563069f20a40 0x563069f24690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:07.098 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.094+0000 7fb3def4db80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563069f21360 0x563069f24dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:07.098 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.094+0000 7fb3def4db80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563069e6c740 con 0x563069f21360 2023-08-10T11:59:07.098 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.094+0000 7fb3def4db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563069e0ba60 con 0x563069f20a40 2023-08-10T11:59:07.098 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.094+0000 7fb3def4db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563069e0b760 con 0x563069f1b550 2023-08-10T11:59:07.099 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.094+0000 7fb3def4db80 10 client.0 _ll_register_callbacks cb 0x563069e09620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:59:07.099 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.094+0000 7fb3d0b50700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563069f1b550 0x563069f273a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:07.099 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.094+0000 7fb3d0b50700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563069f1b550 0x563069f273a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:60998/0 (socket says 172.21.15.73:60998) 2023-08-10T11:59:07.099 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.094+0000 7fb3d0b50700 1 -- 172.21.15.73:0/1018934728 learned_addr learned my addr 172.21.15.73:0/1018934728 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:07.099 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.094+0000 7fb3cbfff700 1 --2- 172.21.15.73:0/1018934728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563069f20a40 0x563069f24690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:07.099 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.094+0000 7fb3d0b50700 1 -- 172.21.15.73:0/1018934728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563069f20a40 msgr2=0x563069f24690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:07.099 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.094+0000 7fb3d0b50700 1 --2- 172.21.15.73:0/1018934728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563069f20a40 0x563069f24690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.099 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.094+0000 7fb3d0b50700 1 -- 172.21.15.73:0/1018934728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563069f21360 msgr2=0x563069f24dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.094+0000 7fb3d0b50700 1 --2- 172.21.15.73:0/1018934728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563069f21360 0x563069f24dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.094+0000 7fb3d0b50700 1 -- 172.21.15.73:0/1018934728 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c400e140 con 0x563069f1b550 2023-08-10T11:59:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.096+0000 7fb3d0b50700 1 --2- 172.21.15.73:0/1018934728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563069f1b550 0x563069f273a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc0057c0 tx=0x7fb3bc00f7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ceba16777b4d0995 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.096+0000 7fb3abfff700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T11:59:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.096+0000 7fb3abfff700 1 -- 172.21.15.73:0/1018934728 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc01d070 con 0x563069f1b550 2023-08-10T11:59:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.096+0000 7fb3abfff700 1 -- 172.21.15.73:0/1018934728 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fb3bc023460 con 0x563069f1b550 2023-08-10T11:59:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.096+0000 7fb3def4db80 1 -- 172.21.15.73:0/1018934728 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563069f0e1c0 con 0x563069f1b550 2023-08-10T11:59:07.101 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.096+0000 7fb3abfff700 1 -- 172.21.15.73:0/1018934728 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3bc023620 con 0x563069f1b550 2023-08-10T11:59:07.101 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.096+0000 7fb3def4db80 10 client.26008 fetch_fsmap learned FSMap version 43 2023-08-10T11:59:07.101 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.096+0000 7fb3def4db80 1 -- 172.21.15.73:0/1018934728 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x563069c99d80 con 0x563069f1b550 2023-08-10T11:59:07.101 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.097+0000 7fb3abfff700 1 -- 172.21.15.73:0/1018934728 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563069f0e1c0 con 0x563069f1b550 2023-08-10T11:59:07.102 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.097+0000 7fb3abfff700 1 -- 172.21.15.73:0/1018934728 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 43) v1 ==== 6965+0+0 (secure 0 0 0) 0x7fb3bc031c00 con 0x563069f1b550 2023-08-10T11:59:07.102 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.097+0000 7fb3def4db80 10 client.26008 fetch_fsmap finished waiting for FSMap version 43 2023-08-10T11:59:07.102 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.097+0000 7fb3def4db80 10 client.26008 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:59:07.103 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.097+0000 7fb3def4db80 20 client.26008 populate_metadata read hostname 'smithi073' 2023-08-10T11:59:07.103 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.097+0000 7fb3def4db80 1 --2- 172.21.15.73:0/1018934728 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563069f45ef0 0x563069f48310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:07.103 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.097+0000 7fb3def4db80 4 client.26008 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:59:07.103 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.097+0000 7fb3def4db80 1 -- 172.21.15.73:0/1018934728 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563069eea970 con 0x563069f45ef0 2023-08-10T11:59:07.103 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.097+0000 7fb3cbfff700 1 --2- 172.21.15.73:0/1018934728 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563069f45ef0 0x563069f48310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:07.103 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.098+0000 7fb3abfff700 10 client.26008 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:59:07.103 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.098+0000 7fb3cbfff700 1 --2- 172.21.15.73:0/1018934728 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563069f45ef0 0x563069f48310 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d47810e05b5b2cd3 server_cookie=fdae01d25f3f14b2 in_seq=0 out_seq=0 2023-08-10T11:59:07.104 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.099+0000 7fb3abfff700 1 -- 172.21.15.73:0/1018934728 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x563069eea970 con 0x563069f45ef0 2023-08-10T11:59:07.104 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.099+0000 7fb3abfff700 10 client.26008 handle_command_reply: tid=0 2023-08-10T11:59:07.104 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.099+0000 7fb3def4db80 1 client.26008 shutdown 2023-08-10T11:59:07.104 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.099+0000 7fb3def4db80 1 -- 172.21.15.73:0/1018934728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563069f1b550 msgr2=0x563069f273a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:07.104 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.099+0000 7fb3def4db80 1 --2- 172.21.15.73:0/1018934728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563069f1b550 0x563069f273a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc0057c0 tx=0x7fb3bc00f7f0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.104 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.100+0000 7fb3def4db80 1 -- 172.21.15.73:0/1018934728 shutdown_connections 2023-08-10T11:59:07.104 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.100+0000 7fb3def4db80 1 --2- 172.21.15.73:0/1018934728 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563069f45ef0 0x563069f48310 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.100+0000 7fb3def4db80 1 --2- 172.21.15.73:0/1018934728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563069f21360 0x563069f24dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.100+0000 7fb3abfff700 0 client.26008 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:59:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.100+0000 7fb3def4db80 1 --2- 172.21.15.73:0/1018934728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563069f1b550 0x563069f273a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.100+0000 7fb3def4db80 1 --2- 172.21.15.73:0/1018934728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563069f20a40 0x563069f24690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.100+0000 7fb3def4db80 1 -- 172.21.15.73:0/1018934728 >> 172.21.15.73:0/1018934728 conn(0x563069e78c70 msgr2=0x563069f154b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.100+0000 7fb3def4db80 1 -- 172.21.15.73:0/1018934728 shutdown_connections 2023-08-10T11:59:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.100+0000 7fb3def4db80 1 -- 172.21.15.73:0/1018934728 wait complete. 2023-08-10T11:59:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.101+0000 7fb3def4db80 20 client.26008 trim_cache size 0 max 16384 2023-08-10T11:59:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.124+0000 7fb3def4db80 1 Processor -- start 2023-08-10T11:59:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.124+0000 7fb3def4db80 1 -- start start 2023-08-10T11:59:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.124+0000 7fb3def4db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563069f1b550 0x563069f4cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.124+0000 7fb3def4db80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563069f20a40 0x563069f1ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.124+0000 7fb3def4db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563069f21360 0x563069f15c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.124+0000 7fb3def4db80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563069cef8c0 con 0x563069f20a40 2023-08-10T11:59:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.124+0000 7fb3def4db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563069f204c0 con 0x563069f1b550 2023-08-10T11:59:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.124+0000 7fb3def4db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563069f16c40 con 0x563069f21360 2023-08-10T11:59:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.124+0000 7fb3d0b50700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563069f1b550 0x563069f4cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.125+0000 7fb3d0b50700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563069f1b550 0x563069f4cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:50152/0 (socket says 172.21.15.73:50152) 2023-08-10T11:59:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.125+0000 7fb3d0b50700 1 -- 172.21.15.73:0/2007763857 learned_addr learned my addr 172.21.15.73:0/2007763857 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.125+0000 7fb3cbfff700 1 --2- 172.21.15.73:0/2007763857 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563069f20a40 0x563069f1ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.125+0000 7fb3cbfff700 1 -- 172.21.15.73:0/2007763857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563069f21360 msgr2=0x563069f15c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.125+0000 7fb3cbfff700 1 --2- 172.21.15.73:0/2007763857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563069f21360 0x563069f15c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.125+0000 7fb3cbfff700 1 -- 172.21.15.73:0/2007763857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563069f1b550 msgr2=0x563069f4cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.125+0000 7fb3cbfff700 1 --2- 172.21.15.73:0/2007763857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563069f1b550 0x563069f4cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.125+0000 7fb3cbfff700 1 -- 172.21.15.73:0/2007763857 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563069c82c00 con 0x563069f20a40 2023-08-10T11:59:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.125+0000 7fb3cbfff700 1 --2- 172.21.15.73:0/2007763857 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563069f20a40 0x563069f1ff80 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0099800 tx=0x7fb3c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1746c293f2b762 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.125+0000 7fb3b37fe700 1 -- 172.21.15.73:0/2007763857 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c00b7ea0 con 0x563069f20a40 2023-08-10T11:59:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.126+0000 7fb3b37fe700 1 -- 172.21.15.73:0/2007763857 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb3c00a1cc0 con 0x563069f20a40 2023-08-10T11:59:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.126+0000 7fb3b37fe700 1 -- 172.21.15.73:0/2007763857 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c00a1830 con 0x563069f20a40 2023-08-10T11:59:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.127+0000 7fb3def4db80 1 -- 172.21.15.73:0/2007763857 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563069f20a40 msgr2=0x563069f1ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.127+0000 7fb3def4db80 1 --2- 172.21.15.73:0/2007763857 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563069f20a40 0x563069f1ff80 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0099800 tx=0x7fb3c0004750 comp rx=0 tx=0).stop 2023-08-10T11:59:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.128+0000 7fb3def4db80 1 -- 172.21.15.73:0/2007763857 shutdown_connections 2023-08-10T11:59:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.128+0000 7fb3def4db80 1 --2- 172.21.15.73:0/2007763857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563069f1b550 0x563069f4cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.128+0000 7fb3def4db80 1 --2- 172.21.15.73:0/2007763857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563069f21360 0x563069f15c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.128+0000 7fb3def4db80 1 --2- 172.21.15.73:0/2007763857 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563069f20a40 0x563069f1ff80 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.128+0000 7fb3def4db80 1 -- 172.21.15.73:0/2007763857 >> 172.21.15.73:0/2007763857 conn(0x563069e78c70 msgr2=0x563069f1f870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.128+0000 7fb3def4db80 1 -- 172.21.15.73:0/2007763857 shutdown_connections 2023-08-10T11:59:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.128+0000 7fb3def4db80 1 -- 172.21.15.73:0/2007763857 wait complete. 2023-08-10T11:59:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.128+0000 7fb3def4db80 1 -- start start 2023-08-10T11:59:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.129+0000 7fb3def4db80 1 Processor -- start 2023-08-10T11:59:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.129+0000 7fb3def4db80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563069f1b550 0x563069f3cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.129+0000 7fb3def4db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563069f20a40 0x563069f38f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.129+0000 7fb3def4db80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563069f21360 0x563069f39480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.129+0000 7fb3def4db80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563069f39a30 con 0x563069f1b550 2023-08-10T11:59:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.129+0000 7fb3def4db80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563069f39ba0 con 0x563069f21360 2023-08-10T11:59:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.129+0000 7fb3def4db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563069f39d60 con 0x563069f20a40 2023-08-10T11:59:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.129+0000 7fb3def4db80 10 client.0 _ll_register_callbacks cb 0x563069e09620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:59:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.130+0000 7fb3d0b50700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563069f1b550 0x563069f3cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.130+0000 7fb3cbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563069f20a40 0x563069f38f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.130+0000 7fb3cbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563069f20a40 0x563069f38f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:32784/0 (socket says 172.21.15.73:32784) 2023-08-10T11:59:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.130+0000 7fb3d0b50700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563069f1b550 0x563069f3cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35508/0 (socket says 172.21.15.73:35508) 2023-08-10T11:59:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.130+0000 7fb3cbfff700 1 -- 172.21.15.73:0/3277909783 learned_addr learned my addr 172.21.15.73:0/3277909783 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.130+0000 7fb3d0b50700 1 -- 172.21.15.73:0/3277909783 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563069f20a40 msgr2=0x563069f38f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.130+0000 7fb3d0b50700 1 --2- 172.21.15.73:0/3277909783 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563069f20a40 0x563069f38f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.130+0000 7fb3d0b50700 1 -- 172.21.15.73:0/3277909783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563069f21360 msgr2=0x563069f39480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.130+0000 7fb3d0b50700 1 --2- 172.21.15.73:0/3277909783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563069f21360 0x563069f39480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.130+0000 7fb3d0b50700 1 -- 172.21.15.73:0/3277909783 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3cc1a5ae0 con 0x563069f1b550 2023-08-10T11:59:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.130+0000 7fb3d0b50700 1 --2- 172.21.15.73:0/3277909783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563069f1b550 0x563069f3cbc0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc00fcf0 tx=0x7fb3bc0379c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5200f21a32797b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.130+0000 7fb3abfff700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:59:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.131+0000 7fb3abfff700 1 -- 172.21.15.73:0/3277909783 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc026630 con 0x563069f1b550 2023-08-10T11:59:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.131+0000 7fb3abfff700 1 -- 172.21.15.73:0/3277909783 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fb3bc03c070 con 0x563069f1b550 2023-08-10T11:59:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.131+0000 7fb3def4db80 1 -- 172.21.15.73:0/3277909783 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb3c400f040 con 0x563069f1b550 2023-08-10T11:59:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.131+0000 7fb3abfff700 1 -- 172.21.15.73:0/3277909783 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3bc026790 con 0x563069f1b550 2023-08-10T11:59:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.131+0000 7fb3def4db80 10 client.16521 fetch_fsmap learned FSMap version 43 2023-08-10T11:59:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.131+0000 7fb3def4db80 1 -- 172.21.15.73:0/3277909783 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x563069cc01f0 con 0x563069f1b550 2023-08-10T11:59:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.132+0000 7fb3abfff700 1 -- 172.21.15.73:0/3277909783 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb3c400f040 con 0x563069f1b550 2023-08-10T11:59:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.132+0000 7fb3abfff700 1 -- 172.21.15.73:0/3277909783 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 43) v1 ==== 6965+0+0 (secure 0 0 0) 0x7fb3bc023ab0 con 0x563069f1b550 2023-08-10T11:59:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.132+0000 7fb3def4db80 10 client.16521 fetch_fsmap finished waiting for FSMap version 43 2023-08-10T11:59:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.132+0000 7fb3def4db80 10 client.16521 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:59:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.132+0000 7fb3def4db80 20 client.16521 populate_metadata read hostname 'smithi073' 2023-08-10T11:59:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.132+0000 7fb3def4db80 1 --2- 172.21.15.73:0/3277909783 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563069f279f0 0x563069f29e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.132+0000 7fb3def4db80 4 client.16521 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:59:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.132+0000 7fb3def4db80 1 -- 172.21.15.73:0/3277909783 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563069e65720 con 0x563069f279f0 2023-08-10T11:59:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.132+0000 7fb3cbfff700 1 --2- 172.21.15.73:0/3277909783 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563069f279f0 0x563069f29e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.133+0000 7fb3cbfff700 1 --2- 172.21.15.73:0/3277909783 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563069f279f0 0x563069f29e50 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b859875b1a277b97 server_cookie=c2d336cbe61b51a7 in_seq=0 out_seq=0 2023-08-10T11:59:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.133+0000 7fb3abfff700 10 client.16521 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:59:07.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:06 smithi152 ceph-mon[130220]: pgmap v198: 97 pgs: 1 active+clean+snaptrim_wait, 94 active+clean, 2 active+clean+snaptrim; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 1.9 MiB/s wr, 192 op/s 2023-08-10T11:59:07.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:06 smithi156 ceph-mon[130574]: pgmap v198: 97 pgs: 1 active+clean+snaptrim_wait, 94 active+clean, 2 active+clean+snaptrim; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 1.9 MiB/s wr, 192 op/s 2023-08-10T11:59:07.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.259+0000 7fb3abfff700 1 -- 172.21.15.73:0/3277909783 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563069e65720 con 0x563069f279f0 2023-08-10T11:59:07.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.259+0000 7fb3abfff700 10 client.16521 handle_command_reply: tid=0 2023-08-10T11:59:07.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.259+0000 7fb3def4db80 1 client.16521 shutdown 2023-08-10T11:59:07.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.260+0000 7fb3def4db80 1 -- 172.21.15.73:0/3277909783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563069f1b550 msgr2=0x563069f3cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:07.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.260+0000 7fb3def4db80 1 --2- 172.21.15.73:0/3277909783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563069f1b550 0x563069f3cbc0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc00fcf0 tx=0x7fb3bc0379c0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.260+0000 7fb3def4db80 1 -- 172.21.15.73:0/3277909783 shutdown_connections 2023-08-10T11:59:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.260+0000 7fb3def4db80 1 --2- 172.21.15.73:0/3277909783 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563069f279f0 0x563069f29e50 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.260+0000 7fb3def4db80 1 --2- 172.21.15.73:0/3277909783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563069f21360 0x563069f39480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.260+0000 7fb3def4db80 1 --2- 172.21.15.73:0/3277909783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563069f1b550 0x563069f3cbc0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.260+0000 7fb3abfff700 0 client.16521 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:59:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.260+0000 7fb3def4db80 1 --2- 172.21.15.73:0/3277909783 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563069f20a40 0x563069f38f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.260+0000 7fb3def4db80 1 -- 172.21.15.73:0/3277909783 >> 172.21.15.73:0/3277909783 conn(0x563069e78c70 msgr2=0x563069f21740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.260+0000 7fb3def4db80 1 -- 172.21.15.73:0/3277909783 shutdown_connections 2023-08-10T11:59:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.260+0000 7fb3def4db80 1 -- 172.21.15.73:0/3277909783 wait complete. 2023-08-10T11:59:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.260+0000 7fb3def4db80 20 client.16521 trim_cache size 0 max 16384 2023-08-10T11:59:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:59:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:59:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:59:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:59:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.261+0000 7fb3d2db4700 1 -- 172.21.15.73:0/2997604188 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb3b40a1300 msgr2=0x7fb3b40a37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.261+0000 7fb3d2db4700 1 --2- 172.21.15.73:0/2997604188 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb3b40a1300 0x7fb3b40a37c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc0098e0 tx=0x7fb3bc00b690 comp rx=0 tx=0).stop 2023-08-10T11:59:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.261+0000 7fb3d2db4700 1 -- 172.21.15.73:0/2997604188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3cc1010f0 msgr2=0x7fb3cc198fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.261+0000 7fb3d2db4700 1 --2- 172.21.15.73:0/2997604188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3cc1010f0 0x7fb3cc198fb0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb3c000b530 tx=0x7fb3c000b8f0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.261+0000 7fb3d2db4700 1 -- 172.21.15.73:0/2997604188 shutdown_connections 2023-08-10T11:59:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.261+0000 7fb3d2db4700 1 --2- 172.21.15.73:0/2997604188 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb3b40a1300 0x7fb3b40a37c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.261+0000 7fb3d2db4700 1 --2- 172.21.15.73:0/2997604188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3cc100730 0x7fb3cc198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.261+0000 7fb3d2db4700 1 --2- 172.21.15.73:0/2997604188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3cc106740 0x7fb3cc19c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.261+0000 7fb3d2db4700 1 --2- 172.21.15.73:0/2997604188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3cc1010f0 0x7fb3cc198fb0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.261+0000 7fb3d2db4700 1 -- 172.21.15.73:0/2997604188 >> 172.21.15.73:0/2997604188 conn(0x7fb3cc0763b0 msgr2=0x7fb3cc104240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.263+0000 7fb3d2db4700 1 -- 172.21.15.73:0/2997604188 shutdown_connections 2023-08-10T11:59:07.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:07.263+0000 7fb3d2db4700 1 -- 172.21.15.73:0/2997604188 wait complete. 2023-08-10T11:59:07.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:06 smithi073 ceph-mon[128869]: pgmap v198: 97 pgs: 1 active+clean+snaptrim_wait, 94 active+clean, 2 active+clean+snaptrim; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 1.9 MiB/s wr, 192 op/s 2023-08-10T11:59:09.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:09 smithi073 ceph-mon[128869]: pgmap v199: 97 pgs: 5 active+clean+snaptrim_wait, 88 active+clean, 4 active+clean+snaptrim; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 907 KiB/s wr, 111 op/s 2023-08-10T11:59:09.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:09 smithi152 ceph-mon[130220]: pgmap v199: 97 pgs: 5 active+clean+snaptrim_wait, 88 active+clean, 4 active+clean+snaptrim; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 907 KiB/s wr, 111 op/s 2023-08-10T11:59:09.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:09 smithi156 ceph-mon[130574]: pgmap v199: 97 pgs: 5 active+clean+snaptrim_wait, 88 active+clean, 4 active+clean+snaptrim; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 907 KiB/s wr, 111 op/s 2023-08-10T11:59:11.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:11 smithi073 ceph-mon[128869]: pgmap v200: 97 pgs: 11 active+clean+snaptrim_wait, 80 active+clean, 6 active+clean+snaptrim; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 689 KiB/s wr, 85 op/s 2023-08-10T11:59:11.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:11 smithi152 ceph-mon[130220]: pgmap v200: 97 pgs: 11 active+clean+snaptrim_wait, 80 active+clean, 6 active+clean+snaptrim; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 689 KiB/s wr, 85 op/s 2023-08-10T11:59:11.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:11 smithi156 ceph-mon[130574]: pgmap v200: 97 pgs: 11 active+clean+snaptrim_wait, 80 active+clean, 6 active+clean+snaptrim; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 689 KiB/s wr, 85 op/s 2023-08-10T11:59:13.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:13 smithi152 ceph-mon[130220]: pgmap v201: 97 pgs: 6 active+clean+snaptrim_wait, 89 active+clean, 2 active+clean+snaptrim; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 205 KiB/s wr, 82 op/s 2023-08-10T11:59:13.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:13 smithi156 ceph-mon[130574]: pgmap v201: 97 pgs: 6 active+clean+snaptrim_wait, 89 active+clean, 2 active+clean+snaptrim; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 205 KiB/s wr, 82 op/s 2023-08-10T11:59:13.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:13 smithi073 ceph-mon[128869]: pgmap v201: 97 pgs: 6 active+clean+snaptrim_wait, 89 active+clean, 2 active+clean+snaptrim; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 205 KiB/s wr, 82 op/s 2023-08-10T11:59:15.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:14 smithi152 ceph-mon[130220]: pgmap v202: 97 pgs: 97 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 203 KiB/s wr, 81 op/s 2023-08-10T11:59:15.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:14 smithi156 ceph-mon[130574]: pgmap v202: 97 pgs: 97 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 203 KiB/s wr, 81 op/s 2023-08-10T11:59:15.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:14 smithi073 ceph-mon[128869]: pgmap v202: 97 pgs: 97 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 203 KiB/s wr, 81 op/s 2023-08-10T11:59:17.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:17 smithi073 ceph-mon[128869]: pgmap v203: 97 pgs: 97 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 155 KiB/s wr, 71 op/s 2023-08-10T11:59:17.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:17 smithi152 ceph-mon[130220]: pgmap v203: 97 pgs: 97 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 155 KiB/s wr, 71 op/s 2023-08-10T11:59:17.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:17 smithi156 ceph-mon[130574]: pgmap v203: 97 pgs: 97 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 155 KiB/s wr, 71 op/s 2023-08-10T11:59:19.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:19 smithi152 ceph-mon[130220]: pgmap v204: 97 pgs: 97 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 106 KiB/s wr, 48 op/s 2023-08-10T11:59:19.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:19 smithi152 ceph-mon[130220]: osdmap e88: 12 total, 12 up, 12 in 2023-08-10T11:59:19.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:19 smithi156 ceph-mon[130574]: pgmap v204: 97 pgs: 97 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 106 KiB/s wr, 48 op/s 2023-08-10T11:59:19.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:19 smithi156 ceph-mon[130574]: osdmap e88: 12 total, 12 up, 12 in 2023-08-10T11:59:19.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:19 smithi073 ceph-mon[128869]: pgmap v204: 97 pgs: 97 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 106 KiB/s wr, 48 op/s 2023-08-10T11:59:19.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:19 smithi073 ceph-mon[128869]: osdmap e88: 12 total, 12 up, 12 in 2023-08-10T11:59:20.387 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.385+0000 7fdf98c24700 1 -- 172.21.15.73:0/1506715400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf94104940 msgr2=0x7fdf9410c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.385+0000 7fdf98c24700 1 --2- 172.21.15.73:0/1506715400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf94104940 0x7fdf9410c550 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c00b0a0 tx=0x7fdf8c00b3b0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.385+0000 7fdf98c24700 1 -- 172.21.15.73:0/1506715400 shutdown_connections 2023-08-10T11:59:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.385+0000 7fdf98c24700 1 --2- 172.21.15.73:0/1506715400 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf940fff90 0x7fdf94100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.385+0000 7fdf98c24700 1 --2- 172.21.15.73:0/1506715400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf94104940 0x7fdf9410c550 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.385+0000 7fdf98c24700 1 --2- 172.21.15.73:0/1506715400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf94100940 0x7fdf94104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.385+0000 7fdf98c24700 1 -- 172.21.15.73:0/1506715400 >> 172.21.15.73:0/1506715400 conn(0x7fdf94076b40 msgr2=0x7fdf940fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.385+0000 7fdf98c24700 1 -- 172.21.15.73:0/1506715400 shutdown_connections 2023-08-10T11:59:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.385+0000 7fdf98c24700 1 -- 172.21.15.73:0/1506715400 wait complete. 2023-08-10T11:59:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.386+0000 7fdf98c24700 1 Processor -- start 2023-08-10T11:59:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.386+0000 7fdf98c24700 1 -- start start 2023-08-10T11:59:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.386+0000 7fdf98c24700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf940fff90 0x7fdf940fb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.386+0000 7fdf98c24700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf94104940 0x7fdf940fb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.386+0000 7fdf98c24700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf941a2a90 0x7fdf941a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.386+0000 7fdf98c24700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf941a53c0 con 0x7fdf94104940 2023-08-10T11:59:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.386+0000 7fdf98c24700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf941a5500 con 0x7fdf940fff90 2023-08-10T11:59:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.386+0000 7fdf98c24700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf941a5670 con 0x7fdf941a2a90 2023-08-10T11:59:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.386+0000 7fdf9259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf940fff90 0x7fdf940fb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.386+0000 7fdf91d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf94104940 0x7fdf940fb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.387+0000 7fdf91d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf94104940 0x7fdf940fb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35526/0 (socket says 172.21.15.73:35526) 2023-08-10T11:59:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.387+0000 7fdf91d9b700 1 -- 172.21.15.73:0/3687584080 learned_addr learned my addr 172.21.15.73:0/3687584080 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.386+0000 7fdf9259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf940fff90 0x7fdf940fb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:50172/0 (socket says 172.21.15.73:50172) 2023-08-10T11:59:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.387+0000 7fdf92d9d700 1 --2- 172.21.15.73:0/3687584080 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf941a2a90 0x7fdf941a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.387+0000 7fdf91d9b700 1 -- 172.21.15.73:0/3687584080 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf941a2a90 msgr2=0x7fdf941a4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.387+0000 7fdf91d9b700 1 --2- 172.21.15.73:0/3687584080 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf941a2a90 0x7fdf941a4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.387+0000 7fdf91d9b700 1 -- 172.21.15.73:0/3687584080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf940fff90 msgr2=0x7fdf940fb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.387+0000 7fdf91d9b700 1 --2- 172.21.15.73:0/3687584080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf940fff90 0x7fdf940fb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.387+0000 7fdf91d9b700 1 -- 172.21.15.73:0/3687584080 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf84009520 con 0x7fdf94104940 2023-08-10T11:59:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.387+0000 7fdf91d9b700 1 --2- 172.21.15.73:0/3687584080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf94104940 0x7fdf940fb660 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400ea30 tx=0x7fdf8400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.387+0000 7fdf837fe700 1 -- 172.21.15.73:0/3687584080 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8400cbd0 con 0x7fdf94104940 2023-08-10T11:59:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.387+0000 7fdf98c24700 1 -- 172.21.15.73:0/3687584080 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8c009d00 con 0x7fdf94104940 2023-08-10T11:59:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.387+0000 7fdf837fe700 1 -- 172.21.15.73:0/3687584080 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf8400eed0 con 0x7fdf94104940 2023-08-10T11:59:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.387+0000 7fdf837fe700 1 -- 172.21.15.73:0/3687584080 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84003d20 con 0x7fdf94104940 2023-08-10T11:59:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.387+0000 7fdf98c24700 1 -- 172.21.15.73:0/3687584080 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf941a5cd0 con 0x7fdf94104940 2023-08-10T11:59:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.389+0000 7fdf837fe700 1 -- 172.21.15.73:0/3687584080 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fdf84003ee0 con 0x7fdf94104940 2023-08-10T11:59:20.398 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.390+0000 7fdf837fe700 1 --2- 172.21.15.73:0/3687584080 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fdf7c0a12c0 0x7fdf7c0a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:20.398 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.390+0000 7fdf837fe700 1 -- 172.21.15.73:0/3687584080 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fdf84014070 con 0x7fdf94104940 2023-08-10T11:59:20.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.390+0000 7fdf9259c700 1 --2- 172.21.15.73:0/3687584080 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fdf7c0a12c0 0x7fdf7c0a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:20.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.390+0000 7fdf9259c700 1 --2- 172.21.15.73:0/3687584080 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fdf7c0a12c0 0x7fdf7c0a3780 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009c60 tx=0x7fdf88009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:20.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.391+0000 7fdfa4dbdb80 1 Processor -- start 2023-08-10T11:59:20.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.391+0000 7fdfa4dbdb80 1 -- start start 2023-08-10T11:59:20.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.391+0000 7fdfa4dbdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562baed25a40 0x562baed25e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:20.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.391+0000 7fdfa4dbdb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562baed26360 0x562baed20010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:20.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.391+0000 7fdfa4dbdb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562baed20550 0x562baed209d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:20.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.391+0000 7fdfa4dbdb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baec9bd60 con 0x562baed26360 2023-08-10T11:59:20.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.391+0000 7fdfa4dbdb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baec78530 con 0x562baed20550 2023-08-10T11:59:20.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.391+0000 7fdfa4dbdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baec75e50 con 0x562baed25a40 2023-08-10T11:59:20.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.391+0000 7fdf91d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562baed26360 0x562baed20010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:20.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.391+0000 7fdf9259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562baed25a40 0x562baed25e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:20.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.391+0000 7fdf9259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562baed25a40 0x562baed25e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:32802/0 (socket says 172.21.15.73:32802) 2023-08-10T11:59:20.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.391+0000 7fdf9259c700 1 -- 172.21.15.73:0/3527006607 learned_addr learned my addr 172.21.15.73:0/3527006607 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:20.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.391+0000 7fdf92d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562baed20550 0x562baed209d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:20.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.392+0000 7fdf9259c700 1 -- 172.21.15.73:0/3527006607 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562baed20550 msgr2=0x562baed209d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:20.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.392+0000 7fdf9259c700 1 --2- 172.21.15.73:0/3527006607 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562baed20550 0x562baed209d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.392+0000 7fdf9259c700 1 -- 172.21.15.73:0/3527006607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562baed26360 msgr2=0x562baed20010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:20.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.392+0000 7fdf9259c700 1 --2- 172.21.15.73:0/3527006607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562baed26360 0x562baed20010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.392+0000 7fdf9259c700 1 -- 172.21.15.73:0/3527006607 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562baeaf25d0 con 0x562baed25a40 2023-08-10T11:59:20.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.392+0000 7fdf91d9b700 1 --2- 172.21.15.73:0/3527006607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562baed26360 0x562baed20010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:59:20.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.392+0000 7fdf9259c700 1 --2- 172.21.15.73:0/3527006607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562baed25a40 0x562baed25e20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdf8800e4e0 tx=0x7fdf88014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a4abfb419b68d5d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:20.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.392+0000 7fdf80ff9700 1 -- 172.21.15.73:0/3527006607 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8800ee00 con 0x562baed25a40 2023-08-10T11:59:20.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.392+0000 7fdf80ff9700 1 -- 172.21.15.73:0/3527006607 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf88021070 con 0x562baed25a40 2023-08-10T11:59:20.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.392+0000 7fdf80ff9700 1 -- 172.21.15.73:0/3527006607 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8801d810 con 0x562baed25a40 2023-08-10T11:59:20.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.393+0000 7fdfa4dbdb80 1 -- 172.21.15.73:0/3527006607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562baed25a40 msgr2=0x562baed25e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:20.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.393+0000 7fdfa4dbdb80 1 --2- 172.21.15.73:0/3527006607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562baed25a40 0x562baed25e20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdf8800e4e0 tx=0x7fdf88014000 comp rx=0 tx=0).stop 2023-08-10T11:59:20.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.393+0000 7fdfa4dbdb80 1 -- 172.21.15.73:0/3527006607 shutdown_connections 2023-08-10T11:59:20.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.393+0000 7fdfa4dbdb80 1 --2- 172.21.15.73:0/3527006607 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562baed20550 0x562baed209d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.393+0000 7fdfa4dbdb80 1 --2- 172.21.15.73:0/3527006607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562baed25a40 0x562baed25e20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.393+0000 7fdfa4dbdb80 1 --2- 172.21.15.73:0/3527006607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562baed26360 0x562baed20010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.393+0000 7fdfa4dbdb80 1 -- 172.21.15.73:0/3527006607 >> 172.21.15.73:0/3527006607 conn(0x562baec7dc70 msgr2=0x562baed1ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:20.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.393+0000 7fdfa4dbdb80 1 -- 172.21.15.73:0/3527006607 shutdown_connections 2023-08-10T11:59:20.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.393+0000 7fdfa4dbdb80 1 -- 172.21.15.73:0/3527006607 wait complete. 2023-08-10T11:59:20.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.393+0000 7fdfa4dbdb80 1 -- start start 2023-08-10T11:59:20.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.393+0000 7fdfa4dbdb80 1 Processor -- start 2023-08-10T11:59:20.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.394+0000 7fdfa4dbdb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562baed20550 0x562baed2c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:20.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.394+0000 7fdfa4dbdb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562baed25a40 0x562baed29570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:20.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.394+0000 7fdfa4dbdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562baed26360 0x562baed29b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:20.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.394+0000 7fdfa4dbdb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baec71740 con 0x562baed20550 2023-08-10T11:59:20.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.394+0000 7fdfa4dbdb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baec10a60 con 0x562baed25a40 2023-08-10T11:59:20.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.394+0000 7fdfa4dbdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baec10760 con 0x562baed26360 2023-08-10T11:59:20.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.394+0000 7fdfa4dbdb80 10 client.0 _ll_register_callbacks cb 0x562baec0e620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:59:20.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.394+0000 7fdf9259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562baed20550 0x562baed2c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:20.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.394+0000 7fdf9259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562baed20550 0x562baed2c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35536/0 (socket says 172.21.15.73:35536) 2023-08-10T11:59:20.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.394+0000 7fdf9259c700 1 -- 172.21.15.73:0/713321285 learned_addr learned my addr 172.21.15.73:0/713321285 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:20.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.394+0000 7fdf91d9b700 1 --2- 172.21.15.73:0/713321285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562baed25a40 0x562baed29570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:20.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.394+0000 7fdf92d9d700 1 --2- 172.21.15.73:0/713321285 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562baed26360 0x562baed29b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:20.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.394+0000 7fdf9259c700 1 -- 172.21.15.73:0/713321285 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562baed26360 msgr2=0x562baed29b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:20.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.394+0000 7fdf9259c700 1 --2- 172.21.15.73:0/713321285 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562baed26360 0x562baed29b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.394+0000 7fdf9259c700 1 -- 172.21.15.73:0/713321285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562baed25a40 msgr2=0x562baed29570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:20.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.394+0000 7fdf9259c700 1 --2- 172.21.15.73:0/713321285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562baed25a40 0x562baed29570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.394+0000 7fdf9259c700 1 -- 172.21.15.73:0/713321285 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf941a5cd0 con 0x562baed20550 2023-08-10T11:59:20.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.394+0000 7fdf9259c700 1 --2- 172.21.15.73:0/713321285 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562baed20550 0x562baed2c2f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fdf8800e4b0 tx=0x7fdf8800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb8836d2c981bda server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:20.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.394+0000 7fdf79ffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:59:20.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.394+0000 7fdf79ffb700 1 -- 172.21.15.73:0/713321285 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf880052d0 con 0x562baed20550 2023-08-10T11:59:20.406 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.394+0000 7fdfa4dbdb80 1 -- 172.21.15.73:0/713321285 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562baed131c0 con 0x562baed20550 2023-08-10T11:59:20.407 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.394+0000 7fdf79ffb700 1 -- 172.21.15.73:0/713321285 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fdf88005430 con 0x562baed20550 2023-08-10T11:59:20.407 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.394+0000 7fdf79ffb700 1 -- 172.21.15.73:0/713321285 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf880055f0 con 0x562baed20550 2023-08-10T11:59:20.407 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.394+0000 7fdfa4dbdb80 10 client.16533 fetch_fsmap learned FSMap version 43 2023-08-10T11:59:20.407 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.394+0000 7fdfa4dbdb80 1 -- 172.21.15.73:0/713321285 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x7fdf88017070 con 0x562baed20550 2023-08-10T11:59:20.407 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.395+0000 7fdf79ffb700 1 -- 172.21.15.73:0/713321285 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf8803b020 con 0x562baed20550 2023-08-10T11:59:20.407 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.395+0000 7fdf79ffb700 1 -- 172.21.15.73:0/713321285 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 43) v1 ==== 6965+0+0 (secure 0 0 0) 0x7fdf8801c6f0 con 0x562baed20550 2023-08-10T11:59:20.407 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.395+0000 7fdfa4dbdb80 10 client.16533 fetch_fsmap finished waiting for FSMap version 43 2023-08-10T11:59:20.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.395+0000 7fdfa4dbdb80 10 client.16533 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:59:20.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.395+0000 7fdfa4dbdb80 20 client.16533 populate_metadata read hostname 'smithi073' 2023-08-10T11:59:20.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.395+0000 7fdfa4dbdb80 1 --2- 172.21.15.73:0/713321285 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x562baed39c40 0x562baed3c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:20.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.395+0000 7fdfa4dbdb80 4 client.16533 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:59:20.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.395+0000 7fdfa4dbdb80 1 -- 172.21.15.73:0/713321285 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562baecef970 con 0x562baed39c40 2023-08-10T11:59:20.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.395+0000 7fdf91d9b700 1 --2- 172.21.15.73:0/713321285 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x562baed39c40 0x562baed3c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:20.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.395+0000 7fdf79ffb700 10 client.16533 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:59:20.409 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.395+0000 7fdf91d9b700 1 --2- 172.21.15.73:0/713321285 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x562baed39c40 0x562baed3c060 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=697b7285a94b1f88 server_cookie=48dac326811a6df5 in_seq=0 out_seq=0 2023-08-10T11:59:20.409 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.396+0000 7fdf79ffb700 1 -- 172.21.15.73:0/713321285 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x562baecef970 con 0x562baed39c40 2023-08-10T11:59:20.409 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.396+0000 7fdf79ffb700 10 client.16533 handle_command_reply: tid=0 2023-08-10T11:59:20.409 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.396+0000 7fdfa4dbdb80 1 client.16533 shutdown 2023-08-10T11:59:20.409 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.396+0000 7fdfa4dbdb80 1 -- 172.21.15.73:0/713321285 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562baed20550 msgr2=0x562baed2c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:20.409 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.396+0000 7fdfa4dbdb80 1 --2- 172.21.15.73:0/713321285 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562baed20550 0x562baed2c2f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fdf8800e4b0 tx=0x7fdf8800ed40 comp rx=0 tx=0).stop 2023-08-10T11:59:20.409 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.396+0000 7fdfa4dbdb80 1 -- 172.21.15.73:0/713321285 shutdown_connections 2023-08-10T11:59:20.409 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.396+0000 7fdfa4dbdb80 1 --2- 172.21.15.73:0/713321285 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x562baed39c40 0x562baed3c060 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.396+0000 7fdfa4dbdb80 1 --2- 172.21.15.73:0/713321285 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562baed26360 0x562baed29b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.396+0000 7fdf79ffb700 0 client.16533 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:59:20.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.396+0000 7fdfa4dbdb80 1 --2- 172.21.15.73:0/713321285 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562baed20550 0x562baed2c2f0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.396+0000 7fdfa4dbdb80 1 --2- 172.21.15.73:0/713321285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562baed25a40 0x562baed29570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.396+0000 7fdfa4dbdb80 1 -- 172.21.15.73:0/713321285 >> 172.21.15.73:0/713321285 conn(0x562baec7dc70 msgr2=0x562baed1a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:20.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.396+0000 7fdfa4dbdb80 1 -- 172.21.15.73:0/713321285 shutdown_connections 2023-08-10T11:59:20.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.396+0000 7fdfa4dbdb80 1 -- 172.21.15.73:0/713321285 wait complete. 2023-08-10T11:59:20.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.397+0000 7fdfa4dbdb80 20 client.16533 trim_cache size 0 max 16384 2023-08-10T11:59:20.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.411+0000 7fdfa4dbdb80 1 Processor -- start 2023-08-10T11:59:20.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.411+0000 7fdfa4dbdb80 1 -- start start 2023-08-10T11:59:20.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.411+0000 7fdfa4dbdb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562baed20550 0x562baed1ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:20.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.411+0000 7fdfa4dbdb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562baed25a40 0x562baed2be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:20.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.411+0000 7fdfa4dbdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562baed26360 0x562baed28d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:20.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.411+0000 7fdfa4dbdb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baeaf48c0 con 0x562baed25a40 2023-08-10T11:59:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.411+0000 7fdfa4dbdb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baed25690 con 0x562baed20550 2023-08-10T11:59:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.411+0000 7fdfa4dbdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baed36670 con 0x562baed26360 2023-08-10T11:59:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.411+0000 7fdf91d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562baed25a40 0x562baed2be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.411+0000 7fdf92d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562baed26360 0x562baed28d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.411+0000 7fdf91d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562baed25a40 0x562baed2be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35546/0 (socket says 172.21.15.73:35546) 2023-08-10T11:59:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.411+0000 7fdf9259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562baed20550 0x562baed1ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.411+0000 7fdf91d9b700 1 -- 172.21.15.73:0/1198577055 learned_addr learned my addr 172.21.15.73:0/1198577055 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.412+0000 7fdf91d9b700 1 -- 172.21.15.73:0/1198577055 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562baed26360 msgr2=0x562baed28d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.412+0000 7fdf91d9b700 1 --2- 172.21.15.73:0/1198577055 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562baed26360 0x562baed28d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.412+0000 7fdf91d9b700 1 -- 172.21.15.73:0/1198577055 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562baed20550 msgr2=0x562baed1ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.412+0000 7fdf91d9b700 1 --2- 172.21.15.73:0/1198577055 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562baed20550 0x562baed1ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.412+0000 7fdf91d9b700 1 -- 172.21.15.73:0/1198577055 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562baea9ed80 con 0x562baed25a40 2023-08-10T11:59:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.412+0000 7fdf92d9d700 1 --2- 172.21.15.73:0/1198577055 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562baed26360 0x562baed28d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:59:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.412+0000 7fdf91d9b700 1 --2- 172.21.15.73:0/1198577055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562baed25a40 0x562baed2be90 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fdf8409a0b0 tx=0x7fdf8409d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e41f15f1d951bcd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.412+0000 7fdf817fa700 1 -- 172.21.15.73:0/1198577055 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf840984c0 con 0x562baed25a40 2023-08-10T11:59:20.417 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.412+0000 7fdf817fa700 1 -- 172.21.15.73:0/1198577055 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf8400cd30 con 0x562baed25a40 2023-08-10T11:59:20.417 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.412+0000 7fdf817fa700 1 -- 172.21.15.73:0/1198577055 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8409a5e0 con 0x562baed25a40 2023-08-10T11:59:20.419 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.412+0000 7fdfa4dbdb80 1 -- 172.21.15.73:0/1198577055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562baed25a40 msgr2=0x562baed2be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:20.419 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.412+0000 7fdfa4dbdb80 1 --2- 172.21.15.73:0/1198577055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562baed25a40 0x562baed2be90 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fdf8409a0b0 tx=0x7fdf8409d040 comp rx=0 tx=0).stop 2023-08-10T11:59:20.420 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.413+0000 7fdfa4dbdb80 1 -- 172.21.15.73:0/1198577055 shutdown_connections 2023-08-10T11:59:20.420 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.413+0000 7fdfa4dbdb80 1 --2- 172.21.15.73:0/1198577055 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562baed20550 0x562baed1ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.420 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.413+0000 7fdfa4dbdb80 1 --2- 172.21.15.73:0/1198577055 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562baed26360 0x562baed28d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.420 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.413+0000 7fdfa4dbdb80 1 --2- 172.21.15.73:0/1198577055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562baed25a40 0x562baed2be90 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.420 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.413+0000 7fdfa4dbdb80 1 -- 172.21.15.73:0/1198577055 >> 172.21.15.73:0/1198577055 conn(0x562baec7dc70 msgr2=0x562baed23810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:20.420 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.413+0000 7fdfa4dbdb80 1 -- 172.21.15.73:0/1198577055 shutdown_connections 2023-08-10T11:59:20.420 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.413+0000 7fdfa4dbdb80 1 -- 172.21.15.73:0/1198577055 wait complete. 2023-08-10T11:59:20.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.413+0000 7fdfa4dbdb80 1 -- start start 2023-08-10T11:59:20.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.413+0000 7fdfa4dbdb80 1 Processor -- start 2023-08-10T11:59:20.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.413+0000 7fdfa4dbdb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562baed20550 0x562baed2eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:20.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.413+0000 7fdfa4dbdb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562baed25a40 0x562baed2f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:20.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.413+0000 7fdfa4dbdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562baed26360 0x562baed8c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:20.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.413+0000 7fdfa4dbdb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baed8cdf0 con 0x562baed25a40 2023-08-10T11:59:20.421 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.413+0000 7fdfa4dbdb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baed8cf60 con 0x562baed20550 2023-08-10T11:59:20.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.413+0000 7fdfa4dbdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baed8d120 con 0x562baed26360 2023-08-10T11:59:20.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.413+0000 7fdfa4dbdb80 10 client.0 _ll_register_callbacks cb 0x562baec0e620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:59:20.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.413+0000 7fdf91d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562baed25a40 0x562baed2f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:20.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.413+0000 7fdf9259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562baed20550 0x562baed2eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:20.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.413+0000 7fdf91d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562baed25a40 0x562baed2f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35552/0 (socket says 172.21.15.73:35552) 2023-08-10T11:59:20.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.413+0000 7fdf92d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562baed26360 0x562baed8c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:20.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.413+0000 7fdf91d9b700 1 -- 172.21.15.73:0/2808132132 learned_addr learned my addr 172.21.15.73:0/2808132132 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:20.422 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.414+0000 7fdf91d9b700 1 -- 172.21.15.73:0/2808132132 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562baed26360 msgr2=0x562baed8c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:20.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.414+0000 7fdf91d9b700 1 --2- 172.21.15.73:0/2808132132 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562baed26360 0x562baed8c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.414+0000 7fdf91d9b700 1 -- 172.21.15.73:0/2808132132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562baed20550 msgr2=0x562baed2eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:20.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.414+0000 7fdf91d9b700 1 --2- 172.21.15.73:0/2808132132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562baed20550 0x562baed2eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.414+0000 7fdf91d9b700 1 -- 172.21.15.73:0/2808132132 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9410cd60 con 0x562baed25a40 2023-08-10T11:59:20.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.414+0000 7fdf92d9d700 1 --2- 172.21.15.73:0/2808132132 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562baed26360 0x562baed8c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:59:20.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.414+0000 7fdf91d9b700 1 --2- 172.21.15.73:0/2808132132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562baed25a40 0x562baed2f530 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400c5b0 tx=0x7fdf8400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aefb04fb081ea23b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:20.423 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.414+0000 7fdf79ffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:59:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.414+0000 7fdf79ffb700 1 -- 172.21.15.73:0/2808132132 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf840cac30 con 0x562baed25a40 2023-08-10T11:59:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.414+0000 7fdfa4dbdb80 1 -- 172.21.15.73:0/2808132132 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdf88021070 con 0x562baed25a40 2023-08-10T11:59:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.414+0000 7fdf79ffb700 1 -- 172.21.15.73:0/2808132132 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fdf84099610 con 0x562baed25a40 2023-08-10T11:59:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.414+0000 7fdf79ffb700 1 -- 172.21.15.73:0/2808132132 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf84004390 con 0x562baed25a40 2023-08-10T11:59:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.414+0000 7fdfa4dbdb80 10 client.16539 fetch_fsmap learned FSMap version 43 2023-08-10T11:59:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.414+0000 7fdfa4dbdb80 1 -- 172.21.15.73:0/2808132132 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x7fdf8c009d00 con 0x562baed25a40 2023-08-10T11:59:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.414+0000 7fdf79ffb700 1 -- 172.21.15.73:0/2808132132 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf88021070 con 0x562baed25a40 2023-08-10T11:59:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.414+0000 7fdf79ffb700 1 -- 172.21.15.73:0/2808132132 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 43) v1 ==== 6965+0+0 (secure 0 0 0) 0x7fdf840a20e0 con 0x562baed25a40 2023-08-10T11:59:20.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.414+0000 7fdfa4dbdb80 10 client.16539 fetch_fsmap finished waiting for FSMap version 43 2023-08-10T11:59:20.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.414+0000 7fdfa4dbdb80 10 client.16539 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:59:20.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.414+0000 7fdfa4dbdb80 20 client.16539 populate_metadata read hostname 'smithi073' 2023-08-10T11:59:20.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.414+0000 7fdfa4dbdb80 1 --2- 172.21.15.73:0/2808132132 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x562baed39c40 0x562baed904c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:20.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.414+0000 7fdfa4dbdb80 4 client.16539 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:59:20.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.414+0000 7fdfa4dbdb80 1 -- 172.21.15.73:0/2808132132 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562baec6a720 con 0x562baed39c40 2023-08-10T11:59:20.425 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.415+0000 7fdf9259c700 1 --2- 172.21.15.73:0/2808132132 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x562baed39c40 0x562baed904c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:20.426 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.415+0000 7fdf9259c700 1 --2- 172.21.15.73:0/2808132132 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x562baed39c40 0x562baed904c0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc424eaed972207a server_cookie=a58ec0d2e7f22b5b in_seq=0 out_seq=0 2023-08-10T11:59:20.426 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.415+0000 7fdf79ffb700 10 client.16539 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:59:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.612+0000 7fdf79ffb700 1 -- 172.21.15.73:0/2808132132 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562baec6a720 con 0x562baed39c40 2023-08-10T11:59:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.612+0000 7fdf79ffb700 10 client.16539 handle_command_reply: tid=0 2023-08-10T11:59:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.612+0000 7fdfa4dbdb80 1 client.16539 shutdown 2023-08-10T11:59:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.612+0000 7fdfa4dbdb80 1 -- 172.21.15.73:0/2808132132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562baed25a40 msgr2=0x562baed2f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.612+0000 7fdfa4dbdb80 1 --2- 172.21.15.73:0/2808132132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562baed25a40 0x562baed2f530 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400c5b0 tx=0x7fdf8400cea0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.613+0000 7fdfa4dbdb80 1 -- 172.21.15.73:0/2808132132 shutdown_connections 2023-08-10T11:59:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.613+0000 7fdfa4dbdb80 1 --2- 172.21.15.73:0/2808132132 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x562baed39c40 0x562baed904c0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.613+0000 7fdfa4dbdb80 1 --2- 172.21.15.73:0/2808132132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562baed20550 0x562baed2eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.613+0000 7fdfa4dbdb80 1 --2- 172.21.15.73:0/2808132132 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562baed26360 0x562baed8c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.613+0000 7fdfa4dbdb80 1 --2- 172.21.15.73:0/2808132132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562baed25a40 0x562baed2f530 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.613+0000 7fdf79ffb700 0 client.16539 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:59:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.613+0000 7fdfa4dbdb80 1 -- 172.21.15.73:0/2808132132 >> 172.21.15.73:0/2808132132 conn(0x562baec7dc70 msgr2=0x562baed24760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:20.617 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.613+0000 7fdfa4dbdb80 1 -- 172.21.15.73:0/2808132132 shutdown_connections 2023-08-10T11:59:20.617 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.613+0000 7fdfa4dbdb80 1 -- 172.21.15.73:0/2808132132 wait complete. 2023-08-10T11:59:20.617 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.613+0000 7fdfa4dbdb80 20 client.16539 trim_cache size 0 max 16384 2023-08-10T11:59:20.617 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:59:20.617 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:59:20.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:59:20.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:59:20.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.613+0000 7fdf98c24700 1 -- 172.21.15.73:0/3687584080 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fdf7c0a12c0 msgr2=0x7fdf7c0a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:20.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.613+0000 7fdf98c24700 1 --2- 172.21.15.73:0/3687584080 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fdf7c0a12c0 0x7fdf7c0a3780 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009c60 tx=0x7fdf88009260 comp rx=0 tx=0).stop 2023-08-10T11:59:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.613+0000 7fdf98c24700 1 -- 172.21.15.73:0/3687584080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf94104940 msgr2=0x7fdf940fb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.613+0000 7fdf98c24700 1 --2- 172.21.15.73:0/3687584080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf94104940 0x7fdf940fb660 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400ea30 tx=0x7fdf8400ed40 comp rx=0 tx=0).stop 2023-08-10T11:59:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.614+0000 7fdf98c24700 1 -- 172.21.15.73:0/3687584080 shutdown_connections 2023-08-10T11:59:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.614+0000 7fdf98c24700 1 --2- 172.21.15.73:0/3687584080 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fdf7c0a12c0 0x7fdf7c0a3780 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.614+0000 7fdf98c24700 1 --2- 172.21.15.73:0/3687584080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf940fff90 0x7fdf940fb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.614+0000 7fdf98c24700 1 --2- 172.21.15.73:0/3687584080 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf941a2a90 0x7fdf941a4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.614+0000 7fdf98c24700 1 --2- 172.21.15.73:0/3687584080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf94104940 0x7fdf940fb660 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.614+0000 7fdf98c24700 1 -- 172.21.15.73:0/3687584080 >> 172.21.15.73:0/3687584080 conn(0x7fdf94076b40 msgr2=0x7fdf941030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.614+0000 7fdf98c24700 1 -- 172.21.15.73:0/3687584080 shutdown_connections 2023-08-10T11:59:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:20.614+0000 7fdf98c24700 1 -- 172.21.15.73:0/3687584080 wait complete. 2023-08-10T11:59:21.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:21 smithi152 ceph-mon[130220]: pgmap v206: 97 pgs: 97 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 1.0 MiB/s wr, 40 op/s 2023-08-10T11:59:21.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:21 smithi156 ceph-mon[130574]: pgmap v206: 97 pgs: 97 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 1.0 MiB/s wr, 40 op/s 2023-08-10T11:59:21.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:21 smithi073 ceph-mon[128869]: pgmap v206: 97 pgs: 97 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 1.0 MiB/s wr, 40 op/s 2023-08-10T11:59:23.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:23 smithi152 ceph-mon[130220]: pgmap v207: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 35 op/s 2023-08-10T11:59:23.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:23 smithi156 ceph-mon[130574]: pgmap v207: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 35 op/s 2023-08-10T11:59:23.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:23 smithi073 ceph-mon[128869]: pgmap v207: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 35 op/s 2023-08-10T11:59:23.946 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:59:24.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.079+0000 7f3e6fda9700 1 -- 172.21.15.73:0/2590783260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e68105690 msgr2=0x7f3e68105a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:24.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.079+0000 7f3e6fda9700 1 --2- 172.21.15.73:0/2590783260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e68105690 0x7f3e68105a70 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3e580099c0 tx=0x7f3e58009cd0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.079+0000 7f3e6fda9700 1 -- 172.21.15.73:0/2590783260 shutdown_connections 2023-08-10T11:59:24.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.079+0000 7f3e6fda9700 1 --2- 172.21.15.73:0/2590783260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e680fff90 0x7f3e6810c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.079+0000 7f3e6fda9700 1 --2- 172.21.15.73:0/2590783260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e68105690 0x7f3e68105a70 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.079+0000 7f3e6fda9700 1 --2- 172.21.15.73:0/2590783260 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e680ff5d0 0x7f3e680ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.079+0000 7f3e6fda9700 1 -- 172.21.15.73:0/2590783260 >> 172.21.15.73:0/2590783260 conn(0x7f3e680fb0c0 msgr2=0x7f3e680fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:24.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.079+0000 7f3e6fda9700 1 -- 172.21.15.73:0/2590783260 shutdown_connections 2023-08-10T11:59:24.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.079+0000 7f3e6fda9700 1 -- 172.21.15.73:0/2590783260 wait complete. 2023-08-10T11:59:24.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.080+0000 7f3e6fda9700 1 Processor -- start 2023-08-10T11:59:24.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.080+0000 7f3e6fda9700 1 -- start start 2023-08-10T11:59:24.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.080+0000 7f3e6fda9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e680ff5d0 0x7f3e681956c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:24.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.080+0000 7f3e6fda9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e680fff90 0x7f3e68195c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:24.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.080+0000 7f3e6fda9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e68105690 0x7f3e68198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:24.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.080+0000 7f3e6fda9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e681995b0 con 0x7f3e680fff90 2023-08-10T11:59:24.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.080+0000 7f3e6fda9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e68199720 con 0x7f3e680ff5d0 2023-08-10T11:59:24.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.080+0000 7f3e6fda9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e681998e0 con 0x7f3e68105690 2023-08-10T11:59:24.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.080+0000 7f3e6d344700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e680fff90 0x7f3e68195c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:24.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.080+0000 7f3e6d344700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e680fff90 0x7f3e68195c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35566/0 (socket says 172.21.15.73:35566) 2023-08-10T11:59:24.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.080+0000 7f3e6d344700 1 -- 172.21.15.73:0/1332645221 learned_addr learned my addr 172.21.15.73:0/1332645221 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:24.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.080+0000 7f3e6e346700 1 --2- 172.21.15.73:0/1332645221 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e68105690 0x7f3e68198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:24.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.080+0000 7f3e6db45700 1 --2- 172.21.15.73:0/1332645221 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e680ff5d0 0x7f3e681956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:24.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.081+0000 7f3e6d344700 1 -- 172.21.15.73:0/1332645221 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e68105690 msgr2=0x7f3e68198fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:24.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.081+0000 7f3e6d344700 1 --2- 172.21.15.73:0/1332645221 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e68105690 0x7f3e68198fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.081+0000 7f3e6d344700 1 -- 172.21.15.73:0/1332645221 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e680ff5d0 msgr2=0x7f3e681956c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:24.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.081+0000 7f3e6d344700 1 --2- 172.21.15.73:0/1332645221 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e680ff5d0 0x7f3e681956c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.081+0000 7f3e6d344700 1 -- 172.21.15.73:0/1332645221 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e580095f0 con 0x7f3e680fff90 2023-08-10T11:59:24.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.081+0000 7f3e6d344700 1 --2- 172.21.15.73:0/1332645221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e680fff90 0x7f3e68195c00 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400e9a0 tx=0x7f3e6400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:24.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.081+0000 7f3e5effd700 1 -- 172.21.15.73:0/1332645221 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e64009790 con 0x7f3e680fff90 2023-08-10T11:59:24.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.081+0000 7f3e5effd700 1 -- 172.21.15.73:0/1332645221 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e64010430 con 0x7f3e680fff90 2023-08-10T11:59:24.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.081+0000 7f3e5effd700 1 -- 172.21.15.73:0/1332645221 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e64018680 con 0x7f3e680fff90 2023-08-10T11:59:24.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.081+0000 7f3e6fda9700 1 -- 172.21.15.73:0/1332645221 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e68199bc0 con 0x7f3e680fff90 2023-08-10T11:59:24.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.081+0000 7f3e6fda9700 1 -- 172.21.15.73:0/1332645221 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e681a2520 con 0x7f3e680fff90 2023-08-10T11:59:24.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.083+0000 7f3e5effd700 1 -- 172.21.15.73:0/1332645221 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f3e640105a0 con 0x7f3e680fff90 2023-08-10T11:59:24.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.084+0000 7f3e5effd700 1 --2- 172.21.15.73:0/1332645221 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f3e540a12c0 0x7f3e540a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:24.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.084+0000 7f3e6db45700 1 --2- 172.21.15.73:0/1332645221 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f3e540a12c0 0x7f3e540a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:24.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.084+0000 7f3e5effd700 1 -- 172.21.15.73:0/1332645221 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f3e64014070 con 0x7f3e680fff90 2023-08-10T11:59:24.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.084+0000 7f3e6db45700 1 --2- 172.21.15.73:0/1332645221 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f3e540a12c0 0x7f3e540a3780 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3e58009990 tx=0x7f3e58005fb0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:24.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.085+0000 7f3e7bf42b80 1 Processor -- start 2023-08-10T11:59:24.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.085+0000 7f3e7bf42b80 1 -- start start 2023-08-10T11:59:24.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.085+0000 7f3e7bf42b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f8d763040 0x561f8d7612c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:24.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.085+0000 7f3e7bf42b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561f8d761800 0x561f8d761c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:24.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.085+0000 7f3e7bf42b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561f8d76f940 0x561f8d771d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:24.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.085+0000 7f3e7bf42b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f8d6dcdc0 con 0x561f8d761800 2023-08-10T11:59:24.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.085+0000 7f3e7bf42b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f8d6b9590 con 0x561f8d76f940 2023-08-10T11:59:24.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.085+0000 7f3e7bf42b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f8d6b6eb0 con 0x561f8d763040 2023-08-10T11:59:24.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.085+0000 7f3e6d344700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561f8d761800 0x561f8d761c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:24.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.085+0000 7f3e6db45700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f8d763040 0x561f8d7612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:24.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.085+0000 7f3e6e346700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561f8d76f940 0x561f8d771d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:24.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.085+0000 7f3e6d344700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561f8d761800 0x561f8d761c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35574/0 (socket says 172.21.15.73:35574) 2023-08-10T11:59:24.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.085+0000 7f3e6db45700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f8d763040 0x561f8d7612c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:32844/0 (socket says 172.21.15.73:32844) 2023-08-10T11:59:24.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.085+0000 7f3e6d344700 1 -- 172.21.15.73:0/2472363261 learned_addr learned my addr 172.21.15.73:0/2472363261 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:24.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.085+0000 7f3e6d344700 1 -- 172.21.15.73:0/2472363261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f8d763040 msgr2=0x561f8d7612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:24.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.085+0000 7f3e6d344700 1 --2- 172.21.15.73:0/2472363261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f8d763040 0x561f8d7612c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.085+0000 7f3e6d344700 1 -- 172.21.15.73:0/2472363261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561f8d76f940 msgr2=0x561f8d771d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:24.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.085+0000 7f3e6d344700 1 --2- 172.21.15.73:0/2472363261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561f8d76f940 0x561f8d771d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.085+0000 7f3e6d344700 1 -- 172.21.15.73:0/2472363261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f8d533630 con 0x561f8d761800 2023-08-10T11:59:24.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.086+0000 7f3e6d344700 1 --2- 172.21.15.73:0/2472363261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561f8d761800 0x561f8d761c80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3e640a1ed0 tx=0x7f3e64099fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba552cd972950fb1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:24.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.086+0000 7f3e53fff700 1 -- 172.21.15.73:0/2472363261 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e64010880 con 0x561f8d761800 2023-08-10T11:59:24.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.086+0000 7f3e53fff700 1 -- 172.21.15.73:0/2472363261 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e640109e0 con 0x561f8d761800 2023-08-10T11:59:24.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.086+0000 7f3e53fff700 1 -- 172.21.15.73:0/2472363261 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e640a1f70 con 0x561f8d761800 2023-08-10T11:59:24.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.086+0000 7f3e7bf42b80 1 -- 172.21.15.73:0/2472363261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561f8d761800 msgr2=0x561f8d761c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:24.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.086+0000 7f3e7bf42b80 1 --2- 172.21.15.73:0/2472363261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561f8d761800 0x561f8d761c80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3e640a1ed0 tx=0x7f3e64099fb0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.086+0000 7f3e7bf42b80 1 -- 172.21.15.73:0/2472363261 shutdown_connections 2023-08-10T11:59:24.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.086+0000 7f3e7bf42b80 1 --2- 172.21.15.73:0/2472363261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561f8d76f940 0x561f8d771d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.086+0000 7f3e7bf42b80 1 --2- 172.21.15.73:0/2472363261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f8d763040 0x561f8d7612c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.086+0000 7f3e7bf42b80 1 --2- 172.21.15.73:0/2472363261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561f8d761800 0x561f8d761c80 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.086+0000 7f3e7bf42b80 1 -- 172.21.15.73:0/2472363261 >> 172.21.15.73:0/2472363261 conn(0x561f8d6becd0 msgr2=0x561f8d75c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:24.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.087+0000 7f3e7bf42b80 1 -- 172.21.15.73:0/2472363261 shutdown_connections 2023-08-10T11:59:24.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.087+0000 7f3e7bf42b80 1 -- 172.21.15.73:0/2472363261 wait complete. 2023-08-10T11:59:24.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.087+0000 7f3e7bf42b80 1 -- start start 2023-08-10T11:59:24.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.087+0000 7f3e7bf42b80 1 Processor -- start 2023-08-10T11:59:24.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.087+0000 7f3e7bf42b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561f8d761800 0x561f8d76c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:24.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.087+0000 7f3e7bf42b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f8d763040 0x561f8d76cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:24.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.087+0000 7f3e7bf42b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561f8d76f940 0x561f8d76d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:24.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.087+0000 7f3e7bf42b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f8d6b27a0 con 0x561f8d76f940 2023-08-10T11:59:24.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.087+0000 7f3e7bf42b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f8d651ac0 con 0x561f8d761800 2023-08-10T11:59:24.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.087+0000 7f3e7bf42b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f8d6517c0 con 0x561f8d763040 2023-08-10T11:59:24.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.087+0000 7f3e7bf42b80 10 client.0 _ll_register_callbacks cb 0x561f8d64f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:59:24.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.088+0000 7f3e6db45700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561f8d761800 0x561f8d76c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:24.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.088+0000 7f3e6e346700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561f8d76f940 0x561f8d76d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:24.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.088+0000 7f3e6db45700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561f8d761800 0x561f8d76c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:50228/0 (socket says 172.21.15.73:50228) 2023-08-10T11:59:24.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.088+0000 7f3e6db45700 1 -- 172.21.15.73:0/3678513294 learned_addr learned my addr 172.21.15.73:0/3678513294 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:24.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.088+0000 7f3e6d344700 1 --2- 172.21.15.73:0/3678513294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f8d763040 0x561f8d76cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:24.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.088+0000 7f3e6e346700 1 -- 172.21.15.73:0/3678513294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f8d763040 msgr2=0x561f8d76cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:24.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.088+0000 7f3e6e346700 1 --2- 172.21.15.73:0/3678513294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f8d763040 0x561f8d76cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.088+0000 7f3e6e346700 1 -- 172.21.15.73:0/3678513294 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561f8d761800 msgr2=0x561f8d76c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:24.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.088+0000 7f3e6e346700 1 --2- 172.21.15.73:0/3678513294 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561f8d761800 0x561f8d76c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.088+0000 7f3e6e346700 1 -- 172.21.15.73:0/3678513294 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e681a2520 con 0x561f8d76f940 2023-08-10T11:59:24.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.088+0000 7f3e6e346700 1 --2- 172.21.15.73:0/3678513294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561f8d76f940 0x561f8d76d0f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3e60011e60 tx=0x7f3e60014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc666d4d5f8d0f58 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:24.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.088+0000 7f3e517fa700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:59:24.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.088+0000 7f3e517fa700 1 -- 172.21.15.73:0/3678513294 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6000e040 con 0x561f8d76f940 2023-08-10T11:59:24.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.088+0000 7f3e7bf42b80 1 -- 172.21.15.73:0/3678513294 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561f8d754470 con 0x561f8d76f940 2023-08-10T11:59:24.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.088+0000 7f3e517fa700 1 -- 172.21.15.73:0/3678513294 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f3e600093a0 con 0x561f8d76f940 2023-08-10T11:59:24.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.088+0000 7f3e517fa700 1 -- 172.21.15.73:0/3678513294 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e60004db0 con 0x561f8d76f940 2023-08-10T11:59:24.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.088+0000 7f3e7bf42b80 10 client.16551 fetch_fsmap learned FSMap version 43 2023-08-10T11:59:24.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.088+0000 7f3e7bf42b80 1 -- 172.21.15.73:0/3678513294 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x561f8d4dfde0 con 0x561f8d76f940 2023-08-10T11:59:24.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.089+0000 7f3e517fa700 1 -- 172.21.15.73:0/3678513294 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561f8d754470 con 0x561f8d76f940 2023-08-10T11:59:24.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.089+0000 7f3e517fa700 1 -- 172.21.15.73:0/3678513294 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 43) v1 ==== 6965+0+0 (secure 0 0 0) 0x7f3e6001c030 con 0x561f8d76f940 2023-08-10T11:59:24.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.089+0000 7f3e7bf42b80 10 client.16551 fetch_fsmap finished waiting for FSMap version 43 2023-08-10T11:59:24.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.089+0000 7f3e7bf42b80 10 client.16551 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:59:24.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.089+0000 7f3e7bf42b80 20 client.16551 populate_metadata read hostname 'smithi073' 2023-08-10T11:59:24.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.089+0000 7f3e7bf42b80 1 --2- 172.21.15.73:0/3678513294 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561f8d77f7f0 0x561f8d781c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:24.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.089+0000 7f3e7bf42b80 4 client.16551 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:59:24.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.089+0000 7f3e7bf42b80 1 -- 172.21.15.73:0/3678513294 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561f8d7309d0 con 0x561f8d77f7f0 2023-08-10T11:59:24.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.089+0000 7f3e6db45700 1 --2- 172.21.15.73:0/3678513294 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561f8d77f7f0 0x561f8d781c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:24.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.089+0000 7f3e517fa700 10 client.16551 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:59:24.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.089+0000 7f3e6db45700 1 --2- 172.21.15.73:0/3678513294 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561f8d77f7f0 0x561f8d781c10 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2e4624294503a01 server_cookie=85ffb618161b3fee in_seq=0 out_seq=0 2023-08-10T11:59:24.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.090+0000 7f3e517fa700 1 -- 172.21.15.73:0/3678513294 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x561f8d7309d0 con 0x561f8d77f7f0 2023-08-10T11:59:24.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.090+0000 7f3e517fa700 10 client.16551 handle_command_reply: tid=0 2023-08-10T11:59:24.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.090+0000 7f3e7bf42b80 1 client.16551 shutdown 2023-08-10T11:59:24.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.090+0000 7f3e7bf42b80 1 -- 172.21.15.73:0/3678513294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561f8d76f940 msgr2=0x561f8d76d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:24.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.090+0000 7f3e7bf42b80 1 --2- 172.21.15.73:0/3678513294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561f8d76f940 0x561f8d76d0f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3e60011e60 tx=0x7f3e60014600 comp rx=0 tx=0).stop 2023-08-10T11:59:24.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.090+0000 7f3e7bf42b80 1 -- 172.21.15.73:0/3678513294 shutdown_connections 2023-08-10T11:59:24.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.090+0000 7f3e7bf42b80 1 --2- 172.21.15.73:0/3678513294 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561f8d77f7f0 0x561f8d781c10 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.090+0000 7f3e7bf42b80 1 --2- 172.21.15.73:0/3678513294 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561f8d761800 0x561f8d76c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.090+0000 7f3e7bf42b80 1 --2- 172.21.15.73:0/3678513294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561f8d76f940 0x561f8d76d0f0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.090+0000 7f3e7bf42b80 1 --2- 172.21.15.73:0/3678513294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f8d763040 0x561f8d76cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.090+0000 7f3e517fa700 0 client.16551 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:59:24.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.090+0000 7f3e7bf42b80 1 -- 172.21.15.73:0/3678513294 >> 172.21.15.73:0/3678513294 conn(0x561f8d6becd0 msgr2=0x561f8d75b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:24.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.090+0000 7f3e7bf42b80 1 -- 172.21.15.73:0/3678513294 shutdown_connections 2023-08-10T11:59:24.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.090+0000 7f3e7bf42b80 1 -- 172.21.15.73:0/3678513294 wait complete. 2023-08-10T11:59:24.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.091+0000 7f3e7bf42b80 20 client.16551 trim_cache size 0 max 16384 2023-08-10T11:59:24.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.107+0000 7f3e7bf42b80 1 Processor -- start 2023-08-10T11:59:24.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.107+0000 7f3e7bf42b80 1 -- start start 2023-08-10T11:59:24.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.107+0000 7f3e7bf42b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561f8d761800 0x561f8d7612c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:24.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.107+0000 7f3e7bf42b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f8d763040 0x561f8d7767a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:24.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.107+0000 7f3e7bf42b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561f8d76f940 0x561f8d76e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:24.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.107+0000 7f3e7bf42b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f8d535920 con 0x561f8d761800 2023-08-10T11:59:24.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.107+0000 7f3e7bf42b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f8d76d780 con 0x561f8d76f940 2023-08-10T11:59:24.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.107+0000 7f3e7bf42b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f8d77ce30 con 0x561f8d763040 2023-08-10T11:59:24.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.107+0000 7f3e6db45700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561f8d761800 0x561f8d7612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:24.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.107+0000 7f3e6db45700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561f8d761800 0x561f8d7612c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35586/0 (socket says 172.21.15.73:35586) 2023-08-10T11:59:24.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.107+0000 7f3e6db45700 1 -- 172.21.15.73:0/3054464210 learned_addr learned my addr 172.21.15.73:0/3054464210 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:24.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.107+0000 7f3e6d344700 1 --2- 172.21.15.73:0/3054464210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f8d763040 0x561f8d7767a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:24.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.107+0000 7f3e6e346700 1 --2- 172.21.15.73:0/3054464210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561f8d76f940 0x561f8d76e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:24.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.107+0000 7f3e6db45700 1 -- 172.21.15.73:0/3054464210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f8d763040 msgr2=0x561f8d7767a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:24.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.107+0000 7f3e6db45700 1 --2- 172.21.15.73:0/3054464210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f8d763040 0x561f8d7767a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.107+0000 7f3e6db45700 1 -- 172.21.15.73:0/3054464210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561f8d76f940 msgr2=0x561f8d76e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:24.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.107+0000 7f3e6db45700 1 --2- 172.21.15.73:0/3054464210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561f8d76f940 0x561f8d76e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.107+0000 7f3e6db45700 1 -- 172.21.15.73:0/3054464210 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f8d4c8c60 con 0x561f8d761800 2023-08-10T11:59:24.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.108+0000 7f3e6db45700 1 --2- 172.21.15.73:0/3054464210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561f8d761800 0x561f8d7612c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f3e580098e0 tx=0x7f3e58022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20fd0f9c0823fc3b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:24.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.108+0000 7f3e5cff9700 1 -- 172.21.15.73:0/3054464210 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5802c040 con 0x561f8d761800 2023-08-10T11:59:24.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.108+0000 7f3e5cff9700 1 -- 172.21.15.73:0/3054464210 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e5802d040 con 0x561f8d761800 2023-08-10T11:59:24.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.108+0000 7f3e5cff9700 1 -- 172.21.15.73:0/3054464210 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e58004240 con 0x561f8d761800 2023-08-10T11:59:24.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.108+0000 7f3e7bf42b80 1 -- 172.21.15.73:0/3054464210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561f8d761800 msgr2=0x561f8d7612c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:24.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.108+0000 7f3e7bf42b80 1 --2- 172.21.15.73:0/3054464210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561f8d761800 0x561f8d7612c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f3e580098e0 tx=0x7f3e58022000 comp rx=0 tx=0).stop 2023-08-10T11:59:24.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.108+0000 7f3e7bf42b80 1 -- 172.21.15.73:0/3054464210 shutdown_connections 2023-08-10T11:59:24.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.108+0000 7f3e7bf42b80 1 --2- 172.21.15.73:0/3054464210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561f8d76f940 0x561f8d76e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.108+0000 7f3e7bf42b80 1 --2- 172.21.15.73:0/3054464210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561f8d761800 0x561f8d7612c0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.108+0000 7f3e7bf42b80 1 --2- 172.21.15.73:0/3054464210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f8d763040 0x561f8d7767a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.108+0000 7f3e7bf42b80 1 -- 172.21.15.73:0/3054464210 >> 172.21.15.73:0/3054464210 conn(0x561f8d6becd0 msgr2=0x561f8d76df80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:24.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.108+0000 7f3e7bf42b80 1 -- 172.21.15.73:0/3054464210 shutdown_connections 2023-08-10T11:59:24.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.109+0000 7f3e7bf42b80 1 -- 172.21.15.73:0/3054464210 wait complete. 2023-08-10T11:59:24.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.109+0000 7f3e7bf42b80 1 -- start start 2023-08-10T11:59:24.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.109+0000 7f3e7bf42b80 1 Processor -- start 2023-08-10T11:59:24.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.109+0000 7f3e7bf42b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561f8d761800 0x561f8d7ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:24.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.109+0000 7f3e7bf42b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f8d763040 0x561f8d7ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:24.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.109+0000 7f3e7bf42b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561f8d76f940 0x561f8d7c7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:24.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.109+0000 7f3e7bf42b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f8d7c79f0 con 0x561f8d761800 2023-08-10T11:59:24.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.109+0000 7f3e7bf42b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f8d7c7b60 con 0x561f8d76f940 2023-08-10T11:59:24.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.109+0000 7f3e7bf42b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f8d7c7d20 con 0x561f8d763040 2023-08-10T11:59:24.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.109+0000 7f3e7bf42b80 10 client.0 _ll_register_callbacks cb 0x561f8d64f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:59:24.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.109+0000 7f3e6db45700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561f8d761800 0x561f8d7ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:24.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.109+0000 7f3e6db45700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561f8d761800 0x561f8d7ccaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35592/0 (socket says 172.21.15.73:35592) 2023-08-10T11:59:24.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.109+0000 7f3e6db45700 1 -- 172.21.15.73:0/469416498 learned_addr learned my addr 172.21.15.73:0/469416498 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:24.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.109+0000 7f3e6e346700 1 --2- 172.21.15.73:0/469416498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561f8d76f940 0x561f8d7c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:24.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.109+0000 7f3e6d344700 1 --2- 172.21.15.73:0/469416498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f8d763040 0x561f8d7ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:24.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.110+0000 7f3e6db45700 1 -- 172.21.15.73:0/469416498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f8d763040 msgr2=0x561f8d7ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:24.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.110+0000 7f3e6db45700 1 --2- 172.21.15.73:0/469416498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f8d763040 0x561f8d7ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.110+0000 7f3e6db45700 1 -- 172.21.15.73:0/469416498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561f8d76f940 msgr2=0x561f8d7c7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:24.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.110+0000 7f3e6db45700 1 --2- 172.21.15.73:0/469416498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561f8d76f940 0x561f8d7c7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.110+0000 7f3e6db45700 1 -- 172.21.15.73:0/469416498 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e6810cd50 con 0x561f8d761800 2023-08-10T11:59:24.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.110+0000 7f3e6d344700 1 --2- 172.21.15.73:0/469416498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f8d763040 0x561f8d7ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:59:24.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.110+0000 7f3e6db45700 1 --2- 172.21.15.73:0/469416498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561f8d761800 0x561f8d7ccaa0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f3e580058e0 tx=0x7f3e58033420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e7044b0bfd0a94 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:24.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.110+0000 7f3e517fa700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:59:24.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.110+0000 7f3e517fa700 1 -- 172.21.15.73:0/469416498 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e58033ac0 con 0x561f8d761800 2023-08-10T11:59:24.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.110+0000 7f3e517fa700 1 -- 172.21.15.73:0/469416498 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f3e58033c20 con 0x561f8d761800 2023-08-10T11:59:24.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.110+0000 7f3e7bf42b80 1 -- 172.21.15.73:0/469416498 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3e640109e0 con 0x561f8d761800 2023-08-10T11:59:24.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.110+0000 7f3e517fa700 1 -- 172.21.15.73:0/469416498 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e58033de0 con 0x561f8d761800 2023-08-10T11:59:24.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.110+0000 7f3e7bf42b80 10 client.16557 fetch_fsmap learned FSMap version 43 2023-08-10T11:59:24.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.110+0000 7f3e7bf42b80 1 -- 172.21.15.73:0/469416498 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x561f8d506250 con 0x561f8d761800 2023-08-10T11:59:24.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.110+0000 7f3e517fa700 1 -- 172.21.15.73:0/469416498 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e640109e0 con 0x561f8d761800 2023-08-10T11:59:24.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.110+0000 7f3e517fa700 1 -- 172.21.15.73:0/469416498 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 43) v1 ==== 6965+0+0 (secure 0 0 0) 0x7f3e5804c970 con 0x561f8d761800 2023-08-10T11:59:24.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.110+0000 7f3e7bf42b80 10 client.16557 fetch_fsmap finished waiting for FSMap version 43 2023-08-10T11:59:24.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.110+0000 7f3e7bf42b80 10 client.16557 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:59:24.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.110+0000 7f3e7bf42b80 20 client.16557 populate_metadata read hostname 'smithi073' 2023-08-10T11:59:24.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.110+0000 7f3e7bf42b80 1 --2- 172.21.15.73:0/469416498 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561f8d7d4440 0x561f8d7d6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:24.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.111+0000 7f3e7bf42b80 4 client.16557 mds_command: new command op to 24503 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:59:24.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.111+0000 7f3e7bf42b80 1 -- 172.21.15.73:0/469416498 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561f8d6ab780 con 0x561f8d7d4440 2023-08-10T11:59:24.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.111+0000 7f3e6d344700 1 --2- 172.21.15.73:0/469416498 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561f8d7d4440 0x561f8d7d6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:24.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.111+0000 7f3e6d344700 1 --2- 172.21.15.73:0/469416498 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561f8d7d4440 0x561f8d7d6830 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67639665d8c11c3 server_cookie=87046869c8b68108 in_seq=0 out_seq=0 2023-08-10T11:59:24.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.111+0000 7f3e517fa700 10 client.16557 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:59:24.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.111+0000 7f3e517fa700 1 -- 172.21.15.73:0/469416498 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x561f8d6ab780 con 0x561f8d7d4440 2023-08-10T11:59:24.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.111+0000 7f3e517fa700 10 client.16557 handle_command_reply: tid=0 2023-08-10T11:59:24.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.111+0000 7f3e7bf42b80 1 client.16557 shutdown 2023-08-10T11:59:24.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.111+0000 7f3e7bf42b80 1 -- 172.21.15.73:0/469416498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561f8d761800 msgr2=0x561f8d7ccaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:24.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.111+0000 7f3e7bf42b80 1 --2- 172.21.15.73:0/469416498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561f8d761800 0x561f8d7ccaa0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f3e580058e0 tx=0x7f3e58033420 comp rx=0 tx=0).stop 2023-08-10T11:59:24.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.111+0000 7f3e7bf42b80 1 -- 172.21.15.73:0/469416498 shutdown_connections 2023-08-10T11:59:24.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.111+0000 7f3e7bf42b80 1 --2- 172.21.15.73:0/469416498 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561f8d7d4440 0x561f8d7d6830 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.111+0000 7f3e7bf42b80 1 --2- 172.21.15.73:0/469416498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561f8d76f940 0x561f8d7c7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.111+0000 7f3e7bf42b80 1 --2- 172.21.15.73:0/469416498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561f8d761800 0x561f8d7ccaa0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.111+0000 7f3e7bf42b80 1 --2- 172.21.15.73:0/469416498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f8d763040 0x561f8d7ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.111+0000 7f3e517fa700 0 client.16557 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:59:24.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.111+0000 7f3e7bf42b80 1 -- 172.21.15.73:0/469416498 >> 172.21.15.73:0/469416498 conn(0x561f8d6becd0 msgr2=0x561f8d76e810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:24.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.112+0000 7f3e7bf42b80 1 -- 172.21.15.73:0/469416498 shutdown_connections 2023-08-10T11:59:24.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.112+0000 7f3e7bf42b80 1 -- 172.21.15.73:0/469416498 wait complete. 2023-08-10T11:59:24.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.112+0000 7f3e7bf42b80 20 client.16557 trim_cache size 0 max 16384 2023-08-10T11:59:24.124 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:59:24.125 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:59:24.125 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": { 2023-08-10T11:59:24.125 INFO:teuthology.orchestra.run.smithi073.stdout: "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d": { 2023-08-10T11:59:24.125 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2023-08-10T11:59:24.125 INFO:teuthology.orchestra.run.smithi073.stdout: "tag": "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d", 2023-08-10T11:59:24.125 INFO:teuthology.orchestra.run.smithi073.stdout: "options": "recursive,force" 2023-08-10T11:59:24.125 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:59:24.126 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:59:24.126 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:59:24.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.112+0000 7f3e6fda9700 1 -- 172.21.15.73:0/1332645221 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f3e540a12c0 msgr2=0x7f3e540a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:24.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.112+0000 7f3e6fda9700 1 --2- 172.21.15.73:0/1332645221 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f3e540a12c0 0x7f3e540a3780 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3e58009990 tx=0x7f3e58005fb0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.112+0000 7f3e6fda9700 1 -- 172.21.15.73:0/1332645221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e680fff90 msgr2=0x7f3e68195c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:24.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.112+0000 7f3e6fda9700 1 --2- 172.21.15.73:0/1332645221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e680fff90 0x7f3e68195c00 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400e9a0 tx=0x7f3e6400ecb0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.112+0000 7f3e6fda9700 1 -- 172.21.15.73:0/1332645221 shutdown_connections 2023-08-10T11:59:24.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.112+0000 7f3e6fda9700 1 --2- 172.21.15.73:0/1332645221 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f3e540a12c0 0x7f3e540a3780 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.112+0000 7f3e6fda9700 1 --2- 172.21.15.73:0/1332645221 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e680ff5d0 0x7f3e681956c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.112+0000 7f3e6fda9700 1 --2- 172.21.15.73:0/1332645221 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e68105690 0x7f3e68198fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.112+0000 7f3e6fda9700 1 --2- 172.21.15.73:0/1332645221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e680fff90 0x7f3e68195c00 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:24.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.112+0000 7f3e6fda9700 1 -- 172.21.15.73:0/1332645221 >> 172.21.15.73:0/1332645221 conn(0x7f3e680fb0c0 msgr2=0x7f3e680fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:24.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.112+0000 7f3e6fda9700 1 -- 172.21.15.73:0/1332645221 shutdown_connections 2023-08-10T11:59:24.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:24.112+0000 7f3e6fda9700 1 -- 172.21.15.73:0/1332645221 wait complete. 2023-08-10T11:59:24.129 INFO:tasks.cephfs.filesystem:scrub status for tag:9d39b3fa-9b62-42b4-b1a5-738cb3118a5d - {'path': '/', 'tag': '9d39b3fa-9b62-42b4-b1a5-738cb3118a5d', 'options': 'recursive,force'} 2023-08-10T11:59:25.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:24 smithi152 ceph-mon[130220]: pgmap v208: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 57 op/s 2023-08-10T11:59:25.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:24 smithi156 ceph-mon[130574]: pgmap v208: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 57 op/s 2023-08-10T11:59:25.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:24 smithi073 ceph-mon[128869]: pgmap v208: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 57 op/s 2023-08-10T11:59:27.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:27 smithi152 ceph-mon[130220]: pgmap v209: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 78 op/s 2023-08-10T11:59:27.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:27 smithi156 ceph-mon[130574]: pgmap v209: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 78 op/s 2023-08-10T11:59:27.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:27 smithi073 ceph-mon[128869]: pgmap v209: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 78 op/s 2023-08-10T11:59:29.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:29 smithi152 ceph-mon[130220]: pgmap v210: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 82 op/s 2023-08-10T11:59:29.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:29 smithi156 ceph-mon[130574]: pgmap v210: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 82 op/s 2023-08-10T11:59:29.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:29 smithi073 ceph-mon[128869]: pgmap v210: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 82 op/s 2023-08-10T11:59:31.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:31 smithi152 ceph-mon[130220]: pgmap v211: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.5 MiB/s wr, 78 op/s 2023-08-10T11:59:31.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:31 smithi156 ceph-mon[130574]: pgmap v211: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.5 MiB/s wr, 78 op/s 2023-08-10T11:59:31.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:31 smithi073 ceph-mon[128869]: pgmap v211: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.5 MiB/s wr, 78 op/s 2023-08-10T11:59:33.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:33 smithi152 ceph-mon[130220]: pgmap v212: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 66 op/s 2023-08-10T11:59:33.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:33 smithi156 ceph-mon[130574]: pgmap v212: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 66 op/s 2023-08-10T11:59:33.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:33 smithi073 ceph-mon[128869]: pgmap v212: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 66 op/s 2023-08-10T11:59:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.731+0000 7fdf74e21700 1 -- 172.21.15.73:0/586230454 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf70100290 msgr2=0x7fdf7010c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.731+0000 7fdf74e21700 1 --2- 172.21.15.73:0/586230454 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf70100290 0x7fdf7010c4a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800b0a0 tx=0x7fdf6800b3b0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.736 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.731+0000 7fdf74e21700 1 -- 172.21.15.73:0/586230454 shutdown_connections 2023-08-10T11:59:33.736 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.731+0000 7fdf74e21700 1 --2- 172.21.15.73:0/586230454 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf70105670 0x7fdf70105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.736 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.731+0000 7fdf74e21700 1 --2- 172.21.15.73:0/586230454 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf70100290 0x7fdf7010c4a0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.736 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.731+0000 7fdf74e21700 1 --2- 172.21.15.73:0/586230454 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf700ff8d0 0x7fdf700ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.736 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.731+0000 7fdf74e21700 1 -- 172.21.15.73:0/586230454 >> 172.21.15.73:0/586230454 conn(0x7fdf700750a0 msgr2=0x7fdf700754b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:33.736 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.731+0000 7fdf74e21700 1 -- 172.21.15.73:0/586230454 shutdown_connections 2023-08-10T11:59:33.736 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.731+0000 7fdf74e21700 1 -- 172.21.15.73:0/586230454 wait complete. 2023-08-10T11:59:33.737 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.732+0000 7fdf74e21700 1 Processor -- start 2023-08-10T11:59:33.737 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.732+0000 7fdf74e21700 1 -- start start 2023-08-10T11:59:33.737 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.732+0000 7fdf74e21700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf700ff8d0 0x7fdf70197790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:33.737 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.732+0000 7fdf74e21700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf70100290 0x7fdf70197cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:33.737 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.732+0000 7fdf74e21700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf70105670 0x7fdf701a2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:33.737 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.732+0000 7fdf74e21700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf701a2c00 con 0x7fdf700ff8d0 2023-08-10T11:59:33.737 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.732+0000 7fdf74e21700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf701a2d70 con 0x7fdf70100290 2023-08-10T11:59:33.738 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.732+0000 7fdf74e21700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf701a2f30 con 0x7fdf70105670 2023-08-10T11:59:33.738 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.732+0000 7fdf6e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf700ff8d0 0x7fdf70197790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:33.738 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.732+0000 7fdf6e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf700ff8d0 0x7fdf70197790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35606/0 (socket says 172.21.15.73:35606) 2023-08-10T11:59:33.738 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.732+0000 7fdf6e59c700 1 -- 172.21.15.73:0/686347121 learned_addr learned my addr 172.21.15.73:0/686347121 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:33.738 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.732+0000 7fdf6ed9d700 1 --2- 172.21.15.73:0/686347121 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf70105670 0x7fdf701a2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:33.738 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.732+0000 7fdf6dd9b700 1 --2- 172.21.15.73:0/686347121 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf70100290 0x7fdf70197cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:33.738 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.733+0000 7fdf6e59c700 1 -- 172.21.15.73:0/686347121 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf70105670 msgr2=0x7fdf701a2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:33.738 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.733+0000 7fdf6e59c700 1 --2- 172.21.15.73:0/686347121 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf70105670 0x7fdf701a2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.733+0000 7fdf6e59c700 1 -- 172.21.15.73:0/686347121 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf70100290 msgr2=0x7fdf70197cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.733+0000 7fdf6e59c700 1 --2- 172.21.15.73:0/686347121 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf70100290 0x7fdf70197cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.733+0000 7fdf6e59c700 1 -- 172.21.15.73:0/686347121 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf68009d00 con 0x7fdf700ff8d0 2023-08-10T11:59:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.733+0000 7fdf6e59c700 1 --2- 172.21.15.73:0/686347121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf700ff8d0 0x7fdf70197790 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400e970 tx=0x7fdf6400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.733+0000 7fdf5f7fe700 1 -- 172.21.15.73:0/686347121 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf64009790 con 0x7fdf700ff8d0 2023-08-10T11:59:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.733+0000 7fdf5f7fe700 1 -- 172.21.15.73:0/686347121 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf6400c7e0 con 0x7fdf700ff8d0 2023-08-10T11:59:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.733+0000 7fdf74e21700 1 -- 172.21.15.73:0/686347121 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf701a3210 con 0x7fdf700ff8d0 2023-08-10T11:59:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.733+0000 7fdf5f7fe700 1 -- 172.21.15.73:0/686347121 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf64003c70 con 0x7fdf700ff8d0 2023-08-10T11:59:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.733+0000 7fdf74e21700 1 -- 172.21.15.73:0/686347121 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf701a3720 con 0x7fdf700ff8d0 2023-08-10T11:59:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.735+0000 7fdf5f7fe700 1 -- 172.21.15.73:0/686347121 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fdf6400cc50 con 0x7fdf700ff8d0 2023-08-10T11:59:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.736+0000 7fdf5f7fe700 1 --2- 172.21.15.73:0/686347121 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fdf580a12c0 0x7fdf580a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.736+0000 7fdf6dd9b700 1 --2- 172.21.15.73:0/686347121 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fdf580a12c0 0x7fdf580a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.736+0000 7fdf5f7fe700 1 -- 172.21.15.73:0/686347121 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fdf64014070 con 0x7fdf700ff8d0 2023-08-10T11:59:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.736+0000 7fdf6dd9b700 1 --2- 172.21.15.73:0/686347121 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fdf580a12c0 0x7fdf580a3780 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdf70068c40 tx=0x7fdf60009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.736+0000 7fdf80fbab80 1 Processor -- start 2023-08-10T11:59:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.737+0000 7fdf80fbab80 1 -- start start 2023-08-10T11:59:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.737+0000 7fdf80fbab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564506460a40 0x564506460e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.737+0000 7fdf80fbab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564506461360 0x56450645b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.737+0000 7fdf80fbab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56450645b550 0x56450645b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.737+0000 7fdf80fbab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645063d6d60 con 0x564506461360 2023-08-10T11:59:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.737+0000 7fdf80fbab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645063b3530 con 0x564506460a40 2023-08-10T11:59:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.737+0000 7fdf80fbab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645063b0e50 con 0x56450645b550 2023-08-10T11:59:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.737+0000 7fdf6dd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564506461360 0x56450645b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.737+0000 7fdf6dd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564506461360 0x56450645b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35616/0 (socket says 172.21.15.73:35616) 2023-08-10T11:59:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.737+0000 7fdf6dd9b700 1 -- 172.21.15.73:0/878351547 learned_addr learned my addr 172.21.15.73:0/878351547 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.737+0000 7fdf6e59c700 1 --2- 172.21.15.73:0/878351547 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564506460a40 0x564506460e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.737+0000 7fdf6ed9d700 1 --2- 172.21.15.73:0/878351547 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56450645b550 0x56450645b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.737+0000 7fdf6dd9b700 1 -- 172.21.15.73:0/878351547 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56450645b550 msgr2=0x56450645b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.737+0000 7fdf6dd9b700 1 --2- 172.21.15.73:0/878351547 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56450645b550 0x56450645b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.737+0000 7fdf6dd9b700 1 -- 172.21.15.73:0/878351547 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564506460a40 msgr2=0x564506460e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.737+0000 7fdf6dd9b700 1 --2- 172.21.15.73:0/878351547 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564506460a40 0x564506460e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.737+0000 7fdf6dd9b700 1 -- 172.21.15.73:0/878351547 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56450622d5d0 con 0x564506461360 2023-08-10T11:59:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.737+0000 7fdf6e59c700 1 --2- 172.21.15.73:0/878351547 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564506460a40 0x564506460e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:59:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.737+0000 7fdf6dd9b700 1 --2- 172.21.15.73:0/878351547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564506461360 0x56450645b010 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fdf60011d50 tx=0x7fdf60014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f666e22a5f7ceeab server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:33.749 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.738+0000 7fdf5cff9700 1 -- 172.21.15.73:0/878351547 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6000eb20 con 0x564506461360 2023-08-10T11:59:33.749 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.738+0000 7fdf5cff9700 1 -- 172.21.15.73:0/878351547 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf60021070 con 0x564506461360 2023-08-10T11:59:33.749 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.738+0000 7fdf5cff9700 1 -- 172.21.15.73:0/878351547 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6001d670 con 0x564506461360 2023-08-10T11:59:33.749 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.738+0000 7fdf80fbab80 1 -- 172.21.15.73:0/878351547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564506461360 msgr2=0x56450645b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:33.749 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.738+0000 7fdf80fbab80 1 --2- 172.21.15.73:0/878351547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564506461360 0x56450645b010 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fdf60011d50 tx=0x7fdf60014000 comp rx=0 tx=0).stop 2023-08-10T11:59:33.749 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.738+0000 7fdf80fbab80 1 -- 172.21.15.73:0/878351547 shutdown_connections 2023-08-10T11:59:33.749 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.738+0000 7fdf80fbab80 1 --2- 172.21.15.73:0/878351547 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564506460a40 0x564506460e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.749 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.738+0000 7fdf80fbab80 1 --2- 172.21.15.73:0/878351547 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56450645b550 0x56450645b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.750 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.738+0000 7fdf80fbab80 1 --2- 172.21.15.73:0/878351547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564506461360 0x56450645b010 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.750 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.738+0000 7fdf80fbab80 1 -- 172.21.15.73:0/878351547 >> 172.21.15.73:0/878351547 conn(0x5645063b8c70 msgr2=0x564506455d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:33.750 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.739+0000 7fdf80fbab80 1 -- 172.21.15.73:0/878351547 shutdown_connections 2023-08-10T11:59:33.750 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.739+0000 7fdf80fbab80 1 -- 172.21.15.73:0/878351547 wait complete. 2023-08-10T11:59:33.750 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.739+0000 7fdf80fbab80 1 -- start start 2023-08-10T11:59:33.750 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.739+0000 7fdf80fbab80 1 Processor -- start 2023-08-10T11:59:33.750 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.739+0000 7fdf80fbab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56450645b550 0x564506467370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:33.751 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.739+0000 7fdf80fbab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564506460a40 0x5645064645f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:33.751 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.739+0000 7fdf80fbab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564506461360 0x564506464d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:33.751 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.739+0000 7fdf80fbab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645063ac740 con 0x564506461360 2023-08-10T11:59:33.751 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.739+0000 7fdf80fbab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56450634ba60 con 0x56450645b550 2023-08-10T11:59:33.751 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.739+0000 7fdf80fbab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56450634b760 con 0x564506460a40 2023-08-10T11:59:33.751 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.739+0000 7fdf80fbab80 10 client.0 _ll_register_callbacks cb 0x564506349620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:59:33.751 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.739+0000 7fdf6ed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564506461360 0x564506464d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:33.751 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.739+0000 7fdf6dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564506460a40 0x5645064645f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:33.752 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.739+0000 7fdf6e59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56450645b550 0x564506467370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:33.752 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.739+0000 7fdf6ed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564506461360 0x564506464d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35624/0 (socket says 172.21.15.73:35624) 2023-08-10T11:59:33.752 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.739+0000 7fdf6dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564506460a40 0x5645064645f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:32894/0 (socket says 172.21.15.73:32894) 2023-08-10T11:59:33.752 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.739+0000 7fdf6ed9d700 1 -- 172.21.15.73:0/772626665 learned_addr learned my addr 172.21.15.73:0/772626665 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:33.752 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.739+0000 7fdf6e59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56450645b550 0x564506467370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:50270/0 (socket says 172.21.15.73:50270) 2023-08-10T11:59:33.752 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.740+0000 7fdf6dd9b700 1 -- 172.21.15.73:0/772626665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56450645b550 msgr2=0x564506467370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:33.752 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.740+0000 7fdf6dd9b700 1 --2- 172.21.15.73:0/772626665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56450645b550 0x564506467370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.753 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.740+0000 7fdf6dd9b700 1 -- 172.21.15.73:0/772626665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564506461360 msgr2=0x564506464d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:33.753 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.740+0000 7fdf6dd9b700 1 --2- 172.21.15.73:0/772626665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564506461360 0x564506464d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.753 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.740+0000 7fdf6dd9b700 1 -- 172.21.15.73:0/772626665 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf701a3720 con 0x564506460a40 2023-08-10T11:59:33.753 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.740+0000 7fdf6ed9d700 1 --2- 172.21.15.73:0/772626665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564506461360 0x564506464d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:59:33.753 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.740+0000 7fdf6dd9b700 1 --2- 172.21.15.73:0/772626665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564506460a40 0x5645064645f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdf60011d20 tx=0x7fdf6001cc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=958a2aceeddab1c5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:33.753 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.740+0000 7fdf55ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T11:59:33.753 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.740+0000 7fdf55ffb700 1 -- 172.21.15.73:0/772626665 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6000ed30 con 0x564506460a40 2023-08-10T11:59:33.753 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.740+0000 7fdf80fbab80 1 -- 172.21.15.73:0/772626665 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56450644e1c0 con 0x564506460a40 2023-08-10T11:59:33.754 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.740+0000 7fdf55ffb700 1 -- 172.21.15.73:0/772626665 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fdf6001c410 con 0x564506460a40 2023-08-10T11:59:33.754 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.740+0000 7fdf55ffb700 1 -- 172.21.15.73:0/772626665 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf6000ee90 con 0x564506460a40 2023-08-10T11:59:33.754 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.740+0000 7fdf80fbab80 10 client.26059 fetch_fsmap learned FSMap version 43 2023-08-10T11:59:33.754 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.740+0000 7fdf80fbab80 1 -- 172.21.15.73:0/772626665 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x7fdf60017070 con 0x564506460a40 2023-08-10T11:59:33.754 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.740+0000 7fdf55ffb700 1 -- 172.21.15.73:0/772626665 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56450644e1c0 con 0x564506460a40 2023-08-10T11:59:33.754 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.741+0000 7fdf55ffb700 1 -- 172.21.15.73:0/772626665 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 43) v1 ==== 6965+0+0 (secure 0 0 0) 0x7fdf60003710 con 0x564506460a40 2023-08-10T11:59:33.754 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.741+0000 7fdf80fbab80 10 client.26059 fetch_fsmap finished waiting for FSMap version 43 2023-08-10T11:59:33.754 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.741+0000 7fdf80fbab80 10 client.26059 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:59:33.755 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.741+0000 7fdf80fbab80 20 client.26059 populate_metadata read hostname 'smithi073' 2023-08-10T11:59:33.755 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.741+0000 7fdf80fbab80 1 --2- 172.21.15.73:0/772626665 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x564506474dc0 0x5645064771e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:33.755 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.741+0000 7fdf80fbab80 4 client.26059 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:59:33.755 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.741+0000 7fdf80fbab80 1 -- 172.21.15.73:0/772626665 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56450642a970 con 0x564506474dc0 2023-08-10T11:59:33.755 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.741+0000 7fdf6e59c700 1 --2- 172.21.15.73:0/772626665 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x564506474dc0 0x5645064771e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:33.755 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.741+0000 7fdf55ffb700 10 client.26059 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:59:33.755 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.741+0000 7fdf6e59c700 1 --2- 172.21.15.73:0/772626665 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x564506474dc0 0x5645064771e0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e311250de8ee5973 server_cookie=14d5cd56ede1372c in_seq=0 out_seq=0 2023-08-10T11:59:33.756 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.742+0000 7fdf55ffb700 1 -- 172.21.15.73:0/772626665 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x56450642a970 con 0x564506474dc0 2023-08-10T11:59:33.756 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.742+0000 7fdf55ffb700 10 client.26059 handle_command_reply: tid=0 2023-08-10T11:59:33.756 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.742+0000 7fdf80fbab80 1 client.26059 shutdown 2023-08-10T11:59:33.756 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.742+0000 7fdf80fbab80 1 -- 172.21.15.73:0/772626665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564506460a40 msgr2=0x5645064645f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:33.756 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.742+0000 7fdf80fbab80 1 --2- 172.21.15.73:0/772626665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564506460a40 0x5645064645f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdf60011d20 tx=0x7fdf6001cc90 comp rx=0 tx=0).stop 2023-08-10T11:59:33.756 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.742+0000 7fdf80fbab80 1 -- 172.21.15.73:0/772626665 shutdown_connections 2023-08-10T11:59:33.756 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.742+0000 7fdf80fbab80 1 --2- 172.21.15.73:0/772626665 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x564506474dc0 0x5645064771e0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.757 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.742+0000 7fdf80fbab80 1 --2- 172.21.15.73:0/772626665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56450645b550 0x564506467370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.757 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.742+0000 7fdf80fbab80 1 --2- 172.21.15.73:0/772626665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564506461360 0x564506464d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.757 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.742+0000 7fdf55ffb700 0 client.26059 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:59:33.757 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.742+0000 7fdf80fbab80 1 --2- 172.21.15.73:0/772626665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564506460a40 0x5645064645f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.757 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.742+0000 7fdf80fbab80 1 -- 172.21.15.73:0/772626665 >> 172.21.15.73:0/772626665 conn(0x5645063b8c70 msgr2=0x5645064554b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:33.757 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.742+0000 7fdf80fbab80 1 -- 172.21.15.73:0/772626665 shutdown_connections 2023-08-10T11:59:33.757 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.742+0000 7fdf80fbab80 1 -- 172.21.15.73:0/772626665 wait complete. 2023-08-10T11:59:33.758 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.742+0000 7fdf80fbab80 20 client.26059 trim_cache size 0 max 16384 2023-08-10T11:59:33.761 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.756+0000 7fdf80fbab80 1 Processor -- start 2023-08-10T11:59:33.761 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.756+0000 7fdf80fbab80 1 -- start start 2023-08-10T11:59:33.762 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.757+0000 7fdf80fbab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56450645b550 0x56450647bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:33.762 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.757+0000 7fdf80fbab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564506460a40 0x564506455c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:33.762 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.757+0000 7fdf80fbab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564506461360 0x56450645f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:33.762 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.757+0000 7fdf80fbab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56450622f8c0 con 0x56450645b550 2023-08-10T11:59:33.762 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.757+0000 7fdf80fbab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56450645b3c0 con 0x564506460a40 2023-08-10T11:59:33.762 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.757+0000 7fdf80fbab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564506450760 con 0x564506461360 2023-08-10T11:59:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.757+0000 7fdf6e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56450645b550 0x56450647bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.757+0000 7fdf6e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56450645b550 0x56450647bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35628/0 (socket says 172.21.15.73:35628) 2023-08-10T11:59:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.757+0000 7fdf6e59c700 1 -- 172.21.15.73:0/3505956810 learned_addr learned my addr 172.21.15.73:0/3505956810 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.757+0000 7fdf6dd9b700 1 --2- 172.21.15.73:0/3505956810 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564506460a40 0x564506455c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.757+0000 7fdf6ed9d700 1 --2- 172.21.15.73:0/3505956810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564506461360 0x56450645f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.757+0000 7fdf6e59c700 1 -- 172.21.15.73:0/3505956810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564506461360 msgr2=0x56450645f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:33.763 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.757+0000 7fdf6e59c700 1 --2- 172.21.15.73:0/3505956810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564506461360 0x56450645f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.764 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.757+0000 7fdf6e59c700 1 -- 172.21.15.73:0/3505956810 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564506460a40 msgr2=0x564506455c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:33.764 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.757+0000 7fdf6e59c700 1 --2- 172.21.15.73:0/3505956810 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564506460a40 0x564506455c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.764 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.757+0000 7fdf6e59c700 1 -- 172.21.15.73:0/3505956810 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645061d9d80 con 0x56450645b550 2023-08-10T11:59:33.764 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.757+0000 7fdf6ed9d700 1 --2- 172.21.15.73:0/3505956810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564506461360 0x56450645f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:59:33.764 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.757+0000 7fdf6e59c700 1 --2- 172.21.15.73:0/3505956810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56450645b550 0x56450647bb00 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fdf64099ec0 tx=0x7fdf64099960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3210dd711a6c043 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:33.764 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.757+0000 7fdf5d7fa700 1 -- 172.21.15.73:0/3505956810 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf640a2380 con 0x56450645b550 2023-08-10T11:59:33.764 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.757+0000 7fdf5d7fa700 1 -- 172.21.15.73:0/3505956810 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf640982d0 con 0x56450645b550 2023-08-10T11:59:33.765 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.757+0000 7fdf5d7fa700 1 -- 172.21.15.73:0/3505956810 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6409a190 con 0x56450645b550 2023-08-10T11:59:33.765 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.758+0000 7fdf80fbab80 1 -- 172.21.15.73:0/3505956810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56450645b550 msgr2=0x56450647bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:33.765 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.758+0000 7fdf80fbab80 1 --2- 172.21.15.73:0/3505956810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56450645b550 0x56450647bb00 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fdf64099ec0 tx=0x7fdf64099960 comp rx=0 tx=0).stop 2023-08-10T11:59:33.765 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.758+0000 7fdf80fbab80 1 -- 172.21.15.73:0/3505956810 shutdown_connections 2023-08-10T11:59:33.765 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.758+0000 7fdf80fbab80 1 --2- 172.21.15.73:0/3505956810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564506461360 0x56450645f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.765 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.758+0000 7fdf80fbab80 1 --2- 172.21.15.73:0/3505956810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56450645b550 0x56450647bb00 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.765 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.758+0000 7fdf80fbab80 1 --2- 172.21.15.73:0/3505956810 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564506460a40 0x564506455c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.765 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.758+0000 7fdf80fbab80 1 -- 172.21.15.73:0/3505956810 >> 172.21.15.73:0/3505956810 conn(0x5645063b8c70 msgr2=0x56450645e830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:33.766 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.758+0000 7fdf80fbab80 1 -- 172.21.15.73:0/3505956810 shutdown_connections 2023-08-10T11:59:33.766 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.758+0000 7fdf80fbab80 1 -- 172.21.15.73:0/3505956810 wait complete. 2023-08-10T11:59:33.766 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.758+0000 7fdf80fbab80 1 -- start start 2023-08-10T11:59:33.766 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.758+0000 7fdf80fbab80 1 Processor -- start 2023-08-10T11:59:33.766 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.759+0000 7fdf80fbab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56450645b550 0x56450646b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:33.766 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.759+0000 7fdf80fbab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564506460a40 0x56450646bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:33.766 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.759+0000 7fdf80fbab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564506461360 0x564506469e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:33.766 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.759+0000 7fdf80fbab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56450646a480 con 0x564506460a40 2023-08-10T11:59:33.767 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.759+0000 7fdf80fbab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56450646a5f0 con 0x564506461360 2023-08-10T11:59:33.767 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.759+0000 7fdf80fbab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56450646a7b0 con 0x56450645b550 2023-08-10T11:59:33.767 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.759+0000 7fdf80fbab80 10 client.0 _ll_register_callbacks cb 0x564506349620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:59:33.767 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.759+0000 7fdf6dd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564506460a40 0x56450646bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:33.767 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.759+0000 7fdf6dd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564506460a40 0x56450646bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35636/0 (socket says 172.21.15.73:35636) 2023-08-10T11:59:33.767 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.759+0000 7fdf6dd9b700 1 -- 172.21.15.73:0/1766110068 learned_addr learned my addr 172.21.15.73:0/1766110068 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:33.767 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.759+0000 7fdf6e59c700 1 --2- 172.21.15.73:0/1766110068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56450645b550 0x56450646b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:33.768 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.759+0000 7fdf6ed9d700 1 --2- 172.21.15.73:0/1766110068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564506461360 0x564506469e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:33.768 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.759+0000 7fdf6dd9b700 1 -- 172.21.15.73:0/1766110068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56450645b550 msgr2=0x56450646b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:33.768 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.759+0000 7fdf6dd9b700 1 --2- 172.21.15.73:0/1766110068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56450645b550 0x56450646b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.768 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.759+0000 7fdf6dd9b700 1 -- 172.21.15.73:0/1766110068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564506461360 msgr2=0x564506469e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:33.768 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.759+0000 7fdf6dd9b700 1 --2- 172.21.15.73:0/1766110068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564506461360 0x564506469e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.768 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.759+0000 7fdf6dd9b700 1 -- 172.21.15.73:0/1766110068 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf701a3210 con 0x564506460a40 2023-08-10T11:59:33.768 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.759+0000 7fdf6dd9b700 1 --2- 172.21.15.73:0/1766110068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564506460a40 0x56450646bc70 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fdf60003a70 tx=0x7fdf600093c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836a4adde10b4ede server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:33.769 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.759+0000 7fdf55ffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:59:33.769 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.759+0000 7fdf55ffb700 1 -- 172.21.15.73:0/1766110068 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf60003680 con 0x564506460a40 2023-08-10T11:59:33.769 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.759+0000 7fdf55ffb700 1 -- 172.21.15.73:0/1766110068 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fdf600037e0 con 0x564506460a40 2023-08-10T11:59:33.769 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.759+0000 7fdf80fbab80 1 -- 172.21.15.73:0/1766110068 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdf60021070 con 0x564506460a40 2023-08-10T11:59:33.769 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.760+0000 7fdf55ffb700 1 -- 172.21.15.73:0/1766110068 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf600050b0 con 0x564506460a40 2023-08-10T11:59:33.769 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.760+0000 7fdf80fbab80 10 client.16575 fetch_fsmap learned FSMap version 43 2023-08-10T11:59:33.769 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.760+0000 7fdf80fbab80 1 -- 172.21.15.73:0/1766110068 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5645061c2c00 con 0x564506460a40 2023-08-10T11:59:33.769 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.760+0000 7fdf55ffb700 1 -- 172.21.15.73:0/1766110068 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf6004c080 con 0x564506460a40 2023-08-10T11:59:33.770 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.760+0000 7fdf55ffb700 1 -- 172.21.15.73:0/1766110068 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 43) v1 ==== 6965+0+0 (secure 0 0 0) 0x7fdf60046030 con 0x564506460a40 2023-08-10T11:59:33.770 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.760+0000 7fdf80fbab80 10 client.16575 fetch_fsmap finished waiting for FSMap version 43 2023-08-10T11:59:33.770 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.760+0000 7fdf80fbab80 10 client.16575 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:59:33.770 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.760+0000 7fdf80fbab80 20 client.16575 populate_metadata read hostname 'smithi073' 2023-08-10T11:59:33.770 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.760+0000 7fdf80fbab80 1 --2- 172.21.15.73:0/1766110068 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5645064c9920 0x5645064cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:33.770 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.760+0000 7fdf80fbab80 4 client.16575 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:59:33.770 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.760+0000 7fdf80fbab80 1 -- 172.21.15.73:0/1766110068 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5645063a5720 con 0x5645064c9920 2023-08-10T11:59:33.770 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.760+0000 7fdf6e59c700 1 --2- 172.21.15.73:0/1766110068 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5645064c9920 0x5645064cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:33.771 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.760+0000 7fdf55ffb700 10 client.16575 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:59:33.771 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.760+0000 7fdf6e59c700 1 --2- 172.21.15.73:0/1766110068 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5645064c9920 0x5645064cbd40 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa86fe08ff07dcb7 server_cookie=f87c98f4164ce38d in_seq=0 out_seq=0 2023-08-10T11:59:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.789+0000 7fdf55ffb700 1 -- 172.21.15.73:0/1766110068 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5645063a5720 con 0x5645064c9920 2023-08-10T11:59:33.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.789+0000 7fdf55ffb700 10 client.16575 handle_command_reply: tid=0 2023-08-10T11:59:33.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.789+0000 7fdf80fbab80 1 client.16575 shutdown 2023-08-10T11:59:33.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.789+0000 7fdf80fbab80 1 -- 172.21.15.73:0/1766110068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564506460a40 msgr2=0x56450646bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:33.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.789+0000 7fdf80fbab80 1 --2- 172.21.15.73:0/1766110068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564506460a40 0x56450646bc70 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fdf60003a70 tx=0x7fdf600093c0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.789+0000 7fdf80fbab80 1 -- 172.21.15.73:0/1766110068 shutdown_connections 2023-08-10T11:59:33.791 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.789+0000 7fdf80fbab80 1 --2- 172.21.15.73:0/1766110068 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5645064c9920 0x5645064cbd40 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.792 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.789+0000 7fdf80fbab80 1 --2- 172.21.15.73:0/1766110068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564506461360 0x564506469e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.792 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.789+0000 7fdf80fbab80 1 --2- 172.21.15.73:0/1766110068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56450645b550 0x56450646b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.792 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.789+0000 7fdf55ffb700 0 client.16575 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:59:33.792 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.789+0000 7fdf80fbab80 1 --2- 172.21.15.73:0/1766110068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564506460a40 0x56450646bc70 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.792 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.789+0000 7fdf80fbab80 1 -- 172.21.15.73:0/1766110068 >> 172.21.15.73:0/1766110068 conn(0x5645063b8c70 msgr2=0x56450645f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:33.792 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.790+0000 7fdf80fbab80 1 -- 172.21.15.73:0/1766110068 shutdown_connections 2023-08-10T11:59:33.792 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.790+0000 7fdf80fbab80 1 -- 172.21.15.73:0/1766110068 wait complete. 2023-08-10T11:59:33.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.790+0000 7fdf80fbab80 20 client.16575 trim_cache size 0 max 16384 2023-08-10T11:59:33.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:59:33.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:59:33.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:59:33.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:59:33.794 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.790+0000 7fdf74e21700 1 -- 172.21.15.73:0/686347121 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fdf580a12c0 msgr2=0x7fdf580a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:33.794 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.790+0000 7fdf74e21700 1 --2- 172.21.15.73:0/686347121 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fdf580a12c0 0x7fdf580a3780 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdf70068c40 tx=0x7fdf60009260 comp rx=0 tx=0).stop 2023-08-10T11:59:33.794 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.790+0000 7fdf74e21700 1 -- 172.21.15.73:0/686347121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf700ff8d0 msgr2=0x7fdf70197790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.790+0000 7fdf74e21700 1 --2- 172.21.15.73:0/686347121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf700ff8d0 0x7fdf70197790 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400e970 tx=0x7fdf6400ec80 comp rx=0 tx=0).stop 2023-08-10T11:59:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.790+0000 7fdf74e21700 1 -- 172.21.15.73:0/686347121 shutdown_connections 2023-08-10T11:59:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.790+0000 7fdf74e21700 1 --2- 172.21.15.73:0/686347121 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fdf580a12c0 0x7fdf580a3780 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.790+0000 7fdf74e21700 1 --2- 172.21.15.73:0/686347121 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf70105670 0x7fdf701a2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.790+0000 7fdf74e21700 1 --2- 172.21.15.73:0/686347121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf700ff8d0 0x7fdf70197790 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.790+0000 7fdf74e21700 1 --2- 172.21.15.73:0/686347121 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf70100290 0x7fdf70197cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.790+0000 7fdf74e21700 1 -- 172.21.15.73:0/686347121 >> 172.21.15.73:0/686347121 conn(0x7fdf700750a0 msgr2=0x7fdf70103300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:33.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.790+0000 7fdf74e21700 1 -- 172.21.15.73:0/686347121 shutdown_connections 2023-08-10T11:59:33.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:33.790+0000 7fdf74e21700 1 -- 172.21.15.73:0/686347121 wait complete. 2023-08-10T11:59:35.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:34 smithi152 ceph-mon[130220]: pgmap v213: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 894 KiB/s wr, 61 op/s 2023-08-10T11:59:35.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:34 smithi156 ceph-mon[130574]: pgmap v213: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 894 KiB/s wr, 61 op/s 2023-08-10T11:59:35.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:34 smithi073 ceph-mon[128869]: pgmap v213: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 894 KiB/s wr, 61 op/s 2023-08-10T11:59:37.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:37 smithi152 ceph-mon[130220]: pgmap v214: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 412 KiB/s wr, 50 op/s 2023-08-10T11:59:37.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:37 smithi156 ceph-mon[130574]: pgmap v214: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 412 KiB/s wr, 50 op/s 2023-08-10T11:59:37.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:37 smithi073 ceph-mon[128869]: pgmap v214: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 412 KiB/s wr, 50 op/s 2023-08-10T11:59:39.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:39 smithi152 ceph-mon[130220]: pgmap v215: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 206 KiB/s wr, 30 op/s 2023-08-10T11:59:39.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:39 smithi156 ceph-mon[130574]: pgmap v215: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 206 KiB/s wr, 30 op/s 2023-08-10T11:59:39.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:39 smithi073 ceph-mon[128869]: pgmap v215: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 206 KiB/s wr, 30 op/s 2023-08-10T11:59:41.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:41 smithi152 ceph-mon[130220]: pgmap v216: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 208 KiB/s wr, 35 op/s 2023-08-10T11:59:41.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:41 smithi156 ceph-mon[130574]: pgmap v216: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 208 KiB/s wr, 35 op/s 2023-08-10T11:59:41.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:41 smithi073 ceph-mon[128869]: pgmap v216: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 208 KiB/s wr, 35 op/s 2023-08-10T11:59:43.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:43 smithi152 ceph-mon[130220]: pgmap v217: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 75 KiB/s wr, 26 op/s 2023-08-10T11:59:43.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:43 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T11:59:43.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:43 smithi156 ceph-mon[130574]: pgmap v217: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 75 KiB/s wr, 26 op/s 2023-08-10T11:59:43.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:43 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T11:59:43.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:43 smithi073 ceph-mon[128869]: pgmap v217: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 75 KiB/s wr, 26 op/s 2023-08-10T11:59:43.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:43 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T11:59:45.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:44 smithi152 ceph-mon[130220]: pgmap v218: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 76 KiB/s wr, 27 op/s 2023-08-10T11:59:45.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:44 smithi156 ceph-mon[130574]: pgmap v218: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 76 KiB/s wr, 27 op/s 2023-08-10T11:59:45.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:44 smithi073 ceph-mon[128869]: pgmap v218: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 76 KiB/s wr, 27 op/s 2023-08-10T11:59:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.906+0000 7fcbb04e0700 1 -- 172.21.15.73:0/3795858026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcba8100290 msgr2=0x7fcba810c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.906+0000 7fcbb04e0700 1 --2- 172.21.15.73:0/3795858026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcba8100290 0x7fcba810c4a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fcba000b0a0 tx=0x7fcba000b3b0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.906+0000 7fcbb04e0700 1 -- 172.21.15.73:0/3795858026 shutdown_connections 2023-08-10T11:59:46.908 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.906+0000 7fcbb04e0700 1 --2- 172.21.15.73:0/3795858026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcba8100290 0x7fcba810c4a0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.908 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.906+0000 7fcbb04e0700 1 --2- 172.21.15.73:0/3795858026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcba8105670 0x7fcba8105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.908 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.906+0000 7fcbb04e0700 1 --2- 172.21.15.73:0/3795858026 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcba80ff8d0 0x7fcba80ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.908 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.906+0000 7fcbb04e0700 1 -- 172.21.15.73:0/3795858026 >> 172.21.15.73:0/3795858026 conn(0x7fcba80750a0 msgr2=0x7fcba80754b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:46.908 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.906+0000 7fcbb04e0700 1 -- 172.21.15.73:0/3795858026 shutdown_connections 2023-08-10T11:59:46.908 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.906+0000 7fcbb04e0700 1 -- 172.21.15.73:0/3795858026 wait complete. 2023-08-10T11:59:46.910 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.907+0000 7fcbb04e0700 1 Processor -- start 2023-08-10T11:59:46.910 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.907+0000 7fcbb04e0700 1 -- start start 2023-08-10T11:59:46.910 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.907+0000 7fcbb04e0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcba80ff8d0 0x7fcba819e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:46.910 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.907+0000 7fcbb04e0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcba8100290 0x7fcba819ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:46.910 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.907+0000 7fcbb04e0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcba8105670 0x7fcba8198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.907+0000 7fcbb04e0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba8198d90 con 0x7fcba8100290 2023-08-10T11:59:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.907+0000 7fcbb04e0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba8198f00 con 0x7fcba8105670 2023-08-10T11:59:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.907+0000 7fcbb04e0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba81990c0 con 0x7fcba80ff8d0 2023-08-10T11:59:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.907+0000 7fcbada7b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcba8100290 0x7fcba819ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.907+0000 7fcbada7b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcba8100290 0x7fcba819ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35650/0 (socket says 172.21.15.73:35650) 2023-08-10T11:59:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.907+0000 7fcbada7b700 1 -- 172.21.15.73:0/3120498954 learned_addr learned my addr 172.21.15.73:0/3120498954 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.907+0000 7fcbae27c700 1 --2- 172.21.15.73:0/3120498954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcba80ff8d0 0x7fcba819e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:46.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.907+0000 7fcbaea7d700 1 --2- 172.21.15.73:0/3120498954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcba8105670 0x7fcba8198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:46.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.907+0000 7fcbada7b700 1 -- 172.21.15.73:0/3120498954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcba80ff8d0 msgr2=0x7fcba819e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:46.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.907+0000 7fcbada7b700 1 --2- 172.21.15.73:0/3120498954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcba80ff8d0 0x7fcba819e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.907+0000 7fcbada7b700 1 -- 172.21.15.73:0/3120498954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcba8105670 msgr2=0x7fcba8198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:46.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.907+0000 7fcbada7b700 1 --2- 172.21.15.73:0/3120498954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcba8105670 0x7fcba8198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.907+0000 7fcbada7b700 1 -- 172.21.15.73:0/3120498954 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba0009d00 con 0x7fcba8100290 2023-08-10T11:59:46.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.908+0000 7fcbada7b700 1 --2- 172.21.15.73:0/3120498954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcba8100290 0x7fcba819ee00 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00e9a0 tx=0x7fcb9c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.908+0000 7fcba77fe700 1 -- 172.21.15.73:0/3120498954 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c009790 con 0x7fcba8100290 2023-08-10T11:59:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.908+0000 7fcba77fe700 1 -- 172.21.15.73:0/3120498954 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb9c010430 con 0x7fcba8100290 2023-08-10T11:59:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.908+0000 7fcbb04e0700 1 -- 172.21.15.73:0/3120498954 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba81993a0 con 0x7fcba8100290 2023-08-10T11:59:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.908+0000 7fcba77fe700 1 -- 172.21.15.73:0/3120498954 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c018680 con 0x7fcba8100290 2023-08-10T11:59:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.908+0000 7fcbb04e0700 1 -- 172.21.15.73:0/3120498954 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba81a58b0 con 0x7fcba8100290 2023-08-10T11:59:46.919 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.910+0000 7fcba77fe700 1 -- 172.21.15.73:0/3120498954 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fcb9c0105a0 con 0x7fcba8100290 2023-08-10T11:59:46.920 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.911+0000 7fcba77fe700 1 --2- 172.21.15.73:0/3120498954 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fcb900a1340 0x7fcb900a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:46.920 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.911+0000 7fcba77fe700 1 -- 172.21.15.73:0/3120498954 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fcb9c014070 con 0x7fcba8100290 2023-08-10T11:59:46.920 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.911+0000 7fcbae27c700 1 --2- 172.21.15.73:0/3120498954 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fcb900a1340 0x7fcb900a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:46.920 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.911+0000 7fcbae27c700 1 --2- 172.21.15.73:0/3120498954 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fcb900a1340 0x7fcb900a3800 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcba80766a0 tx=0x7fcb98009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:46.921 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.912+0000 7fcbbc679b80 1 Processor -- start 2023-08-10T11:59:46.921 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.912+0000 7fcbbc679b80 1 -- start start 2023-08-10T11:59:46.921 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.912+0000 7fcbbc679b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636bd4c0a40 0x5636bd4c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:46.921 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.912+0000 7fcbbc679b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4c1360 0x5636bd4bb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.912+0000 7fcbbc679b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636bd4bb550 0x5636bd4bb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.912+0000 7fcbbc679b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636bd436d60 con 0x5636bd4c1360 2023-08-10T11:59:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.912+0000 7fcbbc679b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636bd413530 con 0x5636bd4bb550 2023-08-10T11:59:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.912+0000 7fcbbc679b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636bd410e50 con 0x5636bd4c0a40 2023-08-10T11:59:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.912+0000 7fcbada7b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4c1360 0x5636bd4bb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.912+0000 7fcbada7b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4c1360 0x5636bd4bb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35658/0 (socket says 172.21.15.73:35658) 2023-08-10T11:59:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.912+0000 7fcbada7b700 1 -- 172.21.15.73:0/3868644351 learned_addr learned my addr 172.21.15.73:0/3868644351 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.912+0000 7fcbaea7d700 1 --2- 172.21.15.73:0/3868644351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636bd4bb550 0x5636bd4bb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.912+0000 7fcbae27c700 1 --2- 172.21.15.73:0/3868644351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636bd4c0a40 0x5636bd4c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:46.924 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.912+0000 7fcbada7b700 1 -- 172.21.15.73:0/3868644351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636bd4c0a40 msgr2=0x5636bd4c0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:46.924 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.912+0000 7fcbada7b700 1 --2- 172.21.15.73:0/3868644351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636bd4c0a40 0x5636bd4c0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.924 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.912+0000 7fcbada7b700 1 -- 172.21.15.73:0/3868644351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636bd4bb550 msgr2=0x5636bd4bb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:46.924 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.912+0000 7fcbada7b700 1 --2- 172.21.15.73:0/3868644351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636bd4bb550 0x5636bd4bb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.924 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.912+0000 7fcbada7b700 1 -- 172.21.15.73:0/3868644351 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636bd28d5d0 con 0x5636bd4c1360 2023-08-10T11:59:46.925 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.913+0000 7fcbada7b700 1 --2- 172.21.15.73:0/3868644351 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4c1360 0x5636bd4bb010 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c096a20 tx=0x7fcb9c099c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf688fd455d62274 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:46.925 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.913+0000 7fcba4ff9700 1 -- 172.21.15.73:0/3868644351 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c0a2400 con 0x5636bd4c1360 2023-08-10T11:59:46.925 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.913+0000 7fcba4ff9700 1 -- 172.21.15.73:0/3868644351 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb9c010880 con 0x5636bd4c1360 2023-08-10T11:59:46.925 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.913+0000 7fcba4ff9700 1 -- 172.21.15.73:0/3868644351 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c0a1f70 con 0x5636bd4c1360 2023-08-10T11:59:46.926 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.913+0000 7fcbbc679b80 1 -- 172.21.15.73:0/3868644351 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4c1360 msgr2=0x5636bd4bb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:46.926 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.913+0000 7fcbbc679b80 1 --2- 172.21.15.73:0/3868644351 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4c1360 0x5636bd4bb010 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c096a20 tx=0x7fcb9c099c20 comp rx=0 tx=0).stop 2023-08-10T11:59:46.926 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.913+0000 7fcbbc679b80 1 -- 172.21.15.73:0/3868644351 shutdown_connections 2023-08-10T11:59:46.926 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.913+0000 7fcbbc679b80 1 --2- 172.21.15.73:0/3868644351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636bd4bb550 0x5636bd4bb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.926 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.913+0000 7fcbbc679b80 1 --2- 172.21.15.73:0/3868644351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636bd4c0a40 0x5636bd4c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.927 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.913+0000 7fcbbc679b80 1 --2- 172.21.15.73:0/3868644351 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4c1360 0x5636bd4bb010 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.927 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.913+0000 7fcbbc679b80 1 -- 172.21.15.73:0/3868644351 >> 172.21.15.73:0/3868644351 conn(0x5636bd418c70 msgr2=0x5636bd4b5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:46.927 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.914+0000 7fcbbc679b80 1 -- 172.21.15.73:0/3868644351 shutdown_connections 2023-08-10T11:59:46.927 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.914+0000 7fcbbc679b80 1 -- 172.21.15.73:0/3868644351 wait complete. 2023-08-10T11:59:46.928 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.914+0000 7fcbbc679b80 1 -- start start 2023-08-10T11:59:46.928 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.914+0000 7fcbbc679b80 1 Processor -- start 2023-08-10T11:59:46.928 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.914+0000 7fcbbc679b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4bb550 0x5636bd4c73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:46.928 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.914+0000 7fcbbc679b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636bd4c0a40 0x5636bd4c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:46.929 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.914+0000 7fcbbc679b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636bd4c1360 0x5636bd4c4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:46.929 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.914+0000 7fcbbc679b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636bd40c740 con 0x5636bd4bb550 2023-08-10T11:59:46.929 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.914+0000 7fcbbc679b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636bd3aba60 con 0x5636bd4c1360 2023-08-10T11:59:46.929 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.914+0000 7fcbbc679b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636bd3ab760 con 0x5636bd4c0a40 2023-08-10T11:59:46.929 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.914+0000 7fcbbc679b80 10 client.0 _ll_register_callbacks cb 0x5636bd3a9620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:59:46.930 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.914+0000 7fcbae27c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4bb550 0x5636bd4c73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:46.930 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.914+0000 7fcbae27c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4bb550 0x5636bd4c73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35662/0 (socket says 172.21.15.73:35662) 2023-08-10T11:59:46.930 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.914+0000 7fcbae27c700 1 -- 172.21.15.73:0/2160611142 learned_addr learned my addr 172.21.15.73:0/2160611142 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:46.930 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.914+0000 7fcbaea7d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636bd4c1360 0x5636bd4c4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:46.930 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.914+0000 7fcbada7b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636bd4c0a40 0x5636bd4c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:46.931 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.915+0000 7fcbae27c700 1 -- 172.21.15.73:0/2160611142 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636bd4c0a40 msgr2=0x5636bd4c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:46.931 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.915+0000 7fcbae27c700 1 --2- 172.21.15.73:0/2160611142 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636bd4c0a40 0x5636bd4c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.931 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.915+0000 7fcbae27c700 1 -- 172.21.15.73:0/2160611142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636bd4c1360 msgr2=0x5636bd4c4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:46.931 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.915+0000 7fcbae27c700 1 --2- 172.21.15.73:0/2160611142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636bd4c1360 0x5636bd4c4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.931 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.915+0000 7fcbae27c700 1 -- 172.21.15.73:0/2160611142 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba81a58b0 con 0x5636bd4bb550 2023-08-10T11:59:46.931 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.915+0000 7fcbada7b700 1 --2- 172.21.15.73:0/2160611142 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636bd4c0a40 0x5636bd4c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:59:46.931 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.915+0000 7fcbaea7d700 1 --2- 172.21.15.73:0/2160611142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636bd4c1360 0x5636bd4c4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:59:46.932 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.915+0000 7fcbae27c700 1 --2- 172.21.15.73:0/2160611142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4bb550 0x5636bd4c73e0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fcb9801dc00 tx=0x7fcb980047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f833f0d0535ed8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:46.932 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.915+0000 7fcb8dffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:59:46.932 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.915+0000 7fcb8dffb700 1 -- 172.21.15.73:0/2160611142 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb98022070 con 0x5636bd4bb550 2023-08-10T11:59:46.932 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.915+0000 7fcb8dffb700 1 -- 172.21.15.73:0/2160611142 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fcb9801c690 con 0x5636bd4bb550 2023-08-10T11:59:46.932 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.915+0000 7fcbbc679b80 1 -- 172.21.15.73:0/2160611142 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5636bd4ae1c0 con 0x5636bd4bb550 2023-08-10T11:59:46.932 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.915+0000 7fcb8dffb700 1 -- 172.21.15.73:0/2160611142 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb9801c850 con 0x5636bd4bb550 2023-08-10T11:59:46.932 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.915+0000 7fcbbc679b80 10 client.16587 fetch_fsmap learned FSMap version 44 2023-08-10T11:59:46.933 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.915+0000 7fcbbc679b80 1 -- 172.21.15.73:0/2160611142 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x5636bd239d80 con 0x5636bd4bb550 2023-08-10T11:59:46.933 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.915+0000 7fcb8dffb700 1 -- 172.21.15.73:0/2160611142 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb98033020 con 0x5636bd4bb550 2023-08-10T11:59:46.933 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.916+0000 7fcb8dffb700 1 -- 172.21.15.73:0/2160611142 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 44) v1 ==== 6969+0+0 (secure 0 0 0) 0x7fcb98026b50 con 0x5636bd4bb550 2023-08-10T11:59:46.933 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.916+0000 7fcbbc679b80 10 client.16587 fetch_fsmap finished waiting for FSMap version 44 2023-08-10T11:59:46.933 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.916+0000 7fcbbc679b80 10 client.16587 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:59:46.933 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.916+0000 7fcbbc679b80 20 client.16587 populate_metadata read hostname 'smithi073' 2023-08-10T11:59:46.933 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.916+0000 7fcbbc679b80 1 --2- 172.21.15.73:0/2160611142 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5636bd4d4ed0 0x5636bd4d72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:46.933 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.916+0000 7fcbbc679b80 4 client.16587 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:59:46.934 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.916+0000 7fcbbc679b80 1 -- 172.21.15.73:0/2160611142 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5636bd48a970 con 0x5636bd4d4ed0 2023-08-10T11:59:46.934 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.916+0000 7fcbada7b700 1 --2- 172.21.15.73:0/2160611142 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5636bd4d4ed0 0x5636bd4d72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:46.934 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.916+0000 7fcbada7b700 1 --2- 172.21.15.73:0/2160611142 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5636bd4d4ed0 0x5636bd4d72f0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b2adda729d2e191 server_cookie=3e81d1e7fff1287a in_seq=0 out_seq=0 2023-08-10T11:59:46.934 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.916+0000 7fcb8dffb700 10 client.16587 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:59:46.934 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.917+0000 7fcb8dffb700 1 -- 172.21.15.73:0/2160611142 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5636bd48a970 con 0x5636bd4d4ed0 2023-08-10T11:59:46.934 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.917+0000 7fcb8dffb700 10 client.16587 handle_command_reply: tid=0 2023-08-10T11:59:46.934 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.917+0000 7fcbbc679b80 1 client.16587 shutdown 2023-08-10T11:59:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.917+0000 7fcbbc679b80 1 -- 172.21.15.73:0/2160611142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4bb550 msgr2=0x5636bd4c73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.917+0000 7fcbbc679b80 1 --2- 172.21.15.73:0/2160611142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4bb550 0x5636bd4c73e0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fcb9801dc00 tx=0x7fcb980047c0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.917+0000 7fcbbc679b80 1 -- 172.21.15.73:0/2160611142 shutdown_connections 2023-08-10T11:59:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.917+0000 7fcbbc679b80 1 --2- 172.21.15.73:0/2160611142 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5636bd4d4ed0 0x5636bd4d72f0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.917+0000 7fcbbc679b80 1 --2- 172.21.15.73:0/2160611142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636bd4c1360 0x5636bd4c4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.917+0000 7fcbbc679b80 1 --2- 172.21.15.73:0/2160611142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4bb550 0x5636bd4c73e0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.917+0000 7fcb8dffb700 0 client.16587 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:59:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.917+0000 7fcbbc679b80 1 --2- 172.21.15.73:0/2160611142 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636bd4c0a40 0x5636bd4c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.936 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.917+0000 7fcbbc679b80 1 -- 172.21.15.73:0/2160611142 >> 172.21.15.73:0/2160611142 conn(0x5636bd418c70 msgr2=0x5636bd4b54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:46.936 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.917+0000 7fcbbc679b80 1 -- 172.21.15.73:0/2160611142 shutdown_connections 2023-08-10T11:59:46.936 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.917+0000 7fcbbc679b80 1 -- 172.21.15.73:0/2160611142 wait complete. 2023-08-10T11:59:46.936 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.917+0000 7fcbbc679b80 20 client.16587 trim_cache size 0 max 16384 2023-08-10T11:59:46.940 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.931+0000 7fcbbc679b80 1 Processor -- start 2023-08-10T11:59:46.940 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.931+0000 7fcbbc679b80 1 -- start start 2023-08-10T11:59:46.940 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.932+0000 7fcbbc679b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4bb550 0x5636bd4c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:46.940 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.932+0000 7fcbbc679b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636bd4c0a40 0x5636bd4dbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:46.941 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.932+0000 7fcbbc679b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636bd4c1360 0x5636bd4b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:46.941 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.932+0000 7fcbbc679b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636bd28f8c0 con 0x5636bd4bb550 2023-08-10T11:59:46.941 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.932+0000 7fcbbc679b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636bd4d2420 con 0x5636bd4c0a40 2023-08-10T11:59:46.941 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.932+0000 7fcbbc679b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636bd4d1710 con 0x5636bd4c1360 2023-08-10T11:59:46.941 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.932+0000 7fcbae27c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4bb550 0x5636bd4c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:46.942 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.932+0000 7fcbada7b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636bd4c0a40 0x5636bd4dbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:46.942 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.932+0000 7fcbae27c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4bb550 0x5636bd4c45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35670/0 (socket says 172.21.15.73:35670) 2023-08-10T11:59:46.942 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.932+0000 7fcbaea7d700 1 --2- 172.21.15.73:0/1621369179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636bd4c1360 0x5636bd4b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:46.942 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.932+0000 7fcbae27c700 1 -- 172.21.15.73:0/1621369179 learned_addr learned my addr 172.21.15.73:0/1621369179 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:46.943 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.932+0000 7fcbada7b700 1 -- 172.21.15.73:0/1621369179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636bd4c1360 msgr2=0x5636bd4b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:46.943 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.932+0000 7fcbada7b700 1 --2- 172.21.15.73:0/1621369179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636bd4c1360 0x5636bd4b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.943 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.932+0000 7fcbada7b700 1 -- 172.21.15.73:0/1621369179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4bb550 msgr2=0x5636bd4c45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:46.943 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.932+0000 7fcbada7b700 1 --2- 172.21.15.73:0/1621369179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4bb550 0x5636bd4c45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.944 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.932+0000 7fcbada7b700 1 -- 172.21.15.73:0/1621369179 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636bd222c00 con 0x5636bd4c0a40 2023-08-10T11:59:46.944 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.932+0000 7fcbae27c700 1 --2- 172.21.15.73:0/1621369179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4bb550 0x5636bd4c45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:59:46.944 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.932+0000 7fcbada7b700 1 --2- 172.21.15.73:0/1621369179 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636bd4c0a40 0x5636bd4dbc10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c099cb0 tx=0x7fcb9c096370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70b8328ed71f8634 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:46.945 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.932+0000 7fcba57fa700 1 -- 172.21.15.73:0/1621369179 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c09a030 con 0x5636bd4c0a40 2023-08-10T11:59:46.945 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.933+0000 7fcba57fa700 1 -- 172.21.15.73:0/1621369179 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb9c0b1070 con 0x5636bd4c0a40 2023-08-10T11:59:46.945 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.933+0000 7fcba57fa700 1 -- 172.21.15.73:0/1621369179 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c0a21d0 con 0x5636bd4c0a40 2023-08-10T11:59:46.945 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.933+0000 7fcbbc679b80 1 -- 172.21.15.73:0/1621369179 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636bd4c0a40 msgr2=0x5636bd4dbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:46.946 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.933+0000 7fcbbc679b80 1 --2- 172.21.15.73:0/1621369179 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636bd4c0a40 0x5636bd4dbc10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c099cb0 tx=0x7fcb9c096370 comp rx=0 tx=0).stop 2023-08-10T11:59:46.946 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.933+0000 7fcbbc679b80 1 -- 172.21.15.73:0/1621369179 shutdown_connections 2023-08-10T11:59:46.946 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.933+0000 7fcbbc679b80 1 --2- 172.21.15.73:0/1621369179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636bd4c1360 0x5636bd4b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.947 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.933+0000 7fcbbc679b80 1 --2- 172.21.15.73:0/1621369179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4bb550 0x5636bd4c45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.947 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.933+0000 7fcbbc679b80 1 --2- 172.21.15.73:0/1621369179 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636bd4c0a40 0x5636bd4dbc10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.947 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.933+0000 7fcbbc679b80 1 -- 172.21.15.73:0/1621369179 >> 172.21.15.73:0/1621369179 conn(0x5636bd418c70 msgr2=0x5636bd4c3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:46.947 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.933+0000 7fcbbc679b80 1 -- 172.21.15.73:0/1621369179 shutdown_connections 2023-08-10T11:59:46.947 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.933+0000 7fcbbc679b80 1 -- 172.21.15.73:0/1621369179 wait complete. 2023-08-10T11:59:46.947 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.933+0000 7fcbbc679b80 1 -- start start 2023-08-10T11:59:46.948 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.933+0000 7fcbbc679b80 1 Processor -- start 2023-08-10T11:59:46.948 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.934+0000 7fcbbc679b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4bb550 0x5636bd4cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:46.948 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.934+0000 7fcbbc679b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636bd4c0a40 0x5636bd4cb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:46.948 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.934+0000 7fcbbc679b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636bd4c1360 0x5636bd527b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:46.948 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.934+0000 7fcbbc679b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636bd4cbdf0 con 0x5636bd4bb550 2023-08-10T11:59:46.948 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.934+0000 7fcbbc679b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636bd528080 con 0x5636bd4c0a40 2023-08-10T11:59:46.948 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.934+0000 7fcbbc679b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636bd5281c0 con 0x5636bd4c1360 2023-08-10T11:59:46.949 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.934+0000 7fcbbc679b80 10 client.0 _ll_register_callbacks cb 0x5636bd3a9620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:59:46.949 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.934+0000 7fcbae27c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4bb550 0x5636bd4cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:46.949 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.934+0000 7fcbada7b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636bd4c0a40 0x5636bd4cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:46.949 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.934+0000 7fcbae27c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4bb550 0x5636bd4cafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35676/0 (socket says 172.21.15.73:35676) 2023-08-10T11:59:46.949 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.934+0000 7fcbae27c700 1 -- 172.21.15.73:0/728723413 learned_addr learned my addr 172.21.15.73:0/728723413 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:46.949 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.934+0000 7fcbaea7d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636bd4c1360 0x5636bd527b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:46.949 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.934+0000 7fcbada7b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636bd4c0a40 0x5636bd4cb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:50328/0 (socket says 172.21.15.73:50328) 2023-08-10T11:59:46.950 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.934+0000 7fcbae27c700 1 -- 172.21.15.73:0/728723413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636bd4c1360 msgr2=0x5636bd527b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:46.950 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.934+0000 7fcbae27c700 1 --2- 172.21.15.73:0/728723413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636bd4c1360 0x5636bd527b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.950 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.934+0000 7fcbae27c700 1 -- 172.21.15.73:0/728723413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636bd4c0a40 msgr2=0x5636bd4cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:46.950 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.934+0000 7fcbae27c700 1 --2- 172.21.15.73:0/728723413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636bd4c0a40 0x5636bd4cb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.950 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.934+0000 7fcbae27c700 1 -- 172.21.15.73:0/728723413 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5636bd239d80 con 0x5636bd4bb550 2023-08-10T11:59:46.950 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.934+0000 7fcbae27c700 1 --2- 172.21.15.73:0/728723413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4bb550 0x5636bd4cafd0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fcb98026eb0 tx=0x7fcb9802ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4fa5b1ded017780 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:46.950 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.934+0000 7fcb8dffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:59:46.951 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.934+0000 7fcb8dffb700 1 -- 172.21.15.73:0/728723413 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb98022070 con 0x5636bd4bb550 2023-08-10T11:59:46.951 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.934+0000 7fcb8dffb700 1 -- 172.21.15.73:0/728723413 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fcb98034080 con 0x5636bd4bb550 2023-08-10T11:59:46.951 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.934+0000 7fcbbc679b80 1 -- 172.21.15.73:0/728723413 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcb9c010880 con 0x5636bd4bb550 2023-08-10T11:59:46.951 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.935+0000 7fcb8dffb700 1 -- 172.21.15.73:0/728723413 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb9801c690 con 0x5636bd4bb550 2023-08-10T11:59:46.951 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.935+0000 7fcbbc679b80 10 client.16593 fetch_fsmap learned FSMap version 44 2023-08-10T11:59:46.951 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.935+0000 7fcbbc679b80 1 -- 172.21.15.73:0/728723413 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x5636bd28d5d0 con 0x5636bd4bb550 2023-08-10T11:59:46.951 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.935+0000 7fcb8dffb700 1 -- 172.21.15.73:0/728723413 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb9c010880 con 0x5636bd4bb550 2023-08-10T11:59:46.951 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.935+0000 7fcb8dffb700 1 -- 172.21.15.73:0/728723413 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 44) v1 ==== 6969+0+0 (secure 0 0 0) 0x7fcb9803e070 con 0x5636bd4bb550 2023-08-10T11:59:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.935+0000 7fcbbc679b80 10 client.16593 fetch_fsmap finished waiting for FSMap version 44 2023-08-10T11:59:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.935+0000 7fcbbc679b80 10 client.16593 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T11:59:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.935+0000 7fcbbc679b80 20 client.16593 populate_metadata read hostname 'smithi073' 2023-08-10T11:59:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.935+0000 7fcbbc679b80 1 --2- 172.21.15.73:0/728723413 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5636bd5299f0 0x5636bd52be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.935+0000 7fcbbc679b80 4 client.16593 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T11:59:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.935+0000 7fcbbc679b80 1 -- 172.21.15.73:0/728723413 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5636bd405720 con 0x5636bd5299f0 2023-08-10T11:59:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.935+0000 7fcbada7b700 1 --2- 172.21.15.73:0/728723413 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5636bd5299f0 0x5636bd52be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.936+0000 7fcb8dffb700 10 client.16593 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:59:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.936+0000 7fcbada7b700 1 --2- 172.21.15.73:0/728723413 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5636bd5299f0 0x5636bd52be10 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa363e27157fbf10 server_cookie=51dd89f007a109f2 in_seq=0 out_seq=0 2023-08-10T11:59:46.954 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.953+0000 7fcb8dffb700 1 -- 172.21.15.73:0/728723413 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5636bd405720 con 0x5636bd5299f0 2023-08-10T11:59:46.954 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.953+0000 7fcb8dffb700 10 client.16593 handle_command_reply: tid=0 2023-08-10T11:59:46.954 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.953+0000 7fcbbc679b80 1 client.16593 shutdown 2023-08-10T11:59:46.954 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.953+0000 7fcbbc679b80 1 -- 172.21.15.73:0/728723413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4bb550 msgr2=0x5636bd4cafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.953+0000 7fcbbc679b80 1 --2- 172.21.15.73:0/728723413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4bb550 0x5636bd4cafd0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fcb98026eb0 tx=0x7fcb9802ea40 comp rx=0 tx=0).stop 2023-08-10T11:59:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.953+0000 7fcbbc679b80 1 -- 172.21.15.73:0/728723413 shutdown_connections 2023-08-10T11:59:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.953+0000 7fcbbc679b80 1 --2- 172.21.15.73:0/728723413 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5636bd5299f0 0x5636bd52be10 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.953+0000 7fcbbc679b80 1 --2- 172.21.15.73:0/728723413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636bd4c1360 0x5636bd527b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.953+0000 7fcb8dffb700 0 client.16593 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:59:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.953+0000 7fcbbc679b80 1 --2- 172.21.15.73:0/728723413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5636bd4bb550 0x5636bd4cafd0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.953+0000 7fcbbc679b80 1 --2- 172.21.15.73:0/728723413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636bd4c0a40 0x5636bd4cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.953+0000 7fcbbc679b80 1 -- 172.21.15.73:0/728723413 >> 172.21.15.73:0/728723413 conn(0x5636bd418c70 msgr2=0x5636bd4c0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:46.956 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.953+0000 7fcbbc679b80 1 -- 172.21.15.73:0/728723413 shutdown_connections 2023-08-10T11:59:46.956 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.953+0000 7fcbbc679b80 1 -- 172.21.15.73:0/728723413 wait complete. 2023-08-10T11:59:46.956 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.953+0000 7fcbbc679b80 20 client.16593 trim_cache size 0 max 16384 2023-08-10T11:59:46.956 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T11:59:46.956 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T11:59:46.957 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T11:59:46.957 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T11:59:46.957 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.954+0000 7fcbb04e0700 1 -- 172.21.15.73:0/3120498954 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fcb900a1340 msgr2=0x7fcb900a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:46.957 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.954+0000 7fcbb04e0700 1 --2- 172.21.15.73:0/3120498954 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fcb900a1340 0x7fcb900a3800 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcba80766a0 tx=0x7fcb98009260 comp rx=0 tx=0).stop 2023-08-10T11:59:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.954+0000 7fcbb04e0700 1 -- 172.21.15.73:0/3120498954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcba8100290 msgr2=0x7fcba819ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.954+0000 7fcbb04e0700 1 --2- 172.21.15.73:0/3120498954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcba8100290 0x7fcba819ee00 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00e9a0 tx=0x7fcb9c00ecb0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.954+0000 7fcbb04e0700 1 -- 172.21.15.73:0/3120498954 shutdown_connections 2023-08-10T11:59:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.954+0000 7fcbb04e0700 1 --2- 172.21.15.73:0/3120498954 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fcb900a1340 0x7fcb900a3800 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.954+0000 7fcbb04e0700 1 --2- 172.21.15.73:0/3120498954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcba8105670 0x7fcba8198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.954+0000 7fcbb04e0700 1 --2- 172.21.15.73:0/3120498954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcba80ff8d0 0x7fcba819e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.954+0000 7fcbb04e0700 1 --2- 172.21.15.73:0/3120498954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcba8100290 0x7fcba819ee00 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.954+0000 7fcbb04e0700 1 -- 172.21.15.73:0/3120498954 >> 172.21.15.73:0/3120498954 conn(0x7fcba80750a0 msgr2=0x7fcba80fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.954+0000 7fcbb04e0700 1 -- 172.21.15.73:0/3120498954 shutdown_connections 2023-08-10T11:59:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T11:59:46.954+0000 7fcbb04e0700 1 -- 172.21.15.73:0/3120498954 wait complete. 2023-08-10T11:59:47.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:47 smithi152 ceph-mon[130220]: pgmap v219: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 115 KiB/s wr, 32 op/s 2023-08-10T11:59:47.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:47 smithi156 ceph-mon[130574]: pgmap v219: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 115 KiB/s wr, 32 op/s 2023-08-10T11:59:47.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:47 smithi073 ceph-mon[128869]: pgmap v219: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 115 KiB/s wr, 32 op/s 2023-08-10T11:59:48.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:48 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T11:59:48.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:48 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T11:59:48.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:48 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T11:59:49.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:49 smithi152 ceph-mon[130220]: pgmap v220: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 169 KiB/s wr, 27 op/s 2023-08-10T11:59:49.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:49 smithi156 ceph-mon[130574]: pgmap v220: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 169 KiB/s wr, 27 op/s 2023-08-10T11:59:49.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:49 smithi073 ceph-mon[128869]: pgmap v220: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 169 KiB/s wr, 27 op/s 2023-08-10T11:59:51.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:51 smithi152 ceph-mon[130220]: pgmap v221: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 288 KiB/s wr, 38 op/s 2023-08-10T11:59:51.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:51 smithi156 ceph-mon[130574]: pgmap v221: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 288 KiB/s wr, 38 op/s 2023-08-10T11:59:51.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:51 smithi073 ceph-mon[128869]: pgmap v221: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 288 KiB/s wr, 38 op/s 2023-08-10T11:59:52.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:52 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:59:52.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:52 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:59:52.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:52 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:59:53.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:53 smithi152 ceph-mon[130220]: pgmap v222: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 238 KiB/s wr, 33 op/s 2023-08-10T11:59:53.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:53 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:59:53.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:53 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:59:53.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:53 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:59:53.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:53 smithi156 ceph-mon[130574]: pgmap v222: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 238 KiB/s wr, 33 op/s 2023-08-10T11:59:53.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:53 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:59:53.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:53 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:59:53.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:53 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:59:53.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:53 smithi073 ceph-mon[128869]: pgmap v222: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 238 KiB/s wr, 33 op/s 2023-08-10T11:59:53.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:53 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:59:53.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:53 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:59:53.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:53 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T11:59:54.130 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:59:54.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.268+0000 7fefc3a7b700 1 -- 172.21.15.73:0/909697643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefbc0ff5d0 msgr2=0x7fefbc0ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:54.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.268+0000 7fefc3a7b700 1 --2- 172.21.15.73:0/909697643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefbc0ff5d0 0x7fefbc0ffa50 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fefb80099c0 tx=0x7fefb8009cd0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.268+0000 7fefc3a7b700 1 -- 172.21.15.73:0/909697643 shutdown_connections 2023-08-10T11:59:54.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.268+0000 7fefc3a7b700 1 --2- 172.21.15.73:0/909697643 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fefbc0fff90 0x7fefbc10c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.268+0000 7fefc3a7b700 1 --2- 172.21.15.73:0/909697643 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefbc105690 0x7fefbc105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.268+0000 7fefc3a7b700 1 --2- 172.21.15.73:0/909697643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefbc0ff5d0 0x7fefbc0ffa50 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.268+0000 7fefc3a7b700 1 -- 172.21.15.73:0/909697643 >> 172.21.15.73:0/909697643 conn(0x7fefbc0fb0c0 msgr2=0x7fefbc0fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:54.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.268+0000 7fefc3a7b700 1 -- 172.21.15.73:0/909697643 shutdown_connections 2023-08-10T11:59:54.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.268+0000 7fefc3a7b700 1 -- 172.21.15.73:0/909697643 wait complete. 2023-08-10T11:59:54.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.268+0000 7fefc3a7b700 1 Processor -- start 2023-08-10T11:59:54.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.268+0000 7fefc3a7b700 1 -- start start 2023-08-10T11:59:54.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.269+0000 7fefc3a7b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fefbc0ff5d0 0x7fefbc1953f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:54.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.269+0000 7fefc3a7b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefbc0fff90 0x7fefbc195930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:54.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.269+0000 7fefc3a7b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefbc105690 0x7fefbc195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:54.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.269+0000 7fefc3a7b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc1a4c30 con 0x7fefbc0fff90 2023-08-10T11:59:54.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.269+0000 7fefc3a7b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc1a4da0 con 0x7fefbc0ff5d0 2023-08-10T11:59:54.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.269+0000 7fefc3a7b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc1a4f60 con 0x7fefbc105690 2023-08-10T11:59:54.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.269+0000 7fefc1016700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefbc0fff90 0x7fefbc195930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:54.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.269+0000 7fefc1016700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefbc0fff90 0x7fefbc195930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35690/0 (socket says 172.21.15.73:35690) 2023-08-10T11:59:54.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.269+0000 7fefc2018700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefbc105690 0x7fefbc195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:54.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.269+0000 7fefc1016700 1 -- 172.21.15.73:0/1166448809 learned_addr learned my addr 172.21.15.73:0/1166448809 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:54.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.269+0000 7fefc1817700 1 --2- 172.21.15.73:0/1166448809 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fefbc0ff5d0 0x7fefbc1953f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:54.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.269+0000 7fefc1016700 1 -- 172.21.15.73:0/1166448809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefbc105690 msgr2=0x7fefbc195e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:54.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.269+0000 7fefc1016700 1 --2- 172.21.15.73:0/1166448809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefbc105690 0x7fefbc195e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.269+0000 7fefc1016700 1 -- 172.21.15.73:0/1166448809 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fefbc0ff5d0 msgr2=0x7fefbc1953f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:54.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.269+0000 7fefc1016700 1 --2- 172.21.15.73:0/1166448809 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fefbc0ff5d0 0x7fefbc1953f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.269+0000 7fefc1016700 1 -- 172.21.15.73:0/1166448809 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb80095f0 con 0x7fefbc0fff90 2023-08-10T11:59:54.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.269+0000 7fefc2018700 1 --2- 172.21.15.73:0/1166448809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefbc105690 0x7fefbc195e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:59:54.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.269+0000 7fefc1016700 1 --2- 172.21.15.73:0/1166448809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefbc0fff90 0x7fefbc195930 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fefb8000c00 tx=0x7fefb800bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:54.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.269+0000 7fefaeffd700 1 -- 172.21.15.73:0/1166448809 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb801d070 con 0x7fefbc0fff90 2023-08-10T11:59:54.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.270+0000 7fefc3a7b700 1 -- 172.21.15.73:0/1166448809 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefbc1a51e0 con 0x7fefbc0fff90 2023-08-10T11:59:54.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.270+0000 7fefaeffd700 1 -- 172.21.15.73:0/1166448809 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefb8005050 con 0x7fefbc0fff90 2023-08-10T11:59:54.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.270+0000 7fefaeffd700 1 -- 172.21.15.73:0/1166448809 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb8004ab0 con 0x7fefbc0fff90 2023-08-10T11:59:54.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.270+0000 7fefc3a7b700 1 -- 172.21.15.73:0/1166448809 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefbc1a5600 con 0x7fefbc0fff90 2023-08-10T11:59:54.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.272+0000 7fefaeffd700 1 -- 172.21.15.73:0/1166448809 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fefb80051c0 con 0x7fefbc0fff90 2023-08-10T11:59:54.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.272+0000 7fefaeffd700 1 --2- 172.21.15.73:0/1166448809 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fefa80a12c0 0x7fefa80a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:54.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.273+0000 7fefc1817700 1 --2- 172.21.15.73:0/1166448809 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fefa80a12c0 0x7fefa80a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:54.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.273+0000 7fefaeffd700 1 -- 172.21.15.73:0/1166448809 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fefb80cd9e0 con 0x7fefbc0fff90 2023-08-10T11:59:54.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.273+0000 7fefc1817700 1 --2- 172.21.15.73:0/1166448809 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fefa80a12c0 0x7fefa80a3780 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fefb0009be0 tx=0x7fefb0009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:54.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.273+0000 7fefcfc14b80 1 Processor -- start 2023-08-10T11:59:54.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.274+0000 7fefcfc14b80 1 -- start start 2023-08-10T11:59:54.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.274+0000 7fefcfc14b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d021ca4f50 0x55d021ca5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:54.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.274+0000 7fefcfc14b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021ca5870 0x55d021c9f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:54.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.274+0000 7fefcfc14b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d021c9f800 0x55d021c9fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:54.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.274+0000 7fefcfc14b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d021c1adc0 con 0x55d021ca5870 2023-08-10T11:59:54.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.274+0000 7fefcfc14b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d021bf7590 con 0x55d021ca4f50 2023-08-10T11:59:54.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.274+0000 7fefcfc14b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d021bf4eb0 con 0x55d021c9f800 2023-08-10T11:59:54.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.274+0000 7fefc1016700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021ca5870 0x55d021c9f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:54.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.274+0000 7fefc1817700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d021ca4f50 0x55d021ca5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:54.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.274+0000 7fefc1016700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021ca5870 0x55d021c9f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35698/0 (socket says 172.21.15.73:35698) 2023-08-10T11:59:54.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.274+0000 7fefc1016700 1 -- 172.21.15.73:0/2358452647 learned_addr learned my addr 172.21.15.73:0/2358452647 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:54.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.274+0000 7fefc2018700 1 --2- 172.21.15.73:0/2358452647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d021c9f800 0x55d021c9fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:54.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.274+0000 7fefc1016700 1 -- 172.21.15.73:0/2358452647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d021c9f800 msgr2=0x55d021c9fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:54.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.274+0000 7fefc1016700 1 --2- 172.21.15.73:0/2358452647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d021c9f800 0x55d021c9fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.274+0000 7fefc1016700 1 -- 172.21.15.73:0/2358452647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d021ca4f50 msgr2=0x55d021ca5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:54.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.274+0000 7fefc1016700 1 --2- 172.21.15.73:0/2358452647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d021ca4f50 0x55d021ca5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.274+0000 7fefc1016700 1 -- 172.21.15.73:0/2358452647 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d021a71630 con 0x55d021ca5870 2023-08-10T11:59:54.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.274+0000 7fefc1016700 1 --2- 172.21.15.73:0/2358452647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021ca5870 0x55d021c9f2c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fefb80cb190 tx=0x7fefb809a590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b5c1331c6ac1f7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:54.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.275+0000 7fefa7fff700 1 -- 172.21.15.73:0/2358452647 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb80a2f00 con 0x55d021ca5870 2023-08-10T11:59:54.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.275+0000 7fefa7fff700 1 -- 172.21.15.73:0/2358452647 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefb80054a0 con 0x55d021ca5870 2023-08-10T11:59:54.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.275+0000 7fefa7fff700 1 -- 172.21.15.73:0/2358452647 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb809afa0 con 0x55d021ca5870 2023-08-10T11:59:54.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.275+0000 7fefcfc14b80 1 -- 172.21.15.73:0/2358452647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021ca5870 msgr2=0x55d021c9f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:54.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.275+0000 7fefcfc14b80 1 --2- 172.21.15.73:0/2358452647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021ca5870 0x55d021c9f2c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fefb80cb190 tx=0x7fefb809a590 comp rx=0 tx=0).stop 2023-08-10T11:59:54.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.275+0000 7fefcfc14b80 1 -- 172.21.15.73:0/2358452647 shutdown_connections 2023-08-10T11:59:54.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.275+0000 7fefcfc14b80 1 --2- 172.21.15.73:0/2358452647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d021ca4f50 0x55d021ca5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.275+0000 7fefcfc14b80 1 --2- 172.21.15.73:0/2358452647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d021c9f800 0x55d021c9fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.275+0000 7fefcfc14b80 1 --2- 172.21.15.73:0/2358452647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021ca5870 0x55d021c9f2c0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.275+0000 7fefcfc14b80 1 -- 172.21.15.73:0/2358452647 >> 172.21.15.73:0/2358452647 conn(0x55d021bfccd0 msgr2=0x55d021c9a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:54.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.276+0000 7fefcfc14b80 1 -- 172.21.15.73:0/2358452647 shutdown_connections 2023-08-10T11:59:54.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.276+0000 7fefcfc14b80 1 -- 172.21.15.73:0/2358452647 wait complete. 2023-08-10T11:59:54.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.276+0000 7fefcfc14b80 1 -- start start 2023-08-10T11:59:54.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.276+0000 7fefcfc14b80 1 Processor -- start 2023-08-10T11:59:54.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.276+0000 7fefcfc14b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d021c9f800 0x55d021cab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:54.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.276+0000 7fefcfc14b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021ca4f50 0x55d021ca8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:54.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.276+0000 7fefcfc14b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d021ca5870 0x55d021ca9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:54.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.276+0000 7fefcfc14b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d021bf07a0 con 0x55d021ca4f50 2023-08-10T11:59:54.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.276+0000 7fefcfc14b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d021b8fac0 con 0x55d021ca5870 2023-08-10T11:59:54.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.276+0000 7fefcfc14b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d021b8f7c0 con 0x55d021c9f800 2023-08-10T11:59:54.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.276+0000 7fefcfc14b80 10 client.0 _ll_register_callbacks cb 0x55d021b8d680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:59:54.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.276+0000 7fefc1016700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021ca4f50 0x55d021ca8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:54.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.277+0000 7fefc1016700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021ca4f50 0x55d021ca8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35704/0 (socket says 172.21.15.73:35704) 2023-08-10T11:59:54.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.277+0000 7fefc1817700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d021c9f800 0x55d021cab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:54.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.277+0000 7fefc1016700 1 -- 172.21.15.73:0/1994854921 learned_addr learned my addr 172.21.15.73:0/1994854921 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:54.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.277+0000 7fefc2018700 1 --2- 172.21.15.73:0/1994854921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d021ca5870 0x55d021ca9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:54.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.277+0000 7fefc1016700 1 -- 172.21.15.73:0/1994854921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d021c9f800 msgr2=0x55d021cab8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:54.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.277+0000 7fefc1016700 1 --2- 172.21.15.73:0/1994854921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d021c9f800 0x55d021cab8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.277+0000 7fefc1016700 1 -- 172.21.15.73:0/1994854921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d021ca5870 msgr2=0x55d021ca9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:54.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.277+0000 7fefc1016700 1 --2- 172.21.15.73:0/1994854921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d021ca5870 0x55d021ca9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.277+0000 7fefc1016700 1 -- 172.21.15.73:0/1994854921 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefbc1a5600 con 0x55d021ca4f50 2023-08-10T11:59:54.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.277+0000 7fefc1016700 1 --2- 172.21.15.73:0/1994854921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021ca4f50 0x55d021ca8b40 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fefb80cdcc0 tx=0x7fefb8009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa8a39400762d6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:54.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.277+0000 7fefa57fa700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:59:54.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.277+0000 7fefa57fa700 1 -- 172.21.15.73:0/1994854921 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb80b3260 con 0x55d021ca4f50 2023-08-10T11:59:54.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.277+0000 7fefa57fa700 1 -- 172.21.15.73:0/1994854921 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fefb80a2f00 con 0x55d021ca4f50 2023-08-10T11:59:54.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.277+0000 7fefcfc14b80 1 -- 172.21.15.73:0/1994854921 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d021c92470 con 0x55d021ca4f50 2023-08-10T11:59:54.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.277+0000 7fefa57fa700 1 -- 172.21.15.73:0/1994854921 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefb809a240 con 0x55d021ca4f50 2023-08-10T11:59:54.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.277+0000 7fefcfc14b80 10 client.16605 fetch_fsmap learned FSMap version 45 2023-08-10T11:59:54.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.277+0000 7fefcfc14b80 1 -- 172.21.15.73:0/1994854921 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55d021a1dde0 con 0x55d021ca4f50 2023-08-10T11:59:54.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.277+0000 7fefa57fa700 1 -- 172.21.15.73:0/1994854921 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d021c92470 con 0x55d021ca4f50 2023-08-10T11:59:54.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.278+0000 7fefa57fa700 1 -- 172.21.15.73:0/1994854921 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 45) v1 ==== 6981+0+0 (secure 0 0 0) 0x7fefb8096930 con 0x55d021ca4f50 2023-08-10T11:59:54.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.278+0000 7fefcfc14b80 10 client.16605 fetch_fsmap finished waiting for FSMap version 45 2023-08-10T11:59:54.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.278+0000 7fefcfc14b80 10 client.16605 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:59:54.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.278+0000 7fefcfc14b80 20 client.16605 populate_metadata read hostname 'smithi073' 2023-08-10T11:59:54.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.278+0000 7fefcfc14b80 1 --2- 172.21.15.73:0/1994854921 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55d021cb8bf0 0x55d021cbb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:54.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.278+0000 7fefcfc14b80 4 client.16605 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:59:54.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.278+0000 7fefcfc14b80 1 -- 172.21.15.73:0/1994854921 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d021c6e9d0 con 0x55d021cb8bf0 2023-08-10T11:59:54.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.278+0000 7fefc1817700 1 --2- 172.21.15.73:0/1994854921 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55d021cb8bf0 0x55d021cbb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:54.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.278+0000 7fefa57fa700 10 client.16605 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:59:54.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.278+0000 7fefc1817700 1 --2- 172.21.15.73:0/1994854921 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55d021cb8bf0 0x55d021cbb010 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c85c49252438169 server_cookie=4b0b8857181b41b9 in_seq=0 out_seq=0 2023-08-10T11:59:54.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.279+0000 7fefa57fa700 1 -- 172.21.15.73:0/1994854921 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55d021c6e9d0 con 0x55d021cb8bf0 2023-08-10T11:59:54.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.279+0000 7fefa57fa700 10 client.16605 handle_command_reply: tid=0 2023-08-10T11:59:54.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.279+0000 7fefcfc14b80 1 client.16605 shutdown 2023-08-10T11:59:54.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.279+0000 7fefcfc14b80 1 -- 172.21.15.73:0/1994854921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021ca4f50 msgr2=0x55d021ca8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:54.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.279+0000 7fefcfc14b80 1 --2- 172.21.15.73:0/1994854921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021ca4f50 0x55d021ca8b40 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fefb80cdcc0 tx=0x7fefb8009310 comp rx=0 tx=0).stop 2023-08-10T11:59:54.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.279+0000 7fefcfc14b80 1 -- 172.21.15.73:0/1994854921 shutdown_connections 2023-08-10T11:59:54.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.279+0000 7fefcfc14b80 1 --2- 172.21.15.73:0/1994854921 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55d021cb8bf0 0x55d021cbb010 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.279+0000 7fefcfc14b80 1 --2- 172.21.15.73:0/1994854921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d021ca5870 0x55d021ca9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.279+0000 7fefa57fa700 0 client.16605 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:59:54.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.279+0000 7fefcfc14b80 1 --2- 172.21.15.73:0/1994854921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d021c9f800 0x55d021cab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.279+0000 7fefcfc14b80 1 --2- 172.21.15.73:0/1994854921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021ca4f50 0x55d021ca8b40 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.279+0000 7fefcfc14b80 1 -- 172.21.15.73:0/1994854921 >> 172.21.15.73:0/1994854921 conn(0x55d021bfccd0 msgr2=0x55d021c999b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:54.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.279+0000 7fefcfc14b80 1 -- 172.21.15.73:0/1994854921 shutdown_connections 2023-08-10T11:59:54.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.279+0000 7fefcfc14b80 1 -- 172.21.15.73:0/1994854921 wait complete. 2023-08-10T11:59:54.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.279+0000 7fefcfc14b80 20 client.16605 trim_cache size 0 max 16384 2023-08-10T11:59:54.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.296+0000 7fefcfc14b80 1 Processor -- start 2023-08-10T11:59:54.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.296+0000 7fefcfc14b80 1 -- start start 2023-08-10T11:59:54.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.296+0000 7fefcfc14b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021c9f800 0x55d021caffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:54.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.296+0000 7fefcfc14b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d021ca4f50 0x55d021c9a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:54.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.296+0000 7fefcfc14b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d021ca5870 0x55d021c9a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:54.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.296+0000 7fefcfc14b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d021a73920 con 0x55d021c9f800 2023-08-10T11:59:54.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.296+0000 7fefcfc14b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d021c96fb0 con 0x55d021ca5870 2023-08-10T11:59:54.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.296+0000 7fefcfc14b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d021ca9b40 con 0x55d021ca4f50 2023-08-10T11:59:54.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.296+0000 7fefc1817700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021c9f800 0x55d021caffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:54.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.296+0000 7fefc1817700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021c9f800 0x55d021caffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35710/0 (socket says 172.21.15.73:35710) 2023-08-10T11:59:54.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.296+0000 7fefc1817700 1 -- 172.21.15.73:0/102513556 learned_addr learned my addr 172.21.15.73:0/102513556 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:54.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.296+0000 7fefc2018700 1 --2- 172.21.15.73:0/102513556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d021ca5870 0x55d021c9a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:54.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.296+0000 7fefc1016700 1 --2- 172.21.15.73:0/102513556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d021ca4f50 0x55d021c9a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:54.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.296+0000 7fefc1817700 1 -- 172.21.15.73:0/102513556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d021ca4f50 msgr2=0x55d021c9a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:54.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.296+0000 7fefc1817700 1 --2- 172.21.15.73:0/102513556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d021ca4f50 0x55d021c9a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.296+0000 7fefc1817700 1 -- 172.21.15.73:0/102513556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d021ca5870 msgr2=0x55d021c9a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:54.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.296+0000 7fefc1817700 1 --2- 172.21.15.73:0/102513556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d021ca5870 0x55d021c9a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.296+0000 7fefc1817700 1 -- 172.21.15.73:0/102513556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d021a06c60 con 0x55d021c9f800 2023-08-10T11:59:54.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.296+0000 7fefc2018700 1 --2- 172.21.15.73:0/102513556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d021ca5870 0x55d021c9a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:59:54.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.296+0000 7fefc1817700 1 --2- 172.21.15.73:0/102513556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021c9f800 0x55d021caffe0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fefb0005950 tx=0x7fefb0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1298923f732d9ea server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:54.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.297+0000 7fefacdaa700 1 -- 172.21.15.73:0/102513556 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb0024040 con 0x55d021c9f800 2023-08-10T11:59:54.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.297+0000 7fefacdaa700 1 -- 172.21.15.73:0/102513556 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefb00293b0 con 0x55d021c9f800 2023-08-10T11:59:54.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.297+0000 7fefacdaa700 1 -- 172.21.15.73:0/102513556 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb0003b90 con 0x55d021c9f800 2023-08-10T11:59:54.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.297+0000 7fefcfc14b80 1 -- 172.21.15.73:0/102513556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021c9f800 msgr2=0x55d021caffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:54.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.297+0000 7fefcfc14b80 1 --2- 172.21.15.73:0/102513556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021c9f800 0x55d021caffe0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fefb0005950 tx=0x7fefb0014000 comp rx=0 tx=0).stop 2023-08-10T11:59:54.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.297+0000 7fefcfc14b80 1 -- 172.21.15.73:0/102513556 shutdown_connections 2023-08-10T11:59:54.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.297+0000 7fefcfc14b80 1 --2- 172.21.15.73:0/102513556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d021ca5870 0x55d021c9a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.297+0000 7fefcfc14b80 1 --2- 172.21.15.73:0/102513556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021c9f800 0x55d021caffe0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.297+0000 7fefcfc14b80 1 --2- 172.21.15.73:0/102513556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d021ca4f50 0x55d021c9a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.297+0000 7fefcfc14b80 1 -- 172.21.15.73:0/102513556 >> 172.21.15.73:0/102513556 conn(0x55d021bfccd0 msgr2=0x55d021ca2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:54.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.297+0000 7fefcfc14b80 1 -- 172.21.15.73:0/102513556 shutdown_connections 2023-08-10T11:59:54.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.297+0000 7fefcfc14b80 1 -- 172.21.15.73:0/102513556 wait complete. 2023-08-10T11:59:54.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.297+0000 7fefcfc14b80 1 -- start start 2023-08-10T11:59:54.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.298+0000 7fefcfc14b80 1 Processor -- start 2023-08-10T11:59:54.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.298+0000 7fefcfc14b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d021c9f800 0x55d021ca2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:54.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.298+0000 7fefcfc14b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021ca4f50 0x55d021ca0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:54.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.298+0000 7fefcfc14b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d021ca5870 0x55d021ca0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:54.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.298+0000 7fefcfc14b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d021ca13f0 con 0x55d021ca4f50 2023-08-10T11:59:54.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.298+0000 7fefcfc14b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d021ca1560 con 0x55d021ca5870 2023-08-10T11:59:54.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.298+0000 7fefcfc14b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d021ca1720 con 0x55d021c9f800 2023-08-10T11:59:54.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.298+0000 7fefcfc14b80 10 client.0 _ll_register_callbacks cb 0x55d021b8d680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:59:54.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.298+0000 7fefc1016700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021ca4f50 0x55d021ca0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:54.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.298+0000 7fefc2018700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d021ca5870 0x55d021ca0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:54.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.298+0000 7fefc1016700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021ca4f50 0x55d021ca0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35718/0 (socket says 172.21.15.73:35718) 2023-08-10T11:59:54.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.298+0000 7fefc1817700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d021c9f800 0x55d021ca2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:54.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.298+0000 7fefc1016700 1 -- 172.21.15.73:0/1477188283 learned_addr learned my addr 172.21.15.73:0/1477188283 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T11:59:54.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.298+0000 7fefc2018700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d021ca5870 0x55d021ca0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:50370/0 (socket says 172.21.15.73:50370) 2023-08-10T11:59:54.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.299+0000 7fefc1016700 1 -- 172.21.15.73:0/1477188283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d021c9f800 msgr2=0x55d021ca2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:54.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.299+0000 7fefc1016700 1 --2- 172.21.15.73:0/1477188283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d021c9f800 0x55d021ca2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.299+0000 7fefc1016700 1 -- 172.21.15.73:0/1477188283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d021ca5870 msgr2=0x55d021ca0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:59:54.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.299+0000 7fefc1016700 1 --2- 172.21.15.73:0/1477188283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d021ca5870 0x55d021ca0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.299+0000 7fefc1016700 1 -- 172.21.15.73:0/1477188283 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb0017070 con 0x55d021ca4f50 2023-08-10T11:59:54.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.299+0000 7fefc1016700 1 --2- 172.21.15.73:0/1477188283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021ca4f50 0x55d021ca0970 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fefb8009fd0 tx=0x7fefb8096de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da23aa714e90af8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:59:54.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.299+0000 7fefa57fa700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T11:59:54.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.299+0000 7fefa57fa700 1 -- 172.21.15.73:0/1477188283 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb809a4a0 con 0x55d021ca4f50 2023-08-10T11:59:54.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.299+0000 7fefa57fa700 1 -- 172.21.15.73:0/1477188283 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fefb80b3260 con 0x55d021ca4f50 2023-08-10T11:59:54.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.299+0000 7fefcfc14b80 1 -- 172.21.15.73:0/1477188283 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fefb80054a0 con 0x55d021ca4f50 2023-08-10T11:59:54.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.299+0000 7fefa57fa700 1 -- 172.21.15.73:0/1477188283 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefb809a240 con 0x55d021ca4f50 2023-08-10T11:59:54.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.299+0000 7fefcfc14b80 10 client.16611 fetch_fsmap learned FSMap version 45 2023-08-10T11:59:54.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.299+0000 7fefcfc14b80 1 -- 172.21.15.73:0/1477188283 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55d021a44250 con 0x55d021ca4f50 2023-08-10T11:59:54.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.299+0000 7fefa57fa700 1 -- 172.21.15.73:0/1477188283 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefb80054a0 con 0x55d021ca4f50 2023-08-10T11:59:54.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.299+0000 7fefa57fa700 1 -- 172.21.15.73:0/1477188283 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 45) v1 ==== 6981+0+0 (secure 0 0 0) 0x7fefb8099bc0 con 0x55d021ca4f50 2023-08-10T11:59:54.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.299+0000 7fefcfc14b80 10 client.16611 fetch_fsmap finished waiting for FSMap version 45 2023-08-10T11:59:54.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.299+0000 7fefcfc14b80 10 client.16611 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:59:54.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.299+0000 7fefcfc14b80 20 client.16611 populate_metadata read hostname 'smithi073' 2023-08-10T11:59:54.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.299+0000 7fefcfc14b80 1 --2- 172.21.15.73:0/1477188283 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55d021d0d770 0x55d021d0fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:59:54.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.299+0000 7fefcfc14b80 4 client.16611 mds_command: new command op to 24503 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:59:54.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.299+0000 7fefcfc14b80 1 -- 172.21.15.73:0/1477188283 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d021be9780 con 0x55d021d0d770 2023-08-10T11:59:54.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.300+0000 7fefc1817700 1 --2- 172.21.15.73:0/1477188283 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55d021d0d770 0x55d021d0fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:59:54.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.300+0000 7fefa57fa700 10 client.16611 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T11:59:54.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.300+0000 7fefc1817700 1 --2- 172.21.15.73:0/1477188283 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55d021d0d770 0x55d021d0fb90 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd077f8bfa735826 server_cookie=6cb5b584686afd8e in_seq=0 out_seq=0 2023-08-10T11:59:54.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.300+0000 7fefa57fa700 1 -- 172.21.15.73:0/1477188283 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55d021be9780 con 0x55d021d0d770 2023-08-10T11:59:54.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.300+0000 7fefa57fa700 10 client.16611 handle_command_reply: tid=0 2023-08-10T11:59:54.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.300+0000 7fefcfc14b80 1 client.16611 shutdown 2023-08-10T11:59:54.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.300+0000 7fefcfc14b80 1 -- 172.21.15.73:0/1477188283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021ca4f50 msgr2=0x55d021ca0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:54.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.300+0000 7fefcfc14b80 1 --2- 172.21.15.73:0/1477188283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021ca4f50 0x55d021ca0970 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fefb8009fd0 tx=0x7fefb8096de0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.300+0000 7fefcfc14b80 1 -- 172.21.15.73:0/1477188283 shutdown_connections 2023-08-10T11:59:54.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.300+0000 7fefcfc14b80 1 --2- 172.21.15.73:0/1477188283 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55d021d0d770 0x55d021d0fb90 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.300+0000 7fefcfc14b80 1 --2- 172.21.15.73:0/1477188283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d021ca5870 0x55d021ca0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.300+0000 7fefa57fa700 0 client.16611 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T11:59:54.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.300+0000 7fefcfc14b80 1 --2- 172.21.15.73:0/1477188283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d021c9f800 0x55d021ca2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.300+0000 7fefcfc14b80 1 --2- 172.21.15.73:0/1477188283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d021ca4f50 0x55d021ca0970 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.300+0000 7fefcfc14b80 1 -- 172.21.15.73:0/1477188283 >> 172.21.15.73:0/1477188283 conn(0x55d021bfccd0 msgr2=0x55d021ca3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:54.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.300+0000 7fefcfc14b80 1 -- 172.21.15.73:0/1477188283 shutdown_connections 2023-08-10T11:59:54.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.300+0000 7fefcfc14b80 1 -- 172.21.15.73:0/1477188283 wait complete. 2023-08-10T11:59:54.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.300+0000 7fefcfc14b80 20 client.16611 trim_cache size 0 max 16384 2023-08-10T11:59:54.312 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T11:59:54.312 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:59:54.312 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": { 2023-08-10T11:59:54.312 INFO:teuthology.orchestra.run.smithi073.stdout: "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d": { 2023-08-10T11:59:54.312 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2023-08-10T11:59:54.313 INFO:teuthology.orchestra.run.smithi073.stdout: "tag": "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d", 2023-08-10T11:59:54.313 INFO:teuthology.orchestra.run.smithi073.stdout: "options": "recursive,force" 2023-08-10T11:59:54.313 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:59:54.313 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T11:59:54.313 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T11:59:54.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.301+0000 7fefc3a7b700 1 -- 172.21.15.73:0/1166448809 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fefa80a12c0 msgr2=0x7fefa80a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:54.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.301+0000 7fefc3a7b700 1 --2- 172.21.15.73:0/1166448809 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fefa80a12c0 0x7fefa80a3780 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fefb0009be0 tx=0x7fefb0009260 comp rx=0 tx=0).stop 2023-08-10T11:59:54.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.301+0000 7fefc3a7b700 1 -- 172.21.15.73:0/1166448809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefbc0fff90 msgr2=0x7fefbc195930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:59:54.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.301+0000 7fefc3a7b700 1 --2- 172.21.15.73:0/1166448809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefbc0fff90 0x7fefbc195930 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fefb8000c00 tx=0x7fefb800bfd0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.301+0000 7fefc3a7b700 1 -- 172.21.15.73:0/1166448809 shutdown_connections 2023-08-10T11:59:54.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.301+0000 7fefc3a7b700 1 --2- 172.21.15.73:0/1166448809 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fefa80a12c0 0x7fefa80a3780 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.301+0000 7fefc3a7b700 1 --2- 172.21.15.73:0/1166448809 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fefbc0ff5d0 0x7fefbc1953f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.301+0000 7fefc3a7b700 1 --2- 172.21.15.73:0/1166448809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefbc105690 0x7fefbc195e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.301+0000 7fefc3a7b700 1 --2- 172.21.15.73:0/1166448809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefbc0fff90 0x7fefbc195930 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:59:54.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.301+0000 7fefc3a7b700 1 -- 172.21.15.73:0/1166448809 >> 172.21.15.73:0/1166448809 conn(0x7fefbc0fb0c0 msgr2=0x7fefbc0fc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:59:54.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.301+0000 7fefc3a7b700 1 -- 172.21.15.73:0/1166448809 shutdown_connections 2023-08-10T11:59:54.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T11:59:54.301+0000 7fefc3a7b700 1 -- 172.21.15.73:0/1166448809 wait complete. 2023-08-10T11:59:54.316 INFO:tasks.cephfs.filesystem:scrub status for tag:9d39b3fa-9b62-42b4-b1a5-738cb3118a5d - {'path': '/', 'tag': '9d39b3fa-9b62-42b4-b1a5-738cb3118a5d', 'options': 'recursive,force'} 2023-08-10T11:59:55.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:54 smithi152 ceph-mon[130220]: pgmap v223: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 245 KiB/s wr, 34 op/s 2023-08-10T11:59:55.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:54 smithi156 ceph-mon[130574]: pgmap v223: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 245 KiB/s wr, 34 op/s 2023-08-10T11:59:55.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:54 smithi073 ceph-mon[128869]: pgmap v223: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 245 KiB/s wr, 34 op/s 2023-08-10T11:59:57.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:57 smithi152 ceph-mon[130220]: pgmap v224: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 242 KiB/s wr, 34 op/s 2023-08-10T11:59:57.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:57 smithi156 ceph-mon[130574]: pgmap v224: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 242 KiB/s wr, 34 op/s 2023-08-10T11:59:57.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:57 smithi073 ceph-mon[128869]: pgmap v224: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 242 KiB/s wr, 34 op/s 2023-08-10T11:59:59.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 11:59:59 smithi152 ceph-mon[130220]: pgmap v225: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 228 KiB/s wr, 27 op/s 2023-08-10T11:59:59.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 11:59:59 smithi156 ceph-mon[130574]: pgmap v225: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 228 KiB/s wr, 27 op/s 2023-08-10T11:59:59.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 11:59:59 smithi073 ceph-mon[128869]: pgmap v225: 97 pgs: 97 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 228 KiB/s wr, 27 op/s 2023-08-10T12:00:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.075+0000 7f065d785700 1 -- 172.21.15.73:0/2800366577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0658105640 msgr2=0x7f0658105a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.075+0000 7f065d785700 1 --2- 172.21.15.73:0/2800366577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0658105640 0x7f0658105a20 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f0648009990 tx=0x7f0648009ca0 comp rx=0 tx=0).stop 2023-08-10T12:00:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.075+0000 7f065d785700 1 -- 172.21.15.73:0/2800366577 shutdown_connections 2023-08-10T12:00:00.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.075+0000 7f065d785700 1 --2- 172.21.15.73:0/2800366577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06581001c0 0x7f065810c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:00.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.075+0000 7f065d785700 1 --2- 172.21.15.73:0/2800366577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0658105640 0x7f0658105a20 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:00.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.075+0000 7f065d785700 1 --2- 172.21.15.73:0/2800366577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06580ff800 0x7f06580ffc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:00.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.075+0000 7f065d785700 1 -- 172.21.15.73:0/2800366577 >> 172.21.15.73:0/2800366577 conn(0x7f06580774a0 msgr2=0x7f06580778b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:00.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.075+0000 7f065d785700 1 -- 172.21.15.73:0/2800366577 shutdown_connections 2023-08-10T12:00:00.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.075+0000 7f065d785700 1 -- 172.21.15.73:0/2800366577 wait complete. 2023-08-10T12:00:00.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.076+0000 7f065d785700 1 Processor -- start 2023-08-10T12:00:00.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.076+0000 7f065d785700 1 -- start start 2023-08-10T12:00:00.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.076+0000 7f065d785700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06580ff800 0x7f0658195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:00.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.076+0000 7f065d785700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06581001c0 0x7f0658195c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:00.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.076+0000 7f065d785700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0658105640 0x7f06581a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:00.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.076+0000 7f065d785700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06581a50f0 con 0x7f06580ff800 2023-08-10T12:00:00.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.076+0000 7f065d785700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06581a5230 con 0x7f0658105640 2023-08-10T12:00:00.084 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.076+0000 7f065d785700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06581a5370 con 0x7f06581001c0 2023-08-10T12:00:00.084 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.076+0000 7f0656ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06580ff800 0x7f0658195710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:00.084 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.076+0000 7f0656ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06580ff800 0x7f0658195710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35732/0 (socket says 172.21.15.73:35732) 2023-08-10T12:00:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.076+0000 7f0656ffd700 1 -- 172.21.15.73:0/358794448 learned_addr learned my addr 172.21.15.73:0/358794448 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.076+0000 7f06567fc700 1 --2- 172.21.15.73:0/358794448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06581001c0 0x7f0658195c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.077+0000 7f06577fe700 1 --2- 172.21.15.73:0/358794448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0658105640 0x7f06581a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.077+0000 7f0656ffd700 1 -- 172.21.15.73:0/358794448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06581001c0 msgr2=0x7f0658195c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:00.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.077+0000 7f0656ffd700 1 --2- 172.21.15.73:0/358794448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06581001c0 0x7f0658195c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:00.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.077+0000 7f0656ffd700 1 -- 172.21.15.73:0/358794448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0658105640 msgr2=0x7f06581a4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:00.086 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.077+0000 7f0656ffd700 1 --2- 172.21.15.73:0/358794448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0658105640 0x7f06581a4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:00.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.077+0000 7f0656ffd700 1 -- 172.21.15.73:0/358794448 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06480095f0 con 0x7f06580ff800 2023-08-10T12:00:00.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.077+0000 7f0656ffd700 1 --2- 172.21.15.73:0/358794448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06580ff800 0x7f0658195710 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f0648006010 tx=0x7f064800f700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:00.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.077+0000 7f063ffff700 1 -- 172.21.15.73:0/358794448 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064801d070 con 0x7f06580ff800 2023-08-10T12:00:00.087 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.077+0000 7f063ffff700 1 -- 172.21.15.73:0/358794448 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f064800fbf0 con 0x7f06580ff800 2023-08-10T12:00:00.088 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.077+0000 7f065d785700 1 -- 172.21.15.73:0/358794448 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06581a55a0 con 0x7f06580ff800 2023-08-10T12:00:00.088 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.077+0000 7f063ffff700 1 -- 172.21.15.73:0/358794448 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648017650 con 0x7f06580ff800 2023-08-10T12:00:00.088 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.077+0000 7f065d785700 1 -- 172.21.15.73:0/358794448 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06581a5a50 con 0x7f06580ff800 2023-08-10T12:00:00.097 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.079+0000 7f063ffff700 1 -- 172.21.15.73:0/358794448 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f06480177b0 con 0x7f06580ff800 2023-08-10T12:00:00.097 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.080+0000 7f063ffff700 1 --2- 172.21.15.73:0/358794448 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f06400a12c0 0x7f06400a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:00.098 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.080+0000 7f063ffff700 1 -- 172.21.15.73:0/358794448 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f06480cdfb0 con 0x7f06580ff800 2023-08-10T12:00:00.098 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.080+0000 7f06567fc700 1 --2- 172.21.15.73:0/358794448 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f06400a12c0 0x7f06400a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:00.098 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.081+0000 7f06567fc700 1 --2- 172.21.15.73:0/358794448 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f06400a12c0 0x7f06400a3780 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0658197690 tx=0x7f064c009190 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:00.099 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.081+0000 7f066991eb80 1 Processor -- start 2023-08-10T12:00:00.099 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.081+0000 7f066991eb80 1 -- start start 2023-08-10T12:00:00.099 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.081+0000 7f066991eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56011a16ca40 0x56011a16ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:00.099 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.081+0000 7f066991eb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a16d360 0x56011a167010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:00.100 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.081+0000 7f066991eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56011a167550 0x56011a1679d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:00.100 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.081+0000 7f066991eb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56011a0e2d60 con 0x56011a16d360 2023-08-10T12:00:00.100 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.081+0000 7f066991eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56011a0bf530 con 0x56011a16ca40 2023-08-10T12:00:00.100 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.081+0000 7f066991eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56011a0bce50 con 0x56011a167550 2023-08-10T12:00:00.101 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.081+0000 7f06567fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a16d360 0x56011a167010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:00.101 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.081+0000 7f06567fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a16d360 0x56011a167010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35742/0 (socket says 172.21.15.73:35742) 2023-08-10T12:00:00.101 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.081+0000 7f06567fc700 1 -- 172.21.15.73:0/1522729885 learned_addr learned my addr 172.21.15.73:0/1522729885 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:00.101 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.081+0000 7f0656ffd700 1 --2- 172.21.15.73:0/1522729885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56011a16ca40 0x56011a16ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:00.102 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.081+0000 7f06577fe700 1 --2- 172.21.15.73:0/1522729885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56011a167550 0x56011a1679d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:00.102 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.082+0000 7f06567fc700 1 -- 172.21.15.73:0/1522729885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56011a167550 msgr2=0x56011a1679d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:00.102 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.082+0000 7f06567fc700 1 --2- 172.21.15.73:0/1522729885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56011a167550 0x56011a1679d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:00.102 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.082+0000 7f06567fc700 1 -- 172.21.15.73:0/1522729885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56011a16ca40 msgr2=0x56011a16ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:00.103 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.082+0000 7f06567fc700 1 --2- 172.21.15.73:0/1522729885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56011a16ca40 0x56011a16ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:00.103 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.082+0000 7f06567fc700 1 -- 172.21.15.73:0/1522729885 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560119f395d0 con 0x56011a16d360 2023-08-10T12:00:00.103 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.082+0000 7f06567fc700 1 --2- 172.21.15.73:0/1522729885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a16d360 0x56011a167010 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f064c009fd0 tx=0x7f064c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b51f44b75b368a85 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:00.103 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.082+0000 7f063d7fa700 1 -- 172.21.15.73:0/1522729885 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c00ee90 con 0x56011a16d360 2023-08-10T12:00:00.104 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.082+0000 7f063d7fa700 1 -- 172.21.15.73:0/1522729885 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f064c015940 con 0x56011a16d360 2023-08-10T12:00:00.104 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.082+0000 7f063d7fa700 1 -- 172.21.15.73:0/1522729885 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c013970 con 0x56011a16d360 2023-08-10T12:00:00.104 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.083+0000 7f066991eb80 1 -- 172.21.15.73:0/1522729885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a16d360 msgr2=0x56011a167010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:00.104 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.083+0000 7f066991eb80 1 --2- 172.21.15.73:0/1522729885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a16d360 0x56011a167010 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f064c009fd0 tx=0x7f064c011000 comp rx=0 tx=0).stop 2023-08-10T12:00:00.105 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.083+0000 7f066991eb80 1 -- 172.21.15.73:0/1522729885 shutdown_connections 2023-08-10T12:00:00.105 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.083+0000 7f066991eb80 1 --2- 172.21.15.73:0/1522729885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56011a16ca40 0x56011a16ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:00.105 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.083+0000 7f066991eb80 1 --2- 172.21.15.73:0/1522729885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56011a167550 0x56011a1679d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:00.106 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.083+0000 7f066991eb80 1 --2- 172.21.15.73:0/1522729885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a16d360 0x56011a167010 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:00.106 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.083+0000 7f066991eb80 1 -- 172.21.15.73:0/1522729885 >> 172.21.15.73:0/1522729885 conn(0x56011a0c4c70 msgr2=0x56011a161d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:00.106 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.083+0000 7f066991eb80 1 -- 172.21.15.73:0/1522729885 shutdown_connections 2023-08-10T12:00:00.106 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.083+0000 7f066991eb80 1 -- 172.21.15.73:0/1522729885 wait complete. 2023-08-10T12:00:00.107 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.083+0000 7f066991eb80 1 -- start start 2023-08-10T12:00:00.107 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.083+0000 7f066991eb80 1 Processor -- start 2023-08-10T12:00:00.107 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.083+0000 7f066991eb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a167550 0x56011a173340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:00.108 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.083+0000 7f066991eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56011a16ca40 0x56011a1705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:00.108 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.083+0000 7f066991eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56011a16d360 0x56011a170bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:00.108 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.083+0000 7f066991eb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56011a0b8740 con 0x56011a167550 2023-08-10T12:00:00.108 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.083+0000 7f066991eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56011a057a60 con 0x56011a16d360 2023-08-10T12:00:00.109 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.083+0000 7f066991eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56011a057760 con 0x56011a16ca40 2023-08-10T12:00:00.109 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.083+0000 7f066991eb80 10 client.0 _ll_register_callbacks cb 0x56011a055620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:00:00.109 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.083+0000 7f0656ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a167550 0x56011a173340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:00.109 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.083+0000 7f0656ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a167550 0x56011a173340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35746/0 (socket says 172.21.15.73:35746) 2023-08-10T12:00:00.109 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.083+0000 7f0656ffd700 1 -- 172.21.15.73:0/2342616172 learned_addr learned my addr 172.21.15.73:0/2342616172 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:00.109 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.083+0000 7f06567fc700 1 --2- 172.21.15.73:0/2342616172 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56011a16ca40 0x56011a1705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:00.110 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.084+0000 7f06577fe700 1 --2- 172.21.15.73:0/2342616172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56011a16d360 0x56011a170bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:00.110 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.084+0000 7f0656ffd700 1 -- 172.21.15.73:0/2342616172 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56011a16ca40 msgr2=0x56011a1705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:00.110 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.084+0000 7f0656ffd700 1 --2- 172.21.15.73:0/2342616172 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56011a16ca40 0x56011a1705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:00.110 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.084+0000 7f0656ffd700 1 -- 172.21.15.73:0/2342616172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56011a16d360 msgr2=0x56011a170bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:00.110 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.084+0000 7f0656ffd700 1 --2- 172.21.15.73:0/2342616172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56011a16d360 0x56011a170bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:00.111 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.084+0000 7f0656ffd700 1 -- 172.21.15.73:0/2342616172 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064c00e6c0 con 0x56011a167550 2023-08-10T12:00:00.111 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.084+0000 7f06567fc700 1 --2- 172.21.15.73:0/2342616172 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56011a16ca40 0x56011a1705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:00:00.111 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.084+0000 7f0656ffd700 1 --2- 172.21.15.73:0/2342616172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a167550 0x56011a173340 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f06480cb760 tx=0x7f064809b250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d52f2bb0c308cd8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:00.111 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.084+0000 7f063aff5700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:00:00.111 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.084+0000 7f063aff5700 1 -- 172.21.15.73:0/2342616172 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06480b2070 con 0x56011a167550 2023-08-10T12:00:00.111 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.084+0000 7f063aff5700 1 -- 172.21.15.73:0/2342616172 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f064809a600 con 0x56011a167550 2023-08-10T12:00:00.111 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.084+0000 7f066991eb80 1 -- 172.21.15.73:0/2342616172 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56011a15a1c0 con 0x56011a167550 2023-08-10T12:00:00.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.084+0000 7f063aff5700 1 -- 172.21.15.73:0/2342616172 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f064809a7c0 con 0x56011a167550 2023-08-10T12:00:00.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.084+0000 7f066991eb80 10 client.16623 fetch_fsmap learned FSMap version 45 2023-08-10T12:00:00.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.084+0000 7f066991eb80 1 -- 172.21.15.73:0/2342616172 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x560119ee5d80 con 0x56011a167550 2023-08-10T12:00:00.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.084+0000 7f063aff5700 1 -- 172.21.15.73:0/2342616172 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f06480c9080 con 0x56011a167550 2023-08-10T12:00:00.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.085+0000 7f063aff5700 1 -- 172.21.15.73:0/2342616172 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 45) v1 ==== 6981+0+0 (secure 0 0 0) 0x7f0648097020 con 0x56011a167550 2023-08-10T12:00:00.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.085+0000 7f066991eb80 10 client.16623 fetch_fsmap finished waiting for FSMap version 45 2023-08-10T12:00:00.112 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.085+0000 7f066991eb80 10 client.16623 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:00:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.085+0000 7f066991eb80 20 client.16623 populate_metadata read hostname 'smithi073' 2023-08-10T12:00:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.085+0000 7f066991eb80 1 --2- 172.21.15.73:0/2342616172 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56011a1809c0 0x56011a182de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.085+0000 7f066991eb80 4 client.16623 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:00:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.085+0000 7f066991eb80 1 -- 172.21.15.73:0/2342616172 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56011a136970 con 0x56011a1809c0 2023-08-10T12:00:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.085+0000 7f06567fc700 1 --2- 172.21.15.73:0/2342616172 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56011a1809c0 0x56011a182de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.085+0000 7f063aff5700 10 client.16623 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.085+0000 7f06567fc700 1 --2- 172.21.15.73:0/2342616172 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56011a1809c0 0x56011a182de0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e702e789c3560957 server_cookie=3ec248d28f6dc9ab in_seq=0 out_seq=0 2023-08-10T12:00:00.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.088+0000 7f063aff5700 1 -- 172.21.15.73:0/2342616172 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x56011a136970 con 0x56011a1809c0 2023-08-10T12:00:00.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.088+0000 7f063aff5700 10 client.16623 handle_command_reply: tid=0 2023-08-10T12:00:00.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.088+0000 7f066991eb80 1 client.16623 shutdown 2023-08-10T12:00:00.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.088+0000 7f066991eb80 1 -- 172.21.15.73:0/2342616172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a167550 msgr2=0x56011a173340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:00.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.088+0000 7f066991eb80 1 --2- 172.21.15.73:0/2342616172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a167550 0x56011a173340 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f06480cb760 tx=0x7f064809b250 comp rx=0 tx=0).stop 2023-08-10T12:00:00.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.088+0000 7f066991eb80 1 -- 172.21.15.73:0/2342616172 shutdown_connections 2023-08-10T12:00:00.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.088+0000 7f066991eb80 1 --2- 172.21.15.73:0/2342616172 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56011a1809c0 0x56011a182de0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:00.114 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.088+0000 7f066991eb80 1 --2- 172.21.15.73:0/2342616172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56011a16d360 0x56011a170bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:00.115 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.088+0000 7f066991eb80 1 --2- 172.21.15.73:0/2342616172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a167550 0x56011a173340 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:00.115 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.088+0000 7f066991eb80 1 --2- 172.21.15.73:0/2342616172 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56011a16ca40 0x56011a1705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:00.115 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.088+0000 7f063aff5700 0 client.16623 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:00.115 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.088+0000 7f066991eb80 1 -- 172.21.15.73:0/2342616172 >> 172.21.15.73:0/2342616172 conn(0x56011a0c4c70 msgr2=0x56011a1614b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:00.115 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.088+0000 7f066991eb80 1 -- 172.21.15.73:0/2342616172 shutdown_connections 2023-08-10T12:00:00.115 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.088+0000 7f066991eb80 1 -- 172.21.15.73:0/2342616172 wait complete. 2023-08-10T12:00:00.115 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.088+0000 7f066991eb80 20 client.16623 trim_cache size 0 max 16384 2023-08-10T12:00:00.119 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.102+0000 7f066991eb80 1 Processor -- start 2023-08-10T12:00:00.119 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.102+0000 7f066991eb80 1 -- start start 2023-08-10T12:00:00.120 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.103+0000 7f066991eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56011a167550 0x56011a187740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:00.120 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.103+0000 7f066991eb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a16ca40 0x56011a16fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:00.120 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.103+0000 7f066991eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56011a16d360 0x56011a161c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:00.120 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.103+0000 7f066991eb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x560119f3b8c0 con 0x56011a16ca40 2023-08-10T12:00:00.120 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.103+0000 7f066991eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56011a15ecd0 con 0x56011a167550 2023-08-10T12:00:00.120 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.103+0000 7f066991eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56011a171ba0 con 0x56011a16d360 2023-08-10T12:00:00.120 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.103+0000 7f06567fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a16ca40 0x56011a16fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:00.121 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.103+0000 7f06567fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a16ca40 0x56011a16fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35756/0 (socket says 172.21.15.73:35756) 2023-08-10T12:00:00.121 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.103+0000 7f06567fc700 1 -- 172.21.15.73:0/165157872 learned_addr learned my addr 172.21.15.73:0/165157872 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:00.121 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.103+0000 7f06577fe700 1 --2- 172.21.15.73:0/165157872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56011a16d360 0x56011a161c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:00.121 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.103+0000 7f06567fc700 1 -- 172.21.15.73:0/165157872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56011a16d360 msgr2=0x56011a161c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:00.121 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.103+0000 7f0656ffd700 1 --2- 172.21.15.73:0/165157872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56011a167550 0x56011a187740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:00.121 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.103+0000 7f06567fc700 1 --2- 172.21.15.73:0/165157872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56011a16d360 0x56011a161c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:00.121 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.103+0000 7f06567fc700 1 -- 172.21.15.73:0/165157872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56011a167550 msgr2=0x56011a187740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:00.121 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.103+0000 7f06567fc700 1 --2- 172.21.15.73:0/165157872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56011a167550 0x56011a187740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.103+0000 7f06567fc700 1 -- 172.21.15.73:0/165157872 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560119ecec00 con 0x56011a16ca40 2023-08-10T12:00:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.103+0000 7f0656ffd700 1 --2- 172.21.15.73:0/165157872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56011a167550 0x56011a187740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T12:00:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.103+0000 7f06567fc700 1 --2- 172.21.15.73:0/165157872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a16ca40 0x56011a16fdc0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f064c013560 tx=0x7f064c013450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f763af55058cfd77 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.103+0000 7f063dffb700 1 -- 172.21.15.73:0/165157872 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c02e040 con 0x56011a16ca40 2023-08-10T12:00:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.103+0000 7f063dffb700 1 -- 172.21.15.73:0/165157872 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f064c00ee90 con 0x56011a16ca40 2023-08-10T12:00:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.103+0000 7f063dffb700 1 -- 172.21.15.73:0/165157872 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c013600 con 0x56011a16ca40 2023-08-10T12:00:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.104+0000 7f066991eb80 1 -- 172.21.15.73:0/165157872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a16ca40 msgr2=0x56011a16fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.104+0000 7f066991eb80 1 --2- 172.21.15.73:0/165157872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a16ca40 0x56011a16fdc0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f064c013560 tx=0x7f064c013450 comp rx=0 tx=0).stop 2023-08-10T12:00:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.104+0000 7f066991eb80 1 -- 172.21.15.73:0/165157872 shutdown_connections 2023-08-10T12:00:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.104+0000 7f066991eb80 1 --2- 172.21.15.73:0/165157872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56011a167550 0x56011a187740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.104+0000 7f066991eb80 1 --2- 172.21.15.73:0/165157872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56011a16d360 0x56011a161c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.104+0000 7f066991eb80 1 --2- 172.21.15.73:0/165157872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a16ca40 0x56011a16fdc0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.104+0000 7f066991eb80 1 -- 172.21.15.73:0/165157872 >> 172.21.15.73:0/165157872 conn(0x56011a0c4c70 msgr2=0x56011a16d740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.104+0000 7f066991eb80 1 -- 172.21.15.73:0/165157872 shutdown_connections 2023-08-10T12:00:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.104+0000 7f066991eb80 1 -- 172.21.15.73:0/165157872 wait complete. 2023-08-10T12:00:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.104+0000 7f066991eb80 1 -- start start 2023-08-10T12:00:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.104+0000 7f066991eb80 1 Processor -- start 2023-08-10T12:00:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.104+0000 7f066991eb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a167550 0x56011a177bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.104+0000 7f066991eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56011a16ca40 0x56011a175ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.104+0000 7f066991eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56011a16d360 0x56011a176410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.104+0000 7f066991eb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56011a176950 con 0x56011a167550 2023-08-10T12:00:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.104+0000 7f066991eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56011a176ac0 con 0x56011a16d360 2023-08-10T12:00:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.104+0000 7f066991eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56011a176c80 con 0x56011a16ca40 2023-08-10T12:00:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.105+0000 7f066991eb80 10 client.0 _ll_register_callbacks cb 0x56011a055620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:00:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.105+0000 7f0656ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a167550 0x56011a177bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.105+0000 7f0656ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a167550 0x56011a177bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35760/0 (socket says 172.21.15.73:35760) 2023-08-10T12:00:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.105+0000 7f0656ffd700 1 -- 172.21.15.73:0/593432568 learned_addr learned my addr 172.21.15.73:0/593432568 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.105+0000 7f06567fc700 1 --2- 172.21.15.73:0/593432568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56011a16ca40 0x56011a175ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.105+0000 7f0656ffd700 1 -- 172.21.15.73:0/593432568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56011a16ca40 msgr2=0x56011a175ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.105+0000 7f0656ffd700 1 --2- 172.21.15.73:0/593432568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56011a16ca40 0x56011a175ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.105+0000 7f06577fe700 1 --2- 172.21.15.73:0/593432568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56011a16d360 0x56011a176410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.105+0000 7f0656ffd700 1 -- 172.21.15.73:0/593432568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56011a16d360 msgr2=0x56011a176410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.105+0000 7f0656ffd700 1 --2- 172.21.15.73:0/593432568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56011a16d360 0x56011a176410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.105+0000 7f0656ffd700 1 -- 172.21.15.73:0/593432568 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560119f395d0 con 0x56011a167550 2023-08-10T12:00:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.105+0000 7f06577fe700 1 --2- 172.21.15.73:0/593432568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56011a16d360 0x56011a176410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T12:00:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.105+0000 7f0656ffd700 1 --2- 172.21.15.73:0/593432568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a167550 0x56011a177bb0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f06480a2fa0 tx=0x7f06480996c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d64d51f984ae59 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.105+0000 7f063aff5700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:00:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.105+0000 7f063aff5700 1 -- 172.21.15.73:0/593432568 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06480b2070 con 0x56011a167550 2023-08-10T12:00:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.105+0000 7f063aff5700 1 -- 172.21.15.73:0/593432568 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f06480a3040 con 0x56011a167550 2023-08-10T12:00:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.105+0000 7f066991eb80 1 -- 172.21.15.73:0/593432568 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f064c015940 con 0x56011a167550 2023-08-10T12:00:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.105+0000 7f063aff5700 1 -- 172.21.15.73:0/593432568 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f064809a0c0 con 0x56011a167550 2023-08-10T12:00:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.105+0000 7f066991eb80 10 client.16629 fetch_fsmap learned FSMap version 45 2023-08-10T12:00:00.129 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.105+0000 7f066991eb80 1 -- 172.21.15.73:0/593432568 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x560119f0c1f0 con 0x56011a167550 2023-08-10T12:00:00.129 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.105+0000 7f063aff5700 1 -- 172.21.15.73:0/593432568 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f064c015940 con 0x56011a167550 2023-08-10T12:00:00.129 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.106+0000 7f063aff5700 1 -- 172.21.15.73:0/593432568 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 45) v1 ==== 6981+0+0 (secure 0 0 0) 0x7f0648097820 con 0x56011a167550 2023-08-10T12:00:00.129 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.106+0000 7f066991eb80 10 client.16629 fetch_fsmap finished waiting for FSMap version 45 2023-08-10T12:00:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.106+0000 7f066991eb80 10 client.16629 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:00:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.106+0000 7f066991eb80 20 client.16629 populate_metadata read hostname 'smithi073' 2023-08-10T12:00:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.106+0000 7f066991eb80 1 --2- 172.21.15.73:0/593432568 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56011a1d5540 0x56011a1d7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.106+0000 7f066991eb80 4 client.16629 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T12:00:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.106+0000 7f066991eb80 1 -- 172.21.15.73:0/593432568 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56011a0b1720 con 0x56011a1d5540 2023-08-10T12:00:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.106+0000 7f06567fc700 1 --2- 172.21.15.73:0/593432568 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56011a1d5540 0x56011a1d7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:00.132 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.106+0000 7f063aff5700 10 client.16629 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:00.132 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:00.106+0000 7f06567fc700 1 --2- 172.21.15.73:0/593432568 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56011a1d5540 0x56011a1d7930 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=217e1d93b797acca server_cookie=3a95f0d529959d9c in_seq=0 out_seq=0 2023-08-10T12:00:00.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:00 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mon-a[128845]: 2023-08-10T11:59:59.998+0000 7f3dd78d8700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-08-10T12:00:00.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:00 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mon-a[128845]: 2023-08-10T11:59:59.998+0000 7f3dd78d8700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-08-10T12:00:00.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:00 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mon-a[128845]: 2023-08-10T11:59:59.998+0000 7f3dd78d8700 -1 log_channel(cluster) log [ERR] : mds.h(mds.1): Metadata damage detected 2023-08-10T12:00:00.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:00 smithi073 ceph-mon[128869]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-08-10T12:00:00.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:00 smithi073 ceph-mon[128869]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-08-10T12:00:00.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:00 smithi073 ceph-mon[128869]: mds.h(mds.1): Metadata damage detected 2023-08-10T12:00:00.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:00 smithi152 ceph-mon[130220]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-08-10T12:00:00.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:00 smithi152 ceph-mon[130220]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-08-10T12:00:00.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:00 smithi152 ceph-mon[130220]: mds.h(mds.1): Metadata damage detected 2023-08-10T12:00:00.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:00 smithi156 ceph-mon[130574]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-08-10T12:00:00.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:00 smithi156 ceph-mon[130574]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-08-10T12:00:00.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:00 smithi156 ceph-mon[130574]: mds.h(mds.1): Metadata damage detected 2023-08-10T12:00:01.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:01 smithi152 ceph-mon[130220]: pgmap v226: 97 pgs: 97 active+clean; 1.8 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.9 MiB/s wr, 35 op/s 2023-08-10T12:00:01.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:01 smithi156 ceph-mon[130574]: pgmap v226: 97 pgs: 97 active+clean; 1.8 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.9 MiB/s wr, 35 op/s 2023-08-10T12:00:01.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:01 smithi073 ceph-mon[128869]: pgmap v226: 97 pgs: 97 active+clean; 1.8 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.9 MiB/s wr, 35 op/s 2023-08-10T12:00:03.438 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:03.436+0000 7f063aff5700 1 -- 172.21.15.73:0/593432568 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56011a0b1720 con 0x56011a1d5540 2023-08-10T12:00:03.439 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:03.436+0000 7f063aff5700 10 client.16629 handle_command_reply: tid=0 2023-08-10T12:00:03.439 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:03.436+0000 7f066991eb80 1 client.16629 shutdown 2023-08-10T12:00:03.439 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:03.436+0000 7f066991eb80 1 -- 172.21.15.73:0/593432568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a167550 msgr2=0x56011a177bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:03.439 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:03.436+0000 7f066991eb80 1 --2- 172.21.15.73:0/593432568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a167550 0x56011a177bb0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f06480a2fa0 tx=0x7f06480996c0 comp rx=0 tx=0).stop 2023-08-10T12:00:03.439 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:03.436+0000 7f066991eb80 1 -- 172.21.15.73:0/593432568 shutdown_connections 2023-08-10T12:00:03.439 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:03.437+0000 7f066991eb80 1 --2- 172.21.15.73:0/593432568 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56011a1d5540 0x56011a1d7930 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:03.439 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:03.437+0000 7f066991eb80 1 --2- 172.21.15.73:0/593432568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56011a16d360 0x56011a176410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:03.440 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:03.437+0000 7f066991eb80 1 --2- 172.21.15.73:0/593432568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56011a167550 0x56011a177bb0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:03.440 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:03.437+0000 7f063aff5700 0 client.16629 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:03.440 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:03.437+0000 7f066991eb80 1 --2- 172.21.15.73:0/593432568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56011a16ca40 0x56011a175ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:03.440 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:03.437+0000 7f066991eb80 1 -- 172.21.15.73:0/593432568 >> 172.21.15.73:0/593432568 conn(0x56011a0c4c70 msgr2=0x56011a16c050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:03.440 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:03.437+0000 7f066991eb80 1 -- 172.21.15.73:0/593432568 shutdown_connections 2023-08-10T12:00:03.440 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:03.437+0000 7f066991eb80 1 -- 172.21.15.73:0/593432568 wait complete. 2023-08-10T12:00:03.440 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:03.437+0000 7f066991eb80 20 client.16629 trim_cache size 0 max 16384 2023-08-10T12:00:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T12:00:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T12:00:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T12:00:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T12:00:03.442 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:03.437+0000 7f065d785700 1 -- 172.21.15.73:0/358794448 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f06400a12c0 msgr2=0x7f06400a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:03.442 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:03.437+0000 7f065d785700 1 --2- 172.21.15.73:0/358794448 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f06400a12c0 0x7f06400a3780 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0658197690 tx=0x7f064c009190 comp rx=0 tx=0).stop 2023-08-10T12:00:03.442 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:03.437+0000 7f065d785700 1 -- 172.21.15.73:0/358794448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06580ff800 msgr2=0x7f0658195710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:03.442 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:03.437+0000 7f065d785700 1 --2- 172.21.15.73:0/358794448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06580ff800 0x7f0658195710 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f0648006010 tx=0x7f064800f700 comp rx=0 tx=0).stop 2023-08-10T12:00:03.443 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:03.437+0000 7f065d785700 1 -- 172.21.15.73:0/358794448 shutdown_connections 2023-08-10T12:00:03.443 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:03.437+0000 7f065d785700 1 --2- 172.21.15.73:0/358794448 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f06400a12c0 0x7f06400a3780 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:03.443 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:03.437+0000 7f065d785700 1 --2- 172.21.15.73:0/358794448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0658105640 0x7f06581a4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:03.443 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:03.437+0000 7f065d785700 1 --2- 172.21.15.73:0/358794448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06580ff800 0x7f0658195710 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:03.443 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:03.437+0000 7f065d785700 1 --2- 172.21.15.73:0/358794448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06581001c0 0x7f0658195c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:03.443 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:03.437+0000 7f065d785700 1 -- 172.21.15.73:0/358794448 >> 172.21.15.73:0/358794448 conn(0x7f06580774a0 msgr2=0x7f06580fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:03.443 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:03.438+0000 7f065d785700 1 -- 172.21.15.73:0/358794448 shutdown_connections 2023-08-10T12:00:03.443 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:03.438+0000 7f065d785700 1 -- 172.21.15.73:0/358794448 wait complete. 2023-08-10T12:00:03.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:03 smithi152 ceph-mon[130220]: pgmap v227: 97 pgs: 97 active+clean; 1.8 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.7 MiB/s wr, 24 op/s 2023-08-10T12:00:03.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:03 smithi156 ceph-mon[130574]: pgmap v227: 97 pgs: 97 active+clean; 1.8 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.7 MiB/s wr, 24 op/s 2023-08-10T12:00:03.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:03 smithi073 ceph-mon[128869]: pgmap v227: 97 pgs: 97 active+clean; 1.8 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.7 MiB/s wr, 24 op/s 2023-08-10T12:00:05.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:04 smithi152 ceph-mon[130220]: pgmap v228: 97 pgs: 97 active+clean; 1.8 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 7.2 MiB/s wr, 71 op/s 2023-08-10T12:00:05.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:04 smithi156 ceph-mon[130574]: pgmap v228: 97 pgs: 97 active+clean; 1.8 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 7.2 MiB/s wr, 71 op/s 2023-08-10T12:00:05.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:04 smithi073 ceph-mon[128869]: pgmap v228: 97 pgs: 97 active+clean; 1.8 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 7.2 MiB/s wr, 71 op/s 2023-08-10T12:00:07.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:07 smithi152 ceph-mon[130220]: pgmap v229: 97 pgs: 97 active+clean; 1.9 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 11 MiB/s wr, 157 op/s 2023-08-10T12:00:07.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:07 smithi156 ceph-mon[130574]: pgmap v229: 97 pgs: 97 active+clean; 1.9 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 11 MiB/s wr, 157 op/s 2023-08-10T12:00:07.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:07 smithi073 ceph-mon[128869]: pgmap v229: 97 pgs: 97 active+clean; 1.9 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 11 MiB/s wr, 157 op/s 2023-08-10T12:00:09.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:09 smithi152 ceph-mon[130220]: pgmap v230: 97 pgs: 97 active+clean; 1.9 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 11 MiB/s wr, 169 op/s 2023-08-10T12:00:09.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:09 smithi156 ceph-mon[130574]: pgmap v230: 97 pgs: 97 active+clean; 1.9 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 11 MiB/s wr, 169 op/s 2023-08-10T12:00:09.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:09 smithi073 ceph-mon[128869]: pgmap v230: 97 pgs: 97 active+clean; 1.9 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 11 MiB/s wr, 169 op/s 2023-08-10T12:00:11.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:11 smithi152 ceph-mon[130220]: pgmap v231: 97 pgs: 97 active+clean; 1.9 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 13 MiB/s wr, 230 op/s 2023-08-10T12:00:11.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:11 smithi152 ceph-mon[130220]: osdmap e89: 12 total, 12 up, 12 in 2023-08-10T12:00:11.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:11 smithi156 ceph-mon[130574]: pgmap v231: 97 pgs: 97 active+clean; 1.9 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 13 MiB/s wr, 230 op/s 2023-08-10T12:00:11.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:11 smithi156 ceph-mon[130574]: osdmap e89: 12 total, 12 up, 12 in 2023-08-10T12:00:11.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:11 smithi073 ceph-mon[128869]: pgmap v231: 97 pgs: 97 active+clean; 1.9 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 13 MiB/s wr, 230 op/s 2023-08-10T12:00:11.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:11 smithi073 ceph-mon[128869]: osdmap e89: 12 total, 12 up, 12 in 2023-08-10T12:00:13.499 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:13 smithi152 ceph-mon[130220]: pgmap v233: 97 pgs: 5 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 88 active+clean; 1.9 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 8.8 MiB/s wr, 266 op/s 2023-08-10T12:00:13.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:13 smithi156 ceph-mon[130574]: pgmap v233: 97 pgs: 5 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 88 active+clean; 1.9 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 8.8 MiB/s wr, 266 op/s 2023-08-10T12:00:13.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:13 smithi073 ceph-mon[128869]: pgmap v233: 97 pgs: 5 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 88 active+clean; 1.9 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 8.8 MiB/s wr, 266 op/s 2023-08-10T12:00:15.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:14 smithi152 ceph-mon[130220]: pgmap v234: 97 pgs: 16 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 72 active+clean; 1.9 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 7.1 MiB/s wr, 213 op/s 2023-08-10T12:00:15.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:14 smithi156 ceph-mon[130574]: pgmap v234: 97 pgs: 16 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 72 active+clean; 1.9 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 7.1 MiB/s wr, 213 op/s 2023-08-10T12:00:15.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:14 smithi073 ceph-mon[128869]: pgmap v234: 97 pgs: 16 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 72 active+clean; 1.9 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 7.1 MiB/s wr, 213 op/s 2023-08-10T12:00:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.556+0000 7fe3f84ec700 1 -- 172.21.15.73:0/680568815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3f01045e0 msgr2=0x7fe3f01049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.556+0000 7fe3f84ec700 1 --2- 172.21.15.73:0/680568815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3f01045e0 0x7fe3f01049c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009990 tx=0x7fe3ec009ca0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.556+0000 7fe3f84ec700 1 -- 172.21.15.73:0/680568815 shutdown_connections 2023-08-10T12:00:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.556+0000 7fe3f84ec700 1 --2- 172.21.15.73:0/680568815 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3f0100760 0x7fe3f010c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.556+0000 7fe3f84ec700 1 --2- 172.21.15.73:0/680568815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3f01045e0 0x7fe3f01049c0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.556+0000 7fe3f84ec700 1 --2- 172.21.15.73:0/680568815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3f00ffda0 0x7fe3f0100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.556+0000 7fe3f84ec700 1 -- 172.21.15.73:0/680568815 >> 172.21.15.73:0/680568815 conn(0x7fe3f0076b40 msgr2=0x7fe3f00fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.556+0000 7fe3f84ec700 1 -- 172.21.15.73:0/680568815 shutdown_connections 2023-08-10T12:00:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.556+0000 7fe3f84ec700 1 -- 172.21.15.73:0/680568815 wait complete. 2023-08-10T12:00:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.557+0000 7fe3f84ec700 1 Processor -- start 2023-08-10T12:00:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.557+0000 7fe3f84ec700 1 -- start start 2023-08-10T12:00:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.557+0000 7fe3f84ec700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3f00ffda0 0x7fe3f019b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.557+0000 7fe3f84ec700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3f0100760 0x7fe3f019bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.557+0000 7fe3f84ec700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3f01045e0 0x7fe3f0195520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:16.561 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.557+0000 7fe3f84ec700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f0195b90 con 0x7fe3f0100760 2023-08-10T12:00:16.561 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.557+0000 7fe3f84ec700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f0195d00 con 0x7fe3f01045e0 2023-08-10T12:00:16.561 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.557+0000 7fe3f84ec700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f0195ec0 con 0x7fe3f00ffda0 2023-08-10T12:00:16.561 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.557+0000 7fe3f5a87700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3f0100760 0x7fe3f019bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:16.561 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.557+0000 7fe3f5a87700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3f0100760 0x7fe3f019bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35776/0 (socket says 172.21.15.73:35776) 2023-08-10T12:00:16.562 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.557+0000 7fe3f6288700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3f00ffda0 0x7fe3f019b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:16.562 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.557+0000 7fe3f5a87700 1 -- 172.21.15.73:0/4200349931 learned_addr learned my addr 172.21.15.73:0/4200349931 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:16.562 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.557+0000 7fe3f6a89700 1 --2- 172.21.15.73:0/4200349931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3f01045e0 0x7fe3f0195520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:16.562 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.558+0000 7fe3f5a87700 1 -- 172.21.15.73:0/4200349931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3f00ffda0 msgr2=0x7fe3f019b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:16.562 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.558+0000 7fe3f5a87700 1 --2- 172.21.15.73:0/4200349931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3f00ffda0 0x7fe3f019b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.562 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.558+0000 7fe3f5a87700 1 -- 172.21.15.73:0/4200349931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3f01045e0 msgr2=0x7fe3f0195520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:16.563 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.558+0000 7fe3f5a87700 1 --2- 172.21.15.73:0/4200349931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3f01045e0 0x7fe3f0195520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.563 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.558+0000 7fe3f5a87700 1 -- 172.21.15.73:0/4200349931 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ec0095f0 con 0x7fe3f0100760 2023-08-10T12:00:16.563 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.558+0000 7fe3f5a87700 1 --2- 172.21.15.73:0/4200349931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3f0100760 0x7fe3f019bc00 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000e9a0 tx=0x7fe3e000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:16.563 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.558+0000 7fe3e77fe700 1 -- 172.21.15.73:0/4200349931 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0009790 con 0x7fe3f0100760 2023-08-10T12:00:16.563 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.558+0000 7fe3e77fe700 1 -- 172.21.15.73:0/4200349931 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe3e0010430 con 0x7fe3f0100760 2023-08-10T12:00:16.563 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.558+0000 7fe3f84ec700 1 -- 172.21.15.73:0/4200349931 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f01961a0 con 0x7fe3f0100760 2023-08-10T12:00:16.563 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.558+0000 7fe3e77fe700 1 -- 172.21.15.73:0/4200349931 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0018680 con 0x7fe3f0100760 2023-08-10T12:00:16.564 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.558+0000 7fe3f84ec700 1 -- 172.21.15.73:0/4200349931 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f01a26b0 con 0x7fe3f0100760 2023-08-10T12:00:16.569 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.560+0000 7fe3e77fe700 1 -- 172.21.15.73:0/4200349931 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fe3e00105a0 con 0x7fe3f0100760 2023-08-10T12:00:16.570 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.561+0000 7fe3e77fe700 1 --2- 172.21.15.73:0/4200349931 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe3dc0a12c0 0x7fe3dc0a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:16.570 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.561+0000 7fe3f6288700 1 --2- 172.21.15.73:0/4200349931 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe3dc0a12c0 0x7fe3dc0a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:16.570 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.561+0000 7fe3e77fe700 1 -- 172.21.15.73:0/4200349931 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fe3e0014070 con 0x7fe3f0100760 2023-08-10T12:00:16.570 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.562+0000 7fe3f6288700 1 --2- 172.21.15.73:0/4200349931 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe3dc0a12c0 0x7fe3dc0a3780 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec00b2e0 tx=0x7fe3ec005fb0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.562+0000 7fe404685b80 1 Processor -- start 2023-08-10T12:00:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.562+0000 7fe404685b80 1 -- start start 2023-08-10T12:00:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.562+0000 7fe404685b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56546a4dba40 0x56546a4dbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.562+0000 7fe404685b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56546a4dc360 0x56546a4d6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.562+0000 7fe404685b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56546a4d6550 0x56546a4d69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.562+0000 7fe404685b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56546a451d60 con 0x56546a4d6550 2023-08-10T12:00:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.562+0000 7fe404685b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56546a42e530 con 0x56546a4dba40 2023-08-10T12:00:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.562+0000 7fe404685b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56546a42be50 con 0x56546a4dc360 2023-08-10T12:00:16.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.563+0000 7fe3f6a89700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56546a4d6550 0x56546a4d69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:16.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.563+0000 7fe3f6288700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56546a4dba40 0x56546a4dbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:16.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.563+0000 7fe3f6a89700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56546a4d6550 0x56546a4d69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35786/0 (socket says 172.21.15.73:35786) 2023-08-10T12:00:16.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.563+0000 7fe3f6288700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56546a4dba40 0x56546a4dbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:50432/0 (socket says 172.21.15.73:50432) 2023-08-10T12:00:16.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.563+0000 7fe3f6a89700 1 -- 172.21.15.73:0/1036933670 learned_addr learned my addr 172.21.15.73:0/1036933670 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:16.572 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.563+0000 7fe3f5a87700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56546a4dc360 0x56546a4d6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.563+0000 7fe3f6a89700 1 -- 172.21.15.73:0/1036933670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56546a4dc360 msgr2=0x56546a4d6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.563+0000 7fe3f6a89700 1 --2- 172.21.15.73:0/1036933670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56546a4dc360 0x56546a4d6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.563+0000 7fe3f6a89700 1 -- 172.21.15.73:0/1036933670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56546a4dba40 msgr2=0x56546a4dbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.563+0000 7fe3f6a89700 1 --2- 172.21.15.73:0/1036933670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56546a4dba40 0x56546a4dbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.563+0000 7fe3f6a89700 1 -- 172.21.15.73:0/1036933670 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56546a2a85d0 con 0x56546a4d6550 2023-08-10T12:00:16.574 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.563+0000 7fe3f6a89700 1 --2- 172.21.15.73:0/1036933670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56546a4d6550 0x56546a4d69d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8011600 tx=0x7fe3e8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8bd26fb91a2b179 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:16.574 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.563+0000 7fe3e4ff9700 1 -- 172.21.15.73:0/1036933670 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e800e040 con 0x56546a4d6550 2023-08-10T12:00:16.574 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.563+0000 7fe3e4ff9700 1 -- 172.21.15.73:0/1036933670 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe3e800f040 con 0x56546a4d6550 2023-08-10T12:00:16.574 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.563+0000 7fe3e4ff9700 1 -- 172.21.15.73:0/1036933670 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8004610 con 0x56546a4d6550 2023-08-10T12:00:16.574 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.564+0000 7fe404685b80 1 -- 172.21.15.73:0/1036933670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56546a4d6550 msgr2=0x56546a4d69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:16.574 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.564+0000 7fe404685b80 1 --2- 172.21.15.73:0/1036933670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56546a4d6550 0x56546a4d69d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8011600 tx=0x7fe3e8009920 comp rx=0 tx=0).stop 2023-08-10T12:00:16.574 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.564+0000 7fe404685b80 1 -- 172.21.15.73:0/1036933670 shutdown_connections 2023-08-10T12:00:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.564+0000 7fe404685b80 1 --2- 172.21.15.73:0/1036933670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56546a4dba40 0x56546a4dbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.564+0000 7fe404685b80 1 --2- 172.21.15.73:0/1036933670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56546a4d6550 0x56546a4d69d0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.564+0000 7fe404685b80 1 --2- 172.21.15.73:0/1036933670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56546a4dc360 0x56546a4d6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.564+0000 7fe404685b80 1 -- 172.21.15.73:0/1036933670 >> 172.21.15.73:0/1036933670 conn(0x56546a433c70 msgr2=0x56546a4d0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.564+0000 7fe404685b80 1 -- 172.21.15.73:0/1036933670 shutdown_connections 2023-08-10T12:00:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.564+0000 7fe404685b80 1 -- 172.21.15.73:0/1036933670 wait complete. 2023-08-10T12:00:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.564+0000 7fe404685b80 1 -- start start 2023-08-10T12:00:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.565+0000 7fe404685b80 1 Processor -- start 2023-08-10T12:00:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.565+0000 7fe404685b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56546a4d6550 0x56546a4e2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.565+0000 7fe404685b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56546a4dba40 0x56546a4df610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.565+0000 7fe404685b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56546a4dc360 0x56546a4dfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.565+0000 7fe404685b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56546a427740 con 0x56546a4dba40 2023-08-10T12:00:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.565+0000 7fe404685b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56546a3c6a60 con 0x56546a4d6550 2023-08-10T12:00:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.565+0000 7fe404685b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56546a3c6760 con 0x56546a4dc360 2023-08-10T12:00:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.565+0000 7fe404685b80 10 client.0 _ll_register_callbacks cb 0x56546a3c4620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:00:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.565+0000 7fe3f5a87700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56546a4dba40 0x56546a4df610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.565+0000 7fe3f5a87700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56546a4dba40 0x56546a4df610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35790/0 (socket says 172.21.15.73:35790) 2023-08-10T12:00:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.565+0000 7fe3f5a87700 1 -- 172.21.15.73:0/4048269373 learned_addr learned my addr 172.21.15.73:0/4048269373 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.565+0000 7fe3f6288700 1 --2- 172.21.15.73:0/4048269373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56546a4d6550 0x56546a4e2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.565+0000 7fe3f6a89700 1 --2- 172.21.15.73:0/4048269373 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56546a4dc360 0x56546a4dfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.565+0000 7fe3f5a87700 1 -- 172.21.15.73:0/4048269373 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56546a4dc360 msgr2=0x56546a4dfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.565+0000 7fe3f5a87700 1 --2- 172.21.15.73:0/4048269373 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56546a4dc360 0x56546a4dfd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.565+0000 7fe3f5a87700 1 -- 172.21.15.73:0/4048269373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56546a4d6550 msgr2=0x56546a4e2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.565+0000 7fe3f5a87700 1 --2- 172.21.15.73:0/4048269373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56546a4d6550 0x56546a4e2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.565+0000 7fe3f5a87700 1 -- 172.21.15.73:0/4048269373 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e80112b0 con 0x56546a4dba40 2023-08-10T12:00:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.565+0000 7fe3f5a87700 1 --2- 172.21.15.73:0/4048269373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56546a4dba40 0x56546a4df610 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0099cb0 tx=0x7fe3e009a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7400bed669e0acbd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.565+0000 7fe3d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:00:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.566+0000 7fe3d9ffb700 1 -- 172.21.15.73:0/4048269373 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e00996a0 con 0x56546a4dba40 2023-08-10T12:00:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.566+0000 7fe404685b80 1 -- 172.21.15.73:0/4048269373 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56546a4c91c0 con 0x56546a4dba40 2023-08-10T12:00:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.566+0000 7fe3d9ffb700 1 -- 172.21.15.73:0/4048269373 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fe3e00a1f70 con 0x56546a4dba40 2023-08-10T12:00:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.566+0000 7fe3d9ffb700 1 -- 172.21.15.73:0/4048269373 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3e00b8330 con 0x56546a4dba40 2023-08-10T12:00:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.566+0000 7fe404685b80 10 client.16641 fetch_fsmap learned FSMap version 46 2023-08-10T12:00:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.566+0000 7fe404685b80 1 -- 172.21.15.73:0/4048269373 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x56546a254d80 con 0x56546a4dba40 2023-08-10T12:00:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.566+0000 7fe3d9ffb700 1 -- 172.21.15.73:0/4048269373 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56546a4c91c0 con 0x56546a4dba40 2023-08-10T12:00:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.566+0000 7fe3d9ffb700 1 -- 172.21.15.73:0/4048269373 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 46) v1 ==== 6977+0+0 (secure 0 0 0) 0x7fe3e0098f10 con 0x56546a4dba40 2023-08-10T12:00:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.566+0000 7fe404685b80 10 client.16641 fetch_fsmap finished waiting for FSMap version 46 2023-08-10T12:00:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.566+0000 7fe404685b80 10 client.16641 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:00:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.566+0000 7fe404685b80 20 client.16641 populate_metadata read hostname 'smithi073' 2023-08-10T12:00:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.566+0000 7fe404685b80 1 --2- 172.21.15.73:0/4048269373 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56546a4efe30 0x56546a4f2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.566+0000 7fe404685b80 4 client.16641 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:00:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.566+0000 7fe404685b80 1 -- 172.21.15.73:0/4048269373 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56546a4a5970 con 0x56546a4efe30 2023-08-10T12:00:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.566+0000 7fe3f6288700 1 --2- 172.21.15.73:0/4048269373 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56546a4efe30 0x56546a4f2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.567+0000 7fe3d9ffb700 10 client.16641 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.567+0000 7fe3f6288700 1 --2- 172.21.15.73:0/4048269373 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56546a4efe30 0x56546a4f2250 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79d12a5a3f2452dc server_cookie=ac8349e98cc89824 in_seq=0 out_seq=0 2023-08-10T12:00:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.567+0000 7fe3d9ffb700 1 -- 172.21.15.73:0/4048269373 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x56546a4a5970 con 0x56546a4efe30 2023-08-10T12:00:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.567+0000 7fe3d9ffb700 10 client.16641 handle_command_reply: tid=0 2023-08-10T12:00:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.567+0000 7fe404685b80 1 client.16641 shutdown 2023-08-10T12:00:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.568+0000 7fe404685b80 1 -- 172.21.15.73:0/4048269373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56546a4dba40 msgr2=0x56546a4df610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.568+0000 7fe404685b80 1 --2- 172.21.15.73:0/4048269373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56546a4dba40 0x56546a4df610 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0099cb0 tx=0x7fe3e009a100 comp rx=0 tx=0).stop 2023-08-10T12:00:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.568+0000 7fe404685b80 1 -- 172.21.15.73:0/4048269373 shutdown_connections 2023-08-10T12:00:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.568+0000 7fe404685b80 1 --2- 172.21.15.73:0/4048269373 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56546a4efe30 0x56546a4f2250 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.568+0000 7fe404685b80 1 --2- 172.21.15.73:0/4048269373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56546a4d6550 0x56546a4e2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.568+0000 7fe404685b80 1 --2- 172.21.15.73:0/4048269373 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56546a4dc360 0x56546a4dfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.568+0000 7fe3d9ffb700 0 client.16641 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.568+0000 7fe404685b80 1 --2- 172.21.15.73:0/4048269373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56546a4dba40 0x56546a4df610 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.568+0000 7fe404685b80 1 -- 172.21.15.73:0/4048269373 >> 172.21.15.73:0/4048269373 conn(0x56546a433c70 msgr2=0x56546a4d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.568+0000 7fe404685b80 1 -- 172.21.15.73:0/4048269373 shutdown_connections 2023-08-10T12:00:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.568+0000 7fe404685b80 1 -- 172.21.15.73:0/4048269373 wait complete. 2023-08-10T12:00:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.568+0000 7fe404685b80 20 client.16641 trim_cache size 0 max 16384 2023-08-10T12:00:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.582+0000 7fe404685b80 1 Processor -- start 2023-08-10T12:00:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.582+0000 7fe404685b80 1 -- start start 2023-08-10T12:00:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.582+0000 7fe404685b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56546a4d6550 0x56546a4d6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.582+0000 7fe404685b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56546a4dba40 0x56546a4df5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.582+0000 7fe404685b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56546a4dc360 0x56546a4d0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.582+0000 7fe404685b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56546a2aa8c0 con 0x56546a4dba40 2023-08-10T12:00:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.582+0000 7fe404685b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56546a4dc070 con 0x56546a4dc360 2023-08-10T12:00:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.582+0000 7fe404685b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56546a4ec710 con 0x56546a4d6550 2023-08-10T12:00:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.582+0000 7fe3f5a87700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56546a4dba40 0x56546a4df5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.583+0000 7fe3f5a87700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56546a4dba40 0x56546a4df5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35798/0 (socket says 172.21.15.73:35798) 2023-08-10T12:00:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.583+0000 7fe3f5a87700 1 -- 172.21.15.73:0/1778685526 learned_addr learned my addr 172.21.15.73:0/1778685526 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.583+0000 7fe3f6a89700 1 --2- 172.21.15.73:0/1778685526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56546a4dc360 0x56546a4d0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.583+0000 7fe3f6288700 1 --2- 172.21.15.73:0/1778685526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56546a4d6550 0x56546a4d6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.583+0000 7fe3f5a87700 1 -- 172.21.15.73:0/1778685526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56546a4d6550 msgr2=0x56546a4d6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.583+0000 7fe3f5a87700 1 --2- 172.21.15.73:0/1778685526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56546a4d6550 0x56546a4d6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.583+0000 7fe3f5a87700 1 -- 172.21.15.73:0/1778685526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56546a4dc360 msgr2=0x56546a4d0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.583+0000 7fe3f5a87700 1 --2- 172.21.15.73:0/1778685526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56546a4dc360 0x56546a4d0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.583+0000 7fe3f5a87700 1 -- 172.21.15.73:0/1778685526 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56546a23dc00 con 0x56546a4dba40 2023-08-10T12:00:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.583+0000 7fe3f6a89700 1 --2- 172.21.15.73:0/1778685526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56546a4dc360 0x56546a4d0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:00:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.583+0000 7fe3f5a87700 1 --2- 172.21.15.73:0/1778685526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56546a4dba40 0x56546a4df5c0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fe3e00cac30 tx=0x7fe3e00a24c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919643927a05e0ba server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.583+0000 7fe3e57fa700 1 -- 172.21.15.73:0/1778685526 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0098f10 con 0x56546a4dba40 2023-08-10T12:00:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.583+0000 7fe3e57fa700 1 -- 172.21.15.73:0/1778685526 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe3e0099070 con 0x56546a4dba40 2023-08-10T12:00:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.583+0000 7fe3e57fa700 1 -- 172.21.15.73:0/1778685526 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e00ca540 con 0x56546a4dba40 2023-08-10T12:00:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.584+0000 7fe404685b80 1 -- 172.21.15.73:0/1778685526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56546a4dba40 msgr2=0x56546a4df5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.584+0000 7fe404685b80 1 --2- 172.21.15.73:0/1778685526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56546a4dba40 0x56546a4df5c0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fe3e00cac30 tx=0x7fe3e00a24c0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.584+0000 7fe404685b80 1 -- 172.21.15.73:0/1778685526 shutdown_connections 2023-08-10T12:00:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.584+0000 7fe404685b80 1 --2- 172.21.15.73:0/1778685526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56546a4dc360 0x56546a4d0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.584+0000 7fe404685b80 1 --2- 172.21.15.73:0/1778685526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56546a4d6550 0x56546a4d6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.584+0000 7fe404685b80 1 --2- 172.21.15.73:0/1778685526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56546a4dba40 0x56546a4df5c0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.584+0000 7fe404685b80 1 -- 172.21.15.73:0/1778685526 >> 172.21.15.73:0/1778685526 conn(0x56546a433c70 msgr2=0x56546a4deeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.584+0000 7fe404685b80 1 -- 172.21.15.73:0/1778685526 shutdown_connections 2023-08-10T12:00:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.584+0000 7fe404685b80 1 -- 172.21.15.73:0/1778685526 wait complete. 2023-08-10T12:00:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.584+0000 7fe404685b80 1 -- start start 2023-08-10T12:00:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.584+0000 7fe404685b80 1 Processor -- start 2023-08-10T12:00:16.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.584+0000 7fe404685b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56546a4d6550 0x56546a4e6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:16.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.584+0000 7fe404685b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56546a4dba40 0x56546a4e4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:16.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.584+0000 7fe404685b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56546a4dc360 0x56546a4e5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:16.591 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.584+0000 7fe404685b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56546a4e5880 con 0x56546a4dc360 2023-08-10T12:00:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.584+0000 7fe404685b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56546a4e59f0 con 0x56546a4dba40 2023-08-10T12:00:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.584+0000 7fe404685b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56546a4e5bb0 con 0x56546a4d6550 2023-08-10T12:00:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.584+0000 7fe404685b80 10 client.0 _ll_register_callbacks cb 0x56546a3c4620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:00:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.584+0000 7fe3f5a87700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56546a4dba40 0x56546a4e4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.584+0000 7fe3f6a89700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56546a4dc360 0x56546a4e5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.584+0000 7fe3f5a87700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56546a4dba40 0x56546a4e4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:50454/0 (socket says 172.21.15.73:50454) 2023-08-10T12:00:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.584+0000 7fe3f5a87700 1 -- 172.21.15.73:0/3965321298 learned_addr learned my addr 172.21.15.73:0/3965321298 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:16.593 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.584+0000 7fe3f6288700 1 --2- 172.21.15.73:0/3965321298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56546a4d6550 0x56546a4e6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:16.593 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.585+0000 7fe3f5a87700 1 -- 172.21.15.73:0/3965321298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56546a4d6550 msgr2=0x56546a4e6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:16.593 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.585+0000 7fe3f5a87700 1 --2- 172.21.15.73:0/3965321298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56546a4d6550 0x56546a4e6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.593 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.585+0000 7fe3f5a87700 1 -- 172.21.15.73:0/3965321298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56546a4dc360 msgr2=0x56546a4e5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:16.593 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.585+0000 7fe3f5a87700 1 --2- 172.21.15.73:0/3965321298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56546a4dc360 0x56546a4e5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.593 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.585+0000 7fe3f5a87700 1 -- 172.21.15.73:0/3965321298 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56546a2a85d0 con 0x56546a4dba40 2023-08-10T12:00:16.593 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.585+0000 7fe3f6a89700 1 --2- 172.21.15.73:0/3965321298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56546a4dc360 0x56546a4e5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:00:16.593 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.585+0000 7fe3f5a87700 1 --2- 172.21.15.73:0/3965321298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56546a4dba40 0x56546a4e4e00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0000c00 tx=0x7fe3e00ca6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d05733d4d8be60c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.585+0000 7fe3d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T12:00:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.585+0000 7fe3d9ffb700 1 -- 172.21.15.73:0/3965321298 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0098f10 con 0x56546a4dba40 2023-08-10T12:00:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.585+0000 7fe404685b80 1 -- 172.21.15.73:0/3965321298 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe3e800f040 con 0x56546a4dba40 2023-08-10T12:00:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.585+0000 7fe3d9ffb700 1 -- 172.21.15.73:0/3965321298 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fe3e00a2170 con 0x56546a4dba40 2023-08-10T12:00:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.585+0000 7fe3d9ffb700 1 -- 172.21.15.73:0/3965321298 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3e00994a0 con 0x56546a4dba40 2023-08-10T12:00:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.585+0000 7fe404685b80 10 client.26075 fetch_fsmap learned FSMap version 46 2023-08-10T12:00:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.585+0000 7fe404685b80 1 -- 172.21.15.73:0/3965321298 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x56546a254d80 con 0x56546a4dba40 2023-08-10T12:00:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.585+0000 7fe3d9ffb700 1 -- 172.21.15.73:0/3965321298 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe3e800f040 con 0x56546a4dba40 2023-08-10T12:00:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.586+0000 7fe3d9ffb700 1 -- 172.21.15.73:0/3965321298 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 46) v1 ==== 6977+0+0 (secure 0 0 0) 0x7fe3e000ccc0 con 0x56546a4dba40 2023-08-10T12:00:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.586+0000 7fe404685b80 10 client.26075 fetch_fsmap finished waiting for FSMap version 46 2023-08-10T12:00:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.586+0000 7fe404685b80 10 client.26075 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:00:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.586+0000 7fe404685b80 20 client.26075 populate_metadata read hostname 'smithi073' 2023-08-10T12:00:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.586+0000 7fe404685b80 1 --2- 172.21.15.73:0/3965321298 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56546a548db0 0x56546a54b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:16.596 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.586+0000 7fe404685b80 4 client.26075 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T12:00:16.596 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.586+0000 7fe404685b80 1 -- 172.21.15.73:0/3965321298 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56546a420720 con 0x56546a548db0 2023-08-10T12:00:16.596 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.586+0000 7fe3f6288700 1 --2- 172.21.15.73:0/3965321298 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56546a548db0 0x56546a54b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:16.596 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.586+0000 7fe3f6288700 1 --2- 172.21.15.73:0/3965321298 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56546a548db0 0x56546a54b1d0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf8c21d8b3d6f776 server_cookie=9c15c0683fc1835b in_seq=0 out_seq=0 2023-08-10T12:00:16.596 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.586+0000 7fe3d9ffb700 10 client.26075 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:16.777 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.776+0000 7fe3d9ffb700 1 -- 172.21.15.73:0/3965321298 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56546a420720 con 0x56546a548db0 2023-08-10T12:00:16.777 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.776+0000 7fe3d9ffb700 10 client.26075 handle_command_reply: tid=0 2023-08-10T12:00:16.777 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.776+0000 7fe404685b80 1 client.26075 shutdown 2023-08-10T12:00:16.778 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.776+0000 7fe404685b80 1 -- 172.21.15.73:0/3965321298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56546a4dba40 msgr2=0x56546a4e4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:16.778 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.776+0000 7fe404685b80 1 --2- 172.21.15.73:0/3965321298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56546a4dba40 0x56546a4e4e00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0000c00 tx=0x7fe3e00ca6e0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.778 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.776+0000 7fe404685b80 1 -- 172.21.15.73:0/3965321298 shutdown_connections 2023-08-10T12:00:16.778 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.776+0000 7fe404685b80 1 --2- 172.21.15.73:0/3965321298 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56546a548db0 0x56546a54b1d0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.778 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.776+0000 7fe404685b80 1 --2- 172.21.15.73:0/3965321298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56546a4dc360 0x56546a4e5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.778 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.776+0000 7fe404685b80 1 --2- 172.21.15.73:0/3965321298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56546a4d6550 0x56546a4e6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.778 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.776+0000 7fe404685b80 1 --2- 172.21.15.73:0/3965321298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56546a4dba40 0x56546a4e4e00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.779 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.776+0000 7fe404685b80 1 -- 172.21.15.73:0/3965321298 >> 172.21.15.73:0/3965321298 conn(0x56546a433c70 msgr2=0x56546a4da7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:16.779 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.776+0000 7fe3d9ffb700 0 client.26075 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:16.779 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.776+0000 7fe404685b80 1 -- 172.21.15.73:0/3965321298 shutdown_connections 2023-08-10T12:00:16.779 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.776+0000 7fe404685b80 1 -- 172.21.15.73:0/3965321298 wait complete. 2023-08-10T12:00:16.779 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.776+0000 7fe404685b80 20 client.26075 trim_cache size 0 max 16384 2023-08-10T12:00:16.780 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T12:00:16.780 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T12:00:16.780 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T12:00:16.780 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T12:00:16.781 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.777+0000 7fe3f84ec700 1 -- 172.21.15.73:0/4200349931 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe3dc0a12c0 msgr2=0x7fe3dc0a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:16.781 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.777+0000 7fe3f84ec700 1 --2- 172.21.15.73:0/4200349931 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe3dc0a12c0 0x7fe3dc0a3780 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec00b2e0 tx=0x7fe3ec005fb0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.781 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.777+0000 7fe3f84ec700 1 -- 172.21.15.73:0/4200349931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3f0100760 msgr2=0x7fe3f019bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:16.781 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.777+0000 7fe3f84ec700 1 --2- 172.21.15.73:0/4200349931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3f0100760 0x7fe3f019bc00 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000e9a0 tx=0x7fe3e000ecb0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.781 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.777+0000 7fe3f84ec700 1 -- 172.21.15.73:0/4200349931 shutdown_connections 2023-08-10T12:00:16.781 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.777+0000 7fe3f84ec700 1 --2- 172.21.15.73:0/4200349931 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe3dc0a12c0 0x7fe3dc0a3780 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.781 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.777+0000 7fe3f84ec700 1 --2- 172.21.15.73:0/4200349931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3f01045e0 0x7fe3f0195520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.782 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.777+0000 7fe3f84ec700 1 --2- 172.21.15.73:0/4200349931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3f00ffda0 0x7fe3f019b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.782 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.777+0000 7fe3f84ec700 1 --2- 172.21.15.73:0/4200349931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3f0100760 0x7fe3f019bc00 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:16.782 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.777+0000 7fe3f84ec700 1 -- 172.21.15.73:0/4200349931 >> 172.21.15.73:0/4200349931 conn(0x7fe3f0076b40 msgr2=0x7fe3f0102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:16.782 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.777+0000 7fe3f84ec700 1 -- 172.21.15.73:0/4200349931 shutdown_connections 2023-08-10T12:00:16.782 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:16.777+0000 7fe3f84ec700 1 -- 172.21.15.73:0/4200349931 wait complete. 2023-08-10T12:00:17.058 INFO:tasks.workunit.client.0.smithi073.stdout: 2023-08-10T12:00:17.058 INFO:tasks.workunit.client.0.smithi073.stdout:Final score for writes: 421 2023-08-10T12:00:17.058 INFO:tasks.workunit.client.0.smithi073.stdout:Final score for reads : 976021 2023-08-10T12:00:17.058 INFO:tasks.workunit.client.0.smithi073.stdout: 2023-08-10T12:00:17.059 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-08-10T12:00:17.060 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-08-10T12:00:17.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:16 smithi152 ceph-mon[130220]: pgmap v235: 97 pgs: 15 active+clean+snaptrim_wait, 7 active+clean+snaptrim, 75 active+clean; 1.9 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 119 op/s 2023-08-10T12:00:17.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:16 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:00:17.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:16 smithi156 ceph-mon[130574]: pgmap v235: 97 pgs: 15 active+clean+snaptrim_wait, 7 active+clean+snaptrim, 75 active+clean; 1.9 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 119 op/s 2023-08-10T12:00:17.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:16 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:00:17.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:16 smithi073 ceph-mon[128869]: pgmap v235: 97 pgs: 15 active+clean+snaptrim_wait, 7 active+clean+snaptrim, 75 active+clean; 1.9 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 119 op/s 2023-08-10T12:00:17.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:16 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:00:19.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:18 smithi152 ceph-mon[130220]: pgmap v236: 97 pgs: 11 active+clean+snaptrim_wait, 5 active+clean+snaptrim, 81 active+clean; 1.9 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 108 op/s 2023-08-10T12:00:19.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:18 smithi156 ceph-mon[130574]: pgmap v236: 97 pgs: 11 active+clean+snaptrim_wait, 5 active+clean+snaptrim, 81 active+clean; 1.9 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 108 op/s 2023-08-10T12:00:19.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:18 smithi073 ceph-mon[128869]: pgmap v236: 97 pgs: 11 active+clean+snaptrim_wait, 5 active+clean+snaptrim, 81 active+clean; 1.9 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 108 op/s 2023-08-10T12:00:21.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:21 smithi156 ceph-mon[130574]: pgmap v237: 97 pgs: 97 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 684 KiB/s wr, 129 op/s 2023-08-10T12:00:21.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:21 smithi073 ceph-mon[128869]: pgmap v237: 97 pgs: 97 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 684 KiB/s wr, 129 op/s 2023-08-10T12:00:21.445 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:21 smithi152 ceph-mon[130220]: pgmap v237: 97 pgs: 97 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 684 KiB/s wr, 129 op/s 2023-08-10T12:00:22.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:22 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:00:22.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:22 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:00:22.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:22 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:00:23.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:23 smithi073 ceph-mon[128869]: pgmap v238: 97 pgs: 97 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 634 KiB/s wr, 130 op/s 2023-08-10T12:00:23.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:23 smithi152 ceph-mon[130220]: pgmap v238: 97 pgs: 97 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 634 KiB/s wr, 130 op/s 2023-08-10T12:00:23.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:23 smithi156 ceph-mon[130574]: pgmap v238: 97 pgs: 97 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 634 KiB/s wr, 130 op/s 2023-08-10T12:00:24.316 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T12:00:24.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.442+0000 7ff5ba377700 1 -- 172.21.15.73:0/1835431472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5b40ff5d0 msgr2=0x7ff5b40ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:24.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.442+0000 7ff5ba377700 1 --2- 172.21.15.73:0/1835431472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5b40ff5d0 0x7ff5b40ffa50 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ff5a80099c0 tx=0x7ff5a8009cd0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.442+0000 7ff5ba377700 1 -- 172.21.15.73:0/1835431472 shutdown_connections 2023-08-10T12:00:24.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.442+0000 7ff5ba377700 1 --2- 172.21.15.73:0/1835431472 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5b40fff90 0x7ff5b410c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.442+0000 7ff5ba377700 1 --2- 172.21.15.73:0/1835431472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5b4105690 0x7ff5b4105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.442+0000 7ff5ba377700 1 --2- 172.21.15.73:0/1835431472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5b40ff5d0 0x7ff5b40ffa50 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.442+0000 7ff5ba377700 1 -- 172.21.15.73:0/1835431472 >> 172.21.15.73:0/1835431472 conn(0x7ff5b40fb0c0 msgr2=0x7ff5b40fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:24.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.442+0000 7ff5ba377700 1 -- 172.21.15.73:0/1835431472 shutdown_connections 2023-08-10T12:00:24.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.442+0000 7ff5ba377700 1 -- 172.21.15.73:0/1835431472 wait complete. 2023-08-10T12:00:24.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.442+0000 7ff5ba377700 1 Processor -- start 2023-08-10T12:00:24.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.442+0000 7ff5ba377700 1 -- start start 2023-08-10T12:00:24.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.443+0000 7ff5ba377700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5b40ff5d0 0x7ff5b41975f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:24.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.443+0000 7ff5ba377700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5b40fff90 0x7ff5b4197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:24.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.443+0000 7ff5ba377700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5b4105690 0x7ff5b41a2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:24.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.443+0000 7ff5ba377700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b41a2bb0 con 0x7ff5b40ff5d0 2023-08-10T12:00:24.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.443+0000 7ff5ba377700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b41a2cf0 con 0x7ff5b4105690 2023-08-10T12:00:24.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.443+0000 7ff5ba377700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b41a2e30 con 0x7ff5b40fff90 2023-08-10T12:00:24.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.443+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5b40ff5d0 0x7ff5b41975f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:24.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.443+0000 7ff5b8914700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5b4105690 0x7ff5b41a2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:24.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.443+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5b40ff5d0 0x7ff5b41975f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35818/0 (socket says 172.21.15.73:35818) 2023-08-10T12:00:24.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.443+0000 7ff5b3fff700 1 -- 172.21.15.73:0/4224135150 learned_addr learned my addr 172.21.15.73:0/4224135150 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:24.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.443+0000 7ff5b37fe700 1 --2- 172.21.15.73:0/4224135150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5b40fff90 0x7ff5b4197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:24.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.443+0000 7ff5b3fff700 1 -- 172.21.15.73:0/4224135150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5b40fff90 msgr2=0x7ff5b4197b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:24.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.443+0000 7ff5b3fff700 1 --2- 172.21.15.73:0/4224135150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5b40fff90 0x7ff5b4197b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.443+0000 7ff5b3fff700 1 -- 172.21.15.73:0/4224135150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5b4105690 msgr2=0x7ff5b41a2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:24.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.443+0000 7ff5b3fff700 1 --2- 172.21.15.73:0/4224135150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5b4105690 0x7ff5b41a2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.443+0000 7ff5b3fff700 1 -- 172.21.15.73:0/4224135150 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a80095f0 con 0x7ff5b40ff5d0 2023-08-10T12:00:24.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.443+0000 7ff5b8914700 1 --2- 172.21.15.73:0/4224135150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5b4105690 0x7ff5b41a2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:00:24.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.444+0000 7ff5b3fff700 1 --2- 172.21.15.73:0/4224135150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5b40ff5d0 0x7ff5b41975f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400e9a0 tx=0x7ff5a400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:24.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.444+0000 7ff5b17fa700 1 -- 172.21.15.73:0/4224135150 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4009790 con 0x7ff5b40ff5d0 2023-08-10T12:00:24.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.444+0000 7ff5ba377700 1 -- 172.21.15.73:0/4224135150 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b4195440 con 0x7ff5b40ff5d0 2023-08-10T12:00:24.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.444+0000 7ff5b17fa700 1 -- 172.21.15.73:0/4224135150 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5a4010430 con 0x7ff5b40ff5d0 2023-08-10T12:00:24.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.444+0000 7ff5b17fa700 1 -- 172.21.15.73:0/4224135150 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4018680 con 0x7ff5b40ff5d0 2023-08-10T12:00:24.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.444+0000 7ff5ba377700 1 -- 172.21.15.73:0/4224135150 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b4195950 con 0x7ff5b40ff5d0 2023-08-10T12:00:24.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.447+0000 7ff5b17fa700 1 -- 172.21.15.73:0/4224135150 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7ff5a40105a0 con 0x7ff5b40ff5d0 2023-08-10T12:00:24.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.448+0000 7ff5c6510b80 1 Processor -- start 2023-08-10T12:00:24.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.448+0000 7ff5c6510b80 1 -- start start 2023-08-10T12:00:24.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.448+0000 7ff5c6510b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5619a1649f50 0x5619a164a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:24.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.448+0000 7ff5c6510b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5619a164a870 0x5619a16442c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:24.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.448+0000 7ff5c6510b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619a1644800 0x5619a1644c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:24.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.448+0000 7ff5b17fa700 1 --2- 172.21.15.73:0/4224135150 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ff59c0a12c0 0x7ff59c0a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:24.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.448+0000 7ff5c6510b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619a15bfdc0 con 0x5619a1649f50 2023-08-10T12:00:24.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.448+0000 7ff5c6510b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619a159c590 con 0x5619a1644800 2023-08-10T12:00:24.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.448+0000 7ff5c6510b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619a1599eb0 con 0x5619a164a870 2023-08-10T12:00:24.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.448+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5619a164a870 0x5619a16442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:24.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.448+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5619a164a870 0x5619a16442c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:33096/0 (socket says 172.21.15.73:33096) 2023-08-10T12:00:24.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.448+0000 7ff5b3fff700 1 -- 172.21.15.73:0/1924733399 learned_addr learned my addr 172.21.15.73:0/1924733399 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:24.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.448+0000 7ff5b8914700 1 --2- 172.21.15.73:0/4224135150 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ff59c0a12c0 0x7ff59c0a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:24.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.448+0000 7ff5b8914700 1 --2- 172.21.15.73:0/1924733399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5619a1649f50 0x5619a164a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:24.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.448+0000 7ff5b37fe700 1 --2- 172.21.15.73:0/1924733399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619a1644800 0x5619a1644c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:24.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.448+0000 7ff5b17fa700 1 -- 172.21.15.73:0/4224135150 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff5a4014070 con 0x7ff5b40ff5d0 2023-08-10T12:00:24.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.449+0000 7ff5b3fff700 1 -- 172.21.15.73:0/1924733399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619a1644800 msgr2=0x5619a1644c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:24.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.449+0000 7ff5b3fff700 1 --2- 172.21.15.73:0/1924733399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619a1644800 0x5619a1644c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.449+0000 7ff5b3fff700 1 -- 172.21.15.73:0/1924733399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5619a1649f50 msgr2=0x5619a164a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:24.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.449+0000 7ff5b3fff700 1 --2- 172.21.15.73:0/1924733399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5619a1649f50 0x5619a164a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.449+0000 7ff5b3fff700 1 -- 172.21.15.73:0/1924733399 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619a1416630 con 0x5619a164a870 2023-08-10T12:00:24.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.449+0000 7ff5b37fe700 1 --2- 172.21.15.73:0/1924733399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619a1644800 0x5619a1644c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T12:00:24.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.449+0000 7ff5b3fff700 1 --2- 172.21.15.73:0/1924733399 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5619a164a870 0x5619a16442c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400e970 tx=0x7ff5a4099dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c258c075982af4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:24.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.449+0000 7ff5b8914700 1 --2- 172.21.15.73:0/4224135150 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ff59c0a12c0 0x7ff59c0a3780 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac007f40 tx=0x7ff5ac007580 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:24.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.449+0000 7ff59a7fc700 1 -- 172.21.15.73:0/1924733399 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4099f20 con 0x5619a164a870 2023-08-10T12:00:24.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.449+0000 7ff59a7fc700 1 -- 172.21.15.73:0/1924733399 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5a409df50 con 0x5619a164a870 2023-08-10T12:00:24.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.449+0000 7ff59a7fc700 1 -- 172.21.15.73:0/1924733399 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a409a180 con 0x5619a164a870 2023-08-10T12:00:24.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.450+0000 7ff5c6510b80 1 -- 172.21.15.73:0/1924733399 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5619a164a870 msgr2=0x5619a16442c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:24.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.450+0000 7ff5c6510b80 1 --2- 172.21.15.73:0/1924733399 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5619a164a870 0x5619a16442c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400e970 tx=0x7ff5a4099dc0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.450+0000 7ff5c6510b80 1 -- 172.21.15.73:0/1924733399 shutdown_connections 2023-08-10T12:00:24.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.450+0000 7ff5c6510b80 1 --2- 172.21.15.73:0/1924733399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619a1644800 0x5619a1644c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.450+0000 7ff5c6510b80 1 --2- 172.21.15.73:0/1924733399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5619a1649f50 0x5619a164a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.450+0000 7ff5c6510b80 1 --2- 172.21.15.73:0/1924733399 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5619a164a870 0x5619a16442c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.450+0000 7ff5c6510b80 1 -- 172.21.15.73:0/1924733399 >> 172.21.15.73:0/1924733399 conn(0x5619a15a1cd0 msgr2=0x5619a163f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:24.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.450+0000 7ff5c6510b80 1 -- 172.21.15.73:0/1924733399 shutdown_connections 2023-08-10T12:00:24.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.450+0000 7ff5c6510b80 1 -- 172.21.15.73:0/1924733399 wait complete. 2023-08-10T12:00:24.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.450+0000 7ff5c6510b80 1 -- start start 2023-08-10T12:00:24.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.450+0000 7ff5c6510b80 1 Processor -- start 2023-08-10T12:00:24.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.451+0000 7ff5c6510b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5619a1644800 0x5619a1650890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:24.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.451+0000 7ff5c6510b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619a1649f50 0x5619a164db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:24.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.451+0000 7ff5c6510b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5619a164a870 0x5619a164e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:24.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.451+0000 7ff5c6510b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619a15957a0 con 0x5619a164a870 2023-08-10T12:00:24.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.451+0000 7ff5c6510b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619a1534ac0 con 0x5619a1649f50 2023-08-10T12:00:24.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.451+0000 7ff5c6510b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619a15347c0 con 0x5619a1644800 2023-08-10T12:00:24.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.451+0000 7ff5c6510b80 10 client.0 _ll_register_callbacks cb 0x5619a1532680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:00:24.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.451+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5619a1644800 0x5619a1650890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:24.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.451+0000 7ff5b37fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619a1649f50 0x5619a164db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:24.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.451+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5619a1644800 0x5619a1650890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:33102/0 (socket says 172.21.15.73:33102) 2023-08-10T12:00:24.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.451+0000 7ff5b3fff700 1 -- 172.21.15.73:0/1100503636 learned_addr learned my addr 172.21.15.73:0/1100503636 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:24.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.451+0000 7ff5b8914700 1 --2- 172.21.15.73:0/1100503636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5619a164a870 0x5619a164e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:24.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.451+0000 7ff5b3fff700 1 -- 172.21.15.73:0/1100503636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619a1649f50 msgr2=0x5619a164db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:24.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.451+0000 7ff5b3fff700 1 --2- 172.21.15.73:0/1100503636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619a1649f50 0x5619a164db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.451+0000 7ff5b3fff700 1 -- 172.21.15.73:0/1100503636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5619a164a870 msgr2=0x5619a164e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:24.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.451+0000 7ff5b3fff700 1 --2- 172.21.15.73:0/1100503636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5619a164a870 0x5619a164e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.451+0000 7ff5b3fff700 1 -- 172.21.15.73:0/1100503636 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b4195950 con 0x5619a1644800 2023-08-10T12:00:24.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.451+0000 7ff5b8914700 1 --2- 172.21.15.73:0/1100503636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5619a164a870 0x5619a164e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:00:24.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.451+0000 7ff5b3fff700 1 --2- 172.21.15.73:0/1100503636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5619a1644800 0x5619a1650890 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4099c20 tx=0x7ff5a4010ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c24edee586df36a4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:24.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.451+0000 7ff5937fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T12:00:24.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.452+0000 7ff5937fe700 1 -- 172.21.15.73:0/1100503636 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a409f030 con 0x5619a1644800 2023-08-10T12:00:24.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.452+0000 7ff5937fe700 1 -- 172.21.15.73:0/1100503636 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff5a409f190 con 0x5619a1644800 2023-08-10T12:00:24.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.452+0000 7ff5c6510b80 1 -- 172.21.15.73:0/1100503636 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5619a1637470 con 0x5619a1644800 2023-08-10T12:00:24.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.452+0000 7ff5937fe700 1 -- 172.21.15.73:0/1100503636 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5a40ca2c0 con 0x5619a1644800 2023-08-10T12:00:24.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.452+0000 7ff5c6510b80 10 client.26146 fetch_fsmap learned FSMap version 47 2023-08-10T12:00:24.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.452+0000 7ff5c6510b80 1 -- 172.21.15.73:0/1100503636 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x5619a13c2de0 con 0x5619a1644800 2023-08-10T12:00:24.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.452+0000 7ff5937fe700 1 -- 172.21.15.73:0/1100503636 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5619a1637470 con 0x5619a1644800 2023-08-10T12:00:24.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.452+0000 7ff5937fe700 1 -- 172.21.15.73:0/1100503636 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 47) v1 ==== 6981+0+0 (secure 0 0 0) 0x7ff5a40a1ee0 con 0x5619a1644800 2023-08-10T12:00:24.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.452+0000 7ff5c6510b80 10 client.26146 fetch_fsmap finished waiting for FSMap version 47 2023-08-10T12:00:24.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.452+0000 7ff5c6510b80 10 client.26146 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T12:00:24.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.452+0000 7ff5c6510b80 20 client.26146 populate_metadata read hostname 'smithi073' 2023-08-10T12:00:24.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.452+0000 7ff5c6510b80 1 --2- 172.21.15.73:0/1100503636 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5619a165dfd0 0x5619a16603f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:24.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.452+0000 7ff5c6510b80 4 client.26146 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:00:24.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.452+0000 7ff5c6510b80 1 -- 172.21.15.73:0/1100503636 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5619a16139d0 con 0x5619a165dfd0 2023-08-10T12:00:24.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.452+0000 7ff5b37fe700 1 --2- 172.21.15.73:0/1100503636 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5619a165dfd0 0x5619a16603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:24.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.453+0000 7ff5b37fe700 1 --2- 172.21.15.73:0/1100503636 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5619a165dfd0 0x5619a16603f0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9afe35d0e330b21 server_cookie=6edcf5b99d9eae15 in_seq=0 out_seq=0 2023-08-10T12:00:24.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.453+0000 7ff5937fe700 10 client.26146 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:24.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.454+0000 7ff5937fe700 1 -- 172.21.15.73:0/1100503636 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5619a16139d0 con 0x5619a165dfd0 2023-08-10T12:00:24.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.454+0000 7ff5937fe700 10 client.26146 handle_command_reply: tid=0 2023-08-10T12:00:24.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.454+0000 7ff5c6510b80 1 client.26146 shutdown 2023-08-10T12:00:24.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.454+0000 7ff5c6510b80 1 -- 172.21.15.73:0/1100503636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5619a1644800 msgr2=0x5619a1650890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:24.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.454+0000 7ff5c6510b80 1 --2- 172.21.15.73:0/1100503636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5619a1644800 0x5619a1650890 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4099c20 tx=0x7ff5a4010ab0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.454+0000 7ff5c6510b80 1 -- 172.21.15.73:0/1100503636 shutdown_connections 2023-08-10T12:00:24.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.454+0000 7ff5c6510b80 1 --2- 172.21.15.73:0/1100503636 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5619a165dfd0 0x5619a16603f0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.454+0000 7ff5c6510b80 1 --2- 172.21.15.73:0/1100503636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5619a164a870 0x5619a164e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.454+0000 7ff5937fe700 0 client.26146 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:24.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.454+0000 7ff5c6510b80 1 --2- 172.21.15.73:0/1100503636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5619a1644800 0x5619a1650890 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.454+0000 7ff5c6510b80 1 --2- 172.21.15.73:0/1100503636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619a1649f50 0x5619a164db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.454+0000 7ff5c6510b80 1 -- 172.21.15.73:0/1100503636 >> 172.21.15.73:0/1100503636 conn(0x5619a15a1cd0 msgr2=0x5619a163e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:24.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.454+0000 7ff5c6510b80 1 -- 172.21.15.73:0/1100503636 shutdown_connections 2023-08-10T12:00:24.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.454+0000 7ff5c6510b80 1 -- 172.21.15.73:0/1100503636 wait complete. 2023-08-10T12:00:24.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.454+0000 7ff5c6510b80 20 client.26146 trim_cache size 0 max 16384 2023-08-10T12:00:24.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.471+0000 7ff5c6510b80 1 Processor -- start 2023-08-10T12:00:24.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.471+0000 7ff5c6510b80 1 -- start start 2023-08-10T12:00:24.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.471+0000 7ff5c6510b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5619a1644800 0x5619a1655300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:24.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.471+0000 7ff5c6510b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5619a1649f50 0x5619a16492b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:24.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.471+0000 7ff5c6510b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619a164a870 0x5619a1650430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:24.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.471+0000 7ff5c6510b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619a1418920 con 0x5619a1644800 2023-08-10T12:00:24.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.471+0000 7ff5c6510b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619a164f0f0 con 0x5619a164a870 2023-08-10T12:00:24.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.471+0000 7ff5c6510b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619a1648790 con 0x5619a1649f50 2023-08-10T12:00:24.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.471+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5619a1644800 0x5619a1655300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:24.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.471+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5619a1644800 0x5619a1655300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35838/0 (socket says 172.21.15.73:35838) 2023-08-10T12:00:24.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.471+0000 7ff5b3fff700 1 -- 172.21.15.73:0/3124644835 learned_addr learned my addr 172.21.15.73:0/3124644835 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:24.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.471+0000 7ff5b37fe700 1 --2- 172.21.15.73:0/3124644835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5619a1649f50 0x5619a16492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:24.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.471+0000 7ff5b8914700 1 --2- 172.21.15.73:0/3124644835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619a164a870 0x5619a1650430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:24.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.472+0000 7ff5b3fff700 1 -- 172.21.15.73:0/3124644835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5619a1649f50 msgr2=0x5619a16492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:24.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.472+0000 7ff5b3fff700 1 --2- 172.21.15.73:0/3124644835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5619a1649f50 0x5619a16492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.472+0000 7ff5b3fff700 1 -- 172.21.15.73:0/3124644835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619a164a870 msgr2=0x5619a1650430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:24.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.472+0000 7ff5b3fff700 1 --2- 172.21.15.73:0/3124644835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619a164a870 0x5619a1650430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.472+0000 7ff5b3fff700 1 -- 172.21.15.73:0/3124644835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619a13abc60 con 0x5619a1644800 2023-08-10T12:00:24.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.472+0000 7ff5b3fff700 1 --2- 172.21.15.73:0/3124644835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5619a1644800 0x5619a1655300 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40caba0 tx=0x7ff5a40ca650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17c80c1a3e39364 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:24.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.472+0000 7ff59affd700 1 -- 172.21.15.73:0/3124644835 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4099a60 con 0x5619a1644800 2023-08-10T12:00:24.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.472+0000 7ff59affd700 1 -- 172.21.15.73:0/3124644835 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5a4098380 con 0x5619a1644800 2023-08-10T12:00:24.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.472+0000 7ff59affd700 1 -- 172.21.15.73:0/3124644835 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a409f290 con 0x5619a1644800 2023-08-10T12:00:24.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.473+0000 7ff5c6510b80 1 -- 172.21.15.73:0/3124644835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5619a1644800 msgr2=0x5619a1655300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:24.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.473+0000 7ff5c6510b80 1 --2- 172.21.15.73:0/3124644835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5619a1644800 0x5619a1655300 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40caba0 tx=0x7ff5a40ca650 comp rx=0 tx=0).stop 2023-08-10T12:00:24.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.473+0000 7ff5c6510b80 1 -- 172.21.15.73:0/3124644835 shutdown_connections 2023-08-10T12:00:24.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.473+0000 7ff5c6510b80 1 --2- 172.21.15.73:0/3124644835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619a164a870 0x5619a1650430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.473+0000 7ff5c6510b80 1 --2- 172.21.15.73:0/3124644835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5619a1644800 0x5619a1655300 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.473+0000 7ff5c6510b80 1 --2- 172.21.15.73:0/3124644835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5619a1649f50 0x5619a16492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.473+0000 7ff5c6510b80 1 -- 172.21.15.73:0/3124644835 >> 172.21.15.73:0/3124644835 conn(0x5619a15a1cd0 msgr2=0x5619a1648ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:24.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.473+0000 7ff5c6510b80 1 -- 172.21.15.73:0/3124644835 shutdown_connections 2023-08-10T12:00:24.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.473+0000 7ff5c6510b80 1 -- 172.21.15.73:0/3124644835 wait complete. 2023-08-10T12:00:24.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.473+0000 7ff5c6510b80 1 -- start start 2023-08-10T12:00:24.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.473+0000 7ff5c6510b80 1 Processor -- start 2023-08-10T12:00:24.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.474+0000 7ff5c6510b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5619a1644800 0x5619a1655230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:24.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.474+0000 7ff5c6510b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619a1649f50 0x5619a1651540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:24.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.474+0000 7ff5c6510b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5619a164a870 0x5619a1651a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:24.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.474+0000 7ff5c6510b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619a1652190 con 0x5619a164a870 2023-08-10T12:00:24.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.474+0000 7ff5c6510b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619a1652300 con 0x5619a1649f50 2023-08-10T12:00:24.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.474+0000 7ff5c6510b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619a16b1c40 con 0x5619a1644800 2023-08-10T12:00:24.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.474+0000 7ff5c6510b80 10 client.0 _ll_register_callbacks cb 0x5619a1532680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:00:24.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.474+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5619a1644800 0x5619a1655230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:24.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.474+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5619a1644800 0x5619a1655230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:33116/0 (socket says 172.21.15.73:33116) 2023-08-10T12:00:24.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.474+0000 7ff5b37fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619a1649f50 0x5619a1651540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:24.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.474+0000 7ff5b3fff700 1 -- 172.21.15.73:0/3782984654 learned_addr learned my addr 172.21.15.73:0/3782984654 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:24.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.474+0000 7ff5b8914700 1 --2- 172.21.15.73:0/3782984654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5619a164a870 0x5619a1651a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:24.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.474+0000 7ff5b3fff700 1 -- 172.21.15.73:0/3782984654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619a1649f50 msgr2=0x5619a1651540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:24.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.474+0000 7ff5b3fff700 1 --2- 172.21.15.73:0/3782984654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619a1649f50 0x5619a1651540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.474+0000 7ff5b3fff700 1 -- 172.21.15.73:0/3782984654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5619a164a870 msgr2=0x5619a1651a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:24.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.474+0000 7ff5b3fff700 1 --2- 172.21.15.73:0/3782984654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5619a164a870 0x5619a1651a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.474+0000 7ff5b3fff700 1 -- 172.21.15.73:0/3782984654 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5619a13c2de0 con 0x5619a1644800 2023-08-10T12:00:24.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.474+0000 7ff5b3fff700 1 --2- 172.21.15.73:0/3782984654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5619a1644800 0x5619a1655230 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4099eb0 tx=0x7ff5a4099b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13f23ccb39220b70 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:24.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.474+0000 7ff5937fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T12:00:24.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.475+0000 7ff5937fe700 1 -- 172.21.15.73:0/3782984654 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a409f230 con 0x5619a1644800 2023-08-10T12:00:24.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.475+0000 7ff5c6510b80 1 -- 172.21.15.73:0/3782984654 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff5a409df50 con 0x5619a1644800 2023-08-10T12:00:24.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.475+0000 7ff5937fe700 1 -- 172.21.15.73:0/3782984654 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff5a40ca2c0 con 0x5619a1644800 2023-08-10T12:00:24.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.475+0000 7ff5937fe700 1 -- 172.21.15.73:0/3782984654 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5a4099410 con 0x5619a1644800 2023-08-10T12:00:24.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.475+0000 7ff5c6510b80 10 client.26152 fetch_fsmap learned FSMap version 47 2023-08-10T12:00:24.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.475+0000 7ff5c6510b80 1 -- 172.21.15.73:0/3782984654 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x5619a13e9250 con 0x5619a1644800 2023-08-10T12:00:24.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.475+0000 7ff5937fe700 1 -- 172.21.15.73:0/3782984654 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5a409df50 con 0x5619a1644800 2023-08-10T12:00:24.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.475+0000 7ff5937fe700 1 -- 172.21.15.73:0/3782984654 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 47) v1 ==== 6981+0+0 (secure 0 0 0) 0x7ff5a40c7c60 con 0x5619a1644800 2023-08-10T12:00:24.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.475+0000 7ff5c6510b80 10 client.26152 fetch_fsmap finished waiting for FSMap version 47 2023-08-10T12:00:24.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.475+0000 7ff5c6510b80 10 client.26152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T12:00:24.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.475+0000 7ff5c6510b80 20 client.26152 populate_metadata read hostname 'smithi073' 2023-08-10T12:00:24.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.475+0000 7ff5c6510b80 1 --2- 172.21.15.73:0/3782984654 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5619a16b2e20 0x5619a16b5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:24.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.475+0000 7ff5c6510b80 4 client.26152 mds_command: new command op to 24503 tid=0[{"prefix": "scrub status"}] 2023-08-10T12:00:24.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.475+0000 7ff5c6510b80 1 -- 172.21.15.73:0/3782984654 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5619a158e780 con 0x5619a16b2e20 2023-08-10T12:00:24.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.476+0000 7ff5b37fe700 1 --2- 172.21.15.73:0/3782984654 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5619a16b2e20 0x5619a16b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:24.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.476+0000 7ff5937fe700 10 client.26152 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:24.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.476+0000 7ff5b37fe700 1 --2- 172.21.15.73:0/3782984654 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5619a16b2e20 0x5619a16b5210 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbd9e3226c39b110 server_cookie=eb8f6a3e7ad67554 in_seq=0 out_seq=0 2023-08-10T12:00:24.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.476+0000 7ff5937fe700 1 -- 172.21.15.73:0/3782984654 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5619a158e780 con 0x5619a16b2e20 2023-08-10T12:00:24.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.476+0000 7ff5937fe700 10 client.26152 handle_command_reply: tid=0 2023-08-10T12:00:24.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.476+0000 7ff5c6510b80 1 client.26152 shutdown 2023-08-10T12:00:24.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.477+0000 7ff5c6510b80 1 -- 172.21.15.73:0/3782984654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5619a1644800 msgr2=0x5619a1655230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:24.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.477+0000 7ff5c6510b80 1 --2- 172.21.15.73:0/3782984654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5619a1644800 0x5619a1655230 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4099eb0 tx=0x7ff5a4099b10 comp rx=0 tx=0).stop 2023-08-10T12:00:24.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.477+0000 7ff5c6510b80 1 -- 172.21.15.73:0/3782984654 shutdown_connections 2023-08-10T12:00:24.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.477+0000 7ff5c6510b80 1 --2- 172.21.15.73:0/3782984654 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5619a16b2e20 0x5619a16b5210 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.477+0000 7ff5c6510b80 1 --2- 172.21.15.73:0/3782984654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5619a164a870 0x5619a1651a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.477+0000 7ff5937fe700 0 client.26152 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:24.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.477+0000 7ff5c6510b80 1 --2- 172.21.15.73:0/3782984654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5619a1644800 0x5619a1655230 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.477+0000 7ff5c6510b80 1 --2- 172.21.15.73:0/3782984654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5619a1649f50 0x5619a1651540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.477+0000 7ff5c6510b80 1 -- 172.21.15.73:0/3782984654 >> 172.21.15.73:0/3782984654 conn(0x5619a15a1cd0 msgr2=0x5619a1643b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:24.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.477+0000 7ff5c6510b80 1 -- 172.21.15.73:0/3782984654 shutdown_connections 2023-08-10T12:00:24.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.477+0000 7ff5c6510b80 1 -- 172.21.15.73:0/3782984654 wait complete. 2023-08-10T12:00:24.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.477+0000 7ff5c6510b80 20 client.26152 trim_cache size 0 max 16384 2023-08-10T12:00:24.487 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T12:00:24.487 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T12:00:24.487 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": { 2023-08-10T12:00:24.488 INFO:teuthology.orchestra.run.smithi073.stdout: "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d": { 2023-08-10T12:00:24.488 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2023-08-10T12:00:24.488 INFO:teuthology.orchestra.run.smithi073.stdout: "tag": "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d", 2023-08-10T12:00:24.488 INFO:teuthology.orchestra.run.smithi073.stdout: "options": "recursive,force" 2023-08-10T12:00:24.488 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:00:24.488 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:00:24.488 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T12:00:24.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.477+0000 7ff5ba377700 1 -- 172.21.15.73:0/4224135150 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ff59c0a12c0 msgr2=0x7ff59c0a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:24.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.477+0000 7ff5ba377700 1 --2- 172.21.15.73:0/4224135150 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ff59c0a12c0 0x7ff59c0a3780 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac007f40 tx=0x7ff5ac007580 comp rx=0 tx=0).stop 2023-08-10T12:00:24.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.477+0000 7ff5ba377700 1 -- 172.21.15.73:0/4224135150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5b40ff5d0 msgr2=0x7ff5b41975f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:24.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.477+0000 7ff5ba377700 1 --2- 172.21.15.73:0/4224135150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5b40ff5d0 0x7ff5b41975f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400e9a0 tx=0x7ff5a400ecb0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.478+0000 7ff5ba377700 1 -- 172.21.15.73:0/4224135150 shutdown_connections 2023-08-10T12:00:24.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.478+0000 7ff5ba377700 1 --2- 172.21.15.73:0/4224135150 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ff59c0a12c0 0x7ff59c0a3780 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.478+0000 7ff5ba377700 1 --2- 172.21.15.73:0/4224135150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5b4105690 0x7ff5b41a2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.478+0000 7ff5ba377700 1 --2- 172.21.15.73:0/4224135150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5b40ff5d0 0x7ff5b41975f0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.478+0000 7ff5ba377700 1 --2- 172.21.15.73:0/4224135150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5b40fff90 0x7ff5b4197b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:24.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.478+0000 7ff5ba377700 1 -- 172.21.15.73:0/4224135150 >> 172.21.15.73:0/4224135150 conn(0x7ff5b40fb0c0 msgr2=0x7ff5b40fc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:24.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.478+0000 7ff5ba377700 1 -- 172.21.15.73:0/4224135150 shutdown_connections 2023-08-10T12:00:24.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:24.478+0000 7ff5ba377700 1 -- 172.21.15.73:0/4224135150 wait complete. 2023-08-10T12:00:24.493 INFO:tasks.cephfs.filesystem:scrub status for tag:9d39b3fa-9b62-42b4-b1a5-738cb3118a5d - {'path': '/', 'tag': '9d39b3fa-9b62-42b4-b1a5-738cb3118a5d', 'options': 'recursive,force'} 2023-08-10T12:00:25.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:24 smithi152 ceph-mon[130220]: osdmap e90: 12 total, 12 up, 12 in 2023-08-10T12:00:25.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:24 smithi152 ceph-mon[130220]: pgmap v240: 97 pgs: 97 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 1.1 MiB/s wr, 207 op/s 2023-08-10T12:00:25.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:24 smithi156 ceph-mon[130574]: osdmap e90: 12 total, 12 up, 12 in 2023-08-10T12:00:25.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:24 smithi156 ceph-mon[130574]: pgmap v240: 97 pgs: 97 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 1.1 MiB/s wr, 207 op/s 2023-08-10T12:00:25.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:24 smithi073 ceph-mon[128869]: osdmap e90: 12 total, 12 up, 12 in 2023-08-10T12:00:25.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:24 smithi073 ceph-mon[128869]: pgmap v240: 97 pgs: 97 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 1.1 MiB/s wr, 207 op/s 2023-08-10T12:00:26.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:25 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:00:26.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:25 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:00:26.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:25 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:00:27.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:26 smithi152 ceph-mon[130220]: pgmap v241: 97 pgs: 97 active+clean; 1.9 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 265 op/s 2023-08-10T12:00:27.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:26 smithi156 ceph-mon[130574]: pgmap v241: 97 pgs: 97 active+clean; 1.9 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 265 op/s 2023-08-10T12:00:27.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:26 smithi073 ceph-mon[128869]: pgmap v241: 97 pgs: 97 active+clean; 1.9 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 265 op/s 2023-08-10T12:00:29.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:28 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:00:29.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:28 smithi152 ceph-mon[130220]: pgmap v242: 97 pgs: 97 active+clean; 1.9 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 271 op/s 2023-08-10T12:00:29.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:28 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:00:29.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:28 smithi156 ceph-mon[130574]: pgmap v242: 97 pgs: 97 active+clean; 1.9 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 271 op/s 2023-08-10T12:00:29.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:28 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:00:29.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:28 smithi073 ceph-mon[128869]: pgmap v242: 97 pgs: 97 active+clean; 1.9 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 271 op/s 2023-08-10T12:00:29.902 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.901+0000 7fe445f87700 1 -- 172.21.15.73:0/3982396617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4400ff8d0 msgr2=0x7fe4400ffd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.901+0000 7fe445f87700 1 --2- 172.21.15.73:0/3982396617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4400ff8d0 0x7fe4400ffd50 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fe434009990 tx=0x7fe434009ca0 comp rx=0 tx=0).stop 2023-08-10T12:00:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.901+0000 7fe445f87700 1 -- 172.21.15.73:0/3982396617 shutdown_connections 2023-08-10T12:00:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.901+0000 7fe445f87700 1 --2- 172.21.15.73:0/3982396617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe440100290 0x7fe44010c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.901+0000 7fe445f87700 1 --2- 172.21.15.73:0/3982396617 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe440105670 0x7fe440105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.901+0000 7fe445f87700 1 --2- 172.21.15.73:0/3982396617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4400ff8d0 0x7fe4400ffd50 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.901+0000 7fe445f87700 1 -- 172.21.15.73:0/3982396617 >> 172.21.15.73:0/3982396617 conn(0x7fe4400750a0 msgr2=0x7fe4400754b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.901+0000 7fe445f87700 1 -- 172.21.15.73:0/3982396617 shutdown_connections 2023-08-10T12:00:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.902+0000 7fe445f87700 1 -- 172.21.15.73:0/3982396617 wait complete. 2023-08-10T12:00:29.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.902+0000 7fe445f87700 1 Processor -- start 2023-08-10T12:00:29.905 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.903+0000 7fe445f87700 1 -- start start 2023-08-10T12:00:29.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.903+0000 7fe445f87700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4400ff8d0 0x7fe44019c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:29.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.903+0000 7fe445f87700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe440100290 0x7fe44019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:29.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.903+0000 7fe445f87700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe440105670 0x7fe440196510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:29.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.903+0000 7fe445f87700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe440196b80 con 0x7fe440100290 2023-08-10T12:00:29.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.903+0000 7fe445f87700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe440196cf0 con 0x7fe440105670 2023-08-10T12:00:29.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.903+0000 7fe445f87700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe440196eb0 con 0x7fe4400ff8d0 2023-08-10T12:00:29.906 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.903+0000 7fe43effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe440100290 0x7fe44019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:29.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.903+0000 7fe43f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4400ff8d0 0x7fe44019c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:29.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.903+0000 7fe43effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe440100290 0x7fe44019cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35860/0 (socket says 172.21.15.73:35860) 2023-08-10T12:00:29.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.903+0000 7fe43effd700 1 -- 172.21.15.73:0/3838819422 learned_addr learned my addr 172.21.15.73:0/3838819422 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:29.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.903+0000 7fe43ffff700 1 --2- 172.21.15.73:0/3838819422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe440105670 0x7fe440196510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:29.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.903+0000 7fe43effd700 1 -- 172.21.15.73:0/3838819422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4400ff8d0 msgr2=0x7fe44019c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:29.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.903+0000 7fe43effd700 1 --2- 172.21.15.73:0/3838819422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4400ff8d0 0x7fe44019c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:29.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.903+0000 7fe43effd700 1 -- 172.21.15.73:0/3838819422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe440105670 msgr2=0x7fe440196510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:29.907 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.903+0000 7fe43effd700 1 --2- 172.21.15.73:0/3838819422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe440105670 0x7fe440196510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:29.908 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.903+0000 7fe43effd700 1 -- 172.21.15.73:0/3838819422 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4340095f0 con 0x7fe440100290 2023-08-10T12:00:29.908 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.903+0000 7fe43effd700 1 --2- 172.21.15.73:0/3838819422 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe440100290 0x7fe44019cbf0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe434000c00 tx=0x7fe434004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:29.908 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.904+0000 7fe43cff9700 1 -- 172.21.15.73:0/3838819422 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43401d070 con 0x7fe440100290 2023-08-10T12:00:29.908 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.904+0000 7fe445f87700 1 -- 172.21.15.73:0/3838819422 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe440197190 con 0x7fe440100290 2023-08-10T12:00:29.908 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.904+0000 7fe43cff9700 1 -- 172.21.15.73:0/3838819422 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe434021410 con 0x7fe440100290 2023-08-10T12:00:29.908 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.904+0000 7fe43cff9700 1 -- 172.21.15.73:0/3838819422 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe434017650 con 0x7fe440100290 2023-08-10T12:00:29.908 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.904+0000 7fe445f87700 1 -- 172.21.15.73:0/3838819422 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4401a36a0 con 0x7fe440100290 2023-08-10T12:00:29.910 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.906+0000 7fe43cff9700 1 -- 172.21.15.73:0/3838819422 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fe434021580 con 0x7fe440100290 2023-08-10T12:00:29.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.907+0000 7fe43cff9700 1 --2- 172.21.15.73:0/3838819422 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe4280a12c0 0x7fe4280a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:29.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.907+0000 7fe43f7fe700 1 --2- 172.21.15.73:0/3838819422 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe4280a12c0 0x7fe4280a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:29.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.907+0000 7fe43cff9700 1 -- 172.21.15.73:0/3838819422 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe4340cdfa0 con 0x7fe440100290 2023-08-10T12:00:29.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.907+0000 7fe43f7fe700 1 --2- 172.21.15.73:0/3838819422 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe4280a12c0 0x7fe4280a3780 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe4400766a0 tx=0x7fe430009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:29.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.908+0000 7fe452120b80 1 Processor -- start 2023-08-10T12:00:29.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.908+0000 7fe452120b80 1 -- start start 2023-08-10T12:00:29.911 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.908+0000 7fe452120b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b90c7da40 0x556b90c7de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.908+0000 7fe452120b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b90c7e360 0x556b90c78010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.908+0000 7fe452120b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556b90c78550 0x556b90c789d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.908+0000 7fe452120b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b90bf3d60 con 0x556b90c78550 2023-08-10T12:00:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.908+0000 7fe452120b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b90bd0530 con 0x556b90c7e360 2023-08-10T12:00:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.908+0000 7fe452120b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b90bcde50 con 0x556b90c7da40 2023-08-10T12:00:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.908+0000 7fe43ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556b90c78550 0x556b90c789d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.908+0000 7fe43effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b90c7e360 0x556b90c78010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:29.913 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.908+0000 7fe43f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b90c7da40 0x556b90c7de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:29.913 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.908+0000 7fe43effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b90c7e360 0x556b90c78010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:50518/0 (socket says 172.21.15.73:50518) 2023-08-10T12:00:29.913 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.908+0000 7fe43ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556b90c78550 0x556b90c789d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35870/0 (socket says 172.21.15.73:35870) 2023-08-10T12:00:29.913 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.908+0000 7fe43effd700 1 -- 172.21.15.73:0/4037025103 learned_addr learned my addr 172.21.15.73:0/4037025103 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:29.913 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.908+0000 7fe43f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b90c7da40 0x556b90c7de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:33138/0 (socket says 172.21.15.73:33138) 2023-08-10T12:00:29.913 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.908+0000 7fe43ffff700 1 -- 172.21.15.73:0/4037025103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b90c7da40 msgr2=0x556b90c7de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:29.913 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.908+0000 7fe43ffff700 1 --2- 172.21.15.73:0/4037025103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b90c7da40 0x556b90c7de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:29.914 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.908+0000 7fe43ffff700 1 -- 172.21.15.73:0/4037025103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b90c7e360 msgr2=0x556b90c78010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:29.914 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.908+0000 7fe43ffff700 1 --2- 172.21.15.73:0/4037025103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b90c7e360 0x556b90c78010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:29.914 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.908+0000 7fe43ffff700 1 -- 172.21.15.73:0/4037025103 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b90a4a5d0 con 0x556b90c78550 2023-08-10T12:00:29.914 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.909+0000 7fe43effd700 1 --2- 172.21.15.73:0/4037025103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b90c7e360 0x556b90c78010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:00:29.914 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.909+0000 7fe43ffff700 1 --2- 172.21.15.73:0/4037025103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556b90c78550 0x556b90c789d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fe438011550 tx=0x7fe438009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e16b12aaf51eac server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:29.914 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.909+0000 7fe425ffb700 1 -- 172.21.15.73:0/4037025103 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43800e040 con 0x556b90c78550 2023-08-10T12:00:29.914 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.909+0000 7fe425ffb700 1 -- 172.21.15.73:0/4037025103 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe43800f040 con 0x556b90c78550 2023-08-10T12:00:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.909+0000 7fe425ffb700 1 -- 172.21.15.73:0/4037025103 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4380043b0 con 0x556b90c78550 2023-08-10T12:00:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.910+0000 7fe452120b80 1 -- 172.21.15.73:0/4037025103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556b90c78550 msgr2=0x556b90c789d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.910+0000 7fe452120b80 1 --2- 172.21.15.73:0/4037025103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556b90c78550 0x556b90c789d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fe438011550 tx=0x7fe438009920 comp rx=0 tx=0).stop 2023-08-10T12:00:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.910+0000 7fe452120b80 1 -- 172.21.15.73:0/4037025103 shutdown_connections 2023-08-10T12:00:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.910+0000 7fe452120b80 1 --2- 172.21.15.73:0/4037025103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556b90c78550 0x556b90c789d0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.910+0000 7fe452120b80 1 --2- 172.21.15.73:0/4037025103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b90c7da40 0x556b90c7de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.910+0000 7fe452120b80 1 --2- 172.21.15.73:0/4037025103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b90c7e360 0x556b90c78010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.910+0000 7fe452120b80 1 -- 172.21.15.73:0/4037025103 >> 172.21.15.73:0/4037025103 conn(0x556b90bd5c70 msgr2=0x556b90c72d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:29.917 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.912+0000 7fe452120b80 1 -- 172.21.15.73:0/4037025103 shutdown_connections 2023-08-10T12:00:29.918 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.912+0000 7fe452120b80 1 -- 172.21.15.73:0/4037025103 wait complete. 2023-08-10T12:00:29.918 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.912+0000 7fe452120b80 1 -- start start 2023-08-10T12:00:29.918 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.913+0000 7fe452120b80 1 Processor -- start 2023-08-10T12:00:29.918 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.913+0000 7fe452120b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b90c78550 0x556b90c843b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:29.918 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.913+0000 7fe452120b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556b90c7da40 0x556b90c815c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:29.918 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.913+0000 7fe452120b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b90c7e360 0x556b90c81bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:29.919 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.913+0000 7fe452120b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b90bc9740 con 0x556b90c7da40 2023-08-10T12:00:29.919 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.913+0000 7fe452120b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b90b68a60 con 0x556b90c7e360 2023-08-10T12:00:29.919 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.913+0000 7fe452120b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b90b68760 con 0x556b90c78550 2023-08-10T12:00:29.919 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.913+0000 7fe452120b80 10 client.0 _ll_register_callbacks cb 0x556b90b66620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:00:29.919 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.913+0000 7fe43effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556b90c7da40 0x556b90c815c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:29.919 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.914+0000 7fe43effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556b90c7da40 0x556b90c815c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35872/0 (socket says 172.21.15.73:35872) 2023-08-10T12:00:29.919 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.914+0000 7fe43effd700 1 -- 172.21.15.73:0/2995602761 learned_addr learned my addr 172.21.15.73:0/2995602761 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:29.919 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.914+0000 7fe43ffff700 1 --2- 172.21.15.73:0/2995602761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b90c7e360 0x556b90c81bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:29.920 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.914+0000 7fe43effd700 1 -- 172.21.15.73:0/2995602761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b90c78550 msgr2=0x556b90c843b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T12:00:29.920 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.914+0000 7fe43effd700 1 --2- 172.21.15.73:0/2995602761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b90c78550 0x556b90c843b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:29.920 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.914+0000 7fe43effd700 1 -- 172.21.15.73:0/2995602761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b90c7e360 msgr2=0x556b90c81bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:29.920 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.914+0000 7fe43effd700 1 --2- 172.21.15.73:0/2995602761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b90c7e360 0x556b90c81bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:29.920 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.914+0000 7fe43effd700 1 -- 172.21.15.73:0/2995602761 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4401a36a0 con 0x556b90c7da40 2023-08-10T12:00:29.920 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.914+0000 7fe43effd700 1 --2- 172.21.15.73:0/2995602761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556b90c7da40 0x556b90c815c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe434005910 tx=0x7fe43409ab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=863ba6f553aff70d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:29.920 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.914+0000 7fe41effd700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:00:29.921 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.914+0000 7fe41effd700 1 -- 172.21.15.73:0/2995602761 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4340a34c0 con 0x556b90c7da40 2023-08-10T12:00:29.921 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.914+0000 7fe41effd700 1 -- 172.21.15.73:0/2995602761 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe4340cbe40 con 0x556b90c7da40 2023-08-10T12:00:29.921 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.914+0000 7fe452120b80 1 -- 172.21.15.73:0/2995602761 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556b90c6b1c0 con 0x556b90c7da40 2023-08-10T12:00:29.921 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.914+0000 7fe41effd700 1 -- 172.21.15.73:0/2995602761 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4340b9300 con 0x556b90c7da40 2023-08-10T12:00:29.921 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.914+0000 7fe452120b80 10 client.16677 fetch_fsmap learned FSMap version 50 2023-08-10T12:00:29.921 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.914+0000 7fe452120b80 1 -- 172.21.15.73:0/2995602761 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x7fe438011230 con 0x556b90c7da40 2023-08-10T12:00:29.921 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.915+0000 7fe41effd700 1 -- 172.21.15.73:0/2995602761 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe4340c9080 con 0x556b90c7da40 2023-08-10T12:00:29.922 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.915+0000 7fe41effd700 1 -- 172.21.15.73:0/2995602761 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 50) v1 ==== 6977+0+0 (secure 0 0 0) 0x7fe4340b9020 con 0x556b90c7da40 2023-08-10T12:00:29.922 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.915+0000 7fe452120b80 10 client.16677 fetch_fsmap finished waiting for FSMap version 50 2023-08-10T12:00:29.922 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.915+0000 7fe452120b80 10 client.16677 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:00:29.922 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.915+0000 7fe452120b80 20 client.16677 populate_metadata read hostname 'smithi073' 2023-08-10T12:00:29.922 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.915+0000 7fe452120b80 1 --2- 172.21.15.73:0/2995602761 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x556b90ca2aa0 0x556b90ca4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:29.922 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.915+0000 7fe452120b80 4 client.16677 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:00:29.922 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.915+0000 7fe452120b80 1 -- 172.21.15.73:0/2995602761 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556b90c47970 con 0x556b90ca2aa0 2023-08-10T12:00:29.922 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.915+0000 7fe43f7fe700 1 --2- 172.21.15.73:0/2995602761 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x556b90ca2aa0 0x556b90ca4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:29.923 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.918+0000 7fe41effd700 10 client.16677 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:29.923 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.918+0000 7fe43f7fe700 1 --2- 172.21.15.73:0/2995602761 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x556b90ca2aa0 0x556b90ca4ec0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7ed162f3ce62635 server_cookie=484e41977230cd0f in_seq=0 out_seq=0 2023-08-10T12:00:29.940 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.939+0000 7fe41effd700 1 -- 172.21.15.73:0/2995602761 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x556b90c47970 con 0x556b90ca2aa0 2023-08-10T12:00:29.940 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.939+0000 7fe41effd700 10 client.16677 handle_command_reply: tid=0 2023-08-10T12:00:29.940 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.939+0000 7fe452120b80 1 client.16677 shutdown 2023-08-10T12:00:29.941 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.940+0000 7fe452120b80 1 -- 172.21.15.73:0/2995602761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556b90c7da40 msgr2=0x556b90c815c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:29.941 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.940+0000 7fe452120b80 1 --2- 172.21.15.73:0/2995602761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556b90c7da40 0x556b90c815c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe434005910 tx=0x7fe43409ab50 comp rx=0 tx=0).stop 2023-08-10T12:00:29.941 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.940+0000 7fe452120b80 1 -- 172.21.15.73:0/2995602761 shutdown_connections 2023-08-10T12:00:29.942 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.940+0000 7fe452120b80 1 --2- 172.21.15.73:0/2995602761 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x556b90ca2aa0 0x556b90ca4ec0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:29.942 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.940+0000 7fe452120b80 1 --2- 172.21.15.73:0/2995602761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b90c7e360 0x556b90c81bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:29.942 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.940+0000 7fe41effd700 0 client.16677 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:29.942 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.940+0000 7fe452120b80 1 --2- 172.21.15.73:0/2995602761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b90c78550 0x556b90c843b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:29.942 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.940+0000 7fe452120b80 1 --2- 172.21.15.73:0/2995602761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556b90c7da40 0x556b90c815c0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:29.942 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.940+0000 7fe452120b80 1 -- 172.21.15.73:0/2995602761 >> 172.21.15.73:0/2995602761 conn(0x556b90bd5c70 msgr2=0x556b90c724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:29.943 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.940+0000 7fe452120b80 1 -- 172.21.15.73:0/2995602761 shutdown_connections 2023-08-10T12:00:29.943 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.940+0000 7fe452120b80 1 -- 172.21.15.73:0/2995602761 wait complete. 2023-08-10T12:00:29.943 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.940+0000 7fe452120b80 20 client.16677 trim_cache size 0 max 16384 2023-08-10T12:00:29.960 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.959+0000 7fe452120b80 1 Processor -- start 2023-08-10T12:00:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.959+0000 7fe452120b80 1 -- start start 2023-08-10T12:00:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.959+0000 7fe452120b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556b90c78550 0x556b90ca9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.959+0000 7fe452120b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b90c7da40 0x556b90c72c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.959+0000 7fe452120b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b90c7e360 0x556b90c7cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.959+0000 7fe452120b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b90a4c8c0 con 0x556b90c78550 2023-08-10T12:00:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.959+0000 7fe452120b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b90c73a30 con 0x556b90c7e360 2023-08-10T12:00:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.959+0000 7fe452120b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b90c7c420 con 0x556b90c7da40 2023-08-10T12:00:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.960+0000 7fe43ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b90c7e360 0x556b90c7cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.960+0000 7fe43f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556b90c78550 0x556b90ca9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.960+0000 7fe43ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b90c7e360 0x556b90c7cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:50532/0 (socket says 172.21.15.73:50532) 2023-08-10T12:00:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.960+0000 7fe43ffff700 1 -- 172.21.15.73:0/176260253 learned_addr learned my addr 172.21.15.73:0/176260253 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.960+0000 7fe43f7fe700 1 -- 172.21.15.73:0/176260253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b90c7da40 msgr2=0x556b90c72c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.960+0000 7fe43f7fe700 1 --2- 172.21.15.73:0/176260253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b90c7da40 0x556b90c72c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:29.963 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.960+0000 7fe43f7fe700 1 -- 172.21.15.73:0/176260253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b90c7e360 msgr2=0x556b90c7cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:29.963 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.960+0000 7fe43f7fe700 1 --2- 172.21.15.73:0/176260253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b90c7e360 0x556b90c7cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:29.963 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.960+0000 7fe43f7fe700 1 -- 172.21.15.73:0/176260253 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b909f6d80 con 0x556b90c78550 2023-08-10T12:00:29.964 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.960+0000 7fe43f7fe700 1 --2- 172.21.15.73:0/176260253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556b90c78550 0x556b90ca9820 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe4300117d0 tx=0x7fe430014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a47b0daa83c4eb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:29.964 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.961+0000 7fe4267fc700 1 -- 172.21.15.73:0/176260253 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4300254d0 con 0x556b90c78550 2023-08-10T12:00:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.961+0000 7fe4267fc700 1 -- 172.21.15.73:0/176260253 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe430023040 con 0x556b90c78550 2023-08-10T12:00:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.961+0000 7fe4267fc700 1 -- 172.21.15.73:0/176260253 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43001c660 con 0x556b90c78550 2023-08-10T12:00:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.962+0000 7fe452120b80 1 -- 172.21.15.73:0/176260253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556b90c78550 msgr2=0x556b90ca9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.962+0000 7fe452120b80 1 --2- 172.21.15.73:0/176260253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556b90c78550 0x556b90ca9820 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe4300117d0 tx=0x7fe430014000 comp rx=0 tx=0).stop 2023-08-10T12:00:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.962+0000 7fe452120b80 1 -- 172.21.15.73:0/176260253 shutdown_connections 2023-08-10T12:00:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.962+0000 7fe452120b80 1 --2- 172.21.15.73:0/176260253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b90c7e360 0x556b90c7cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.962+0000 7fe452120b80 1 --2- 172.21.15.73:0/176260253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556b90c78550 0x556b90ca9820 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.962+0000 7fe452120b80 1 --2- 172.21.15.73:0/176260253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b90c7da40 0x556b90c72c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.962+0000 7fe452120b80 1 -- 172.21.15.73:0/176260253 >> 172.21.15.73:0/176260253 conn(0x556b90bd5c70 msgr2=0x556b90c7c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.962+0000 7fe452120b80 1 -- 172.21.15.73:0/176260253 shutdown_connections 2023-08-10T12:00:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.962+0000 7fe452120b80 1 -- 172.21.15.73:0/176260253 wait complete. 2023-08-10T12:00:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.962+0000 7fe452120b80 1 -- start start 2023-08-10T12:00:29.967 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.962+0000 7fe452120b80 1 Processor -- start 2023-08-10T12:00:29.967 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.963+0000 7fe452120b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b90c78550 0x556b90c886b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:29.967 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.963+0000 7fe452120b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556b90c7da40 0x556b90c88bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:29.967 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.963+0000 7fe452120b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b90c7e360 0x556b90c86e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:29.967 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.963+0000 7fe452120b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b90c874e0 con 0x556b90c7da40 2023-08-10T12:00:29.967 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.963+0000 7fe452120b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b90c87650 con 0x556b90c78550 2023-08-10T12:00:29.967 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.963+0000 7fe452120b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b90c87810 con 0x556b90c7e360 2023-08-10T12:00:29.968 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.963+0000 7fe452120b80 10 client.0 _ll_register_callbacks cb 0x556b90b66620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:00:29.968 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.964+0000 7fe43effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556b90c7da40 0x556b90c88bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:29.968 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.964+0000 7fe43effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556b90c7da40 0x556b90c88bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35890/0 (socket says 172.21.15.73:35890) 2023-08-10T12:00:29.968 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.964+0000 7fe43effd700 1 -- 172.21.15.73:0/3655424883 learned_addr learned my addr 172.21.15.73:0/3655424883 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:29.968 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.964+0000 7fe43f7fe700 1 --2- 172.21.15.73:0/3655424883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b90c78550 0x556b90c886b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.964+0000 7fe43effd700 1 -- 172.21.15.73:0/3655424883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b90c7e360 msgr2=0x556b90c86e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.964+0000 7fe43effd700 1 --2- 172.21.15.73:0/3655424883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b90c7e360 0x556b90c86e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.964+0000 7fe43effd700 1 -- 172.21.15.73:0/3655424883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b90c78550 msgr2=0x556b90c886b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.964+0000 7fe43effd700 1 --2- 172.21.15.73:0/3655424883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b90c78550 0x556b90c886b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.964+0000 7fe43effd700 1 -- 172.21.15.73:0/3655424883 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe430017070 con 0x556b90c7da40 2023-08-10T12:00:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.964+0000 7fe43effd700 1 --2- 172.21.15.73:0/3655424883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556b90c7da40 0x556b90c88bf0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fe434097b70 tx=0x7fe434021c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60014be2ea3681b1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.964+0000 7fe41effd700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:00:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.965+0000 7fe41effd700 1 -- 172.21.15.73:0/3655424883 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43409a7f0 con 0x556b90c7da40 2023-08-10T12:00:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.965+0000 7fe452120b80 1 -- 172.21.15.73:0/3655424883 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe43800f040 con 0x556b90c7da40 2023-08-10T12:00:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.965+0000 7fe41effd700 1 -- 172.21.15.73:0/3655424883 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe4340cbe40 con 0x556b90c7da40 2023-08-10T12:00:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.965+0000 7fe41effd700 1 -- 172.21.15.73:0/3655424883 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4340a34c0 con 0x556b90c7da40 2023-08-10T12:00:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.965+0000 7fe452120b80 10 client.16683 fetch_fsmap learned FSMap version 50 2023-08-10T12:00:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.965+0000 7fe452120b80 1 -- 172.21.15.73:0/3655424883 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x556b909dfc00 con 0x556b90c7da40 2023-08-10T12:00:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.965+0000 7fe41effd700 1 -- 172.21.15.73:0/3655424883 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe43800f040 con 0x556b90c7da40 2023-08-10T12:00:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.965+0000 7fe41effd700 1 -- 172.21.15.73:0/3655424883 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 50) v1 ==== 6977+0+0 (secure 0 0 0) 0x7fe4340cb180 con 0x556b90c7da40 2023-08-10T12:00:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.965+0000 7fe452120b80 10 client.16683 fetch_fsmap finished waiting for FSMap version 50 2023-08-10T12:00:29.972 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.965+0000 7fe452120b80 10 client.16683 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:00:29.972 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.965+0000 7fe452120b80 20 client.16683 populate_metadata read hostname 'smithi073' 2023-08-10T12:00:29.972 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.965+0000 7fe452120b80 1 --2- 172.21.15.73:0/3655424883 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x556b90ca2aa0 0x556b90cf95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:29.972 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.966+0000 7fe452120b80 4 client.16683 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T12:00:29.972 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.966+0000 7fe452120b80 1 -- 172.21.15.73:0/3655424883 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556b90bc2720 con 0x556b90ca2aa0 2023-08-10T12:00:29.972 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.966+0000 7fe43f7fe700 1 --2- 172.21.15.73:0/3655424883 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x556b90ca2aa0 0x556b90cf95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:29.972 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.966+0000 7fe41effd700 10 client.16683 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:29.973 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:29.966+0000 7fe43f7fe700 1 --2- 172.21.15.73:0/3655424883 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x556b90ca2aa0 0x556b90cf95e0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d8280548f6559f7 server_cookie=9c5afd5fc1fa189 in_seq=0 out_seq=0 2023-08-10T12:00:31.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:30 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:00:31.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:30 smithi152 ceph-mon[130220]: pgmap v243: 97 pgs: 97 active+clean; 1.9 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 290 op/s 2023-08-10T12:00:31.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:30 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:00:31.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:30 smithi156 ceph-mon[130574]: pgmap v243: 97 pgs: 97 active+clean; 1.9 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 290 op/s 2023-08-10T12:00:31.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:30 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:00:31.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:30 smithi073 ceph-mon[128869]: pgmap v243: 97 pgs: 97 active+clean; 1.9 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 290 op/s 2023-08-10T12:00:31.668 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:31.667+0000 7fe41effd700 1 -- 172.21.15.73:0/3655424883 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556b90bc2720 con 0x556b90ca2aa0 2023-08-10T12:00:31.668 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:31.667+0000 7fe41effd700 10 client.16683 handle_command_reply: tid=0 2023-08-10T12:00:31.668 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:31.667+0000 7fe452120b80 1 client.16683 shutdown 2023-08-10T12:00:31.668 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:31.667+0000 7fe452120b80 1 -- 172.21.15.73:0/3655424883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556b90c7da40 msgr2=0x556b90c88bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:31.668 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:31.667+0000 7fe452120b80 1 --2- 172.21.15.73:0/3655424883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556b90c7da40 0x556b90c88bf0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fe434097b70 tx=0x7fe434021c00 comp rx=0 tx=0).stop 2023-08-10T12:00:31.669 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:31.667+0000 7fe452120b80 1 -- 172.21.15.73:0/3655424883 shutdown_connections 2023-08-10T12:00:31.669 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:31.667+0000 7fe452120b80 1 --2- 172.21.15.73:0/3655424883 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x556b90ca2aa0 0x556b90cf95e0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:31.669 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:31.667+0000 7fe452120b80 1 --2- 172.21.15.73:0/3655424883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b90c78550 0x556b90c886b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:31.669 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:31.667+0000 7fe452120b80 1 --2- 172.21.15.73:0/3655424883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b90c7e360 0x556b90c86e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:31.669 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:31.667+0000 7fe452120b80 1 --2- 172.21.15.73:0/3655424883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556b90c7da40 0x556b90c88bf0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:31.669 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:31.667+0000 7fe452120b80 1 -- 172.21.15.73:0/3655424883 >> 172.21.15.73:0/3655424883 conn(0x556b90bd5c70 msgr2=0x556b90c7d040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:31.667+0000 7fe41effd700 0 client.16683 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:31.667+0000 7fe452120b80 1 -- 172.21.15.73:0/3655424883 shutdown_connections 2023-08-10T12:00:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:31.667+0000 7fe452120b80 1 -- 172.21.15.73:0/3655424883 wait complete. 2023-08-10T12:00:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:31.667+0000 7fe452120b80 20 client.16683 trim_cache size 0 max 16384 2023-08-10T12:00:31.671 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T12:00:31.671 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T12:00:31.671 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T12:00:31.671 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T12:00:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:31.668+0000 7fe445f87700 1 -- 172.21.15.73:0/3838819422 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe4280a12c0 msgr2=0x7fe4280a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:31.668+0000 7fe445f87700 1 --2- 172.21.15.73:0/3838819422 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe4280a12c0 0x7fe4280a3780 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe4400766a0 tx=0x7fe430009260 comp rx=0 tx=0).stop 2023-08-10T12:00:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:31.668+0000 7fe445f87700 1 -- 172.21.15.73:0/3838819422 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe440100290 msgr2=0x7fe44019cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:31.668+0000 7fe445f87700 1 --2- 172.21.15.73:0/3838819422 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe440100290 0x7fe44019cbf0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe434000c00 tx=0x7fe434004790 comp rx=0 tx=0).stop 2023-08-10T12:00:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:31.668+0000 7fe445f87700 1 -- 172.21.15.73:0/3838819422 shutdown_connections 2023-08-10T12:00:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:31.668+0000 7fe445f87700 1 --2- 172.21.15.73:0/3838819422 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe4280a12c0 0x7fe4280a3780 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:31.668+0000 7fe445f87700 1 --2- 172.21.15.73:0/3838819422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe440105670 0x7fe440196510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:31.668+0000 7fe445f87700 1 --2- 172.21.15.73:0/3838819422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4400ff8d0 0x7fe44019c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:31.668+0000 7fe445f87700 1 --2- 172.21.15.73:0/3838819422 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe440100290 0x7fe44019cbf0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:31.668+0000 7fe445f87700 1 -- 172.21.15.73:0/3838819422 >> 172.21.15.73:0/3838819422 conn(0x7fe4400750a0 msgr2=0x7fe4400fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:31.668+0000 7fe445f87700 1 -- 172.21.15.73:0/3838819422 shutdown_connections 2023-08-10T12:00:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:31.668+0000 7fe445f87700 1 -- 172.21.15.73:0/3838819422 wait complete. 2023-08-10T12:00:33.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:33 smithi152 ceph-mon[130220]: pgmap v244: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 311 op/s 2023-08-10T12:00:33.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:33 smithi156 ceph-mon[130574]: pgmap v244: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 311 op/s 2023-08-10T12:00:33.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:33 smithi073 ceph-mon[128869]: pgmap v244: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 311 op/s 2023-08-10T12:00:35.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:34 smithi152 ceph-mon[130220]: pgmap v245: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 323 op/s 2023-08-10T12:00:35.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:34 smithi156 ceph-mon[130574]: pgmap v245: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 323 op/s 2023-08-10T12:00:35.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:34 smithi073 ceph-mon[128869]: pgmap v245: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 323 op/s 2023-08-10T12:00:37.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:37 smithi152 ceph-mon[130220]: pgmap v246: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 337 op/s 2023-08-10T12:00:37.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:37 smithi156 ceph-mon[130574]: pgmap v246: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 337 op/s 2023-08-10T12:00:37.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:37 smithi073 ceph-mon[128869]: pgmap v246: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 337 op/s 2023-08-10T12:00:38.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:38 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:00:38.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:38 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:00:38.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:38 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:00:39.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:39 smithi152 ceph-mon[130220]: pgmap v247: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.8 MiB/s wr, 293 op/s 2023-08-10T12:00:39.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:39 smithi156 ceph-mon[130574]: pgmap v247: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.8 MiB/s wr, 293 op/s 2023-08-10T12:00:39.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:39 smithi073 ceph-mon[128869]: pgmap v247: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.8 MiB/s wr, 293 op/s 2023-08-10T12:00:41.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:41 smithi152 ceph-mon[130220]: pgmap v248: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 384 op/s 2023-08-10T12:00:41.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:41 smithi156 ceph-mon[130574]: pgmap v248: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 384 op/s 2023-08-10T12:00:41.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:41 smithi073 ceph-mon[128869]: pgmap v248: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 384 op/s 2023-08-10T12:00:43.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:43 smithi152 ceph-mon[130220]: pgmap v249: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 311 op/s 2023-08-10T12:00:43.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:43 smithi156 ceph-mon[130574]: pgmap v249: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 311 op/s 2023-08-10T12:00:43.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:43 smithi073 ceph-mon[128869]: pgmap v249: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 311 op/s 2023-08-10T12:00:44.782 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.780+0000 7fc034da9700 1 -- 172.21.15.73:0/1007666427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc030105670 msgr2=0x7fc030105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:44.782 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.780+0000 7fc034da9700 1 --2- 172.21.15.73:0/1007666427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc030105670 0x7fc030105a50 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc02800b0a0 tx=0x7fc02800b3b0 comp rx=0 tx=0).stop 2023-08-10T12:00:44.782 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.780+0000 7fc034da9700 1 -- 172.21.15.73:0/1007666427 shutdown_connections 2023-08-10T12:00:44.782 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.780+0000 7fc034da9700 1 --2- 172.21.15.73:0/1007666427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc030100290 0x7fc03010c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:44.783 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.780+0000 7fc034da9700 1 --2- 172.21.15.73:0/1007666427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc030105670 0x7fc030105a50 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:44.783 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.780+0000 7fc034da9700 1 --2- 172.21.15.73:0/1007666427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc0300ff8d0 0x7fc0300ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:44.783 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.780+0000 7fc034da9700 1 -- 172.21.15.73:0/1007666427 >> 172.21.15.73:0/1007666427 conn(0x7fc0300750a0 msgr2=0x7fc0300754b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:44.783 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.780+0000 7fc034da9700 1 -- 172.21.15.73:0/1007666427 shutdown_connections 2023-08-10T12:00:44.783 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.780+0000 7fc034da9700 1 -- 172.21.15.73:0/1007666427 wait complete. 2023-08-10T12:00:44.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.781+0000 7fc034da9700 1 Processor -- start 2023-08-10T12:00:44.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.781+0000 7fc034da9700 1 -- start start 2023-08-10T12:00:44.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.781+0000 7fc034da9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0300ff8d0 0x7fc03019b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:44.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.781+0000 7fc034da9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc030100290 0x7fc03019bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:44.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.781+0000 7fc034da9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc030105670 0x7fc030195480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:44.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.781+0000 7fc034da9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc030195af0 con 0x7fc0300ff8d0 2023-08-10T12:00:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.781+0000 7fc034da9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc030195c60 con 0x7fc030105670 2023-08-10T12:00:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.781+0000 7fc034da9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc030195e20 con 0x7fc030100290 2023-08-10T12:00:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.781+0000 7fc02e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0300ff8d0 0x7fc03019b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.781+0000 7fc02e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0300ff8d0 0x7fc03019b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35904/0 (socket says 172.21.15.73:35904) 2023-08-10T12:00:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.781+0000 7fc02e59c700 1 -- 172.21.15.73:0/3564776516 learned_addr learned my addr 172.21.15.73:0/3564776516 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.781+0000 7fc02dd9b700 1 --2- 172.21.15.73:0/3564776516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc030100290 0x7fc03019bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.781+0000 7fc02ed9d700 1 --2- 172.21.15.73:0/3564776516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc030105670 0x7fc030195480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:44.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.782+0000 7fc02e59c700 1 -- 172.21.15.73:0/3564776516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc030100290 msgr2=0x7fc03019bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:44.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.782+0000 7fc02e59c700 1 --2- 172.21.15.73:0/3564776516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc030100290 0x7fc03019bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:44.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.782+0000 7fc02e59c700 1 -- 172.21.15.73:0/3564776516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc030105670 msgr2=0x7fc030195480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:44.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.782+0000 7fc02e59c700 1 --2- 172.21.15.73:0/3564776516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc030105670 0x7fc030195480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:44.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.782+0000 7fc02e59c700 1 -- 172.21.15.73:0/3564776516 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc028009d00 con 0x7fc0300ff8d0 2023-08-10T12:00:44.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.782+0000 7fc02e59c700 1 --2- 172.21.15.73:0/3564776516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0300ff8d0 0x7fc03019b620 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc02800b780 tx=0x7fc028007640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:44.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.782+0000 7fc01f7fe700 1 -- 172.21.15.73:0/3564776516 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02800e040 con 0x7fc0300ff8d0 2023-08-10T12:00:44.788 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.782+0000 7fc034da9700 1 -- 172.21.15.73:0/3564776516 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0301960a0 con 0x7fc0300ff8d0 2023-08-10T12:00:44.788 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.782+0000 7fc01f7fe700 1 -- 172.21.15.73:0/3564776516 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc028004c50 con 0x7fc0300ff8d0 2023-08-10T12:00:44.788 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.782+0000 7fc01f7fe700 1 -- 172.21.15.73:0/3564776516 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc028005280 con 0x7fc0300ff8d0 2023-08-10T12:00:44.788 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.782+0000 7fc034da9700 1 -- 172.21.15.73:0/3564776516 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0301a2610 con 0x7fc0300ff8d0 2023-08-10T12:00:44.792 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.785+0000 7fc01f7fe700 1 -- 172.21.15.73:0/3564776516 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fc0280053e0 con 0x7fc0300ff8d0 2023-08-10T12:00:44.792 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.785+0000 7fc01f7fe700 1 --2- 172.21.15.73:0/3564776516 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fc0180a12c0 0x7fc0180a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:44.792 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.785+0000 7fc01f7fe700 1 -- 172.21.15.73:0/3564776516 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc0280ce330 con 0x7fc0300ff8d0 2023-08-10T12:00:44.792 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.785+0000 7fc02dd9b700 1 --2- 172.21.15.73:0/3564776516 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fc0180a12c0 0x7fc0180a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:44.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.786+0000 7fc02dd9b700 1 --2- 172.21.15.73:0/3564776516 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fc0180a12c0 0x7fc0180a3780 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc0300fe1c0 tx=0x7fc02000b410 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:44.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.786+0000 7fc040f42b80 1 Processor -- start 2023-08-10T12:00:44.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.786+0000 7fc040f42b80 1 -- start start 2023-08-10T12:00:44.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.786+0000 7fc040f42b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5585df6d6c60 0x5585df6d7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:44.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.786+0000 7fc040f42b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5585df6d7580 0x5585df6d1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:44.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.786+0000 7fc040f42b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5585df6d1760 0x5585df6d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:44.793 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.786+0000 7fc040f42b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585df64ad60 con 0x5585df6d7580 2023-08-10T12:00:44.794 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.786+0000 7fc040f42b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585df627530 con 0x5585df6d1760 2023-08-10T12:00:44.794 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.786+0000 7fc040f42b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585df624e50 con 0x5585df6d6c60 2023-08-10T12:00:44.794 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.786+0000 7fc02dd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5585df6d7580 0x5585df6d1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:44.794 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.786+0000 7fc02e59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5585df6d6c60 0x5585df6d7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:44.794 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.786+0000 7fc02dd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5585df6d7580 0x5585df6d1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35914/0 (socket says 172.21.15.73:35914) 2023-08-10T12:00:44.794 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.786+0000 7fc02dd9b700 1 -- 172.21.15.73:0/3104432195 learned_addr learned my addr 172.21.15.73:0/3104432195 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:44.794 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.786+0000 7fc02ed9d700 1 --2- 172.21.15.73:0/3104432195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5585df6d1760 0x5585df6d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:44.794 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.787+0000 7fc02e59c700 1 -- 172.21.15.73:0/3104432195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5585df6d1760 msgr2=0x5585df6d1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:44.795 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.787+0000 7fc02e59c700 1 --2- 172.21.15.73:0/3104432195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5585df6d1760 0x5585df6d1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:44.795 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.787+0000 7fc02e59c700 1 -- 172.21.15.73:0/3104432195 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5585df6d7580 msgr2=0x5585df6d1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:44.795 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.787+0000 7fc02e59c700 1 --2- 172.21.15.73:0/3104432195 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5585df6d7580 0x5585df6d1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:44.795 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.787+0000 7fc02e59c700 1 -- 172.21.15.73:0/3104432195 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585df4a15d0 con 0x5585df6d6c60 2023-08-10T12:00:44.795 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.787+0000 7fc02dd9b700 1 --2- 172.21.15.73:0/3104432195 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5585df6d7580 0x5585df6d1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:00:44.795 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.787+0000 7fc02e59c700 1 --2- 172.21.15.73:0/3104432195 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5585df6d6c60 0x5585df6d7040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc0280cba80 tx=0x7fc02801dcd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72dc6e10000bbeb0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:44.795 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.787+0000 7fc01cff9700 1 -- 172.21.15.73:0/3104432195 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0280a3850 con 0x5585df6d6c60 2023-08-10T12:00:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.787+0000 7fc01cff9700 1 -- 172.21.15.73:0/3104432195 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc0280995d0 con 0x5585df6d6c60 2023-08-10T12:00:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.787+0000 7fc01cff9700 1 -- 172.21.15.73:0/3104432195 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc028099930 con 0x5585df6d6c60 2023-08-10T12:00:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.788+0000 7fc040f42b80 1 -- 172.21.15.73:0/3104432195 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5585df6d6c60 msgr2=0x5585df6d7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.788+0000 7fc040f42b80 1 --2- 172.21.15.73:0/3104432195 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5585df6d6c60 0x5585df6d7040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc0280cba80 tx=0x7fc02801dcd0 comp rx=0 tx=0).stop 2023-08-10T12:00:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.788+0000 7fc040f42b80 1 -- 172.21.15.73:0/3104432195 shutdown_connections 2023-08-10T12:00:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.788+0000 7fc040f42b80 1 --2- 172.21.15.73:0/3104432195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5585df6d1760 0x5585df6d1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.788+0000 7fc040f42b80 1 --2- 172.21.15.73:0/3104432195 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5585df6d6c60 0x5585df6d7040 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.788+0000 7fc040f42b80 1 --2- 172.21.15.73:0/3104432195 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5585df6d7580 0x5585df6d1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.788+0000 7fc040f42b80 1 -- 172.21.15.73:0/3104432195 >> 172.21.15.73:0/3104432195 conn(0x5585df62cc70 msgr2=0x5585df6c9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.788+0000 7fc040f42b80 1 -- 172.21.15.73:0/3104432195 shutdown_connections 2023-08-10T12:00:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.788+0000 7fc040f42b80 1 -- 172.21.15.73:0/3104432195 wait complete. 2023-08-10T12:00:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.788+0000 7fc040f42b80 1 -- start start 2023-08-10T12:00:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.788+0000 7fc040f42b80 1 Processor -- start 2023-08-10T12:00:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.788+0000 7fc040f42b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5585df6d1760 0x5585df6dd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.788+0000 7fc040f42b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5585df6d6c60 0x5585df6da870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:44.798 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.788+0000 7fc040f42b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5585df6d7580 0x5585df6daf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:44.798 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.788+0000 7fc040f42b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585df620740 con 0x5585df6d6c60 2023-08-10T12:00:44.798 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.788+0000 7fc040f42b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585df5bfa60 con 0x5585df6d7580 2023-08-10T12:00:44.798 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.788+0000 7fc040f42b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585df5bf760 con 0x5585df6d1760 2023-08-10T12:00:44.798 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.789+0000 7fc040f42b80 10 client.0 _ll_register_callbacks cb 0x5585df5bd620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:00:44.798 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.789+0000 7fc02dd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5585df6d6c60 0x5585df6da870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:44.798 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.789+0000 7fc02e59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5585df6d1760 0x5585df6dd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:44.798 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.789+0000 7fc02e59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5585df6d1760 0x5585df6dd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:33190/0 (socket says 172.21.15.73:33190) 2023-08-10T12:00:44.799 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.789+0000 7fc02e59c700 1 -- 172.21.15.73:0/3439258176 learned_addr learned my addr 172.21.15.73:0/3439258176 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:44.799 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.789+0000 7fc02ed9d700 1 --2- 172.21.15.73:0/3439258176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5585df6d7580 0x5585df6daf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:44.799 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.789+0000 7fc02e59c700 1 -- 172.21.15.73:0/3439258176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5585df6d7580 msgr2=0x5585df6daf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:44.799 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.789+0000 7fc02e59c700 1 --2- 172.21.15.73:0/3439258176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5585df6d7580 0x5585df6daf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:44.799 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.789+0000 7fc02e59c700 1 -- 172.21.15.73:0/3439258176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5585df6d6c60 msgr2=0x5585df6da870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:44.799 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.789+0000 7fc02e59c700 1 --2- 172.21.15.73:0/3439258176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5585df6d6c60 0x5585df6da870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:44.799 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.789+0000 7fc02e59c700 1 -- 172.21.15.73:0/3439258176 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc020010c20 con 0x5585df6d1760 2023-08-10T12:00:44.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.789+0000 7fc02dd9b700 1 --2- 172.21.15.73:0/3439258176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5585df6d6c60 0x5585df6da870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:00:44.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.789+0000 7fc02e59c700 1 --2- 172.21.15.73:0/3439258176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5585df6d1760 0x5585df6dd580 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc02800b070 tx=0x7fc028007a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5871e2afd817069 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:44.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.789+0000 7fc015ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T12:00:44.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.789+0000 7fc015ffb700 1 -- 172.21.15.73:0/3439258176 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc028004dc0 con 0x5585df6d1760 2023-08-10T12:00:44.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.789+0000 7fc015ffb700 1 -- 172.21.15.73:0/3439258176 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc0280a3850 con 0x5585df6d1760 2023-08-10T12:00:44.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.789+0000 7fc040f42b80 1 -- 172.21.15.73:0/3439258176 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5585df6c21c0 con 0x5585df6d1760 2023-08-10T12:00:44.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.790+0000 7fc015ffb700 1 -- 172.21.15.73:0/3439258176 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc02809f170 con 0x5585df6d1760 2023-08-10T12:00:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.790+0000 7fc040f42b80 10 client.26173 fetch_fsmap learned FSMap version 51 2023-08-10T12:00:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.790+0000 7fc040f42b80 1 -- 172.21.15.73:0/3439258176 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x7fc0301a2610 con 0x5585df6d1760 2023-08-10T12:00:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.790+0000 7fc015ffb700 1 -- 172.21.15.73:0/3439258176 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc0280c9020 con 0x5585df6d1760 2023-08-10T12:00:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.790+0000 7fc015ffb700 1 -- 172.21.15.73:0/3439258176 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 51) v1 ==== 6981+0+0 (secure 0 0 0) 0x7fc02809b7d0 con 0x5585df6d1760 2023-08-10T12:00:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.790+0000 7fc040f42b80 10 client.26173 fetch_fsmap finished waiting for FSMap version 51 2023-08-10T12:00:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.790+0000 7fc040f42b80 10 client.26173 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:00:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.790+0000 7fc040f42b80 20 client.26173 populate_metadata read hostname 'smithi073' 2023-08-10T12:00:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.790+0000 7fc040f42b80 1 --2- 172.21.15.73:0/3439258176 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5585df6d0730 0x5585df6d0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.790+0000 7fc040f42b80 4 client.26173 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:00:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.790+0000 7fc040f42b80 1 -- 172.21.15.73:0/3439258176 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5585df69e970 con 0x5585df6d0730 2023-08-10T12:00:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.790+0000 7fc02dd9b700 1 --2- 172.21.15.73:0/3439258176 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5585df6d0730 0x5585df6d0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.791+0000 7fc015ffb700 10 client.26173 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.791+0000 7fc02dd9b700 1 --2- 172.21.15.73:0/3439258176 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5585df6d0730 0x5585df6d0b40 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f8e6838fe81baaf server_cookie=846df4828be9c89b in_seq=0 out_seq=0 2023-08-10T12:00:44.803 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.791+0000 7fc015ffb700 1 -- 172.21.15.73:0/3439258176 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5585df69e970 con 0x5585df6d0730 2023-08-10T12:00:44.803 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.791+0000 7fc015ffb700 10 client.26173 handle_command_reply: tid=0 2023-08-10T12:00:44.803 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.791+0000 7fc040f42b80 1 client.26173 shutdown 2023-08-10T12:00:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.792+0000 7fc040f42b80 1 -- 172.21.15.73:0/3439258176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5585df6d1760 msgr2=0x5585df6dd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.792+0000 7fc040f42b80 1 --2- 172.21.15.73:0/3439258176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5585df6d1760 0x5585df6dd580 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc02800b070 tx=0x7fc028007a80 comp rx=0 tx=0).stop 2023-08-10T12:00:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.792+0000 7fc040f42b80 1 -- 172.21.15.73:0/3439258176 shutdown_connections 2023-08-10T12:00:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.792+0000 7fc040f42b80 1 --2- 172.21.15.73:0/3439258176 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5585df6d0730 0x5585df6d0b40 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.792+0000 7fc040f42b80 1 --2- 172.21.15.73:0/3439258176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5585df6d7580 0x5585df6daf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.792+0000 7fc015ffb700 0 client.26173 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.792+0000 7fc040f42b80 1 --2- 172.21.15.73:0/3439258176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5585df6d1760 0x5585df6dd580 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.792+0000 7fc040f42b80 1 --2- 172.21.15.73:0/3439258176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5585df6d6c60 0x5585df6da870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.792+0000 7fc040f42b80 1 -- 172.21.15.73:0/3439258176 >> 172.21.15.73:0/3439258176 conn(0x5585df62cc70 msgr2=0x5585df6c94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.792+0000 7fc040f42b80 1 -- 172.21.15.73:0/3439258176 shutdown_connections 2023-08-10T12:00:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.792+0000 7fc040f42b80 1 -- 172.21.15.73:0/3439258176 wait complete. 2023-08-10T12:00:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.792+0000 7fc040f42b80 20 client.26173 trim_cache size 0 max 16384 2023-08-10T12:00:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.807+0000 7fc040f42b80 1 Processor -- start 2023-08-10T12:00:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.807+0000 7fc040f42b80 1 -- start start 2023-08-10T12:00:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.808+0000 7fc040f42b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5585df6d0730 0x5585df6e1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.808+0000 7fc040f42b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5585df6d1760 0x5585df6d6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.808+0000 7fc040f42b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5585df6d6c60 0x5585df6c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.808+0000 7fc040f42b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585df4a38c0 con 0x5585df6d1760 2023-08-10T12:00:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.808+0000 7fc040f42b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585df6c1d00 con 0x5585df6d0730 2023-08-10T12:00:44.810 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.808+0000 7fc040f42b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585df6ca970 con 0x5585df6d6c60 2023-08-10T12:00:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.808+0000 7fc02dd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5585df6d1760 0x5585df6d6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.808+0000 7fc02dd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5585df6d1760 0x5585df6d6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35928/0 (socket says 172.21.15.73:35928) 2023-08-10T12:00:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.808+0000 7fc02dd9b700 1 -- 172.21.15.73:0/308249201 learned_addr learned my addr 172.21.15.73:0/308249201 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.808+0000 7fc02ed9d700 1 --2- 172.21.15.73:0/308249201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5585df6d6c60 0x5585df6c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.808+0000 7fc02e59c700 1 --2- 172.21.15.73:0/308249201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5585df6d0730 0x5585df6e1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.808+0000 7fc02dd9b700 1 -- 172.21.15.73:0/308249201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5585df6d6c60 msgr2=0x5585df6c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.808+0000 7fc02dd9b700 1 --2- 172.21.15.73:0/308249201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5585df6d6c60 0x5585df6c9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.808+0000 7fc02dd9b700 1 -- 172.21.15.73:0/308249201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5585df6d0730 msgr2=0x5585df6e1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.808+0000 7fc02dd9b700 1 --2- 172.21.15.73:0/308249201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5585df6d0730 0x5585df6e1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.808+0000 7fc02dd9b700 1 -- 172.21.15.73:0/308249201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585df44dd80 con 0x5585df6d1760 2023-08-10T12:00:44.814 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.808+0000 7fc02dd9b700 1 --2- 172.21.15.73:0/308249201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5585df6d1760 0x5585df6d6080 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc020005d70 tx=0x7fc020013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e653bc6f6dc7a21 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:44.815 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.808+0000 7fc01d7fa700 1 -- 172.21.15.73:0/308249201 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02002d070 con 0x5585df6d1760 2023-08-10T12:00:44.815 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.808+0000 7fc01d7fa700 1 -- 172.21.15.73:0/308249201 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc020015070 con 0x5585df6d1760 2023-08-10T12:00:44.815 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.808+0000 7fc01d7fa700 1 -- 172.21.15.73:0/308249201 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc020024040 con 0x5585df6d1760 2023-08-10T12:00:44.815 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.809+0000 7fc040f42b80 1 -- 172.21.15.73:0/308249201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5585df6d1760 msgr2=0x5585df6d6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:44.815 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.809+0000 7fc040f42b80 1 --2- 172.21.15.73:0/308249201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5585df6d1760 0x5585df6d6080 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc020005d70 tx=0x7fc020013000 comp rx=0 tx=0).stop 2023-08-10T12:00:44.815 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.809+0000 7fc040f42b80 1 -- 172.21.15.73:0/308249201 shutdown_connections 2023-08-10T12:00:44.815 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.809+0000 7fc040f42b80 1 --2- 172.21.15.73:0/308249201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5585df6d0730 0x5585df6e1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.809+0000 7fc040f42b80 1 --2- 172.21.15.73:0/308249201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5585df6d6c60 0x5585df6c9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.809+0000 7fc040f42b80 1 --2- 172.21.15.73:0/308249201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5585df6d1760 0x5585df6d6080 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.809+0000 7fc040f42b80 1 -- 172.21.15.73:0/308249201 >> 172.21.15.73:0/308249201 conn(0x5585df62cc70 msgr2=0x5585df6d5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.809+0000 7fc040f42b80 1 -- 172.21.15.73:0/308249201 shutdown_connections 2023-08-10T12:00:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.809+0000 7fc040f42b80 1 -- 172.21.15.73:0/308249201 wait complete. 2023-08-10T12:00:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.809+0000 7fc040f42b80 1 -- start start 2023-08-10T12:00:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.810+0000 7fc040f42b80 1 Processor -- start 2023-08-10T12:00:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.810+0000 7fc040f42b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5585df6d0730 0x5585df7348c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.810+0000 7fc040f42b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5585df6d1760 0x5585df734e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.810+0000 7fc040f42b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5585df6d6c60 0x5585df739790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.810+0000 7fc040f42b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585df739cd0 con 0x5585df6d6c60 2023-08-10T12:00:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.810+0000 7fc040f42b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585df739e40 con 0x5585df6d0730 2023-08-10T12:00:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.810+0000 7fc040f42b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585df73a000 con 0x5585df6d1760 2023-08-10T12:00:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.810+0000 7fc040f42b80 10 client.0 _ll_register_callbacks cb 0x5585df5bd620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:00:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.810+0000 7fc02e59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5585df6d0730 0x5585df7348c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.810+0000 7fc02ed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5585df6d6c60 0x5585df739790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.810+0000 7fc02e59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5585df6d0730 0x5585df7348c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:50582/0 (socket says 172.21.15.73:50582) 2023-08-10T12:00:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.810+0000 7fc02dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5585df6d1760 0x5585df734e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.810+0000 7fc02e59c700 1 -- 172.21.15.73:0/80570711 learned_addr learned my addr 172.21.15.73:0/80570711 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.810+0000 7fc02ed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5585df6d6c60 0x5585df739790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35936/0 (socket says 172.21.15.73:35936) 2023-08-10T12:00:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.810+0000 7fc02ed9d700 1 -- 172.21.15.73:0/80570711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5585df6d1760 msgr2=0x5585df734e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.810+0000 7fc02ed9d700 1 --2- 172.21.15.73:0/80570711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5585df6d1760 0x5585df734e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.810+0000 7fc02ed9d700 1 -- 172.21.15.73:0/80570711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5585df6d0730 msgr2=0x5585df7348c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:44.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.810+0000 7fc02ed9d700 1 --2- 172.21.15.73:0/80570711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5585df6d0730 0x5585df7348c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:44.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.810+0000 7fc02ed9d700 1 -- 172.21.15.73:0/80570711 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc020011600 con 0x5585df6d6c60 2023-08-10T12:00:44.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.810+0000 7fc02e59c700 1 --2- 172.21.15.73:0/80570711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5585df6d0730 0x5585df7348c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:00:44.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.810+0000 7fc02ed9d700 1 --2- 172.21.15.73:0/80570711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5585df6d6c60 0x5585df739790 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc03019c320 tx=0x7fc024012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=251e2b392ad752d9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:44.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.810+0000 7fc015ffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:00:44.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.811+0000 7fc015ffb700 1 -- 172.21.15.73:0/80570711 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc024017040 con 0x5585df6d6c60 2023-08-10T12:00:44.819 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.811+0000 7fc015ffb700 1 -- 172.21.15.73:0/80570711 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc024004250 con 0x5585df6d6c60 2023-08-10T12:00:44.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.811+0000 7fc040f42b80 1 -- 172.21.15.73:0/80570711 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc0280995d0 con 0x5585df6d6c60 2023-08-10T12:00:44.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.811+0000 7fc015ffb700 1 -- 172.21.15.73:0/80570711 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc024004410 con 0x5585df6d6c60 2023-08-10T12:00:44.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.811+0000 7fc040f42b80 10 client.16701 fetch_fsmap learned FSMap version 51 2023-08-10T12:00:44.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.811+0000 7fc040f42b80 1 -- 172.21.15.73:0/80570711 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x5585df436c00 con 0x5585df6d6c60 2023-08-10T12:00:44.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.811+0000 7fc015ffb700 1 -- 172.21.15.73:0/80570711 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc0280995d0 con 0x5585df6d6c60 2023-08-10T12:00:44.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.811+0000 7fc015ffb700 1 -- 172.21.15.73:0/80570711 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 51) v1 ==== 6981+0+0 (secure 0 0 0) 0x7fc02400f840 con 0x5585df6d6c60 2023-08-10T12:00:44.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.811+0000 7fc040f42b80 10 client.16701 fetch_fsmap finished waiting for FSMap version 51 2023-08-10T12:00:44.820 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.811+0000 7fc040f42b80 10 client.16701 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:00:44.821 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.811+0000 7fc040f42b80 20 client.16701 populate_metadata read hostname 'smithi073' 2023-08-10T12:00:44.821 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.811+0000 7fc040f42b80 1 --2- 172.21.15.73:0/80570711 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5585df6d7580 0x5585df7439e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:44.821 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.811+0000 7fc040f42b80 4 client.16701 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T12:00:44.821 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.811+0000 7fc040f42b80 1 -- 172.21.15.73:0/80570711 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5585df619720 con 0x5585df6d7580 2023-08-10T12:00:44.821 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.811+0000 7fc02e59c700 1 --2- 172.21.15.73:0/80570711 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5585df6d7580 0x5585df7439e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:44.821 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.812+0000 7fc015ffb700 10 client.16701 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:44.821 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:44.812+0000 7fc02e59c700 1 --2- 172.21.15.73:0/80570711 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5585df6d7580 0x5585df7439e0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8aac5fe04b1a428 server_cookie=d158ccfc7493ddb7 in_seq=0 out_seq=0 2023-08-10T12:00:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:45.136+0000 7fc015ffb700 1 -- 172.21.15.73:0/80570711 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5585df619720 con 0x5585df6d7580 2023-08-10T12:00:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:45.136+0000 7fc015ffb700 10 client.16701 handle_command_reply: tid=0 2023-08-10T12:00:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:45.136+0000 7fc040f42b80 1 client.16701 shutdown 2023-08-10T12:00:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:45.136+0000 7fc040f42b80 1 -- 172.21.15.73:0/80570711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5585df6d6c60 msgr2=0x5585df739790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:45.136+0000 7fc040f42b80 1 --2- 172.21.15.73:0/80570711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5585df6d6c60 0x5585df739790 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc03019c320 tx=0x7fc024012bc0 comp rx=0 tx=0).stop 2023-08-10T12:00:45.144 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:45.136+0000 7fc040f42b80 1 -- 172.21.15.73:0/80570711 shutdown_connections 2023-08-10T12:00:45.144 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:45.136+0000 7fc040f42b80 1 --2- 172.21.15.73:0/80570711 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5585df6d7580 0x5585df7439e0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:45.144 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:45.136+0000 7fc040f42b80 1 --2- 172.21.15.73:0/80570711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5585df6d0730 0x5585df7348c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:45.144 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:45.136+0000 7fc040f42b80 1 --2- 172.21.15.73:0/80570711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5585df6d6c60 0x5585df739790 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:45.144 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:45.136+0000 7fc040f42b80 1 --2- 172.21.15.73:0/80570711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5585df6d1760 0x5585df734e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:45.144 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:45.136+0000 7fc015ffb700 0 client.16701 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:45.144 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:45.136+0000 7fc040f42b80 1 -- 172.21.15.73:0/80570711 >> 172.21.15.73:0/80570711 conn(0x5585df62cc70 msgr2=0x5585df6ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:45.145 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:45.136+0000 7fc040f42b80 1 -- 172.21.15.73:0/80570711 shutdown_connections 2023-08-10T12:00:45.145 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:45.136+0000 7fc040f42b80 1 -- 172.21.15.73:0/80570711 wait complete. 2023-08-10T12:00:45.145 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:45.136+0000 7fc040f42b80 20 client.16701 trim_cache size 0 max 16384 2023-08-10T12:00:45.145 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T12:00:45.145 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T12:00:45.145 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T12:00:45.146 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T12:00:45.146 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:45.137+0000 7fc034da9700 1 -- 172.21.15.73:0/3564776516 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fc0180a12c0 msgr2=0x7fc0180a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:45.146 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:45.137+0000 7fc034da9700 1 --2- 172.21.15.73:0/3564776516 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fc0180a12c0 0x7fc0180a3780 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc0300fe1c0 tx=0x7fc02000b410 comp rx=0 tx=0).stop 2023-08-10T12:00:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:45.137+0000 7fc034da9700 1 -- 172.21.15.73:0/3564776516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0300ff8d0 msgr2=0x7fc03019b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:45.137+0000 7fc034da9700 1 --2- 172.21.15.73:0/3564776516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0300ff8d0 0x7fc03019b620 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc02800b780 tx=0x7fc028007640 comp rx=0 tx=0).stop 2023-08-10T12:00:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:45.137+0000 7fc034da9700 1 -- 172.21.15.73:0/3564776516 shutdown_connections 2023-08-10T12:00:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:45.137+0000 7fc034da9700 1 --2- 172.21.15.73:0/3564776516 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fc0180a12c0 0x7fc0180a3780 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:45.137+0000 7fc034da9700 1 --2- 172.21.15.73:0/3564776516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc030105670 0x7fc030195480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:45.137+0000 7fc034da9700 1 --2- 172.21.15.73:0/3564776516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0300ff8d0 0x7fc03019b620 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:45.137+0000 7fc034da9700 1 --2- 172.21.15.73:0/3564776516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc030100290 0x7fc03019bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:45.148 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:45.137+0000 7fc034da9700 1 -- 172.21.15.73:0/3564776516 >> 172.21.15.73:0/3564776516 conn(0x7fc0300750a0 msgr2=0x7fc0300fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:45.148 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:45.137+0000 7fc034da9700 1 -- 172.21.15.73:0/3564776516 shutdown_connections 2023-08-10T12:00:45.148 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:45.137+0000 7fc034da9700 1 -- 172.21.15.73:0/3564776516 wait complete. 2023-08-10T12:00:45.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:44 smithi152 ceph-mon[130220]: pgmap v250: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 321 op/s 2023-08-10T12:00:45.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:44 smithi156 ceph-mon[130574]: pgmap v250: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 321 op/s 2023-08-10T12:00:45.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:44 smithi073 ceph-mon[128869]: pgmap v250: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 321 op/s 2023-08-10T12:00:47.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:47 smithi152 ceph-mon[130220]: pgmap v251: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 307 op/s 2023-08-10T12:00:47.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:47 smithi156 ceph-mon[130574]: pgmap v251: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 307 op/s 2023-08-10T12:00:47.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:47 smithi073 ceph-mon[128869]: pgmap v251: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 307 op/s 2023-08-10T12:00:48.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:48 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:00:48.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:48 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:00:48.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:48 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:00:49.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:49 smithi152 ceph-mon[130220]: pgmap v252: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 266 op/s 2023-08-10T12:00:49.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:49 smithi156 ceph-mon[130574]: pgmap v252: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 266 op/s 2023-08-10T12:00:49.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:49 smithi073 ceph-mon[128869]: pgmap v252: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 266 op/s 2023-08-10T12:00:51.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:50 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:00:51.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:50 smithi152 ceph-mon[130220]: pgmap v253: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 447 op/s 2023-08-10T12:00:51.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:50 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:00:51.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:50 smithi156 ceph-mon[130574]: pgmap v253: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 447 op/s 2023-08-10T12:00:51.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:50 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:00:51.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:50 smithi073 ceph-mon[128869]: pgmap v253: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 447 op/s 2023-08-10T12:00:53.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:53 smithi152 ceph-mon[130220]: pgmap v254: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 362 op/s 2023-08-10T12:00:53.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:53 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:00:53.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:53 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:00:53.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:53 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:00:53.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:53 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:00:53.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:53 smithi156 ceph-mon[130574]: pgmap v254: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 362 op/s 2023-08-10T12:00:53.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:53 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:00:53.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:53 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:00:53.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:53 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:00:53.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:53 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:00:53.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:53 smithi073 ceph-mon[128869]: pgmap v254: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 362 op/s 2023-08-10T12:00:53.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:53 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:00:53.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:53 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:00:53.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:53 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:00:53.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:53 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:00:54.494 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T12:00:54.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.620+0000 7fa5b15f8700 1 -- 172.21.15.73:0/497238035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5ac0fff90 msgr2=0x7fa5ac10c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:54.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.620+0000 7fa5b15f8700 1 --2- 172.21.15.73:0/497238035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5ac0fff90 0x7fa5ac10c450 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fa59c00b1d0 tx=0x7fa59c00b4e0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.620+0000 7fa5b15f8700 1 -- 172.21.15.73:0/497238035 shutdown_connections 2023-08-10T12:00:54.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.620+0000 7fa5b15f8700 1 --2- 172.21.15.73:0/497238035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5ac105690 0x7fa5ac105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.620+0000 7fa5b15f8700 1 --2- 172.21.15.73:0/497238035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5ac0fff90 0x7fa5ac10c450 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.620+0000 7fa5b15f8700 1 --2- 172.21.15.73:0/497238035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5ac0ff5d0 0x7fa5ac0ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.620+0000 7fa5b15f8700 1 -- 172.21.15.73:0/497238035 >> 172.21.15.73:0/497238035 conn(0x7fa5ac0fb0c0 msgr2=0x7fa5ac0fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:54.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.620+0000 7fa5b15f8700 1 -- 172.21.15.73:0/497238035 shutdown_connections 2023-08-10T12:00:54.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.620+0000 7fa5b15f8700 1 -- 172.21.15.73:0/497238035 wait complete. 2023-08-10T12:00:54.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.620+0000 7fa5b15f8700 1 Processor -- start 2023-08-10T12:00:54.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.621+0000 7fa5b15f8700 1 -- start start 2023-08-10T12:00:54.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.621+0000 7fa5b15f8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5ac0ff5d0 0x7fa5ac194520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:54.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.621+0000 7fa5b15f8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5ac0fff90 0x7fa5ac194a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:54.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.621+0000 7fa5b15f8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5ac105690 0x7fa5ac198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:54.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.621+0000 7fa5b15f8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac199500 con 0x7fa5ac0fff90 2023-08-10T12:00:54.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.621+0000 7fa5b15f8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac199670 con 0x7fa5ac0ff5d0 2023-08-10T12:00:54.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.621+0000 7fa5b15f8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac199830 con 0x7fa5ac105690 2023-08-10T12:00:54.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.621+0000 7fa5aa7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5ac0fff90 0x7fa5ac194a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:54.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.621+0000 7fa5aa7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5ac0fff90 0x7fa5ac194a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35946/0 (socket says 172.21.15.73:35946) 2023-08-10T12:00:54.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.621+0000 7fa5aa7fc700 1 -- 172.21.15.73:0/3910419603 learned_addr learned my addr 172.21.15.73:0/3910419603 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:54.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.621+0000 7fa5aaffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5ac0ff5d0 0x7fa5ac194520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:54.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.621+0000 7fa5ab7fe700 1 --2- 172.21.15.73:0/3910419603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5ac105690 0x7fa5ac198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:54.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.621+0000 7fa5aa7fc700 1 -- 172.21.15.73:0/3910419603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5ac105690 msgr2=0x7fa5ac198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:54.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.621+0000 7fa5aa7fc700 1 --2- 172.21.15.73:0/3910419603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5ac105690 0x7fa5ac198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.621+0000 7fa5aa7fc700 1 -- 172.21.15.73:0/3910419603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5ac0ff5d0 msgr2=0x7fa5ac194520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:54.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.621+0000 7fa5aa7fc700 1 --2- 172.21.15.73:0/3910419603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5ac0ff5d0 0x7fa5ac194520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.621+0000 7fa5aa7fc700 1 -- 172.21.15.73:0/3910419603 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59c009d00 con 0x7fa5ac0fff90 2023-08-10T12:00:54.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.621+0000 7fa5aa7fc700 1 --2- 172.21.15.73:0/3910419603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5ac0fff90 0x7fa5ac194a60 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fa59400e9c0 tx=0x7fa59400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:54.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.622+0000 7fa5a3fff700 1 -- 172.21.15.73:0/3910419603 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5940097b0 con 0x7fa5ac0fff90 2023-08-10T12:00:54.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.622+0000 7fa5a3fff700 1 -- 172.21.15.73:0/3910419603 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa59400ee60 con 0x7fa5ac0fff90 2023-08-10T12:00:54.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.622+0000 7fa5b15f8700 1 -- 172.21.15.73:0/3910419603 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ac199b10 con 0x7fa5ac0fff90 2023-08-10T12:00:54.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.622+0000 7fa5a3fff700 1 -- 172.21.15.73:0/3910419603 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5940054f0 con 0x7fa5ac0fff90 2023-08-10T12:00:54.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.622+0000 7fa5b15f8700 1 -- 172.21.15.73:0/3910419603 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ac1a1350 con 0x7fa5ac0fff90 2023-08-10T12:00:54.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.624+0000 7fa5a3fff700 1 -- 172.21.15.73:0/3910419603 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fa594004750 con 0x7fa5ac0fff90 2023-08-10T12:00:54.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.624+0000 7fa5a3fff700 1 --2- 172.21.15.73:0/3910419603 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa5980a12c0 0x7fa5980a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:54.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.624+0000 7fa5aaffd700 1 --2- 172.21.15.73:0/3910419603 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa5980a12c0 0x7fa5980a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:54.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.624+0000 7fa5a3fff700 1 -- 172.21.15.73:0/3910419603 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa594014070 con 0x7fa5ac0fff90 2023-08-10T12:00:54.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.625+0000 7fa5aaffd700 1 --2- 172.21.15.73:0/3910419603 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa5980a12c0 0x7fa5980a3780 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4009c60 tx=0x7fa5a4009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:54.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.625+0000 7fa5bd791b80 1 Processor -- start 2023-08-10T12:00:54.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.625+0000 7fa5bd791b80 1 -- start start 2023-08-10T12:00:54.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.626+0000 7fa5bd791b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7328c0f50 0x55b7328c1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:54.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.626+0000 7fa5bd791b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328c1870 0x55b7328bb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:54.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.626+0000 7fa5bd791b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b7328bb800 0x55b7328bbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:54.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.626+0000 7fa5bd791b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b732836dc0 con 0x55b7328c1870 2023-08-10T12:00:54.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.626+0000 7fa5bd791b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b732813590 con 0x55b7328c0f50 2023-08-10T12:00:54.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.626+0000 7fa5bd791b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b732810eb0 con 0x55b7328bb800 2023-08-10T12:00:54.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.626+0000 7fa5aa7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328c1870 0x55b7328bb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:54.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.626+0000 7fa5aa7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328c1870 0x55b7328bb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35954/0 (socket says 172.21.15.73:35954) 2023-08-10T12:00:54.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.626+0000 7fa5aa7fc700 1 -- 172.21.15.73:0/2328721205 learned_addr learned my addr 172.21.15.73:0/2328721205 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:54.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.626+0000 7fa5aaffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7328c0f50 0x55b7328c1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:54.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.626+0000 7fa5ab7fe700 1 --2- 172.21.15.73:0/2328721205 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b7328bb800 0x55b7328bbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:54.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.626+0000 7fa5aa7fc700 1 -- 172.21.15.73:0/2328721205 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b7328bb800 msgr2=0x55b7328bbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:54.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.626+0000 7fa5aa7fc700 1 --2- 172.21.15.73:0/2328721205 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b7328bb800 0x55b7328bbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.626+0000 7fa5aa7fc700 1 -- 172.21.15.73:0/2328721205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7328c0f50 msgr2=0x55b7328c1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:54.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.626+0000 7fa5aa7fc700 1 --2- 172.21.15.73:0/2328721205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7328c0f50 0x55b7328c1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.626+0000 7fa5aa7fc700 1 -- 172.21.15.73:0/2328721205 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b73268d630 con 0x55b7328c1870 2023-08-10T12:00:54.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.626+0000 7fa5aa7fc700 1 --2- 172.21.15.73:0/2328721205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328c1870 0x55b7328bb2c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fa5940a1f30 tx=0x7fa59409a090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=102377a3507991f8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:54.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.626+0000 7fa5a17fa700 1 -- 172.21.15.73:0/2328721205 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa594098150 con 0x55b7328c1870 2023-08-10T12:00:54.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.626+0000 7fa5a17fa700 1 -- 172.21.15.73:0/2328721205 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5940983b0 con 0x55b7328c1870 2023-08-10T12:00:54.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.626+0000 7fa5a17fa700 1 -- 172.21.15.73:0/2328721205 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa594099760 con 0x55b7328c1870 2023-08-10T12:00:54.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.627+0000 7fa5bd791b80 1 -- 172.21.15.73:0/2328721205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328c1870 msgr2=0x55b7328bb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:54.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.627+0000 7fa5bd791b80 1 --2- 172.21.15.73:0/2328721205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328c1870 0x55b7328bb2c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fa5940a1f30 tx=0x7fa59409a090 comp rx=0 tx=0).stop 2023-08-10T12:00:54.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.627+0000 7fa5bd791b80 1 -- 172.21.15.73:0/2328721205 shutdown_connections 2023-08-10T12:00:54.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.627+0000 7fa5bd791b80 1 --2- 172.21.15.73:0/2328721205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7328c0f50 0x55b7328c1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.627+0000 7fa5bd791b80 1 --2- 172.21.15.73:0/2328721205 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b7328bb800 0x55b7328bbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.627+0000 7fa5bd791b80 1 --2- 172.21.15.73:0/2328721205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328c1870 0x55b7328bb2c0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.627+0000 7fa5bd791b80 1 -- 172.21.15.73:0/2328721205 >> 172.21.15.73:0/2328721205 conn(0x55b732818cd0 msgr2=0x55b7328b64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:54.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.627+0000 7fa5bd791b80 1 -- 172.21.15.73:0/2328721205 shutdown_connections 2023-08-10T12:00:54.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.627+0000 7fa5bd791b80 1 -- 172.21.15.73:0/2328721205 wait complete. 2023-08-10T12:00:54.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.627+0000 7fa5bd791b80 1 -- start start 2023-08-10T12:00:54.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.627+0000 7fa5bd791b80 1 Processor -- start 2023-08-10T12:00:54.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.628+0000 7fa5bd791b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b7328bb800 0x55b7328c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:54.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.628+0000 7fa5bd791b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328c0f50 0x55b7328c5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:54.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.628+0000 7fa5bd791b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7328c1870 0x55b7328c5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:54.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.628+0000 7fa5bd791b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b73280c7a0 con 0x55b7328c0f50 2023-08-10T12:00:54.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.628+0000 7fa5bd791b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7327abac0 con 0x55b7328c1870 2023-08-10T12:00:54.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.628+0000 7fa5bd791b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7327ab7c0 con 0x55b7328bb800 2023-08-10T12:00:54.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.628+0000 7fa5bd791b80 10 client.0 _ll_register_callbacks cb 0x55b7327a9680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:00:54.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.628+0000 7fa5aa7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328c0f50 0x55b7328c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:54.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.628+0000 7fa5aa7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328c0f50 0x55b7328c5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35960/0 (socket says 172.21.15.73:35960) 2023-08-10T12:00:54.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.628+0000 7fa5aa7fc700 1 -- 172.21.15.73:0/3205518944 learned_addr learned my addr 172.21.15.73:0/3205518944 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:54.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.628+0000 7fa5aaffd700 1 --2- 172.21.15.73:0/3205518944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b7328bb800 0x55b7328c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:54.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.628+0000 7fa5ab7fe700 1 --2- 172.21.15.73:0/3205518944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7328c1870 0x55b7328c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:54.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.628+0000 7fa5aa7fc700 1 -- 172.21.15.73:0/3205518944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b7328bb800 msgr2=0x55b7328c4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:54.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.628+0000 7fa5aa7fc700 1 --2- 172.21.15.73:0/3205518944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b7328bb800 0x55b7328c4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.628+0000 7fa5aa7fc700 1 -- 172.21.15.73:0/3205518944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7328c1870 msgr2=0x55b7328c5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:54.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.628+0000 7fa5aa7fc700 1 --2- 172.21.15.73:0/3205518944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7328c1870 0x55b7328c5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.628+0000 7fa5aa7fc700 1 -- 172.21.15.73:0/3205518944 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ac1a1350 con 0x55b7328c0f50 2023-08-10T12:00:54.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.628+0000 7fa5aa7fc700 1 --2- 172.21.15.73:0/3205518944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328c0f50 0x55b7328c5140 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fa5940cac90 tx=0x7fa594096350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8af3383ca04dee9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:54.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.628+0000 7fa5927fc700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:00:54.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.628+0000 7fa5927fc700 1 -- 172.21.15.73:0/3205518944 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa594099700 con 0x55b7328c0f50 2023-08-10T12:00:54.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.628+0000 7fa5927fc700 1 -- 172.21.15.73:0/3205518944 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa5940b8400 con 0x55b7328c0f50 2023-08-10T12:00:54.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.628+0000 7fa5bd791b80 1 -- 172.21.15.73:0/3205518944 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b7328ae470 con 0x55b7328c0f50 2023-08-10T12:00:54.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.629+0000 7fa5927fc700 1 -- 172.21.15.73:0/3205518944 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa59409a270 con 0x55b7328c0f50 2023-08-10T12:00:54.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.629+0000 7fa5bd791b80 10 client.16713 fetch_fsmap learned FSMap version 53 2023-08-10T12:00:54.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.629+0000 7fa5bd791b80 1 -- 172.21.15.73:0/3205518944 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x55b732639de0 con 0x55b7328c0f50 2023-08-10T12:00:54.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.629+0000 7fa5927fc700 1 -- 172.21.15.73:0/3205518944 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa59407c020 con 0x55b7328c0f50 2023-08-10T12:00:54.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.629+0000 7fa5927fc700 1 -- 172.21.15.73:0/3205518944 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 53) v1 ==== 6985+0+0 (secure 0 0 0) 0x7fa594016c00 con 0x55b7328c0f50 2023-08-10T12:00:54.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.629+0000 7fa5bd791b80 10 client.16713 fetch_fsmap finished waiting for FSMap version 53 2023-08-10T12:00:54.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.629+0000 7fa5bd791b80 10 client.16713 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T12:00:54.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.629+0000 7fa5bd791b80 20 client.16713 populate_metadata read hostname 'smithi073' 2023-08-10T12:00:54.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.629+0000 7fa5bd791b80 1 --2- 172.21.15.73:0/3205518944 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b7328d5070 0x55b7328d7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:54.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.629+0000 7fa5bd791b80 4 client.16713 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:00:54.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.629+0000 7fa5bd791b80 1 -- 172.21.15.73:0/3205518944 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b73288a9d0 con 0x55b7328d5070 2023-08-10T12:00:54.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.629+0000 7fa5aaffd700 1 --2- 172.21.15.73:0/3205518944 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b7328d5070 0x55b7328d7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:54.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.630+0000 7fa5927fc700 10 client.16713 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:54.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.630+0000 7fa5aaffd700 1 --2- 172.21.15.73:0/3205518944 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b7328d5070 0x55b7328d7490 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88e3938d864c675c server_cookie=184449ae7571f27c in_seq=0 out_seq=0 2023-08-10T12:00:54.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.632+0000 7fa5927fc700 1 -- 172.21.15.73:0/3205518944 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55b73288a9d0 con 0x55b7328d5070 2023-08-10T12:00:54.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.632+0000 7fa5927fc700 10 client.16713 handle_command_reply: tid=0 2023-08-10T12:00:54.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.632+0000 7fa5bd791b80 1 client.16713 shutdown 2023-08-10T12:00:54.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.632+0000 7fa5bd791b80 1 -- 172.21.15.73:0/3205518944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328c0f50 msgr2=0x55b7328c5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:54.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.632+0000 7fa5bd791b80 1 --2- 172.21.15.73:0/3205518944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328c0f50 0x55b7328c5140 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fa5940cac90 tx=0x7fa594096350 comp rx=0 tx=0).stop 2023-08-10T12:00:54.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.632+0000 7fa5bd791b80 1 -- 172.21.15.73:0/3205518944 shutdown_connections 2023-08-10T12:00:54.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.632+0000 7fa5bd791b80 1 --2- 172.21.15.73:0/3205518944 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b7328d5070 0x55b7328d7490 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.632+0000 7fa5bd791b80 1 --2- 172.21.15.73:0/3205518944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7328c1870 0x55b7328c5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.632+0000 7fa5927fc700 0 client.16713 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:54.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.632+0000 7fa5bd791b80 1 --2- 172.21.15.73:0/3205518944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b7328bb800 0x55b7328c4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.632+0000 7fa5bd791b80 1 --2- 172.21.15.73:0/3205518944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328c0f50 0x55b7328c5140 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.632+0000 7fa5bd791b80 1 -- 172.21.15.73:0/3205518944 >> 172.21.15.73:0/3205518944 conn(0x55b732818cd0 msgr2=0x55b7328b59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:54.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.632+0000 7fa5bd791b80 1 -- 172.21.15.73:0/3205518944 shutdown_connections 2023-08-10T12:00:54.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.632+0000 7fa5bd791b80 1 -- 172.21.15.73:0/3205518944 wait complete. 2023-08-10T12:00:54.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.632+0000 7fa5bd791b80 20 client.16713 trim_cache size 0 max 16384 2023-08-10T12:00:54.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.649+0000 7fa5bd791b80 1 Processor -- start 2023-08-10T12:00:54.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.649+0000 7fa5bd791b80 1 -- start start 2023-08-10T12:00:54.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.649+0000 7fa5bd791b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b7328bb800 0x55b7328b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:54.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.649+0000 7fa5bd791b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328c0f50 0x55b7328b6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:54.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.649+0000 7fa5bd791b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7328c1870 0x55b7328bfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:54.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.649+0000 7fa5bd791b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b73268f920 con 0x55b7328c0f50 2023-08-10T12:00:54.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.649+0000 7fa5bd791b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7328c7e60 con 0x55b7328c1870 2023-08-10T12:00:54.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.649+0000 7fa5bd791b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7328d1d80 con 0x55b7328bb800 2023-08-10T12:00:54.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.649+0000 7fa5aa7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328c0f50 0x55b7328b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:54.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.649+0000 7fa5aaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b7328bb800 0x55b7328b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:54.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.649+0000 7fa5aa7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328c0f50 0x55b7328b6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35968/0 (socket says 172.21.15.73:35968) 2023-08-10T12:00:54.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.649+0000 7fa5aa7fc700 1 -- 172.21.15.73:0/292455125 learned_addr learned my addr 172.21.15.73:0/292455125 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:54.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.649+0000 7fa5ab7fe700 1 --2- 172.21.15.73:0/292455125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7328c1870 0x55b7328bfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:54.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.650+0000 7fa5aa7fc700 1 -- 172.21.15.73:0/292455125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b7328bb800 msgr2=0x55b7328b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:54.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.650+0000 7fa5aa7fc700 1 --2- 172.21.15.73:0/292455125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b7328bb800 0x55b7328b6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.650+0000 7fa5aa7fc700 1 -- 172.21.15.73:0/292455125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7328c1870 msgr2=0x55b7328bfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:54.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.650+0000 7fa5aa7fc700 1 --2- 172.21.15.73:0/292455125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7328c1870 0x55b7328bfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.650+0000 7fa5aa7fc700 1 -- 172.21.15.73:0/292455125 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b732622c60 con 0x55b7328c0f50 2023-08-10T12:00:54.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.650+0000 7fa5aa7fc700 1 --2- 172.21.15.73:0/292455125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328c0f50 0x55b7328b6670 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fa594096510 tx=0x7fa594098290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=194b63eae3ec7e87 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:54.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.650+0000 7fa5a1ffb700 1 -- 172.21.15.73:0/292455125 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59409a090 con 0x55b7328c0f50 2023-08-10T12:00:54.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.650+0000 7fa5a1ffb700 1 -- 172.21.15.73:0/292455125 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa59407c030 con 0x55b7328c0f50 2023-08-10T12:00:54.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.650+0000 7fa5a1ffb700 1 -- 172.21.15.73:0/292455125 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa594098670 con 0x55b7328c0f50 2023-08-10T12:00:54.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.650+0000 7fa5bd791b80 1 -- 172.21.15.73:0/292455125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328c0f50 msgr2=0x55b7328b6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:54.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.651+0000 7fa5bd791b80 1 --2- 172.21.15.73:0/292455125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328c0f50 0x55b7328b6670 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fa594096510 tx=0x7fa594098290 comp rx=0 tx=0).stop 2023-08-10T12:00:54.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.651+0000 7fa5bd791b80 1 -- 172.21.15.73:0/292455125 shutdown_connections 2023-08-10T12:00:54.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.651+0000 7fa5bd791b80 1 --2- 172.21.15.73:0/292455125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7328c1870 0x55b7328bfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.651+0000 7fa5bd791b80 1 --2- 172.21.15.73:0/292455125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b7328bb800 0x55b7328b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.651+0000 7fa5bd791b80 1 --2- 172.21.15.73:0/292455125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328c0f50 0x55b7328b6670 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.651+0000 7fa5bd791b80 1 -- 172.21.15.73:0/292455125 >> 172.21.15.73:0/292455125 conn(0x55b732818cd0 msgr2=0x55b7328becc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:54.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.651+0000 7fa5bd791b80 1 -- 172.21.15.73:0/292455125 shutdown_connections 2023-08-10T12:00:54.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.651+0000 7fa5bd791b80 1 -- 172.21.15.73:0/292455125 wait complete. 2023-08-10T12:00:54.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.651+0000 7fa5bd791b80 1 -- start start 2023-08-10T12:00:54.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.651+0000 7fa5bd791b80 1 Processor -- start 2023-08-10T12:00:54.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.651+0000 7fa5bd791b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328bb800 0x55b73291ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:54.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.651+0000 7fa5bd791b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7328c0f50 0x55b73291d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:54.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.651+0000 7fa5bd791b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b7328c1870 0x55b732920d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:54.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.651+0000 7fa5bd791b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b732921340 con 0x55b7328bb800 2023-08-10T12:00:54.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.651+0000 7fa5bd791b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7329214b0 con 0x55b7328c0f50 2023-08-10T12:00:54.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.651+0000 7fa5bd791b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b732921670 con 0x55b7328c1870 2023-08-10T12:00:54.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.651+0000 7fa5bd791b80 10 client.0 _ll_register_callbacks cb 0x55b7327a9680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:00:54.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.651+0000 7fa5aaffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328bb800 0x55b73291ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:54.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.651+0000 7fa5aaffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328bb800 0x55b73291ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35972/0 (socket says 172.21.15.73:35972) 2023-08-10T12:00:54.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.651+0000 7fa5aaffd700 1 -- 172.21.15.73:0/1329579893 learned_addr learned my addr 172.21.15.73:0/1329579893 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:54.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.651+0000 7fa5aa7fc700 1 --2- 172.21.15.73:0/1329579893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7328c0f50 0x55b73291d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:54.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.651+0000 7fa5ab7fe700 1 --2- 172.21.15.73:0/1329579893 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b7328c1870 0x55b732920d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:54.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.652+0000 7fa5aaffd700 1 -- 172.21.15.73:0/1329579893 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b7328c1870 msgr2=0x55b732920d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:54.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.652+0000 7fa5aaffd700 1 --2- 172.21.15.73:0/1329579893 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b7328c1870 0x55b732920d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.652+0000 7fa5aaffd700 1 -- 172.21.15.73:0/1329579893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7328c0f50 msgr2=0x55b73291d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:54.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.652+0000 7fa5aaffd700 1 --2- 172.21.15.73:0/1329579893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7328c0f50 0x55b73291d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.652+0000 7fa5aaffd700 1 -- 172.21.15.73:0/1329579893 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b732639de0 con 0x55b7328bb800 2023-08-10T12:00:54.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.652+0000 7fa5aaffd700 1 --2- 172.21.15.73:0/1329579893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328bb800 0x55b73291ce60 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40097c0 tx=0x7fa5a40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab2feddb02c64ef server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:54.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.652+0000 7fa5927fc700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:00:54.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.652+0000 7fa5927fc700 1 -- 172.21.15.73:0/1329579893 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a4022040 con 0x55b7328bb800 2023-08-10T12:00:54.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.652+0000 7fa5927fc700 1 -- 172.21.15.73:0/1329579893 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa5a402b040 con 0x55b7328bb800 2023-08-10T12:00:54.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.652+0000 7fa5bd791b80 1 -- 172.21.15.73:0/1329579893 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa5940983b0 con 0x55b7328bb800 2023-08-10T12:00:54.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.652+0000 7fa5927fc700 1 -- 172.21.15.73:0/1329579893 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5a402b200 con 0x55b7328bb800 2023-08-10T12:00:54.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.652+0000 7fa5bd791b80 10 client.16719 fetch_fsmap learned FSMap version 53 2023-08-10T12:00:54.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.652+0000 7fa5bd791b80 1 -- 172.21.15.73:0/1329579893 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x55b732660250 con 0x55b7328bb800 2023-08-10T12:00:54.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.652+0000 7fa5927fc700 1 -- 172.21.15.73:0/1329579893 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5a4040080 con 0x55b7328bb800 2023-08-10T12:00:54.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.652+0000 7fa5927fc700 1 -- 172.21.15.73:0/1329579893 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 53) v1 ==== 6985+0+0 (secure 0 0 0) 0x7fa5a403a030 con 0x55b7328bb800 2023-08-10T12:00:54.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.652+0000 7fa5bd791b80 10 client.16719 fetch_fsmap finished waiting for FSMap version 53 2023-08-10T12:00:54.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.652+0000 7fa5bd791b80 10 client.16719 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T12:00:54.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.653+0000 7fa5bd791b80 20 client.16719 populate_metadata read hostname 'smithi073' 2023-08-10T12:00:54.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.653+0000 7fa5bd791b80 1 --2- 172.21.15.73:0/1329579893 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b73292a120 0x55b73292c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:54.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.653+0000 7fa5bd791b80 4 client.16719 mds_command: new command op to 24503 tid=0[{"prefix": "scrub status"}] 2023-08-10T12:00:54.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.653+0000 7fa5bd791b80 1 -- 172.21.15.73:0/1329579893 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b732805780 con 0x55b73292a120 2023-08-10T12:00:54.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.653+0000 7fa5aa7fc700 1 --2- 172.21.15.73:0/1329579893 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b73292a120 0x55b73292c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:54.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.653+0000 7fa5927fc700 10 client.16719 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:54.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.653+0000 7fa5aa7fc700 1 --2- 172.21.15.73:0/1329579893 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b73292a120 0x55b73292c540 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f25d5213d01dcea server_cookie=91d312fc29bcd1f7 in_seq=0 out_seq=0 2023-08-10T12:00:54.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.653+0000 7fa5927fc700 1 -- 172.21.15.73:0/1329579893 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55b732805780 con 0x55b73292a120 2023-08-10T12:00:54.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.653+0000 7fa5927fc700 10 client.16719 handle_command_reply: tid=0 2023-08-10T12:00:54.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.653+0000 7fa5bd791b80 1 client.16719 shutdown 2023-08-10T12:00:54.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.653+0000 7fa5bd791b80 1 -- 172.21.15.73:0/1329579893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328bb800 msgr2=0x55b73291ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:54.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.653+0000 7fa5bd791b80 1 --2- 172.21.15.73:0/1329579893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328bb800 0x55b73291ce60 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40097c0 tx=0x7fa5a40047c0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.654+0000 7fa5bd791b80 1 -- 172.21.15.73:0/1329579893 shutdown_connections 2023-08-10T12:00:54.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.654+0000 7fa5bd791b80 1 --2- 172.21.15.73:0/1329579893 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55b73292a120 0x55b73292c540 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.654+0000 7fa5bd791b80 1 --2- 172.21.15.73:0/1329579893 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b7328c1870 0x55b732920d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.654+0000 7fa5bd791b80 1 --2- 172.21.15.73:0/1329579893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b7328bb800 0x55b73291ce60 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.654+0000 7fa5927fc700 0 client.16719 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:54.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.654+0000 7fa5bd791b80 1 --2- 172.21.15.73:0/1329579893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7328c0f50 0x55b73291d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.654+0000 7fa5bd791b80 1 -- 172.21.15.73:0/1329579893 >> 172.21.15.73:0/1329579893 conn(0x55b732818cd0 msgr2=0x55b7328c6510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:54.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.654+0000 7fa5bd791b80 1 -- 172.21.15.73:0/1329579893 shutdown_connections 2023-08-10T12:00:54.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.654+0000 7fa5bd791b80 1 -- 172.21.15.73:0/1329579893 wait complete. 2023-08-10T12:00:54.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.654+0000 7fa5bd791b80 20 client.16719 trim_cache size 0 max 16384 2023-08-10T12:00:54.666 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T12:00:54.666 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T12:00:54.666 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": { 2023-08-10T12:00:54.667 INFO:teuthology.orchestra.run.smithi073.stdout: "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d": { 2023-08-10T12:00:54.667 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2023-08-10T12:00:54.667 INFO:teuthology.orchestra.run.smithi073.stdout: "tag": "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d", 2023-08-10T12:00:54.667 INFO:teuthology.orchestra.run.smithi073.stdout: "options": "recursive,force" 2023-08-10T12:00:54.667 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:00:54.667 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:00:54.668 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T12:00:54.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.654+0000 7fa5b15f8700 1 -- 172.21.15.73:0/3910419603 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa5980a12c0 msgr2=0x7fa5980a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:54.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.654+0000 7fa5b15f8700 1 --2- 172.21.15.73:0/3910419603 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa5980a12c0 0x7fa5980a3780 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4009c60 tx=0x7fa5a4009260 comp rx=0 tx=0).stop 2023-08-10T12:00:54.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.654+0000 7fa5b15f8700 1 -- 172.21.15.73:0/3910419603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5ac0fff90 msgr2=0x7fa5ac194a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:54.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.654+0000 7fa5b15f8700 1 --2- 172.21.15.73:0/3910419603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5ac0fff90 0x7fa5ac194a60 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fa59400e9c0 tx=0x7fa59400ecd0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.654+0000 7fa5b15f8700 1 -- 172.21.15.73:0/3910419603 shutdown_connections 2023-08-10T12:00:54.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.654+0000 7fa5b15f8700 1 --2- 172.21.15.73:0/3910419603 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa5980a12c0 0x7fa5980a3780 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.654+0000 7fa5b15f8700 1 --2- 172.21.15.73:0/3910419603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5ac0ff5d0 0x7fa5ac194520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.654+0000 7fa5b15f8700 1 --2- 172.21.15.73:0/3910419603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5ac105690 0x7fa5ac198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.654+0000 7fa5b15f8700 1 --2- 172.21.15.73:0/3910419603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5ac0fff90 0x7fa5ac194a60 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:54.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.654+0000 7fa5b15f8700 1 -- 172.21.15.73:0/3910419603 >> 172.21.15.73:0/3910419603 conn(0x7fa5ac0fb0c0 msgr2=0x7fa5ac0fc760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:54.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.654+0000 7fa5b15f8700 1 -- 172.21.15.73:0/3910419603 shutdown_connections 2023-08-10T12:00:54.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:00:54.654+0000 7fa5b15f8700 1 -- 172.21.15.73:0/3910419603 wait complete. 2023-08-10T12:00:54.670 INFO:tasks.cephfs.filesystem:scrub status for tag:9d39b3fa-9b62-42b4-b1a5-738cb3118a5d - {'path': '/', 'tag': '9d39b3fa-9b62-42b4-b1a5-738cb3118a5d', 'options': 'recursive,force'} 2023-08-10T12:00:55.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:54 smithi152 ceph-mon[130220]: pgmap v255: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 399 op/s 2023-08-10T12:00:55.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:54 smithi156 ceph-mon[130574]: pgmap v255: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 399 op/s 2023-08-10T12:00:55.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:54 smithi073 ceph-mon[128869]: pgmap v255: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 399 op/s 2023-08-10T12:00:57.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:57 smithi152 ceph-mon[130220]: pgmap v256: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 402 op/s 2023-08-10T12:00:57.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:57 smithi156 ceph-mon[130574]: pgmap v256: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 402 op/s 2023-08-10T12:00:57.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:57 smithi073 ceph-mon[128869]: pgmap v256: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 402 op/s 2023-08-10T12:00:58.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.250+0000 7f945314b700 1 -- 172.21.15.73:0/2441531315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f944c067b60 msgr2=0x7f944c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:58.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.250+0000 7f945314b700 1 --2- 172.21.15.73:0/2441531315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f944c067b60 0x7f944c067fe0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f94380099c0 tx=0x7f9438009cd0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.250+0000 7f945314b700 1 -- 172.21.15.73:0/2441531315 shutdown_connections 2023-08-10T12:00:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.250+0000 7f945314b700 1 --2- 172.21.15.73:0/2441531315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f944c068520 0x7f944c10d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.250+0000 7f945314b700 1 --2- 172.21.15.73:0/2441531315 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f944c106720 0x7f944c106b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.250+0000 7f945314b700 1 --2- 172.21.15.73:0/2441531315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f944c067b60 0x7f944c067fe0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.250+0000 7f945314b700 1 -- 172.21.15.73:0/2441531315 >> 172.21.15.73:0/2441531315 conn(0x7f944c0750a0 msgr2=0x7f944c0754b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.250+0000 7f945314b700 1 -- 172.21.15.73:0/2441531315 shutdown_connections 2023-08-10T12:00:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.250+0000 7f945314b700 1 -- 172.21.15.73:0/2441531315 wait complete. 2023-08-10T12:00:58.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.251+0000 7f945314b700 1 Processor -- start 2023-08-10T12:00:58.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.251+0000 7f945314b700 1 -- start start 2023-08-10T12:00:58.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.251+0000 7f945314b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f944c067b60 0x7f944c19c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:58.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.251+0000 7f945314b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f944c068520 0x7f944c19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:58.254 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.251+0000 7f945314b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f944c106720 0x7f944c196620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.251+0000 7f945314b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c196c90 con 0x7f944c106720 2023-08-10T12:00:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.251+0000 7f945314b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c196e00 con 0x7f944c068520 2023-08-10T12:00:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.251+0000 7f945314b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c196fc0 con 0x7f944c067b60 2023-08-10T12:00:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.251+0000 7f94516e8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f944c106720 0x7f944c196620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.251+0000 7f94516e8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f944c106720 0x7f944c196620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35990/0 (socket says 172.21.15.73:35990) 2023-08-10T12:00:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.251+0000 7f94516e8700 1 -- 172.21.15.73:0/1354205147 learned_addr learned my addr 172.21.15.73:0/1354205147 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.251+0000 7f944bfff700 1 --2- 172.21.15.73:0/1354205147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f944c068520 0x7f944c19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.251+0000 7f9450ee7700 1 --2- 172.21.15.73:0/1354205147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f944c067b60 0x7f944c19c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.251+0000 7f94516e8700 1 -- 172.21.15.73:0/1354205147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f944c067b60 msgr2=0x7f944c19c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.251+0000 7f94516e8700 1 --2- 172.21.15.73:0/1354205147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f944c067b60 0x7f944c19c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.251+0000 7f94516e8700 1 -- 172.21.15.73:0/1354205147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f944c068520 msgr2=0x7f944c19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.251+0000 7f94516e8700 1 --2- 172.21.15.73:0/1354205147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f944c068520 0x7f944c19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.251+0000 7f94516e8700 1 -- 172.21.15.73:0/1354205147 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94380095f0 con 0x7f944c106720 2023-08-10T12:00:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.251+0000 7f94516e8700 1 --2- 172.21.15.73:0/1354205147 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f944c106720 0x7f944c196620 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f944400ef30 tx=0x7f944400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.252+0000 7f9449ffb700 1 -- 172.21.15.73:0/1354205147 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9444018070 con 0x7f944c106720 2023-08-10T12:00:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.252+0000 7f945314b700 1 -- 172.21.15.73:0/1354205147 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f944c197240 con 0x7f944c106720 2023-08-10T12:00:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.252+0000 7f9449ffb700 1 -- 172.21.15.73:0/1354205147 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f944400f040 con 0x7f944c106720 2023-08-10T12:00:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.252+0000 7f9449ffb700 1 -- 172.21.15.73:0/1354205147 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944400cd00 con 0x7f944c106720 2023-08-10T12:00:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.252+0000 7f945314b700 1 -- 172.21.15.73:0/1354205147 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f944c1a37b0 con 0x7f944c106720 2023-08-10T12:00:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.254+0000 7f9449ffb700 1 -- 172.21.15.73:0/1354205147 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f9444003a00 con 0x7f944c106720 2023-08-10T12:00:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.255+0000 7f9449ffb700 1 --2- 172.21.15.73:0/1354205147 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f943c0a12c0 0x7f943c0a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.255+0000 7f9450ee7700 1 --2- 172.21.15.73:0/1354205147 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f943c0a12c0 0x7f943c0a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.255+0000 7f9449ffb700 1 -- 172.21.15.73:0/1354205147 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f94440cc870 con 0x7f944c106720 2023-08-10T12:00:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.255+0000 7f9450ee7700 1 --2- 172.21.15.73:0/1354205147 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f943c0a12c0 0x7f943c0a3780 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9440009be0 tx=0x7f9440009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.256+0000 7f945f2e4b80 1 Processor -- start 2023-08-10T12:00:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.256+0000 7f945f2e4b80 1 -- start start 2023-08-10T12:00:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.256+0000 7f945f2e4b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9dca40 0x5652bd9dce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.256+0000 7f945f2e4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652bd9dd360 0x5652bd9d7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.256+0000 7f945f2e4b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652bd9d7550 0x5652bd9d79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.256+0000 7f945f2e4b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652bd952d60 con 0x5652bd9dca40 2023-08-10T12:00:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.256+0000 7f945f2e4b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652bd92f530 con 0x5652bd9d7550 2023-08-10T12:00:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.256+0000 7f945f2e4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652bd92ce50 con 0x5652bd9dd360 2023-08-10T12:00:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.256+0000 7f9450ee7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9dca40 0x5652bd9dce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.256+0000 7f9450ee7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9dca40 0x5652bd9dce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35994/0 (socket says 172.21.15.73:35994) 2023-08-10T12:00:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.256+0000 7f9450ee7700 1 -- 172.21.15.73:0/3210319831 learned_addr learned my addr 172.21.15.73:0/3210319831 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.256+0000 7f94516e8700 1 --2- 172.21.15.73:0/3210319831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652bd9d7550 0x5652bd9d79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.256+0000 7f944bfff700 1 --2- 172.21.15.73:0/3210319831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652bd9dd360 0x5652bd9d7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.256+0000 7f9450ee7700 1 -- 172.21.15.73:0/3210319831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652bd9dd360 msgr2=0x5652bd9d7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.256+0000 7f9450ee7700 1 --2- 172.21.15.73:0/3210319831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652bd9dd360 0x5652bd9d7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.256+0000 7f9450ee7700 1 -- 172.21.15.73:0/3210319831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652bd9d7550 msgr2=0x5652bd9d79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.256+0000 7f9450ee7700 1 --2- 172.21.15.73:0/3210319831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652bd9d7550 0x5652bd9d79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.256+0000 7f9450ee7700 1 -- 172.21.15.73:0/3210319831 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652bd7a95d0 con 0x5652bd9dca40 2023-08-10T12:00:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.257+0000 7f9450ee7700 1 --2- 172.21.15.73:0/3210319831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9dca40 0x5652bd9dce20 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f9440011d70 tx=0x7f9440014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae82dff7ea7365e2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.257+0000 7f9436ffd700 1 -- 172.21.15.73:0/3210319831 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440011da0 con 0x5652bd9dca40 2023-08-10T12:00:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.257+0000 7f9436ffd700 1 -- 172.21.15.73:0/3210319831 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9440004020 con 0x5652bd9dca40 2023-08-10T12:00:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.257+0000 7f9436ffd700 1 -- 172.21.15.73:0/3210319831 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440003bc0 con 0x5652bd9dca40 2023-08-10T12:00:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.257+0000 7f945f2e4b80 1 -- 172.21.15.73:0/3210319831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9dca40 msgr2=0x5652bd9dce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.257+0000 7f945f2e4b80 1 --2- 172.21.15.73:0/3210319831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9dca40 0x5652bd9dce20 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f9440011d70 tx=0x7f9440014000 comp rx=0 tx=0).stop 2023-08-10T12:00:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.257+0000 7f945f2e4b80 1 -- 172.21.15.73:0/3210319831 shutdown_connections 2023-08-10T12:00:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.257+0000 7f945f2e4b80 1 --2- 172.21.15.73:0/3210319831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652bd9d7550 0x5652bd9d79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.257+0000 7f945f2e4b80 1 --2- 172.21.15.73:0/3210319831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9dca40 0x5652bd9dce20 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.257+0000 7f945f2e4b80 1 --2- 172.21.15.73:0/3210319831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652bd9dd360 0x5652bd9d7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.257+0000 7f945f2e4b80 1 -- 172.21.15.73:0/3210319831 >> 172.21.15.73:0/3210319831 conn(0x5652bd934c70 msgr2=0x5652bd9d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.258+0000 7f945f2e4b80 1 -- 172.21.15.73:0/3210319831 shutdown_connections 2023-08-10T12:00:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.258+0000 7f945f2e4b80 1 -- 172.21.15.73:0/3210319831 wait complete. 2023-08-10T12:00:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.258+0000 7f945f2e4b80 1 -- start start 2023-08-10T12:00:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.258+0000 7f945f2e4b80 1 Processor -- start 2023-08-10T12:00:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.258+0000 7f945f2e4b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652bd9d7550 0x5652bd9e33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.258+0000 7f945f2e4b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9dca40 0x5652bd9e0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.258+0000 7f945f2e4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652bd9dd360 0x5652bd9e0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.258+0000 7f945f2e4b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652bd928740 con 0x5652bd9dca40 2023-08-10T12:00:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.258+0000 7f945f2e4b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652bd8c7a60 con 0x5652bd9d7550 2023-08-10T12:00:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.258+0000 7f945f2e4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652bd8c7760 con 0x5652bd9dd360 2023-08-10T12:00:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.258+0000 7f945f2e4b80 10 client.0 _ll_register_callbacks cb 0x5652bd8c5620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:00:58.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.258+0000 7f944bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9dca40 0x5652bd9e0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:58.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.258+0000 7f944bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9dca40 0x5652bd9e0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36002/0 (socket says 172.21.15.73:36002) 2023-08-10T12:00:58.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.258+0000 7f944bfff700 1 -- 172.21.15.73:0/3674199263 learned_addr learned my addr 172.21.15.73:0/3674199263 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:58.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.258+0000 7f9450ee7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652bd9d7550 0x5652bd9e33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:58.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.259+0000 7f94516e8700 1 --2- 172.21.15.73:0/3674199263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652bd9dd360 0x5652bd9e0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:58.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.259+0000 7f944bfff700 1 -- 172.21.15.73:0/3674199263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652bd9dd360 msgr2=0x5652bd9e0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:58.270 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.259+0000 7f944bfff700 1 --2- 172.21.15.73:0/3674199263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652bd9dd360 0x5652bd9e0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.259+0000 7f944bfff700 1 -- 172.21.15.73:0/3674199263 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652bd9d7550 msgr2=0x5652bd9e33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.259+0000 7f944bfff700 1 --2- 172.21.15.73:0/3674199263 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652bd9d7550 0x5652bd9e33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.259+0000 7f944bfff700 1 -- 172.21.15.73:0/3674199263 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9440017070 con 0x5652bd9dca40 2023-08-10T12:00:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.259+0000 7f944bfff700 1 --2- 172.21.15.73:0/3674199263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9dca40 0x5652bd9e0630 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f94380095c0 tx=0x7f943800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11ff6dfee957429 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.259+0000 7f942bfff700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:00:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.259+0000 7f942bfff700 1 -- 172.21.15.73:0/3674199263 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943801d040 con 0x5652bd9dca40 2023-08-10T12:00:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.259+0000 7f945f2e4b80 1 -- 172.21.15.73:0/3674199263 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5652bd9ca1c0 con 0x5652bd9dca40 2023-08-10T12:00:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.259+0000 7f942bfff700 1 -- 172.21.15.73:0/3674199263 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f94380055a0 con 0x5652bd9dca40 2023-08-10T12:00:58.272 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.259+0000 7f942bfff700 1 -- 172.21.15.73:0/3674199263 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9438003820 con 0x5652bd9dca40 2023-08-10T12:00:58.272 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.259+0000 7f945f2e4b80 10 client.16731 fetch_fsmap learned FSMap version 53 2023-08-10T12:00:58.272 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.259+0000 7f945f2e4b80 1 -- 172.21.15.73:0/3674199263 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x5652bd755d80 con 0x5652bd9dca40 2023-08-10T12:00:58.272 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.259+0000 7f942bfff700 1 -- 172.21.15.73:0/3674199263 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9438032020 con 0x5652bd9dca40 2023-08-10T12:00:58.272 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.259+0000 7f942bfff700 1 -- 172.21.15.73:0/3674199263 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 53) v1 ==== 6985+0+0 (secure 0 0 0) 0x7f943800f960 con 0x5652bd9dca40 2023-08-10T12:00:58.272 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.260+0000 7f945f2e4b80 10 client.16731 fetch_fsmap finished waiting for FSMap version 53 2023-08-10T12:00:58.272 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.260+0000 7f945f2e4b80 10 client.16731 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:00:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.260+0000 7f945f2e4b80 20 client.16731 populate_metadata read hostname 'smithi073' 2023-08-10T12:00:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.260+0000 7f945f2e4b80 1 --2- 172.21.15.73:0/3674199263 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5652bd9f0e60 0x5652bd9f3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.260+0000 7f945f2e4b80 4 client.16731 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:00:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.260+0000 7f945f2e4b80 1 -- 172.21.15.73:0/3674199263 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5652bd9a6970 con 0x5652bd9f0e60 2023-08-10T12:00:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.260+0000 7f9450ee7700 1 --2- 172.21.15.73:0/3674199263 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5652bd9f0e60 0x5652bd9f3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.260+0000 7f942bfff700 10 client.16731 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.260+0000 7f9450ee7700 1 --2- 172.21.15.73:0/3674199263 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5652bd9f0e60 0x5652bd9f3280 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f198e45d132bcda server_cookie=3f82d3824e0dafab in_seq=0 out_seq=0 2023-08-10T12:00:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.261+0000 7f942bfff700 1 -- 172.21.15.73:0/3674199263 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5652bd9a6970 con 0x5652bd9f0e60 2023-08-10T12:00:58.274 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.261+0000 7f942bfff700 10 client.16731 handle_command_reply: tid=0 2023-08-10T12:00:58.274 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.261+0000 7f945f2e4b80 1 client.16731 shutdown 2023-08-10T12:00:58.274 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.261+0000 7f945f2e4b80 1 -- 172.21.15.73:0/3674199263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9dca40 msgr2=0x5652bd9e0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:58.274 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.261+0000 7f945f2e4b80 1 --2- 172.21.15.73:0/3674199263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9dca40 0x5652bd9e0630 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f94380095c0 tx=0x7f943800bea0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.274 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.261+0000 7f945f2e4b80 1 -- 172.21.15.73:0/3674199263 shutdown_connections 2023-08-10T12:00:58.274 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.261+0000 7f945f2e4b80 1 --2- 172.21.15.73:0/3674199263 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5652bd9f0e60 0x5652bd9f3280 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.274 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.261+0000 7f945f2e4b80 1 --2- 172.21.15.73:0/3674199263 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652bd9d7550 0x5652bd9e33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.261+0000 7f942bfff700 0 client.16731 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:58.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.261+0000 7f945f2e4b80 1 --2- 172.21.15.73:0/3674199263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652bd9dd360 0x5652bd9e0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.261+0000 7f945f2e4b80 1 --2- 172.21.15.73:0/3674199263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9dca40 0x5652bd9e0630 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.261+0000 7f945f2e4b80 1 -- 172.21.15.73:0/3674199263 >> 172.21.15.73:0/3674199263 conn(0x5652bd934c70 msgr2=0x5652bd9d14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:58.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.261+0000 7f945f2e4b80 1 -- 172.21.15.73:0/3674199263 shutdown_connections 2023-08-10T12:00:58.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.261+0000 7f945f2e4b80 1 -- 172.21.15.73:0/3674199263 wait complete. 2023-08-10T12:00:58.275 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.261+0000 7f945f2e4b80 20 client.16731 trim_cache size 0 max 16384 2023-08-10T12:00:58.278 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.276+0000 7f945f2e4b80 1 Processor -- start 2023-08-10T12:00:58.278 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.276+0000 7f945f2e4b80 1 -- start start 2023-08-10T12:00:58.278 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.276+0000 7f945f2e4b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9d7550 0x5652bd9f7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:58.278 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.276+0000 7f945f2e4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652bd9dca40 0x5652bd9d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:58.278 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.276+0000 7f945f2e4b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652bd9dd360 0x5652bd9dbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:58.279 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.276+0000 7f945f2e4b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652bd7ab8c0 con 0x5652bd9d7550 2023-08-10T12:00:58.279 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.276+0000 7f945f2e4b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652bd9debb0 con 0x5652bd9dd360 2023-08-10T12:00:58.279 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.276+0000 7f945f2e4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652bd9db420 con 0x5652bd9dca40 2023-08-10T12:00:58.279 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.277+0000 7f9450ee7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9d7550 0x5652bd9f7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:58.279 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.277+0000 7f9450ee7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9d7550 0x5652bd9f7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36008/0 (socket says 172.21.15.73:36008) 2023-08-10T12:00:58.279 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.277+0000 7f944bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652bd9dca40 0x5652bd9d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:58.279 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.277+0000 7f9450ee7700 1 -- 172.21.15.73:0/1419599781 learned_addr learned my addr 172.21.15.73:0/1419599781 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:58.279 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.277+0000 7f94516e8700 1 --2- 172.21.15.73:0/1419599781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652bd9dd360 0x5652bd9dbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:58.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.277+0000 7f9450ee7700 1 -- 172.21.15.73:0/1419599781 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652bd9dca40 msgr2=0x5652bd9d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:58.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.277+0000 7f9450ee7700 1 --2- 172.21.15.73:0/1419599781 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652bd9dca40 0x5652bd9d1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.277+0000 7f9450ee7700 1 -- 172.21.15.73:0/1419599781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652bd9dd360 msgr2=0x5652bd9dbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:58.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.277+0000 7f9450ee7700 1 --2- 172.21.15.73:0/1419599781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652bd9dd360 0x5652bd9dbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.277+0000 7f9450ee7700 1 -- 172.21.15.73:0/1419599781 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652bd73ec00 con 0x5652bd9d7550 2023-08-10T12:00:58.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.277+0000 7f9450ee7700 1 --2- 172.21.15.73:0/1419599781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9d7550 0x5652bd9f7be0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f9440005950 tx=0x7f94400037c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97ed1a583f41c65 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:58.280 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.277+0000 7f94377fe700 1 -- 172.21.15.73:0/1419599781 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944002b040 con 0x5652bd9d7550 2023-08-10T12:00:58.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.277+0000 7f94377fe700 1 -- 172.21.15.73:0/1419599781 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f94400056c0 con 0x5652bd9d7550 2023-08-10T12:00:58.281 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.277+0000 7f94377fe700 1 -- 172.21.15.73:0/1419599781 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440034b70 con 0x5652bd9d7550 2023-08-10T12:00:58.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.278+0000 7f945f2e4b80 1 -- 172.21.15.73:0/1419599781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9d7550 msgr2=0x5652bd9f7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:58.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.278+0000 7f945f2e4b80 1 --2- 172.21.15.73:0/1419599781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9d7550 0x5652bd9f7be0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f9440005950 tx=0x7f94400037c0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.283 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.278+0000 7f945f2e4b80 1 -- 172.21.15.73:0/1419599781 shutdown_connections 2023-08-10T12:00:58.284 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.278+0000 7f945f2e4b80 1 --2- 172.21.15.73:0/1419599781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652bd9dd360 0x5652bd9dbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.284 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.278+0000 7f945f2e4b80 1 --2- 172.21.15.73:0/1419599781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9d7550 0x5652bd9f7be0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.284 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.278+0000 7f945f2e4b80 1 --2- 172.21.15.73:0/1419599781 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652bd9dca40 0x5652bd9d1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.284 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.278+0000 7f945f2e4b80 1 -- 172.21.15.73:0/1419599781 >> 172.21.15.73:0/1419599781 conn(0x5652bd934c70 msgr2=0x5652bd9db830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:58.284 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.278+0000 7f945f2e4b80 1 -- 172.21.15.73:0/1419599781 shutdown_connections 2023-08-10T12:00:58.284 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.278+0000 7f945f2e4b80 1 -- 172.21.15.73:0/1419599781 wait complete. 2023-08-10T12:00:58.284 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.278+0000 7f945f2e4b80 1 -- start start 2023-08-10T12:00:58.284 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.278+0000 7f945f2e4b80 1 Processor -- start 2023-08-10T12:00:58.285 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.279+0000 7f945f2e4b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652bd9d7550 0x5652bd9e5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:58.285 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.279+0000 7f945f2e4b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9dca40 0x5652bd9e6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:58.285 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.279+0000 7f945f2e4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652bd9dd360 0x5652bda43b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:58.285 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.279+0000 7f945f2e4b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652bda44050 con 0x5652bd9dca40 2023-08-10T12:00:58.285 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.279+0000 7f945f2e4b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652bda44190 con 0x5652bd9d7550 2023-08-10T12:00:58.285 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.279+0000 7f945f2e4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652bda442d0 con 0x5652bd9dd360 2023-08-10T12:00:58.285 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.279+0000 7f945f2e4b80 10 client.0 _ll_register_callbacks cb 0x5652bd8c5620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:00:58.286 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.279+0000 7f944bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9dca40 0x5652bd9e6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:58.286 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.279+0000 7f944bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9dca40 0x5652bd9e6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36016/0 (socket says 172.21.15.73:36016) 2023-08-10T12:00:58.286 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.279+0000 7f9450ee7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652bd9d7550 0x5652bd9e5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:58.286 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.279+0000 7f944bfff700 1 -- 172.21.15.73:0/809325774 learned_addr learned my addr 172.21.15.73:0/809325774 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:00:58.286 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.279+0000 7f94516e8700 1 --2- 172.21.15.73:0/809325774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652bd9dd360 0x5652bda43b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:58.286 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.279+0000 7f944bfff700 1 -- 172.21.15.73:0/809325774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652bd9dd360 msgr2=0x5652bda43b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:58.286 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.279+0000 7f944bfff700 1 --2- 172.21.15.73:0/809325774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652bd9dd360 0x5652bda43b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.286 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.279+0000 7f944bfff700 1 -- 172.21.15.73:0/809325774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652bd9d7550 msgr2=0x5652bd9e5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:00:58.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.279+0000 7f944bfff700 1 --2- 172.21.15.73:0/809325774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652bd9d7550 0x5652bd9e5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.279+0000 7f944bfff700 1 -- 172.21.15.73:0/809325774 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5652bd7a95d0 con 0x5652bd9dca40 2023-08-10T12:00:58.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.279+0000 7f94516e8700 1 --2- 172.21.15.73:0/809325774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652bd9dd360 0x5652bda43b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T12:00:58.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.279+0000 7f944bfff700 1 --2- 172.21.15.73:0/809325774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9dca40 0x5652bd9e6530 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f9438009350 tx=0x7f9438009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8968a5584511b75 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:00:58.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.279+0000 7f942bfff700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:00:58.287 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.279+0000 7f942bfff700 1 -- 172.21.15.73:0/809325774 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943801d040 con 0x5652bd9dca40 2023-08-10T12:00:58.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.279+0000 7f942bfff700 1 -- 172.21.15.73:0/809325774 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f9438033080 con 0x5652bd9dca40 2023-08-10T12:00:58.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.279+0000 7f945f2e4b80 1 -- 172.21.15.73:0/809325774 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9440004020 con 0x5652bd9dca40 2023-08-10T12:00:58.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.279+0000 7f942bfff700 1 -- 172.21.15.73:0/809325774 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9438005bc0 con 0x5652bd9dca40 2023-08-10T12:00:58.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.279+0000 7f945f2e4b80 10 client.16737 fetch_fsmap learned FSMap version 53 2023-08-10T12:00:58.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.279+0000 7f945f2e4b80 1 -- 172.21.15.73:0/809325774 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x5652bd77c1f0 con 0x5652bd9dca40 2023-08-10T12:00:58.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.280+0000 7f942bfff700 1 -- 172.21.15.73:0/809325774 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9438044080 con 0x5652bd9dca40 2023-08-10T12:00:58.288 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.280+0000 7f942bfff700 1 -- 172.21.15.73:0/809325774 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 53) v1 ==== 6985+0+0 (secure 0 0 0) 0x7f9438023590 con 0x5652bd9dca40 2023-08-10T12:00:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.280+0000 7f945f2e4b80 10 client.16737 fetch_fsmap finished waiting for FSMap version 53 2023-08-10T12:00:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.280+0000 7f945f2e4b80 10 client.16737 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:00:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.280+0000 7f945f2e4b80 20 client.16737 populate_metadata read hostname 'smithi073' 2023-08-10T12:00:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.280+0000 7f945f2e4b80 1 --2- 172.21.15.73:0/809325774 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5652bd9f0e60 0x5652bda475b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:00:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.280+0000 7f945f2e4b80 4 client.16737 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T12:00:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.280+0000 7f945f2e4b80 1 -- 172.21.15.73:0/809325774 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5652bd921720 con 0x5652bd9f0e60 2023-08-10T12:00:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.280+0000 7f9450ee7700 1 --2- 172.21.15.73:0/809325774 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5652bd9f0e60 0x5652bda475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:00:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.280+0000 7f942bfff700 10 client.16737 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.280+0000 7f9450ee7700 1 --2- 172.21.15.73:0/809325774 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5652bd9f0e60 0x5652bda475b0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe4285d189b8fba6 server_cookie=11a414c710102a45 in_seq=0 out_seq=0 2023-08-10T12:00:58.463 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.462+0000 7f942bfff700 1 -- 172.21.15.73:0/809325774 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5652bd921720 con 0x5652bd9f0e60 2023-08-10T12:00:58.463 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.462+0000 7f942bfff700 10 client.16737 handle_command_reply: tid=0 2023-08-10T12:00:58.463 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.462+0000 7f945f2e4b80 1 client.16737 shutdown 2023-08-10T12:00:58.463 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.462+0000 7f945f2e4b80 1 -- 172.21.15.73:0/809325774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9dca40 msgr2=0x5652bd9e6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.462+0000 7f945f2e4b80 1 --2- 172.21.15.73:0/809325774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9dca40 0x5652bd9e6530 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f9438009350 tx=0x7f9438009fd0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.462+0000 7f945f2e4b80 1 -- 172.21.15.73:0/809325774 shutdown_connections 2023-08-10T12:00:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.462+0000 7f945f2e4b80 1 --2- 172.21.15.73:0/809325774 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5652bd9f0e60 0x5652bda475b0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.462+0000 7f945f2e4b80 1 --2- 172.21.15.73:0/809325774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5652bd9d7550 0x5652bd9e5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.462+0000 7f945f2e4b80 1 --2- 172.21.15.73:0/809325774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652bd9dd360 0x5652bda43b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.462+0000 7f945f2e4b80 1 --2- 172.21.15.73:0/809325774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5652bd9dca40 0x5652bd9e6530 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.462+0000 7f945f2e4b80 1 -- 172.21.15.73:0/809325774 >> 172.21.15.73:0/809325774 conn(0x5652bd934c70 msgr2=0x5652bd9dc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.462+0000 7f942bfff700 0 client.16737 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:00:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.462+0000 7f945f2e4b80 1 -- 172.21.15.73:0/809325774 shutdown_connections 2023-08-10T12:00:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.462+0000 7f945f2e4b80 1 -- 172.21.15.73:0/809325774 wait complete. 2023-08-10T12:00:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.462+0000 7f945f2e4b80 20 client.16737 trim_cache size 0 max 16384 2023-08-10T12:00:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T12:00:58.466 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T12:00:58.466 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T12:00:58.466 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T12:00:58.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.463+0000 7f945314b700 1 -- 172.21.15.73:0/1354205147 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f943c0a12c0 msgr2=0x7f943c0a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:58.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.463+0000 7f945314b700 1 --2- 172.21.15.73:0/1354205147 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f943c0a12c0 0x7f943c0a3780 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9440009be0 tx=0x7f9440009260 comp rx=0 tx=0).stop 2023-08-10T12:00:58.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.463+0000 7f945314b700 1 -- 172.21.15.73:0/1354205147 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f944c106720 msgr2=0x7f944c196620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:00:58.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.463+0000 7f945314b700 1 --2- 172.21.15.73:0/1354205147 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f944c106720 0x7f944c196620 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f944400ef30 tx=0x7f944400c3a0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.463+0000 7f945314b700 1 -- 172.21.15.73:0/1354205147 shutdown_connections 2023-08-10T12:00:58.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.463+0000 7f945314b700 1 --2- 172.21.15.73:0/1354205147 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f943c0a12c0 0x7f943c0a3780 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.463+0000 7f945314b700 1 --2- 172.21.15.73:0/1354205147 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f944c106720 0x7f944c196620 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.468 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.463+0000 7f945314b700 1 --2- 172.21.15.73:0/1354205147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f944c067b60 0x7f944c19c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.468 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.463+0000 7f945314b700 1 --2- 172.21.15.73:0/1354205147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f944c068520 0x7f944c19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:00:58.468 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.463+0000 7f945314b700 1 -- 172.21.15.73:0/1354205147 >> 172.21.15.73:0/1354205147 conn(0x7f944c0750a0 msgr2=0x7f944c0fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:00:58.468 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.463+0000 7f945314b700 1 -- 172.21.15.73:0/1354205147 shutdown_connections 2023-08-10T12:00:58.468 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:00:58.463+0000 7f945314b700 1 -- 172.21.15.73:0/1354205147 wait complete. 2023-08-10T12:00:59.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:00:59 smithi152 ceph-mon[130220]: pgmap v257: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 356 op/s 2023-08-10T12:00:59.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:00:59 smithi156 ceph-mon[130574]: pgmap v257: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 356 op/s 2023-08-10T12:00:59.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:00:59 smithi073 ceph-mon[128869]: pgmap v257: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 356 op/s 2023-08-10T12:01:01.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:01 smithi152 ceph-mon[130220]: pgmap v258: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 423 op/s 2023-08-10T12:01:01.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:01 smithi156 ceph-mon[130574]: pgmap v258: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 423 op/s 2023-08-10T12:01:01.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:01 smithi073 ceph-mon[128869]: pgmap v258: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 423 op/s 2023-08-10T12:01:03.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:03 smithi152 ceph-mon[130220]: pgmap v259: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 244 op/s 2023-08-10T12:01:03.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:03 smithi156 ceph-mon[130574]: pgmap v259: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 244 op/s 2023-08-10T12:01:03.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:03 smithi073 ceph-mon[128869]: pgmap v259: 97 pgs: 97 active+clean; 1.9 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 244 op/s 2023-08-10T12:01:05.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:04 smithi152 ceph-mon[130220]: pgmap v260: 97 pgs: 97 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 282 op/s 2023-08-10T12:01:05.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:04 smithi156 ceph-mon[130574]: pgmap v260: 97 pgs: 97 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 282 op/s 2023-08-10T12:01:05.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:04 smithi073 ceph-mon[128869]: pgmap v260: 97 pgs: 97 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 282 op/s 2023-08-10T12:01:07.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:07 smithi152 ceph-mon[130220]: pgmap v261: 97 pgs: 97 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.8 MiB/s wr, 280 op/s 2023-08-10T12:01:07.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:07 smithi156 ceph-mon[130574]: pgmap v261: 97 pgs: 97 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.8 MiB/s wr, 280 op/s 2023-08-10T12:01:07.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:07 smithi073 ceph-mon[128869]: pgmap v261: 97 pgs: 97 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.8 MiB/s wr, 280 op/s 2023-08-10T12:01:09.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:09 smithi152 ceph-mon[130220]: pgmap v262: 97 pgs: 97 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 239 op/s 2023-08-10T12:01:09.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:09 smithi156 ceph-mon[130574]: pgmap v262: 97 pgs: 97 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 239 op/s 2023-08-10T12:01:09.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:09 smithi073 ceph-mon[128869]: pgmap v262: 97 pgs: 97 active+clean; 1.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 239 op/s 2023-08-10T12:01:11.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:11 smithi152 ceph-mon[130220]: pgmap v263: 97 pgs: 97 active+clean; 1.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 328 op/s 2023-08-10T12:01:11.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:11 smithi152 ceph-mon[130220]: osdmap e91: 12 total, 12 up, 12 in 2023-08-10T12:01:11.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:11 smithi156 ceph-mon[130574]: pgmap v263: 97 pgs: 97 active+clean; 1.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 328 op/s 2023-08-10T12:01:11.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:11 smithi156 ceph-mon[130574]: osdmap e91: 12 total, 12 up, 12 in 2023-08-10T12:01:11.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:11 smithi073 ceph-mon[128869]: pgmap v263: 97 pgs: 97 active+clean; 1.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 328 op/s 2023-08-10T12:01:11.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:11 smithi073 ceph-mon[128869]: osdmap e91: 12 total, 12 up, 12 in 2023-08-10T12:01:11.642 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.641+0000 7fbe9d09b700 1 -- 172.21.15.73:0/1153038500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe98119f50 msgr2=0x7fbe9811c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.641+0000 7fbe9d09b700 1 --2- 172.21.15.73:0/1153038500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe98119f50 0x7fbe9811c340 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009990 tx=0x7fbe8c009ca0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.642+0000 7fbe9d09b700 1 -- 172.21.15.73:0/1153038500 shutdown_connections 2023-08-10T12:01:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.642+0000 7fbe9d09b700 1 --2- 172.21.15.73:0/1153038500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe98119f50 0x7fbe9811c340 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.642+0000 7fbe9d09b700 1 --2- 172.21.15.73:0/1153038500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe9810eec0 0x7fbe98107770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.642+0000 7fbe9d09b700 1 --2- 172.21.15.73:0/1153038500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe9810f330 0x7fbe98107cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.642+0000 7fbe9d09b700 1 -- 172.21.15.73:0/1153038500 >> 172.21.15.73:0/1153038500 conn(0x7fbe9806c830 msgr2=0x7fbe9806cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.644+0000 7fbe9d09b700 1 -- 172.21.15.73:0/1153038500 shutdown_connections 2023-08-10T12:01:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.644+0000 7fbe9d09b700 1 -- 172.21.15.73:0/1153038500 wait complete. 2023-08-10T12:01:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.645+0000 7fbe9d09b700 1 Processor -- start 2023-08-10T12:01:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.646+0000 7fbe9d09b700 1 -- start start 2023-08-10T12:01:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.646+0000 7fbe9d09b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe9810eec0 0x7fbe981a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.646+0000 7fbe9d09b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe9810f330 0x7fbe981a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.646+0000 7fbe9d09b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe98119f50 0x7fbe981aa370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.646+0000 7fbe9d09b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe981aa940 con 0x7fbe98119f50 2023-08-10T12:01:11.648 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.646+0000 7fbe9d09b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe981aaab0 con 0x7fbe9810eec0 2023-08-10T12:01:11.648 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.646+0000 7fbe9d09b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe981aac70 con 0x7fbe9810f330 2023-08-10T12:01:11.648 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.646+0000 7fbe9759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe98119f50 0x7fbe981aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:11.648 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.646+0000 7fbe9659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe9810f330 0x7fbe981a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:11.648 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.646+0000 7fbe9759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe98119f50 0x7fbe981aa370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36030/0 (socket says 172.21.15.73:36030) 2023-08-10T12:01:11.648 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.646+0000 7fbe9759e700 1 -- 172.21.15.73:0/3832328842 learned_addr learned my addr 172.21.15.73:0/3832328842 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:11.648 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.646+0000 7fbe96d9d700 1 --2- 172.21.15.73:0/3832328842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe9810eec0 0x7fbe981a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:11.649 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.646+0000 7fbe9659c700 1 -- 172.21.15.73:0/3832328842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe9810eec0 msgr2=0x7fbe981a5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:11.649 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.646+0000 7fbe9659c700 1 --2- 172.21.15.73:0/3832328842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe9810eec0 0x7fbe981a5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.649 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.646+0000 7fbe9659c700 1 -- 172.21.15.73:0/3832328842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe98119f50 msgr2=0x7fbe981aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:11.649 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.646+0000 7fbe9659c700 1 --2- 172.21.15.73:0/3832328842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe98119f50 0x7fbe981aa370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.649 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.646+0000 7fbe9659c700 1 -- 172.21.15.73:0/3832328842 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8c0095f0 con 0x7fbe9810f330 2023-08-10T12:01:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.647+0000 7fbe9659c700 1 --2- 172.21.15.73:0/3832328842 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe9810f330 0x7fbe981a5cd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000bd40 tx=0x7fbe9000bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.649+0000 7fbe7ffff700 1 -- 172.21.15.73:0/3832328842 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9000cb30 con 0x7fbe9810f330 2023-08-10T12:01:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.649+0000 7fbe7ffff700 1 -- 172.21.15.73:0/3832328842 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe9000cc90 con 0x7fbe9810f330 2023-08-10T12:01:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.649+0000 7fbe7ffff700 1 -- 172.21.15.73:0/3832328842 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe90012650 con 0x7fbe9810f330 2023-08-10T12:01:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.649+0000 7fbe9d09b700 1 -- 172.21.15.73:0/3832328842 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe981aaf50 con 0x7fbe9810f330 2023-08-10T12:01:11.651 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.649+0000 7fbe9d09b700 1 -- 172.21.15.73:0/3832328842 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe981b2800 con 0x7fbe9810f330 2023-08-10T12:01:11.654 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.653+0000 7fbea9234b80 1 Processor -- start 2023-08-10T12:01:11.654 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.653+0000 7fbea9234b80 1 -- start start 2023-08-10T12:01:11.654 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.653+0000 7fbea9234b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5599cd535a40 0x5599cd535e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.653+0000 7fbea9234b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5599cd536360 0x5599cd530010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.653+0000 7fbea9234b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599cd530550 0x5599cd5309d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.653+0000 7fbea9234b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cd4abd60 con 0x5599cd535a40 2023-08-10T12:01:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.653+0000 7fbea9234b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cd488530 con 0x5599cd536360 2023-08-10T12:01:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.653+0000 7fbea9234b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cd485e50 con 0x5599cd530550 2023-08-10T12:01:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.654+0000 7fbe9759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5599cd535a40 0x5599cd535e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.654+0000 7fbe9759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5599cd535a40 0x5599cd535e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36032/0 (socket says 172.21.15.73:36032) 2023-08-10T12:01:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.654+0000 7fbe9759e700 1 -- 172.21.15.73:0/4248310296 learned_addr learned my addr 172.21.15.73:0/4248310296 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.654+0000 7fbe7ffff700 1 -- 172.21.15.73:0/3832328842 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fbe90014440 con 0x7fbe9810f330 2023-08-10T12:01:11.657 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.654+0000 7fbe9759e700 1 -- 172.21.15.73:0/4248310296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599cd530550 msgr2=0x5599cd5309d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:11.657 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.654+0000 7fbe9759e700 1 --2- 172.21.15.73:0/4248310296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599cd530550 0x5599cd5309d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.657 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.654+0000 7fbe9759e700 1 -- 172.21.15.73:0/4248310296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5599cd536360 msgr2=0x5599cd530010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:11.657 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.654+0000 7fbe9759e700 1 --2- 172.21.15.73:0/4248310296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5599cd536360 0x5599cd530010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.657 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.654+0000 7fbe9759e700 1 -- 172.21.15.73:0/4248310296 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599cd3025d0 con 0x5599cd535a40 2023-08-10T12:01:11.657 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.654+0000 7fbe9759e700 1 --2- 172.21.15.73:0/4248310296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5599cd535a40 0x5599cd535e20 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c005120 tx=0x7fbe8c005150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=680de05c2dd3a192 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:11.658 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.654+0000 7fbe7d7fa700 1 -- 172.21.15.73:0/4248310296 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c01d070 con 0x5599cd535a40 2023-08-10T12:01:11.658 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.654+0000 7fbe7ffff700 1 --2- 172.21.15.73:0/3832328842 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fbe800a1450 0x7fbe800a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:11.658 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.654+0000 7fbe7d7fa700 1 -- 172.21.15.73:0/4248310296 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe8c01e040 con 0x5599cd535a40 2023-08-10T12:01:11.658 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.654+0000 7fbe7d7fa700 1 -- 172.21.15.73:0/4248310296 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c004900 con 0x5599cd535a40 2023-08-10T12:01:11.658 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.654+0000 7fbe96d9d700 1 --2- 172.21.15.73:0/3832328842 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fbe800a1450 0x7fbe800a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:11.658 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.654+0000 7fbe7ffff700 1 -- 172.21.15.73:0/3832328842 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fbe90006e40 con 0x7fbe9810f330 2023-08-10T12:01:11.658 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.655+0000 7fbea9234b80 1 -- 172.21.15.73:0/4248310296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5599cd535a40 msgr2=0x5599cd535e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:11.658 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.655+0000 7fbe96d9d700 1 --2- 172.21.15.73:0/3832328842 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fbe800a1450 0x7fbe800a3910 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbe88006b30 tx=0x7fbe88006ac0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:11.659 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.655+0000 7fbea9234b80 1 --2- 172.21.15.73:0/4248310296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5599cd535a40 0x5599cd535e20 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c005120 tx=0x7fbe8c005150 comp rx=0 tx=0).stop 2023-08-10T12:01:11.659 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.655+0000 7fbea9234b80 1 -- 172.21.15.73:0/4248310296 shutdown_connections 2023-08-10T12:01:11.659 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.655+0000 7fbea9234b80 1 --2- 172.21.15.73:0/4248310296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599cd530550 0x5599cd5309d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.659 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.655+0000 7fbea9234b80 1 --2- 172.21.15.73:0/4248310296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5599cd535a40 0x5599cd535e20 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.659 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.655+0000 7fbea9234b80 1 --2- 172.21.15.73:0/4248310296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5599cd536360 0x5599cd530010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.659 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.655+0000 7fbea9234b80 1 -- 172.21.15.73:0/4248310296 >> 172.21.15.73:0/4248310296 conn(0x5599cd48dc70 msgr2=0x5599cd52ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:11.662 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.657+0000 7fbea9234b80 1 -- 172.21.15.73:0/4248310296 shutdown_connections 2023-08-10T12:01:11.662 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.657+0000 7fbea9234b80 1 -- 172.21.15.73:0/4248310296 wait complete. 2023-08-10T12:01:11.662 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.657+0000 7fbea9234b80 1 -- start start 2023-08-10T12:01:11.662 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.658+0000 7fbea9234b80 1 Processor -- start 2023-08-10T12:01:11.662 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.658+0000 7fbea9234b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5599cd530550 0x5599cd539730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.658+0000 7fbea9234b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599cd535a40 0x5599cd539c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.658+0000 7fbea9234b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5599cd536360 0x5599cd53a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.658+0000 7fbea9234b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cd481740 con 0x5599cd530550 2023-08-10T12:01:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.658+0000 7fbea9234b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cd420a60 con 0x5599cd536360 2023-08-10T12:01:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.658+0000 7fbea9234b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cd420760 con 0x5599cd535a40 2023-08-10T12:01:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.658+0000 7fbea9234b80 10 client.0 _ll_register_callbacks cb 0x5599cd41e620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:01:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.658+0000 7fbe96d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5599cd530550 0x5599cd539730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.658+0000 7fbe96d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5599cd530550 0x5599cd539730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36040/0 (socket says 172.21.15.73:36040) 2023-08-10T12:01:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.658+0000 7fbe96d9d700 1 -- 172.21.15.73:0/3563700045 learned_addr learned my addr 172.21.15.73:0/3563700045 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.658+0000 7fbe9659c700 1 --2- 172.21.15.73:0/3563700045 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599cd535a40 0x5599cd539c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.658+0000 7fbe9759e700 1 --2- 172.21.15.73:0/3563700045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5599cd536360 0x5599cd53a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.658+0000 7fbe96d9d700 1 -- 172.21.15.73:0/3563700045 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599cd535a40 msgr2=0x5599cd539c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.658+0000 7fbe96d9d700 1 --2- 172.21.15.73:0/3563700045 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599cd535a40 0x5599cd539c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.658+0000 7fbe96d9d700 1 -- 172.21.15.73:0/3563700045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5599cd536360 msgr2=0x5599cd53a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.658+0000 7fbe96d9d700 1 --2- 172.21.15.73:0/3563700045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5599cd536360 0x5599cd53a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.665 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.658+0000 7fbe96d9d700 1 -- 172.21.15.73:0/3563700045 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe9811cc70 con 0x5599cd530550 2023-08-10T12:01:11.665 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.658+0000 7fbe9659c700 1 --2- 172.21.15.73:0/3563700045 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599cd535a40 0x5599cd539c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:01:11.665 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.659+0000 7fbe96d9d700 1 --2- 172.21.15.73:0/3563700045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5599cd530550 0x5599cd539730 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fbe88015500 tx=0x7fbe88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282882e8d6b37d32 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:11.665 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.659+0000 7fbe7aff5700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:01:11.665 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.659+0000 7fbe7aff5700 1 -- 172.21.15.73:0/3563700045 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe88015a00 con 0x5599cd530550 2023-08-10T12:01:11.665 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.659+0000 7fbe7aff5700 1 -- 172.21.15.73:0/3563700045 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fbe88015b60 con 0x5599cd530550 2023-08-10T12:01:11.665 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.659+0000 7fbea9234b80 1 -- 172.21.15.73:0/3563700045 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5599cd5231c0 con 0x5599cd530550 2023-08-10T12:01:11.666 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.659+0000 7fbe7aff5700 1 -- 172.21.15.73:0/3563700045 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe88015d20 con 0x5599cd530550 2023-08-10T12:01:11.666 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.659+0000 7fbea9234b80 10 client.16749 fetch_fsmap learned FSMap version 53 2023-08-10T12:01:11.666 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.659+0000 7fbea9234b80 1 -- 172.21.15.73:0/3563700045 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x5599cd2aed80 con 0x5599cd530550 2023-08-10T12:01:11.666 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.659+0000 7fbe7aff5700 1 -- 172.21.15.73:0/3563700045 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5599cd5231c0 con 0x5599cd530550 2023-08-10T12:01:11.666 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.659+0000 7fbe7aff5700 1 -- 172.21.15.73:0/3563700045 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 53) v1 ==== 6985+0+0 (secure 0 0 0) 0x7fbe8801f3f0 con 0x5599cd530550 2023-08-10T12:01:11.666 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.659+0000 7fbea9234b80 10 client.16749 fetch_fsmap finished waiting for FSMap version 53 2023-08-10T12:01:11.666 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.659+0000 7fbea9234b80 10 client.16749 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:01:11.666 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.660+0000 7fbea9234b80 20 client.16749 populate_metadata read hostname 'smithi073' 2023-08-10T12:01:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.660+0000 7fbea9234b80 1 --2- 172.21.15.73:0/3563700045 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5599cd549e90 0x5599cd54c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.660+0000 7fbea9234b80 4 client.16749 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:01:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.660+0000 7fbea9234b80 1 -- 172.21.15.73:0/3563700045 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5599cd4ff970 con 0x5599cd549e90 2023-08-10T12:01:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.660+0000 7fbe9659c700 1 --2- 172.21.15.73:0/3563700045 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5599cd549e90 0x5599cd54c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.661+0000 7fbe7aff5700 10 client.16749 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.661+0000 7fbe9659c700 1 --2- 172.21.15.73:0/3563700045 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5599cd549e90 0x5599cd54c2b0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=faea3131dee2a1f7 server_cookie=a9fc8713dc210356 in_seq=0 out_seq=0 2023-08-10T12:01:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.664+0000 7fbe7aff5700 1 -- 172.21.15.73:0/3563700045 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5599cd4ff970 con 0x5599cd549e90 2023-08-10T12:01:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.664+0000 7fbe7aff5700 10 client.16749 handle_command_reply: tid=0 2023-08-10T12:01:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.664+0000 7fbea9234b80 1 client.16749 shutdown 2023-08-10T12:01:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.664+0000 7fbea9234b80 1 -- 172.21.15.73:0/3563700045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5599cd530550 msgr2=0x5599cd539730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.664+0000 7fbea9234b80 1 --2- 172.21.15.73:0/3563700045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5599cd530550 0x5599cd539730 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fbe88015500 tx=0x7fbe88004750 comp rx=0 tx=0).stop 2023-08-10T12:01:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.665+0000 7fbea9234b80 1 -- 172.21.15.73:0/3563700045 shutdown_connections 2023-08-10T12:01:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.665+0000 7fbea9234b80 1 --2- 172.21.15.73:0/3563700045 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5599cd549e90 0x5599cd54c2b0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.665+0000 7fbea9234b80 1 --2- 172.21.15.73:0/3563700045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5599cd536360 0x5599cd53a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.665+0000 7fbea9234b80 1 --2- 172.21.15.73:0/3563700045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5599cd530550 0x5599cd539730 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.665+0000 7fbea9234b80 1 --2- 172.21.15.73:0/3563700045 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599cd535a40 0x5599cd539c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.665+0000 7fbea9234b80 1 -- 172.21.15.73:0/3563700045 >> 172.21.15.73:0/3563700045 conn(0x5599cd48dc70 msgr2=0x5599cd52a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.665+0000 7fbe7aff5700 0 client.16749 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.666+0000 7fbea9234b80 1 -- 172.21.15.73:0/3563700045 shutdown_connections 2023-08-10T12:01:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.666+0000 7fbea9234b80 1 -- 172.21.15.73:0/3563700045 wait complete. 2023-08-10T12:01:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.666+0000 7fbea9234b80 20 client.16749 trim_cache size 0 max 16384 2023-08-10T12:01:11.690 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.689+0000 7fbea9234b80 1 Processor -- start 2023-08-10T12:01:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.689+0000 7fbea9234b80 1 -- start start 2023-08-10T12:01:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.689+0000 7fbea9234b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5599cd530550 0x5599cd540dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.689+0000 7fbea9234b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599cd535a40 0x5599cd52ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.689+0000 7fbea9234b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5599cd536360 0x5599cd5348f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.689+0000 7fbea9234b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cd3048c0 con 0x5599cd536360 2023-08-10T12:01:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.689+0000 7fbea9234b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cd52cb10 con 0x5599cd530550 2023-08-10T12:01:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.689+0000 7fbea9234b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cd5474c0 con 0x5599cd535a40 2023-08-10T12:01:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.690+0000 7fbe9659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599cd535a40 0x5599cd52ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.690+0000 7fbe9659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599cd535a40 0x5599cd52ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:33320/0 (socket says 172.21.15.73:33320) 2023-08-10T12:01:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.690+0000 7fbe9659c700 1 -- 172.21.15.73:0/3000079480 learned_addr learned my addr 172.21.15.73:0/3000079480 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.690+0000 7fbe96d9d700 1 --2- 172.21.15.73:0/3000079480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5599cd530550 0x5599cd540dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.690+0000 7fbe9759e700 1 --2- 172.21.15.73:0/3000079480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5599cd536360 0x5599cd5348f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.690+0000 7fbe9659c700 1 -- 172.21.15.73:0/3000079480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5599cd530550 msgr2=0x5599cd540dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:11.693 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.690+0000 7fbe9659c700 1 --2- 172.21.15.73:0/3000079480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5599cd530550 0x5599cd540dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.693 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.690+0000 7fbe9659c700 1 -- 172.21.15.73:0/3000079480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5599cd536360 msgr2=0x5599cd5348f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:11.693 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.690+0000 7fbe9659c700 1 --2- 172.21.15.73:0/3000079480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5599cd536360 0x5599cd5348f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.693 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.690+0000 7fbe9659c700 1 -- 172.21.15.73:0/3000079480 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599cd5273f0 con 0x5599cd535a40 2023-08-10T12:01:11.693 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.690+0000 7fbe9659c700 1 --2- 172.21.15.73:0/3000079480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599cd535a40 0x5599cd52ac30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbe90095990 tx=0x7fbe90004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=251d60f8c31ddab3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:11.694 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.691+0000 7fbe7dffb700 1 -- 172.21.15.73:0/3000079480 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe90099490 con 0x5599cd535a40 2023-08-10T12:01:11.694 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.691+0000 7fbe7dffb700 1 -- 172.21.15.73:0/3000079480 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe9009d4c0 con 0x5599cd535a40 2023-08-10T12:01:11.694 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.691+0000 7fbe7dffb700 1 -- 172.21.15.73:0/3000079480 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe900996f0 con 0x5599cd535a40 2023-08-10T12:01:11.694 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.692+0000 7fbea9234b80 1 -- 172.21.15.73:0/3000079480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599cd535a40 msgr2=0x5599cd52ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:11.695 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.692+0000 7fbea9234b80 1 --2- 172.21.15.73:0/3000079480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599cd535a40 0x5599cd52ac30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbe90095990 tx=0x7fbe90004ad0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.695 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.692+0000 7fbea9234b80 1 -- 172.21.15.73:0/3000079480 shutdown_connections 2023-08-10T12:01:11.695 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.692+0000 7fbea9234b80 1 --2- 172.21.15.73:0/3000079480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5599cd530550 0x5599cd540dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.695 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.692+0000 7fbea9234b80 1 --2- 172.21.15.73:0/3000079480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5599cd536360 0x5599cd5348f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.695 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.692+0000 7fbea9234b80 1 --2- 172.21.15.73:0/3000079480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599cd535a40 0x5599cd52ac30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.695 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.692+0000 7fbea9234b80 1 -- 172.21.15.73:0/3000079480 >> 172.21.15.73:0/3000079480 conn(0x5599cd48dc70 msgr2=0x5599cd5338d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:11.695 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.692+0000 7fbea9234b80 1 -- 172.21.15.73:0/3000079480 shutdown_connections 2023-08-10T12:01:11.695 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.692+0000 7fbea9234b80 1 -- 172.21.15.73:0/3000079480 wait complete. 2023-08-10T12:01:11.696 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.692+0000 7fbea9234b80 1 -- start start 2023-08-10T12:01:11.696 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.693+0000 7fbea9234b80 1 Processor -- start 2023-08-10T12:01:11.697 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.693+0000 7fbea9234b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5599cd530550 0x5599cd591cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:11.697 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.693+0000 7fbea9234b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5599cd535a40 0x5599cd592200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:11.697 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.693+0000 7fbea9234b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599cd536360 0x5599cd59cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:11.697 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.693+0000 7fbea9234b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cd592910 con 0x5599cd530550 2023-08-10T12:01:11.698 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.693+0000 7fbea9234b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cd59d090 con 0x5599cd535a40 2023-08-10T12:01:11.698 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.693+0000 7fbea9234b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cd59d1d0 con 0x5599cd536360 2023-08-10T12:01:11.698 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.693+0000 7fbea9234b80 10 client.0 _ll_register_callbacks cb 0x5599cd41e620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:01:11.698 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.693+0000 7fbe9659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5599cd535a40 0x5599cd592200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:11.698 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.693+0000 7fbe96d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5599cd530550 0x5599cd591cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:11.698 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.693+0000 7fbe9759e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599cd536360 0x5599cd59cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:11.698 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.693+0000 7fbe9659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5599cd535a40 0x5599cd592200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:50704/0 (socket says 172.21.15.73:50704) 2023-08-10T12:01:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.693+0000 7fbe9659c700 1 -- 172.21.15.73:0/1636442481 learned_addr learned my addr 172.21.15.73:0/1636442481 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.694+0000 7fbe9759e700 1 -- 172.21.15.73:0/1636442481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5599cd535a40 msgr2=0x5599cd592200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.694+0000 7fbe9759e700 1 --2- 172.21.15.73:0/1636442481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5599cd535a40 0x5599cd592200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.694+0000 7fbe9759e700 1 -- 172.21.15.73:0/1636442481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5599cd530550 msgr2=0x5599cd591cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.694+0000 7fbe9759e700 1 --2- 172.21.15.73:0/1636442481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5599cd530550 0x5599cd591cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.694+0000 7fbe9759e700 1 -- 172.21.15.73:0/1636442481 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe900b1e70 con 0x5599cd536360 2023-08-10T12:01:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.694+0000 7fbe96d9d700 1 --2- 172.21.15.73:0/1636442481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5599cd530550 0x5599cd591cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:01:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.694+0000 7fbe9759e700 1 --2- 172.21.15.73:0/1636442481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599cd536360 0x5599cd59cb50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c004540 tx=0x7fbe8c00b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0a7d85fd4401c16 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:11.700 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.694+0000 7fbe7aff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T12:01:11.700 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.694+0000 7fbe7aff5700 1 -- 172.21.15.73:0/1636442481 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c01d040 con 0x5599cd536360 2023-08-10T12:01:11.700 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.694+0000 7fbe7aff5700 1 -- 172.21.15.73:0/1636442481 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fbe8c00be20 con 0x5599cd536360 2023-08-10T12:01:11.700 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.694+0000 7fbea9234b80 1 -- 172.21.15.73:0/1636442481 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbe8c01e040 con 0x5599cd536360 2023-08-10T12:01:11.700 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.694+0000 7fbe7aff5700 1 -- 172.21.15.73:0/1636442481 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe8c004570 con 0x5599cd536360 2023-08-10T12:01:11.700 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.694+0000 7fbea9234b80 10 client.26227 fetch_fsmap learned FSMap version 53 2023-08-10T12:01:11.700 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.694+0000 7fbea9234b80 1 -- 172.21.15.73:0/1636442481 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x5599cd297c00 con 0x5599cd536360 2023-08-10T12:01:11.701 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.695+0000 7fbe7aff5700 1 -- 172.21.15.73:0/1636442481 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe8c01e040 con 0x5599cd536360 2023-08-10T12:01:11.701 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.695+0000 7fbe7aff5700 1 -- 172.21.15.73:0/1636442481 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 53) v1 ==== 6985+0+0 (secure 0 0 0) 0x7fbe8c003ba0 con 0x5599cd536360 2023-08-10T12:01:11.701 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.695+0000 7fbea9234b80 10 client.26227 fetch_fsmap finished waiting for FSMap version 53 2023-08-10T12:01:11.701 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.695+0000 7fbea9234b80 10 client.26227 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:01:11.701 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.695+0000 7fbea9234b80 20 client.26227 populate_metadata read hostname 'smithi073' 2023-08-10T12:01:11.701 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.695+0000 7fbea9234b80 1 --2- 172.21.15.73:0/1636442481 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5599cd59e4d0 0x5599cd5a08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:11.701 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.695+0000 7fbea9234b80 4 client.26227 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T12:01:11.701 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.695+0000 7fbea9234b80 1 -- 172.21.15.73:0/1636442481 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5599cd47a720 con 0x5599cd59e4d0 2023-08-10T12:01:11.702 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.697+0000 7fbe96d9d700 1 --2- 172.21.15.73:0/1636442481 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5599cd59e4d0 0x5599cd5a08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:11.702 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.698+0000 7fbe7aff5700 10 client.26227 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:11.702 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.698+0000 7fbe96d9d700 1 --2- 172.21.15.73:0/1636442481 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5599cd59e4d0 0x5599cd5a08f0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c28f25477d77b53a server_cookie=146bf53f25b477cf in_seq=0 out_seq=0 2023-08-10T12:01:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.773+0000 7fbe7aff5700 1 -- 172.21.15.73:0/1636442481 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5599cd47a720 con 0x5599cd59e4d0 2023-08-10T12:01:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.773+0000 7fbe7aff5700 10 client.26227 handle_command_reply: tid=0 2023-08-10T12:01:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.773+0000 7fbea9234b80 1 client.26227 shutdown 2023-08-10T12:01:11.775 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.773+0000 7fbea9234b80 1 -- 172.21.15.73:0/1636442481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599cd536360 msgr2=0x5599cd59cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:11.775 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.773+0000 7fbea9234b80 1 --2- 172.21.15.73:0/1636442481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599cd536360 0x5599cd59cb50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c004540 tx=0x7fbe8c00b8a0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.775 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.774+0000 7fbea9234b80 1 -- 172.21.15.73:0/1636442481 shutdown_connections 2023-08-10T12:01:11.775 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.774+0000 7fbea9234b80 1 --2- 172.21.15.73:0/1636442481 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5599cd59e4d0 0x5599cd5a08f0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.775 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.774+0000 7fbea9234b80 1 --2- 172.21.15.73:0/1636442481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599cd536360 0x5599cd59cb50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.776 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.774+0000 7fbea9234b80 1 --2- 172.21.15.73:0/1636442481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5599cd530550 0x5599cd591cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.776 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.774+0000 7fbea9234b80 1 --2- 172.21.15.73:0/1636442481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5599cd535a40 0x5599cd592200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.776 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.774+0000 7fbea9234b80 1 -- 172.21.15.73:0/1636442481 >> 172.21.15.73:0/1636442481 conn(0x5599cd48dc70 msgr2=0x5599cd5348f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:11.776 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.774+0000 7fbe7aff5700 0 client.26227 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:11.779 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T12:01:11.779 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T12:01:11.779 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T12:01:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T12:01:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.776+0000 7fbea9234b80 1 -- 172.21.15.73:0/1636442481 shutdown_connections 2023-08-10T12:01:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.777+0000 7fbea9234b80 1 -- 172.21.15.73:0/1636442481 wait complete. 2023-08-10T12:01:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.778+0000 7fbea9234b80 20 client.26227 trim_cache size 0 max 16384 2023-08-10T12:01:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.781+0000 7fbe9d09b700 1 -- 172.21.15.73:0/3832328842 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fbe800a1450 msgr2=0x7fbe800a3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.781+0000 7fbe9d09b700 1 --2- 172.21.15.73:0/3832328842 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fbe800a1450 0x7fbe800a3910 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbe88006b30 tx=0x7fbe88006ac0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.782+0000 7fbe9d09b700 1 -- 172.21.15.73:0/3832328842 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe9810f330 msgr2=0x7fbe981a5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.782+0000 7fbe9d09b700 1 --2- 172.21.15.73:0/3832328842 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe9810f330 0x7fbe981a5cd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000bd40 tx=0x7fbe9000bd70 comp rx=0 tx=0).stop 2023-08-10T12:01:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.782+0000 7fbe9d09b700 1 -- 172.21.15.73:0/3832328842 shutdown_connections 2023-08-10T12:01:11.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.782+0000 7fbe9d09b700 1 --2- 172.21.15.73:0/3832328842 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fbe800a1450 0x7fbe800a3910 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.782+0000 7fbe9d09b700 1 --2- 172.21.15.73:0/3832328842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe9810eec0 0x7fbe981a5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.782+0000 7fbe9d09b700 1 --2- 172.21.15.73:0/3832328842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe98119f50 0x7fbe981aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.782+0000 7fbe9d09b700 1 --2- 172.21.15.73:0/3832328842 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe9810f330 0x7fbe981a5cd0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:11.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.782+0000 7fbe9d09b700 1 -- 172.21.15.73:0/3832328842 >> 172.21.15.73:0/3832328842 conn(0x7fbe9806c830 msgr2=0x7fbe98117f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.784+0000 7fbe9d09b700 1 -- 172.21.15.73:0/3832328842 shutdown_connections 2023-08-10T12:01:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:11.784+0000 7fbe9d09b700 1 -- 172.21.15.73:0/3832328842 wait complete. 2023-08-10T12:01:13.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:13 smithi152 ceph-mon[130220]: pgmap v265: 97 pgs: 5 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 88 active+clean; 1.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 284 op/s 2023-08-10T12:01:13.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:13 smithi156 ceph-mon[130574]: pgmap v265: 97 pgs: 5 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 88 active+clean; 1.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 284 op/s 2023-08-10T12:01:13.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:13 smithi073 ceph-mon[128869]: pgmap v265: 97 pgs: 5 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 88 active+clean; 1.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 284 op/s 2023-08-10T12:01:15.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:14 smithi152 ceph-mon[130220]: pgmap v266: 97 pgs: 20 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 65 active+clean; 1.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 272 op/s 2023-08-10T12:01:15.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:14 smithi156 ceph-mon[130574]: pgmap v266: 97 pgs: 20 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 65 active+clean; 1.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 272 op/s 2023-08-10T12:01:15.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:14 smithi073 ceph-mon[128869]: pgmap v266: 97 pgs: 20 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 65 active+clean; 1.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 272 op/s 2023-08-10T12:01:17.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:17 smithi152 ceph-mon[130220]: pgmap v267: 97 pgs: 33 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 47 active+clean; 1.9 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 234 op/s 2023-08-10T12:01:17.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:17 smithi156 ceph-mon[130574]: pgmap v267: 97 pgs: 33 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 47 active+clean; 1.9 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 234 op/s 2023-08-10T12:01:17.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:17 smithi073 ceph-mon[128869]: pgmap v267: 97 pgs: 33 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 47 active+clean; 1.9 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 234 op/s 2023-08-10T12:01:19.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:19 smithi152 ceph-mon[130220]: pgmap v268: 97 pgs: 29 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 53 active+clean; 1.9 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 229 op/s 2023-08-10T12:01:19.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:19 smithi156 ceph-mon[130574]: pgmap v268: 97 pgs: 29 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 53 active+clean; 1.9 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 229 op/s 2023-08-10T12:01:19.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:19 smithi073 ceph-mon[128869]: pgmap v268: 97 pgs: 29 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 53 active+clean; 1.9 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 229 op/s 2023-08-10T12:01:21.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:21 smithi152 ceph-mon[130220]: pgmap v269: 97 pgs: 97 active+clean; 1.9 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 183 op/s 2023-08-10T12:01:21.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:21 smithi156 ceph-mon[130574]: pgmap v269: 97 pgs: 97 active+clean; 1.9 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 183 op/s 2023-08-10T12:01:21.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:21 smithi073 ceph-mon[128869]: pgmap v269: 97 pgs: 97 active+clean; 1.9 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 183 op/s 2023-08-10T12:01:23.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:23 smithi152 ceph-mon[130220]: pgmap v270: 97 pgs: 97 active+clean; 1.9 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 166 op/s 2023-08-10T12:01:23.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:23 smithi156 ceph-mon[130574]: pgmap v270: 97 pgs: 97 active+clean; 1.9 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 166 op/s 2023-08-10T12:01:23.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:23 smithi073 ceph-mon[128869]: pgmap v270: 97 pgs: 97 active+clean; 1.9 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 166 op/s 2023-08-10T12:01:24.672 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T12:01:24.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.800+0000 7fa2b6b81700 1 -- 172.21.15.73:0/1705963598 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2b0104a70 msgr2=0x7fa2b0104f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:24.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.800+0000 7fa2b6b81700 1 --2- 172.21.15.73:0/1705963598 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2b0104a70 0x7fa2b0104f20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009990 tx=0x7fa2a4009ca0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.801+0000 7fa2b6b81700 1 -- 172.21.15.73:0/1705963598 shutdown_connections 2023-08-10T12:01:24.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.801+0000 7fa2b6b81700 1 --2- 172.21.15.73:0/1705963598 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2b0104a70 0x7fa2b0104f20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.801+0000 7fa2b6b81700 1 --2- 172.21.15.73:0/1705963598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2b00ff670 0x7fa2b00ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.801+0000 7fa2b6b81700 1 --2- 172.21.15.73:0/1705963598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2b00fff90 0x7fa2b0104450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.801+0000 7fa2b6b81700 1 -- 172.21.15.73:0/1705963598 >> 172.21.15.73:0/1705963598 conn(0x7fa2b00fb0c0 msgr2=0x7fa2b00fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:24.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.801+0000 7fa2b6b81700 1 -- 172.21.15.73:0/1705963598 shutdown_connections 2023-08-10T12:01:24.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.801+0000 7fa2b6b81700 1 -- 172.21.15.73:0/1705963598 wait complete. 2023-08-10T12:01:24.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.801+0000 7fa2b6b81700 1 Processor -- start 2023-08-10T12:01:24.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.801+0000 7fa2b6b81700 1 -- start start 2023-08-10T12:01:24.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.802+0000 7fa2b6b81700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2b00ff670 0x7fa2b019cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.802+0000 7fa2b6b81700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2b00fff90 0x7fa2b019d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.802+0000 7fa2b6b81700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2b0104a70 0x7fa2b01a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.802+0000 7fa2b6b81700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b01a1e80 con 0x7fa2b00fff90 2023-08-10T12:01:24.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.802+0000 7fa2b6b81700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b01a1ff0 con 0x7fa2b00ff670 2023-08-10T12:01:24.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.802+0000 7fa2b6b81700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b01a21b0 con 0x7fa2b0104a70 2023-08-10T12:01:24.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.802+0000 7fa2affff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2b00fff90 0x7fa2b019d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:24.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.802+0000 7fa2affff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2b00fff90 0x7fa2b019d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36068/0 (socket says 172.21.15.73:36068) 2023-08-10T12:01:24.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.802+0000 7fa2affff700 1 -- 172.21.15.73:0/3931078105 learned_addr learned my addr 172.21.15.73:0/3931078105 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:24.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.802+0000 7fa2b511e700 1 --2- 172.21.15.73:0/3931078105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2b0104a70 0x7fa2b01a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:24.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.802+0000 7fa2affff700 1 -- 172.21.15.73:0/3931078105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2b0104a70 msgr2=0x7fa2b01a1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:24.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.802+0000 7fa2affff700 1 --2- 172.21.15.73:0/3931078105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2b0104a70 0x7fa2b01a1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.802+0000 7fa2affff700 1 -- 172.21.15.73:0/3931078105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2b00ff670 msgr2=0x7fa2b019cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:24.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.802+0000 7fa2affff700 1 --2- 172.21.15.73:0/3931078105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2b00ff670 0x7fa2b019cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.802+0000 7fa2affff700 1 -- 172.21.15.73:0/3931078105 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a40095f0 con 0x7fa2b00fff90 2023-08-10T12:01:24.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.803+0000 7fa2affff700 1 --2- 172.21.15.73:0/3931078105 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2b00fff90 0x7fa2b019d3e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000d950 tx=0x7fa2a000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:24.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.803+0000 7fa2adffb700 1 -- 172.21.15.73:0/3931078105 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0009930 con 0x7fa2b00fff90 2023-08-10T12:01:24.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.803+0000 7fa2b6b81700 1 -- 172.21.15.73:0/3931078105 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b01a2490 con 0x7fa2b00fff90 2023-08-10T12:01:24.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.803+0000 7fa2adffb700 1 -- 172.21.15.73:0/3931078105 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2a0010460 con 0x7fa2b00fff90 2023-08-10T12:01:24.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.803+0000 7fa2adffb700 1 -- 172.21.15.73:0/3931078105 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a000f620 con 0x7fa2b00fff90 2023-08-10T12:01:24.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.803+0000 7fa2b6b81700 1 -- 172.21.15.73:0/3931078105 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b01a9cd0 con 0x7fa2b00fff90 2023-08-10T12:01:24.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.807+0000 7fa2adffb700 1 -- 172.21.15.73:0/3931078105 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fa2a0010860 con 0x7fa2b00fff90 2023-08-10T12:01:24.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.808+0000 7fa2c2d1ab80 1 Processor -- start 2023-08-10T12:01:24.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.808+0000 7fa2c2d1ab80 1 -- start start 2023-08-10T12:01:24.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.808+0000 7fa2c2d1ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b7974cf50 0x562b7974d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.808+0000 7fa2c2d1ab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b7974d870 0x562b797472c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.808+0000 7fa2c2d1ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b79747800 0x562b79747c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.808+0000 7fa2c2d1ab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b796c2dc0 con 0x562b7974d870 2023-08-10T12:01:24.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.808+0000 7fa2c2d1ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b7969f590 con 0x562b79747800 2023-08-10T12:01:24.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.808+0000 7fa2c2d1ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b7969ceb0 con 0x562b7974cf50 2023-08-10T12:01:24.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.808+0000 7fa2adffb700 1 --2- 172.21.15.73:0/3931078105 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa2980a1340 0x7fa2980a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.809+0000 7fa2b511e700 1 --2- 172.21.15.73:0/3931078105 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa2980a1340 0x7fa2980a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:24.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.809+0000 7fa2b491d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b7974d870 0x562b797472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:24.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.809+0000 7fa2adffb700 1 -- 172.21.15.73:0/3931078105 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa2a00ccaf0 con 0x7fa2b00fff90 2023-08-10T12:01:24.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.809+0000 7fa2b491d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b7974d870 0x562b797472c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36074/0 (socket says 172.21.15.73:36074) 2023-08-10T12:01:24.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.809+0000 7fa2b511e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b7974cf50 0x562b7974d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:24.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.809+0000 7fa2b491d700 1 -- 172.21.15.73:0/2753759358 learned_addr learned my addr 172.21.15.73:0/2753759358 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:24.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.809+0000 7fa2b491d700 1 -- 172.21.15.73:0/2753759358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b7974cf50 msgr2=0x562b7974d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:24.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.809+0000 7fa2b491d700 1 --2- 172.21.15.73:0/2753759358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b7974cf50 0x562b7974d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.809+0000 7fa2b491d700 1 -- 172.21.15.73:0/2753759358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b79747800 msgr2=0x562b79747c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T12:01:24.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.809+0000 7fa2b491d700 1 --2- 172.21.15.73:0/2753759358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b79747800 0x562b79747c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.809+0000 7fa2b491d700 1 -- 172.21.15.73:0/2753759358 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b79519630 con 0x562b7974d870 2023-08-10T12:01:24.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.809+0000 7fa2b511e700 1 --2- 172.21.15.73:0/2753759358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b7974cf50 0x562b7974d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:01:24.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.809+0000 7fa2b491d700 1 --2- 172.21.15.73:0/2753759358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b7974d870 0x562b797472c0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8009d80 tx=0x7fa2a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc095e11c5f7fe5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:24.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.809+0000 7fa2b511e700 1 --2- 172.21.15.73:0/3931078105 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa2980a1340 0x7fa2980a3800 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa2a400a010 tx=0x7fa2a4009ee0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:24.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.810+0000 7fa296ffd700 1 -- 172.21.15.73:0/2753759358 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a800e070 con 0x562b7974d870 2023-08-10T12:01:24.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.810+0000 7fa296ffd700 1 -- 172.21.15.73:0/2753759358 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2a8012430 con 0x562b7974d870 2023-08-10T12:01:24.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.810+0000 7fa296ffd700 1 -- 172.21.15.73:0/2753759358 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a80115f0 con 0x562b7974d870 2023-08-10T12:01:24.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.812+0000 7fa2c2d1ab80 1 -- 172.21.15.73:0/2753759358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b7974d870 msgr2=0x562b797472c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:24.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.812+0000 7fa2c2d1ab80 1 --2- 172.21.15.73:0/2753759358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b7974d870 0x562b797472c0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8009d80 tx=0x7fa2a800b330 comp rx=0 tx=0).stop 2023-08-10T12:01:24.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.812+0000 7fa2c2d1ab80 1 -- 172.21.15.73:0/2753759358 shutdown_connections 2023-08-10T12:01:24.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.812+0000 7fa2c2d1ab80 1 --2- 172.21.15.73:0/2753759358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b79747800 0x562b79747c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.812+0000 7fa2c2d1ab80 1 --2- 172.21.15.73:0/2753759358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b7974cf50 0x562b7974d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.812+0000 7fa2c2d1ab80 1 --2- 172.21.15.73:0/2753759358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b7974d870 0x562b797472c0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.812+0000 7fa2c2d1ab80 1 -- 172.21.15.73:0/2753759358 >> 172.21.15.73:0/2753759358 conn(0x562b796a4cd0 msgr2=0x562b797424d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:24.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.812+0000 7fa2c2d1ab80 1 -- 172.21.15.73:0/2753759358 shutdown_connections 2023-08-10T12:01:24.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.813+0000 7fa2c2d1ab80 1 -- 172.21.15.73:0/2753759358 wait complete. 2023-08-10T12:01:24.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.813+0000 7fa2c2d1ab80 1 -- start start 2023-08-10T12:01:24.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.813+0000 7fa2c2d1ab80 1 Processor -- start 2023-08-10T12:01:24.817 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:24 smithi073 ceph-mon[128869]: osdmap e92: 12 total, 12 up, 12 in 2023-08-10T12:01:24.817 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:24 smithi073 ceph-mon[128869]: pgmap v272: 97 pgs: 97 active+clean; 1.9 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 201 op/s 2023-08-10T12:01:24.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.813+0000 7fa2c2d1ab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b79747800 0x562b79750c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.813+0000 7fa2c2d1ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b7974cf50 0x562b797511b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.814+0000 7fa2c2d1ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b7974d870 0x562b797516f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.814+0000 7fa2c2d1ab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b796987a0 con 0x562b79747800 2023-08-10T12:01:24.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.814+0000 7fa2c2d1ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b79637ac0 con 0x562b7974cf50 2023-08-10T12:01:24.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.814+0000 7fa2c2d1ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b796377c0 con 0x562b7974d870 2023-08-10T12:01:24.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.814+0000 7fa2c2d1ab80 10 client.0 _ll_register_callbacks cb 0x562b79635680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:01:24.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.814+0000 7fa2b491d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b79747800 0x562b79750c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:24.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.814+0000 7fa2b511e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b7974d870 0x562b797516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:24.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.814+0000 7fa2b491d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b79747800 0x562b79750c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36082/0 (socket says 172.21.15.73:36082) 2023-08-10T12:01:24.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.814+0000 7fa2b491d700 1 -- 172.21.15.73:0/4137678219 learned_addr learned my addr 172.21.15.73:0/4137678219 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:24.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.814+0000 7fa2affff700 1 --2- 172.21.15.73:0/4137678219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b7974cf50 0x562b797511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:24.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.814+0000 7fa2b491d700 1 -- 172.21.15.73:0/4137678219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b7974d870 msgr2=0x562b797516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:24.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.814+0000 7fa2b491d700 1 --2- 172.21.15.73:0/4137678219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b7974d870 0x562b797516f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.814+0000 7fa2b491d700 1 -- 172.21.15.73:0/4137678219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b7974cf50 msgr2=0x562b797511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:24.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.814+0000 7fa2b491d700 1 --2- 172.21.15.73:0/4137678219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b7974cf50 0x562b797511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.814+0000 7fa2b491d700 1 -- 172.21.15.73:0/4137678219 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a4020040 con 0x562b79747800 2023-08-10T12:01:24.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.814+0000 7fa2b511e700 1 --2- 172.21.15.73:0/4137678219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b7974d870 0x562b797516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:01:24.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.814+0000 7fa2affff700 1 --2- 172.21.15.73:0/4137678219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b7974cf50 0x562b797511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T12:01:24.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.814+0000 7fa2b491d700 1 --2- 172.21.15.73:0/4137678219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b79747800 0x562b79750c70 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800bdd0 tx=0x7fa2a800be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c2112baee27f9b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:24.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.814+0000 7fa28ffff700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:01:24.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.815+0000 7fa28ffff700 1 -- 172.21.15.73:0/4137678219 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a800e040 con 0x562b79747800 2023-08-10T12:01:24.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.815+0000 7fa28ffff700 1 -- 172.21.15.73:0/4137678219 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa2a801b830 con 0x562b79747800 2023-08-10T12:01:24.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.815+0000 7fa2c2d1ab80 1 -- 172.21.15.73:0/4137678219 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b7973a470 con 0x562b79747800 2023-08-10T12:01:24.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.819+0000 7fa28ffff700 1 -- 172.21.15.73:0/4137678219 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2a8009450 con 0x562b79747800 2023-08-10T12:01:24.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.819+0000 7fa2c2d1ab80 10 client.16764 fetch_fsmap learned FSMap version 53 2023-08-10T12:01:24.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.819+0000 7fa2c2d1ab80 1 -- 172.21.15.73:0/4137678219 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x7fa2a8009a30 con 0x562b79747800 2023-08-10T12:01:24.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.820+0000 7fa28ffff700 1 -- 172.21.15.73:0/4137678219 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562b7973a470 con 0x562b79747800 2023-08-10T12:01:24.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.821+0000 7fa28ffff700 1 -- 172.21.15.73:0/4137678219 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 53) v1 ==== 6985+0+0 (secure 0 0 0) 0x7fa2a801a9f0 con 0x562b79747800 2023-08-10T12:01:24.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.821+0000 7fa2c2d1ab80 10 client.16764 fetch_fsmap finished waiting for FSMap version 53 2023-08-10T12:01:24.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.821+0000 7fa2c2d1ab80 10 client.16764 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T12:01:24.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.821+0000 7fa2c2d1ab80 20 client.16764 populate_metadata read hostname 'smithi073' 2023-08-10T12:01:24.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.821+0000 7fa2c2d1ab80 1 --2- 172.21.15.73:0/4137678219 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x562b797611e0 0x562b79763600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.821+0000 7fa2c2d1ab80 4 client.16764 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:01:24.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.821+0000 7fa2c2d1ab80 1 -- 172.21.15.73:0/4137678219 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562b797169d0 con 0x562b797611e0 2023-08-10T12:01:24.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.821+0000 7fa2affff700 1 --2- 172.21.15.73:0/4137678219 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x562b797611e0 0x562b79763600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:24.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.822+0000 7fa28ffff700 10 client.16764 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:24.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.822+0000 7fa2affff700 1 --2- 172.21.15.73:0/4137678219 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x562b797611e0 0x562b79763600 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b242577f7a3836 server_cookie=c81c52a9567fbd9a in_seq=0 out_seq=0 2023-08-10T12:01:24.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.822+0000 7fa28ffff700 1 -- 172.21.15.73:0/4137678219 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x562b797169d0 con 0x562b797611e0 2023-08-10T12:01:24.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.822+0000 7fa28ffff700 10 client.16764 handle_command_reply: tid=0 2023-08-10T12:01:24.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.822+0000 7fa2c2d1ab80 1 client.16764 shutdown 2023-08-10T12:01:24.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.823+0000 7fa2c2d1ab80 1 -- 172.21.15.73:0/4137678219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b79747800 msgr2=0x562b79750c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:24.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.823+0000 7fa2c2d1ab80 1 --2- 172.21.15.73:0/4137678219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b79747800 0x562b79750c70 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800bdd0 tx=0x7fa2a800be00 comp rx=0 tx=0).stop 2023-08-10T12:01:24.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.824+0000 7fa2c2d1ab80 1 -- 172.21.15.73:0/4137678219 shutdown_connections 2023-08-10T12:01:24.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.824+0000 7fa2c2d1ab80 1 --2- 172.21.15.73:0/4137678219 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x562b797611e0 0x562b79763600 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.824+0000 7fa2c2d1ab80 1 --2- 172.21.15.73:0/4137678219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b7974d870 0x562b797516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.824+0000 7fa28ffff700 0 client.16764 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:24.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.824+0000 7fa2c2d1ab80 1 --2- 172.21.15.73:0/4137678219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b79747800 0x562b79750c70 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.824+0000 7fa2c2d1ab80 1 --2- 172.21.15.73:0/4137678219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b7974cf50 0x562b797511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.824+0000 7fa2c2d1ab80 1 -- 172.21.15.73:0/4137678219 >> 172.21.15.73:0/4137678219 conn(0x562b796a4cd0 msgr2=0x562b797419b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:24.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.824+0000 7fa2c2d1ab80 1 -- 172.21.15.73:0/4137678219 shutdown_connections 2023-08-10T12:01:24.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.824+0000 7fa2c2d1ab80 1 -- 172.21.15.73:0/4137678219 wait complete. 2023-08-10T12:01:24.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.824+0000 7fa2c2d1ab80 20 client.16764 trim_cache size 0 max 16384 2023-08-10T12:01:24.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.849+0000 7fa2c2d1ab80 1 Processor -- start 2023-08-10T12:01:24.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.849+0000 7fa2c2d1ab80 1 -- start start 2023-08-10T12:01:24.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.849+0000 7fa2c2d1ab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b79747800 0x562b797472c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.849+0000 7fa2c2d1ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b7974cf50 0x562b79758360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.849+0000 7fa2c2d1ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b7974d870 0x562b79751570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.849+0000 7fa2c2d1ab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b7951b920 con 0x562b79747800 2023-08-10T12:01:24.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.849+0000 7fa2c2d1ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b79716a00 con 0x562b7974d870 2023-08-10T12:01:24.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.849+0000 7fa2c2d1ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b79753e90 con 0x562b7974cf50 2023-08-10T12:01:24.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.850+0000 7fa2b491d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b79747800 0x562b797472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:24.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.850+0000 7fa2b491d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b79747800 0x562b797472c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36090/0 (socket says 172.21.15.73:36090) 2023-08-10T12:01:24.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.850+0000 7fa2b491d700 1 -- 172.21.15.73:0/3210934112 learned_addr learned my addr 172.21.15.73:0/3210934112 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:24.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.850+0000 7fa2b491d700 1 -- 172.21.15.73:0/3210934112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b7974cf50 msgr2=0x562b79758360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:24.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.850+0000 7fa2b491d700 1 --2- 172.21.15.73:0/3210934112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b7974cf50 0x562b79758360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.850+0000 7fa2b491d700 1 -- 172.21.15.73:0/3210934112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b7974d870 msgr2=0x562b79751570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T12:01:24.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.850+0000 7fa2b491d700 1 --2- 172.21.15.73:0/3210934112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b7974d870 0x562b79751570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.850+0000 7fa2b491d700 1 -- 172.21.15.73:0/3210934112 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b794c5de0 con 0x562b79747800 2023-08-10T12:01:24.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.851+0000 7fa2b491d700 1 --2- 172.21.15.73:0/3210934112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b79747800 0x562b797472c0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800bda0 tx=0x7fa2a8009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24f9756c576083e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:24.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.851+0000 7fa2977fe700 1 -- 172.21.15.73:0/3210934112 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a800e040 con 0x562b79747800 2023-08-10T12:01:24.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.851+0000 7fa2977fe700 1 -- 172.21.15.73:0/3210934112 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2a802f290 con 0x562b79747800 2023-08-10T12:01:24.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.851+0000 7fa2977fe700 1 -- 172.21.15.73:0/3210934112 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a801a5e0 con 0x562b79747800 2023-08-10T12:01:24.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.852+0000 7fa2c2d1ab80 1 -- 172.21.15.73:0/3210934112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b79747800 msgr2=0x562b797472c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:24.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.852+0000 7fa2c2d1ab80 1 --2- 172.21.15.73:0/3210934112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b79747800 0x562b797472c0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800bda0 tx=0x7fa2a8009ed0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.852+0000 7fa2c2d1ab80 1 -- 172.21.15.73:0/3210934112 shutdown_connections 2023-08-10T12:01:24.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.852+0000 7fa2c2d1ab80 1 --2- 172.21.15.73:0/3210934112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b7974d870 0x562b79751570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.852+0000 7fa2c2d1ab80 1 --2- 172.21.15.73:0/3210934112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b79747800 0x562b797472c0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.852+0000 7fa2c2d1ab80 1 --2- 172.21.15.73:0/3210934112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b7974cf50 0x562b79758360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.852+0000 7fa2c2d1ab80 1 -- 172.21.15.73:0/3210934112 >> 172.21.15.73:0/3210934112 conn(0x562b796a4cd0 msgr2=0x562b7974c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:24.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.852+0000 7fa2c2d1ab80 1 -- 172.21.15.73:0/3210934112 shutdown_connections 2023-08-10T12:01:24.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.852+0000 7fa2c2d1ab80 1 -- 172.21.15.73:0/3210934112 wait complete. 2023-08-10T12:01:24.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.852+0000 7fa2c2d1ab80 1 -- start start 2023-08-10T12:01:24.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.853+0000 7fa2c2d1ab80 1 Processor -- start 2023-08-10T12:01:24.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.853+0000 7fa2c2d1ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b79747800 0x562b79757e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.853+0000 7fa2c2d1ab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b7974cf50 0x562b79756120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.853+0000 7fa2c2d1ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b7974d870 0x562b79756660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.853+0000 7fa2c2d1ab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b79756ba0 con 0x562b7974cf50 2023-08-10T12:01:24.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.853+0000 7fa2c2d1ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b79756d10 con 0x562b79747800 2023-08-10T12:01:24.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.853+0000 7fa2c2d1ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b79756ed0 con 0x562b7974d870 2023-08-10T12:01:24.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.853+0000 7fa2c2d1ab80 10 client.0 _ll_register_callbacks cb 0x562b79635680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:01:24.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.853+0000 7fa2affff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b7974cf50 0x562b79756120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:24.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.853+0000 7fa2affff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b7974cf50 0x562b79756120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36096/0 (socket says 172.21.15.73:36096) 2023-08-10T12:01:24.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.853+0000 7fa2affff700 1 -- 172.21.15.73:0/1527185087 learned_addr learned my addr 172.21.15.73:0/1527185087 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:24.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.853+0000 7fa2b491d700 1 --2- 172.21.15.73:0/1527185087 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b79747800 0x562b79757e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:24.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.854+0000 7fa2b511e700 1 --2- 172.21.15.73:0/1527185087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b7974d870 0x562b79756660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:24.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.854+0000 7fa2affff700 1 -- 172.21.15.73:0/1527185087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b7974d870 msgr2=0x562b79756660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:24.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.854+0000 7fa2affff700 1 --2- 172.21.15.73:0/1527185087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b7974d870 0x562b79756660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.854+0000 7fa2affff700 1 -- 172.21.15.73:0/1527185087 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b79747800 msgr2=0x562b79757e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:24.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.854+0000 7fa2affff700 1 --2- 172.21.15.73:0/1527185087 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b79747800 0x562b79757e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.854+0000 7fa2affff700 1 -- 172.21.15.73:0/1527185087 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a8009a30 con 0x562b7974cf50 2023-08-10T12:01:24.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.854+0000 7fa2affff700 1 --2- 172.21.15.73:0/1527185087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b7974cf50 0x562b79756120 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0096060 tx=0x7fa2a0010f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9669e8352c72e5cc server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:24.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.854+0000 7fa28ffff700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:01:24.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.854+0000 7fa28ffff700 1 -- 172.21.15.73:0/1527185087 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a00a1fb0 con 0x562b7974cf50 2023-08-10T12:01:24.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.854+0000 7fa28ffff700 1 -- 172.21.15.73:0/1527185087 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa2a00b9040 con 0x562b7974cf50 2023-08-10T12:01:24.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.854+0000 7fa2c2d1ab80 1 -- 172.21.15.73:0/1527185087 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa2a8012430 con 0x562b7974cf50 2023-08-10T12:01:24.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.854+0000 7fa28ffff700 1 -- 172.21.15.73:0/1527185087 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2a00510b0 con 0x562b7974cf50 2023-08-10T12:01:24.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.854+0000 7fa2c2d1ab80 10 client.16770 fetch_fsmap learned FSMap version 53 2023-08-10T12:01:24.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.854+0000 7fa2c2d1ab80 1 -- 172.21.15.73:0/1527185087 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x562b794aec60 con 0x562b7974cf50 2023-08-10T12:01:24.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.855+0000 7fa28ffff700 1 -- 172.21.15.73:0/1527185087 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2a00b6020 con 0x562b7974cf50 2023-08-10T12:01:24.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.855+0000 7fa28ffff700 1 -- 172.21.15.73:0/1527185087 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 53) v1 ==== 6985+0+0 (secure 0 0 0) 0x7fa2a0099050 con 0x562b7974cf50 2023-08-10T12:01:24.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.855+0000 7fa2c2d1ab80 10 client.16770 fetch_fsmap finished waiting for FSMap version 53 2023-08-10T12:01:24.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.855+0000 7fa2c2d1ab80 10 client.16770 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T12:01:24.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.855+0000 7fa2c2d1ab80 20 client.16770 populate_metadata read hostname 'smithi073' 2023-08-10T12:01:24.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.855+0000 7fa2c2d1ab80 1 --2- 172.21.15.73:0/1527185087 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x562b797b6320 0x562b797b8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.855+0000 7fa2c2d1ab80 4 client.16770 mds_command: new command op to 24503 tid=0[{"prefix": "scrub status"}] 2023-08-10T12:01:24.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.855+0000 7fa2c2d1ab80 1 -- 172.21.15.73:0/1527185087 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562b79691780 con 0x562b797b6320 2023-08-10T12:01:24.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.855+0000 7fa2b491d700 1 --2- 172.21.15.73:0/1527185087 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x562b797b6320 0x562b797b8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:24.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.856+0000 7fa28ffff700 10 client.16770 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:24.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.856+0000 7fa2b491d700 1 --2- 172.21.15.73:0/1527185087 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x562b797b6320 0x562b797b8740 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e98b0653a68b7f1 server_cookie=992562346611a94f in_seq=0 out_seq=0 2023-08-10T12:01:24.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.856+0000 7fa28ffff700 1 -- 172.21.15.73:0/1527185087 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x562b79691780 con 0x562b797b6320 2023-08-10T12:01:24.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.856+0000 7fa28ffff700 10 client.16770 handle_command_reply: tid=0 2023-08-10T12:01:24.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.856+0000 7fa2c2d1ab80 1 client.16770 shutdown 2023-08-10T12:01:24.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.859+0000 7fa2c2d1ab80 1 -- 172.21.15.73:0/1527185087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b7974cf50 msgr2=0x562b79756120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:24.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.859+0000 7fa2c2d1ab80 1 --2- 172.21.15.73:0/1527185087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b7974cf50 0x562b79756120 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0096060 tx=0x7fa2a0010f60 comp rx=0 tx=0).stop 2023-08-10T12:01:24.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.859+0000 7fa2c2d1ab80 1 -- 172.21.15.73:0/1527185087 shutdown_connections 2023-08-10T12:01:24.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.859+0000 7fa2c2d1ab80 1 --2- 172.21.15.73:0/1527185087 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x562b797b6320 0x562b797b8740 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.859+0000 7fa2c2d1ab80 1 --2- 172.21.15.73:0/1527185087 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562b79747800 0x562b79757e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.859+0000 7fa2c2d1ab80 1 --2- 172.21.15.73:0/1527185087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b7974d870 0x562b79756660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.859+0000 7fa28ffff700 0 client.16770 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:24.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.859+0000 7fa2c2d1ab80 1 --2- 172.21.15.73:0/1527185087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562b7974cf50 0x562b79756120 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.859+0000 7fa2c2d1ab80 1 -- 172.21.15.73:0/1527185087 >> 172.21.15.73:0/1527185087 conn(0x562b796a4cd0 msgr2=0x562b79751230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:24.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.859+0000 7fa2c2d1ab80 1 -- 172.21.15.73:0/1527185087 shutdown_connections 2023-08-10T12:01:24.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.859+0000 7fa2c2d1ab80 1 -- 172.21.15.73:0/1527185087 wait complete. 2023-08-10T12:01:24.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.859+0000 7fa2c2d1ab80 20 client.16770 trim_cache size 0 max 16384 2023-08-10T12:01:24.867 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T12:01:24.867 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T12:01:24.867 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": { 2023-08-10T12:01:24.867 INFO:teuthology.orchestra.run.smithi073.stdout: "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d": { 2023-08-10T12:01:24.867 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2023-08-10T12:01:24.867 INFO:teuthology.orchestra.run.smithi073.stdout: "tag": "9d39b3fa-9b62-42b4-b1a5-738cb3118a5d", 2023-08-10T12:01:24.868 INFO:teuthology.orchestra.run.smithi073.stdout: "options": "recursive,force" 2023-08-10T12:01:24.868 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:01:24.868 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:01:24.868 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T12:01:24.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.860+0000 7fa2b6b81700 1 -- 172.21.15.73:0/3931078105 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa2980a1340 msgr2=0x7fa2980a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:24.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.860+0000 7fa2b6b81700 1 --2- 172.21.15.73:0/3931078105 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa2980a1340 0x7fa2980a3800 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa2a400a010 tx=0x7fa2a4009ee0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.860+0000 7fa2b6b81700 1 -- 172.21.15.73:0/3931078105 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2b00fff90 msgr2=0x7fa2b019d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:24.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.860+0000 7fa2b6b81700 1 --2- 172.21.15.73:0/3931078105 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2b00fff90 0x7fa2b019d3e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000d950 tx=0x7fa2a000dc60 comp rx=0 tx=0).stop 2023-08-10T12:01:24.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.860+0000 7fa2b6b81700 1 -- 172.21.15.73:0/3931078105 shutdown_connections 2023-08-10T12:01:24.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.860+0000 7fa2b6b81700 1 --2- 172.21.15.73:0/3931078105 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa2980a1340 0x7fa2980a3800 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.860+0000 7fa2b6b81700 1 --2- 172.21.15.73:0/3931078105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2b00ff670 0x7fa2b019cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.860+0000 7fa2b6b81700 1 --2- 172.21.15.73:0/3931078105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2b0104a70 0x7fa2b01a1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.860+0000 7fa2b6b81700 1 --2- 172.21.15.73:0/3931078105 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2b00fff90 0x7fa2b019d3e0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.860+0000 7fa2b6b81700 1 -- 172.21.15.73:0/3931078105 >> 172.21.15.73:0/3931078105 conn(0x7fa2b00fb0c0 msgr2=0x7fa2b0102500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:24.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.865+0000 7fa2b6b81700 1 -- 172.21.15.73:0/3931078105 shutdown_connections 2023-08-10T12:01:24.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:24.865+0000 7fa2b6b81700 1 -- 172.21.15.73:0/3931078105 wait complete. 2023-08-10T12:01:24.886 INFO:tasks.cephfs.filesystem:scrub status for tag:9d39b3fa-9b62-42b4-b1a5-738cb3118a5d - {'path': '/', 'tag': '9d39b3fa-9b62-42b4-b1a5-738cb3118a5d', 'options': 'recursive,force'} 2023-08-10T12:01:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.945+0000 7f00645c0700 1 -- 172.21.15.73:0/3285879450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f005c100c20 msgr2=0x7f005c104230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:24.948 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.945+0000 7f00645c0700 1 --2- 172.21.15.73:0/3285879450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f005c100c20 0x7f005c104230 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f004c009990 tx=0x7f004c009ca0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.948 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.945+0000 7f00645c0700 1 -- 172.21.15.73:0/3285879450 shutdown_connections 2023-08-10T12:01:24.948 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.945+0000 7f00645c0700 1 --2- 172.21.15.73:0/3285879450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f005c104910 0x7f005c10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.948 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.945+0000 7f00645c0700 1 --2- 172.21.15.73:0/3285879450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f005c100270 0x7f005c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.948 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.945+0000 7f00645c0700 1 --2- 172.21.15.73:0/3285879450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f005c100c20 0x7f005c104230 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.948 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.945+0000 7f00645c0700 1 -- 172.21.15.73:0/3285879450 >> 172.21.15.73:0/3285879450 conn(0x7f005c075a90 msgr2=0x7f005c075ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:24.949 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.946+0000 7f00645c0700 1 -- 172.21.15.73:0/3285879450 shutdown_connections 2023-08-10T12:01:24.949 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.946+0000 7f00645c0700 1 -- 172.21.15.73:0/3285879450 wait complete. 2023-08-10T12:01:24.950 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.946+0000 7f00645c0700 1 Processor -- start 2023-08-10T12:01:24.950 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.946+0000 7f00645c0700 1 -- start start 2023-08-10T12:01:24.951 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.946+0000 7f00645c0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f005c100270 0x7f005c1956b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.951 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.946+0000 7f00645c0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f005c104910 0x7f005c195bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.951 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.946+0000 7f00645c0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f005c198fa0 0x7f005c199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.951 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.946+0000 7f00645c0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c199990 con 0x7f005c100270 2023-08-10T12:01:24.951 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.946+0000 7f00645c0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c199b00 con 0x7f005c198fa0 2023-08-10T12:01:24.951 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.946+0000 7f00645c0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c199cc0 con 0x7f005c104910 2023-08-10T12:01:24.951 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.947+0000 7f006235c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f005c100270 0x7f005c1956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:24.952 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.947+0000 7f006235c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f005c100270 0x7f005c1956b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36108/0 (socket says 172.21.15.73:36108) 2023-08-10T12:01:24.952 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.947+0000 7f006235c700 1 -- 172.21.15.73:0/380552882 learned_addr learned my addr 172.21.15.73:0/380552882 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:24.952 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.947+0000 7f0061b5b700 1 --2- 172.21.15.73:0/380552882 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f005c104910 0x7f005c195bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:24.952 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.947+0000 7f006235c700 1 -- 172.21.15.73:0/380552882 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f005c104910 msgr2=0x7f005c195bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:24.952 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.947+0000 7f006235c700 1 --2- 172.21.15.73:0/380552882 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f005c104910 0x7f005c195bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.952 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.947+0000 7f006235c700 1 -- 172.21.15.73:0/380552882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f005c198fa0 msgr2=0x7f005c199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:24.952 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.947+0000 7f006235c700 1 --2- 172.21.15.73:0/380552882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f005c198fa0 0x7f005c199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.952 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.947+0000 7f006235c700 1 -- 172.21.15.73:0/380552882 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004c0095f0 con 0x7f005c100270 2023-08-10T12:01:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.947+0000 7f006235c700 1 --2- 172.21.15.73:0/380552882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f005c100270 0x7f005c1956b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f005800d980 tx=0x7f005800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.947+0000 7f00537fe700 1 -- 172.21.15.73:0/380552882 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0058004220 con 0x7f005c100270 2023-08-10T12:01:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.947+0000 7f00537fe700 1 -- 172.21.15.73:0/380552882 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0058007640 con 0x7f005c100270 2023-08-10T12:01:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.947+0000 7f00537fe700 1 -- 172.21.15.73:0/380552882 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0058005610 con 0x7f005c100270 2023-08-10T12:01:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.948+0000 7f00645c0700 1 -- 172.21.15.73:0/380552882 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f005c1a2330 con 0x7f005c100270 2023-08-10T12:01:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.948+0000 7f00645c0700 1 -- 172.21.15.73:0/380552882 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005c1a27c0 con 0x7f005c100270 2023-08-10T12:01:24.957 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.953+0000 7f0070759b80 1 Processor -- start 2023-08-10T12:01:24.957 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.953+0000 7f0070759b80 1 -- start start 2023-08-10T12:01:24.957 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.953+0000 7f0070759b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8d7066800 0x55c8d7066be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.957 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.953+0000 7f0070759b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d7064ff0 0x55c8d7065470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.957 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.953+0000 7f0070759b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c8d70659b0 0x55c8d707ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.953+0000 7f0070759b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d6fe3d60 con 0x55c8d70659b0 2023-08-10T12:01:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.953+0000 7f0070759b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d6fc0530 con 0x55c8d7066800 2023-08-10T12:01:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.953+0000 7f0070759b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d6fbde50 con 0x55c8d7064ff0 2023-08-10T12:01:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.953+0000 7f0061b5b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c8d70659b0 0x55c8d707ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.953+0000 7f0061b5b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c8d70659b0 0x55c8d707ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36116/0 (socket says 172.21.15.73:36116) 2023-08-10T12:01:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.953+0000 7f0061b5b700 1 -- 172.21.15.73:0/2044357203 learned_addr learned my addr 172.21.15.73:0/2044357203 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.953+0000 7f0062b5d700 1 --2- 172.21.15.73:0/2044357203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8d7066800 0x55c8d7066be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.953+0000 7f006235c700 1 --2- 172.21.15.73:0/2044357203 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d7064ff0 0x55c8d7065470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.954+0000 7f0061b5b700 1 -- 172.21.15.73:0/2044357203 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d7064ff0 msgr2=0x55c8d7065470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.954+0000 7f0061b5b700 1 --2- 172.21.15.73:0/2044357203 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d7064ff0 0x55c8d7065470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.954+0000 7f0061b5b700 1 -- 172.21.15.73:0/2044357203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8d7066800 msgr2=0x55c8d7066be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.954+0000 7f0061b5b700 1 --2- 172.21.15.73:0/2044357203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8d7066800 0x55c8d7066be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.954+0000 7f0061b5b700 1 -- 172.21.15.73:0/2044357203 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8d6e3a5d0 con 0x55c8d70659b0 2023-08-10T12:01:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.954+0000 7f0061b5b700 1 --2- 172.21.15.73:0/2044357203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c8d70659b0 0x55c8d707ce70 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f004c006010 tx=0x7f004c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a06496d3564443b4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.954+0000 7f0050ff9700 1 -- 172.21.15.73:0/2044357203 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c01d050 con 0x55c8d70659b0 2023-08-10T12:01:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.954+0000 7f0050ff9700 1 -- 172.21.15.73:0/2044357203 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f004c01e040 con 0x55c8d70659b0 2023-08-10T12:01:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.954+0000 7f0050ff9700 1 -- 172.21.15.73:0/2044357203 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c005360 con 0x55c8d70659b0 2023-08-10T12:01:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.955+0000 7f0070759b80 1 -- 172.21.15.73:0/2044357203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c8d70659b0 msgr2=0x55c8d707ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.955+0000 7f0070759b80 1 --2- 172.21.15.73:0/2044357203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c8d70659b0 0x55c8d707ce70 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f004c006010 tx=0x7f004c009f90 comp rx=0 tx=0).stop 2023-08-10T12:01:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.955+0000 7f0070759b80 1 -- 172.21.15.73:0/2044357203 shutdown_connections 2023-08-10T12:01:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.955+0000 7f0070759b80 1 --2- 172.21.15.73:0/2044357203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8d7066800 0x55c8d7066be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.955+0000 7f0070759b80 1 --2- 172.21.15.73:0/2044357203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c8d70659b0 0x55c8d707ce70 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.955+0000 7f0070759b80 1 --2- 172.21.15.73:0/2044357203 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d7064ff0 0x55c8d7065470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.955+0000 7f0070759b80 1 -- 172.21.15.73:0/2044357203 >> 172.21.15.73:0/2044357203 conn(0x55c8d6fc5c70 msgr2=0x55c8d7062d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.956+0000 7f00537fe700 1 -- 172.21.15.73:0/380552882 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f0058004750 con 0x7f005c100270 2023-08-10T12:01:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.956+0000 7f0070759b80 1 -- 172.21.15.73:0/2044357203 shutdown_connections 2023-08-10T12:01:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.956+0000 7f0070759b80 1 -- 172.21.15.73:0/2044357203 wait complete. 2023-08-10T12:01:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.956+0000 7f0070759b80 1 -- start start 2023-08-10T12:01:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.956+0000 7f0070759b80 1 Processor -- start 2023-08-10T12:01:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.956+0000 7f00537fe700 1 --2- 172.21.15.73:0/380552882 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f00480a1280 0x7f00480a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.956+0000 7f0070759b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c8d7064ff0 0x55c8d70777c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.957+0000 7f0070759b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8d70659b0 0x55c8d7077d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.957+0000 7f0070759b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d7066800 0x55c8d7071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.957+0000 7f0070759b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d6fb9740 con 0x55c8d7064ff0 2023-08-10T12:01:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.957+0000 7f0070759b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d6f58a60 con 0x55c8d70659b0 2023-08-10T12:01:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.957+0000 7f0070759b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d6f58760 con 0x55c8d7066800 2023-08-10T12:01:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.957+0000 7f0070759b80 10 client.0 _ll_register_callbacks cb 0x55c8d6f56620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:01:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.957+0000 7f0062b5d700 1 --2- 172.21.15.73:0/380552882 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f00480a1280 0x7f00480a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.957+0000 7f00537fe700 1 -- 172.21.15.73:0/380552882 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f00580eee60 con 0x7f005c100270 2023-08-10T12:01:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.957+0000 7f0062b5d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d7066800 0x55c8d7071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.957+0000 7f0062b5d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d7066800 0x55c8d7071ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:33396/0 (socket says 172.21.15.73:33396) 2023-08-10T12:01:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.957+0000 7f0062b5d700 1 -- 172.21.15.73:0/1118667229 learned_addr learned my addr 172.21.15.73:0/1118667229 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.957+0000 7f0061b5b700 1 --2- 172.21.15.73:0/1118667229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8d70659b0 0x55c8d7077d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.957+0000 7f0062b5d700 1 --2- 172.21.15.73:0/380552882 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f00480a1280 0x7f00480a3740 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0054013820 tx=0x7f0054013be0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.957+0000 7f0062b5d700 1 -- 172.21.15.73:0/1118667229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8d70659b0 msgr2=0x55c8d7077d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.957+0000 7f0062b5d700 1 --2- 172.21.15.73:0/1118667229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8d70659b0 0x55c8d7077d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.957+0000 7f0062b5d700 1 -- 172.21.15.73:0/1118667229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c8d7064ff0 msgr2=0x55c8d70777c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T12:01:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.957+0000 7f0062b5d700 1 --2- 172.21.15.73:0/1118667229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c8d7064ff0 0x55c8d70777c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.957+0000 7f0062b5d700 1 -- 172.21.15.73:0/1118667229 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005c10cd20 con 0x55c8d7066800 2023-08-10T12:01:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.957+0000 7f0062b5d700 1 --2- 172.21.15.73:0/1118667229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d7066800 0x55c8d7071ac0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0054016ed0 tx=0x7f005401c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69913ef05732b5e7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.957+0000 7f0045ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T12:01:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.958+0000 7f0045ffb700 1 -- 172.21.15.73:0/1118667229 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0054022400 con 0x55c8d7066800 2023-08-10T12:01:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.958+0000 7f0045ffb700 1 -- 172.21.15.73:0/1118667229 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0054022560 con 0x55c8d7066800 2023-08-10T12:01:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.958+0000 7f0070759b80 1 -- 172.21.15.73:0/1118667229 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c8d705b1c0 con 0x55c8d7066800 2023-08-10T12:01:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.958+0000 7f0045ffb700 1 -- 172.21.15.73:0/1118667229 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0054022720 con 0x55c8d7066800 2023-08-10T12:01:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.958+0000 7f0070759b80 10 client.26254 fetch_fsmap learned FSMap version 53 2023-08-10T12:01:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.958+0000 7f0070759b80 1 -- 172.21.15.73:0/1118667229 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x55c8d6de6d80 con 0x55c8d7066800 2023-08-10T12:01:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.958+0000 7f0045ffb700 1 -- 172.21.15.73:0/1118667229 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c8d705b1c0 con 0x55c8d7066800 2023-08-10T12:01:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.958+0000 7f0045ffb700 1 -- 172.21.15.73:0/1118667229 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 53) v1 ==== 6985+0+0 (secure 0 0 0) 0x7f00540189f0 con 0x55c8d7066800 2023-08-10T12:01:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.958+0000 7f0070759b80 10 client.26254 fetch_fsmap finished waiting for FSMap version 53 2023-08-10T12:01:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.958+0000 7f0070759b80 10 client.26254 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:01:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.958+0000 7f0070759b80 20 client.26254 populate_metadata read hostname 'smithi073' 2023-08-10T12:01:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.958+0000 7f0070759b80 1 --2- 172.21.15.73:0/1118667229 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c8d7081d90 0x55c8d70841b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.958+0000 7f0070759b80 4 client.26254 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:01:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.958+0000 7f0070759b80 1 -- 172.21.15.73:0/1118667229 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c8d7037970 con 0x55c8d7081d90 2023-08-10T12:01:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.959+0000 7f006235c700 1 --2- 172.21.15.73:0/1118667229 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c8d7081d90 0x55c8d70841b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.959+0000 7f0045ffb700 10 client.26254 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.959+0000 7f006235c700 1 --2- 172.21.15.73:0/1118667229 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c8d7081d90 0x55c8d70841b0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72df2ae2e7764cb1 server_cookie=586dad602f6de0b3 in_seq=0 out_seq=0 2023-08-10T12:01:24.969 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.962+0000 7f0045ffb700 1 -- 172.21.15.73:0/1118667229 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55c8d7037970 con 0x55c8d7081d90 2023-08-10T12:01:24.969 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.962+0000 7f0045ffb700 10 client.26254 handle_command_reply: tid=0 2023-08-10T12:01:24.969 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.962+0000 7f0070759b80 1 client.26254 shutdown 2023-08-10T12:01:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.962+0000 7f0070759b80 1 -- 172.21.15.73:0/1118667229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d7066800 msgr2=0x55c8d7071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.962+0000 7f0070759b80 1 --2- 172.21.15.73:0/1118667229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d7066800 0x55c8d7071ac0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0054016ed0 tx=0x7f005401c000 comp rx=0 tx=0).stop 2023-08-10T12:01:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.962+0000 7f0070759b80 1 -- 172.21.15.73:0/1118667229 shutdown_connections 2023-08-10T12:01:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.962+0000 7f0070759b80 1 --2- 172.21.15.73:0/1118667229 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c8d7081d90 0x55c8d70841b0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.962+0000 7f0070759b80 1 --2- 172.21.15.73:0/1118667229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d7066800 0x55c8d7071ac0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.962+0000 7f0070759b80 1 --2- 172.21.15.73:0/1118667229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c8d7064ff0 0x55c8d70777c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.962+0000 7f0045ffb700 0 client.26254 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.962+0000 7f0070759b80 1 --2- 172.21.15.73:0/1118667229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8d70659b0 0x55c8d7077d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.962+0000 7f0070759b80 1 -- 172.21.15.73:0/1118667229 >> 172.21.15.73:0/1118667229 conn(0x55c8d6fc5c70 msgr2=0x55c8d70624b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.964+0000 7f0070759b80 1 -- 172.21.15.73:0/1118667229 shutdown_connections 2023-08-10T12:01:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.965+0000 7f0070759b80 1 -- 172.21.15.73:0/1118667229 wait complete. 2023-08-10T12:01:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.965+0000 7f0070759b80 20 client.26254 trim_cache size 0 max 16384 2023-08-10T12:01:24.991 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.987+0000 7f0070759b80 1 Processor -- start 2023-08-10T12:01:24.991 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.987+0000 7f0070759b80 1 -- start start 2023-08-10T12:01:24.991 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.987+0000 7f0070759b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d7064ff0 0x55c8d706b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.991 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.987+0000 7f0070759b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c8d70659b0 0x55c8d7077390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.992 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.987+0000 7f0070759b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8d7066800 0x55c8d70778d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.992 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.987+0000 7f0070759b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d6e3c8c0 con 0x55c8d70659b0 2023-08-10T12:01:24.992 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.987+0000 7f0070759b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d7066460 con 0x55c8d7066800 2023-08-10T12:01:24.992 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.987+0000 7f0070759b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d705adc0 con 0x55c8d7064ff0 2023-08-10T12:01:24.992 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.987+0000 7f0061b5b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c8d70659b0 0x55c8d7077390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:24.992 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.987+0000 7f0061b5b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c8d70659b0 0x55c8d7077390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36130/0 (socket says 172.21.15.73:36130) 2023-08-10T12:01:24.992 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.987+0000 7f0061b5b700 1 -- 172.21.15.73:0/900000754 learned_addr learned my addr 172.21.15.73:0/900000754 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.987+0000 7f006235c700 1 --2- 172.21.15.73:0/900000754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d7064ff0 0x55c8d706b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.987+0000 7f0062b5d700 1 --2- 172.21.15.73:0/900000754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8d7066800 0x55c8d70778d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.987+0000 7f0061b5b700 1 -- 172.21.15.73:0/900000754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d7064ff0 msgr2=0x55c8d706b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.987+0000 7f0061b5b700 1 --2- 172.21.15.73:0/900000754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d7064ff0 0x55c8d706b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.987+0000 7f0061b5b700 1 -- 172.21.15.73:0/900000754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8d7066800 msgr2=0x55c8d70778d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.987+0000 7f0061b5b700 1 --2- 172.21.15.73:0/900000754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8d7066800 0x55c8d70778d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.987+0000 7f0061b5b700 1 -- 172.21.15.73:0/900000754 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8d6dcfc00 con 0x55c8d70659b0 2023-08-10T12:01:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.988+0000 7f0061b5b700 1 --2- 172.21.15.73:0/900000754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c8d70659b0 0x55c8d7077390 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f004c00bbe0 tx=0x7f004c005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e42cd564e7f25 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.988+0000 7f00517fa700 1 -- 172.21.15.73:0/900000754 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c00b9d0 con 0x55c8d70659b0 2023-08-10T12:01:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.988+0000 7f00517fa700 1 -- 172.21.15.73:0/900000754 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f004c003d50 con 0x55c8d70659b0 2023-08-10T12:01:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.988+0000 7f00517fa700 1 -- 172.21.15.73:0/900000754 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c00f460 con 0x55c8d70659b0 2023-08-10T12:01:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.989+0000 7f0070759b80 1 -- 172.21.15.73:0/900000754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c8d70659b0 msgr2=0x55c8d7077390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.989+0000 7f0070759b80 1 --2- 172.21.15.73:0/900000754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c8d70659b0 0x55c8d7077390 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f004c00bbe0 tx=0x7f004c005040 comp rx=0 tx=0).stop 2023-08-10T12:01:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.989+0000 7f0070759b80 1 -- 172.21.15.73:0/900000754 shutdown_connections 2023-08-10T12:01:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.989+0000 7f0070759b80 1 --2- 172.21.15.73:0/900000754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8d7066800 0x55c8d70778d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.989+0000 7f0070759b80 1 --2- 172.21.15.73:0/900000754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d7064ff0 0x55c8d706b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.989+0000 7f0070759b80 1 --2- 172.21.15.73:0/900000754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c8d70659b0 0x55c8d7077390 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.989+0000 7f0070759b80 1 -- 172.21.15.73:0/900000754 >> 172.21.15.73:0/900000754 conn(0x55c8d6fc5c70 msgr2=0x55c8d706b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.989+0000 7f0070759b80 1 -- 172.21.15.73:0/900000754 shutdown_connections 2023-08-10T12:01:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.989+0000 7f0070759b80 1 -- 172.21.15.73:0/900000754 wait complete. 2023-08-10T12:01:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.989+0000 7f0070759b80 1 -- start start 2023-08-10T12:01:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.989+0000 7f0070759b80 1 Processor -- start 2023-08-10T12:01:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.990+0000 7f0070759b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c8d7064ff0 0x55c8d70ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.990+0000 7f0070759b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d70659b0 0x55c8d70ced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.990+0000 7f0070759b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8d7066800 0x55c8d70c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.990+0000 7f0070759b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d70c9150 con 0x55c8d7064ff0 2023-08-10T12:01:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.990+0000 7f0070759b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d70c92c0 con 0x55c8d7066800 2023-08-10T12:01:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.990+0000 7f0070759b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d70c9480 con 0x55c8d70659b0 2023-08-10T12:01:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.990+0000 7f0070759b80 10 client.0 _ll_register_callbacks cb 0x55c8d6f56620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:01:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.990+0000 7f006235c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c8d7064ff0 0x55c8d70ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.990+0000 7f006235c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c8d7064ff0 0x55c8d70ce7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36134/0 (socket says 172.21.15.73:36134) 2023-08-10T12:01:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.990+0000 7f006235c700 1 -- 172.21.15.73:0/361444932 learned_addr learned my addr 172.21.15.73:0/361444932 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.990+0000 7f006235c700 1 -- 172.21.15.73:0/361444932 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d70659b0 msgr2=0x55c8d70ced10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T12:01:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.990+0000 7f006235c700 1 --2- 172.21.15.73:0/361444932 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d70659b0 0x55c8d70ced10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.990+0000 7f006235c700 1 -- 172.21.15.73:0/361444932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8d7066800 msgr2=0x55c8d70c8b70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T12:01:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.990+0000 7f006235c700 1 --2- 172.21.15.73:0/361444932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8d7066800 0x55c8d70c8b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.990+0000 7f006235c700 1 -- 172.21.15.73:0/361444932 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c8d6e3a5d0 con 0x55c8d7064ff0 2023-08-10T12:01:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.991+0000 7f006235c700 1 --2- 172.21.15.73:0/361444932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c8d7064ff0 0x55c8d70ce7d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f005800b540 tx=0x7f00580bc110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4071f742f56969 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.991+0000 7f0045ffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:01:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.991+0000 7f0045ffb700 1 -- 172.21.15.73:0/361444932 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00580bc3f0 con 0x55c8d7064ff0 2023-08-10T12:01:25.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.991+0000 7f0045ffb700 1 -- 172.21.15.73:0/361444932 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f00580bb480 con 0x55c8d7064ff0 2023-08-10T12:01:25.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.991+0000 7f0070759b80 1 -- 172.21.15.73:0/361444932 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f004c01e040 con 0x55c8d7064ff0 2023-08-10T12:01:25.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.991+0000 7f0045ffb700 1 -- 172.21.15.73:0/361444932 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00580da300 con 0x55c8d7064ff0 2023-08-10T12:01:25.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.991+0000 7f0070759b80 10 client.16785 fetch_fsmap learned FSMap version 53 2023-08-10T12:01:25.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.991+0000 7f0070759b80 1 -- 172.21.15.73:0/361444932 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x55c8d6e0d1f0 con 0x55c8d7064ff0 2023-08-10T12:01:25.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.991+0000 7f0045ffb700 1 -- 172.21.15.73:0/361444932 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f004c01e040 con 0x55c8d7064ff0 2023-08-10T12:01:25.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.992+0000 7f0045ffb700 1 -- 172.21.15.73:0/361444932 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 53) v1 ==== 6985+0+0 (secure 0 0 0) 0x7f00580da020 con 0x55c8d7064ff0 2023-08-10T12:01:25.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.992+0000 7f0070759b80 10 client.16785 fetch_fsmap finished waiting for FSMap version 53 2023-08-10T12:01:25.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.992+0000 7f0070759b80 10 client.16785 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:01:25.002 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.992+0000 7f0070759b80 20 client.16785 populate_metadata read hostname 'smithi073' 2023-08-10T12:01:25.002 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.992+0000 7f0070759b80 1 --2- 172.21.15.73:0/361444932 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c8d70d6660 0x55c8d70d8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.992+0000 7f0070759b80 4 client.16785 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T12:01:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.992+0000 7f0070759b80 1 -- 172.21.15.73:0/361444932 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c8d6fb2720 con 0x55c8d70d6660 2023-08-10T12:01:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.992+0000 7f0061b5b700 1 --2- 172.21.15.73:0/361444932 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c8d70d6660 0x55c8d70d8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.993+0000 7f0045ffb700 10 client.16785 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:24.993+0000 7f0061b5b700 1 --2- 172.21.15.73:0/361444932 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c8d70d6660 0x55c8d70d8a80 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66340433293100d2 server_cookie=a8cc692ee4ec2eec in_seq=0 out_seq=0 2023-08-10T12:01:25.016 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:25.014+0000 7f0045ffb700 1 -- 172.21.15.73:0/361444932 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c8d6fb2720 con 0x55c8d70d6660 2023-08-10T12:01:25.016 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:25.014+0000 7f0045ffb700 10 client.16785 handle_command_reply: tid=0 2023-08-10T12:01:25.017 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:25.014+0000 7f0070759b80 1 client.16785 shutdown 2023-08-10T12:01:25.017 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:25.014+0000 7f0070759b80 1 -- 172.21.15.73:0/361444932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c8d7064ff0 msgr2=0x55c8d70ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:25.017 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:25.014+0000 7f0070759b80 1 --2- 172.21.15.73:0/361444932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c8d7064ff0 0x55c8d70ce7d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f005800b540 tx=0x7f00580bc110 comp rx=0 tx=0).stop 2023-08-10T12:01:25.017 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:25.014+0000 7f0070759b80 1 -- 172.21.15.73:0/361444932 shutdown_connections 2023-08-10T12:01:25.017 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:25.014+0000 7f0070759b80 1 --2- 172.21.15.73:0/361444932 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c8d70d6660 0x55c8d70d8a80 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:25.017 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:25.014+0000 7f0070759b80 1 --2- 172.21.15.73:0/361444932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8d7066800 0x55c8d70c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:25.017 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:25.014+0000 7f0070759b80 1 --2- 172.21.15.73:0/361444932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c8d7064ff0 0x55c8d70ce7d0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:25.018 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:25.014+0000 7f0070759b80 1 --2- 172.21.15.73:0/361444932 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d70659b0 0x55c8d70ced10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:25.018 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:25.015+0000 7f0070759b80 1 -- 172.21.15.73:0/361444932 >> 172.21.15.73:0/361444932 conn(0x55c8d6fc5c70 msgr2=0x55c8d706f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:25.018 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:25.015+0000 7f0045ffb700 0 client.16785 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:25.018 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:25.015+0000 7f0070759b80 1 -- 172.21.15.73:0/361444932 shutdown_connections 2023-08-10T12:01:25.018 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:25.015+0000 7f0070759b80 1 -- 172.21.15.73:0/361444932 wait complete. 2023-08-10T12:01:25.019 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:25.015+0000 7f0070759b80 20 client.16785 trim_cache size 0 max 16384 2023-08-10T12:01:25.019 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T12:01:25.019 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T12:01:25.019 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T12:01:25.019 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T12:01:25.020 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:25.016+0000 7f00645c0700 1 -- 172.21.15.73:0/380552882 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f00480a1280 msgr2=0x7f00480a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:25.020 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:25.016+0000 7f00645c0700 1 --2- 172.21.15.73:0/380552882 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f00480a1280 0x7f00480a3740 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0054013820 tx=0x7f0054013be0 comp rx=0 tx=0).stop 2023-08-10T12:01:25.020 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:25.016+0000 7f00645c0700 1 -- 172.21.15.73:0/380552882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f005c100270 msgr2=0x7f005c1956b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:25.020 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:25.016+0000 7f00645c0700 1 --2- 172.21.15.73:0/380552882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f005c100270 0x7f005c1956b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f005800d980 tx=0x7f005800dc90 comp rx=0 tx=0).stop 2023-08-10T12:01:25.021 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:25.016+0000 7f00645c0700 1 -- 172.21.15.73:0/380552882 shutdown_connections 2023-08-10T12:01:25.021 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:25.016+0000 7f00645c0700 1 --2- 172.21.15.73:0/380552882 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f00480a1280 0x7f00480a3740 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:25.021 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:25.016+0000 7f00645c0700 1 --2- 172.21.15.73:0/380552882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f005c198fa0 0x7f005c199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:25.021 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:25.016+0000 7f00645c0700 1 --2- 172.21.15.73:0/380552882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f005c100270 0x7f005c1956b0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:25.021 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:25.016+0000 7f00645c0700 1 --2- 172.21.15.73:0/380552882 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f005c104910 0x7f005c195bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:25.021 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:25.016+0000 7f00645c0700 1 -- 172.21.15.73:0/380552882 >> 172.21.15.73:0/380552882 conn(0x7f005c075a90 msgr2=0x7f005c0fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:25.021 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:25.016+0000 7f00645c0700 1 -- 172.21.15.73:0/380552882 shutdown_connections 2023-08-10T12:01:25.022 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:25.016+0000 7f00645c0700 1 -- 172.21.15.73:0/380552882 wait complete. 2023-08-10T12:01:25.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:24 smithi152 ceph-mon[130220]: osdmap e92: 12 total, 12 up, 12 in 2023-08-10T12:01:25.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:24 smithi152 ceph-mon[130220]: pgmap v272: 97 pgs: 97 active+clean; 1.9 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 201 op/s 2023-08-10T12:01:25.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:24 smithi156 ceph-mon[130574]: osdmap e92: 12 total, 12 up, 12 in 2023-08-10T12:01:25.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:24 smithi156 ceph-mon[130574]: pgmap v272: 97 pgs: 97 active+clean; 1.9 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 201 op/s 2023-08-10T12:01:27.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:27 smithi152 ceph-mon[130220]: pgmap v273: 97 pgs: 97 active+clean; 1.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 225 op/s 2023-08-10T12:01:27.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:27 smithi156 ceph-mon[130574]: pgmap v273: 97 pgs: 97 active+clean; 1.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 225 op/s 2023-08-10T12:01:27.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:27 smithi073 ceph-mon[128869]: pgmap v273: 97 pgs: 97 active+clean; 1.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 225 op/s 2023-08-10T12:01:29.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:29 smithi152 ceph-mon[130220]: pgmap v274: 97 pgs: 97 active+clean; 1.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 228 op/s 2023-08-10T12:01:29.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:29 smithi156 ceph-mon[130574]: pgmap v274: 97 pgs: 97 active+clean; 1.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 228 op/s 2023-08-10T12:01:29.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:29 smithi073 ceph-mon[128869]: pgmap v274: 97 pgs: 97 active+clean; 1.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 228 op/s 2023-08-10T12:01:30.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:30 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:01:30.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:30 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:01:30.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:30 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:01:31.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:31 smithi152 ceph-mon[130220]: pgmap v275: 97 pgs: 97 active+clean; 1.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 279 op/s 2023-08-10T12:01:31.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:31 smithi152 ceph-mon[130220]: scrub summary: idle+waiting paths [/] 2023-08-10T12:01:31.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:31 smithi156 ceph-mon[130574]: pgmap v275: 97 pgs: 97 active+clean; 1.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 279 op/s 2023-08-10T12:01:31.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:31 smithi156 ceph-mon[130574]: scrub summary: idle+waiting paths [/] 2023-08-10T12:01:31.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:31 smithi073 ceph-mon[128869]: pgmap v275: 97 pgs: 97 active+clean; 1.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 279 op/s 2023-08-10T12:01:31.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:31 smithi073 ceph-mon[128869]: scrub summary: idle+waiting paths [/] 2023-08-10T12:01:33.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:33 smithi152 ceph-mon[130220]: pgmap v276: 97 pgs: 97 active+clean; 1.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 283 op/s 2023-08-10T12:01:33.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:33 smithi156 ceph-mon[130574]: pgmap v276: 97 pgs: 97 active+clean; 1.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 283 op/s 2023-08-10T12:01:33.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:33 smithi073 ceph-mon[128869]: pgmap v276: 97 pgs: 97 active+clean; 1.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 283 op/s 2023-08-10T12:01:35.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:35 smithi152 ceph-mon[130220]: pgmap v277: 97 pgs: 97 active+clean; 1.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 259 op/s 2023-08-10T12:01:35.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:35 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:01:35.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:35 smithi156 ceph-mon[130574]: pgmap v277: 97 pgs: 97 active+clean; 1.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 259 op/s 2023-08-10T12:01:35.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:35 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:01:35.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:35 smithi073 ceph-mon[128869]: pgmap v277: 97 pgs: 97 active+clean; 1.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 259 op/s 2023-08-10T12:01:35.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:35 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:01:37.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:37 smithi152 ceph-mon[130220]: pgmap v278: 97 pgs: 97 active+clean; 1.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 260 op/s 2023-08-10T12:01:37.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:37 smithi156 ceph-mon[130574]: pgmap v278: 97 pgs: 97 active+clean; 1.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 260 op/s 2023-08-10T12:01:37.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:37 smithi073 ceph-mon[128869]: pgmap v278: 97 pgs: 97 active+clean; 1.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 260 op/s 2023-08-10T12:01:38.151 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.150+0000 7fcd9862d700 1 -- 172.21.15.73:0/2420578730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd90100290 msgr2=0x7fcd9010c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:38.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.150+0000 7fcd9862d700 1 --2- 172.21.15.73:0/2420578730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd90100290 0x7fcd9010c4a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fcd8800b0a0 tx=0x7fcd8800b3b0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.150+0000 7fcd9862d700 1 -- 172.21.15.73:0/2420578730 shutdown_connections 2023-08-10T12:01:38.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.150+0000 7fcd9862d700 1 --2- 172.21.15.73:0/2420578730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd90100290 0x7fcd9010c4a0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.150+0000 7fcd9862d700 1 --2- 172.21.15.73:0/2420578730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd90105670 0x7fcd90105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.152 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.150+0000 7fcd9862d700 1 --2- 172.21.15.73:0/2420578730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd900ff8d0 0x7fcd900ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.153 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.150+0000 7fcd9862d700 1 -- 172.21.15.73:0/2420578730 >> 172.21.15.73:0/2420578730 conn(0x7fcd900750a0 msgr2=0x7fcd900754b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:38.153 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.150+0000 7fcd9862d700 1 -- 172.21.15.73:0/2420578730 shutdown_connections 2023-08-10T12:01:38.153 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.150+0000 7fcd9862d700 1 -- 172.21.15.73:0/2420578730 wait complete. 2023-08-10T12:01:38.155 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.150+0000 7fcd9862d700 1 Processor -- start 2023-08-10T12:01:38.155 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.150+0000 7fcd9862d700 1 -- start start 2023-08-10T12:01:38.155 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.150+0000 7fcd9862d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd900ff8d0 0x7fcd90101450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:38.155 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.150+0000 7fcd9862d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd90100290 0x7fcd90101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:38.155 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.150+0000 7fcd9862d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd90105670 0x7fcd901a4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:38.155 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.150+0000 7fcd9862d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd901a4dc0 con 0x7fcd90105670 2023-08-10T12:01:38.156 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.151+0000 7fcd9862d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd901a4f30 con 0x7fcd90100290 2023-08-10T12:01:38.156 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.151+0000 7fcd9862d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd901a50f0 con 0x7fcd900ff8d0 2023-08-10T12:01:38.156 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.151+0000 7fcd96bca700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd90105670 0x7fcd901a4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:38.156 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.151+0000 7fcd963c9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd900ff8d0 0x7fcd90101450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:38.156 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.151+0000 7fcd96bca700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd90105670 0x7fcd901a4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36152/0 (socket says 172.21.15.73:36152) 2023-08-10T12:01:38.156 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.151+0000 7fcd95bc8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd90100290 0x7fcd90101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:38.156 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.151+0000 7fcd96bca700 1 -- 172.21.15.73:0/1913101026 learned_addr learned my addr 172.21.15.73:0/1913101026 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:38.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.151+0000 7fcd963c9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd900ff8d0 0x7fcd90101450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:33420/0 (socket says 172.21.15.73:33420) 2023-08-10T12:01:38.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.151+0000 7fcd96bca700 1 -- 172.21.15.73:0/1913101026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd900ff8d0 msgr2=0x7fcd90101450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:38.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.151+0000 7fcd96bca700 1 --2- 172.21.15.73:0/1913101026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd900ff8d0 0x7fcd90101450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.151+0000 7fcd96bca700 1 -- 172.21.15.73:0/1913101026 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd90100290 msgr2=0x7fcd90101990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:38.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.151+0000 7fcd96bca700 1 --2- 172.21.15.73:0/1913101026 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd90100290 0x7fcd90101990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.151+0000 7fcd96bca700 1 -- 172.21.15.73:0/1913101026 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd88009d00 con 0x7fcd90105670 2023-08-10T12:01:38.157 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.151+0000 7fcd96bca700 1 --2- 172.21.15.73:0/1913101026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd90105670 0x7fcd901a4880 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fcd880062a0 tx=0x7fcd88007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:38.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.151+0000 7fcd877fe700 1 -- 172.21.15.73:0/1913101026 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8800e040 con 0x7fcd90105670 2023-08-10T12:01:38.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.151+0000 7fcd9862d700 1 -- 172.21.15.73:0/1913101026 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd901a5370 con 0x7fcd90105670 2023-08-10T12:01:38.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.151+0000 7fcd877fe700 1 -- 172.21.15.73:0/1913101026 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd880094c0 con 0x7fcd90105670 2023-08-10T12:01:38.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.151+0000 7fcd877fe700 1 -- 172.21.15.73:0/1913101026 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd880052a0 con 0x7fcd90105670 2023-08-10T12:01:38.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.151+0000 7fcd9862d700 1 -- 172.21.15.73:0/1913101026 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd901a57f0 con 0x7fcd90105670 2023-08-10T12:01:38.158 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.153+0000 7fcd877fe700 1 -- 172.21.15.73:0/1913101026 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fcd8801d470 con 0x7fcd90105670 2023-08-10T12:01:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.154+0000 7fcd877fe700 1 --2- 172.21.15.73:0/1913101026 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fcd7c0a12c0 0x7fcd7c0a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.154+0000 7fcd877fe700 1 -- 172.21.15.73:0/1913101026 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fcd880ce3f0 con 0x7fcd90105670 2023-08-10T12:01:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.154+0000 7fcd963c9700 1 --2- 172.21.15.73:0/1913101026 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fcd7c0a12c0 0x7fcd7c0a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.154+0000 7fcd963c9700 1 --2- 172.21.15.73:0/1913101026 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fcd7c0a12c0 0x7fcd7c0a3780 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcd900766a0 tx=0x7fcd8c009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.155+0000 7fcda47c6b80 1 Processor -- start 2023-08-10T12:01:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.155+0000 7fcda47c6b80 1 -- start start 2023-08-10T12:01:38.164 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.155+0000 7fcda47c6b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc69a40 0x55ba2dc69e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:38.164 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.155+0000 7fcda47c6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba2dc6a360 0x55ba2dc64010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:38.164 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.155+0000 7fcda47c6b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2dc64550 0x55ba2dc649d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:38.164 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.155+0000 7fcda47c6b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba2dbdfd60 con 0x55ba2dc69a40 2023-08-10T12:01:38.164 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.155+0000 7fcda47c6b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba2dbbc530 con 0x55ba2dc64550 2023-08-10T12:01:38.164 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.155+0000 7fcda47c6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba2dbb9e50 con 0x55ba2dc6a360 2023-08-10T12:01:38.164 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.155+0000 7fcd963c9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc69a40 0x55ba2dc69e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:38.164 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.155+0000 7fcd963c9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc69a40 0x55ba2dc69e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36156/0 (socket says 172.21.15.73:36156) 2023-08-10T12:01:38.165 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.155+0000 7fcd963c9700 1 -- 172.21.15.73:0/2851222348 learned_addr learned my addr 172.21.15.73:0/2851222348 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:38.165 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.155+0000 7fcd96bca700 1 --2- 172.21.15.73:0/2851222348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2dc64550 0x55ba2dc649d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:38.165 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.156+0000 7fcd95bc8700 1 --2- 172.21.15.73:0/2851222348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba2dc6a360 0x55ba2dc64010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:38.165 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.156+0000 7fcd963c9700 1 -- 172.21.15.73:0/2851222348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba2dc6a360 msgr2=0x55ba2dc64010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:38.165 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.156+0000 7fcd963c9700 1 --2- 172.21.15.73:0/2851222348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba2dc6a360 0x55ba2dc64010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.165 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.156+0000 7fcd963c9700 1 -- 172.21.15.73:0/2851222348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2dc64550 msgr2=0x55ba2dc649d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:38.165 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.156+0000 7fcd963c9700 1 --2- 172.21.15.73:0/2851222348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2dc64550 0x55ba2dc649d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.166 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.156+0000 7fcd963c9700 1 -- 172.21.15.73:0/2851222348 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba2da365d0 con 0x55ba2dc69a40 2023-08-10T12:01:38.166 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.156+0000 7fcd95bc8700 1 --2- 172.21.15.73:0/2851222348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba2dc6a360 0x55ba2dc64010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T12:01:38.166 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.156+0000 7fcd963c9700 1 --2- 172.21.15.73:0/2851222348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc69a40 0x55ba2dc69e20 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c005950 tx=0x7fcd8c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712bfec23a16a668 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:38.166 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.156+0000 7fcd84ff9700 1 -- 172.21.15.73:0/2851222348 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c004220 con 0x55ba2dc69a40 2023-08-10T12:01:38.166 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.156+0000 7fcd84ff9700 1 -- 172.21.15.73:0/2851222348 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd8c021070 con 0x55ba2dc69a40 2023-08-10T12:01:38.166 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.156+0000 7fcd84ff9700 1 -- 172.21.15.73:0/2851222348 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c003c60 con 0x55ba2dc69a40 2023-08-10T12:01:38.166 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.157+0000 7fcda47c6b80 1 -- 172.21.15.73:0/2851222348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc69a40 msgr2=0x55ba2dc69e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:38.166 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.157+0000 7fcda47c6b80 1 --2- 172.21.15.73:0/2851222348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc69a40 0x55ba2dc69e20 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c005950 tx=0x7fcd8c014000 comp rx=0 tx=0).stop 2023-08-10T12:01:38.167 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.157+0000 7fcda47c6b80 1 -- 172.21.15.73:0/2851222348 shutdown_connections 2023-08-10T12:01:38.167 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.157+0000 7fcda47c6b80 1 --2- 172.21.15.73:0/2851222348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2dc64550 0x55ba2dc649d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.167 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.157+0000 7fcda47c6b80 1 --2- 172.21.15.73:0/2851222348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc69a40 0x55ba2dc69e20 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.167 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.157+0000 7fcda47c6b80 1 --2- 172.21.15.73:0/2851222348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba2dc6a360 0x55ba2dc64010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.167 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.157+0000 7fcda47c6b80 1 -- 172.21.15.73:0/2851222348 >> 172.21.15.73:0/2851222348 conn(0x55ba2dbc1c70 msgr2=0x55ba2dc5ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:38.167 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.157+0000 7fcda47c6b80 1 -- 172.21.15.73:0/2851222348 shutdown_connections 2023-08-10T12:01:38.167 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.157+0000 7fcda47c6b80 1 -- 172.21.15.73:0/2851222348 wait complete. 2023-08-10T12:01:38.167 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.157+0000 7fcda47c6b80 1 -- start start 2023-08-10T12:01:38.168 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.157+0000 7fcda47c6b80 1 Processor -- start 2023-08-10T12:01:38.168 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.157+0000 7fcda47c6b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc64550 0x55ba2dc703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:38.168 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.157+0000 7fcda47c6b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2dc69a40 0x55ba2dc6d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:38.168 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.157+0000 7fcda47c6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba2dc6a360 0x55ba2dc6dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:38.168 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.157+0000 7fcda47c6b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba2dbb5740 con 0x55ba2dc64550 2023-08-10T12:01:38.168 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.157+0000 7fcda47c6b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba2db54a60 con 0x55ba2dc69a40 2023-08-10T12:01:38.168 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.157+0000 7fcda47c6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba2db54760 con 0x55ba2dc6a360 2023-08-10T12:01:38.169 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.157+0000 7fcda47c6b80 10 client.0 _ll_register_callbacks cb 0x55ba2db52620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:01:38.169 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.158+0000 7fcd963c9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc64550 0x55ba2dc703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:38.169 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.158+0000 7fcd963c9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc64550 0x55ba2dc703e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36162/0 (socket says 172.21.15.73:36162) 2023-08-10T12:01:38.169 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.158+0000 7fcd963c9700 1 -- 172.21.15.73:0/3432882768 learned_addr learned my addr 172.21.15.73:0/3432882768 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:38.169 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.158+0000 7fcd95bc8700 1 --2- 172.21.15.73:0/3432882768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2dc69a40 0x55ba2dc6d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:38.169 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.158+0000 7fcd96bca700 1 --2- 172.21.15.73:0/3432882768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba2dc6a360 0x55ba2dc6dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:38.169 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.158+0000 7fcd963c9700 1 -- 172.21.15.73:0/3432882768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba2dc6a360 msgr2=0x55ba2dc6dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:38.169 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.158+0000 7fcd963c9700 1 --2- 172.21.15.73:0/3432882768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba2dc6a360 0x55ba2dc6dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.170 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.158+0000 7fcd963c9700 1 -- 172.21.15.73:0/3432882768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2dc69a40 msgr2=0x55ba2dc6d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:38.170 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.158+0000 7fcd963c9700 1 --2- 172.21.15.73:0/3432882768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2dc69a40 0x55ba2dc6d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.170 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.158+0000 7fcd963c9700 1 -- 172.21.15.73:0/3432882768 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd8c017070 con 0x55ba2dc64550 2023-08-10T12:01:38.170 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.158+0000 7fcd963c9700 1 --2- 172.21.15.73:0/3432882768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc64550 0x55ba2dc703e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c009fd0 tx=0x7fcd8c005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b50db9ba5ea691 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:38.170 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.158+0000 7fcd79ffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:01:38.170 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.158+0000 7fcd79ffb700 1 -- 172.21.15.73:0/3432882768 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c00ed50 con 0x55ba2dc64550 2023-08-10T12:01:38.170 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.158+0000 7fcd79ffb700 1 -- 172.21.15.73:0/3432882768 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fcd8c026480 con 0x55ba2dc64550 2023-08-10T12:01:38.171 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.158+0000 7fcda47c6b80 1 -- 172.21.15.73:0/3432882768 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ba2dc571c0 con 0x55ba2dc64550 2023-08-10T12:01:38.171 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.158+0000 7fcd79ffb700 1 -- 172.21.15.73:0/3432882768 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd8c026640 con 0x55ba2dc64550 2023-08-10T12:01:38.171 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.158+0000 7fcda47c6b80 10 client.16797 fetch_fsmap learned FSMap version 55 2023-08-10T12:01:38.171 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.158+0000 7fcda47c6b80 1 -- 172.21.15.73:0/3432882768 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55ba2d9e2d80 con 0x55ba2dc64550 2023-08-10T12:01:38.171 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.159+0000 7fcd79ffb700 1 -- 172.21.15.73:0/3432882768 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ba2dc571c0 con 0x55ba2dc64550 2023-08-10T12:01:38.171 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.159+0000 7fcd79ffb700 1 -- 172.21.15.73:0/3432882768 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7fcd8c039930 con 0x55ba2dc64550 2023-08-10T12:01:38.171 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.159+0000 7fcda47c6b80 10 client.16797 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:01:38.171 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.159+0000 7fcda47c6b80 10 client.16797 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:01:38.172 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.159+0000 7fcda47c6b80 20 client.16797 populate_metadata read hostname 'smithi073' 2023-08-10T12:01:38.172 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.159+0000 7fcda47c6b80 1 --2- 172.21.15.73:0/3432882768 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55ba2dc7de20 0x55ba2dc80240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:38.172 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.159+0000 7fcda47c6b80 4 client.16797 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:01:38.172 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.159+0000 7fcda47c6b80 1 -- 172.21.15.73:0/3432882768 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ba2dc33970 con 0x55ba2dc7de20 2023-08-10T12:01:38.172 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.159+0000 7fcd95bc8700 1 --2- 172.21.15.73:0/3432882768 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55ba2dc7de20 0x55ba2dc80240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:38.172 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.159+0000 7fcd79ffb700 10 client.16797 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:38.172 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.159+0000 7fcd95bc8700 1 --2- 172.21.15.73:0/3432882768 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55ba2dc7de20 0x55ba2dc80240 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d354b9a77181ca2e server_cookie=fef3f7498a14310c in_seq=0 out_seq=0 2023-08-10T12:01:38.173 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.160+0000 7fcd79ffb700 1 -- 172.21.15.73:0/3432882768 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55ba2dc33970 con 0x55ba2dc7de20 2023-08-10T12:01:38.173 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.160+0000 7fcd79ffb700 10 client.16797 handle_command_reply: tid=0 2023-08-10T12:01:38.173 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.160+0000 7fcda47c6b80 1 client.16797 shutdown 2023-08-10T12:01:38.173 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.160+0000 7fcda47c6b80 1 -- 172.21.15.73:0/3432882768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc64550 msgr2=0x55ba2dc703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:38.173 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.160+0000 7fcda47c6b80 1 --2- 172.21.15.73:0/3432882768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc64550 0x55ba2dc703e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c009fd0 tx=0x7fcd8c005790 comp rx=0 tx=0).stop 2023-08-10T12:01:38.173 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.160+0000 7fcda47c6b80 1 -- 172.21.15.73:0/3432882768 shutdown_connections 2023-08-10T12:01:38.173 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.160+0000 7fcda47c6b80 1 --2- 172.21.15.73:0/3432882768 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55ba2dc7de20 0x55ba2dc80240 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.173 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.160+0000 7fcda47c6b80 1 --2- 172.21.15.73:0/3432882768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba2dc6a360 0x55ba2dc6dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.174 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.160+0000 7fcd79ffb700 0 client.16797 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:38.174 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.160+0000 7fcda47c6b80 1 --2- 172.21.15.73:0/3432882768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc64550 0x55ba2dc703e0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.174 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.160+0000 7fcda47c6b80 1 --2- 172.21.15.73:0/3432882768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2dc69a40 0x55ba2dc6d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.174 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.160+0000 7fcda47c6b80 1 -- 172.21.15.73:0/3432882768 >> 172.21.15.73:0/3432882768 conn(0x55ba2dbc1c70 msgr2=0x55ba2dc5e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:38.174 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.160+0000 7fcda47c6b80 1 -- 172.21.15.73:0/3432882768 shutdown_connections 2023-08-10T12:01:38.174 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.160+0000 7fcda47c6b80 1 -- 172.21.15.73:0/3432882768 wait complete. 2023-08-10T12:01:38.174 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.160+0000 7fcda47c6b80 20 client.16797 trim_cache size 0 max 16384 2023-08-10T12:01:38.177 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.175+0000 7fcda47c6b80 1 Processor -- start 2023-08-10T12:01:38.178 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.175+0000 7fcda47c6b80 1 -- start start 2023-08-10T12:01:38.178 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.175+0000 7fcda47c6b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc64550 0x55ba2dc5ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:38.178 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.175+0000 7fcda47c6b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2dc69a40 0x55ba2dc68f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:38.178 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.175+0000 7fcda47c6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba2dc6a360 0x55ba2dc6ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:38.178 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.175+0000 7fcda47c6b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba2da388c0 con 0x55ba2dc64550 2023-08-10T12:01:38.178 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.175+0000 7fcda47c6b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba2dc5fe20 con 0x55ba2dc69a40 2023-08-10T12:01:38.178 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.175+0000 7fcda47c6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba2dc808a0 con 0x55ba2dc6a360 2023-08-10T12:01:38.179 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.175+0000 7fcd963c9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc64550 0x55ba2dc5ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:38.179 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.175+0000 7fcd963c9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc64550 0x55ba2dc5ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36170/0 (socket says 172.21.15.73:36170) 2023-08-10T12:01:38.179 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.175+0000 7fcd963c9700 1 -- 172.21.15.73:0/2040101332 learned_addr learned my addr 172.21.15.73:0/2040101332 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:38.179 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.175+0000 7fcd95bc8700 1 --2- 172.21.15.73:0/2040101332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2dc69a40 0x55ba2dc68f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:38.179 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.175+0000 7fcd96bca700 1 --2- 172.21.15.73:0/2040101332 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba2dc6a360 0x55ba2dc6ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:38.179 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.175+0000 7fcd963c9700 1 -- 172.21.15.73:0/2040101332 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba2dc6a360 msgr2=0x55ba2dc6ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:38.179 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.175+0000 7fcd963c9700 1 --2- 172.21.15.73:0/2040101332 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba2dc6a360 0x55ba2dc6ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.179 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.175+0000 7fcd963c9700 1 -- 172.21.15.73:0/2040101332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2dc69a40 msgr2=0x55ba2dc68f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:38.180 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.175+0000 7fcd963c9700 1 --2- 172.21.15.73:0/2040101332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2dc69a40 0x55ba2dc68f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.180 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.175+0000 7fcd963c9700 1 -- 172.21.15.73:0/2040101332 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba2d9cbc00 con 0x55ba2dc64550 2023-08-10T12:01:38.180 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.175+0000 7fcd963c9700 1 --2- 172.21.15.73:0/2040101332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc64550 0x55ba2dc5ec30 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c016040 tx=0x7fcd8c004550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c98a2765f41f8bd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:38.180 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.176+0000 7fcd857fa700 1 -- 172.21.15.73:0/2040101332 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c00eb50 con 0x55ba2dc64550 2023-08-10T12:01:38.180 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.176+0000 7fcd857fa700 1 -- 172.21.15.73:0/2040101332 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd8c00ecb0 con 0x55ba2dc64550 2023-08-10T12:01:38.180 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.176+0000 7fcd857fa700 1 -- 172.21.15.73:0/2040101332 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c01d9c0 con 0x55ba2dc64550 2023-08-10T12:01:38.180 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.176+0000 7fcda47c6b80 1 -- 172.21.15.73:0/2040101332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc64550 msgr2=0x55ba2dc5ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.176+0000 7fcda47c6b80 1 --2- 172.21.15.73:0/2040101332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc64550 0x55ba2dc5ec30 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c016040 tx=0x7fcd8c004550 comp rx=0 tx=0).stop 2023-08-10T12:01:38.183 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.176+0000 7fcda47c6b80 1 -- 172.21.15.73:0/2040101332 shutdown_connections 2023-08-10T12:01:38.184 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.176+0000 7fcda47c6b80 1 --2- 172.21.15.73:0/2040101332 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba2dc6a360 0x55ba2dc6ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.184 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.176+0000 7fcda47c6b80 1 --2- 172.21.15.73:0/2040101332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc64550 0x55ba2dc5ec30 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.184 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.176+0000 7fcda47c6b80 1 --2- 172.21.15.73:0/2040101332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2dc69a40 0x55ba2dc68f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.184 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.176+0000 7fcda47c6b80 1 -- 172.21.15.73:0/2040101332 >> 172.21.15.73:0/2040101332 conn(0x55ba2dbc1c70 msgr2=0x55ba2dc68820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:38.184 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.176+0000 7fcda47c6b80 1 -- 172.21.15.73:0/2040101332 shutdown_connections 2023-08-10T12:01:38.184 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.176+0000 7fcda47c6b80 1 -- 172.21.15.73:0/2040101332 wait complete. 2023-08-10T12:01:38.184 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.177+0000 7fcda47c6b80 1 -- start start 2023-08-10T12:01:38.185 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.177+0000 7fcda47c6b80 1 Processor -- start 2023-08-10T12:01:38.185 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.177+0000 7fcda47c6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba2dc64550 0x55ba2dc72ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:38.185 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.177+0000 7fcda47c6b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2dc69a40 0x55ba2dc73530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:38.185 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.177+0000 7fcda47c6b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc6a360 0x55ba2dccaa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:38.185 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.177+0000 7fcda47c6b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba2dccb010 con 0x55ba2dc6a360 2023-08-10T12:01:38.185 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.177+0000 7fcda47c6b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba2dccb180 con 0x55ba2dc69a40 2023-08-10T12:01:38.185 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.177+0000 7fcda47c6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba2dccb340 con 0x55ba2dc64550 2023-08-10T12:01:38.186 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.177+0000 7fcda47c6b80 10 client.0 _ll_register_callbacks cb 0x55ba2db52620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:01:38.186 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.177+0000 7fcd96bca700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc6a360 0x55ba2dccaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:38.186 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.177+0000 7fcd96bca700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc6a360 0x55ba2dccaa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36180/0 (socket says 172.21.15.73:36180) 2023-08-10T12:01:38.186 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.177+0000 7fcd95bc8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2dc69a40 0x55ba2dc73530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:38.186 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.177+0000 7fcd96bca700 1 -- 172.21.15.73:0/1643181071 learned_addr learned my addr 172.21.15.73:0/1643181071 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:38.186 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.177+0000 7fcd963c9700 1 --2- 172.21.15.73:0/1643181071 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba2dc64550 0x55ba2dc72ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:38.186 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.177+0000 7fcd96bca700 1 -- 172.21.15.73:0/1643181071 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba2dc64550 msgr2=0x55ba2dc72ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.177+0000 7fcd96bca700 1 --2- 172.21.15.73:0/1643181071 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba2dc64550 0x55ba2dc72ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.177+0000 7fcd96bca700 1 -- 172.21.15.73:0/1643181071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2dc69a40 msgr2=0x55ba2dc73530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.177+0000 7fcd96bca700 1 --2- 172.21.15.73:0/1643181071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2dc69a40 0x55ba2dc73530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.177+0000 7fcd96bca700 1 -- 172.21.15.73:0/1643181071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ba2d9e2d80 con 0x55ba2dc6a360 2023-08-10T12:01:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.177+0000 7fcd96bca700 1 --2- 172.21.15.73:0/1643181071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc6a360 0x55ba2dccaa60 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fcd8800b800 tx=0x7fcd8800b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de327a6c0f3f986 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.177+0000 7fcd79ffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:01:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.178+0000 7fcd79ffb700 1 -- 172.21.15.73:0/1643181071 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd880b3ea0 con 0x55ba2dc6a360 2023-08-10T12:01:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.178+0000 7fcda47c6b80 1 -- 172.21.15.73:0/1643181071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcd8c021070 con 0x55ba2dc6a360 2023-08-10T12:01:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.178+0000 7fcd79ffb700 1 -- 172.21.15.73:0/1643181071 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fcd8809b550 con 0x55ba2dc6a360 2023-08-10T12:01:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.178+0000 7fcd79ffb700 1 -- 172.21.15.73:0/1643181071 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd8809f370 con 0x55ba2dc6a360 2023-08-10T12:01:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.178+0000 7fcda47c6b80 10 client.16803 fetch_fsmap learned FSMap version 55 2023-08-10T12:01:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.178+0000 7fcda47c6b80 1 -- 172.21.15.73:0/1643181071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55ba2da091f0 con 0x55ba2dc6a360 2023-08-10T12:01:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.178+0000 7fcd79ffb700 1 -- 172.21.15.73:0/1643181071 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd880c9080 con 0x55ba2dc6a360 2023-08-10T12:01:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.178+0000 7fcd79ffb700 1 -- 172.21.15.73:0/1643181071 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7fcd8809aa40 con 0x55ba2dc6a360 2023-08-10T12:01:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.178+0000 7fcda47c6b80 10 client.16803 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:01:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.178+0000 7fcda47c6b80 10 client.16803 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:01:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.178+0000 7fcda47c6b80 20 client.16803 populate_metadata read hostname 'smithi073' 2023-08-10T12:01:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.178+0000 7fcda47c6b80 1 --2- 172.21.15.73:0/1643181071 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55ba2dcd2a20 0x55ba2dcd4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.178+0000 7fcda47c6b80 4 client.16803 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T12:01:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.178+0000 7fcda47c6b80 1 -- 172.21.15.73:0/1643181071 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ba2dbae720 con 0x55ba2dcd2a20 2023-08-10T12:01:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.178+0000 7fcd963c9700 1 --2- 172.21.15.73:0/1643181071 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55ba2dcd2a20 0x55ba2dcd4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.179+0000 7fcd79ffb700 10 client.16803 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.179+0000 7fcd963c9700 1 --2- 172.21.15.73:0/1643181071 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55ba2dcd2a20 0x55ba2dcd4e10 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aaa52e84da903dad server_cookie=a16f5eef27c870de in_seq=0 out_seq=0 2023-08-10T12:01:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.185+0000 7fcd79ffb700 1 -- 172.21.15.73:0/1643181071 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ba2dbae720 con 0x55ba2dcd2a20 2023-08-10T12:01:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.185+0000 7fcd79ffb700 10 client.16803 handle_command_reply: tid=0 2023-08-10T12:01:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.185+0000 7fcda47c6b80 1 client.16803 shutdown 2023-08-10T12:01:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.186+0000 7fcda47c6b80 1 -- 172.21.15.73:0/1643181071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc6a360 msgr2=0x55ba2dccaa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.186+0000 7fcda47c6b80 1 --2- 172.21.15.73:0/1643181071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc6a360 0x55ba2dccaa60 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fcd8800b800 tx=0x7fcd8800b3b0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.186+0000 7fcda47c6b80 1 -- 172.21.15.73:0/1643181071 shutdown_connections 2023-08-10T12:01:38.192 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.186+0000 7fcda47c6b80 1 --2- 172.21.15.73:0/1643181071 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55ba2dcd2a20 0x55ba2dcd4e10 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.192 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.186+0000 7fcda47c6b80 1 --2- 172.21.15.73:0/1643181071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ba2dc6a360 0x55ba2dccaa60 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.192 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.186+0000 7fcda47c6b80 1 --2- 172.21.15.73:0/1643181071 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba2dc64550 0x55ba2dc72ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.192 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.186+0000 7fcd79ffb700 0 client.16803 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:38.192 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.186+0000 7fcda47c6b80 1 --2- 172.21.15.73:0/1643181071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ba2dc69a40 0x55ba2dc73530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.192 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.186+0000 7fcda47c6b80 1 -- 172.21.15.73:0/1643181071 >> 172.21.15.73:0/1643181071 conn(0x55ba2dbc1c70 msgr2=0x55ba2dc690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:38.192 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.186+0000 7fcda47c6b80 1 -- 172.21.15.73:0/1643181071 shutdown_connections 2023-08-10T12:01:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.186+0000 7fcda47c6b80 1 -- 172.21.15.73:0/1643181071 wait complete. 2023-08-10T12:01:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.186+0000 7fcda47c6b80 20 client.16803 trim_cache size 0 max 16384 2023-08-10T12:01:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T12:01:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T12:01:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T12:01:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T12:01:38.194 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.186+0000 7fcd9862d700 1 -- 172.21.15.73:0/1913101026 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fcd7c0a12c0 msgr2=0x7fcd7c0a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:38.194 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.186+0000 7fcd9862d700 1 --2- 172.21.15.73:0/1913101026 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fcd7c0a12c0 0x7fcd7c0a3780 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcd900766a0 tx=0x7fcd8c009260 comp rx=0 tx=0).stop 2023-08-10T12:01:38.194 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.186+0000 7fcd9862d700 1 -- 172.21.15.73:0/1913101026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd90105670 msgr2=0x7fcd901a4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:38.195 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.186+0000 7fcd9862d700 1 --2- 172.21.15.73:0/1913101026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd90105670 0x7fcd901a4880 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fcd880062a0 tx=0x7fcd88007870 comp rx=0 tx=0).stop 2023-08-10T12:01:38.195 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.186+0000 7fcd9862d700 1 -- 172.21.15.73:0/1913101026 shutdown_connections 2023-08-10T12:01:38.195 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.186+0000 7fcd9862d700 1 --2- 172.21.15.73:0/1913101026 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fcd7c0a12c0 0x7fcd7c0a3780 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.195 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.186+0000 7fcd9862d700 1 --2- 172.21.15.73:0/1913101026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd90105670 0x7fcd901a4880 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.195 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.186+0000 7fcd9862d700 1 --2- 172.21.15.73:0/1913101026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd900ff8d0 0x7fcd90101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.195 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.186+0000 7fcd9862d700 1 --2- 172.21.15.73:0/1913101026 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd90100290 0x7fcd90101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:38.195 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.186+0000 7fcd9862d700 1 -- 172.21.15.73:0/1913101026 >> 172.21.15.73:0/1913101026 conn(0x7fcd900750a0 msgr2=0x7fcd90067b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:38.196 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.186+0000 7fcd9862d700 1 -- 172.21.15.73:0/1913101026 shutdown_connections 2023-08-10T12:01:38.196 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:38.186+0000 7fcd9862d700 1 -- 172.21.15.73:0/1913101026 wait complete. 2023-08-10T12:01:39.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:39 smithi152 ceph-mon[130220]: pgmap v279: 97 pgs: 97 active+clean; 1.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 226 op/s 2023-08-10T12:01:39.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:39 smithi156 ceph-mon[130574]: pgmap v279: 97 pgs: 97 active+clean; 1.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 226 op/s 2023-08-10T12:01:39.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:39 smithi073 ceph-mon[128869]: pgmap v279: 97 pgs: 97 active+clean; 1.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 226 op/s 2023-08-10T12:01:41.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:41 smithi152 ceph-mon[130220]: pgmap v280: 97 pgs: 97 active+clean; 2.0 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.6 MiB/s wr, 319 op/s 2023-08-10T12:01:41.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:41 smithi156 ceph-mon[130574]: pgmap v280: 97 pgs: 97 active+clean; 2.0 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.6 MiB/s wr, 319 op/s 2023-08-10T12:01:41.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:41 smithi073 ceph-mon[128869]: pgmap v280: 97 pgs: 97 active+clean; 2.0 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.6 MiB/s wr, 319 op/s 2023-08-10T12:01:43.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:43 smithi152 ceph-mon[130220]: pgmap v281: 97 pgs: 97 active+clean; 2.0 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 237 op/s 2023-08-10T12:01:43.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:43 smithi156 ceph-mon[130574]: pgmap v281: 97 pgs: 97 active+clean; 2.0 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 237 op/s 2023-08-10T12:01:43.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:43 smithi073 ceph-mon[128869]: pgmap v281: 97 pgs: 97 active+clean; 2.0 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 237 op/s 2023-08-10T12:01:45.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:44 smithi152 ceph-mon[130220]: pgmap v282: 97 pgs: 97 active+clean; 2.0 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 284 op/s 2023-08-10T12:01:45.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:44 smithi156 ceph-mon[130574]: pgmap v282: 97 pgs: 97 active+clean; 2.0 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 284 op/s 2023-08-10T12:01:45.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:44 smithi073 ceph-mon[128869]: pgmap v282: 97 pgs: 97 active+clean; 2.0 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 284 op/s 2023-08-10T12:01:46.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:45 smithi152 ceph-mon[130220]: scrub summary: idle 2023-08-10T12:01:46.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:45 smithi152 ceph-mon[130220]: scrub summary: idle 2023-08-10T12:01:46.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:45 smithi152 ceph-mon[130220]: scrub summary: idle 2023-08-10T12:01:46.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:45 smithi152 ceph-mon[130220]: scrub summary: idle 2023-08-10T12:01:46.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:45 smithi156 ceph-mon[130574]: scrub summary: idle 2023-08-10T12:01:46.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:45 smithi156 ceph-mon[130574]: scrub summary: idle 2023-08-10T12:01:46.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:45 smithi156 ceph-mon[130574]: scrub summary: idle 2023-08-10T12:01:46.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:45 smithi156 ceph-mon[130574]: scrub summary: idle 2023-08-10T12:01:46.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:45 smithi073 ceph-mon[128869]: scrub summary: idle 2023-08-10T12:01:46.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:45 smithi073 ceph-mon[128869]: scrub summary: idle 2023-08-10T12:01:46.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:45 smithi073 ceph-mon[128869]: scrub summary: idle 2023-08-10T12:01:46.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:45 smithi073 ceph-mon[128869]: scrub summary: idle 2023-08-10T12:01:47.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:46 smithi152 ceph-mon[130220]: pgmap v283: 97 pgs: 97 active+clean; 2.0 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.3 MiB/s wr, 291 op/s 2023-08-10T12:01:47.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:46 smithi156 ceph-mon[130574]: pgmap v283: 97 pgs: 97 active+clean; 2.0 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.3 MiB/s wr, 291 op/s 2023-08-10T12:01:47.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:46 smithi073 ceph-mon[128869]: pgmap v283: 97 pgs: 97 active+clean; 2.0 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.3 MiB/s wr, 291 op/s 2023-08-10T12:01:49.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:49 smithi152 ceph-mon[130220]: pgmap v284: 97 pgs: 97 active+clean; 2.0 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 264 op/s 2023-08-10T12:01:49.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:49 smithi156 ceph-mon[130574]: pgmap v284: 97 pgs: 97 active+clean; 2.0 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 264 op/s 2023-08-10T12:01:49.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:49 smithi073 ceph-mon[128869]: pgmap v284: 97 pgs: 97 active+clean; 2.0 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 264 op/s 2023-08-10T12:01:51.307 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.305+0000 7f8c4dc2f700 1 -- 172.21.15.73:0/1832684540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c48068a70 msgr2=0x7f8c48068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:51.307 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.305+0000 7f8c4dc2f700 1 --2- 172.21.15.73:0/1832684540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c48068a70 0x7f8c48068ed0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c009990 tx=0x7f8c3c009ca0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.307 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.305+0000 7f8c4dc2f700 1 -- 172.21.15.73:0/1832684540 shutdown_connections 2023-08-10T12:01:51.307 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.305+0000 7f8c4dc2f700 1 --2- 172.21.15.73:0/1832684540 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c48106710 0x7f8c48106af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.307 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.305+0000 7f8c4dc2f700 1 --2- 172.21.15.73:0/1832684540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c48069410 0x7f8c4810d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.308 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.305+0000 7f8c4dc2f700 1 --2- 172.21.15.73:0/1832684540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c48068a70 0x7f8c48068ed0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.308 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.305+0000 7f8c4dc2f700 1 -- 172.21.15.73:0/1832684540 >> 172.21.15.73:0/1832684540 conn(0x7f8c48076770 msgr2=0x7f8c48076b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:51.308 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.306+0000 7f8c4dc2f700 1 -- 172.21.15.73:0/1832684540 shutdown_connections 2023-08-10T12:01:51.308 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.306+0000 7f8c4dc2f700 1 -- 172.21.15.73:0/1832684540 wait complete. 2023-08-10T12:01:51.308 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.306+0000 7f8c4dc2f700 1 Processor -- start 2023-08-10T12:01:51.308 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.306+0000 7f8c4dc2f700 1 -- start start 2023-08-10T12:01:51.310 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.306+0000 7f8c4dc2f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c48068a70 0x7f8c480ff890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:51.310 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.306+0000 7f8c4dc2f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c48069410 0x7f8c480ffdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:51.310 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.306+0000 7f8c4dc2f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c48106710 0x7f8c481a4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:51.310 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.307+0000 7f8c4dc2f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c481a4f40 con 0x7f8c48106710 2023-08-10T12:01:51.311 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.307+0000 7f8c4dc2f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c481a5080 con 0x7f8c48068a70 2023-08-10T12:01:51.311 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.307+0000 7f8c4dc2f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c481a51f0 con 0x7f8c48069410 2023-08-10T12:01:51.311 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.307+0000 7f8c47fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c48106710 0x7f8c481a4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:51.311 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.307+0000 7f8c46ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c48069410 0x7f8c480ffdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:51.311 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.307+0000 7f8c477fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c48068a70 0x7f8c480ff890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:51.311 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.307+0000 7f8c47fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c48106710 0x7f8c481a4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36192/0 (socket says 172.21.15.73:36192) 2023-08-10T12:01:51.311 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.307+0000 7f8c47fff700 1 -- 172.21.15.73:0/206415636 learned_addr learned my addr 172.21.15.73:0/206415636 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:51.311 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.307+0000 7f8c46ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c48069410 0x7f8c480ffdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:33462/0 (socket says 172.21.15.73:33462) 2023-08-10T12:01:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.307+0000 7f8c47fff700 1 -- 172.21.15.73:0/206415636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c48069410 msgr2=0x7f8c480ffdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.307+0000 7f8c47fff700 1 --2- 172.21.15.73:0/206415636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c48069410 0x7f8c480ffdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.307+0000 7f8c47fff700 1 -- 172.21.15.73:0/206415636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c48068a70 msgr2=0x7f8c480ff890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.307+0000 7f8c47fff700 1 --2- 172.21.15.73:0/206415636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c48068a70 0x7f8c480ff890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.307+0000 7f8c47fff700 1 -- 172.21.15.73:0/206415636 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c0095f0 con 0x7f8c48106710 2023-08-10T12:01:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.307+0000 7f8c46ffd700 1 --2- 172.21.15.73:0/206415636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c48069410 0x7f8c480ffdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:01:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.307+0000 7f8c47fff700 1 --2- 172.21.15.73:0/206415636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c48106710 0x7f8c481a4a00 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f8c4000ef30 tx=0x7f8c4000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:51.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.307+0000 7f8c44ff9700 1 -- 172.21.15.73:0/206415636 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c40018070 con 0x7f8c48106710 2023-08-10T12:01:51.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.307+0000 7f8c4dc2f700 1 -- 172.21.15.73:0/206415636 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c481a5470 con 0x7f8c48106710 2023-08-10T12:01:51.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.307+0000 7f8c44ff9700 1 -- 172.21.15.73:0/206415636 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c4000f040 con 0x7f8c48106710 2023-08-10T12:01:51.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.307+0000 7f8c44ff9700 1 -- 172.21.15.73:0/206415636 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4000cd00 con 0x7f8c48106710 2023-08-10T12:01:51.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.307+0000 7f8c4dc2f700 1 -- 172.21.15.73:0/206415636 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c481a5930 con 0x7f8c48106710 2023-08-10T12:01:51.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.310+0000 7f8c44ff9700 1 -- 172.21.15.73:0/206415636 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f8c40003a00 con 0x7f8c48106710 2023-08-10T12:01:51.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.310+0000 7f8c44ff9700 1 --2- 172.21.15.73:0/206415636 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f8c300a12c0 0x7f8c300a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:51.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.311+0000 7f8c477fe700 1 --2- 172.21.15.73:0/206415636 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f8c300a12c0 0x7f8c300a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:51.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.311+0000 7f8c44ff9700 1 -- 172.21.15.73:0/206415636 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8c400cc870 con 0x7f8c48106710 2023-08-10T12:01:51.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.311+0000 7f8c477fe700 1 --2- 172.21.15.73:0/206415636 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f8c300a12c0 0x7f8c300a3780 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8c38009be0 tx=0x7f8c38009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:51.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.311+0000 7f8c59dc8b80 1 Processor -- start 2023-08-10T12:01:51.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.311+0000 7f8c59dc8b80 1 -- start start 2023-08-10T12:01:51.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.312+0000 7f8c59dc8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559024aa6a40 0x559024aa6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:51.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.312+0000 7f8c59dc8b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa7360 0x559024aa1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:51.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.312+0000 7f8c59dc8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559024aa1550 0x559024aa19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:51.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.312+0000 7f8c59dc8b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x559024a1cd60 con 0x559024aa7360 2023-08-10T12:01:51.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.312+0000 7f8c59dc8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590249f9530 con 0x559024aa1550 2023-08-10T12:01:51.320 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.312+0000 7f8c59dc8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590249f6e50 con 0x559024aa6a40 2023-08-10T12:01:51.320 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.312+0000 7f8c46ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa7360 0x559024aa1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:51.320 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.312+0000 7f8c477fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559024aa6a40 0x559024aa6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:51.320 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.312+0000 7f8c46ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa7360 0x559024aa1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36198/0 (socket says 172.21.15.73:36198) 2023-08-10T12:01:51.320 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.312+0000 7f8c46ffd700 1 -- 172.21.15.73:0/1194551738 learned_addr learned my addr 172.21.15.73:0/1194551738 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:51.320 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.312+0000 7f8c47fff700 1 --2- 172.21.15.73:0/1194551738 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559024aa1550 0x559024aa19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:51.321 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.312+0000 7f8c46ffd700 1 -- 172.21.15.73:0/1194551738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559024aa6a40 msgr2=0x559024aa6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:51.321 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.312+0000 7f8c46ffd700 1 --2- 172.21.15.73:0/1194551738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559024aa6a40 0x559024aa6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.321 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.312+0000 7f8c46ffd700 1 -- 172.21.15.73:0/1194551738 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559024aa1550 msgr2=0x559024aa19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:51.321 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.312+0000 7f8c46ffd700 1 --2- 172.21.15.73:0/1194551738 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559024aa1550 0x559024aa19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.321 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.312+0000 7f8c46ffd700 1 -- 172.21.15.73:0/1194551738 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590248735d0 con 0x559024aa7360 2023-08-10T12:01:51.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.312+0000 7f8c46ffd700 1 --2- 172.21.15.73:0/1194551738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa7360 0x559024aa1010 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c015000 tx=0x7f8c3c005ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d84d7b142cb0aa server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:51.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.312+0000 7f8c2dffb700 1 -- 172.21.15.73:0/1194551738 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c01d050 con 0x559024aa7360 2023-08-10T12:01:51.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.312+0000 7f8c2dffb700 1 -- 172.21.15.73:0/1194551738 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c3c01e040 con 0x559024aa7360 2023-08-10T12:01:51.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.312+0000 7f8c2dffb700 1 -- 172.21.15.73:0/1194551738 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c005430 con 0x559024aa7360 2023-08-10T12:01:51.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.313+0000 7f8c59dc8b80 1 -- 172.21.15.73:0/1194551738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa7360 msgr2=0x559024aa1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:51.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.313+0000 7f8c59dc8b80 1 --2- 172.21.15.73:0/1194551738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa7360 0x559024aa1010 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c015000 tx=0x7f8c3c005ea0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.313+0000 7f8c59dc8b80 1 -- 172.21.15.73:0/1194551738 shutdown_connections 2023-08-10T12:01:51.322 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.313+0000 7f8c59dc8b80 1 --2- 172.21.15.73:0/1194551738 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559024aa1550 0x559024aa19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.313+0000 7f8c59dc8b80 1 --2- 172.21.15.73:0/1194551738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559024aa6a40 0x559024aa6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.313+0000 7f8c59dc8b80 1 --2- 172.21.15.73:0/1194551738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa7360 0x559024aa1010 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.313+0000 7f8c59dc8b80 1 -- 172.21.15.73:0/1194551738 >> 172.21.15.73:0/1194551738 conn(0x5590249fec70 msgr2=0x559024a9bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:51.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.313+0000 7f8c59dc8b80 1 -- 172.21.15.73:0/1194551738 shutdown_connections 2023-08-10T12:01:51.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.313+0000 7f8c59dc8b80 1 -- 172.21.15.73:0/1194551738 wait complete. 2023-08-10T12:01:51.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.313+0000 7f8c59dc8b80 1 -- start start 2023-08-10T12:01:51.323 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.314+0000 7f8c59dc8b80 1 Processor -- start 2023-08-10T12:01:51.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.314+0000 7f8c59dc8b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa1550 0x559024aad330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:51.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.314+0000 7f8c59dc8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559024aa6a40 0x559024aaa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:51.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.314+0000 7f8c59dc8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559024aa7360 0x559024aaabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:51.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.314+0000 7f8c59dc8b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590249f2740 con 0x559024aa1550 2023-08-10T12:01:51.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.314+0000 7f8c59dc8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x559024991a60 con 0x559024aa6a40 2023-08-10T12:01:51.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.314+0000 7f8c59dc8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559024991760 con 0x559024aa7360 2023-08-10T12:01:51.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.314+0000 7f8c59dc8b80 10 client.0 _ll_register_callbacks cb 0x55902498f620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:01:51.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.314+0000 7f8c477fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa1550 0x559024aad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:51.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.314+0000 7f8c477fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa1550 0x559024aad330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36202/0 (socket says 172.21.15.73:36202) 2023-08-10T12:01:51.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.314+0000 7f8c477fe700 1 -- 172.21.15.73:0/33313418 learned_addr learned my addr 172.21.15.73:0/33313418 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:51.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.314+0000 7f8c46ffd700 1 --2- 172.21.15.73:0/33313418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559024aa6a40 0x559024aaa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:51.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.314+0000 7f8c47fff700 1 --2- 172.21.15.73:0/33313418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559024aa7360 0x559024aaabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:51.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.314+0000 7f8c477fe700 1 -- 172.21.15.73:0/33313418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559024aa7360 msgr2=0x559024aaabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:51.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.314+0000 7f8c477fe700 1 --2- 172.21.15.73:0/33313418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559024aa7360 0x559024aaabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.314+0000 7f8c477fe700 1 -- 172.21.15.73:0/33313418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559024aa6a40 msgr2=0x559024aaa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:51.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.314+0000 7f8c477fe700 1 --2- 172.21.15.73:0/33313418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559024aa6a40 0x559024aaa5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.314+0000 7f8c477fe700 1 -- 172.21.15.73:0/33313418 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c4810ded0 con 0x559024aa1550 2023-08-10T12:01:51.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.314+0000 7f8c47fff700 1 --2- 172.21.15.73:0/33313418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559024aa7360 0x559024aaabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T12:01:51.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.314+0000 7f8c477fe700 1 --2- 172.21.15.73:0/33313418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa1550 0x559024aad330 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f8c3801fbf0 tx=0x7f8c380047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b3aa7d2030fde9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:51.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.314+0000 7f8c26ffd700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:01:51.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.315+0000 7f8c26ffd700 1 -- 172.21.15.73:0/33313418 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38011e30 con 0x559024aa1550 2023-08-10T12:01:51.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.315+0000 7f8c26ffd700 1 -- 172.21.15.73:0/33313418 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8c38004020 con 0x559024aa1550 2023-08-10T12:01:51.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.315+0000 7f8c59dc8b80 1 -- 172.21.15.73:0/33313418 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559024a941c0 con 0x559024aa1550 2023-08-10T12:01:51.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.315+0000 7f8c26ffd700 1 -- 172.21.15.73:0/33313418 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c38004220 con 0x559024aa1550 2023-08-10T12:01:51.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.315+0000 7f8c59dc8b80 10 client.16815 fetch_fsmap learned FSMap version 55 2023-08-10T12:01:51.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.315+0000 7f8c59dc8b80 1 -- 172.21.15.73:0/33313418 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55902481fd80 con 0x559024aa1550 2023-08-10T12:01:51.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.315+0000 7f8c26ffd700 1 -- 172.21.15.73:0/33313418 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c38033080 con 0x559024aa1550 2023-08-10T12:01:51.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.315+0000 7f8c26ffd700 1 -- 172.21.15.73:0/33313418 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7f8c380039e0 con 0x559024aa1550 2023-08-10T12:01:51.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.315+0000 7f8c59dc8b80 10 client.16815 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:01:51.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.315+0000 7f8c59dc8b80 10 client.16815 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:01:51.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.315+0000 7f8c59dc8b80 20 client.16815 populate_metadata read hostname 'smithi073' 2023-08-10T12:01:51.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.315+0000 7f8c59dc8b80 1 --2- 172.21.15.73:0/33313418 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x559024abadf0 0x559024abd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:51.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.315+0000 7f8c59dc8b80 4 client.16815 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:01:51.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.315+0000 7f8c59dc8b80 1 -- 172.21.15.73:0/33313418 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559024a70970 con 0x559024abadf0 2023-08-10T12:01:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.315+0000 7f8c46ffd700 1 --2- 172.21.15.73:0/33313418 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x559024abadf0 0x559024abd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.316+0000 7f8c26ffd700 10 client.16815 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.316+0000 7f8c46ffd700 1 --2- 172.21.15.73:0/33313418 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x559024abadf0 0x559024abd210 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fffb6ee1a874eeb server_cookie=a4e2ee664999d1ce in_seq=0 out_seq=0 2023-08-10T12:01:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.316+0000 7f8c26ffd700 1 -- 172.21.15.73:0/33313418 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x559024a70970 con 0x559024abadf0 2023-08-10T12:01:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.316+0000 7f8c26ffd700 10 client.16815 handle_command_reply: tid=0 2023-08-10T12:01:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.316+0000 7f8c59dc8b80 1 client.16815 shutdown 2023-08-10T12:01:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.317+0000 7f8c59dc8b80 1 -- 172.21.15.73:0/33313418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa1550 msgr2=0x559024aad330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.317+0000 7f8c59dc8b80 1 --2- 172.21.15.73:0/33313418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa1550 0x559024aad330 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f8c3801fbf0 tx=0x7f8c380047c0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.317+0000 7f8c59dc8b80 1 -- 172.21.15.73:0/33313418 shutdown_connections 2023-08-10T12:01:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.317+0000 7f8c59dc8b80 1 --2- 172.21.15.73:0/33313418 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x559024abadf0 0x559024abd210 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.317+0000 7f8c59dc8b80 1 --2- 172.21.15.73:0/33313418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559024aa7360 0x559024aaabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.317+0000 7f8c26ffd700 0 client.16815 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.317+0000 7f8c59dc8b80 1 --2- 172.21.15.73:0/33313418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa1550 0x559024aad330 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.317+0000 7f8c59dc8b80 1 --2- 172.21.15.73:0/33313418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559024aa6a40 0x559024aaa5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.317+0000 7f8c59dc8b80 1 -- 172.21.15.73:0/33313418 >> 172.21.15.73:0/33313418 conn(0x5590249fec70 msgr2=0x559024a9b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.317+0000 7f8c59dc8b80 1 -- 172.21.15.73:0/33313418 shutdown_connections 2023-08-10T12:01:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.317+0000 7f8c59dc8b80 1 -- 172.21.15.73:0/33313418 wait complete. 2023-08-10T12:01:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.317+0000 7f8c59dc8b80 20 client.16815 trim_cache size 0 max 16384 2023-08-10T12:01:51.333 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.332+0000 7f8c59dc8b80 1 Processor -- start 2023-08-10T12:01:51.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.332+0000 7f8c59dc8b80 1 -- start start 2023-08-10T12:01:51.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.332+0000 7f8c59dc8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559024aa1550 0x559024aa1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:51.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.332+0000 7f8c59dc8b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa6a40 0x559024aa6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:51.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.332+0000 7f8c59dc8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559024aa7360 0x559024ab1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:51.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.332+0000 7f8c59dc8b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590248758c0 con 0x559024aa6a40 2023-08-10T12:01:51.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.332+0000 7f8c59dc8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x559024aabb90 con 0x559024aa1550 2023-08-10T12:01:51.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.332+0000 7f8c59dc8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559024a9d1c0 con 0x559024aa7360 2023-08-10T12:01:51.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.332+0000 7f8c46ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa6a40 0x559024aa6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:51.335 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.332+0000 7f8c46ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa6a40 0x559024aa6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36212/0 (socket says 172.21.15.73:36212) 2023-08-10T12:01:51.335 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.332+0000 7f8c46ffd700 1 -- 172.21.15.73:0/3178304600 learned_addr learned my addr 172.21.15.73:0/3178304600 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:51.335 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.332+0000 7f8c477fe700 1 --2- 172.21.15.73:0/3178304600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559024aa1550 0x559024aa1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:51.335 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.333+0000 7f8c47fff700 1 --2- 172.21.15.73:0/3178304600 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559024aa7360 0x559024ab1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:51.335 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.333+0000 7f8c46ffd700 1 -- 172.21.15.73:0/3178304600 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559024aa7360 msgr2=0x559024ab1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:51.335 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.333+0000 7f8c46ffd700 1 --2- 172.21.15.73:0/3178304600 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559024aa7360 0x559024ab1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.335 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.333+0000 7f8c46ffd700 1 -- 172.21.15.73:0/3178304600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559024aa1550 msgr2=0x559024aa1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:51.336 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.333+0000 7f8c46ffd700 1 --2- 172.21.15.73:0/3178304600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559024aa1550 0x559024aa1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.336 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.333+0000 7f8c46ffd700 1 -- 172.21.15.73:0/3178304600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559024808c00 con 0x559024aa6a40 2023-08-10T12:01:51.336 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.333+0000 7f8c47fff700 1 --2- 172.21.15.73:0/3178304600 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559024aa7360 0x559024ab1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T12:01:51.336 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.333+0000 7f8c46ffd700 1 --2- 172.21.15.73:0/3178304600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa6a40 0x559024aa6020 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c004f50 tx=0x7f8c3c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62a1764b2263a3e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:51.336 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.333+0000 7f8c2e7fc700 1 -- 172.21.15.73:0/3178304600 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c00b2e0 con 0x559024aa6a40 2023-08-10T12:01:51.336 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.333+0000 7f8c2e7fc700 1 -- 172.21.15.73:0/3178304600 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c3c004ca0 con 0x559024aa6a40 2023-08-10T12:01:51.336 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.333+0000 7f8c2e7fc700 1 -- 172.21.15.73:0/3178304600 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c00f6c0 con 0x559024aa6a40 2023-08-10T12:01:51.339 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.334+0000 7f8c59dc8b80 1 -- 172.21.15.73:0/3178304600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa6a40 msgr2=0x559024aa6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:51.339 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.334+0000 7f8c59dc8b80 1 --2- 172.21.15.73:0/3178304600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa6a40 0x559024aa6020 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c004f50 tx=0x7f8c3c005fd0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.339 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.334+0000 7f8c59dc8b80 1 -- 172.21.15.73:0/3178304600 shutdown_connections 2023-08-10T12:01:51.339 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.334+0000 7f8c59dc8b80 1 --2- 172.21.15.73:0/3178304600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559024aa1550 0x559024aa1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.339 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.334+0000 7f8c59dc8b80 1 --2- 172.21.15.73:0/3178304600 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559024aa7360 0x559024ab1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.334+0000 7f8c59dc8b80 1 --2- 172.21.15.73:0/3178304600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa6a40 0x559024aa6020 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.334+0000 7f8c59dc8b80 1 -- 172.21.15.73:0/3178304600 >> 172.21.15.73:0/3178304600 conn(0x5590249fec70 msgr2=0x559024aa7740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.334+0000 7f8c59dc8b80 1 -- 172.21.15.73:0/3178304600 shutdown_connections 2023-08-10T12:01:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.334+0000 7f8c59dc8b80 1 -- 172.21.15.73:0/3178304600 wait complete. 2023-08-10T12:01:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.334+0000 7f8c59dc8b80 1 -- start start 2023-08-10T12:01:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.334+0000 7f8c59dc8b80 1 Processor -- start 2023-08-10T12:01:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.334+0000 7f8c59dc8b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa1550 0x559024b07f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.334+0000 7f8c59dc8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559024aa6a40 0x559024b08470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.335+0000 7f8c59dc8b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559024aa7360 0x559024b06ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.335+0000 7f8c59dc8b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x559024b07250 con 0x559024aa1550 2023-08-10T12:01:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.335+0000 7f8c59dc8b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x559024b073c0 con 0x559024aa7360 2023-08-10T12:01:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.335+0000 7f8c59dc8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559024b07580 con 0x559024aa6a40 2023-08-10T12:01:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.335+0000 7f8c59dc8b80 10 client.0 _ll_register_callbacks cb 0x55902498f620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:01:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.335+0000 7f8c477fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa1550 0x559024b07f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.335+0000 7f8c477fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa1550 0x559024b07f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36216/0 (socket says 172.21.15.73:36216) 2023-08-10T12:01:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.335+0000 7f8c46ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559024aa6a40 0x559024b08470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.335+0000 7f8c477fe700 1 -- 172.21.15.73:0/11376641 learned_addr learned my addr 172.21.15.73:0/11376641 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.335+0000 7f8c47fff700 1 --2- 172.21.15.73:0/11376641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559024aa7360 0x559024b06ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.335+0000 7f8c477fe700 1 -- 172.21.15.73:0/11376641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559024aa6a40 msgr2=0x559024b08470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.335+0000 7f8c477fe700 1 --2- 172.21.15.73:0/11376641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559024aa6a40 0x559024b08470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.335+0000 7f8c477fe700 1 -- 172.21.15.73:0/11376641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559024aa7360 msgr2=0x559024b06ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.335+0000 7f8c477fe700 1 --2- 172.21.15.73:0/11376641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559024aa7360 0x559024b06ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.335+0000 7f8c477fe700 1 -- 172.21.15.73:0/11376641 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5590248735d0 con 0x559024aa1550 2023-08-10T12:01:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.335+0000 7f8c477fe700 1 --2- 172.21.15.73:0/11376641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa1550 0x559024b07f30 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f8c38003d40 tx=0x7f8c38004190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c65b7584a39621c1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.335+0000 7f8c26ffd700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:01:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.335+0000 7f8c26ffd700 1 -- 172.21.15.73:0/11376641 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3802f410 con 0x559024aa1550 2023-08-10T12:01:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.335+0000 7f8c59dc8b80 1 -- 172.21.15.73:0/11376641 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5590249eb720 con 0x559024aa1550 2023-08-10T12:01:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.335+0000 7f8c26ffd700 1 -- 172.21.15.73:0/11376641 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8c38004490 con 0x559024aa1550 2023-08-10T12:01:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.335+0000 7f8c26ffd700 1 -- 172.21.15.73:0/11376641 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c3801d740 con 0x559024aa1550 2023-08-10T12:01:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.335+0000 7f8c59dc8b80 10 client.16821 fetch_fsmap learned FSMap version 55 2023-08-10T12:01:51.344 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.335+0000 7f8c59dc8b80 1 -- 172.21.15.73:0/11376641 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x5590248461f0 con 0x559024aa1550 2023-08-10T12:01:51.344 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.336+0000 7f8c26ffd700 1 -- 172.21.15.73:0/11376641 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5590249eb720 con 0x559024aa1550 2023-08-10T12:01:51.344 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.336+0000 7f8c26ffd700 1 -- 172.21.15.73:0/11376641 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7f8c3802f6b0 con 0x559024aa1550 2023-08-10T12:01:51.344 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.336+0000 7f8c59dc8b80 10 client.16821 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:01:51.344 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.336+0000 7f8c59dc8b80 10 client.16821 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:01:51.344 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.336+0000 7f8c59dc8b80 20 client.16821 populate_metadata read hostname 'smithi073' 2023-08-10T12:01:51.344 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.336+0000 7f8c59dc8b80 1 --2- 172.21.15.73:0/11376641 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x559024b0ff70 0x559024b12390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:51.344 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.336+0000 7f8c59dc8b80 4 client.16821 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T12:01:51.345 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.336+0000 7f8c59dc8b80 1 -- 172.21.15.73:0/11376641 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5590249acff0 con 0x559024b0ff70 2023-08-10T12:01:51.345 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.336+0000 7f8c46ffd700 1 --2- 172.21.15.73:0/11376641 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x559024b0ff70 0x559024b12390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:51.345 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.336+0000 7f8c26ffd700 10 client.16821 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:51.345 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.336+0000 7f8c46ffd700 1 --2- 172.21.15.73:0/11376641 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x559024b0ff70 0x559024b12390 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=592aaa799b931754 server_cookie=a6e81dbe8653ccf6 in_seq=0 out_seq=0 2023-08-10T12:01:51.346 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.344+0000 7f8c26ffd700 1 -- 172.21.15.73:0/11376641 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5590249acff0 con 0x559024b0ff70 2023-08-10T12:01:51.346 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.344+0000 7f8c26ffd700 10 client.16821 handle_command_reply: tid=0 2023-08-10T12:01:51.346 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.344+0000 7f8c59dc8b80 1 client.16821 shutdown 2023-08-10T12:01:51.347 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.344+0000 7f8c59dc8b80 1 -- 172.21.15.73:0/11376641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa1550 msgr2=0x559024b07f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:51.347 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.344+0000 7f8c59dc8b80 1 --2- 172.21.15.73:0/11376641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa1550 0x559024b07f30 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f8c38003d40 tx=0x7f8c38004190 comp rx=0 tx=0).stop 2023-08-10T12:01:51.347 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.344+0000 7f8c59dc8b80 1 -- 172.21.15.73:0/11376641 shutdown_connections 2023-08-10T12:01:51.347 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.344+0000 7f8c59dc8b80 1 --2- 172.21.15.73:0/11376641 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x559024b0ff70 0x559024b12390 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.347 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.344+0000 7f8c59dc8b80 1 --2- 172.21.15.73:0/11376641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559024aa7360 0x559024b06ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.347 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.344+0000 7f8c59dc8b80 1 --2- 172.21.15.73:0/11376641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559024aa1550 0x559024b07f30 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.347 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.344+0000 7f8c59dc8b80 1 --2- 172.21.15.73:0/11376641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559024aa6a40 0x559024b08470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.348 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.344+0000 7f8c26ffd700 0 client.16821 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:51.348 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.344+0000 7f8c59dc8b80 1 -- 172.21.15.73:0/11376641 >> 172.21.15.73:0/11376641 conn(0x5590249fec70 msgr2=0x559024aa7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:51.348 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.344+0000 7f8c59dc8b80 1 -- 172.21.15.73:0/11376641 shutdown_connections 2023-08-10T12:01:51.348 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.344+0000 7f8c59dc8b80 1 -- 172.21.15.73:0/11376641 wait complete. 2023-08-10T12:01:51.348 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.345+0000 7f8c59dc8b80 20 client.16821 trim_cache size 0 max 16384 2023-08-10T12:01:51.348 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T12:01:51.349 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T12:01:51.349 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T12:01:51.349 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T12:01:51.349 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.345+0000 7f8c4dc2f700 1 -- 172.21.15.73:0/206415636 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f8c300a12c0 msgr2=0x7f8c300a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:51.350 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.345+0000 7f8c4dc2f700 1 --2- 172.21.15.73:0/206415636 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f8c300a12c0 0x7f8c300a3780 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8c38009be0 tx=0x7f8c38009260 comp rx=0 tx=0).stop 2023-08-10T12:01:51.350 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.345+0000 7f8c4dc2f700 1 -- 172.21.15.73:0/206415636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c48106710 msgr2=0x7f8c481a4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:51.350 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.345+0000 7f8c4dc2f700 1 --2- 172.21.15.73:0/206415636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c48106710 0x7f8c481a4a00 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f8c4000ef30 tx=0x7f8c4000c3a0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.350 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.345+0000 7f8c4dc2f700 1 -- 172.21.15.73:0/206415636 shutdown_connections 2023-08-10T12:01:51.350 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.345+0000 7f8c4dc2f700 1 --2- 172.21.15.73:0/206415636 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f8c300a12c0 0x7f8c300a3780 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.350 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.345+0000 7f8c4dc2f700 1 --2- 172.21.15.73:0/206415636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c48068a70 0x7f8c480ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.351 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.345+0000 7f8c4dc2f700 1 --2- 172.21.15.73:0/206415636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c48106710 0x7f8c481a4a00 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.351 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.345+0000 7f8c4dc2f700 1 --2- 172.21.15.73:0/206415636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c48069410 0x7f8c480ffdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:51.351 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.345+0000 7f8c4dc2f700 1 -- 172.21.15.73:0/206415636 >> 172.21.15.73:0/206415636 conn(0x7f8c48076770 msgr2=0x7f8c480fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:51.351 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.345+0000 7f8c4dc2f700 1 -- 172.21.15.73:0/206415636 shutdown_connections 2023-08-10T12:01:51.351 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:01:51.345+0000 7f8c4dc2f700 1 -- 172.21.15.73:0/206415636 wait complete. 2023-08-10T12:01:51.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:51 smithi152 ceph-mon[130220]: pgmap v285: 97 pgs: 97 active+clean; 2.0 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.4 MiB/s wr, 342 op/s 2023-08-10T12:01:51.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:51 smithi156 ceph-mon[130574]: pgmap v285: 97 pgs: 97 active+clean; 2.0 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.4 MiB/s wr, 342 op/s 2023-08-10T12:01:51.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:51 smithi073 ceph-mon[128869]: pgmap v285: 97 pgs: 97 active+clean; 2.0 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.4 MiB/s wr, 342 op/s 2023-08-10T12:01:53.503 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:53 smithi152 ceph-mon[130220]: pgmap v286: 97 pgs: 97 active+clean; 2.0 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 263 op/s 2023-08-10T12:01:53.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:53 smithi156 ceph-mon[130574]: pgmap v286: 97 pgs: 97 active+clean; 2.0 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 263 op/s 2023-08-10T12:01:53.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:53 smithi073 ceph-mon[128869]: pgmap v286: 97 pgs: 97 active+clean; 2.0 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 263 op/s 2023-08-10T12:01:54.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:54 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:01:54.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:54 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:01:54.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:54 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:01:54.887 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T12:01:55.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.017+0000 7fe28556a700 1 -- 172.21.15.73:0/1087488094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe280072b10 msgr2=0x7fe280072ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.017+0000 7fe28556a700 1 --2- 172.21.15.73:0/1087488094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe280072b10 0x7fe280072ef0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fe27800b0a0 tx=0x7fe27800b3b0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.017+0000 7fe28556a700 1 -- 172.21.15.73:0/1087488094 shutdown_connections 2023-08-10T12:01:55.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.017+0000 7fe28556a700 1 --2- 172.21.15.73:0/1087488094 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2801116d0 0x7fe280113ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.017+0000 7fe28556a700 1 --2- 172.21.15.73:0/1087488094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe280072b10 0x7fe280072ef0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.017+0000 7fe28556a700 1 --2- 172.21.15.73:0/1087488094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe280073430 0x7fe280111190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.017+0000 7fe28556a700 1 -- 172.21.15.73:0/1087488094 >> 172.21.15.73:0/1087488094 conn(0x7fe2800fc1f0 msgr2=0x7fe2800fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:55.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.019+0000 7fe28556a700 1 -- 172.21.15.73:0/1087488094 shutdown_connections 2023-08-10T12:01:55.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.019+0000 7fe28556a700 1 -- 172.21.15.73:0/1087488094 wait complete. 2023-08-10T12:01:55.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.019+0000 7fe28556a700 1 Processor -- start 2023-08-10T12:01:55.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.020+0000 7fe28556a700 1 -- start start 2023-08-10T12:01:55.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.020+0000 7fe28556a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe280072b10 0x7fe28006fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.020+0000 7fe28556a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe280073430 0x7fe28006ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.020+0000 7fe28556a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2801116d0 0x7fe28006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.020+0000 7fe28556a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28006b250 con 0x7fe280072b10 2023-08-10T12:01:55.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.020+0000 7fe28556a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28006b3c0 con 0x7fe280073430 2023-08-10T12:01:55.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.020+0000 7fe28556a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28006b580 con 0x7fe2801116d0 2023-08-10T12:01:55.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.020+0000 7fe27effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe280072b10 0x7fe28006fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.020+0000 7fe27effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe280072b10 0x7fe28006fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36230/0 (socket says 172.21.15.73:36230) 2023-08-10T12:01:55.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.020+0000 7fe27effd700 1 -- 172.21.15.73:0/2397666885 learned_addr learned my addr 172.21.15.73:0/2397666885 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:55.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.020+0000 7fe27e7fc700 1 --2- 172.21.15.73:0/2397666885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe280073430 0x7fe28006ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.021+0000 7fe27f7fe700 1 --2- 172.21.15.73:0/2397666885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2801116d0 0x7fe28006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.021+0000 7fe27effd700 1 -- 172.21.15.73:0/2397666885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2801116d0 msgr2=0x7fe28006aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.021+0000 7fe27effd700 1 --2- 172.21.15.73:0/2397666885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2801116d0 0x7fe28006aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.021+0000 7fe27effd700 1 -- 172.21.15.73:0/2397666885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe280073430 msgr2=0x7fe28006ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.021+0000 7fe27effd700 1 --2- 172.21.15.73:0/2397666885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe280073430 0x7fe28006ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.021+0000 7fe27effd700 1 -- 172.21.15.73:0/2397666885 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe278009d00 con 0x7fe280072b10 2023-08-10T12:01:55.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.021+0000 7fe27effd700 1 --2- 172.21.15.73:0/2397666885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe280072b10 0x7fe28006fa20 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fe27800b070 tx=0x7fe278007b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:55.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.021+0000 7fe277fff700 1 -- 172.21.15.73:0/2397666885 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27800e040 con 0x7fe280072b10 2023-08-10T12:01:55.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.021+0000 7fe277fff700 1 -- 172.21.15.73:0/2397666885 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe278005530 con 0x7fe280072b10 2023-08-10T12:01:55.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.021+0000 7fe28556a700 1 -- 172.21.15.73:0/2397666885 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe28006b800 con 0x7fe280072b10 2023-08-10T12:01:55.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.021+0000 7fe277fff700 1 -- 172.21.15.73:0/2397666885 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27801db30 con 0x7fe280072b10 2023-08-10T12:01:55.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.021+0000 7fe28556a700 1 -- 172.21.15.73:0/2397666885 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe28006e960 con 0x7fe280072b10 2023-08-10T12:01:55.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.026+0000 7fe277fff700 1 -- 172.21.15.73:0/2397666885 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fe2780056a0 con 0x7fe280072b10 2023-08-10T12:01:55.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.026+0000 7fe291703b80 1 Processor -- start 2023-08-10T12:01:55.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.026+0000 7fe291703b80 1 -- start start 2023-08-10T12:01:55.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.027+0000 7fe291703b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 0x5581a763c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.027+0000 7fe291703b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581a763c870 0x5581a76362c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.027+0000 7fe291703b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581a7636800 0x5581a7636c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.027+0000 7fe291703b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581a75b1dc0 con 0x5581a763bf50 2023-08-10T12:01:55.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.027+0000 7fe291703b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581a758e590 con 0x5581a763c870 2023-08-10T12:01:55.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.027+0000 7fe291703b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581a758beb0 con 0x5581a7636800 2023-08-10T12:01:55.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.027+0000 7fe277fff700 1 --2- 172.21.15.73:0/2397666885 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe26c0a1380 0x7fe26c0a3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.027+0000 7fe27f7fe700 1 --2- 172.21.15.73:0/2397666885 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe26c0a1380 0x7fe26c0a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.027+0000 7fe277fff700 1 -- 172.21.15.73:0/2397666885 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe2780ce0e0 con 0x7fe280072b10 2023-08-10T12:01:55.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.028+0000 7fe27f7fe700 1 --2- 172.21.15.73:0/2397666885 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe26c0a1380 0x7fe26c0a3840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe268006e50 tx=0x7fe268006dc0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:55.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.029+0000 7fe27effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581a763c870 0x5581a76362c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.029+0000 7fe27f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 0x5581a763c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.029+0000 7fe27e7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581a7636800 0x5581a7636c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.029+0000 7fe27f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 0x5581a763c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36236/0 (socket says 172.21.15.73:36236) 2023-08-10T12:01:55.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.029+0000 7fe27f7fe700 1 -- 172.21.15.73:0/2239835498 learned_addr learned my addr 172.21.15.73:0/2239835498 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:55.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.029+0000 7fe27e7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581a7636800 0x5581a7636c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:33514/0 (socket says 172.21.15.73:33514) 2023-08-10T12:01:55.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.029+0000 7fe27f7fe700 1 -- 172.21.15.73:0/2239835498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581a7636800 msgr2=0x5581a7636c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:55.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.029+0000 7fe27f7fe700 1 --2- 172.21.15.73:0/2239835498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581a7636800 0x5581a7636c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.029+0000 7fe27f7fe700 1 -- 172.21.15.73:0/2239835498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581a763c870 msgr2=0x5581a76362c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:55.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.029+0000 7fe27f7fe700 1 --2- 172.21.15.73:0/2239835498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581a763c870 0x5581a76362c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.029+0000 7fe27f7fe700 1 -- 172.21.15.73:0/2239835498 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581a7408630 con 0x5581a763bf50 2023-08-10T12:01:55.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.029+0000 7fe27f7fe700 1 --2- 172.21.15.73:0/2239835498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 0x5581a763c330 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe268010a70 tx=0x7fe26800b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9917f6e587c631 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:55.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.030+0000 7fe2757fa700 1 -- 172.21.15.73:0/2239835498 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2680148c0 con 0x5581a763bf50 2023-08-10T12:01:55.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.030+0000 7fe2757fa700 1 -- 172.21.15.73:0/2239835498 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe26801e3f0 con 0x5581a763bf50 2023-08-10T12:01:55.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.030+0000 7fe2757fa700 1 -- 172.21.15.73:0/2239835498 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe268013630 con 0x5581a763bf50 2023-08-10T12:01:55.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.030+0000 7fe291703b80 1 -- 172.21.15.73:0/2239835498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 msgr2=0x5581a763c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.030+0000 7fe291703b80 1 --2- 172.21.15.73:0/2239835498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 0x5581a763c330 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe268010a70 tx=0x7fe26800b000 comp rx=0 tx=0).stop 2023-08-10T12:01:55.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.031+0000 7fe291703b80 1 -- 172.21.15.73:0/2239835498 shutdown_connections 2023-08-10T12:01:55.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.031+0000 7fe291703b80 1 --2- 172.21.15.73:0/2239835498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581a7636800 0x5581a7636c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.031+0000 7fe291703b80 1 --2- 172.21.15.73:0/2239835498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 0x5581a763c330 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.031+0000 7fe291703b80 1 --2- 172.21.15.73:0/2239835498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581a763c870 0x5581a76362c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.031+0000 7fe291703b80 1 -- 172.21.15.73:0/2239835498 >> 172.21.15.73:0/2239835498 conn(0x5581a7593cd0 msgr2=0x5581a76314d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:55.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.031+0000 7fe291703b80 1 -- 172.21.15.73:0/2239835498 shutdown_connections 2023-08-10T12:01:55.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.031+0000 7fe291703b80 1 -- 172.21.15.73:0/2239835498 wait complete. 2023-08-10T12:01:55.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.031+0000 7fe291703b80 1 -- start start 2023-08-10T12:01:55.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.031+0000 7fe291703b80 1 Processor -- start 2023-08-10T12:01:55.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.032+0000 7fe291703b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581a7636800 0x5581a76428a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.032+0000 7fe291703b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 0x5581a763fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.032+0000 7fe291703b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581a763c870 0x5581a76401c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.032+0000 7fe291703b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581a75877a0 con 0x5581a763bf50 2023-08-10T12:01:55.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.032+0000 7fe291703b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581a7526ac0 con 0x5581a7636800 2023-08-10T12:01:55.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.032+0000 7fe291703b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581a75267c0 con 0x5581a763c870 2023-08-10T12:01:55.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.032+0000 7fe291703b80 10 client.0 _ll_register_callbacks cb 0x5581a7524680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:01:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.032+0000 7fe27e7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 0x5581a763fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.032+0000 7fe27e7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 0x5581a763fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36246/0 (socket says 172.21.15.73:36246) 2023-08-10T12:01:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.032+0000 7fe27e7fc700 1 -- 172.21.15.73:0/4001506657 learned_addr learned my addr 172.21.15.73:0/4001506657 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.032+0000 7fe27f7fe700 1 --2- 172.21.15.73:0/4001506657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581a763c870 0x5581a76401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.032+0000 7fe27effd700 1 --2- 172.21.15.73:0/4001506657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581a7636800 0x5581a76428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.032+0000 7fe27e7fc700 1 -- 172.21.15.73:0/4001506657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581a763c870 msgr2=0x5581a76401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:55.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.032+0000 7fe27e7fc700 1 --2- 172.21.15.73:0/4001506657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581a763c870 0x5581a76401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.032+0000 7fe27e7fc700 1 -- 172.21.15.73:0/4001506657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581a7636800 msgr2=0x5581a76428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:55.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.032+0000 7fe27e7fc700 1 --2- 172.21.15.73:0/4001506657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581a7636800 0x5581a76428a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.032+0000 7fe27e7fc700 1 -- 172.21.15.73:0/4001506657 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe268010750 con 0x5581a763bf50 2023-08-10T12:01:55.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.032+0000 7fe27e7fc700 1 --2- 172.21.15.73:0/4001506657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 0x5581a763fb20 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe270011570 tx=0x7fe270011880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2123237e8f52e6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:55.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.032+0000 7fe2667fc700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:01:55.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.032+0000 7fe2667fc700 1 -- 172.21.15.73:0/4001506657 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe270014650 con 0x5581a763bf50 2023-08-10T12:01:55.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.032+0000 7fe291703b80 1 -- 172.21.15.73:0/4001506657 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5581a7629470 con 0x5581a763bf50 2023-08-10T12:01:55.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.033+0000 7fe2667fc700 1 -- 172.21.15.73:0/4001506657 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe2700147b0 con 0x5581a763bf50 2023-08-10T12:01:55.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.033+0000 7fe2667fc700 1 -- 172.21.15.73:0/4001506657 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe270014970 con 0x5581a763bf50 2023-08-10T12:01:55.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.033+0000 7fe291703b80 10 client.16833 fetch_fsmap learned FSMap version 55 2023-08-10T12:01:55.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.033+0000 7fe291703b80 1 -- 172.21.15.73:0/4001506657 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x5581a73b4de0 con 0x5581a763bf50 2023-08-10T12:01:55.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.033+0000 7fe2667fc700 1 -- 172.21.15.73:0/4001506657 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5581a7629470 con 0x5581a763bf50 2023-08-10T12:01:55.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.033+0000 7fe2667fc700 1 -- 172.21.15.73:0/4001506657 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7fe27001b020 con 0x5581a763bf50 2023-08-10T12:01:55.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.033+0000 7fe291703b80 10 client.16833 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:01:55.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.033+0000 7fe291703b80 10 client.16833 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T12:01:55.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.033+0000 7fe291703b80 20 client.16833 populate_metadata read hostname 'smithi073' 2023-08-10T12:01:55.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.033+0000 7fe291703b80 1 --2- 172.21.15.73:0/4001506657 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5581a76502b0 0x5581a76526d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.033+0000 7fe291703b80 4 client.16833 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:01:55.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.033+0000 7fe291703b80 1 -- 172.21.15.73:0/4001506657 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5581a76059d0 con 0x5581a76502b0 2023-08-10T12:01:55.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.034+0000 7fe27effd700 1 --2- 172.21.15.73:0/4001506657 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5581a76502b0 0x5581a76526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.035+0000 7fe2667fc700 10 client.16833 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:55.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.035+0000 7fe27effd700 1 --2- 172.21.15.73:0/4001506657 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5581a76502b0 0x5581a76526d0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20a88f0131e77e16 server_cookie=62e6ff6bcb7b8544 in_seq=0 out_seq=0 2023-08-10T12:01:55.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.229+0000 7fe2667fc700 1 -- 172.21.15.73:0/4001506657 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5581a76059d0 con 0x5581a76502b0 2023-08-10T12:01:55.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.229+0000 7fe2667fc700 10 client.16833 handle_command_reply: tid=0 2023-08-10T12:01:55.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.229+0000 7fe291703b80 1 client.16833 shutdown 2023-08-10T12:01:55.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.229+0000 7fe291703b80 1 -- 172.21.15.73:0/4001506657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 msgr2=0x5581a763fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.229+0000 7fe291703b80 1 --2- 172.21.15.73:0/4001506657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 0x5581a763fb20 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe270011570 tx=0x7fe270011880 comp rx=0 tx=0).stop 2023-08-10T12:01:55.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.229+0000 7fe291703b80 1 -- 172.21.15.73:0/4001506657 shutdown_connections 2023-08-10T12:01:55.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.229+0000 7fe291703b80 1 --2- 172.21.15.73:0/4001506657 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5581a76502b0 0x5581a76526d0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.229+0000 7fe291703b80 1 --2- 172.21.15.73:0/4001506657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581a7636800 0x5581a76428a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.229+0000 7fe2667fc700 0 client.16833 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:55.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.229+0000 7fe291703b80 1 --2- 172.21.15.73:0/4001506657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581a763c870 0x5581a76401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.229+0000 7fe291703b80 1 --2- 172.21.15.73:0/4001506657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 0x5581a763fb20 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.229+0000 7fe291703b80 1 -- 172.21.15.73:0/4001506657 >> 172.21.15.73:0/4001506657 conn(0x5581a7593cd0 msgr2=0x5581a76309b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:55.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.229+0000 7fe291703b80 1 -- 172.21.15.73:0/4001506657 shutdown_connections 2023-08-10T12:01:55.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.229+0000 7fe291703b80 1 -- 172.21.15.73:0/4001506657 wait complete. 2023-08-10T12:01:55.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.229+0000 7fe291703b80 20 client.16833 trim_cache size 0 max 16384 2023-08-10T12:01:55.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.247+0000 7fe291703b80 1 Processor -- start 2023-08-10T12:01:55.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.247+0000 7fe291703b80 1 -- start start 2023-08-10T12:01:55.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.248+0000 7fe291703b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581a7636800 0x5581a7647360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.248+0000 7fe291703b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 0x5581a763b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.248+0000 7fe291703b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581a763c870 0x5581a7642440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.248+0000 7fe291703b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581a740a920 con 0x5581a763bf50 2023-08-10T12:01:55.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.248+0000 7fe291703b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581a762df80 con 0x5581a763c870 2023-08-10T12:01:55.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.248+0000 7fe291703b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581a764cc80 con 0x5581a7636800 2023-08-10T12:01:55.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.248+0000 7fe27e7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 0x5581a763b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.248+0000 7fe27e7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 0x5581a763b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36256/0 (socket says 172.21.15.73:36256) 2023-08-10T12:01:55.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.248+0000 7fe27e7fc700 1 -- 172.21.15.73:0/3208287922 learned_addr learned my addr 172.21.15.73:0/3208287922 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:55.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.248+0000 7fe27f7fe700 1 --2- 172.21.15.73:0/3208287922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581a763c870 0x5581a7642440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.248+0000 7fe27effd700 1 --2- 172.21.15.73:0/3208287922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581a7636800 0x5581a7647360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.248+0000 7fe27e7fc700 1 -- 172.21.15.73:0/3208287922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581a7636800 msgr2=0x5581a7647360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:55.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.248+0000 7fe27e7fc700 1 --2- 172.21.15.73:0/3208287922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581a7636800 0x5581a7647360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.248+0000 7fe27e7fc700 1 -- 172.21.15.73:0/3208287922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581a763c870 msgr2=0x5581a7642440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:55.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.248+0000 7fe27e7fc700 1 --2- 172.21.15.73:0/3208287922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581a763c870 0x5581a7642440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.248+0000 7fe27e7fc700 1 -- 172.21.15.73:0/3208287922 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581a739dc60 con 0x5581a763bf50 2023-08-10T12:01:55.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.248+0000 7fe27e7fc700 1 --2- 172.21.15.73:0/3208287922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 0x5581a763b2b0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fe27000b010 tx=0x7fe270026da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e118c9dac2e992 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:55.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.248+0000 7fe275ffb700 1 -- 172.21.15.73:0/3208287922 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe270026630 con 0x5581a763bf50 2023-08-10T12:01:55.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.249+0000 7fe275ffb700 1 -- 172.21.15.73:0/3208287922 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe270011bd0 con 0x5581a763bf50 2023-08-10T12:01:55.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.249+0000 7fe275ffb700 1 -- 172.21.15.73:0/3208287922 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe270003940 con 0x5581a763bf50 2023-08-10T12:01:55.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.249+0000 7fe291703b80 1 -- 172.21.15.73:0/3208287922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 msgr2=0x5581a763b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.249+0000 7fe291703b80 1 --2- 172.21.15.73:0/3208287922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 0x5581a763b2b0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fe27000b010 tx=0x7fe270026da0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.250+0000 7fe291703b80 1 -- 172.21.15.73:0/3208287922 shutdown_connections 2023-08-10T12:01:55.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.250+0000 7fe291703b80 1 --2- 172.21.15.73:0/3208287922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581a763c870 0x5581a7642440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.250+0000 7fe291703b80 1 --2- 172.21.15.73:0/3208287922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581a7636800 0x5581a7647360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.250+0000 7fe291703b80 1 --2- 172.21.15.73:0/3208287922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 0x5581a763b2b0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.250+0000 7fe291703b80 1 -- 172.21.15.73:0/3208287922 >> 172.21.15.73:0/3208287922 conn(0x5581a7593cd0 msgr2=0x5581a763aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:55.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.250+0000 7fe291703b80 1 -- 172.21.15.73:0/3208287922 shutdown_connections 2023-08-10T12:01:55.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.250+0000 7fe291703b80 1 -- 172.21.15.73:0/3208287922 wait complete. 2023-08-10T12:01:55.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.250+0000 7fe291703b80 1 -- start start 2023-08-10T12:01:55.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.250+0000 7fe291703b80 1 Processor -- start 2023-08-10T12:01:55.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.250+0000 7fe291703b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581a7636800 0x5581a76471c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.250+0000 7fe291703b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 0x5581a7643540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.250+0000 7fe291703b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581a763c870 0x5581a7643ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.250+0000 7fe291703b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581a7644220 con 0x5581a763bf50 2023-08-10T12:01:55.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.250+0000 7fe291703b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581a7644390 con 0x5581a7636800 2023-08-10T12:01:55.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.250+0000 7fe291703b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581a76a3f20 con 0x5581a763c870 2023-08-10T12:01:55.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.250+0000 7fe291703b80 10 client.0 _ll_register_callbacks cb 0x5581a7524680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:01:55.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.251+0000 7fe27e7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 0x5581a7643540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.251+0000 7fe27e7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 0x5581a7643540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36260/0 (socket says 172.21.15.73:36260) 2023-08-10T12:01:55.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.251+0000 7fe27e7fc700 1 -- 172.21.15.73:0/899299839 learned_addr learned my addr 172.21.15.73:0/899299839 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:55.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.251+0000 7fe27effd700 1 --2- 172.21.15.73:0/899299839 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581a7636800 0x5581a76471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.251+0000 7fe27f7fe700 1 --2- 172.21.15.73:0/899299839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581a763c870 0x5581a7643ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.251+0000 7fe27e7fc700 1 -- 172.21.15.73:0/899299839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581a763c870 msgr2=0x5581a7643ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:55.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.251+0000 7fe27e7fc700 1 --2- 172.21.15.73:0/899299839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581a763c870 0x5581a7643ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.251+0000 7fe27e7fc700 1 -- 172.21.15.73:0/899299839 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581a7636800 msgr2=0x5581a76471c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:55.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.251+0000 7fe27e7fc700 1 --2- 172.21.15.73:0/899299839 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581a7636800 0x5581a76471c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.251+0000 7fe27e7fc700 1 -- 172.21.15.73:0/899299839 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5581a73b4de0 con 0x5581a763bf50 2023-08-10T12:01:55.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.251+0000 7fe27f7fe700 1 --2- 172.21.15.73:0/899299839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581a763c870 0x5581a7643ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T12:01:55.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.251+0000 7fe27e7fc700 1 --2- 172.21.15.73:0/899299839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 0x5581a7643540 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fe270000c00 tx=0x7fe270026a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3119a2964f9cfa6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:55.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.251+0000 7fe2667fc700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:01:55.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.251+0000 7fe2667fc700 1 -- 172.21.15.73:0/899299839 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe270014a60 con 0x5581a763bf50 2023-08-10T12:01:55.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.251+0000 7fe2667fc700 1 -- 172.21.15.73:0/899299839 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe270014bc0 con 0x5581a763bf50 2023-08-10T12:01:55.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.251+0000 7fe291703b80 1 -- 172.21.15.73:0/899299839 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe26801e3f0 con 0x5581a763bf50 2023-08-10T12:01:55.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.252+0000 7fe2667fc700 1 -- 172.21.15.73:0/899299839 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe270014dc0 con 0x5581a763bf50 2023-08-10T12:01:55.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.252+0000 7fe291703b80 10 client.16839 fetch_fsmap learned FSMap version 55 2023-08-10T12:01:55.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.252+0000 7fe291703b80 1 -- 172.21.15.73:0/899299839 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x5581a73db250 con 0x5581a763bf50 2023-08-10T12:01:55.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.252+0000 7fe2667fc700 1 -- 172.21.15.73:0/899299839 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe26801e3f0 con 0x5581a763bf50 2023-08-10T12:01:55.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.252+0000 7fe2667fc700 1 -- 172.21.15.73:0/899299839 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7fe2700115a0 con 0x5581a763bf50 2023-08-10T12:01:55.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.252+0000 7fe291703b80 10 client.16839 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:01:55.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.252+0000 7fe291703b80 10 client.16839 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T12:01:55.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.252+0000 7fe291703b80 20 client.16839 populate_metadata read hostname 'smithi073' 2023-08-10T12:01:55.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.252+0000 7fe291703b80 1 --2- 172.21.15.73:0/899299839 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5581a76a52d0 0x5581a76a76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.252+0000 7fe291703b80 4 client.16839 mds_command: new command op to 24503 tid=0[{"prefix": "scrub status"}] 2023-08-10T12:01:55.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.252+0000 7fe291703b80 1 -- 172.21.15.73:0/899299839 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5581a7580780 con 0x5581a76a52d0 2023-08-10T12:01:55.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.253+0000 7fe27effd700 1 --2- 172.21.15.73:0/899299839 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5581a76a52d0 0x5581a76a76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.253+0000 7fe27effd700 1 --2- 172.21.15.73:0/899299839 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5581a76a52d0 0x5581a76a76f0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26aa0c903195fc95 server_cookie=abc9979ad0dce135 in_seq=0 out_seq=0 2023-08-10T12:01:55.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.253+0000 7fe2667fc700 10 client.16839 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:55.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.253+0000 7fe2667fc700 1 -- 172.21.15.73:0/899299839 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5581a7580780 con 0x5581a76a52d0 2023-08-10T12:01:55.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.253+0000 7fe2667fc700 10 client.16839 handle_command_reply: tid=0 2023-08-10T12:01:55.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.253+0000 7fe291703b80 1 client.16839 shutdown 2023-08-10T12:01:55.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.254+0000 7fe291703b80 1 -- 172.21.15.73:0/899299839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 msgr2=0x5581a7643540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.254+0000 7fe291703b80 1 --2- 172.21.15.73:0/899299839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 0x5581a7643540 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fe270000c00 tx=0x7fe270026a80 comp rx=0 tx=0).stop 2023-08-10T12:01:55.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.254+0000 7fe291703b80 1 -- 172.21.15.73:0/899299839 shutdown_connections 2023-08-10T12:01:55.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.254+0000 7fe291703b80 1 --2- 172.21.15.73:0/899299839 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5581a76a52d0 0x5581a76a76f0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.254+0000 7fe291703b80 1 --2- 172.21.15.73:0/899299839 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5581a7636800 0x5581a76471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.254+0000 7fe291703b80 1 --2- 172.21.15.73:0/899299839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581a763c870 0x5581a7643ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.254+0000 7fe291703b80 1 --2- 172.21.15.73:0/899299839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5581a763bf50 0x5581a7643540 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.254+0000 7fe291703b80 1 -- 172.21.15.73:0/899299839 >> 172.21.15.73:0/899299839 conn(0x5581a7593cd0 msgr2=0x5581a763b430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:55.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.254+0000 7fe2667fc700 0 client.16839 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:55.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.254+0000 7fe291703b80 1 -- 172.21.15.73:0/899299839 shutdown_connections 2023-08-10T12:01:55.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.254+0000 7fe291703b80 1 -- 172.21.15.73:0/899299839 wait complete. 2023-08-10T12:01:55.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.254+0000 7fe291703b80 20 client.16839 trim_cache size 0 max 16384 2023-08-10T12:01:55.264 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T12:01:55.264 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "no active scrubs running", 2023-08-10T12:01:55.264 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": {} 2023-08-10T12:01:55.264 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T12:01:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.254+0000 7fe28556a700 1 -- 172.21.15.73:0/2397666885 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe26c0a1380 msgr2=0x7fe26c0a3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.254+0000 7fe28556a700 1 --2- 172.21.15.73:0/2397666885 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe26c0a1380 0x7fe26c0a3840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe268006e50 tx=0x7fe268006dc0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.254+0000 7fe28556a700 1 -- 172.21.15.73:0/2397666885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe280072b10 msgr2=0x7fe28006fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.254+0000 7fe28556a700 1 --2- 172.21.15.73:0/2397666885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe280072b10 0x7fe28006fa20 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fe27800b070 tx=0x7fe278007b60 comp rx=0 tx=0).stop 2023-08-10T12:01:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.255+0000 7fe28556a700 1 -- 172.21.15.73:0/2397666885 shutdown_connections 2023-08-10T12:01:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.255+0000 7fe28556a700 1 --2- 172.21.15.73:0/2397666885 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe26c0a1380 0x7fe26c0a3840 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.255+0000 7fe28556a700 1 --2- 172.21.15.73:0/2397666885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2801116d0 0x7fe28006aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.255+0000 7fe28556a700 1 --2- 172.21.15.73:0/2397666885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe280072b10 0x7fe28006fa20 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.255+0000 7fe28556a700 1 --2- 172.21.15.73:0/2397666885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe280073430 0x7fe28006ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.255+0000 7fe28556a700 1 -- 172.21.15.73:0/2397666885 >> 172.21.15.73:0/2397666885 conn(0x7fe2800fc1f0 msgr2=0x7fe2800fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:55.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.255+0000 7fe28556a700 1 -- 172.21.15.73:0/2397666885 shutdown_connections 2023-08-10T12:01:55.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.255+0000 7fe28556a700 1 -- 172.21.15.73:0/2397666885 wait complete. 2023-08-10T12:01:55.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:55 smithi073 ceph-mon[128869]: pgmap v287: 97 pgs: 97 active+clean; 2.0 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 291 op/s 2023-08-10T12:01:55.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:55 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:01:55.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:55 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:01:55.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:55 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:01:55.268 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-08-10T12:01:55.268 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T12:01:55.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.391+0000 7f00e88d3700 1 -- 172.21.15.73:0/3859657429 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00e4100a20 msgr2=0x7f00e410c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.391+0000 7f00e88d3700 1 --2- 172.21.15.73:0/3859657429 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00e4100a20 0x7f00e410c4d0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00b0d0 tx=0x7f00dc00b3e0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.391+0000 7f00e88d3700 1 -- 172.21.15.73:0/3859657429 shutdown_connections 2023-08-10T12:01:55.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.391+0000 7f00e88d3700 1 --2- 172.21.15.73:0/3859657429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00e4104640 0x7f00e4104a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.391+0000 7f00e88d3700 1 --2- 172.21.15.73:0/3859657429 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00e4100a20 0x7f00e410c4d0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.391+0000 7f00e88d3700 1 --2- 172.21.15.73:0/3859657429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00e4100060 0x7f00e41004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.391+0000 7f00e88d3700 1 -- 172.21.15.73:0/3859657429 >> 172.21.15.73:0/3859657429 conn(0x7f00e4075a60 msgr2=0x7f00e4075e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:55.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.391+0000 7f00e88d3700 1 -- 172.21.15.73:0/3859657429 shutdown_connections 2023-08-10T12:01:55.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.391+0000 7f00e88d3700 1 -- 172.21.15.73:0/3859657429 wait complete. 2023-08-10T12:01:55.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.392+0000 7f00e88d3700 1 Processor -- start 2023-08-10T12:01:55.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.392+0000 7f00e88d3700 1 -- start start 2023-08-10T12:01:55.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.392+0000 7f00e88d3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00e4100060 0x7f00e419c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.392+0000 7f00e88d3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00e4100a20 0x7f00e419cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.392+0000 7f00e88d3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00e4104640 0x7f00e4196650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.392+0000 7f00e88d3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e4196cc0 con 0x7f00e4100060 2023-08-10T12:01:55.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.392+0000 7f00e88d3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e4196e30 con 0x7f00e4100a20 2023-08-10T12:01:55.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.392+0000 7f00e88d3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e4196ff0 con 0x7f00e4104640 2023-08-10T12:01:55.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.392+0000 7f00e259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00e4100060 0x7f00e419c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.392+0000 7f00e259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00e4100060 0x7f00e419c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36272/0 (socket says 172.21.15.73:36272) 2023-08-10T12:01:55.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.392+0000 7f00e1d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00e4100a20 0x7f00e419cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.392+0000 7f00e259c700 1 -- 172.21.15.73:0/2436824257 learned_addr learned my addr 172.21.15.73:0/2436824257 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:55.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.392+0000 7f00e2d9d700 1 --2- 172.21.15.73:0/2436824257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00e4104640 0x7f00e4196650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.392+0000 7f00e259c700 1 -- 172.21.15.73:0/2436824257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00e4104640 msgr2=0x7f00e4196650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.393+0000 7f00e259c700 1 --2- 172.21.15.73:0/2436824257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00e4104640 0x7f00e4196650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.393+0000 7f00e259c700 1 -- 172.21.15.73:0/2436824257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00e4100a20 msgr2=0x7f00e419cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.393+0000 7f00e259c700 1 --2- 172.21.15.73:0/2436824257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00e4100a20 0x7f00e419cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.393+0000 7f00e259c700 1 -- 172.21.15.73:0/2436824257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc009d00 con 0x7f00e4100060 2023-08-10T12:01:55.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.393+0000 7f00e1d9b700 1 --2- 172.21.15.73:0/2436824257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00e4100a20 0x7f00e419cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:01:55.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.393+0000 7f00e259c700 1 --2- 172.21.15.73:0/2436824257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00e4100060 0x7f00e419c5e0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00e9a0 tx=0x7f00cc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:55.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.393+0000 7f00db7fe700 1 -- 172.21.15.73:0/2436824257 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc009790 con 0x7f00e4100060 2023-08-10T12:01:55.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.393+0000 7f00db7fe700 1 -- 172.21.15.73:0/2436824257 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f00cc010430 con 0x7f00e4100060 2023-08-10T12:01:55.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.393+0000 7f00e88d3700 1 -- 172.21.15.73:0/2436824257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e41972d0 con 0x7f00e4100060 2023-08-10T12:01:55.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.393+0000 7f00db7fe700 1 -- 172.21.15.73:0/2436824257 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc018680 con 0x7f00e4100060 2023-08-10T12:01:55.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.393+0000 7f00e88d3700 1 -- 172.21.15.73:0/2436824257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e41a35d0 con 0x7f00e4100060 2023-08-10T12:01:55.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.394+0000 7f00e88d3700 1 -- 172.21.15.73:0/2436824257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e40679b0 con 0x7f00e4100060 2023-08-10T12:01:55.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.395+0000 7f00db7fe700 1 -- 172.21.15.73:0/2436824257 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f00cc0105a0 con 0x7f00e4100060 2023-08-10T12:01:55.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.395+0000 7f00db7fe700 1 --2- 172.21.15.73:0/2436824257 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f00d00a1380 0x7f00d00a3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.396+0000 7f00e1d9b700 1 --2- 172.21.15.73:0/2436824257 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f00d00a1380 0x7f00d00a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.396+0000 7f00db7fe700 1 -- 172.21.15.73:0/2436824257 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f00cc014070 con 0x7f00e4100060 2023-08-10T12:01:55.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.396+0000 7f00e1d9b700 1 --2- 172.21.15.73:0/2436824257 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f00d00a1380 0x7f00d00a3840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f00e4105bf0 tx=0x7f00d4009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:55.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.399+0000 7f00db7fe700 1 -- 172.21.15.73:0/2436824257 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f00cc0964a0 con 0x7f00e4100060 2023-08-10T12:01:55.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:55 smithi152 ceph-mon[130220]: pgmap v287: 97 pgs: 97 active+clean; 2.0 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 291 op/s 2023-08-10T12:01:55.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:55 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:01:55.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:55 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:01:55.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:55 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:01:55.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:55 smithi156 ceph-mon[130574]: pgmap v287: 97 pgs: 97 active+clean; 2.0 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 291 op/s 2023-08-10T12:01:55.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:55 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:01:55.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:55 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:01:55.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:55 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:01:55.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.647+0000 7f00e88d3700 1 -- 172.21.15.73:0/2436824257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00e4197b60 con 0x7f00e4100060 2023-08-10T12:01:55.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.648+0000 7f00db7fe700 1 -- 172.21.15.73:0/2436824257 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+10167 (secure 0 0 0) 0x7f00cc0ade60 con 0x7f00e4100060 2023-08-10T12:01:55.649 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T12:01:55.649 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":55,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1319360725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1319360725},{"type":"v1","addr":"172.21.15.73:6835","nonce":1319360725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":55,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-10T11:50:54.304447+0000","modified":"2023-08-10T12:01:34.076486+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24503,"mds_1":24479,"mds_2":24451,"mds_3":24443,"mds_4":24419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14559":{"gid":14559,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6837/431221951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":431221951},{"type":"v1","addr":"172.21.15.73:6837","nonce":431221951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6839/1099539481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1099539481},{"type":"v1","addr":"172.21.15.73:6839","nonce":1099539481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6841/3067925859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6840","nonce":3067925859},{"type":"v1","addr":"172.21.15.73:6841","nonce":3067925859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24397":{"gid":24397,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6833/3028461815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3028461815},{"type":"v1","addr":"172.21.15.156:6833","nonce":3028461815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24419":{"gid":24419,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.152:6833/4148407154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":4148407154},{"type":"v1","addr":"172.21.15.152:6833","nonce":4148407154}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24443":{"gid":24443,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.152:6835/1791572604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1791572604},{"type":"v1","addr":"172.21.15.152:6835","nonce":1791572604}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.156:6835/904126790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":904126790},{"type":"v1","addr":"172.21.15.156:6835","nonce":904126790}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24457":{"gid":24457,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/4284306352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":4284306352},{"type":"v1","addr":"172.21.15.156:6837","nonce":4284306352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":55,"addr":"172.21.15.152:6837/74214089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":74214089},{"type":"v1","addr":"172.21.15.152:6837","nonce":74214089}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6839/3870202690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3870202690},{"type":"v1","addr":"172.21.15.152:6839","nonce":3870202690}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T12:01:55.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.650+0000 7f00e88d3700 1 -- 172.21.15.73:0/2436824257 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f00d00a1380 msgr2=0x7f00d00a3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.650+0000 7f00e88d3700 1 --2- 172.21.15.73:0/2436824257 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f00d00a1380 0x7f00d00a3840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f00e4105bf0 tx=0x7f00d4009260 comp rx=0 tx=0).stop 2023-08-10T12:01:55.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.650+0000 7f00e88d3700 1 -- 172.21.15.73:0/2436824257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00e4100060 msgr2=0x7f00e419c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.650+0000 7f00e88d3700 1 --2- 172.21.15.73:0/2436824257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00e4100060 0x7f00e419c5e0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00e9a0 tx=0x7f00cc00ecb0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.650+0000 7f00e88d3700 1 -- 172.21.15.73:0/2436824257 shutdown_connections 2023-08-10T12:01:55.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.650+0000 7f00e88d3700 1 --2- 172.21.15.73:0/2436824257 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f00d00a1380 0x7f00d00a3840 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.650+0000 7f00e88d3700 1 --2- 172.21.15.73:0/2436824257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00e4104640 0x7f00e4196650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.650+0000 7f00e88d3700 1 --2- 172.21.15.73:0/2436824257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00e4100060 0x7f00e419c5e0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.650+0000 7f00e88d3700 1 --2- 172.21.15.73:0/2436824257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00e4100a20 0x7f00e419cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.650+0000 7f00e88d3700 1 -- 172.21.15.73:0/2436824257 >> 172.21.15.73:0/2436824257 conn(0x7f00e4075a60 msgr2=0x7f00e40fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:55.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.651+0000 7f00e88d3700 1 -- 172.21.15.73:0/2436824257 shutdown_connections 2023-08-10T12:01:55.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.651+0000 7f00e88d3700 1 -- 172.21.15.73:0/2436824257 wait complete. 2023-08-10T12:01:55.653 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 55 2023-08-10T12:01:55.664 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-08-10T12:01:55.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.801+0000 7f6baed4e700 1 -- 172.21.15.73:0/4145378592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ba8108920 msgr2=0x7f6ba8108d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.801+0000 7f6baed4e700 1 --2- 172.21.15.73:0/4145378592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ba8108920 0x7f6ba8108d00 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009990 tx=0x7f6b9c009ca0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.801+0000 7f6baed4e700 1 -- 172.21.15.73:0/4145378592 shutdown_connections 2023-08-10T12:01:55.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.801+0000 7f6baed4e700 1 --2- 172.21.15.73:0/4145378592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ba81032d0 0x7f6ba810f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.801+0000 7f6baed4e700 1 --2- 172.21.15.73:0/4145378592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ba8108920 0x7f6ba8108d00 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.801+0000 7f6baed4e700 1 --2- 172.21.15.73:0/4145378592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ba8102910 0x7f6ba8102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.801+0000 7f6baed4e700 1 -- 172.21.15.73:0/4145378592 >> 172.21.15.73:0/4145378592 conn(0x7f6ba80fe400 msgr2=0x7f6ba8100820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.801+0000 7f6baed4e700 1 -- 172.21.15.73:0/4145378592 shutdown_connections 2023-08-10T12:01:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.801+0000 7f6baed4e700 1 -- 172.21.15.73:0/4145378592 wait complete. 2023-08-10T12:01:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.801+0000 7f6baed4e700 1 Processor -- start 2023-08-10T12:01:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.801+0000 7f6baed4e700 1 -- start start 2023-08-10T12:01:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.802+0000 7f6baed4e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ba8102910 0x7f6ba819e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.802+0000 7f6baed4e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ba81032d0 0x7f6ba819ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.802+0000 7f6baed4e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ba8108920 0x7f6ba8198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.802+0000 7f6baed4e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba8198ec0 con 0x7f6ba8108920 2023-08-10T12:01:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.802+0000 7f6baed4e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba8199030 con 0x7f6ba81032d0 2023-08-10T12:01:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.802+0000 7f6baed4e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba81991f0 con 0x7f6ba8102910 2023-08-10T12:01:55.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.802+0000 7f6bad2eb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ba8108920 0x7f6ba8198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.802+0000 7f6bacaea700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ba8102910 0x7f6ba819e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.802+0000 7f6ba7fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ba81032d0 0x7f6ba819ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.802+0000 7f6bad2eb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ba8108920 0x7f6ba8198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36290/0 (socket says 172.21.15.73:36290) 2023-08-10T12:01:55.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.802+0000 7f6bacaea700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ba8102910 0x7f6ba819e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:33558/0 (socket says 172.21.15.73:33558) 2023-08-10T12:01:55.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.802+0000 7f6bad2eb700 1 -- 172.21.15.73:0/2828009729 learned_addr learned my addr 172.21.15.73:0/2828009729 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:55.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.802+0000 7f6ba7fff700 1 --2- 172.21.15.73:0/2828009729 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ba81032d0 0x7f6ba819ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:50938/0 (socket says 172.21.15.73:50938) 2023-08-10T12:01:55.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.802+0000 7f6bad2eb700 1 -- 172.21.15.73:0/2828009729 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ba8102910 msgr2=0x7f6ba819e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.802+0000 7f6bad2eb700 1 --2- 172.21.15.73:0/2828009729 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ba8102910 0x7f6ba819e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.802+0000 7f6bad2eb700 1 -- 172.21.15.73:0/2828009729 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ba81032d0 msgr2=0x7f6ba819ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.802+0000 7f6bad2eb700 1 --2- 172.21.15.73:0/2828009729 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ba81032d0 0x7f6ba819ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.802+0000 7f6bad2eb700 1 -- 172.21.15.73:0/2828009729 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9c0095f0 con 0x7f6ba8108920 2023-08-10T12:01:55.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.802+0000 7f6bad2eb700 1 --2- 172.21.15.73:0/2828009729 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ba8108920 0x7f6ba8198850 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000ef30 tx=0x7f6ba000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:55.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.802+0000 7f6ba5ffb700 1 -- 172.21.15.73:0/2828009729 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0018070 con 0x7f6ba8108920 2023-08-10T12:01:55.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.802+0000 7f6ba5ffb700 1 -- 172.21.15.73:0/2828009729 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ba000f040 con 0x7f6ba8108920 2023-08-10T12:01:55.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.802+0000 7f6baed4e700 1 -- 172.21.15.73:0/2828009729 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba8199470 con 0x7f6ba8108920 2023-08-10T12:01:55.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.802+0000 7f6ba5ffb700 1 -- 172.21.15.73:0/2828009729 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba000cd00 con 0x7f6ba8108920 2023-08-10T12:01:55.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.803+0000 7f6baed4e700 1 -- 172.21.15.73:0/2828009729 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba81a57d0 con 0x7f6ba8108920 2023-08-10T12:01:55.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.804+0000 7f6ba5ffb700 1 -- 172.21.15.73:0/2828009729 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f6ba0003a00 con 0x7f6ba8108920 2023-08-10T12:01:55.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.805+0000 7f6ba5ffb700 1 --2- 172.21.15.73:0/2828009729 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f6b980a12c0 0x7f6b980a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.805+0000 7f6bacaea700 1 --2- 172.21.15.73:0/2828009729 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f6b980a12c0 0x7f6b980a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.805+0000 7f6ba5ffb700 1 -- 172.21.15.73:0/2828009729 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6ba00cc790 con 0x7f6ba8108920 2023-08-10T12:01:55.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.805+0000 7f6bacaea700 1 --2- 172.21.15.73:0/2828009729 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f6b980a12c0 0x7f6b980a3780 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c00b2e0 tx=0x7f6b9c005fb0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:55.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.806+0000 7f6bbaee7b80 1 Processor -- start 2023-08-10T12:01:55.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.806+0000 7f6bbaee7b80 1 -- start start 2023-08-10T12:01:55.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.806+0000 7f6bbaee7b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d68f822f50 0x55d68f823330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.806+0000 7f6bbaee7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68f823870 0x55d68f81d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.806+0000 7f6bbaee7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d68f81d800 0x55d68f81dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.806+0000 7f6bbaee7b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d68f798dc0 con 0x55d68f822f50 2023-08-10T12:01:55.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.806+0000 7f6bbaee7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d68f775590 con 0x55d68f823870 2023-08-10T12:01:55.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.806+0000 7f6bbaee7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d68f772eb0 con 0x55d68f81d800 2023-08-10T12:01:55.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.806+0000 7f6bacaea700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d68f822f50 0x55d68f823330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.806+0000 7f6bacaea700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d68f822f50 0x55d68f823330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36294/0 (socket says 172.21.15.73:36294) 2023-08-10T12:01:55.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.806+0000 7f6ba7fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68f823870 0x55d68f81d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.806+0000 7f6bacaea700 1 -- 172.21.15.73:0/2306080448 learned_addr learned my addr 172.21.15.73:0/2306080448 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:55.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.806+0000 7f6bad2eb700 1 --2- 172.21.15.73:0/2306080448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d68f81d800 0x55d68f81dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.807+0000 7f6bad2eb700 1 -- 172.21.15.73:0/2306080448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68f823870 msgr2=0x55d68f81d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:55.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.807+0000 7f6bad2eb700 1 --2- 172.21.15.73:0/2306080448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68f823870 0x55d68f81d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.807+0000 7f6bad2eb700 1 -- 172.21.15.73:0/2306080448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d68f822f50 msgr2=0x55d68f823330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:55.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.807+0000 7f6bad2eb700 1 --2- 172.21.15.73:0/2306080448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d68f822f50 0x55d68f823330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.807+0000 7f6bad2eb700 1 -- 172.21.15.73:0/2306080448 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d68f5ef630 con 0x55d68f81d800 2023-08-10T12:01:55.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.807+0000 7f6bad2eb700 1 --2- 172.21.15.73:0/2306080448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d68f81d800 0x55d68f81dc80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00c9ee0 tx=0x7f6ba0095d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4f7c15db794180e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:55.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.807+0000 7f6b92ffd700 1 -- 172.21.15.73:0/2306080448 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba000ce60 con 0x55d68f81d800 2023-08-10T12:01:55.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.807+0000 7f6b92ffd700 1 -- 172.21.15.73:0/2306080448 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ba00b7e90 con 0x55d68f81d800 2023-08-10T12:01:55.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.807+0000 7f6b92ffd700 1 -- 172.21.15.73:0/2306080448 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0099b50 con 0x55d68f81d800 2023-08-10T12:01:55.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.808+0000 7f6bbaee7b80 1 -- 172.21.15.73:0/2306080448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d68f81d800 msgr2=0x55d68f81dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.808+0000 7f6bbaee7b80 1 --2- 172.21.15.73:0/2306080448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d68f81d800 0x55d68f81dc80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00c9ee0 tx=0x7f6ba0095d40 comp rx=0 tx=0).stop 2023-08-10T12:01:55.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.808+0000 7f6bbaee7b80 1 -- 172.21.15.73:0/2306080448 shutdown_connections 2023-08-10T12:01:55.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.808+0000 7f6bbaee7b80 1 --2- 172.21.15.73:0/2306080448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d68f81d800 0x55d68f81dc80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.808+0000 7f6bbaee7b80 1 --2- 172.21.15.73:0/2306080448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d68f822f50 0x55d68f823330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.808+0000 7f6bbaee7b80 1 --2- 172.21.15.73:0/2306080448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68f823870 0x55d68f81d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.808+0000 7f6bbaee7b80 1 -- 172.21.15.73:0/2306080448 >> 172.21.15.73:0/2306080448 conn(0x55d68f77acd0 msgr2=0x55d68f8184d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:55.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.808+0000 7f6bbaee7b80 1 -- 172.21.15.73:0/2306080448 shutdown_connections 2023-08-10T12:01:55.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.808+0000 7f6bbaee7b80 1 -- 172.21.15.73:0/2306080448 wait complete. 2023-08-10T12:01:55.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.808+0000 7f6bbaee7b80 1 -- start start 2023-08-10T12:01:55.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.808+0000 7f6bbaee7b80 1 Processor -- start 2023-08-10T12:01:55.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.809+0000 7f6bbaee7b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d68f81d800 0x55d68f826c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.809+0000 7f6bbaee7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d68f822f50 0x55d68f8271d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.809+0000 7f6bbaee7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68f823870 0x55d68f827710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.809+0000 7f6bbaee7b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d68f76e7a0 con 0x55d68f81d800 2023-08-10T12:01:55.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.809+0000 7f6bbaee7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d68f70dac0 con 0x55d68f823870 2023-08-10T12:01:55.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.809+0000 7f6bbaee7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d68f70d7c0 con 0x55d68f822f50 2023-08-10T12:01:55.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.809+0000 7f6bbaee7b80 10 client.0 _ll_register_callbacks cb 0x55d68f70b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:01:55.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.809+0000 7f6bacaea700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d68f81d800 0x55d68f826c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.809+0000 7f6bacaea700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d68f81d800 0x55d68f826c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36302/0 (socket says 172.21.15.73:36302) 2023-08-10T12:01:55.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.809+0000 7f6bacaea700 1 -- 172.21.15.73:0/826941496 learned_addr learned my addr 172.21.15.73:0/826941496 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:55.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.809+0000 7f6ba7fff700 1 --2- 172.21.15.73:0/826941496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d68f822f50 0x55d68f8271d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.809+0000 7f6bad2eb700 1 --2- 172.21.15.73:0/826941496 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68f823870 0x55d68f827710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.809+0000 7f6bacaea700 1 -- 172.21.15.73:0/826941496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d68f822f50 msgr2=0x55d68f8271d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:55.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.809+0000 7f6bacaea700 1 --2- 172.21.15.73:0/826941496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d68f822f50 0x55d68f8271d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.809+0000 7f6bacaea700 1 -- 172.21.15.73:0/826941496 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68f823870 msgr2=0x55d68f827710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:55.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.809+0000 7f6bacaea700 1 --2- 172.21.15.73:0/826941496 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68f823870 0x55d68f827710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.809+0000 7f6bacaea700 1 -- 172.21.15.73:0/826941496 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba81a57d0 con 0x55d68f81d800 2023-08-10T12:01:55.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.809+0000 7f6bacaea700 1 --2- 172.21.15.73:0/826941496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d68f81d800 0x55d68f826c90 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009990 tx=0x7f6b9c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf179a9bd0f3564c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:55.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.809+0000 7f6b87fff700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:01:55.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.810+0000 7f6b87fff700 1 -- 172.21.15.73:0/826941496 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c02d040 con 0x55d68f81d800 2023-08-10T12:01:55.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.810+0000 7f6b87fff700 1 -- 172.21.15.73:0/826941496 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6b9c00f460 con 0x55d68f81d800 2023-08-10T12:01:55.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.810+0000 7f6bbaee7b80 1 -- 172.21.15.73:0/826941496 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d68f810470 con 0x55d68f81d800 2023-08-10T12:01:55.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.810+0000 7f6b87fff700 1 -- 172.21.15.73:0/826941496 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b9c00f620 con 0x55d68f81d800 2023-08-10T12:01:55.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.810+0000 7f6bbaee7b80 10 client.16857 fetch_fsmap learned FSMap version 55 2023-08-10T12:01:55.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.810+0000 7f6bbaee7b80 1 -- 172.21.15.73:0/826941496 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55d68f59bde0 con 0x55d68f81d800 2023-08-10T12:01:55.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.810+0000 7f6b87fff700 1 -- 172.21.15.73:0/826941496 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b9c03e080 con 0x55d68f81d800 2023-08-10T12:01:55.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.810+0000 7f6b87fff700 1 -- 172.21.15.73:0/826941496 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7f6b9c038030 con 0x55d68f81d800 2023-08-10T12:01:55.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.810+0000 7f6bbaee7b80 10 client.16857 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:01:55.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.810+0000 7f6bbaee7b80 10 client.16857 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2023-08-10T12:01:55.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.810+0000 7f6bbaee7b80 20 client.16857 populate_metadata read hostname 'smithi073' 2023-08-10T12:01:55.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.810+0000 7f6bbaee7b80 1 --2- 172.21.15.73:0/826941496 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55d68f837450 0x55d68f839870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.810+0000 7f6bbaee7b80 4 client.16857 mds_command: new command op to 24419 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:01:55.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.810+0000 7f6bbaee7b80 1 -- 172.21.15.73:0/826941496 --> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d68f7ec9d0 con 0x55d68f837450 2023-08-10T12:01:55.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.810+0000 7f6ba7fff700 1 --2- 172.21.15.73:0/826941496 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55d68f837450 0x55d68f839870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.811+0000 7f6b87fff700 10 client.16857 ms_handle_connect on v2:172.21.15.152:6832/4148407154 2023-08-10T12:01:55.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.811+0000 7f6ba7fff700 1 --2- 172.21.15.73:0/826941496 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55d68f837450 0x55d68f839870 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2aaf3f630418aab3 server_cookie=3421a1c7478292f1 in_seq=0 out_seq=0 2023-08-10T12:01:55.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.812+0000 7f6b87fff700 1 -- 172.21.15.73:0/826941496 <== mds.4 v2:172.21.15.152:6832/4148407154 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55d68f7ec9d0 con 0x55d68f837450 2023-08-10T12:01:55.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.812+0000 7f6b87fff700 10 client.16857 handle_command_reply: tid=0 2023-08-10T12:01:55.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.812+0000 7f6bbaee7b80 1 client.16857 shutdown 2023-08-10T12:01:55.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.812+0000 7f6bbaee7b80 1 -- 172.21.15.73:0/826941496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d68f81d800 msgr2=0x55d68f826c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.812+0000 7f6bbaee7b80 1 --2- 172.21.15.73:0/826941496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d68f81d800 0x55d68f826c90 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009990 tx=0x7f6b9c020000 comp rx=0 tx=0).stop 2023-08-10T12:01:55.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.812+0000 7f6bbaee7b80 1 -- 172.21.15.73:0/826941496 shutdown_connections 2023-08-10T12:01:55.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.812+0000 7f6bbaee7b80 1 --2- 172.21.15.73:0/826941496 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55d68f837450 0x55d68f839870 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.812+0000 7f6bbaee7b80 1 --2- 172.21.15.73:0/826941496 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68f823870 0x55d68f827710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.812+0000 7f6b87fff700 0 client.16857 ms_handle_reset on v2:172.21.15.152:6832/4148407154 2023-08-10T12:01:55.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.812+0000 7f6bbaee7b80 1 --2- 172.21.15.73:0/826941496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d68f81d800 0x55d68f826c90 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.812+0000 7f6bbaee7b80 1 --2- 172.21.15.73:0/826941496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d68f822f50 0x55d68f8271d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.812+0000 7f6bbaee7b80 1 -- 172.21.15.73:0/826941496 >> 172.21.15.73:0/826941496 conn(0x55d68f77acd0 msgr2=0x55d68f8179b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:55.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.812+0000 7f6bbaee7b80 1 -- 172.21.15.73:0/826941496 shutdown_connections 2023-08-10T12:01:55.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.812+0000 7f6bbaee7b80 1 -- 172.21.15.73:0/826941496 wait complete. 2023-08-10T12:01:55.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.812+0000 7f6bbaee7b80 20 client.16857 trim_cache size 0 max 16384 2023-08-10T12:01:55.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.827+0000 7f6bbaee7b80 1 Processor -- start 2023-08-10T12:01:55.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.827+0000 7f6bbaee7b80 1 -- start start 2023-08-10T12:01:55.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.827+0000 7f6bbaee7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d68f81d800 0x55d68f81d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.827+0000 7f6bbaee7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68f822f50 0x55d68f82e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.827+0000 7f6bbaee7b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d68f823870 0x55d68f8223b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.827+0000 7f6bbaee7b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d68f5f1920 con 0x55d68f823870 2023-08-10T12:01:55.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.827+0000 7f6bbaee7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d68f834a30 con 0x55d68f822f50 2023-08-10T12:01:55.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.827+0000 7f6bbaee7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d68f814f80 con 0x55d68f81d800 2023-08-10T12:01:55.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.827+0000 7f6bad2eb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d68f823870 0x55d68f8223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.827+0000 7f6bad2eb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d68f823870 0x55d68f8223b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36312/0 (socket says 172.21.15.73:36312) 2023-08-10T12:01:55.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.827+0000 7f6bad2eb700 1 -- 172.21.15.73:0/2550014323 learned_addr learned my addr 172.21.15.73:0/2550014323 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:55.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.827+0000 7f6bacaea700 1 --2- 172.21.15.73:0/2550014323 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d68f81d800 0x55d68f81d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.827+0000 7f6ba7fff700 1 --2- 172.21.15.73:0/2550014323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68f822f50 0x55d68f82e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.828+0000 7f6bad2eb700 1 -- 172.21.15.73:0/2550014323 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d68f81d800 msgr2=0x55d68f81d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:55.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.828+0000 7f6bad2eb700 1 --2- 172.21.15.73:0/2550014323 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d68f81d800 0x55d68f81d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.828+0000 7f6bad2eb700 1 -- 172.21.15.73:0/2550014323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68f822f50 msgr2=0x55d68f82e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:55.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.828+0000 7f6bad2eb700 1 --2- 172.21.15.73:0/2550014323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68f822f50 0x55d68f82e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.828+0000 7f6bad2eb700 1 -- 172.21.15.73:0/2550014323 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d68f8146a0 con 0x55d68f823870 2023-08-10T12:01:55.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.828+0000 7f6ba7fff700 1 --2- 172.21.15.73:0/2550014323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68f822f50 0x55d68f82e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T12:01:55.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.828+0000 7f6bad2eb700 1 --2- 172.21.15.73:0/2550014323 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d68f823870 0x55d68f8223b0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000c6f0 tx=0x7f6ba00b9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6472da75cf35534 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:55.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.828+0000 7f6b937fe700 1 -- 172.21.15.73:0/2550014323 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba000ce60 con 0x55d68f823870 2023-08-10T12:01:55.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.828+0000 7f6b937fe700 1 -- 172.21.15.73:0/2550014323 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ba00998f0 con 0x55d68f823870 2023-08-10T12:01:55.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.828+0000 7f6b937fe700 1 -- 172.21.15.73:0/2550014323 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0099040 con 0x55d68f823870 2023-08-10T12:01:55.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.828+0000 7f6bbaee7b80 1 -- 172.21.15.73:0/2550014323 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d68f823870 msgr2=0x55d68f8223b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.828+0000 7f6bbaee7b80 1 --2- 172.21.15.73:0/2550014323 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d68f823870 0x55d68f8223b0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000c6f0 tx=0x7f6ba00b9040 comp rx=0 tx=0).stop 2023-08-10T12:01:55.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.828+0000 7f6bbaee7b80 1 -- 172.21.15.73:0/2550014323 shutdown_connections 2023-08-10T12:01:55.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.828+0000 7f6bbaee7b80 1 --2- 172.21.15.73:0/2550014323 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d68f823870 0x55d68f8223b0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.828+0000 7f6bbaee7b80 1 --2- 172.21.15.73:0/2550014323 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d68f81d800 0x55d68f81d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.828+0000 7f6bbaee7b80 1 --2- 172.21.15.73:0/2550014323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68f822f50 0x55d68f82e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.829+0000 7f6bbaee7b80 1 -- 172.21.15.73:0/2550014323 >> 172.21.15.73:0/2550014323 conn(0x55d68f77acd0 msgr2=0x55d68f821ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:55.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.829+0000 7f6bbaee7b80 1 -- 172.21.15.73:0/2550014323 shutdown_connections 2023-08-10T12:01:55.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.829+0000 7f6bbaee7b80 1 -- 172.21.15.73:0/2550014323 wait complete. 2023-08-10T12:01:55.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.829+0000 7f6bbaee7b80 1 -- start start 2023-08-10T12:01:55.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.829+0000 7f6bbaee7b80 1 Processor -- start 2023-08-10T12:01:55.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.829+0000 7f6bbaee7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68f81d800 0x55d68f87f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.829+0000 7f6bbaee7b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d68f822f50 0x55d68f87f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.830+0000 7f6bbaee7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d68f823870 0x55d68f8840a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.830+0000 7f6bbaee7b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d68f8845e0 con 0x55d68f822f50 2023-08-10T12:01:55.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.830+0000 7f6bbaee7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d68f884750 con 0x55d68f81d800 2023-08-10T12:01:55.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.830+0000 7f6bbaee7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d68f884910 con 0x55d68f823870 2023-08-10T12:01:55.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.830+0000 7f6bbaee7b80 10 client.0 _ll_register_callbacks cb 0x55d68f70b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:01:55.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.830+0000 7f6ba7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d68f822f50 0x55d68f87f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.830+0000 7f6ba7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d68f822f50 0x55d68f87f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36316/0 (socket says 172.21.15.73:36316) 2023-08-10T12:01:55.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.830+0000 7f6ba7fff700 1 -- 172.21.15.73:0/1762452696 learned_addr learned my addr 172.21.15.73:0/1762452696 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:55.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.830+0000 7f6bacaea700 1 --2- 172.21.15.73:0/1762452696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68f81d800 0x55d68f87f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.830+0000 7f6bad2eb700 1 --2- 172.21.15.73:0/1762452696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d68f823870 0x55d68f8840a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.830+0000 7f6ba7fff700 1 -- 172.21.15.73:0/1762452696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d68f823870 msgr2=0x55d68f8840a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:55.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.830+0000 7f6ba7fff700 1 --2- 172.21.15.73:0/1762452696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d68f823870 0x55d68f8840a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.830+0000 7f6ba7fff700 1 -- 172.21.15.73:0/1762452696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68f81d800 msgr2=0x55d68f87f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:55.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.830+0000 7f6ba7fff700 1 --2- 172.21.15.73:0/1762452696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68f81d800 0x55d68f87f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.830+0000 7f6ba7fff700 1 -- 172.21.15.73:0/1762452696 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d68f5ef630 con 0x55d68f822f50 2023-08-10T12:01:55.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.830+0000 7f6ba7fff700 1 --2- 172.21.15.73:0/1762452696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d68f822f50 0x55d68f87f780 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f6b94005d90 tx=0x7f6b94004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8988a8c0b171c8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:55.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.830+0000 7f6b87fff700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:01:55.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.830+0000 7f6b87fff700 1 -- 172.21.15.73:0/1762452696 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b94017070 con 0x55d68f822f50 2023-08-10T12:01:55.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.830+0000 7f6b87fff700 1 -- 172.21.15.73:0/1762452696 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6b9401ecd0 con 0x55d68f822f50 2023-08-10T12:01:55.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.830+0000 7f6bbaee7b80 1 -- 172.21.15.73:0/1762452696 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6ba00b7e90 con 0x55d68f822f50 2023-08-10T12:01:55.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.830+0000 7f6b87fff700 1 -- 172.21.15.73:0/1762452696 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b9401ee90 con 0x55d68f822f50 2023-08-10T12:01:55.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.830+0000 7f6bbaee7b80 10 client.16863 fetch_fsmap learned FSMap version 55 2023-08-10T12:01:55.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.830+0000 7f6bbaee7b80 1 -- 172.21.15.73:0/1762452696 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55d68f584c60 con 0x55d68f822f50 2023-08-10T12:01:55.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.831+0000 7f6b87fff700 1 -- 172.21.15.73:0/1762452696 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ba00b7e90 con 0x55d68f822f50 2023-08-10T12:01:55.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.831+0000 7f6b87fff700 1 -- 172.21.15.73:0/1762452696 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7f6b9402ac40 con 0x55d68f822f50 2023-08-10T12:01:55.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.831+0000 7f6bbaee7b80 10 client.16863 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:01:55.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.831+0000 7f6bbaee7b80 10 client.16863 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2023-08-10T12:01:55.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.831+0000 7f6bbaee7b80 20 client.16863 populate_metadata read hostname 'smithi073' 2023-08-10T12:01:55.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.831+0000 7f6bbaee7b80 1 --2- 172.21.15.73:0/1762452696 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55d68f88c230 0x55d68f88e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.831+0000 7f6bbaee7b80 4 client.16863 mds_command: new command op to 24419 tid=0[{"prefix": "damage ls"}] 2023-08-10T12:01:55.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.831+0000 7f6bbaee7b80 1 -- 172.21.15.73:0/1762452696 --> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d68f767780 con 0x55d68f88c230 2023-08-10T12:01:55.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.831+0000 7f6bacaea700 1 --2- 172.21.15.73:0/1762452696 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55d68f88c230 0x55d68f88e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.831+0000 7f6bacaea700 1 --2- 172.21.15.73:0/1762452696 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55d68f88c230 0x55d68f88e650 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=203fc121f2429c8f server_cookie=18e118dfe0cc2bec in_seq=0 out_seq=0 2023-08-10T12:01:55.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.831+0000 7f6b87fff700 10 client.16863 ms_handle_connect on v2:172.21.15.152:6832/4148407154 2023-08-10T12:01:55.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.832+0000 7f6b87fff700 1 -- 172.21.15.73:0/1762452696 <== mds.4 v2:172.21.15.152:6832/4148407154 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d68f767780 con 0x55d68f88c230 2023-08-10T12:01:55.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.832+0000 7f6b87fff700 10 client.16863 handle_command_reply: tid=0 2023-08-10T12:01:55.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.832+0000 7f6bbaee7b80 1 client.16863 shutdown 2023-08-10T12:01:55.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.832+0000 7f6bbaee7b80 1 -- 172.21.15.73:0/1762452696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d68f822f50 msgr2=0x55d68f87f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.832+0000 7f6bbaee7b80 1 --2- 172.21.15.73:0/1762452696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d68f822f50 0x55d68f87f780 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f6b94005d90 tx=0x7f6b94004320 comp rx=0 tx=0).stop 2023-08-10T12:01:55.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.832+0000 7f6bbaee7b80 1 -- 172.21.15.73:0/1762452696 shutdown_connections 2023-08-10T12:01:55.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.832+0000 7f6bbaee7b80 1 --2- 172.21.15.73:0/1762452696 >> [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] conn(0x55d68f88c230 0x55d68f88e650 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.832+0000 7f6bbaee7b80 1 --2- 172.21.15.73:0/1762452696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d68f81d800 0x55d68f87f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.832+0000 7f6b87fff700 0 client.16863 ms_handle_reset on v2:172.21.15.152:6832/4148407154 2023-08-10T12:01:55.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.832+0000 7f6bbaee7b80 1 --2- 172.21.15.73:0/1762452696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d68f823870 0x55d68f8840a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.832+0000 7f6bbaee7b80 1 --2- 172.21.15.73:0/1762452696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d68f822f50 0x55d68f87f780 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.832+0000 7f6bbaee7b80 1 -- 172.21.15.73:0/1762452696 >> 172.21.15.73:0/1762452696 conn(0x55d68f77acd0 msgr2=0x55d68f822530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:55.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.832+0000 7f6bbaee7b80 1 -- 172.21.15.73:0/1762452696 shutdown_connections 2023-08-10T12:01:55.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.832+0000 7f6bbaee7b80 1 -- 172.21.15.73:0/1762452696 wait complete. 2023-08-10T12:01:55.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.832+0000 7f6bbaee7b80 20 client.16863 trim_cache size 0 max 16384 2023-08-10T12:01:55.843 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2023-08-10T12:01:55.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.833+0000 7f6baed4e700 1 -- 172.21.15.73:0/2828009729 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f6b980a12c0 msgr2=0x7f6b980a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.833+0000 7f6baed4e700 1 --2- 172.21.15.73:0/2828009729 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f6b980a12c0 0x7f6b980a3780 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c00b2e0 tx=0x7f6b9c005fb0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.833+0000 7f6baed4e700 1 -- 172.21.15.73:0/2828009729 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ba8108920 msgr2=0x7f6ba8198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.833+0000 7f6baed4e700 1 --2- 172.21.15.73:0/2828009729 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ba8108920 0x7f6ba8198850 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000ef30 tx=0x7f6ba000c3a0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.833+0000 7f6baed4e700 1 -- 172.21.15.73:0/2828009729 shutdown_connections 2023-08-10T12:01:55.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.833+0000 7f6baed4e700 1 --2- 172.21.15.73:0/2828009729 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f6b980a12c0 0x7f6b980a3780 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.833+0000 7f6baed4e700 1 --2- 172.21.15.73:0/2828009729 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ba8108920 0x7f6ba8198850 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.833+0000 7f6baed4e700 1 --2- 172.21.15.73:0/2828009729 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ba8102910 0x7f6ba819e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.833+0000 7f6baed4e700 1 --2- 172.21.15.73:0/2828009729 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ba81032d0 0x7f6ba819ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.833+0000 7f6baed4e700 1 -- 172.21.15.73:0/2828009729 >> 172.21.15.73:0/2828009729 conn(0x7f6ba80fe400 msgr2=0x7f6ba8106420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:55.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.833+0000 7f6baed4e700 1 -- 172.21.15.73:0/2828009729 shutdown_connections 2023-08-10T12:01:55.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.833+0000 7f6baed4e700 1 -- 172.21.15.73:0/2828009729 wait complete. 2023-08-10T12:01:55.846 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-08-10T12:01:55.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.969+0000 7fa3c4d59700 1 -- 172.21.15.73:0/1551430192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c00ff5d0 msgr2=0x7fa3c00ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.969+0000 7fa3c4d59700 1 --2- 172.21.15.73:0/1551430192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c00ff5d0 0x7fa3c00ffa50 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40099c0 tx=0x7fa3b4009cd0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.969+0000 7fa3c4d59700 1 -- 172.21.15.73:0/1551430192 shutdown_connections 2023-08-10T12:01:55.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.969+0000 7fa3c4d59700 1 --2- 172.21.15.73:0/1551430192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3c0105690 0x7fa3c0105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.969+0000 7fa3c4d59700 1 --2- 172.21.15.73:0/1551430192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3c00fff90 0x7fa3c010c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.969+0000 7fa3c4d59700 1 --2- 172.21.15.73:0/1551430192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c00ff5d0 0x7fa3c00ffa50 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.969+0000 7fa3c4d59700 1 -- 172.21.15.73:0/1551430192 >> 172.21.15.73:0/1551430192 conn(0x7fa3c00fb0c0 msgr2=0x7fa3c00fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:55.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.969+0000 7fa3c4d59700 1 -- 172.21.15.73:0/1551430192 shutdown_connections 2023-08-10T12:01:55.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.969+0000 7fa3c4d59700 1 -- 172.21.15.73:0/1551430192 wait complete. 2023-08-10T12:01:55.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.969+0000 7fa3c4d59700 1 Processor -- start 2023-08-10T12:01:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.969+0000 7fa3c4d59700 1 -- start start 2023-08-10T12:01:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.970+0000 7fa3c4d59700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3c00ff5d0 0x7fa3c019c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.970+0000 7fa3c4d59700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3c00fff90 0x7fa3c019ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.970+0000 7fa3c4d59700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c0105690 0x7fa3c01965b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.970+0000 7fa3c4d59700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c0196c20 con 0x7fa3c0105690 2023-08-10T12:01:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.970+0000 7fa3c4d59700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c0196d90 con 0x7fa3c00ff5d0 2023-08-10T12:01:55.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.970+0000 7fa3c4d59700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c0196f50 con 0x7fa3c00fff90 2023-08-10T12:01:55.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.970+0000 7fa3bed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c0105690 0x7fa3c01965b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.970+0000 7fa3bed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c0105690 0x7fa3c01965b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36332/0 (socket says 172.21.15.73:36332) 2023-08-10T12:01:55.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.970+0000 7fa3bed9d700 1 -- 172.21.15.73:0/1621741922 learned_addr learned my addr 172.21.15.73:0/1621741922 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:55.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.970+0000 7fa3be59c700 1 --2- 172.21.15.73:0/1621741922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3c00ff5d0 0x7fa3c019c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.970+0000 7fa3bdd9b700 1 --2- 172.21.15.73:0/1621741922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3c00fff90 0x7fa3c019ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.970+0000 7fa3bed9d700 1 -- 172.21.15.73:0/1621741922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3c00fff90 msgr2=0x7fa3c019ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.970+0000 7fa3bed9d700 1 --2- 172.21.15.73:0/1621741922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3c00fff90 0x7fa3c019ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.970+0000 7fa3bed9d700 1 -- 172.21.15.73:0/1621741922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3c00ff5d0 msgr2=0x7fa3c019c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.970+0000 7fa3bed9d700 1 --2- 172.21.15.73:0/1621741922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3c00ff5d0 0x7fa3c019c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.970+0000 7fa3bed9d700 1 -- 172.21.15.73:0/1621741922 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b40095f0 con 0x7fa3c0105690 2023-08-10T12:01:55.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.970+0000 7fa3bed9d700 1 --2- 172.21.15.73:0/1621741922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c0105690 0x7fa3c01965b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800ef30 tx=0x7fa3b800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:55.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.970+0000 7fa3af7fe700 1 -- 172.21.15.73:0/1621741922 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8018070 con 0x7fa3c0105690 2023-08-10T12:01:55.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.970+0000 7fa3c4d59700 1 -- 172.21.15.73:0/1621741922 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c01971d0 con 0x7fa3c0105690 2023-08-10T12:01:55.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.970+0000 7fa3af7fe700 1 -- 172.21.15.73:0/1621741922 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3b800f040 con 0x7fa3c0105690 2023-08-10T12:01:55.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.970+0000 7fa3af7fe700 1 -- 172.21.15.73:0/1621741922 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b800cd00 con 0x7fa3c0105690 2023-08-10T12:01:55.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.970+0000 7fa3c4d59700 1 -- 172.21.15.73:0/1621741922 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c01a3530 con 0x7fa3c0105690 2023-08-10T12:01:55.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.973+0000 7fa3af7fe700 1 -- 172.21.15.73:0/1621741922 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fa3b8003a00 con 0x7fa3c0105690 2023-08-10T12:01:55.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.974+0000 7fa3af7fe700 1 --2- 172.21.15.73:0/1621741922 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa3a80a12c0 0x7fa3a80a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.974+0000 7fa3be59c700 1 --2- 172.21.15.73:0/1621741922 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa3a80a12c0 0x7fa3a80a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.974+0000 7fa3af7fe700 1 -- 172.21.15.73:0/1621741922 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa3b80cc870 con 0x7fa3c0105690 2023-08-10T12:01:55.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.974+0000 7fa3d0ef2b80 1 Processor -- start 2023-08-10T12:01:55.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.974+0000 7fa3be59c700 1 --2- 172.21.15.73:0/1621741922 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa3a80a12c0 0x7fa3a80a3780 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0007be0 tx=0x7fa3b00073d0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:55.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.974+0000 7fa3d0ef2b80 1 -- start start 2023-08-10T12:01:55.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.974+0000 7fa3d0ef2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597a342ef50 0x5597a342f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.975+0000 7fa3d0ef2b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a342f870 0x5597a34292c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.975+0000 7fa3d0ef2b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a3429800 0x5597a3429c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.975+0000 7fa3d0ef2b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597a33a4dc0 con 0x5597a342f870 2023-08-10T12:01:55.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.975+0000 7fa3d0ef2b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597a3381590 con 0x5597a3429800 2023-08-10T12:01:55.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.975+0000 7fa3d0ef2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597a337eeb0 con 0x5597a342ef50 2023-08-10T12:01:55.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.975+0000 7fa3bdd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a342f870 0x5597a34292c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.975+0000 7fa3bdd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a342f870 0x5597a34292c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36338/0 (socket says 172.21.15.73:36338) 2023-08-10T12:01:55.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.975+0000 7fa3be59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597a342ef50 0x5597a342f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.975+0000 7fa3bdd9b700 1 -- 172.21.15.73:0/458827677 learned_addr learned my addr 172.21.15.73:0/458827677 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:55.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.975+0000 7fa3bed9d700 1 --2- 172.21.15.73:0/458827677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a3429800 0x5597a3429c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.975+0000 7fa3bdd9b700 1 -- 172.21.15.73:0/458827677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597a342ef50 msgr2=0x5597a342f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:55.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.975+0000 7fa3bdd9b700 1 --2- 172.21.15.73:0/458827677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597a342ef50 0x5597a342f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.975+0000 7fa3bdd9b700 1 -- 172.21.15.73:0/458827677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a3429800 msgr2=0x5597a3429c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:55.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.975+0000 7fa3bdd9b700 1 --2- 172.21.15.73:0/458827677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a3429800 0x5597a3429c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.975+0000 7fa3bdd9b700 1 -- 172.21.15.73:0/458827677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597a31fb630 con 0x5597a342f870 2023-08-10T12:01:55.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.975+0000 7fa3be59c700 1 --2- 172.21.15.73:0/458827677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597a342ef50 0x5597a342f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:01:55.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.975+0000 7fa3bdd9b700 1 --2- 172.21.15.73:0/458827677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a342f870 0x5597a34292c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40058e0 tx=0x7fa3b4005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8201544642847f21 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:55.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.975+0000 7fa3acff9700 1 -- 172.21.15.73:0/458827677 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b400b990 con 0x5597a342f870 2023-08-10T12:01:55.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.975+0000 7fa3acff9700 1 -- 172.21.15.73:0/458827677 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3b401e040 con 0x5597a342f870 2023-08-10T12:01:55.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.975+0000 7fa3acff9700 1 -- 172.21.15.73:0/458827677 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b400fda0 con 0x5597a342f870 2023-08-10T12:01:55.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.976+0000 7fa3d0ef2b80 1 -- 172.21.15.73:0/458827677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a342f870 msgr2=0x5597a34292c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.976+0000 7fa3d0ef2b80 1 --2- 172.21.15.73:0/458827677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a342f870 0x5597a34292c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40058e0 tx=0x7fa3b4005f00 comp rx=0 tx=0).stop 2023-08-10T12:01:55.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.976+0000 7fa3d0ef2b80 1 -- 172.21.15.73:0/458827677 shutdown_connections 2023-08-10T12:01:55.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.976+0000 7fa3d0ef2b80 1 --2- 172.21.15.73:0/458827677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a3429800 0x5597a3429c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.976+0000 7fa3d0ef2b80 1 --2- 172.21.15.73:0/458827677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597a342ef50 0x5597a342f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.976+0000 7fa3d0ef2b80 1 --2- 172.21.15.73:0/458827677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a342f870 0x5597a34292c0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.976+0000 7fa3d0ef2b80 1 -- 172.21.15.73:0/458827677 >> 172.21.15.73:0/458827677 conn(0x5597a3386cd0 msgr2=0x5597a34244d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:55.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.976+0000 7fa3d0ef2b80 1 -- 172.21.15.73:0/458827677 shutdown_connections 2023-08-10T12:01:55.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.976+0000 7fa3d0ef2b80 1 -- 172.21.15.73:0/458827677 wait complete. 2023-08-10T12:01:55.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.976+0000 7fa3d0ef2b80 1 -- start start 2023-08-10T12:01:55.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.977+0000 7fa3d0ef2b80 1 Processor -- start 2023-08-10T12:01:55.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.977+0000 7fa3d0ef2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597a3429800 0x5597a3432bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.977+0000 7fa3d0ef2b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a342ef50 0x5597a3433110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.977+0000 7fa3d0ef2b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a342f870 0x5597a3433650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.977+0000 7fa3d0ef2b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597a337a7a0 con 0x5597a342ef50 2023-08-10T12:01:55.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.977+0000 7fa3d0ef2b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597a3319ac0 con 0x5597a342f870 2023-08-10T12:01:55.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.977+0000 7fa3d0ef2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597a33197c0 con 0x5597a3429800 2023-08-10T12:01:55.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.977+0000 7fa3d0ef2b80 10 client.0 _ll_register_callbacks cb 0x5597a3317680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:01:55.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.977+0000 7fa3bdd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a342ef50 0x5597a3433110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.977+0000 7fa3bdd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a342ef50 0x5597a3433110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36344/0 (socket says 172.21.15.73:36344) 2023-08-10T12:01:55.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.977+0000 7fa3bdd9b700 1 -- 172.21.15.73:0/2481482685 learned_addr learned my addr 172.21.15.73:0/2481482685 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:55.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.977+0000 7fa3be59c700 1 --2- 172.21.15.73:0/2481482685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597a3429800 0x5597a3432bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.977+0000 7fa3bed9d700 1 --2- 172.21.15.73:0/2481482685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a342f870 0x5597a3433650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.977+0000 7fa3bdd9b700 1 -- 172.21.15.73:0/2481482685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597a3429800 msgr2=0x5597a3432bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:55.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.977+0000 7fa3bdd9b700 1 --2- 172.21.15.73:0/2481482685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597a3429800 0x5597a3432bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.977+0000 7fa3bdd9b700 1 -- 172.21.15.73:0/2481482685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a342f870 msgr2=0x5597a3433650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:55.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.977+0000 7fa3bdd9b700 1 --2- 172.21.15.73:0/2481482685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a342f870 0x5597a3433650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.977+0000 7fa3bdd9b700 1 -- 172.21.15.73:0/2481482685 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b0010ab0 con 0x5597a342ef50 2023-08-10T12:01:55.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.977+0000 7fa3be59c700 1 --2- 172.21.15.73:0/2481482685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597a3429800 0x5597a3432bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:01:55.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.977+0000 7fa3bed9d700 1 --2- 172.21.15.73:0/2481482685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a342f870 0x5597a3433650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:01:55.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.977+0000 7fa3bdd9b700 1 --2- 172.21.15.73:0/2481482685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a342ef50 0x5597a3433110 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400fef0 tx=0x7fa3b4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9300b11cd8d76bb7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:55.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.977+0000 7fa3a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:01:55.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.978+0000 7fa3a5ffb700 1 -- 172.21.15.73:0/2481482685 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b400bba0 con 0x5597a342ef50 2023-08-10T12:01:55.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.978+0000 7fa3a5ffb700 1 -- 172.21.15.73:0/2481482685 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa3b400bd00 con 0x5597a342ef50 2023-08-10T12:01:55.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.978+0000 7fa3d0ef2b80 1 -- 172.21.15.73:0/2481482685 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5597a341c470 con 0x5597a342ef50 2023-08-10T12:01:55.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.978+0000 7fa3a5ffb700 1 -- 172.21.15.73:0/2481482685 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3b400bec0 con 0x5597a342ef50 2023-08-10T12:01:55.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.978+0000 7fa3d0ef2b80 10 client.16875 fetch_fsmap learned FSMap version 55 2023-08-10T12:01:55.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.978+0000 7fa3d0ef2b80 1 -- 172.21.15.73:0/2481482685 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x7fa3c010cd50 con 0x5597a342ef50 2023-08-10T12:01:55.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.978+0000 7fa3a5ffb700 1 -- 172.21.15.73:0/2481482685 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5597a341c470 con 0x5597a342ef50 2023-08-10T12:01:55.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.978+0000 7fa3a5ffb700 1 -- 172.21.15.73:0/2481482685 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7fa3b4021070 con 0x5597a342ef50 2023-08-10T12:01:55.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.978+0000 7fa3d0ef2b80 10 client.16875 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:01:55.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.978+0000 7fa3d0ef2b80 10 client.16875 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-08-10T12:01:55.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.978+0000 7fa3d0ef2b80 20 client.16875 populate_metadata read hostname 'smithi073' 2023-08-10T12:01:55.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.978+0000 7fa3d0ef2b80 1 --2- 172.21.15.73:0/2481482685 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x5597a3442d80 0x5597a34451a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.978+0000 7fa3d0ef2b80 4 client.16875 mds_command: new command op to 24443 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:01:55.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.978+0000 7fa3d0ef2b80 1 -- 172.21.15.73:0/2481482685 --> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5597a33f89d0 con 0x5597a3442d80 2023-08-10T12:01:55.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.978+0000 7fa3be59c700 1 --2- 172.21.15.73:0/2481482685 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x5597a3442d80 0x5597a34451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:55.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.979+0000 7fa3a5ffb700 10 client.16875 ms_handle_connect on v2:172.21.15.152:6834/1791572604 2023-08-10T12:01:55.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.979+0000 7fa3be59c700 1 --2- 172.21.15.73:0/2481482685 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x5597a3442d80 0x5597a34451a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2d9d30819f42fc05 server_cookie=8d68db6f889bd953 in_seq=0 out_seq=0 2023-08-10T12:01:55.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.980+0000 7fa3a5ffb700 1 -- 172.21.15.73:0/2481482685 <== mds.3 v2:172.21.15.152:6834/1791572604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5597a33f89d0 con 0x5597a3442d80 2023-08-10T12:01:55.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.980+0000 7fa3a5ffb700 10 client.16875 handle_command_reply: tid=0 2023-08-10T12:01:55.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.980+0000 7fa3d0ef2b80 1 client.16875 shutdown 2023-08-10T12:01:55.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.980+0000 7fa3d0ef2b80 1 -- 172.21.15.73:0/2481482685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a342ef50 msgr2=0x5597a3433110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:55.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.980+0000 7fa3d0ef2b80 1 --2- 172.21.15.73:0/2481482685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a342ef50 0x5597a3433110 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400fef0 tx=0x7fa3b4000bc0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.980+0000 7fa3d0ef2b80 1 -- 172.21.15.73:0/2481482685 shutdown_connections 2023-08-10T12:01:55.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.980+0000 7fa3d0ef2b80 1 --2- 172.21.15.73:0/2481482685 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x5597a3442d80 0x5597a34451a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.980+0000 7fa3d0ef2b80 1 --2- 172.21.15.73:0/2481482685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a342f870 0x5597a3433650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.980+0000 7fa3d0ef2b80 1 --2- 172.21.15.73:0/2481482685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597a3429800 0x5597a3432bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.980+0000 7fa3a5ffb700 0 client.16875 ms_handle_reset on v2:172.21.15.152:6834/1791572604 2023-08-10T12:01:55.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.980+0000 7fa3d0ef2b80 1 --2- 172.21.15.73:0/2481482685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a342ef50 0x5597a3433110 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:55.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.980+0000 7fa3d0ef2b80 1 -- 172.21.15.73:0/2481482685 >> 172.21.15.73:0/2481482685 conn(0x5597a3386cd0 msgr2=0x5597a34239b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:55.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.980+0000 7fa3d0ef2b80 1 -- 172.21.15.73:0/2481482685 shutdown_connections 2023-08-10T12:01:55.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.980+0000 7fa3d0ef2b80 1 -- 172.21.15.73:0/2481482685 wait complete. 2023-08-10T12:01:55.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.980+0000 7fa3d0ef2b80 20 client.16875 trim_cache size 0 max 16384 2023-08-10T12:01:55.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.992+0000 7fa3d0ef2b80 1 Processor -- start 2023-08-10T12:01:55.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.993+0000 7fa3d0ef2b80 1 -- start start 2023-08-10T12:01:55.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.993+0000 7fa3d0ef2b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a3429800 0x5597a3431eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.993+0000 7fa3d0ef2b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a342ef50 0x5597a342e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.993+0000 7fa3d0ef2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597a342f870 0x5597a343a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:55.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.993+0000 7fa3d0ef2b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597a31fd920 con 0x5597a3429800 2023-08-10T12:01:55.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.993+0000 7fa3d0ef2b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597a3425c70 con 0x5597a342ef50 2023-08-10T12:01:55.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.993+0000 7fa3d0ef2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597a343f250 con 0x5597a342f870 2023-08-10T12:01:56.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.993+0000 7fa3be59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a3429800 0x5597a3431eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.993+0000 7fa3be59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a3429800 0x5597a3431eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36350/0 (socket says 172.21.15.73:36350) 2023-08-10T12:01:56.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.993+0000 7fa3be59c700 1 -- 172.21.15.73:0/1355354225 learned_addr learned my addr 172.21.15.73:0/1355354225 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:56.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.993+0000 7fa3bdd9b700 1 --2- 172.21.15.73:0/1355354225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a342ef50 0x5597a342e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.993+0000 7fa3bed9d700 1 --2- 172.21.15.73:0/1355354225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597a342f870 0x5597a343a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.993+0000 7fa3be59c700 1 -- 172.21.15.73:0/1355354225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597a342f870 msgr2=0x5597a343a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:56.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.993+0000 7fa3be59c700 1 --2- 172.21.15.73:0/1355354225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597a342f870 0x5597a343a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.993+0000 7fa3be59c700 1 -- 172.21.15.73:0/1355354225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a342ef50 msgr2=0x5597a342e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:56.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.993+0000 7fa3be59c700 1 --2- 172.21.15.73:0/1355354225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a342ef50 0x5597a342e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.993+0000 7fa3be59c700 1 -- 172.21.15.73:0/1355354225 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597a34329e0 con 0x5597a3429800 2023-08-10T12:01:56.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.993+0000 7fa3bdd9b700 1 --2- 172.21.15.73:0/1355354225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a342ef50 0x5597a342e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T12:01:56.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.993+0000 7fa3bed9d700 1 --2- 172.21.15.73:0/1355354225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597a342f870 0x5597a343a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T12:01:56.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.993+0000 7fa3be59c700 1 --2- 172.21.15.73:0/1355354225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a3429800 0x5597a3431eb0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x5597a342a520 tx=0x7fa3b0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7128dae29dd2e94a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:56.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.993+0000 7fa3ad7fa700 1 -- 172.21.15.73:0/1355354225 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b0027070 con 0x5597a3429800 2023-08-10T12:01:56.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.993+0000 7fa3ad7fa700 1 -- 172.21.15.73:0/1355354225 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3b00044c0 con 0x5597a3429800 2023-08-10T12:01:56.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.993+0000 7fa3ad7fa700 1 -- 172.21.15.73:0/1355354225 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b0028bc0 con 0x5597a3429800 2023-08-10T12:01:56.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.994+0000 7fa3d0ef2b80 1 -- 172.21.15.73:0/1355354225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a3429800 msgr2=0x5597a3431eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.994+0000 7fa3d0ef2b80 1 --2- 172.21.15.73:0/1355354225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a3429800 0x5597a3431eb0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x5597a342a520 tx=0x7fa3b0013000 comp rx=0 tx=0).stop 2023-08-10T12:01:56.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.994+0000 7fa3d0ef2b80 1 -- 172.21.15.73:0/1355354225 shutdown_connections 2023-08-10T12:01:56.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.994+0000 7fa3d0ef2b80 1 --2- 172.21.15.73:0/1355354225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597a342f870 0x5597a343a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.994+0000 7fa3d0ef2b80 1 --2- 172.21.15.73:0/1355354225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a3429800 0x5597a3431eb0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.994+0000 7fa3d0ef2b80 1 --2- 172.21.15.73:0/1355354225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a342ef50 0x5597a342e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.994+0000 7fa3d0ef2b80 1 -- 172.21.15.73:0/1355354225 >> 172.21.15.73:0/1355354225 conn(0x5597a3386cd0 msgr2=0x5597a3432b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:56.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.994+0000 7fa3d0ef2b80 1 -- 172.21.15.73:0/1355354225 shutdown_connections 2023-08-10T12:01:56.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.994+0000 7fa3d0ef2b80 1 -- 172.21.15.73:0/1355354225 wait complete. 2023-08-10T12:01:56.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.994+0000 7fa3d0ef2b80 1 -- start start 2023-08-10T12:01:56.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.994+0000 7fa3d0ef2b80 1 Processor -- start 2023-08-10T12:01:56.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.995+0000 7fa3d0ef2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597a3429800 0x5597a342c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.995+0000 7fa3d0ef2b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a342ef50 0x5597a342a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.995+0000 7fa3d0ef2b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a342f870 0x5597a342aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.995+0000 7fa3d0ef2b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597a342b3f0 con 0x5597a342ef50 2023-08-10T12:01:56.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.995+0000 7fa3d0ef2b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597a342b530 con 0x5597a342f870 2023-08-10T12:01:56.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.995+0000 7fa3d0ef2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597a342b6f0 con 0x5597a3429800 2023-08-10T12:01:56.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.995+0000 7fa3d0ef2b80 10 client.0 _ll_register_callbacks cb 0x5597a3317680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:01:56.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.995+0000 7fa3bdd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a342ef50 0x5597a342a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.995+0000 7fa3be59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597a3429800 0x5597a342c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.995+0000 7fa3bdd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a342ef50 0x5597a342a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36358/0 (socket says 172.21.15.73:36358) 2023-08-10T12:01:56.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.995+0000 7fa3bed9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a342f870 0x5597a342aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.995+0000 7fa3bdd9b700 1 -- 172.21.15.73:0/3230514278 learned_addr learned my addr 172.21.15.73:0/3230514278 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:56.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.995+0000 7fa3bdd9b700 1 -- 172.21.15.73:0/3230514278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597a3429800 msgr2=0x5597a342c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:56.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.995+0000 7fa3bdd9b700 1 --2- 172.21.15.73:0/3230514278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597a3429800 0x5597a342c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.995+0000 7fa3bdd9b700 1 -- 172.21.15.73:0/3230514278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a342f870 msgr2=0x5597a342aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:56.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.995+0000 7fa3bdd9b700 1 --2- 172.21.15.73:0/3230514278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a342f870 0x5597a342aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.995+0000 7fa3bdd9b700 1 -- 172.21.15.73:0/3230514278 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5597a31a7de0 con 0x5597a342ef50 2023-08-10T12:01:56.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.995+0000 7fa3be59c700 1 --2- 172.21.15.73:0/3230514278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597a3429800 0x5597a342c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:01:56.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.995+0000 7fa3bdd9b700 1 --2- 172.21.15.73:0/3230514278 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a342ef50 0x5597a342a970 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40036c0 tx=0x7fa3b4017d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c7e4710db19565 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:56.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.995+0000 7fa3a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:01:56.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.995+0000 7fa3a5ffb700 1 -- 172.21.15.73:0/3230514278 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b400bdb0 con 0x5597a342ef50 2023-08-10T12:01:56.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.995+0000 7fa3a5ffb700 1 -- 172.21.15.73:0/3230514278 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa3b4000e40 con 0x5597a342ef50 2023-08-10T12:01:56.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.995+0000 7fa3d0ef2b80 1 -- 172.21.15.73:0/3230514278 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa3b401e040 con 0x5597a342ef50 2023-08-10T12:01:56.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.995+0000 7fa3a5ffb700 1 -- 172.21.15.73:0/3230514278 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3b400f770 con 0x5597a342ef50 2023-08-10T12:01:56.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.995+0000 7fa3d0ef2b80 10 client.16881 fetch_fsmap learned FSMap version 55 2023-08-10T12:01:56.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.995+0000 7fa3d0ef2b80 1 -- 172.21.15.73:0/3230514278 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x5597a3190c60 con 0x5597a342ef50 2023-08-10T12:01:56.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.996+0000 7fa3a5ffb700 1 -- 172.21.15.73:0/3230514278 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3b4047080 con 0x5597a342ef50 2023-08-10T12:01:56.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.996+0000 7fa3a5ffb700 1 -- 172.21.15.73:0/3230514278 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7fa3b40099f0 con 0x5597a342ef50 2023-08-10T12:01:56.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.996+0000 7fa3d0ef2b80 10 client.16881 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:01:56.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.996+0000 7fa3d0ef2b80 10 client.16881 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-08-10T12:01:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.996+0000 7fa3d0ef2b80 20 client.16881 populate_metadata read hostname 'smithi073' 2023-08-10T12:01:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.996+0000 7fa3d0ef2b80 1 --2- 172.21.15.73:0/3230514278 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x5597a3497b00 0x5597a3499f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.996+0000 7fa3d0ef2b80 4 client.16881 mds_command: new command op to 24443 tid=0[{"prefix": "damage ls"}] 2023-08-10T12:01:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.996+0000 7fa3d0ef2b80 1 -- 172.21.15.73:0/3230514278 --> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5597a3373780 con 0x5597a3497b00 2023-08-10T12:01:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.996+0000 7fa3be59c700 1 --2- 172.21.15.73:0/3230514278 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x5597a3497b00 0x5597a3499f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.996+0000 7fa3a5ffb700 10 client.16881 ms_handle_connect on v2:172.21.15.152:6834/1791572604 2023-08-10T12:01:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.996+0000 7fa3be59c700 1 --2- 172.21.15.73:0/3230514278 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x5597a3497b00 0x5597a3499f20 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b877041939830647 server_cookie=7b61d7ecbbc87850 in_seq=0 out_seq=0 2023-08-10T12:01:56.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.997+0000 7fa3a5ffb700 1 -- 172.21.15.73:0/3230514278 <== mds.3 v2:172.21.15.152:6834/1791572604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5597a3373780 con 0x5597a3497b00 2023-08-10T12:01:56.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.997+0000 7fa3a5ffb700 10 client.16881 handle_command_reply: tid=0 2023-08-10T12:01:56.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.997+0000 7fa3d0ef2b80 1 client.16881 shutdown 2023-08-10T12:01:56.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.997+0000 7fa3d0ef2b80 1 -- 172.21.15.73:0/3230514278 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a342ef50 msgr2=0x5597a342a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.997+0000 7fa3d0ef2b80 1 --2- 172.21.15.73:0/3230514278 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a342ef50 0x5597a342a970 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40036c0 tx=0x7fa3b4017d60 comp rx=0 tx=0).stop 2023-08-10T12:01:56.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.997+0000 7fa3d0ef2b80 1 -- 172.21.15.73:0/3230514278 shutdown_connections 2023-08-10T12:01:56.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.997+0000 7fa3d0ef2b80 1 --2- 172.21.15.73:0/3230514278 >> [v2:172.21.15.152:6834/1791572604,v1:172.21.15.152:6835/1791572604] conn(0x5597a3497b00 0x5597a3499f20 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.997+0000 7fa3d0ef2b80 1 --2- 172.21.15.73:0/3230514278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5597a342f870 0x5597a342aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.997+0000 7fa3d0ef2b80 1 --2- 172.21.15.73:0/3230514278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597a3429800 0x5597a342c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.997+0000 7fa3a5ffb700 0 client.16881 ms_handle_reset on v2:172.21.15.152:6834/1791572604 2023-08-10T12:01:56.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.997+0000 7fa3d0ef2b80 1 --2- 172.21.15.73:0/3230514278 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597a342ef50 0x5597a342a970 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.997+0000 7fa3d0ef2b80 1 -- 172.21.15.73:0/3230514278 >> 172.21.15.73:0/3230514278 conn(0x5597a3386cd0 msgr2=0x5597a3433400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:56.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.997+0000 7fa3d0ef2b80 1 -- 172.21.15.73:0/3230514278 shutdown_connections 2023-08-10T12:01:56.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.997+0000 7fa3d0ef2b80 1 -- 172.21.15.73:0/3230514278 wait complete. 2023-08-10T12:01:56.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.997+0000 7fa3d0ef2b80 20 client.16881 trim_cache size 0 max 16384 2023-08-10T12:01:56.011 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2023-08-10T12:01:56.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.997+0000 7fa3c4d59700 1 -- 172.21.15.73:0/1621741922 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa3a80a12c0 msgr2=0x7fa3a80a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.997+0000 7fa3c4d59700 1 --2- 172.21.15.73:0/1621741922 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa3a80a12c0 0x7fa3a80a3780 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0007be0 tx=0x7fa3b00073d0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.997+0000 7fa3c4d59700 1 -- 172.21.15.73:0/1621741922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c0105690 msgr2=0x7fa3c01965b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.997+0000 7fa3c4d59700 1 --2- 172.21.15.73:0/1621741922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c0105690 0x7fa3c01965b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800ef30 tx=0x7fa3b800c3a0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.997+0000 7fa3c4d59700 1 -- 172.21.15.73:0/1621741922 shutdown_connections 2023-08-10T12:01:56.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.997+0000 7fa3c4d59700 1 --2- 172.21.15.73:0/1621741922 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa3a80a12c0 0x7fa3a80a3780 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.997+0000 7fa3c4d59700 1 --2- 172.21.15.73:0/1621741922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3c00ff5d0 0x7fa3c019c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.997+0000 7fa3c4d59700 1 --2- 172.21.15.73:0/1621741922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3c0105690 0x7fa3c01965b0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.997+0000 7fa3c4d59700 1 --2- 172.21.15.73:0/1621741922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3c00fff90 0x7fa3c019ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.997+0000 7fa3c4d59700 1 -- 172.21.15.73:0/1621741922 >> 172.21.15.73:0/1621741922 conn(0x7fa3c00fb0c0 msgr2=0x7fa3c00fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:56.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.997+0000 7fa3c4d59700 1 -- 172.21.15.73:0/1621741922 shutdown_connections 2023-08-10T12:01:56.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:55.997+0000 7fa3c4d59700 1 -- 172.21.15.73:0/1621741922 wait complete. 2023-08-10T12:01:56.014 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-08-10T12:01:56.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.144+0000 7f1dd0c36700 1 -- 172.21.15.73:0/551555086 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dcc0ff5d0 msgr2=0x7f1dcc0ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.144+0000 7f1dd0c36700 1 --2- 172.21.15.73:0/551555086 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dcc0ff5d0 0x7f1dcc0ffa50 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0009990 tx=0x7f1dc0009ca0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.144+0000 7f1dd0c36700 1 -- 172.21.15.73:0/551555086 shutdown_connections 2023-08-10T12:01:56.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.144+0000 7f1dd0c36700 1 --2- 172.21.15.73:0/551555086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dcc105670 0x7f1dcc105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.144+0000 7f1dd0c36700 1 --2- 172.21.15.73:0/551555086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dcc0fff90 0x7f1dcc10c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.144+0000 7f1dd0c36700 1 --2- 172.21.15.73:0/551555086 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dcc0ff5d0 0x7f1dcc0ffa50 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.144+0000 7f1dd0c36700 1 -- 172.21.15.73:0/551555086 >> 172.21.15.73:0/551555086 conn(0x7f1dcc0fb0e0 msgr2=0x7f1dcc0fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:56.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.144+0000 7f1dd0c36700 1 -- 172.21.15.73:0/551555086 shutdown_connections 2023-08-10T12:01:56.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.144+0000 7f1dd0c36700 1 -- 172.21.15.73:0/551555086 wait complete. 2023-08-10T12:01:56.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.145+0000 7f1dd0c36700 1 Processor -- start 2023-08-10T12:01:56.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.145+0000 7f1dd0c36700 1 -- start start 2023-08-10T12:01:56.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.145+0000 7f1dd0c36700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dcc0ff5d0 0x7f1dcc197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.145+0000 7f1dd0c36700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dcc0fff90 0x7f1dcc197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.145+0000 7f1dd0c36700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dcc105670 0x7f1dcc1a25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.145+0000 7f1dd0c36700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc1983a0 con 0x7f1dcc0fff90 2023-08-10T12:01:56.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.145+0000 7f1dd0c36700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc1a2b10 con 0x7f1dcc105670 2023-08-10T12:01:56.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.145+0000 7f1dd0c36700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc1a2c80 con 0x7f1dcc0ff5d0 2023-08-10T12:01:56.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.145+0000 7f1dc9d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dcc0fff90 0x7f1dcc197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.145+0000 7f1dc9d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dcc0fff90 0x7f1dcc197a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36372/0 (socket says 172.21.15.73:36372) 2023-08-10T12:01:56.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.145+0000 7f1dc9d9b700 1 -- 172.21.15.73:0/1379693983 learned_addr learned my addr 172.21.15.73:0/1379693983 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:56.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.145+0000 7f1dca59c700 1 --2- 172.21.15.73:0/1379693983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dcc0ff5d0 0x7f1dcc197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.145+0000 7f1dcad9d700 1 --2- 172.21.15.73:0/1379693983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dcc105670 0x7f1dcc1a25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.145+0000 7f1dc9d9b700 1 -- 172.21.15.73:0/1379693983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dcc0ff5d0 msgr2=0x7f1dcc197550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.145+0000 7f1dc9d9b700 1 --2- 172.21.15.73:0/1379693983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dcc0ff5d0 0x7f1dcc197550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.145+0000 7f1dc9d9b700 1 -- 172.21.15.73:0/1379693983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dcc105670 msgr2=0x7f1dcc1a25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.145+0000 7f1dc9d9b700 1 --2- 172.21.15.73:0/1379693983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dcc105670 0x7f1dcc1a25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.145+0000 7f1dc9d9b700 1 -- 172.21.15.73:0/1379693983 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc00095f0 con 0x7f1dcc0fff90 2023-08-10T12:01:56.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.145+0000 7f1dc9d9b700 1 --2- 172.21.15.73:0/1379693983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dcc0fff90 0x7f1dcc197a90 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f1dc000b2e0 tx=0x7f1dc0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:56.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.146+0000 7f1dbb7fe700 1 -- 172.21.15.73:0/1379693983 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc001d070 con 0x7f1dcc0fff90 2023-08-10T12:01:56.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.146+0000 7f1dbb7fe700 1 -- 172.21.15.73:0/1379693983 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1dc0021410 con 0x7f1dcc0fff90 2023-08-10T12:01:56.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.146+0000 7f1dd0c36700 1 -- 172.21.15.73:0/1379693983 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dcc1a2f00 con 0x7f1dcc0fff90 2023-08-10T12:01:56.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.146+0000 7f1dbb7fe700 1 -- 172.21.15.73:0/1379693983 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc0017650 con 0x7f1dcc0fff90 2023-08-10T12:01:56.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.146+0000 7f1dd0c36700 1 -- 172.21.15.73:0/1379693983 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dcc1a3330 con 0x7f1dcc0fff90 2023-08-10T12:01:56.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.149+0000 7f1ddcdcfb80 1 Processor -- start 2023-08-10T12:01:56.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.150+0000 7f1ddcdcfb80 1 -- start start 2023-08-10T12:01:56.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.150+0000 7f1ddcdcfb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642c2789f50 0x5642c278a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.150+0000 7f1ddcdcfb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5642c278a870 0x5642c27842c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.150+0000 7f1ddcdcfb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642c2784800 0x5642c2784c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.150+0000 7f1ddcdcfb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642c26ffdc0 con 0x5642c2789f50 2023-08-10T12:01:56.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.150+0000 7f1ddcdcfb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642c26dc590 con 0x5642c278a870 2023-08-10T12:01:56.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.150+0000 7f1ddcdcfb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642c26d9eb0 con 0x5642c2784800 2023-08-10T12:01:56.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.150+0000 7f1dcad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642c2789f50 0x5642c278a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.150+0000 7f1dbb7fe700 1 -- 172.21.15.73:0/1379693983 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f1dc0021580 con 0x7f1dcc0fff90 2023-08-10T12:01:56.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.150+0000 7f1dcad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642c2789f50 0x5642c278a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36376/0 (socket says 172.21.15.73:36376) 2023-08-10T12:01:56.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.150+0000 7f1dcad9d700 1 -- 172.21.15.73:0/623360249 learned_addr learned my addr 172.21.15.73:0/623360249 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:56.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.150+0000 7f1dc9d9b700 1 --2- 172.21.15.73:0/623360249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642c2784800 0x5642c2784c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.150+0000 7f1dcad9d700 1 -- 172.21.15.73:0/623360249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642c2784800 msgr2=0x5642c2784c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:56.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.150+0000 7f1dcad9d700 1 --2- 172.21.15.73:0/623360249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642c2784800 0x5642c2784c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.150+0000 7f1dcad9d700 1 -- 172.21.15.73:0/623360249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5642c278a870 msgr2=0x5642c27842c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:56.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.150+0000 7f1dcad9d700 1 --2- 172.21.15.73:0/623360249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5642c278a870 0x5642c27842c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.150+0000 7f1dcad9d700 1 -- 172.21.15.73:0/623360249 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642c2556630 con 0x5642c2789f50 2023-08-10T12:01:56.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.151+0000 7f1dcad9d700 1 --2- 172.21.15.73:0/623360249 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642c2789f50 0x5642c278a330 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4011680 tx=0x7f1dc4009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84abc319be7ec580 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:56.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.151+0000 7f1dbb7fe700 1 --2- 172.21.15.73:0/1379693983 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f1db40a12c0 0x7f1db40a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.151+0000 7f1db8ff9700 1 -- 172.21.15.73:0/623360249 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc400e040 con 0x5642c2789f50 2023-08-10T12:01:56.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.151+0000 7f1db8ff9700 1 -- 172.21.15.73:0/623360249 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1dc400f040 con 0x5642c2789f50 2023-08-10T12:01:56.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.151+0000 7f1db8ff9700 1 -- 172.21.15.73:0/623360249 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4004880 con 0x5642c2789f50 2023-08-10T12:01:56.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.151+0000 7f1dbb7fe700 1 -- 172.21.15.73:0/1379693983 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1dc00cdf20 con 0x7f1dcc0fff90 2023-08-10T12:01:56.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.151+0000 7f1dca59c700 1 --2- 172.21.15.73:0/1379693983 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f1db40a12c0 0x7f1db40a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.152+0000 7f1dca59c700 1 --2- 172.21.15.73:0/1379693983 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f1db40a12c0 0x7f1db40a3780 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x5642c278acf0 tx=0x7f1dbc0098d0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:56.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.152+0000 7f1ddcdcfb80 1 -- 172.21.15.73:0/623360249 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642c2789f50 msgr2=0x5642c278a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.152+0000 7f1ddcdcfb80 1 --2- 172.21.15.73:0/623360249 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642c2789f50 0x5642c278a330 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4011680 tx=0x7f1dc4009920 comp rx=0 tx=0).stop 2023-08-10T12:01:56.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.152+0000 7f1ddcdcfb80 1 -- 172.21.15.73:0/623360249 shutdown_connections 2023-08-10T12:01:56.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.152+0000 7f1ddcdcfb80 1 --2- 172.21.15.73:0/623360249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642c2784800 0x5642c2784c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.152+0000 7f1ddcdcfb80 1 --2- 172.21.15.73:0/623360249 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642c2789f50 0x5642c278a330 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.152+0000 7f1ddcdcfb80 1 --2- 172.21.15.73:0/623360249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5642c278a870 0x5642c27842c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.152+0000 7f1ddcdcfb80 1 -- 172.21.15.73:0/623360249 >> 172.21.15.73:0/623360249 conn(0x5642c26e1cd0 msgr2=0x5642c277f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:56.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.152+0000 7f1ddcdcfb80 1 -- 172.21.15.73:0/623360249 shutdown_connections 2023-08-10T12:01:56.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.152+0000 7f1ddcdcfb80 1 -- 172.21.15.73:0/623360249 wait complete. 2023-08-10T12:01:56.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.152+0000 7f1ddcdcfb80 1 -- start start 2023-08-10T12:01:56.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.152+0000 7f1ddcdcfb80 1 Processor -- start 2023-08-10T12:01:56.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.152+0000 7f1ddcdcfb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5642c2784800 0x5642c2790990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.152+0000 7f1ddcdcfb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642c2789f50 0x5642c278dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.152+0000 7f1ddcdcfb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642c278a870 0x5642c278e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.152+0000 7f1ddcdcfb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642c26d57a0 con 0x5642c2789f50 2023-08-10T12:01:56.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.152+0000 7f1ddcdcfb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642c2674ac0 con 0x5642c2784800 2023-08-10T12:01:56.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.152+0000 7f1ddcdcfb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642c26747c0 con 0x5642c278a870 2023-08-10T12:01:56.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.153+0000 7f1ddcdcfb80 10 client.0 _ll_register_callbacks cb 0x5642c2672680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:01:56.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.153+0000 7f1dc9d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642c2789f50 0x5642c278dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.153+0000 7f1dca59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5642c2784800 0x5642c2790990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.153+0000 7f1dca59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5642c2784800 0x5642c2790990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:51034/0 (socket says 172.21.15.73:51034) 2023-08-10T12:01:56.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.153+0000 7f1dca59c700 1 -- 172.21.15.73:0/548873655 learned_addr learned my addr 172.21.15.73:0/548873655 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:56.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.153+0000 7f1dc9d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642c2789f50 0x5642c278dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36386/0 (socket says 172.21.15.73:36386) 2023-08-10T12:01:56.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.153+0000 7f1dcad9d700 1 --2- 172.21.15.73:0/548873655 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642c278a870 0x5642c278e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.153+0000 7f1dc9d9b700 1 -- 172.21.15.73:0/548873655 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642c278a870 msgr2=0x5642c278e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:56.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.153+0000 7f1dc9d9b700 1 --2- 172.21.15.73:0/548873655 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642c278a870 0x5642c278e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.153+0000 7f1dc9d9b700 1 -- 172.21.15.73:0/548873655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5642c2784800 msgr2=0x5642c2790990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:56.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.153+0000 7f1dc9d9b700 1 --2- 172.21.15.73:0/548873655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5642c2784800 0x5642c2790990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.153+0000 7f1dc9d9b700 1 -- 172.21.15.73:0/548873655 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc4011330 con 0x5642c2789f50 2023-08-10T12:01:56.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.153+0000 7f1dca59c700 1 --2- 172.21.15.73:0/548873655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5642c2784800 0x5642c2790990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:01:56.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.153+0000 7f1dcad9d700 1 --2- 172.21.15.73:0/548873655 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642c278a870 0x5642c278e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:01:56.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.153+0000 7f1dc9d9b700 1 --2- 172.21.15.73:0/548873655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642c2789f50 0x5642c278dc80 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00cb720 tx=0x7f1dc0021b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e00fab4a4932195b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:56.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.153+0000 7f1db1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:01:56.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.153+0000 7f1db1ffb700 1 -- 172.21.15.73:0/548873655 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc009aa90 con 0x5642c2789f50 2023-08-10T12:01:56.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.153+0000 7f1ddcdcfb80 1 -- 172.21.15.73:0/548873655 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5642c2777470 con 0x5642c2789f50 2023-08-10T12:01:56.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.153+0000 7f1db1ffb700 1 -- 172.21.15.73:0/548873655 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1dc009b130 con 0x5642c2789f50 2023-08-10T12:01:56.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.154+0000 7f1db1ffb700 1 -- 172.21.15.73:0/548873655 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1dc009f160 con 0x5642c2789f50 2023-08-10T12:01:56.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.154+0000 7f1ddcdcfb80 10 client.16893 fetch_fsmap learned FSMap version 55 2023-08-10T12:01:56.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.154+0000 7f1ddcdcfb80 1 -- 172.21.15.73:0/548873655 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x5642c2502de0 con 0x5642c2789f50 2023-08-10T12:01:56.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.154+0000 7f1db1ffb700 1 -- 172.21.15.73:0/548873655 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5642c2777470 con 0x5642c2789f50 2023-08-10T12:01:56.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.154+0000 7f1db1ffb700 1 -- 172.21.15.73:0/548873655 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7f1dc00a30f0 con 0x5642c2789f50 2023-08-10T12:01:56.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.154+0000 7f1ddcdcfb80 10 client.16893 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:01:56.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.154+0000 7f1ddcdcfb80 10 client.16893 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-08-10T12:01:56.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.154+0000 7f1ddcdcfb80 20 client.16893 populate_metadata read hostname 'smithi073' 2023-08-10T12:01:56.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.154+0000 7f1ddcdcfb80 1 --2- 172.21.15.73:0/548873655 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x5642c27a2470 0x5642c27a4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.154+0000 7f1ddcdcfb80 4 client.16893 mds_command: new command op to 24451 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:01:56.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.154+0000 7f1ddcdcfb80 1 -- 172.21.15.73:0/548873655 --> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5642c27539d0 con 0x5642c27a2470 2023-08-10T12:01:56.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.154+0000 7f1dca59c700 1 --2- 172.21.15.73:0/548873655 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x5642c27a2470 0x5642c27a4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.155+0000 7f1db1ffb700 10 client.16893 ms_handle_connect on v2:172.21.15.156:6834/904126790 2023-08-10T12:01:56.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.155+0000 7f1dca59c700 1 --2- 172.21.15.73:0/548873655 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x5642c27a2470 0x5642c27a4890 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=83663cfb4cc463e1 server_cookie=30c84de019c0d816 in_seq=0 out_seq=0 2023-08-10T12:01:56.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.155+0000 7f1db1ffb700 1 -- 172.21.15.73:0/548873655 <== mds.2 v2:172.21.15.156:6834/904126790 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5642c27539d0 con 0x5642c27a2470 2023-08-10T12:01:56.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.155+0000 7f1db1ffb700 10 client.16893 handle_command_reply: tid=0 2023-08-10T12:01:56.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.155+0000 7f1ddcdcfb80 1 client.16893 shutdown 2023-08-10T12:01:56.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.155+0000 7f1ddcdcfb80 1 -- 172.21.15.73:0/548873655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642c2789f50 msgr2=0x5642c278dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.155+0000 7f1ddcdcfb80 1 --2- 172.21.15.73:0/548873655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642c2789f50 0x5642c278dc80 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00cb720 tx=0x7f1dc0021b60 comp rx=0 tx=0).stop 2023-08-10T12:01:56.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.155+0000 7f1ddcdcfb80 1 -- 172.21.15.73:0/548873655 shutdown_connections 2023-08-10T12:01:56.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.155+0000 7f1ddcdcfb80 1 --2- 172.21.15.73:0/548873655 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x5642c27a2470 0x5642c27a4890 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.155+0000 7f1ddcdcfb80 1 --2- 172.21.15.73:0/548873655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5642c2784800 0x5642c2790990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.155+0000 7f1ddcdcfb80 1 --2- 172.21.15.73:0/548873655 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642c278a870 0x5642c278e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.155+0000 7f1db1ffb700 0 client.16893 ms_handle_reset on v2:172.21.15.156:6834/904126790 2023-08-10T12:01:56.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.155+0000 7f1ddcdcfb80 1 --2- 172.21.15.73:0/548873655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642c2789f50 0x5642c278dc80 secure :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00cb720 tx=0x7f1dc0021b60 comp rx=0 tx=0).stop 2023-08-10T12:01:56.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.155+0000 7f1ddcdcfb80 1 -- 172.21.15.73:0/548873655 >> 172.21.15.73:0/548873655 conn(0x5642c26e1cd0 msgr2=0x5642c277e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:56.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.155+0000 7f1ddcdcfb80 1 -- 172.21.15.73:0/548873655 shutdown_connections 2023-08-10T12:01:56.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.155+0000 7f1ddcdcfb80 1 -- 172.21.15.73:0/548873655 wait complete. 2023-08-10T12:01:56.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.156+0000 7f1ddcdcfb80 20 client.16893 trim_cache size 0 max 16384 2023-08-10T12:01:56.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.168+0000 7f1ddcdcfb80 1 Processor -- start 2023-08-10T12:01:56.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.168+0000 7f1ddcdcfb80 1 -- start start 2023-08-10T12:01:56.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.169+0000 7f1ddcdcfb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642c2784800 0x5642c27842c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.169+0000 7f1ddcdcfb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5642c278a870 0x5642c27a91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.169+0000 7f1ddcdcfb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642c2788470 0x5642c278d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.169+0000 7f1ddcdcfb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642c2558920 con 0x5642c2788470 2023-08-10T12:01:56.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.169+0000 7f1ddcdcfb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642c279e6d0 con 0x5642c278a870 2023-08-10T12:01:56.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.169+0000 7f1ddcdcfb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642c2780920 con 0x5642c2784800 2023-08-10T12:01:56.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.169+0000 7f1dcad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642c2788470 0x5642c278d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.169+0000 7f1dca59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642c2784800 0x5642c27842c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.169+0000 7f1dc9d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5642c278a870 0x5642c27a91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.169+0000 7f1dca59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642c2784800 0x5642c27842c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:33664/0 (socket says 172.21.15.73:33664) 2023-08-10T12:01:56.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.169+0000 7f1dc9d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5642c278a870 0x5642c27a91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:51042/0 (socket says 172.21.15.73:51042) 2023-08-10T12:01:56.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.169+0000 7f1dca59c700 1 -- 172.21.15.73:0/1870805086 learned_addr learned my addr 172.21.15.73:0/1870805086 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:56.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.169+0000 7f1dca59c700 1 -- 172.21.15.73:0/1870805086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5642c278a870 msgr2=0x5642c27a91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:56.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.169+0000 7f1dca59c700 1 --2- 172.21.15.73:0/1870805086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5642c278a870 0x5642c27a91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.169+0000 7f1dca59c700 1 -- 172.21.15.73:0/1870805086 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642c2788470 msgr2=0x5642c278d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:56.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.169+0000 7f1dca59c700 1 --2- 172.21.15.73:0/1870805086 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642c2788470 0x5642c278d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.169+0000 7f1dca59c700 1 -- 172.21.15.73:0/1870805086 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642c24ebc60 con 0x5642c2784800 2023-08-10T12:01:56.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.169+0000 7f1dcad9d700 1 --2- 172.21.15.73:0/1870805086 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642c2788470 0x5642c278d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:01:56.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.169+0000 7f1dca59c700 1 --2- 172.21.15.73:0/1870805086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642c2784800 0x5642c27842c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x5642c27a5160 tx=0x7f1dbc014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=988cc689224c2845 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:56.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.169+0000 7f1db97fa700 1 -- 172.21.15.73:0/1870805086 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc022040 con 0x5642c2784800 2023-08-10T12:01:56.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.170+0000 7f1db97fa700 1 -- 172.21.15.73:0/1870805086 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1dbc0284d0 con 0x5642c2784800 2023-08-10T12:01:56.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.170+0000 7f1db97fa700 1 -- 172.21.15.73:0/1870805086 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc01d670 con 0x5642c2784800 2023-08-10T12:01:56.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.170+0000 7f1ddcdcfb80 1 -- 172.21.15.73:0/1870805086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642c2784800 msgr2=0x5642c27842c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.170+0000 7f1ddcdcfb80 1 --2- 172.21.15.73:0/1870805086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642c2784800 0x5642c27842c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x5642c27a5160 tx=0x7f1dbc014000 comp rx=0 tx=0).stop 2023-08-10T12:01:56.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.170+0000 7f1ddcdcfb80 1 -- 172.21.15.73:0/1870805086 shutdown_connections 2023-08-10T12:01:56.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.170+0000 7f1ddcdcfb80 1 --2- 172.21.15.73:0/1870805086 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642c2788470 0x5642c278d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.170+0000 7f1ddcdcfb80 1 --2- 172.21.15.73:0/1870805086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642c2784800 0x5642c27842c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.170+0000 7f1ddcdcfb80 1 --2- 172.21.15.73:0/1870805086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5642c278a870 0x5642c27a91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.170+0000 7f1ddcdcfb80 1 -- 172.21.15.73:0/1870805086 >> 172.21.15.73:0/1870805086 conn(0x5642c26e1cd0 msgr2=0x5642c2787d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:56.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.170+0000 7f1ddcdcfb80 1 -- 172.21.15.73:0/1870805086 shutdown_connections 2023-08-10T12:01:56.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.170+0000 7f1ddcdcfb80 1 -- 172.21.15.73:0/1870805086 wait complete. 2023-08-10T12:01:56.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.171+0000 7f1ddcdcfb80 1 -- start start 2023-08-10T12:01:56.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.171+0000 7f1ddcdcfb80 1 Processor -- start 2023-08-10T12:01:56.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.171+0000 7f1ddcdcfb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5642c2784800 0x5642c2799380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.171+0000 7f1ddcdcfb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642c2788470 0x5642c27998c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.171+0000 7f1ddcdcfb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642c278a870 0x5642c2797970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.171+0000 7f1ddcdcfb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642c2798080 con 0x5642c2788470 2023-08-10T12:01:56.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.171+0000 7f1ddcdcfb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642c27981f0 con 0x5642c2784800 2023-08-10T12:01:56.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.171+0000 7f1ddcdcfb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642c27983b0 con 0x5642c278a870 2023-08-10T12:01:56.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.171+0000 7f1ddcdcfb80 10 client.0 _ll_register_callbacks cb 0x5642c2672680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:01:56.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.171+0000 7f1dca59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5642c2784800 0x5642c2799380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.171+0000 7f1dc9d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642c2788470 0x5642c27998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.171+0000 7f1dca59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5642c2784800 0x5642c2799380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:51048/0 (socket says 172.21.15.73:51048) 2023-08-10T12:01:56.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.171+0000 7f1dca59c700 1 -- 172.21.15.73:0/2609372214 learned_addr learned my addr 172.21.15.73:0/2609372214 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:56.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.171+0000 7f1dcad9d700 1 --2- 172.21.15.73:0/2609372214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642c278a870 0x5642c2797970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.171+0000 7f1dca59c700 1 -- 172.21.15.73:0/2609372214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642c278a870 msgr2=0x5642c2797970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:56.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.171+0000 7f1dca59c700 1 --2- 172.21.15.73:0/2609372214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642c278a870 0x5642c2797970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.171+0000 7f1dca59c700 1 -- 172.21.15.73:0/2609372214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642c2788470 msgr2=0x5642c27998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:56.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.171+0000 7f1dca59c700 1 --2- 172.21.15.73:0/2609372214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642c2788470 0x5642c27998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.171+0000 7f1dca59c700 1 -- 172.21.15.73:0/2609372214 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5642c2556630 con 0x5642c2784800 2023-08-10T12:01:56.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.171+0000 7f1dc9d9b700 1 --2- 172.21.15.73:0/2609372214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642c2788470 0x5642c27998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:01:56.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.172+0000 7f1dca59c700 1 --2- 172.21.15.73:0/2609372214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5642c2784800 0x5642c2799380 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc011c00 tx=0x7f1dbc003af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83c426e9f69f5058 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:56.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.172+0000 7f1db1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T12:01:56.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.172+0000 7f1db1ffb700 1 -- 172.21.15.73:0/2609372214 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc022040 con 0x5642c2784800 2023-08-10T12:01:56.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.172+0000 7f1ddcdcfb80 1 -- 172.21.15.73:0/2609372214 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1dc400f040 con 0x5642c2784800 2023-08-10T12:01:56.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.172+0000 7f1db1ffb700 1 -- 172.21.15.73:0/2609372214 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1dbc0288b0 con 0x5642c2784800 2023-08-10T12:01:56.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.172+0000 7f1db1ffb700 1 -- 172.21.15.73:0/2609372214 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1dbc028a70 con 0x5642c2784800 2023-08-10T12:01:56.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.172+0000 7f1ddcdcfb80 10 client.26303 fetch_fsmap learned FSMap version 55 2023-08-10T12:01:56.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.172+0000 7f1ddcdcfb80 1 -- 172.21.15.73:0/2609372214 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x7f1dbc017070 con 0x5642c2784800 2023-08-10T12:01:56.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.172+0000 7f1db1ffb700 1 -- 172.21.15.73:0/2609372214 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1dc400f040 con 0x5642c2784800 2023-08-10T12:01:56.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.172+0000 7f1db1ffb700 1 -- 172.21.15.73:0/2609372214 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7f1dbc039410 con 0x5642c2784800 2023-08-10T12:01:56.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.172+0000 7f1ddcdcfb80 10 client.26303 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:01:56.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.173+0000 7f1ddcdcfb80 10 client.26303 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-08-10T12:01:56.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.173+0000 7f1ddcdcfb80 20 client.26303 populate_metadata read hostname 'smithi073' 2023-08-10T12:01:56.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.173+0000 7f1ddcdcfb80 1 --2- 172.21.15.73:0/2609372214 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x5642c27f7420 0x5642c27f9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.173+0000 7f1ddcdcfb80 4 client.26303 mds_command: new command op to 24451 tid=0[{"prefix": "damage ls"}] 2023-08-10T12:01:56.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.173+0000 7f1ddcdcfb80 1 -- 172.21.15.73:0/2609372214 --> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5642c26ce780 con 0x5642c27f7420 2023-08-10T12:01:56.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.173+0000 7f1dc9d9b700 1 --2- 172.21.15.73:0/2609372214 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x5642c27f7420 0x5642c27f9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.173+0000 7f1db1ffb700 10 client.26303 ms_handle_connect on v2:172.21.15.156:6834/904126790 2023-08-10T12:01:56.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.173+0000 7f1dc9d9b700 1 --2- 172.21.15.73:0/2609372214 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x5642c27f7420 0x5642c27f9840 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ee3825dc179e4c15 server_cookie=3b71bf3de3bec232 in_seq=0 out_seq=0 2023-08-10T12:01:56.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.173+0000 7f1db1ffb700 1 -- 172.21.15.73:0/2609372214 <== mds.2 v2:172.21.15.156:6834/904126790 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5642c26ce780 con 0x5642c27f7420 2023-08-10T12:01:56.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.173+0000 7f1db1ffb700 10 client.26303 handle_command_reply: tid=0 2023-08-10T12:01:56.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.173+0000 7f1ddcdcfb80 1 client.26303 shutdown 2023-08-10T12:01:56.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.173+0000 7f1ddcdcfb80 1 -- 172.21.15.73:0/2609372214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5642c2784800 msgr2=0x5642c2799380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.173+0000 7f1ddcdcfb80 1 --2- 172.21.15.73:0/2609372214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5642c2784800 0x5642c2799380 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc011c00 tx=0x7f1dbc003af0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.173+0000 7f1ddcdcfb80 1 -- 172.21.15.73:0/2609372214 shutdown_connections 2023-08-10T12:01:56.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.173+0000 7f1ddcdcfb80 1 --2- 172.21.15.73:0/2609372214 >> [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] conn(0x5642c27f7420 0x5642c27f9840 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.173+0000 7f1ddcdcfb80 1 --2- 172.21.15.73:0/2609372214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5642c2784800 0x5642c2799380 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.173+0000 7f1ddcdcfb80 1 --2- 172.21.15.73:0/2609372214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642c278a870 0x5642c2797970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.173+0000 7f1db1ffb700 0 client.26303 ms_handle_reset on v2:172.21.15.156:6834/904126790 2023-08-10T12:01:56.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.173+0000 7f1ddcdcfb80 1 --2- 172.21.15.73:0/2609372214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5642c2788470 0x5642c27998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.173+0000 7f1ddcdcfb80 1 -- 172.21.15.73:0/2609372214 >> 172.21.15.73:0/2609372214 conn(0x5642c26e1cd0 msgr2=0x5642c2788d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:56.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.173+0000 7f1ddcdcfb80 1 -- 172.21.15.73:0/2609372214 shutdown_connections 2023-08-10T12:01:56.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.173+0000 7f1ddcdcfb80 1 -- 172.21.15.73:0/2609372214 wait complete. 2023-08-10T12:01:56.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.174+0000 7f1ddcdcfb80 20 client.26303 trim_cache size 0 max 16384 2023-08-10T12:01:56.187 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2023-08-10T12:01:56.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.174+0000 7f1dd0c36700 1 -- 172.21.15.73:0/1379693983 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f1db40a12c0 msgr2=0x7f1db40a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.174+0000 7f1dd0c36700 1 --2- 172.21.15.73:0/1379693983 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f1db40a12c0 0x7f1db40a3780 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x5642c278acf0 tx=0x7f1dbc0098d0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.174+0000 7f1dd0c36700 1 -- 172.21.15.73:0/1379693983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dcc0fff90 msgr2=0x7f1dcc197a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.174+0000 7f1dd0c36700 1 --2- 172.21.15.73:0/1379693983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dcc0fff90 0x7f1dcc197a90 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f1dc000b2e0 tx=0x7f1dc0004730 comp rx=0 tx=0).stop 2023-08-10T12:01:56.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.174+0000 7f1dd0c36700 1 -- 172.21.15.73:0/1379693983 shutdown_connections 2023-08-10T12:01:56.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.174+0000 7f1dd0c36700 1 --2- 172.21.15.73:0/1379693983 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f1db40a12c0 0x7f1db40a3780 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.174+0000 7f1dd0c36700 1 --2- 172.21.15.73:0/1379693983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dcc105670 0x7f1dcc1a25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.174+0000 7f1dd0c36700 1 --2- 172.21.15.73:0/1379693983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dcc0ff5d0 0x7f1dcc197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.174+0000 7f1dd0c36700 1 --2- 172.21.15.73:0/1379693983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dcc0fff90 0x7f1dcc197a90 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.174+0000 7f1dd0c36700 1 -- 172.21.15.73:0/1379693983 >> 172.21.15.73:0/1379693983 conn(0x7f1dcc0fb0e0 msgr2=0x7f1dcc0fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:56.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.174+0000 7f1dd0c36700 1 -- 172.21.15.73:0/1379693983 shutdown_connections 2023-08-10T12:01:56.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.174+0000 7f1dd0c36700 1 -- 172.21.15.73:0/1379693983 wait complete. 2023-08-10T12:01:56.190 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-08-10T12:01:56.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:56 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2436824257' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T12:01:56.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.317+0000 7f10a9a3a700 1 -- 172.21.15.73:0/1863287135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10a40ff5d0 msgr2=0x7f10a40ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.317+0000 7f10a9a3a700 1 --2- 172.21.15.73:0/1863287135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10a40ff5d0 0x7f10a40ffa50 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f10940099c0 tx=0x7f1094009cd0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.317+0000 7f10a9a3a700 1 -- 172.21.15.73:0/1863287135 shutdown_connections 2023-08-10T12:01:56.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.317+0000 7f10a9a3a700 1 --2- 172.21.15.73:0/1863287135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10a40fff90 0x7f10a410c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.317+0000 7f10a9a3a700 1 --2- 172.21.15.73:0/1863287135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10a4105690 0x7f10a4105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.317+0000 7f10a9a3a700 1 --2- 172.21.15.73:0/1863287135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10a40ff5d0 0x7f10a40ffa50 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.317+0000 7f10a9a3a700 1 -- 172.21.15.73:0/1863287135 >> 172.21.15.73:0/1863287135 conn(0x7f10a40fb0c0 msgr2=0x7f10a40fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:56.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.317+0000 7f10a9a3a700 1 -- 172.21.15.73:0/1863287135 shutdown_connections 2023-08-10T12:01:56.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.317+0000 7f10a9a3a700 1 -- 172.21.15.73:0/1863287135 wait complete. 2023-08-10T12:01:56.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.317+0000 7f10a9a3a700 1 Processor -- start 2023-08-10T12:01:56.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.318+0000 7f10a9a3a700 1 -- start start 2023-08-10T12:01:56.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.318+0000 7f10a9a3a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10a40ff5d0 0x7f10a41953f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.318+0000 7f10a9a3a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10a40fff90 0x7f10a4195930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.318+0000 7f10a9a3a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10a4105690 0x7f10a4195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.318+0000 7f10a9a3a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a41a4c30 con 0x7f10a40ff5d0 2023-08-10T12:01:56.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.318+0000 7f10a9a3a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a41a4da0 con 0x7f10a40fff90 2023-08-10T12:01:56.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.318+0000 7f10a9a3a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a41a4f60 con 0x7f10a4105690 2023-08-10T12:01:56.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.318+0000 7f10a2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10a40ff5d0 0x7f10a41953f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.318+0000 7f10a2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10a40ff5d0 0x7f10a41953f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36412/0 (socket says 172.21.15.73:36412) 2023-08-10T12:01:56.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.318+0000 7f10a2ffd700 1 -- 172.21.15.73:0/2871075464 learned_addr learned my addr 172.21.15.73:0/2871075464 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:56.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.318+0000 7f10a27fc700 1 --2- 172.21.15.73:0/2871075464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10a40fff90 0x7f10a4195930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.318+0000 7f10a37fe700 1 --2- 172.21.15.73:0/2871075464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10a4105690 0x7f10a4195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.318+0000 7f10a2ffd700 1 -- 172.21.15.73:0/2871075464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10a4105690 msgr2=0x7f10a4195e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.318+0000 7f10a2ffd700 1 --2- 172.21.15.73:0/2871075464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10a4105690 0x7f10a4195e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.318+0000 7f10a2ffd700 1 -- 172.21.15.73:0/2871075464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10a40fff90 msgr2=0x7f10a4195930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.318+0000 7f10a2ffd700 1 --2- 172.21.15.73:0/2871075464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10a40fff90 0x7f10a4195930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.318+0000 7f10a2ffd700 1 -- 172.21.15.73:0/2871075464 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10940095f0 con 0x7f10a40ff5d0 2023-08-10T12:01:56.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.318+0000 7f10a2ffd700 1 --2- 172.21.15.73:0/2871075464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10a40ff5d0 0x7f10a41953f0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f109800e9a0 tx=0x7f109800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:56.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.318+0000 7f10a8a38700 1 -- 172.21.15.73:0/2871075464 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1098009790 con 0x7f10a40ff5d0 2023-08-10T12:01:56.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.319+0000 7f10a8a38700 1 -- 172.21.15.73:0/2871075464 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1098010430 con 0x7f10a40ff5d0 2023-08-10T12:01:56.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.319+0000 7f10a9a3a700 1 -- 172.21.15.73:0/2871075464 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a41a5240 con 0x7f10a40ff5d0 2023-08-10T12:01:56.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.319+0000 7f10a8a38700 1 -- 172.21.15.73:0/2871075464 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1098018680 con 0x7f10a40ff5d0 2023-08-10T12:01:56.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.319+0000 7f10a9a3a700 1 -- 172.21.15.73:0/2871075464 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a41a5720 con 0x7f10a40ff5d0 2023-08-10T12:01:56.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.321+0000 7f10a8a38700 1 -- 172.21.15.73:0/2871075464 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f10980105a0 con 0x7f10a40ff5d0 2023-08-10T12:01:56.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.322+0000 7f10a8a38700 1 --2- 172.21.15.73:0/2871075464 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f108c0a12c0 0x7f108c0a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.322+0000 7f10a27fc700 1 --2- 172.21.15.73:0/2871075464 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f108c0a12c0 0x7f108c0a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.322+0000 7f10a8a38700 1 -- 172.21.15.73:0/2871075464 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1098014070 con 0x7f10a40ff5d0 2023-08-10T12:01:56.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.322+0000 7f10a27fc700 1 --2- 172.21.15.73:0/2871075464 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f108c0a12c0 0x7f108c0a3780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1094009990 tx=0x7f1094005fb0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:56.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.322+0000 7f10b5bd3b80 1 Processor -- start 2023-08-10T12:01:56.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.322+0000 7f10b5bd3b80 1 -- start start 2023-08-10T12:01:56.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.323+0000 7f10b5bd3b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fadf50 0x559539fae330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.323+0000 7f10b5bd3b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559539fae870 0x559539fa82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.323+0000 7f10b5bd3b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559539fa8800 0x559539fa8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.323+0000 7f10b5bd3b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x559539f23dc0 con 0x559539fadf50 2023-08-10T12:01:56.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.323+0000 7f10b5bd3b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x559539f00590 con 0x559539fa8800 2023-08-10T12:01:56.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.323+0000 7f10b5bd3b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559539efdeb0 con 0x559539fae870 2023-08-10T12:01:56.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.323+0000 7f10a2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fadf50 0x559539fae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.323+0000 7f10a2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fadf50 0x559539fae330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36420/0 (socket says 172.21.15.73:36420) 2023-08-10T12:01:56.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.323+0000 7f10a2ffd700 1 -- 172.21.15.73:0/954713289 learned_addr learned my addr 172.21.15.73:0/954713289 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:56.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.323+0000 7f10a37fe700 1 --2- 172.21.15.73:0/954713289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559539fa8800 0x559539fa8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.323+0000 7f10a27fc700 1 --2- 172.21.15.73:0/954713289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559539fae870 0x559539fa82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.323+0000 7f10a2ffd700 1 -- 172.21.15.73:0/954713289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559539fae870 msgr2=0x559539fa82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:56.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.323+0000 7f10a2ffd700 1 --2- 172.21.15.73:0/954713289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559539fae870 0x559539fa82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.323+0000 7f10a2ffd700 1 -- 172.21.15.73:0/954713289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559539fa8800 msgr2=0x559539fa8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:56.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.323+0000 7f10a2ffd700 1 --2- 172.21.15.73:0/954713289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559539fa8800 0x559539fa8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.323+0000 7f10a2ffd700 1 -- 172.21.15.73:0/954713289 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559539d7a630 con 0x559539fadf50 2023-08-10T12:01:56.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.323+0000 7f10a27fc700 1 --2- 172.21.15.73:0/954713289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559539fae870 0x559539fa82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T12:01:56.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.323+0000 7f10a2ffd700 1 --2- 172.21.15.73:0/954713289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fadf50 0x559539fae330 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f1098009230 tx=0x7f1098099950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dea4fc1ac8ccb6c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:56.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.323+0000 7f1089ffb700 1 -- 172.21.15.73:0/954713289 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10980a2370 con 0x559539fadf50 2023-08-10T12:01:56.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.323+0000 7f1089ffb700 1 -- 172.21.15.73:0/954713289 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1098010880 con 0x559539fadf50 2023-08-10T12:01:56.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.323+0000 7f1089ffb700 1 -- 172.21.15.73:0/954713289 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10980a1ee0 con 0x559539fadf50 2023-08-10T12:01:56.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.324+0000 7f10b5bd3b80 1 -- 172.21.15.73:0/954713289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fadf50 msgr2=0x559539fae330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.324+0000 7f10b5bd3b80 1 --2- 172.21.15.73:0/954713289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fadf50 0x559539fae330 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f1098009230 tx=0x7f1098099950 comp rx=0 tx=0).stop 2023-08-10T12:01:56.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.324+0000 7f10b5bd3b80 1 -- 172.21.15.73:0/954713289 shutdown_connections 2023-08-10T12:01:56.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.324+0000 7f10b5bd3b80 1 --2- 172.21.15.73:0/954713289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559539fa8800 0x559539fa8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.324+0000 7f10b5bd3b80 1 --2- 172.21.15.73:0/954713289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fadf50 0x559539fae330 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.324+0000 7f10b5bd3b80 1 --2- 172.21.15.73:0/954713289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559539fae870 0x559539fa82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.324+0000 7f10b5bd3b80 1 -- 172.21.15.73:0/954713289 >> 172.21.15.73:0/954713289 conn(0x559539f05cd0 msgr2=0x559539fa34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:56.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.324+0000 7f10b5bd3b80 1 -- 172.21.15.73:0/954713289 shutdown_connections 2023-08-10T12:01:56.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.324+0000 7f10b5bd3b80 1 -- 172.21.15.73:0/954713289 wait complete. 2023-08-10T12:01:56.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.324+0000 7f10b5bd3b80 1 -- start start 2023-08-10T12:01:56.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.325+0000 7f10b5bd3b80 1 Processor -- start 2023-08-10T12:01:56.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.325+0000 7f10b5bd3b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559539fa8800 0x559539fb4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.325+0000 7f10b5bd3b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559539fadf50 0x559539fb1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.325+0000 7f10b5bd3b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fae870 0x559539fb2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.325+0000 7f10b5bd3b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x559539ef97a0 con 0x559539fae870 2023-08-10T12:01:56.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.325+0000 7f10b5bd3b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x559539e98ac0 con 0x559539fadf50 2023-08-10T12:01:56.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.325+0000 7f10b5bd3b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559539e987c0 con 0x559539fa8800 2023-08-10T12:01:56.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.325+0000 7f10b5bd3b80 10 client.0 _ll_register_callbacks cb 0x559539e96680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:01:56.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.325+0000 7f10a37fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fae870 0x559539fb2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.325+0000 7f10a27fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559539fadf50 0x559539fb1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.325+0000 7f10a37fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fae870 0x559539fb2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36430/0 (socket says 172.21.15.73:36430) 2023-08-10T12:01:56.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.325+0000 7f10a37fe700 1 -- 172.21.15.73:0/3828258231 learned_addr learned my addr 172.21.15.73:0/3828258231 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:56.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.325+0000 7f10a2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559539fa8800 0x559539fb4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.325+0000 7f10a37fe700 1 -- 172.21.15.73:0/3828258231 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559539fa8800 msgr2=0x559539fb4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:56.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.325+0000 7f10a37fe700 1 --2- 172.21.15.73:0/3828258231 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559539fa8800 0x559539fb4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.325+0000 7f10a37fe700 1 -- 172.21.15.73:0/3828258231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559539fadf50 msgr2=0x559539fb1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:56.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.325+0000 7f10a37fe700 1 --2- 172.21.15.73:0/3828258231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559539fadf50 0x559539fb1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.325+0000 7f10a37fe700 1 -- 172.21.15.73:0/3828258231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a41a5720 con 0x559539fae870 2023-08-10T12:01:56.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.325+0000 7f10a27fc700 1 --2- 172.21.15.73:0/3828258231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559539fadf50 0x559539fb1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:01:56.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.326+0000 7f10a37fe700 1 --2- 172.21.15.73:0/3828258231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fae870 0x559539fb2370 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f109c011e80 tx=0x7f109c014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7372a9e10e9137 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:56.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.326+0000 7f1082ffd700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:01:56.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.326+0000 7f1082ffd700 1 -- 172.21.15.73:0/3828258231 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c00e040 con 0x559539fae870 2023-08-10T12:01:56.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.326+0000 7f1082ffd700 1 -- 172.21.15.73:0/3828258231 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f109c01a070 con 0x559539fae870 2023-08-10T12:01:56.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.326+0000 7f10b5bd3b80 1 -- 172.21.15.73:0/3828258231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559539f9b470 con 0x559539fae870 2023-08-10T12:01:56.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.326+0000 7f1082ffd700 1 -- 172.21.15.73:0/3828258231 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f109c027460 con 0x559539fae870 2023-08-10T12:01:56.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.326+0000 7f10b5bd3b80 10 client.16911 fetch_fsmap learned FSMap version 55 2023-08-10T12:01:56.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.326+0000 7f10b5bd3b80 1 -- 172.21.15.73:0/3828258231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x559539d26de0 con 0x559539fae870 2023-08-10T12:01:56.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.326+0000 7f1082ffd700 1 -- 172.21.15.73:0/3828258231 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559539f9b470 con 0x559539fae870 2023-08-10T12:01:56.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.326+0000 7f1082ffd700 1 -- 172.21.15.73:0/3828258231 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7f109c016520 con 0x559539fae870 2023-08-10T12:01:56.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.326+0000 7f10b5bd3b80 10 client.16911 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:01:56.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.326+0000 7f10b5bd3b80 10 client.16911 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-08-10T12:01:56.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.326+0000 7f10b5bd3b80 20 client.16911 populate_metadata read hostname 'smithi073' 2023-08-10T12:01:56.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.326+0000 7f10b5bd3b80 1 --2- 172.21.15.73:0/3828258231 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x559539fc24d0 0x559539fc48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.326+0000 7f10b5bd3b80 4 client.16911 mds_command: new command op to 24479 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:01:56.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.326+0000 7f10b5bd3b80 1 -- 172.21.15.73:0/3828258231 --> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559539f779d0 con 0x559539fc24d0 2023-08-10T12:01:56.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.327+0000 7f10a2ffd700 1 --2- 172.21.15.73:0/3828258231 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x559539fc24d0 0x559539fc48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.327+0000 7f1082ffd700 10 client.16911 ms_handle_connect on v2:172.21.15.152:6836/74214089 2023-08-10T12:01:56.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.327+0000 7f10a2ffd700 1 --2- 172.21.15.73:0/3828258231 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x559539fc24d0 0x559539fc48f0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8da45d690d52182f server_cookie=2f2d409a4b246fda in_seq=0 out_seq=0 2023-08-10T12:01:56.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.328+0000 7f1082ffd700 1 -- 172.21.15.73:0/3828258231 <== mds.1 v2:172.21.15.152:6836/74214089 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x559539f779d0 con 0x559539fc24d0 2023-08-10T12:01:56.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.328+0000 7f1082ffd700 10 client.16911 handle_command_reply: tid=0 2023-08-10T12:01:56.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.328+0000 7f10b5bd3b80 1 client.16911 shutdown 2023-08-10T12:01:56.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.328+0000 7f10b5bd3b80 1 -- 172.21.15.73:0/3828258231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fae870 msgr2=0x559539fb2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.328+0000 7f10b5bd3b80 1 --2- 172.21.15.73:0/3828258231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fae870 0x559539fb2370 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f109c011e80 tx=0x7f109c014600 comp rx=0 tx=0).stop 2023-08-10T12:01:56.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.328+0000 7f10b5bd3b80 1 -- 172.21.15.73:0/3828258231 shutdown_connections 2023-08-10T12:01:56.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.328+0000 7f10b5bd3b80 1 --2- 172.21.15.73:0/3828258231 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x559539fc24d0 0x559539fc48f0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.328+0000 7f10b5bd3b80 1 --2- 172.21.15.73:0/3828258231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fae870 0x559539fb2370 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.329+0000 7f1082ffd700 0 client.16911 ms_handle_reset on v2:172.21.15.152:6836/74214089 2023-08-10T12:01:56.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.329+0000 7f10b5bd3b80 1 --2- 172.21.15.73:0/3828258231 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559539fa8800 0x559539fb4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.329+0000 7f10b5bd3b80 1 --2- 172.21.15.73:0/3828258231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559539fadf50 0x559539fb1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.329+0000 7f10b5bd3b80 1 -- 172.21.15.73:0/3828258231 >> 172.21.15.73:0/3828258231 conn(0x559539f05cd0 msgr2=0x559539fa29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:56.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.329+0000 7f10b5bd3b80 1 -- 172.21.15.73:0/3828258231 shutdown_connections 2023-08-10T12:01:56.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.329+0000 7f10b5bd3b80 1 -- 172.21.15.73:0/3828258231 wait complete. 2023-08-10T12:01:56.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.329+0000 7f10b5bd3b80 20 client.16911 trim_cache size 0 max 16384 2023-08-10T12:01:56.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.342+0000 7f10b5bd3b80 1 Processor -- start 2023-08-10T12:01:56.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.342+0000 7f10b5bd3b80 1 -- start start 2023-08-10T12:01:56.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.342+0000 7f10b5bd3b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559539fa8800 0x559539fa82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.342+0000 7f10b5bd3b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fadf50 0x559539fb9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.342+0000 7f10b5bd3b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559539fae870 0x559539fa3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.342+0000 7f10b5bd3b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x559539d7c920 con 0x559539fadf50 2023-08-10T12:01:56.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.342+0000 7f10b5bd3b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x559539f9da80 con 0x559539fa8800 2023-08-10T12:01:56.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.342+0000 7f10b5bd3b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559539fafc60 con 0x559539fae870 2023-08-10T12:01:56.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.342+0000 7f10a27fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fadf50 0x559539fb9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.342+0000 7f10a27fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fadf50 0x559539fb9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36436/0 (socket says 172.21.15.73:36436) 2023-08-10T12:01:56.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.342+0000 7f10a27fc700 1 -- 172.21.15.73:0/1603017320 learned_addr learned my addr 172.21.15.73:0/1603017320 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:56.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.342+0000 7f10a37fe700 1 --2- 172.21.15.73:0/1603017320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559539fae870 0x559539fa3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.342+0000 7f10a2ffd700 1 --2- 172.21.15.73:0/1603017320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559539fa8800 0x559539fa82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.342+0000 7f10a27fc700 1 -- 172.21.15.73:0/1603017320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559539fae870 msgr2=0x559539fa3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:56.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.342+0000 7f10a27fc700 1 --2- 172.21.15.73:0/1603017320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559539fae870 0x559539fa3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.342+0000 7f10a27fc700 1 -- 172.21.15.73:0/1603017320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559539fa8800 msgr2=0x559539fa82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:56.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.342+0000 7f10a27fc700 1 --2- 172.21.15.73:0/1603017320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559539fa8800 0x559539fa82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.342+0000 7f10a27fc700 1 -- 172.21.15.73:0/1603017320 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559539d0fc60 con 0x559539fadf50 2023-08-10T12:01:56.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.342+0000 7f10a37fe700 1 --2- 172.21.15.73:0/1603017320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559539fae870 0x559539fa3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:01:56.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.342+0000 7f10a27fc700 1 --2- 172.21.15.73:0/1603017320 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fadf50 0x559539fb9360 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f1094015000 tx=0x7f109401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1585613579853c6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:56.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.343+0000 7f108a7fc700 1 -- 172.21.15.73:0/1603017320 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109402c070 con 0x559539fadf50 2023-08-10T12:01:56.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.343+0000 7f108a7fc700 1 -- 172.21.15.73:0/1603017320 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f109402d040 con 0x559539fadf50 2023-08-10T12:01:56.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.343+0000 7f108a7fc700 1 -- 172.21.15.73:0/1603017320 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109400f8f0 con 0x559539fadf50 2023-08-10T12:01:56.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.343+0000 7f10b5bd3b80 1 -- 172.21.15.73:0/1603017320 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fadf50 msgr2=0x559539fb9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.343+0000 7f10b5bd3b80 1 --2- 172.21.15.73:0/1603017320 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fadf50 0x559539fb9360 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f1094015000 tx=0x7f109401f000 comp rx=0 tx=0).stop 2023-08-10T12:01:56.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.343+0000 7f10b5bd3b80 1 -- 172.21.15.73:0/1603017320 shutdown_connections 2023-08-10T12:01:56.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.343+0000 7f10b5bd3b80 1 --2- 172.21.15.73:0/1603017320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559539fa8800 0x559539fa82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.343+0000 7f10b5bd3b80 1 --2- 172.21.15.73:0/1603017320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559539fae870 0x559539fa3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.343+0000 7f10b5bd3b80 1 --2- 172.21.15.73:0/1603017320 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fadf50 0x559539fb9360 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.343+0000 7f10b5bd3b80 1 -- 172.21.15.73:0/1603017320 >> 172.21.15.73:0/1603017320 conn(0x559539f05cd0 msgr2=0x559539fabd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:56.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.343+0000 7f10b5bd3b80 1 -- 172.21.15.73:0/1603017320 shutdown_connections 2023-08-10T12:01:56.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.343+0000 7f10b5bd3b80 1 -- 172.21.15.73:0/1603017320 wait complete. 2023-08-10T12:01:56.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.344+0000 7f10b5bd3b80 1 -- start start 2023-08-10T12:01:56.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.344+0000 7f10b5bd3b80 1 Processor -- start 2023-08-10T12:01:56.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.344+0000 7f10b5bd3b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559539fa8800 0x559539fb8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.344+0000 7f10b5bd3b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fadf50 0x559539fb8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.344+0000 7f10b5bd3b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559539fae870 0x55953a015180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.344+0000 7f10b5bd3b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55953a0156c0 con 0x559539fadf50 2023-08-10T12:01:56.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.344+0000 7f10b5bd3b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55953a015800 con 0x559539fae870 2023-08-10T12:01:56.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.344+0000 7f10b5bd3b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55953a015970 con 0x559539fa8800 2023-08-10T12:01:56.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.344+0000 7f10b5bd3b80 10 client.0 _ll_register_callbacks cb 0x559539e96680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:01:56.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.344+0000 7f10a27fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fadf50 0x559539fb8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.344+0000 7f10a2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559539fa8800 0x559539fb8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.344+0000 7f10a27fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fadf50 0x559539fb8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36442/0 (socket says 172.21.15.73:36442) 2023-08-10T12:01:56.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.344+0000 7f10a27fc700 1 -- 172.21.15.73:0/62678077 learned_addr learned my addr 172.21.15.73:0/62678077 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:56.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.344+0000 7f10a37fe700 1 --2- 172.21.15.73:0/62678077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559539fae870 0x55953a015180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.345+0000 7f10a27fc700 1 -- 172.21.15.73:0/62678077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559539fa8800 msgr2=0x559539fb8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:56.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.345+0000 7f10a27fc700 1 --2- 172.21.15.73:0/62678077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559539fa8800 0x559539fb8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.345+0000 7f10a27fc700 1 -- 172.21.15.73:0/62678077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559539fae870 msgr2=0x55953a015180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:56.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.345+0000 7f10a27fc700 1 --2- 172.21.15.73:0/62678077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559539fae870 0x55953a015180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.345+0000 7f10a27fc700 1 -- 172.21.15.73:0/62678077 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559539d26de0 con 0x559539fadf50 2023-08-10T12:01:56.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.345+0000 7f10a2ffd700 1 --2- 172.21.15.73:0/62678077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559539fa8800 0x559539fb8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:01:56.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.345+0000 7f10a37fe700 1 --2- 172.21.15.73:0/62678077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559539fae870 0x55953a015180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T12:01:56.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.345+0000 7f10a27fc700 1 --2- 172.21.15.73:0/62678077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fadf50 0x559539fb8cc0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f10940099c0 tx=0x7f1094004200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a3e844733c34027 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:56.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.345+0000 7f1082ffd700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:01:56.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.345+0000 7f1082ffd700 1 -- 172.21.15.73:0/62678077 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109402c040 con 0x559539fadf50 2023-08-10T12:01:56.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.345+0000 7f1082ffd700 1 -- 172.21.15.73:0/62678077 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f10940045e0 con 0x559539fadf50 2023-08-10T12:01:56.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.345+0000 7f10b5bd3b80 1 -- 172.21.15.73:0/62678077 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1098010880 con 0x559539fadf50 2023-08-10T12:01:56.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.345+0000 7f1082ffd700 1 -- 172.21.15.73:0/62678077 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f109400f870 con 0x559539fadf50 2023-08-10T12:01:56.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.345+0000 7f10b5bd3b80 10 client.16917 fetch_fsmap learned FSMap version 55 2023-08-10T12:01:56.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.345+0000 7f10b5bd3b80 1 -- 172.21.15.73:0/62678077 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x7f10a410cd50 con 0x559539fadf50 2023-08-10T12:01:56.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.345+0000 7f1082ffd700 1 -- 172.21.15.73:0/62678077 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f109404a020 con 0x559539fadf50 2023-08-10T12:01:56.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.346+0000 7f1082ffd700 1 -- 172.21.15.73:0/62678077 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7f1094046aa0 con 0x559539fadf50 2023-08-10T12:01:56.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.346+0000 7f10b5bd3b80 10 client.16917 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:01:56.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.346+0000 7f10b5bd3b80 10 client.16917 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-08-10T12:01:56.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.346+0000 7f10b5bd3b80 20 client.16917 populate_metadata read hostname 'smithi073' 2023-08-10T12:01:56.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.346+0000 7f10b5bd3b80 1 --2- 172.21.15.73:0/62678077 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x559539fc24d0 0x55953a018ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.346+0000 7f10b5bd3b80 4 client.16917 mds_command: new command op to 24479 tid=0[{"prefix": "damage ls"}] 2023-08-10T12:01:56.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.346+0000 7f10b5bd3b80 1 -- 172.21.15.73:0/62678077 --> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559539ef2780 con 0x559539fc24d0 2023-08-10T12:01:56.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.346+0000 7f10a2ffd700 1 --2- 172.21.15.73:0/62678077 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x559539fc24d0 0x55953a018ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.346+0000 7f1082ffd700 10 client.16917 ms_handle_connect on v2:172.21.15.152:6836/74214089 2023-08-10T12:01:56.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.346+0000 7f10a2ffd700 1 --2- 172.21.15.73:0/62678077 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x559539fc24d0 0x55953a018ce0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=579253a3b11a79d5 server_cookie=c79260a517c7bbe5 in_seq=0 out_seq=0 2023-08-10T12:01:56.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.360+0000 7f1082ffd700 1 -- 172.21.15.73:0/62678077 <== mds.1 v2:172.21.15.152:6836/74214089 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+30423 (crc 0 0 0) 0x559539ef2780 con 0x559539fc24d0 2023-08-10T12:01:56.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.360+0000 7f1082ffd700 10 client.16917 handle_command_reply: tid=0 2023-08-10T12:01:56.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.360+0000 7f10b5bd3b80 1 client.16917 shutdown 2023-08-10T12:01:56.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.360+0000 7f10b5bd3b80 1 -- 172.21.15.73:0/62678077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fadf50 msgr2=0x559539fb8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.360+0000 7f10b5bd3b80 1 --2- 172.21.15.73:0/62678077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fadf50 0x559539fb8cc0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f10940099c0 tx=0x7f1094004200 comp rx=0 tx=0).stop 2023-08-10T12:01:56.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.360+0000 7f10b5bd3b80 1 -- 172.21.15.73:0/62678077 shutdown_connections 2023-08-10T12:01:56.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.360+0000 7f10b5bd3b80 1 --2- 172.21.15.73:0/62678077 >> [v2:172.21.15.152:6836/74214089,v1:172.21.15.152:6837/74214089] conn(0x559539fc24d0 0x55953a018ce0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.360+0000 7f10b5bd3b80 1 --2- 172.21.15.73:0/62678077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559539fae870 0x55953a015180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.360+0000 7f10b5bd3b80 1 --2- 172.21.15.73:0/62678077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559539fa8800 0x559539fb8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.360+0000 7f1082ffd700 0 client.16917 ms_handle_reset on v2:172.21.15.152:6836/74214089 2023-08-10T12:01:56.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.360+0000 7f10b5bd3b80 1 --2- 172.21.15.73:0/62678077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559539fadf50 0x559539fb8cc0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.360+0000 7f10b5bd3b80 1 -- 172.21.15.73:0/62678077 >> 172.21.15.73:0/62678077 conn(0x559539f05cd0 msgr2=0x559539faccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:56.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.360+0000 7f10b5bd3b80 1 -- 172.21.15.73:0/62678077 shutdown_connections 2023-08-10T12:01:56.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.360+0000 7f10b5bd3b80 1 -- 172.21.15.73:0/62678077 wait complete. 2023-08-10T12:01:56.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.360+0000 7f10b5bd3b80 20 client.16917 trim_cache size 0 max 16384 2023-08-10T12:01:56.363 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2023-08-10T12:01:56.364 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.364 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.364 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2321553, 2023-08-10T12:01:56.364 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629941, 2023-08-10T12:01:56.364 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-60.xml" 2023-08-10T12:01:56.364 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.365 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.365 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.365 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 38604728, 2023-08-10T12:01:56.365 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629998, 2023-08-10T12:01:56.365 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-3.xml" 2023-08-10T12:01:56.365 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.365 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.365 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.366 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 67308605, 2023-08-10T12:01:56.366 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629954, 2023-08-10T12:01:56.366 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-47.xml" 2023-08-10T12:01:56.366 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.366 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.366 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.366 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 89039763, 2023-08-10T12:01:56.366 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629922, 2023-08-10T12:01:56.367 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-79.xml" 2023-08-10T12:01:56.367 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.367 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.367 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.367 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 115716368, 2023-08-10T12:01:56.367 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629979, 2023-08-10T12:01:56.367 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-22.xml" 2023-08-10T12:01:56.368 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.368 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.368 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.368 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 134379395, 2023-08-10T12:01:56.368 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629944, 2023-08-10T12:01:56.368 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-57.xml" 2023-08-10T12:01:56.368 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.368 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.369 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.369 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 167965261, 2023-08-10T12:01:56.369 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630024, 2023-08-10T12:01:56.369 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-84.xml" 2023-08-10T12:01:56.369 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.369 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.369 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.370 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 193217001, 2023-08-10T12:01:56.370 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629963, 2023-08-10T12:01:56.370 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-38.xml" 2023-08-10T12:01:56.370 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.370 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.370 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.370 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 318907639, 2023-08-10T12:01:56.370 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630014, 2023-08-10T12:01:56.371 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-9.jpg" 2023-08-10T12:01:56.371 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.371 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.371 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.371 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 338005062, 2023-08-10T12:01:56.371 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630013, 2023-08-10T12:01:56.371 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-10.jpg" 2023-08-10T12:01:56.371 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.372 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.372 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.372 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 392832306, 2023-08-10T12:01:56.372 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511627796, 2023-08-10T12:01:56.372 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/process.c" 2023-08-10T12:01:56.372 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.372 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.372 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.373 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 471080179, 2023-08-10T12:01:56.373 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629936, 2023-08-10T12:01:56.373 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-65.xml" 2023-08-10T12:01:56.373 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.373 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.373 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.373 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 479511604, 2023-08-10T12:01:56.374 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629974, 2023-08-10T12:01:56.374 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-27.xml" 2023-08-10T12:01:56.374 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.374 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.374 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.374 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 505276770, 2023-08-10T12:01:56.374 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511628108, 2023-08-10T12:01:56.374 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/mysnprintf.Po" 2023-08-10T12:01:56.375 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.375 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.375 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.375 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 541445611, 2023-08-10T12:01:56.375 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629976, 2023-08-10T12:01:56.375 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-25.xml" 2023-08-10T12:01:56.375 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.375 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.376 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.376 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 593317929, 2023-08-10T12:01:56.376 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629996, 2023-08-10T12:01:56.376 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-5.xml" 2023-08-10T12:01:56.376 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.376 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.376 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.376 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 613572805, 2023-08-10T12:01:56.377 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630019, 2023-08-10T12:01:56.377 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-4.jpg" 2023-08-10T12:01:56.377 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.377 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.377 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.377 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 615182471, 2023-08-10T12:01:56.377 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629942, 2023-08-10T12:01:56.378 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-59.xml" 2023-08-10T12:01:56.378 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.378 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.378 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.378 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 692987401, 2023-08-10T12:01:56.378 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629988, 2023-08-10T12:01:56.378 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-13.xml" 2023-08-10T12:01:56.378 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.379 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.379 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.379 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 711086618, 2023-08-10T12:01:56.379 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629949, 2023-08-10T12:01:56.379 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-52.xml" 2023-08-10T12:01:56.379 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.379 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.379 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.380 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 739216915, 2023-08-10T12:01:56.380 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511628295, 2023-08-10T12:01:56.380 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/mysnprintf.c" 2023-08-10T12:01:56.380 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.380 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.380 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.381 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 748587854, 2023-08-10T12:01:56.381 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629995, 2023-08-10T12:01:56.381 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-6.xml" 2023-08-10T12:01:56.381 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.381 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.381 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.381 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 758141205, 2023-08-10T12:01:56.381 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511631174, 2023-08-10T12:01:56.382 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-7.jpg" 2023-08-10T12:01:56.382 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.382 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.382 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.382 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 801382348, 2023-08-10T12:01:56.382 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629930, 2023-08-10T12:01:56.382 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-71.xml" 2023-08-10T12:01:56.382 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.383 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.383 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.383 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 825947793, 2023-08-10T12:01:56.383 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511627802, 2023-08-10T12:01:56.384 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/helpers.c" 2023-08-10T12:01:56.384 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.384 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.384 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.384 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 837780127, 2023-08-10T12:01:56.384 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511627794, 2023-08-10T12:01:56.384 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/Makefile.am" 2023-08-10T12:01:56.385 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.385 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.385 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.385 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 842829098, 2023-08-10T12:01:56.385 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630026, 2023-08-10T12:01:56.385 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-55.xml" 2023-08-10T12:01:56.385 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.386 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.386 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.386 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 852288089, 2023-08-10T12:01:56.386 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629977, 2023-08-10T12:01:56.386 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-24.xml" 2023-08-10T12:01:56.386 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.386 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.386 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.387 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 890098411, 2023-08-10T12:01:56.387 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511627801, 2023-08-10T12:01:56.387 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/writer.c" 2023-08-10T12:01:56.387 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.387 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.387 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.387 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 960613053, 2023-08-10T12:01:56.387 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511627798, 2023-08-10T12:01:56.388 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/commenter.c" 2023-08-10T12:01:56.388 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.388 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.388 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.388 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 986868525, 2023-08-10T12:01:56.388 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511627787, 2023-08-10T12:01:56.388 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench.c" 2023-08-10T12:01:56.389 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.389 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.389 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.389 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 998918525, 2023-08-10T12:01:56.389 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629993, 2023-08-10T12:01:56.389 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-8.xml" 2023-08-10T12:01:56.389 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.389 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.390 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.390 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1000216008, 2023-08-10T12:01:56.390 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511628627, 2023-08-10T12:01:56.390 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/process.o" 2023-08-10T12:01:56.390 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.390 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.390 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.390 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1050646193, 2023-08-10T12:01:56.391 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511628635, 2023-08-10T12:01:56.391 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/mysnprintf.o" 2023-08-10T12:01:56.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.391 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.391 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.391 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1100420492, 2023-08-10T12:01:56.391 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630005, 2023-08-10T12:01:56.392 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-18.jpg" 2023-08-10T12:01:56.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.392 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.392 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.392 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1134233598, 2023-08-10T12:01:56.392 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630015, 2023-08-10T12:01:56.392 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-8.jpg" 2023-08-10T12:01:56.393 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.393 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.393 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.393 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1175020466, 2023-08-10T12:01:56.393 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629975, 2023-08-10T12:01:56.393 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-26.xml" 2023-08-10T12:01:56.393 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.393 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.394 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.394 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1183059727, 2023-08-10T12:01:56.394 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511628625, 2023-08-10T12:01:56.394 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/blogbench.Po" 2023-08-10T12:01:56.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.394 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.394 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1207631163, 2023-08-10T12:01:56.395 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630012, 2023-08-10T12:01:56.395 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-11.jpg" 2023-08-10T12:01:56.395 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.395 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.395 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.395 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1215650451, 2023-08-10T12:01:56.395 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630008, 2023-08-10T12:01:56.395 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-15.jpg" 2023-08-10T12:01:56.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.396 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.396 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.396 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1276284943, 2023-08-10T12:01:56.396 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629940, 2023-08-10T12:01:56.396 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-61.xml" 2023-08-10T12:01:56.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.397 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.397 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.397 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1294155292, 2023-08-10T12:01:56.397 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630001, 2023-08-10T12:01:56.397 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-22.jpg" 2023-08-10T12:01:56.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.397 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.397 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.398 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1312800310, 2023-08-10T12:01:56.398 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629991, 2023-08-10T12:01:56.398 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-10.xml" 2023-08-10T12:01:56.398 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.398 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.398 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.398 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1328166477, 2023-08-10T12:01:56.398 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629948, 2023-08-10T12:01:56.399 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-53.xml" 2023-08-10T12:01:56.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.399 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.399 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.399 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1393601460, 2023-08-10T12:01:56.399 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511628636, 2023-08-10T12:01:56.399 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench" 2023-08-10T12:01:56.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.400 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.400 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.400 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1406753861, 2023-08-10T12:01:56.400 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511627789, 2023-08-10T12:01:56.400 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/fakesnprintf.c" 2023-08-10T12:01:56.400 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.400 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.401 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.401 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1427059460, 2023-08-10T12:01:56.401 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630161, 2023-08-10T12:01:56.401 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-24.jpg" 2023-08-10T12:01:56.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.401 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.401 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.401 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1453057337, 2023-08-10T12:01:56.402 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629950, 2023-08-10T12:01:56.402 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-51.xml" 2023-08-10T12:01:56.402 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.402 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.402 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.402 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1460250043, 2023-08-10T12:01:56.402 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511628632, 2023-08-10T12:01:56.402 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/helpers.o" 2023-08-10T12:01:56.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.403 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.403 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.403 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1510802497, 2023-08-10T12:01:56.403 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630006, 2023-08-10T12:01:56.403 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-17.jpg" 2023-08-10T12:01:56.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.404 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.404 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.404 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1625526922, 2023-08-10T12:01:56.404 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511628631, 2023-08-10T12:01:56.404 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/commenter.o" 2023-08-10T12:01:56.404 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.404 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.404 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.405 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1645049870, 2023-08-10T12:01:56.405 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630004, 2023-08-10T12:01:56.405 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-19.jpg" 2023-08-10T12:01:56.405 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.405 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.405 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.405 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1746674458, 2023-08-10T12:01:56.405 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629969, 2023-08-10T12:01:56.406 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-32.xml" 2023-08-10T12:01:56.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.406 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.406 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.406 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1851938098, 2023-08-10T12:01:56.406 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511628100, 2023-08-10T12:01:56.406 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/process.Po" 2023-08-10T12:01:56.407 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.407 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.407 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.407 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1855168528, 2023-08-10T12:01:56.407 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629985, 2023-08-10T12:01:56.407 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-16.xml" 2023-08-10T12:01:56.407 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.408 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.408 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.408 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1859026469, 2023-08-10T12:01:56.408 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630021, 2023-08-10T12:01:56.408 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-2.jpg" 2023-08-10T12:01:56.408 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.408 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.408 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.409 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1864624721, 2023-08-10T12:01:56.409 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511627790, 2023-08-10T12:01:56.409 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/fakesnprintf.h" 2023-08-10T12:01:56.409 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.409 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.409 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.409 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1948954232, 2023-08-10T12:01:56.410 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630146, 2023-08-10T12:01:56.410 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-14.xml" 2023-08-10T12:01:56.410 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.410 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.410 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.410 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1950109155, 2023-08-10T12:01:56.410 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629934, 2023-08-10T12:01:56.411 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-67.xml" 2023-08-10T12:01:56.411 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.411 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.411 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.411 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 1973319372, 2023-08-10T12:01:56.411 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511627799, 2023-08-10T12:01:56.411 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/rewriter.c" 2023-08-10T12:01:56.411 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.412 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.412 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.412 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2013204412, 2023-08-10T12:01:56.412 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629947, 2023-08-10T12:01:56.412 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-54.xml" 2023-08-10T12:01:56.412 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.412 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.412 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.413 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2013291872, 2023-08-10T12:01:56.413 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629960, 2023-08-10T12:01:56.413 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-41.xml" 2023-08-10T12:01:56.413 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.413 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.413 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.413 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2025123272, 2023-08-10T12:01:56.413 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511631175, 2023-08-10T12:01:56.414 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-21.xml" 2023-08-10T12:01:56.414 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.414 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.414 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.414 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2028271490, 2023-08-10T12:01:56.414 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511627786, 2023-08-10T12:01:56.414 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/mysnprintf.h" 2023-08-10T12:01:56.415 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.415 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.415 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.415 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2249852930, 2023-08-10T12:01:56.415 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629971, 2023-08-10T12:01:56.415 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-30.xml" 2023-08-10T12:01:56.415 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.415 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.416 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.416 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2251351870, 2023-08-10T12:01:56.416 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630244, 2023-08-10T12:01:56.416 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-60.jpg" 2023-08-10T12:01:56.416 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.416 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.416 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.416 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2267919590, 2023-08-10T12:01:56.417 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629968, 2023-08-10T12:01:56.417 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-33.xml" 2023-08-10T12:01:56.417 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.417 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.417 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.417 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2298149333, 2023-08-10T12:01:56.417 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629951, 2023-08-10T12:01:56.418 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-50.xml" 2023-08-10T12:01:56.418 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.418 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.418 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.418 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2337863903, 2023-08-10T12:01:56.418 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511627793, 2023-08-10T12:01:56.418 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.h" 2023-08-10T12:01:56.418 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.419 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.419 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.419 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2358252178, 2023-08-10T12:01:56.419 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511628623, 2023-08-10T12:01:56.419 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps" 2023-08-10T12:01:56.419 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.420 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.420 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.420 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2359879470, 2023-08-10T12:01:56.420 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630245, 2023-08-10T12:01:56.420 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-46.xml" 2023-08-10T12:01:56.420 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.420 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.421 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.421 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2466864676, 2023-08-10T12:01:56.421 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511628637, 2023-08-10T12:01:56.421 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in" 2023-08-10T12:01:56.421 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.421 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.421 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.421 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2473596878, 2023-08-10T12:01:56.422 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629932, 2023-08-10T12:01:56.422 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-69.xml" 2023-08-10T12:01:56.422 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.422 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.422 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.422 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2505149245, 2023-08-10T12:01:56.422 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511627788, 2023-08-10T12:01:56.422 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench.h" 2023-08-10T12:01:56.423 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.423 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.423 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.423 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2529482199, 2023-08-10T12:01:56.423 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629967, 2023-08-10T12:01:56.423 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-34.xml" 2023-08-10T12:01:56.423 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.424 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.424 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.424 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2530018955, 2023-08-10T12:01:56.424 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629939, 2023-08-10T12:01:56.424 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-62.xml" 2023-08-10T12:01:56.424 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.424 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.424 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.425 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2539615781, 2023-08-10T12:01:56.425 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630011, 2023-08-10T12:01:56.425 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-12.jpg" 2023-08-10T12:01:56.425 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.425 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.425 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.425 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2548347688, 2023-08-10T12:01:56.426 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629972, 2023-08-10T12:01:56.426 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-29.xml" 2023-08-10T12:01:56.426 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.426 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.426 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.426 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2581926007, 2023-08-10T12:01:56.426 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629997, 2023-08-10T12:01:56.427 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-4.xml" 2023-08-10T12:01:56.427 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.427 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.427 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.427 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2588399077, 2023-08-10T12:01:56.427 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630162, 2023-08-10T12:01:56.427 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-81.xml" 2023-08-10T12:01:56.427 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.428 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.428 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.428 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2592915216, 2023-08-10T12:01:56.428 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629943, 2023-08-10T12:01:56.428 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-58.xml" 2023-08-10T12:01:56.428 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.428 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.428 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.429 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2641499867, 2023-08-10T12:01:56.429 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511627792, 2023-08-10T12:01:56.429 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.c" 2023-08-10T12:01:56.429 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.429 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.429 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.429 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2641874001, 2023-08-10T12:01:56.430 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629952, 2023-08-10T12:01:56.430 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-49.xml" 2023-08-10T12:01:56.430 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.430 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.430 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.430 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2653510681, 2023-08-10T12:01:56.430 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629958, 2023-08-10T12:01:56.430 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-43.xml" 2023-08-10T12:01:56.431 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.431 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.431 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.431 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2755287391, 2023-08-10T12:01:56.431 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629927, 2023-08-10T12:01:56.431 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-74.xml" 2023-08-10T12:01:56.431 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.431 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.432 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.432 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2872114540, 2023-08-10T12:01:56.432 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629970, 2023-08-10T12:01:56.432 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-31.xml" 2023-08-10T12:01:56.432 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.432 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.432 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.433 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2872517908, 2023-08-10T12:01:56.433 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630010, 2023-08-10T12:01:56.433 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-13.jpg" 2023-08-10T12:01:56.433 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.433 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.433 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.433 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2901256859, 2023-08-10T12:01:56.433 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629973, 2023-08-10T12:01:56.434 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-28.xml" 2023-08-10T12:01:56.434 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.434 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.434 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.434 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2932406549, 2023-08-10T12:01:56.434 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511627795, 2023-08-10T12:01:56.434 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/Makefile.in" 2023-08-10T12:01:56.434 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.435 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.435 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.435 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2938211946, 2023-08-10T12:01:56.435 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630022, 2023-08-10T12:01:56.435 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-1.jpg" 2023-08-10T12:01:56.435 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.435 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.435 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.436 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2940889399, 2023-08-10T12:01:56.436 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511628101, 2023-08-10T12:01:56.436 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/writer.Po" 2023-08-10T12:01:56.436 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.436 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.436 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.436 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2990637286, 2023-08-10T12:01:56.437 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511628633, 2023-08-10T12:01:56.437 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.o" 2023-08-10T12:01:56.437 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.437 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.437 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.437 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 2992632942, 2023-08-10T12:01:56.437 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629957, 2023-08-10T12:01:56.437 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-44.xml" 2023-08-10T12:01:56.438 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.438 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.438 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.438 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 3054501671, 2023-08-10T12:01:56.438 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629994, 2023-08-10T12:01:56.438 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-7.xml" 2023-08-10T12:01:56.438 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.438 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.439 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.439 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 3058190567, 2023-08-10T12:01:56.439 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511628634, 2023-08-10T12:01:56.439 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/fakesnprintf.o" 2023-08-10T12:01:56.439 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.439 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.439 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.439 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 3097559780, 2023-08-10T12:01:56.440 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511628083, 2023-08-10T12:01:56.440 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/Makefile" 2023-08-10T12:01:56.440 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.440 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.440 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.440 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 3118236289, 2023-08-10T12:01:56.440 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630243, 2023-08-10T12:01:56.440 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-56.xml" 2023-08-10T12:01:56.441 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.441 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.441 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.441 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 3232033304, 2023-08-10T12:01:56.441 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630020, 2023-08-10T12:01:56.441 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-3.jpg" 2023-08-10T12:01:56.441 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.442 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.442 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.442 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 3369949270, 2023-08-10T12:01:56.442 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630017, 2023-08-10T12:01:56.442 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-6.jpg" 2023-08-10T12:01:56.442 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.442 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.442 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.443 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 3491155947, 2023-08-10T12:01:56.443 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630009, 2023-08-10T12:01:56.443 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-14.jpg" 2023-08-10T12:01:56.443 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.443 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.443 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.444 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 3491573216, 2023-08-10T12:01:56.444 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629999, 2023-08-10T12:01:56.444 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-2.xml" 2023-08-10T12:01:56.444 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.444 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.444 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.444 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 3524020540, 2023-08-10T12:01:56.445 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511628629, 2023-08-10T12:01:56.445 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/rewriter.o" 2023-08-10T12:01:56.445 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.445 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.445 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.445 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 3540437827, 2023-08-10T12:01:56.445 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511628106, 2023-08-10T12:01:56.445 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/bsd-getopt_long.Po" 2023-08-10T12:01:56.446 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.446 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.446 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.446 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 3567003328, 2023-08-10T12:01:56.446 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630025, 2023-08-10T12:01:56.446 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-31.jpg" 2023-08-10T12:01:56.446 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.447 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.447 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.447 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 3589143746, 2023-08-10T12:01:56.447 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629983, 2023-08-10T12:01:56.447 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-18.xml" 2023-08-10T12:01:56.447 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.447 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.447 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.448 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 3600012807, 2023-08-10T12:01:56.448 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511627800, 2023-08-10T12:01:56.448 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/reader.c" 2023-08-10T12:01:56.448 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.448 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.448 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.448 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 3601339684, 2023-08-10T12:01:56.449 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511628105, 2023-08-10T12:01:56.449 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/helpers.Po" 2023-08-10T12:01:56.449 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.449 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.449 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.449 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 3605772340, 2023-08-10T12:01:56.449 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511627797, 2023-08-10T12:01:56.449 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/globals.h" 2023-08-10T12:01:56.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.450 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.450 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.450 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 3724210511, 2023-08-10T12:01:56.450 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511628630, 2023-08-10T12:01:56.450 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/reader.o" 2023-08-10T12:01:56.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.450 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.451 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.451 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 3727481397, 2023-08-10T12:01:56.451 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629992, 2023-08-10T12:01:56.451 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-9.xml" 2023-08-10T12:01:56.451 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.451 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.451 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.451 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 3738605286, 2023-08-10T12:01:56.452 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511628103, 2023-08-10T12:01:56.452 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/reader.Po" 2023-08-10T12:01:56.452 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.452 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.452 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.452 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 3765716149, 2023-08-10T12:01:56.452 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511628626, 2023-08-10T12:01:56.453 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench.o" 2023-08-10T12:01:56.453 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.453 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.453 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.453 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 3768814974, 2023-08-10T12:01:56.453 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629990, 2023-08-10T12:01:56.453 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-11.xml" 2023-08-10T12:01:56.453 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.454 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.454 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.454 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 3809544164, 2023-08-10T12:01:56.454 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511628628, 2023-08-10T12:01:56.454 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/writer.o" 2023-08-10T12:01:56.454 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.454 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.455 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.455 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 3842497782, 2023-08-10T12:01:56.455 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629953, 2023-08-10T12:01:56.455 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-48.xml" 2023-08-10T12:01:56.455 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.455 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.455 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.455 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 3904623531, 2023-08-10T12:01:56.456 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630018, 2023-08-10T12:01:56.456 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-5.jpg" 2023-08-10T12:01:56.456 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.456 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.456 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.456 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 3914675679, 2023-08-10T12:01:56.456 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629925, 2023-08-10T12:01:56.456 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-76.xml" 2023-08-10T12:01:56.457 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.457 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.457 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.457 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 3988867388, 2023-08-10T12:01:56.457 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511628107, 2023-08-10T12:01:56.457 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/fakesnprintf.Po" 2023-08-10T12:01:56.457 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.458 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.458 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.458 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4009454723, 2023-08-10T12:01:56.458 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629923, 2023-08-10T12:01:56.458 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-78.xml" 2023-08-10T12:01:56.458 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.458 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.458 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.459 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4026433277, 2023-08-10T12:01:56.459 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629981, 2023-08-10T12:01:56.459 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-20.xml" 2023-08-10T12:01:56.459 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.459 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.459 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.459 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4028427876, 2023-08-10T12:01:56.459 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629933, 2023-08-10T12:01:56.460 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-68.xml" 2023-08-10T12:01:56.460 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.460 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.460 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.460 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4131159781, 2023-08-10T12:01:56.460 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511627791, 2023-08-10T12:01:56.460 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench_p.h" 2023-08-10T12:01:56.461 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.461 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.461 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.461 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4179047951, 2023-08-10T12:01:56.461 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511630242, 2023-08-10T12:01:56.461 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-68.jpg" 2023-08-10T12:01:56.461 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.461 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.462 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.462 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4216365512, 2023-08-10T12:01:56.462 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511629931, 2023-08-10T12:01:56.462 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-70.xml" 2023-08-10T12:01:56.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.462 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.462 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.462 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4222377910, 2023-08-10T12:01:56.463 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511628102, 2023-08-10T12:01:56.463 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/rewriter.Po" 2023-08-10T12:01:56.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:01:56.463 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:01:56.463 INFO:teuthology.orchestra.run.smithi073.stdout: "damage_type": "backtrace", 2023-08-10T12:01:56.463 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4254639852, 2023-08-10T12:01:56.463 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 1099511628104, 2023-08-10T12:01:56.463 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/commenter.Po" 2023-08-10T12:01:56.464 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:01:56.464 INFO:teuthology.orchestra.run.smithi073.stdout:] 2023-08-10T12:01:56.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.361+0000 7f10a9a3a700 1 -- 172.21.15.73:0/2871075464 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f108c0a12c0 msgr2=0x7f108c0a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.361+0000 7f10a9a3a700 1 --2- 172.21.15.73:0/2871075464 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f108c0a12c0 0x7f108c0a3780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1094009990 tx=0x7f1094005fb0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.361+0000 7f10a9a3a700 1 -- 172.21.15.73:0/2871075464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10a40ff5d0 msgr2=0x7f10a41953f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.361+0000 7f10a9a3a700 1 --2- 172.21.15.73:0/2871075464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10a40ff5d0 0x7f10a41953f0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f109800e9a0 tx=0x7f109800ecb0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.361+0000 7f10a9a3a700 1 -- 172.21.15.73:0/2871075464 shutdown_connections 2023-08-10T12:01:56.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.361+0000 7f10a9a3a700 1 --2- 172.21.15.73:0/2871075464 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f108c0a12c0 0x7f108c0a3780 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.361+0000 7f10a9a3a700 1 --2- 172.21.15.73:0/2871075464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10a4105690 0x7f10a4195e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.361+0000 7f10a9a3a700 1 --2- 172.21.15.73:0/2871075464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10a40ff5d0 0x7f10a41953f0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.361+0000 7f10a9a3a700 1 --2- 172.21.15.73:0/2871075464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10a40fff90 0x7f10a4195930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.361+0000 7f10a9a3a700 1 -- 172.21.15.73:0/2871075464 >> 172.21.15.73:0/2871075464 conn(0x7f10a40fb0c0 msgr2=0x7f10a40fc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:56.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.361+0000 7f10a9a3a700 1 -- 172.21.15.73:0/2871075464 shutdown_connections 2023-08-10T12:01:56.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.361+0000 7f10a9a3a700 1 -- 172.21.15.73:0/2871075464 wait complete. 2023-08-10T12:01:56.467 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-08-10T12:01:56.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:56 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/2436824257' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T12:01:56.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.603+0000 7fdd13edd700 1 -- 172.21.15.73:0/1414846345 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd0c1045e0 msgr2=0x7fdd0c1049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.603+0000 7fdd13edd700 1 --2- 172.21.15.73:0/1414846345 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd0c1045e0 0x7fdd0c1049c0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fdd08009990 tx=0x7fdd08009ca0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.604+0000 7fdd13edd700 1 -- 172.21.15.73:0/1414846345 shutdown_connections 2023-08-10T12:01:56.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.604+0000 7fdd13edd700 1 --2- 172.21.15.73:0/1414846345 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd0c100760 0x7fdd0c10c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.604+0000 7fdd13edd700 1 --2- 172.21.15.73:0/1414846345 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd0c1045e0 0x7fdd0c1049c0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.604+0000 7fdd13edd700 1 --2- 172.21.15.73:0/1414846345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd0c0ffda0 0x7fdd0c100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.604+0000 7fdd13edd700 1 -- 172.21.15.73:0/1414846345 >> 172.21.15.73:0/1414846345 conn(0x7fdd0c076be0 msgr2=0x7fdd0c0fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:56.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.604+0000 7fdd13edd700 1 -- 172.21.15.73:0/1414846345 shutdown_connections 2023-08-10T12:01:56.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.604+0000 7fdd13edd700 1 -- 172.21.15.73:0/1414846345 wait complete. 2023-08-10T12:01:56.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.604+0000 7fdd13edd700 1 Processor -- start 2023-08-10T12:01:56.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.604+0000 7fdd13edd700 1 -- start start 2023-08-10T12:01:56.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.604+0000 7fdd13edd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd0c0ffda0 0x7fdd0c10ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.604+0000 7fdd13edd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd0c100760 0x7fdd0c10d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.604+0000 7fdd13edd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd0c1045e0 0x7fdd0c1a4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.604+0000 7fdd13edd700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c10dc00 con 0x7fdd0c0ffda0 2023-08-10T12:01:56.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.604+0000 7fdd13edd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c1a4f90 con 0x7fdd0c1045e0 2023-08-10T12:01:56.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.604+0000 7fdd13edd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c1a50d0 con 0x7fdd0c100760 2023-08-10T12:01:56.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.605+0000 7fdd11c79700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd0c0ffda0 0x7fdd0c10ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.605+0000 7fdd11c79700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd0c0ffda0 0x7fdd0c10ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36454/0 (socket says 172.21.15.73:36454) 2023-08-10T12:01:56.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.605+0000 7fdd11c79700 1 -- 172.21.15.73:0/1844644427 learned_addr learned my addr 172.21.15.73:0/1844644427 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:56.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.605+0000 7fdd11478700 1 --2- 172.21.15.73:0/1844644427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd0c100760 0x7fdd0c10d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.605+0000 7fdd1247a700 1 --2- 172.21.15.73:0/1844644427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd0c1045e0 0x7fdd0c1a4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.605+0000 7fdd11c79700 1 -- 172.21.15.73:0/1844644427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd0c100760 msgr2=0x7fdd0c10d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.605+0000 7fdd11c79700 1 --2- 172.21.15.73:0/1844644427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd0c100760 0x7fdd0c10d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.605+0000 7fdd11c79700 1 -- 172.21.15.73:0/1844644427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd0c1045e0 msgr2=0x7fdd0c1a4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.605+0000 7fdd11c79700 1 --2- 172.21.15.73:0/1844644427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd0c1045e0 0x7fdd0c1a4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.605+0000 7fdd11c79700 1 -- 172.21.15.73:0/1844644427 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd080095f0 con 0x7fdd0c0ffda0 2023-08-10T12:01:56.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.605+0000 7fdd11478700 1 --2- 172.21.15.73:0/1844644427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd0c100760 0x7fdd0c10d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:01:56.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.605+0000 7fdd11c79700 1 --2- 172.21.15.73:0/1844644427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd0c0ffda0 0x7fdd0c10ce90 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fdd08005910 tx=0x7fdd08004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:56.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.605+0000 7fdd02ffd700 1 -- 172.21.15.73:0/1844644427 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0801d070 con 0x7fdd0c0ffda0 2023-08-10T12:01:56.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.605+0000 7fdd13edd700 1 -- 172.21.15.73:0/1844644427 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd0c1a52d0 con 0x7fdd0c0ffda0 2023-08-10T12:01:56.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.605+0000 7fdd02ffd700 1 -- 172.21.15.73:0/1844644427 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd08022470 con 0x7fdd0c0ffda0 2023-08-10T12:01:56.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.605+0000 7fdd02ffd700 1 -- 172.21.15.73:0/1844644427 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd08017650 con 0x7fdd0c0ffda0 2023-08-10T12:01:56.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.605+0000 7fdd13edd700 1 -- 172.21.15.73:0/1844644427 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd0c1a5750 con 0x7fdd0c0ffda0 2023-08-10T12:01:56.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.607+0000 7fdd02ffd700 1 -- 172.21.15.73:0/1844644427 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fdd080225e0 con 0x7fdd0c0ffda0 2023-08-10T12:01:56.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.608+0000 7fdd02ffd700 1 --2- 172.21.15.73:0/1844644427 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fdcf80a12c0 0x7fdcf80a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.608+0000 7fdd11478700 1 --2- 172.21.15.73:0/1844644427 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fdcf80a12c0 0x7fdcf80a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.608+0000 7fdd02ffd700 1 -- 172.21.15.73:0/1844644427 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fdd080cded0 con 0x7fdd0c0ffda0 2023-08-10T12:01:56.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.608+0000 7fdd11478700 1 --2- 172.21.15.73:0/1844644427 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fdcf80a12c0 0x7fdcf80a3780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c10e680 tx=0x7fdcfc009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:56.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.609+0000 7fdd20076b80 1 Processor -- start 2023-08-10T12:01:56.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.609+0000 7fdd20076b80 1 -- start start 2023-08-10T12:01:56.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.609+0000 7fdd20076b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c910a00f50 0x55c910a01330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.609+0000 7fdd20076b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c910a01870 0x55c9109fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.609+0000 7fdd20076b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9109fb800 0x55c9109fbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.609+0000 7fdd20076b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c910976dc0 con 0x55c9109fb800 2023-08-10T12:01:56.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.609+0000 7fdd20076b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c910953590 con 0x55c910a01870 2023-08-10T12:01:56.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.609+0000 7fdd20076b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c910950eb0 con 0x55c910a00f50 2023-08-10T12:01:56.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.610+0000 7fdd1247a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9109fb800 0x55c9109fbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.610+0000 7fdd11478700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c910a01870 0x55c9109fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.610+0000 7fdd11c79700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c910a00f50 0x55c910a01330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.610+0000 7fdd1247a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9109fb800 0x55c9109fbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36466/0 (socket says 172.21.15.73:36466) 2023-08-10T12:01:56.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.610+0000 7fdd1247a700 1 -- 172.21.15.73:0/3492091949 learned_addr learned my addr 172.21.15.73:0/3492091949 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:56.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.610+0000 7fdd1247a700 1 -- 172.21.15.73:0/3492091949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c910a00f50 msgr2=0x55c910a01330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:56.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.610+0000 7fdd1247a700 1 --2- 172.21.15.73:0/3492091949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c910a00f50 0x55c910a01330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.610+0000 7fdd1247a700 1 -- 172.21.15.73:0/3492091949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c910a01870 msgr2=0x55c9109fb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:56.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.610+0000 7fdd1247a700 1 --2- 172.21.15.73:0/3492091949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c910a01870 0x55c9109fb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.610+0000 7fdd1247a700 1 -- 172.21.15.73:0/3492091949 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9107cd630 con 0x55c9109fb800 2023-08-10T12:01:56.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.610+0000 7fdd11c79700 1 --2- 172.21.15.73:0/3492091949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c910a00f50 0x55c910a01330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:01:56.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.610+0000 7fdd1247a700 1 --2- 172.21.15.73:0/3492091949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9109fb800 0x55c9109fbc80 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fdd04011600 tx=0x7fdd04009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97df030e0509735f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:56.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.610+0000 7fdcf7fff700 1 -- 172.21.15.73:0/3492091949 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0400e040 con 0x55c9109fb800 2023-08-10T12:01:56.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.610+0000 7fdcf7fff700 1 -- 172.21.15.73:0/3492091949 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd0400f040 con 0x55c9109fb800 2023-08-10T12:01:56.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.610+0000 7fdcf7fff700 1 -- 172.21.15.73:0/3492091949 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd04004760 con 0x55c9109fb800 2023-08-10T12:01:56.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.611+0000 7fdd20076b80 1 -- 172.21.15.73:0/3492091949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9109fb800 msgr2=0x55c9109fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.611+0000 7fdd20076b80 1 --2- 172.21.15.73:0/3492091949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9109fb800 0x55c9109fbc80 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fdd04011600 tx=0x7fdd04009920 comp rx=0 tx=0).stop 2023-08-10T12:01:56.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.611+0000 7fdd20076b80 1 -- 172.21.15.73:0/3492091949 shutdown_connections 2023-08-10T12:01:56.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.611+0000 7fdd20076b80 1 --2- 172.21.15.73:0/3492091949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9109fb800 0x55c9109fbc80 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.611+0000 7fdd20076b80 1 --2- 172.21.15.73:0/3492091949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c910a00f50 0x55c910a01330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.611+0000 7fdd20076b80 1 --2- 172.21.15.73:0/3492091949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c910a01870 0x55c9109fb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.611+0000 7fdd20076b80 1 -- 172.21.15.73:0/3492091949 >> 172.21.15.73:0/3492091949 conn(0x55c910958cd0 msgr2=0x55c9109f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:56.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.611+0000 7fdd20076b80 1 -- 172.21.15.73:0/3492091949 shutdown_connections 2023-08-10T12:01:56.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.611+0000 7fdd20076b80 1 -- 172.21.15.73:0/3492091949 wait complete. 2023-08-10T12:01:56.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.611+0000 7fdd20076b80 1 -- start start 2023-08-10T12:01:56.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.611+0000 7fdd20076b80 1 Processor -- start 2023-08-10T12:01:56.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.612+0000 7fdd20076b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9109fb800 0x55c910a07970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.612+0000 7fdd20076b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c910a00f50 0x55c910a04b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.612+0000 7fdd20076b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c910a01870 0x55c910a05270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.612+0000 7fdd20076b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c91094c7a0 con 0x55c9109fb800 2023-08-10T12:01:56.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.612+0000 7fdd20076b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9108ebac0 con 0x55c910a01870 2023-08-10T12:01:56.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.612+0000 7fdd20076b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9108eb7c0 con 0x55c910a00f50 2023-08-10T12:01:56.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.612+0000 7fdd20076b80 10 client.0 _ll_register_callbacks cb 0x55c9108e9680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:01:56.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.612+0000 7fdd11c79700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9109fb800 0x55c910a07970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.612+0000 7fdd11c79700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9109fb800 0x55c910a07970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36468/0 (socket says 172.21.15.73:36468) 2023-08-10T12:01:56.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.612+0000 7fdd11c79700 1 -- 172.21.15.73:0/1985878446 learned_addr learned my addr 172.21.15.73:0/1985878446 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:56.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.612+0000 7fdd11478700 1 --2- 172.21.15.73:0/1985878446 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c910a00f50 0x55c910a04b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.612+0000 7fdd1247a700 1 --2- 172.21.15.73:0/1985878446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c910a01870 0x55c910a05270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.612+0000 7fdd11c79700 1 -- 172.21.15.73:0/1985878446 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c910a00f50 msgr2=0x55c910a04b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:56.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.612+0000 7fdd11c79700 1 --2- 172.21.15.73:0/1985878446 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c910a00f50 0x55c910a04b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.612+0000 7fdd11c79700 1 -- 172.21.15.73:0/1985878446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c910a01870 msgr2=0x55c910a05270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:56.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.612+0000 7fdd11c79700 1 --2- 172.21.15.73:0/1985878446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c910a01870 0x55c910a05270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.612+0000 7fdd11c79700 1 -- 172.21.15.73:0/1985878446 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd0c1a5750 con 0x55c9109fb800 2023-08-10T12:01:56.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.612+0000 7fdd1247a700 1 --2- 172.21.15.73:0/1985878446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c910a01870 0x55c910a05270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T12:01:56.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.612+0000 7fdd11c79700 1 --2- 172.21.15.73:0/1985878446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9109fb800 0x55c910a07970 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fdd08006010 tx=0x7fdd0809abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd93e598bb411d00 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:56.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.612+0000 7fdcf57fa700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:01:56.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.612+0000 7fdcf57fa700 1 -- 172.21.15.73:0/1985878446 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd080b2070 con 0x55c9109fb800 2023-08-10T12:01:56.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.613+0000 7fdcf57fa700 1 -- 172.21.15.73:0/1985878446 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fdd0809b030 con 0x55c9109fb800 2023-08-10T12:01:56.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.613+0000 7fdd20076b80 1 -- 172.21.15.73:0/1985878446 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c9109ee470 con 0x55c9109fb800 2023-08-10T12:01:56.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.613+0000 7fdcf57fa700 1 -- 172.21.15.73:0/1985878446 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd0809f060 con 0x55c9109fb800 2023-08-10T12:01:56.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.613+0000 7fdd20076b80 10 client.16929 fetch_fsmap learned FSMap version 55 2023-08-10T12:01:56.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.613+0000 7fdd20076b80 1 -- 172.21.15.73:0/1985878446 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x7fdd040112b0 con 0x55c9109fb800 2023-08-10T12:01:56.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.613+0000 7fdcf57fa700 1 -- 172.21.15.73:0/1985878446 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd080c9080 con 0x55c9109fb800 2023-08-10T12:01:56.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.613+0000 7fdcf57fa700 1 -- 172.21.15.73:0/1985878446 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7fdd080a2f60 con 0x55c9109fb800 2023-08-10T12:01:56.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.613+0000 7fdd20076b80 10 client.16929 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:01:56.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.613+0000 7fdd20076b80 10 client.16929 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T12:01:56.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.613+0000 7fdd20076b80 20 client.16929 populate_metadata read hostname 'smithi073' 2023-08-10T12:01:56.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.613+0000 7fdd20076b80 1 --2- 172.21.15.73:0/1985878446 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c910a14ee0 0x55c910a17300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.613+0000 7fdd20076b80 4 client.16929 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:01:56.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.613+0000 7fdd20076b80 1 -- 172.21.15.73:0/1985878446 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c9109ca9d0 con 0x55c910a14ee0 2023-08-10T12:01:56.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.615+0000 7fdd11478700 1 --2- 172.21.15.73:0/1985878446 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c910a14ee0 0x55c910a17300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.616+0000 7fdd11478700 1 --2- 172.21.15.73:0/1985878446 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c910a14ee0 0x55c910a17300 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=326531fbd9d51dd6 server_cookie=d4370da983eb19aa in_seq=0 out_seq=0 2023-08-10T12:01:56.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.616+0000 7fdcf57fa700 10 client.16929 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:56.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.617+0000 7fdcf57fa700 1 -- 172.21.15.73:0/1985878446 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55c9109ca9d0 con 0x55c910a14ee0 2023-08-10T12:01:56.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.617+0000 7fdcf57fa700 10 client.16929 handle_command_reply: tid=0 2023-08-10T12:01:56.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.617+0000 7fdd20076b80 1 client.16929 shutdown 2023-08-10T12:01:56.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.619+0000 7fdd20076b80 1 -- 172.21.15.73:0/1985878446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9109fb800 msgr2=0x55c910a07970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.619+0000 7fdd20076b80 1 --2- 172.21.15.73:0/1985878446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9109fb800 0x55c910a07970 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fdd08006010 tx=0x7fdd0809abf0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.619+0000 7fdd20076b80 1 -- 172.21.15.73:0/1985878446 shutdown_connections 2023-08-10T12:01:56.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.619+0000 7fdd20076b80 1 --2- 172.21.15.73:0/1985878446 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c910a14ee0 0x55c910a17300 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.619+0000 7fdd20076b80 1 --2- 172.21.15.73:0/1985878446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c910a01870 0x55c910a05270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.619+0000 7fdd20076b80 1 --2- 172.21.15.73:0/1985878446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9109fb800 0x55c910a07970 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.619+0000 7fdd20076b80 1 --2- 172.21.15.73:0/1985878446 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c910a00f50 0x55c910a04b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.619+0000 7fdd20076b80 1 -- 172.21.15.73:0/1985878446 >> 172.21.15.73:0/1985878446 conn(0x55c910958cd0 msgr2=0x55c9109f59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:56.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.619+0000 7fdcf57fa700 0 client.16929 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:56.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.619+0000 7fdd20076b80 1 -- 172.21.15.73:0/1985878446 shutdown_connections 2023-08-10T12:01:56.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.619+0000 7fdd20076b80 1 -- 172.21.15.73:0/1985878446 wait complete. 2023-08-10T12:01:56.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.619+0000 7fdd20076b80 20 client.16929 trim_cache size 0 max 16384 2023-08-10T12:01:56.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.638+0000 7fdd20076b80 1 Processor -- start 2023-08-10T12:01:56.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.639+0000 7fdd20076b80 1 -- start start 2023-08-10T12:01:56.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.639+0000 7fdd20076b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c9109fb800 0x55c910a0c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.639+0000 7fdd20076b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c910a00f50 0x55c910a00290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.639+0000 7fdd20076b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c910a01870 0x55c9109f6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.639+0000 7fdd20076b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9107cf920 con 0x55c910a00f50 2023-08-10T12:01:56.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.639+0000 7fdd20076b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9109f6a60 con 0x55c9109fb800 2023-08-10T12:01:56.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.639+0000 7fdd20076b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9109edfb0 con 0x55c910a01870 2023-08-10T12:01:56.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.639+0000 7fdd11478700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c910a00f50 0x55c910a00290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.639+0000 7fdd11478700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c910a00f50 0x55c910a00290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36478/0 (socket says 172.21.15.73:36478) 2023-08-10T12:01:56.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.639+0000 7fdd11478700 1 -- 172.21.15.73:0/3117131330 learned_addr learned my addr 172.21.15.73:0/3117131330 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:56.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.639+0000 7fdd11c79700 1 --2- 172.21.15.73:0/3117131330 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c9109fb800 0x55c910a0c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.639+0000 7fdd1247a700 1 --2- 172.21.15.73:0/3117131330 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c910a01870 0x55c9109f6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.642 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:56 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/2436824257' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T12:01:56.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.639+0000 7fdd11478700 1 -- 172.21.15.73:0/3117131330 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c910a01870 msgr2=0x55c9109f6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:56.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.639+0000 7fdd11478700 1 --2- 172.21.15.73:0/3117131330 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c910a01870 0x55c9109f6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.639+0000 7fdd11478700 1 -- 172.21.15.73:0/3117131330 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c9109fb800 msgr2=0x55c910a0c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:56.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.639+0000 7fdd11478700 1 --2- 172.21.15.73:0/3117131330 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c9109fb800 0x55c910a0c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.639+0000 7fdd11478700 1 -- 172.21.15.73:0/3117131330 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9109f26a0 con 0x55c910a00f50 2023-08-10T12:01:56.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.639+0000 7fdd11478700 1 --2- 172.21.15.73:0/3117131330 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c910a00f50 0x55c910a00290 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc011bb0 tx=0x7fdcfc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66b0a8939555e6b7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:56.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.640+0000 7fdd00ff9700 1 -- 172.21.15.73:0/3117131330 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc024070 con 0x55c910a00f50 2023-08-10T12:01:56.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.640+0000 7fdd00ff9700 1 -- 172.21.15.73:0/3117131330 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdcfc025040 con 0x55c910a00f50 2023-08-10T12:01:56.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.640+0000 7fdd00ff9700 1 -- 172.21.15.73:0/3117131330 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc028670 con 0x55c910a00f50 2023-08-10T12:01:56.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.641+0000 7fdd20076b80 1 -- 172.21.15.73:0/3117131330 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c910a00f50 msgr2=0x55c910a00290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.641+0000 7fdd20076b80 1 --2- 172.21.15.73:0/3117131330 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c910a00f50 0x55c910a00290 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc011bb0 tx=0x7fdcfc014000 comp rx=0 tx=0).stop 2023-08-10T12:01:56.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.641+0000 7fdd20076b80 1 -- 172.21.15.73:0/3117131330 shutdown_connections 2023-08-10T12:01:56.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.641+0000 7fdd20076b80 1 --2- 172.21.15.73:0/3117131330 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c9109fb800 0x55c910a0c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.641+0000 7fdd20076b80 1 --2- 172.21.15.73:0/3117131330 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c910a01870 0x55c9109f6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.641+0000 7fdd20076b80 1 --2- 172.21.15.73:0/3117131330 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c910a00f50 0x55c910a00290 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.641+0000 7fdd20076b80 1 -- 172.21.15.73:0/3117131330 >> 172.21.15.73:0/3117131330 conn(0x55c910958cd0 msgr2=0x55c9109ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:56.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.641+0000 7fdd20076b80 1 -- 172.21.15.73:0/3117131330 shutdown_connections 2023-08-10T12:01:56.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.641+0000 7fdd20076b80 1 -- 172.21.15.73:0/3117131330 wait complete. 2023-08-10T12:01:56.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.641+0000 7fdd20076b80 1 -- start start 2023-08-10T12:01:56.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.641+0000 7fdd20076b80 1 Processor -- start 2023-08-10T12:01:56.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.642+0000 7fdd20076b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9109fb800 0x55c9109fdad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.642+0000 7fdd20076b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c910a00f50 0x55c9109fe010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.642+0000 7fdd20076b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c910a01870 0x55c9109fc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.642+0000 7fdd20076b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9109fceb0 con 0x55c9109fb800 2023-08-10T12:01:56.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.642+0000 7fdd20076b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9109fd020 con 0x55c910a01870 2023-08-10T12:01:56.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.642+0000 7fdd20076b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9109fd1e0 con 0x55c910a00f50 2023-08-10T12:01:56.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.642+0000 7fdd20076b80 10 client.0 _ll_register_callbacks cb 0x55c9108e9680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:01:56.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.642+0000 7fdd11c79700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9109fb800 0x55c9109fdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.642+0000 7fdd11c79700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9109fb800 0x55c9109fdad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36482/0 (socket says 172.21.15.73:36482) 2023-08-10T12:01:56.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.642+0000 7fdd11c79700 1 -- 172.21.15.73:0/3419889037 learned_addr learned my addr 172.21.15.73:0/3419889037 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:01:56.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.642+0000 7fdd11c79700 1 -- 172.21.15.73:0/3419889037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c910a00f50 msgr2=0x55c9109fe010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T12:01:56.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.642+0000 7fdd11c79700 1 --2- 172.21.15.73:0/3419889037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c910a00f50 0x55c9109fe010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.642+0000 7fdd11c79700 1 -- 172.21.15.73:0/3419889037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c910a01870 msgr2=0x55c9109fc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:01:56.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.642+0000 7fdd11c79700 1 --2- 172.21.15.73:0/3419889037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c910a01870 0x55c9109fc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.642+0000 7fdd11c79700 1 -- 172.21.15.73:0/3419889037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcfc017070 con 0x55c9109fb800 2023-08-10T12:01:56.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.642+0000 7fdd11c79700 1 --2- 172.21.15.73:0/3419889037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9109fb800 0x55c9109fdad0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fdd08097aa0 tx=0x7fdd08009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74c274ed42340fc server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:01:56.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.642+0000 7fdcf57fa700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:01:56.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.643+0000 7fdcf57fa700 1 -- 172.21.15.73:0/3419889037 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd080b2070 con 0x55c9109fb800 2023-08-10T12:01:56.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.643+0000 7fdcf57fa700 1 -- 172.21.15.73:0/3419889037 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fdd080ca060 con 0x55c9109fb800 2023-08-10T12:01:56.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.643+0000 7fdd20076b80 1 -- 172.21.15.73:0/3419889037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdd0400f040 con 0x55c9109fb800 2023-08-10T12:01:56.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.643+0000 7fdcf57fa700 1 -- 172.21.15.73:0/3419889037 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd080971c0 con 0x55c9109fb800 2023-08-10T12:01:56.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.643+0000 7fdd20076b80 10 client.16935 fetch_fsmap learned FSMap version 55 2023-08-10T12:01:56.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.643+0000 7fdd20076b80 1 -- 172.21.15.73:0/3419889037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55c910779de0 con 0x55c9109fb800 2023-08-10T12:01:56.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.643+0000 7fdcf57fa700 1 -- 172.21.15.73:0/3419889037 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd0400f040 con 0x55c9109fb800 2023-08-10T12:01:56.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.643+0000 7fdcf57fa700 1 -- 172.21.15.73:0/3419889037 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7fdd080cb280 con 0x55c9109fb800 2023-08-10T12:01:56.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.643+0000 7fdd20076b80 10 client.16935 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:01:56.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.643+0000 7fdd20076b80 10 client.16935 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T12:01:56.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.643+0000 7fdd20076b80 20 client.16935 populate_metadata read hostname 'smithi073' 2023-08-10T12:01:56.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.643+0000 7fdd20076b80 1 --2- 172.21.15.73:0/3419889037 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c910a69770 0x55c910a6bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:01:56.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.643+0000 7fdd20076b80 4 client.16935 mds_command: new command op to 24503 tid=0[{"prefix": "damage ls"}] 2023-08-10T12:01:56.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.643+0000 7fdd20076b80 1 -- 172.21.15.73:0/3419889037 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c910945780 con 0x55c910a69770 2023-08-10T12:01:56.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.644+0000 7fdd11478700 1 --2- 172.21.15.73:0/3419889037 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c910a69770 0x55c910a6bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:01:56.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.644+0000 7fdcf57fa700 10 client.16935 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:56.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.644+0000 7fdd11478700 1 --2- 172.21.15.73:0/3419889037 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c910a69770 0x55c910a6bb90 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dd588d144bdd5d9 server_cookie=3d6ea1d85ecd5465 in_seq=0 out_seq=0 2023-08-10T12:01:56.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.644+0000 7fdcf57fa700 1 -- 172.21.15.73:0/3419889037 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c910945780 con 0x55c910a69770 2023-08-10T12:01:56.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.644+0000 7fdcf57fa700 10 client.16935 handle_command_reply: tid=0 2023-08-10T12:01:56.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.644+0000 7fdd20076b80 1 client.16935 shutdown 2023-08-10T12:01:56.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.644+0000 7fdd20076b80 1 -- 172.21.15.73:0/3419889037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9109fb800 msgr2=0x55c9109fdad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.644+0000 7fdd20076b80 1 --2- 172.21.15.73:0/3419889037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9109fb800 0x55c9109fdad0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fdd08097aa0 tx=0x7fdd08009ca0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.644+0000 7fdd20076b80 1 -- 172.21.15.73:0/3419889037 shutdown_connections 2023-08-10T12:01:56.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.644+0000 7fdd20076b80 1 --2- 172.21.15.73:0/3419889037 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55c910a69770 0x55c910a6bb90 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.645+0000 7fdd20076b80 1 --2- 172.21.15.73:0/3419889037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c910a01870 0x55c9109fc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.645+0000 7fdcf57fa700 0 client.16935 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:01:56.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.645+0000 7fdd20076b80 1 --2- 172.21.15.73:0/3419889037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c9109fb800 0x55c9109fdad0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.645+0000 7fdd20076b80 1 --2- 172.21.15.73:0/3419889037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c910a00f50 0x55c9109fe010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.645+0000 7fdd20076b80 1 -- 172.21.15.73:0/3419889037 >> 172.21.15.73:0/3419889037 conn(0x55c910958cd0 msgr2=0x55c910a00410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:56.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.645+0000 7fdd20076b80 1 -- 172.21.15.73:0/3419889037 shutdown_connections 2023-08-10T12:01:56.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.645+0000 7fdd20076b80 1 -- 172.21.15.73:0/3419889037 wait complete. 2023-08-10T12:01:56.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.645+0000 7fdd20076b80 20 client.16935 trim_cache size 0 max 16384 2023-08-10T12:01:56.656 INFO:teuthology.orchestra.run.smithi073.stdout:[] 2023-08-10T12:01:56.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.648+0000 7fdd13edd700 1 -- 172.21.15.73:0/1844644427 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fdcf80a12c0 msgr2=0x7fdcf80a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.648+0000 7fdd13edd700 1 --2- 172.21.15.73:0/1844644427 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fdcf80a12c0 0x7fdcf80a3780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c10e680 tx=0x7fdcfc009260 comp rx=0 tx=0).stop 2023-08-10T12:01:56.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.648+0000 7fdd13edd700 1 -- 172.21.15.73:0/1844644427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd0c0ffda0 msgr2=0x7fdd0c10ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:01:56.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.648+0000 7fdd13edd700 1 --2- 172.21.15.73:0/1844644427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd0c0ffda0 0x7fdd0c10ce90 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fdd08005910 tx=0x7fdd08004710 comp rx=0 tx=0).stop 2023-08-10T12:01:56.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.648+0000 7fdd13edd700 1 -- 172.21.15.73:0/1844644427 shutdown_connections 2023-08-10T12:01:56.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.648+0000 7fdd13edd700 1 --2- 172.21.15.73:0/1844644427 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fdcf80a12c0 0x7fdcf80a3780 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.648+0000 7fdd13edd700 1 --2- 172.21.15.73:0/1844644427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd0c1045e0 0x7fdd0c1a4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.648+0000 7fdd13edd700 1 --2- 172.21.15.73:0/1844644427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd0c0ffda0 0x7fdd0c10ce90 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.648+0000 7fdd13edd700 1 --2- 172.21.15.73:0/1844644427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd0c100760 0x7fdd0c10d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:01:56.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.648+0000 7fdd13edd700 1 -- 172.21.15.73:0/1844644427 >> 172.21.15.73:0/1844644427 conn(0x7fdd0c076be0 msgr2=0x7fdd0c102b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:01:56.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.648+0000 7fdd13edd700 1 -- 172.21.15.73:0/1844644427 shutdown_connections 2023-08-10T12:01:56.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:01:56.648+0000 7fdd13edd700 1 -- 172.21.15.73:0/1844644427 wait complete. 2023-08-10T12:01:56.666 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 2321553, 'ino': 1099511629941, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-60.xml'}, {'damage_type': 'backtrace', 'id': 38604728, 'ino': 1099511629998, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-3.xml'}, {'damage_type': 'backtrace', 'id': 67308605, 'ino': 1099511629954, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-47.xml'}, {'damage_type': 'backtrace', 'id': 89039763, 'ino': 1099511629922, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-79.xml'}, {'damage_type': 'backtrace', 'id': 115716368, 'ino': 1099511629979, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-22.xml'}, {'damage_type': 'backtrace', 'id': 134379395, 'ino': 1099511629944, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-57.xml'}, {'damage_type': 'backtrace', 'id': 167965261, 'ino': 1099511630024, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-84.xml'}, {'damage_type': 'backtrace', 'id': 193217001, 'ino': 1099511629963, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-38.xml'}, {'damage_type': 'backtrace', 'id': 318907639, 'ino': 1099511630014, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 338005062, 'ino': 1099511630013, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 392832306, 'ino': 1099511627796, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/process.c'}, {'damage_type': 'backtrace', 'id': 471080179, 'ino': 1099511629936, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-65.xml'}, {'damage_type': 'backtrace', 'id': 479511604, 'ino': 1099511629974, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-27.xml'}, {'damage_type': 'backtrace', 'id': 505276770, 'ino': 1099511628108, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/mysnprintf.Po'}, {'damage_type': 'backtrace', 'id': 541445611, 'ino': 1099511629976, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-25.xml'}, {'damage_type': 'backtrace', 'id': 593317929, 'ino': 1099511629996, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-5.xml'}, {'damage_type': 'backtrace', 'id': 613572805, 'ino': 1099511630019, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 615182471, 'ino': 1099511629942, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-59.xml'}, {'damage_type': 'backtrace', 'id': 692987401, 'ino': 1099511629988, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-13.xml'}, {'damage_type': 'backtrace', 'id': 711086618, 'ino': 1099511629949, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-52.xml'}, {'damage_type': 'backtrace', 'id': 739216915, 'ino': 1099511628295, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/mysnprintf.c'}, {'damage_type': 'backtrace', 'id': 748587854, 'ino': 1099511629995, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-6.xml'}, {'damage_type': 'backtrace', 'id': 758141205, 'ino': 1099511631174, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 801382348, 'ino': 1099511629930, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-71.xml'}, {'damage_type': 'backtrace', 'id': 825947793, 'ino': 1099511627802, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/helpers.c'}, {'damage_type': 'backtrace', 'id': 837780127, 'ino': 1099511627794, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/Makefile.am'}, {'damage_type': 'backtrace', 'id': 842829098, 'ino': 1099511630026, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-55.xml'}, {'damage_type': 'backtrace', 'id': 852288089, 'ino': 1099511629977, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-24.xml'}, {'damage_type': 'backtrace', 'id': 890098411, 'ino': 1099511627801, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/writer.c'}, {'damage_type': 'backtrace', 'id': 960613053, 'ino': 1099511627798, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/commenter.c'}, {'damage_type': 'backtrace', 'id': 986868525, 'ino': 1099511627787, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench.c'}, {'damage_type': 'backtrace', 'id': 998918525, 'ino': 1099511629993, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-8.xml'}, {'damage_type': 'backtrace', 'id': 1000216008, 'ino': 1099511628627, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/process.o'}, {'damage_type': 'backtrace', 'id': 1050646193, 'ino': 1099511628635, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/mysnprintf.o'}, {'damage_type': 'backtrace', 'id': 1100420492, 'ino': 1099511630005, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 1134233598, 'ino': 1099511630015, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 1175020466, 'ino': 1099511629975, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-26.xml'}, {'damage_type': 'backtrace', 'id': 1183059727, 'ino': 1099511628625, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/blogbench.Po'}, {'damage_type': 'backtrace', 'id': 1207631163, 'ino': 1099511630012, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 1215650451, 'ino': 1099511630008, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 1276284943, 'ino': 1099511629940, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-61.xml'}, {'damage_type': 'backtrace', 'id': 1294155292, 'ino': 1099511630001, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 1312800310, 'ino': 1099511629991, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-10.xml'}, {'damage_type': 'backtrace', 'id': 1328166477, 'ino': 1099511629948, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-53.xml'}, {'damage_type': 'backtrace', 'id': 1393601460, 'ino': 1099511628636, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench'}, {'damage_type': 'backtrace', 'id': 1406753861, 'ino': 1099511627789, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/fakesnprintf.c'}, {'damage_type': 'backtrace', 'id': 1427059460, 'ino': 1099511630161, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 1453057337, 'ino': 1099511629950, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-51.xml'}, {'damage_type': 'backtrace', 'id': 1460250043, 'ino': 1099511628632, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/helpers.o'}, {'damage_type': 'backtrace', 'id': 1510802497, 'ino': 1099511630006, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 1625526922, 'ino': 1099511628631, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/commenter.o'}, {'damage_type': 'backtrace', 'id': 1645049870, 'ino': 1099511630004, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 1746674458, 'ino': 1099511629969, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-32.xml'}, {'damage_type': 'backtrace', 'id': 1851938098, 'ino': 1099511628100, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/process.Po'}, {'damage_type': 'backtrace', 'id': 1855168528, 'ino': 1099511629985, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-16.xml'}, {'damage_type': 'backtrace', 'id': 1859026469, 'ino': 1099511630021, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 1864624721, 'ino': 1099511627790, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/fakesnprintf.h'}, {'damage_type': 'backtrace', 'id': 1948954232, 'ino': 1099511630146, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-14.xml'}, {'damage_type': 'backtrace', 'id': 1950109155, 'ino': 1099511629934, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-67.xml'}, {'damage_type': 'backtrace', 'id': 1973319372, 'ino': 1099511627799, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/rewriter.c'}, {'damage_type': 'backtrace', 'id': 2013204412, 'ino': 1099511629947, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-54.xml'}, {'damage_type': 'backtrace', 'id': 2013291872, 'ino': 1099511629960, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-41.xml'}, {'damage_type': 'backtrace', 'id': 2025123272, 'ino': 1099511631175, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-21.xml'}, {'damage_type': 'backtrace', 'id': 2028271490, 'ino': 1099511627786, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/mysnprintf.h'}, {'damage_type': 'backtrace', 'id': 2249852930, 'ino': 1099511629971, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-30.xml'}, {'damage_type': 'backtrace', 'id': 2251351870, 'ino': 1099511630244, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 2267919590, 'ino': 1099511629968, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-33.xml'}, {'damage_type': 'backtrace', 'id': 2298149333, 'ino': 1099511629951, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-50.xml'}, {'damage_type': 'backtrace', 'id': 2337863903, 'ino': 1099511627793, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.h'}, {'damage_type': 'backtrace', 'id': 2358252178, 'ino': 1099511628623, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps'}, {'damage_type': 'backtrace', 'id': 2359879470, 'ino': 1099511630245, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-46.xml'}, {'damage_type': 'backtrace', 'id': 2466864676, 'ino': 1099511628637, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in'}, {'damage_type': 'backtrace', 'id': 2473596878, 'ino': 1099511629932, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-69.xml'}, {'damage_type': 'backtrace', 'id': 2505149245, 'ino': 1099511627788, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench.h'}, {'damage_type': 'backtrace', 'id': 2529482199, 'ino': 1099511629967, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-34.xml'}, {'damage_type': 'backtrace', 'id': 2530018955, 'ino': 1099511629939, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-62.xml'}, {'damage_type': 'backtrace', 'id': 2539615781, 'ino': 1099511630011, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 2548347688, 'ino': 1099511629972, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-29.xml'}, {'damage_type': 'backtrace', 'id': 2581926007, 'ino': 1099511629997, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-4.xml'}, {'damage_type': 'backtrace', 'id': 2588399077, 'ino': 1099511630162, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-81.xml'}, {'damage_type': 'backtrace', 'id': 2592915216, 'ino': 1099511629943, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-58.xml'}, {'damage_type': 'backtrace', 'id': 2641499867, 'ino': 1099511627792, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.c'}, {'damage_type': 'backtrace', 'id': 2641874001, 'ino': 1099511629952, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-49.xml'}, {'damage_type': 'backtrace', 'id': 2653510681, 'ino': 1099511629958, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-43.xml'}, {'damage_type': 'backtrace', 'id': 2755287391, 'ino': 1099511629927, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-74.xml'}, {'damage_type': 'backtrace', 'id': 2872114540, 'ino': 1099511629970, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-31.xml'}, {'damage_type': 'backtrace', 'id': 2872517908, 'ino': 1099511630010, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 2901256859, 'ino': 1099511629973, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-28.xml'}, {'damage_type': 'backtrace', 'id': 2932406549, 'ino': 1099511627795, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/Makefile.in'}, {'damage_type': 'backtrace', 'id': 2938211946, 'ino': 1099511630022, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 2940889399, 'ino': 1099511628101, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/writer.Po'}, {'damage_type': 'backtrace', 'id': 2990637286, 'ino': 1099511628633, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/bsd-getopt_long.o'}, {'damage_type': 'backtrace', 'id': 2992632942, 'ino': 1099511629957, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-44.xml'}, {'damage_type': 'backtrace', 'id': 3054501671, 'ino': 1099511629994, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-7.xml'}, {'damage_type': 'backtrace', 'id': 3058190567, 'ino': 1099511628634, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/fakesnprintf.o'}, {'damage_type': 'backtrace', 'id': 3097559780, 'ino': 1099511628083, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/Makefile'}, {'damage_type': 'backtrace', 'id': 3118236289, 'ino': 1099511630243, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-56.xml'}, {'damage_type': 'backtrace', 'id': 3232033304, 'ino': 1099511630020, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 3369949270, 'ino': 1099511630017, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 3491155947, 'ino': 1099511630009, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 3491573216, 'ino': 1099511629999, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-2.xml'}, {'damage_type': 'backtrace', 'id': 3524020540, 'ino': 1099511628629, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/rewriter.o'}, {'damage_type': 'backtrace', 'id': 3540437827, 'ino': 1099511628106, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/bsd-getopt_long.Po'}, {'damage_type': 'backtrace', 'id': 3567003328, 'ino': 1099511630025, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 3589143746, 'ino': 1099511629983, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-18.xml'}, {'damage_type': 'backtrace', 'id': 3600012807, 'ino': 1099511627800, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/reader.c'}, {'damage_type': 'backtrace', 'id': 3601339684, 'ino': 1099511628105, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/helpers.Po'}, {'damage_type': 'backtrace', 'id': 3605772340, 'ino': 1099511627797, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/globals.h'}, {'damage_type': 'backtrace', 'id': 3724210511, 'ino': 1099511628630, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/reader.o'}, {'damage_type': 'backtrace', 'id': 3727481397, 'ino': 1099511629992, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-9.xml'}, {'damage_type': 'backtrace', 'id': 3738605286, 'ino': 1099511628103, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/reader.Po'}, {'damage_type': 'backtrace', 'id': 3765716149, 'ino': 1099511628626, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench.o'}, {'damage_type': 'backtrace', 'id': 3768814974, 'ino': 1099511629990, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-11.xml'}, {'damage_type': 'backtrace', 'id': 3809544164, 'ino': 1099511628628, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/writer.o'}, {'damage_type': 'backtrace', 'id': 3842497782, 'ino': 1099511629953, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-48.xml'}, {'damage_type': 'backtrace', 'id': 3904623531, 'ino': 1099511630018, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 3914675679, 'ino': 1099511629925, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-76.xml'}, {'damage_type': 'backtrace', 'id': 3988867388, 'ino': 1099511628107, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/fakesnprintf.Po'}, {'damage_type': 'backtrace', 'id': 4009454723, 'ino': 1099511629923, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-78.xml'}, {'damage_type': 'backtrace', 'id': 4026433277, 'ino': 1099511629981, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-20.xml'}, {'damage_type': 'backtrace', 'id': 4028427876, 'ino': 1099511629933, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-68.xml'}, {'damage_type': 'backtrace', 'id': 4131159781, 'ino': 1099511627791, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogbench_p.h'}, {'damage_type': 'backtrace', 'id': 4179047951, 'ino': 1099511630242, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/picture-68.jpg'}, {'damage_type': 'backtrace', 'id': 4216365512, 'ino': 1099511629931, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-11/article-70.xml'}, {'damage_type': 'backtrace', 'id': 4222377910, 'ino': 1099511628102, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/rewriter.Po'}, {'damage_type': 'backtrace', 'id': 4254639852, 'ino': 1099511628104, 'path': '/volumes/_nogroup/sv_1/0b107504-3b45-4e9e-bf20-13a87924d8c8/client.0/tmp/blogbench-1.0/src/.deps/commenter.Po'}] 2023-08-10T12:01:56.667 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/fwd_scrub.py", line 38, in _run File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/fwd_scrub.py", line 55, in do_scrub File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/fwd_scrub.py", line 79, in _scrub File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/fwd_scrub.py", line 90, in _check_damage RuntimeError: rank damage found: {'backtrace'} 2023-08-10T12:01:57.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:57 smithi156 ceph-mon[130574]: pgmap v288: 97 pgs: 97 active+clean; 2.0 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 281 op/s 2023-08-10T12:01:57.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:57 smithi073 ceph-mon[128869]: pgmap v288: 97 pgs: 97 active+clean; 2.0 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 281 op/s 2023-08-10T12:01:57.537 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:57 smithi152 ceph-mon[130220]: pgmap v288: 97 pgs: 97 active+clean; 2.0 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 281 op/s 2023-08-10T12:01:59.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:01:59 smithi156 ceph-mon[130574]: pgmap v289: 97 pgs: 97 active+clean; 2.0 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 238 op/s 2023-08-10T12:01:59.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:01:59 smithi073 ceph-mon[128869]: pgmap v289: 97 pgs: 97 active+clean; 2.0 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 238 op/s 2023-08-10T12:01:59.797 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:01:59 smithi152 ceph-mon[130220]: pgmap v289: 97 pgs: 97 active+clean; 2.0 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 238 op/s 2023-08-10T12:02:01.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:01 smithi152 ceph-mon[130220]: pgmap v290: 97 pgs: 97 active+clean; 2.0 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.8 MiB/s wr, 307 op/s 2023-08-10T12:02:01.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:01 smithi156 ceph-mon[130574]: pgmap v290: 97 pgs: 97 active+clean; 2.0 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.8 MiB/s wr, 307 op/s 2023-08-10T12:02:01.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:01 smithi073 ceph-mon[128869]: pgmap v290: 97 pgs: 97 active+clean; 2.0 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.8 MiB/s wr, 307 op/s 2023-08-10T12:02:03.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:03 smithi152 ceph-mon[130220]: pgmap v291: 97 pgs: 97 active+clean; 2.0 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.1 MiB/s wr, 233 op/s 2023-08-10T12:02:03.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:03 smithi156 ceph-mon[130574]: pgmap v291: 97 pgs: 97 active+clean; 2.0 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.1 MiB/s wr, 233 op/s 2023-08-10T12:02:03.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:03 smithi073 ceph-mon[128869]: pgmap v291: 97 pgs: 97 active+clean; 2.0 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.1 MiB/s wr, 233 op/s 2023-08-10T12:02:04.456 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.454+0000 7f0c0030e700 1 -- 172.21.15.73:0/766947938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0bf8105a40 msgr2=0x7f0bf810d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:04.456 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.454+0000 7f0c0030e700 1 --2- 172.21.15.73:0/766947938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0bf8105a40 0x7f0bf810d650 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000b0d0 tx=0x7f0bf000b3e0 comp rx=0 tx=0).stop 2023-08-10T12:02:04.456 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.455+0000 7f0c0030e700 1 -- 172.21.15.73:0/766947938 shutdown_connections 2023-08-10T12:02:04.456 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.455+0000 7f0c0030e700 1 --2- 172.21.15.73:0/766947938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf80fede0 0x7f0bf80ff1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.455+0000 7f0c0030e700 1 --2- 172.21.15.73:0/766947938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0bf8105a40 0x7f0bf810d650 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.455+0000 7f0c0030e700 1 --2- 172.21.15.73:0/766947938 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bf80ff790 0x7f0bf8105310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.455+0000 7f0c0030e700 1 -- 172.21.15.73:0/766947938 >> 172.21.15.73:0/766947938 conn(0x7f0bf8076b40 msgr2=0x7f0bf80fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:02:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.455+0000 7f0c0030e700 1 -- 172.21.15.73:0/766947938 shutdown_connections 2023-08-10T12:02:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.455+0000 7f0c0030e700 1 -- 172.21.15.73:0/766947938 wait complete. 2023-08-10T12:02:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.455+0000 7f0c0030e700 1 Processor -- start 2023-08-10T12:02:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.455+0000 7f0c0030e700 1 -- start start 2023-08-10T12:02:04.459 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.455+0000 7f0c0030e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bf80fede0 0x7f0bf80fff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:04.459 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.455+0000 7f0c0030e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf8105a40 0x7f0bf8100470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:04.459 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.455+0000 7f0c0030e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0bf81a2a80 0x7f0bf81a4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:04.459 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.455+0000 7f0c0030e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf81a53b0 con 0x7f0bf81a2a80 2023-08-10T12:02:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.455+0000 7f0c0030e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf81a54f0 con 0x7f0bf8105a40 2023-08-10T12:02:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.455+0000 7f0c0030e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf81a5660 con 0x7f0bf80fede0 2023-08-10T12:02:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.456+0000 7f0bfe8ab700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0bf81a2a80 0x7f0bf81a4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.456+0000 7f0bfd8a9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf8105a40 0x7f0bf8100470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.456+0000 7f0bfe8ab700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0bf81a2a80 0x7f0bf81a4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36500/0 (socket says 172.21.15.73:36500) 2023-08-10T12:02:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.456+0000 7f0bfe0aa700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bf80fede0 0x7f0bf80fff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.456+0000 7f0bfd8a9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf8105a40 0x7f0bf8100470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:51148/0 (socket says 172.21.15.73:51148) 2023-08-10T12:02:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.456+0000 7f0bfe8ab700 1 -- 172.21.15.73:0/2669865811 learned_addr learned my addr 172.21.15.73:0/2669865811 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:02:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.456+0000 7f0bfe8ab700 1 -- 172.21.15.73:0/2669865811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bf80fede0 msgr2=0x7f0bf80fff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.456+0000 7f0bfe8ab700 1 --2- 172.21.15.73:0/2669865811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bf80fede0 0x7f0bf80fff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.456+0000 7f0bfe8ab700 1 -- 172.21.15.73:0/2669865811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf8105a40 msgr2=0x7f0bf8100470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.456+0000 7f0bfe8ab700 1 --2- 172.21.15.73:0/2669865811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf8105a40 0x7f0bf8100470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.456+0000 7f0bfe8ab700 1 -- 172.21.15.73:0/2669865811 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf0009d00 con 0x7f0bf81a2a80 2023-08-10T12:02:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.456+0000 7f0bfd8a9700 1 --2- 172.21.15.73:0/2669865811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf8105a40 0x7f0bf8100470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:02:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.456+0000 7f0bfe8ab700 1 --2- 172.21.15.73:0/2669865811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0bf81a2a80 0x7f0bf81a4e70 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0007930 tx=0x7f0bf0007960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:02:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.456+0000 7f0bef7fe700 1 -- 172.21.15.73:0/2669865811 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf000e040 con 0x7f0bf81a2a80 2023-08-10T12:02:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.456+0000 7f0c0030e700 1 -- 172.21.15.73:0/2669865811 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf81a58e0 con 0x7f0bf81a2a80 2023-08-10T12:02:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.456+0000 7f0bef7fe700 1 -- 172.21.15.73:0/2669865811 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0bf001d470 con 0x7f0bf81a2a80 2023-08-10T12:02:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.456+0000 7f0bef7fe700 1 -- 172.21.15.73:0/2669865811 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf00052a0 con 0x7f0bf81a2a80 2023-08-10T12:02:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.456+0000 7f0c0030e700 1 -- 172.21.15.73:0/2669865811 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf81a5d60 con 0x7f0bf81a2a80 2023-08-10T12:02:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.459+0000 7f0bef7fe700 1 -- 172.21.15.73:0/2669865811 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f0bf001d8a0 con 0x7f0bf81a2a80 2023-08-10T12:02:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.459+0000 7f0bef7fe700 1 --2- 172.21.15.73:0/2669865811 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0be40a12c0 0x7f0be40a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.459+0000 7f0bef7fe700 1 -- 172.21.15.73:0/2669865811 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0bf00cdea0 con 0x7f0bf81a2a80 2023-08-10T12:02:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.459+0000 7f0bfe0aa700 1 --2- 172.21.15.73:0/2669865811 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0be40a12c0 0x7f0be40a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:04.468 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.460+0000 7f0bfe0aa700 1 --2- 172.21.15.73:0/2669865811 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0be40a12c0 0x7f0be40a3780 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4009c60 tx=0x7f0bf4009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:02:04.468 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.460+0000 7f0c0c4a7b80 1 Processor -- start 2023-08-10T12:02:04.468 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.460+0000 7f0c0c4a7b80 1 -- start start 2023-08-10T12:02:04.468 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.461+0000 7f0c0c4a7b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 0x557f02e44e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:04.468 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.461+0000 7f0c0c4a7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f02e45360 0x557f02e3f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:04.468 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.461+0000 7f0c0c4a7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557f02e3f550 0x557f02e3f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:04.469 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.461+0000 7f0c0c4a7b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f02dbad60 con 0x557f02e44a40 2023-08-10T12:02:04.469 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.461+0000 7f0c0c4a7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f02d97530 con 0x557f02e45360 2023-08-10T12:02:04.469 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.461+0000 7f0c0c4a7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f02d94e50 con 0x557f02e3f550 2023-08-10T12:02:04.469 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.461+0000 7f0bfe0aa700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 0x557f02e44e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:04.469 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.461+0000 7f0bfe0aa700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 0x557f02e44e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36504/0 (socket says 172.21.15.73:36504) 2023-08-10T12:02:04.469 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.461+0000 7f0bfe0aa700 1 -- 172.21.15.73:0/2527975643 learned_addr learned my addr 172.21.15.73:0/2527975643 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:02:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.461+0000 7f0bfd8a9700 1 --2- 172.21.15.73:0/2527975643 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f02e45360 0x557f02e3f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.461+0000 7f0bfe8ab700 1 --2- 172.21.15.73:0/2527975643 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557f02e3f550 0x557f02e3f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.461+0000 7f0bfe0aa700 1 -- 172.21.15.73:0/2527975643 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557f02e3f550 msgr2=0x557f02e3f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.461+0000 7f0bfe0aa700 1 --2- 172.21.15.73:0/2527975643 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557f02e3f550 0x557f02e3f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.461+0000 7f0bfe0aa700 1 -- 172.21.15.73:0/2527975643 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f02e45360 msgr2=0x557f02e3f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.461+0000 7f0bfe0aa700 1 --2- 172.21.15.73:0/2527975643 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f02e45360 0x557f02e3f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.461+0000 7f0bfe0aa700 1 -- 172.21.15.73:0/2527975643 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f02c115d0 con 0x557f02e44a40 2023-08-10T12:02:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.461+0000 7f0bfe0aa700 1 --2- 172.21.15.73:0/2527975643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 0x557f02e44e20 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400e4e0 tx=0x7f0bf4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=552fd415195b6b0c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:02:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.461+0000 7f0becdaa700 1 -- 172.21.15.73:0/2527975643 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf400ee00 con 0x557f02e44a40 2023-08-10T12:02:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.461+0000 7f0becdaa700 1 -- 172.21.15.73:0/2527975643 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0bf4021070 con 0x557f02e44a40 2023-08-10T12:02:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.461+0000 7f0becdaa700 1 -- 172.21.15.73:0/2527975643 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf401d7b0 con 0x557f02e44a40 2023-08-10T12:02:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.462+0000 7f0c0c4a7b80 1 -- 172.21.15.73:0/2527975643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 msgr2=0x557f02e44e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.462+0000 7f0c0c4a7b80 1 --2- 172.21.15.73:0/2527975643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 0x557f02e44e20 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400e4e0 tx=0x7f0bf4014000 comp rx=0 tx=0).stop 2023-08-10T12:02:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.462+0000 7f0c0c4a7b80 1 -- 172.21.15.73:0/2527975643 shutdown_connections 2023-08-10T12:02:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.462+0000 7f0c0c4a7b80 1 --2- 172.21.15.73:0/2527975643 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557f02e3f550 0x557f02e3f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.462+0000 7f0c0c4a7b80 1 --2- 172.21.15.73:0/2527975643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 0x557f02e44e20 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.462+0000 7f0c0c4a7b80 1 --2- 172.21.15.73:0/2527975643 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f02e45360 0x557f02e3f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.462+0000 7f0c0c4a7b80 1 -- 172.21.15.73:0/2527975643 >> 172.21.15.73:0/2527975643 conn(0x557f02d9cc70 msgr2=0x557f02e39d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:02:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.462+0000 7f0c0c4a7b80 1 -- 172.21.15.73:0/2527975643 shutdown_connections 2023-08-10T12:02:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.462+0000 7f0c0c4a7b80 1 -- 172.21.15.73:0/2527975643 wait complete. 2023-08-10T12:02:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.462+0000 7f0c0c4a7b80 1 -- start start 2023-08-10T12:02:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.463+0000 7f0c0c4a7b80 1 Processor -- start 2023-08-10T12:02:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.463+0000 7f0c0c4a7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f02e3f550 0x557f02e4b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.463+0000 7f0c0c4a7b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 0x557f02e48630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.463+0000 7f0c0c4a7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557f02e45360 0x557f02e48cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.463+0000 7f0c0c4a7b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f02d90740 con 0x557f02e44a40 2023-08-10T12:02:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.463+0000 7f0c0c4a7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f02d2fa60 con 0x557f02e3f550 2023-08-10T12:02:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.463+0000 7f0c0c4a7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f02d2f760 con 0x557f02e45360 2023-08-10T12:02:04.474 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.463+0000 7f0c0c4a7b80 10 client.0 _ll_register_callbacks cb 0x557f02d2d620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:02:04.474 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.463+0000 7f0bfd8a9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 0x557f02e48630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:04.474 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.463+0000 7f0bfd8a9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 0x557f02e48630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36512/0 (socket says 172.21.15.73:36512) 2023-08-10T12:02:04.474 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.463+0000 7f0bfd8a9700 1 -- 172.21.15.73:0/1495892787 learned_addr learned my addr 172.21.15.73:0/1495892787 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:02:04.474 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.463+0000 7f0bfe8ab700 1 --2- 172.21.15.73:0/1495892787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557f02e45360 0x557f02e48cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:04.474 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.463+0000 7f0bfe0aa700 1 --2- 172.21.15.73:0/1495892787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f02e3f550 0x557f02e4b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:04.474 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.463+0000 7f0bfd8a9700 1 -- 172.21.15.73:0/1495892787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557f02e45360 msgr2=0x557f02e48cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:04.475 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.464+0000 7f0bfd8a9700 1 --2- 172.21.15.73:0/1495892787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557f02e45360 0x557f02e48cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:04.475 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.464+0000 7f0bfd8a9700 1 -- 172.21.15.73:0/1495892787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f02e3f550 msgr2=0x557f02e4b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:04.475 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.464+0000 7f0bfd8a9700 1 --2- 172.21.15.73:0/1495892787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f02e3f550 0x557f02e4b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:04.475 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.464+0000 7f0bfd8a9700 1 -- 172.21.15.73:0/1495892787 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf4017070 con 0x557f02e44a40 2023-08-10T12:02:04.475 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.464+0000 7f0bfe8ab700 1 --2- 172.21.15.73:0/1495892787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557f02e45360 0x557f02e48cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:02:04.475 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.464+0000 7f0bfd8a9700 1 --2- 172.21.15.73:0/1495892787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 0x557f02e48630 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f0be8012d00 tx=0x7f0be800f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a056a14eaeb87a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:02:04.475 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.464+0000 7f0be1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:02:04.476 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.464+0000 7f0be1ffb700 1 -- 172.21.15.73:0/1495892787 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8017070 con 0x557f02e44a40 2023-08-10T12:02:04.476 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.464+0000 7f0be1ffb700 1 -- 172.21.15.73:0/1495892787 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0be800fc30 con 0x557f02e44a40 2023-08-10T12:02:04.476 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.464+0000 7f0c0c4a7b80 1 -- 172.21.15.73:0/1495892787 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557f02e321c0 con 0x557f02e44a40 2023-08-10T12:02:04.476 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.464+0000 7f0be1ffb700 1 -- 172.21.15.73:0/1495892787 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0be800fdf0 con 0x557f02e44a40 2023-08-10T12:02:04.476 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.464+0000 7f0c0c4a7b80 10 client.16947 fetch_fsmap learned FSMap version 55 2023-08-10T12:02:04.476 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.464+0000 7f0c0c4a7b80 1 -- 172.21.15.73:0/1495892787 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x557f02bbdd80 con 0x557f02e44a40 2023-08-10T12:02:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.464+0000 7f0be1ffb700 1 -- 172.21.15.73:0/1495892787 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557f02e321c0 con 0x557f02e44a40 2023-08-10T12:02:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.464+0000 7f0be1ffb700 1 -- 172.21.15.73:0/1495892787 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7f0be8003c80 con 0x557f02e44a40 2023-08-10T12:02:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.464+0000 7f0c0c4a7b80 10 client.16947 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:02:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.464+0000 7f0c0c4a7b80 10 client.16947 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:02:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.464+0000 7f0c0c4a7b80 20 client.16947 populate_metadata read hostname 'smithi073' 2023-08-10T12:02:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.464+0000 7f0c0c4a7b80 1 --2- 172.21.15.73:0/1495892787 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x557f02e58eb0 0x557f02e5b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.464+0000 7f0c0c4a7b80 4 client.16947 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:02:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.464+0000 7f0c0c4a7b80 1 -- 172.21.15.73:0/1495892787 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557f02e0e970 con 0x557f02e58eb0 2023-08-10T12:02:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.465+0000 7f0bfe0aa700 1 --2- 172.21.15.73:0/1495892787 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x557f02e58eb0 0x557f02e5b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.465+0000 7f0be1ffb700 10 client.16947 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:02:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.465+0000 7f0bfe0aa700 1 --2- 172.21.15.73:0/1495892787 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x557f02e58eb0 0x557f02e5b2d0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=572a4e32d84013c0 server_cookie=586af3de49b6bb1c in_seq=0 out_seq=0 2023-08-10T12:02:04.496 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.495+0000 7f0be1ffb700 1 -- 172.21.15.73:0/1495892787 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x557f02e0e970 con 0x557f02e58eb0 2023-08-10T12:02:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.495+0000 7f0be1ffb700 10 client.16947 handle_command_reply: tid=0 2023-08-10T12:02:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.495+0000 7f0c0c4a7b80 1 client.16947 shutdown 2023-08-10T12:02:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.495+0000 7f0c0c4a7b80 1 -- 172.21.15.73:0/1495892787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 msgr2=0x557f02e48630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.495+0000 7f0c0c4a7b80 1 --2- 172.21.15.73:0/1495892787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 0x557f02e48630 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f0be8012d00 tx=0x7f0be800f6a0 comp rx=0 tx=0).stop 2023-08-10T12:02:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.495+0000 7f0c0c4a7b80 1 -- 172.21.15.73:0/1495892787 shutdown_connections 2023-08-10T12:02:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.496+0000 7f0c0c4a7b80 1 --2- 172.21.15.73:0/1495892787 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x557f02e58eb0 0x557f02e5b2d0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:04.498 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.496+0000 7f0c0c4a7b80 1 --2- 172.21.15.73:0/1495892787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f02e3f550 0x557f02e4b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:04.498 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.496+0000 7f0be1ffb700 0 client.16947 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:02:04.498 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.496+0000 7f0c0c4a7b80 1 --2- 172.21.15.73:0/1495892787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557f02e45360 0x557f02e48cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:04.498 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.496+0000 7f0c0c4a7b80 1 --2- 172.21.15.73:0/1495892787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 0x557f02e48630 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:04.498 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.496+0000 7f0c0c4a7b80 1 -- 172.21.15.73:0/1495892787 >> 172.21.15.73:0/1495892787 conn(0x557f02d9cc70 msgr2=0x557f02e394b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:02:04.498 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.496+0000 7f0c0c4a7b80 1 -- 172.21.15.73:0/1495892787 shutdown_connections 2023-08-10T12:02:04.498 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.496+0000 7f0c0c4a7b80 1 -- 172.21.15.73:0/1495892787 wait complete. 2023-08-10T12:02:04.499 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.496+0000 7f0c0c4a7b80 20 client.16947 trim_cache size 0 max 16384 2023-08-10T12:02:04.525 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.523+0000 7f0c0c4a7b80 1 Processor -- start 2023-08-10T12:02:04.525 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.523+0000 7f0c0c4a7b80 1 -- start start 2023-08-10T12:02:04.525 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.524+0000 7f0c0c4a7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f02e3f550 0x557f02e3f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:04.525 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.524+0000 7f0c0c4a7b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 0x557f02e3f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:04.525 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.524+0000 7f0c0c4a7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557f02e45360 0x557f02e39c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:04.525 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.524+0000 7f0c0c4a7b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f02c138c0 con 0x557f02e44a40 2023-08-10T12:02:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.524+0000 7f0c0c4a7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f02e3b1c0 con 0x557f02e3f550 2023-08-10T12:02:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.524+0000 7f0c0c4a7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f02e3bae0 con 0x557f02e45360 2023-08-10T12:02:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.524+0000 7f0bfd8a9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 0x557f02e3f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.524+0000 7f0bfe8ab700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557f02e45360 0x557f02e39c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.524+0000 7f0bfd8a9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 0x557f02e3f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36520/0 (socket says 172.21.15.73:36520) 2023-08-10T12:02:04.527 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.524+0000 7f0bfe0aa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f02e3f550 0x557f02e3f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:04.527 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.524+0000 7f0bfd8a9700 1 -- 172.21.15.73:0/2247806458 learned_addr learned my addr 172.21.15.73:0/2247806458 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:02:04.527 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.524+0000 7f0bfd8a9700 1 -- 172.21.15.73:0/2247806458 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557f02e45360 msgr2=0x557f02e39c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:04.527 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.524+0000 7f0bfd8a9700 1 --2- 172.21.15.73:0/2247806458 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557f02e45360 0x557f02e39c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:04.527 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.524+0000 7f0bfd8a9700 1 -- 172.21.15.73:0/2247806458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f02e3f550 msgr2=0x557f02e3f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:04.527 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.524+0000 7f0bfd8a9700 1 --2- 172.21.15.73:0/2247806458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f02e3f550 0x557f02e3f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:04.527 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.524+0000 7f0bfd8a9700 1 -- 172.21.15.73:0/2247806458 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f02ba6c00 con 0x557f02e44a40 2023-08-10T12:02:04.528 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.524+0000 7f0bfe8ab700 1 --2- 172.21.15.73:0/2247806458 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557f02e45360 0x557f02e39c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:02:04.528 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.524+0000 7f0bfd8a9700 1 --2- 172.21.15.73:0/2247806458 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 0x557f02e3f930 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f0be8009340 tx=0x7f0be8010500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed2ba2f6e30545d0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:02:04.531 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.524+0000 7f0bed5ab700 1 -- 172.21.15.73:0/2247806458 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8017040 con 0x557f02e44a40 2023-08-10T12:02:04.531 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.524+0000 7f0bed5ab700 1 -- 172.21.15.73:0/2247806458 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0be8010650 con 0x557f02e44a40 2023-08-10T12:02:04.531 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.524+0000 7f0bed5ab700 1 -- 172.21.15.73:0/2247806458 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be801aa40 con 0x557f02e44a40 2023-08-10T12:02:04.531 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.525+0000 7f0c0c4a7b80 1 -- 172.21.15.73:0/2247806458 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 msgr2=0x557f02e3f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:04.531 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.525+0000 7f0c0c4a7b80 1 --2- 172.21.15.73:0/2247806458 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 0x557f02e3f930 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f0be8009340 tx=0x7f0be8010500 comp rx=0 tx=0).stop 2023-08-10T12:02:04.531 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.525+0000 7f0c0c4a7b80 1 -- 172.21.15.73:0/2247806458 shutdown_connections 2023-08-10T12:02:04.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.525+0000 7f0c0c4a7b80 1 --2- 172.21.15.73:0/2247806458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f02e3f550 0x557f02e3f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:04.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.525+0000 7f0c0c4a7b80 1 --2- 172.21.15.73:0/2247806458 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557f02e45360 0x557f02e39c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:04.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.525+0000 7f0c0c4a7b80 1 --2- 172.21.15.73:0/2247806458 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 0x557f02e3f930 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:04.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.525+0000 7f0c0c4a7b80 1 -- 172.21.15.73:0/2247806458 >> 172.21.15.73:0/2247806458 conn(0x557f02d9cc70 msgr2=0x557f02e437d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:02:04.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.525+0000 7f0c0c4a7b80 1 -- 172.21.15.73:0/2247806458 shutdown_connections 2023-08-10T12:02:04.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.525+0000 7f0c0c4a7b80 1 -- 172.21.15.73:0/2247806458 wait complete. 2023-08-10T12:02:04.533 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.526+0000 7f0c0c4a7b80 1 -- start start 2023-08-10T12:02:04.533 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.526+0000 7f0c0c4a7b80 1 Processor -- start 2023-08-10T12:02:04.533 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.526+0000 7f0c0c4a7b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f02e3f550 0x557f02e4fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:04.533 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.526+0000 7f0c0c4a7b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 0x557f02e4dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:04.533 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.526+0000 7f0c0c4a7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557f02e45360 0x557f02e4e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:04.533 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.526+0000 7f0c0c4a7b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f02e4ebd0 con 0x557f02e44a40 2023-08-10T12:02:04.533 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.526+0000 7f0c0c4a7b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f02e4ed40 con 0x557f02e3f550 2023-08-10T12:02:04.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.526+0000 7f0c0c4a7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f02eacb30 con 0x557f02e45360 2023-08-10T12:02:04.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.526+0000 7f0c0c4a7b80 10 client.0 _ll_register_callbacks cb 0x557f02d2d620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:02:04.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.526+0000 7f0bfd8a9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 0x557f02e4dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:04.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.526+0000 7f0bfe0aa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f02e3f550 0x557f02e4fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:04.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.526+0000 7f0bfd8a9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 0x557f02e4dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36526/0 (socket says 172.21.15.73:36526) 2023-08-10T12:02:04.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.526+0000 7f0bfe0aa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f02e3f550 0x557f02e4fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:51174/0 (socket says 172.21.15.73:51174) 2023-08-10T12:02:04.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.526+0000 7f0bfd8a9700 1 -- 172.21.15.73:0/4094704003 learned_addr learned my addr 172.21.15.73:0/4094704003 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:02:04.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.527+0000 7f0bfe8ab700 1 --2- 172.21.15.73:0/4094704003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557f02e45360 0x557f02e4e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:04.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.527+0000 7f0bfe0aa700 1 -- 172.21.15.73:0/4094704003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557f02e45360 msgr2=0x557f02e4e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:04.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.527+0000 7f0bfe0aa700 1 --2- 172.21.15.73:0/4094704003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557f02e45360 0x557f02e4e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:04.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.527+0000 7f0bfe0aa700 1 -- 172.21.15.73:0/4094704003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 msgr2=0x557f02e4dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:04.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.527+0000 7f0bfe0aa700 1 --2- 172.21.15.73:0/4094704003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 0x557f02e4dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:04.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.527+0000 7f0bfe0aa700 1 -- 172.21.15.73:0/4094704003 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf81a5d60 con 0x557f02e3f550 2023-08-10T12:02:04.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.527+0000 7f0bfd8a9700 1 --2- 172.21.15.73:0/4094704003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 0x557f02e4dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:02:04.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.527+0000 7f0bfe0aa700 1 --2- 172.21.15.73:0/4094704003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f02e3f550 0x557f02e4fcd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400ead0 tx=0x7f0bf400eb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de897c90ae7fa9ac server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:02:04.536 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.527+0000 7f0be1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T12:02:04.536 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.527+0000 7f0be1ffb700 1 -- 172.21.15.73:0/4094704003 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf40330b0 con 0x557f02e3f550 2023-08-10T12:02:04.536 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.527+0000 7f0c0c4a7b80 1 -- 172.21.15.73:0/4094704003 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0bf4021070 con 0x557f02e3f550 2023-08-10T12:02:04.536 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.527+0000 7f0be1ffb700 1 -- 172.21.15.73:0/4094704003 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0bf4033210 con 0x557f02e3f550 2023-08-10T12:02:04.536 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.528+0000 7f0be1ffb700 1 -- 172.21.15.73:0/4094704003 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bf40333d0 con 0x557f02e3f550 2023-08-10T12:02:04.536 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.528+0000 7f0c0c4a7b80 10 client.26354 fetch_fsmap learned FSMap version 55 2023-08-10T12:02:04.536 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.528+0000 7f0c0c4a7b80 1 -- 172.21.15.73:0/4094704003 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x557f02bbdd80 con 0x557f02e3f550 2023-08-10T12:02:04.537 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.528+0000 7f0be1ffb700 1 -- 172.21.15.73:0/4094704003 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0bf4021070 con 0x557f02e3f550 2023-08-10T12:02:04.537 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.528+0000 7f0be1ffb700 1 -- 172.21.15.73:0/4094704003 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7f0bf403a060 con 0x557f02e3f550 2023-08-10T12:02:04.537 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.528+0000 7f0c0c4a7b80 10 client.26354 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:02:04.537 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.528+0000 7f0c0c4a7b80 10 client.26354 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:02:04.537 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.528+0000 7f0c0c4a7b80 20 client.26354 populate_metadata read hostname 'smithi073' 2023-08-10T12:02:04.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.528+0000 7f0c0c4a7b80 1 --2- 172.21.15.73:0/4094704003 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x557f02eae230 0x557f02eb0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:04.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.528+0000 7f0c0c4a7b80 4 client.26354 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T12:02:04.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.528+0000 7f0c0c4a7b80 1 -- 172.21.15.73:0/4094704003 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557f02d89720 con 0x557f02eae230 2023-08-10T12:02:04.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.529+0000 7f0bfd8a9700 1 --2- 172.21.15.73:0/4094704003 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x557f02eae230 0x557f02eb0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:04.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.529+0000 7f0be1ffb700 10 client.26354 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:02:04.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:04.529+0000 7f0bfd8a9700 1 --2- 172.21.15.73:0/4094704003 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x557f02eae230 0x557f02eb0650 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96bb995391b272cb server_cookie=d6ce267d154c83f5 in_seq=0 out_seq=0 2023-08-10T12:02:05.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:04 smithi152 ceph-mon[130220]: pgmap v292: 97 pgs: 97 active+clean; 2.0 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.0 MiB/s wr, 259 op/s 2023-08-10T12:02:05.258 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:04 smithi156 ceph-mon[130574]: pgmap v292: 97 pgs: 97 active+clean; 2.0 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.0 MiB/s wr, 259 op/s 2023-08-10T12:02:05.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:04 smithi073 ceph-mon[128869]: pgmap v292: 97 pgs: 97 active+clean; 2.0 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.0 MiB/s wr, 259 op/s 2023-08-10T12:02:06.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:05 smithi152 ceph-mon[130220]: osdmap e93: 12 total, 12 up, 12 in 2023-08-10T12:02:06.267 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:05 smithi156 ceph-mon[130574]: osdmap e93: 12 total, 12 up, 12 in 2023-08-10T12:02:06.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:05 smithi073 ceph-mon[128869]: osdmap e93: 12 total, 12 up, 12 in 2023-08-10T12:02:06.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:06.799+0000 7f0be1ffb700 1 -- 172.21.15.73:0/4094704003 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557f02d89720 con 0x557f02eae230 2023-08-10T12:02:06.800 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:06.799+0000 7f0be1ffb700 10 client.26354 handle_command_reply: tid=0 2023-08-10T12:02:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:06.800+0000 7f0c0c4a7b80 1 client.26354 shutdown 2023-08-10T12:02:06.804 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:06.804+0000 7f0c0c4a7b80 1 -- 172.21.15.73:0/4094704003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f02e3f550 msgr2=0x557f02e4fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:06.805 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:06.804+0000 7f0c0c4a7b80 1 --2- 172.21.15.73:0/4094704003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f02e3f550 0x557f02e4fcd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400ead0 tx=0x7f0bf400eb90 comp rx=0 tx=0).stop 2023-08-10T12:02:06.805 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T12:02:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T12:02:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T12:02:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T12:02:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:06.804+0000 7f0c0c4a7b80 1 -- 172.21.15.73:0/4094704003 shutdown_connections 2023-08-10T12:02:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:06.804+0000 7f0c0c4a7b80 1 --2- 172.21.15.73:0/4094704003 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x557f02eae230 0x557f02eb0650 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:06.804+0000 7f0c0c4a7b80 1 --2- 172.21.15.73:0/4094704003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f02e3f550 0x557f02e4fcd0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:06.804+0000 7f0c0c4a7b80 1 --2- 172.21.15.73:0/4094704003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557f02e45360 0x557f02e4e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:06.804+0000 7f0c0c4a7b80 1 --2- 172.21.15.73:0/4094704003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557f02e44a40 0x557f02e4dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:06.804+0000 7f0c0c4a7b80 1 -- 172.21.15.73:0/4094704003 >> 172.21.15.73:0/4094704003 conn(0x557f02d9cc70 msgr2=0x557f02e44060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:02:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:06.804+0000 7f0be1ffb700 0 client.26354 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:02:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:06.804+0000 7f0c0c4a7b80 1 -- 172.21.15.73:0/4094704003 shutdown_connections 2023-08-10T12:02:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:06.804+0000 7f0c0c4a7b80 1 -- 172.21.15.73:0/4094704003 wait complete. 2023-08-10T12:02:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:06.805+0000 7f0c0c4a7b80 20 client.26354 trim_cache size 0 max 16384 2023-08-10T12:02:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:06.805+0000 7f0c0030e700 1 -- 172.21.15.73:0/2669865811 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0be40a12c0 msgr2=0x7f0be40a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:06.805+0000 7f0c0030e700 1 --2- 172.21.15.73:0/2669865811 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0be40a12c0 0x7f0be40a3780 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4009c60 tx=0x7f0bf4009260 comp rx=0 tx=0).stop 2023-08-10T12:02:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:06.805+0000 7f0c0030e700 1 -- 172.21.15.73:0/2669865811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0bf81a2a80 msgr2=0x7f0bf81a4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:06.805+0000 7f0c0030e700 1 --2- 172.21.15.73:0/2669865811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0bf81a2a80 0x7f0bf81a4e70 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0007930 tx=0x7f0bf0007960 comp rx=0 tx=0).stop 2023-08-10T12:02:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:06.805+0000 7f0c0030e700 1 -- 172.21.15.73:0/2669865811 shutdown_connections 2023-08-10T12:02:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:06.805+0000 7f0c0030e700 1 --2- 172.21.15.73:0/2669865811 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0be40a12c0 0x7f0be40a3780 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:06.805+0000 7f0c0030e700 1 --2- 172.21.15.73:0/2669865811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0bf81a2a80 0x7f0bf81a4e70 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:06.805+0000 7f0c0030e700 1 --2- 172.21.15.73:0/2669865811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bf80fede0 0x7f0bf80fff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:06.805+0000 7f0c0030e700 1 --2- 172.21.15.73:0/2669865811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf8105a40 0x7f0bf8100470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:06.805+0000 7f0c0030e700 1 -- 172.21.15.73:0/2669865811 >> 172.21.15.73:0/2669865811 conn(0x7f0bf8076b40 msgr2=0x7f0bf8103970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:02:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:06.805+0000 7f0c0030e700 1 -- 172.21.15.73:0/2669865811 shutdown_connections 2023-08-10T12:02:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:06.805+0000 7f0c0030e700 1 -- 172.21.15.73:0/2669865811 wait complete. 2023-08-10T12:02:07.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:06 smithi152 ceph-mon[130220]: pgmap v294: 97 pgs: 1 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 94 active+clean; 2.0 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 305 op/s 2023-08-10T12:02:07.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:06 smithi156 ceph-mon[130574]: pgmap v294: 97 pgs: 1 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 94 active+clean; 2.0 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 305 op/s 2023-08-10T12:02:07.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:06 smithi073 ceph-mon[128869]: pgmap v294: 97 pgs: 1 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 94 active+clean; 2.0 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 305 op/s 2023-08-10T12:02:09.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:09 smithi152 ceph-mon[130220]: pgmap v295: 97 pgs: 5 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 88 active+clean; 2.0 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 400 op/s 2023-08-10T12:02:09.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:09 smithi156 ceph-mon[130574]: pgmap v295: 97 pgs: 5 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 88 active+clean; 2.0 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 400 op/s 2023-08-10T12:02:09.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:09 smithi073 ceph-mon[128869]: pgmap v295: 97 pgs: 5 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 88 active+clean; 2.0 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 400 op/s 2023-08-10T12:02:11.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:11 smithi152 ceph-mon[130220]: pgmap v296: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.0 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 1.24k op/s 2023-08-10T12:02:11.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:11 smithi156 ceph-mon[130574]: pgmap v296: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.0 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 1.24k op/s 2023-08-10T12:02:11.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:11 smithi073 ceph-mon[128869]: pgmap v296: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.0 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 1.24k op/s 2023-08-10T12:02:13.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:13 smithi152 ceph-mon[130220]: pgmap v297: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 2.0 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 1.24k op/s 2023-08-10T12:02:13.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:13 smithi156 ceph-mon[130574]: pgmap v297: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 2.0 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 1.24k op/s 2023-08-10T12:02:13.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:13 smithi073 ceph-mon[128869]: pgmap v297: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 2.0 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 1.24k op/s 2023-08-10T12:02:15.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:14 smithi152 ceph-mon[130220]: pgmap v298: 97 pgs: 37 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 41 active+clean; 2.0 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 1.21k op/s 2023-08-10T12:02:15.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:14 smithi156 ceph-mon[130574]: pgmap v298: 97 pgs: 37 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 41 active+clean; 2.0 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 1.21k op/s 2023-08-10T12:02:15.270 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:14 smithi073 ceph-mon[128869]: pgmap v298: 97 pgs: 37 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 41 active+clean; 2.0 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 1.21k op/s 2023-08-10T12:02:17.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:17 smithi152 ceph-mon[130220]: pgmap v299: 97 pgs: 35 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 46 active+clean; 2.0 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 1.06k op/s 2023-08-10T12:02:17.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:17 smithi156 ceph-mon[130574]: pgmap v299: 97 pgs: 35 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 46 active+clean; 2.0 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 1.06k op/s 2023-08-10T12:02:17.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:17 smithi073 ceph-mon[128869]: pgmap v299: 97 pgs: 35 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 46 active+clean; 2.0 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 1.06k op/s 2023-08-10T12:02:19.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:19 smithi152 ceph-mon[130220]: pgmap v300: 97 pgs: 31 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 52 active+clean; 2.0 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 933 op/s 2023-08-10T12:02:19.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:19 smithi156 ceph-mon[130574]: pgmap v300: 97 pgs: 31 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 52 active+clean; 2.0 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 933 op/s 2023-08-10T12:02:19.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:19 smithi073 ceph-mon[128869]: pgmap v300: 97 pgs: 31 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 52 active+clean; 2.0 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 933 op/s 2023-08-10T12:02:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.952+0000 7f9debf2b700 1 -- 172.21.15.73:0/1637620880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9de40ff800 msgr2=0x7f9de40ffc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.952+0000 7f9debf2b700 1 --2- 172.21.15.73:0/1637620880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9de40ff800 0x7f9de40ffc80 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4009990 tx=0x7f9dd4009ca0 comp rx=0 tx=0).stop 2023-08-10T12:02:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.953+0000 7f9debf2b700 1 -- 172.21.15.73:0/1637620880 shutdown_connections 2023-08-10T12:02:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.953+0000 7f9debf2b700 1 --2- 172.21.15.73:0/1637620880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9de4105650 0x7f9de4105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.953+0000 7f9debf2b700 1 --2- 172.21.15.73:0/1637620880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9de41001c0 0x7f9de410c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.953+0000 7f9debf2b700 1 --2- 172.21.15.73:0/1637620880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9de40ff800 0x7f9de40ffc80 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:19.956 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.953+0000 7f9debf2b700 1 -- 172.21.15.73:0/1637620880 >> 172.21.15.73:0/1637620880 conn(0x7f9de40775a0 msgr2=0x7f9de40779b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:02:19.956 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.953+0000 7f9debf2b700 1 -- 172.21.15.73:0/1637620880 shutdown_connections 2023-08-10T12:02:19.956 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.953+0000 7f9debf2b700 1 -- 172.21.15.73:0/1637620880 wait complete. 2023-08-10T12:02:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.953+0000 7f9debf2b700 1 Processor -- start 2023-08-10T12:02:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.953+0000 7f9debf2b700 1 -- start start 2023-08-10T12:02:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.954+0000 7f9debf2b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9de40ff800 0x7f9de4106790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.954+0000 7f9debf2b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9de41001c0 0x7f9de4106cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.954+0000 7f9debf2b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9de4105650 0x7f9de41a4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.954+0000 7f9debf2b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de41a4ec0 con 0x7f9de40ff800 2023-08-10T12:02:19.959 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.954+0000 7f9debf2b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de41a5000 con 0x7f9de4105650 2023-08-10T12:02:19.959 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.954+0000 7f9debf2b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de41a5170 con 0x7f9de41001c0 2023-08-10T12:02:19.959 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.954+0000 7f9de9cc7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9de40ff800 0x7f9de4106790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:19.959 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.954+0000 7f9de9cc7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9de40ff800 0x7f9de4106790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36538/0 (socket says 172.21.15.73:36538) 2023-08-10T12:02:19.959 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.954+0000 7f9de9cc7700 1 -- 172.21.15.73:0/331793099 learned_addr learned my addr 172.21.15.73:0/331793099 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:02:19.959 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.954+0000 7f9de94c6700 1 --2- 172.21.15.73:0/331793099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9de41001c0 0x7f9de4106cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:19.959 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.954+0000 7f9de9cc7700 1 -- 172.21.15.73:0/331793099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9de41001c0 msgr2=0x7f9de4106cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.954+0000 7f9de9cc7700 1 --2- 172.21.15.73:0/331793099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9de41001c0 0x7f9de4106cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.954+0000 7f9de9cc7700 1 -- 172.21.15.73:0/331793099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9de4105650 msgr2=0x7f9de41a4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.954+0000 7f9de9cc7700 1 --2- 172.21.15.73:0/331793099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9de4105650 0x7f9de41a4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.954+0000 7f9de9cc7700 1 -- 172.21.15.73:0/331793099 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd40095f0 con 0x7f9de40ff800 2023-08-10T12:02:19.961 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.954+0000 7f9de94c6700 1 --2- 172.21.15.73:0/331793099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9de41001c0 0x7f9de4106cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T12:02:19.961 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.954+0000 7f9de9cc7700 1 --2- 172.21.15.73:0/331793099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9de40ff800 0x7f9de4106790 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f9de000e9a0 tx=0x7f9de000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:02:19.961 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.954+0000 7f9ddaffd700 1 -- 172.21.15.73:0/331793099 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0009790 con 0x7f9de40ff800 2023-08-10T12:02:19.962 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.954+0000 7f9debf2b700 1 -- 172.21.15.73:0/331793099 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de41a5450 con 0x7f9de40ff800 2023-08-10T12:02:19.962 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.954+0000 7f9ddaffd700 1 -- 172.21.15.73:0/331793099 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9de000cbd0 con 0x7f9de40ff800 2023-08-10T12:02:19.962 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.954+0000 7f9ddaffd700 1 -- 172.21.15.73:0/331793099 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0018680 con 0x7f9de40ff800 2023-08-10T12:02:19.962 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.955+0000 7f9debf2b700 1 -- 172.21.15.73:0/331793099 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de41a59b0 con 0x7f9de40ff800 2023-08-10T12:02:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.957+0000 7f9ddaffd700 1 -- 172.21.15.73:0/331793099 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f9de000cd40 con 0x7f9de40ff800 2023-08-10T12:02:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.958+0000 7f9ddaffd700 1 --2- 172.21.15.73:0/331793099 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f9dd00a12c0 0x7f9dd00a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.958+0000 7f9ddaffd700 1 -- 172.21.15.73:0/331793099 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f9de0014070 con 0x7f9de40ff800 2023-08-10T12:02:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.958+0000 7f9de94c6700 1 --2- 172.21.15.73:0/331793099 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f9dd00a12c0 0x7f9dd00a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.959+0000 7f9de94c6700 1 --2- 172.21.15.73:0/331793099 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f9dd00a12c0 0x7f9dd00a3780 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400b2e0 tx=0x7f9dd4005fb0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:02:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.959+0000 7f9df80c4b80 1 Processor -- start 2023-08-10T12:02:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.959+0000 7f9df80c4b80 1 -- start start 2023-08-10T12:02:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.959+0000 7f9df80c4b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5615fa661a40 0x5615fa661e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.959+0000 7f9df80c4b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615fa662360 0x5615fa65c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.959+0000 7f9df80c4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5615fa65c550 0x5615fa65c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.959+0000 7f9df80c4b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615fa5d7d60 con 0x5615fa661a40 2023-08-10T12:02:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.959+0000 7f9df80c4b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615fa5b4530 con 0x5615fa662360 2023-08-10T12:02:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.959+0000 7f9df80c4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615fa5b1e50 con 0x5615fa65c550 2023-08-10T12:02:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.960+0000 7f9de94c6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615fa662360 0x5615fa65c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.960+0000 7f9de94c6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615fa662360 0x5615fa65c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:51198/0 (socket says 172.21.15.73:51198) 2023-08-10T12:02:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.960+0000 7f9de94c6700 1 -- 172.21.15.73:0/1210460884 learned_addr learned my addr 172.21.15.73:0/1210460884 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:02:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.960+0000 7f9de94c6700 1 -- 172.21.15.73:0/1210460884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5615fa65c550 msgr2=0x5615fa65c9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T12:02:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.960+0000 7f9de94c6700 1 --2- 172.21.15.73:0/1210460884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5615fa65c550 0x5615fa65c9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.960+0000 7f9de94c6700 1 -- 172.21.15.73:0/1210460884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5615fa661a40 msgr2=0x5615fa661e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.960+0000 7f9de94c6700 1 --2- 172.21.15.73:0/1210460884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5615fa661a40 0x5615fa661e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.960+0000 7f9de94c6700 1 -- 172.21.15.73:0/1210460884 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615fa42e5d0 con 0x5615fa662360 2023-08-10T12:02:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.960+0000 7f9de94c6700 1 --2- 172.21.15.73:0/1210460884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615fa662360 0x5615fa65c010 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4015000 tx=0x7f9dd401f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c010a26787ed3deb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:02:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.961+0000 7f9dcffff700 1 -- 172.21.15.73:0/1210460884 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd402b070 con 0x5615fa662360 2023-08-10T12:02:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.961+0000 7f9dcffff700 1 -- 172.21.15.73:0/1210460884 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9dd401e040 con 0x5615fa662360 2023-08-10T12:02:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.961+0000 7f9dcffff700 1 -- 172.21.15.73:0/1210460884 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd402f9b0 con 0x5615fa662360 2023-08-10T12:02:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.961+0000 7f9df80c4b80 1 -- 172.21.15.73:0/1210460884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615fa662360 msgr2=0x5615fa65c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.961+0000 7f9df80c4b80 1 --2- 172.21.15.73:0/1210460884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615fa662360 0x5615fa65c010 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4015000 tx=0x7f9dd401f000 comp rx=0 tx=0).stop 2023-08-10T12:02:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.962+0000 7f9df80c4b80 1 -- 172.21.15.73:0/1210460884 shutdown_connections 2023-08-10T12:02:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.962+0000 7f9df80c4b80 1 --2- 172.21.15.73:0/1210460884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5615fa65c550 0x5615fa65c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.962+0000 7f9df80c4b80 1 --2- 172.21.15.73:0/1210460884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5615fa661a40 0x5615fa661e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.962+0000 7f9df80c4b80 1 --2- 172.21.15.73:0/1210460884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615fa662360 0x5615fa65c010 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.962+0000 7f9df80c4b80 1 -- 172.21.15.73:0/1210460884 >> 172.21.15.73:0/1210460884 conn(0x5615fa5b9c70 msgr2=0x5615fa656d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:02:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.962+0000 7f9df80c4b80 1 -- 172.21.15.73:0/1210460884 shutdown_connections 2023-08-10T12:02:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.962+0000 7f9df80c4b80 1 -- 172.21.15.73:0/1210460884 wait complete. 2023-08-10T12:02:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.962+0000 7f9df80c4b80 1 -- start start 2023-08-10T12:02:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.962+0000 7f9df80c4b80 1 Processor -- start 2023-08-10T12:02:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.963+0000 7f9df80c4b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5615fa65c550 0x5615fa668420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.963+0000 7f9df80c4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5615fa661a40 0x5615fa6656a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.963+0000 7f9df80c4b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615fa662360 0x5615fa665d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.963+0000 7f9df80c4b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615fa5ad740 con 0x5615fa65c550 2023-08-10T12:02:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.963+0000 7f9df80c4b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615fa54ca60 con 0x5615fa662360 2023-08-10T12:02:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.963+0000 7f9df80c4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615fa54c760 con 0x5615fa661a40 2023-08-10T12:02:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.963+0000 7f9df80c4b80 10 client.0 _ll_register_callbacks cb 0x5615fa54a620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:02:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.963+0000 7f9de9cc7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5615fa65c550 0x5615fa668420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.963+0000 7f9de9cc7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5615fa65c550 0x5615fa668420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36550/0 (socket says 172.21.15.73:36550) 2023-08-10T12:02:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.963+0000 7f9de9cc7700 1 -- 172.21.15.73:0/3657704798 learned_addr learned my addr 172.21.15.73:0/3657704798 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:02:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.963+0000 7f9de94c6700 1 --2- 172.21.15.73:0/3657704798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5615fa661a40 0x5615fa6656a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.963+0000 7f9dea4c8700 1 --2- 172.21.15.73:0/3657704798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615fa662360 0x5615fa665d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.963+0000 7f9de9cc7700 1 -- 172.21.15.73:0/3657704798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5615fa661a40 msgr2=0x5615fa6656a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.963+0000 7f9de9cc7700 1 --2- 172.21.15.73:0/3657704798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5615fa661a40 0x5615fa6656a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.963+0000 7f9de9cc7700 1 -- 172.21.15.73:0/3657704798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615fa662360 msgr2=0x5615fa665d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.963+0000 7f9de9cc7700 1 --2- 172.21.15.73:0/3657704798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615fa662360 0x5615fa665d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.963+0000 7f9de9cc7700 1 -- 172.21.15.73:0/3657704798 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de410ce10 con 0x5615fa65c550 2023-08-10T12:02:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.963+0000 7f9de9cc7700 1 --2- 172.21.15.73:0/3657704798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5615fa65c550 0x5615fa668420 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9de00ca850 tx=0x7f9de009a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=789514aea4af4b85 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:02:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.963+0000 7f9dcd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:02:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.964+0000 7f9dcd7fa700 1 -- 172.21.15.73:0/3657704798 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0099f40 con 0x5615fa65c550 2023-08-10T12:02:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.964+0000 7f9dcd7fa700 1 -- 172.21.15.73:0/3657704798 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f9de00a25c0 con 0x5615fa65c550 2023-08-10T12:02:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.964+0000 7f9df80c4b80 1 -- 172.21.15.73:0/3657704798 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5615fa64f1c0 con 0x5615fa65c550 2023-08-10T12:02:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.964+0000 7f9dcd7fa700 1 -- 172.21.15.73:0/3657704798 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9de00a2130 con 0x5615fa65c550 2023-08-10T12:02:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.964+0000 7f9df80c4b80 10 client.16962 fetch_fsmap learned FSMap version 55 2023-08-10T12:02:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.964+0000 7f9df80c4b80 1 -- 172.21.15.73:0/3657704798 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x5615fa3dad80 con 0x5615fa65c550 2023-08-10T12:02:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.964+0000 7f9dcd7fa700 1 -- 172.21.15.73:0/3657704798 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5615fa64f1c0 con 0x5615fa65c550 2023-08-10T12:02:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.964+0000 7f9dcd7fa700 1 -- 172.21.15.73:0/3657704798 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7f9de00960f0 con 0x5615fa65c550 2023-08-10T12:02:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.964+0000 7f9df80c4b80 10 client.16962 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:02:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.964+0000 7f9df80c4b80 10 client.16962 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:02:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.964+0000 7f9df80c4b80 20 client.16962 populate_metadata read hostname 'smithi073' 2023-08-10T12:02:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.964+0000 7f9df80c4b80 1 --2- 172.21.15.73:0/3657704798 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5615fa675d70 0x5615fa678190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.964+0000 7f9df80c4b80 4 client.16962 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:02:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.964+0000 7f9df80c4b80 1 -- 172.21.15.73:0/3657704798 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5615fa62b970 con 0x5615fa675d70 2023-08-10T12:02:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.964+0000 7f9de94c6700 1 --2- 172.21.15.73:0/3657704798 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5615fa675d70 0x5615fa678190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.965+0000 7f9dcd7fa700 10 client.16962 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:02:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.965+0000 7f9de94c6700 1 --2- 172.21.15.73:0/3657704798 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5615fa675d70 0x5615fa678190 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26a85208cea2bae8 server_cookie=bfdad5db70b3f5ef in_seq=0 out_seq=0 2023-08-10T12:02:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.966+0000 7f9dcd7fa700 1 -- 172.21.15.73:0/3657704798 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5615fa62b970 con 0x5615fa675d70 2023-08-10T12:02:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.966+0000 7f9dcd7fa700 10 client.16962 handle_command_reply: tid=0 2023-08-10T12:02:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.966+0000 7f9df80c4b80 1 client.16962 shutdown 2023-08-10T12:02:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.966+0000 7f9df80c4b80 1 -- 172.21.15.73:0/3657704798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5615fa65c550 msgr2=0x5615fa668420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.966+0000 7f9df80c4b80 1 --2- 172.21.15.73:0/3657704798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5615fa65c550 0x5615fa668420 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9de00ca850 tx=0x7f9de009a2e0 comp rx=0 tx=0).stop 2023-08-10T12:02:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.966+0000 7f9df80c4b80 1 -- 172.21.15.73:0/3657704798 shutdown_connections 2023-08-10T12:02:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.966+0000 7f9df80c4b80 1 --2- 172.21.15.73:0/3657704798 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5615fa675d70 0x5615fa678190 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.966+0000 7f9df80c4b80 1 --2- 172.21.15.73:0/3657704798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615fa662360 0x5615fa665d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.966+0000 7f9df80c4b80 1 --2- 172.21.15.73:0/3657704798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5615fa65c550 0x5615fa668420 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.966+0000 7f9df80c4b80 1 --2- 172.21.15.73:0/3657704798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5615fa661a40 0x5615fa6656a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.966+0000 7f9dcd7fa700 0 client.16962 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:02:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.966+0000 7f9df80c4b80 1 -- 172.21.15.73:0/3657704798 >> 172.21.15.73:0/3657704798 conn(0x5615fa5b9c70 msgr2=0x5615fa6564b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:02:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.966+0000 7f9df80c4b80 1 -- 172.21.15.73:0/3657704798 shutdown_connections 2023-08-10T12:02:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.966+0000 7f9df80c4b80 1 -- 172.21.15.73:0/3657704798 wait complete. 2023-08-10T12:02:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.966+0000 7f9df80c4b80 20 client.16962 trim_cache size 0 max 16384 2023-08-10T12:02:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.985+0000 7f9df80c4b80 1 Processor -- start 2023-08-10T12:02:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.985+0000 7f9df80c4b80 1 -- start start 2023-08-10T12:02:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.985+0000 7f9df80c4b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615fa65c550 0x5615fa65c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.985+0000 7f9df80c4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5615fa661a40 0x5615fa656c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.985+0000 7f9df80c4b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5615fa662360 0x5615fa660f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.985+0000 7f9df80c4b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615fa4308c0 con 0x5615fa662360 2023-08-10T12:02:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.985+0000 7f9df80c4b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615fa657c10 con 0x5615fa65c550 2023-08-10T12:02:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.985+0000 7f9df80c4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615fa660410 con 0x5615fa661a40 2023-08-10T12:02:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.985+0000 7f9dea4c8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5615fa662360 0x5615fa660f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.985+0000 7f9dea4c8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5615fa662360 0x5615fa660f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36562/0 (socket says 172.21.15.73:36562) 2023-08-10T12:02:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.985+0000 7f9dea4c8700 1 -- 172.21.15.73:0/2261362761 learned_addr learned my addr 172.21.15.73:0/2261362761 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:02:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.985+0000 7f9de94c6700 1 --2- 172.21.15.73:0/2261362761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5615fa661a40 0x5615fa656c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.985+0000 7f9dea4c8700 1 -- 172.21.15.73:0/2261362761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5615fa661a40 msgr2=0x5615fa656c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.985+0000 7f9dea4c8700 1 --2- 172.21.15.73:0/2261362761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5615fa661a40 0x5615fa656c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.985+0000 7f9dea4c8700 1 -- 172.21.15.73:0/2261362761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615fa65c550 msgr2=0x5615fa65c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.985+0000 7f9dea4c8700 1 --2- 172.21.15.73:0/2261362761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615fa65c550 0x5615fa65c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.985+0000 7f9dea4c8700 1 -- 172.21.15.73:0/2261362761 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615fa3c3c00 con 0x5615fa662360 2023-08-10T12:02:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.985+0000 7f9dea4c8700 1 --2- 172.21.15.73:0/2261362761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5615fa662360 0x5615fa660f30 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc009c90 tx=0x7f9ddc0094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a902b1fbbbdddfc0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:02:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.986+0000 7f9dd8ff9700 1 -- 172.21.15.73:0/2261362761 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc010040 con 0x5615fa662360 2023-08-10T12:02:19.991 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.986+0000 7f9dd8ff9700 1 -- 172.21.15.73:0/2261362761 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ddc00adc0 con 0x5615fa662360 2023-08-10T12:02:19.991 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.986+0000 7f9dd8ff9700 1 -- 172.21.15.73:0/2261362761 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc0137a0 con 0x5615fa662360 2023-08-10T12:02:19.992 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.986+0000 7f9df80c4b80 1 -- 172.21.15.73:0/2261362761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5615fa662360 msgr2=0x5615fa660f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:19.992 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.986+0000 7f9df80c4b80 1 --2- 172.21.15.73:0/2261362761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5615fa662360 0x5615fa660f30 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc009c90 tx=0x7f9ddc0094a0 comp rx=0 tx=0).stop 2023-08-10T12:02:19.992 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.987+0000 7f9df80c4b80 1 -- 172.21.15.73:0/2261362761 shutdown_connections 2023-08-10T12:02:19.992 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.987+0000 7f9df80c4b80 1 --2- 172.21.15.73:0/2261362761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615fa65c550 0x5615fa65c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:19.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.987+0000 7f9df80c4b80 1 --2- 172.21.15.73:0/2261362761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5615fa662360 0x5615fa660f30 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:19.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.987+0000 7f9df80c4b80 1 --2- 172.21.15.73:0/2261362761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5615fa661a40 0x5615fa656c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:19.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.987+0000 7f9df80c4b80 1 -- 172.21.15.73:0/2261362761 >> 172.21.15.73:0/2261362761 conn(0x5615fa5b9c70 msgr2=0x5615fa660820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:02:19.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.987+0000 7f9df80c4b80 1 -- 172.21.15.73:0/2261362761 shutdown_connections 2023-08-10T12:02:19.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.987+0000 7f9df80c4b80 1 -- 172.21.15.73:0/2261362761 wait complete. 2023-08-10T12:02:19.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.987+0000 7f9df80c4b80 1 -- start start 2023-08-10T12:02:19.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.987+0000 7f9df80c4b80 1 Processor -- start 2023-08-10T12:02:19.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.988+0000 7f9df80c4b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5615fa65c550 0x5615fa66ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.988+0000 7f9df80c4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5615fa661a40 0x5615fa66bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.988+0000 7f9df80c4b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615fa662360 0x5615fa6c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.988+0000 7f9df80c4b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615fa66c720 con 0x5615fa65c550 2023-08-10T12:02:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.988+0000 7f9df80c4b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615fa6c9f60 con 0x5615fa662360 2023-08-10T12:02:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.988+0000 7f9df80c4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615fa6ca120 con 0x5615fa661a40 2023-08-10T12:02:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.988+0000 7f9df80c4b80 10 client.0 _ll_register_callbacks cb 0x5615fa54a620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:02:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.988+0000 7f9dea4c8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615fa662360 0x5615fa6c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.988+0000 7f9dea4c8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615fa662360 0x5615fa6c99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:51216/0 (socket says 172.21.15.73:51216) 2023-08-10T12:02:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.988+0000 7f9dea4c8700 1 -- 172.21.15.73:0/2392391873 learned_addr learned my addr 172.21.15.73:0/2392391873 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:02:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.988+0000 7f9de94c6700 1 --2- 172.21.15.73:0/2392391873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5615fa661a40 0x5615fa66bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.989+0000 7f9de9cc7700 1 --2- 172.21.15.73:0/2392391873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5615fa65c550 0x5615fa66ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.989+0000 7f9de94c6700 1 -- 172.21.15.73:0/2392391873 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615fa662360 msgr2=0x5615fa6c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.989+0000 7f9de94c6700 1 --2- 172.21.15.73:0/2392391873 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615fa662360 0x5615fa6c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.989+0000 7f9de94c6700 1 -- 172.21.15.73:0/2392391873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5615fa65c550 msgr2=0x5615fa66ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.989+0000 7f9de94c6700 1 --2- 172.21.15.73:0/2392391873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5615fa65c550 0x5615fa66ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.989+0000 7f9de94c6700 1 -- 172.21.15.73:0/2392391873 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ddc009940 con 0x5615fa661a40 2023-08-10T12:02:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.992+0000 7f9de94c6700 1 --2- 172.21.15.73:0/2392391873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5615fa661a40 0x5615fa66bf90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4005850 tx=0x7f9dd402f410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16648806eaab3fa5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:02:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.992+0000 7f9dcd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T12:02:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.992+0000 7f9dcd7fa700 1 -- 172.21.15.73:0/2392391873 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd402b040 con 0x5615fa661a40 2023-08-10T12:02:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.992+0000 7f9dcd7fa700 1 -- 172.21.15.73:0/2392391873 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f9dd400f8c0 con 0x5615fa661a40 2023-08-10T12:02:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.992+0000 7f9df80c4b80 1 -- 172.21.15.73:0/2392391873 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9dd401e040 con 0x5615fa661a40 2023-08-10T12:02:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.992+0000 7f9dcd7fa700 1 -- 172.21.15.73:0/2392391873 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9dd400fa80 con 0x5615fa661a40 2023-08-10T12:02:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.992+0000 7f9df80c4b80 10 client.26428 fetch_fsmap learned FSMap version 55 2023-08-10T12:02:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.992+0000 7f9df80c4b80 1 -- 172.21.15.73:0/2392391873 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x5615fa4011f0 con 0x5615fa661a40 2023-08-10T12:02:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.993+0000 7f9dcd7fa700 1 -- 172.21.15.73:0/2392391873 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9dd4056020 con 0x5615fa661a40 2023-08-10T12:02:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.994+0000 7f9dcd7fa700 1 -- 172.21.15.73:0/2392391873 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7f9dd400fbe0 con 0x5615fa661a40 2023-08-10T12:02:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.994+0000 7f9df80c4b80 10 client.26428 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:02:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.994+0000 7f9df80c4b80 10 client.26428 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:02:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.994+0000 7f9df80c4b80 20 client.26428 populate_metadata read hostname 'smithi073' 2023-08-10T12:02:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.994+0000 7f9df80c4b80 1 --2- 172.21.15.73:0/2392391873 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5615fa6cb570 0x5615fa6cd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.994+0000 7f9df80c4b80 4 client.26428 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T12:02:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.994+0000 7f9df80c4b80 1 -- 172.21.15.73:0/2392391873 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5615fa5a6720 con 0x5615fa6cb570 2023-08-10T12:02:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.994+0000 7f9de9cc7700 1 --2- 172.21.15.73:0/2392391873 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5615fa6cb570 0x5615fa6cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.994+0000 7f9de9cc7700 1 --2- 172.21.15.73:0/2392391873 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5615fa6cb570 0x5615fa6cd990 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69b6ed902a73104e server_cookie=2bed62cc2c2da353 in_seq=0 out_seq=0 2023-08-10T12:02:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:19.994+0000 7f9dcd7fa700 10 client.26428 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:02:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:20.072+0000 7f9dcd7fa700 1 -- 172.21.15.73:0/2392391873 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5615fa5a6720 con 0x5615fa6cb570 2023-08-10T12:02:20.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:20.072+0000 7f9dcd7fa700 10 client.26428 handle_command_reply: tid=0 2023-08-10T12:02:20.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:20.072+0000 7f9df80c4b80 1 client.26428 shutdown 2023-08-10T12:02:20.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:20.072+0000 7f9df80c4b80 1 -- 172.21.15.73:0/2392391873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5615fa661a40 msgr2=0x5615fa66bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:20.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:20.072+0000 7f9df80c4b80 1 --2- 172.21.15.73:0/2392391873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5615fa661a40 0x5615fa66bf90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4005850 tx=0x7f9dd402f410 comp rx=0 tx=0).stop 2023-08-10T12:02:20.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:20.073+0000 7f9df80c4b80 1 -- 172.21.15.73:0/2392391873 shutdown_connections 2023-08-10T12:02:20.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:20.073+0000 7f9df80c4b80 1 --2- 172.21.15.73:0/2392391873 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5615fa6cb570 0x5615fa6cd990 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:20.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:20.073+0000 7f9df80c4b80 1 --2- 172.21.15.73:0/2392391873 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615fa662360 0x5615fa6c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:20.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:20.073+0000 7f9dcd7fa700 0 client.26428 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:02:20.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:20.073+0000 7f9df80c4b80 1 --2- 172.21.15.73:0/2392391873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5615fa65c550 0x5615fa66ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:20.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:20.073+0000 7f9df80c4b80 1 --2- 172.21.15.73:0/2392391873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5615fa661a40 0x5615fa66bf90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:20.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:20.073+0000 7f9df80c4b80 1 -- 172.21.15.73:0/2392391873 >> 172.21.15.73:0/2392391873 conn(0x5615fa5b9c70 msgr2=0x5615fa662740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:02:20.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:20.073+0000 7f9df80c4b80 1 -- 172.21.15.73:0/2392391873 shutdown_connections 2023-08-10T12:02:20.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:20.073+0000 7f9df80c4b80 1 -- 172.21.15.73:0/2392391873 wait complete. 2023-08-10T12:02:20.077 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:20.073+0000 7f9df80c4b80 20 client.26428 trim_cache size 0 max 16384 2023-08-10T12:02:20.077 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T12:02:20.077 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T12:02:20.077 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T12:02:20.077 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T12:02:20.078 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:20.073+0000 7f9debf2b700 1 -- 172.21.15.73:0/331793099 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f9dd00a12c0 msgr2=0x7f9dd00a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:20.078 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:20.073+0000 7f9debf2b700 1 --2- 172.21.15.73:0/331793099 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f9dd00a12c0 0x7f9dd00a3780 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400b2e0 tx=0x7f9dd4005fb0 comp rx=0 tx=0).stop 2023-08-10T12:02:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:20.073+0000 7f9debf2b700 1 -- 172.21.15.73:0/331793099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9de40ff800 msgr2=0x7f9de4106790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:20.073+0000 7f9debf2b700 1 --2- 172.21.15.73:0/331793099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9de40ff800 0x7f9de4106790 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f9de000e9a0 tx=0x7f9de000ed60 comp rx=0 tx=0).stop 2023-08-10T12:02:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:20.073+0000 7f9debf2b700 1 -- 172.21.15.73:0/331793099 shutdown_connections 2023-08-10T12:02:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:20.073+0000 7f9debf2b700 1 --2- 172.21.15.73:0/331793099 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f9dd00a12c0 0x7f9dd00a3780 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:20.073+0000 7f9debf2b700 1 --2- 172.21.15.73:0/331793099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9de4105650 0x7f9de41a4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:20.073+0000 7f9debf2b700 1 --2- 172.21.15.73:0/331793099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9de40ff800 0x7f9de4106790 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:20.080 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:20.073+0000 7f9debf2b700 1 --2- 172.21.15.73:0/331793099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9de41001c0 0x7f9de4106cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:20.080 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:20.073+0000 7f9debf2b700 1 -- 172.21.15.73:0/331793099 >> 172.21.15.73:0/331793099 conn(0x7f9de40775a0 msgr2=0x7f9de4101140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:02:20.080 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:20.074+0000 7f9debf2b700 1 -- 172.21.15.73:0/331793099 shutdown_connections 2023-08-10T12:02:20.080 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:20.074+0000 7f9debf2b700 1 -- 172.21.15.73:0/331793099 wait complete. 2023-08-10T12:02:21.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:21 smithi152 ceph-mon[130220]: pgmap v301: 97 pgs: 97 active+clean; 2.0 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 874 op/s 2023-08-10T12:02:21.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:21 smithi156 ceph-mon[130574]: pgmap v301: 97 pgs: 97 active+clean; 2.0 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 874 op/s 2023-08-10T12:02:21.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:21 smithi073 ceph-mon[128869]: pgmap v301: 97 pgs: 97 active+clean; 2.0 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 874 op/s 2023-08-10T12:02:23.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:23 smithi152 ceph-mon[130220]: pgmap v302: 97 pgs: 97 active+clean; 2.0 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 121 op/s 2023-08-10T12:02:23.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:23 smithi156 ceph-mon[130574]: pgmap v302: 97 pgs: 97 active+clean; 2.0 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 121 op/s 2023-08-10T12:02:23.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:23 smithi073 ceph-mon[128869]: pgmap v302: 97 pgs: 97 active+clean; 2.0 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 121 op/s 2023-08-10T12:02:25.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:24 smithi152 ceph-mon[130220]: osdmap e94: 12 total, 12 up, 12 in 2023-08-10T12:02:25.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:24 smithi152 ceph-mon[130220]: pgmap v304: 97 pgs: 97 active+clean; 2.0 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 214 op/s 2023-08-10T12:02:25.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:24 smithi156 ceph-mon[130574]: osdmap e94: 12 total, 12 up, 12 in 2023-08-10T12:02:25.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:24 smithi156 ceph-mon[130574]: pgmap v304: 97 pgs: 97 active+clean; 2.0 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 214 op/s 2023-08-10T12:02:25.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:24 smithi073 ceph-mon[128869]: osdmap e94: 12 total, 12 up, 12 in 2023-08-10T12:02:25.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:24 smithi073 ceph-mon[128869]: pgmap v304: 97 pgs: 97 active+clean; 2.0 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 214 op/s 2023-08-10T12:02:27.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:27 smithi152 ceph-mon[130220]: pgmap v305: 97 pgs: 97 active+clean; 2.0 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 264 op/s 2023-08-10T12:02:27.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:27 smithi156 ceph-mon[130574]: pgmap v305: 97 pgs: 97 active+clean; 2.0 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 264 op/s 2023-08-10T12:02:27.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:27 smithi073 ceph-mon[128869]: pgmap v305: 97 pgs: 97 active+clean; 2.0 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 264 op/s 2023-08-10T12:02:29.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:29 smithi152 ceph-mon[130220]: pgmap v306: 97 pgs: 97 active+clean; 2.0 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 272 op/s 2023-08-10T12:02:29.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:29 smithi156 ceph-mon[130574]: pgmap v306: 97 pgs: 97 active+clean; 2.0 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 272 op/s 2023-08-10T12:02:29.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:29 smithi073 ceph-mon[128869]: pgmap v306: 97 pgs: 97 active+clean; 2.0 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 272 op/s 2023-08-10T12:02:31.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:31 smithi152 ceph-mon[130220]: pgmap v307: 97 pgs: 97 active+clean; 2.0 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.0 MiB/s wr, 339 op/s 2023-08-10T12:02:31.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:31 smithi156 ceph-mon[130574]: pgmap v307: 97 pgs: 97 active+clean; 2.0 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.0 MiB/s wr, 339 op/s 2023-08-10T12:02:31.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:31 smithi073 ceph-mon[128869]: pgmap v307: 97 pgs: 97 active+clean; 2.0 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.0 MiB/s wr, 339 op/s 2023-08-10T12:02:33.192 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.191+0000 7fe109617700 1 -- 172.21.15.73:0/1263320215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe104100490 msgr2=0x7fe104104230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:33.192 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.191+0000 7fe109617700 1 --2- 172.21.15.73:0/1263320215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe104100490 0x7fe104104230 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8009990 tx=0x7fe0f8009ca0 comp rx=0 tx=0).stop 2023-08-10T12:02:33.192 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.191+0000 7fe109617700 1 -- 172.21.15.73:0/1263320215 shutdown_connections 2023-08-10T12:02:33.193 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.191+0000 7fe109617700 1 --2- 172.21.15.73:0/1263320215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1040ffae0 0x7fe1040ffec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:33.193 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.191+0000 7fe109617700 1 --2- 172.21.15.73:0/1263320215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe104104960 0x7fe10410c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:33.193 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.191+0000 7fe109617700 1 --2- 172.21.15.73:0/1263320215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe104100490 0x7fe104104230 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:33.193 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.191+0000 7fe109617700 1 -- 172.21.15.73:0/1263320215 >> 172.21.15.73:0/1263320215 conn(0x7fe104077520 msgr2=0x7fe104077930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:02:33.193 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.191+0000 7fe109617700 1 -- 172.21.15.73:0/1263320215 shutdown_connections 2023-08-10T12:02:33.193 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.191+0000 7fe109617700 1 -- 172.21.15.73:0/1263320215 wait complete. 2023-08-10T12:02:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.192+0000 7fe109617700 1 Processor -- start 2023-08-10T12:02:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.192+0000 7fe109617700 1 -- start start 2023-08-10T12:02:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.192+0000 7fe109617700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1040ffae0 0x7fe104197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.192+0000 7fe109617700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe104100490 0x7fe104197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.192+0000 7fe109617700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe104104960 0x7fe1041a27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.192+0000 7fe109617700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1041a2da0 con 0x7fe104104960 2023-08-10T12:02:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.192+0000 7fe109617700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1041a2f10 con 0x7fe104100490 2023-08-10T12:02:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.192+0000 7fe109617700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1041a30d0 con 0x7fe1040ffae0 2023-08-10T12:02:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.192+0000 7fe102ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1040ffae0 0x7fe104197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.192+0000 7fe1037fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe104104960 0x7fe1041a27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.192+0000 7fe102ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1040ffae0 0x7fe104197930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:33850/0 (socket says 172.21.15.73:33850) 2023-08-10T12:02:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.192+0000 7fe102ffd700 1 -- 172.21.15.73:0/2866822661 learned_addr learned my addr 172.21.15.73:0/2866822661 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:02:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.192+0000 7fe1027fc700 1 --2- 172.21.15.73:0/2866822661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe104100490 0x7fe104197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.192+0000 7fe102ffd700 1 -- 172.21.15.73:0/2866822661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe104100490 msgr2=0x7fe104197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.193+0000 7fe102ffd700 1 --2- 172.21.15.73:0/2866822661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe104100490 0x7fe104197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.193+0000 7fe102ffd700 1 -- 172.21.15.73:0/2866822661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe104104960 msgr2=0x7fe1041a27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.193+0000 7fe102ffd700 1 --2- 172.21.15.73:0/2866822661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe104104960 0x7fe1041a27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.193+0000 7fe102ffd700 1 -- 172.21.15.73:0/2866822661 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f80095f0 con 0x7fe1040ffae0 2023-08-10T12:02:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.193+0000 7fe102ffd700 1 --2- 172.21.15.73:0/2866822661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1040ffae0 0x7fe104197930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400e9a0 tx=0x7fe0f400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:02:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.193+0000 7fe0ebfff700 1 -- 172.21.15.73:0/2866822661 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4009790 con 0x7fe1040ffae0 2023-08-10T12:02:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.193+0000 7fe109617700 1 -- 172.21.15.73:0/2866822661 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1041a33b0 con 0x7fe1040ffae0 2023-08-10T12:02:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.193+0000 7fe0ebfff700 1 -- 172.21.15.73:0/2866822661 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe0f4010430 con 0x7fe1040ffae0 2023-08-10T12:02:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.193+0000 7fe0ebfff700 1 -- 172.21.15.73:0/2866822661 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4018680 con 0x7fe1040ffae0 2023-08-10T12:02:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.193+0000 7fe109617700 1 -- 172.21.15.73:0/2866822661 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1041a38e0 con 0x7fe1040ffae0 2023-08-10T12:02:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.195+0000 7fe0ebfff700 1 -- 172.21.15.73:0/2866822661 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fe0f40105a0 con 0x7fe1040ffae0 2023-08-10T12:02:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.196+0000 7fe0ebfff700 1 --2- 172.21.15.73:0/2866822661 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe0ec0a1340 0x7fe0ec0a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.196+0000 7fe1027fc700 1 --2- 172.21.15.73:0/2866822661 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe0ec0a1340 0x7fe0ec0a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.196+0000 7fe0ebfff700 1 -- 172.21.15.73:0/2866822661 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe0f4014070 con 0x7fe1040ffae0 2023-08-10T12:02:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.196+0000 7fe1157b0b80 1 Processor -- start 2023-08-10T12:02:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.196+0000 7fe1157b0b80 1 -- start start 2023-08-10T12:02:33.204 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.196+0000 7fe1027fc700 1 --2- 172.21.15.73:0/2866822661 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe0ec0a1340 0x7fe0ec0a3800 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe0f800b2e0 tx=0x7fe0f8005fb0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:02:33.204 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.196+0000 7fe1157b0b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd4a40 0x55dd5fdd4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:33.204 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.196+0000 7fe1157b0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd5fdd5360 0x55dd5fdcf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:33.204 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.196+0000 7fe1157b0b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd5fdcf550 0x55dd5fdcf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:33.204 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.196+0000 7fe1157b0b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5fd4ad60 con 0x55dd5fdd4a40 2023-08-10T12:02:33.204 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.196+0000 7fe1157b0b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5fd27530 con 0x55dd5fdcf550 2023-08-10T12:02:33.204 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.196+0000 7fe1157b0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5fd24e50 con 0x55dd5fdd5360 2023-08-10T12:02:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.197+0000 7fe102ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd4a40 0x55dd5fdd4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.197+0000 7fe102ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd4a40 0x55dd5fdd4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36586/0 (socket says 172.21.15.73:36586) 2023-08-10T12:02:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.197+0000 7fe102ffd700 1 -- 172.21.15.73:0/503217748 learned_addr learned my addr 172.21.15.73:0/503217748 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:02:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.197+0000 7fe1037fe700 1 --2- 172.21.15.73:0/503217748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd5fdcf550 0x55dd5fdcf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.197+0000 7fe1027fc700 1 --2- 172.21.15.73:0/503217748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd5fdd5360 0x55dd5fdcf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.197+0000 7fe102ffd700 1 -- 172.21.15.73:0/503217748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd5fdd5360 msgr2=0x55dd5fdcf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.197+0000 7fe102ffd700 1 --2- 172.21.15.73:0/503217748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd5fdd5360 0x55dd5fdcf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.197+0000 7fe102ffd700 1 -- 172.21.15.73:0/503217748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd5fdcf550 msgr2=0x55dd5fdcf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.197+0000 7fe102ffd700 1 --2- 172.21.15.73:0/503217748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd5fdcf550 0x55dd5fdcf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.197+0000 7fe102ffd700 1 -- 172.21.15.73:0/503217748 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd5fba15d0 con 0x55dd5fdd4a40 2023-08-10T12:02:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.197+0000 7fe102ffd700 1 --2- 172.21.15.73:0/503217748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd4a40 0x55dd5fdd4e20 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4096a20 tx=0x7fe0f4099c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea2414a2251c92d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:02:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.197+0000 7fe0e97fa700 1 -- 172.21.15.73:0/503217748 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f40a2400 con 0x55dd5fdd4a40 2023-08-10T12:02:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.197+0000 7fe0e97fa700 1 -- 172.21.15.73:0/503217748 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe0f4010880 con 0x55dd5fdd4a40 2023-08-10T12:02:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.197+0000 7fe0e97fa700 1 -- 172.21.15.73:0/503217748 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f40a1f70 con 0x55dd5fdd4a40 2023-08-10T12:02:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.198+0000 7fe1157b0b80 1 -- 172.21.15.73:0/503217748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd4a40 msgr2=0x55dd5fdd4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.198+0000 7fe1157b0b80 1 --2- 172.21.15.73:0/503217748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd4a40 0x55dd5fdd4e20 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4096a20 tx=0x7fe0f4099c20 comp rx=0 tx=0).stop 2023-08-10T12:02:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.198+0000 7fe1157b0b80 1 -- 172.21.15.73:0/503217748 shutdown_connections 2023-08-10T12:02:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.198+0000 7fe1157b0b80 1 --2- 172.21.15.73:0/503217748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd5fdcf550 0x55dd5fdcf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.198+0000 7fe1157b0b80 1 --2- 172.21.15.73:0/503217748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd4a40 0x55dd5fdd4e20 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.198+0000 7fe1157b0b80 1 --2- 172.21.15.73:0/503217748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd5fdd5360 0x55dd5fdcf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.198+0000 7fe1157b0b80 1 -- 172.21.15.73:0/503217748 >> 172.21.15.73:0/503217748 conn(0x55dd5fd2cc70 msgr2=0x55dd5fdc9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:02:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.198+0000 7fe1157b0b80 1 -- 172.21.15.73:0/503217748 shutdown_connections 2023-08-10T12:02:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.198+0000 7fe1157b0b80 1 -- 172.21.15.73:0/503217748 wait complete. 2023-08-10T12:02:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.198+0000 7fe1157b0b80 1 -- start start 2023-08-10T12:02:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.198+0000 7fe1157b0b80 1 Processor -- start 2023-08-10T12:02:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.199+0000 7fe1157b0b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd5fdcf550 0x55dd5fddb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.199+0000 7fe1157b0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd5fdd4a40 0x55dd5fdd85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.199+0000 7fe1157b0b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd5360 0x55dd5fdd8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.199+0000 7fe1157b0b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5fd20740 con 0x55dd5fdd5360 2023-08-10T12:02:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.199+0000 7fe1157b0b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5fcbfa60 con 0x55dd5fdcf550 2023-08-10T12:02:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.199+0000 7fe1157b0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5fcbf760 con 0x55dd5fdd4a40 2023-08-10T12:02:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.199+0000 7fe1157b0b80 10 client.0 _ll_register_callbacks cb 0x55dd5fcbd620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:02:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.199+0000 7fe1037fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd5360 0x55dd5fdd8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.199+0000 7fe1027fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd5fdd4a40 0x55dd5fdd85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.199+0000 7fe1037fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd5360 0x55dd5fdd8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36596/0 (socket says 172.21.15.73:36596) 2023-08-10T12:02:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.199+0000 7fe1037fe700 1 -- 172.21.15.73:0/119713229 learned_addr learned my addr 172.21.15.73:0/119713229 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:02:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.199+0000 7fe102ffd700 1 --2- 172.21.15.73:0/119713229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd5fdcf550 0x55dd5fddb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.199+0000 7fe1037fe700 1 -- 172.21.15.73:0/119713229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd5fdd4a40 msgr2=0x55dd5fdd85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.199+0000 7fe1037fe700 1 --2- 172.21.15.73:0/119713229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd5fdd4a40 0x55dd5fdd85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.199+0000 7fe1037fe700 1 -- 172.21.15.73:0/119713229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd5fdcf550 msgr2=0x55dd5fddb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.199+0000 7fe1037fe700 1 --2- 172.21.15.73:0/119713229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd5fdcf550 0x55dd5fddb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.199+0000 7fe1037fe700 1 -- 172.21.15.73:0/119713229 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1041a38e0 con 0x55dd5fdd5360 2023-08-10T12:02:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.199+0000 7fe1037fe700 1 --2- 172.21.15.73:0/119713229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd5360 0x55dd5fdd8d30 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc012e80 tx=0x7fe0fc014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2030ad0bb69f8c24 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:02:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.199+0000 7fe0e6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:02:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.199+0000 7fe0e6ff5700 1 -- 172.21.15.73:0/119713229 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc00e040 con 0x55dd5fdd5360 2023-08-10T12:02:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.199+0000 7fe0e6ff5700 1 -- 172.21.15.73:0/119713229 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe0fc014ae0 con 0x55dd5fdd5360 2023-08-10T12:02:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.199+0000 7fe1157b0b80 1 -- 172.21.15.73:0/119713229 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dd5fdc21c0 con 0x55dd5fdd5360 2023-08-10T12:02:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.200+0000 7fe0e6ff5700 1 -- 172.21.15.73:0/119713229 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0fc014ce0 con 0x55dd5fdd5360 2023-08-10T12:02:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.200+0000 7fe1157b0b80 10 client.16980 fetch_fsmap learned FSMap version 55 2023-08-10T12:02:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.200+0000 7fe1157b0b80 1 -- 172.21.15.73:0/119713229 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55dd5fb4dd80 con 0x55dd5fdd5360 2023-08-10T12:02:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.200+0000 7fe0e6ff5700 1 -- 172.21.15.73:0/119713229 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55dd5fdc21c0 con 0x55dd5fdd5360 2023-08-10T12:02:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.200+0000 7fe0e6ff5700 1 -- 172.21.15.73:0/119713229 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7fe0fc01c020 con 0x55dd5fdd5360 2023-08-10T12:02:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.200+0000 7fe1157b0b80 10 client.16980 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:02:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.200+0000 7fe1157b0b80 10 client.16980 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:02:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.200+0000 7fe1157b0b80 20 client.16980 populate_metadata read hostname 'smithi073' 2023-08-10T12:02:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.200+0000 7fe1157b0b80 1 --2- 172.21.15.73:0/119713229 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55dd5fde8e80 0x55dd5fdeb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.200+0000 7fe1157b0b80 4 client.16980 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:02:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.200+0000 7fe1157b0b80 1 -- 172.21.15.73:0/119713229 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dd5fd9e970 con 0x55dd5fde8e80 2023-08-10T12:02:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.200+0000 7fe102ffd700 1 --2- 172.21.15.73:0/119713229 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55dd5fde8e80 0x55dd5fdeb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:33.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.200+0000 7fe102ffd700 1 --2- 172.21.15.73:0/119713229 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55dd5fde8e80 0x55dd5fdeb2a0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29e6dc7d3f906169 server_cookie=5c568e90fbface3a in_seq=0 out_seq=0 2023-08-10T12:02:33.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.200+0000 7fe0e6ff5700 10 client.16980 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:02:33.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.201+0000 7fe0e6ff5700 1 -- 172.21.15.73:0/119713229 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55dd5fd9e970 con 0x55dd5fde8e80 2023-08-10T12:02:33.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.201+0000 7fe0e6ff5700 10 client.16980 handle_command_reply: tid=0 2023-08-10T12:02:33.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.201+0000 7fe1157b0b80 1 client.16980 shutdown 2023-08-10T12:02:33.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.201+0000 7fe1157b0b80 1 -- 172.21.15.73:0/119713229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd5360 msgr2=0x55dd5fdd8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:33.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.201+0000 7fe1157b0b80 1 --2- 172.21.15.73:0/119713229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd5360 0x55dd5fdd8d30 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc012e80 tx=0x7fe0fc014600 comp rx=0 tx=0).stop 2023-08-10T12:02:33.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.201+0000 7fe1157b0b80 1 -- 172.21.15.73:0/119713229 shutdown_connections 2023-08-10T12:02:33.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.201+0000 7fe1157b0b80 1 --2- 172.21.15.73:0/119713229 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55dd5fde8e80 0x55dd5fdeb2a0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:33.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.201+0000 7fe1157b0b80 1 --2- 172.21.15.73:0/119713229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd5fdcf550 0x55dd5fddb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:33.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.201+0000 7fe0e6ff5700 0 client.16980 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:02:33.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.201+0000 7fe1157b0b80 1 --2- 172.21.15.73:0/119713229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd5360 0x55dd5fdd8d30 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:33.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.201+0000 7fe1157b0b80 1 --2- 172.21.15.73:0/119713229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd5fdd4a40 0x55dd5fdd85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:33.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.201+0000 7fe1157b0b80 1 -- 172.21.15.73:0/119713229 >> 172.21.15.73:0/119713229 conn(0x55dd5fd2cc70 msgr2=0x55dd5fdc94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:02:33.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.201+0000 7fe1157b0b80 1 -- 172.21.15.73:0/119713229 shutdown_connections 2023-08-10T12:02:33.215 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.201+0000 7fe1157b0b80 1 -- 172.21.15.73:0/119713229 wait complete. 2023-08-10T12:02:33.215 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.201+0000 7fe1157b0b80 20 client.16980 trim_cache size 0 max 16384 2023-08-10T12:02:33.216 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.216+0000 7fe1157b0b80 1 Processor -- start 2023-08-10T12:02:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.216+0000 7fe1157b0b80 1 -- start start 2023-08-10T12:02:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.216+0000 7fe1157b0b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd5fdcf550 0x55dd5fdd85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.216+0000 7fe1157b0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd5fdd4a40 0x55dd5fddfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.216+0000 7fe1157b0b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd5360 0x55dd5fdc9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.216+0000 7fe1157b0b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5fba38c0 con 0x55dd5fdd5360 2023-08-10T12:02:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.216+0000 7fe1157b0b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5fde4d60 con 0x55dd5fdcf550 2023-08-10T12:02:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.216+0000 7fe1157b0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5fdc4730 con 0x55dd5fdd4a40 2023-08-10T12:02:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.217+0000 7fe102ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd5fdcf550 0x55dd5fdd85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.217+0000 7fe1037fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd5360 0x55dd5fdc9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.217+0000 7fe1027fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd5fdd4a40 0x55dd5fddfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.217+0000 7fe102ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd5fdcf550 0x55dd5fdd85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:51250/0 (socket says 172.21.15.73:51250) 2023-08-10T12:02:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.217+0000 7fe1037fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd5360 0x55dd5fdc9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36604/0 (socket says 172.21.15.73:36604) 2023-08-10T12:02:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.217+0000 7fe1027fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd5fdd4a40 0x55dd5fddfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:33874/0 (socket says 172.21.15.73:33874) 2023-08-10T12:02:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.217+0000 7fe102ffd700 1 -- 172.21.15.73:0/984282276 learned_addr learned my addr 172.21.15.73:0/984282276 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:02:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.217+0000 7fe1037fe700 1 -- 172.21.15.73:0/984282276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd5fdd4a40 msgr2=0x55dd5fddfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.217+0000 7fe1037fe700 1 --2- 172.21.15.73:0/984282276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd5fdd4a40 0x55dd5fddfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:33.221 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.217+0000 7fe1037fe700 1 -- 172.21.15.73:0/984282276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd5fdcf550 msgr2=0x55dd5fdd85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:33.221 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.217+0000 7fe1037fe700 1 --2- 172.21.15.73:0/984282276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd5fdcf550 0x55dd5fdd85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:33.221 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.217+0000 7fe1037fe700 1 -- 172.21.15.73:0/984282276 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd5fb36c00 con 0x55dd5fdd5360 2023-08-10T12:02:33.221 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.217+0000 7fe1027fc700 1 --2- 172.21.15.73:0/984282276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd5fdd4a40 0x55dd5fddfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:02:33.221 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.217+0000 7fe102ffd700 1 --2- 172.21.15.73:0/984282276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd5fdcf550 0x55dd5fdd85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:02:33.221 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.217+0000 7fe1037fe700 1 --2- 172.21.15.73:0/984282276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd5360 0x55dd5fdc9c30 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc00b010 tx=0x7fe0fc004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccbb35e57ab56755 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:02:33.221 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.217+0000 7fe0e9ffb700 1 -- 172.21.15.73:0/984282276 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc00e070 con 0x55dd5fdd5360 2023-08-10T12:02:33.221 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.217+0000 7fe0e9ffb700 1 -- 172.21.15.73:0/984282276 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe0fc00f040 con 0x55dd5fdd5360 2023-08-10T12:02:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.217+0000 7fe0e9ffb700 1 -- 172.21.15.73:0/984282276 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc0077e0 con 0x55dd5fdd5360 2023-08-10T12:02:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.218+0000 7fe1157b0b80 1 -- 172.21.15.73:0/984282276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd5360 msgr2=0x55dd5fdc9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.218+0000 7fe1157b0b80 1 --2- 172.21.15.73:0/984282276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd5360 0x55dd5fdc9c30 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc00b010 tx=0x7fe0fc004760 comp rx=0 tx=0).stop 2023-08-10T12:02:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.218+0000 7fe1157b0b80 1 -- 172.21.15.73:0/984282276 shutdown_connections 2023-08-10T12:02:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.218+0000 7fe1157b0b80 1 --2- 172.21.15.73:0/984282276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd5fdcf550 0x55dd5fdd85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.218+0000 7fe1157b0b80 1 --2- 172.21.15.73:0/984282276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd5360 0x55dd5fdc9c30 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.218+0000 7fe1157b0b80 1 --2- 172.21.15.73:0/984282276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd5fdd4a40 0x55dd5fddfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.218+0000 7fe1157b0b80 1 -- 172.21.15.73:0/984282276 >> 172.21.15.73:0/984282276 conn(0x55dd5fd2cc70 msgr2=0x55dd5fdd7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:02:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.218+0000 7fe1157b0b80 1 -- 172.21.15.73:0/984282276 shutdown_connections 2023-08-10T12:02:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.218+0000 7fe1157b0b80 1 -- 172.21.15.73:0/984282276 wait complete. 2023-08-10T12:02:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.218+0000 7fe1157b0b80 1 -- start start 2023-08-10T12:02:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.218+0000 7fe1157b0b80 1 Processor -- start 2023-08-10T12:02:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.219+0000 7fe1157b0b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd5fdcf550 0x55dd5fdddff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.219+0000 7fe1157b0b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd4a40 0x55dd5fdde530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.219+0000 7fe1157b0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd5fdd5360 0x55dd5fe35ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.219+0000 7fe1157b0b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5fe36070 con 0x55dd5fdd4a40 2023-08-10T12:02:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.219+0000 7fe1157b0b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5fe361e0 con 0x55dd5fdcf550 2023-08-10T12:02:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.219+0000 7fe1157b0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5fe363a0 con 0x55dd5fdd5360 2023-08-10T12:02:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.219+0000 7fe1157b0b80 10 client.0 _ll_register_callbacks cb 0x55dd5fcbd620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:02:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.219+0000 7fe1027fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd4a40 0x55dd5fdde530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.219+0000 7fe1027fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd4a40 0x55dd5fdde530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36610/0 (socket says 172.21.15.73:36610) 2023-08-10T12:02:33.227 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.219+0000 7fe1027fc700 1 -- 172.21.15.73:0/3815283837 learned_addr learned my addr 172.21.15.73:0/3815283837 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:02:33.227 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.219+0000 7fe1037fe700 1 --2- 172.21.15.73:0/3815283837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd5fdd5360 0x55dd5fe35ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:33.227 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.219+0000 7fe102ffd700 1 --2- 172.21.15.73:0/3815283837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd5fdcf550 0x55dd5fdddff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:33.227 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.219+0000 7fe1027fc700 1 -- 172.21.15.73:0/3815283837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd5fdd5360 msgr2=0x55dd5fe35ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:33.227 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.219+0000 7fe1027fc700 1 --2- 172.21.15.73:0/3815283837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd5fdd5360 0x55dd5fe35ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:33.227 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.219+0000 7fe1027fc700 1 -- 172.21.15.73:0/3815283837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd5fdcf550 msgr2=0x55dd5fdddff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:33.227 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.219+0000 7fe1027fc700 1 --2- 172.21.15.73:0/3815283837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd5fdcf550 0x55dd5fdddff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:33.227 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.219+0000 7fe1027fc700 1 -- 172.21.15.73:0/3815283837 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dd5fba15d0 con 0x55dd5fdd4a40 2023-08-10T12:02:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.219+0000 7fe1027fc700 1 --2- 172.21.15.73:0/3815283837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd4a40 0x55dd5fdde530 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8009990 tx=0x7fe0f8009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8420a3b0e55f03f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:02:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.219+0000 7fe0e6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:02:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.219+0000 7fe0e6ff5700 1 -- 172.21.15.73:0/3815283837 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8004c80 con 0x55dd5fdd4a40 2023-08-10T12:02:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.219+0000 7fe0e6ff5700 1 -- 172.21.15.73:0/3815283837 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe0f8004de0 con 0x55dd5fdd4a40 2023-08-10T12:02:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.219+0000 7fe1157b0b80 1 -- 172.21.15.73:0/3815283837 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe0f4010880 con 0x55dd5fdd4a40 2023-08-10T12:02:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.219+0000 7fe0e6ff5700 1 -- 172.21.15.73:0/3815283837 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0f800f460 con 0x55dd5fdd4a40 2023-08-10T12:02:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.219+0000 7fe1157b0b80 10 client.16986 fetch_fsmap learned FSMap version 55 2023-08-10T12:02:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.219+0000 7fe1157b0b80 1 -- 172.21.15.73:0/3815283837 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x7fe10410cd70 con 0x55dd5fdd4a40 2023-08-10T12:02:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.220+0000 7fe0e6ff5700 1 -- 172.21.15.73:0/3815283837 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe0f4010880 con 0x55dd5fdd4a40 2023-08-10T12:02:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.220+0000 7fe0e6ff5700 1 -- 172.21.15.73:0/3815283837 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7fe0f8045640 con 0x55dd5fdd4a40 2023-08-10T12:02:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.220+0000 7fe1157b0b80 10 client.16986 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:02:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.220+0000 7fe1157b0b80 10 client.16986 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:02:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.220+0000 7fe1157b0b80 20 client.16986 populate_metadata read hostname 'smithi073' 2023-08-10T12:02:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.220+0000 7fe1157b0b80 1 --2- 172.21.15.73:0/3815283837 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55dd5fe3dc70 0x55dd5fe40090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.220+0000 7fe1157b0b80 4 client.16986 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T12:02:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.220+0000 7fe1157b0b80 1 -- 172.21.15.73:0/3815283837 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dd5fd19720 con 0x55dd5fe3dc70 2023-08-10T12:02:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.220+0000 7fe102ffd700 1 --2- 172.21.15.73:0/3815283837 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55dd5fe3dc70 0x55dd5fe40090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.220+0000 7fe0e6ff5700 10 client.16986 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:02:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:33.220+0000 7fe102ffd700 1 --2- 172.21.15.73:0/3815283837 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55dd5fe3dc70 0x55dd5fe40090 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e59174abcae3897 server_cookie=6b54e720f8d268e1 in_seq=0 out_seq=0 2023-08-10T12:02:33.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:33 smithi152 ceph-mon[130220]: pgmap v308: 97 pgs: 97 active+clean; 2.0 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 312 op/s 2023-08-10T12:02:33.517 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:33 smithi156 ceph-mon[130574]: pgmap v308: 97 pgs: 97 active+clean; 2.0 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 312 op/s 2023-08-10T12:02:33.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:33 smithi073 ceph-mon[128869]: pgmap v308: 97 pgs: 97 active+clean; 2.0 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 312 op/s 2023-08-10T12:02:35.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:34 smithi152 ceph-mon[130220]: pgmap v309: 97 pgs: 97 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 347 op/s 2023-08-10T12:02:35.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:34 smithi156 ceph-mon[130574]: pgmap v309: 97 pgs: 97 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 347 op/s 2023-08-10T12:02:35.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:34 smithi073 ceph-mon[128869]: pgmap v309: 97 pgs: 97 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 347 op/s 2023-08-10T12:02:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:37.197+0000 7fe0e6ff5700 1 -- 172.21.15.73:0/3815283837 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dd5fd19720 con 0x55dd5fe3dc70 2023-08-10T12:02:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:37.197+0000 7fe0e6ff5700 10 client.16986 handle_command_reply: tid=0 2023-08-10T12:02:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:37.197+0000 7fe1157b0b80 1 client.16986 shutdown 2023-08-10T12:02:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:37.197+0000 7fe1157b0b80 1 -- 172.21.15.73:0/3815283837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd4a40 msgr2=0x55dd5fdde530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:37.197+0000 7fe1157b0b80 1 --2- 172.21.15.73:0/3815283837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd4a40 0x55dd5fdde530 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8009990 tx=0x7fe0f8009ca0 comp rx=0 tx=0).stop 2023-08-10T12:02:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:37.197+0000 7fe1157b0b80 1 -- 172.21.15.73:0/3815283837 shutdown_connections 2023-08-10T12:02:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:37.197+0000 7fe1157b0b80 1 --2- 172.21.15.73:0/3815283837 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55dd5fe3dc70 0x55dd5fe40090 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:37.197+0000 7fe1157b0b80 1 --2- 172.21.15.73:0/3815283837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dd5fdcf550 0x55dd5fdddff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:37.197+0000 7fe0e6ff5700 0 client.16986 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:02:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:37.197+0000 7fe1157b0b80 1 --2- 172.21.15.73:0/3815283837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd5fdd5360 0x55dd5fe35ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:37.197+0000 7fe1157b0b80 1 --2- 172.21.15.73:0/3815283837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55dd5fdd4a40 0x55dd5fdde530 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:37.197+0000 7fe1157b0b80 1 -- 172.21.15.73:0/3815283837 >> 172.21.15.73:0/3815283837 conn(0x55dd5fd2cc70 msgr2=0x55dd5fdd4080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:02:37.200 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:37.197+0000 7fe1157b0b80 1 -- 172.21.15.73:0/3815283837 shutdown_connections 2023-08-10T12:02:37.200 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:37.197+0000 7fe1157b0b80 1 -- 172.21.15.73:0/3815283837 wait complete. 2023-08-10T12:02:37.200 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:37.197+0000 7fe1157b0b80 20 client.16986 trim_cache size 0 max 16384 2023-08-10T12:02:37.200 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T12:02:37.200 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T12:02:37.200 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T12:02:37.201 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T12:02:37.201 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:37.198+0000 7fe109617700 1 -- 172.21.15.73:0/2866822661 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe0ec0a1340 msgr2=0x7fe0ec0a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:37.201 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:37.198+0000 7fe109617700 1 --2- 172.21.15.73:0/2866822661 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe0ec0a1340 0x7fe0ec0a3800 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe0f800b2e0 tx=0x7fe0f8005fb0 comp rx=0 tx=0).stop 2023-08-10T12:02:37.202 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:37.198+0000 7fe109617700 1 -- 172.21.15.73:0/2866822661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1040ffae0 msgr2=0x7fe104197930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:37.202 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:37.198+0000 7fe109617700 1 --2- 172.21.15.73:0/2866822661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1040ffae0 0x7fe104197930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400e9a0 tx=0x7fe0f400ecb0 comp rx=0 tx=0).stop 2023-08-10T12:02:37.202 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:37.198+0000 7fe109617700 1 -- 172.21.15.73:0/2866822661 shutdown_connections 2023-08-10T12:02:37.202 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:37.198+0000 7fe109617700 1 --2- 172.21.15.73:0/2866822661 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fe0ec0a1340 0x7fe0ec0a3800 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:37.202 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:37.198+0000 7fe109617700 1 --2- 172.21.15.73:0/2866822661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe104104960 0x7fe1041a27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:37.202 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:37.198+0000 7fe109617700 1 --2- 172.21.15.73:0/2866822661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1040ffae0 0x7fe104197930 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:37.202 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:37.198+0000 7fe109617700 1 --2- 172.21.15.73:0/2866822661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe104100490 0x7fe104197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:37.198+0000 7fe109617700 1 -- 172.21.15.73:0/2866822661 >> 172.21.15.73:0/2866822661 conn(0x7fe104077520 msgr2=0x7fe104103210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:02:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:37.198+0000 7fe109617700 1 -- 172.21.15.73:0/2866822661 shutdown_connections 2023-08-10T12:02:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:37.198+0000 7fe109617700 1 -- 172.21.15.73:0/2866822661 wait complete. 2023-08-10T12:02:37.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:37 smithi152 ceph-mon[130220]: pgmap v310: 97 pgs: 97 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 473 op/s 2023-08-10T12:02:37.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:37 smithi156 ceph-mon[130574]: pgmap v310: 97 pgs: 97 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 473 op/s 2023-08-10T12:02:37.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:37 smithi073 ceph-mon[128869]: pgmap v310: 97 pgs: 97 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 473 op/s 2023-08-10T12:02:39.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:39 smithi152 ceph-mon[130220]: pgmap v311: 97 pgs: 97 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 453 op/s 2023-08-10T12:02:39.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:39 smithi156 ceph-mon[130574]: pgmap v311: 97 pgs: 97 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 453 op/s 2023-08-10T12:02:39.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:39 smithi073 ceph-mon[128869]: pgmap v311: 97 pgs: 97 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 453 op/s 2023-08-10T12:02:41.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:41 smithi152 ceph-mon[130220]: pgmap v312: 97 pgs: 97 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 573 op/s 2023-08-10T12:02:41.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:41 smithi156 ceph-mon[130574]: pgmap v312: 97 pgs: 97 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 573 op/s 2023-08-10T12:02:41.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:41 smithi073 ceph-mon[128869]: pgmap v312: 97 pgs: 97 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 573 op/s 2023-08-10T12:02:43.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:43 smithi152 ceph-mon[130220]: pgmap v313: 97 pgs: 97 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 1.1 MiB/s wr, 504 op/s 2023-08-10T12:02:43.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:43 smithi156 ceph-mon[130574]: pgmap v313: 97 pgs: 97 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 1.1 MiB/s wr, 504 op/s 2023-08-10T12:02:43.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:43 smithi073 ceph-mon[128869]: pgmap v313: 97 pgs: 97 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 1.1 MiB/s wr, 504 op/s 2023-08-10T12:02:45.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:44 smithi152 ceph-mon[130220]: pgmap v314: 97 pgs: 97 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 561 op/s 2023-08-10T12:02:45.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:44 smithi156 ceph-mon[130574]: pgmap v314: 97 pgs: 97 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 561 op/s 2023-08-10T12:02:45.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:44 smithi073 ceph-mon[128869]: pgmap v314: 97 pgs: 97 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 561 op/s 2023-08-10T12:02:47.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:47 smithi152 ceph-mon[130220]: pgmap v315: 97 pgs: 97 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 487 op/s 2023-08-10T12:02:47.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:47 smithi156 ceph-mon[130574]: pgmap v315: 97 pgs: 97 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 487 op/s 2023-08-10T12:02:47.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:47 smithi073 ceph-mon[128869]: pgmap v315: 97 pgs: 97 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 487 op/s 2023-08-10T12:02:49.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:49 smithi152 ceph-mon[130220]: pgmap v316: 97 pgs: 97 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 323 op/s 2023-08-10T12:02:49.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:49 smithi156 ceph-mon[130574]: pgmap v316: 97 pgs: 97 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 323 op/s 2023-08-10T12:02:49.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:49 smithi073 ceph-mon[128869]: pgmap v316: 97 pgs: 97 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 323 op/s 2023-08-10T12:02:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.311+0000 7fb3f57b5700 1 -- 172.21.15.73:0/135814684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3f0100250 msgr2=0x7fb3f010c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.312+0000 7fb3f57b5700 1 --2- 172.21.15.73:0/135814684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3f0100250 0x7fb3f010c600 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fb3e800b0a0 tx=0x7fb3e800b3b0 comp rx=0 tx=0).stop 2023-08-10T12:02:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.312+0000 7fb3f57b5700 1 -- 172.21.15.73:0/135814684 shutdown_connections 2023-08-10T12:02:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.312+0000 7fb3f57b5700 1 --2- 172.21.15.73:0/135814684 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3f0104780 0x7fb3f0104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.312+0000 7fb3f57b5700 1 --2- 172.21.15.73:0/135814684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3f0100250 0x7fb3f010c600 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.312+0000 7fb3f57b5700 1 --2- 172.21.15.73:0/135814684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3f00ff890 0x7fb3f00ffd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.312+0000 7fb3f57b5700 1 -- 172.21.15.73:0/135814684 >> 172.21.15.73:0/135814684 conn(0x7fb3f0076550 msgr2=0x7fb3f0076960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:02:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.312+0000 7fb3f57b5700 1 -- 172.21.15.73:0/135814684 shutdown_connections 2023-08-10T12:02:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.312+0000 7fb3f57b5700 1 -- 172.21.15.73:0/135814684 wait complete. 2023-08-10T12:02:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.312+0000 7fb3f57b5700 1 Processor -- start 2023-08-10T12:02:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.312+0000 7fb3f57b5700 1 -- start start 2023-08-10T12:02:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.313+0000 7fb3f57b5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3f00ff890 0x7fb3f0101400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.313+0000 7fb3f57b5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3f0100250 0x7fb3f0101940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.313+0000 7fb3f57b5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3f0104780 0x7fb3f01a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.313+0000 7fb3f57b5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f01a51a0 con 0x7fb3f00ff890 2023-08-10T12:02:50.317 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.313+0000 7fb3f57b5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f01a52e0 con 0x7fb3f0104780 2023-08-10T12:02:50.317 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.313+0000 7fb3f57b5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f01a5450 con 0x7fb3f0100250 2023-08-10T12:02:50.317 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.313+0000 7fb3eeffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3f00ff890 0x7fb3f0101400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:50.317 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.313+0000 7fb3eeffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3f00ff890 0x7fb3f0101400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36620/0 (socket says 172.21.15.73:36620) 2023-08-10T12:02:50.317 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.313+0000 7fb3eeffd700 1 -- 172.21.15.73:0/3235363231 learned_addr learned my addr 172.21.15.73:0/3235363231 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:02:50.317 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.313+0000 7fb3ee7fc700 1 --2- 172.21.15.73:0/3235363231 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3f0100250 0x7fb3f0101940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:50.317 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.313+0000 7fb3ef7fe700 1 --2- 172.21.15.73:0/3235363231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3f0104780 0x7fb3f01a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.313+0000 7fb3eeffd700 1 -- 172.21.15.73:0/3235363231 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3f0100250 msgr2=0x7fb3f0101940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.313+0000 7fb3eeffd700 1 --2- 172.21.15.73:0/3235363231 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3f0100250 0x7fb3f0101940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.313+0000 7fb3eeffd700 1 -- 172.21.15.73:0/3235363231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3f0104780 msgr2=0x7fb3f01a4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.313+0000 7fb3eeffd700 1 --2- 172.21.15.73:0/3235363231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3f0104780 0x7fb3f01a4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.313+0000 7fb3eeffd700 1 -- 172.21.15.73:0/3235363231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e8009d00 con 0x7fb3f00ff890 2023-08-10T12:02:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.313+0000 7fb3eeffd700 1 --2- 172.21.15.73:0/3235363231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3f00ff890 0x7fb3f0101400 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000e9a0 tx=0x7fb3e000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:02:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.313+0000 7fb3d7fff700 1 -- 172.21.15.73:0/3235363231 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0009790 con 0x7fb3f00ff890 2023-08-10T12:02:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.313+0000 7fb3f57b5700 1 -- 172.21.15.73:0/3235363231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f01a5730 con 0x7fb3f00ff890 2023-08-10T12:02:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.313+0000 7fb3d7fff700 1 -- 172.21.15.73:0/3235363231 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb3e0010430 con 0x7fb3f00ff890 2023-08-10T12:02:50.320 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.313+0000 7fb3d7fff700 1 -- 172.21.15.73:0/3235363231 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0018680 con 0x7fb3f00ff890 2023-08-10T12:02:50.320 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.313+0000 7fb3f57b5700 1 -- 172.21.15.73:0/3235363231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f01a5c40 con 0x7fb3f00ff890 2023-08-10T12:02:50.320 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.315+0000 7fb3d7fff700 1 -- 172.21.15.73:0/3235363231 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fb3e00105a0 con 0x7fb3f00ff890 2023-08-10T12:02:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.316+0000 7fb3d7fff700 1 --2- 172.21.15.73:0/3235363231 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb3d80a12c0 0x7fb3d80a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.316+0000 7fb3ee7fc700 1 --2- 172.21.15.73:0/3235363231 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb3d80a12c0 0x7fb3d80a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.316+0000 7fb3d7fff700 1 -- 172.21.15.73:0/3235363231 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb3e0014070 con 0x7fb3f00ff890 2023-08-10T12:02:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.316+0000 7fb3ee7fc700 1 --2- 172.21.15.73:0/3235363231 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb3d80a12c0 0x7fb3d80a3780 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0102c20 tx=0x7fb3e4009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:02:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.317+0000 7fb40194eb80 1 Processor -- start 2023-08-10T12:02:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.317+0000 7fb40194eb80 1 -- start start 2023-08-10T12:02:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.317+0000 7fb40194eb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f662a40 0x55671f662e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.317+0000 7fb40194eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55671f663360 0x55671f65d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:50.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.317+0000 7fb40194eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55671f65d550 0x55671f65d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:50.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.317+0000 7fb40194eb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55671f5d8d60 con 0x55671f662a40 2023-08-10T12:02:50.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.317+0000 7fb40194eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55671f5b5530 con 0x55671f663360 2023-08-10T12:02:50.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.317+0000 7fb40194eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55671f5b2e50 con 0x55671f65d550 2023-08-10T12:02:50.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.317+0000 7fb3eeffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f662a40 0x55671f662e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:50.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.317+0000 7fb3ee7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55671f663360 0x55671f65d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:50.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.317+0000 7fb3eeffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f662a40 0x55671f662e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36628/0 (socket says 172.21.15.73:36628) 2023-08-10T12:02:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.317+0000 7fb3eeffd700 1 -- 172.21.15.73:0/3358710776 learned_addr learned my addr 172.21.15.73:0/3358710776 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:02:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.317+0000 7fb3ef7fe700 1 --2- 172.21.15.73:0/3358710776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55671f65d550 0x55671f65d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.318+0000 7fb3eeffd700 1 -- 172.21.15.73:0/3358710776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55671f65d550 msgr2=0x55671f65d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.318+0000 7fb3eeffd700 1 --2- 172.21.15.73:0/3358710776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55671f65d550 0x55671f65d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.318+0000 7fb3eeffd700 1 -- 172.21.15.73:0/3358710776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55671f663360 msgr2=0x55671f65d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.318+0000 7fb3eeffd700 1 --2- 172.21.15.73:0/3358710776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55671f663360 0x55671f65d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.318+0000 7fb3eeffd700 1 -- 172.21.15.73:0/3358710776 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55671f42f5d0 con 0x55671f662a40 2023-08-10T12:02:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.318+0000 7fb3ee7fc700 1 --2- 172.21.15.73:0/3358710776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55671f663360 0x55671f65d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:02:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.318+0000 7fb3ef7fe700 1 --2- 172.21.15.73:0/3358710776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55671f65d550 0x55671f65d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:02:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.318+0000 7fb3eeffd700 1 --2- 172.21.15.73:0/3358710776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f662a40 0x55671f662e20 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fb3e00a1e40 tx=0x7fb3e0099900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31268b1cee55c9c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:02:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.318+0000 7fb3d57fa700 1 -- 172.21.15.73:0/3358710776 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e00a2370 con 0x55671f662a40 2023-08-10T12:02:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.318+0000 7fb3d57fa700 1 -- 172.21.15.73:0/3358710776 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb3e0010880 con 0x55671f662a40 2023-08-10T12:02:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.318+0000 7fb3d57fa700 1 -- 172.21.15.73:0/3358710776 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e00a1ee0 con 0x55671f662a40 2023-08-10T12:02:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.319+0000 7fb40194eb80 1 -- 172.21.15.73:0/3358710776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f662a40 msgr2=0x55671f662e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.319+0000 7fb40194eb80 1 --2- 172.21.15.73:0/3358710776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f662a40 0x55671f662e20 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fb3e00a1e40 tx=0x7fb3e0099900 comp rx=0 tx=0).stop 2023-08-10T12:02:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.319+0000 7fb40194eb80 1 -- 172.21.15.73:0/3358710776 shutdown_connections 2023-08-10T12:02:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.319+0000 7fb40194eb80 1 --2- 172.21.15.73:0/3358710776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55671f65d550 0x55671f65d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.319+0000 7fb40194eb80 1 --2- 172.21.15.73:0/3358710776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f662a40 0x55671f662e20 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.319+0000 7fb40194eb80 1 --2- 172.21.15.73:0/3358710776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55671f663360 0x55671f65d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.319+0000 7fb40194eb80 1 -- 172.21.15.73:0/3358710776 >> 172.21.15.73:0/3358710776 conn(0x55671f5bac70 msgr2=0x55671f657d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:02:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.319+0000 7fb40194eb80 1 -- 172.21.15.73:0/3358710776 shutdown_connections 2023-08-10T12:02:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.319+0000 7fb40194eb80 1 -- 172.21.15.73:0/3358710776 wait complete. 2023-08-10T12:02:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.319+0000 7fb40194eb80 1 -- start start 2023-08-10T12:02:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.319+0000 7fb40194eb80 1 Processor -- start 2023-08-10T12:02:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.319+0000 7fb40194eb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f65d550 0x55671f669440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.319+0000 7fb40194eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55671f662a40 0x55671f6666c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.320+0000 7fb40194eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55671f663360 0x55671f666e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.320+0000 7fb40194eb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55671f5ae740 con 0x55671f65d550 2023-08-10T12:02:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.320+0000 7fb40194eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55671f54da60 con 0x55671f663360 2023-08-10T12:02:50.331 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.320+0000 7fb40194eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55671f54d760 con 0x55671f662a40 2023-08-10T12:02:50.331 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.320+0000 7fb40194eb80 10 client.0 _ll_register_callbacks cb 0x55671f54b620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:02:50.331 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.320+0000 7fb3eeffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f65d550 0x55671f669440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:50.331 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.320+0000 7fb3eeffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f65d550 0x55671f669440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36634/0 (socket says 172.21.15.73:36634) 2023-08-10T12:02:50.331 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.320+0000 7fb3eeffd700 1 -- 172.21.15.73:0/3228434262 learned_addr learned my addr 172.21.15.73:0/3228434262 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:02:50.331 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.320+0000 7fb3ee7fc700 1 --2- 172.21.15.73:0/3228434262 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55671f662a40 0x55671f6666c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:50.331 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.320+0000 7fb3ef7fe700 1 --2- 172.21.15.73:0/3228434262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55671f663360 0x55671f666e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:50.332 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.320+0000 7fb3eeffd700 1 -- 172.21.15.73:0/3228434262 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55671f662a40 msgr2=0x55671f6666c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:50.332 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.320+0000 7fb3eeffd700 1 --2- 172.21.15.73:0/3228434262 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55671f662a40 0x55671f6666c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:50.332 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.320+0000 7fb3eeffd700 1 -- 172.21.15.73:0/3228434262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55671f663360 msgr2=0x55671f666e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:50.332 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.320+0000 7fb3eeffd700 1 --2- 172.21.15.73:0/3228434262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55671f663360 0x55671f666e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:50.332 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.320+0000 7fb3eeffd700 1 -- 172.21.15.73:0/3228434262 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e4017070 con 0x55671f65d550 2023-08-10T12:02:50.332 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.320+0000 7fb3ef7fe700 1 --2- 172.21.15.73:0/3228434262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55671f663360 0x55671f666e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T12:02:50.333 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.320+0000 7fb3eeffd700 1 --2- 172.21.15.73:0/3228434262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f65d550 0x55671f669440 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000c510 tx=0x7fb3e0010a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8913528b82d596f9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:02:50.333 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.320+0000 7fb3d2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:02:50.333 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.320+0000 7fb3d2ff5700 1 -- 172.21.15.73:0/3228434262 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e00b8070 con 0x55671f65d550 2023-08-10T12:02:50.333 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.320+0000 7fb3d2ff5700 1 -- 172.21.15.73:0/3228434262 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb3e00a2370 con 0x55671f65d550 2023-08-10T12:02:50.333 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.320+0000 7fb40194eb80 1 -- 172.21.15.73:0/3228434262 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55671f6501c0 con 0x55671f65d550 2023-08-10T12:02:50.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.320+0000 7fb3d2ff5700 1 -- 172.21.15.73:0/3228434262 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3e00ca300 con 0x55671f65d550 2023-08-10T12:02:50.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.320+0000 7fb40194eb80 10 client.16998 fetch_fsmap learned FSMap version 55 2023-08-10T12:02:50.334 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.320+0000 7fb40194eb80 1 -- 172.21.15.73:0/3228434262 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x7fb3f01a5c40 con 0x55671f65d550 2023-08-10T12:02:50.335 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.320+0000 7fb3d2ff5700 1 -- 172.21.15.73:0/3228434262 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55671f6501c0 con 0x55671f65d550 2023-08-10T12:02:50.335 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.321+0000 7fb3d2ff5700 1 -- 172.21.15.73:0/3228434262 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7fb3e00ca020 con 0x55671f65d550 2023-08-10T12:02:50.335 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.321+0000 7fb40194eb80 10 client.16998 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:02:50.335 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.321+0000 7fb40194eb80 10 client.16998 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:02:50.336 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.321+0000 7fb40194eb80 20 client.16998 populate_metadata read hostname 'smithi073' 2023-08-10T12:02:50.336 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.321+0000 7fb40194eb80 1 --2- 172.21.15.73:0/3228434262 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55671f676a30 0x55671f678e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:50.336 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.321+0000 7fb40194eb80 4 client.16998 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:02:50.337 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.321+0000 7fb40194eb80 1 -- 172.21.15.73:0/3228434262 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55671f62c970 con 0x55671f676a30 2023-08-10T12:02:50.337 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.321+0000 7fb3ee7fc700 1 --2- 172.21.15.73:0/3228434262 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55671f676a30 0x55671f678e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:50.337 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.321+0000 7fb3d2ff5700 10 client.16998 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:02:50.337 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.321+0000 7fb3ee7fc700 1 --2- 172.21.15.73:0/3228434262 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55671f676a30 0x55671f678e50 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3a6cba2886e6e10 server_cookie=21bdf8c47736da90 in_seq=0 out_seq=0 2023-08-10T12:02:50.339 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.325+0000 7fb3d2ff5700 1 -- 172.21.15.73:0/3228434262 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55671f62c970 con 0x55671f676a30 2023-08-10T12:02:50.340 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.325+0000 7fb3d2ff5700 10 client.16998 handle_command_reply: tid=0 2023-08-10T12:02:50.340 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.325+0000 7fb40194eb80 1 client.16998 shutdown 2023-08-10T12:02:50.340 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.325+0000 7fb40194eb80 1 -- 172.21.15.73:0/3228434262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f65d550 msgr2=0x55671f669440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:50.340 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.325+0000 7fb40194eb80 1 --2- 172.21.15.73:0/3228434262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f65d550 0x55671f669440 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000c510 tx=0x7fb3e0010a60 comp rx=0 tx=0).stop 2023-08-10T12:02:50.340 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.325+0000 7fb40194eb80 1 -- 172.21.15.73:0/3228434262 shutdown_connections 2023-08-10T12:02:50.341 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.325+0000 7fb40194eb80 1 --2- 172.21.15.73:0/3228434262 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55671f676a30 0x55671f678e50 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:50.341 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.325+0000 7fb40194eb80 1 --2- 172.21.15.73:0/3228434262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55671f663360 0x55671f666e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:50.341 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.325+0000 7fb3d2ff5700 0 client.16998 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:02:50.341 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.325+0000 7fb40194eb80 1 --2- 172.21.15.73:0/3228434262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f65d550 0x55671f669440 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:50.341 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.325+0000 7fb40194eb80 1 --2- 172.21.15.73:0/3228434262 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55671f662a40 0x55671f6666c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:50.341 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.325+0000 7fb40194eb80 1 -- 172.21.15.73:0/3228434262 >> 172.21.15.73:0/3228434262 conn(0x55671f5bac70 msgr2=0x55671f6574b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:02:50.341 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.325+0000 7fb40194eb80 1 -- 172.21.15.73:0/3228434262 shutdown_connections 2023-08-10T12:02:50.342 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.325+0000 7fb40194eb80 1 -- 172.21.15.73:0/3228434262 wait complete. 2023-08-10T12:02:50.342 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.325+0000 7fb40194eb80 20 client.16998 trim_cache size 0 max 16384 2023-08-10T12:02:50.346 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.340+0000 7fb40194eb80 1 Processor -- start 2023-08-10T12:02:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.340+0000 7fb40194eb80 1 -- start start 2023-08-10T12:02:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.340+0000 7fb40194eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55671f65d550 0x55671f666670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.340+0000 7fb40194eb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f662a40 0x55671f657c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.340+0000 7fb40194eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55671f663360 0x55671f668f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.340+0000 7fb40194eb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55671f4318c0 con 0x55671f662a40 2023-08-10T12:02:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.340+0000 7fb40194eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55671f658cb0 con 0x55671f663360 2023-08-10T12:02:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.340+0000 7fb40194eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55671f6591e0 con 0x55671f65d550 2023-08-10T12:02:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.340+0000 7fb3ee7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f662a40 0x55671f657c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.340+0000 7fb3ee7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f662a40 0x55671f657c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36644/0 (socket says 172.21.15.73:36644) 2023-08-10T12:02:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.340+0000 7fb3ee7fc700 1 -- 172.21.15.73:0/933633686 learned_addr learned my addr 172.21.15.73:0/933633686 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:02:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.340+0000 7fb3eeffd700 1 --2- 172.21.15.73:0/933633686 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55671f65d550 0x55671f666670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.340+0000 7fb3ef7fe700 1 --2- 172.21.15.73:0/933633686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55671f663360 0x55671f668f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.340+0000 7fb3ee7fc700 1 -- 172.21.15.73:0/933633686 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55671f65d550 msgr2=0x55671f666670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.340+0000 7fb3ee7fc700 1 --2- 172.21.15.73:0/933633686 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55671f65d550 0x55671f666670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.340+0000 7fb3ee7fc700 1 -- 172.21.15.73:0/933633686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55671f663360 msgr2=0x55671f668f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.340+0000 7fb3ee7fc700 1 --2- 172.21.15.73:0/933633686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55671f663360 0x55671f668f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.340+0000 7fb3ee7fc700 1 -- 172.21.15.73:0/933633686 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55671f3dbd80 con 0x55671f662a40 2023-08-10T12:02:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.340+0000 7fb3ef7fe700 1 --2- 172.21.15.73:0/933633686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55671f663360 0x55671f668f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T12:02:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.340+0000 7fb3ee7fc700 1 --2- 172.21.15.73:0/933633686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f662a40 0x55671f657c30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40097c0 tx=0x7fb3e4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa008ff7edd84142 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:02:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.341+0000 7fb3d5ffb700 1 -- 172.21.15.73:0/933633686 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e4022070 con 0x55671f662a40 2023-08-10T12:02:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.341+0000 7fb3d5ffb700 1 -- 172.21.15.73:0/933633686 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb3e4023040 con 0x55671f662a40 2023-08-10T12:02:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.341+0000 7fb3d5ffb700 1 -- 172.21.15.73:0/933633686 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e4003e70 con 0x55671f662a40 2023-08-10T12:02:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.341+0000 7fb40194eb80 1 -- 172.21.15.73:0/933633686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f662a40 msgr2=0x55671f657c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.341+0000 7fb40194eb80 1 --2- 172.21.15.73:0/933633686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f662a40 0x55671f657c30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40097c0 tx=0x7fb3e4014000 comp rx=0 tx=0).stop 2023-08-10T12:02:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.341+0000 7fb40194eb80 1 -- 172.21.15.73:0/933633686 shutdown_connections 2023-08-10T12:02:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.341+0000 7fb40194eb80 1 --2- 172.21.15.73:0/933633686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55671f663360 0x55671f668f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.341+0000 7fb40194eb80 1 --2- 172.21.15.73:0/933633686 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55671f65d550 0x55671f666670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.341+0000 7fb40194eb80 1 --2- 172.21.15.73:0/933633686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f662a40 0x55671f657c30 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:50.351 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.341+0000 7fb40194eb80 1 -- 172.21.15.73:0/933633686 >> 172.21.15.73:0/933633686 conn(0x55671f5bac70 msgr2=0x55671f665f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:02:50.351 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.341+0000 7fb40194eb80 1 -- 172.21.15.73:0/933633686 shutdown_connections 2023-08-10T12:02:50.351 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.341+0000 7fb40194eb80 1 -- 172.21.15.73:0/933633686 wait complete. 2023-08-10T12:02:50.351 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.342+0000 7fb40194eb80 1 -- start start 2023-08-10T12:02:50.351 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.342+0000 7fb40194eb80 1 Processor -- start 2023-08-10T12:02:50.351 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.342+0000 7fb40194eb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f65d550 0x55671f66dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:50.351 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.342+0000 7fb40194eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55671f662a40 0x55671f66bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.342+0000 7fb40194eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55671f663360 0x55671f66c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.342+0000 7fb40194eb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55671f66cab0 con 0x55671f65d550 2023-08-10T12:02:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.342+0000 7fb40194eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55671f66cc20 con 0x55671f662a40 2023-08-10T12:02:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.342+0000 7fb40194eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55671f66cde0 con 0x55671f663360 2023-08-10T12:02:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.342+0000 7fb40194eb80 10 client.0 _ll_register_callbacks cb 0x55671f54b620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:02:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.342+0000 7fb3eeffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f65d550 0x55671f66dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.342+0000 7fb3eeffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f65d550 0x55671f66dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36648/0 (socket says 172.21.15.73:36648) 2023-08-10T12:02:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.342+0000 7fb3eeffd700 1 -- 172.21.15.73:0/3411351971 learned_addr learned my addr 172.21.15.73:0/3411351971 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:02:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.342+0000 7fb3ef7fe700 1 --2- 172.21.15.73:0/3411351971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55671f663360 0x55671f66c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.342+0000 7fb3ee7fc700 1 --2- 172.21.15.73:0/3411351971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55671f662a40 0x55671f66bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.342+0000 7fb3eeffd700 1 -- 172.21.15.73:0/3411351971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55671f663360 msgr2=0x55671f66c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.342+0000 7fb3eeffd700 1 --2- 172.21.15.73:0/3411351971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55671f663360 0x55671f66c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.342+0000 7fb3eeffd700 1 -- 172.21.15.73:0/3411351971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55671f662a40 msgr2=0x55671f66bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:02:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.342+0000 7fb3eeffd700 1 --2- 172.21.15.73:0/3411351971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55671f662a40 0x55671f66bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.342+0000 7fb3eeffd700 1 -- 172.21.15.73:0/3411351971 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55671f3c4c00 con 0x55671f65d550 2023-08-10T12:02:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.342+0000 7fb3ef7fe700 1 --2- 172.21.15.73:0/3411351971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55671f663360 0x55671f66c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T12:02:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.343+0000 7fb3eeffd700 1 --2- 172.21.15.73:0/3411351971 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f65d550 0x55671f66dc70 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000e970 tx=0x7fb3e0099d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8859853ab90fc9d0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:02:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.343+0000 7fb3d2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:02:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.343+0000 7fb3d2ff5700 1 -- 172.21.15.73:0/3411351971 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e00b8040 con 0x55671f65d550 2023-08-10T12:02:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.343+0000 7fb3d2ff5700 1 -- 172.21.15.73:0/3411351971 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb3e00a2370 con 0x55671f65d550 2023-08-10T12:02:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.343+0000 7fb40194eb80 1 -- 172.21.15.73:0/3411351971 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb3e0010880 con 0x55671f65d550 2023-08-10T12:02:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.343+0000 7fb3d2ff5700 1 -- 172.21.15.73:0/3411351971 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3e00b5d20 con 0x55671f65d550 2023-08-10T12:02:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.343+0000 7fb40194eb80 10 client.17004 fetch_fsmap learned FSMap version 55 2023-08-10T12:02:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.343+0000 7fb40194eb80 1 -- 172.21.15.73:0/3411351971 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55671f4021f0 con 0x55671f65d550 2023-08-10T12:02:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.343+0000 7fb3d2ff5700 1 -- 172.21.15.73:0/3411351971 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb3e0010880 con 0x55671f65d550 2023-08-10T12:02:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.343+0000 7fb3d2ff5700 1 -- 172.21.15.73:0/3411351971 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7fb3e0096630 con 0x55671f65d550 2023-08-10T12:02:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.343+0000 7fb40194eb80 10 client.17004 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:02:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.343+0000 7fb40194eb80 10 client.17004 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:02:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.343+0000 7fb40194eb80 20 client.17004 populate_metadata read hostname 'smithi073' 2023-08-10T12:02:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.343+0000 7fb40194eb80 1 --2- 172.21.15.73:0/3411351971 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55671f6cb730 0x55671f6cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:02:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.343+0000 7fb40194eb80 4 client.17004 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T12:02:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.343+0000 7fb40194eb80 1 -- 172.21.15.73:0/3411351971 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55671f5a7720 con 0x55671f6cb730 2023-08-10T12:02:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.343+0000 7fb3ee7fc700 1 --2- 172.21.15.73:0/3411351971 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55671f6cb730 0x55671f6cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:02:50.357 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.344+0000 7fb3d2ff5700 10 client.17004 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:02:50.357 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:50.344+0000 7fb3ee7fc700 1 --2- 172.21.15.73:0/3411351971 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55671f6cb730 0x55671f6cdb20 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8cfbaf398b95f3c server_cookie=4b7e20b85d3532de in_seq=0 out_seq=0 2023-08-10T12:02:51.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:51 smithi152 ceph-mon[130220]: pgmap v317: 97 pgs: 97 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 382 op/s 2023-08-10T12:02:51.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:51 smithi156 ceph-mon[130574]: pgmap v317: 97 pgs: 97 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 382 op/s 2023-08-10T12:02:51.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:51 smithi073 ceph-mon[128869]: pgmap v317: 97 pgs: 97 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 382 op/s 2023-08-10T12:02:53.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:53 smithi152 ceph-mon[130220]: pgmap v318: 97 pgs: 97 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 277 op/s 2023-08-10T12:02:53.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:53 smithi156 ceph-mon[130574]: pgmap v318: 97 pgs: 97 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 277 op/s 2023-08-10T12:02:53.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:53 smithi073 ceph-mon[128869]: pgmap v318: 97 pgs: 97 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 277 op/s 2023-08-10T12:02:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:55.026+0000 7fb3d2ff5700 1 -- 172.21.15.73:0/3411351971 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55671f5a7720 con 0x55671f6cb730 2023-08-10T12:02:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:55.026+0000 7fb3d2ff5700 10 client.17004 handle_command_reply: tid=0 2023-08-10T12:02:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:55.026+0000 7fb40194eb80 1 client.17004 shutdown 2023-08-10T12:02:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:55.027+0000 7fb40194eb80 1 -- 172.21.15.73:0/3411351971 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f65d550 msgr2=0x55671f66dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:55.027+0000 7fb40194eb80 1 --2- 172.21.15.73:0/3411351971 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f65d550 0x55671f66dc70 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000e970 tx=0x7fb3e0099d80 comp rx=0 tx=0).stop 2023-08-10T12:02:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:55.027+0000 7fb40194eb80 1 -- 172.21.15.73:0/3411351971 shutdown_connections 2023-08-10T12:02:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:55.027+0000 7fb40194eb80 1 --2- 172.21.15.73:0/3411351971 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55671f6cb730 0x55671f6cdb20 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:55.027+0000 7fb40194eb80 1 --2- 172.21.15.73:0/3411351971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55671f663360 0x55671f66c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:55.027+0000 7fb40194eb80 1 --2- 172.21.15.73:0/3411351971 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55671f65d550 0x55671f66dc70 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:55.027+0000 7fb40194eb80 1 --2- 172.21.15.73:0/3411351971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55671f662a40 0x55671f66bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:55.027+0000 7fb3d2ff5700 0 client.17004 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:02:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:55.027+0000 7fb40194eb80 1 -- 172.21.15.73:0/3411351971 >> 172.21.15.73:0/3411351971 conn(0x55671f5bac70 msgr2=0x55671f662130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:02:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:55.027+0000 7fb40194eb80 1 -- 172.21.15.73:0/3411351971 shutdown_connections 2023-08-10T12:02:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:55.027+0000 7fb40194eb80 1 -- 172.21.15.73:0/3411351971 wait complete. 2023-08-10T12:02:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:55.027+0000 7fb40194eb80 20 client.17004 trim_cache size 0 max 16384 2023-08-10T12:02:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T12:02:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T12:02:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T12:02:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T12:02:55.032 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:55.028+0000 7fb3f57b5700 1 -- 172.21.15.73:0/3235363231 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb3d80a12c0 msgr2=0x7fb3d80a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:55.028+0000 7fb3f57b5700 1 --2- 172.21.15.73:0/3235363231 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb3d80a12c0 0x7fb3d80a3780 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0102c20 tx=0x7fb3e4009260 comp rx=0 tx=0).stop 2023-08-10T12:02:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:55.028+0000 7fb3f57b5700 1 -- 172.21.15.73:0/3235363231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3f00ff890 msgr2=0x7fb3f0101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:02:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:55.028+0000 7fb3f57b5700 1 --2- 172.21.15.73:0/3235363231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3f00ff890 0x7fb3f0101400 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000e9a0 tx=0x7fb3e000ecb0 comp rx=0 tx=0).stop 2023-08-10T12:02:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:55.028+0000 7fb3f57b5700 1 -- 172.21.15.73:0/3235363231 shutdown_connections 2023-08-10T12:02:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:55.028+0000 7fb3f57b5700 1 --2- 172.21.15.73:0/3235363231 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb3d80a12c0 0x7fb3d80a3780 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:55.028+0000 7fb3f57b5700 1 --2- 172.21.15.73:0/3235363231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3f0104780 0x7fb3f01a4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:55.028+0000 7fb3f57b5700 1 --2- 172.21.15.73:0/3235363231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3f00ff890 0x7fb3f0101400 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:55.028+0000 7fb3f57b5700 1 --2- 172.21.15.73:0/3235363231 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3f0100250 0x7fb3f0101940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:02:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:55.028+0000 7fb3f57b5700 1 -- 172.21.15.73:0/3235363231 >> 172.21.15.73:0/3235363231 conn(0x7fb3f0076550 msgr2=0x7fb3f0068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:02:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:55.029+0000 7fb3f57b5700 1 -- 172.21.15.73:0/3235363231 shutdown_connections 2023-08-10T12:02:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:02:55.029+0000 7fb3f57b5700 1 -- 172.21.15.73:0/3235363231 wait complete. 2023-08-10T12:02:55.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:54 smithi152 ceph-mon[130220]: pgmap v319: 97 pgs: 97 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 348 op/s 2023-08-10T12:02:55.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:54 smithi156 ceph-mon[130574]: pgmap v319: 97 pgs: 97 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 348 op/s 2023-08-10T12:02:55.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:54 smithi073 ceph-mon[128869]: pgmap v319: 97 pgs: 97 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 348 op/s 2023-08-10T12:02:56.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:55 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:02:56.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:55 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:02:56.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:55 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:02:57.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:56 smithi152 ceph-mon[130220]: pgmap v320: 97 pgs: 97 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 370 op/s 2023-08-10T12:02:57.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:56 smithi156 ceph-mon[130574]: pgmap v320: 97 pgs: 97 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 370 op/s 2023-08-10T12:02:57.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:56 smithi073 ceph-mon[128869]: pgmap v320: 97 pgs: 97 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 370 op/s 2023-08-10T12:02:59.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:59 smithi152 ceph-mon[130220]: pgmap v321: 97 pgs: 97 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 325 op/s 2023-08-10T12:02:59.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:59 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:02:59.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:59 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:02:59.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:59 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:02:59.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:59 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:02:59.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:59 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:02:59.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:59 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:02:59.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:59 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:02:59.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:59 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:02:59.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:59 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:02:59.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:59 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:02:59.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:59 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:02:59.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:59 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:02:59.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:59 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:02:59.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:59 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:02:59.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:59 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:02:59.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:59 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:02:59.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:59 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:02:59.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:59 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:02:59.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:59 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:02:59.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:59 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:02:59.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:59 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:02:59.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:02:59 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:59 smithi156 ceph-mon[130574]: pgmap v321: 97 pgs: 97 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 325 op/s 2023-08-10T12:03:00.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:59 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:03:00.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:59 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:03:00.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:59 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:03:00.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:59 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:03:00.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:59 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:59 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:59 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:59 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:59 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:59 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:59 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:59 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:59 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:03:00.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:59 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:03:00.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:59 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:59 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:59 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:59 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:59 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.010 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:59 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.010 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:59 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.010 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:02:59 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:59 smithi073 ceph-mon[128869]: pgmap v321: 97 pgs: 97 active+clean; 2.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 325 op/s 2023-08-10T12:03:00.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:59 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:03:00.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:59 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:03:00.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:59 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:03:00.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:59 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:03:00.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:59 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:59 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:59 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:59 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:59 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:59 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:59 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:59 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:59 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:03:00.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:59 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:03:00.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:59 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:59 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:59 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:59 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:59 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:59 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:59 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:02:59 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:00 smithi152 ceph-mon[130220]: Adjusting osd_memory_target on smithi156 to 196.2M 2023-08-10T12:03:00.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:00 smithi152 ceph-mon[130220]: Unable to set osd_memory_target on smithi156 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-08-10T12:03:00.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:00 smithi152 ceph-mon[130220]: Adjusting osd_memory_target on smithi073 to 196.2M 2023-08-10T12:03:00.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:00 smithi152 ceph-mon[130220]: Unable to set osd_memory_target on smithi073 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-08-10T12:03:00.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:00 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:00 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:00 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:00 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:00 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:00 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:00 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:00 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:00.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:00 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:03:00.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:00 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:03:00.999 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:00 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:03:01.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:00 smithi156 ceph-mon[130574]: Adjusting osd_memory_target on smithi156 to 196.2M 2023-08-10T12:03:01.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:00 smithi156 ceph-mon[130574]: Unable to set osd_memory_target on smithi156 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-08-10T12:03:01.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:00 smithi156 ceph-mon[130574]: Adjusting osd_memory_target on smithi073 to 196.2M 2023-08-10T12:03:01.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:00 smithi156 ceph-mon[130574]: Unable to set osd_memory_target on smithi073 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-08-10T12:03:01.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:00 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:01.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:00 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:01.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:00 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:01.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:00 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:01.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:00 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:01.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:00 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:01.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:00 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:01.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:00 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:01.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:00 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:03:01.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:00 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:03:01.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:00 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:03:01.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:00 smithi073 ceph-mon[128869]: Adjusting osd_memory_target on smithi156 to 196.2M 2023-08-10T12:03:01.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:00 smithi073 ceph-mon[128869]: Unable to set osd_memory_target on smithi156 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-08-10T12:03:01.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:00 smithi073 ceph-mon[128869]: Adjusting osd_memory_target on smithi073 to 196.2M 2023-08-10T12:03:01.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:00 smithi073 ceph-mon[128869]: Unable to set osd_memory_target on smithi073 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-08-10T12:03:01.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:00 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:01.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:00 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:01.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:00 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:01.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:00 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:01.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:00 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:01.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:00 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:01.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:00 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:01.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:00 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:03:01.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:00 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:03:01.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:00 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:03:01.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:00 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:03:01.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:01 smithi152 ceph-mon[130220]: pgmap v322: 97 pgs: 97 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 387 op/s 2023-08-10T12:03:01.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:01 smithi152 ceph-mon[130220]: Adjusting osd_memory_target on smithi152 to 196.2M 2023-08-10T12:03:01.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:01 smithi152 ceph-mon[130220]: Unable to set osd_memory_target on smithi152 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-08-10T12:03:02.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:01 smithi156 ceph-mon[130574]: pgmap v322: 97 pgs: 97 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 387 op/s 2023-08-10T12:03:02.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:01 smithi156 ceph-mon[130574]: Adjusting osd_memory_target on smithi152 to 196.2M 2023-08-10T12:03:02.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:01 smithi156 ceph-mon[130574]: Unable to set osd_memory_target on smithi152 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-08-10T12:03:02.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:01 smithi073 ceph-mon[128869]: pgmap v322: 97 pgs: 97 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 387 op/s 2023-08-10T12:03:02.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:01 smithi073 ceph-mon[128869]: Adjusting osd_memory_target on smithi152 to 196.2M 2023-08-10T12:03:02.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:01 smithi073 ceph-mon[128869]: Unable to set osd_memory_target on smithi152 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-08-10T12:03:03.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:03 smithi152 ceph-mon[130220]: pgmap v323: 97 pgs: 97 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 310 op/s 2023-08-10T12:03:04.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:03 smithi156 ceph-mon[130574]: pgmap v323: 97 pgs: 97 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 310 op/s 2023-08-10T12:03:04.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:03 smithi073 ceph-mon[128869]: pgmap v323: 97 pgs: 97 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 310 op/s 2023-08-10T12:03:05.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:04 smithi152 ceph-mon[130220]: pgmap v324: 97 pgs: 97 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 336 op/s 2023-08-10T12:03:05.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:04 smithi156 ceph-mon[130574]: pgmap v324: 97 pgs: 97 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 336 op/s 2023-08-10T12:03:05.270 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:04 smithi073 ceph-mon[128869]: pgmap v324: 97 pgs: 97 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 336 op/s 2023-08-10T12:03:06.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:05 smithi152 ceph-mon[130220]: osdmap e95: 12 total, 12 up, 12 in 2023-08-10T12:03:06.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:05 smithi156 ceph-mon[130574]: osdmap e95: 12 total, 12 up, 12 in 2023-08-10T12:03:06.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:05 smithi073 ceph-mon[128869]: osdmap e95: 12 total, 12 up, 12 in 2023-08-10T12:03:07.248 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:06 smithi152 ceph-mon[130220]: pgmap v326: 97 pgs: 1 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 94 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 275 op/s 2023-08-10T12:03:07.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:06 smithi156 ceph-mon[130574]: pgmap v326: 97 pgs: 1 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 94 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 275 op/s 2023-08-10T12:03:07.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:06 smithi073 ceph-mon[128869]: pgmap v326: 97 pgs: 1 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 94 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 275 op/s 2023-08-10T12:03:08.216 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.214+0000 7f862a51c700 1 -- 172.21.15.73:0/4166407659 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8624106730 msgr2=0x7f8624106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:08.216 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.214+0000 7f862a51c700 1 --2- 172.21.15.73:0/4166407659 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8624106730 0x7f8624106b10 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f860c0098f0 tx=0x7f860c009c00 comp rx=0 tx=0).stop 2023-08-10T12:03:08.218 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.214+0000 7f862a51c700 1 -- 172.21.15.73:0/4166407659 shutdown_connections 2023-08-10T12:03:08.218 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.214+0000 7f862a51c700 1 --2- 172.21.15.73:0/4166407659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86241010e0 0x7f862410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.218 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.214+0000 7f862a51c700 1 --2- 172.21.15.73:0/4166407659 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8624106730 0x7f8624106b10 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.214+0000 7f862a51c700 1 --2- 172.21.15.73:0/4166407659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8624100720 0x7f8624100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.214+0000 7f862a51c700 1 -- 172.21.15.73:0/4166407659 >> 172.21.15.73:0/4166407659 conn(0x7f86240fc230 msgr2=0x7f86240fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:03:08.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.218+0000 7f862a51c700 1 -- 172.21.15.73:0/4166407659 shutdown_connections 2023-08-10T12:03:08.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.218+0000 7f862a51c700 1 -- 172.21.15.73:0/4166407659 wait complete. 2023-08-10T12:03:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.219+0000 7f862a51c700 1 Processor -- start 2023-08-10T12:03:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.219+0000 7f862a51c700 1 -- start start 2023-08-10T12:03:08.222 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.219+0000 7f862a51c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8624100720 0x7f862419ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:08.222 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.219+0000 7f862a51c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86241010e0 0x7f862419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:08.222 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.219+0000 7f862a51c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8624106730 0x7f86241988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:08.222 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.219+0000 7f862a51c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8624198f10 con 0x7f86241010e0 2023-08-10T12:03:08.222 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.219+0000 7f862a51c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8624199080 con 0x7f8624100720 2023-08-10T12:03:08.223 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.219+0000 7f862a51c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8624199240 con 0x7f8624106730 2023-08-10T12:03:08.223 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.219+0000 7f86237fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86241010e0 0x7f862419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:08.224 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.219+0000 7f86237fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86241010e0 0x7f862419ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36664/0 (socket says 172.21.15.73:36664) 2023-08-10T12:03:08.224 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.219+0000 7f86237fe700 1 -- 172.21.15.73:0/1185685511 learned_addr learned my addr 172.21.15.73:0/1185685511 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:03:08.224 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.220+0000 7f8623fff700 1 --2- 172.21.15.73:0/1185685511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8624100720 0x7f862419ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:08.225 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.220+0000 7f8628ab9700 1 --2- 172.21.15.73:0/1185685511 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8624106730 0x7f86241988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:08.225 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.220+0000 7f8623fff700 1 -- 172.21.15.73:0/1185685511 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8624106730 msgr2=0x7f86241988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:08.225 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.220+0000 7f8623fff700 1 --2- 172.21.15.73:0/1185685511 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8624106730 0x7f86241988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.225 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.220+0000 7f8623fff700 1 -- 172.21.15.73:0/1185685511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86241010e0 msgr2=0x7f862419ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:08.226 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.220+0000 7f8623fff700 1 --2- 172.21.15.73:0/1185685511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86241010e0 0x7f862419ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.226 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.220+0000 7f8623fff700 1 -- 172.21.15.73:0/1185685511 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c009520 con 0x7f8624100720 2023-08-10T12:03:08.226 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.220+0000 7f86237fe700 1 --2- 172.21.15.73:0/1185685511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86241010e0 0x7f862419ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:03:08.232 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.231+0000 7f8623fff700 1 --2- 172.21.15.73:0/1185685511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8624100720 0x7f862419ea40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f860c00b2e0 tx=0x7f860c010fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:03:08.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.235+0000 7f86217fa700 1 -- 172.21.15.73:0/1185685511 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c01c070 con 0x7f8624100720 2023-08-10T12:03:08.237 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.235+0000 7f86217fa700 1 -- 172.21.15.73:0/1185685511 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f860c005590 con 0x7f8624100720 2023-08-10T12:03:08.237 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.235+0000 7f86217fa700 1 -- 172.21.15.73:0/1185685511 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c003ab0 con 0x7f8624100720 2023-08-10T12:03:08.237 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.235+0000 7f862a51c700 1 -- 172.21.15.73:0/1185685511 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86241994c0 con 0x7f8624100720 2023-08-10T12:03:08.237 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.235+0000 7f862a51c700 1 -- 172.21.15.73:0/1185685511 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f862410f260 con 0x7f8624100720 2023-08-10T12:03:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.243+0000 7f86217fa700 1 -- 172.21.15.73:0/1185685511 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f860c020070 con 0x7f8624100720 2023-08-10T12:03:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.244+0000 7f86217fa700 1 --2- 172.21.15.73:0/1185685511 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f86100a14d0 0x7f86100a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.244+0000 7f86217fa700 1 -- 172.21.15.73:0/1185685511 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f860c0cdc20 con 0x7f8624100720 2023-08-10T12:03:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.244+0000 7f86237fe700 1 --2- 172.21.15.73:0/1185685511 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f86100a14d0 0x7f86100a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.245+0000 7f86237fe700 1 --2- 172.21.15.73:0/1185685511 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f86100a14d0 0x7f86100a3990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8614009fd0 tx=0x7f8614009040 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:03:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.245+0000 7f86366b5b80 1 Processor -- start 2023-08-10T12:03:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.245+0000 7f86366b5b80 1 -- start start 2023-08-10T12:03:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.246+0000 7f86366b5b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f0c9eba40 0x563f0c9ebe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.246+0000 7f86366b5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0c9ec360 0x563f0c9e6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.246+0000 7f86366b5b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0c9e6550 0x563f0c9e69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.246+0000 7f86366b5b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0c961d60 con 0x563f0c9eba40 2023-08-10T12:03:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.246+0000 7f86366b5b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0c93e530 con 0x563f0c9e6550 2023-08-10T12:03:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.246+0000 7f86366b5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0c93be50 con 0x563f0c9ec360 2023-08-10T12:03:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.246+0000 7f86237fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0c9ec360 0x563f0c9e6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.246+0000 7f86237fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0c9ec360 0x563f0c9e6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:33944/0 (socket says 172.21.15.73:33944) 2023-08-10T12:03:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.246+0000 7f86237fe700 1 -- 172.21.15.73:0/3512053935 learned_addr learned my addr 172.21.15.73:0/3512053935 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:03:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.246+0000 7f8628ab9700 1 --2- 172.21.15.73:0/3512053935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0c9e6550 0x563f0c9e69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:08.250 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.247+0000 7f86237fe700 1 -- 172.21.15.73:0/3512053935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0c9e6550 msgr2=0x563f0c9e69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:08.250 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.247+0000 7f86237fe700 1 --2- 172.21.15.73:0/3512053935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0c9e6550 0x563f0c9e69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.250 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.247+0000 7f86237fe700 1 -- 172.21.15.73:0/3512053935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f0c9eba40 msgr2=0x563f0c9ebe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:08.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.247+0000 7f86237fe700 1 --2- 172.21.15.73:0/3512053935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f0c9eba40 0x563f0c9ebe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.247+0000 7f86237fe700 1 -- 172.21.15.73:0/3512053935 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f0c7b85d0 con 0x563f0c9ec360 2023-08-10T12:03:08.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.248+0000 7f86237fe700 1 --2- 172.21.15.73:0/3512053935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0c9ec360 0x563f0c9e6010 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f86140158e0 tx=0x7f861400b050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=254594ff615c383d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:03:08.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.248+0000 7f861a7fc700 1 -- 172.21.15.73:0/3512053935 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8614016980 con 0x563f0c9ec360 2023-08-10T12:03:08.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.248+0000 7f861a7fc700 1 -- 172.21.15.73:0/3512053935 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f861400f040 con 0x563f0c9ec360 2023-08-10T12:03:08.251 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.248+0000 7f861a7fc700 1 -- 172.21.15.73:0/3512053935 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86140203a0 con 0x563f0c9ec360 2023-08-10T12:03:08.252 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.249+0000 7f86366b5b80 1 -- 172.21.15.73:0/3512053935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0c9ec360 msgr2=0x563f0c9e6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:08.252 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.249+0000 7f86366b5b80 1 --2- 172.21.15.73:0/3512053935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0c9ec360 0x563f0c9e6010 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f86140158e0 tx=0x7f861400b050 comp rx=0 tx=0).stop 2023-08-10T12:03:08.252 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.249+0000 7f86366b5b80 1 -- 172.21.15.73:0/3512053935 shutdown_connections 2023-08-10T12:03:08.252 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.249+0000 7f86366b5b80 1 --2- 172.21.15.73:0/3512053935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0c9e6550 0x563f0c9e69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.253 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.249+0000 7f86366b5b80 1 --2- 172.21.15.73:0/3512053935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f0c9eba40 0x563f0c9ebe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.253 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.249+0000 7f86366b5b80 1 --2- 172.21.15.73:0/3512053935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0c9ec360 0x563f0c9e6010 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.253 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.249+0000 7f86366b5b80 1 -- 172.21.15.73:0/3512053935 >> 172.21.15.73:0/3512053935 conn(0x563f0c943c70 msgr2=0x563f0c9e0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:03:08.259 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.251+0000 7f86366b5b80 1 -- 172.21.15.73:0/3512053935 shutdown_connections 2023-08-10T12:03:08.259 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.252+0000 7f86366b5b80 1 -- 172.21.15.73:0/3512053935 wait complete. 2023-08-10T12:03:08.259 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.252+0000 7f86366b5b80 1 -- start start 2023-08-10T12:03:08.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.252+0000 7f86366b5b80 1 Processor -- start 2023-08-10T12:03:08.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.253+0000 7f86366b5b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f0c9e6550 0x563f0c9f2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:08.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.253+0000 7f86366b5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0c9eba40 0x563f0c9ef6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:08.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.253+0000 7f86366b5b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0c9ec360 0x563f0c9efdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:08.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.253+0000 7f86366b5b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0c937740 con 0x563f0c9e6550 2023-08-10T12:03:08.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.253+0000 7f86366b5b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0c8d6a60 con 0x563f0c9ec360 2023-08-10T12:03:08.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.253+0000 7f86366b5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0c8d6760 con 0x563f0c9eba40 2023-08-10T12:03:08.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.253+0000 7f86366b5b80 10 client.0 _ll_register_callbacks cb 0x563f0c8d4620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:03:08.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.253+0000 7f86237fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0c9eba40 0x563f0c9ef6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:08.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.253+0000 7f86237fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0c9eba40 0x563f0c9ef6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:33952/0 (socket says 172.21.15.73:33952) 2023-08-10T12:03:08.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.253+0000 7f86237fe700 1 -- 172.21.15.73:0/1572062224 learned_addr learned my addr 172.21.15.73:0/1572062224 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:03:08.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.253+0000 7f8628ab9700 1 --2- 172.21.15.73:0/1572062224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0c9ec360 0x563f0c9efdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:08.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.254+0000 7f86237fe700 1 -- 172.21.15.73:0/1572062224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0c9ec360 msgr2=0x563f0c9efdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:08.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.254+0000 7f86237fe700 1 --2- 172.21.15.73:0/1572062224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0c9ec360 0x563f0c9efdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.254+0000 7f86237fe700 1 -- 172.21.15.73:0/1572062224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f0c9e6550 msgr2=0x563f0c9f2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:08.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.254+0000 7f86237fe700 1 --2- 172.21.15.73:0/1572062224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f0c9e6550 0x563f0c9f2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.254+0000 7f86237fe700 1 -- 172.21.15.73:0/1572062224 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86140155d0 con 0x563f0c9eba40 2023-08-10T12:03:08.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.254+0000 7f86237fe700 1 --2- 172.21.15.73:0/1572062224 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0c9eba40 0x563f0c9ef6b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f86140094f0 tx=0x7f8614021e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25679f8ed69ab45b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:03:08.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.254+0000 7f86037fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T12:03:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.254+0000 7f86037fe700 1 -- 172.21.15.73:0/1572062224 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8614004e80 con 0x563f0c9eba40 2023-08-10T12:03:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.254+0000 7f86366b5b80 1 -- 172.21.15.73:0/1572062224 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563f0c9d91c0 con 0x563f0c9eba40 2023-08-10T12:03:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.254+0000 7f86037fe700 1 -- 172.21.15.73:0/1572062224 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f8614016780 con 0x563f0c9eba40 2023-08-10T12:03:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.255+0000 7f86037fe700 1 -- 172.21.15.73:0/1572062224 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8614016940 con 0x563f0c9eba40 2023-08-10T12:03:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.255+0000 7f86366b5b80 10 client.26476 fetch_fsmap learned FSMap version 55 2023-08-10T12:03:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.255+0000 7f86366b5b80 1 -- 172.21.15.73:0/1572062224 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x563f0c764d80 con 0x563f0c9eba40 2023-08-10T12:03:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.260+0000 7f86037fe700 1 -- 172.21.15.73:0/1572062224 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563f0c9d91c0 con 0x563f0c9eba40 2023-08-10T12:03:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.260+0000 7f86037fe700 1 -- 172.21.15.73:0/1572062224 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7f8614030030 con 0x563f0c9eba40 2023-08-10T12:03:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.260+0000 7f86366b5b80 10 client.26476 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:03:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.260+0000 7f86366b5b80 10 client.26476 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:03:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.260+0000 7f86366b5b80 20 client.26476 populate_metadata read hostname 'smithi073' 2023-08-10T12:03:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.260+0000 7f86366b5b80 1 --2- 172.21.15.73:0/1572062224 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563f0ca10eb0 0x563f0ca132d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:08.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.260+0000 7f86366b5b80 4 client.26476 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:03:08.267 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.260+0000 7f86366b5b80 1 -- 172.21.15.73:0/1572062224 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563f0c9b5970 con 0x563f0ca10eb0 2023-08-10T12:03:08.268 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.267+0000 7f8623fff700 1 --2- 172.21.15.73:0/1572062224 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563f0ca10eb0 0x563f0ca132d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:08.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.267+0000 7f86037fe700 10 client.26476 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:03:08.269 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.267+0000 7f8623fff700 1 --2- 172.21.15.73:0/1572062224 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563f0ca10eb0 0x563f0ca132d0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a70491a81dddcb12 server_cookie=ca4378e07e5f325b in_seq=0 out_seq=0 2023-08-10T12:03:08.284 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.278+0000 7f86037fe700 1 -- 172.21.15.73:0/1572062224 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x563f0c9b5970 con 0x563f0ca10eb0 2023-08-10T12:03:08.284 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.278+0000 7f86037fe700 10 client.26476 handle_command_reply: tid=0 2023-08-10T12:03:08.294 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.286+0000 7f86366b5b80 1 client.26476 shutdown 2023-08-10T12:03:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.287+0000 7f86366b5b80 1 -- 172.21.15.73:0/1572062224 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0c9eba40 msgr2=0x563f0c9ef6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.287+0000 7f86366b5b80 1 --2- 172.21.15.73:0/1572062224 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0c9eba40 0x563f0c9ef6b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f86140094f0 tx=0x7f8614021e20 comp rx=0 tx=0).stop 2023-08-10T12:03:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.289+0000 7f86366b5b80 1 -- 172.21.15.73:0/1572062224 shutdown_connections 2023-08-10T12:03:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.289+0000 7f86366b5b80 1 --2- 172.21.15.73:0/1572062224 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563f0ca10eb0 0x563f0ca132d0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.289+0000 7f86366b5b80 1 --2- 172.21.15.73:0/1572062224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0c9ec360 0x563f0c9efdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.289+0000 7f86366b5b80 1 --2- 172.21.15.73:0/1572062224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f0c9e6550 0x563f0c9f2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.289+0000 7f86366b5b80 1 --2- 172.21.15.73:0/1572062224 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0c9eba40 0x563f0c9ef6b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.296 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.289+0000 7f86366b5b80 1 -- 172.21.15.73:0/1572062224 >> 172.21.15.73:0/1572062224 conn(0x563f0c943c70 msgr2=0x563f0c9e04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:03:08.296 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.289+0000 7f86037fe700 0 client.26476 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:03:08.296 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.290+0000 7f86366b5b80 1 -- 172.21.15.73:0/1572062224 shutdown_connections 2023-08-10T12:03:08.296 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.290+0000 7f86366b5b80 1 -- 172.21.15.73:0/1572062224 wait complete. 2023-08-10T12:03:08.296 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.290+0000 7f86366b5b80 20 client.26476 trim_cache size 0 max 16384 2023-08-10T12:03:08.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.317+0000 7f86366b5b80 1 Processor -- start 2023-08-10T12:03:08.324 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.317+0000 7f86366b5b80 1 -- start start 2023-08-10T12:03:08.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.317+0000 7f86366b5b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0c9e6550 0x563f0ca07eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:08.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.317+0000 7f86366b5b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f0c9eba40 0x563f0c9e0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:08.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.317+0000 7f86366b5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0c9ec360 0x563f0c9eee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:08.325 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.317+0000 7f86366b5b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0c7ba8c0 con 0x563f0c9eba40 2023-08-10T12:03:08.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.317+0000 7f86366b5b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0c9e1c10 con 0x563f0c9e6550 2023-08-10T12:03:08.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.317+0000 7f86366b5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0c9edc10 con 0x563f0c9ec360 2023-08-10T12:03:08.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.317+0000 7f8628ab9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0c9ec360 0x563f0c9eee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:08.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.317+0000 7f8628ab9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0c9ec360 0x563f0c9eee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:33956/0 (socket says 172.21.15.73:33956) 2023-08-10T12:03:08.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.317+0000 7f8628ab9700 1 -- 172.21.15.73:0/1594567962 learned_addr learned my addr 172.21.15.73:0/1594567962 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:03:08.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.320+0000 7f8628ab9700 1 -- 172.21.15.73:0/1594567962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0c9e6550 msgr2=0x563f0ca07eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:08.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.320+0000 7f8628ab9700 1 --2- 172.21.15.73:0/1594567962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0c9e6550 0x563f0ca07eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.326 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.320+0000 7f8628ab9700 1 -- 172.21.15.73:0/1594567962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f0c9eba40 msgr2=0x563f0c9e0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:08.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.320+0000 7f8628ab9700 1 --2- 172.21.15.73:0/1594567962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f0c9eba40 0x563f0c9e0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.320+0000 7f8628ab9700 1 -- 172.21.15.73:0/1594567962 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f0c74dc00 con 0x563f0c9ec360 2023-08-10T12:03:08.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.320+0000 7f8628ab9700 1 --2- 172.21.15.73:0/1594567962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0c9ec360 0x563f0c9eee70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f861c004680 tx=0x7f861c00b950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=565889e7442ab296 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:03:08.327 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.321+0000 7f861affd700 1 -- 172.21.15.73:0/1594567962 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c039070 con 0x563f0c9ec360 2023-08-10T12:03:08.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.321+0000 7f861affd700 1 -- 172.21.15.73:0/1594567962 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f861c003b40 con 0x563f0c9ec360 2023-08-10T12:03:08.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.321+0000 7f861affd700 1 -- 172.21.15.73:0/1594567962 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c033b30 con 0x563f0c9ec360 2023-08-10T12:03:08.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.322+0000 7f86366b5b80 1 -- 172.21.15.73:0/1594567962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0c9ec360 msgr2=0x563f0c9eee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:08.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.322+0000 7f86366b5b80 1 --2- 172.21.15.73:0/1594567962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0c9ec360 0x563f0c9eee70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f861c004680 tx=0x7f861c00b950 comp rx=0 tx=0).stop 2023-08-10T12:03:08.328 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.326+0000 7f86366b5b80 1 -- 172.21.15.73:0/1594567962 shutdown_connections 2023-08-10T12:03:08.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.326+0000 7f86366b5b80 1 --2- 172.21.15.73:0/1594567962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0c9e6550 0x563f0ca07eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.326+0000 7f86366b5b80 1 --2- 172.21.15.73:0/1594567962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0c9ec360 0x563f0c9eee70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.326+0000 7f86366b5b80 1 --2- 172.21.15.73:0/1594567962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f0c9eba40 0x563f0c9e0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.329 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.326+0000 7f86366b5b80 1 -- 172.21.15.73:0/1594567962 >> 172.21.15.73:0/1594567962 conn(0x563f0c943c70 msgr2=0x563f0c9e98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:03:08.335 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.333+0000 7f86366b5b80 1 -- 172.21.15.73:0/1594567962 shutdown_connections 2023-08-10T12:03:08.342 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.336+0000 7f86366b5b80 1 -- 172.21.15.73:0/1594567962 wait complete. 2023-08-10T12:03:08.342 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.337+0000 7f86366b5b80 1 -- start start 2023-08-10T12:03:08.342 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.337+0000 7f86366b5b80 1 Processor -- start 2023-08-10T12:03:08.342 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.337+0000 7f86366b5b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0c9e6550 0x563f0ca06580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:08.342 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.337+0000 7f86366b5b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f0c9eba40 0x563f0ca06ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:08.343 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.337+0000 7f86366b5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0c9ec360 0x563f0ca07000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:08.343 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.337+0000 7f86366b5b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0ca64c60 con 0x563f0c9eba40 2023-08-10T12:03:08.343 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.337+0000 7f86366b5b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0ca64dd0 con 0x563f0c9e6550 2023-08-10T12:03:08.343 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.337+0000 7f86366b5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0ca64f90 con 0x563f0c9ec360 2023-08-10T12:03:08.343 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.337+0000 7f86366b5b80 10 client.0 _ll_register_callbacks cb 0x563f0c8d4620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:03:08.343 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.338+0000 7f8623fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0c9e6550 0x563f0ca06580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:08.343 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.338+0000 7f8623fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0c9e6550 0x563f0ca06580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:51340/0 (socket says 172.21.15.73:51340) 2023-08-10T12:03:08.344 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.338+0000 7f8623fff700 1 -- 172.21.15.73:0/237110089 learned_addr learned my addr 172.21.15.73:0/237110089 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:03:08.344 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.338+0000 7f8628ab9700 1 --2- 172.21.15.73:0/237110089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0c9ec360 0x563f0ca07000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:08.344 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.338+0000 7f8628ab9700 1 -- 172.21.15.73:0/237110089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0c9e6550 msgr2=0x563f0ca06580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:08.344 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.338+0000 7f8628ab9700 1 --2- 172.21.15.73:0/237110089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0c9e6550 0x563f0ca06580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.344 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.338+0000 7f8628ab9700 1 -- 172.21.15.73:0/237110089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f0c9eba40 msgr2=0x563f0ca06ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T12:03:08.344 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.338+0000 7f8628ab9700 1 --2- 172.21.15.73:0/237110089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f0c9eba40 0x563f0ca06ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.345 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.338+0000 7f8628ab9700 1 -- 172.21.15.73:0/237110089 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f861c004330 con 0x563f0c9ec360 2023-08-10T12:03:08.345 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.338+0000 7f8628ab9700 1 --2- 172.21.15.73:0/237110089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0c9ec360 0x563f0ca07000 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x563f0c9e1f70 tx=0x7f861c003ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=922f88f614d5da9a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:03:08.345 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.338+0000 7f86037fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T12:03:08.345 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.339+0000 7f86037fe700 1 -- 172.21.15.73:0/237110089 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c039030 con 0x563f0c9ec360 2023-08-10T12:03:08.345 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.339+0000 7f86037fe700 1 -- 172.21.15.73:0/237110089 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f861c003950 con 0x563f0c9ec360 2023-08-10T12:03:08.345 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.339+0000 7f86366b5b80 1 -- 172.21.15.73:0/237110089 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f861400f040 con 0x563f0c9ec360 2023-08-10T12:03:08.346 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.339+0000 7f86037fe700 1 -- 172.21.15.73:0/237110089 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f861c005050 con 0x563f0c9ec360 2023-08-10T12:03:08.346 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.339+0000 7f86366b5b80 10 client.26482 fetch_fsmap learned FSMap version 55 2023-08-10T12:03:08.346 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.339+0000 7f86366b5b80 1 -- 172.21.15.73:0/237110089 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x563f0c78b1f0 con 0x563f0c9ec360 2023-08-10T12:03:08.346 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.339+0000 7f86037fe700 1 -- 172.21.15.73:0/237110089 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f861400f040 con 0x563f0c9ec360 2023-08-10T12:03:08.346 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.339+0000 7f86037fe700 1 -- 172.21.15.73:0/237110089 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7f861c033710 con 0x563f0c9ec360 2023-08-10T12:03:08.346 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.339+0000 7f86366b5b80 10 client.26482 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:03:08.346 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.339+0000 7f86366b5b80 10 client.26482 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:03:08.346 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.339+0000 7f86366b5b80 20 client.26482 populate_metadata read hostname 'smithi073' 2023-08-10T12:03:08.347 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.339+0000 7f86366b5b80 1 --2- 172.21.15.73:0/237110089 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563f0ca66750 0x563f0ca68b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:08.347 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.340+0000 7f86366b5b80 4 client.26482 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T12:03:08.347 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.340+0000 7f86366b5b80 1 -- 172.21.15.73:0/237110089 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563f0c930720 con 0x563f0ca66750 2023-08-10T12:03:08.347 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.341+0000 7f8623fff700 1 --2- 172.21.15.73:0/237110089 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563f0ca66750 0x563f0ca68b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:08.348 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.344+0000 7f8623fff700 1 --2- 172.21.15.73:0/237110089 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563f0ca66750 0x563f0ca68b70 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7e581b979bc2588 server_cookie=f75f5b0c4d2b86fe in_seq=0 out_seq=0 2023-08-10T12:03:08.348 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.344+0000 7f86037fe700 10 client.26482 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:03:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.824+0000 7f86037fe700 1 -- 172.21.15.73:0/237110089 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563f0c930720 con 0x563f0ca66750 2023-08-10T12:03:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.824+0000 7f86037fe700 10 client.26482 handle_command_reply: tid=0 2023-08-10T12:03:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.824+0000 7f86366b5b80 1 client.26482 shutdown 2023-08-10T12:03:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.825+0000 7f86366b5b80 1 -- 172.21.15.73:0/237110089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0c9ec360 msgr2=0x563f0ca07000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.825+0000 7f86366b5b80 1 --2- 172.21.15.73:0/237110089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0c9ec360 0x563f0ca07000 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x563f0c9e1f70 tx=0x7f861c003ee0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.825+0000 7f86366b5b80 1 -- 172.21.15.73:0/237110089 shutdown_connections 2023-08-10T12:03:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.825+0000 7f86366b5b80 1 --2- 172.21.15.73:0/237110089 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563f0ca66750 0x563f0ca68b70 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.825+0000 7f86366b5b80 1 --2- 172.21.15.73:0/237110089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f0c9e6550 0x563f0ca06580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.825+0000 7f86366b5b80 1 --2- 172.21.15.73:0/237110089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0c9ec360 0x563f0ca07000 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.825+0000 7f86366b5b80 1 --2- 172.21.15.73:0/237110089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f0c9eba40 0x563f0ca06ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.825+0000 7f86366b5b80 1 -- 172.21.15.73:0/237110089 >> 172.21.15.73:0/237110089 conn(0x563f0c943c70 msgr2=0x563f0c9ec740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:03:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.826+0000 7f86037fe700 0 client.26482 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:03:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.827+0000 7f86366b5b80 1 -- 172.21.15.73:0/237110089 shutdown_connections 2023-08-10T12:03:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.827+0000 7f86366b5b80 1 -- 172.21.15.73:0/237110089 wait complete. 2023-08-10T12:03:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.827+0000 7f86366b5b80 20 client.26482 trim_cache size 0 max 16384 2023-08-10T12:03:08.830 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T12:03:08.830 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T12:03:08.830 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T12:03:08.830 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T12:03:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.831+0000 7f862a51c700 1 -- 172.21.15.73:0/1185685511 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f86100a14d0 msgr2=0x7f86100a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.831+0000 7f862a51c700 1 --2- 172.21.15.73:0/1185685511 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f86100a14d0 0x7f86100a3990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8614009fd0 tx=0x7f8614009040 comp rx=0 tx=0).stop 2023-08-10T12:03:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.831+0000 7f862a51c700 1 -- 172.21.15.73:0/1185685511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8624100720 msgr2=0x7f862419ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.831+0000 7f862a51c700 1 --2- 172.21.15.73:0/1185685511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8624100720 0x7f862419ea40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f860c00b2e0 tx=0x7f860c010fa0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.831+0000 7f862a51c700 1 -- 172.21.15.73:0/1185685511 shutdown_connections 2023-08-10T12:03:08.834 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.831+0000 7f862a51c700 1 --2- 172.21.15.73:0/1185685511 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f86100a14d0 0x7f86100a3990 secure :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8614009fd0 tx=0x7f8614009040 comp rx=0 tx=0).stop 2023-08-10T12:03:08.834 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.831+0000 7f862a51c700 1 --2- 172.21.15.73:0/1185685511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8624100720 0x7f862419ea40 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f860c00b2e0 tx=0x7f860c010fa0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.834 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.831+0000 7f862a51c700 1 --2- 172.21.15.73:0/1185685511 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8624106730 0x7f86241988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.834 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.831+0000 7f862a51c700 1 --2- 172.21.15.73:0/1185685511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86241010e0 0x7f862419ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:08.834 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.831+0000 7f862a51c700 1 -- 172.21.15.73:0/1185685511 >> 172.21.15.73:0/1185685511 conn(0x7f86240fc230 msgr2=0x7f86240fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:03:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.835+0000 7f862a51c700 1 -- 172.21.15.73:0/1185685511 shutdown_connections 2023-08-10T12:03:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:08.836+0000 7f862a51c700 1 -- 172.21.15.73:0/1185685511 wait complete. 2023-08-10T12:03:09.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:09 smithi152 ceph-mon[130220]: pgmap v327: 97 pgs: 5 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 88 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 281 op/s 2023-08-10T12:03:09.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:09 smithi156 ceph-mon[130574]: pgmap v327: 97 pgs: 5 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 88 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 281 op/s 2023-08-10T12:03:09.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:09 smithi073 ceph-mon[128869]: pgmap v327: 97 pgs: 5 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 88 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 281 op/s 2023-08-10T12:03:11.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:11 smithi152 ceph-mon[130220]: pgmap v328: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 351 op/s 2023-08-10T12:03:11.508 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:11 smithi156 ceph-mon[130574]: pgmap v328: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 351 op/s 2023-08-10T12:03:11.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:11 smithi073 ceph-mon[128869]: pgmap v328: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 351 op/s 2023-08-10T12:03:13.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:13 smithi152 ceph-mon[130220]: pgmap v329: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 357 op/s 2023-08-10T12:03:13.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:13 smithi156 ceph-mon[130574]: pgmap v329: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 357 op/s 2023-08-10T12:03:13.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:13 smithi073 ceph-mon[128869]: pgmap v329: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 357 op/s 2023-08-10T12:03:15.248 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:14 smithi152 ceph-mon[130220]: pgmap v330: 97 pgs: 38 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 38 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 319 op/s 2023-08-10T12:03:15.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:14 smithi156 ceph-mon[130574]: pgmap v330: 97 pgs: 38 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 38 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 319 op/s 2023-08-10T12:03:15.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:14 smithi073 ceph-mon[128869]: pgmap v330: 97 pgs: 38 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 38 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 319 op/s 2023-08-10T12:03:17.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:17 smithi152 ceph-mon[130220]: pgmap v331: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 1.1 MiB/s wr, 256 op/s 2023-08-10T12:03:17.509 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:17 smithi156 ceph-mon[130574]: pgmap v331: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 1.1 MiB/s wr, 256 op/s 2023-08-10T12:03:17.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:17 smithi073 ceph-mon[128869]: pgmap v331: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 1.1 MiB/s wr, 256 op/s 2023-08-10T12:03:19.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:19 smithi152 ceph-mon[130220]: pgmap v332: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 1.0 MiB/s wr, 226 op/s 2023-08-10T12:03:19.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:19 smithi156 ceph-mon[130574]: pgmap v332: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 1.0 MiB/s wr, 226 op/s 2023-08-10T12:03:19.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:19 smithi073 ceph-mon[128869]: pgmap v332: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 1.0 MiB/s wr, 226 op/s 2023-08-10T12:03:21.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:21 smithi152 ceph-mon[130220]: pgmap v333: 97 pgs: 25 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 61 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 1.1 MiB/s wr, 247 op/s 2023-08-10T12:03:21.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:21 smithi156 ceph-mon[130574]: pgmap v333: 97 pgs: 25 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 61 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 1.1 MiB/s wr, 247 op/s 2023-08-10T12:03:21.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:21 smithi073 ceph-mon[128869]: pgmap v333: 97 pgs: 25 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 61 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 1.1 MiB/s wr, 247 op/s 2023-08-10T12:03:21.972 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.971+0000 7f3f58bba700 1 -- 172.21.15.73:0/382133749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f54106720 msgr2=0x7f3f54106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:21.972 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.971+0000 7f3f58bba700 1 --2- 172.21.15.73:0/382133749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f54106720 0x7f3f54106b00 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f3f480099c0 tx=0x7f3f48009cd0 comp rx=0 tx=0).stop 2023-08-10T12:03:21.972 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.971+0000 7f3f58bba700 1 -- 172.21.15.73:0/382133749 shutdown_connections 2023-08-10T12:03:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.971+0000 7f3f58bba700 1 --2- 172.21.15.73:0/382133749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f54068520 0x7f3f5410d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.971+0000 7f3f58bba700 1 --2- 172.21.15.73:0/382133749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f54106720 0x7f3f54106b00 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.971+0000 7f3f58bba700 1 --2- 172.21.15.73:0/382133749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f54067b60 0x7f3f54067fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.971+0000 7f3f58bba700 1 -- 172.21.15.73:0/382133749 >> 172.21.15.73:0/382133749 conn(0x7f3f540750a0 msgr2=0x7f3f540754b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:03:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.971+0000 7f3f58bba700 1 -- 172.21.15.73:0/382133749 shutdown_connections 2023-08-10T12:03:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.971+0000 7f3f58bba700 1 -- 172.21.15.73:0/382133749 wait complete. 2023-08-10T12:03:21.976 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.972+0000 7f3f58bba700 1 Processor -- start 2023-08-10T12:03:21.976 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.972+0000 7f3f58bba700 1 -- start start 2023-08-10T12:03:21.976 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.972+0000 7f3f58bba700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f54067b60 0x7f3f5419c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:21.976 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.972+0000 7f3f58bba700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f54068520 0x7f3f5419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:21.977 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.972+0000 7f3f58bba700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f54106720 0x7f3f541966d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:21.977 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.972+0000 7f3f58bba700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f54196d40 con 0x7f3f54067b60 2023-08-10T12:03:21.977 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.972+0000 7f3f58bba700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f54196eb0 con 0x7f3f54106720 2023-08-10T12:03:21.977 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.972+0000 7f3f58bba700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f54197070 con 0x7f3f54068520 2023-08-10T12:03:21.978 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.973+0000 7f3f5259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f54067b60 0x7f3f5419c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:21.978 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.973+0000 7f3f5259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f54067b60 0x7f3f5419c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36702/0 (socket says 172.21.15.73:36702) 2023-08-10T12:03:21.978 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.973+0000 7f3f5259c700 1 -- 172.21.15.73:0/50530965 learned_addr learned my addr 172.21.15.73:0/50530965 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:03:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.973+0000 7f3f51d9b700 1 --2- 172.21.15.73:0/50530965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f54068520 0x7f3f5419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.973+0000 7f3f52d9d700 1 --2- 172.21.15.73:0/50530965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f54106720 0x7f3f541966d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.973+0000 7f3f5259c700 1 -- 172.21.15.73:0/50530965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f54068520 msgr2=0x7f3f5419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.973+0000 7f3f5259c700 1 --2- 172.21.15.73:0/50530965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f54068520 0x7f3f5419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:21.980 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.973+0000 7f3f5259c700 1 -- 172.21.15.73:0/50530965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f54106720 msgr2=0x7f3f541966d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:21.980 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.973+0000 7f3f5259c700 1 --2- 172.21.15.73:0/50530965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f54106720 0x7f3f541966d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:21.980 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.973+0000 7f3f5259c700 1 -- 172.21.15.73:0/50530965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f480095f0 con 0x7f3f54067b60 2023-08-10T12:03:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.973+0000 7f3f5259c700 1 --2- 172.21.15.73:0/50530965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f54067b60 0x7f3f5419c820 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f3f480036c0 tx=0x7f3f48005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:03:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.973+0000 7f3f437fe700 1 -- 172.21.15.73:0/50530965 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4801d070 con 0x7f3f54067b60 2023-08-10T12:03:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.973+0000 7f3f437fe700 1 -- 172.21.15.73:0/50530965 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f4800fb30 con 0x7f3f54067b60 2023-08-10T12:03:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.973+0000 7f3f58bba700 1 -- 172.21.15.73:0/50530965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f541972f0 con 0x7f3f54067b60 2023-08-10T12:03:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.973+0000 7f3f437fe700 1 -- 172.21.15.73:0/50530965 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f48022c20 con 0x7f3f54067b60 2023-08-10T12:03:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.973+0000 7f3f58bba700 1 -- 172.21.15.73:0/50530965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f541a3810 con 0x7f3f54067b60 2023-08-10T12:03:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.975+0000 7f3f437fe700 1 -- 172.21.15.73:0/50530965 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f3f4800fca0 con 0x7f3f54067b60 2023-08-10T12:03:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.976+0000 7f3f437fe700 1 --2- 172.21.15.73:0/50530965 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f3f3c0a12c0 0x7f3f3c0a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.976+0000 7f3f437fe700 1 -- 172.21.15.73:0/50530965 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f3f480ce2a0 con 0x7f3f54067b60 2023-08-10T12:03:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.976+0000 7f3f51d9b700 1 --2- 172.21.15.73:0/50530965 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f3f3c0a12c0 0x7f3f3c0a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.976+0000 7f3f51d9b700 1 --2- 172.21.15.73:0/50530965 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f3f3c0a12c0 0x7f3f3c0a3780 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3f54105c30 tx=0x7f3f440073d0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:03:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.977+0000 7f3f64d53b80 1 Processor -- start 2023-08-10T12:03:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.977+0000 7f3f64d53b80 1 -- start start 2023-08-10T12:03:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.977+0000 7f3f64d53b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3fa40 0x557d26a3fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.977+0000 7f3f64d53b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d26a40360 0x557d26a3a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.977+0000 7f3f64d53b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d26a3a550 0x557d26a3a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.977+0000 7f3f64d53b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d269b5d60 con 0x557d26a3fa40 2023-08-10T12:03:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.977+0000 7f3f64d53b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d26992530 con 0x557d26a40360 2023-08-10T12:03:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.977+0000 7f3f64d53b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2698fe50 con 0x557d26a3a550 2023-08-10T12:03:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.977+0000 7f3f5259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3fa40 0x557d26a3fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.977+0000 7f3f5259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3fa40 0x557d26a3fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36710/0 (socket says 172.21.15.73:36710) 2023-08-10T12:03:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.977+0000 7f3f5259c700 1 -- 172.21.15.73:0/4292238387 learned_addr learned my addr 172.21.15.73:0/4292238387 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:03:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.977+0000 7f3f51d9b700 1 --2- 172.21.15.73:0/4292238387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d26a40360 0x557d26a3a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.977+0000 7f3f52d9d700 1 --2- 172.21.15.73:0/4292238387 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d26a3a550 0x557d26a3a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.978+0000 7f3f5259c700 1 -- 172.21.15.73:0/4292238387 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d26a3a550 msgr2=0x557d26a3a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.978+0000 7f3f5259c700 1 --2- 172.21.15.73:0/4292238387 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d26a3a550 0x557d26a3a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.978+0000 7f3f5259c700 1 -- 172.21.15.73:0/4292238387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d26a40360 msgr2=0x557d26a3a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.978+0000 7f3f5259c700 1 --2- 172.21.15.73:0/4292238387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d26a40360 0x557d26a3a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.978+0000 7f3f5259c700 1 -- 172.21.15.73:0/4292238387 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d2680c5d0 con 0x557d26a3fa40 2023-08-10T12:03:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.978+0000 7f3f5259c700 1 --2- 172.21.15.73:0/4292238387 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3fa40 0x557d26a3fe20 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f3f48097e50 tx=0x7f3f480226c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a35178dfe6de2f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:03:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.978+0000 7f3f40ff9700 1 -- 172.21.15.73:0/4292238387 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4809f410 con 0x557d26a3fa40 2023-08-10T12:03:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.978+0000 7f3f40ff9700 1 -- 172.21.15.73:0/4292238387 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f480a37a0 con 0x557d26a3fa40 2023-08-10T12:03:21.992 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.978+0000 7f3f40ff9700 1 -- 172.21.15.73:0/4292238387 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f48084be0 con 0x557d26a3fa40 2023-08-10T12:03:21.992 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.979+0000 7f3f64d53b80 1 -- 172.21.15.73:0/4292238387 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3fa40 msgr2=0x557d26a3fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:21.992 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.979+0000 7f3f64d53b80 1 --2- 172.21.15.73:0/4292238387 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3fa40 0x557d26a3fe20 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f3f48097e50 tx=0x7f3f480226c0 comp rx=0 tx=0).stop 2023-08-10T12:03:21.992 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.979+0000 7f3f64d53b80 1 -- 172.21.15.73:0/4292238387 shutdown_connections 2023-08-10T12:03:21.992 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.979+0000 7f3f64d53b80 1 --2- 172.21.15.73:0/4292238387 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d26a3a550 0x557d26a3a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:21.992 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.979+0000 7f3f64d53b80 1 --2- 172.21.15.73:0/4292238387 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3fa40 0x557d26a3fe20 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:21.992 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.979+0000 7f3f64d53b80 1 --2- 172.21.15.73:0/4292238387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d26a40360 0x557d26a3a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.979+0000 7f3f64d53b80 1 -- 172.21.15.73:0/4292238387 >> 172.21.15.73:0/4292238387 conn(0x557d26997c70 msgr2=0x557d26a34d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:03:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.979+0000 7f3f64d53b80 1 -- 172.21.15.73:0/4292238387 shutdown_connections 2023-08-10T12:03:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.979+0000 7f3f64d53b80 1 -- 172.21.15.73:0/4292238387 wait complete. 2023-08-10T12:03:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.979+0000 7f3f64d53b80 1 -- start start 2023-08-10T12:03:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.979+0000 7f3f64d53b80 1 Processor -- start 2023-08-10T12:03:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.979+0000 7f3f64d53b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d26a3a550 0x557d26a436c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.979+0000 7f3f64d53b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3fa40 0x557d26a43c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.979+0000 7f3f64d53b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d26a40360 0x557d26a44140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.979+0000 7f3f64d53b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2698b740 con 0x557d26a3fa40 2023-08-10T12:03:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.979+0000 7f3f64d53b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2692aa60 con 0x557d26a3a550 2023-08-10T12:03:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.979+0000 7f3f64d53b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2692a760 con 0x557d26a40360 2023-08-10T12:03:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.979+0000 7f3f64d53b80 10 client.0 _ll_register_callbacks cb 0x557d26928620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:03:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.979+0000 7f3f51d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3fa40 0x557d26a43c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.979+0000 7f3f51d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3fa40 0x557d26a43c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36718/0 (socket says 172.21.15.73:36718) 2023-08-10T12:03:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.979+0000 7f3f51d9b700 1 -- 172.21.15.73:0/2748265509 learned_addr learned my addr 172.21.15.73:0/2748265509 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:03:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.980+0000 7f3f52d9d700 1 --2- 172.21.15.73:0/2748265509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d26a40360 0x557d26a44140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.980+0000 7f3f5259c700 1 --2- 172.21.15.73:0/2748265509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d26a3a550 0x557d26a436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.980+0000 7f3f51d9b700 1 -- 172.21.15.73:0/2748265509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d26a40360 msgr2=0x557d26a44140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.980+0000 7f3f51d9b700 1 --2- 172.21.15.73:0/2748265509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d26a40360 0x557d26a44140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.980+0000 7f3f51d9b700 1 -- 172.21.15.73:0/2748265509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d26a3a550 msgr2=0x557d26a436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.980+0000 7f3f51d9b700 1 --2- 172.21.15.73:0/2748265509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d26a3a550 0x557d26a436c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.980+0000 7f3f51d9b700 1 -- 172.21.15.73:0/2748265509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f541a3810 con 0x557d26a3fa40 2023-08-10T12:03:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.980+0000 7f3f5259c700 1 --2- 172.21.15.73:0/2748265509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d26a3a550 0x557d26a436c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T12:03:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.980+0000 7f3f51d9b700 1 --2- 172.21.15.73:0/2748265509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3fa40 0x557d26a43c00 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f3f44011010 tx=0x7f3f440047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fbc6f32f9609621 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:03:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.980+0000 7f3f39ffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:03:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.980+0000 7f3f39ffb700 1 -- 172.21.15.73:0/2748265509 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f44003b90 con 0x557d26a3fa40 2023-08-10T12:03:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.980+0000 7f3f39ffb700 1 -- 172.21.15.73:0/2748265509 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f3f44017070 con 0x557d26a3fa40 2023-08-10T12:03:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.980+0000 7f3f64d53b80 1 -- 172.21.15.73:0/2748265509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557d26a2d1c0 con 0x557d26a3fa40 2023-08-10T12:03:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.980+0000 7f3f39ffb700 1 -- 172.21.15.73:0/2748265509 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f44003cf0 con 0x557d26a3fa40 2023-08-10T12:03:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.980+0000 7f3f64d53b80 10 client.17022 fetch_fsmap learned FSMap version 55 2023-08-10T12:03:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.980+0000 7f3f64d53b80 1 -- 172.21.15.73:0/2748265509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x557d267b8d80 con 0x557d26a3fa40 2023-08-10T12:03:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.980+0000 7f3f39ffb700 1 -- 172.21.15.73:0/2748265509 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557d26a2d1c0 con 0x557d26a3fa40 2023-08-10T12:03:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.980+0000 7f3f39ffb700 1 -- 172.21.15.73:0/2748265509 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7f3f44020530 con 0x557d26a3fa40 2023-08-10T12:03:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.980+0000 7f3f64d53b80 10 client.17022 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:03:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.980+0000 7f3f64d53b80 10 client.17022 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:03:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.981+0000 7f3f64d53b80 20 client.17022 populate_metadata read hostname 'smithi073' 2023-08-10T12:03:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.981+0000 7f3f64d53b80 1 --2- 172.21.15.73:0/2748265509 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x557d26a53ba0 0x557d26a55fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.981+0000 7f3f64d53b80 4 client.17022 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:03:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.981+0000 7f3f64d53b80 1 -- 172.21.15.73:0/2748265509 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557d26a09970 con 0x557d26a53ba0 2023-08-10T12:03:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.981+0000 7f3f5259c700 1 --2- 172.21.15.73:0/2748265509 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x557d26a53ba0 0x557d26a55fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.981+0000 7f3f39ffb700 10 client.17022 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:03:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.981+0000 7f3f5259c700 1 --2- 172.21.15.73:0/2748265509 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x557d26a53ba0 0x557d26a55fc0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18f5d2b681e2a782 server_cookie=95ccc6ec16fea96b in_seq=0 out_seq=0 2023-08-10T12:03:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.982+0000 7f3f39ffb700 1 -- 172.21.15.73:0/2748265509 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x557d26a09970 con 0x557d26a53ba0 2023-08-10T12:03:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.982+0000 7f3f39ffb700 10 client.17022 handle_command_reply: tid=0 2023-08-10T12:03:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.982+0000 7f3f64d53b80 1 client.17022 shutdown 2023-08-10T12:03:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.982+0000 7f3f64d53b80 1 -- 172.21.15.73:0/2748265509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3fa40 msgr2=0x557d26a43c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.982+0000 7f3f64d53b80 1 --2- 172.21.15.73:0/2748265509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3fa40 0x557d26a43c00 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f3f44011010 tx=0x7f3f440047c0 comp rx=0 tx=0).stop 2023-08-10T12:03:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.982+0000 7f3f64d53b80 1 -- 172.21.15.73:0/2748265509 shutdown_connections 2023-08-10T12:03:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.982+0000 7f3f64d53b80 1 --2- 172.21.15.73:0/2748265509 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x557d26a53ba0 0x557d26a55fc0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.982+0000 7f3f64d53b80 1 --2- 172.21.15.73:0/2748265509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d26a3a550 0x557d26a436c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.982+0000 7f3f64d53b80 1 --2- 172.21.15.73:0/2748265509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d26a40360 0x557d26a44140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.982+0000 7f3f64d53b80 1 --2- 172.21.15.73:0/2748265509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3fa40 0x557d26a43c00 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.982+0000 7f3f39ffb700 0 client.17022 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:03:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.982+0000 7f3f64d53b80 1 -- 172.21.15.73:0/2748265509 >> 172.21.15.73:0/2748265509 conn(0x557d26997c70 msgr2=0x557d26a344b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:03:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.982+0000 7f3f64d53b80 1 -- 172.21.15.73:0/2748265509 shutdown_connections 2023-08-10T12:03:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.982+0000 7f3f64d53b80 1 -- 172.21.15.73:0/2748265509 wait complete. 2023-08-10T12:03:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.982+0000 7f3f64d53b80 20 client.17022 trim_cache size 0 max 16384 2023-08-10T12:03:22.006 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.996+0000 7f3f64d53b80 1 Processor -- start 2023-08-10T12:03:22.006 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.996+0000 7f3f64d53b80 1 -- start start 2023-08-10T12:03:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.996+0000 7f3f64d53b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3a550 0x557d26a3a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.996+0000 7f3f64d53b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d26a3fa40 0x557d26a4ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.996+0000 7f3f64d53b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d26a40360 0x557d26a34c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.996+0000 7f3f64d53b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2680e8c0 con 0x557d26a3a550 2023-08-10T12:03:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.996+0000 7f3f64d53b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d26a3d450 con 0x557d26a3fa40 2023-08-10T12:03:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.996+0000 7f3f64d53b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d26a3e450 con 0x557d26a40360 2023-08-10T12:03:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.997+0000 7f3f5259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3a550 0x557d26a3a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:22.008 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.997+0000 7f3f5259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3a550 0x557d26a3a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36724/0 (socket says 172.21.15.73:36724) 2023-08-10T12:03:22.008 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.997+0000 7f3f5259c700 1 -- 172.21.15.73:0/249547780 learned_addr learned my addr 172.21.15.73:0/249547780 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:03:22.008 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.997+0000 7f3f52d9d700 1 --2- 172.21.15.73:0/249547780 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d26a40360 0x557d26a34c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:22.008 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.997+0000 7f3f51d9b700 1 --2- 172.21.15.73:0/249547780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d26a3fa40 0x557d26a4ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:22.008 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.997+0000 7f3f5259c700 1 -- 172.21.15.73:0/249547780 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d26a40360 msgr2=0x557d26a34c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:22.008 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.997+0000 7f3f5259c700 1 --2- 172.21.15.73:0/249547780 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d26a40360 0x557d26a34c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:22.008 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.997+0000 7f3f5259c700 1 -- 172.21.15.73:0/249547780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d26a3fa40 msgr2=0x557d26a4ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:22.009 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.997+0000 7f3f5259c700 1 --2- 172.21.15.73:0/249547780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d26a3fa40 0x557d26a4ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:22.009 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.997+0000 7f3f5259c700 1 -- 172.21.15.73:0/249547780 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d267a1c00 con 0x557d26a3a550 2023-08-10T12:03:22.009 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.997+0000 7f3f51d9b700 1 --2- 172.21.15.73:0/249547780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d26a3fa40 0x557d26a4ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T12:03:22.009 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.997+0000 7f3f5259c700 1 --2- 172.21.15.73:0/249547780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3a550 0x557d26a3a010 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f3f480cbf50 tx=0x7f3f4809b1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f3d913ae91f8a87 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:03:22.009 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.997+0000 7f3f417fa700 1 -- 172.21.15.73:0/249547780 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f480995a0 con 0x557d26a3a550 2023-08-10T12:03:22.009 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.997+0000 7f3f417fa700 1 -- 172.21.15.73:0/249547780 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f480b2070 con 0x557d26a3a550 2023-08-10T12:03:22.009 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.997+0000 7f3f417fa700 1 -- 172.21.15.73:0/249547780 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f480a12a0 con 0x557d26a3a550 2023-08-10T12:03:22.010 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.998+0000 7f3f64d53b80 1 -- 172.21.15.73:0/249547780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3a550 msgr2=0x557d26a3a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:22.010 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.998+0000 7f3f64d53b80 1 --2- 172.21.15.73:0/249547780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3a550 0x557d26a3a010 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f3f480cbf50 tx=0x7f3f4809b1b0 comp rx=0 tx=0).stop 2023-08-10T12:03:22.010 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.998+0000 7f3f64d53b80 1 -- 172.21.15.73:0/249547780 shutdown_connections 2023-08-10T12:03:22.010 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.998+0000 7f3f64d53b80 1 --2- 172.21.15.73:0/249547780 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d26a40360 0x557d26a34c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:22.010 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.998+0000 7f3f64d53b80 1 --2- 172.21.15.73:0/249547780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3a550 0x557d26a3a010 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:22.010 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.998+0000 7f3f64d53b80 1 --2- 172.21.15.73:0/249547780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d26a3fa40 0x557d26a4ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:22.010 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.998+0000 7f3f64d53b80 1 -- 172.21.15.73:0/249547780 >> 172.21.15.73:0/249547780 conn(0x557d26997c70 msgr2=0x557d26a43c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:03:22.011 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.998+0000 7f3f64d53b80 1 -- 172.21.15.73:0/249547780 shutdown_connections 2023-08-10T12:03:22.011 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.998+0000 7f3f64d53b80 1 -- 172.21.15.73:0/249547780 wait complete. 2023-08-10T12:03:22.011 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.998+0000 7f3f64d53b80 1 -- start start 2023-08-10T12:03:22.011 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.998+0000 7f3f64d53b80 1 Processor -- start 2023-08-10T12:03:22.011 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.998+0000 7f3f64d53b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d26a3a550 0x557d26a9b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:22.011 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.998+0000 7f3f64d53b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3fa40 0x557d26a9bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:22.011 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.998+0000 7f3f64d53b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d26a40360 0x557d26aa6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:22.011 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.998+0000 7f3f64d53b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d26a9c5a0 con 0x557d26a3fa40 2023-08-10T12:03:22.012 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.998+0000 7f3f64d53b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d26aa6d60 con 0x557d26a40360 2023-08-10T12:03:22.012 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.998+0000 7f3f64d53b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d26aa6ea0 con 0x557d26a3a550 2023-08-10T12:03:22.012 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.998+0000 7f3f64d53b80 10 client.0 _ll_register_callbacks cb 0x557d26928620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:03:22.012 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.999+0000 7f3f51d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3fa40 0x557d26a9bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:22.012 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.999+0000 7f3f52d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d26a40360 0x557d26aa6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:22.012 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.999+0000 7f3f5259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d26a3a550 0x557d26a9b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.999+0000 7f3f51d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3fa40 0x557d26a9bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36732/0 (socket says 172.21.15.73:36732) 2023-08-10T12:03:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.999+0000 7f3f51d9b700 1 -- 172.21.15.73:0/282352779 learned_addr learned my addr 172.21.15.73:0/282352779 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:03:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.999+0000 7f3f5259c700 1 -- 172.21.15.73:0/282352779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d26a40360 msgr2=0x557d26aa6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.999+0000 7f3f5259c700 1 --2- 172.21.15.73:0/282352779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d26a40360 0x557d26aa6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.999+0000 7f3f5259c700 1 -- 172.21.15.73:0/282352779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3fa40 msgr2=0x557d26a9bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.999+0000 7f3f5259c700 1 --2- 172.21.15.73:0/282352779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3fa40 0x557d26a9bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.999+0000 7f3f5259c700 1 -- 172.21.15.73:0/282352779 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557d2680c5d0 con 0x557d26a3a550 2023-08-10T12:03:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.999+0000 7f3f52d9d700 1 --2- 172.21.15.73:0/282352779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d26a40360 0x557d26aa6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:03:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.999+0000 7f3f51d9b700 1 --2- 172.21.15.73:0/282352779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3fa40 0x557d26a9bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:03:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.999+0000 7f3f5259c700 1 --2- 172.21.15.73:0/282352779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d26a3a550 0x557d26a9b7a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3f4809b0e0 tx=0x7f3f48009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56577b6b39730ebd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:03:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.999+0000 7f3f39ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T12:03:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.999+0000 7f3f39ffb700 1 -- 172.21.15.73:0/282352779 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4809f120 con 0x557d26a3a550 2023-08-10T12:03:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.999+0000 7f3f64d53b80 1 -- 172.21.15.73:0/282352779 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3f480a37a0 con 0x557d26a3a550 2023-08-10T12:03:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.999+0000 7f3f39ffb700 1 -- 172.21.15.73:0/282352779 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f3f480a10c0 con 0x557d26a3a550 2023-08-10T12:03:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.999+0000 7f3f39ffb700 1 -- 172.21.15.73:0/282352779 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f480a1280 con 0x557d26a3a550 2023-08-10T12:03:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.999+0000 7f3f64d53b80 10 client.26500 fetch_fsmap learned FSMap version 55 2023-08-10T12:03:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:21.999+0000 7f3f64d53b80 1 -- 172.21.15.73:0/282352779 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x557d267df1f0 con 0x557d26a3a550 2023-08-10T12:03:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.000+0000 7f3f39ffb700 1 -- 172.21.15.73:0/282352779 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f480a37a0 con 0x557d26a3a550 2023-08-10T12:03:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.000+0000 7f3f39ffb700 1 -- 172.21.15.73:0/282352779 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7f3f4807b080 con 0x557d26a3a550 2023-08-10T12:03:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.000+0000 7f3f64d53b80 10 client.26500 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:03:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.000+0000 7f3f64d53b80 10 client.26500 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:03:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.000+0000 7f3f64d53b80 20 client.26500 populate_metadata read hostname 'smithi073' 2023-08-10T12:03:22.016 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.000+0000 7f3f64d53b80 1 --2- 172.21.15.73:0/282352779 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x557d26aa8200 0x557d26aaa620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:22.016 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.000+0000 7f3f64d53b80 4 client.26500 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T12:03:22.016 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.000+0000 7f3f64d53b80 1 -- 172.21.15.73:0/282352779 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557d26984720 con 0x557d26aa8200 2023-08-10T12:03:22.016 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.000+0000 7f3f51d9b700 1 --2- 172.21.15.73:0/282352779 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x557d26aa8200 0x557d26aaa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:22.016 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.000+0000 7f3f39ffb700 10 client.26500 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:03:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.000+0000 7f3f51d9b700 1 --2- 172.21.15.73:0/282352779 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x557d26aa8200 0x557d26aaa620 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18e5a2703480e136 server_cookie=6a295451d61bd67 in_seq=0 out_seq=0 2023-08-10T12:03:22.074 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.072+0000 7f3f39ffb700 1 -- 172.21.15.73:0/282352779 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557d26984720 con 0x557d26aa8200 2023-08-10T12:03:22.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.072+0000 7f3f39ffb700 10 client.26500 handle_command_reply: tid=0 2023-08-10T12:03:22.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.072+0000 7f3f64d53b80 1 client.26500 shutdown 2023-08-10T12:03:22.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.072+0000 7f3f64d53b80 1 -- 172.21.15.73:0/282352779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d26a3a550 msgr2=0x557d26a9b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:22.075 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.072+0000 7f3f64d53b80 1 --2- 172.21.15.73:0/282352779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d26a3a550 0x557d26a9b7a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3f4809b0e0 tx=0x7f3f48009310 comp rx=0 tx=0).stop 2023-08-10T12:03:22.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.072+0000 7f3f64d53b80 1 -- 172.21.15.73:0/282352779 shutdown_connections 2023-08-10T12:03:22.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.072+0000 7f3f64d53b80 1 --2- 172.21.15.73:0/282352779 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x557d26aa8200 0x557d26aaa620 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:22.076 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.072+0000 7f3f64d53b80 1 --2- 172.21.15.73:0/282352779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557d26a40360 0x557d26aa6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:22.077 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.072+0000 7f3f39ffb700 0 client.26500 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:03:22.077 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.072+0000 7f3f64d53b80 1 --2- 172.21.15.73:0/282352779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d26a3a550 0x557d26a9b7a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:22.077 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.072+0000 7f3f64d53b80 1 --2- 172.21.15.73:0/282352779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d26a3fa40 0x557d26a9bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:22.077 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.072+0000 7f3f64d53b80 1 -- 172.21.15.73:0/282352779 >> 172.21.15.73:0/282352779 conn(0x557d26997c70 msgr2=0x557d26a3e860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:03:22.078 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.072+0000 7f3f64d53b80 1 -- 172.21.15.73:0/282352779 shutdown_connections 2023-08-10T12:03:22.078 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.072+0000 7f3f64d53b80 1 -- 172.21.15.73:0/282352779 wait complete. 2023-08-10T12:03:22.078 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.073+0000 7f3f64d53b80 20 client.26500 trim_cache size 0 max 16384 2023-08-10T12:03:22.079 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T12:03:22.079 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T12:03:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T12:03:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T12:03:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.073+0000 7f3f58bba700 1 -- 172.21.15.73:0/50530965 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f3f3c0a12c0 msgr2=0x7f3f3c0a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.073+0000 7f3f58bba700 1 --2- 172.21.15.73:0/50530965 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f3f3c0a12c0 0x7f3f3c0a3780 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3f54105c30 tx=0x7f3f440073d0 comp rx=0 tx=0).stop 2023-08-10T12:03:22.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.073+0000 7f3f58bba700 1 -- 172.21.15.73:0/50530965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f54067b60 msgr2=0x7f3f5419c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:22.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.073+0000 7f3f58bba700 1 --2- 172.21.15.73:0/50530965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f54067b60 0x7f3f5419c820 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f3f480036c0 tx=0x7f3f48005740 comp rx=0 tx=0).stop 2023-08-10T12:03:22.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.073+0000 7f3f58bba700 1 -- 172.21.15.73:0/50530965 shutdown_connections 2023-08-10T12:03:22.082 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.073+0000 7f3f58bba700 1 --2- 172.21.15.73:0/50530965 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f3f3c0a12c0 0x7f3f3c0a3780 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:22.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.073+0000 7f3f58bba700 1 --2- 172.21.15.73:0/50530965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f54106720 0x7f3f541966d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:22.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.073+0000 7f3f58bba700 1 --2- 172.21.15.73:0/50530965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f54067b60 0x7f3f5419c820 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:22.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.073+0000 7f3f58bba700 1 --2- 172.21.15.73:0/50530965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f54068520 0x7f3f5419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:22.083 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.073+0000 7f3f58bba700 1 -- 172.21.15.73:0/50530965 >> 172.21.15.73:0/50530965 conn(0x7f3f540750a0 msgr2=0x7f3f540fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:03:22.084 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.073+0000 7f3f58bba700 1 -- 172.21.15.73:0/50530965 shutdown_connections 2023-08-10T12:03:22.084 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:22.073+0000 7f3f58bba700 1 -- 172.21.15.73:0/50530965 wait complete. 2023-08-10T12:03:23.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:23 smithi152 ceph-mon[130220]: pgmap v334: 97 pgs: 21 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 68 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 888 KiB/s wr, 121 op/s 2023-08-10T12:03:23.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:23 smithi156 ceph-mon[130574]: pgmap v334: 97 pgs: 21 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 68 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 888 KiB/s wr, 121 op/s 2023-08-10T12:03:23.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:23 smithi073 ceph-mon[128869]: pgmap v334: 97 pgs: 21 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 68 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 888 KiB/s wr, 121 op/s 2023-08-10T12:03:25.248 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:24 smithi152 ceph-mon[130220]: pgmap v335: 97 pgs: 10 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 83 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 130 op/s 2023-08-10T12:03:25.258 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:24 smithi156 ceph-mon[130574]: pgmap v335: 97 pgs: 10 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 83 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 130 op/s 2023-08-10T12:03:25.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:24 smithi073 ceph-mon[128869]: pgmap v335: 97 pgs: 10 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 83 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 130 op/s 2023-08-10T12:03:27.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:27 smithi152 ceph-mon[130220]: pgmap v336: 97 pgs: 97 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 164 op/s 2023-08-10T12:03:27.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:27 smithi156 ceph-mon[130574]: pgmap v336: 97 pgs: 97 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 164 op/s 2023-08-10T12:03:27.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:27 smithi073 ceph-mon[128869]: pgmap v336: 97 pgs: 97 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 164 op/s 2023-08-10T12:03:29.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:29 smithi152 ceph-mon[130220]: pgmap v337: 97 pgs: 97 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 161 op/s 2023-08-10T12:03:29.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:29 smithi152 ceph-mon[130220]: osdmap e96: 12 total, 12 up, 12 in 2023-08-10T12:03:29.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:29 smithi156 ceph-mon[130574]: pgmap v337: 97 pgs: 97 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 161 op/s 2023-08-10T12:03:29.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:29 smithi156 ceph-mon[130574]: osdmap e96: 12 total, 12 up, 12 in 2023-08-10T12:03:29.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:29 smithi073 ceph-mon[128869]: pgmap v337: 97 pgs: 97 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 161 op/s 2023-08-10T12:03:29.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:29 smithi073 ceph-mon[128869]: osdmap e96: 12 total, 12 up, 12 in 2023-08-10T12:03:31.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:31 smithi152 ceph-mon[130220]: pgmap v339: 97 pgs: 97 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 323 op/s 2023-08-10T12:03:31.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:31 smithi156 ceph-mon[130574]: pgmap v339: 97 pgs: 97 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 323 op/s 2023-08-10T12:03:31.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:31 smithi073 ceph-mon[128869]: pgmap v339: 97 pgs: 97 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 323 op/s 2023-08-10T12:03:33.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:33 smithi152 ceph-mon[130220]: pgmap v340: 97 pgs: 97 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 345 op/s 2023-08-10T12:03:33.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:33 smithi156 ceph-mon[130574]: pgmap v340: 97 pgs: 97 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 345 op/s 2023-08-10T12:03:33.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:33 smithi073 ceph-mon[128869]: pgmap v340: 97 pgs: 97 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 345 op/s 2023-08-10T12:03:35.184 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.181+0000 7ffab35cd700 1 -- 172.21.15.73:0/497521610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaac0fffe0 msgr2=0x7ffaac10c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:35.185 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.181+0000 7ffab35cd700 1 --2- 172.21.15.73:0/497521610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaac0fffe0 0x7ffaac10c4f0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400b0a0 tx=0x7ffaa400b3b0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.185 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.181+0000 7ffab35cd700 1 -- 172.21.15.73:0/497521610 shutdown_connections 2023-08-10T12:03:35.186 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.181+0000 7ffab35cd700 1 --2- 172.21.15.73:0/497521610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffaac105630 0x7ffaac105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.186 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.181+0000 7ffab35cd700 1 --2- 172.21.15.73:0/497521610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaac0fffe0 0x7ffaac10c4f0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.186 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.181+0000 7ffab35cd700 1 --2- 172.21.15.73:0/497521610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffaac0ff620 0x7ffaac0ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.187 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.181+0000 7ffab35cd700 1 -- 172.21.15.73:0/497521610 >> 172.21.15.73:0/497521610 conn(0x7ffaac0fb0b0 msgr2=0x7ffaac0fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:03:35.187 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.181+0000 7ffab35cd700 1 -- 172.21.15.73:0/497521610 shutdown_connections 2023-08-10T12:03:35.187 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.181+0000 7ffab35cd700 1 -- 172.21.15.73:0/497521610 wait complete. 2023-08-10T12:03:35.187 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.182+0000 7ffab35cd700 1 Processor -- start 2023-08-10T12:03:35.188 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.182+0000 7ffab35cd700 1 -- start start 2023-08-10T12:03:35.188 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.182+0000 7ffab35cd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffaac0ff620 0x7ffaac19c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:35.189 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.182+0000 7ffab35cd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffaac0fffe0 0x7ffaac19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:35.189 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.182+0000 7ffab35cd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaac105630 0x7ffaac196640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:35.189 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.182+0000 7ffab35cd700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac196cb0 con 0x7ffaac105630 2023-08-10T12:03:35.190 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.182+0000 7ffab35cd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac196e20 con 0x7ffaac0ff620 2023-08-10T12:03:35.190 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.182+0000 7ffab35cd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac196fe0 con 0x7ffaac0fffe0 2023-08-10T12:03:35.190 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.182+0000 7ffab1b6a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaac105630 0x7ffaac196640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:35.190 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.182+0000 7ffab1369700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffaac0ff620 0x7ffaac19c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:35.191 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.182+0000 7ffab1b6a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaac105630 0x7ffaac196640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36748/0 (socket says 172.21.15.73:36748) 2023-08-10T12:03:35.191 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.182+0000 7ffab1369700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffaac0ff620 0x7ffaac19c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:51394/0 (socket says 172.21.15.73:51394) 2023-08-10T12:03:35.191 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.182+0000 7ffab1b6a700 1 -- 172.21.15.73:0/3532642935 learned_addr learned my addr 172.21.15.73:0/3532642935 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:03:35.191 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.182+0000 7ffab0b68700 1 --2- 172.21.15.73:0/3532642935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffaac0fffe0 0x7ffaac19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:35.192 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.182+0000 7ffab1b6a700 1 -- 172.21.15.73:0/3532642935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffaac0fffe0 msgr2=0x7ffaac19cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:35.192 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.182+0000 7ffab1b6a700 1 --2- 172.21.15.73:0/3532642935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffaac0fffe0 0x7ffaac19cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.192 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.182+0000 7ffab1b6a700 1 -- 172.21.15.73:0/3532642935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffaac0ff620 msgr2=0x7ffaac19c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:35.193 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.182+0000 7ffab1b6a700 1 --2- 172.21.15.73:0/3532642935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffaac0ff620 0x7ffaac19c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.193 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.182+0000 7ffab1b6a700 1 -- 172.21.15.73:0/3532642935 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa4009d00 con 0x7ffaac105630 2023-08-10T12:03:35.193 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.182+0000 7ffab1b6a700 1 --2- 172.21.15.73:0/3532642935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaac105630 0x7ffaac196640 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4009850 tx=0x7ffaa40077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:03:35.193 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.183+0000 7ffaa27fc700 1 -- 172.21.15.73:0/3532642935 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa400e040 con 0x7ffaac105630 2023-08-10T12:03:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.183+0000 7ffaa27fc700 1 -- 172.21.15.73:0/3532642935 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffaa40079e0 con 0x7ffaac105630 2023-08-10T12:03:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.183+0000 7ffab35cd700 1 -- 172.21.15.73:0/3532642935 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaac197260 con 0x7ffaac105630 2023-08-10T12:03:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.183+0000 7ffaa27fc700 1 -- 172.21.15.73:0/3532642935 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa40052a0 con 0x7ffaac105630 2023-08-10T12:03:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.183+0000 7ffab35cd700 1 -- 172.21.15.73:0/3532642935 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaac1a37d0 con 0x7ffaac105630 2023-08-10T12:03:35.205 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.185+0000 7ffaa27fc700 1 -- 172.21.15.73:0/3532642935 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7ffaa401d470 con 0x7ffaac105630 2023-08-10T12:03:35.206 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.186+0000 7ffaa27fc700 1 --2- 172.21.15.73:0/3532642935 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ffa980a12c0 0x7ffa980a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:35.206 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.186+0000 7ffab1369700 1 --2- 172.21.15.73:0/3532642935 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ffa980a12c0 0x7ffa980a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:35.206 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.186+0000 7ffaa27fc700 1 -- 172.21.15.73:0/3532642935 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ffaa40ce010 con 0x7ffaac105630 2023-08-10T12:03:35.207 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.186+0000 7ffab1369700 1 --2- 172.21.15.73:0/3532642935 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ffa980a12c0 0x7ffa980a3780 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009be0 tx=0x7ffa9c009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:03:35.207 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.187+0000 7ffabf766b80 1 Processor -- start 2023-08-10T12:03:35.207 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.187+0000 7ffabf766b80 1 -- start start 2023-08-10T12:03:35.207 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.187+0000 7ffabf766b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56553b61ba40 0x56553b61be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:35.208 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.187+0000 7ffabf766b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b61c360 0x56553b616010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:35.208 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.187+0000 7ffabf766b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56553b616550 0x56553b6169d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:35.208 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.187+0000 7ffabf766b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56553b591d60 con 0x56553b61c360 2023-08-10T12:03:35.208 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.187+0000 7ffabf766b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56553b56e530 con 0x56553b61ba40 2023-08-10T12:03:35.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.187+0000 7ffabf766b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56553b56be50 con 0x56553b616550 2023-08-10T12:03:35.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.187+0000 7ffab0b68700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b61c360 0x56553b616010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:35.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.187+0000 7ffab1369700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56553b61ba40 0x56553b61be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:35.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.187+0000 7ffab0b68700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b61c360 0x56553b616010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36754/0 (socket says 172.21.15.73:36754) 2023-08-10T12:03:35.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.187+0000 7ffab0b68700 1 -- 172.21.15.73:0/2966133016 learned_addr learned my addr 172.21.15.73:0/2966133016 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:03:35.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.187+0000 7ffab1b6a700 1 --2- 172.21.15.73:0/2966133016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56553b616550 0x56553b6169d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:35.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.187+0000 7ffab0b68700 1 -- 172.21.15.73:0/2966133016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56553b616550 msgr2=0x56553b6169d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:35.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.187+0000 7ffab0b68700 1 --2- 172.21.15.73:0/2966133016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56553b616550 0x56553b6169d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.187+0000 7ffab0b68700 1 -- 172.21.15.73:0/2966133016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56553b61ba40 msgr2=0x56553b61be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:35.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.187+0000 7ffab0b68700 1 --2- 172.21.15.73:0/2966133016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56553b61ba40 0x56553b61be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.187+0000 7ffab0b68700 1 -- 172.21.15.73:0/2966133016 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56553b3e85d0 con 0x56553b61c360 2023-08-10T12:03:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.187+0000 7ffab0b68700 1 --2- 172.21.15.73:0/2966133016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b61c360 0x56553b616010 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8009d20 tx=0x7ffaa8011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd103ac874c96d2c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:03:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.188+0000 7ffa977fe700 1 -- 172.21.15.73:0/2966133016 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8019630 con 0x56553b61c360 2023-08-10T12:03:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.188+0000 7ffa977fe700 1 -- 172.21.15.73:0/2966133016 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffaa8009e70 con 0x56553b61c360 2023-08-10T12:03:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.188+0000 7ffa977fe700 1 -- 172.21.15.73:0/2966133016 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa800eab0 con 0x56553b61c360 2023-08-10T12:03:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.188+0000 7ffabf766b80 1 -- 172.21.15.73:0/2966133016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b61c360 msgr2=0x56553b616010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.188+0000 7ffabf766b80 1 --2- 172.21.15.73:0/2966133016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b61c360 0x56553b616010 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8009d20 tx=0x7ffaa8011720 comp rx=0 tx=0).stop 2023-08-10T12:03:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.188+0000 7ffabf766b80 1 -- 172.21.15.73:0/2966133016 shutdown_connections 2023-08-10T12:03:35.212 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.188+0000 7ffabf766b80 1 --2- 172.21.15.73:0/2966133016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56553b61ba40 0x56553b61be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.212 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.188+0000 7ffabf766b80 1 --2- 172.21.15.73:0/2966133016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56553b616550 0x56553b6169d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.212 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.188+0000 7ffabf766b80 1 --2- 172.21.15.73:0/2966133016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b61c360 0x56553b616010 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.212 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.188+0000 7ffabf766b80 1 -- 172.21.15.73:0/2966133016 >> 172.21.15.73:0/2966133016 conn(0x56553b573c70 msgr2=0x56553b610d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:03:35.212 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.188+0000 7ffabf766b80 1 -- 172.21.15.73:0/2966133016 shutdown_connections 2023-08-10T12:03:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.188+0000 7ffabf766b80 1 -- 172.21.15.73:0/2966133016 wait complete. 2023-08-10T12:03:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.189+0000 7ffabf766b80 1 -- start start 2023-08-10T12:03:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.189+0000 7ffabf766b80 1 Processor -- start 2023-08-10T12:03:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.189+0000 7ffabf766b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56553b616550 0x56553b6223b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.189+0000 7ffabf766b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56553b61ba40 0x56553b61f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.189+0000 7ffabf766b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b61c360 0x56553b61fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.189+0000 7ffabf766b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56553b567740 con 0x56553b61c360 2023-08-10T12:03:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.189+0000 7ffabf766b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56553b506a60 con 0x56553b61ba40 2023-08-10T12:03:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.189+0000 7ffabf766b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56553b506760 con 0x56553b616550 2023-08-10T12:03:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.189+0000 7ffabf766b80 10 client.0 _ll_register_callbacks cb 0x56553b504620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:03:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.189+0000 7ffab1b6a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b61c360 0x56553b61fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.189+0000 7ffab0b68700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56553b61ba40 0x56553b61f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.189+0000 7ffab1369700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56553b616550 0x56553b6223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.189+0000 7ffab1b6a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b61c360 0x56553b61fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36762/0 (socket says 172.21.15.73:36762) 2023-08-10T12:03:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.189+0000 7ffab1b6a700 1 -- 172.21.15.73:0/4115324079 learned_addr learned my addr 172.21.15.73:0/4115324079 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:03:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.190+0000 7ffab1b6a700 1 -- 172.21.15.73:0/4115324079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56553b616550 msgr2=0x56553b6223b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.190+0000 7ffab1b6a700 1 --2- 172.21.15.73:0/4115324079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56553b616550 0x56553b6223b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.190+0000 7ffab1b6a700 1 -- 172.21.15.73:0/4115324079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56553b61ba40 msgr2=0x56553b61f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.190+0000 7ffab1b6a700 1 --2- 172.21.15.73:0/4115324079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56553b61ba40 0x56553b61f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.190+0000 7ffab1b6a700 1 -- 172.21.15.73:0/4115324079 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa8009980 con 0x56553b61c360 2023-08-10T12:03:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.190+0000 7ffab1369700 1 --2- 172.21.15.73:0/4115324079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56553b616550 0x56553b6223b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:03:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.190+0000 7ffab1b6a700 1 --2- 172.21.15.73:0/4115324079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b61c360 0x56553b61fd90 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4097670 tx=0x7ffaa409aad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da04f03f8c632c9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:03:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.190+0000 7ffa94ff9700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:03:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.190+0000 7ffa94ff9700 1 -- 172.21.15.73:0/4115324079 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa409b5d0 con 0x56553b61c360 2023-08-10T12:03:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.190+0000 7ffa94ff9700 1 -- 172.21.15.73:0/4115324079 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ffaa409b170 con 0x56553b61c360 2023-08-10T12:03:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.190+0000 7ffabf766b80 1 -- 172.21.15.73:0/4115324079 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56553b6091c0 con 0x56553b61c360 2023-08-10T12:03:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.190+0000 7ffa94ff9700 1 -- 172.21.15.73:0/4115324079 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffaa4004e60 con 0x56553b61c360 2023-08-10T12:03:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.190+0000 7ffabf766b80 10 client.17040 fetch_fsmap learned FSMap version 55 2023-08-10T12:03:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.190+0000 7ffabf766b80 1 -- 172.21.15.73:0/4115324079 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x56553b394d80 con 0x56553b61c360 2023-08-10T12:03:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.190+0000 7ffa94ff9700 1 -- 172.21.15.73:0/4115324079 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffaa40b7080 con 0x56553b61c360 2023-08-10T12:03:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.190+0000 7ffa94ff9700 1 -- 172.21.15.73:0/4115324079 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7ffaa40a30a0 con 0x56553b61c360 2023-08-10T12:03:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.190+0000 7ffabf766b80 10 client.17040 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:03:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.190+0000 7ffabf766b80 10 client.17040 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:03:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.190+0000 7ffabf766b80 20 client.17040 populate_metadata read hostname 'smithi073' 2023-08-10T12:03:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.191+0000 7ffabf766b80 1 --2- 172.21.15.73:0/4115324079 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56553b62fc60 0x56553b632080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:35.218 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.191+0000 7ffabf766b80 4 client.17040 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:03:35.218 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.191+0000 7ffabf766b80 1 -- 172.21.15.73:0/4115324079 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56553b5e5970 con 0x56553b62fc60 2023-08-10T12:03:35.218 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.191+0000 7ffab1369700 1 --2- 172.21.15.73:0/4115324079 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56553b62fc60 0x56553b632080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:35.218 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.191+0000 7ffa94ff9700 10 client.17040 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:03:35.218 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.191+0000 7ffab1369700 1 --2- 172.21.15.73:0/4115324079 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56553b62fc60 0x56553b632080 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebe8a459bd5d127d server_cookie=231aeed76e01b674 in_seq=0 out_seq=0 2023-08-10T12:03:35.218 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.192+0000 7ffa94ff9700 1 -- 172.21.15.73:0/4115324079 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x56553b5e5970 con 0x56553b62fc60 2023-08-10T12:03:35.218 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.192+0000 7ffa94ff9700 10 client.17040 handle_command_reply: tid=0 2023-08-10T12:03:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.192+0000 7ffabf766b80 1 client.17040 shutdown 2023-08-10T12:03:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.192+0000 7ffabf766b80 1 -- 172.21.15.73:0/4115324079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b61c360 msgr2=0x56553b61fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.192+0000 7ffabf766b80 1 --2- 172.21.15.73:0/4115324079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b61c360 0x56553b61fd90 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4097670 tx=0x7ffaa409aad0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.192+0000 7ffabf766b80 1 -- 172.21.15.73:0/4115324079 shutdown_connections 2023-08-10T12:03:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.192+0000 7ffabf766b80 1 --2- 172.21.15.73:0/4115324079 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56553b62fc60 0x56553b632080 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.192+0000 7ffabf766b80 1 --2- 172.21.15.73:0/4115324079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b61c360 0x56553b61fd90 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.192+0000 7ffabf766b80 1 --2- 172.21.15.73:0/4115324079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56553b616550 0x56553b6223b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.192+0000 7ffa94ff9700 0 client.17040 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:03:35.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.192+0000 7ffabf766b80 1 --2- 172.21.15.73:0/4115324079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56553b61ba40 0x56553b61f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.192+0000 7ffabf766b80 1 -- 172.21.15.73:0/4115324079 >> 172.21.15.73:0/4115324079 conn(0x56553b573c70 msgr2=0x56553b6104b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:03:35.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.192+0000 7ffabf766b80 1 -- 172.21.15.73:0/4115324079 shutdown_connections 2023-08-10T12:03:35.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.192+0000 7ffabf766b80 1 -- 172.21.15.73:0/4115324079 wait complete. 2023-08-10T12:03:35.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.192+0000 7ffabf766b80 20 client.17040 trim_cache size 0 max 16384 2023-08-10T12:03:35.225 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.206+0000 7ffabf766b80 1 Processor -- start 2023-08-10T12:03:35.225 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.207+0000 7ffabf766b80 1 -- start start 2023-08-10T12:03:35.225 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.207+0000 7ffabf766b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b616550 0x56553b61af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:35.225 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.207+0000 7ffabf766b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56553b61ba40 0x56553b61ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:35.226 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.207+0000 7ffabf766b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56553b61c360 0x56553b610c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:35.226 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.207+0000 7ffabf766b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56553b612b80 con 0x56553b616550 2023-08-10T12:03:35.226 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.207+0000 7ffabf766b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56553b3ea8c0 con 0x56553b61c360 2023-08-10T12:03:35.226 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.207+0000 7ffabf766b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56553b620c10 con 0x56553b61ba40 2023-08-10T12:03:35.226 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.207+0000 7ffab1369700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b616550 0x56553b61af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:35.226 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.207+0000 7ffab1369700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b616550 0x56553b61af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36766/0 (socket says 172.21.15.73:36766) 2023-08-10T12:03:35.226 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.207+0000 7ffab1369700 1 -- 172.21.15.73:0/2825430371 learned_addr learned my addr 172.21.15.73:0/2825430371 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:03:35.226 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.207+0000 7ffab0b68700 1 --2- 172.21.15.73:0/2825430371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56553b61ba40 0x56553b61ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:35.227 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.207+0000 7ffab1b6a700 1 --2- 172.21.15.73:0/2825430371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56553b61c360 0x56553b610c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:35.227 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.207+0000 7ffab1369700 1 -- 172.21.15.73:0/2825430371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56553b61ba40 msgr2=0x56553b61ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:35.227 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.207+0000 7ffab1369700 1 --2- 172.21.15.73:0/2825430371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56553b61ba40 0x56553b61ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.227 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.207+0000 7ffab1369700 1 -- 172.21.15.73:0/2825430371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56553b61c360 msgr2=0x56553b610c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:35.227 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.207+0000 7ffab1369700 1 --2- 172.21.15.73:0/2825430371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56553b61c360 0x56553b610c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.227 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.207+0000 7ffab1369700 1 -- 172.21.15.73:0/2825430371 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56553b37dc00 con 0x56553b616550 2023-08-10T12:03:35.227 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.207+0000 7ffab1369700 1 --2- 172.21.15.73:0/2825430371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b616550 0x56553b61af60 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c005950 tx=0x7ffa9c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9ad64cb66bb73a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:03:35.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.207+0000 7ffa97fff700 1 -- 172.21.15.73:0/2825430371 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c024040 con 0x56553b616550 2023-08-10T12:03:35.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.207+0000 7ffa97fff700 1 -- 172.21.15.73:0/2825430371 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffa9c02a4d0 con 0x56553b616550 2023-08-10T12:03:35.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.208+0000 7ffa97fff700 1 -- 172.21.15.73:0/2825430371 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c01fd90 con 0x56553b616550 2023-08-10T12:03:35.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.208+0000 7ffabf766b80 1 -- 172.21.15.73:0/2825430371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b616550 msgr2=0x56553b61af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:35.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.208+0000 7ffabf766b80 1 --2- 172.21.15.73:0/2825430371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b616550 0x56553b61af60 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c005950 tx=0x7ffa9c014000 comp rx=0 tx=0).stop 2023-08-10T12:03:35.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.208+0000 7ffabf766b80 1 -- 172.21.15.73:0/2825430371 shutdown_connections 2023-08-10T12:03:35.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.208+0000 7ffabf766b80 1 --2- 172.21.15.73:0/2825430371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56553b61c360 0x56553b610c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.208+0000 7ffabf766b80 1 --2- 172.21.15.73:0/2825430371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b616550 0x56553b61af60 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.208+0000 7ffabf766b80 1 --2- 172.21.15.73:0/2825430371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56553b61ba40 0x56553b61ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.208+0000 7ffabf766b80 1 -- 172.21.15.73:0/2825430371 >> 172.21.15.73:0/2825430371 conn(0x56553b573c70 msgr2=0x56553b61a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:03:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.208+0000 7ffabf766b80 1 -- 172.21.15.73:0/2825430371 shutdown_connections 2023-08-10T12:03:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.208+0000 7ffabf766b80 1 -- 172.21.15.73:0/2825430371 wait complete. 2023-08-10T12:03:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.208+0000 7ffabf766b80 1 -- start start 2023-08-10T12:03:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.208+0000 7ffabf766b80 1 Processor -- start 2023-08-10T12:03:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.209+0000 7ffabf766b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56553b616550 0x56553b626e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:35.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.209+0000 7ffabf766b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56553b61ba40 0x56553b625250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:35.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.209+0000 7ffabf766b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b61c360 0x56553b625810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:35.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.209+0000 7ffabf766b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56553b625f20 con 0x56553b61c360 2023-08-10T12:03:35.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.209+0000 7ffabf766b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56553b626090 con 0x56553b61ba40 2023-08-10T12:03:35.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.209+0000 7ffabf766b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56553b687cf0 con 0x56553b616550 2023-08-10T12:03:35.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.209+0000 7ffabf766b80 10 client.0 _ll_register_callbacks cb 0x56553b504620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:03:35.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.209+0000 7ffab1b6a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b61c360 0x56553b625810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:35.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.209+0000 7ffab1b6a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b61c360 0x56553b625810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36776/0 (socket says 172.21.15.73:36776) 2023-08-10T12:03:35.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.209+0000 7ffab0b68700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56553b61ba40 0x56553b625250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:35.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.209+0000 7ffab1b6a700 1 -- 172.21.15.73:0/1135459864 learned_addr learned my addr 172.21.15.73:0/1135459864 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:03:35.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.209+0000 7ffab1369700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56553b616550 0x56553b626e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:35.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.209+0000 7ffab1b6a700 1 -- 172.21.15.73:0/1135459864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56553b616550 msgr2=0x56553b626e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:35.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.209+0000 7ffab1b6a700 1 --2- 172.21.15.73:0/1135459864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56553b616550 0x56553b626e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.209+0000 7ffab1b6a700 1 -- 172.21.15.73:0/1135459864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56553b61ba40 msgr2=0x56553b625250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:35.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.209+0000 7ffab1b6a700 1 --2- 172.21.15.73:0/1135459864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56553b61ba40 0x56553b625250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.232 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.209+0000 7ffab1b6a700 1 -- 172.21.15.73:0/1135459864 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa9c017070 con 0x56553b61c360 2023-08-10T12:03:35.232 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.209+0000 7ffab1b6a700 1 --2- 172.21.15.73:0/1135459864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b61c360 0x56553b625810 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40994c0 tx=0x7ffaa401dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631c25e88d8a9c9d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:03:35.232 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.209+0000 7ffa94ff9700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:03:35.232 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.210+0000 7ffa94ff9700 1 -- 172.21.15.73:0/1135459864 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4004e60 con 0x56553b61c360 2023-08-10T12:03:35.232 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.210+0000 7ffa94ff9700 1 -- 172.21.15.73:0/1135459864 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ffaa409b170 con 0x56553b61c360 2023-08-10T12:03:35.232 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.210+0000 7ffabf766b80 1 -- 172.21.15.73:0/1135459864 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffaa8009e70 con 0x56553b61c360 2023-08-10T12:03:35.233 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.210+0000 7ffa94ff9700 1 -- 172.21.15.73:0/1135459864 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffaa409f1a0 con 0x56553b61c360 2023-08-10T12:03:35.233 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.210+0000 7ffabf766b80 10 client.17046 fetch_fsmap learned FSMap version 55 2023-08-10T12:03:35.233 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.210+0000 7ffabf766b80 1 -- 172.21.15.73:0/1135459864 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x56553b3bb1f0 con 0x56553b61c360 2023-08-10T12:03:35.233 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.210+0000 7ffa94ff9700 1 -- 172.21.15.73:0/1135459864 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffaa40bae90 con 0x56553b61c360 2023-08-10T12:03:35.233 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.210+0000 7ffa94ff9700 1 -- 172.21.15.73:0/1135459864 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7ffaa4066020 con 0x56553b61c360 2023-08-10T12:03:35.233 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.210+0000 7ffabf766b80 10 client.17046 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:03:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.210+0000 7ffabf766b80 10 client.17046 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:03:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.210+0000 7ffabf766b80 20 client.17046 populate_metadata read hostname 'smithi073' 2023-08-10T12:03:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.210+0000 7ffabf766b80 1 --2- 172.21.15.73:0/1135459864 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56553b688ff0 0x56553b68b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.210+0000 7ffabf766b80 4 client.17046 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T12:03:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.210+0000 7ffabf766b80 1 -- 172.21.15.73:0/1135459864 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56553b560720 con 0x56553b688ff0 2023-08-10T12:03:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.210+0000 7ffab1369700 1 --2- 172.21.15.73:0/1135459864 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56553b688ff0 0x56553b68b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.211+0000 7ffa94ff9700 10 client.17046 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:03:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.211+0000 7ffab1369700 1 --2- 172.21.15.73:0/1135459864 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56553b688ff0 0x56553b68b3e0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b151c4d899607328 server_cookie=713c282003edb5a5 in_seq=0 out_seq=0 2023-08-10T12:03:35.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.219+0000 7ffa94ff9700 1 -- 172.21.15.73:0/1135459864 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56553b560720 con 0x56553b688ff0 2023-08-10T12:03:35.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.220+0000 7ffa94ff9700 10 client.17046 handle_command_reply: tid=0 2023-08-10T12:03:35.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.220+0000 7ffabf766b80 1 client.17046 shutdown 2023-08-10T12:03:35.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.220+0000 7ffabf766b80 1 -- 172.21.15.73:0/1135459864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b61c360 msgr2=0x56553b625810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:35.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.220+0000 7ffabf766b80 1 --2- 172.21.15.73:0/1135459864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b61c360 0x56553b625810 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40994c0 tx=0x7ffaa401dbf0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.220+0000 7ffabf766b80 1 -- 172.21.15.73:0/1135459864 shutdown_connections 2023-08-10T12:03:35.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.220+0000 7ffabf766b80 1 --2- 172.21.15.73:0/1135459864 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x56553b688ff0 0x56553b68b3e0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.220+0000 7ffabf766b80 1 --2- 172.21.15.73:0/1135459864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56553b61c360 0x56553b625810 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.220+0000 7ffabf766b80 1 --2- 172.21.15.73:0/1135459864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56553b616550 0x56553b626e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.220+0000 7ffa94ff9700 0 client.17046 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:03:35.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.220+0000 7ffabf766b80 1 --2- 172.21.15.73:0/1135459864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56553b61ba40 0x56553b625250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.220+0000 7ffabf766b80 1 -- 172.21.15.73:0/1135459864 >> 172.21.15.73:0/1135459864 conn(0x56553b573c70 msgr2=0x56553b61c740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:03:35.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.220+0000 7ffabf766b80 1 -- 172.21.15.73:0/1135459864 shutdown_connections 2023-08-10T12:03:35.237 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.220+0000 7ffabf766b80 1 -- 172.21.15.73:0/1135459864 wait complete. 2023-08-10T12:03:35.237 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.220+0000 7ffabf766b80 20 client.17046 trim_cache size 0 max 16384 2023-08-10T12:03:35.237 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T12:03:35.237 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T12:03:35.237 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T12:03:35.238 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T12:03:35.238 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.221+0000 7ffab35cd700 1 -- 172.21.15.73:0/3532642935 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ffa980a12c0 msgr2=0x7ffa980a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:35.238 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.221+0000 7ffab35cd700 1 --2- 172.21.15.73:0/3532642935 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ffa980a12c0 0x7ffa980a3780 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009be0 tx=0x7ffa9c009260 comp rx=0 tx=0).stop 2023-08-10T12:03:35.238 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.221+0000 7ffab35cd700 1 -- 172.21.15.73:0/3532642935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaac105630 msgr2=0x7ffaac196640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:35.239 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.221+0000 7ffab35cd700 1 --2- 172.21.15.73:0/3532642935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaac105630 0x7ffaac196640 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4009850 tx=0x7ffaa40077f0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.239 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.221+0000 7ffab35cd700 1 -- 172.21.15.73:0/3532642935 shutdown_connections 2023-08-10T12:03:35.239 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.221+0000 7ffab35cd700 1 --2- 172.21.15.73:0/3532642935 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ffa980a12c0 0x7ffa980a3780 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.239 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.221+0000 7ffab35cd700 1 --2- 172.21.15.73:0/3532642935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffaac0ff620 0x7ffaac19c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.239 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.221+0000 7ffab35cd700 1 --2- 172.21.15.73:0/3532642935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaac105630 0x7ffaac196640 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.239 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.221+0000 7ffab35cd700 1 --2- 172.21.15.73:0/3532642935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffaac0fffe0 0x7ffaac19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:35.239 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.221+0000 7ffab35cd700 1 -- 172.21.15.73:0/3532642935 >> 172.21.15.73:0/3532642935 conn(0x7ffaac0fb0b0 msgr2=0x7ffaac103330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:03:35.240 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.221+0000 7ffab35cd700 1 -- 172.21.15.73:0/3532642935 shutdown_connections 2023-08-10T12:03:35.240 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:35.221+0000 7ffab35cd700 1 -- 172.21.15.73:0/3532642935 wait complete. 2023-08-10T12:03:35.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:34 smithi152 ceph-mon[130220]: pgmap v341: 97 pgs: 97 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 360 op/s 2023-08-10T12:03:35.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:34 smithi156 ceph-mon[130574]: pgmap v341: 97 pgs: 97 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 360 op/s 2023-08-10T12:03:35.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:34 smithi073 ceph-mon[128869]: pgmap v341: 97 pgs: 97 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 360 op/s 2023-08-10T12:03:37.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:37 smithi152 ceph-mon[130220]: pgmap v342: 97 pgs: 97 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.1 MiB/s wr, 369 op/s 2023-08-10T12:03:37.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:37 smithi156 ceph-mon[130574]: pgmap v342: 97 pgs: 97 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.1 MiB/s wr, 369 op/s 2023-08-10T12:03:37.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:37 smithi073 ceph-mon[128869]: pgmap v342: 97 pgs: 97 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.1 MiB/s wr, 369 op/s 2023-08-10T12:03:39.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:39 smithi152 ceph-mon[130220]: pgmap v343: 97 pgs: 97 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 361 op/s 2023-08-10T12:03:39.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:39 smithi156 ceph-mon[130574]: pgmap v343: 97 pgs: 97 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 361 op/s 2023-08-10T12:03:39.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:39 smithi073 ceph-mon[128869]: pgmap v343: 97 pgs: 97 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 361 op/s 2023-08-10T12:03:41.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:41 smithi152 ceph-mon[130220]: pgmap v344: 97 pgs: 97 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.1 MiB/s wr, 360 op/s 2023-08-10T12:03:41.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:41 smithi156 ceph-mon[130574]: pgmap v344: 97 pgs: 97 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.1 MiB/s wr, 360 op/s 2023-08-10T12:03:41.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:41 smithi073 ceph-mon[128869]: pgmap v344: 97 pgs: 97 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.1 MiB/s wr, 360 op/s 2023-08-10T12:03:43.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:43 smithi152 ceph-mon[130220]: pgmap v345: 97 pgs: 97 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 247 op/s 2023-08-10T12:03:43.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:43 smithi156 ceph-mon[130574]: pgmap v345: 97 pgs: 97 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 247 op/s 2023-08-10T12:03:43.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:43 smithi073 ceph-mon[128869]: pgmap v345: 97 pgs: 97 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 247 op/s 2023-08-10T12:03:45.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:44 smithi152 ceph-mon[130220]: pgmap v346: 97 pgs: 97 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 264 op/s 2023-08-10T12:03:45.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:44 smithi156 ceph-mon[130574]: pgmap v346: 97 pgs: 97 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 264 op/s 2023-08-10T12:03:45.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:44 smithi073 ceph-mon[128869]: pgmap v346: 97 pgs: 97 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 264 op/s 2023-08-10T12:03:47.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:47 smithi152 ceph-mon[130220]: pgmap v347: 97 pgs: 97 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.7 MiB/s wr, 284 op/s 2023-08-10T12:03:47.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:47 smithi156 ceph-mon[130574]: pgmap v347: 97 pgs: 97 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.7 MiB/s wr, 284 op/s 2023-08-10T12:03:47.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:47 smithi073 ceph-mon[128869]: pgmap v347: 97 pgs: 97 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.7 MiB/s wr, 284 op/s 2023-08-10T12:03:48.357 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.355+0000 7f3804a46700 1 -- 172.21.15.73:0/1465594329 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3800100290 msgr2=0x7f380010c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:48.357 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.355+0000 7f3804a46700 1 --2- 172.21.15.73:0/1465594329 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3800100290 0x7f380010c4a0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f37f800b0a0 tx=0x7f37f800b3b0 comp rx=0 tx=0).stop 2023-08-10T12:03:48.357 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.355+0000 7f3804a46700 1 -- 172.21.15.73:0/1465594329 shutdown_connections 2023-08-10T12:03:48.357 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.355+0000 7f3804a46700 1 --2- 172.21.15.73:0/1465594329 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3800100290 0x7f380010c4a0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:48.357 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.355+0000 7f3804a46700 1 --2- 172.21.15.73:0/1465594329 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3800105670 0x7f3800105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:48.357 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.355+0000 7f3804a46700 1 --2- 172.21.15.73:0/1465594329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38000ff8d0 0x7f38000ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:48.358 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.355+0000 7f3804a46700 1 -- 172.21.15.73:0/1465594329 >> 172.21.15.73:0/1465594329 conn(0x7f38000750a0 msgr2=0x7f38000754b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:03:48.358 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.355+0000 7f3804a46700 1 -- 172.21.15.73:0/1465594329 shutdown_connections 2023-08-10T12:03:48.358 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.355+0000 7f3804a46700 1 -- 172.21.15.73:0/1465594329 wait complete. 2023-08-10T12:03:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.356+0000 7f3804a46700 1 Processor -- start 2023-08-10T12:03:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.356+0000 7f3804a46700 1 -- start start 2023-08-10T12:03:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.356+0000 7f3804a46700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38000ff8d0 0x7f3800194d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:48.360 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.356+0000 7f3804a46700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3800100290 0x7f38001952c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:48.360 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.356+0000 7f3804a46700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3800105670 0x7f3800198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:48.360 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.356+0000 7f3804a46700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3800198860 con 0x7f3800105670 2023-08-10T12:03:48.360 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.356+0000 7f3804a46700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38001989d0 con 0x7f3800100290 2023-08-10T12:03:48.360 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.356+0000 7f3804a46700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3800198b90 con 0x7f38000ff8d0 2023-08-10T12:03:48.360 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.356+0000 7f37fe59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38000ff8d0 0x7f3800194d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:48.360 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.357+0000 7f37fe59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38000ff8d0 0x7f3800194d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:34058/0 (socket says 172.21.15.73:34058) 2023-08-10T12:03:48.361 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.357+0000 7f37fe59c700 1 -- 172.21.15.73:0/4089759276 learned_addr learned my addr 172.21.15.73:0/4089759276 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:03:48.361 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.357+0000 7f37fdd9b700 1 --2- 172.21.15.73:0/4089759276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3800100290 0x7f38001952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:48.361 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.357+0000 7f37fe59c700 1 -- 172.21.15.73:0/4089759276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3800100290 msgr2=0x7f38001952c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:48.361 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.357+0000 7f37fe59c700 1 --2- 172.21.15.73:0/4089759276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3800100290 0x7f38001952c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:48.361 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.357+0000 7f37fe59c700 1 -- 172.21.15.73:0/4089759276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3800105670 msgr2=0x7f3800198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:48.361 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.357+0000 7f37fe59c700 1 --2- 172.21.15.73:0/4089759276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3800105670 0x7f3800198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:48.362 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.357+0000 7f37fe59c700 1 -- 172.21.15.73:0/4089759276 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f8009d00 con 0x7f38000ff8d0 2023-08-10T12:03:48.362 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.357+0000 7f37fe59c700 1 --2- 172.21.15.73:0/4089759276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38000ff8d0 0x7f3800194d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f37f000e970 tx=0x7f37f000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:03:48.362 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.357+0000 7f37ef7fe700 1 -- 172.21.15.73:0/4089759276 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f0009790 con 0x7f38000ff8d0 2023-08-10T12:03:48.362 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.357+0000 7f3804a46700 1 -- 172.21.15.73:0/4089759276 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3800198e70 con 0x7f38000ff8d0 2023-08-10T12:03:48.362 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.357+0000 7f3804a46700 1 -- 172.21.15.73:0/4089759276 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3800199500 con 0x7f38000ff8d0 2023-08-10T12:03:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.358+0000 7f37ef7fe700 1 -- 172.21.15.73:0/4089759276 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f37f000eec0 con 0x7f38000ff8d0 2023-08-10T12:03:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.358+0000 7f37ef7fe700 1 -- 172.21.15.73:0/4089759276 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f0021ea0 con 0x7f38000ff8d0 2023-08-10T12:03:48.363 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.362+0000 7f3810bdfb80 1 Processor -- start 2023-08-10T12:03:48.364 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.362+0000 7f3810bdfb80 1 -- start start 2023-08-10T12:03:48.364 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.362+0000 7f3810bdfb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560a9b138a40 0x560a9b138e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:48.364 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.362+0000 7f3810bdfb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560a9b139360 0x560a9b133010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:48.365 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.362+0000 7f3810bdfb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560a9b133550 0x560a9b1339d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:48.365 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.362+0000 7f3810bdfb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a9b0aed60 con 0x560a9b133550 2023-08-10T12:03:48.365 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.362+0000 7f3810bdfb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a9b08b530 con 0x560a9b138a40 2023-08-10T12:03:48.365 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.362+0000 7f3810bdfb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a9b088e50 con 0x560a9b139360 2023-08-10T12:03:48.365 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.363+0000 7f37fdd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560a9b133550 0x560a9b1339d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:48.365 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.363+0000 7f37fed9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560a9b138a40 0x560a9b138e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:48.365 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.363+0000 7f37fdd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560a9b133550 0x560a9b1339d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36794/0 (socket says 172.21.15.73:36794) 2023-08-10T12:03:48.366 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.363+0000 7f37fed9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560a9b138a40 0x560a9b138e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:51442/0 (socket says 172.21.15.73:51442) 2023-08-10T12:03:48.366 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.363+0000 7f37fdd9b700 1 -- 172.21.15.73:0/2755524152 learned_addr learned my addr 172.21.15.73:0/2755524152 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:03:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.363+0000 7f37fdd9b700 1 -- 172.21.15.73:0/2755524152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560a9b139360 msgr2=0x560a9b133010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T12:03:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.363+0000 7f37fdd9b700 1 --2- 172.21.15.73:0/2755524152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560a9b139360 0x560a9b133010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.363+0000 7f37fdd9b700 1 -- 172.21.15.73:0/2755524152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560a9b138a40 msgr2=0x560a9b138e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.363+0000 7f37fdd9b700 1 --2- 172.21.15.73:0/2755524152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560a9b138a40 0x560a9b138e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.363+0000 7f37fdd9b700 1 -- 172.21.15.73:0/2755524152 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a9af055d0 con 0x560a9b133550 2023-08-10T12:03:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.363+0000 7f37fdd9b700 1 --2- 172.21.15.73:0/2755524152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560a9b133550 0x560a9b1339d0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009a50 tx=0x7f37f4009d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8804d51d4a75c872 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:03:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.363+0000 7f37ecff9700 1 -- 172.21.15.73:0/2755524152 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f400e8d0 con 0x560a9b133550 2023-08-10T12:03:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.363+0000 7f37ecff9700 1 -- 172.21.15.73:0/2755524152 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f37f4013470 con 0x560a9b133550 2023-08-10T12:03:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.363+0000 7f37ecff9700 1 -- 172.21.15.73:0/2755524152 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f4012630 con 0x560a9b133550 2023-08-10T12:03:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.364+0000 7f3810bdfb80 1 -- 172.21.15.73:0/2755524152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560a9b133550 msgr2=0x560a9b1339d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.364+0000 7f3810bdfb80 1 --2- 172.21.15.73:0/2755524152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560a9b133550 0x560a9b1339d0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009a50 tx=0x7f37f4009d60 comp rx=0 tx=0).stop 2023-08-10T12:03:48.370 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.364+0000 7f3810bdfb80 1 -- 172.21.15.73:0/2755524152 shutdown_connections 2023-08-10T12:03:48.370 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.364+0000 7f3810bdfb80 1 --2- 172.21.15.73:0/2755524152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560a9b138a40 0x560a9b138e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:48.370 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.364+0000 7f3810bdfb80 1 --2- 172.21.15.73:0/2755524152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560a9b133550 0x560a9b1339d0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:48.370 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.364+0000 7f3810bdfb80 1 --2- 172.21.15.73:0/2755524152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560a9b139360 0x560a9b133010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:48.370 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.364+0000 7f3810bdfb80 1 -- 172.21.15.73:0/2755524152 >> 172.21.15.73:0/2755524152 conn(0x560a9b090c70 msgr2=0x560a9b12dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:03:48.370 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.364+0000 7f37ef7fe700 1 -- 172.21.15.73:0/4089759276 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f37f000cbd0 con 0x7f38000ff8d0 2023-08-10T12:03:48.370 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.365+0000 7f3810bdfb80 1 -- 172.21.15.73:0/2755524152 shutdown_connections 2023-08-10T12:03:48.370 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.365+0000 7f3810bdfb80 1 -- 172.21.15.73:0/2755524152 wait complete. 2023-08-10T12:03:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.365+0000 7f3810bdfb80 1 -- start start 2023-08-10T12:03:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.365+0000 7f3810bdfb80 1 Processor -- start 2023-08-10T12:03:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.365+0000 7f37ef7fe700 1 --2- 172.21.15.73:0/4089759276 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f37e80a11d0 0x7f37e80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.365+0000 7f3810bdfb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560a9b133550 0x560a9b13c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.365+0000 7f3810bdfb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560a9b138a40 0x560a9b13cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.365+0000 7f3810bdfb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560a9b13d1b0 0x560a9b148f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:48.371 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.365+0000 7f3810bdfb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a9b084740 con 0x560a9b133550 2023-08-10T12:03:48.372 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.365+0000 7f3810bdfb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a9b023a60 con 0x560a9b13d1b0 2023-08-10T12:03:48.372 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.365+0000 7f3810bdfb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a9b023760 con 0x560a9b138a40 2023-08-10T12:03:48.372 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.365+0000 7f37fed9d700 1 --2- 172.21.15.73:0/4089759276 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f37e80a11d0 0x7f37e80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:48.372 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.365+0000 7f3810bdfb80 10 client.0 _ll_register_callbacks cb 0x560a9b021620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:03:48.372 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.366+0000 7f37ef7fe700 1 -- 172.21.15.73:0/4089759276 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f37f0014070 con 0x7f38000ff8d0 2023-08-10T12:03:48.372 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.366+0000 7f37fed9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560a9b13d1b0 0x560a9b148f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.366+0000 7f37fed9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560a9b13d1b0 0x560a9b148f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:51454/0 (socket says 172.21.15.73:51454) 2023-08-10T12:03:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.366+0000 7f37fed9d700 1 -- 172.21.15.73:0/379986645 learned_addr learned my addr 172.21.15.73:0/379986645 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:03:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.366+0000 7f37fe59c700 1 --2- 172.21.15.73:0/379986645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560a9b133550 0x560a9b13c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.366+0000 7f37fed9d700 1 --2- 172.21.15.73:0/4089759276 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f37e80a11d0 0x7f37e80a3690 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f37f800b070 tx=0x7f37f800bf70 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:03:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.366+0000 7f37fe59c700 1 -- 172.21.15.73:0/379986645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560a9b138a40 msgr2=0x560a9b13cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.366+0000 7f37fe59c700 1 --2- 172.21.15.73:0/379986645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560a9b138a40 0x560a9b13cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.366+0000 7f37fe59c700 1 -- 172.21.15.73:0/379986645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560a9b13d1b0 msgr2=0x560a9b148f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:48.373 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.366+0000 7f37fe59c700 1 --2- 172.21.15.73:0/379986645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560a9b13d1b0 0x560a9b148f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:48.374 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.366+0000 7f37fe59c700 1 -- 172.21.15.73:0/379986645 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f40096b0 con 0x560a9b133550 2023-08-10T12:03:48.374 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.366+0000 7f37fed9d700 1 --2- 172.21.15.73:0/379986645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560a9b13d1b0 0x560a9b148f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:03:48.374 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.366+0000 7f37fe59c700 1 --2- 172.21.15.73:0/379986645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560a9b133550 0x560a9b13c730 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f37f00ca710 tx=0x7f37f0099b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1497d93ca80f17c3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:03:48.374 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.366+0000 7f37e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:03:48.374 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.367+0000 7f37e5ffb700 1 -- 172.21.15.73:0/379986645 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f00a24e0 con 0x560a9b133550 2023-08-10T12:03:48.374 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.367+0000 7f37e5ffb700 1 -- 172.21.15.73:0/379986645 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f37f0099580 con 0x560a9b133550 2023-08-10T12:03:48.374 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.367+0000 7f3810bdfb80 1 -- 172.21.15.73:0/379986645 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560a9b1261c0 con 0x560a9b133550 2023-08-10T12:03:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.367+0000 7f37e5ffb700 1 -- 172.21.15.73:0/379986645 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37f0099740 con 0x560a9b133550 2023-08-10T12:03:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.367+0000 7f3810bdfb80 10 client.17055 fetch_fsmap learned FSMap version 55 2023-08-10T12:03:48.376 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.367+0000 7f3810bdfb80 1 -- 172.21.15.73:0/379986645 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x560a9aeb1d80 con 0x560a9b133550 2023-08-10T12:03:48.377 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.367+0000 7f37e5ffb700 1 -- 172.21.15.73:0/379986645 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f37f00c8080 con 0x560a9b133550 2023-08-10T12:03:48.377 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.367+0000 7f37e5ffb700 1 -- 172.21.15.73:0/379986645 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7f37f0098ff0 con 0x560a9b133550 2023-08-10T12:03:48.377 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.367+0000 7f3810bdfb80 10 client.17055 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:03:48.377 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.367+0000 7f3810bdfb80 10 client.17055 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:03:48.377 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.367+0000 7f3810bdfb80 20 client.17055 populate_metadata read hostname 'smithi073' 2023-08-10T12:03:48.377 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.367+0000 7f3810bdfb80 1 --2- 172.21.15.73:0/379986645 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x560a9b14d400 0x560a9b14f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:48.377 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.367+0000 7f3810bdfb80 4 client.17055 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:03:48.378 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.367+0000 7f3810bdfb80 1 -- 172.21.15.73:0/379986645 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560a9b102970 con 0x560a9b14d400 2023-08-10T12:03:48.378 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.367+0000 7f37fdd9b700 1 --2- 172.21.15.73:0/379986645 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x560a9b14d400 0x560a9b14f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:48.378 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.368+0000 7f37e5ffb700 10 client.17055 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:03:48.378 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.368+0000 7f37fdd9b700 1 --2- 172.21.15.73:0/379986645 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x560a9b14d400 0x560a9b14f820 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc4cccf3bb17ef77 server_cookie=162b7bb528dffb5c in_seq=0 out_seq=0 2023-08-10T12:03:48.378 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.369+0000 7f37e5ffb700 1 -- 172.21.15.73:0/379986645 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x560a9b102970 con 0x560a9b14d400 2023-08-10T12:03:48.378 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.369+0000 7f37e5ffb700 10 client.17055 handle_command_reply: tid=0 2023-08-10T12:03:48.378 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.369+0000 7f3810bdfb80 1 client.17055 shutdown 2023-08-10T12:03:48.378 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.369+0000 7f3810bdfb80 1 -- 172.21.15.73:0/379986645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560a9b133550 msgr2=0x560a9b13c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:48.379 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.369+0000 7f3810bdfb80 1 --2- 172.21.15.73:0/379986645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560a9b133550 0x560a9b13c730 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f37f00ca710 tx=0x7f37f0099b20 comp rx=0 tx=0).stop 2023-08-10T12:03:48.379 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.369+0000 7f3810bdfb80 1 -- 172.21.15.73:0/379986645 shutdown_connections 2023-08-10T12:03:48.379 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.369+0000 7f3810bdfb80 1 --2- 172.21.15.73:0/379986645 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x560a9b14d400 0x560a9b14f820 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:48.379 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.369+0000 7f3810bdfb80 1 --2- 172.21.15.73:0/379986645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560a9b13d1b0 0x560a9b148f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:48.379 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.369+0000 7f3810bdfb80 1 --2- 172.21.15.73:0/379986645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560a9b133550 0x560a9b13c730 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:48.379 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.369+0000 7f37e5ffb700 0 client.17055 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:03:48.379 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.369+0000 7f3810bdfb80 1 --2- 172.21.15.73:0/379986645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560a9b138a40 0x560a9b13cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:48.380 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.369+0000 7f3810bdfb80 1 -- 172.21.15.73:0/379986645 >> 172.21.15.73:0/379986645 conn(0x560a9b090c70 msgr2=0x560a9b12d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:03:48.380 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.369+0000 7f3810bdfb80 1 -- 172.21.15.73:0/379986645 shutdown_connections 2023-08-10T12:03:48.380 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.369+0000 7f3810bdfb80 1 -- 172.21.15.73:0/379986645 wait complete. 2023-08-10T12:03:48.380 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.369+0000 7f3810bdfb80 20 client.17055 trim_cache size 0 max 16384 2023-08-10T12:03:48.390 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.388+0000 7f3810bdfb80 1 Processor -- start 2023-08-10T12:03:48.390 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.388+0000 7f3810bdfb80 1 -- start start 2023-08-10T12:03:48.390 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.388+0000 7f3810bdfb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560a9b133550 0x560a9b133010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:48.390 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.388+0000 7f3810bdfb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560a9b138a40 0x560a9b154180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:48.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.389+0000 7f3810bdfb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560a9b13d1b0 0x560a9b143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:48.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.389+0000 7f3810bdfb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a9af078c0 con 0x560a9b13d1b0 2023-08-10T12:03:48.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.389+0000 7f3810bdfb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a9b149cf0 con 0x560a9b133550 2023-08-10T12:03:48.391 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.389+0000 7f3810bdfb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a9b137420 con 0x560a9b138a40 2023-08-10T12:03:48.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.389+0000 7f37fed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560a9b13d1b0 0x560a9b143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:48.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.389+0000 7f37fdd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560a9b138a40 0x560a9b154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:48.392 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.389+0000 7f37fed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560a9b13d1b0 0x560a9b143eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36812/0 (socket says 172.21.15.73:36812) 2023-08-10T12:03:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.389+0000 7f37fed9d700 1 -- 172.21.15.73:0/1699524532 learned_addr learned my addr 172.21.15.73:0/1699524532 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:03:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.389+0000 7f37fed9d700 1 -- 172.21.15.73:0/1699524532 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560a9b138a40 msgr2=0x560a9b154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.389+0000 7f37fed9d700 1 --2- 172.21.15.73:0/1699524532 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560a9b138a40 0x560a9b154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.389+0000 7f37fed9d700 1 -- 172.21.15.73:0/1699524532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560a9b133550 msgr2=0x560a9b133010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.389+0000 7f37fed9d700 1 --2- 172.21.15.73:0/1699524532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560a9b133550 0x560a9b133010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.389+0000 7f37fed9d700 1 -- 172.21.15.73:0/1699524532 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a9ae9ac00 con 0x560a9b13d1b0 2023-08-10T12:03:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.389+0000 7f37fed9d700 1 --2- 172.21.15.73:0/1699524532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560a9b13d1b0 0x560a9b143eb0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f37f800bbb0 tx=0x7f37f8023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=218888690f45cf0c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:03:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.389+0000 7f37ed7fa700 1 -- 172.21.15.73:0/1699524532 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f800e040 con 0x560a9b13d1b0 2023-08-10T12:03:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.390+0000 7f37ed7fa700 1 -- 172.21.15.73:0/1699524532 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f37f801fc40 con 0x560a9b13d1b0 2023-08-10T12:03:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.390+0000 7f37ed7fa700 1 -- 172.21.15.73:0/1699524532 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f802ab40 con 0x560a9b13d1b0 2023-08-10T12:03:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.390+0000 7f3810bdfb80 1 -- 172.21.15.73:0/1699524532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560a9b13d1b0 msgr2=0x560a9b143eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.390+0000 7f3810bdfb80 1 --2- 172.21.15.73:0/1699524532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560a9b13d1b0 0x560a9b143eb0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f37f800bbb0 tx=0x7f37f8023000 comp rx=0 tx=0).stop 2023-08-10T12:03:48.395 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.393+0000 7f3810bdfb80 1 -- 172.21.15.73:0/1699524532 shutdown_connections 2023-08-10T12:03:48.395 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.393+0000 7f3810bdfb80 1 --2- 172.21.15.73:0/1699524532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560a9b133550 0x560a9b133010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:48.395 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.393+0000 7f3810bdfb80 1 --2- 172.21.15.73:0/1699524532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560a9b13d1b0 0x560a9b143eb0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:48.395 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.393+0000 7f3810bdfb80 1 --2- 172.21.15.73:0/1699524532 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560a9b138a40 0x560a9b154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:48.396 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.393+0000 7f3810bdfb80 1 -- 172.21.15.73:0/1699524532 >> 172.21.15.73:0/1699524532 conn(0x560a9b090c70 msgr2=0x560a9b1378d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:03:48.396 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.393+0000 7f3810bdfb80 1 -- 172.21.15.73:0/1699524532 shutdown_connections 2023-08-10T12:03:48.396 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.393+0000 7f3810bdfb80 1 -- 172.21.15.73:0/1699524532 wait complete. 2023-08-10T12:03:48.396 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.394+0000 7f3810bdfb80 1 -- start start 2023-08-10T12:03:48.397 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.394+0000 7f3810bdfb80 1 Processor -- start 2023-08-10T12:03:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.394+0000 7f3810bdfb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560a9b133550 0x560a9b195230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.394+0000 7f3810bdfb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560a9b138a40 0x560a9b195770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.394+0000 7f3810bdfb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560a9b13d1b0 0x560a9b19a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.394+0000 7f3810bdfb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a9b19a5d0 con 0x560a9b133550 2023-08-10T12:03:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.394+0000 7f3810bdfb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a9b19a710 con 0x560a9b13d1b0 2023-08-10T12:03:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.394+0000 7f3810bdfb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a9b19a8d0 con 0x560a9b138a40 2023-08-10T12:03:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.394+0000 7f3810bdfb80 10 client.0 _ll_register_callbacks cb 0x560a9b021620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:03:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.394+0000 7f37fe59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560a9b133550 0x560a9b195230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:48.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.394+0000 7f37fe59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560a9b133550 0x560a9b195230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36814/0 (socket says 172.21.15.73:36814) 2023-08-10T12:03:48.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.394+0000 7f37fdd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560a9b138a40 0x560a9b195770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:48.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.394+0000 7f37fe59c700 1 -- 172.21.15.73:0/2772370902 learned_addr learned my addr 172.21.15.73:0/2772370902 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:03:48.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.394+0000 7f37fed9d700 1 --2- 172.21.15.73:0/2772370902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560a9b13d1b0 0x560a9b19a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:48.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.395+0000 7f37fe59c700 1 -- 172.21.15.73:0/2772370902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560a9b138a40 msgr2=0x560a9b195770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:48.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.395+0000 7f37fe59c700 1 --2- 172.21.15.73:0/2772370902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560a9b138a40 0x560a9b195770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:48.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.395+0000 7f37fe59c700 1 -- 172.21.15.73:0/2772370902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560a9b13d1b0 msgr2=0x560a9b19a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:03:48.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.395+0000 7f37fe59c700 1 --2- 172.21.15.73:0/2772370902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560a9b13d1b0 0x560a9b19a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:48.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.395+0000 7f37fe59c700 1 -- 172.21.15.73:0/2772370902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f8026050 con 0x560a9b133550 2023-08-10T12:03:48.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.395+0000 7f37fe59c700 1 --2- 172.21.15.73:0/2772370902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560a9b133550 0x560a9b195230 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f37f00983e0 tx=0x7f37f00994d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d88ebff7a62c98 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:03:48.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.395+0000 7f37e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:03:48.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.395+0000 7f37e5ffb700 1 -- 172.21.15.73:0/2772370902 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f00a2250 con 0x560a9b133550 2023-08-10T12:03:48.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.395+0000 7f37e5ffb700 1 -- 172.21.15.73:0/2772370902 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f37f0099580 con 0x560a9b133550 2023-08-10T12:03:48.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.395+0000 7f3810bdfb80 1 -- 172.21.15.73:0/2772370902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f37f4013470 con 0x560a9b133550 2023-08-10T12:03:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.395+0000 7f37e5ffb700 1 -- 172.21.15.73:0/2772370902 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37f0099780 con 0x560a9b133550 2023-08-10T12:03:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.395+0000 7f3810bdfb80 10 client.17061 fetch_fsmap learned FSMap version 55 2023-08-10T12:03:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.395+0000 7f3810bdfb80 1 -- 172.21.15.73:0/2772370902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x560a9aed81f0 con 0x560a9b133550 2023-08-10T12:03:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.396+0000 7f37e5ffb700 1 -- 172.21.15.73:0/2772370902 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f37f4013470 con 0x560a9b133550 2023-08-10T12:03:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.396+0000 7f37e5ffb700 1 -- 172.21.15.73:0/2772370902 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7f37f00b2ae0 con 0x560a9b133550 2023-08-10T12:03:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.396+0000 7f3810bdfb80 10 client.17061 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:03:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.396+0000 7f3810bdfb80 10 client.17061 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:03:48.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.396+0000 7f3810bdfb80 20 client.17061 populate_metadata read hostname 'smithi073' 2023-08-10T12:03:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.396+0000 7f3810bdfb80 1 --2- 172.21.15.73:0/2772370902 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x560a9b1a1cc0 0x560a9b1a40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:03:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.396+0000 7f3810bdfb80 4 client.17061 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T12:03:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.396+0000 7f3810bdfb80 1 -- 172.21.15.73:0/2772370902 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560a9b07d720 con 0x560a9b1a1cc0 2023-08-10T12:03:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.396+0000 7f37fdd9b700 1 --2- 172.21.15.73:0/2772370902 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x560a9b1a1cc0 0x560a9b1a40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:03:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.397+0000 7f37e5ffb700 10 client.17061 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:03:48.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:48.397+0000 7f37fdd9b700 1 --2- 172.21.15.73:0/2772370902 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x560a9b1a1cc0 0x560a9b1a40b0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2700c8952cdee560 server_cookie=1d492294e3d7e61 in_seq=0 out_seq=0 2023-08-10T12:03:49.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:49 smithi152 ceph-mon[130220]: pgmap v348: 97 pgs: 97 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 237 op/s 2023-08-10T12:03:49.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:49 smithi156 ceph-mon[130574]: pgmap v348: 97 pgs: 97 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 237 op/s 2023-08-10T12:03:49.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:49 smithi073 ceph-mon[128869]: pgmap v348: 97 pgs: 97 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 237 op/s 2023-08-10T12:03:51.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:51 smithi073 ceph-mon[128869]: pgmap v349: 97 pgs: 97 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 435 op/s 2023-08-10T12:03:51.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:51 smithi152 ceph-mon[130220]: pgmap v349: 97 pgs: 97 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 435 op/s 2023-08-10T12:03:51.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:51 smithi156 ceph-mon[130574]: pgmap v349: 97 pgs: 97 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 435 op/s 2023-08-10T12:03:52.407 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:52.405+0000 7f37e5ffb700 1 -- 172.21.15.73:0/2772370902 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560a9b07d720 con 0x560a9b1a1cc0 2023-08-10T12:03:52.407 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:52.405+0000 7f37e5ffb700 10 client.17061 handle_command_reply: tid=0 2023-08-10T12:03:52.407 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:52.405+0000 7f3810bdfb80 1 client.17061 shutdown 2023-08-10T12:03:52.407 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:52.405+0000 7f3810bdfb80 1 -- 172.21.15.73:0/2772370902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560a9b133550 msgr2=0x560a9b195230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:52.405+0000 7f3810bdfb80 1 --2- 172.21.15.73:0/2772370902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560a9b133550 0x560a9b195230 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f37f00983e0 tx=0x7f37f00994d0 comp rx=0 tx=0).stop 2023-08-10T12:03:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:52.405+0000 7f3810bdfb80 1 -- 172.21.15.73:0/2772370902 shutdown_connections 2023-08-10T12:03:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:52.405+0000 7f3810bdfb80 1 --2- 172.21.15.73:0/2772370902 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x560a9b1a1cc0 0x560a9b1a40b0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:52.405+0000 7f3810bdfb80 1 --2- 172.21.15.73:0/2772370902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560a9b13d1b0 0x560a9b19a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:52.405+0000 7f3810bdfb80 1 --2- 172.21.15.73:0/2772370902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560a9b133550 0x560a9b195230 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:52.405+0000 7f3810bdfb80 1 --2- 172.21.15.73:0/2772370902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560a9b138a40 0x560a9b195770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:52.409 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:52.405+0000 7f37e5ffb700 0 client.17061 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:03:52.409 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:52.405+0000 7f3810bdfb80 1 -- 172.21.15.73:0/2772370902 >> 172.21.15.73:0/2772370902 conn(0x560a9b090c70 msgr2=0x560a9b148c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:03:52.409 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:52.405+0000 7f3810bdfb80 1 -- 172.21.15.73:0/2772370902 shutdown_connections 2023-08-10T12:03:52.409 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:52.405+0000 7f3810bdfb80 1 -- 172.21.15.73:0/2772370902 wait complete. 2023-08-10T12:03:52.409 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:52.405+0000 7f3810bdfb80 20 client.17061 trim_cache size 0 max 16384 2023-08-10T12:03:52.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T12:03:52.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T12:03:52.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T12:03:52.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T12:03:52.411 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:52.405+0000 7f3804a46700 1 -- 172.21.15.73:0/4089759276 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f37e80a11d0 msgr2=0x7f37e80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:52.411 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:52.405+0000 7f3804a46700 1 --2- 172.21.15.73:0/4089759276 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f37e80a11d0 0x7f37e80a3690 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f37f800b070 tx=0x7f37f800bf70 comp rx=0 tx=0).stop 2023-08-10T12:03:52.411 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:52.406+0000 7f3804a46700 1 -- 172.21.15.73:0/4089759276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38000ff8d0 msgr2=0x7f3800194d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:03:52.411 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:52.406+0000 7f3804a46700 1 --2- 172.21.15.73:0/4089759276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38000ff8d0 0x7f3800194d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f37f000e970 tx=0x7f37f000ec80 comp rx=0 tx=0).stop 2023-08-10T12:03:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:52.406+0000 7f3804a46700 1 -- 172.21.15.73:0/4089759276 shutdown_connections 2023-08-10T12:03:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:52.406+0000 7f3804a46700 1 --2- 172.21.15.73:0/4089759276 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f37e80a11d0 0x7f37e80a3690 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:52.406+0000 7f3804a46700 1 --2- 172.21.15.73:0/4089759276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3800105670 0x7f3800198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:52.406+0000 7f3804a46700 1 --2- 172.21.15.73:0/4089759276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38000ff8d0 0x7f3800194d80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:52.406+0000 7f3804a46700 1 --2- 172.21.15.73:0/4089759276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3800100290 0x7f38001952c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:03:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:52.406+0000 7f3804a46700 1 -- 172.21.15.73:0/4089759276 >> 172.21.15.73:0/4089759276 conn(0x7f38000750a0 msgr2=0x7f3800067b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:03:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:52.406+0000 7f3804a46700 1 -- 172.21.15.73:0/4089759276 shutdown_connections 2023-08-10T12:03:52.413 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:03:52.406+0000 7f3804a46700 1 -- 172.21.15.73:0/4089759276 wait complete. 2023-08-10T12:03:53.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:53 smithi073 ceph-mon[128869]: pgmap v350: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 798 op/s 2023-08-10T12:03:53.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:53 smithi152 ceph-mon[130220]: pgmap v350: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 798 op/s 2023-08-10T12:03:53.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:53 smithi156 ceph-mon[130574]: pgmap v350: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 798 op/s 2023-08-10T12:03:55.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:54 smithi152 ceph-mon[130220]: pgmap v351: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 1.05k op/s 2023-08-10T12:03:55.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:54 smithi156 ceph-mon[130574]: pgmap v351: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 1.05k op/s 2023-08-10T12:03:55.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:54 smithi073 ceph-mon[128869]: pgmap v351: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 1.05k op/s 2023-08-10T12:03:57.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:57 smithi152 ceph-mon[130220]: pgmap v352: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 1.52k op/s 2023-08-10T12:03:57.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:57 smithi156 ceph-mon[130574]: pgmap v352: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 1.52k op/s 2023-08-10T12:03:57.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:57 smithi073 ceph-mon[128869]: pgmap v352: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 1.52k op/s 2023-08-10T12:03:59.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:03:59 smithi152 ceph-mon[130220]: pgmap v353: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 1.47k op/s 2023-08-10T12:03:59.509 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:03:59 smithi156 ceph-mon[130574]: pgmap v353: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 1.47k op/s 2023-08-10T12:03:59.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:03:59 smithi073 ceph-mon[128869]: pgmap v353: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 1.47k op/s 2023-08-10T12:04:01.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:01 smithi152 ceph-mon[130220]: pgmap v354: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 1.52k op/s 2023-08-10T12:04:01.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:01 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:04:01.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:01 smithi156 ceph-mon[130574]: pgmap v354: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 1.52k op/s 2023-08-10T12:04:01.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:01 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:04:01.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:01 smithi073 ceph-mon[128869]: pgmap v354: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 1.52k op/s 2023-08-10T12:04:01.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:01 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:04:03.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:03 smithi152 ceph-mon[130220]: pgmap v355: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 1.37k op/s 2023-08-10T12:04:03.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:03 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:04:03.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:03 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:04:03.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:03 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:04:03.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:03 smithi156 ceph-mon[130574]: pgmap v355: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 1.37k op/s 2023-08-10T12:04:03.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:03 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:04:03.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:03 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:04:03.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:03 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:04:03.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:03 smithi073 ceph-mon[128869]: pgmap v355: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 1.37k op/s 2023-08-10T12:04:03.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:03 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:04:03.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:03 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:04:03.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:03 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:04:05.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:04 smithi152 ceph-mon[130220]: pgmap v356: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 949 op/s 2023-08-10T12:04:05.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:04 smithi156 ceph-mon[130574]: pgmap v356: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 949 op/s 2023-08-10T12:04:05.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:04 smithi073 ceph-mon[128869]: pgmap v356: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 949 op/s 2023-08-10T12:04:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.520+0000 7fb130de0700 1 -- 172.21.15.73:0/3446218648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb12c1045e0 msgr2=0x7fb12c1049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.520+0000 7fb130de0700 1 --2- 172.21.15.73:0/3446218648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb12c1045e0 0x7fb12c1049c0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fb11c009990 tx=0x7fb11c009ca0 comp rx=0 tx=0).stop 2023-08-10T12:04:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.520+0000 7fb130de0700 1 -- 172.21.15.73:0/3446218648 shutdown_connections 2023-08-10T12:04:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.520+0000 7fb130de0700 1 --2- 172.21.15.73:0/3446218648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb12c100760 0x7fb12c10c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.520+0000 7fb130de0700 1 --2- 172.21.15.73:0/3446218648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb12c1045e0 0x7fb12c1049c0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.520+0000 7fb130de0700 1 --2- 172.21.15.73:0/3446218648 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb12c0ffda0 0x7fb12c100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:05.522 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.520+0000 7fb130de0700 1 -- 172.21.15.73:0/3446218648 >> 172.21.15.73:0/3446218648 conn(0x7fb12c076b40 msgr2=0x7fb12c0fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:04:05.522 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.520+0000 7fb130de0700 1 -- 172.21.15.73:0/3446218648 shutdown_connections 2023-08-10T12:04:05.522 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.520+0000 7fb130de0700 1 -- 172.21.15.73:0/3446218648 wait complete. 2023-08-10T12:04:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.520+0000 7fb130de0700 1 Processor -- start 2023-08-10T12:04:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.521+0000 7fb130de0700 1 -- start start 2023-08-10T12:04:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.521+0000 7fb130de0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb12c0ffda0 0x7fb12c19c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.521+0000 7fb130de0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb12c100760 0x7fb12c19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.521+0000 7fb130de0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb12c1045e0 0x7fb12c196580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.521+0000 7fb130de0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c196bf0 con 0x7fb12c100760 2023-08-10T12:04:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.521+0000 7fb130de0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c196d60 con 0x7fb12c0ffda0 2023-08-10T12:04:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.521+0000 7fb130de0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c196f20 con 0x7fb12c1045e0 2023-08-10T12:04:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.521+0000 7fb129d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb12c100760 0x7fb12c19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.521+0000 7fb129d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb12c100760 0x7fb12c19cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36830/0 (socket says 172.21.15.73:36830) 2023-08-10T12:04:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.521+0000 7fb129d9b700 1 -- 172.21.15.73:0/1261291333 learned_addr learned my addr 172.21.15.73:0/1261291333 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:04:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.521+0000 7fb12a59c700 1 --2- 172.21.15.73:0/1261291333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb12c0ffda0 0x7fb12c19c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.521+0000 7fb12ad9d700 1 --2- 172.21.15.73:0/1261291333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb12c1045e0 0x7fb12c196580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.521+0000 7fb129d9b700 1 -- 172.21.15.73:0/1261291333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb12c1045e0 msgr2=0x7fb12c196580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.521+0000 7fb129d9b700 1 --2- 172.21.15.73:0/1261291333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb12c1045e0 0x7fb12c196580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.521+0000 7fb129d9b700 1 -- 172.21.15.73:0/1261291333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb12c0ffda0 msgr2=0x7fb12c19c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.521+0000 7fb129d9b700 1 --2- 172.21.15.73:0/1261291333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb12c0ffda0 0x7fb12c19c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.521+0000 7fb129d9b700 1 -- 172.21.15.73:0/1261291333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11c0095f0 con 0x7fb12c100760 2023-08-10T12:04:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.521+0000 7fb129d9b700 1 --2- 172.21.15.73:0/1261291333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb12c100760 0x7fb12c19cc60 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb12000e9a0 tx=0x7fb12000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:04:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.521+0000 7fb11b7fe700 1 -- 172.21.15.73:0/1261291333 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120009790 con 0x7fb12c100760 2023-08-10T12:04:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.521+0000 7fb130de0700 1 -- 172.21.15.73:0/1261291333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb12c197200 con 0x7fb12c100760 2023-08-10T12:04:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.522+0000 7fb11b7fe700 1 -- 172.21.15.73:0/1261291333 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb120010430 con 0x7fb12c100760 2023-08-10T12:04:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.522+0000 7fb11b7fe700 1 -- 172.21.15.73:0/1261291333 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120018680 con 0x7fb12c100760 2023-08-10T12:04:05.527 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.522+0000 7fb130de0700 1 -- 172.21.15.73:0/1261291333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb12c1a3710 con 0x7fb12c100760 2023-08-10T12:04:05.530 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.523+0000 7fb11b7fe700 1 -- 172.21.15.73:0/1261291333 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fb1200105a0 con 0x7fb12c100760 2023-08-10T12:04:05.530 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.524+0000 7fb11b7fe700 1 --2- 172.21.15.73:0/1261291333 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb1140a12c0 0x7fb1140a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.524+0000 7fb11b7fe700 1 -- 172.21.15.73:0/1261291333 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb120014070 con 0x7fb12c100760 2023-08-10T12:04:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.524+0000 7fb12a59c700 1 --2- 172.21.15.73:0/1261291333 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb1140a12c0 0x7fb1140a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.525+0000 7fb12a59c700 1 --2- 172.21.15.73:0/1261291333 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb1140a12c0 0x7fb1140a3780 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb11c00b2e0 tx=0x7fb11c005fd0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:04:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.525+0000 7fb13cf79b80 1 Processor -- start 2023-08-10T12:04:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.525+0000 7fb13cf79b80 1 -- start start 2023-08-10T12:04:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.525+0000 7fb13cf79b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8e61f0a40 0x55f8e61f0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.526+0000 7fb13cf79b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8e61f1360 0x55f8e61eb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.526+0000 7fb13cf79b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8e61eb550 0x55f8e61eb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.526+0000 7fb13cf79b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8e6166d60 con 0x55f8e61eb550 2023-08-10T12:04:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.526+0000 7fb13cf79b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8e6143530 con 0x55f8e61f1360 2023-08-10T12:04:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.526+0000 7fb13cf79b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8e6140e50 con 0x55f8e61f0a40 2023-08-10T12:04:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.526+0000 7fb12a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8e61f0a40 0x55f8e61f0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.526+0000 7fb12ad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8e61eb550 0x55f8e61eb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.526+0000 7fb129d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8e61f1360 0x55f8e61eb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:05.533 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.526+0000 7fb12a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8e61f0a40 0x55f8e61f0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:34108/0 (socket says 172.21.15.73:34108) 2023-08-10T12:04:05.533 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.526+0000 7fb12ad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8e61eb550 0x55f8e61eb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36840/0 (socket says 172.21.15.73:36840) 2023-08-10T12:04:05.533 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.526+0000 7fb12a59c700 1 -- 172.21.15.73:0/2496807233 learned_addr learned my addr 172.21.15.73:0/2496807233 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:04:05.533 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.526+0000 7fb12a59c700 1 -- 172.21.15.73:0/2496807233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8e61f1360 msgr2=0x55f8e61eb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:05.533 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.526+0000 7fb12a59c700 1 --2- 172.21.15.73:0/2496807233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8e61f1360 0x55f8e61eb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:05.533 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.526+0000 7fb12a59c700 1 -- 172.21.15.73:0/2496807233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8e61eb550 msgr2=0x55f8e61eb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:05.533 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.526+0000 7fb12a59c700 1 --2- 172.21.15.73:0/2496807233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8e61eb550 0x55f8e61eb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:05.533 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.526+0000 7fb12a59c700 1 -- 172.21.15.73:0/2496807233 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8e5fbd5d0 con 0x55f8e61f0a40 2023-08-10T12:04:05.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.526+0000 7fb12ad9d700 1 --2- 172.21.15.73:0/2496807233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8e61eb550 0x55f8e61eb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:04:05.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.526+0000 7fb12a59c700 1 --2- 172.21.15.73:0/2496807233 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8e61f0a40 0x55f8e61f0e20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb11c015000 tx=0x7fb11c020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64fdb2d103d85340 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:04:05.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.526+0000 7fb118ff9700 1 -- 172.21.15.73:0/2496807233 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c02b070 con 0x55f8e61f0a40 2023-08-10T12:04:05.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.526+0000 7fb118ff9700 1 -- 172.21.15.73:0/2496807233 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb11c01e040 con 0x55f8e61f0a40 2023-08-10T12:04:05.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.526+0000 7fb118ff9700 1 -- 172.21.15.73:0/2496807233 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c00f6c0 con 0x55f8e61f0a40 2023-08-10T12:04:05.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.527+0000 7fb13cf79b80 1 -- 172.21.15.73:0/2496807233 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8e61f0a40 msgr2=0x55f8e61f0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:05.534 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.527+0000 7fb13cf79b80 1 --2- 172.21.15.73:0/2496807233 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8e61f0a40 0x55f8e61f0e20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb11c015000 tx=0x7fb11c020000 comp rx=0 tx=0).stop 2023-08-10T12:04:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.527+0000 7fb13cf79b80 1 -- 172.21.15.73:0/2496807233 shutdown_connections 2023-08-10T12:04:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.527+0000 7fb13cf79b80 1 --2- 172.21.15.73:0/2496807233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8e61eb550 0x55f8e61eb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.527+0000 7fb13cf79b80 1 --2- 172.21.15.73:0/2496807233 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8e61f0a40 0x55f8e61f0e20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.527+0000 7fb13cf79b80 1 --2- 172.21.15.73:0/2496807233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8e61f1360 0x55f8e61eb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.527+0000 7fb13cf79b80 1 -- 172.21.15.73:0/2496807233 >> 172.21.15.73:0/2496807233 conn(0x55f8e6148c70 msgr2=0x55f8e61e5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:04:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.527+0000 7fb13cf79b80 1 -- 172.21.15.73:0/2496807233 shutdown_connections 2023-08-10T12:04:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.527+0000 7fb13cf79b80 1 -- 172.21.15.73:0/2496807233 wait complete. 2023-08-10T12:04:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.527+0000 7fb13cf79b80 1 -- start start 2023-08-10T12:04:05.536 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.528+0000 7fb13cf79b80 1 Processor -- start 2023-08-10T12:04:05.536 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.528+0000 7fb13cf79b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8e61eb550 0x55f8e61f7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:05.536 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.528+0000 7fb13cf79b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8e61f0a40 0x55f8e61f4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:05.536 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.528+0000 7fb13cf79b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8e61f1360 0x55f8e61f4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:05.536 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.528+0000 7fb13cf79b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8e613c740 con 0x55f8e61eb550 2023-08-10T12:04:05.536 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.528+0000 7fb13cf79b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8e60dba60 con 0x55f8e61f1360 2023-08-10T12:04:05.536 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.528+0000 7fb13cf79b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8e60db760 con 0x55f8e61f0a40 2023-08-10T12:04:05.537 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.528+0000 7fb13cf79b80 10 client.0 _ll_register_callbacks cb 0x55f8e60d9620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:04:05.537 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.528+0000 7fb12a59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8e61eb550 0x55f8e61f7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:05.537 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.528+0000 7fb12a59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8e61eb550 0x55f8e61f7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36842/0 (socket says 172.21.15.73:36842) 2023-08-10T12:04:05.537 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.528+0000 7fb12a59c700 1 -- 172.21.15.73:0/1465852007 learned_addr learned my addr 172.21.15.73:0/1465852007 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:04:05.537 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.528+0000 7fb12ad9d700 1 --2- 172.21.15.73:0/1465852007 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8e61f1360 0x55f8e61f4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:05.537 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.528+0000 7fb129d9b700 1 --2- 172.21.15.73:0/1465852007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8e61f0a40 0x55f8e61f4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:05.537 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.528+0000 7fb12a59c700 1 -- 172.21.15.73:0/1465852007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8e61f0a40 msgr2=0x55f8e61f4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:05.537 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.528+0000 7fb12a59c700 1 --2- 172.21.15.73:0/1465852007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8e61f0a40 0x55f8e61f4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.528+0000 7fb12a59c700 1 -- 172.21.15.73:0/1465852007 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8e61f1360 msgr2=0x55f8e61f4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.528+0000 7fb12a59c700 1 --2- 172.21.15.73:0/1465852007 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8e61f1360 0x55f8e61f4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.528+0000 7fb12a59c700 1 -- 172.21.15.73:0/1465852007 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb124011230 con 0x55f8e61eb550 2023-08-10T12:04:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.528+0000 7fb129d9b700 1 --2- 172.21.15.73:0/1465852007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8e61f0a40 0x55f8e61f4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T12:04:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.529+0000 7fb12a59c700 1 --2- 172.21.15.73:0/1465852007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8e61eb550 0x55f8e61f7410 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fb11c0098e0 tx=0x7fb11c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198db7dbe80d1575 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:04:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.529+0000 7fb111ffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:04:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.529+0000 7fb111ffb700 1 -- 172.21.15.73:0/1465852007 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c02b040 con 0x55f8e61eb550 2023-08-10T12:04:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.529+0000 7fb111ffb700 1 -- 172.21.15.73:0/1465852007 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb11c004910 con 0x55f8e61eb550 2023-08-10T12:04:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.529+0000 7fb13cf79b80 1 -- 172.21.15.73:0/1465852007 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f8e61de1c0 con 0x55f8e61eb550 2023-08-10T12:04:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.529+0000 7fb111ffb700 1 -- 172.21.15.73:0/1465852007 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb11c00f750 con 0x55f8e61eb550 2023-08-10T12:04:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.529+0000 7fb13cf79b80 10 client.17073 fetch_fsmap learned FSMap version 55 2023-08-10T12:04:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.529+0000 7fb13cf79b80 1 -- 172.21.15.73:0/1465852007 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x7fb12c0fec90 con 0x55f8e61eb550 2023-08-10T12:04:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.529+0000 7fb111ffb700 1 -- 172.21.15.73:0/1465852007 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f8e61de1c0 con 0x55f8e61eb550 2023-08-10T12:04:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.529+0000 7fb111ffb700 1 -- 172.21.15.73:0/1465852007 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7fb11c03d030 con 0x55f8e61eb550 2023-08-10T12:04:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.529+0000 7fb13cf79b80 10 client.17073 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:04:05.540 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.529+0000 7fb13cf79b80 10 client.17073 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:04:05.540 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.529+0000 7fb13cf79b80 20 client.17073 populate_metadata read hostname 'smithi073' 2023-08-10T12:04:05.540 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.529+0000 7fb13cf79b80 1 --2- 172.21.15.73:0/1465852007 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f8e62047f0 0x55f8e6206c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:05.540 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.529+0000 7fb13cf79b80 4 client.17073 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:04:05.540 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.529+0000 7fb13cf79b80 1 -- 172.21.15.73:0/1465852007 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f8e61ba970 con 0x55f8e62047f0 2023-08-10T12:04:05.540 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.530+0000 7fb129d9b700 1 --2- 172.21.15.73:0/1465852007 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f8e62047f0 0x55f8e6206c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:05.540 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.530+0000 7fb111ffb700 10 client.17073 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:04:05.540 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.530+0000 7fb129d9b700 1 --2- 172.21.15.73:0/1465852007 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f8e62047f0 0x55f8e6206c10 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb1f8c1d1bd51ab2 server_cookie=ec705526d40f56f0 in_seq=0 out_seq=0 2023-08-10T12:04:05.541 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.531+0000 7fb111ffb700 1 -- 172.21.15.73:0/1465852007 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55f8e61ba970 con 0x55f8e62047f0 2023-08-10T12:04:05.542 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.531+0000 7fb111ffb700 10 client.17073 handle_command_reply: tid=0 2023-08-10T12:04:05.542 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.531+0000 7fb13cf79b80 1 client.17073 shutdown 2023-08-10T12:04:05.542 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.531+0000 7fb13cf79b80 1 -- 172.21.15.73:0/1465852007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8e61eb550 msgr2=0x55f8e61f7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:05.542 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.531+0000 7fb13cf79b80 1 --2- 172.21.15.73:0/1465852007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8e61eb550 0x55f8e61f7410 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fb11c0098e0 tx=0x7fb11c00bc80 comp rx=0 tx=0).stop 2023-08-10T12:04:05.542 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.531+0000 7fb13cf79b80 1 -- 172.21.15.73:0/1465852007 shutdown_connections 2023-08-10T12:04:05.542 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.531+0000 7fb13cf79b80 1 --2- 172.21.15.73:0/1465852007 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f8e62047f0 0x55f8e6206c10 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:05.542 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.531+0000 7fb13cf79b80 1 --2- 172.21.15.73:0/1465852007 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8e61f1360 0x55f8e61f4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:05.543 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.531+0000 7fb13cf79b80 1 --2- 172.21.15.73:0/1465852007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8e61eb550 0x55f8e61f7410 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:05.543 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.531+0000 7fb111ffb700 0 client.17073 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:04:05.543 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.531+0000 7fb13cf79b80 1 --2- 172.21.15.73:0/1465852007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8e61f0a40 0x55f8e61f4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:05.543 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.531+0000 7fb13cf79b80 1 -- 172.21.15.73:0/1465852007 >> 172.21.15.73:0/1465852007 conn(0x55f8e6148c70 msgr2=0x55f8e61e54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:04:05.543 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.531+0000 7fb13cf79b80 1 -- 172.21.15.73:0/1465852007 shutdown_connections 2023-08-10T12:04:05.543 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.531+0000 7fb13cf79b80 1 -- 172.21.15.73:0/1465852007 wait complete. 2023-08-10T12:04:05.543 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.531+0000 7fb13cf79b80 20 client.17073 trim_cache size 0 max 16384 2023-08-10T12:04:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.546+0000 7fb13cf79b80 1 Processor -- start 2023-08-10T12:04:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.546+0000 7fb13cf79b80 1 -- start start 2023-08-10T12:04:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.547+0000 7fb13cf79b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8e61eb550 0x55f8e61eb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.547+0000 7fb13cf79b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8e61f0a40 0x55f8e61e5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.547+0000 7fb13cf79b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8e61f1360 0x55f8e61f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.547+0000 7fb13cf79b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8e5fbf8c0 con 0x55f8e61f1360 2023-08-10T12:04:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.547+0000 7fb13cf79b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8e61f5c70 con 0x55f8e61f0a40 2023-08-10T12:04:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.547+0000 7fb13cf79b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8e61e0730 con 0x55f8e61eb550 2023-08-10T12:04:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.547+0000 7fb12a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8e61eb550 0x55f8e61eb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.547+0000 7fb12ad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8e61f1360 0x55f8e61f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.547+0000 7fb12a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8e61eb550 0x55f8e61eb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:34122/0 (socket says 172.21.15.73:34122) 2023-08-10T12:04:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.547+0000 7fb12a59c700 1 -- 172.21.15.73:0/1134430700 learned_addr learned my addr 172.21.15.73:0/1134430700 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:04:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.547+0000 7fb129d9b700 1 --2- 172.21.15.73:0/1134430700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8e61f0a40 0x55f8e61e5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.547+0000 7fb12a59c700 1 -- 172.21.15.73:0/1134430700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8e61f0a40 msgr2=0x55f8e61e5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.547+0000 7fb12a59c700 1 --2- 172.21.15.73:0/1134430700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8e61f0a40 0x55f8e61e5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.547+0000 7fb12a59c700 1 -- 172.21.15.73:0/1134430700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8e61f1360 msgr2=0x55f8e61f3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.547+0000 7fb12a59c700 1 --2- 172.21.15.73:0/1134430700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8e61f1360 0x55f8e61f3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.547+0000 7fb12a59c700 1 -- 172.21.15.73:0/1134430700 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8e5f69d80 con 0x55f8e61eb550 2023-08-10T12:04:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.547+0000 7fb12ad9d700 1 --2- 172.21.15.73:0/1134430700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8e61f1360 0x55f8e61f3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:04:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.547+0000 7fb12a59c700 1 --2- 172.21.15.73:0/1134430700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8e61eb550 0x55f8e61eb010 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb11c005680 tx=0x7fb11c0056b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=580cc7cb7df0443d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:04:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.547+0000 7fb1197fa700 1 -- 172.21.15.73:0/1134430700 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c02b040 con 0x55f8e61eb550 2023-08-10T12:04:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.547+0000 7fb1197fa700 1 -- 172.21.15.73:0/1134430700 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb11c024950 con 0x55f8e61eb550 2023-08-10T12:04:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.547+0000 7fb1197fa700 1 -- 172.21.15.73:0/1134430700 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c00f980 con 0x55f8e61eb550 2023-08-10T12:04:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.548+0000 7fb13cf79b80 1 -- 172.21.15.73:0/1134430700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8e61eb550 msgr2=0x55f8e61eb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.548+0000 7fb13cf79b80 1 --2- 172.21.15.73:0/1134430700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8e61eb550 0x55f8e61eb010 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb11c005680 tx=0x7fb11c0056b0 comp rx=0 tx=0).stop 2023-08-10T12:04:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.548+0000 7fb13cf79b80 1 -- 172.21.15.73:0/1134430700 shutdown_connections 2023-08-10T12:04:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.548+0000 7fb13cf79b80 1 --2- 172.21.15.73:0/1134430700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8e61f1360 0x55f8e61f3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.548+0000 7fb13cf79b80 1 --2- 172.21.15.73:0/1134430700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8e61eb550 0x55f8e61eb010 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.548+0000 7fb13cf79b80 1 --2- 172.21.15.73:0/1134430700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8e61f0a40 0x55f8e61e5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:05.553 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.548+0000 7fb13cf79b80 1 -- 172.21.15.73:0/1134430700 >> 172.21.15.73:0/1134430700 conn(0x55f8e6148c70 msgr2=0x55f8e61ee970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:04:05.553 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.548+0000 7fb13cf79b80 1 -- 172.21.15.73:0/1134430700 shutdown_connections 2023-08-10T12:04:05.553 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.548+0000 7fb13cf79b80 1 -- 172.21.15.73:0/1134430700 wait complete. 2023-08-10T12:04:05.553 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.548+0000 7fb13cf79b80 1 -- start start 2023-08-10T12:04:05.553 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.548+0000 7fb13cf79b80 1 Processor -- start 2023-08-10T12:04:05.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.549+0000 7fb13cf79b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8e61eb550 0x55f8e61fb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:05.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.549+0000 7fb13cf79b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8e61f0a40 0x55f8e61fbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:05.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.549+0000 7fb13cf79b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8e61f1360 0x55f8e61f9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:05.557 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.549+0000 7fb13cf79b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8e61fa400 con 0x55f8e61f1360 2023-08-10T12:04:05.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.549+0000 7fb13cf79b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8e61fa570 con 0x55f8e61eb550 2023-08-10T12:04:05.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.549+0000 7fb13cf79b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8e61fa730 con 0x55f8e61f0a40 2023-08-10T12:04:05.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.549+0000 7fb13cf79b80 10 client.0 _ll_register_callbacks cb 0x55f8e60d9620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:04:05.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.549+0000 7fb12ad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8e61f1360 0x55f8e61f9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:05.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.549+0000 7fb12ad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8e61f1360 0x55f8e61f9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36860/0 (socket says 172.21.15.73:36860) 2023-08-10T12:04:05.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.549+0000 7fb12a59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8e61eb550 0x55f8e61fb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:05.558 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.549+0000 7fb12ad9d700 1 -- 172.21.15.73:0/2774978000 learned_addr learned my addr 172.21.15.73:0/2774978000 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:04:05.559 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.549+0000 7fb129d9b700 1 --2- 172.21.15.73:0/2774978000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8e61f0a40 0x55f8e61fbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:05.559 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.549+0000 7fb12ad9d700 1 -- 172.21.15.73:0/2774978000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8e61f0a40 msgr2=0x55f8e61fbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:05.559 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.549+0000 7fb12ad9d700 1 --2- 172.21.15.73:0/2774978000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8e61f0a40 0x55f8e61fbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:05.559 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.549+0000 7fb12ad9d700 1 -- 172.21.15.73:0/2774978000 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8e61eb550 msgr2=0x55f8e61fb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:05.559 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.549+0000 7fb12ad9d700 1 --2- 172.21.15.73:0/2774978000 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8e61eb550 0x55f8e61fb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:05.559 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.549+0000 7fb12ad9d700 1 -- 172.21.15.73:0/2774978000 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb124003b30 con 0x55f8e61f1360 2023-08-10T12:04:05.559 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.549+0000 7fb12a59c700 1 --2- 172.21.15.73:0/2774978000 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8e61eb550 0x55f8e61fb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:04:05.560 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.549+0000 7fb12ad9d700 1 --2- 172.21.15.73:0/2774978000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8e61f1360 0x55f8e61f9d40 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fb124003f00 tx=0x7fb1240176f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ac4f70a47947cb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:04:05.560 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.549+0000 7fb111ffb700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:04:05.560 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.550+0000 7fb111ffb700 1 -- 172.21.15.73:0/2774978000 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12401c070 con 0x55f8e61f1360 2023-08-10T12:04:05.560 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.550+0000 7fb111ffb700 1 -- 172.21.15.73:0/2774978000 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb1240076b0 con 0x55f8e61f1360 2023-08-10T12:04:05.560 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.550+0000 7fb13cf79b80 1 -- 172.21.15.73:0/2774978000 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb11c01e040 con 0x55f8e61f1360 2023-08-10T12:04:05.560 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.550+0000 7fb111ffb700 1 -- 172.21.15.73:0/2774978000 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb12400e040 con 0x55f8e61f1360 2023-08-10T12:04:05.560 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.550+0000 7fb13cf79b80 10 client.17079 fetch_fsmap learned FSMap version 55 2023-08-10T12:04:05.561 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.550+0000 7fb13cf79b80 1 -- 172.21.15.73:0/2774978000 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x7fb12c0fec90 con 0x55f8e61f1360 2023-08-10T12:04:05.561 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.550+0000 7fb111ffb700 1 -- 172.21.15.73:0/2774978000 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb11c01e040 con 0x55f8e61f1360 2023-08-10T12:04:05.561 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.550+0000 7fb111ffb700 1 -- 172.21.15.73:0/2774978000 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7fb124020830 con 0x55f8e61f1360 2023-08-10T12:04:05.561 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.550+0000 7fb13cf79b80 10 client.17079 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:04:05.561 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.550+0000 7fb13cf79b80 10 client.17079 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:04:05.561 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.550+0000 7fb13cf79b80 20 client.17079 populate_metadata read hostname 'smithi073' 2023-08-10T12:04:05.561 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.550+0000 7fb13cf79b80 1 --2- 172.21.15.73:0/2774978000 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f8e62596b0 0x55f8e625bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:05.562 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.550+0000 7fb13cf79b80 4 client.17079 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T12:04:05.562 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.550+0000 7fb13cf79b80 1 -- 172.21.15.73:0/2774978000 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f8e6135720 con 0x55f8e62596b0 2023-08-10T12:04:05.562 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.550+0000 7fb12a59c700 1 --2- 172.21.15.73:0/2774978000 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f8e62596b0 0x55f8e625bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:05.562 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.551+0000 7fb111ffb700 10 client.17079 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:04:05.562 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:05.551+0000 7fb12a59c700 1 --2- 172.21.15.73:0/2774978000 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f8e62596b0 0x55f8e625bad0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8399a549aa293ac server_cookie=a9e9207769034485 in_seq=0 out_seq=0 2023-08-10T12:04:07.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:07 smithi152 ceph-mon[130220]: pgmap v357: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 727 op/s 2023-08-10T12:04:07.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:07 smithi156 ceph-mon[130574]: pgmap v357: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 727 op/s 2023-08-10T12:04:07.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:07 smithi073 ceph-mon[128869]: pgmap v357: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 727 op/s 2023-08-10T12:04:09.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:09 smithi152 ceph-mon[130220]: pgmap v358: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 217 op/s 2023-08-10T12:04:09.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:09 smithi156 ceph-mon[130574]: pgmap v358: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 217 op/s 2023-08-10T12:04:09.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:09 smithi073 ceph-mon[128869]: pgmap v358: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 217 op/s 2023-08-10T12:04:09.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:09.994+0000 7fb111ffb700 1 -- 172.21.15.73:0/2774978000 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f8e6135720 con 0x55f8e62596b0 2023-08-10T12:04:09.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:09.994+0000 7fb111ffb700 10 client.17079 handle_command_reply: tid=0 2023-08-10T12:04:09.995 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:09.994+0000 7fb13cf79b80 1 client.17079 shutdown 2023-08-10T12:04:09.996 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:09.994+0000 7fb13cf79b80 1 -- 172.21.15.73:0/2774978000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8e61f1360 msgr2=0x55f8e61f9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:09.996 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:09.994+0000 7fb13cf79b80 1 --2- 172.21.15.73:0/2774978000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8e61f1360 0x55f8e61f9d40 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fb124003f00 tx=0x7fb1240176f0 comp rx=0 tx=0).stop 2023-08-10T12:04:09.996 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:09.994+0000 7fb13cf79b80 1 -- 172.21.15.73:0/2774978000 shutdown_connections 2023-08-10T12:04:09.996 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:09.994+0000 7fb13cf79b80 1 --2- 172.21.15.73:0/2774978000 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x55f8e62596b0 0x55f8e625bad0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:09.996 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:09.994+0000 7fb13cf79b80 1 --2- 172.21.15.73:0/2774978000 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f8e61eb550 0x55f8e61fb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:09.996 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:09.994+0000 7fb111ffb700 0 client.17079 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:04:09.996 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:09.994+0000 7fb13cf79b80 1 --2- 172.21.15.73:0/2774978000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8e61f1360 0x55f8e61f9d40 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:09.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:09.994+0000 7fb13cf79b80 1 --2- 172.21.15.73:0/2774978000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8e61f0a40 0x55f8e61fbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:09.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:09.994+0000 7fb13cf79b80 1 -- 172.21.15.73:0/2774978000 >> 172.21.15.73:0/2774978000 conn(0x55f8e6148c70 msgr2=0x55f8e61ef890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:04:09.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:09.994+0000 7fb13cf79b80 1 -- 172.21.15.73:0/2774978000 shutdown_connections 2023-08-10T12:04:09.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:09.994+0000 7fb13cf79b80 1 -- 172.21.15.73:0/2774978000 wait complete. 2023-08-10T12:04:09.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:09.995+0000 7fb13cf79b80 20 client.17079 trim_cache size 0 max 16384 2023-08-10T12:04:09.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T12:04:09.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T12:04:09.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T12:04:09.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T12:04:09.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:09.995+0000 7fb130de0700 1 -- 172.21.15.73:0/1261291333 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb1140a12c0 msgr2=0x7fb1140a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:09.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:09.995+0000 7fb130de0700 1 --2- 172.21.15.73:0/1261291333 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb1140a12c0 0x7fb1140a3780 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb11c00b2e0 tx=0x7fb11c005fd0 comp rx=0 tx=0).stop 2023-08-10T12:04:09.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:09.995+0000 7fb130de0700 1 -- 172.21.15.73:0/1261291333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb12c100760 msgr2=0x7fb12c19cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:09.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:09.995+0000 7fb130de0700 1 --2- 172.21.15.73:0/1261291333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb12c100760 0x7fb12c19cc60 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb12000e9a0 tx=0x7fb12000ecb0 comp rx=0 tx=0).stop 2023-08-10T12:04:09.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:09.995+0000 7fb130de0700 1 -- 172.21.15.73:0/1261291333 shutdown_connections 2023-08-10T12:04:09.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:09.995+0000 7fb130de0700 1 --2- 172.21.15.73:0/1261291333 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb1140a12c0 0x7fb1140a3780 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:09.999 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:09.995+0000 7fb130de0700 1 --2- 172.21.15.73:0/1261291333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb12c0ffda0 0x7fb12c19c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:10.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:09.995+0000 7fb130de0700 1 --2- 172.21.15.73:0/1261291333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb12c1045e0 0x7fb12c196580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:10.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:09.995+0000 7fb130de0700 1 --2- 172.21.15.73:0/1261291333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb12c100760 0x7fb12c19cc60 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:10.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:09.995+0000 7fb130de0700 1 -- 172.21.15.73:0/1261291333 >> 172.21.15.73:0/1261291333 conn(0x7fb12c076b40 msgr2=0x7fb12c1021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:04:10.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:09.995+0000 7fb130de0700 1 -- 172.21.15.73:0/1261291333 shutdown_connections 2023-08-10T12:04:10.000 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:09.995+0000 7fb130de0700 1 -- 172.21.15.73:0/1261291333 wait complete. 2023-08-10T12:04:11.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:11 smithi152 ceph-mon[130220]: pgmap v359: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 251 op/s 2023-08-10T12:04:11.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:11 smithi152 ceph-mon[130220]: osdmap e97: 12 total, 12 up, 12 in 2023-08-10T12:04:11.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:11 smithi156 ceph-mon[130574]: pgmap v359: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 251 op/s 2023-08-10T12:04:11.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:11 smithi156 ceph-mon[130574]: osdmap e97: 12 total, 12 up, 12 in 2023-08-10T12:04:11.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:11 smithi073 ceph-mon[128869]: pgmap v359: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 251 op/s 2023-08-10T12:04:11.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:11 smithi073 ceph-mon[128869]: osdmap e97: 12 total, 12 up, 12 in 2023-08-10T12:04:13.501 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:13 smithi152 ceph-mon[130220]: pgmap v361: 97 pgs: 17 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 68 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 669 KiB/s wr, 204 op/s 2023-08-10T12:04:13.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:13 smithi156 ceph-mon[130574]: pgmap v361: 97 pgs: 17 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 68 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 669 KiB/s wr, 204 op/s 2023-08-10T12:04:13.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:13 smithi073 ceph-mon[128869]: pgmap v361: 97 pgs: 17 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 68 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 669 KiB/s wr, 204 op/s 2023-08-10T12:04:15.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:14 smithi152 ceph-mon[130220]: pgmap v362: 97 pgs: 28 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 53 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 669 KiB/s wr, 191 op/s 2023-08-10T12:04:15.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:14 smithi156 ceph-mon[130574]: pgmap v362: 97 pgs: 28 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 53 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 669 KiB/s wr, 191 op/s 2023-08-10T12:04:15.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:14 smithi073 ceph-mon[128869]: pgmap v362: 97 pgs: 28 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 53 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 669 KiB/s wr, 191 op/s 2023-08-10T12:04:17.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:17 smithi152 ceph-mon[130220]: pgmap v363: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 760 KiB/s wr, 164 op/s 2023-08-10T12:04:17.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:17 smithi156 ceph-mon[130574]: pgmap v363: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 760 KiB/s wr, 164 op/s 2023-08-10T12:04:17.523 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:17 smithi073 ceph-mon[128869]: pgmap v363: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 760 KiB/s wr, 164 op/s 2023-08-10T12:04:19.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:19 smithi152 ceph-mon[130220]: pgmap v364: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 797 KiB/s rd, 757 KiB/s wr, 160 op/s 2023-08-10T12:04:19.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:19 smithi156 ceph-mon[130574]: pgmap v364: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 797 KiB/s rd, 757 KiB/s wr, 160 op/s 2023-08-10T12:04:19.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:19 smithi073 ceph-mon[128869]: pgmap v364: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 797 KiB/s rd, 757 KiB/s wr, 160 op/s 2023-08-10T12:04:21.499 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:21 smithi152 ceph-mon[130220]: pgmap v365: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 673 KiB/s wr, 129 op/s 2023-08-10T12:04:21.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:21 smithi156 ceph-mon[130574]: pgmap v365: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 673 KiB/s wr, 129 op/s 2023-08-10T12:04:21.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:21 smithi073 ceph-mon[128869]: pgmap v365: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 673 KiB/s wr, 129 op/s 2023-08-10T12:04:23.169 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.167+0000 7febf0b71700 1 -- 172.21.15.73:0/1465502406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febec1006f0 msgr2=0x7febec100b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:23.169 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.167+0000 7febf0b71700 1 --2- 172.21.15.73:0/1465502406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febec1006f0 0x7febec100b70 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7febdc009990 tx=0x7febdc009ca0 comp rx=0 tx=0).stop 2023-08-10T12:04:23.169 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.167+0000 7febf0b71700 1 -- 172.21.15.73:0/1465502406 shutdown_connections 2023-08-10T12:04:23.169 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.167+0000 7febf0b71700 1 --2- 172.21.15.73:0/1465502406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febec106700 0x7febec106ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:23.170 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.167+0000 7febf0b71700 1 --2- 172.21.15.73:0/1465502406 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febec1010b0 0x7febec10d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:23.170 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.167+0000 7febf0b71700 1 --2- 172.21.15.73:0/1465502406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febec1006f0 0x7febec100b70 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:23.170 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.167+0000 7febf0b71700 1 -- 172.21.15.73:0/1465502406 >> 172.21.15.73:0/1465502406 conn(0x7febec0fc220 msgr2=0x7febec0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:04:23.183 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.181+0000 7febf0b71700 1 -- 172.21.15.73:0/1465502406 shutdown_connections 2023-08-10T12:04:23.183 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.182+0000 7febf0b71700 1 -- 172.21.15.73:0/1465502406 wait complete. 2023-08-10T12:04:23.184 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.182+0000 7febf0b71700 1 Processor -- start 2023-08-10T12:04:23.184 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.183+0000 7febf0b71700 1 -- start start 2023-08-10T12:04:23.185 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.183+0000 7febf0b71700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febec1006f0 0x7febec19ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:23.185 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.183+0000 7febf0b71700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febec1010b0 0x7febec19cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.183+0000 7febf0b71700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febec1968b0 0x7febec196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.183+0000 7febf0b71700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec197330 con 0x7febec1010b0 2023-08-10T12:04:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.183+0000 7febf0b71700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec197470 con 0x7febec1006f0 2023-08-10T12:04:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.183+0000 7febf0b71700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec197630 con 0x7febec1968b0 2023-08-10T12:04:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.183+0000 7febea59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febec1006f0 0x7febec19ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.183+0000 7febea59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febec1006f0 0x7febec19ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:51520/0 (socket says 172.21.15.73:51520) 2023-08-10T12:04:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.183+0000 7febea59c700 1 -- 172.21.15.73:0/3017359694 learned_addr learned my addr 172.21.15.73:0/3017359694 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:04:23.187 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.183+0000 7febead9d700 1 --2- 172.21.15.73:0/3017359694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febec1968b0 0x7febec196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:23.187 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.184+0000 7febead9d700 1 -- 172.21.15.73:0/3017359694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febec1006f0 msgr2=0x7febec19ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:23.187 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.184+0000 7febead9d700 1 --2- 172.21.15.73:0/3017359694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febec1006f0 0x7febec19ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:23.187 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.184+0000 7febead9d700 1 -- 172.21.15.73:0/3017359694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febec1010b0 msgr2=0x7febec19cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:23.187 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.184+0000 7febead9d700 1 --2- 172.21.15.73:0/3017359694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febec1010b0 0x7febec19cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:23.187 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.184+0000 7febead9d700 1 -- 172.21.15.73:0/3017359694 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febdc0095f0 con 0x7febec1968b0 2023-08-10T12:04:23.187 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.184+0000 7febea59c700 1 --2- 172.21.15.73:0/3017359694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febec1006f0 0x7febec19ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:04:23.188 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.184+0000 7febead9d700 1 --2- 172.21.15.73:0/3017359694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febec1968b0 0x7febec196d60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7febe4007f10 tx=0x7febe400d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:04:23.188 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.185+0000 7febdb7fe700 1 -- 172.21.15.73:0/3017359694 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe4009ea0 con 0x7febec1968b0 2023-08-10T12:04:23.188 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.185+0000 7febdb7fe700 1 -- 172.21.15.73:0/3017359694 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7febe400f040 con 0x7febec1968b0 2023-08-10T12:04:23.188 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.185+0000 7febdb7fe700 1 -- 172.21.15.73:0/3017359694 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe4004400 con 0x7febec1968b0 2023-08-10T12:04:23.189 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.185+0000 7febf0b71700 1 -- 172.21.15.73:0/3017359694 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febec072a00 con 0x7febec1968b0 2023-08-10T12:04:23.190 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.185+0000 7febf0b71700 1 -- 172.21.15.73:0/3017359694 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febec072ec0 con 0x7febec1968b0 2023-08-10T12:04:23.191 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.189+0000 7febdb7fe700 1 -- 172.21.15.73:0/3017359694 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7febe4004ad0 con 0x7febec1968b0 2023-08-10T12:04:23.191 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.190+0000 7febfcd0ab80 1 Processor -- start 2023-08-10T12:04:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.190+0000 7febdb7fe700 1 --2- 172.21.15.73:0/3017359694 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7febd40a5820 0x7febd40a7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.190+0000 7febdb7fe700 1 -- 172.21.15.73:0/3017359694 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8557+0+0 (secure 0 0 0) 0x7febe40cc510 con 0x7febec1968b0 2023-08-10T12:04:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.190+0000 7febe9d9b700 1 --2- 172.21.15.73:0/3017359694 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7febd40a5820 0x7febd40a7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.191+0000 7febfcd0ab80 1 -- start start 2023-08-10T12:04:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.191+0000 7febe9d9b700 1 --2- 172.21.15.73:0/3017359694 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7febd40a5820 0x7febd40a7ce0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7febdc00b5c0 tx=0x7febdc005fd0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:04:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.191+0000 7febfcd0ab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563879fd6a40 0x563879fd6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.191+0000 7febfcd0ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563879fd7360 0x563879fd1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.191+0000 7febfcd0ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563879fd1550 0x563879fd19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.191+0000 7febfcd0ab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563879f4cd60 con 0x563879fd6a40 2023-08-10T12:04:23.194 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.191+0000 7febfcd0ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563879f29530 con 0x563879fd7360 2023-08-10T12:04:23.194 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.191+0000 7febfcd0ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563879f26e50 con 0x563879fd1550 2023-08-10T12:04:23.194 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.191+0000 7febe9d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563879fd7360 0x563879fd1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:23.194 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.191+0000 7febe9d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563879fd7360 0x563879fd1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:51530/0 (socket says 172.21.15.73:51530) 2023-08-10T12:04:23.195 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.192+0000 7febe9d9b700 1 -- 172.21.15.73:0/2624105709 learned_addr learned my addr 172.21.15.73:0/2624105709 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:04:23.195 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.192+0000 7febea59c700 1 --2- 172.21.15.73:0/2624105709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563879fd6a40 0x563879fd6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:23.195 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.192+0000 7febe9d9b700 1 -- 172.21.15.73:0/2624105709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563879fd1550 msgr2=0x563879fd19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:23.195 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.192+0000 7febe9d9b700 1 --2- 172.21.15.73:0/2624105709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563879fd1550 0x563879fd19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:23.195 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.192+0000 7febe9d9b700 1 -- 172.21.15.73:0/2624105709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563879fd6a40 msgr2=0x563879fd6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:23.195 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.192+0000 7febe9d9b700 1 --2- 172.21.15.73:0/2624105709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563879fd6a40 0x563879fd6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:23.195 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.192+0000 7febe9d9b700 1 -- 172.21.15.73:0/2624105709 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563879da35d0 con 0x563879fd7360 2023-08-10T12:04:23.196 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.192+0000 7febe9d9b700 1 --2- 172.21.15.73:0/2624105709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563879fd7360 0x563879fd1010 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7febdc015000 tx=0x7febdc01d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d0574872e366baf server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:04:23.198 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.195+0000 7febd8ff9700 1 -- 172.21.15.73:0/2624105709 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc01d070 con 0x563879fd7360 2023-08-10T12:04:23.199 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.195+0000 7febd8ff9700 1 -- 172.21.15.73:0/2624105709 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7febdc003d30 con 0x563879fd7360 2023-08-10T12:04:23.199 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.195+0000 7febd8ff9700 1 -- 172.21.15.73:0/2624105709 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc00f9a0 con 0x563879fd7360 2023-08-10T12:04:23.199 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.196+0000 7febfcd0ab80 1 -- 172.21.15.73:0/2624105709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563879fd7360 msgr2=0x563879fd1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:23.199 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.196+0000 7febfcd0ab80 1 --2- 172.21.15.73:0/2624105709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563879fd7360 0x563879fd1010 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7febdc015000 tx=0x7febdc01d000 comp rx=0 tx=0).stop 2023-08-10T12:04:23.199 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.196+0000 7febfcd0ab80 1 -- 172.21.15.73:0/2624105709 shutdown_connections 2023-08-10T12:04:23.199 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.196+0000 7febfcd0ab80 1 --2- 172.21.15.73:0/2624105709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563879fd1550 0x563879fd19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:23.199 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.196+0000 7febfcd0ab80 1 --2- 172.21.15.73:0/2624105709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563879fd6a40 0x563879fd6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:23.200 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.196+0000 7febfcd0ab80 1 --2- 172.21.15.73:0/2624105709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563879fd7360 0x563879fd1010 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:23.200 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.196+0000 7febfcd0ab80 1 -- 172.21.15.73:0/2624105709 >> 172.21.15.73:0/2624105709 conn(0x563879f2ec70 msgr2=0x563879fcbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:04:23.200 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.196+0000 7febfcd0ab80 1 -- 172.21.15.73:0/2624105709 shutdown_connections 2023-08-10T12:04:23.200 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.196+0000 7febfcd0ab80 1 -- 172.21.15.73:0/2624105709 wait complete. 2023-08-10T12:04:23.200 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.196+0000 7febfcd0ab80 1 -- start start 2023-08-10T12:04:23.200 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.196+0000 7febfcd0ab80 1 Processor -- start 2023-08-10T12:04:23.200 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.197+0000 7febfcd0ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563879fd1550 0x563879fda770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:23.201 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.197+0000 7febfcd0ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563879fd6a40 0x563879fdacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:23.201 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.197+0000 7febfcd0ab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563879fd7360 0x563879fdb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:23.201 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.197+0000 7febfcd0ab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563879f22740 con 0x563879fd7360 2023-08-10T12:04:23.201 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.197+0000 7febfcd0ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563879ec1a60 con 0x563879fd1550 2023-08-10T12:04:23.201 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.197+0000 7febfcd0ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563879ec1760 con 0x563879fd6a40 2023-08-10T12:04:23.201 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.197+0000 7febfcd0ab80 10 client.0 _ll_register_callbacks cb 0x563879ebf620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:04:23.201 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.197+0000 7febe9d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563879fd6a40 0x563879fdacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:23.201 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.197+0000 7febe9d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563879fd6a40 0x563879fdacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:34156/0 (socket says 172.21.15.73:34156) 2023-08-10T12:04:23.202 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.197+0000 7febe9d9b700 1 -- 172.21.15.73:0/2982191800 learned_addr learned my addr 172.21.15.73:0/2982191800 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:04:23.203 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.197+0000 7febea59c700 1 --2- 172.21.15.73:0/2982191800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563879fd1550 0x563879fda770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:23.203 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.198+0000 7febe9d9b700 1 -- 172.21.15.73:0/2982191800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563879fd1550 msgr2=0x563879fda770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:23.203 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.198+0000 7febe9d9b700 1 --2- 172.21.15.73:0/2982191800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563879fd1550 0x563879fda770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:23.203 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.198+0000 7febe9d9b700 1 -- 172.21.15.73:0/2982191800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563879fd7360 msgr2=0x563879fdb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:23.203 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.198+0000 7febe9d9b700 1 --2- 172.21.15.73:0/2982191800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563879fd7360 0x563879fdb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:23.203 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.198+0000 7febe9d9b700 1 -- 172.21.15.73:0/2982191800 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febec10dec0 con 0x563879fd6a40 2023-08-10T12:04:23.203 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.198+0000 7febe9d9b700 1 --2- 172.21.15.73:0/2982191800 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563879fd6a40 0x563879fdacb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7febdc0098e0 tx=0x7febdc00f460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb174f22e23f8c66 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:04:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.198+0000 7febd1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T12:04:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.198+0000 7febd1ffb700 1 -- 172.21.15.73:0/2982191800 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc00f840 con 0x563879fd6a40 2023-08-10T12:04:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.198+0000 7febd1ffb700 1 -- 172.21.15.73:0/2982191800 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8557+0+0 (secure 0 0 0) 0x7febdc0056f0 con 0x563879fd6a40 2023-08-10T12:04:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.198+0000 7febfcd0ab80 1 -- 172.21.15.73:0/2982191800 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563879fc41c0 con 0x563879fd6a40 2023-08-10T12:04:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.199+0000 7febd1ffb700 1 -- 172.21.15.73:0/2982191800 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7febdc00f9a0 con 0x563879fd6a40 2023-08-10T12:04:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.205+0000 7febfcd0ab80 10 client.26557 fetch_fsmap learned FSMap version 55 2023-08-10T12:04:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.205+0000 7febfcd0ab80 1 -- 172.21.15.73:0/2982191800 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x563879d4fd80 con 0x563879fd6a40 2023-08-10T12:04:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.206+0000 7febd1ffb700 1 -- 172.21.15.73:0/2982191800 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7febdc03e070 con 0x563879fd6a40 2023-08-10T12:04:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.207+0000 7febd1ffb700 1 -- 172.21.15.73:0/2982191800 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7febdc00fb00 con 0x563879fd6a40 2023-08-10T12:04:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.207+0000 7febfcd0ab80 10 client.26557 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:04:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.207+0000 7febfcd0ab80 10 client.26557 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:04:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.207+0000 7febfcd0ab80 20 client.26557 populate_metadata read hostname 'smithi073' 2023-08-10T12:04:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.207+0000 7febfcd0ab80 1 --2- 172.21.15.73:0/2982191800 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563879ffb9b0 0x563879ffddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.207+0000 7febfcd0ab80 4 client.26557 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:04:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.207+0000 7febfcd0ab80 1 -- 172.21.15.73:0/2982191800 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563879fa0970 con 0x563879ffb9b0 2023-08-10T12:04:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.207+0000 7febea59c700 1 --2- 172.21.15.73:0/2982191800 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563879ffb9b0 0x563879ffddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.209+0000 7febea59c700 1 --2- 172.21.15.73:0/2982191800 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563879ffb9b0 0x563879ffddd0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87420a746472f976 server_cookie=4ec41f4d20b6caa6 in_seq=0 out_seq=0 2023-08-10T12:04:23.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.212+0000 7febd1ffb700 10 client.26557 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:04:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.213+0000 7febd1ffb700 1 -- 172.21.15.73:0/2982191800 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x563879fa0970 con 0x563879ffb9b0 2023-08-10T12:04:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.213+0000 7febd1ffb700 10 client.26557 handle_command_reply: tid=0 2023-08-10T12:04:23.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.215+0000 7febfcd0ab80 1 client.26557 shutdown 2023-08-10T12:04:23.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.215+0000 7febfcd0ab80 1 -- 172.21.15.73:0/2982191800 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563879fd6a40 msgr2=0x563879fdacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:23.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.215+0000 7febfcd0ab80 1 --2- 172.21.15.73:0/2982191800 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563879fd6a40 0x563879fdacb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7febdc0098e0 tx=0x7febdc00f460 comp rx=0 tx=0).stop 2023-08-10T12:04:23.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.216+0000 7febfcd0ab80 1 -- 172.21.15.73:0/2982191800 shutdown_connections 2023-08-10T12:04:23.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.216+0000 7febfcd0ab80 1 --2- 172.21.15.73:0/2982191800 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563879ffb9b0 0x563879ffddd0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:23.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.216+0000 7febfcd0ab80 1 --2- 172.21.15.73:0/2982191800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563879fd1550 0x563879fda770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:23.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.216+0000 7febfcd0ab80 1 --2- 172.21.15.73:0/2982191800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563879fd7360 0x563879fdb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:23.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.216+0000 7febd1ffb700 0 client.26557 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:04:23.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.216+0000 7febfcd0ab80 1 --2- 172.21.15.73:0/2982191800 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563879fd6a40 0x563879fdacb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:23.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.216+0000 7febfcd0ab80 1 -- 172.21.15.73:0/2982191800 >> 172.21.15.73:0/2982191800 conn(0x563879f2ec70 msgr2=0x563879fcb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:04:23.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.216+0000 7febfcd0ab80 1 -- 172.21.15.73:0/2982191800 shutdown_connections 2023-08-10T12:04:23.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.217+0000 7febfcd0ab80 1 -- 172.21.15.73:0/2982191800 wait complete. 2023-08-10T12:04:23.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.217+0000 7febfcd0ab80 20 client.26557 trim_cache size 0 max 16384 2023-08-10T12:04:23.242 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.241+0000 7febfcd0ab80 1 Processor -- start 2023-08-10T12:04:23.242 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.241+0000 7febfcd0ab80 1 -- start start 2023-08-10T12:04:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.241+0000 7febfcd0ab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563879fd1550 0x563879fd1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.241+0000 7febfcd0ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563879fd6a40 0x563879fd6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.241+0000 7febfcd0ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563879fd7360 0x563879fcbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.241+0000 7febfcd0ab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563879da58c0 con 0x563879fd1550 2023-08-10T12:04:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.241+0000 7febfcd0ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563879fd66c0 con 0x563879fd6a40 2023-08-10T12:04:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.241+0000 7febfcd0ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563879fcd800 con 0x563879fd7360 2023-08-10T12:04:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.244+0000 7febead9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563879fd7360 0x563879fcbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.244+0000 7febead9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563879fd7360 0x563879fcbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:34168/0 (socket says 172.21.15.73:34168) 2023-08-10T12:04:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.244+0000 7febead9d700 1 -- 172.21.15.73:0/3429851009 learned_addr learned my addr 172.21.15.73:0/3429851009 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:04:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.245+0000 7febe9d9b700 1 --2- 172.21.15.73:0/3429851009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563879fd6a40 0x563879fd6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.245+0000 7febead9d700 1 -- 172.21.15.73:0/3429851009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563879fd6a40 msgr2=0x563879fd6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.245+0000 7febead9d700 1 --2- 172.21.15.73:0/3429851009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563879fd6a40 0x563879fd6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.245+0000 7febead9d700 1 -- 172.21.15.73:0/3429851009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563879fd1550 msgr2=0x563879fd1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.245+0000 7febead9d700 1 --2- 172.21.15.73:0/3429851009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563879fd1550 0x563879fd1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.245+0000 7febead9d700 1 -- 172.21.15.73:0/3429851009 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563879d38c00 con 0x563879fd7360 2023-08-10T12:04:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.245+0000 7febe9d9b700 1 --2- 172.21.15.73:0/3429851009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563879fd6a40 0x563879fd6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T12:04:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.245+0000 7febead9d700 1 --2- 172.21.15.73:0/3429851009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563879fd7360 0x563879fcbc30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7febe4096030 tx=0x7febe40093e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d53addc8c2856250 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:04:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.246+0000 7febd97fa700 1 -- 172.21.15.73:0/3429851009 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe40b90d0 con 0x563879fd7360 2023-08-10T12:04:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.246+0000 7febd97fa700 1 -- 172.21.15.73:0/3429851009 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7febe4098f20 con 0x563879fd7360 2023-08-10T12:04:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.246+0000 7febd97fa700 1 -- 172.21.15.73:0/3429851009 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe4099820 con 0x563879fd7360 2023-08-10T12:04:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.247+0000 7febfcd0ab80 1 -- 172.21.15.73:0/3429851009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563879fd7360 msgr2=0x563879fcbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.247+0000 7febfcd0ab80 1 --2- 172.21.15.73:0/3429851009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563879fd7360 0x563879fcbc30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7febe4096030 tx=0x7febe40093e0 comp rx=0 tx=0).stop 2023-08-10T12:04:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.247+0000 7febfcd0ab80 1 -- 172.21.15.73:0/3429851009 shutdown_connections 2023-08-10T12:04:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.247+0000 7febfcd0ab80 1 --2- 172.21.15.73:0/3429851009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563879fd7360 0x563879fcbc30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.247+0000 7febfcd0ab80 1 --2- 172.21.15.73:0/3429851009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563879fd1550 0x563879fd1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.247+0000 7febfcd0ab80 1 --2- 172.21.15.73:0/3429851009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563879fd6a40 0x563879fd6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.247+0000 7febfcd0ab80 1 -- 172.21.15.73:0/3429851009 >> 172.21.15.73:0/3429851009 conn(0x563879f2ec70 msgr2=0x563879fda730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:04:23.255 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.253+0000 7febfcd0ab80 1 -- 172.21.15.73:0/3429851009 shutdown_connections 2023-08-10T12:04:23.255 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.254+0000 7febfcd0ab80 1 -- 172.21.15.73:0/3429851009 wait complete. 2023-08-10T12:04:23.256 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.254+0000 7febfcd0ab80 1 -- start start 2023-08-10T12:04:23.256 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.254+0000 7febfcd0ab80 1 Processor -- start 2023-08-10T12:04:23.259 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.255+0000 7febfcd0ab80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563879fd1550 0x563879ff2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.255+0000 7febfcd0ab80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563879fd6a40 0x563879ff1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.255+0000 7febfcd0ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563879fd7360 0x563879ff1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.255+0000 7febfcd0ab80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563879ff1d50 con 0x563879fd1550 2023-08-10T12:04:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.255+0000 7febfcd0ab80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563879ff1ec0 con 0x563879fd6a40 2023-08-10T12:04:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.255+0000 7febfcd0ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56387a04f670 con 0x563879fd7360 2023-08-10T12:04:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.255+0000 7febfcd0ab80 10 client.0 _ll_register_callbacks cb 0x563879ebf620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:04:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.256+0000 7febe9d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563879fd6a40 0x563879ff1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.256+0000 7febe9d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563879fd6a40 0x563879ff1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:51548/0 (socket says 172.21.15.73:51548) 2023-08-10T12:04:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.256+0000 7febe9d9b700 1 -- 172.21.15.73:0/1008434361 learned_addr learned my addr 172.21.15.73:0/1008434361 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:04:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.256+0000 7febe9d9b700 1 -- 172.21.15.73:0/1008434361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563879fd7360 msgr2=0x563879ff1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.256+0000 7febe9d9b700 1 --2- 172.21.15.73:0/1008434361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563879fd7360 0x563879ff1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.256+0000 7febe9d9b700 1 -- 172.21.15.73:0/1008434361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563879fd1550 msgr2=0x563879ff2e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T12:04:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.256+0000 7febe9d9b700 1 --2- 172.21.15.73:0/1008434361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563879fd1550 0x563879ff2e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.256+0000 7febe9d9b700 1 -- 172.21.15.73:0/1008434361 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febec072ec0 con 0x563879fd6a40 2023-08-10T12:04:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.256+0000 7febe9d9b700 1 --2- 172.21.15.73:0/1008434361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563879fd6a40 0x563879ff1120 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7febdc00bf30 tx=0x7febdc00b720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c00b04d9a6ae08d9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:04:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.256+0000 7febd1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T12:04:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.257+0000 7febd1ffb700 1 -- 172.21.15.73:0/1008434361 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc01d040 con 0x563879fd6a40 2023-08-10T12:04:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.257+0000 7febd1ffb700 1 -- 172.21.15.73:0/1008434361 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8557+0+0 (secure 0 0 0) 0x7febdc02dac0 con 0x563879fd6a40 2023-08-10T12:04:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.257+0000 7febfcd0ab80 1 -- 172.21.15.73:0/1008434361 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7febdc003d30 con 0x563879fd6a40 2023-08-10T12:04:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.257+0000 7febd1ffb700 1 -- 172.21.15.73:0/1008434361 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7febdc02dc80 con 0x563879fd6a40 2023-08-10T12:04:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.257+0000 7febfcd0ab80 10 client.26495 fetch_fsmap learned FSMap version 55 2023-08-10T12:04:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.257+0000 7febfcd0ab80 1 -- 172.21.15.73:0/1008434361 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x563879d761f0 con 0x563879fd6a40 2023-08-10T12:04:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.258+0000 7febd1ffb700 1 -- 172.21.15.73:0/1008434361 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7febdc003d30 con 0x563879fd6a40 2023-08-10T12:04:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.261+0000 7febd1ffb700 1 -- 172.21.15.73:0/1008434361 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 55) v1 ==== 6997+0+0 (secure 0 0 0) 0x7febdc00f460 con 0x563879fd6a40 2023-08-10T12:04:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.261+0000 7febfcd0ab80 10 client.26495 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T12:04:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.261+0000 7febfcd0ab80 10 client.26495 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:04:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.261+0000 7febfcd0ab80 20 client.26495 populate_metadata read hostname 'smithi073' 2023-08-10T12:04:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.261+0000 7febfcd0ab80 1 --2- 172.21.15.73:0/1008434361 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563879fddc30 0x563879fe0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.261+0000 7febfcd0ab80 4 client.26495 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T12:04:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.261+0000 7febfcd0ab80 1 -- 172.21.15.73:0/1008434361 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563879f1b720 con 0x563879fddc30 2023-08-10T12:04:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.265+0000 7febea59c700 1 --2- 172.21.15.73:0/1008434361 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563879fddc30 0x563879fe0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.268+0000 7febd1ffb700 10 client.26495 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:04:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:23.268+0000 7febea59c700 1 --2- 172.21.15.73:0/1008434361 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563879fddc30 0x563879fe0050 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7ff1e9e9c6caed4 server_cookie=160f27c021b915c7 in_seq=0 out_seq=0 2023-08-10T12:04:23.499 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:23 smithi152 ceph-mon[130220]: pgmap v366: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 932 KiB/s wr, 136 op/s 2023-08-10T12:04:23.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:23 smithi156 ceph-mon[130574]: pgmap v366: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 932 KiB/s wr, 136 op/s 2023-08-10T12:04:23.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:23 smithi073 ceph-mon[128869]: pgmap v366: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 932 KiB/s wr, 136 op/s 2023-08-10T12:04:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:24.984+0000 7febd1ffb700 1 -- 172.21.15.73:0/1008434361 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563879f1b720 con 0x563879fddc30 2023-08-10T12:04:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:24.984+0000 7febd1ffb700 10 client.26495 handle_command_reply: tid=0 2023-08-10T12:04:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:24.984+0000 7febfcd0ab80 1 client.26495 shutdown 2023-08-10T12:04:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:24.984+0000 7febfcd0ab80 1 -- 172.21.15.73:0/1008434361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563879fd6a40 msgr2=0x563879ff1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:24.984+0000 7febfcd0ab80 1 --2- 172.21.15.73:0/1008434361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563879fd6a40 0x563879ff1120 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7febdc00bf30 tx=0x7febdc00b720 comp rx=0 tx=0).stop 2023-08-10T12:04:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:24.985+0000 7febfcd0ab80 1 -- 172.21.15.73:0/1008434361 shutdown_connections 2023-08-10T12:04:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:24.985+0000 7febfcd0ab80 1 --2- 172.21.15.73:0/1008434361 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x563879fddc30 0x563879fe0050 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:24.985+0000 7febfcd0ab80 1 --2- 172.21.15.73:0/1008434361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563879fd7360 0x563879ff1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:24.985+0000 7febfcd0ab80 1 --2- 172.21.15.73:0/1008434361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563879fd1550 0x563879ff2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:24.985+0000 7febfcd0ab80 1 --2- 172.21.15.73:0/1008434361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563879fd6a40 0x563879ff1120 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7febdc00bf30 tx=0x7febdc00b720 comp rx=0 tx=0).stop 2023-08-10T12:04:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:24.985+0000 7febfcd0ab80 1 -- 172.21.15.73:0/1008434361 >> 172.21.15.73:0/1008434361 conn(0x563879f2ec70 msgr2=0x563879fd7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:04:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:24.985+0000 7febd1ffb700 0 client.26495 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:04:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:24.987+0000 7febfcd0ab80 1 -- 172.21.15.73:0/1008434361 shutdown_connections 2023-08-10T12:04:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:24.987+0000 7febfcd0ab80 1 -- 172.21.15.73:0/1008434361 wait complete. 2023-08-10T12:04:24.992 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:24.990+0000 7febfcd0ab80 20 client.26495 trim_cache size 0 max 16384 2023-08-10T12:04:24.992 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T12:04:24.992 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T12:04:24.992 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T12:04:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T12:04:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:24.992+0000 7febf0b71700 1 -- 172.21.15.73:0/3017359694 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7febd40a5820 msgr2=0x7febd40a7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:24.992+0000 7febf0b71700 1 --2- 172.21.15.73:0/3017359694 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7febd40a5820 0x7febd40a7ce0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7febdc00b5c0 tx=0x7febdc005fd0 comp rx=0 tx=0).stop 2023-08-10T12:04:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:24.992+0000 7febf0b71700 1 -- 172.21.15.73:0/3017359694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febec1968b0 msgr2=0x7febec196d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:24.992+0000 7febf0b71700 1 --2- 172.21.15.73:0/3017359694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febec1968b0 0x7febec196d60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7febe4007f10 tx=0x7febe400d3b0 comp rx=0 tx=0).stop 2023-08-10T12:04:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:24.994+0000 7febf0b71700 1 -- 172.21.15.73:0/3017359694 shutdown_connections 2023-08-10T12:04:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:24.994+0000 7febf0b71700 1 --2- 172.21.15.73:0/3017359694 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7febd40a5820 0x7febd40a7ce0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:24.994+0000 7febf0b71700 1 --2- 172.21.15.73:0/3017359694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febec1006f0 0x7febec19ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:24.994+0000 7febf0b71700 1 --2- 172.21.15.73:0/3017359694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febec1968b0 0x7febec196d60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:24.994+0000 7febf0b71700 1 --2- 172.21.15.73:0/3017359694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febec1010b0 0x7febec19cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:24.994+0000 7febf0b71700 1 -- 172.21.15.73:0/3017359694 >> 172.21.15.73:0/3017359694 conn(0x7febec0fc220 msgr2=0x7febec0fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:04:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:24.994+0000 7febf0b71700 1 -- 172.21.15.73:0/3017359694 shutdown_connections 2023-08-10T12:04:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:24.995+0000 7febf0b71700 1 -- 172.21.15.73:0/3017359694 wait complete. 2023-08-10T12:04:25.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:25 smithi152 ceph-mon[130220]: pgmap v367: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 796 KiB/s wr, 99 op/s 2023-08-10T12:04:25.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:25 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:04:25.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:25 smithi156 ceph-mon[130574]: pgmap v367: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 796 KiB/s wr, 99 op/s 2023-08-10T12:04:25.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:25 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:04:25.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:25 smithi073 ceph-mon[128869]: pgmap v367: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 796 KiB/s wr, 99 op/s 2023-08-10T12:04:25.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:25 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:04:27.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:27 smithi152 ceph-mon[130220]: pgmap v368: 97 pgs: 37 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 40 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 173 op/s 2023-08-10T12:04:27.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:27 smithi156 ceph-mon[130574]: pgmap v368: 97 pgs: 37 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 40 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 173 op/s 2023-08-10T12:04:27.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:27 smithi073 ceph-mon[128869]: pgmap v368: 97 pgs: 37 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 40 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 173 op/s 2023-08-10T12:04:29.499 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:29 smithi152 ceph-mon[130220]: pgmap v369: 97 pgs: 37 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 40 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 722 KiB/s wr, 153 op/s 2023-08-10T12:04:29.508 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:29 smithi156 ceph-mon[130574]: pgmap v369: 97 pgs: 37 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 40 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 722 KiB/s wr, 153 op/s 2023-08-10T12:04:29.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:29 smithi073 ceph-mon[128869]: pgmap v369: 97 pgs: 37 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 40 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 722 KiB/s wr, 153 op/s 2023-08-10T12:04:31.508 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:31 smithi156 ceph-mon[130574]: pgmap v370: 97 pgs: 37 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 41 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 818 KiB/s wr, 171 op/s 2023-08-10T12:04:31.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:31 smithi073 ceph-mon[128869]: pgmap v370: 97 pgs: 37 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 41 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 818 KiB/s wr, 171 op/s 2023-08-10T12:04:31.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:31 smithi152 ceph-mon[130220]: pgmap v370: 97 pgs: 37 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 41 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 818 KiB/s wr, 171 op/s 2023-08-10T12:04:33.508 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:33 smithi156 ceph-mon[130574]: pgmap v371: 97 pgs: 33 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 48 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 185 op/s 2023-08-10T12:04:33.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:33 smithi073 ceph-mon[128869]: pgmap v371: 97 pgs: 33 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 48 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 185 op/s 2023-08-10T12:04:33.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:33 smithi152 ceph-mon[130220]: pgmap v371: 97 pgs: 33 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 48 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 185 op/s 2023-08-10T12:04:35.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:34 smithi152 ceph-mon[130220]: pgmap v372: 97 pgs: 33 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 48 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 756 KiB/s wr, 170 op/s 2023-08-10T12:04:35.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:34 smithi156 ceph-mon[130574]: pgmap v372: 97 pgs: 33 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 48 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 756 KiB/s wr, 170 op/s 2023-08-10T12:04:35.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:34 smithi073 ceph-mon[128869]: pgmap v372: 97 pgs: 33 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 48 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 756 KiB/s wr, 170 op/s 2023-08-10T12:04:37.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:37 smithi152 ceph-mon[130220]: pgmap v373: 97 pgs: 26 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 59 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 201 op/s 2023-08-10T12:04:37.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:37 smithi156 ceph-mon[130574]: pgmap v373: 97 pgs: 26 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 59 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 201 op/s 2023-08-10T12:04:37.522 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:37 smithi073 ceph-mon[128869]: pgmap v373: 97 pgs: 26 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 59 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 201 op/s 2023-08-10T12:04:38.164 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.162+0000 7ff5f6fd5700 1 -- 172.21.15.73:0/378167563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5f00ff9a0 msgr2=0x7ff5f01039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:38.203 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.162+0000 7ff5f6fd5700 1 --2- 172.21.15.73:0/378167563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5f00ff9a0 0x7ff5f01039e0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff5e400aaa0 tx=0x7ff5e400adb0 comp rx=0 tx=0).stop 2023-08-10T12:04:38.203 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.162+0000 7ff5f6fd5700 1 -- 172.21.15.73:0/378167563 shutdown_connections 2023-08-10T12:04:38.203 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.162+0000 7ff5f6fd5700 1 --2- 172.21.15.73:0/378167563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5f00feff0 0x7ff5f00ff3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:38.203 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.162+0000 7ff5f6fd5700 1 --2- 172.21.15.73:0/378167563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5f0104110 0x7ff5f010bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:38.204 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.162+0000 7ff5f6fd5700 1 --2- 172.21.15.73:0/378167563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5f00ff9a0 0x7ff5f01039e0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:38.204 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.162+0000 7ff5f6fd5700 1 -- 172.21.15.73:0/378167563 >> 172.21.15.73:0/378167563 conn(0x7ff5f0076b40 msgr2=0x7ff5f00fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:04:38.204 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.162+0000 7ff5f6fd5700 1 -- 172.21.15.73:0/378167563 shutdown_connections 2023-08-10T12:04:38.204 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.162+0000 7ff5f6fd5700 1 -- 172.21.15.73:0/378167563 wait complete. 2023-08-10T12:04:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.163+0000 7ff5f6fd5700 1 Processor -- start 2023-08-10T12:04:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.163+0000 7ff5f6fd5700 1 -- start start 2023-08-10T12:04:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.163+0000 7ff5f6fd5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5f00feff0 0x7ff5f0105f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.163+0000 7ff5f6fd5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5f0104110 0x7ff5f0106450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.163+0000 7ff5f6fd5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5f01a2a80 0x7ff5f01a4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.163+0000 7ff5f6fd5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f01a53b0 con 0x7ff5f00feff0 2023-08-10T12:04:38.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.163+0000 7ff5f6fd5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f01a54f0 con 0x7ff5f01a2a80 2023-08-10T12:04:38.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.163+0000 7ff5f6fd5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f01a5660 con 0x7ff5f0104110 2023-08-10T12:04:38.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.164+0000 7ff5f4d71700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5f00feff0 0x7ff5f0105f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:38.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.164+0000 7ff5f4d71700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5f00feff0 0x7ff5f0105f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36910/0 (socket says 172.21.15.73:36910) 2023-08-10T12:04:38.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.164+0000 7ff5effff700 1 --2- 172.21.15.73:0/1563952866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5f0104110 0x7ff5f0106450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:38.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.164+0000 7ff5f4d71700 1 -- 172.21.15.73:0/1563952866 learned_addr learned my addr 172.21.15.73:0/1563952866 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:04:38.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.164+0000 7ff5f5572700 1 --2- 172.21.15.73:0/1563952866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5f01a2a80 0x7ff5f01a4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:38.210 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.164+0000 7ff5f4d71700 1 -- 172.21.15.73:0/1563952866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5f0104110 msgr2=0x7ff5f0106450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:38.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.164+0000 7ff5f4d71700 1 --2- 172.21.15.73:0/1563952866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5f0104110 0x7ff5f0106450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:38.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.164+0000 7ff5f4d71700 1 -- 172.21.15.73:0/1563952866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5f01a2a80 msgr2=0x7ff5f01a4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:38.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.164+0000 7ff5f4d71700 1 --2- 172.21.15.73:0/1563952866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5f01a2a80 0x7ff5f01a4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:38.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.164+0000 7ff5f4d71700 1 -- 172.21.15.73:0/1563952866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e400a700 con 0x7ff5f00feff0 2023-08-10T12:04:38.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.164+0000 7ff5f4d71700 1 --2- 172.21.15.73:0/1563952866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5f00feff0 0x7ff5f0105f10 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc00e9a0 tx=0x7ff5dc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:04:38.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.164+0000 7ff5edffb700 1 -- 172.21.15.73:0/1563952866 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc009790 con 0x7ff5f00feff0 2023-08-10T12:04:38.211 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.165+0000 7ff5f6fd5700 1 -- 172.21.15.73:0/1563952866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f01a5940 con 0x7ff5f00feff0 2023-08-10T12:04:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.165+0000 7ff5edffb700 1 -- 172.21.15.73:0/1563952866 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5dc010430 con 0x7ff5f00feff0 2023-08-10T12:04:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.165+0000 7ff5edffb700 1 -- 172.21.15.73:0/1563952866 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc018680 con 0x7ff5f00feff0 2023-08-10T12:04:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.165+0000 7ff5f6fd5700 1 -- 172.21.15.73:0/1563952866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f01a5e50 con 0x7ff5f00feff0 2023-08-10T12:04:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.167+0000 7ff5edffb700 1 -- 172.21.15.73:0/1563952866 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7ff5dc0105a0 con 0x7ff5f00feff0 2023-08-10T12:04:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.168+0000 7ff5edffb700 1 --2- 172.21.15.73:0/1563952866 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ff5e00a12c0 0x7ff5e00a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.168+0000 7ff5edffb700 1 -- 172.21.15.73:0/1563952866 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8557+0+0 (secure 0 0 0) 0x7ff5dc014070 con 0x7ff5f00feff0 2023-08-10T12:04:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.168+0000 7ff5effff700 1 --2- 172.21.15.73:0/1563952866 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ff5e00a12c0 0x7ff5e00a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.169+0000 7ff5effff700 1 --2- 172.21.15.73:0/1563952866 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ff5e00a12c0 0x7ff5e00a3780 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0107730 tx=0x7ff5e400c650 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:04:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.169+0000 7ff60316eb80 1 Processor -- start 2023-08-10T12:04:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.170+0000 7ff60316eb80 1 -- start start 2023-08-10T12:04:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.170+0000 7ff60316eb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fd5afba40 0x561fd5afbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.170+0000 7ff60316eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd5afc360 0x561fd5af6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.170+0000 7ff60316eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fd5af6550 0x561fd5af69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.170+0000 7ff60316eb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd5a71d60 con 0x561fd5afba40 2023-08-10T12:04:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.170+0000 7ff60316eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd5a4e530 con 0x561fd5af6550 2023-08-10T12:04:38.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.170+0000 7ff60316eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd5a4be50 con 0x561fd5afc360 2023-08-10T12:04:38.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.171+0000 7ff5f5572700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fd5af6550 0x561fd5af69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:38.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.171+0000 7ff5f5572700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fd5af6550 0x561fd5af69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:51568/0 (socket says 172.21.15.73:51568) 2023-08-10T12:04:38.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.171+0000 7ff5f5572700 1 -- 172.21.15.73:0/3186798720 learned_addr learned my addr 172.21.15.73:0/3186798720 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:04:38.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.171+0000 7ff5effff700 1 --2- 172.21.15.73:0/3186798720 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd5afc360 0x561fd5af6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:38.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.171+0000 7ff5f5572700 1 -- 172.21.15.73:0/3186798720 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd5afc360 msgr2=0x561fd5af6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:38.214 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.171+0000 7ff5f5572700 1 --2- 172.21.15.73:0/3186798720 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd5afc360 0x561fd5af6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:38.215 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.171+0000 7ff5f5572700 1 -- 172.21.15.73:0/3186798720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fd5afba40 msgr2=0x561fd5afbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:38.215 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.171+0000 7ff5f5572700 1 --2- 172.21.15.73:0/3186798720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fd5afba40 0x561fd5afbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:38.215 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.171+0000 7ff5f5572700 1 -- 172.21.15.73:0/3186798720 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fd58c85d0 con 0x561fd5af6550 2023-08-10T12:04:38.215 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.171+0000 7ff5f5572700 1 --2- 172.21.15.73:0/3186798720 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fd5af6550 0x561fd5af69d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8011680 tx=0x7ff5e8009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c971cd4176f1388e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:04:38.215 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.172+0000 7ff5daffd700 1 -- 172.21.15.73:0/3186798720 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e800e040 con 0x561fd5af6550 2023-08-10T12:04:38.215 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.172+0000 7ff5daffd700 1 -- 172.21.15.73:0/3186798720 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5e800f040 con 0x561fd5af6550 2023-08-10T12:04:38.215 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.172+0000 7ff5daffd700 1 -- 172.21.15.73:0/3186798720 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e80048c0 con 0x561fd5af6550 2023-08-10T12:04:38.215 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.173+0000 7ff60316eb80 1 -- 172.21.15.73:0/3186798720 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fd5af6550 msgr2=0x561fd5af69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:38.216 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.173+0000 7ff60316eb80 1 --2- 172.21.15.73:0/3186798720 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fd5af6550 0x561fd5af69d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8011680 tx=0x7ff5e8009920 comp rx=0 tx=0).stop 2023-08-10T12:04:38.216 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.174+0000 7ff60316eb80 1 -- 172.21.15.73:0/3186798720 shutdown_connections 2023-08-10T12:04:38.216 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.174+0000 7ff60316eb80 1 --2- 172.21.15.73:0/3186798720 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fd5af6550 0x561fd5af69d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:38.216 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.174+0000 7ff60316eb80 1 --2- 172.21.15.73:0/3186798720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fd5afba40 0x561fd5afbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:38.216 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.174+0000 7ff60316eb80 1 --2- 172.21.15.73:0/3186798720 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd5afc360 0x561fd5af6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:38.216 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.174+0000 7ff60316eb80 1 -- 172.21.15.73:0/3186798720 >> 172.21.15.73:0/3186798720 conn(0x561fd5a53c70 msgr2=0x561fd5af0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:04:38.216 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.175+0000 7ff60316eb80 1 -- 172.21.15.73:0/3186798720 shutdown_connections 2023-08-10T12:04:38.217 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.175+0000 7ff60316eb80 1 -- 172.21.15.73:0/3186798720 wait complete. 2023-08-10T12:04:38.217 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.175+0000 7ff60316eb80 1 -- start start 2023-08-10T12:04:38.217 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.175+0000 7ff60316eb80 1 Processor -- start 2023-08-10T12:04:38.217 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.176+0000 7ff60316eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fd5af6550 0x561fd5aff700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:38.217 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.176+0000 7ff60316eb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fd5afba40 0x561fd5affc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:38.217 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.176+0000 7ff60316eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd5afc360 0x561fd5b00180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:38.217 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.176+0000 7ff60316eb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd5a47740 con 0x561fd5afba40 2023-08-10T12:04:38.217 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.176+0000 7ff60316eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd59e6a60 con 0x561fd5af6550 2023-08-10T12:04:38.218 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.176+0000 7ff60316eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd59e6760 con 0x561fd5afc360 2023-08-10T12:04:38.218 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.176+0000 7ff60316eb80 10 client.0 _ll_register_callbacks cb 0x561fd59e4620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:04:38.218 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.176+0000 7ff5effff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fd5afba40 0x561fd5affc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:38.218 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.176+0000 7ff5effff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fd5afba40 0x561fd5affc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36926/0 (socket says 172.21.15.73:36926) 2023-08-10T12:04:38.218 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.176+0000 7ff5effff700 1 -- 172.21.15.73:0/2282104128 learned_addr learned my addr 172.21.15.73:0/2282104128 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:04:38.218 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.177+0000 7ff5effff700 1 -- 172.21.15.73:0/2282104128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd5afc360 msgr2=0x561fd5b00180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:38.218 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.177+0000 7ff5effff700 1 --2- 172.21.15.73:0/2282104128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd5afc360 0x561fd5b00180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:38.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.177+0000 7ff5effff700 1 -- 172.21.15.73:0/2282104128 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fd5af6550 msgr2=0x561fd5aff700 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T12:04:38.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.177+0000 7ff5effff700 1 --2- 172.21.15.73:0/2282104128 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fd5af6550 0x561fd5aff700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:38.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.177+0000 7ff5effff700 1 -- 172.21.15.73:0/2282104128 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e8011330 con 0x561fd5afba40 2023-08-10T12:04:38.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.177+0000 7ff5effff700 1 --2- 172.21.15.73:0/2282104128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fd5afba40 0x561fd5affc40 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0072e60 tx=0x7ff5e400a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac25e96829686dd5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:04:38.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.177+0000 7ff5cffff700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:04:38.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.177+0000 7ff5cffff700 1 -- 172.21.15.73:0/2282104128 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4021710 con 0x561fd5afba40 2023-08-10T12:04:38.219 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.177+0000 7ff5cffff700 1 -- 172.21.15.73:0/2282104128 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8557+0+0 (secure 0 0 0) 0x7ff5e4012070 con 0x561fd5afba40 2023-08-10T12:04:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.177+0000 7ff60316eb80 1 -- 172.21.15.73:0/2282104128 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561fd5ae91c0 con 0x561fd5afba40 2023-08-10T12:04:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.178+0000 7ff5cffff700 1 -- 172.21.15.73:0/2282104128 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5e4021870 con 0x561fd5afba40 2023-08-10T12:04:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.178+0000 7ff60316eb80 10 client.17094 fetch_fsmap learned FSMap version 56 2023-08-10T12:04:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.178+0000 7ff60316eb80 1 -- 172.21.15.73:0/2282104128 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x561fd5874d80 con 0x561fd5afba40 2023-08-10T12:04:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.178+0000 7ff5cffff700 1 -- 172.21.15.73:0/2282104128 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561fd5ae91c0 con 0x561fd5afba40 2023-08-10T12:04:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.178+0000 7ff5cffff700 1 -- 172.21.15.73:0/2282104128 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 56) v1 ==== 6989+0+0 (secure 0 0 0) 0x7ff5e400eab0 con 0x561fd5afba40 2023-08-10T12:04:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.178+0000 7ff60316eb80 10 client.17094 fetch_fsmap finished waiting for FSMap version 56 2023-08-10T12:04:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.178+0000 7ff60316eb80 10 client.17094 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:04:38.221 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.178+0000 7ff60316eb80 20 client.17094 populate_metadata read hostname 'smithi073' 2023-08-10T12:04:38.221 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.178+0000 7ff60316eb80 1 --2- 172.21.15.73:0/2282104128 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561fd5b18640 0x561fd5b1aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:38.221 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.178+0000 7ff60316eb80 4 client.17094 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:04:38.221 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.178+0000 7ff60316eb80 1 -- 172.21.15.73:0/2282104128 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561fd5ac5970 con 0x561fd5b18640 2023-08-10T12:04:38.221 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.178+0000 7ff5f4d71700 1 --2- 172.21.15.73:0/2282104128 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561fd5b18640 0x561fd5b1aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:38.221 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.179+0000 7ff5cffff700 10 client.17094 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:04:38.221 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.179+0000 7ff5f4d71700 1 --2- 172.21.15.73:0/2282104128 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561fd5b18640 0x561fd5b1aa60 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d0977dfbd15acc8 server_cookie=52b5e9c9ff394dd4 in_seq=0 out_seq=0 2023-08-10T12:04:38.221 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.180+0000 7ff5cffff700 1 -- 172.21.15.73:0/2282104128 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x561fd5ac5970 con 0x561fd5b18640 2023-08-10T12:04:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.180+0000 7ff5cffff700 10 client.17094 handle_command_reply: tid=0 2023-08-10T12:04:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.180+0000 7ff60316eb80 1 client.17094 shutdown 2023-08-10T12:04:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.181+0000 7ff60316eb80 1 -- 172.21.15.73:0/2282104128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fd5afba40 msgr2=0x561fd5affc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.181+0000 7ff60316eb80 1 --2- 172.21.15.73:0/2282104128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fd5afba40 0x561fd5affc40 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0072e60 tx=0x7ff5e400a420 comp rx=0 tx=0).stop 2023-08-10T12:04:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.181+0000 7ff60316eb80 1 -- 172.21.15.73:0/2282104128 shutdown_connections 2023-08-10T12:04:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.181+0000 7ff60316eb80 1 --2- 172.21.15.73:0/2282104128 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561fd5b18640 0x561fd5b1aa60 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.181+0000 7ff60316eb80 1 --2- 172.21.15.73:0/2282104128 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fd5af6550 0x561fd5aff700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:38.223 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.181+0000 7ff5cffff700 0 client.17094 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:04:38.223 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.181+0000 7ff60316eb80 1 --2- 172.21.15.73:0/2282104128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd5afc360 0x561fd5b00180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:38.223 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.181+0000 7ff60316eb80 1 --2- 172.21.15.73:0/2282104128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fd5afba40 0x561fd5affc40 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:38.223 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.181+0000 7ff60316eb80 1 -- 172.21.15.73:0/2282104128 >> 172.21.15.73:0/2282104128 conn(0x561fd5a53c70 msgr2=0x561fd5af04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:04:38.223 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.181+0000 7ff60316eb80 1 -- 172.21.15.73:0/2282104128 shutdown_connections 2023-08-10T12:04:38.223 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.181+0000 7ff60316eb80 1 -- 172.21.15.73:0/2282104128 wait complete. 2023-08-10T12:04:38.223 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.182+0000 7ff60316eb80 20 client.17094 trim_cache size 0 max 16384 2023-08-10T12:04:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.203+0000 7ff60316eb80 1 Processor -- start 2023-08-10T12:04:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.204+0000 7ff60316eb80 1 -- start start 2023-08-10T12:04:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.204+0000 7ff60316eb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fd5af6550 0x561fd5af6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.204+0000 7ff60316eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fd5afc360 0x561fd5b06e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.204+0000 7ff60316eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd5b01fb0 0x561fd5afaf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.204+0000 7ff60316eb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd58ca8c0 con 0x561fd5af6550 2023-08-10T12:04:38.226 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.204+0000 7ff60316eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd5afb6c0 con 0x561fd5afc360 2023-08-10T12:04:38.227 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.204+0000 7ff60316eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd5af9450 con 0x561fd5b01fb0 2023-08-10T12:04:38.227 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.204+0000 7ff5f4d71700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fd5af6550 0x561fd5af6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:38.227 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.204+0000 7ff5f4d71700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fd5af6550 0x561fd5af6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36932/0 (socket says 172.21.15.73:36932) 2023-08-10T12:04:38.227 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.204+0000 7ff5f4d71700 1 -- 172.21.15.73:0/3025470978 learned_addr learned my addr 172.21.15.73:0/3025470978 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:04:38.227 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.204+0000 7ff5f5572700 1 --2- 172.21.15.73:0/3025470978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd5b01fb0 0x561fd5afaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:38.227 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.204+0000 7ff5f4d71700 1 -- 172.21.15.73:0/3025470978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd5b01fb0 msgr2=0x561fd5afaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:38.227 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.204+0000 7ff5f4d71700 1 --2- 172.21.15.73:0/3025470978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd5b01fb0 0x561fd5afaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:38.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.204+0000 7ff5f4d71700 1 -- 172.21.15.73:0/3025470978 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fd5afc360 msgr2=0x561fd5b06e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T12:04:38.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.204+0000 7ff5f4d71700 1 --2- 172.21.15.73:0/3025470978 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fd5afc360 0x561fd5b06e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:38.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.204+0000 7ff5f4d71700 1 -- 172.21.15.73:0/3025470978 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fd585dc00 con 0x561fd5af6550 2023-08-10T12:04:38.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.205+0000 7ff5f4d71700 1 --2- 172.21.15.73:0/3025470978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fd5af6550 0x561fd5af6010 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc00e970 tx=0x7ff5dc010b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db272a39e3f1540d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:04:38.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.210+0000 7ff5db7fe700 1 -- 172.21.15.73:0/3025470978 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc0a23f0 con 0x561fd5af6550 2023-08-10T12:04:38.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.210+0000 7ff5db7fe700 1 -- 172.21.15.73:0/3025470978 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5dc098340 con 0x561fd5af6550 2023-08-10T12:04:38.228 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.210+0000 7ff5db7fe700 1 -- 172.21.15.73:0/3025470978 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc0996f0 con 0x561fd5af6550 2023-08-10T12:04:38.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.211+0000 7ff60316eb80 1 -- 172.21.15.73:0/3025470978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fd5af6550 msgr2=0x561fd5af6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:38.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.211+0000 7ff60316eb80 1 --2- 172.21.15.73:0/3025470978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fd5af6550 0x561fd5af6010 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc00e970 tx=0x7ff5dc010b80 comp rx=0 tx=0).stop 2023-08-10T12:04:38.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.211+0000 7ff60316eb80 1 -- 172.21.15.73:0/3025470978 shutdown_connections 2023-08-10T12:04:38.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.211+0000 7ff60316eb80 1 --2- 172.21.15.73:0/3025470978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd5b01fb0 0x561fd5afaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:38.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.211+0000 7ff60316eb80 1 --2- 172.21.15.73:0/3025470978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fd5af6550 0x561fd5af6010 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:38.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.211+0000 7ff60316eb80 1 --2- 172.21.15.73:0/3025470978 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fd5afc360 0x561fd5b06e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:38.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.211+0000 7ff60316eb80 1 -- 172.21.15.73:0/3025470978 >> 172.21.15.73:0/3025470978 conn(0x561fd5a53c70 msgr2=0x561fd5afa880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:04:38.229 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.212+0000 7ff60316eb80 1 -- 172.21.15.73:0/3025470978 shutdown_connections 2023-08-10T12:04:38.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.212+0000 7ff60316eb80 1 -- 172.21.15.73:0/3025470978 wait complete. 2023-08-10T12:04:38.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.212+0000 7ff60316eb80 1 -- start start 2023-08-10T12:04:38.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.212+0000 7ff60316eb80 1 Processor -- start 2023-08-10T12:04:38.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.213+0000 7ff60316eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd5af6550 0x561fd5b06e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:38.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.213+0000 7ff60316eb80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fd5afc360 0x561fd5b644a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:38.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.213+0000 7ff60316eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fd5b01fb0 0x561fd5b64be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:38.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.213+0000 7ff60316eb80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd5b652b0 con 0x561fd5afc360 2023-08-10T12:04:38.230 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.213+0000 7ff60316eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd5b134d0 con 0x561fd5b01fb0 2023-08-10T12:04:38.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.213+0000 7ff60316eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd5b13690 con 0x561fd5af6550 2023-08-10T12:04:38.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.213+0000 7ff60316eb80 10 client.0 _ll_register_callbacks cb 0x561fd59e4620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:04:38.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.213+0000 7ff5f5572700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fd5b01fb0 0x561fd5b64be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:38.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.213+0000 7ff5f5572700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fd5b01fb0 0x561fd5b64be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:51586/0 (socket says 172.21.15.73:51586) 2023-08-10T12:04:38.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.213+0000 7ff5f5572700 1 -- 172.21.15.73:0/1170244963 learned_addr learned my addr 172.21.15.73:0/1170244963 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:04:38.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.213+0000 7ff5f4d71700 1 --2- 172.21.15.73:0/1170244963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd5af6550 0x561fd5b06e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:38.231 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.213+0000 7ff5f5572700 1 -- 172.21.15.73:0/1170244963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd5af6550 msgr2=0x561fd5b06e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:38.232 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.213+0000 7ff5f5572700 1 --2- 172.21.15.73:0/1170244963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd5af6550 0x561fd5b06e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:38.232 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.214+0000 7ff5f5572700 1 -- 172.21.15.73:0/1170244963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fd5afc360 msgr2=0x561fd5b644a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T12:04:38.232 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.214+0000 7ff5f5572700 1 --2- 172.21.15.73:0/1170244963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fd5afc360 0x561fd5b644a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:38.232 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.214+0000 7ff5f5572700 1 -- 172.21.15.73:0/1170244963 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f01a5e50 con 0x561fd5b01fb0 2023-08-10T12:04:38.232 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.214+0000 7ff5f5572700 1 --2- 172.21.15.73:0/1170244963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fd5b01fb0 0x561fd5b64be0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8011680 tx=0x7ff5e8009510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d43de22304c4a55 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:04:38.232 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.214+0000 7ff5cffff700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T12:04:38.232 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.214+0000 7ff5cffff700 1 -- 172.21.15.73:0/1170244963 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e800e040 con 0x561fd5b01fb0 2023-08-10T12:04:38.232 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.214+0000 7ff5cffff700 1 -- 172.21.15.73:0/1170244963 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8557+0+0 (secure 0 0 0) 0x7ff5e8007710 con 0x561fd5b01fb0 2023-08-10T12:04:38.233 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.214+0000 7ff60316eb80 1 -- 172.21.15.73:0/1170244963 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff5e800f040 con 0x561fd5b01fb0 2023-08-10T12:04:38.233 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.214+0000 7ff5cffff700 1 -- 172.21.15.73:0/1170244963 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5e80078d0 con 0x561fd5b01fb0 2023-08-10T12:04:38.233 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.214+0000 7ff60316eb80 10 client.26507 fetch_fsmap learned FSMap version 56 2023-08-10T12:04:38.233 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.214+0000 7ff60316eb80 1 -- 172.21.15.73:0/1170244963 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x561fd589b1f0 con 0x561fd5b01fb0 2023-08-10T12:04:38.233 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.215+0000 7ff5cffff700 1 -- 172.21.15.73:0/1170244963 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5e800f040 con 0x561fd5b01fb0 2023-08-10T12:04:38.233 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.215+0000 7ff5cffff700 1 -- 172.21.15.73:0/1170244963 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 56) v1 ==== 6989+0+0 (secure 0 0 0) 0x7ff5e8005880 con 0x561fd5b01fb0 2023-08-10T12:04:38.233 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.215+0000 7ff60316eb80 10 client.26507 fetch_fsmap finished waiting for FSMap version 56 2023-08-10T12:04:38.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.215+0000 7ff60316eb80 10 client.26507 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:04:38.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.215+0000 7ff60316eb80 20 client.26507 populate_metadata read hostname 'smithi073' 2023-08-10T12:04:38.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.215+0000 7ff60316eb80 1 --2- 172.21.15.73:0/1170244963 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561fd5b14c90 0x561fd5b150a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:38.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.215+0000 7ff60316eb80 4 client.26507 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T12:04:38.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.215+0000 7ff60316eb80 1 -- 172.21.15.73:0/1170244963 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561fd5a40720 con 0x561fd5b14c90 2023-08-10T12:04:38.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.215+0000 7ff5f4d71700 1 --2- 172.21.15.73:0/1170244963 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561fd5b14c90 0x561fd5b150a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:38.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.216+0000 7ff5cffff700 10 client.26507 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:04:38.234 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:38.216+0000 7ff5f4d71700 1 --2- 172.21.15.73:0/1170244963 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561fd5b14c90 0x561fd5b150a0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6208f4de6be60ef9 server_cookie=749b5d06b58538e1 in_seq=0 out_seq=0 2023-08-10T12:04:39.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:39 smithi152 ceph-mon[130220]: pgmap v374: 97 pgs: 22 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 64 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 820 KiB/s wr, 130 op/s 2023-08-10T12:04:39.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:39 smithi156 ceph-mon[130574]: pgmap v374: 97 pgs: 22 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 64 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 820 KiB/s wr, 130 op/s 2023-08-10T12:04:39.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:39 smithi073 ceph-mon[128869]: pgmap v374: 97 pgs: 22 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 64 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 820 KiB/s wr, 130 op/s 2023-08-10T12:04:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:39.617+0000 7ff5cffff700 1 -- 172.21.15.73:0/1170244963 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561fd5a40720 con 0x561fd5b14c90 2023-08-10T12:04:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:39.617+0000 7ff5cffff700 10 client.26507 handle_command_reply: tid=0 2023-08-10T12:04:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:39.617+0000 7ff60316eb80 1 client.26507 shutdown 2023-08-10T12:04:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:39.618+0000 7ff60316eb80 1 -- 172.21.15.73:0/1170244963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fd5b01fb0 msgr2=0x561fd5b64be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:39.618+0000 7ff60316eb80 1 --2- 172.21.15.73:0/1170244963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fd5b01fb0 0x561fd5b64be0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8011680 tx=0x7ff5e8009510 comp rx=0 tx=0).stop 2023-08-10T12:04:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:39.618+0000 7ff60316eb80 1 -- 172.21.15.73:0/1170244963 shutdown_connections 2023-08-10T12:04:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:39.618+0000 7ff60316eb80 1 --2- 172.21.15.73:0/1170244963 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561fd5b14c90 0x561fd5b150a0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:39.618+0000 7ff60316eb80 1 --2- 172.21.15.73:0/1170244963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561fd5b01fb0 0x561fd5b64be0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:39.618+0000 7ff60316eb80 1 --2- 172.21.15.73:0/1170244963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd5af6550 0x561fd5b06e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:39.618+0000 7ff60316eb80 1 --2- 172.21.15.73:0/1170244963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561fd5afc360 0x561fd5b644a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:39.618+0000 7ff60316eb80 1 -- 172.21.15.73:0/1170244963 >> 172.21.15.73:0/1170244963 conn(0x561fd5a53c70 msgr2=0x561fd5afc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:04:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:39.618+0000 7ff5cffff700 0 client.26507 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:04:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:39.618+0000 7ff60316eb80 1 -- 172.21.15.73:0/1170244963 shutdown_connections 2023-08-10T12:04:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:39.618+0000 7ff60316eb80 1 -- 172.21.15.73:0/1170244963 wait complete. 2023-08-10T12:04:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:39.618+0000 7ff60316eb80 20 client.26507 trim_cache size 0 max 16384 2023-08-10T12:04:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T12:04:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T12:04:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T12:04:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T12:04:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:39.620+0000 7ff5f6fd5700 1 -- 172.21.15.73:0/1563952866 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ff5e00a12c0 msgr2=0x7ff5e00a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:39.620+0000 7ff5f6fd5700 1 --2- 172.21.15.73:0/1563952866 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ff5e00a12c0 0x7ff5e00a3780 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0107730 tx=0x7ff5e400c650 comp rx=0 tx=0).stop 2023-08-10T12:04:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:39.620+0000 7ff5f6fd5700 1 -- 172.21.15.73:0/1563952866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5f00feff0 msgr2=0x7ff5f0105f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:39.620+0000 7ff5f6fd5700 1 --2- 172.21.15.73:0/1563952866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5f00feff0 0x7ff5f0105f10 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc00e9a0 tx=0x7ff5dc00ecb0 comp rx=0 tx=0).stop 2023-08-10T12:04:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:39.621+0000 7ff5f6fd5700 1 -- 172.21.15.73:0/1563952866 shutdown_connections 2023-08-10T12:04:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:39.621+0000 7ff5f6fd5700 1 --2- 172.21.15.73:0/1563952866 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7ff5e00a12c0 0x7ff5e00a3780 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:39.621+0000 7ff5f6fd5700 1 --2- 172.21.15.73:0/1563952866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5f01a2a80 0x7ff5f01a4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:39.621+0000 7ff5f6fd5700 1 --2- 172.21.15.73:0/1563952866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5f00feff0 0x7ff5f0105f10 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:39.621+0000 7ff5f6fd5700 1 --2- 172.21.15.73:0/1563952866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5f0104110 0x7ff5f0106450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:39.621+0000 7ff5f6fd5700 1 -- 172.21.15.73:0/1563952866 >> 172.21.15.73:0/1563952866 conn(0x7ff5f0076b40 msgr2=0x7ff5f01028c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:04:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:39.621+0000 7ff5f6fd5700 1 -- 172.21.15.73:0/1563952866 shutdown_connections 2023-08-10T12:04:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:39.621+0000 7ff5f6fd5700 1 -- 172.21.15.73:0/1563952866 wait complete. 2023-08-10T12:04:41.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:41 smithi152 ceph-mon[130220]: pgmap v375: 97 pgs: 11 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 78 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 824 KiB/s wr, 152 op/s 2023-08-10T12:04:41.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:41 smithi156 ceph-mon[130574]: pgmap v375: 97 pgs: 11 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 78 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 824 KiB/s wr, 152 op/s 2023-08-10T12:04:41.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:41 smithi073 ceph-mon[128869]: pgmap v375: 97 pgs: 11 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 78 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 824 KiB/s wr, 152 op/s 2023-08-10T12:04:43.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:43 smithi152 ceph-mon[130220]: pgmap v376: 97 pgs: 6 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 87 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 205 op/s 2023-08-10T12:04:43.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:43 smithi156 ceph-mon[130574]: pgmap v376: 97 pgs: 6 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 87 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 205 op/s 2023-08-10T12:04:43.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:43 smithi073 ceph-mon[128869]: pgmap v376: 97 pgs: 6 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 87 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 205 op/s 2023-08-10T12:04:45.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:44 smithi152 ceph-mon[130220]: pgmap v377: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 949 KiB/s wr, 191 op/s 2023-08-10T12:04:45.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:44 smithi156 ceph-mon[130574]: pgmap v377: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 949 KiB/s wr, 191 op/s 2023-08-10T12:04:45.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:44 smithi073 ceph-mon[128869]: pgmap v377: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 949 KiB/s wr, 191 op/s 2023-08-10T12:04:47.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:47 smithi152 ceph-mon[130220]: pgmap v378: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 263 op/s 2023-08-10T12:04:47.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:47 smithi156 ceph-mon[130574]: pgmap v378: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 263 op/s 2023-08-10T12:04:47.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:47 smithi073 ceph-mon[128869]: pgmap v378: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 263 op/s 2023-08-10T12:04:49.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:49 smithi152 ceph-mon[130220]: pgmap v379: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 236 op/s 2023-08-10T12:04:49.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:49 smithi152 ceph-mon[130220]: osdmap e98: 12 total, 12 up, 12 in 2023-08-10T12:04:49.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:49 smithi156 ceph-mon[130574]: pgmap v379: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 236 op/s 2023-08-10T12:04:49.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:49 smithi156 ceph-mon[130574]: osdmap e98: 12 total, 12 up, 12 in 2023-08-10T12:04:49.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:49 smithi073 ceph-mon[128869]: pgmap v379: 97 pgs: 97 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 236 op/s 2023-08-10T12:04:49.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:49 smithi073 ceph-mon[128869]: osdmap e98: 12 total, 12 up, 12 in 2023-08-10T12:04:50.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:50 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:04:50.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:50 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:04:50.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:50 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:04:51.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:51 smithi152 ceph-mon[130220]: pgmap v381: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 296 op/s 2023-08-10T12:04:51.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:51 smithi156 ceph-mon[130574]: pgmap v381: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 296 op/s 2023-08-10T12:04:51.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:51 smithi073 ceph-mon[128869]: pgmap v381: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 296 op/s 2023-08-10T12:04:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.736+0000 7fa7d9e99700 1 -- 172.21.15.73:0/2119186080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7d41006f0 msgr2=0x7fa7d4100b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.736+0000 7fa7d9e99700 1 --2- 172.21.15.73:0/2119186080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7d41006f0 0x7fa7d4100b70 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8009990 tx=0x7fa7c8009ca0 comp rx=0 tx=0).stop 2023-08-10T12:04:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.736+0000 7fa7d9e99700 1 -- 172.21.15.73:0/2119186080 shutdown_connections 2023-08-10T12:04:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.736+0000 7fa7d9e99700 1 --2- 172.21.15.73:0/2119186080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7d4106700 0x7fa7d4106ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.736+0000 7fa7d9e99700 1 --2- 172.21.15.73:0/2119186080 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7d41010b0 0x7fa7d410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.736+0000 7fa7d9e99700 1 --2- 172.21.15.73:0/2119186080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7d41006f0 0x7fa7d4100b70 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.736+0000 7fa7d9e99700 1 -- 172.21.15.73:0/2119186080 >> 172.21.15.73:0/2119186080 conn(0x7fa7d40fc1c0 msgr2=0x7fa7d40fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:04:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.736+0000 7fa7d9e99700 1 -- 172.21.15.73:0/2119186080 shutdown_connections 2023-08-10T12:04:52.742 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.736+0000 7fa7d9e99700 1 -- 172.21.15.73:0/2119186080 wait complete. 2023-08-10T12:04:52.742 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.737+0000 7fa7d9e99700 1 Processor -- start 2023-08-10T12:04:52.742 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.737+0000 7fa7d9e99700 1 -- start start 2023-08-10T12:04:52.743 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.737+0000 7fa7d9e99700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7d41006f0 0x7fa7d419c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:52.743 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.737+0000 7fa7d9e99700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7d41010b0 0x7fa7d419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:52.743 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.737+0000 7fa7d9e99700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7d4106700 0x7fa7d4196620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:52.743 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.737+0000 7fa7d9e99700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d4196c90 con 0x7fa7d4106700 2023-08-10T12:04:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.737+0000 7fa7d9e99700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d4196e00 con 0x7fa7d41006f0 2023-08-10T12:04:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.737+0000 7fa7d9e99700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d4196fc0 con 0x7fa7d41010b0 2023-08-10T12:04:52.745 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.737+0000 7fa7d3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7d4106700 0x7fa7d4196620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:52.745 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.737+0000 7fa7d37fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7d41006f0 0x7fa7d419c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:52.746 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.737+0000 7fa7d3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7d4106700 0x7fa7d4196620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36952/0 (socket says 172.21.15.73:36952) 2023-08-10T12:04:52.746 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.737+0000 7fa7d3fff700 1 -- 172.21.15.73:0/2654284491 learned_addr learned my addr 172.21.15.73:0/2654284491 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:04:52.746 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.737+0000 7fa7d2ffd700 1 --2- 172.21.15.73:0/2654284491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7d41010b0 0x7fa7d419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:52.746 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.737+0000 7fa7d3fff700 1 -- 172.21.15.73:0/2654284491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7d41010b0 msgr2=0x7fa7d419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:52.747 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.738+0000 7fa7d3fff700 1 --2- 172.21.15.73:0/2654284491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7d41010b0 0x7fa7d419cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:52.747 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.738+0000 7fa7d3fff700 1 -- 172.21.15.73:0/2654284491 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7d41006f0 msgr2=0x7fa7d419c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:52.747 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.738+0000 7fa7d3fff700 1 --2- 172.21.15.73:0/2654284491 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7d41006f0 0x7fa7d419c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:52.747 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.738+0000 7fa7d3fff700 1 -- 172.21.15.73:0/2654284491 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c80095f0 con 0x7fa7d4106700 2023-08-10T12:04:52.748 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.738+0000 7fa7d3fff700 1 --2- 172.21.15.73:0/2654284491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7d4106700 0x7fa7d4196620 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc007ee0 tx=0x7fa7cc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:04:52.748 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.738+0000 7fa7d0ff9700 1 -- 172.21.15.73:0/2654284491 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc00dd20 con 0x7fa7d4106700 2023-08-10T12:04:52.748 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.738+0000 7fa7d9e99700 1 -- 172.21.15.73:0/2654284491 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d41972a0 con 0x7fa7d4106700 2023-08-10T12:04:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.738+0000 7fa7d0ff9700 1 -- 172.21.15.73:0/2654284491 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa7cc00f040 con 0x7fa7d4106700 2023-08-10T12:04:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.738+0000 7fa7d0ff9700 1 -- 172.21.15.73:0/2654284491 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc0048a0 con 0x7fa7d4106700 2023-08-10T12:04:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.738+0000 7fa7d9e99700 1 -- 172.21.15.73:0/2654284491 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d41a37b0 con 0x7fa7d4106700 2023-08-10T12:04:52.758 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.740+0000 7fa7d0ff9700 1 -- 172.21.15.73:0/2654284491 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fa7cc003a00 con 0x7fa7d4106700 2023-08-10T12:04:52.758 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.741+0000 7fa7d0ff9700 1 --2- 172.21.15.73:0/2654284491 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa7bc0a12c0 0x7fa7bc0a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:52.759 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.741+0000 7fa7d37fe700 1 --2- 172.21.15.73:0/2654284491 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa7bc0a12c0 0x7fa7bc0a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:52.759 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.741+0000 7fa7d0ff9700 1 -- 172.21.15.73:0/2654284491 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa7cc0cc5e0 con 0x7fa7d4106700 2023-08-10T12:04:52.760 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.741+0000 7fa7d37fe700 1 --2- 172.21.15.73:0/2654284491 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa7bc0a12c0 0x7fa7bc0a3780 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4009be0 tx=0x7fa7c4009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:04:52.760 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.741+0000 7fa7e6032b80 1 Processor -- start 2023-08-10T12:04:52.760 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.742+0000 7fa7e6032b80 1 -- start start 2023-08-10T12:04:52.761 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.742+0000 7fa7e6032b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cfed6f610 0x561cfed6f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:52.761 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.742+0000 7fa7e6032b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed6ff30 0x561cfed73a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:52.761 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.742+0000 7fa7e6032b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cfed73fb0 0x561cfed74410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:52.761 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.742+0000 7fa7e6032b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfece6d60 con 0x561cfed6ff30 2023-08-10T12:04:52.761 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.742+0000 7fa7e6032b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfecc3530 con 0x561cfed6f610 2023-08-10T12:04:52.762 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.742+0000 7fa7e6032b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfecc0e50 con 0x561cfed73fb0 2023-08-10T12:04:52.762 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.742+0000 7fa7d2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed6ff30 0x561cfed73a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:52.762 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.742+0000 7fa7d2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed6ff30 0x561cfed73a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36958/0 (socket says 172.21.15.73:36958) 2023-08-10T12:04:52.763 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.742+0000 7fa7d2ffd700 1 -- 172.21.15.73:0/2552089265 learned_addr learned my addr 172.21.15.73:0/2552089265 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:04:52.763 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.742+0000 7fa7d37fe700 1 --2- 172.21.15.73:0/2552089265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cfed6f610 0x561cfed6f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:52.763 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.742+0000 7fa7d3fff700 1 --2- 172.21.15.73:0/2552089265 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cfed73fb0 0x561cfed74410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:52.763 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.742+0000 7fa7d2ffd700 1 -- 172.21.15.73:0/2552089265 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cfed73fb0 msgr2=0x561cfed74410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:52.764 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.742+0000 7fa7d2ffd700 1 --2- 172.21.15.73:0/2552089265 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cfed73fb0 0x561cfed74410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:52.764 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.742+0000 7fa7d2ffd700 1 -- 172.21.15.73:0/2552089265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cfed6f610 msgr2=0x561cfed6f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:52.764 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.742+0000 7fa7d2ffd700 1 --2- 172.21.15.73:0/2552089265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cfed6f610 0x561cfed6f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.742+0000 7fa7d2ffd700 1 -- 172.21.15.73:0/2552089265 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561cfeb3d5d0 con 0x561cfed6ff30 2023-08-10T12:04:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.742+0000 7fa7d2ffd700 1 --2- 172.21.15.73:0/2552089265 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed6ff30 0x561cfed73a70 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8015000 tx=0x7fa7c800b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=facfa76542b3273f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:04:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.742+0000 7fa7b9ffb700 1 -- 172.21.15.73:0/2552089265 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c801d070 con 0x561cfed6ff30 2023-08-10T12:04:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.742+0000 7fa7b9ffb700 1 -- 172.21.15.73:0/2552089265 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa7c801e040 con 0x561cfed6ff30 2023-08-10T12:04:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.742+0000 7fa7b9ffb700 1 -- 172.21.15.73:0/2552089265 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80047b0 con 0x561cfed6ff30 2023-08-10T12:04:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.743+0000 7fa7e6032b80 1 -- 172.21.15.73:0/2552089265 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed6ff30 msgr2=0x561cfed73a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.743+0000 7fa7e6032b80 1 --2- 172.21.15.73:0/2552089265 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed6ff30 0x561cfed73a70 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8015000 tx=0x7fa7c800b610 comp rx=0 tx=0).stop 2023-08-10T12:04:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.743+0000 7fa7e6032b80 1 -- 172.21.15.73:0/2552089265 shutdown_connections 2023-08-10T12:04:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.743+0000 7fa7e6032b80 1 --2- 172.21.15.73:0/2552089265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cfed6f610 0x561cfed6f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.743+0000 7fa7e6032b80 1 --2- 172.21.15.73:0/2552089265 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cfed73fb0 0x561cfed74410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.743+0000 7fa7e6032b80 1 --2- 172.21.15.73:0/2552089265 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed6ff30 0x561cfed73a70 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.743+0000 7fa7e6032b80 1 -- 172.21.15.73:0/2552089265 >> 172.21.15.73:0/2552089265 conn(0x561cfecc8c70 msgr2=0x561cfed65d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:04:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.743+0000 7fa7e6032b80 1 -- 172.21.15.73:0/2552089265 shutdown_connections 2023-08-10T12:04:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.743+0000 7fa7e6032b80 1 -- 172.21.15.73:0/2552089265 wait complete. 2023-08-10T12:04:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.744+0000 7fa7e6032b80 1 -- start start 2023-08-10T12:04:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.744+0000 7fa7e6032b80 1 Processor -- start 2023-08-10T12:04:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.744+0000 7fa7e6032b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cfed6f610 0x561cfed7b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.744+0000 7fa7e6032b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cfed6ff30 0x561cfed78950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.744+0000 7fa7e6032b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed73fb0 0x561cfed78f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.744+0000 7fa7e6032b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfecbc740 con 0x561cfed73fb0 2023-08-10T12:04:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.744+0000 7fa7e6032b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfec5ba60 con 0x561cfed6ff30 2023-08-10T12:04:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.744+0000 7fa7e6032b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfec5b760 con 0x561cfed6f610 2023-08-10T12:04:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.744+0000 7fa7e6032b80 10 client.0 _ll_register_callbacks cb 0x561cfec59620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:04:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.744+0000 7fa7d3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed73fb0 0x561cfed78f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.744+0000 7fa7d2ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cfed6ff30 0x561cfed78950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.744+0000 7fa7d37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cfed6f610 0x561cfed7b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:52.771 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.744+0000 7fa7d3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed73fb0 0x561cfed78f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36966/0 (socket says 172.21.15.73:36966) 2023-08-10T12:04:52.771 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.744+0000 7fa7d3fff700 1 -- 172.21.15.73:0/1880983357 learned_addr learned my addr 172.21.15.73:0/1880983357 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:04:52.771 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.744+0000 7fa7d3fff700 1 -- 172.21.15.73:0/1880983357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cfed6f610 msgr2=0x561cfed7b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:52.771 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.744+0000 7fa7d3fff700 1 --2- 172.21.15.73:0/1880983357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cfed6f610 0x561cfed7b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:52.771 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.745+0000 7fa7d3fff700 1 -- 172.21.15.73:0/1880983357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cfed6ff30 msgr2=0x561cfed78950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:52.771 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.745+0000 7fa7d3fff700 1 --2- 172.21.15.73:0/1880983357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cfed6ff30 0x561cfed78950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:52.771 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.745+0000 7fa7d3fff700 1 -- 172.21.15.73:0/1880983357 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d410dec0 con 0x561cfed73fb0 2023-08-10T12:04:52.771 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.745+0000 7fa7d2ffd700 1 --2- 172.21.15.73:0/1880983357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cfed6ff30 0x561cfed78950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:04:52.772 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.745+0000 7fa7d3fff700 1 --2- 172.21.15.73:0/1880983357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed73fb0 0x561cfed78f60 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc00d700 tx=0x7fa7cc099080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626f891a07679cbb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:04:52.772 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.745+0000 7fa7b2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:04:52.772 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.745+0000 7fa7b2ffd700 1 -- 172.21.15.73:0/1880983357 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc0a1aa0 con 0x561cfed73fb0 2023-08-10T12:04:52.772 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.745+0000 7fa7b2ffd700 1 -- 172.21.15.73:0/1880983357 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa7cc009410 con 0x561cfed73fb0 2023-08-10T12:04:52.772 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.745+0000 7fa7e6032b80 1 -- 172.21.15.73:0/1880983357 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561cfed5e1c0 con 0x561cfed73fb0 2023-08-10T12:04:52.772 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.745+0000 7fa7b2ffd700 1 -- 172.21.15.73:0/1880983357 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7cc095d60 con 0x561cfed73fb0 2023-08-10T12:04:52.772 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.745+0000 7fa7e6032b80 10 client.17109 fetch_fsmap learned FSMap version 57 2023-08-10T12:04:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.745+0000 7fa7e6032b80 1 -- 172.21.15.73:0/1880983357 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) v3 -- 0x561cfeae9d80 con 0x561cfed73fb0 2023-08-10T12:04:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.745+0000 7fa7b2ffd700 1 -- 172.21.15.73:0/1880983357 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561cfed5e1c0 con 0x561cfed73fb0 2023-08-10T12:04:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.745+0000 7fa7b2ffd700 1 -- 172.21.15.73:0/1880983357 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 57) v1 ==== 6985+0+0 (secure 0 0 0) 0x7fa7cc098b40 con 0x561cfed73fb0 2023-08-10T12:04:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.745+0000 7fa7e6032b80 10 client.17109 fetch_fsmap finished waiting for FSMap version 57 2023-08-10T12:04:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.745+0000 7fa7e6032b80 10 client.17109 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:04:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.745+0000 7fa7e6032b80 20 client.17109 populate_metadata read hostname 'smithi073' 2023-08-10T12:04:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.745+0000 7fa7e6032b80 1 --2- 172.21.15.73:0/1880983357 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561cfed89100 0x561cfed8b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.745+0000 7fa7e6032b80 4 client.17109 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:04:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.745+0000 7fa7e6032b80 1 -- 172.21.15.73:0/1880983357 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561cfed3a970 con 0x561cfed89100 2023-08-10T12:04:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.746+0000 7fa7d37fe700 1 --2- 172.21.15.73:0/1880983357 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561cfed89100 0x561cfed8b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.746+0000 7fa7b2ffd700 10 client.17109 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:04:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.746+0000 7fa7d37fe700 1 --2- 172.21.15.73:0/1880983357 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561cfed89100 0x561cfed8b520 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9156a34158cadc8 server_cookie=e41a98638baeb360 in_seq=0 out_seq=0 2023-08-10T12:04:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.747+0000 7fa7b2ffd700 1 -- 172.21.15.73:0/1880983357 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x561cfed3a970 con 0x561cfed89100 2023-08-10T12:04:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.747+0000 7fa7b2ffd700 10 client.17109 handle_command_reply: tid=0 2023-08-10T12:04:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.747+0000 7fa7e6032b80 1 client.17109 shutdown 2023-08-10T12:04:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.747+0000 7fa7e6032b80 1 -- 172.21.15.73:0/1880983357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed73fb0 msgr2=0x561cfed78f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.747+0000 7fa7e6032b80 1 --2- 172.21.15.73:0/1880983357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed73fb0 0x561cfed78f60 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc00d700 tx=0x7fa7cc099080 comp rx=0 tx=0).stop 2023-08-10T12:04:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.747+0000 7fa7e6032b80 1 -- 172.21.15.73:0/1880983357 shutdown_connections 2023-08-10T12:04:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.747+0000 7fa7e6032b80 1 --2- 172.21.15.73:0/1880983357 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561cfed89100 0x561cfed8b520 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.747+0000 7fa7e6032b80 1 --2- 172.21.15.73:0/1880983357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed73fb0 0x561cfed78f60 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.747+0000 7fa7b2ffd700 0 client.17109 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:04:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.747+0000 7fa7e6032b80 1 --2- 172.21.15.73:0/1880983357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cfed6f610 0x561cfed7b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.747+0000 7fa7e6032b80 1 --2- 172.21.15.73:0/1880983357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cfed6ff30 0x561cfed78950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.747+0000 7fa7e6032b80 1 -- 172.21.15.73:0/1880983357 >> 172.21.15.73:0/1880983357 conn(0x561cfecc8c70 msgr2=0x561cfed75410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:04:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.747+0000 7fa7e6032b80 1 -- 172.21.15.73:0/1880983357 shutdown_connections 2023-08-10T12:04:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.747+0000 7fa7e6032b80 1 -- 172.21.15.73:0/1880983357 wait complete. 2023-08-10T12:04:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.747+0000 7fa7e6032b80 20 client.17109 trim_cache size 0 max 16384 2023-08-10T12:04:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.762+0000 7fa7e6032b80 1 Processor -- start 2023-08-10T12:04:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.762+0000 7fa7e6032b80 1 -- start start 2023-08-10T12:04:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.762+0000 7fa7e6032b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cfed6f610 0x561cfed801b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.762+0000 7fa7e6032b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed6ff30 0x561cfed77810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.762+0000 7fa7e6032b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cfed73fb0 0x561cfed7b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.762+0000 7fa7e6032b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfeb3f8c0 con 0x561cfed6ff30 2023-08-10T12:04:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.762+0000 7fa7e6032b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfed866e0 con 0x561cfed6f610 2023-08-10T12:04:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.762+0000 7fa7e6032b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfed76eb0 con 0x561cfed73fb0 2023-08-10T12:04:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.762+0000 7fa7d2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed6ff30 0x561cfed77810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.762+0000 7fa7d37fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cfed6f610 0x561cfed801b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:52.782 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.762+0000 7fa7d2ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed6ff30 0x561cfed77810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36972/0 (socket says 172.21.15.73:36972) 2023-08-10T12:04:52.782 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.762+0000 7fa7d2ffd700 1 -- 172.21.15.73:0/4291251214 learned_addr learned my addr 172.21.15.73:0/4291251214 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:04:52.782 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.762+0000 7fa7d3fff700 1 --2- 172.21.15.73:0/4291251214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cfed73fb0 0x561cfed7b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:52.782 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.762+0000 7fa7d2ffd700 1 -- 172.21.15.73:0/4291251214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cfed73fb0 msgr2=0x561cfed7b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:52.782 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.762+0000 7fa7d2ffd700 1 --2- 172.21.15.73:0/4291251214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cfed73fb0 0x561cfed7b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:52.782 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.762+0000 7fa7d2ffd700 1 -- 172.21.15.73:0/4291251214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cfed6f610 msgr2=0x561cfed801b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:52.782 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.762+0000 7fa7d2ffd700 1 --2- 172.21.15.73:0/4291251214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cfed6f610 0x561cfed801b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.763+0000 7fa7d2ffd700 1 -- 172.21.15.73:0/4291251214 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561cfead2c00 con 0x561cfed6ff30 2023-08-10T12:04:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.763+0000 7fa7d3fff700 1 --2- 172.21.15.73:0/4291251214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cfed73fb0 0x561cfed7b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:04:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.763+0000 7fa7d2ffd700 1 --2- 172.21.15.73:0/4291251214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed6ff30 0x561cfed77810 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8009ce0 tx=0x7fa7c800b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b067d510200f960 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:04:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.763+0000 7fa7ba7fc700 1 -- 172.21.15.73:0/4291251214 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c801d040 con 0x561cfed6ff30 2023-08-10T12:04:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.763+0000 7fa7ba7fc700 1 -- 172.21.15.73:0/4291251214 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa7c8005500 con 0x561cfed6ff30 2023-08-10T12:04:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.763+0000 7fa7ba7fc700 1 -- 172.21.15.73:0/4291251214 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8022c90 con 0x561cfed6ff30 2023-08-10T12:04:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.763+0000 7fa7e6032b80 1 -- 172.21.15.73:0/4291251214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed6ff30 msgr2=0x561cfed77810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.763+0000 7fa7e6032b80 1 --2- 172.21.15.73:0/4291251214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed6ff30 0x561cfed77810 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8009ce0 tx=0x7fa7c800b3b0 comp rx=0 tx=0).stop 2023-08-10T12:04:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.764+0000 7fa7e6032b80 1 -- 172.21.15.73:0/4291251214 shutdown_connections 2023-08-10T12:04:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.764+0000 7fa7e6032b80 1 --2- 172.21.15.73:0/4291251214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cfed6f610 0x561cfed801b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.764+0000 7fa7e6032b80 1 --2- 172.21.15.73:0/4291251214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cfed73fb0 0x561cfed7b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.764+0000 7fa7e6032b80 1 --2- 172.21.15.73:0/4291251214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed6ff30 0x561cfed77810 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.764+0000 7fa7e6032b80 1 -- 172.21.15.73:0/4291251214 >> 172.21.15.73:0/4291251214 conn(0x561cfecc8c70 msgr2=0x561cfed77100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:04:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.764+0000 7fa7e6032b80 1 -- 172.21.15.73:0/4291251214 shutdown_connections 2023-08-10T12:04:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.764+0000 7fa7e6032b80 1 -- 172.21.15.73:0/4291251214 wait complete. 2023-08-10T12:04:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.764+0000 7fa7e6032b80 1 -- start start 2023-08-10T12:04:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.764+0000 7fa7e6032b80 1 Processor -- start 2023-08-10T12:04:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.764+0000 7fa7e6032b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cfed6f610 0x561cfed7d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.764+0000 7fa7e6032b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cfed6ff30 0x561cfed7dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.764+0000 7fa7e6032b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed73fb0 0x561cfed7e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.764+0000 7fa7e6032b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfeddbee0 con 0x561cfed73fb0 2023-08-10T12:04:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.764+0000 7fa7e6032b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfeddc050 con 0x561cfed6f610 2023-08-10T12:04:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.764+0000 7fa7e6032b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfeddc210 con 0x561cfed6ff30 2023-08-10T12:04:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.764+0000 7fa7e6032b80 10 client.0 _ll_register_callbacks cb 0x561cfec59620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:04:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.764+0000 7fa7d3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed73fb0 0x561cfed7e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.765+0000 7fa7d3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed73fb0 0x561cfed7e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36978/0 (socket says 172.21.15.73:36978) 2023-08-10T12:04:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.765+0000 7fa7d37fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cfed6f610 0x561cfed7d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.765+0000 7fa7d3fff700 1 -- 172.21.15.73:0/4096285374 learned_addr learned my addr 172.21.15.73:0/4096285374 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:04:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.765+0000 7fa7d2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cfed6ff30 0x561cfed7dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.765+0000 7fa7d3fff700 1 -- 172.21.15.73:0/4096285374 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cfed6ff30 msgr2=0x561cfed7dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.765+0000 7fa7d3fff700 1 --2- 172.21.15.73:0/4096285374 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cfed6ff30 0x561cfed7dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.765+0000 7fa7d3fff700 1 -- 172.21.15.73:0/4096285374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cfed6f610 msgr2=0x561cfed7d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:04:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.765+0000 7fa7d3fff700 1 --2- 172.21.15.73:0/4096285374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cfed6f610 0x561cfed7d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.765+0000 7fa7d3fff700 1 -- 172.21.15.73:0/4096285374 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561cfeae9d80 con 0x561cfed73fb0 2023-08-10T12:04:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.765+0000 7fa7d3fff700 1 --2- 172.21.15.73:0/4096285374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed73fb0 0x561cfed7e2b0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc0042f0 tx=0x7fa7cc09d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5567ed58dee382 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:04:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.765+0000 7fa7b2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-08-10T12:04:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.765+0000 7fa7b2ffd700 1 -- 172.21.15.73:0/4096285374 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc0842f0 con 0x561cfed73fb0 2023-08-10T12:04:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.765+0000 7fa7b2ffd700 1 -- 172.21.15.73:0/4096285374 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa7cc0998b0 con 0x561cfed73fb0 2023-08-10T12:04:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.765+0000 7fa7e6032b80 1 -- 172.21.15.73:0/4096285374 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa7c801e040 con 0x561cfed73fb0 2023-08-10T12:04:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.765+0000 7fa7b2ffd700 1 -- 172.21.15.73:0/4096285374 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7cc0a1810 con 0x561cfed73fb0 2023-08-10T12:04:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.765+0000 7fa7e6032b80 10 client.17115 fetch_fsmap learned FSMap version 57 2023-08-10T12:04:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.765+0000 7fa7e6032b80 1 -- 172.21.15.73:0/4096285374 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) v3 -- 0x561cfeb3d5d0 con 0x561cfed73fb0 2023-08-10T12:04:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.765+0000 7fa7b2ffd700 1 -- 172.21.15.73:0/4096285374 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa7c801e040 con 0x561cfed73fb0 2023-08-10T12:04:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.765+0000 7fa7b2ffd700 1 -- 172.21.15.73:0/4096285374 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 57) v1 ==== 6985+0+0 (secure 0 0 0) 0x7fa7cc0cc100 con 0x561cfed73fb0 2023-08-10T12:04:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.765+0000 7fa7e6032b80 10 client.17115 fetch_fsmap finished waiting for FSMap version 57 2023-08-10T12:04:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.766+0000 7fa7e6032b80 10 client.17115 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:04:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.766+0000 7fa7e6032b80 20 client.17115 populate_metadata read hostname 'smithi073' 2023-08-10T12:04:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.766+0000 7fa7e6032b80 1 --2- 172.21.15.73:0/4096285374 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561cfed89100 0x561cfeddf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:04:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.766+0000 7fa7e6032b80 4 client.17115 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T12:04:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.766+0000 7fa7e6032b80 1 -- 172.21.15.73:0/4096285374 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561cfecb5720 con 0x561cfed89100 2023-08-10T12:04:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.766+0000 7fa7d37fe700 1 --2- 172.21.15.73:0/4096285374 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561cfed89100 0x561cfeddf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:04:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.766+0000 7fa7b2ffd700 10 client.17115 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:04:52.790 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:52.766+0000 7fa7d37fe700 1 --2- 172.21.15.73:0/4096285374 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561cfed89100 0x561cfeddf600 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72cc9be562ed3ed7 server_cookie=785c0159df4b35b8 in_seq=0 out_seq=0 2023-08-10T12:04:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T12:04:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T12:04:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T12:04:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T12:04:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:53.233+0000 7fa7b2ffd700 1 -- 172.21.15.73:0/4096285374 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561cfecb5720 con 0x561cfed89100 2023-08-10T12:04:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:53.233+0000 7fa7b2ffd700 10 client.17115 handle_command_reply: tid=0 2023-08-10T12:04:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:53.234+0000 7fa7e6032b80 1 client.17115 shutdown 2023-08-10T12:04:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:53.234+0000 7fa7e6032b80 1 -- 172.21.15.73:0/4096285374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed73fb0 msgr2=0x561cfed7e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:53.234+0000 7fa7e6032b80 1 --2- 172.21.15.73:0/4096285374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed73fb0 0x561cfed7e2b0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc0042f0 tx=0x7fa7cc09d800 comp rx=0 tx=0).stop 2023-08-10T12:04:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:53.234+0000 7fa7e6032b80 1 -- 172.21.15.73:0/4096285374 shutdown_connections 2023-08-10T12:04:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:53.234+0000 7fa7e6032b80 1 --2- 172.21.15.73:0/4096285374 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x561cfed89100 0x561cfeddf600 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:53.234+0000 7fa7e6032b80 1 --2- 172.21.15.73:0/4096285374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561cfed6f610 0x561cfed7d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:53.234+0000 7fa7e6032b80 1 --2- 172.21.15.73:0/4096285374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561cfed73fb0 0x561cfed7e2b0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:53.234+0000 7fa7e6032b80 1 --2- 172.21.15.73:0/4096285374 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cfed6ff30 0x561cfed7dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:53.234+0000 7fa7e6032b80 1 -- 172.21.15.73:0/4096285374 >> 172.21.15.73:0/4096285374 conn(0x561cfecc8c70 msgr2=0x561cfed6a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:04:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:53.234+0000 7fa7b2ffd700 0 client.17115 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:04:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:53.234+0000 7fa7e6032b80 1 -- 172.21.15.73:0/4096285374 shutdown_connections 2023-08-10T12:04:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:53.234+0000 7fa7e6032b80 1 -- 172.21.15.73:0/4096285374 wait complete. 2023-08-10T12:04:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:53.235+0000 7fa7e6032b80 20 client.17115 trim_cache size 0 max 16384 2023-08-10T12:04:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:53.235+0000 7fa7d9e99700 1 -- 172.21.15.73:0/2654284491 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa7bc0a12c0 msgr2=0x7fa7bc0a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:53.235+0000 7fa7d9e99700 1 --2- 172.21.15.73:0/2654284491 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa7bc0a12c0 0x7fa7bc0a3780 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4009be0 tx=0x7fa7c4009260 comp rx=0 tx=0).stop 2023-08-10T12:04:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:53.235+0000 7fa7d9e99700 1 -- 172.21.15.73:0/2654284491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7d4106700 msgr2=0x7fa7d4196620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:04:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:53.235+0000 7fa7d9e99700 1 --2- 172.21.15.73:0/2654284491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7d4106700 0x7fa7d4196620 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc007ee0 tx=0x7fa7cc00d3b0 comp rx=0 tx=0).stop 2023-08-10T12:04:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:53.235+0000 7fa7d9e99700 1 -- 172.21.15.73:0/2654284491 shutdown_connections 2023-08-10T12:04:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:53.235+0000 7fa7d9e99700 1 --2- 172.21.15.73:0/2654284491 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fa7bc0a12c0 0x7fa7bc0a3780 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:53.235+0000 7fa7d9e99700 1 --2- 172.21.15.73:0/2654284491 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7d41006f0 0x7fa7d419c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:53.235+0000 7fa7d9e99700 1 --2- 172.21.15.73:0/2654284491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7d4106700 0x7fa7d4196620 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:53.235+0000 7fa7d9e99700 1 --2- 172.21.15.73:0/2654284491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7d41010b0 0x7fa7d419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:04:53.242 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:53.235+0000 7fa7d9e99700 1 -- 172.21.15.73:0/2654284491 >> 172.21.15.73:0/2654284491 conn(0x7fa7d40fc1c0 msgr2=0x7fa7d4104200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:04:53.242 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:53.235+0000 7fa7d9e99700 1 -- 172.21.15.73:0/2654284491 shutdown_connections 2023-08-10T12:04:53.242 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:04:53.235+0000 7fa7d9e99700 1 -- 172.21.15.73:0/2654284491 wait complete. 2023-08-10T12:04:53.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:53 smithi152 ceph-mon[130220]: pgmap v382: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 298 op/s 2023-08-10T12:04:53.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:53 smithi156 ceph-mon[130574]: pgmap v382: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 298 op/s 2023-08-10T12:04:53.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:53 smithi073 ceph-mon[128869]: pgmap v382: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 298 op/s 2023-08-10T12:04:55.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:54 smithi152 ceph-mon[130220]: pgmap v383: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 313 op/s 2023-08-10T12:04:55.259 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:54 smithi156 ceph-mon[130574]: pgmap v383: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 313 op/s 2023-08-10T12:04:55.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:54 smithi073 ceph-mon[128869]: pgmap v383: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 313 op/s 2023-08-10T12:04:57.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:57 smithi152 ceph-mon[130220]: pgmap v384: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 402 op/s 2023-08-10T12:04:57.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:57 smithi156 ceph-mon[130574]: pgmap v384: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 402 op/s 2023-08-10T12:04:57.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:57 smithi073 ceph-mon[128869]: pgmap v384: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 402 op/s 2023-08-10T12:04:59.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:04:59 smithi152 ceph-mon[130220]: pgmap v385: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 419 op/s 2023-08-10T12:04:59.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:04:59 smithi156 ceph-mon[130574]: pgmap v385: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 419 op/s 2023-08-10T12:04:59.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:04:59 smithi073 ceph-mon[128869]: pgmap v385: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 419 op/s 2023-08-10T12:05:00.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:00 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:05:00.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:00 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:05:00.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:00 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:05:01.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:01 smithi152 ceph-mon[130220]: pgmap v386: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.9 MiB/s wr, 419 op/s 2023-08-10T12:05:01.509 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:01 smithi156 ceph-mon[130574]: pgmap v386: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.9 MiB/s wr, 419 op/s 2023-08-10T12:05:01.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:01 smithi073 ceph-mon[128869]: pgmap v386: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.9 MiB/s wr, 419 op/s 2023-08-10T12:05:03.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:03 smithi152 ceph-mon[130220]: pgmap v387: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.0 MiB/s wr, 442 op/s 2023-08-10T12:05:03.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:03 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:05:03.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:03 smithi156 ceph-mon[130574]: pgmap v387: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.0 MiB/s wr, 442 op/s 2023-08-10T12:05:03.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:03 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:05:03.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:03 smithi073 ceph-mon[128869]: pgmap v387: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.0 MiB/s wr, 442 op/s 2023-08-10T12:05:03.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:03 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:05:04.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:04 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:05:04.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:04 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:05:04.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:04 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:05:04.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:04 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:05:04.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:04 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:05:04.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:04 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:05:04.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:04 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:05:04.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:04 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:05:04.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:04 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:05:04.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:04 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:05:04.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:04 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:05:04.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:04 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:05:04.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:04 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:05:04.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:04 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:05:04.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:04 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:05:05.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:05 smithi152 ceph-mon[130220]: pgmap v388: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 388 op/s 2023-08-10T12:05:05.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:05 smithi156 ceph-mon[130574]: pgmap v388: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 388 op/s 2023-08-10T12:05:05.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:05 smithi073 ceph-mon[128869]: pgmap v388: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 388 op/s 2023-08-10T12:05:06.360 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.359+0000 7f91e53a7700 1 -- 172.21.15.73:0/2442952797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91e0100000 msgr2=0x7f91e010c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:06.361 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.359+0000 7f91e53a7700 1 --2- 172.21.15.73:0/2442952797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91e0100000 0x7f91e010c510 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f91d00098f0 tx=0x7f91d0009c00 comp rx=0 tx=0).stop 2023-08-10T12:05:06.361 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.359+0000 7f91e53a7700 1 -- 172.21.15.73:0/2442952797 shutdown_connections 2023-08-10T12:05:06.361 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.359+0000 7f91e53a7700 1 --2- 172.21.15.73:0/2442952797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91e0100000 0x7f91e010c510 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.361 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.359+0000 7f91e53a7700 1 --2- 172.21.15.73:0/2442952797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91e0105650 0x7f91e0105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.361 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.359+0000 7f91e53a7700 1 --2- 172.21.15.73:0/2442952797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91e00ff640 0x7f91e00ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.361 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.359+0000 7f91e53a7700 1 -- 172.21.15.73:0/2442952797 >> 172.21.15.73:0/2442952797 conn(0x7f91e00fb150 msgr2=0x7f91e00fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:06.364 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.363+0000 7f91e53a7700 1 -- 172.21.15.73:0/2442952797 shutdown_connections 2023-08-10T12:05:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.363+0000 7f91e53a7700 1 -- 172.21.15.73:0/2442952797 wait complete. 2023-08-10T12:05:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.364+0000 7f91e53a7700 1 Processor -- start 2023-08-10T12:05:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.364+0000 7f91e53a7700 1 -- start start 2023-08-10T12:05:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.364+0000 7f91e53a7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91e00ff640 0x7f91e010cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.364+0000 7f91e53a7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91e0100000 0x7f91e010d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:06.367 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.364+0000 7f91e53a7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91e0105650 0x7f91e010d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:06.367 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.364+0000 7f91e53a7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e01a9370 con 0x7f91e0105650 2023-08-10T12:05:06.367 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.364+0000 7f91e53a7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e01a94e0 con 0x7f91e00ff640 2023-08-10T12:05:06.367 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.365+0000 7f91e53a7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e01a96a0 con 0x7f91e0100000 2023-08-10T12:05:06.367 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.365+0000 7f91deffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91e00ff640 0x7f91e010cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:06.367 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.365+0000 7f91df7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91e0105650 0x7f91e010d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:06.368 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.365+0000 7f91deffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91e00ff640 0x7f91e010cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:51638/0 (socket says 172.21.15.73:51638) 2023-08-10T12:05:06.368 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.365+0000 7f91deffd700 1 -- 172.21.15.73:0/4236521518 learned_addr learned my addr 172.21.15.73:0/4236521518 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:05:06.368 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.365+0000 7f91df7fe700 1 -- 172.21.15.73:0/4236521518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91e0100000 msgr2=0x7f91e010d420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T12:05:06.368 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.365+0000 7f91df7fe700 1 --2- 172.21.15.73:0/4236521518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91e0100000 0x7f91e010d420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.368 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.365+0000 7f91df7fe700 1 -- 172.21.15.73:0/4236521518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91e00ff640 msgr2=0x7f91e010cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:06.368 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.365+0000 7f91df7fe700 1 --2- 172.21.15.73:0/4236521518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91e00ff640 0x7f91e010cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.368 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.365+0000 7f91df7fe700 1 -- 172.21.15.73:0/4236521518 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d0009520 con 0x7f91e0105650 2023-08-10T12:05:06.369 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.365+0000 7f91df7fe700 1 --2- 172.21.15.73:0/4236521518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91e0105650 0x7f91e010d960 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f91d0009fd0 tx=0x7f91d000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:06.369 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.367+0000 7f91d7fff700 1 -- 172.21.15.73:0/4236521518 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d001c070 con 0x7f91e0105650 2023-08-10T12:05:06.369 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.367+0000 7f91d7fff700 1 -- 172.21.15.73:0/4236521518 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91d0005040 con 0x7f91e0105650 2023-08-10T12:05:06.369 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.367+0000 7f91d7fff700 1 -- 172.21.15.73:0/4236521518 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0003920 con 0x7f91e0105650 2023-08-10T12:05:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.367+0000 7f91e53a7700 1 -- 172.21.15.73:0/4236521518 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e01a9920 con 0x7f91e0105650 2023-08-10T12:05:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.367+0000 7f91e53a7700 1 -- 172.21.15.73:0/4236521518 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e01a9cf0 con 0x7f91e0105650 2023-08-10T12:05:06.371 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.370+0000 7f91d7fff700 1 -- 172.21.15.73:0/4236521518 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f91d0020030 con 0x7f91e0105650 2023-08-10T12:05:06.372 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.371+0000 7f91d7fff700 1 --2- 172.21.15.73:0/4236521518 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f91cc0a1410 0x7f91cc0a38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:06.372 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.371+0000 7f91deffd700 1 --2- 172.21.15.73:0/4236521518 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f91cc0a1410 0x7f91cc0a38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:06.372 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.371+0000 7f91d7fff700 1 -- 172.21.15.73:0/4236521518 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f91d00cdad0 con 0x7f91e0105650 2023-08-10T12:05:06.373 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.371+0000 7f91deffd700 1 --2- 172.21.15.73:0/4236521518 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f91cc0a1410 0x7f91cc0a38d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f91d8009fd0 tx=0x7f91d800b040 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:06.373 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.372+0000 7f91f1540b80 1 Processor -- start 2023-08-10T12:05:06.374 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.372+0000 7f91f1540b80 1 -- start start 2023-08-10T12:05:06.375 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.373+0000 7f91f1540b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608bc24da40 0x5608bc24de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:06.375 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.373+0000 7f91f1540b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608bc24e360 0x5608bc248010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:06.375 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.373+0000 7f91f1540b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5608bc248550 0x5608bc2489d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:06.375 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.373+0000 7f91f1540b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608bc1c3d60 con 0x5608bc248550 2023-08-10T12:05:06.375 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.373+0000 7f91f1540b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608bc1a0530 con 0x5608bc24da40 2023-08-10T12:05:06.376 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.373+0000 7f91f1540b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608bc19de50 con 0x5608bc24e360 2023-08-10T12:05:06.376 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.373+0000 7f91df7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5608bc248550 0x5608bc2489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:06.376 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.373+0000 7f91df7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5608bc248550 0x5608bc2489d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36998/0 (socket says 172.21.15.73:36998) 2023-08-10T12:05:06.376 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.373+0000 7f91deffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608bc24da40 0x5608bc24de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:06.376 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.373+0000 7f91df7fe700 1 -- 172.21.15.73:0/3225089505 learned_addr learned my addr 172.21.15.73:0/3225089505 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:05:06.376 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.373+0000 7f91de7fc700 1 --2- 172.21.15.73:0/3225089505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608bc24e360 0x5608bc248010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:06.377 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.373+0000 7f91df7fe700 1 -- 172.21.15.73:0/3225089505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608bc24e360 msgr2=0x5608bc248010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:05:06.377 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.373+0000 7f91df7fe700 1 --2- 172.21.15.73:0/3225089505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608bc24e360 0x5608bc248010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.377 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.373+0000 7f91df7fe700 1 -- 172.21.15.73:0/3225089505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608bc24da40 msgr2=0x5608bc24de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:05:06.377 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.373+0000 7f91df7fe700 1 --2- 172.21.15.73:0/3225089505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608bc24da40 0x5608bc24de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.377 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.373+0000 7f91df7fe700 1 -- 172.21.15.73:0/3225089505 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608bc01a5d0 con 0x5608bc248550 2023-08-10T12:05:06.377 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.373+0000 7f91deffd700 1 --2- 172.21.15.73:0/3225089505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608bc24da40 0x5608bc24de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T12:05:06.377 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.373+0000 7f91df7fe700 1 --2- 172.21.15.73:0/3225089505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5608bc248550 0x5608bc2489d0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f91d0097130 tx=0x7f91d009ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb52f8ac3b3f46c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:06.378 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.374+0000 7f91d57fa700 1 -- 172.21.15.73:0/3225089505 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d00b2070 con 0x5608bc248550 2023-08-10T12:05:06.378 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.374+0000 7f91d57fa700 1 -- 172.21.15.73:0/3225089505 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91d009ec60 con 0x5608bc248550 2023-08-10T12:05:06.378 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.374+0000 7f91d57fa700 1 -- 172.21.15.73:0/3225089505 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d009e030 con 0x5608bc248550 2023-08-10T12:05:06.380 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.374+0000 7f91f1540b80 1 -- 172.21.15.73:0/3225089505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5608bc248550 msgr2=0x5608bc2489d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:06.380 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.374+0000 7f91f1540b80 1 --2- 172.21.15.73:0/3225089505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5608bc248550 0x5608bc2489d0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f91d0097130 tx=0x7f91d009ef90 comp rx=0 tx=0).stop 2023-08-10T12:05:06.381 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.375+0000 7f91f1540b80 1 -- 172.21.15.73:0/3225089505 shutdown_connections 2023-08-10T12:05:06.381 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.375+0000 7f91f1540b80 1 --2- 172.21.15.73:0/3225089505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608bc24da40 0x5608bc24de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.381 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.375+0000 7f91f1540b80 1 --2- 172.21.15.73:0/3225089505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5608bc248550 0x5608bc2489d0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.381 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.375+0000 7f91f1540b80 1 --2- 172.21.15.73:0/3225089505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608bc24e360 0x5608bc248010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.381 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.375+0000 7f91f1540b80 1 -- 172.21.15.73:0/3225089505 >> 172.21.15.73:0/3225089505 conn(0x5608bc1a5c70 msgr2=0x5608bc242d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:06.381 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.375+0000 7f91f1540b80 1 -- 172.21.15.73:0/3225089505 shutdown_connections 2023-08-10T12:05:06.382 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.375+0000 7f91f1540b80 1 -- 172.21.15.73:0/3225089505 wait complete. 2023-08-10T12:05:06.382 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.375+0000 7f91f1540b80 1 -- start start 2023-08-10T12:05:06.382 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.375+0000 7f91f1540b80 1 Processor -- start 2023-08-10T12:05:06.382 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.375+0000 7f91f1540b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608bc248550 0x5608bc254340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:06.382 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.375+0000 7f91f1540b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5608bc24da40 0x5608bc2515c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:06.382 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.376+0000 7f91f1540b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608bc24e360 0x5608bc251c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:06.382 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.376+0000 7f91f1540b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608bc199740 con 0x5608bc24da40 2023-08-10T12:05:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.376+0000 7f91f1540b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608bc138a60 con 0x5608bc24e360 2023-08-10T12:05:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.376+0000 7f91f1540b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608bc138760 con 0x5608bc248550 2023-08-10T12:05:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.376+0000 7f91f1540b80 10 client.0 _ll_register_callbacks cb 0x5608bc136620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:05:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.376+0000 7f91deffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608bc248550 0x5608bc254340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.376+0000 7f91deffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608bc248550 0x5608bc254340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:34272/0 (socket says 172.21.15.73:34272) 2023-08-10T12:05:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.376+0000 7f91deffd700 1 -- 172.21.15.73:0/47533653 learned_addr learned my addr 172.21.15.73:0/47533653 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:05:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.376+0000 7f91de7fc700 1 --2- 172.21.15.73:0/47533653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5608bc24da40 0x5608bc2515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.376+0000 7f91df7fe700 1 --2- 172.21.15.73:0/47533653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608bc24e360 0x5608bc251c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.376+0000 7f91deffd700 1 -- 172.21.15.73:0/47533653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608bc24e360 msgr2=0x5608bc251c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:05:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.376+0000 7f91deffd700 1 --2- 172.21.15.73:0/47533653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608bc24e360 0x5608bc251c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.376+0000 7f91deffd700 1 -- 172.21.15.73:0/47533653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5608bc24da40 msgr2=0x5608bc2515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:05:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.376+0000 7f91deffd700 1 --2- 172.21.15.73:0/47533653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5608bc24da40 0x5608bc2515c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.376+0000 7f91deffd700 1 -- 172.21.15.73:0/47533653 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e01a9cf0 con 0x5608bc248550 2023-08-10T12:05:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.376+0000 7f91deffd700 1 --2- 172.21.15.73:0/47533653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608bc248550 0x5608bc254340 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f91d8008b30 tx=0x7f91d8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e41d9f2e99088b11 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.376+0000 7f91c67fc700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-08-10T12:05:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.377+0000 7f91c67fc700 1 -- 172.21.15.73:0/47533653 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d801c040 con 0x5608bc248550 2023-08-10T12:05:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.377+0000 7f91f1540b80 1 -- 172.21.15.73:0/47533653 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5608bc23b1c0 con 0x5608bc248550 2023-08-10T12:05:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.377+0000 7f91c67fc700 1 -- 172.21.15.73:0/47533653 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f91d8008e40 con 0x5608bc248550 2023-08-10T12:05:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.377+0000 7f91c67fc700 1 -- 172.21.15.73:0/47533653 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91d8017ce0 con 0x5608bc248550 2023-08-10T12:05:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.377+0000 7f91f1540b80 10 client.26602 fetch_fsmap learned FSMap version 58 2023-08-10T12:05:06.386 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.377+0000 7f91f1540b80 1 -- 172.21.15.73:0/47533653 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x5608bbfc6d80 con 0x5608bc248550 2023-08-10T12:05:06.386 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.377+0000 7f91c67fc700 1 -- 172.21.15.73:0/47533653 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5608bc23b1c0 con 0x5608bc248550 2023-08-10T12:05:06.386 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.377+0000 7f91c67fc700 1 -- 172.21.15.73:0/47533653 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 58) v1 ==== 6981+0+0 (secure 0 0 0) 0x7f91d80154a0 con 0x5608bc248550 2023-08-10T12:05:06.386 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.377+0000 7f91f1540b80 10 client.26602 fetch_fsmap finished waiting for FSMap version 58 2023-08-10T12:05:06.386 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.377+0000 7f91f1540b80 10 client.26602 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:05:06.386 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.377+0000 7f91f1540b80 20 client.26602 populate_metadata read hostname 'smithi073' 2023-08-10T12:05:06.386 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.377+0000 7f91f1540b80 1 --2- 172.21.15.73:0/47533653 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5608bc261bd0 0x5608bc263ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:06.386 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.377+0000 7f91f1540b80 4 client.26602 mds_command: new command op to 24503 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T12:05:06.387 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.377+0000 7f91f1540b80 1 -- 172.21.15.73:0/47533653 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5608bc217970 con 0x5608bc261bd0 2023-08-10T12:05:06.387 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.378+0000 7f91de7fc700 1 --2- 172.21.15.73:0/47533653 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5608bc261bd0 0x5608bc263ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:06.387 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.378+0000 7f91de7fc700 1 --2- 172.21.15.73:0/47533653 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5608bc261bd0 0x5608bc263ff0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5da77a18c5e57ce4 server_cookie=9af8847b77a3e8b4 in_seq=0 out_seq=0 2023-08-10T12:05:06.387 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.378+0000 7f91c67fc700 10 client.26602 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:05:06.387 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.379+0000 7f91c67fc700 1 -- 172.21.15.73:0/47533653 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5608bc217970 con 0x5608bc261bd0 2023-08-10T12:05:06.387 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.379+0000 7f91c67fc700 10 client.26602 handle_command_reply: tid=0 2023-08-10T12:05:06.387 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.379+0000 7f91f1540b80 1 client.26602 shutdown 2023-08-10T12:05:06.388 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.379+0000 7f91f1540b80 1 -- 172.21.15.73:0/47533653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608bc248550 msgr2=0x5608bc254340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.379+0000 7f91f1540b80 1 --2- 172.21.15.73:0/47533653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608bc248550 0x5608bc254340 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f91d8008b30 tx=0x7f91d8004ad0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.379+0000 7f91f1540b80 1 -- 172.21.15.73:0/47533653 shutdown_connections 2023-08-10T12:05:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.379+0000 7f91f1540b80 1 --2- 172.21.15.73:0/47533653 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5608bc261bd0 0x5608bc263ff0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.379+0000 7f91f1540b80 1 --2- 172.21.15.73:0/47533653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608bc24e360 0x5608bc251c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.379+0000 7f91f1540b80 1 --2- 172.21.15.73:0/47533653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608bc248550 0x5608bc254340 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.379+0000 7f91f1540b80 1 --2- 172.21.15.73:0/47533653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5608bc24da40 0x5608bc2515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.379+0000 7f91f1540b80 1 -- 172.21.15.73:0/47533653 >> 172.21.15.73:0/47533653 conn(0x5608bc1a5c70 msgr2=0x5608bc2424b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.379+0000 7f91c67fc700 0 client.26602 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:05:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.379+0000 7f91f1540b80 1 -- 172.21.15.73:0/47533653 shutdown_connections 2023-08-10T12:05:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.379+0000 7f91f1540b80 1 -- 172.21.15.73:0/47533653 wait complete. 2023-08-10T12:05:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.380+0000 7f91f1540b80 20 client.26602 trim_cache size 0 max 16384 2023-08-10T12:05:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.399+0000 7f91f1540b80 1 Processor -- start 2023-08-10T12:05:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.399+0000 7f91f1540b80 1 -- start start 2023-08-10T12:05:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.399+0000 7f91f1540b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5608bc248550 0x5608bc258b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.399+0000 7f91f1540b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608bc24da40 0x5608bc250d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.399+0000 7f91f1540b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608bc24e360 0x5608bc242c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.399+0000 7f91f1540b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608bc01c8c0 con 0x5608bc248550 2023-08-10T12:05:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.399+0000 7f91f1540b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608bc244480 con 0x5608bc24da40 2023-08-10T12:05:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.399+0000 7f91f1540b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608bc23ad80 con 0x5608bc24e360 2023-08-10T12:05:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.400+0000 7f91deffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5608bc248550 0x5608bc258b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.400+0000 7f91deffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5608bc248550 0x5608bc258b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37010/0 (socket says 172.21.15.73:37010) 2023-08-10T12:05:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.400+0000 7f91deffd700 1 -- 172.21.15.73:0/885075286 learned_addr learned my addr 172.21.15.73:0/885075286 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:05:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.400+0000 7f91de7fc700 1 --2- 172.21.15.73:0/885075286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608bc24da40 0x5608bc250d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.400+0000 7f91df7fe700 1 --2- 172.21.15.73:0/885075286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608bc24e360 0x5608bc242c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.400+0000 7f91deffd700 1 -- 172.21.15.73:0/885075286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608bc24e360 msgr2=0x5608bc242c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:05:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.400+0000 7f91deffd700 1 --2- 172.21.15.73:0/885075286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608bc24e360 0x5608bc242c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.400+0000 7f91deffd700 1 -- 172.21.15.73:0/885075286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608bc24da40 msgr2=0x5608bc250d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:05:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.400+0000 7f91deffd700 1 --2- 172.21.15.73:0/885075286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608bc24da40 0x5608bc250d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.400+0000 7f91deffd700 1 -- 172.21.15.73:0/885075286 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608bbfafc00 con 0x5608bc248550 2023-08-10T12:05:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.400+0000 7f91deffd700 1 --2- 172.21.15.73:0/885075286 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5608bc248550 0x5608bc258b80 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f91d8015800 tx=0x7f91d80159a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de15abd5493832b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.400+0000 7f91d5ffb700 1 -- 172.21.15.73:0/885075286 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d8015af0 con 0x5608bc248550 2023-08-10T12:05:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.400+0000 7f91d5ffb700 1 -- 172.21.15.73:0/885075286 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91d800f040 con 0x5608bc248550 2023-08-10T12:05:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.400+0000 7f91d5ffb700 1 -- 172.21.15.73:0/885075286 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d802c6a0 con 0x5608bc248550 2023-08-10T12:05:06.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.401+0000 7f91f1540b80 1 -- 172.21.15.73:0/885075286 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5608bc248550 msgr2=0x5608bc258b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:06.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.401+0000 7f91f1540b80 1 --2- 172.21.15.73:0/885075286 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5608bc248550 0x5608bc258b80 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f91d8015800 tx=0x7f91d80159a0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.408 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.401+0000 7f91f1540b80 1 -- 172.21.15.73:0/885075286 shutdown_connections 2023-08-10T12:05:06.409 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.401+0000 7f91f1540b80 1 --2- 172.21.15.73:0/885075286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608bc24e360 0x5608bc242c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.409 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.401+0000 7f91f1540b80 1 --2- 172.21.15.73:0/885075286 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5608bc248550 0x5608bc258b80 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.409 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.401+0000 7f91f1540b80 1 --2- 172.21.15.73:0/885075286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608bc24da40 0x5608bc250d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.409 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.401+0000 7f91f1540b80 1 -- 172.21.15.73:0/885075286 >> 172.21.15.73:0/885075286 conn(0x5608bc1a5c70 msgr2=0x5608bc24b750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:06.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.401+0000 7f91f1540b80 1 -- 172.21.15.73:0/885075286 shutdown_connections 2023-08-10T12:05:06.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.401+0000 7f91f1540b80 1 -- 172.21.15.73:0/885075286 wait complete. 2023-08-10T12:05:06.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.402+0000 7f91f1540b80 1 -- start start 2023-08-10T12:05:06.410 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.402+0000 7f91f1540b80 1 Processor -- start 2023-08-10T12:05:06.411 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.402+0000 7f91f1540b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608bc248550 0x5608bc249510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:06.411 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.402+0000 7f91f1540b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608bc24da40 0x5608bc249a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:06.411 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.402+0000 7f91f1540b80 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5608bc24e360 0x5608bc249fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:06.411 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.402+0000 7f91f1540b80 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608bc24a6e0 con 0x5608bc24e360 2023-08-10T12:05:06.412 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.402+0000 7f91f1540b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608bc24a850 con 0x5608bc24da40 2023-08-10T12:05:06.412 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.402+0000 7f91f1540b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608bc24aa10 con 0x5608bc248550 2023-08-10T12:05:06.412 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.402+0000 7f91f1540b80 10 client.0 _ll_register_callbacks cb 0x5608bc136620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T12:05:06.413 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.403+0000 7f91df7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5608bc24e360 0x5608bc249fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:06.413 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.403+0000 7f91de7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608bc24da40 0x5608bc249a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:06.413 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.403+0000 7f91de7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608bc24da40 0x5608bc249a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.73:51666/0 (socket says 172.21.15.73:51666) 2023-08-10T12:05:06.413 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.403+0000 7f91df7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5608bc24e360 0x5608bc249fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37018/0 (socket says 172.21.15.73:37018) 2023-08-10T12:05:06.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.403+0000 7f91de7fc700 1 -- 172.21.15.73:0/4057210495 learned_addr learned my addr 172.21.15.73:0/4057210495 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:05:06.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.403+0000 7f91de7fc700 1 -- 172.21.15.73:0/4057210495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608bc248550 msgr2=0x5608bc249510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:05:06.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.403+0000 7f91de7fc700 1 --2- 172.21.15.73:0/4057210495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608bc248550 0x5608bc249510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.414 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.403+0000 7f91de7fc700 1 -- 172.21.15.73:0/4057210495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5608bc24e360 msgr2=0x5608bc249fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T12:05:06.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.403+0000 7f91de7fc700 1 --2- 172.21.15.73:0/4057210495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5608bc24e360 0x5608bc249fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.403+0000 7f91de7fc700 1 -- 172.21.15.73:0/4057210495 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5608bbfc6d80 con 0x5608bc24da40 2023-08-10T12:05:06.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.403+0000 7f91de7fc700 1 --2- 172.21.15.73:0/4057210495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608bc24da40 0x5608bc249a50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009940 tx=0x7f91c8009e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb7f5e9c603e3c41 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:06.415 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.403+0000 7f91c67fc700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-08-10T12:05:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.403+0000 7f91c67fc700 1 -- 172.21.15.73:0/4057210495 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c801b040 con 0x5608bc24da40 2023-08-10T12:05:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.403+0000 7f91f1540b80 1 -- 172.21.15.73:0/4057210495 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f91d009ec60 con 0x5608bc24da40 2023-08-10T12:05:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.403+0000 7f91c67fc700 1 -- 172.21.15.73:0/4057210495 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f91c8016b70 con 0x5608bc24da40 2023-08-10T12:05:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.404+0000 7f91c67fc700 1 -- 172.21.15.73:0/4057210495 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91c8016d50 con 0x5608bc24da40 2023-08-10T12:05:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.404+0000 7f91f1540b80 10 client.26543 fetch_fsmap learned FSMap version 58 2023-08-10T12:05:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.404+0000 7f91f1540b80 1 -- 172.21.15.73:0/4057210495 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x5608bbfed1f0 con 0x5608bc24da40 2023-08-10T12:05:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.404+0000 7f91c67fc700 1 -- 172.21.15.73:0/4057210495 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91c802f080 con 0x5608bc24da40 2023-08-10T12:05:06.418 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.404+0000 7f91c67fc700 1 -- 172.21.15.73:0/4057210495 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 58) v1 ==== 6981+0+0 (secure 0 0 0) 0x7f91c802b410 con 0x5608bc24da40 2023-08-10T12:05:06.418 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.404+0000 7f91f1540b80 10 client.26543 fetch_fsmap finished waiting for FSMap version 58 2023-08-10T12:05:06.418 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.404+0000 7f91f1540b80 10 client.26543 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-08-10T12:05:06.418 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.404+0000 7f91f1540b80 20 client.26543 populate_metadata read hostname 'smithi073' 2023-08-10T12:05:06.418 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.404+0000 7f91f1540b80 1 --2- 172.21.15.73:0/4057210495 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5608bc2b66c0 0x5608bc2b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.404+0000 7f91f1540b80 4 client.26543 mds_command: new command op to 24503 tid=0[{"prefix": "flush journal"}] 2023-08-10T12:05:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.404+0000 7f91f1540b80 1 -- 172.21.15.73:0/4057210495 --> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5608bc192720 con 0x5608bc2b66c0 2023-08-10T12:05:06.420 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.404+0000 7f91deffd700 1 --2- 172.21.15.73:0/4057210495 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5608bc2b66c0 0x5608bc2b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:06.420 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.405+0000 7f91deffd700 1 --2- 172.21.15.73:0/4057210495 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5608bc2b66c0 0x5608bc2b8ae0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=954c8205cea90c6c server_cookie=43c9492f18a380b7 in_seq=0 out_seq=0 2023-08-10T12:05:06.420 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.410+0000 7f91c67fc700 10 client.26543 ms_handle_connect on v2:172.21.15.152:6838/3870202690 2023-08-10T12:05:06.432 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.430+0000 7f91c67fc700 1 -- 172.21.15.73:0/4057210495 <== mds.0 v2:172.21.15.152:6838/3870202690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5608bc192720 con 0x5608bc2b66c0 2023-08-10T12:05:06.432 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.430+0000 7f91c67fc700 10 client.26543 handle_command_reply: tid=0 2023-08-10T12:05:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.430+0000 7f91f1540b80 1 client.26543 shutdown 2023-08-10T12:05:06.434 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.431+0000 7f91f1540b80 1 -- 172.21.15.73:0/4057210495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608bc24da40 msgr2=0x5608bc249a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:06.434 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.431+0000 7f91f1540b80 1 --2- 172.21.15.73:0/4057210495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608bc24da40 0x5608bc249a50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009940 tx=0x7f91c8009e90 comp rx=0 tx=0).stop 2023-08-10T12:05:06.434 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.431+0000 7f91f1540b80 1 -- 172.21.15.73:0/4057210495 shutdown_connections 2023-08-10T12:05:06.435 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.431+0000 7f91f1540b80 1 --2- 172.21.15.73:0/4057210495 >> [v2:172.21.15.152:6838/3870202690,v1:172.21.15.152:6839/3870202690] conn(0x5608bc2b66c0 0x5608bc2b8ae0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.435 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.431+0000 7f91f1540b80 1 --2- 172.21.15.73:0/4057210495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5608bc24e360 0x5608bc249fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.435 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.431+0000 7f91f1540b80 1 --2- 172.21.15.73:0/4057210495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608bc248550 0x5608bc249510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.435 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.431+0000 7f91c67fc700 0 client.26543 ms_handle_reset on v2:172.21.15.152:6838/3870202690 2023-08-10T12:05:06.435 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.431+0000 7f91f1540b80 1 --2- 172.21.15.73:0/4057210495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5608bc24da40 0x5608bc249a50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.435 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.431+0000 7f91f1540b80 1 -- 172.21.15.73:0/4057210495 >> 172.21.15.73:0/4057210495 conn(0x5608bc1a5c70 msgr2=0x5608bc24c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:06.436 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.431+0000 7f91f1540b80 1 -- 172.21.15.73:0/4057210495 shutdown_connections 2023-08-10T12:05:06.436 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.431+0000 7f91f1540b80 1 -- 172.21.15.73:0/4057210495 wait complete. 2023-08-10T12:05:06.436 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.431+0000 7f91f1540b80 20 client.26543 trim_cache size 0 max 16384 2023-08-10T12:05:06.436 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:{ 2023-08-10T12:05:06.436 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "message": "", 2023-08-10T12:05:06.437 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout: "return_code": 0 2023-08-10T12:05:06.437 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stdout:} 2023-08-10T12:05:06.437 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.432+0000 7f91e53a7700 1 -- 172.21.15.73:0/4236521518 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f91cc0a1410 msgr2=0x7f91cc0a38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:06.437 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.432+0000 7f91e53a7700 1 --2- 172.21.15.73:0/4236521518 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f91cc0a1410 0x7f91cc0a38d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f91d8009fd0 tx=0x7f91d800b040 comp rx=0 tx=0).stop 2023-08-10T12:05:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.432+0000 7f91e53a7700 1 -- 172.21.15.73:0/4236521518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91e0105650 msgr2=0x7f91e010d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.432+0000 7f91e53a7700 1 --2- 172.21.15.73:0/4236521518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91e0105650 0x7f91e010d960 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f91d0009fd0 tx=0x7f91d000fa00 comp rx=0 tx=0).stop 2023-08-10T12:05:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.432+0000 7f91e53a7700 1 -- 172.21.15.73:0/4236521518 shutdown_connections 2023-08-10T12:05:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.432+0000 7f91e53a7700 1 --2- 172.21.15.73:0/4236521518 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f91cc0a1410 0x7f91cc0a38d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.432+0000 7f91e53a7700 1 --2- 172.21.15.73:0/4236521518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91e00ff640 0x7f91e010cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.432+0000 7f91e53a7700 1 --2- 172.21.15.73:0/4236521518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91e0105650 0x7f91e010d960 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.432+0000 7f91e53a7700 1 --2- 172.21.15.73:0/4236521518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91e0100000 0x7f91e010d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.432+0000 7f91e53a7700 1 -- 172.21.15.73:0/4236521518 >> 172.21.15.73:0/4236521518 conn(0x7f91e00fb150 msgr2=0x7f91e0103150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.432+0000 7f91e53a7700 1 -- 172.21.15.73:0/4236521518 shutdown_connections 2023-08-10T12:05:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi073.front.sepia.ceph.com.smithi073.stderr:2023-08-10T12:05:06.432+0000 7f91e53a7700 1 -- 172.21.15.73:0/4236521518 wait complete. 2023-08-10T12:05:07.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:07 smithi152 ceph-mon[130220]: pgmap v389: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 460 op/s 2023-08-10T12:05:07.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:07 smithi156 ceph-mon[130574]: pgmap v389: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 460 op/s 2023-08-10T12:05:07.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:07 smithi073 ceph-mon[128869]: pgmap v389: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 460 op/s 2023-08-10T12:05:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:09 smithi152 ceph-mon[130220]: pgmap v390: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 316 op/s 2023-08-10T12:05:09.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:09 smithi156 ceph-mon[130574]: pgmap v390: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 316 op/s 2023-08-10T12:05:09.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:09 smithi073 ceph-mon[128869]: pgmap v390: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 316 op/s 2023-08-10T12:05:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:11 smithi152 ceph-mon[130220]: pgmap v391: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.8 MiB/s wr, 344 op/s 2023-08-10T12:05:11.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:11 smithi156 ceph-mon[130574]: pgmap v391: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.8 MiB/s wr, 344 op/s 2023-08-10T12:05:11.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:11 smithi073 ceph-mon[128869]: pgmap v391: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.8 MiB/s wr, 344 op/s 2023-08-10T12:05:13.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:13 smithi152 ceph-mon[130220]: pgmap v392: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.8 MiB/s wr, 368 op/s 2023-08-10T12:05:13.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:13 smithi156 ceph-mon[130574]: pgmap v392: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.8 MiB/s wr, 368 op/s 2023-08-10T12:05:13.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:13 smithi073 ceph-mon[128869]: pgmap v392: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.8 MiB/s wr, 368 op/s 2023-08-10T12:05:15.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:14 smithi152 ceph-mon[130220]: pgmap v393: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 308 op/s 2023-08-10T12:05:15.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:14 smithi156 ceph-mon[130574]: pgmap v393: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 308 op/s 2023-08-10T12:05:15.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:14 smithi073 ceph-mon[128869]: pgmap v393: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 308 op/s 2023-08-10T12:05:17.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:17 smithi152 ceph-mon[130220]: pgmap v394: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.7 MiB/s wr, 384 op/s 2023-08-10T12:05:17.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:17 smithi156 ceph-mon[130574]: pgmap v394: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.7 MiB/s wr, 384 op/s 2023-08-10T12:05:17.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:17 smithi073 ceph-mon[128869]: pgmap v394: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.7 MiB/s wr, 384 op/s 2023-08-10T12:05:18.256 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2023-08-10T12:05:18.256 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-08-10T12:05:18.629 DEBUG:teuthology.parallel:result is None 2023-08-10T12:05:18.630 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-08-10T12:05:18.709 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-08-10T12:05:18.709 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2023-08-10T12:05:18.720 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi073.front.sepia.ceph.com 2023-08-10T12:05:18.729 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2023-08-10T12:05:18.740 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2023-08-10T12:05:18.741 INFO:teuthology.task.exec:Executing custom commands... 2023-08-10T12:05:18.741 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi073.front.sepia.ceph.com 2023-08-10T12:05:18.741 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2023-08-10T12:05:18.804 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2023-08-10T12:05:18.880 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-08-10T12:05:19.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.051+0000 7f62533b4700 1 -- 172.21.15.73:0/1309768601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f624c104940 msgr2=0x7f624c10c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:19.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.051+0000 7f62533b4700 1 --2- 172.21.15.73:0/1309768601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f624c104940 0x7f624c10c550 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f624400b0d0 tx=0x7f624400b3e0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.051+0000 7f62533b4700 1 -- 172.21.15.73:0/1309768601 shutdown_connections 2023-08-10T12:05:19.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.051+0000 7f62533b4700 1 --2- 172.21.15.73:0/1309768601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f624c0ffff0 0x7f624c1003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.051+0000 7f62533b4700 1 --2- 172.21.15.73:0/1309768601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f624c104940 0x7f624c10c550 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.051+0000 7f62533b4700 1 --2- 172.21.15.73:0/1309768601 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f624c1009a0 0x7f624c104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.051+0000 7f62533b4700 1 -- 172.21.15.73:0/1309768601 >> 172.21.15.73:0/1309768601 conn(0x7f624c076b40 msgr2=0x7f624c0fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:19.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.051+0000 7f62533b4700 1 -- 172.21.15.73:0/1309768601 shutdown_connections 2023-08-10T12:05:19.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.051+0000 7f62533b4700 1 -- 172.21.15.73:0/1309768601 wait complete. 2023-08-10T12:05:19.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.052+0000 7f62533b4700 1 Processor -- start 2023-08-10T12:05:19.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.052+0000 7f62533b4700 1 -- start start 2023-08-10T12:05:19.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.052+0000 7f62533b4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f624c0ffff0 0x7f624c1978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:19.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.052+0000 7f62533b4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f624c104940 0x7f624c197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:19.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.052+0000 7f62533b4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f624c1a0760 0x7f624c1a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:19.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.052+0000 7f62533b4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c1a3120 con 0x7f624c1a0760 2023-08-10T12:05:19.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.052+0000 7f62533b4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c1a3290 con 0x7f624c104940 2023-08-10T12:05:19.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.052+0000 7f62533b4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c1a3450 con 0x7f624c0ffff0 2023-08-10T12:05:19.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.052+0000 7f6251951700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f624c1a0760 0x7f624c1a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:19.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.052+0000 7f6251150700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f624c0ffff0 0x7f624c1978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:19.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.052+0000 7f6251951700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f624c1a0760 0x7f624c1a2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37032/0 (socket says 172.21.15.73:37032) 2023-08-10T12:05:19.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.052+0000 7f6251951700 1 -- 172.21.15.73:0/3109308021 learned_addr learned my addr 172.21.15.73:0/3109308021 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:05:19.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.052+0000 7f625094f700 1 --2- 172.21.15.73:0/3109308021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f624c104940 0x7f624c197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:19.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.052+0000 7f6251951700 1 -- 172.21.15.73:0/3109308021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f624c0ffff0 msgr2=0x7f624c1978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:19.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.052+0000 7f6251951700 1 --2- 172.21.15.73:0/3109308021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f624c0ffff0 0x7f624c1978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.052+0000 7f6251951700 1 -- 172.21.15.73:0/3109308021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f624c104940 msgr2=0x7f624c197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:19.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.052+0000 7f6251951700 1 --2- 172.21.15.73:0/3109308021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f624c104940 0x7f624c197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.053+0000 7f6251951700 1 -- 172.21.15.73:0/3109308021 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6244009d00 con 0x7f624c1a0760 2023-08-10T12:05:19.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.053+0000 7f625094f700 1 --2- 172.21.15.73:0/3109308021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f624c104940 0x7f624c197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T12:05:19.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.053+0000 7f6251951700 1 --2- 172.21.15.73:0/3109308021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f624c1a0760 0x7f624c1a2b50 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f6244004c80 tx=0x7f6244004cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:19.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.053+0000 7f62427fc700 1 -- 172.21.15.73:0/3109308021 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624400e040 con 0x7f624c1a0760 2023-08-10T12:05:19.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.053+0000 7f62427fc700 1 -- 172.21.15.73:0/3109308021 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f62440094c0 con 0x7f624c1a0760 2023-08-10T12:05:19.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.053+0000 7f62533b4700 1 -- 172.21.15.73:0/3109308021 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f624c1a36d0 con 0x7f624c1a0760 2023-08-10T12:05:19.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.053+0000 7f62427fc700 1 -- 172.21.15.73:0/3109308021 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62440052a0 con 0x7f624c1a0760 2023-08-10T12:05:19.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.053+0000 7f62533b4700 1 -- 172.21.15.73:0/3109308021 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f624c1a3b50 con 0x7f624c1a0760 2023-08-10T12:05:19.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.054+0000 7f62533b4700 1 -- 172.21.15.73:0/3109308021 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624c0fe5a0 con 0x7f624c1a0760 2023-08-10T12:05:19.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.055+0000 7f62427fc700 1 -- 172.21.15.73:0/3109308021 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f624401d470 con 0x7f624c1a0760 2023-08-10T12:05:19.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.055+0000 7f62427fc700 1 --2- 172.21.15.73:0/3109308021 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f62380a12f0 0x7f62380a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:19.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.056+0000 7f6251150700 1 --2- 172.21.15.73:0/3109308021 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f62380a12f0 0x7f62380a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:19.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.056+0000 7f62427fc700 1 -- 172.21.15.73:0/3109308021 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f62440ceba0 con 0x7f624c1a0760 2023-08-10T12:05:19.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.056+0000 7f6251150700 1 --2- 172.21.15.73:0/3109308021 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f62380a12f0 0x7f62380a37b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f623c007c60 tx=0x7f623c0073d0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:19.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.059+0000 7f62427fc700 1 -- 172.21.15.73:0/3109308021 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f6244098160 con 0x7f624c1a0760 2023-08-10T12:05:19.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:19 smithi073 ceph-mon[128869]: pgmap v395: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.1 MiB/s wr, 292 op/s 2023-08-10T12:05:19.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.278+0000 7f62533b4700 1 -- 172.21.15.73:0/3109308021 --> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f624c1009a0 con 0x7f62380a12f0 2023-08-10T12:05:19.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.285+0000 7f62427fc700 1 -- 172.21.15.73:0/3109308021 <== mgr.25060 v2:172.21.15.73:6800/807677460 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+335 (secure 0 0 0) 0x7f624c1009a0 con 0x7f62380a12f0 2023-08-10T12:05:19.287 INFO:teuthology.orchestra.run.smithi073.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1M", "retention": {"h": 3, "M": 6}, "start": "2023-08-10T00:00:00", "created": "2023-08-10T11:52:38", "first": "2023-08-10T11:53:00", "last": "2023-08-10T12:05:00", "last_pruned": "2023-08-10T12:04:01", "created_count": 13, "pruned_count": 6, "active": true} 2023-08-10T12:05:19.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.287+0000 7f62533b4700 1 -- 172.21.15.73:0/3109308021 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f62380a12f0 msgr2=0x7f62380a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:19.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.287+0000 7f62533b4700 1 --2- 172.21.15.73:0/3109308021 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f62380a12f0 0x7f62380a37b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f623c007c60 tx=0x7f623c0073d0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.287+0000 7f62533b4700 1 -- 172.21.15.73:0/3109308021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f624c1a0760 msgr2=0x7f624c1a2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:19.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.287+0000 7f62533b4700 1 --2- 172.21.15.73:0/3109308021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f624c1a0760 0x7f624c1a2b50 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f6244004c80 tx=0x7f6244004cb0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.287+0000 7f62533b4700 1 -- 172.21.15.73:0/3109308021 shutdown_connections 2023-08-10T12:05:19.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.287+0000 7f62533b4700 1 --2- 172.21.15.73:0/3109308021 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f62380a12f0 0x7f62380a37b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.287+0000 7f62533b4700 1 --2- 172.21.15.73:0/3109308021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f624c1a0760 0x7f624c1a2b50 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.287+0000 7f62533b4700 1 --2- 172.21.15.73:0/3109308021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f624c0ffff0 0x7f624c1978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.287+0000 7f62533b4700 1 --2- 172.21.15.73:0/3109308021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f624c104940 0x7f624c197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.287+0000 7f62533b4700 1 -- 172.21.15.73:0/3109308021 >> 172.21.15.73:0/3109308021 conn(0x7f624c076b40 msgr2=0x7f624c103160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:19.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.287+0000 7f62533b4700 1 -- 172.21.15.73:0/3109308021 shutdown_connections 2023-08-10T12:05:19.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.287+0000 7f62533b4700 1 -- 172.21.15.73:0/3109308021 wait complete. 2023-08-10T12:05:19.301 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-08-10T12:05:19.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.422+0000 7fccba1c7700 1 -- 172.21.15.73:0/3064759239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccb40ff5f0 msgr2=0x7fccb40ffa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:19.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.422+0000 7fccba1c7700 1 --2- 172.21.15.73:0/3064759239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccb40ff5f0 0x7fccb40ffa70 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fcca8009990 tx=0x7fcca8009ca0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.422+0000 7fccba1c7700 1 -- 172.21.15.73:0/3064759239 shutdown_connections 2023-08-10T12:05:19.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.422+0000 7fccba1c7700 1 --2- 172.21.15.73:0/3064759239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fccb40fffb0 0x7fccb410c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.422+0000 7fccba1c7700 1 --2- 172.21.15.73:0/3064759239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fccb4105690 0x7fccb4105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.422+0000 7fccba1c7700 1 --2- 172.21.15.73:0/3064759239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccb40ff5f0 0x7fccb40ffa70 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.422+0000 7fccba1c7700 1 -- 172.21.15.73:0/3064759239 >> 172.21.15.73:0/3064759239 conn(0x7fccb40fb0a0 msgr2=0x7fccb40fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:19.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.422+0000 7fccba1c7700 1 -- 172.21.15.73:0/3064759239 shutdown_connections 2023-08-10T12:05:19.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.422+0000 7fccba1c7700 1 -- 172.21.15.73:0/3064759239 wait complete. 2023-08-10T12:05:19.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.423+0000 7fccba1c7700 1 Processor -- start 2023-08-10T12:05:19.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.423+0000 7fccba1c7700 1 -- start start 2023-08-10T12:05:19.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.423+0000 7fccba1c7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccb40ff5f0 0x7fccb419c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:19.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.423+0000 7fccba1c7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fccb40fffb0 0x7fccb419cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:19.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.423+0000 7fccba1c7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fccb4105690 0x7fccb4196570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:19.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.423+0000 7fccba1c7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb4196be0 con 0x7fccb40ff5f0 2023-08-10T12:05:19.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.423+0000 7fccba1c7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb4196d50 con 0x7fccb40fffb0 2023-08-10T12:05:19.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.423+0000 7fccba1c7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb4196f10 con 0x7fccb4105690 2023-08-10T12:05:19.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.424+0000 7fccb37fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccb40ff5f0 0x7fccb419c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:19.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.424+0000 7fccb37fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccb40ff5f0 0x7fccb419c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37042/0 (socket says 172.21.15.73:37042) 2023-08-10T12:05:19.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.424+0000 7fccb37fe700 1 -- 172.21.15.73:0/1409447932 learned_addr learned my addr 172.21.15.73:0/1409447932 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:05:19.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.424+0000 7fccb3fff700 1 --2- 172.21.15.73:0/1409447932 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fccb4105690 0x7fccb4196570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:19.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.424+0000 7fccb2ffd700 1 --2- 172.21.15.73:0/1409447932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fccb40fffb0 0x7fccb419cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:19.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.424+0000 7fccb37fe700 1 -- 172.21.15.73:0/1409447932 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fccb4105690 msgr2=0x7fccb4196570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:19.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.424+0000 7fccb37fe700 1 --2- 172.21.15.73:0/1409447932 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fccb4105690 0x7fccb4196570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.424+0000 7fccb37fe700 1 -- 172.21.15.73:0/1409447932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fccb40fffb0 msgr2=0x7fccb419cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:19.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.424+0000 7fccb37fe700 1 --2- 172.21.15.73:0/1409447932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fccb40fffb0 0x7fccb419cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.424+0000 7fccb37fe700 1 -- 172.21.15.73:0/1409447932 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca80095f0 con 0x7fccb40ff5f0 2023-08-10T12:05:19.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.424+0000 7fccb2ffd700 1 --2- 172.21.15.73:0/1409447932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fccb40fffb0 0x7fccb419cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T12:05:19.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.424+0000 7fccb37fe700 1 --2- 172.21.15.73:0/1409447932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccb40ff5f0 0x7fccb419c710 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fcca400e970 tx=0x7fcca400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:19.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.424+0000 7fccb0ff9700 1 -- 172.21.15.73:0/1409447932 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca4009790 con 0x7fccb40ff5f0 2023-08-10T12:05:19.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.424+0000 7fccb0ff9700 1 -- 172.21.15.73:0/1409447932 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcca400eec0 con 0x7fccb40ff5f0 2023-08-10T12:05:19.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.424+0000 7fccba1c7700 1 -- 172.21.15.73:0/1409447932 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb41971f0 con 0x7fccb40ff5f0 2023-08-10T12:05:19.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.424+0000 7fccb0ff9700 1 -- 172.21.15.73:0/1409447932 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca4003cf0 con 0x7fccb40ff5f0 2023-08-10T12:05:19.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.424+0000 7fccba1c7700 1 -- 172.21.15.73:0/1409447932 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb41a3700 con 0x7fccb40ff5f0 2023-08-10T12:05:19.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.425+0000 7fccba1c7700 1 -- 172.21.15.73:0/1409447932 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb40fed30 con 0x7fccb40ff5f0 2023-08-10T12:05:19.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.426+0000 7fccb0ff9700 1 -- 172.21.15.73:0/1409447932 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fcca400ccd0 con 0x7fccb40ff5f0 2023-08-10T12:05:19.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.427+0000 7fccb0ff9700 1 --2- 172.21.15.73:0/1409447932 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fcc9c0a1340 0x7fcc9c0a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:19.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.427+0000 7fccb2ffd700 1 --2- 172.21.15.73:0/1409447932 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fcc9c0a1340 0x7fcc9c0a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:19.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.427+0000 7fccb0ff9700 1 -- 172.21.15.73:0/1409447932 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fcca4014070 con 0x7fccb40ff5f0 2023-08-10T12:05:19.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.427+0000 7fccb2ffd700 1 --2- 172.21.15.73:0/1409447932 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fcc9c0a1340 0x7fcc9c0a3800 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcca800b2e0 tx=0x7fcca8005fd0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:19.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.431+0000 7fccb0ff9700 1 -- 172.21.15.73:0/1409447932 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fcca4096380 con 0x7fccb40ff5f0 2023-08-10T12:05:19.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:19 smithi152 ceph-mon[130220]: pgmap v395: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.1 MiB/s wr, 292 op/s 2023-08-10T12:05:19.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:19 smithi156 ceph-mon[130574]: pgmap v395: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.1 MiB/s wr, 292 op/s 2023-08-10T12:05:19.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.647+0000 7fccba1c7700 1 -- 172.21.15.73:0/1409447932 --> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fccb40fd1d0 con 0x7fcc9c0a1340 2023-08-10T12:05:19.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.654+0000 7fccb0ff9700 1 -- 172.21.15.73:0/1409447932 <== mgr.25060 v2:172.21.15.73:6800/807677460 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7fccb40fd1d0 con 0x7fcc9c0a1340 2023-08-10T12:05:19.656 INFO:teuthology.orchestra.run.smithi073.stdout:/ 1M 6M3h 2023-08-10T12:05:19.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.656+0000 7fccba1c7700 1 -- 172.21.15.73:0/1409447932 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fcc9c0a1340 msgr2=0x7fcc9c0a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:19.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.656+0000 7fccba1c7700 1 --2- 172.21.15.73:0/1409447932 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fcc9c0a1340 0x7fcc9c0a3800 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcca800b2e0 tx=0x7fcca8005fd0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.656+0000 7fccba1c7700 1 -- 172.21.15.73:0/1409447932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccb40ff5f0 msgr2=0x7fccb419c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.656+0000 7fccba1c7700 1 --2- 172.21.15.73:0/1409447932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccb40ff5f0 0x7fccb419c710 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fcca400e970 tx=0x7fcca400ec80 comp rx=0 tx=0).stop 2023-08-10T12:05:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.657+0000 7fccba1c7700 1 -- 172.21.15.73:0/1409447932 shutdown_connections 2023-08-10T12:05:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.657+0000 7fccba1c7700 1 --2- 172.21.15.73:0/1409447932 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fcc9c0a1340 0x7fcc9c0a3800 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.657+0000 7fccba1c7700 1 --2- 172.21.15.73:0/1409447932 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fccb4105690 0x7fccb4196570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.657+0000 7fccba1c7700 1 --2- 172.21.15.73:0/1409447932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccb40ff5f0 0x7fccb419c710 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.657+0000 7fccba1c7700 1 --2- 172.21.15.73:0/1409447932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fccb40fffb0 0x7fccb419cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.657+0000 7fccba1c7700 1 -- 172.21.15.73:0/1409447932 >> 172.21.15.73:0/1409447932 conn(0x7fccb40fb0a0 msgr2=0x7fccb40fcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:19.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.657+0000 7fccba1c7700 1 -- 172.21.15.73:0/1409447932 shutdown_connections 2023-08-10T12:05:19.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.657+0000 7fccba1c7700 1 -- 172.21.15.73:0/1409447932 wait complete. 2023-08-10T12:05:19.670 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-08-10T12:05:19.680 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-08-10T12:05:19.681 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/fwd_scrub.py", line 164, in task File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2023-08-10T12:05:19.681 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-08-10T12:05:19.691 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T12:05:19.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.811+0000 7fafdb408700 1 -- 172.21.15.73:0/1295644029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fafd40fff90 msgr2=0x7fafd410c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:19.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.811+0000 7fafdb408700 1 --2- 172.21.15.73:0/1295644029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fafd40fff90 0x7fafd410c450 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fafcc00b0d0 tx=0x7fafcc00b3e0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.812+0000 7fafdb408700 1 -- 172.21.15.73:0/1295644029 shutdown_connections 2023-08-10T12:05:19.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.812+0000 7fafdb408700 1 --2- 172.21.15.73:0/1295644029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafd4105690 0x7fafd4105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.812+0000 7fafdb408700 1 --2- 172.21.15.73:0/1295644029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fafd40fff90 0x7fafd410c450 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.812+0000 7fafdb408700 1 --2- 172.21.15.73:0/1295644029 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafd40ff5d0 0x7fafd40ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.812+0000 7fafdb408700 1 -- 172.21.15.73:0/1295644029 >> 172.21.15.73:0/1295644029 conn(0x7fafd40fb080 msgr2=0x7fafd40fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:19.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.812+0000 7fafdb408700 1 -- 172.21.15.73:0/1295644029 shutdown_connections 2023-08-10T12:05:19.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.812+0000 7fafdb408700 1 -- 172.21.15.73:0/1295644029 wait complete. 2023-08-10T12:05:19.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.812+0000 7fafdb408700 1 Processor -- start 2023-08-10T12:05:19.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.812+0000 7fafdb408700 1 -- start start 2023-08-10T12:05:19.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.813+0000 7fafdb408700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafd40ff5d0 0x7fafd419b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:19.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.813+0000 7fafdb408700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fafd40fff90 0x7fafd419ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:19.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.813+0000 7fafdb408700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafd4105690 0x7fafd41955a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:19.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.813+0000 7fafdb408700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd4195c10 con 0x7fafd40fff90 2023-08-10T12:05:19.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.813+0000 7fafdb408700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd4195d80 con 0x7fafd40ff5d0 2023-08-10T12:05:19.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.813+0000 7fafdb408700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd4195f40 con 0x7fafd4105690 2023-08-10T12:05:19.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.813+0000 7fafd89a3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fafd40fff90 0x7fafd419ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:19.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.813+0000 7fafd89a3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fafd40fff90 0x7fafd419ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37058/0 (socket says 172.21.15.73:37058) 2023-08-10T12:05:19.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.813+0000 7fafd89a3700 1 -- 172.21.15.73:0/1012335239 learned_addr learned my addr 172.21.15.73:0/1012335239 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:05:19.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.813+0000 7fafd99a5700 1 --2- 172.21.15.73:0/1012335239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafd4105690 0x7fafd41955a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:19.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.813+0000 7fafd91a4700 1 --2- 172.21.15.73:0/1012335239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafd40ff5d0 0x7fafd419b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:19.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.813+0000 7fafd89a3700 1 -- 172.21.15.73:0/1012335239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafd4105690 msgr2=0x7fafd41955a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:19.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.813+0000 7fafd89a3700 1 --2- 172.21.15.73:0/1012335239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafd4105690 0x7fafd41955a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.813+0000 7fafd89a3700 1 -- 172.21.15.73:0/1012335239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafd40ff5d0 msgr2=0x7fafd419b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:19.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.813+0000 7fafd89a3700 1 --2- 172.21.15.73:0/1012335239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafd40ff5d0 0x7fafd419b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:19.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.813+0000 7fafd89a3700 1 -- 172.21.15.73:0/1012335239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc009d00 con 0x7fafd40fff90 2023-08-10T12:05:19.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.813+0000 7fafd89a3700 1 --2- 172.21.15.73:0/1012335239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fafd40fff90 0x7fafd419ba70 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fafc400e9a0 tx=0x7fafc400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:19.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.814+0000 7fafca7fc700 1 -- 172.21.15.73:0/1012335239 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc4009790 con 0x7fafd40fff90 2023-08-10T12:05:19.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.814+0000 7fafca7fc700 1 -- 172.21.15.73:0/1012335239 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fafc400cbd0 con 0x7fafd40fff90 2023-08-10T12:05:19.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.814+0000 7fafca7fc700 1 -- 172.21.15.73:0/1012335239 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc4018680 con 0x7fafd40fff90 2023-08-10T12:05:19.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.814+0000 7fafdb408700 1 -- 172.21.15.73:0/1012335239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd4196220 con 0x7fafd40fff90 2023-08-10T12:05:19.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.814+0000 7fafdb408700 1 -- 172.21.15.73:0/1012335239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd41a2520 con 0x7fafd40fff90 2023-08-10T12:05:19.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.815+0000 7fafdb408700 1 -- 172.21.15.73:0/1012335239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd4067560 con 0x7fafd40fff90 2023-08-10T12:05:19.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.816+0000 7fafca7fc700 1 -- 172.21.15.73:0/1012335239 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fafc400cd40 con 0x7fafd40fff90 2023-08-10T12:05:19.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.816+0000 7fafca7fc700 1 --2- 172.21.15.73:0/1012335239 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fafc00a1300 0x7fafc00a37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:19.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.817+0000 7fafca7fc700 1 -- 172.21.15.73:0/1012335239 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fafc4014070 con 0x7fafd40fff90 2023-08-10T12:05:19.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.817+0000 7fafd91a4700 1 --2- 172.21.15.73:0/1012335239 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fafc00a1300 0x7fafc00a37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:19.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.817+0000 7fafd91a4700 1 --2- 172.21.15.73:0/1012335239 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fafc00a1300 0x7fafc00a37c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fafd0005950 tx=0x7fafd00058e0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:19.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:19.820+0000 7fafca7fc700 1 -- 172.21.15.73:0/1012335239 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fafc4096660 con 0x7fafd40fff90 2023-08-10T12:05:20.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.012+0000 7fafdb408700 1 -- 172.21.15.73:0/1012335239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafd4196ab0 con 0x7fafd40fff90 2023-08-10T12:05:20.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.013+0000 7fafca7fc700 1 -- 172.21.15.73:0/1012335239 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+22949 (secure 0 0 0) 0x7fafc4099c80 con 0x7fafd40fff90 2023-08-10T12:05:20.015 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T12:05:20.015 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":98,"fsid":"0e619a74-3773-11ee-9b37-001a4aab830c","created":"2023-08-10T11:43:53.974768+0000","modified":"2023-08-10T12:04:48.887005+0000","last_up_change":"2023-08-10T11:50:12.914422+0000","last_in_change":"2023-08-10T11:49:54.624543+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T11:46:58.735153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T11:50:52.517974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T11:50:53.465357+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":19,"snap_epoch":97,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3219ae18-cc4c-4712-b616-79f6949066e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6803","nonce":2725694252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6805","nonce":2725694252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6809","nonce":2725694252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6807","nonce":2725694252}]},"public_addr":"172.21.15.73:6803/2725694252","cluster_addr":"172.21.15.73:6805/2725694252","heartbeat_back_addr":"172.21.15.73:6809/2725694252","heartbeat_front_addr":"172.21.15.73:6807/2725694252","state":["exists","up"]},{"osd":1,"uuid":"bbfe6cd9-b3d3-4b8d-8814-507a867f8c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6801","nonce":836829168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6803","nonce":836829168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6807","nonce":836829168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6805","nonce":836829168}]},"public_addr":"172.21.15.152:6801/836829168","cluster_addr":"172.21.15.152:6803/836829168","heartbeat_back_addr":"172.21.15.152:6807/836829168","heartbeat_front_addr":"172.21.15.152:6805/836829168","state":["exists","up"]},{"osd":2,"uuid":"f57f5b2c-3208-45c0-beba-8501694b99c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6801","nonce":1789212298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6803","nonce":1789212298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6807","nonce":1789212298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6805","nonce":1789212298}]},"public_addr":"172.21.15.156:6801/1789212298","cluster_addr":"172.21.15.156:6803/1789212298","heartbeat_back_addr":"172.21.15.156:6807/1789212298","heartbeat_front_addr":"172.21.15.156:6805/1789212298","state":["exists","up"]},{"osd":3,"uuid":"18592408-3696-4ab8-ad41-c172b8409829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6811","nonce":3101572649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6813","nonce":3101572649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6817","nonce":3101572649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6815","nonce":3101572649}]},"public_addr":"172.21.15.73:6811/3101572649","cluster_addr":"172.21.15.73:6813/3101572649","heartbeat_back_addr":"172.21.15.73:6817/3101572649","heartbeat_front_addr":"172.21.15.73:6815/3101572649","state":["exists","up"]},{"osd":4,"uuid":"fb3adb09-8807-42d9-8db9-1867c5fe02da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6809","nonce":1451517889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6811","nonce":1451517889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6815","nonce":1451517889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6813","nonce":1451517889}]},"public_addr":"172.21.15.152:6809/1451517889","cluster_addr":"172.21.15.152:6811/1451517889","heartbeat_back_addr":"172.21.15.152:6815/1451517889","heartbeat_front_addr":"172.21.15.152:6813/1451517889","state":["exists","up"]},{"osd":5,"uuid":"af58a7bd-4e58-4639-95b2-4a76011b61dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6809","nonce":3823368741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6811","nonce":3823368741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6815","nonce":3823368741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6813","nonce":3823368741}]},"public_addr":"172.21.15.156:6809/3823368741","cluster_addr":"172.21.15.156:6811/3823368741","heartbeat_back_addr":"172.21.15.156:6815/3823368741","heartbeat_front_addr":"172.21.15.156:6813/3823368741","state":["exists","up"]},{"osd":6,"uuid":"f6ae502d-4af9-4f6a-8636-b5b683dfdfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6819","nonce":2533620458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6821","nonce":2533620458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6825","nonce":2533620458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6823","nonce":2533620458}]},"public_addr":"172.21.15.73:6819/2533620458","cluster_addr":"172.21.15.73:6821/2533620458","heartbeat_back_addr":"172.21.15.73:6825/2533620458","heartbeat_front_addr":"172.21.15.73:6823/2533620458","state":["exists","up"]},{"osd":7,"uuid":"398fd334-5f6f-427c-95ae-3244fb466f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6817","nonce":4059538477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6819","nonce":4059538477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6823","nonce":4059538477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6821","nonce":4059538477}]},"public_addr":"172.21.15.152:6817/4059538477","cluster_addr":"172.21.15.152:6819/4059538477","heartbeat_back_addr":"172.21.15.152:6823/4059538477","heartbeat_front_addr":"172.21.15.152:6821/4059538477","state":["exists","up"]},{"osd":8,"uuid":"58f46e64-2624-4ad4-bb6a-225624153837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6817","nonce":96487555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6819","nonce":96487555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6823","nonce":96487555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6821","nonce":96487555}]},"public_addr":"172.21.15.156:6817/96487555","cluster_addr":"172.21.15.156:6819/96487555","heartbeat_back_addr":"172.21.15.156:6823/96487555","heartbeat_front_addr":"172.21.15.156:6821/96487555","state":["exists","up"]},{"osd":9,"uuid":"9389dd5b-da2d-43b6-8bc0-bb1af13f72c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6827","nonce":2050124321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6829","nonce":2050124321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6833","nonce":2050124321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6831","nonce":2050124321}]},"public_addr":"172.21.15.73:6827/2050124321","cluster_addr":"172.21.15.73:6829/2050124321","heartbeat_back_addr":"172.21.15.73:6833/2050124321","heartbeat_front_addr":"172.21.15.73:6831/2050124321","state":["exists","up"]},{"osd":10,"uuid":"563c1e34-3acd-46ab-ba36-e9d87f635e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6825","nonce":1513186350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6827","nonce":1513186350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6831","nonce":1513186350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6829","nonce":1513186350}]},"public_addr":"172.21.15.152:6825/1513186350","cluster_addr":"172.21.15.152:6827/1513186350","heartbeat_back_addr":"172.21.15.152:6831/1513186350","heartbeat_front_addr":"172.21.15.152:6829/1513186350","state":["exists","up"]},{"osd":11,"uuid":"f1b55889-14fd-4cc9-bed7-43748086fb77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6825","nonce":737904755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6827","nonce":737904755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6831","nonce":737904755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6829","nonce":737904755}]},"public_addr":"172.21.15.156:6825/737904755","cluster_addr":"172.21.15.156:6827/737904755","heartbeat_back_addr":"172.21.15.156:6831/737904755","heartbeat_front_addr":"172.21.15.156:6829/737904755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:12.023797+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:33.872883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:55.856970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:18.013196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:39.202872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:00.393920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:22.743083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:43.921728+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:05.859488+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:27.618714+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:48.880286+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:50:11.055141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6800/3797582815":"2023-08-11T11:52:37.545186+0000","172.21.15.73:0/3346699990":"2023-08-11T11:52:37.545186+0000","172.21.15.73:0/2211661782":"2023-08-11T11:52:37.545186+0000","172.21.15.73:0/4199164995":"2023-08-11T11:52:37.545186+0000","172.21.15.73:0/978777874":"2023-08-11T11:52:37.545186+0000","172.21.15.73:0/2202785670":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6800/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:6801/3797582815":"2023-08-11T11:52:37.545186+0000","172.21.15.73:6800/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/1447381524":"2023-08-11T11:44:48.401660+0000","172.21.15.73:0/2545059698":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/4193457623":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2561039569":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2927950081":"2023-08-11T11:44:48.401660+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":7,"length":1},{"begin":19,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T12:05:20.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.015+0000 7fafdb408700 1 -- 172.21.15.73:0/1012335239 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fafc00a1300 msgr2=0x7fafc00a37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:20.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.015+0000 7fafdb408700 1 --2- 172.21.15.73:0/1012335239 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fafc00a1300 0x7fafc00a37c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fafd0005950 tx=0x7fafd00058e0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.015+0000 7fafdb408700 1 -- 172.21.15.73:0/1012335239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fafd40fff90 msgr2=0x7fafd419ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:20.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.015+0000 7fafdb408700 1 --2- 172.21.15.73:0/1012335239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fafd40fff90 0x7fafd419ba70 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fafc400e9a0 tx=0x7fafc400ecb0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.015+0000 7fafdb408700 1 -- 172.21.15.73:0/1012335239 shutdown_connections 2023-08-10T12:05:20.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.015+0000 7fafdb408700 1 --2- 172.21.15.73:0/1012335239 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fafc00a1300 0x7fafc00a37c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.015+0000 7fafdb408700 1 --2- 172.21.15.73:0/1012335239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafd40ff5d0 0x7fafd419b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.015+0000 7fafdb408700 1 --2- 172.21.15.73:0/1012335239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafd4105690 0x7fafd41955a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.015+0000 7fafdb408700 1 --2- 172.21.15.73:0/1012335239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fafd40fff90 0x7fafd419ba70 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.015+0000 7fafdb408700 1 -- 172.21.15.73:0/1012335239 >> 172.21.15.73:0/1012335239 conn(0x7fafd40fb080 msgr2=0x7fafd40fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:20.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.015+0000 7fafdb408700 1 -- 172.21.15.73:0/1012335239 shutdown_connections 2023-08-10T12:05:20.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.015+0000 7fafdb408700 1 -- 172.21.15.73:0/1012335239 wait complete. 2023-08-10T12:05:20.029 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T11:46:58.735153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T11:50:52.517974+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T11:50:53.465357+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 19, 'snap_epoch': 97, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T12:05:20.030 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T12:05:20.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.155+0000 7fc0928b7700 1 -- 172.21.15.73:0/1436611144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc08c0fff90 msgr2=0x7fc08c10c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:20.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.155+0000 7fc0928b7700 1 --2- 172.21.15.73:0/1436611144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc08c0fff90 0x7fc08c10c4a0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fc08400b0a0 tx=0x7fc08400b3b0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.155+0000 7fc0928b7700 1 -- 172.21.15.73:0/1436611144 shutdown_connections 2023-08-10T12:05:20.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.155+0000 7fc0928b7700 1 --2- 172.21.15.73:0/1436611144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc08c105670 0x7fc08c105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.155+0000 7fc0928b7700 1 --2- 172.21.15.73:0/1436611144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc08c0fff90 0x7fc08c10c4a0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.155+0000 7fc0928b7700 1 --2- 172.21.15.73:0/1436611144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc08c0ff5d0 0x7fc08c0ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.155+0000 7fc0928b7700 1 -- 172.21.15.73:0/1436611144 >> 172.21.15.73:0/1436611144 conn(0x7fc08c0fb0c0 msgr2=0x7fc08c0fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:20.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.155+0000 7fc0928b7700 1 -- 172.21.15.73:0/1436611144 shutdown_connections 2023-08-10T12:05:20.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.155+0000 7fc0928b7700 1 -- 172.21.15.73:0/1436611144 wait complete. 2023-08-10T12:05:20.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.155+0000 7fc0928b7700 1 Processor -- start 2023-08-10T12:05:20.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.156+0000 7fc0928b7700 1 -- start start 2023-08-10T12:05:20.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.156+0000 7fc0928b7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc08c0ff5d0 0x7fc08c195530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:20.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.156+0000 7fc0928b7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc08c0fff90 0x7fc08c195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:20.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.156+0000 7fc0928b7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc08c105670 0x7fc08c199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:20.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.156+0000 7fc0928b7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c19a510 con 0x7fc08c0fff90 2023-08-10T12:05:20.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.156+0000 7fc0928b7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c19a680 con 0x7fc08c0ff5d0 2023-08-10T12:05:20.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.156+0000 7fc0928b7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c19a840 con 0x7fc08c105670 2023-08-10T12:05:20.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.156+0000 7fc08b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc08c0fff90 0x7fc08c195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:20.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.156+0000 7fc08b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc08c0fff90 0x7fc08c195a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37072/0 (socket says 172.21.15.73:37072) 2023-08-10T12:05:20.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.156+0000 7fc08b7fe700 1 -- 172.21.15.73:0/3499347989 learned_addr learned my addr 172.21.15.73:0/3499347989 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:05:20.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.156+0000 7fc090e54700 1 --2- 172.21.15.73:0/3499347989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc08c105670 0x7fc08c199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:20.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.156+0000 7fc08bfff700 1 --2- 172.21.15.73:0/3499347989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc08c0ff5d0 0x7fc08c195530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:20.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.156+0000 7fc08b7fe700 1 -- 172.21.15.73:0/3499347989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc08c105670 msgr2=0x7fc08c199ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:20.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.156+0000 7fc08b7fe700 1 --2- 172.21.15.73:0/3499347989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc08c105670 0x7fc08c199ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.156+0000 7fc08b7fe700 1 -- 172.21.15.73:0/3499347989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc08c0ff5d0 msgr2=0x7fc08c195530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:20.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.156+0000 7fc08b7fe700 1 --2- 172.21.15.73:0/3499347989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc08c0ff5d0 0x7fc08c195530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.156+0000 7fc08b7fe700 1 -- 172.21.15.73:0/3499347989 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc084009d00 con 0x7fc08c0fff90 2023-08-10T12:05:20.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.157+0000 7fc08b7fe700 1 --2- 172.21.15.73:0/3499347989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc08c0fff90 0x7fc08c195a70 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00e9a0 tx=0x7fc07c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:20.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.157+0000 7fc0897fa700 1 -- 172.21.15.73:0/3499347989 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c009790 con 0x7fc08c0fff90 2023-08-10T12:05:20.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.157+0000 7fc0928b7700 1 -- 172.21.15.73:0/3499347989 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08c19ab20 con 0x7fc08c0fff90 2023-08-10T12:05:20.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.157+0000 7fc0897fa700 1 -- 172.21.15.73:0/3499347989 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc07c00cbd0 con 0x7fc08c0fff90 2023-08-10T12:05:20.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.157+0000 7fc0897fa700 1 -- 172.21.15.73:0/3499347989 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c018680 con 0x7fc08c0fff90 2023-08-10T12:05:20.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.157+0000 7fc0928b7700 1 -- 172.21.15.73:0/3499347989 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc08c1a2360 con 0x7fc08c0fff90 2023-08-10T12:05:20.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.158+0000 7fc0928b7700 1 -- 172.21.15.73:0/3499347989 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc08c066c60 con 0x7fc08c0fff90 2023-08-10T12:05:20.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.159+0000 7fc0897fa700 1 -- 172.21.15.73:0/3499347989 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fc07c00cd40 con 0x7fc08c0fff90 2023-08-10T12:05:20.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.159+0000 7fc0897fa700 1 --2- 172.21.15.73:0/3499347989 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fc0780a1340 0x7fc0780a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:20.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.160+0000 7fc08bfff700 1 --2- 172.21.15.73:0/3499347989 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fc0780a1340 0x7fc0780a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:20.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.160+0000 7fc0897fa700 1 -- 172.21.15.73:0/3499347989 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc07c014070 con 0x7fc08c0fff90 2023-08-10T12:05:20.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.160+0000 7fc08bfff700 1 --2- 172.21.15.73:0/3499347989 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fc0780a1340 0x7fc0780a3800 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc074005fd0 tx=0x7fc074005e50 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:20.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.163+0000 7fc0897fa700 1 -- 172.21.15.73:0/3499347989 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fc07c096660 con 0x7fc08c0fff90 2023-08-10T12:05:20.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.351+0000 7fc0928b7700 1 -- 172.21.15.73:0/3499347989 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc08c1a25f0 con 0x7fc08c0fff90 2023-08-10T12:05:20.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.352+0000 7fc0897fa700 1 -- 172.21.15.73:0/3499347989 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc07c099c80 con 0x7fc08c0fff90 2023-08-10T12:05:20.353 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-08-10T12:05:20.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.354+0000 7fc0928b7700 1 -- 172.21.15.73:0/3499347989 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fc0780a1340 msgr2=0x7fc0780a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:20.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.354+0000 7fc0928b7700 1 --2- 172.21.15.73:0/3499347989 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fc0780a1340 0x7fc0780a3800 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc074005fd0 tx=0x7fc074005e50 comp rx=0 tx=0).stop 2023-08-10T12:05:20.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.354+0000 7fc0928b7700 1 -- 172.21.15.73:0/3499347989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc08c0fff90 msgr2=0x7fc08c195a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:20.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.354+0000 7fc0928b7700 1 --2- 172.21.15.73:0/3499347989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc08c0fff90 0x7fc08c195a70 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00e9a0 tx=0x7fc07c00ecb0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.354+0000 7fc0928b7700 1 -- 172.21.15.73:0/3499347989 shutdown_connections 2023-08-10T12:05:20.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.354+0000 7fc0928b7700 1 --2- 172.21.15.73:0/3499347989 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fc0780a1340 0x7fc0780a3800 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.354+0000 7fc0928b7700 1 --2- 172.21.15.73:0/3499347989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc08c0ff5d0 0x7fc08c195530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.354+0000 7fc0928b7700 1 --2- 172.21.15.73:0/3499347989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc08c105670 0x7fc08c199ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.354+0000 7fc0928b7700 1 --2- 172.21.15.73:0/3499347989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc08c0fff90 0x7fc08c195a70 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.354+0000 7fc0928b7700 1 -- 172.21.15.73:0/3499347989 >> 172.21.15.73:0/3499347989 conn(0x7fc08c0fb0c0 msgr2=0x7fc08c0fc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:20.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.354+0000 7fc0928b7700 1 -- 172.21.15.73:0/3499347989 shutdown_connections 2023-08-10T12:05:20.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.354+0000 7fc0928b7700 1 -- 172.21.15.73:0/3499347989 wait complete. 2023-08-10T12:05:20.367 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:20 smithi073 ceph-mon[128869]: from='client.17136 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T12:05:20.367 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:20 smithi073 ceph-mon[128869]: from='client.17142 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T12:05:20.367 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:20 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1012335239' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T12:05:20.368 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T12:05:20.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.491+0000 7f7b346b0700 1 -- 172.21.15.73:0/788328953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b2c1045e0 msgr2=0x7f7b2c1049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:20.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.491+0000 7f7b346b0700 1 --2- 172.21.15.73:0/788328953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b2c1045e0 0x7f7b2c1049c0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c009990 tx=0x7f7b1c009ca0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.491+0000 7f7b346b0700 1 -- 172.21.15.73:0/788328953 shutdown_connections 2023-08-10T12:05:20.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.491+0000 7f7b346b0700 1 --2- 172.21.15.73:0/788328953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b2c100760 0x7f7b2c10c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.491+0000 7f7b346b0700 1 --2- 172.21.15.73:0/788328953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b2c1045e0 0x7f7b2c1049c0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.491+0000 7f7b346b0700 1 --2- 172.21.15.73:0/788328953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b2c0ffda0 0x7f7b2c100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.491+0000 7f7b346b0700 1 -- 172.21.15.73:0/788328953 >> 172.21.15.73:0/788328953 conn(0x7f7b2c076be0 msgr2=0x7f7b2c0fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:20.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.491+0000 7f7b346b0700 1 -- 172.21.15.73:0/788328953 shutdown_connections 2023-08-10T12:05:20.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.491+0000 7f7b346b0700 1 -- 172.21.15.73:0/788328953 wait complete. 2023-08-10T12:05:20.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.492+0000 7f7b346b0700 1 Processor -- start 2023-08-10T12:05:20.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.492+0000 7f7b346b0700 1 -- start start 2023-08-10T12:05:20.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.492+0000 7f7b346b0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b2c0ffda0 0x7f7b2c19e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:20.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.492+0000 7f7b346b0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b2c100760 0x7f7b2c19ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:20.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.492+0000 7f7b346b0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b2c1045e0 0x7f7b2c198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:20.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.492+0000 7f7b346b0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c198e90 con 0x7f7b2c0ffda0 2023-08-10T12:05:20.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.492+0000 7f7b346b0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c199000 con 0x7f7b2c100760 2023-08-10T12:05:20.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.492+0000 7f7b346b0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c1991c0 con 0x7f7b2c1045e0 2023-08-10T12:05:20.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.492+0000 7f7b3244c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b2c0ffda0 0x7f7b2c19e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:20.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.492+0000 7f7b3244c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b2c0ffda0 0x7f7b2c19e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37084/0 (socket says 172.21.15.73:37084) 2023-08-10T12:05:20.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.492+0000 7f7b3244c700 1 -- 172.21.15.73:0/2658586798 learned_addr learned my addr 172.21.15.73:0/2658586798 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:05:20.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.492+0000 7f7b32c4d700 1 --2- 172.21.15.73:0/2658586798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b2c1045e0 0x7f7b2c198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:20.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.493+0000 7f7b31c4b700 1 --2- 172.21.15.73:0/2658586798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b2c100760 0x7f7b2c19ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:20.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.493+0000 7f7b3244c700 1 -- 172.21.15.73:0/2658586798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b2c1045e0 msgr2=0x7f7b2c198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:20.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.493+0000 7f7b3244c700 1 --2- 172.21.15.73:0/2658586798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b2c1045e0 0x7f7b2c198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.493+0000 7f7b3244c700 1 -- 172.21.15.73:0/2658586798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b2c100760 msgr2=0x7f7b2c19ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:20.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.493+0000 7f7b3244c700 1 --2- 172.21.15.73:0/2658586798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b2c100760 0x7f7b2c19ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.493+0000 7f7b3244c700 1 -- 172.21.15.73:0/2658586798 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1c0095f0 con 0x7f7b2c0ffda0 2023-08-10T12:05:20.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.493+0000 7f7b31c4b700 1 --2- 172.21.15.73:0/2658586798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b2c100760 0x7f7b2c19ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T12:05:20.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.493+0000 7f7b3244c700 1 --2- 172.21.15.73:0/2658586798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b2c0ffda0 0x7f7b2c19e7b0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c005910 tx=0x7f7b1c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:20.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.493+0000 7f7b237fe700 1 -- 172.21.15.73:0/2658586798 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c01d070 con 0x7f7b2c0ffda0 2023-08-10T12:05:20.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.493+0000 7f7b237fe700 1 -- 172.21.15.73:0/2658586798 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b1c022470 con 0x7f7b2c0ffda0 2023-08-10T12:05:20.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.493+0000 7f7b346b0700 1 -- 172.21.15.73:0/2658586798 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b2c199440 con 0x7f7b2c0ffda0 2023-08-10T12:05:20.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.493+0000 7f7b237fe700 1 -- 172.21.15.73:0/2658586798 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c017650 con 0x7f7b2c0ffda0 2023-08-10T12:05:20.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.493+0000 7f7b346b0700 1 -- 172.21.15.73:0/2658586798 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2c1a57a0 con 0x7f7b2c0ffda0 2023-08-10T12:05:20.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.494+0000 7f7b346b0700 1 -- 172.21.15.73:0/2658586798 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b2c066c60 con 0x7f7b2c0ffda0 2023-08-10T12:05:20.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:20 smithi152 ceph-mon[130220]: from='client.17136 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T12:05:20.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:20 smithi152 ceph-mon[130220]: from='client.17142 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T12:05:20.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:20 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1012335239' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T12:05:20.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.495+0000 7f7b237fe700 1 -- 172.21.15.73:0/2658586798 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f7b1c00fad0 con 0x7f7b2c0ffda0 2023-08-10T12:05:20.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.495+0000 7f7b237fe700 1 --2- 172.21.15.73:0/2658586798 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f7b180a12b0 0x7f7b180a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:20.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.496+0000 7f7b31c4b700 1 --2- 172.21.15.73:0/2658586798 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f7b180a12b0 0x7f7b180a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:20.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.496+0000 7f7b237fe700 1 -- 172.21.15.73:0/2658586798 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7b1c0ce610 con 0x7f7b2c0ffda0 2023-08-10T12:05:20.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.496+0000 7f7b31c4b700 1 --2- 172.21.15.73:0/2658586798 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f7b180a12b0 0x7f7b180a3770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7b28005fd0 tx=0x7f7b28005f60 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:20.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.499+0000 7f7b237fe700 1 -- 172.21.15.73:0/2658586798 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f7b1c097ab0 con 0x7f7b2c0ffda0 2023-08-10T12:05:20.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:20 smithi156 ceph-mon[130574]: from='client.17136 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T12:05:20.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:20 smithi156 ceph-mon[130574]: from='client.17142 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T12:05:20.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:20 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1012335239' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T12:05:20.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.688+0000 7f7b346b0700 1 -- 172.21.15.73:0/2658586798 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7b2c1a5930 con 0x7f7b2c0ffda0 2023-08-10T12:05:20.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.688+0000 7f7b237fe700 1 -- 172.21.15.73:0/2658586798 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v98) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7b1c09b0d0 con 0x7f7b2c0ffda0 2023-08-10T12:05:20.690 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-08-10T12:05:20.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.690+0000 7f7b346b0700 1 -- 172.21.15.73:0/2658586798 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f7b180a12b0 msgr2=0x7f7b180a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:20.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.690+0000 7f7b346b0700 1 --2- 172.21.15.73:0/2658586798 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f7b180a12b0 0x7f7b180a3770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7b28005fd0 tx=0x7f7b28005f60 comp rx=0 tx=0).stop 2023-08-10T12:05:20.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.690+0000 7f7b346b0700 1 -- 172.21.15.73:0/2658586798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b2c0ffda0 msgr2=0x7f7b2c19e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:20.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.690+0000 7f7b346b0700 1 --2- 172.21.15.73:0/2658586798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b2c0ffda0 0x7f7b2c19e7b0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c005910 tx=0x7f7b1c004730 comp rx=0 tx=0).stop 2023-08-10T12:05:20.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.690+0000 7f7b346b0700 1 -- 172.21.15.73:0/2658586798 shutdown_connections 2023-08-10T12:05:20.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.690+0000 7f7b346b0700 1 --2- 172.21.15.73:0/2658586798 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f7b180a12b0 0x7f7b180a3770 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.690+0000 7f7b346b0700 1 --2- 172.21.15.73:0/2658586798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b2c1045e0 0x7f7b2c198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.690+0000 7f7b346b0700 1 --2- 172.21.15.73:0/2658586798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b2c0ffda0 0x7f7b2c19e7b0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.690+0000 7f7b346b0700 1 --2- 172.21.15.73:0/2658586798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b2c100760 0x7f7b2c19ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.691+0000 7f7b346b0700 1 -- 172.21.15.73:0/2658586798 >> 172.21.15.73:0/2658586798 conn(0x7f7b2c076be0 msgr2=0x7f7b2c102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:20.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.691+0000 7f7b346b0700 1 -- 172.21.15.73:0/2658586798 shutdown_connections 2023-08-10T12:05:20.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.691+0000 7f7b346b0700 1 -- 172.21.15.73:0/2658586798 wait complete. 2023-08-10T12:05:20.704 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T12:05:20.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.828+0000 7f0fad8d6700 1 -- 172.21.15.73:0/2425424446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa81018f0 msgr2=0x7f0fa8101cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:20.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.828+0000 7f0fad8d6700 1 --2- 172.21.15.73:0/2425424446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa81018f0 0x7f0fa8101cd0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009990 tx=0x7f0f9c009ca0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.828+0000 7f0fad8d6700 1 -- 172.21.15.73:0/2425424446 shutdown_connections 2023-08-10T12:05:20.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.828+0000 7f0fad8d6700 1 --2- 172.21.15.73:0/2425424446 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fa810ad10 0x7f0fa810d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.828+0000 7f0fad8d6700 1 --2- 172.21.15.73:0/2425424446 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa81018f0 0x7f0fa8101cd0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.828+0000 7f0fad8d6700 1 --2- 172.21.15.73:0/2425424446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fa8102210 0x7f0fa810a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.828+0000 7f0fad8d6700 1 -- 172.21.15.73:0/2425424446 >> 172.21.15.73:0/2425424446 conn(0x7f0fa80fb110 msgr2=0x7f0fa80fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:20.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.828+0000 7f0fad8d6700 1 -- 172.21.15.73:0/2425424446 shutdown_connections 2023-08-10T12:05:20.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.828+0000 7f0fad8d6700 1 -- 172.21.15.73:0/2425424446 wait complete. 2023-08-10T12:05:20.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.829+0000 7f0fad8d6700 1 Processor -- start 2023-08-10T12:05:20.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.829+0000 7f0fad8d6700 1 -- start start 2023-08-10T12:05:20.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.829+0000 7f0fad8d6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fa81018f0 0x7f0fa80ff540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:20.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.829+0000 7f0fad8d6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa8102210 0x7f0fa80ffa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:20.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.829+0000 7f0fad8d6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fa810ad10 0x7f0fa81a4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:20.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.829+0000 7f0fad8d6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa81002b0 con 0x7f0fa8102210 2023-08-10T12:05:20.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.829+0000 7f0fad8d6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa81a5050 con 0x7f0fa81018f0 2023-08-10T12:05:20.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.829+0000 7f0fad8d6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa81a5190 con 0x7f0fa810ad10 2023-08-10T12:05:20.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.829+0000 7f0fa67fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa8102210 0x7f0fa80ffa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:20.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.829+0000 7f0fa67fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa8102210 0x7f0fa80ffa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37100/0 (socket says 172.21.15.73:37100) 2023-08-10T12:05:20.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.829+0000 7f0fa67fc700 1 -- 172.21.15.73:0/3533598736 learned_addr learned my addr 172.21.15.73:0/3533598736 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:05:20.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.829+0000 7f0fa77fe700 1 --2- 172.21.15.73:0/3533598736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fa810ad10 0x7f0fa81a4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:20.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.829+0000 7f0fa6ffd700 1 --2- 172.21.15.73:0/3533598736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fa81018f0 0x7f0fa80ff540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:20.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.830+0000 7f0fa67fc700 1 -- 172.21.15.73:0/3533598736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fa810ad10 msgr2=0x7f0fa81a4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:20.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.830+0000 7f0fa67fc700 1 --2- 172.21.15.73:0/3533598736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fa810ad10 0x7f0fa81a4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.830+0000 7f0fa67fc700 1 -- 172.21.15.73:0/3533598736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fa81018f0 msgr2=0x7f0fa80ff540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:20.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.830+0000 7f0fa67fc700 1 --2- 172.21.15.73:0/3533598736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fa81018f0 0x7f0fa80ff540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:20.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.830+0000 7f0fa67fc700 1 -- 172.21.15.73:0/3533598736 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c0095f0 con 0x7f0fa8102210 2023-08-10T12:05:20.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.830+0000 7f0fa6ffd700 1 --2- 172.21.15.73:0/3533598736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fa81018f0 0x7f0fa80ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T12:05:20.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.830+0000 7f0fa67fc700 1 --2- 172.21.15.73:0/3533598736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa8102210 0x7f0fa80ffa80 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800d750 tx=0x7f0f9800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:20.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.830+0000 7f0fac8d4700 1 -- 172.21.15.73:0/3533598736 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98004220 con 0x7f0fa8102210 2023-08-10T12:05:20.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.830+0000 7f0fad8d6700 1 -- 172.21.15.73:0/3533598736 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa81a53f0 con 0x7f0fa8102210 2023-08-10T12:05:20.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.830+0000 7f0fac8d4700 1 -- 172.21.15.73:0/3533598736 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f98004cf0 con 0x7f0fa8102210 2023-08-10T12:05:20.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.830+0000 7f0fac8d4700 1 -- 172.21.15.73:0/3533598736 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f980056a0 con 0x7f0fa8102210 2023-08-10T12:05:20.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.830+0000 7f0fad8d6700 1 -- 172.21.15.73:0/3533598736 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa81a58d0 con 0x7f0fa8102210 2023-08-10T12:05:20.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.831+0000 7f0fad8d6700 1 -- 172.21.15.73:0/3533598736 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa8067940 con 0x7f0fa8102210 2023-08-10T12:05:20.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.832+0000 7f0fac8d4700 1 -- 172.21.15.73:0/3533598736 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f0f98004380 con 0x7f0fa8102210 2023-08-10T12:05:20.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.832+0000 7f0fac8d4700 1 --2- 172.21.15.73:0/3533598736 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0f900a12c0 0x7f0f900a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:20.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.833+0000 7f0fa6ffd700 1 --2- 172.21.15.73:0/3533598736 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0f900a12c0 0x7f0f900a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:20.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.833+0000 7f0fac8d4700 1 -- 172.21.15.73:0/3533598736 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0f980ccf70 con 0x7f0fa8102210 2023-08-10T12:05:20.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.833+0000 7f0fa6ffd700 1 --2- 172.21.15.73:0/3533598736 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0f900a12c0 0x7f0f900a3780 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c000c00 tx=0x7f0f9c005fb0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:20.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:20.836+0000 7f0fac8d4700 1 -- 172.21.15.73:0/3533598736 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0f98096380 con 0x7f0fa8102210 2023-08-10T12:05:21.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.024+0000 7f0fad8d6700 1 -- 172.21.15.73:0/3533598736 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0fa81a5b50 con 0x7f0fa8102210 2023-08-10T12:05:21.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.025+0000 7f0fac8d4700 1 -- 172.21.15.73:0/3533598736 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0f98016020 con 0x7f0fa8102210 2023-08-10T12:05:21.026 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-08-10T12:05:21.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.027+0000 7f0fad8d6700 1 -- 172.21.15.73:0/3533598736 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0f900a12c0 msgr2=0x7f0f900a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:21.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.027+0000 7f0fad8d6700 1 --2- 172.21.15.73:0/3533598736 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0f900a12c0 0x7f0f900a3780 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c000c00 tx=0x7f0f9c005fb0 comp rx=0 tx=0).stop 2023-08-10T12:05:21.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.027+0000 7f0fad8d6700 1 -- 172.21.15.73:0/3533598736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa8102210 msgr2=0x7f0fa80ffa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:21.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.027+0000 7f0fad8d6700 1 --2- 172.21.15.73:0/3533598736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa8102210 0x7f0fa80ffa80 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800d750 tx=0x7f0f9800da60 comp rx=0 tx=0).stop 2023-08-10T12:05:21.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.027+0000 7f0fad8d6700 1 -- 172.21.15.73:0/3533598736 shutdown_connections 2023-08-10T12:05:21.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.027+0000 7f0fad8d6700 1 --2- 172.21.15.73:0/3533598736 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f0f900a12c0 0x7f0f900a3780 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:21.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.027+0000 7f0fad8d6700 1 --2- 172.21.15.73:0/3533598736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fa81018f0 0x7f0fa80ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:21.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.027+0000 7f0fad8d6700 1 --2- 172.21.15.73:0/3533598736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fa810ad10 0x7f0fa81a4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:21.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.027+0000 7f0fad8d6700 1 --2- 172.21.15.73:0/3533598736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa8102210 0x7f0fa80ffa80 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:21.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.027+0000 7f0fad8d6700 1 -- 172.21.15.73:0/3533598736 >> 172.21.15.73:0/3533598736 conn(0x7f0fa80fb110 msgr2=0x7f0fa810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:21.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.027+0000 7f0fad8d6700 1 -- 172.21.15.73:0/3533598736 shutdown_connections 2023-08-10T12:05:21.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.027+0000 7f0fad8d6700 1 -- 172.21.15.73:0/3533598736 wait complete. 2023-08-10T12:05:21.040 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-08-10T12:05:21.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.161+0000 7fb67eece700 1 -- 172.21.15.73:0/1107425203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6780fff90 msgr2=0x7fb67810c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:21.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.161+0000 7fb67eece700 1 --2- 172.21.15.73:0/1107425203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6780fff90 0x7fb67810c4a0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb67000b0a0 tx=0x7fb67000b3b0 comp rx=0 tx=0).stop 2023-08-10T12:05:21.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.161+0000 7fb67eece700 1 -- 172.21.15.73:0/1107425203 shutdown_connections 2023-08-10T12:05:21.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.161+0000 7fb67eece700 1 --2- 172.21.15.73:0/1107425203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6780fff90 0x7fb67810c4a0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:21.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.161+0000 7fb67eece700 1 --2- 172.21.15.73:0/1107425203 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb678105670 0x7fb678105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:21.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.161+0000 7fb67eece700 1 --2- 172.21.15.73:0/1107425203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6780ff5d0 0x7fb6780ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:21.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.161+0000 7fb67eece700 1 -- 172.21.15.73:0/1107425203 >> 172.21.15.73:0/1107425203 conn(0x7fb6780fb080 msgr2=0x7fb6780fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:21.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.161+0000 7fb67eece700 1 -- 172.21.15.73:0/1107425203 shutdown_connections 2023-08-10T12:05:21.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.161+0000 7fb67eece700 1 -- 172.21.15.73:0/1107425203 wait complete. 2023-08-10T12:05:21.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.162+0000 7fb67eece700 1 Processor -- start 2023-08-10T12:05:21.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.162+0000 7fb67eece700 1 -- start start 2023-08-10T12:05:21.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.162+0000 7fb67eece700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6780ff5d0 0x7fb67819c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:21.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.162+0000 7fb67eece700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6780fff90 0x7fb67819cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:21.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.162+0000 7fb67eece700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb678105670 0x7fb678196670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:21.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.162+0000 7fb67eece700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb678196ce0 con 0x7fb678105670 2023-08-10T12:05:21.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.162+0000 7fb67eece700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb678196e50 con 0x7fb6780fff90 2023-08-10T12:05:21.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.162+0000 7fb67eece700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb678197010 con 0x7fb6780ff5d0 2023-08-10T12:05:21.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.162+0000 7fb67d46b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb678105670 0x7fb678196670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:21.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.162+0000 7fb67d46b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb678105670 0x7fb678196670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37116/0 (socket says 172.21.15.73:37116) 2023-08-10T12:05:21.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.162+0000 7fb67d46b700 1 -- 172.21.15.73:0/3787435009 learned_addr learned my addr 172.21.15.73:0/3787435009 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:05:21.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.162+0000 7fb67cc6a700 1 --2- 172.21.15.73:0/3787435009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6780ff5d0 0x7fb67819c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:21.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.162+0000 7fb677fff700 1 --2- 172.21.15.73:0/3787435009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6780fff90 0x7fb67819cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:21.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.162+0000 7fb67d46b700 1 -- 172.21.15.73:0/3787435009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6780ff5d0 msgr2=0x7fb67819c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:21.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.162+0000 7fb67d46b700 1 --2- 172.21.15.73:0/3787435009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6780ff5d0 0x7fb67819c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:21.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.162+0000 7fb67d46b700 1 -- 172.21.15.73:0/3787435009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6780fff90 msgr2=0x7fb67819cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:21.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.162+0000 7fb67d46b700 1 --2- 172.21.15.73:0/3787435009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6780fff90 0x7fb67819cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:21.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.162+0000 7fb67d46b700 1 -- 172.21.15.73:0/3787435009 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb670009d00 con 0x7fb678105670 2023-08-10T12:05:21.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.162+0000 7fb67d46b700 1 --2- 172.21.15.73:0/3787435009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb678105670 0x7fb678196670 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fb670009850 tx=0x7fb6700077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:21.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.162+0000 7fb675ffb700 1 -- 172.21.15.73:0/3787435009 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67000e040 con 0x7fb678105670 2023-08-10T12:05:21.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.163+0000 7fb67eece700 1 -- 172.21.15.73:0/3787435009 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb678197290 con 0x7fb678105670 2023-08-10T12:05:21.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.163+0000 7fb675ffb700 1 -- 172.21.15.73:0/3787435009 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb670004c60 con 0x7fb678105670 2023-08-10T12:05:21.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.163+0000 7fb675ffb700 1 -- 172.21.15.73:0/3787435009 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb670005370 con 0x7fb678105670 2023-08-10T12:05:21.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.163+0000 7fb67eece700 1 -- 172.21.15.73:0/3787435009 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6781a35f0 con 0x7fb678105670 2023-08-10T12:05:21.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.164+0000 7fb67eece700 1 -- 172.21.15.73:0/3787435009 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb678066cd0 con 0x7fb678105670 2023-08-10T12:05:21.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.165+0000 7fb675ffb700 1 -- 172.21.15.73:0/3787435009 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fb67001da30 con 0x7fb678105670 2023-08-10T12:05:21.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.165+0000 7fb675ffb700 1 --2- 172.21.15.73:0/3787435009 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb6680a1300 0x7fb6680a37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:21.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.165+0000 7fb67cc6a700 1 --2- 172.21.15.73:0/3787435009 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb6680a1300 0x7fb6680a37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:21.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.165+0000 7fb675ffb700 1 -- 172.21.15.73:0/3787435009 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb6700ce900 con 0x7fb678105670 2023-08-10T12:05:21.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.166+0000 7fb67cc6a700 1 --2- 172.21.15.73:0/3787435009 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb6680a1300 0x7fb6680a37c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb678100710 tx=0x7fb66c009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:21.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.169+0000 7fb675ffb700 1 -- 172.21.15.73:0/3787435009 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fb670097e60 con 0x7fb678105670 2023-08-10T12:05:21.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.420+0000 7fb67eece700 1 -- 172.21.15.73:0/3787435009 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7fb6781a3780 con 0x7fb678105670 2023-08-10T12:05:21.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.428+0000 7fb675ffb700 1 -- 172.21.15.73:0/3787435009 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) v1 ==== 81+0+733773 (secure 0 0 0) 0x7fb67009b480 con 0x7fb678105670 2023-08-10T12:05:21.436 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T12:05:21.436 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T12:05:21.437 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 25, 2023-08-10T12:05:21.437 INFO:teuthology.orchestra.run.smithi073.stdout: "active_gid": 25060, 2023-08-10T12:05:21.437 INFO:teuthology.orchestra.run.smithi073.stdout: "active_name": "x", 2023-08-10T12:05:21.437 INFO:teuthology.orchestra.run.smithi073.stdout: "active_addrs": { 2023-08-10T12:05:21.437 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2023-08-10T12:05:21.437 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:21.438 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2023-08-10T12:05:21.438 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6800", 2023-08-10T12:05:21.438 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 807677460 2023-08-10T12:05:21.438 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.438 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:21.438 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2023-08-10T12:05:21.438 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6801", 2023-08-10T12:05:21.438 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 807677460 2023-08-10T12:05:21.439 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.439 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-08-10T12:05:21.439 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.439 INFO:teuthology.orchestra.run.smithi073.stdout: "active_addr": "172.21.15.73:6801/807677460", 2023-08-10T12:05:21.439 INFO:teuthology.orchestra.run.smithi073.stdout: "active_change": "2023-08-10T11:52:37.545394+0000", 2023-08-10T12:05:21.439 INFO:teuthology.orchestra.run.smithi073.stdout: "active_mgr_features": 4540138322906710015, 2023-08-10T12:05:21.439 INFO:teuthology.orchestra.run.smithi073.stdout: "available": true, 2023-08-10T12:05:21.439 INFO:teuthology.orchestra.run.smithi073.stdout: "standbys": [ 2023-08-10T12:05:21.440 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:21.440 INFO:teuthology.orchestra.run.smithi073.stdout: "gid": 15480, 2023-08-10T12:05:21.440 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "z", 2023-08-10T12:05:21.440 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_features": 4540138322906710015, 2023-08-10T12:05:21.440 INFO:teuthology.orchestra.run.smithi073.stdout: "available_modules": [ 2023-08-10T12:05:21.440 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:21.440 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "alerts", 2023-08-10T12:05:21.441 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:21.441 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:21.441 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:21.441 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2023-08-10T12:05:21.441 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2023-08-10T12:05:21.441 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:21.441 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.441 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.442 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2023-08-10T12:05:21.442 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.442 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.442 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.442 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How frequently to reexamine health status", 2023-08-10T12:05:21.442 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.442 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.442 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.443 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.443 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:21.443 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:21.443 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.443 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.443 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.443 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.443 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.444 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.444 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.444 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.444 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.444 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.444 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.444 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.444 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.445 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.445 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.445 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.445 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.445 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.445 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.445 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:21.446 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:21.446 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.446 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.446 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.446 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.446 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.446 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.446 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.447 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.447 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.447 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.447 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.447 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.447 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:21.447 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:21.447 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.448 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.448 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.448 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:21.448 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.448 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.448 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.448 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.449 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.449 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.449 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.449 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.449 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.449 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.449 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.449 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.450 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.450 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.450 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:21.450 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:21.450 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.450 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.450 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.451 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.451 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.451 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.451 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.451 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.451 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.451 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.451 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.452 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.452 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_destination": { 2023-08-10T12:05:21.452 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_destination", 2023-08-10T12:05:21.452 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.452 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.452 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.452 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.452 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.453 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.453 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.453 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Email address to send alerts to", 2023-08-10T12:05:21.453 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.453 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.453 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.453 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.453 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_from_name": { 2023-08-10T12:05:21.454 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_from_name", 2023-08-10T12:05:21.454 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.454 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.454 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.454 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "Ceph", 2023-08-10T12:05:21.454 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.454 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.454 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.455 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Email From: name", 2023-08-10T12:05:21.455 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.455 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.455 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.455 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.455 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_host": { 2023-08-10T12:05:21.455 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_host", 2023-08-10T12:05:21.455 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.456 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.456 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.456 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.456 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.456 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.456 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.456 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP server", 2023-08-10T12:05:21.457 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.457 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.457 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.457 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.457 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_password": { 2023-08-10T12:05:21.457 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_password", 2023-08-10T12:05:21.457 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.457 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.458 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.458 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.458 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.458 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.458 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.458 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Password to authenticate with", 2023-08-10T12:05:21.458 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.458 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.459 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.459 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.459 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_port": { 2023-08-10T12:05:21.459 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_port", 2023-08-10T12:05:21.459 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.459 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.459 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.460 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "465", 2023-08-10T12:05:21.460 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.460 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.460 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.460 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP port", 2023-08-10T12:05:21.460 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.460 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.460 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.461 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.461 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_sender": { 2023-08-10T12:05:21.461 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_sender", 2023-08-10T12:05:21.461 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.461 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.461 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.461 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.461 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.462 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.462 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.462 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP envelope sender", 2023-08-10T12:05:21.462 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.462 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.462 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.463 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_ssl": { 2023-08-10T12:05:21.463 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_ssl", 2023-08-10T12:05:21.463 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.463 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.463 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.463 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.463 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.463 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.464 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.464 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use SSL to connect to SMTP server", 2023-08-10T12:05:21.464 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.464 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.464 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.464 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.464 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_user": { 2023-08-10T12:05:21.465 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_user", 2023-08-10T12:05:21.465 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.465 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.465 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.465 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.465 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.465 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.465 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.466 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "User to authenticate as", 2023-08-10T12:05:21.466 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.466 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.466 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.466 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.466 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.466 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:21.467 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "balancer", 2023-08-10T12:05:21.467 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:21.467 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:21.467 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:21.467 INFO:teuthology.orchestra.run.smithi073.stdout: "active": { 2023-08-10T12:05:21.467 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "active", 2023-08-10T12:05:21.468 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.468 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.468 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.468 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.468 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.468 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.468 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.469 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "automatically balance PGs across cluster", 2023-08-10T12:05:21.469 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.469 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.469 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.469 INFO:teuthology.orchestra.run.smithi073.stdout: "begin_time": { 2023-08-10T12:05:21.469 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "begin_time", 2023-08-10T12:05:21.469 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.470 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.470 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.470 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0000", 2023-08-10T12:05:21.470 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.470 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.470 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.470 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "beginning time of day to automatically balance", 2023-08-10T12:05:21.470 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-08-10T12:05:21.471 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.471 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.471 INFO:teuthology.orchestra.run.smithi073.stdout: "begin_weekday": { 2023-08-10T12:05:21.471 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "begin_weekday", 2023-08-10T12:05:21.471 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2023-08-10T12:05:21.471 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.471 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.472 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2023-08-10T12:05:21.472 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0", 2023-08-10T12:05:21.472 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "6", 2023-08-10T12:05:21.472 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.472 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-08-10T12:05:21.472 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-08-10T12:05:21.472 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.473 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.473 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.473 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_max_iterations": { 2023-08-10T12:05:21.473 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_max_iterations", 2023-08-10T12:05:21.473 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2023-08-10T12:05:21.473 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.473 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.473 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "25", 2023-08-10T12:05:21.474 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2023-08-10T12:05:21.474 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "250", 2023-08-10T12:05:21.474 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.474 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-08-10T12:05:21.474 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.474 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.474 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.474 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.475 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_metrics": { 2023-08-10T12:05:21.475 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_metrics", 2023-08-10T12:05:21.475 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.475 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.475 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.475 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "pgs,objects,bytes", 2023-08-10T12:05:21.476 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.476 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.476 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.476 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-08-10T12:05:21.476 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-08-10T12:05:21.476 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.476 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.477 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.477 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_step": { 2023-08-10T12:05:21.477 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_step", 2023-08-10T12:05:21.477 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-08-10T12:05:21.477 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.477 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.477 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0.5", 2023-08-10T12:05:21.477 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0.001", 2023-08-10T12:05:21.478 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "0.999", 2023-08-10T12:05:21.478 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.478 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "aggressiveness of optimization", 2023-08-10T12:05:21.478 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-08-10T12:05:21.478 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.478 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.478 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.478 INFO:teuthology.orchestra.run.smithi073.stdout: "end_time": { 2023-08-10T12:05:21.479 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "end_time", 2023-08-10T12:05:21.479 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.479 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.479 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.479 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "2359", 2023-08-10T12:05:21.479 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.479 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.479 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.480 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "ending time of day to automatically balance", 2023-08-10T12:05:21.480 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-08-10T12:05:21.480 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.480 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.480 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.480 INFO:teuthology.orchestra.run.smithi073.stdout: "end_weekday": { 2023-08-10T12:05:21.480 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "end_weekday", 2023-08-10T12:05:21.480 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2023-08-10T12:05:21.481 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.481 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.481 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2023-08-10T12:05:21.481 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0", 2023-08-10T12:05:21.481 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "6", 2023-08-10T12:05:21.481 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.481 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-08-10T12:05:21.482 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-08-10T12:05:21.482 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.482 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.482 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.482 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:21.482 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:21.482 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.482 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.483 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.483 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.483 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.483 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.483 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.483 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.483 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.483 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.484 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.484 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.484 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.484 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.484 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.484 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.484 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.484 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.485 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.485 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:21.485 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:21.485 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.485 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.485 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.485 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.486 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.486 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.486 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.486 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.486 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.486 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.486 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.486 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.487 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:21.487 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:21.487 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.487 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.487 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.487 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:21.487 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.487 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.488 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.488 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.488 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.488 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.488 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.488 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.488 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.489 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.489 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.489 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.489 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.489 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.489 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:21.489 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:21.490 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.490 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.490 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.490 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.490 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.490 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.490 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.490 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.491 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.491 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.491 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.491 INFO:teuthology.orchestra.run.smithi073.stdout: "min_score": { 2023-08-10T12:05:21.491 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "min_score", 2023-08-10T12:05:21.491 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-08-10T12:05:21.491 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.492 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.492 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2023-08-10T12:05:21.492 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.492 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.492 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.492 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-08-10T12:05:21.492 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.492 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.493 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.493 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": { 2023-08-10T12:05:21.493 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mode", 2023-08-10T12:05:21.493 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.493 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.493 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.493 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "upmap", 2023-08-10T12:05:21.494 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.494 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.494 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.494 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-compat", 2023-08-10T12:05:21.494 INFO:teuthology.orchestra.run.smithi073.stdout: "none", 2023-08-10T12:05:21.494 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap" 2023-08-10T12:05:21.494 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.494 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Balancer mode", 2023-08-10T12:05:21.495 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.495 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.495 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.495 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.495 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_ids": { 2023-08-10T12:05:21.495 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pool_ids", 2023-08-10T12:05:21.495 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.496 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.496 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.496 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.496 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.496 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.496 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.496 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-08-10T12:05:21.496 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.497 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.497 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.497 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.497 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2023-08-10T12:05:21.497 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2023-08-10T12:05:21.497 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:21.497 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.497 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.498 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2023-08-10T12:05:21.498 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.498 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.498 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.498 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-08-10T12:05:21.498 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.498 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.498 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.499 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.499 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap_max_deviation": { 2023-08-10T12:05:21.499 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "upmap_max_deviation", 2023-08-10T12:05:21.499 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.499 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.499 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.499 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2023-08-10T12:05:21.499 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2023-08-10T12:05:21.500 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.500 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.500 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "deviation below which no optimization is attempted", 2023-08-10T12:05:21.500 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-08-10T12:05:21.500 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.500 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.500 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.500 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap_max_optimizations": { 2023-08-10T12:05:21.501 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "upmap_max_optimizations", 2023-08-10T12:05:21.501 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2023-08-10T12:05:21.501 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.501 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.501 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-08-10T12:05:21.501 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.501 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.501 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.502 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-08-10T12:05:21.502 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.502 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.502 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.502 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.502 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.502 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.503 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:21.503 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cephadm", 2023-08-10T12:05:21.503 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:21.503 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:21.503 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:21.503 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_down_multiplier": { 2023-08-10T12:05:21.503 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_down_multiplier", 2023-08-10T12:05:21.503 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-08-10T12:05:21.504 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.504 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.504 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3.0", 2023-08-10T12:05:21.504 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.504 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.504 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.504 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-08-10T12:05:21.504 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.505 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.505 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.505 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.505 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_refresh_rate": { 2023-08-10T12:05:21.505 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_refresh_rate", 2023-08-10T12:05:21.505 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:21.505 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.505 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.506 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "20", 2023-08-10T12:05:21.506 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.506 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.506 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.506 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-08-10T12:05:21.506 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.506 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.506 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.507 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.507 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_starting_port": { 2023-08-10T12:05:21.507 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_starting_port", 2023-08-10T12:05:21.507 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.507 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.507 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.507 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "4721", 2023-08-10T12:05:21.507 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.508 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.508 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.508 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-08-10T12:05:21.508 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.508 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.508 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.508 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.509 INFO:teuthology.orchestra.run.smithi073.stdout: "alertmanager_web_password": { 2023-08-10T12:05:21.509 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "alertmanager_web_password", 2023-08-10T12:05:21.509 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.509 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.509 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.509 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2023-08-10T12:05:21.509 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.510 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.510 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.510 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Alertmanager web password", 2023-08-10T12:05:21.510 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.510 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.510 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.510 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.510 INFO:teuthology.orchestra.run.smithi073.stdout: "alertmanager_web_user": { 2023-08-10T12:05:21.511 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "alertmanager_web_user", 2023-08-10T12:05:21.511 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.511 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.511 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.511 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2023-08-10T12:05:21.511 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.511 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.511 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.512 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Alertmanager web user", 2023-08-10T12:05:21.512 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.512 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.512 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.512 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.512 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_ptrace": { 2023-08-10T12:05:21.512 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_ptrace", 2023-08-10T12:05:21.512 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.513 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.513 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.513 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.513 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.513 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.513 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.513 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-08-10T12:05:21.513 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-08-10T12:05:21.514 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.514 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.514 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.514 INFO:teuthology.orchestra.run.smithi073.stdout: "autotune_interval": { 2023-08-10T12:05:21.514 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "autotune_interval", 2023-08-10T12:05:21.514 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:21.514 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.515 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.515 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2023-08-10T12:05:21.515 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.515 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.515 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.515 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to autotune daemon memory", 2023-08-10T12:05:21.515 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.515 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.516 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.516 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.516 INFO:teuthology.orchestra.run.smithi073.stdout: "autotune_memory_target_ratio": { 2023-08-10T12:05:21.516 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "autotune_memory_target_ratio", 2023-08-10T12:05:21.516 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-08-10T12:05:21.516 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.516 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.516 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0.7", 2023-08-10T12:05:21.517 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.517 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.517 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.517 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-08-10T12:05:21.517 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.517 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.517 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.517 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.518 INFO:teuthology.orchestra.run.smithi073.stdout: "cgroups_split": { 2023-08-10T12:05:21.518 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cgroups_split", 2023-08-10T12:05:21.518 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.518 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.518 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.518 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.518 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.518 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.519 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.519 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-08-10T12:05:21.519 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.519 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.519 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.519 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.519 INFO:teuthology.orchestra.run.smithi073.stdout: "config_checks_enabled": { 2023-08-10T12:05:21.519 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_checks_enabled", 2023-08-10T12:05:21.520 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.520 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.520 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.520 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.520 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.520 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.520 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.520 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-08-10T12:05:21.521 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.521 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.521 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.521 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.521 INFO:teuthology.orchestra.run.smithi073.stdout: "config_dashboard": { 2023-08-10T12:05:21.521 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_dashboard", 2023-08-10T12:05:21.521 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.522 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.522 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.522 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.522 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.522 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.522 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.522 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-08-10T12:05:21.522 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.523 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.523 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.523 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.523 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_alertmanager": { 2023-08-10T12:05:21.523 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_alertmanager", 2023-08-10T12:05:21.523 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.523 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.523 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.524 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-08-10T12:05:21.524 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.524 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.524 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.524 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2023-08-10T12:05:21.524 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.524 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.524 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.525 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.525 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_base": { 2023-08-10T12:05:21.525 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_base", 2023-08-10T12:05:21.525 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.525 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.525 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.525 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/ceph", 2023-08-10T12:05:21.525 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.526 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.526 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.526 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Container image name, without the tag", 2023-08-10T12:05:21.526 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.526 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.526 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.526 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.526 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_elasticsearch": { 2023-08-10T12:05:21.527 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_elasticsearch", 2023-08-10T12:05:21.527 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.527 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.527 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.527 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-08-10T12:05:21.527 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.527 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.527 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.528 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "elasticsearch container image", 2023-08-10T12:05:21.528 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.528 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.528 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.528 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.528 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_grafana": { 2023-08-10T12:05:21.528 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_grafana", 2023-08-10T12:05:21.529 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.529 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.529 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.529 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-08-10T12:05:21.529 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.529 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.529 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.529 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2023-08-10T12:05:21.530 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.530 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.530 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.530 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.530 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_haproxy": { 2023-08-10T12:05:21.530 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_haproxy", 2023-08-10T12:05:21.530 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.531 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.531 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.531 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-08-10T12:05:21.531 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.531 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.531 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.531 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "HAproxy container image", 2023-08-10T12:05:21.531 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.532 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.532 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.532 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.532 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_agent": { 2023-08-10T12:05:21.532 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_agent", 2023-08-10T12:05:21.532 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.532 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.532 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.533 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-08-10T12:05:21.533 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.533 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.533 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.533 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger agent container image", 2023-08-10T12:05:21.533 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.533 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.533 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.534 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.534 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_collector": { 2023-08-10T12:05:21.534 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_collector", 2023-08-10T12:05:21.534 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.534 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.534 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.534 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-08-10T12:05:21.535 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.535 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.535 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.535 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger collector container image", 2023-08-10T12:05:21.535 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.535 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.535 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.535 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.536 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_query": { 2023-08-10T12:05:21.536 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_query", 2023-08-10T12:05:21.536 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.536 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.536 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.536 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-08-10T12:05:21.536 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.536 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.537 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.537 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger query container image", 2023-08-10T12:05:21.537 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.537 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.537 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.537 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.537 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_keepalived": { 2023-08-10T12:05:21.537 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_keepalived", 2023-08-10T12:05:21.538 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.538 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.538 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.538 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-08-10T12:05:21.538 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.538 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.538 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.538 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Keepalived container image", 2023-08-10T12:05:21.539 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.539 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.539 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.539 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.539 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_loki": { 2023-08-10T12:05:21.539 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_loki", 2023-08-10T12:05:21.539 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.539 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.540 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.540 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-08-10T12:05:21.540 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.540 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.540 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.540 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Loki container image", 2023-08-10T12:05:21.540 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.541 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.541 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.541 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.541 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_node_exporter": { 2023-08-10T12:05:21.541 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_node_exporter", 2023-08-10T12:05:21.541 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.541 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.541 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.542 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-08-10T12:05:21.542 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.542 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.542 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.542 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2023-08-10T12:05:21.542 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.542 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.542 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.543 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.543 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_prometheus": { 2023-08-10T12:05:21.543 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_prometheus", 2023-08-10T12:05:21.543 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.543 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.543 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.543 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-08-10T12:05:21.543 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.544 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.544 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.544 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2023-08-10T12:05:21.544 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.544 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.544 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.544 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.544 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_promtail": { 2023-08-10T12:05:21.545 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_promtail", 2023-08-10T12:05:21.545 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.545 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.545 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.545 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-08-10T12:05:21.545 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.545 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.545 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.546 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Promtail container image", 2023-08-10T12:05:21.546 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.546 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.546 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.546 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.546 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_snmp_gateway": { 2023-08-10T12:05:21.546 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_snmp_gateway", 2023-08-10T12:05:21.546 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.547 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.547 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.547 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-08-10T12:05:21.547 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.547 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.547 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.547 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SNMP Gateway container image", 2023-08-10T12:05:21.547 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.548 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.548 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.548 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.548 INFO:teuthology.orchestra.run.smithi073.stdout: "container_init": { 2023-08-10T12:05:21.548 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_init", 2023-08-10T12:05:21.548 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.548 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.548 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.549 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.549 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.549 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.549 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.549 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Run podman/docker with `--init`", 2023-08-10T12:05:21.549 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.549 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.549 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.550 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.550 INFO:teuthology.orchestra.run.smithi073.stdout: "daemon_cache_timeout": { 2023-08-10T12:05:21.550 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "daemon_cache_timeout", 2023-08-10T12:05:21.550 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:21.550 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.550 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.550 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2023-08-10T12:05:21.550 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.551 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.551 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.551 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-08-10T12:05:21.551 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.551 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.551 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.552 INFO:teuthology.orchestra.run.smithi073.stdout: "default_cephadm_command_timeout": { 2023-08-10T12:05:21.552 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "default_cephadm_command_timeout", 2023-08-10T12:05:21.552 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:21.552 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.552 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.552 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "900", 2023-08-10T12:05:21.552 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.553 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.553 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.553 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-08-10T12:05:21.553 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.553 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.553 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.553 INFO:teuthology.orchestra.run.smithi073.stdout: "default_registry": { 2023-08-10T12:05:21.554 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "default_registry", 2023-08-10T12:05:21.554 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.554 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.554 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.554 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io", 2023-08-10T12:05:21.554 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.554 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.554 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.555 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-08-10T12:05:21.555 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.555 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.555 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.555 INFO:teuthology.orchestra.run.smithi073.stdout: "device_cache_timeout": { 2023-08-10T12:05:21.555 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_cache_timeout", 2023-08-10T12:05:21.555 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:21.556 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.556 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.556 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1800", 2023-08-10T12:05:21.556 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.556 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.556 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.556 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache device inventory", 2023-08-10T12:05:21.557 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.557 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.557 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.557 INFO:teuthology.orchestra.run.smithi073.stdout: "device_enhanced_scan": { 2023-08-10T12:05:21.557 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_enhanced_scan", 2023-08-10T12:05:21.557 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.557 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.558 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.558 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.558 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.558 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.558 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.558 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use libstoragemgmt during device scans", 2023-08-10T12:05:21.558 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.558 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.559 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.559 INFO:teuthology.orchestra.run.smithi073.stdout: "facts_cache_timeout": { 2023-08-10T12:05:21.559 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "facts_cache_timeout", 2023-08-10T12:05:21.559 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:21.559 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.559 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.559 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2023-08-10T12:05:21.560 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.560 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.560 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.560 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache host facts data", 2023-08-10T12:05:21.560 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.560 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.560 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.561 INFO:teuthology.orchestra.run.smithi073.stdout: "host_check_interval": { 2023-08-10T12:05:21.561 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "host_check_interval", 2023-08-10T12:05:21.561 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:21.561 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.561 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.561 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2023-08-10T12:05:21.561 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.561 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.562 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.562 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to perform a host check", 2023-08-10T12:05:21.562 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.562 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.562 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.562 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:21.562 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:21.563 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.563 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.563 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.563 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.563 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.563 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.563 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.563 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.564 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.564 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.564 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.564 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.564 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.564 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.564 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.564 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.565 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.565 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.565 INFO:teuthology.orchestra.run.smithi073.stdout: "log_refresh_metadata": { 2023-08-10T12:05:21.565 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_refresh_metadata", 2023-08-10T12:05:21.565 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.565 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.566 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.566 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.566 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.566 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.566 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.566 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-08-10T12:05:21.566 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.566 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.567 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.567 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:21.567 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:21.567 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.567 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.567 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.567 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.568 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.568 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.568 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.568 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-08-10T12:05:21.568 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.568 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.569 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.569 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.569 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:21.569 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:21.569 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.569 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.569 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.569 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:21.570 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.570 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.570 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.570 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.570 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.570 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.570 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.570 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.571 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.571 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.571 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.571 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.571 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.571 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.571 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:21.572 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:21.572 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.572 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.572 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.572 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.572 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.572 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.573 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.573 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.573 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.573 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.573 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.573 INFO:teuthology.orchestra.run.smithi073.stdout: "manage_etc_ceph_ceph_conf": { 2023-08-10T12:05:21.573 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-08-10T12:05:21.574 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.574 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.574 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.574 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.574 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.574 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.574 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.575 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-08-10T12:05:21.575 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.575 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.575 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.575 INFO:teuthology.orchestra.run.smithi073.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-08-10T12:05:21.575 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-08-10T12:05:21.575 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.576 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.576 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.576 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "*", 2023-08-10T12:05:21.576 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.576 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.576 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.577 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-08-10T12:05:21.577 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.577 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.577 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.577 INFO:teuthology.orchestra.run.smithi073.stdout: "max_count_per_host": { 2023-08-10T12:05:21.577 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_count_per_host", 2023-08-10T12:05:21.577 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.578 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.578 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.578 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-08-10T12:05:21.578 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.578 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.578 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.578 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "max number of daemons per service per host", 2023-08-10T12:05:21.578 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.579 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.579 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.579 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd_draining_count": { 2023-08-10T12:05:21.579 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_osd_draining_count", 2023-08-10T12:05:21.579 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.579 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.580 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.580 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-08-10T12:05:21.580 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.580 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.580 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.580 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-08-10T12:05:21.580 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.580 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.581 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.581 INFO:teuthology.orchestra.run.smithi073.stdout: "migration_current": { 2023-08-10T12:05:21.581 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "migration_current", 2023-08-10T12:05:21.581 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.581 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.581 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.581 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.582 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.582 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.582 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.582 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "internal - do not modify", 2023-08-10T12:05:21.582 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.582 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.582 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.583 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": { 2023-08-10T12:05:21.583 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mode", 2023-08-10T12:05:21.583 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.583 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.583 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.583 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "root", 2023-08-10T12:05:21.583 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.583 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.584 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.584 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm-package", 2023-08-10T12:05:21.584 INFO:teuthology.orchestra.run.smithi073.stdout: "root" 2023-08-10T12:05:21.584 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.584 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "mode for remote execution of cephadm", 2023-08-10T12:05:21.584 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.584 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.584 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.585 INFO:teuthology.orchestra.run.smithi073.stdout: "prometheus_alerts_path": { 2023-08-10T12:05:21.585 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus_alerts_path", 2023-08-10T12:05:21.585 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.585 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.585 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.585 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-08-10T12:05:21.585 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.586 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.586 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.586 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-08-10T12:05:21.586 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.586 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.586 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.586 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.586 INFO:teuthology.orchestra.run.smithi073.stdout: "prometheus_web_password": { 2023-08-10T12:05:21.587 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus_web_password", 2023-08-10T12:05:21.587 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.587 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.587 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.587 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2023-08-10T12:05:21.587 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.587 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.587 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.588 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus web password", 2023-08-10T12:05:21.588 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.588 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.588 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.588 INFO:teuthology.orchestra.run.smithi073.stdout: "prometheus_web_user": { 2023-08-10T12:05:21.588 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus_web_user", 2023-08-10T12:05:21.589 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.589 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.589 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.589 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2023-08-10T12:05:21.589 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.589 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.589 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.589 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus web user", 2023-08-10T12:05:21.590 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.590 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.590 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.590 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_insecure": { 2023-08-10T12:05:21.590 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_insecure", 2023-08-10T12:05:21.590 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.590 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.591 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.591 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.591 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.591 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.591 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.591 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-08-10T12:05:21.591 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.591 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.592 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.592 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_password": { 2023-08-10T12:05:21.592 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_password", 2023-08-10T12:05:21.592 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.592 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.592 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.592 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.593 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.593 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.593 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.593 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-08-10T12:05:21.593 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.593 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.593 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.593 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.594 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_url": { 2023-08-10T12:05:21.594 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_url", 2023-08-10T12:05:21.594 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.594 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.594 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.594 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.594 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.594 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.595 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.595 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-08-10T12:05:21.595 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.595 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.595 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.595 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_username": { 2023-08-10T12:05:21.595 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_username", 2023-08-10T12:05:21.596 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.596 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.596 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.596 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.596 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.596 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.596 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.597 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-08-10T12:05:21.597 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.597 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.597 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.597 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.597 INFO:teuthology.orchestra.run.smithi073.stdout: "secure_monitoring_stack": { 2023-08-10T12:05:21.597 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "secure_monitoring_stack", 2023-08-10T12:05:21.598 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.598 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.598 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.598 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.598 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.598 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.598 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.598 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-08-10T12:05:21.599 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.599 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.599 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.599 INFO:teuthology.orchestra.run.smithi073.stdout: "service_discovery_port": { 2023-08-10T12:05:21.599 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "service_discovery_port", 2023-08-10T12:05:21.599 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.599 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.600 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.600 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8765", 2023-08-10T12:05:21.600 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.600 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.600 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.600 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "cephadm service discovery port", 2023-08-10T12:05:21.600 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.600 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.601 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.601 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.601 INFO:teuthology.orchestra.run.smithi073.stdout: "ssh_config_file": { 2023-08-10T12:05:21.601 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssh_config_file", 2023-08-10T12:05:21.601 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.601 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.601 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.602 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.602 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.602 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.602 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.602 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-08-10T12:05:21.602 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.602 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.602 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.603 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.603 INFO:teuthology.orchestra.run.smithi073.stdout: "use_agent": { 2023-08-10T12:05:21.603 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "use_agent", 2023-08-10T12:05:21.603 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.603 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.603 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.603 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.603 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.604 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.604 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.604 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-08-10T12:05:21.604 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.604 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.604 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.604 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.605 INFO:teuthology.orchestra.run.smithi073.stdout: "use_repo_digest": { 2023-08-10T12:05:21.605 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "use_repo_digest", 2023-08-10T12:05:21.605 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.605 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.605 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.605 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.605 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.605 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.606 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.606 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-08-10T12:05:21.606 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.606 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.606 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.606 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_failed_host_check": { 2023-08-10T12:05:21.606 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_failed_host_check", 2023-08-10T12:05:21.607 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.607 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.607 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.607 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.607 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.607 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.607 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.607 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if the host check fails", 2023-08-10T12:05:21.608 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.608 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.608 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.608 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.608 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_stray_daemons": { 2023-08-10T12:05:21.608 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_stray_daemons", 2023-08-10T12:05:21.608 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.608 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.609 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.609 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.609 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.609 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.609 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.609 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-08-10T12:05:21.609 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.609 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.610 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.610 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_stray_hosts": { 2023-08-10T12:05:21.610 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_stray_hosts", 2023-08-10T12:05:21.610 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.610 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.610 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.610 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.611 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.611 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.611 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.611 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-08-10T12:05:21.611 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.611 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.611 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.612 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.612 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.612 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:21.612 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crash", 2023-08-10T12:05:21.612 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:21.612 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:21.612 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:21.613 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:21.613 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:21.613 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.613 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.613 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.613 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.613 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.613 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.614 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.614 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.614 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.614 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.614 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.614 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.614 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.614 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.615 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.615 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.615 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.615 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.615 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:21.615 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:21.615 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.616 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.616 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.616 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.616 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.616 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.616 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.616 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.616 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.617 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.617 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.617 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.617 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:21.617 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:21.617 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.617 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.617 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.618 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:21.618 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.618 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.618 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.618 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.618 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.618 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.618 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.619 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.619 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.619 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.619 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.619 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.619 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.619 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.620 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:21.620 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:21.620 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.620 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.620 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.620 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.620 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.621 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.621 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.621 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.621 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.621 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.621 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.621 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.622 INFO:teuthology.orchestra.run.smithi073.stdout: "retain_interval": { 2023-08-10T12:05:21.622 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "retain_interval", 2023-08-10T12:05:21.622 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:21.622 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.622 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.622 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "31536000", 2023-08-10T12:05:21.622 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.622 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.623 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.623 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long to retain crashes before pruning them", 2023-08-10T12:05:21.623 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.623 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.623 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.623 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.623 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_recent_interval": { 2023-08-10T12:05:21.623 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_recent_interval", 2023-08-10T12:05:21.624 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:21.624 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.624 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.624 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1209600", 2023-08-10T12:05:21.624 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.624 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.624 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.624 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "time interval in which to warn about recent crashes", 2023-08-10T12:05:21.625 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.625 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.625 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.625 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.625 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.625 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.625 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:21.625 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "dashboard", 2023-08-10T12:05:21.626 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:21.626 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:21.626 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:21.626 INFO:teuthology.orchestra.run.smithi073.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-08-10T12:05:21.626 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-08-10T12:05:21.626 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.626 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.626 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.627 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-08-10T12:05:21.627 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.627 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.627 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.627 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.627 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.627 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.627 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.628 INFO:teuthology.orchestra.run.smithi073.stdout: "ALERTMANAGER_API_HOST": { 2023-08-10T12:05:21.628 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ALERTMANAGER_API_HOST", 2023-08-10T12:05:21.628 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.628 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.628 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.628 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.629 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.629 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.629 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.629 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.629 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.629 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.629 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.629 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.630 INFO:teuthology.orchestra.run.smithi073.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-08-10T12:05:21.630 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-08-10T12:05:21.630 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.630 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.630 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.630 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.630 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.630 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.631 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.631 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.631 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.631 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.631 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.631 INFO:teuthology.orchestra.run.smithi073.stdout: "AUDIT_API_ENABLED": { 2023-08-10T12:05:21.631 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "AUDIT_API_ENABLED", 2023-08-10T12:05:21.632 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.632 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.632 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.632 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.632 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.632 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.632 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.632 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.633 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.633 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.633 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.633 INFO:teuthology.orchestra.run.smithi073.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-08-10T12:05:21.633 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-08-10T12:05:21.633 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.633 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.634 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.634 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.634 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.634 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.634 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.634 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.634 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.634 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.635 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.635 INFO:teuthology.orchestra.run.smithi073.stdout: "ENABLE_BROWSABLE_API": { 2023-08-10T12:05:21.635 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ENABLE_BROWSABLE_API", 2023-08-10T12:05:21.635 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.635 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.635 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.635 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.636 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.636 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.636 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.636 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.636 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.636 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.636 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.637 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-08-10T12:05:21.637 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-08-10T12:05:21.637 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.637 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.637 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.637 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.637 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.638 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.638 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.638 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.638 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.638 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.638 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.638 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-08-10T12:05:21.639 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-08-10T12:05:21.639 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.639 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.639 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.639 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.639 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.639 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.639 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.640 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.640 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.640 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.640 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.640 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-08-10T12:05:21.640 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-08-10T12:05:21.640 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.641 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.641 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.641 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.641 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.641 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.641 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.641 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.641 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.642 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.642 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.642 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.642 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-08-10T12:05:21.642 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-08-10T12:05:21.642 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.642 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.642 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.643 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.643 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.643 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.643 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.643 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.643 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.643 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.644 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.644 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_NFS": { 2023-08-10T12:05:21.644 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-08-10T12:05:21.644 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.644 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.644 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.644 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.645 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.645 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.645 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.645 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.645 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.645 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.645 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.646 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_RBD": { 2023-08-10T12:05:21.646 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-08-10T12:05:21.646 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.646 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.646 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.646 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.646 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.647 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.647 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.647 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.647 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.647 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.647 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.647 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_RGW": { 2023-08-10T12:05:21.648 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-08-10T12:05:21.648 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.648 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.648 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.648 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.648 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.648 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.649 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.649 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.649 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.649 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.649 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.649 INFO:teuthology.orchestra.run.smithi073.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-08-10T12:05:21.649 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-08-10T12:05:21.650 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.650 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.650 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.650 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.650 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.650 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.650 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.650 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.651 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.651 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.651 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.651 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_PASSWORD": { 2023-08-10T12:05:21.651 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_PASSWORD", 2023-08-10T12:05:21.651 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.652 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.652 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.652 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2023-08-10T12:05:21.652 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.652 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.652 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.652 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.652 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.653 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.653 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.653 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.653 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-08-10T12:05:21.653 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-08-10T12:05:21.653 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.653 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.653 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.654 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.654 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.654 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.654 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.654 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.654 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.654 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.654 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.655 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_URL": { 2023-08-10T12:05:21.655 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_URL", 2023-08-10T12:05:21.655 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.655 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.655 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.655 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.656 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.656 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.656 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.656 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.656 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.656 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.656 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.656 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.657 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_USERNAME": { 2023-08-10T12:05:21.657 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_USERNAME", 2023-08-10T12:05:21.657 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.657 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.657 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.657 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2023-08-10T12:05:21.657 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.657 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.658 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.658 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.658 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.658 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.658 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.658 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.658 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-08-10T12:05:21.658 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-08-10T12:05:21.659 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.659 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.659 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.659 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.659 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.659 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.659 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.659 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.660 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.660 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.660 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.660 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-08-10T12:05:21.660 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-08-10T12:05:21.660 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.661 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.661 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.661 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.661 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.661 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.661 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.661 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.661 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.662 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.662 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.662 INFO:teuthology.orchestra.run.smithi073.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-08-10T12:05:21.662 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-08-10T12:05:21.662 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.662 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.662 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.663 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.663 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.663 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.663 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.663 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.663 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.663 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.663 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.664 INFO:teuthology.orchestra.run.smithi073.stdout: "ISSUE_TRACKER_API_KEY": { 2023-08-10T12:05:21.664 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-08-10T12:05:21.664 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.664 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.664 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.664 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.664 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.665 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.665 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.665 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.665 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.665 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.665 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.665 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.665 INFO:teuthology.orchestra.run.smithi073.stdout: "PROMETHEUS_API_HOST": { 2023-08-10T12:05:21.666 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PROMETHEUS_API_HOST", 2023-08-10T12:05:21.666 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.666 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.666 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.666 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.666 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.666 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.666 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.667 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.667 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.667 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.667 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.667 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.667 INFO:teuthology.orchestra.run.smithi073.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-08-10T12:05:21.667 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-08-10T12:05:21.668 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.668 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.668 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.668 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.668 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.668 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.668 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.669 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.669 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.669 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.669 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.669 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.669 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-08-10T12:05:21.669 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-08-10T12:05:21.669 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.670 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.670 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.670 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.670 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.670 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.670 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.670 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.670 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.671 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.671 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.671 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.671 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-08-10T12:05:21.671 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-08-10T12:05:21.671 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.671 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.671 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.672 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.672 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.672 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.672 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.672 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.672 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.672 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.673 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.673 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-08-10T12:05:21.673 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-08-10T12:05:21.673 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.673 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.673 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.673 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.674 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.674 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.674 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.674 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.674 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.674 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.674 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.674 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.675 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-08-10T12:05:21.675 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-08-10T12:05:21.675 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.675 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.675 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.675 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.675 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.675 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.676 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.676 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.676 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.676 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.676 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.676 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.676 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-08-10T12:05:21.676 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-08-10T12:05:21.677 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.677 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.677 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.677 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.677 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.677 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.677 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.677 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.678 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.678 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.678 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.678 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.678 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-08-10T12:05:21.678 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-08-10T12:05:21.678 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.679 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.679 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.679 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.679 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.679 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.679 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.679 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.679 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.680 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.680 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.680 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.680 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-08-10T12:05:21.680 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-08-10T12:05:21.680 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.680 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.680 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.681 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.681 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.681 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.681 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.681 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.681 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.681 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.681 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.682 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.682 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_ENABLED": { 2023-08-10T12:05:21.682 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_ENABLED", 2023-08-10T12:05:21.682 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.682 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.682 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.682 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.682 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.683 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.683 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.683 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.683 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.683 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.683 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.683 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.683 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-08-10T12:05:21.684 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-08-10T12:05:21.684 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.684 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.684 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.684 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-08-10T12:05:21.684 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.684 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.685 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.685 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.685 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.685 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.685 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.685 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.685 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-08-10T12:05:21.685 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-08-10T12:05:21.686 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.686 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.686 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.686 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-08-10T12:05:21.686 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.686 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.686 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.686 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.687 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.687 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.687 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.687 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.687 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-08-10T12:05:21.687 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-08-10T12:05:21.687 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.687 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.688 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.688 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8", 2023-08-10T12:05:21.688 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.688 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.688 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.688 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.688 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.688 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.689 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.689 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.689 INFO:teuthology.orchestra.run.smithi073.stdout: "REST_REQUESTS_TIMEOUT": { 2023-08-10T12:05:21.689 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-08-10T12:05:21.689 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.689 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.689 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.689 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "45", 2023-08-10T12:05:21.690 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.690 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.690 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.690 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.690 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.690 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.690 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.691 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.691 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_ACCESS_KEY": { 2023-08-10T12:05:21.691 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_ACCESS_KEY", 2023-08-10T12:05:21.691 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.691 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.691 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.691 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.691 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.692 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.692 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.692 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.692 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.692 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.692 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.692 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.693 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-08-10T12:05:21.693 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-08-10T12:05:21.693 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.693 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.693 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.693 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2023-08-10T12:05:21.693 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.693 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.694 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.694 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.694 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.694 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.694 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.694 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.694 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_SECRET_KEY": { 2023-08-10T12:05:21.694 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_SECRET_KEY", 2023-08-10T12:05:21.695 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.695 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.695 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.695 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.695 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.695 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.695 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.695 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.696 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.696 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.696 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.696 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.696 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_SSL_VERIFY": { 2023-08-10T12:05:21.696 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_SSL_VERIFY", 2023-08-10T12:05:21.696 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.696 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.697 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.697 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.697 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.697 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.697 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.697 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.697 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.697 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.698 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.698 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.698 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-08-10T12:05:21.698 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-08-10T12:05:21.698 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.698 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.698 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.698 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2023-08-10T12:05:21.699 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.699 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.699 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.699 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.699 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.699 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.699 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.700 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.700 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-08-10T12:05:21.700 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-08-10T12:05:21.700 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.700 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.700 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.700 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-08-10T12:05:21.700 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.701 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.701 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.701 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.701 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.701 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.701 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.701 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-08-10T12:05:21.702 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-08-10T12:05:21.702 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.702 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.702 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.702 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2023-08-10T12:05:21.702 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.702 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.702 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.703 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.703 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.703 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.703 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.703 INFO:teuthology.orchestra.run.smithi073.stdout: "cross_origin_url": { 2023-08-10T12:05:21.703 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cross_origin_url", 2023-08-10T12:05:21.703 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.704 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.704 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.704 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.704 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.704 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.704 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.704 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.704 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.705 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.705 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.705 INFO:teuthology.orchestra.run.smithi073.stdout: "crt_file": { 2023-08-10T12:05:21.705 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crt_file", 2023-08-10T12:05:21.705 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.705 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.705 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.706 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.706 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.706 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.706 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.706 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.706 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.706 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.706 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.707 INFO:teuthology.orchestra.run.smithi073.stdout: "debug": { 2023-08-10T12:05:21.707 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "debug", 2023-08-10T12:05:21.707 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.707 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.707 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.707 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.707 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.708 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.708 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.708 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable/disable debug options", 2023-08-10T12:05:21.708 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.708 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.708 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.709 INFO:teuthology.orchestra.run.smithi073.stdout: "jwt_token_ttl": { 2023-08-10T12:05:21.709 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "jwt_token_ttl", 2023-08-10T12:05:21.709 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.709 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.709 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.709 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "28800", 2023-08-10T12:05:21.709 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.709 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.710 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.710 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.710 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.710 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.710 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.710 INFO:teuthology.orchestra.run.smithi073.stdout: "key_file": { 2023-08-10T12:05:21.710 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "key_file", 2023-08-10T12:05:21.711 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.711 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.711 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.711 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.711 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.711 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.711 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.711 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.712 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.712 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.712 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.712 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:21.712 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:21.712 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.712 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.713 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.713 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.713 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.713 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.713 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.713 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.713 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.713 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.714 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.714 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.714 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.714 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.714 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.714 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.714 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.715 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.715 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:21.715 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:21.715 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.715 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.715 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.715 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.716 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.716 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.716 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.716 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.716 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.716 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.716 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.717 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:21.717 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:21.717 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.717 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.717 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.717 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:21.717 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.718 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.718 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.718 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.718 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.718 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.718 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.718 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.718 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.719 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.719 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.719 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.719 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.719 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.719 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.719 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:21.719 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:21.720 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.720 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.720 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.720 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.720 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.720 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.720 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.720 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.721 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.721 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.721 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.721 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.721 INFO:teuthology.orchestra.run.smithi073.stdout: "motd": { 2023-08-10T12:05:21.721 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "motd", 2023-08-10T12:05:21.721 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.721 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.722 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.722 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.722 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.722 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.722 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.722 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "The message of the day", 2023-08-10T12:05:21.722 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.722 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.723 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.723 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.723 INFO:teuthology.orchestra.run.smithi073.stdout: "redirect_resolve_ip_addr": { 2023-08-10T12:05:21.723 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "redirect_resolve_ip_addr", 2023-08-10T12:05:21.723 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.723 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.723 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.723 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.724 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.724 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.724 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.724 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.724 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.724 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.724 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.725 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2023-08-10T12:05:21.725 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2023-08-10T12:05:21.725 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.725 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.725 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.725 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "::", 2023-08-10T12:05:21.725 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.726 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.726 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.726 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.726 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.726 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.726 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.726 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.726 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2023-08-10T12:05:21.727 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2023-08-10T12:05:21.727 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.727 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.727 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.727 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8080", 2023-08-10T12:05:21.727 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.727 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.727 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.728 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.728 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.728 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.728 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.728 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl": { 2023-08-10T12:05:21.728 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl", 2023-08-10T12:05:21.728 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.729 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.729 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.729 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.729 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.729 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.729 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.729 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.729 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.730 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.730 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.730 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.730 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl_server_port": { 2023-08-10T12:05:21.730 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl_server_port", 2023-08-10T12:05:21.730 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.730 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.730 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.731 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8443", 2023-08-10T12:05:21.731 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.731 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.731 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.731 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.731 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.731 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.731 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.732 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.732 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_behaviour": { 2023-08-10T12:05:21.732 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_behaviour", 2023-08-10T12:05:21.732 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.732 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.732 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.732 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "redirect", 2023-08-10T12:05:21.732 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.733 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.733 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.733 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.733 INFO:teuthology.orchestra.run.smithi073.stdout: "redirect" 2023-08-10T12:05:21.733 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.733 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.733 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.734 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.734 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.734 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.734 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_error_status_code": { 2023-08-10T12:05:21.734 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_error_status_code", 2023-08-10T12:05:21.734 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.734 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.734 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.735 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "500", 2023-08-10T12:05:21.735 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "400", 2023-08-10T12:05:21.735 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "599", 2023-08-10T12:05:21.735 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.735 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.735 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.735 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.735 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.736 INFO:teuthology.orchestra.run.smithi073.stdout: "url_prefix": { 2023-08-10T12:05:21.736 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "url_prefix", 2023-08-10T12:05:21.736 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.736 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.736 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.736 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.736 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.737 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.737 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.737 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.737 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.737 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.737 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.737 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.737 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.738 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:21.738 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "devicehealth", 2023-08-10T12:05:21.738 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:21.738 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:21.738 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:21.738 INFO:teuthology.orchestra.run.smithi073.stdout: "enable_monitoring": { 2023-08-10T12:05:21.738 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enable_monitoring", 2023-08-10T12:05:21.739 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.739 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.739 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.739 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.739 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.739 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.739 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.740 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "monitor device health metrics", 2023-08-10T12:05:21.740 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.740 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.740 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.740 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:21.740 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:21.740 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.741 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.741 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.741 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.741 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.741 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.741 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.741 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.741 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.742 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.742 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.742 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.742 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.742 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.742 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.742 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.743 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.743 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.743 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.743 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:21.743 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:21.743 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.743 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.743 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.744 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.744 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.744 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.744 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.744 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.744 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.744 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.744 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.745 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.745 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:21.745 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:21.745 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.745 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.745 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.745 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:21.745 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.746 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.747 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.747 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.747 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.747 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.747 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.747 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.747 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:21.747 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:21.748 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.748 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.748 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.748 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.748 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.748 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.748 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.748 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.749 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.749 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.749 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.749 INFO:teuthology.orchestra.run.smithi073.stdout: "mark_out_threshold": { 2023-08-10T12:05:21.749 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mark_out_threshold", 2023-08-10T12:05:21.749 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:21.750 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.750 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.750 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "2419200", 2023-08-10T12:05:21.750 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.750 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.750 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.750 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-08-10T12:05:21.750 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.751 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.751 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.751 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": { 2023-08-10T12:05:21.751 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pool_name", 2023-08-10T12:05:21.751 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.751 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.751 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.752 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "device_health_metrics", 2023-08-10T12:05:21.752 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.752 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.752 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.752 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "name of pool in which to store device health metrics", 2023-08-10T12:05:21.752 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.752 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.752 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.753 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.753 INFO:teuthology.orchestra.run.smithi073.stdout: "retention_period": { 2023-08-10T12:05:21.753 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "retention_period", 2023-08-10T12:05:21.753 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:21.753 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.753 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.753 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15552000", 2023-08-10T12:05:21.754 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.754 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.754 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.754 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long to retain device health metrics", 2023-08-10T12:05:21.754 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.754 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.754 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.755 INFO:teuthology.orchestra.run.smithi073.stdout: "scrape_frequency": { 2023-08-10T12:05:21.755 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "scrape_frequency", 2023-08-10T12:05:21.755 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:21.755 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.755 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.755 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "86400", 2023-08-10T12:05:21.755 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.755 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.756 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.756 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to scrape device health metrics", 2023-08-10T12:05:21.756 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.756 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.756 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.756 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.756 INFO:teuthology.orchestra.run.smithi073.stdout: "self_heal": { 2023-08-10T12:05:21.756 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "self_heal", 2023-08-10T12:05:21.757 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.757 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.757 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.757 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.757 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.757 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.757 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.757 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-08-10T12:05:21.758 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.758 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.758 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.758 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.758 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2023-08-10T12:05:21.758 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2023-08-10T12:05:21.758 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:21.758 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.759 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.759 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2023-08-10T12:05:21.759 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.759 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.759 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.759 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to wake up and check device health", 2023-08-10T12:05:21.759 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.760 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.760 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.760 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.760 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_threshold": { 2023-08-10T12:05:21.760 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_threshold", 2023-08-10T12:05:21.760 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:21.760 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.760 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.761 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "7257600", 2023-08-10T12:05:21.761 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.761 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.761 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.761 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-08-10T12:05:21.761 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.761 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.761 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.762 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.762 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.762 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.762 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:21.762 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "diskprediction_local", 2023-08-10T12:05:21.762 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:21.762 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:21.763 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:21.763 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:21.763 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:21.763 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.763 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.763 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.763 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.763 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.764 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.764 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.764 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.764 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.764 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.764 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.764 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.764 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.765 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.765 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.765 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.765 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.765 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.765 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.765 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:21.765 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:21.766 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.766 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.766 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.766 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.766 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.766 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.766 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.766 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.767 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.767 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.767 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.767 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.767 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:21.767 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:21.767 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.768 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.768 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.768 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:21.768 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.768 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.768 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.768 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.768 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.769 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.769 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.769 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.769 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.769 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.769 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.769 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.769 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.770 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.770 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.770 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:21.770 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:21.770 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.770 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.770 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.770 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.771 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.771 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.771 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.771 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.771 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.771 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.771 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.772 INFO:teuthology.orchestra.run.smithi073.stdout: "predict_interval": { 2023-08-10T12:05:21.772 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "predict_interval", 2023-08-10T12:05:21.772 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.772 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.772 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.772 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "86400", 2023-08-10T12:05:21.772 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.772 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.773 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.773 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.773 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.773 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.773 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.773 INFO:teuthology.orchestra.run.smithi073.stdout: "predictor_model": { 2023-08-10T12:05:21.773 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "predictor_model", 2023-08-10T12:05:21.774 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.774 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.774 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.774 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "prophetstor", 2023-08-10T12:05:21.774 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.774 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.774 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.775 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.775 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.775 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.775 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.775 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2023-08-10T12:05:21.775 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2023-08-10T12:05:21.775 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.776 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.776 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.776 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2023-08-10T12:05:21.776 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.776 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.776 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.776 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.776 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.777 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.777 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.777 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.777 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.777 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:21.777 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "influx", 2023-08-10T12:05:21.777 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": false, 2023-08-10T12:05:21.778 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "influxdb python module not found", 2023-08-10T12:05:21.778 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:21.778 INFO:teuthology.orchestra.run.smithi073.stdout: "batch_size": { 2023-08-10T12:05:21.778 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "batch_size", 2023-08-10T12:05:21.778 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.778 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.778 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.778 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5000", 2023-08-10T12:05:21.779 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.779 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.779 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.779 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-08-10T12:05:21.779 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.779 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.779 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.780 INFO:teuthology.orchestra.run.smithi073.stdout: "database": { 2023-08-10T12:05:21.780 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "database", 2023-08-10T12:05:21.780 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.780 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.780 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.780 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "ceph", 2023-08-10T12:05:21.780 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.781 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.781 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.781 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-08-10T12:05:21.781 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.781 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.781 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.781 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": { 2023-08-10T12:05:21.782 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "hostname", 2023-08-10T12:05:21.782 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.782 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.782 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.782 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.782 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.782 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.782 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.783 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB server hostname", 2023-08-10T12:05:21.783 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.783 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.783 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.783 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.783 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2023-08-10T12:05:21.783 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2023-08-10T12:05:21.783 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:21.784 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.784 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.784 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "30", 2023-08-10T12:05:21.784 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "5", 2023-08-10T12:05:21.784 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.784 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.784 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-08-10T12:05:21.784 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.785 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.785 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.785 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:21.785 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:21.785 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.785 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.785 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.786 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.786 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.786 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.786 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.786 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.786 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.786 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.787 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.787 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.787 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.787 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.787 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.787 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.787 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.787 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.788 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:21.788 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:21.788 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.788 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.788 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.788 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.788 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.789 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.789 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.789 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.789 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.789 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.789 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.789 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:21.790 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:21.790 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.790 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.790 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.790 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:21.790 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.790 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.791 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.791 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.791 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.791 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.791 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.791 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.791 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.791 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.792 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.792 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.792 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.792 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.792 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:21.792 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:21.792 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.793 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.793 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.793 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.793 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.793 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.793 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.793 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.793 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.794 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.794 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.794 INFO:teuthology.orchestra.run.smithi073.stdout: "password": { 2023-08-10T12:05:21.794 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "password", 2023-08-10T12:05:21.794 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.794 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.794 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.795 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.795 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.795 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.795 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.795 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "password of InfluxDB server user", 2023-08-10T12:05:21.795 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.795 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.795 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.796 INFO:teuthology.orchestra.run.smithi073.stdout: "port": { 2023-08-10T12:05:21.796 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "port", 2023-08-10T12:05:21.796 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.796 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.796 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.796 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8086", 2023-08-10T12:05:21.797 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.797 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.797 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.797 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB server port", 2023-08-10T12:05:21.797 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.797 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.797 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.798 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl": { 2023-08-10T12:05:21.798 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl", 2023-08-10T12:05:21.798 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.798 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.798 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.798 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "false", 2023-08-10T12:05:21.798 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.798 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.799 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.799 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-08-10T12:05:21.799 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.799 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.799 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.799 INFO:teuthology.orchestra.run.smithi073.stdout: "threads": { 2023-08-10T12:05:21.799 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "threads", 2023-08-10T12:05:21.800 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.800 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.800 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.800 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2023-08-10T12:05:21.800 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2023-08-10T12:05:21.800 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "32", 2023-08-10T12:05:21.800 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.800 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-08-10T12:05:21.801 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.801 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.801 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.801 INFO:teuthology.orchestra.run.smithi073.stdout: "username": { 2023-08-10T12:05:21.801 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "username", 2023-08-10T12:05:21.801 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.801 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.802 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.802 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.802 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.802 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.802 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.802 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "username of InfluxDB server user", 2023-08-10T12:05:21.802 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.802 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.803 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.803 INFO:teuthology.orchestra.run.smithi073.stdout: "verify_ssl": { 2023-08-10T12:05:21.803 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "verify_ssl", 2023-08-10T12:05:21.803 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.803 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.803 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.803 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "true", 2023-08-10T12:05:21.804 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.804 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.804 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.804 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-08-10T12:05:21.804 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.804 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.804 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.805 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.805 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:21.805 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "insights", 2023-08-10T12:05:21.805 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:21.805 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:21.805 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:21.806 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:21.806 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:21.806 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.806 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.806 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.806 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.806 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.806 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.807 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.807 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.807 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.807 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.807 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.807 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.807 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.807 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.808 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.808 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.808 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.808 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.808 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:21.808 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:21.808 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.809 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.809 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.809 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.809 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.809 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.809 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.809 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.809 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.810 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.810 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.810 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.810 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:21.810 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:21.810 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.810 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.811 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.811 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:21.811 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.811 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.811 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.811 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.811 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.811 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.812 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.812 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.812 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.812 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.812 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.812 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.812 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.813 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.813 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:21.813 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:21.813 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.813 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.813 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.813 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.814 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.814 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.814 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.814 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.814 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.814 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.814 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.814 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.815 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.815 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:21.815 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "iostat", 2023-08-10T12:05:21.815 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:21.815 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:21.815 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:21.815 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:21.816 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:21.816 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.816 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.816 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.816 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.816 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.816 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.816 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.817 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.817 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.817 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.817 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.817 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.817 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.817 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.817 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.818 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.818 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.818 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.818 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:21.818 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:21.818 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.818 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.819 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.819 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.819 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.819 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.819 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.819 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.819 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.819 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.820 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.820 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:21.820 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:21.820 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.820 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.820 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.821 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:21.821 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.821 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.821 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.821 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.821 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.821 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.821 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.822 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.822 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.822 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.822 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.822 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.822 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.822 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.823 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:21.823 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:21.823 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.823 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.823 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.823 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.823 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.823 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.824 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.824 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.824 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.824 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.824 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.824 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.824 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.825 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:21.825 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "k8sevents", 2023-08-10T12:05:21.825 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:21.825 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:21.825 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:21.825 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_event_retention_days": { 2023-08-10T12:05:21.825 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ceph_event_retention_days", 2023-08-10T12:05:21.825 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.826 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.826 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.826 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "7", 2023-08-10T12:05:21.826 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.826 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.826 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.826 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Days to hold ceph event information within local cache", 2023-08-10T12:05:21.826 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.827 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.827 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.827 INFO:teuthology.orchestra.run.smithi073.stdout: "config_check_secs": { 2023-08-10T12:05:21.827 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_check_secs", 2023-08-10T12:05:21.827 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.827 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.828 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.828 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-08-10T12:05:21.828 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "10", 2023-08-10T12:05:21.828 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.828 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.828 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-08-10T12:05:21.828 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.828 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.829 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.829 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.829 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:21.829 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:21.829 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.829 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.829 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.829 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.830 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.830 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.830 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.830 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.830 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.830 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.830 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.830 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.831 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.831 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.831 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.831 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.831 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.831 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.831 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.831 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:21.832 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:21.832 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.832 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.832 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.832 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.832 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.832 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.833 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.833 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.833 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.833 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.833 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.833 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.833 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:21.833 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:21.834 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.834 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.834 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.834 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:21.834 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.834 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.834 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.834 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.835 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.835 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.835 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.835 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.835 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.835 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.835 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.836 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.836 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.836 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.836 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.836 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:21.836 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:21.836 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.836 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.837 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.837 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.837 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.837 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.837 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.837 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.837 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.837 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.838 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.838 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.838 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.838 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.838 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:21.838 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "localpool", 2023-08-10T12:05:21.838 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:21.838 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:21.839 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:21.839 INFO:teuthology.orchestra.run.smithi073.stdout: "failure_domain": { 2023-08-10T12:05:21.839 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "failure_domain", 2023-08-10T12:05:21.839 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.839 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.839 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.839 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "host", 2023-08-10T12:05:21.840 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.840 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.840 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.840 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "failure domain for any created local pool", 2023-08-10T12:05:21.840 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-08-10T12:05:21.840 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.840 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.841 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:21.841 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:21.841 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.841 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.841 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.841 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.841 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.841 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.842 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.842 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.842 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.842 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.842 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.842 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.842 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.842 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.843 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.843 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.843 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.843 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.843 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:21.843 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:21.843 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.844 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.844 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.844 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.844 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.844 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.844 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.844 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.845 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.845 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.845 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.845 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:21.845 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:21.845 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.845 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.846 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.846 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:21.846 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.846 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.846 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.846 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.846 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.846 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.847 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.847 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.847 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.847 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.847 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.847 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.847 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.847 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.848 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:21.848 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:21.848 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.848 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.848 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.848 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.849 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.849 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.849 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.849 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.849 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.849 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.849 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.849 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.850 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": { 2023-08-10T12:05:21.850 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "min_size", 2023-08-10T12:05:21.850 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.850 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.850 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.850 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.850 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.850 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.851 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.851 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default min_size for any created local pool", 2023-08-10T12:05:21.851 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-08-10T12:05:21.851 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.851 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.851 INFO:teuthology.orchestra.run.smithi073.stdout: "num_rep": { 2023-08-10T12:05:21.851 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "num_rep", 2023-08-10T12:05:21.852 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.852 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.852 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.852 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3", 2023-08-10T12:05:21.852 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.852 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.852 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.853 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default replica count for any created local pool", 2023-08-10T12:05:21.853 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.853 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.853 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.853 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": { 2023-08-10T12:05:21.853 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pg_num", 2023-08-10T12:05:21.853 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.854 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.854 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.854 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "128", 2023-08-10T12:05:21.854 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.854 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.854 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.854 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default pg_num for any created local pool", 2023-08-10T12:05:21.854 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.855 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.855 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.855 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.855 INFO:teuthology.orchestra.run.smithi073.stdout: "prefix": { 2023-08-10T12:05:21.855 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prefix", 2023-08-10T12:05:21.855 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.855 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.856 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.856 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.856 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.856 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.856 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.856 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "name prefix for any created local pool", 2023-08-10T12:05:21.856 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.856 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.857 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.857 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.857 INFO:teuthology.orchestra.run.smithi073.stdout: "subtree": { 2023-08-10T12:05:21.857 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "subtree", 2023-08-10T12:05:21.857 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.857 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.857 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.857 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "rack", 2023-08-10T12:05:21.858 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.858 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.858 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.858 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "CRUSH level for which to create a local pool", 2023-08-10T12:05:21.858 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-08-10T12:05:21.858 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.858 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.859 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.859 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.859 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.859 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:21.859 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mds_autoscaler", 2023-08-10T12:05:21.859 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:21.859 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:21.859 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:21.860 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:21.860 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:21.860 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.860 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.860 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.860 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.860 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.861 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.861 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.861 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.861 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.861 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.861 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.861 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.861 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.862 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.862 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.862 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.862 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.862 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.862 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.862 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:21.862 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:21.863 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.863 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.863 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.863 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.863 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.863 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.863 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.863 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.864 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.864 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.864 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.864 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:21.864 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:21.864 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.865 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.865 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.865 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:21.865 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.865 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.865 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.865 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.865 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.866 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.866 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.866 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.866 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.866 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.866 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.866 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.866 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.867 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.867 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.867 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:21.867 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:21.867 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.867 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.867 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.867 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.868 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.868 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.868 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.868 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.868 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.868 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.868 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.868 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.869 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:21.869 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mirroring", 2023-08-10T12:05:21.869 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:21.869 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:21.869 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:21.869 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:21.870 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:21.870 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.870 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.870 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.870 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.870 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.870 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.870 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.871 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.871 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.871 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.871 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.871 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.871 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.871 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.871 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.872 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.872 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.872 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.872 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.872 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:21.872 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:21.872 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.873 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.873 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.873 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.873 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.873 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.873 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.873 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.873 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.874 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.874 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.874 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:21.874 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:21.874 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.874 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.874 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.875 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:21.875 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.875 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.875 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.875 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.875 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.875 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.875 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.876 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.876 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.876 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.876 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.876 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.876 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.876 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.877 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:21.877 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:21.877 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.877 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.877 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.877 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.877 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.877 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.878 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.878 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.878 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.878 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.878 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.878 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.878 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.879 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:21.879 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "nfs", 2023-08-10T12:05:21.879 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:21.879 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:21.879 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:21.879 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:21.879 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:21.879 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.880 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.880 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.880 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.880 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.880 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.880 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.880 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.881 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.881 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.881 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.881 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.881 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.881 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.881 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.881 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.882 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.882 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.882 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:21.882 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:21.882 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.882 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.882 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.883 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.883 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.883 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.883 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.883 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.883 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.883 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.883 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.884 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:21.884 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:21.884 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.884 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.884 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.884 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:21.884 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.885 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.885 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.885 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.885 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.885 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.885 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.885 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.886 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.886 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.886 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.886 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.886 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.886 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.886 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:21.887 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:21.887 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.887 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.887 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.887 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.887 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.887 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.887 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.888 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.888 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.888 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.888 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.888 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.888 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.888 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:21.889 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "orchestrator", 2023-08-10T12:05:21.889 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:21.889 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:21.889 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:21.889 INFO:teuthology.orchestra.run.smithi073.stdout: "fail_fs": { 2023-08-10T12:05:21.889 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "fail_fs", 2023-08-10T12:05:21.889 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.889 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.890 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.890 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.890 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.890 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.890 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.890 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-08-10T12:05:21.890 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.891 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.891 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.891 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.891 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:21.891 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:21.891 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.891 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.891 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.892 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.892 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.892 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.892 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.892 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.892 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.892 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.892 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.893 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.893 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.893 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.893 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.893 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.893 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.893 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.894 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:21.894 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:21.894 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.894 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.894 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.894 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.894 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.894 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.895 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.895 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.895 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.895 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.895 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.895 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:21.895 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:21.896 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.896 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.896 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.896 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:21.896 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.896 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.896 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.896 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.897 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.897 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.897 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.897 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.897 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.897 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.897 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.897 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.898 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.898 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.898 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:21.898 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:21.898 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.898 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.898 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.899 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.899 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.899 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.899 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.899 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.899 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.899 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.900 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.900 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator": { 2023-08-10T12:05:21.900 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "orchestrator", 2023-08-10T12:05:21.900 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.900 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.900 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.900 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.901 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.901 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.901 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.901 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm", 2023-08-10T12:05:21.901 INFO:teuthology.orchestra.run.smithi073.stdout: "rook", 2023-08-10T12:05:21.901 INFO:teuthology.orchestra.run.smithi073.stdout: "test_orchestrator" 2023-08-10T12:05:21.901 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.901 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Orchestrator backend", 2023-08-10T12:05:21.902 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.902 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.902 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.902 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.902 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:21.902 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "osd_perf_query", 2023-08-10T12:05:21.903 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:21.903 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:21.903 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:21.903 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:21.903 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:21.903 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.903 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.903 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.904 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.904 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.904 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.904 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.904 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.904 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.904 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.904 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.905 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.905 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.905 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.905 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.905 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.905 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.905 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.906 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:21.906 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:21.906 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.906 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.906 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.906 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.906 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.906 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.907 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.907 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.907 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.907 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.907 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.907 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:21.907 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:21.908 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.908 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.908 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.908 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:21.908 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.908 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.908 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.909 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.909 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.909 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.909 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.909 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.909 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.909 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.909 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.910 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.910 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.910 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.910 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:21.910 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:21.910 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.911 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.911 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.911 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.911 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.911 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.911 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.911 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.911 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.912 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.912 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.912 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.912 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:21.912 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "osd_support", 2023-08-10T12:05:21.912 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:21.913 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:21.913 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:21.913 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:21.913 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:21.913 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.913 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.913 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.913 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.914 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.914 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.914 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.914 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.914 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.914 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.914 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.914 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.915 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.915 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.915 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.915 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.915 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.915 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.915 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:21.916 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:21.916 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.916 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.916 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.916 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.916 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.916 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.917 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.917 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.917 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.917 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.917 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.917 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:21.917 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:21.918 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.918 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.918 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.918 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:21.918 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.918 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.918 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.918 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.919 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.919 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.919 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.919 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.919 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.919 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.919 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.919 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.920 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.920 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.920 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:21.920 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:21.920 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.920 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.920 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.921 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.921 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.921 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.921 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.921 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.921 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.921 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.921 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.922 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.922 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:21.922 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pg_autoscaler", 2023-08-10T12:05:21.922 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:21.922 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:21.922 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:21.923 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:21.923 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:21.923 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.923 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.923 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.923 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.923 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.924 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.924 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.924 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.924 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.924 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.924 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.924 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.924 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.925 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.925 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.925 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.925 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.925 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.925 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:21.925 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:21.926 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.926 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.926 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.926 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.926 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.926 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.926 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.926 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.927 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.927 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.927 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.927 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:21.927 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:21.927 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.927 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.928 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.928 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:21.928 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.928 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.928 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.928 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.928 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.928 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.929 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.929 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.929 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.929 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.929 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.929 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.929 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.929 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.930 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:21.930 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:21.930 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.930 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.930 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.930 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.930 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.931 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.931 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.931 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.931 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.931 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.931 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.931 INFO:teuthology.orchestra.run.smithi073.stdout: "noautoscale": { 2023-08-10T12:05:21.932 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "noautoscale", 2023-08-10T12:05:21.932 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.932 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.932 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.932 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.932 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.932 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.932 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.933 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "global autoscale flag", 2023-08-10T12:05:21.933 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-08-10T12:05:21.933 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.933 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.933 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2023-08-10T12:05:21.933 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2023-08-10T12:05:21.933 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:21.934 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.934 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.934 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2023-08-10T12:05:21.934 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.934 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.934 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.934 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.935 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.935 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.935 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.935 INFO:teuthology.orchestra.run.smithi073.stdout: "threshold": { 2023-08-10T12:05:21.935 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "threshold", 2023-08-10T12:05:21.935 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-08-10T12:05:21.935 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.936 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.936 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3.0", 2023-08-10T12:05:21.936 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1.0", 2023-08-10T12:05:21.936 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.936 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.936 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "scaling threshold", 2023-08-10T12:05:21.936 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-08-10T12:05:21.937 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.937 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.937 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.937 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:21.937 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "progress", 2023-08-10T12:05:21.937 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:21.938 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:21.938 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:21.938 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_pg_recovery_event": { 2023-08-10T12:05:21.938 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_pg_recovery_event", 2023-08-10T12:05:21.938 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.938 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.938 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.938 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.939 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.939 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.939 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.939 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow the module to show pg recovery progress", 2023-08-10T12:05:21.939 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.939 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.939 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.940 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": { 2023-08-10T12:05:21.940 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enabled", 2023-08-10T12:05:21.940 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.940 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.940 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.940 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.940 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.940 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.941 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.941 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.941 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.941 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.941 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.941 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:21.942 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:21.942 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.942 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.942 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.942 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.942 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.942 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.942 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.943 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.943 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.943 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.943 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.943 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.943 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.943 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.943 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.944 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.944 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.944 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.944 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:21.944 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:21.944 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.944 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.945 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.945 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.945 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.945 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.945 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.945 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.945 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.945 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.946 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.946 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:21.946 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:21.946 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.946 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.946 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.946 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:21.947 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.947 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.947 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.947 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.947 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.947 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.947 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.947 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.948 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.948 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.948 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.948 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.948 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.948 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.948 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:21.949 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:21.949 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.949 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.949 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.949 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.949 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.949 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.949 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.950 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.950 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.950 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.950 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.950 INFO:teuthology.orchestra.run.smithi073.stdout: "max_completed_events": { 2023-08-10T12:05:21.950 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_completed_events", 2023-08-10T12:05:21.951 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.951 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.951 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.951 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "50", 2023-08-10T12:05:21.951 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.951 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.951 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.951 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "number of past completed events to remember", 2023-08-10T12:05:21.952 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.952 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.952 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.952 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2023-08-10T12:05:21.952 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2023-08-10T12:05:21.952 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:21.952 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.953 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.953 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2023-08-10T12:05:21.953 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.953 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.953 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.953 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long the module is going to sleep", 2023-08-10T12:05:21.953 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.953 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.954 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.954 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.954 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:21.954 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus", 2023-08-10T12:05:21.954 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:21.954 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:21.955 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:21.955 INFO:teuthology.orchestra.run.smithi073.stdout: "cache": { 2023-08-10T12:05:21.955 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cache", 2023-08-10T12:05:21.955 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.955 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.955 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.955 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.955 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.956 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.956 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.956 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.956 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.956 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.956 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.956 INFO:teuthology.orchestra.run.smithi073.stdout: "exclude_perf_counters": { 2023-08-10T12:05:21.957 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "exclude_perf_counters", 2023-08-10T12:05:21.957 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.957 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.957 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.957 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.957 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.957 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.957 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.958 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-08-10T12:05:21.958 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-08-10T12:05:21.958 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.958 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.958 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:21.958 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:21.959 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.959 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.959 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.959 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.959 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.959 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.959 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.959 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.960 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.960 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.960 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.960 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.960 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.960 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.960 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.961 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.961 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.961 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.961 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:21.961 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:21.961 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.961 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.962 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.962 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.962 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.962 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.962 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.962 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.962 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.962 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.963 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.963 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:21.963 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:21.963 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.963 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.963 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.963 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:21.964 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.964 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.964 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.964 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.964 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.964 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.964 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.964 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.965 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.965 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.965 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.965 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.965 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.965 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.965 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:21.966 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:21.966 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.966 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.966 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.966 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.966 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.966 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.966 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.967 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.967 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.967 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.967 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.967 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_stats_pools": { 2023-08-10T12:05:21.967 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_stats_pools", 2023-08-10T12:05:21.967 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.968 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.968 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.968 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.968 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.968 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.968 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.968 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.968 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.969 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.969 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.969 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_stats_pools_refresh_interval": { 2023-08-10T12:05:21.969 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-08-10T12:05:21.969 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.969 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.969 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.970 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "300", 2023-08-10T12:05:21.970 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.970 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.970 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.970 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.970 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.970 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.971 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.971 INFO:teuthology.orchestra.run.smithi073.stdout: "scrape_interval": { 2023-08-10T12:05:21.971 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "scrape_interval", 2023-08-10T12:05:21.971 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-08-10T12:05:21.971 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.971 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.971 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15.0", 2023-08-10T12:05:21.972 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.972 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.972 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.972 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.972 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.972 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.972 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.973 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2023-08-10T12:05:21.973 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2023-08-10T12:05:21.973 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.973 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.973 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.973 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "::", 2023-08-10T12:05:21.973 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.973 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.974 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.974 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-08-10T12:05:21.974 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.974 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.974 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.974 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2023-08-10T12:05:21.974 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2023-08-10T12:05:21.975 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.975 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.975 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.975 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "9283", 2023-08-10T12:05:21.975 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.975 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.975 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.975 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-08-10T12:05:21.976 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.976 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.976 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.976 INFO:teuthology.orchestra.run.smithi073.stdout: "stale_cache_strategy": { 2023-08-10T12:05:21.976 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "stale_cache_strategy", 2023-08-10T12:05:21.976 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.976 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.977 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.977 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "log", 2023-08-10T12:05:21.977 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.977 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.977 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.977 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.977 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.978 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.978 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.978 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_behaviour": { 2023-08-10T12:05:21.978 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_behaviour", 2023-08-10T12:05:21.978 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.978 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.978 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.979 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "default", 2023-08-10T12:05:21.979 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.979 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.979 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.979 INFO:teuthology.orchestra.run.smithi073.stdout: "default", 2023-08-10T12:05:21.979 INFO:teuthology.orchestra.run.smithi073.stdout: "error" 2023-08-10T12:05:21.979 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.979 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.980 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.980 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.980 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.980 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_error_status_code": { 2023-08-10T12:05:21.980 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_error_status_code", 2023-08-10T12:05:21.980 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.980 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.981 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.981 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "500", 2023-08-10T12:05:21.981 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "400", 2023-08-10T12:05:21.981 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "599", 2023-08-10T12:05:21.981 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.981 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.981 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.981 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.982 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.982 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.982 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.982 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:21.982 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_support", 2023-08-10T12:05:21.982 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:21.983 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:21.983 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:21.983 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:21.983 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:21.983 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.983 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.983 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.983 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.984 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.984 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.984 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.984 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.984 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.984 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.984 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.985 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.985 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.985 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.985 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.985 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.985 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.985 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.986 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:21.986 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:21.986 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.986 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.986 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.986 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.986 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.986 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.987 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.987 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.987 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.987 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.987 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.987 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:21.987 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:21.988 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.988 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.988 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.988 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:21.988 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.988 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.988 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:21.988 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:21.989 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:21.989 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:21.989 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:21.989 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:21.989 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:21.989 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:21.989 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.990 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.990 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.990 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.990 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.990 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:21.990 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:21.990 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.990 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.991 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:21.991 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:21.991 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.991 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.991 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.991 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.991 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.991 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.992 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.992 INFO:teuthology.orchestra.run.smithi073.stdout: "max_concurrent_snap_create": { 2023-08-10T12:05:21.992 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_concurrent_snap_create", 2023-08-10T12:05:21.992 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:21.992 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.992 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.992 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-08-10T12:05:21.993 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.993 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.993 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.993 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.993 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.993 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.993 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.994 INFO:teuthology.orchestra.run.smithi073.stdout: "mirror_snapshot_schedule": { 2023-08-10T12:05:21.994 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mirror_snapshot_schedule", 2023-08-10T12:05:21.994 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.994 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.994 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.994 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.994 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.994 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.995 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.995 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.995 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.995 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.995 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.995 INFO:teuthology.orchestra.run.smithi073.stdout: "trash_purge_schedule": { 2023-08-10T12:05:21.995 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "trash_purge_schedule", 2023-08-10T12:05:21.996 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:21.996 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.996 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.996 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:21.996 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.996 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.996 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.996 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.997 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.997 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:21.997 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:21.997 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.997 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:21.997 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:21.997 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:21.998 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "restful", 2023-08-10T12:05:21.998 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:21.998 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:21.998 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:21.998 INFO:teuthology.orchestra.run.smithi073.stdout: "enable_auth": { 2023-08-10T12:05:21.998 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enable_auth", 2023-08-10T12:05:21.998 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:21.998 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:21.999 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:21.999 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:21.999 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:21.999 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:21.999 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:21.999 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:21.999 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:21.999 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.000 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.000 INFO:teuthology.orchestra.run.smithi073.stdout: "key_file": { 2023-08-10T12:05:22.000 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "key_file", 2023-08-10T12:05:22.000 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.000 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.000 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.000 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.001 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.001 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.001 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.001 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.001 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.001 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.001 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.001 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.002 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.002 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.002 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.002 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.002 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.002 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.002 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.002 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.003 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.003 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.003 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.003 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.003 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.003 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.003 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.003 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.004 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.004 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.004 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.004 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.004 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.004 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.005 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.005 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.005 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.005 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.005 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.005 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.005 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.005 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.006 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.006 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.006 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.006 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.006 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.006 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.006 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.007 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.007 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.007 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.007 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.007 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.007 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.008 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.008 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.008 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.008 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.008 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.008 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.008 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.009 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.009 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.009 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.009 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.009 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.009 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.009 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.009 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.010 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.010 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.010 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.010 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.010 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.010 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.010 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.010 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.011 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.011 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2023-08-10T12:05:22.011 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2023-08-10T12:05:22.011 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.011 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.011 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.011 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.012 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.012 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.012 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.012 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.012 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.012 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.012 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.013 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2023-08-10T12:05:22.013 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2023-08-10T12:05:22.013 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.013 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.013 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.013 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.013 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.014 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.014 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.014 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.014 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.014 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.014 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.014 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.014 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.015 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.015 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rgw", 2023-08-10T12:05:22.015 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.015 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.015 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.015 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.015 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.016 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.016 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.016 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.016 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.016 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.016 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.016 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.016 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.017 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.017 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.017 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.017 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.017 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.017 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.017 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.017 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.018 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.018 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.018 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.018 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.018 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.018 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.018 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.019 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.019 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.019 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.019 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.019 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.019 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.019 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.019 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.020 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.020 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.020 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.020 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.020 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.020 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.020 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.020 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.021 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.021 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.021 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.021 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.021 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.021 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.021 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.022 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.022 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.022 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.022 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.022 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.022 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.022 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.022 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.023 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.023 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.023 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.023 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.023 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.023 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.023 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.023 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.024 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.024 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.024 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.024 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.024 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.024 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.024 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.024 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.025 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rook", 2023-08-10T12:05:22.025 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.025 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.025 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.025 INFO:teuthology.orchestra.run.smithi073.stdout: "drive_group_interval": { 2023-08-10T12:05:22.025 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "drive_group_interval", 2023-08-10T12:05:22.025 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-08-10T12:05:22.025 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.026 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.026 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "300.0", 2023-08-10T12:05:22.026 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.026 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.026 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.026 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-08-10T12:05:22.026 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.026 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.027 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.027 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.027 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.027 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.027 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.027 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.027 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.028 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.028 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.028 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.028 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.028 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.028 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.028 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.028 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.029 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.029 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.029 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.029 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.029 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.029 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.030 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.030 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.030 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.030 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.030 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.030 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.030 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.030 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.031 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.031 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.031 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.031 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.031 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.031 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.031 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.032 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.032 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.032 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.032 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.032 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.032 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.032 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.033 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.033 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.033 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.033 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.033 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.033 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.033 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.033 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.034 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.034 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.034 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.034 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.034 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.034 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.035 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.035 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.035 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.035 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.035 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.035 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.035 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.035 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.036 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.036 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.036 INFO:teuthology.orchestra.run.smithi073.stdout: "storage_class": { 2023-08-10T12:05:22.036 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "storage_class", 2023-08-10T12:05:22.036 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.036 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.036 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.037 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "local", 2023-08-10T12:05:22.037 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.037 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.037 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.037 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-08-10T12:05:22.037 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.037 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.037 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.038 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.038 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.038 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "selftest", 2023-08-10T12:05:22.038 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.038 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.038 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.039 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.039 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.039 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.039 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.039 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.039 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.039 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.039 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.040 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.040 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.040 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.040 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.040 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.040 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.040 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.040 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.041 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.041 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.041 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.041 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.041 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.041 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.042 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.042 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.042 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.042 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.042 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.042 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.042 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.042 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.043 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.043 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.043 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.043 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.043 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.043 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.043 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.044 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.044 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.044 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.044 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.044 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.044 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.044 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.044 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.045 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.045 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.045 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.045 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.045 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.045 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.045 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.045 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.046 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.046 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.046 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.046 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.046 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.046 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.047 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.047 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.047 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.047 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.047 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.047 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.047 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.048 INFO:teuthology.orchestra.run.smithi073.stdout: "roption1": { 2023-08-10T12:05:22.048 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "roption1", 2023-08-10T12:05:22.048 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.048 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.048 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.048 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.048 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.048 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.049 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.049 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.049 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.049 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.049 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.049 INFO:teuthology.orchestra.run.smithi073.stdout: "roption2": { 2023-08-10T12:05:22.049 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "roption2", 2023-08-10T12:05:22.050 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.050 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.050 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.050 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "xyz", 2023-08-10T12:05:22.050 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.050 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.050 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.050 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.051 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.051 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.051 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.051 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption1": { 2023-08-10T12:05:22.051 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption1", 2023-08-10T12:05:22.051 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.052 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.052 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.052 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.052 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.052 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.052 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.052 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.052 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.053 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.053 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.053 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption2": { 2023-08-10T12:05:22.053 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption2", 2023-08-10T12:05:22.053 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.053 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.053 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.054 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.054 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.054 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.054 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.054 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.054 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.054 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.054 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.055 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption3": { 2023-08-10T12:05:22.055 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption3", 2023-08-10T12:05:22.055 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-08-10T12:05:22.055 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.055 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.055 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.055 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.056 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.056 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.056 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.056 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.056 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.056 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.056 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption4": { 2023-08-10T12:05:22.057 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption4", 2023-08-10T12:05:22.057 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.057 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.057 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.057 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.057 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.057 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.058 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.058 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.058 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.058 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.058 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.058 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption5": { 2023-08-10T12:05:22.059 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption5", 2023-08-10T12:05:22.059 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.059 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.059 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.059 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.059 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.059 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.059 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.060 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.060 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.060 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.060 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.060 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption6": { 2023-08-10T12:05:22.060 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption6", 2023-08-10T12:05:22.060 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.061 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.061 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.061 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.061 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.061 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.061 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.061 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.061 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.062 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.062 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.062 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption7": { 2023-08-10T12:05:22.062 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption7", 2023-08-10T12:05:22.062 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.062 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.062 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.063 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.063 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2023-08-10T12:05:22.063 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "42", 2023-08-10T12:05:22.063 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.063 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.063 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.063 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.063 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.064 INFO:teuthology.orchestra.run.smithi073.stdout: "testkey": { 2023-08-10T12:05:22.064 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testkey", 2023-08-10T12:05:22.064 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.064 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.064 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.064 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.065 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.065 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.065 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.065 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.065 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.065 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.065 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.066 INFO:teuthology.orchestra.run.smithi073.stdout: "testlkey": { 2023-08-10T12:05:22.066 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testlkey", 2023-08-10T12:05:22.066 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.066 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.066 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.066 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.066 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.066 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.067 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.067 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.067 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.067 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.067 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.067 INFO:teuthology.orchestra.run.smithi073.stdout: "testnewline": { 2023-08-10T12:05:22.067 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testnewline", 2023-08-10T12:05:22.068 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.068 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.068 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.068 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.068 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.068 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.068 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.068 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.069 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.069 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.069 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.069 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.069 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.069 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snap_schedule", 2023-08-10T12:05:22.070 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.070 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.070 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.070 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_m_granularity": { 2023-08-10T12:05:22.070 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_m_granularity", 2023-08-10T12:05:22.070 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.070 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.070 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.071 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.071 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.071 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.071 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.071 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow minute scheduled snapshots", 2023-08-10T12:05:22.071 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.071 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.071 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.072 INFO:teuthology.orchestra.run.smithi073.stdout: "dump_on_update": { 2023-08-10T12:05:22.072 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "dump_on_update", 2023-08-10T12:05:22.072 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.072 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.072 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.072 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.073 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.073 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.073 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.073 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "dump database to debug log on update", 2023-08-10T12:05:22.073 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.073 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.073 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.074 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.074 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.074 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.074 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.074 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.074 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.074 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.074 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.075 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.075 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.075 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.075 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.075 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.075 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.075 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.075 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.076 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.076 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.076 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.076 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.076 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.076 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.076 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.077 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.077 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.077 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.077 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.077 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.077 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.077 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.077 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.078 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.078 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.078 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.078 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.078 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.078 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.078 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.079 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.079 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.079 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.079 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.079 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.079 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.079 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.080 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.080 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.080 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.080 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.080 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.080 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.080 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.080 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.081 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.081 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.081 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.081 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.081 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.081 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.081 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.082 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.082 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.082 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.082 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.082 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.082 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.082 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.083 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.083 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "stats", 2023-08-10T12:05:22.083 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.083 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.083 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.083 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.084 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.084 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.084 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.084 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.084 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.084 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.084 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.084 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.085 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.085 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.085 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.085 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.085 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.085 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.085 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.085 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.086 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.086 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.086 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.086 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.086 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.086 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.086 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.087 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.087 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.087 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.087 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.087 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.087 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.087 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.088 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.088 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.088 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.088 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.088 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.088 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.088 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.089 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.089 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.089 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.089 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.089 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.089 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.089 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.089 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.090 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.090 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.090 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.090 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.090 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.090 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.090 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.091 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.091 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.091 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.091 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.091 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.091 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.091 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.091 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.092 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.092 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.092 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.092 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.092 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.092 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.092 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.093 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "status", 2023-08-10T12:05:22.093 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.093 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.093 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.093 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.093 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.094 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.094 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.094 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.094 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.094 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.094 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.094 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.094 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.095 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.095 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.095 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.095 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.095 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.095 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.095 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.095 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.096 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.096 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.096 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.096 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.096 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.096 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.096 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.097 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.097 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.097 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.097 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.097 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.097 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.097 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.097 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.098 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.098 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.098 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.098 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.098 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.098 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.098 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.099 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.099 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.099 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.099 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.099 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.099 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.099 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.099 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.100 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.100 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.100 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.100 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.100 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.100 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.101 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.101 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.101 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.101 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.101 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.101 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.101 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.101 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.102 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.102 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.102 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.102 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.102 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.102 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.103 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "telegraf", 2023-08-10T12:05:22.103 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.103 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.103 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.103 INFO:teuthology.orchestra.run.smithi073.stdout: "address": { 2023-08-10T12:05:22.103 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "address", 2023-08-10T12:05:22.103 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.103 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.104 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.104 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-08-10T12:05:22.104 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.104 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.104 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.104 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.104 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.104 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.105 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.105 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2023-08-10T12:05:22.105 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2023-08-10T12:05:22.105 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:22.105 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.105 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.105 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15", 2023-08-10T12:05:22.106 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.106 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.106 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.106 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.106 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.106 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.106 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.107 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.107 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.107 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.107 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.107 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.107 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.107 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.108 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.108 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.108 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.108 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.108 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.108 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.108 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.108 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.109 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.109 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.109 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.109 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.109 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.109 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.110 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.110 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.110 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.110 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.110 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.110 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.110 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.110 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.111 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.111 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.111 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.111 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.111 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.111 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.111 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.112 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.112 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.112 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.112 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.112 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.112 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.112 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.112 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.113 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.113 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.113 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.113 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.113 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.113 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.113 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.113 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.114 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.114 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.114 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.114 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.114 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.114 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.114 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.115 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.115 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.115 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.115 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.115 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.115 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.115 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.115 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.116 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.116 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "telemetry", 2023-08-10T12:05:22.116 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.116 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.116 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.117 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_basic": { 2023-08-10T12:05:22.117 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_basic", 2023-08-10T12:05:22.117 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.117 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.117 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.117 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.117 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.117 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.118 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.118 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share basic cluster information (size, version)", 2023-08-10T12:05:22.118 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.118 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.118 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.118 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_crash": { 2023-08-10T12:05:22.118 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_crash", 2023-08-10T12:05:22.119 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.119 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.119 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.119 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.119 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.119 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.119 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.119 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-08-10T12:05:22.120 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.120 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.120 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.120 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_device": { 2023-08-10T12:05:22.120 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_device", 2023-08-10T12:05:22.120 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.120 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.121 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.121 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.121 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.121 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.121 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.121 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-08-10T12:05:22.121 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.122 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.122 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.122 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_ident": { 2023-08-10T12:05:22.122 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_ident", 2023-08-10T12:05:22.122 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.122 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.122 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.123 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.123 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.123 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.123 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.123 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-08-10T12:05:22.123 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.123 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.123 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.124 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_perf": { 2023-08-10T12:05:22.124 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_perf", 2023-08-10T12:05:22.124 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.124 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.124 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.124 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.124 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.125 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.125 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.125 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share various performance metrics of a cluster", 2023-08-10T12:05:22.125 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.125 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.125 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.125 INFO:teuthology.orchestra.run.smithi073.stdout: "contact": { 2023-08-10T12:05:22.126 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "contact", 2023-08-10T12:05:22.126 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.126 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.126 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.126 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.126 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.126 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.127 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.127 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.127 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.127 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.127 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.127 INFO:teuthology.orchestra.run.smithi073.stdout: "description": { 2023-08-10T12:05:22.127 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "description", 2023-08-10T12:05:22.128 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.128 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.128 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.128 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.128 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.128 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.128 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.128 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.129 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.129 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.129 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.129 INFO:teuthology.orchestra.run.smithi073.stdout: "device_url": { 2023-08-10T12:05:22.129 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_url", 2023-08-10T12:05:22.129 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.129 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.130 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.130 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-08-10T12:05:22.130 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.130 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.130 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.130 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.130 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.130 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.131 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.131 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": { 2023-08-10T12:05:22.131 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enabled", 2023-08-10T12:05:22.131 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.131 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.131 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.132 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.132 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.132 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.132 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.132 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.132 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.132 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.132 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.133 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2023-08-10T12:05:22.133 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2023-08-10T12:05:22.133 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.133 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.133 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.133 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "24", 2023-08-10T12:05:22.133 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "8", 2023-08-10T12:05:22.134 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.134 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.134 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.134 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.134 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.134 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.134 INFO:teuthology.orchestra.run.smithi073.stdout: "last_opt_revision": { 2023-08-10T12:05:22.135 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "last_opt_revision", 2023-08-10T12:05:22.135 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.135 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.135 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.135 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1", 2023-08-10T12:05:22.135 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.135 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.135 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.136 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.136 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.136 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.136 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.136 INFO:teuthology.orchestra.run.smithi073.stdout: "leaderboard": { 2023-08-10T12:05:22.136 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "leaderboard", 2023-08-10T12:05:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.138 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.138 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.138 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.138 INFO:teuthology.orchestra.run.smithi073.stdout: "leaderboard_description": { 2023-08-10T12:05:22.138 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "leaderboard_description", 2023-08-10T12:05:22.138 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.138 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.139 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.139 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.139 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.139 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.139 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.139 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.139 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.139 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.140 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.140 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.140 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.140 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.140 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.140 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.140 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.141 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.141 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.141 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.141 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.141 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.141 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.141 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.141 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.142 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.142 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.142 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.142 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.142 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.142 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.142 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.143 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.143 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.143 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.143 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.143 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.143 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.143 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.143 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.144 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.144 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.144 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.144 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.144 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.144 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.145 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.145 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.145 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.145 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.145 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.145 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.145 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.145 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.146 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.146 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.146 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.146 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.146 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.146 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.146 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.146 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.147 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.147 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.147 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.147 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.147 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.147 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.147 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.148 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.148 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.148 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.148 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.148 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.148 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.148 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.148 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.149 INFO:teuthology.orchestra.run.smithi073.stdout: "organization": { 2023-08-10T12:05:22.149 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "organization", 2023-08-10T12:05:22.149 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.149 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.149 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.149 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.149 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.150 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.150 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.150 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.150 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.150 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.150 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.150 INFO:teuthology.orchestra.run.smithi073.stdout: "proxy": { 2023-08-10T12:05:22.151 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "proxy", 2023-08-10T12:05:22.151 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.151 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.151 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.151 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.151 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.151 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.151 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.152 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.152 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.152 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.152 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.152 INFO:teuthology.orchestra.run.smithi073.stdout: "url": { 2023-08-10T12:05:22.152 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "url", 2023-08-10T12:05:22.153 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.153 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.153 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.153 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-08-10T12:05:22.153 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.153 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.153 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.153 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.154 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.154 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.154 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.154 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.154 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.154 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "test_orchestrator", 2023-08-10T12:05:22.155 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.155 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.155 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.155 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.155 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.155 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.155 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.155 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.156 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.156 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.156 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.156 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.156 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.156 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.156 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.157 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.157 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.157 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.157 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.157 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.157 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.157 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.157 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.158 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.158 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.158 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.158 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.158 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.158 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.158 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.159 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.159 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.159 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.159 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.159 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.159 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.160 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.160 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.160 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.160 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.160 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.160 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.160 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.160 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.161 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.161 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.161 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.161 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.161 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.161 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.161 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.161 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.162 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.162 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.162 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.162 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.162 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.162 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.162 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.163 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.163 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.163 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.163 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.163 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.163 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.163 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.163 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.164 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.164 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.164 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.164 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.164 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "volumes", 2023-08-10T12:05:22.164 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.165 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.165 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.165 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.165 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.165 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.165 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.165 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.165 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.166 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.166 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.166 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.166 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.166 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.166 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.166 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.166 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.167 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.167 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.167 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.167 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.167 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.167 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.168 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.168 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.168 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.168 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.168 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.168 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.168 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.168 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.169 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.169 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.169 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.169 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.169 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.169 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.169 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.170 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.170 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.170 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.170 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.170 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.170 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.170 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.170 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.171 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.171 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.171 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.171 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.171 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.171 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.171 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.171 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.172 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.172 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.172 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.172 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.172 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.172 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.172 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.173 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.173 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.173 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.173 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.173 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.173 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.173 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.174 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.174 INFO:teuthology.orchestra.run.smithi073.stdout: "max_concurrent_clones": { 2023-08-10T12:05:22.174 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_concurrent_clones", 2023-08-10T12:05:22.174 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.174 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.174 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.174 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "4", 2023-08-10T12:05:22.175 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.175 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.175 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.175 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Number of asynchronous cloner threads", 2023-08-10T12:05:22.175 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.175 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.175 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.176 INFO:teuthology.orchestra.run.smithi073.stdout: "snapshot_clone_delay": { 2023-08-10T12:05:22.176 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snapshot_clone_delay", 2023-08-10T12:05:22.176 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.176 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.176 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.176 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2023-08-10T12:05:22.176 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.176 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.177 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.177 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-08-10T12:05:22.177 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.177 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.177 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.177 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.177 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.178 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.178 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix", 2023-08-10T12:05:22.178 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.178 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.178 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.178 INFO:teuthology.orchestra.run.smithi073.stdout: "discovery_interval": { 2023-08-10T12:05:22.178 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "discovery_interval", 2023-08-10T12:05:22.178 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2023-08-10T12:05:22.179 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.179 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.179 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "100", 2023-08-10T12:05:22.179 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.179 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.179 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.179 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.179 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.180 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.180 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.180 INFO:teuthology.orchestra.run.smithi073.stdout: "identifier": { 2023-08-10T12:05:22.180 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "identifier", 2023-08-10T12:05:22.180 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.180 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.181 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.181 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.181 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.181 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.181 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.181 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.181 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.182 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.182 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.182 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.182 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2023-08-10T12:05:22.182 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2023-08-10T12:05:22.182 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:22.182 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.182 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.183 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2023-08-10T12:05:22.183 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.183 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.183 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.183 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.183 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.183 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.183 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.184 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.184 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.184 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.184 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.184 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.184 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.184 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.184 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.185 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.185 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.185 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.185 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.185 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.185 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.185 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.185 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.186 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.186 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.186 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.186 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.186 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.186 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.186 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.186 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.187 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.187 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.187 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.187 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.187 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.187 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.187 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.188 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.188 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.188 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.188 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.188 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.188 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.188 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.189 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.189 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.189 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.189 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.189 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.189 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.189 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.189 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.190 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.190 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.190 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.190 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.190 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.190 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.190 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.190 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.191 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.191 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.191 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.191 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.191 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.191 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.191 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.192 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.192 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.192 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.192 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.192 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.192 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.192 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.193 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_host": { 2023-08-10T12:05:22.193 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_host", 2023-08-10T12:05:22.193 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.193 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.193 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.193 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.193 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.194 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.194 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.194 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.194 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.194 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.194 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.194 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_port": { 2023-08-10T12:05:22.195 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_port", 2023-08-10T12:05:22.195 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.195 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.195 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.195 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10051", 2023-08-10T12:05:22.195 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.195 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.195 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.196 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.196 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.196 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.196 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.196 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_sender": { 2023-08-10T12:05:22.196 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_sender", 2023-08-10T12:05:22.196 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.197 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.197 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.197 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-08-10T12:05:22.197 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.197 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.197 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.197 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.197 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.198 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.198 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.198 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.198 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.198 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.198 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-08-10T12:05:22.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.199 INFO:teuthology.orchestra.run.smithi073.stdout: "gid": 25007, 2023-08-10T12:05:22.199 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "y", 2023-08-10T12:05:22.199 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_features": 4540138322906710015, 2023-08-10T12:05:22.199 INFO:teuthology.orchestra.run.smithi073.stdout: "available_modules": [ 2023-08-10T12:05:22.199 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.199 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "alerts", 2023-08-10T12:05:22.199 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.199 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.200 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.200 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2023-08-10T12:05:22.200 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2023-08-10T12:05:22.200 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:22.200 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.200 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.200 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2023-08-10T12:05:22.201 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.201 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.201 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.201 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How frequently to reexamine health status", 2023-08-10T12:05:22.201 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.201 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.201 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.201 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.202 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.202 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.202 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.202 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.202 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.202 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.202 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.202 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.203 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.203 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.203 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.203 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.203 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.203 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.203 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.203 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.204 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.204 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.204 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.204 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.204 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.204 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.204 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.205 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.205 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.205 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.205 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.205 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.205 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.205 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.205 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.206 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.206 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.206 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.206 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.206 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.206 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.206 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.207 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.207 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.207 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.207 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.207 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.207 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.207 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.207 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.208 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.208 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.208 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.208 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.208 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.208 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.208 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.208 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.209 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.209 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.209 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.209 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.209 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.209 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.209 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.209 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.210 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.210 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.210 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.210 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.210 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.210 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.210 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.210 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_destination": { 2023-08-10T12:05:22.211 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_destination", 2023-08-10T12:05:22.211 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.211 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.211 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.211 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.211 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.211 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.211 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.212 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Email address to send alerts to", 2023-08-10T12:05:22.212 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.212 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.212 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.212 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_from_name": { 2023-08-10T12:05:22.212 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_from_name", 2023-08-10T12:05:22.213 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.213 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.213 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.213 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "Ceph", 2023-08-10T12:05:22.213 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.213 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.213 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.213 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Email From: name", 2023-08-10T12:05:22.214 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.214 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.214 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.214 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_host": { 2023-08-10T12:05:22.214 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_host", 2023-08-10T12:05:22.214 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.214 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.215 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.215 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.215 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.215 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.215 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.215 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP server", 2023-08-10T12:05:22.215 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.215 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.216 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.216 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_password": { 2023-08-10T12:05:22.216 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_password", 2023-08-10T12:05:22.216 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.216 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.216 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.216 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.217 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.217 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.217 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.217 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Password to authenticate with", 2023-08-10T12:05:22.217 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.217 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.217 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.218 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_port": { 2023-08-10T12:05:22.218 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_port", 2023-08-10T12:05:22.218 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.218 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.218 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.218 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "465", 2023-08-10T12:05:22.218 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.219 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.219 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.219 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP port", 2023-08-10T12:05:22.219 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.219 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.219 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.219 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.219 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_sender": { 2023-08-10T12:05:22.220 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_sender", 2023-08-10T12:05:22.220 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.220 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.220 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.220 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.220 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.220 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.220 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.221 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP envelope sender", 2023-08-10T12:05:22.221 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.221 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.221 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.221 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.221 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_ssl": { 2023-08-10T12:05:22.221 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_ssl", 2023-08-10T12:05:22.221 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.222 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.222 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.222 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.222 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.222 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.222 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.222 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use SSL to connect to SMTP server", 2023-08-10T12:05:22.222 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.223 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.223 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.223 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_user": { 2023-08-10T12:05:22.223 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_user", 2023-08-10T12:05:22.223 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.223 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.223 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.224 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.224 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.224 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.224 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.224 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "User to authenticate as", 2023-08-10T12:05:22.224 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.224 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.224 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.225 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.225 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.225 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.225 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.225 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "balancer", 2023-08-10T12:05:22.225 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.225 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.225 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.226 INFO:teuthology.orchestra.run.smithi073.stdout: "active": { 2023-08-10T12:05:22.226 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "active", 2023-08-10T12:05:22.226 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.226 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.226 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.226 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.226 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.226 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.227 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.227 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "automatically balance PGs across cluster", 2023-08-10T12:05:22.227 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.227 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.227 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.227 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.227 INFO:teuthology.orchestra.run.smithi073.stdout: "begin_time": { 2023-08-10T12:05:22.228 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "begin_time", 2023-08-10T12:05:22.228 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.228 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.228 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.228 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0000", 2023-08-10T12:05:22.228 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.228 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.228 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.229 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "beginning time of day to automatically balance", 2023-08-10T12:05:22.229 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-08-10T12:05:22.229 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.229 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.229 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.229 INFO:teuthology.orchestra.run.smithi073.stdout: "begin_weekday": { 2023-08-10T12:05:22.229 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "begin_weekday", 2023-08-10T12:05:22.229 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2023-08-10T12:05:22.230 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.230 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.230 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2023-08-10T12:05:22.230 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0", 2023-08-10T12:05:22.230 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "6", 2023-08-10T12:05:22.230 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.230 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-08-10T12:05:22.231 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-08-10T12:05:22.231 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.231 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.231 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.231 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_max_iterations": { 2023-08-10T12:05:22.231 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_max_iterations", 2023-08-10T12:05:22.231 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2023-08-10T12:05:22.231 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.232 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.232 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "25", 2023-08-10T12:05:22.232 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2023-08-10T12:05:22.232 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "250", 2023-08-10T12:05:22.232 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.232 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-08-10T12:05:22.232 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.232 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.233 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.233 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.233 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_metrics": { 2023-08-10T12:05:22.233 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_metrics", 2023-08-10T12:05:22.233 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.233 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.233 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.234 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "pgs,objects,bytes", 2023-08-10T12:05:22.234 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.234 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.234 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.234 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-08-10T12:05:22.234 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-08-10T12:05:22.234 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.234 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.235 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.235 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_step": { 2023-08-10T12:05:22.235 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_step", 2023-08-10T12:05:22.235 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-08-10T12:05:22.235 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.235 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.235 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0.5", 2023-08-10T12:05:22.235 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0.001", 2023-08-10T12:05:22.236 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "0.999", 2023-08-10T12:05:22.236 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.236 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "aggressiveness of optimization", 2023-08-10T12:05:22.236 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-08-10T12:05:22.236 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.236 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.236 INFO:teuthology.orchestra.run.smithi073.stdout: "end_time": { 2023-08-10T12:05:22.237 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "end_time", 2023-08-10T12:05:22.237 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.237 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.237 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.237 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "2359", 2023-08-10T12:05:22.237 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.237 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.237 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.238 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "ending time of day to automatically balance", 2023-08-10T12:05:22.238 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-08-10T12:05:22.238 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.238 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.238 INFO:teuthology.orchestra.run.smithi073.stdout: "end_weekday": { 2023-08-10T12:05:22.238 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "end_weekday", 2023-08-10T12:05:22.238 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2023-08-10T12:05:22.239 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.239 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.239 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2023-08-10T12:05:22.239 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0", 2023-08-10T12:05:22.239 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "6", 2023-08-10T12:05:22.239 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.239 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-08-10T12:05:22.239 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-08-10T12:05:22.240 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.240 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.240 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.240 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.240 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.240 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.240 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.241 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.241 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.241 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.241 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.241 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.241 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.241 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.241 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.242 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.242 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.242 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.242 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.242 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.242 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.242 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.242 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.243 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.243 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.243 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.243 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.243 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.243 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.243 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.244 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.244 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.244 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.244 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.244 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.244 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.244 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.244 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.245 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.245 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.245 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.245 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.245 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.245 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.245 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.245 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.246 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.246 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.246 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.246 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.246 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.246 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.246 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.246 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.247 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.247 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.247 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.247 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.247 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.247 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.247 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.248 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.248 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.248 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.248 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.248 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.248 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.248 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.248 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.249 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.249 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.249 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.249 INFO:teuthology.orchestra.run.smithi073.stdout: "min_score": { 2023-08-10T12:05:22.249 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "min_score", 2023-08-10T12:05:22.249 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-08-10T12:05:22.249 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.249 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.250 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2023-08-10T12:05:22.250 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.250 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.250 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.250 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-08-10T12:05:22.250 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.250 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.250 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.251 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": { 2023-08-10T12:05:22.251 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mode", 2023-08-10T12:05:22.251 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.251 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.251 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.251 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "upmap", 2023-08-10T12:05:22.251 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.252 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.252 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.252 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-compat", 2023-08-10T12:05:22.252 INFO:teuthology.orchestra.run.smithi073.stdout: "none", 2023-08-10T12:05:22.252 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap" 2023-08-10T12:05:22.252 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.252 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Balancer mode", 2023-08-10T12:05:22.253 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.253 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.253 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.253 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.253 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_ids": { 2023-08-10T12:05:22.253 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pool_ids", 2023-08-10T12:05:22.253 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.253 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.254 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.254 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.254 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.254 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.254 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.254 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-08-10T12:05:22.254 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.254 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.255 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.255 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2023-08-10T12:05:22.255 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2023-08-10T12:05:22.255 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:22.255 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.255 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.256 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2023-08-10T12:05:22.256 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.256 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.256 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.256 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-08-10T12:05:22.256 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.256 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.256 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.257 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap_max_deviation": { 2023-08-10T12:05:22.257 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "upmap_max_deviation", 2023-08-10T12:05:22.257 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.257 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.257 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.257 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2023-08-10T12:05:22.257 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2023-08-10T12:05:22.258 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.258 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.258 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "deviation below which no optimization is attempted", 2023-08-10T12:05:22.258 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-08-10T12:05:22.258 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.258 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.258 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.258 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap_max_optimizations": { 2023-08-10T12:05:22.259 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "upmap_max_optimizations", 2023-08-10T12:05:22.259 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2023-08-10T12:05:22.259 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.259 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.259 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-08-10T12:05:22.259 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.259 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.259 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.260 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-08-10T12:05:22.260 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.260 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.260 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.260 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.260 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.260 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.261 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.261 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cephadm", 2023-08-10T12:05:22.261 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.261 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.261 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.261 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_down_multiplier": { 2023-08-10T12:05:22.261 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_down_multiplier", 2023-08-10T12:05:22.261 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-08-10T12:05:22.262 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.262 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.262 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3.0", 2023-08-10T12:05:22.262 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.262 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.262 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.262 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-08-10T12:05:22.262 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.263 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.263 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.263 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.263 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_refresh_rate": { 2023-08-10T12:05:22.263 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_refresh_rate", 2023-08-10T12:05:22.263 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:22.263 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.263 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.264 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "20", 2023-08-10T12:05:22.264 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.264 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.264 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.264 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-08-10T12:05:22.264 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.264 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.264 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.265 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.265 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_starting_port": { 2023-08-10T12:05:22.265 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_starting_port", 2023-08-10T12:05:22.265 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.265 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.265 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.265 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "4721", 2023-08-10T12:05:22.265 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.266 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.266 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.266 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-08-10T12:05:22.266 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.266 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.266 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.266 INFO:teuthology.orchestra.run.smithi073.stdout: "alertmanager_web_password": { 2023-08-10T12:05:22.267 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "alertmanager_web_password", 2023-08-10T12:05:22.267 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.267 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.267 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.267 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2023-08-10T12:05:22.267 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.267 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.267 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.268 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Alertmanager web password", 2023-08-10T12:05:22.268 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.268 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.268 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.268 INFO:teuthology.orchestra.run.smithi073.stdout: "alertmanager_web_user": { 2023-08-10T12:05:22.268 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "alertmanager_web_user", 2023-08-10T12:05:22.269 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.269 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.269 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.269 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2023-08-10T12:05:22.269 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.269 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.269 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.269 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Alertmanager web user", 2023-08-10T12:05:22.270 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.270 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.270 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.270 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_ptrace": { 2023-08-10T12:05:22.270 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_ptrace", 2023-08-10T12:05:22.270 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.270 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.271 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.271 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.271 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.271 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.271 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.271 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-08-10T12:05:22.271 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-08-10T12:05:22.271 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.272 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.272 INFO:teuthology.orchestra.run.smithi073.stdout: "autotune_interval": { 2023-08-10T12:05:22.272 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "autotune_interval", 2023-08-10T12:05:22.272 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:22.272 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.272 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.272 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2023-08-10T12:05:22.273 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.273 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.273 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.273 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to autotune daemon memory", 2023-08-10T12:05:22.273 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.273 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.273 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.274 INFO:teuthology.orchestra.run.smithi073.stdout: "autotune_memory_target_ratio": { 2023-08-10T12:05:22.274 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "autotune_memory_target_ratio", 2023-08-10T12:05:22.274 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-08-10T12:05:22.274 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.274 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.274 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0.7", 2023-08-10T12:05:22.274 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.275 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.275 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.275 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-08-10T12:05:22.275 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.275 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.275 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.275 INFO:teuthology.orchestra.run.smithi073.stdout: "cgroups_split": { 2023-08-10T12:05:22.276 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cgroups_split", 2023-08-10T12:05:22.276 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.276 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.276 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.276 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.276 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.276 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.276 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.277 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-08-10T12:05:22.277 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.277 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.277 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.277 INFO:teuthology.orchestra.run.smithi073.stdout: "config_checks_enabled": { 2023-08-10T12:05:22.277 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_checks_enabled", 2023-08-10T12:05:22.277 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.278 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.278 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.278 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.278 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.278 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.278 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.278 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-08-10T12:05:22.278 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.279 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.279 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.279 INFO:teuthology.orchestra.run.smithi073.stdout: "config_dashboard": { 2023-08-10T12:05:22.279 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_dashboard", 2023-08-10T12:05:22.279 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.279 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.279 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.280 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.280 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.280 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.280 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.280 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-08-10T12:05:22.280 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.280 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.281 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.281 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_alertmanager": { 2023-08-10T12:05:22.281 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_alertmanager", 2023-08-10T12:05:22.281 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.281 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.281 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.281 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-08-10T12:05:22.282 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.282 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.282 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.282 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2023-08-10T12:05:22.282 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.282 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.282 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.282 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.283 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_base": { 2023-08-10T12:05:22.283 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_base", 2023-08-10T12:05:22.283 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.283 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.283 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.283 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/ceph", 2023-08-10T12:05:22.283 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.283 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.284 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.284 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Container image name, without the tag", 2023-08-10T12:05:22.284 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.284 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.284 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.284 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.284 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_elasticsearch": { 2023-08-10T12:05:22.284 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_elasticsearch", 2023-08-10T12:05:22.285 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.285 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.285 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.285 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-08-10T12:05:22.285 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.285 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.285 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.285 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "elasticsearch container image", 2023-08-10T12:05:22.286 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.286 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.286 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.286 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.286 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_grafana": { 2023-08-10T12:05:22.286 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_grafana", 2023-08-10T12:05:22.286 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.286 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.287 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.287 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-08-10T12:05:22.287 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.287 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.287 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.287 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2023-08-10T12:05:22.287 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.287 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.288 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.288 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.288 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_haproxy": { 2023-08-10T12:05:22.288 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_haproxy", 2023-08-10T12:05:22.288 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.288 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.288 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.288 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-08-10T12:05:22.289 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.289 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.289 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.289 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "HAproxy container image", 2023-08-10T12:05:22.289 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.289 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.289 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.289 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.290 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_agent": { 2023-08-10T12:05:22.290 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_agent", 2023-08-10T12:05:22.290 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.290 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.290 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.290 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-08-10T12:05:22.290 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.291 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.291 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.291 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger agent container image", 2023-08-10T12:05:22.291 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.291 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.291 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.291 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.291 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_collector": { 2023-08-10T12:05:22.292 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_collector", 2023-08-10T12:05:22.292 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.292 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.292 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.292 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-08-10T12:05:22.292 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.292 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.292 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.293 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger collector container image", 2023-08-10T12:05:22.293 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.293 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.293 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.293 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.293 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_query": { 2023-08-10T12:05:22.293 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_query", 2023-08-10T12:05:22.293 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.294 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.294 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.294 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-08-10T12:05:22.294 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.294 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.294 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.294 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger query container image", 2023-08-10T12:05:22.294 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.295 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.295 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.295 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_keepalived": { 2023-08-10T12:05:22.295 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_keepalived", 2023-08-10T12:05:22.295 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.295 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.296 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.296 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-08-10T12:05:22.296 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.296 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.296 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.296 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Keepalived container image", 2023-08-10T12:05:22.296 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.296 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.297 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.297 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.297 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_loki": { 2023-08-10T12:05:22.297 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_loki", 2023-08-10T12:05:22.297 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.297 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.297 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.297 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-08-10T12:05:22.298 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.298 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.298 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.298 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Loki container image", 2023-08-10T12:05:22.298 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.298 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.298 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.299 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_node_exporter": { 2023-08-10T12:05:22.299 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_node_exporter", 2023-08-10T12:05:22.299 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.299 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.299 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.299 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-08-10T12:05:22.299 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.299 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.300 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.300 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2023-08-10T12:05:22.300 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.300 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.300 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.300 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_prometheus": { 2023-08-10T12:05:22.301 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_prometheus", 2023-08-10T12:05:22.301 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.301 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.301 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.301 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-08-10T12:05:22.301 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.301 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.301 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.302 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2023-08-10T12:05:22.302 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.302 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.302 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.302 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.302 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_promtail": { 2023-08-10T12:05:22.302 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_promtail", 2023-08-10T12:05:22.302 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.303 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.303 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.303 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-08-10T12:05:22.303 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.303 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.303 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.303 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Promtail container image", 2023-08-10T12:05:22.303 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.304 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.304 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.304 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_snmp_gateway": { 2023-08-10T12:05:22.304 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_snmp_gateway", 2023-08-10T12:05:22.304 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.304 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.304 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.305 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-08-10T12:05:22.305 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.305 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.305 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.305 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SNMP Gateway container image", 2023-08-10T12:05:22.305 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.305 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.305 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.306 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.306 INFO:teuthology.orchestra.run.smithi073.stdout: "container_init": { 2023-08-10T12:05:22.306 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_init", 2023-08-10T12:05:22.306 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.306 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.306 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.306 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.306 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.307 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.307 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.307 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Run podman/docker with `--init`", 2023-08-10T12:05:22.307 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.307 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.307 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.307 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.307 INFO:teuthology.orchestra.run.smithi073.stdout: "daemon_cache_timeout": { 2023-08-10T12:05:22.308 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "daemon_cache_timeout", 2023-08-10T12:05:22.308 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:22.308 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.308 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.308 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2023-08-10T12:05:22.308 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.308 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.308 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.309 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-08-10T12:05:22.309 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.309 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.309 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.309 INFO:teuthology.orchestra.run.smithi073.stdout: "default_cephadm_command_timeout": { 2023-08-10T12:05:22.309 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "default_cephadm_command_timeout", 2023-08-10T12:05:22.310 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:22.310 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.310 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.310 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "900", 2023-08-10T12:05:22.310 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.310 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.310 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.310 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-08-10T12:05:22.311 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.311 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.311 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.311 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.311 INFO:teuthology.orchestra.run.smithi073.stdout: "default_registry": { 2023-08-10T12:05:22.311 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "default_registry", 2023-08-10T12:05:22.311 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.311 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.312 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.312 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io", 2023-08-10T12:05:22.312 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.312 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.312 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.312 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-08-10T12:05:22.312 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.312 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.313 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.313 INFO:teuthology.orchestra.run.smithi073.stdout: "device_cache_timeout": { 2023-08-10T12:05:22.313 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_cache_timeout", 2023-08-10T12:05:22.313 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:22.313 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.313 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.314 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1800", 2023-08-10T12:05:22.314 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.314 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.314 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.314 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache device inventory", 2023-08-10T12:05:22.314 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.314 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.314 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.314 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.315 INFO:teuthology.orchestra.run.smithi073.stdout: "device_enhanced_scan": { 2023-08-10T12:05:22.315 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_enhanced_scan", 2023-08-10T12:05:22.315 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.315 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.315 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.315 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.315 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.316 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.316 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.316 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use libstoragemgmt during device scans", 2023-08-10T12:05:22.316 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.316 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.316 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.316 INFO:teuthology.orchestra.run.smithi073.stdout: "facts_cache_timeout": { 2023-08-10T12:05:22.317 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "facts_cache_timeout", 2023-08-10T12:05:22.317 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:22.317 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.317 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.317 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2023-08-10T12:05:22.317 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.317 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.318 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.318 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache host facts data", 2023-08-10T12:05:22.318 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.318 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.318 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.318 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.318 INFO:teuthology.orchestra.run.smithi073.stdout: "host_check_interval": { 2023-08-10T12:05:22.318 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "host_check_interval", 2023-08-10T12:05:22.319 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:22.319 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.319 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.319 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2023-08-10T12:05:22.319 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.319 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.319 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.319 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to perform a host check", 2023-08-10T12:05:22.320 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.320 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.320 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.320 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.320 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.320 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.321 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.321 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.321 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.321 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.321 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.321 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.321 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.321 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.322 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.322 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.322 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.322 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.322 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.322 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.322 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.322 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.323 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.323 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.323 INFO:teuthology.orchestra.run.smithi073.stdout: "log_refresh_metadata": { 2023-08-10T12:05:22.323 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_refresh_metadata", 2023-08-10T12:05:22.323 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.323 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.323 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.323 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.324 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.324 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.324 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.324 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-08-10T12:05:22.324 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.324 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.324 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.324 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.325 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.325 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.325 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.325 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.325 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.325 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.325 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.325 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.326 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.326 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-08-10T12:05:22.326 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.326 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.326 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.326 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.326 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.327 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.327 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.327 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.327 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.327 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.327 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.327 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.327 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.328 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.328 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.328 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.328 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.328 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.328 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.328 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.328 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.329 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.329 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.329 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.329 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.329 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.329 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.329 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.329 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.330 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.330 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.330 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.330 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.330 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.330 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.330 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.330 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.331 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.331 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.331 INFO:teuthology.orchestra.run.smithi073.stdout: "manage_etc_ceph_ceph_conf": { 2023-08-10T12:05:22.331 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-08-10T12:05:22.331 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.331 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.331 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.331 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.332 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.332 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.332 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.332 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-08-10T12:05:22.332 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.332 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.332 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.333 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.333 INFO:teuthology.orchestra.run.smithi073.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-08-10T12:05:22.333 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-08-10T12:05:22.333 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.333 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.333 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.333 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "*", 2023-08-10T12:05:22.333 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.334 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.334 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.334 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-08-10T12:05:22.334 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.334 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.334 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.334 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.334 INFO:teuthology.orchestra.run.smithi073.stdout: "max_count_per_host": { 2023-08-10T12:05:22.335 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_count_per_host", 2023-08-10T12:05:22.335 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.335 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.335 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.335 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-08-10T12:05:22.335 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.335 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.335 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.336 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "max number of daemons per service per host", 2023-08-10T12:05:22.336 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.336 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.336 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.336 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.336 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd_draining_count": { 2023-08-10T12:05:22.336 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_osd_draining_count", 2023-08-10T12:05:22.337 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.337 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.337 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.337 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-08-10T12:05:22.337 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.337 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.337 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.337 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-08-10T12:05:22.338 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.338 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.338 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.338 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.338 INFO:teuthology.orchestra.run.smithi073.stdout: "migration_current": { 2023-08-10T12:05:22.338 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "migration_current", 2023-08-10T12:05:22.338 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.338 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.339 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.339 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.339 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.339 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.339 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.339 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "internal - do not modify", 2023-08-10T12:05:22.339 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.339 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.340 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.340 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": { 2023-08-10T12:05:22.340 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mode", 2023-08-10T12:05:22.340 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.340 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.340 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.341 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "root", 2023-08-10T12:05:22.341 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.341 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.341 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.341 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm-package", 2023-08-10T12:05:22.341 INFO:teuthology.orchestra.run.smithi073.stdout: "root" 2023-08-10T12:05:22.341 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.341 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "mode for remote execution of cephadm", 2023-08-10T12:05:22.342 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.342 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.342 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.342 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.342 INFO:teuthology.orchestra.run.smithi073.stdout: "prometheus_alerts_path": { 2023-08-10T12:05:22.342 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus_alerts_path", 2023-08-10T12:05:22.342 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.342 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.343 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.343 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-08-10T12:05:22.343 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.343 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.343 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.343 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-08-10T12:05:22.343 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.343 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.344 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.344 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.344 INFO:teuthology.orchestra.run.smithi073.stdout: "prometheus_web_password": { 2023-08-10T12:05:22.344 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus_web_password", 2023-08-10T12:05:22.344 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.344 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.344 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.345 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2023-08-10T12:05:22.345 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.345 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.345 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.345 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus web password", 2023-08-10T12:05:22.345 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.345 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.345 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.346 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.346 INFO:teuthology.orchestra.run.smithi073.stdout: "prometheus_web_user": { 2023-08-10T12:05:22.346 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus_web_user", 2023-08-10T12:05:22.346 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.346 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.346 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.346 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2023-08-10T12:05:22.346 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.347 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.347 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.347 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus web user", 2023-08-10T12:05:22.347 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.347 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.347 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.347 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.347 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_insecure": { 2023-08-10T12:05:22.348 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_insecure", 2023-08-10T12:05:22.348 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.348 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.348 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.348 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.348 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.348 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.348 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.349 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-08-10T12:05:22.349 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.349 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.349 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.349 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.349 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_password": { 2023-08-10T12:05:22.349 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_password", 2023-08-10T12:05:22.349 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.350 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.350 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.350 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.350 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.350 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.350 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.350 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-08-10T12:05:22.351 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.351 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.351 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.351 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.351 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_url": { 2023-08-10T12:05:22.351 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_url", 2023-08-10T12:05:22.351 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.351 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.352 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.352 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.352 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.352 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.352 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.352 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-08-10T12:05:22.352 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.352 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.353 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.353 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.353 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_username": { 2023-08-10T12:05:22.353 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_username", 2023-08-10T12:05:22.353 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.353 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.353 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.353 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.354 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.354 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.354 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.354 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-08-10T12:05:22.354 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.354 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.354 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.354 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.355 INFO:teuthology.orchestra.run.smithi073.stdout: "secure_monitoring_stack": { 2023-08-10T12:05:22.355 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "secure_monitoring_stack", 2023-08-10T12:05:22.355 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.355 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.355 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.355 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.355 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.355 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.356 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.356 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-08-10T12:05:22.356 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.356 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.356 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.356 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.356 INFO:teuthology.orchestra.run.smithi073.stdout: "service_discovery_port": { 2023-08-10T12:05:22.356 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "service_discovery_port", 2023-08-10T12:05:22.357 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.357 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.357 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.357 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8765", 2023-08-10T12:05:22.357 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.357 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.357 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.358 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "cephadm service discovery port", 2023-08-10T12:05:22.358 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.358 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.358 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.358 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.358 INFO:teuthology.orchestra.run.smithi073.stdout: "ssh_config_file": { 2023-08-10T12:05:22.358 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssh_config_file", 2023-08-10T12:05:22.358 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.359 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.359 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.359 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.359 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.359 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.359 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.359 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-08-10T12:05:22.359 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "use_agent": { 2023-08-10T12:05:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "use_agent", 2023-08-10T12:05:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.361 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.361 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.361 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.361 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.361 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-08-10T12:05:22.361 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.361 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.361 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.362 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.362 INFO:teuthology.orchestra.run.smithi073.stdout: "use_repo_digest": { 2023-08-10T12:05:22.362 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "use_repo_digest", 2023-08-10T12:05:22.362 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.362 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.362 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.362 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.363 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.363 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.363 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.363 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-08-10T12:05:22.363 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.363 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.363 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.363 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.364 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_failed_host_check": { 2023-08-10T12:05:22.364 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_failed_host_check", 2023-08-10T12:05:22.364 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.364 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.364 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.364 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.364 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.364 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.365 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.365 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if the host check fails", 2023-08-10T12:05:22.365 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.365 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.365 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.365 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.365 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_stray_daemons": { 2023-08-10T12:05:22.365 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_stray_daemons", 2023-08-10T12:05:22.366 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.366 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.366 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.366 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.366 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.366 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.366 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.366 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-08-10T12:05:22.367 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.367 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.367 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.367 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.367 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_stray_hosts": { 2023-08-10T12:05:22.367 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_stray_hosts", 2023-08-10T12:05:22.367 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.367 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.368 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.368 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.368 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.368 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.368 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.368 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-08-10T12:05:22.368 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.369 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.369 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.369 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.369 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.369 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.369 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.369 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crash", 2023-08-10T12:05:22.369 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.370 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.370 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.370 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.370 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.370 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.370 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.370 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.370 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.371 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.371 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.371 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.371 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.371 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.371 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.371 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.371 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.372 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.372 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.372 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.372 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.372 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.372 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.372 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.372 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.373 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.373 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.373 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.373 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.373 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.373 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.373 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.373 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.374 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.374 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.374 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.374 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.374 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.374 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.374 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.374 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.375 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.375 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.375 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.375 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.375 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.375 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.375 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.375 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.376 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.376 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.376 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.376 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.376 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.376 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.376 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.377 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.377 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.377 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.377 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.377 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.377 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.377 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.377 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.378 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.378 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.378 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.378 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.378 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.378 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.378 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.378 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.379 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.379 INFO:teuthology.orchestra.run.smithi073.stdout: "retain_interval": { 2023-08-10T12:05:22.379 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "retain_interval", 2023-08-10T12:05:22.379 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:22.379 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.379 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.379 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "31536000", 2023-08-10T12:05:22.379 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.380 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.380 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.380 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long to retain crashes before pruning them", 2023-08-10T12:05:22.380 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.380 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.380 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.380 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.380 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_recent_interval": { 2023-08-10T12:05:22.381 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_recent_interval", 2023-08-10T12:05:22.381 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:22.381 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.381 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.381 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1209600", 2023-08-10T12:05:22.381 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.381 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.381 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.382 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "time interval in which to warn about recent crashes", 2023-08-10T12:05:22.382 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.382 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.382 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.382 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.382 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.382 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.382 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.383 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "dashboard", 2023-08-10T12:05:22.383 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.383 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.383 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.383 INFO:teuthology.orchestra.run.smithi073.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-08-10T12:05:22.383 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-08-10T12:05:22.383 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.383 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.384 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.384 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-08-10T12:05:22.384 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.384 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.384 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.384 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.384 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.385 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.385 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.385 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.385 INFO:teuthology.orchestra.run.smithi073.stdout: "ALERTMANAGER_API_HOST": { 2023-08-10T12:05:22.385 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ALERTMANAGER_API_HOST", 2023-08-10T12:05:22.385 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.385 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.385 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.386 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.386 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.386 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.386 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.386 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.386 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.386 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.386 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.387 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.387 INFO:teuthology.orchestra.run.smithi073.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-08-10T12:05:22.387 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-08-10T12:05:22.387 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.387 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.387 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.387 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.387 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.388 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.388 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.388 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.388 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.388 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.388 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.388 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.389 INFO:teuthology.orchestra.run.smithi073.stdout: "AUDIT_API_ENABLED": { 2023-08-10T12:05:22.389 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "AUDIT_API_ENABLED", 2023-08-10T12:05:22.389 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.389 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.389 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.389 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.389 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.389 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.390 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.390 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.390 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.390 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.390 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.390 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.390 INFO:teuthology.orchestra.run.smithi073.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-08-10T12:05:22.390 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-08-10T12:05:22.391 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.391 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.391 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.391 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.391 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.391 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.391 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.391 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.392 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.392 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.392 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.392 INFO:teuthology.orchestra.run.smithi073.stdout: "ENABLE_BROWSABLE_API": { 2023-08-10T12:05:22.392 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ENABLE_BROWSABLE_API", 2023-08-10T12:05:22.392 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.392 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.393 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.393 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.393 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.393 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.393 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.393 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.393 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.393 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.394 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.394 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-08-10T12:05:22.394 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-08-10T12:05:22.394 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.394 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.394 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.394 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.395 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.395 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.395 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.395 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.395 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.395 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.395 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-08-10T12:05:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-08-10T12:05:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-08-10T12:05:22.398 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-08-10T12:05:22.398 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.398 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.398 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.398 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.398 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.398 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.398 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.399 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.399 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.399 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.399 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.399 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-08-10T12:05:22.399 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-08-10T12:05:22.399 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.400 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.400 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.400 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.400 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.400 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.400 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.400 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.400 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.401 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.401 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.401 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_NFS": { 2023-08-10T12:05:22.401 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-08-10T12:05:22.401 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.401 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.401 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.402 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.402 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.402 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.402 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.402 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.402 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.402 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.402 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.403 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_RBD": { 2023-08-10T12:05:22.403 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-08-10T12:05:22.403 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.403 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.403 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.403 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.404 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.404 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.404 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.404 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.404 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.404 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.404 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.404 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.405 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_RGW": { 2023-08-10T12:05:22.405 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-08-10T12:05:22.405 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.405 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.405 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.405 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.405 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.405 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.406 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.406 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.406 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.406 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.406 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.406 INFO:teuthology.orchestra.run.smithi073.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-08-10T12:05:22.406 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-08-10T12:05:22.407 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.407 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.407 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.407 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.407 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.407 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.407 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.407 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_PASSWORD": { 2023-08-10T12:05:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_PASSWORD", 2023-08-10T12:05:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2023-08-10T12:05:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-08-10T12:05:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-08-10T12:05:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_URL": { 2023-08-10T12:05:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_URL", 2023-08-10T12:05:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_USERNAME": { 2023-08-10T12:05:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_USERNAME", 2023-08-10T12:05:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2023-08-10T12:05:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-08-10T12:05:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-08-10T12:05:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-08-10T12:05:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-08-10T12:05:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-08-10T12:05:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-08-10T12:05:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: "ISSUE_TRACKER_API_KEY": { 2023-08-10T12:05:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-08-10T12:05:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.422 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.422 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.422 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.422 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.422 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.422 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.422 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.422 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.423 INFO:teuthology.orchestra.run.smithi073.stdout: "PROMETHEUS_API_HOST": { 2023-08-10T12:05:22.423 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PROMETHEUS_API_HOST", 2023-08-10T12:05:22.423 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.423 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.423 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.423 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.423 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.423 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.424 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.424 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.424 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.424 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.424 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.424 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.424 INFO:teuthology.orchestra.run.smithi073.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-08-10T12:05:22.424 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-08-10T12:05:22.425 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.425 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.425 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.425 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.425 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.425 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.425 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.425 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.426 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.426 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.426 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.426 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.426 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-08-10T12:05:22.426 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-08-10T12:05:22.426 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.426 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.427 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.427 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.427 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.427 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.427 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.427 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.427 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.427 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.428 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.428 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.428 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-08-10T12:05:22.428 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-08-10T12:05:22.428 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.428 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.428 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.428 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.429 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.429 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.429 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.429 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.429 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.429 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.429 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.429 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.430 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-08-10T12:05:22.430 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-08-10T12:05:22.430 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.430 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.430 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.430 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.430 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.430 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.431 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.431 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.431 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.431 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.431 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.431 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.431 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-08-10T12:05:22.431 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-08-10T12:05:22.432 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.432 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.432 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.432 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.432 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.432 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.432 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.433 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.433 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.433 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.433 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.433 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.433 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-08-10T12:05:22.433 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-08-10T12:05:22.433 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.434 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.434 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.434 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.434 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.434 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.434 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.434 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.434 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.435 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.435 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.435 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.435 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-08-10T12:05:22.435 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-08-10T12:05:22.435 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.435 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.435 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.436 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.436 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.436 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.436 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.436 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.436 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.436 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.437 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.437 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.437 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-08-10T12:05:22.437 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-08-10T12:05:22.437 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.437 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.437 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.437 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.438 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.438 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.438 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.438 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.438 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.438 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.438 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.438 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.439 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_ENABLED": { 2023-08-10T12:05:22.439 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_ENABLED", 2023-08-10T12:05:22.439 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.439 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.439 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.439 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.439 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.439 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.440 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.440 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.440 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.440 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.440 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.440 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.440 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-08-10T12:05:22.440 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-08-10T12:05:22.441 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.441 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.441 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.441 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-08-10T12:05:22.441 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.441 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.441 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.441 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.442 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.442 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.442 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.442 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.442 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-08-10T12:05:22.442 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-08-10T12:05:22.442 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.443 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.443 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.443 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-08-10T12:05:22.443 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.443 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.443 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.443 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.443 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.444 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.444 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.444 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.444 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-08-10T12:05:22.444 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-08-10T12:05:22.444 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.444 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.444 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.445 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8", 2023-08-10T12:05:22.445 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.445 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.445 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.445 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.445 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.445 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.445 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.446 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.446 INFO:teuthology.orchestra.run.smithi073.stdout: "REST_REQUESTS_TIMEOUT": { 2023-08-10T12:05:22.446 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-08-10T12:05:22.446 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.446 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.446 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.446 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "45", 2023-08-10T12:05:22.446 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.447 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.447 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.447 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.447 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.447 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.447 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.447 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.447 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_ACCESS_KEY": { 2023-08-10T12:05:22.448 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_ACCESS_KEY", 2023-08-10T12:05:22.448 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.448 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.448 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.448 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.448 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.448 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.448 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.449 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.449 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.449 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.449 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.449 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.449 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-08-10T12:05:22.449 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-08-10T12:05:22.449 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.450 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.450 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.450 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2023-08-10T12:05:22.450 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.450 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.450 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.450 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.450 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.451 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.451 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.451 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.451 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_SECRET_KEY": { 2023-08-10T12:05:22.451 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_SECRET_KEY", 2023-08-10T12:05:22.451 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.451 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.451 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.452 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.452 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.452 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.452 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.452 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.452 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.452 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.453 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.453 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.453 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_SSL_VERIFY": { 2023-08-10T12:05:22.453 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_SSL_VERIFY", 2023-08-10T12:05:22.453 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.453 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.453 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.453 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.454 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.454 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.454 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.454 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.454 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.454 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.454 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.454 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.455 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-08-10T12:05:22.455 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-08-10T12:05:22.455 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.455 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.455 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.455 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2023-08-10T12:05:22.455 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.455 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.456 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.456 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.456 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.456 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.456 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.456 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.456 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-08-10T12:05:22.457 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-08-10T12:05:22.457 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.457 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.457 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.457 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-08-10T12:05:22.457 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.457 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.457 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.458 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.458 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.458 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.458 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.458 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.458 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-08-10T12:05:22.458 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-08-10T12:05:22.458 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.459 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.459 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.459 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2023-08-10T12:05:22.459 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.459 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.459 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.459 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.459 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.460 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.460 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.460 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.460 INFO:teuthology.orchestra.run.smithi073.stdout: "cross_origin_url": { 2023-08-10T12:05:22.460 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cross_origin_url", 2023-08-10T12:05:22.460 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.460 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.460 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.461 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.461 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.461 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.461 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.461 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.461 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.461 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.461 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.462 INFO:teuthology.orchestra.run.smithi073.stdout: "crt_file": { 2023-08-10T12:05:22.462 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crt_file", 2023-08-10T12:05:22.462 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.462 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.462 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.462 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.462 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.463 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.463 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.463 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.463 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.463 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.463 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.463 INFO:teuthology.orchestra.run.smithi073.stdout: "debug": { 2023-08-10T12:05:22.464 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "debug", 2023-08-10T12:05:22.464 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.464 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.464 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.464 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.464 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.464 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.465 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.465 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable/disable debug options", 2023-08-10T12:05:22.465 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.465 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.465 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.465 INFO:teuthology.orchestra.run.smithi073.stdout: "jwt_token_ttl": { 2023-08-10T12:05:22.465 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "jwt_token_ttl", 2023-08-10T12:05:22.466 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.466 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.466 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.466 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "28800", 2023-08-10T12:05:22.466 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.466 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.466 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.466 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.467 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.467 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.467 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.467 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.467 INFO:teuthology.orchestra.run.smithi073.stdout: "key_file": { 2023-08-10T12:05:22.467 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "key_file", 2023-08-10T12:05:22.467 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.467 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.468 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.468 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.468 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.468 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.468 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.468 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.468 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.468 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.469 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.469 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.469 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.469 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.469 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.469 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.470 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.470 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.470 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.470 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.470 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.470 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.470 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.470 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.471 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.471 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.471 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.471 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.471 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.471 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.471 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.472 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.472 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.472 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.472 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.472 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.472 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.472 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.472 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.473 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.473 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.473 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.473 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.473 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.473 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.473 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.473 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.474 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.474 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.474 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.474 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.474 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.474 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.474 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.474 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.475 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.475 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.475 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.475 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.475 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.475 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.475 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.475 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.476 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.476 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.476 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.476 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.476 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.476 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.476 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.477 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.477 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.477 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.477 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.477 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.477 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.477 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.477 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.478 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.478 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.478 INFO:teuthology.orchestra.run.smithi073.stdout: "motd": { 2023-08-10T12:05:22.478 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "motd", 2023-08-10T12:05:22.478 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.478 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.478 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.478 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.479 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.479 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.479 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.479 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "The message of the day", 2023-08-10T12:05:22.479 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.479 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.479 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.479 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.480 INFO:teuthology.orchestra.run.smithi073.stdout: "redirect_resolve_ip_addr": { 2023-08-10T12:05:22.480 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "redirect_resolve_ip_addr", 2023-08-10T12:05:22.480 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.480 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.480 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.480 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.480 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.481 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.481 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.481 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.481 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.481 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.481 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.481 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.481 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2023-08-10T12:05:22.482 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2023-08-10T12:05:22.482 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.482 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.482 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.482 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "::", 2023-08-10T12:05:22.482 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.482 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.482 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.483 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.483 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.483 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.483 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.483 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2023-08-10T12:05:22.483 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2023-08-10T12:05:22.483 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.484 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.484 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.484 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8080", 2023-08-10T12:05:22.484 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.484 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.484 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.484 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.485 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.485 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.485 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.485 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.485 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl": { 2023-08-10T12:05:22.485 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl", 2023-08-10T12:05:22.485 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.485 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.486 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.486 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.486 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.486 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.486 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.486 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.486 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.486 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.487 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.487 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.487 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl_server_port": { 2023-08-10T12:05:22.487 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl_server_port", 2023-08-10T12:05:22.487 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.487 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.487 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.487 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8443", 2023-08-10T12:05:22.488 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.488 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.488 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.488 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.488 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.488 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.488 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.488 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.489 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_behaviour": { 2023-08-10T12:05:22.489 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_behaviour", 2023-08-10T12:05:22.489 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.489 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.489 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.489 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "redirect", 2023-08-10T12:05:22.489 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.490 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.490 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.490 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.490 INFO:teuthology.orchestra.run.smithi073.stdout: "redirect" 2023-08-10T12:05:22.490 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.490 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.490 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.490 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.491 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.491 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_error_status_code": { 2023-08-10T12:05:22.491 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_error_status_code", 2023-08-10T12:05:22.491 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.491 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.491 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.491 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "500", 2023-08-10T12:05:22.492 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "400", 2023-08-10T12:05:22.492 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "599", 2023-08-10T12:05:22.492 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.492 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.492 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.492 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.492 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.492 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.493 INFO:teuthology.orchestra.run.smithi073.stdout: "url_prefix": { 2023-08-10T12:05:22.493 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "url_prefix", 2023-08-10T12:05:22.493 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.493 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.493 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.493 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.493 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.493 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.494 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.494 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.494 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.494 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.494 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.494 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.494 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.495 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.495 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.495 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "devicehealth", 2023-08-10T12:05:22.495 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.495 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.495 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.495 INFO:teuthology.orchestra.run.smithi073.stdout: "enable_monitoring": { 2023-08-10T12:05:22.495 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enable_monitoring", 2023-08-10T12:05:22.496 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.496 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.496 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.496 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.496 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.496 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.496 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.496 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "monitor device health metrics", 2023-08-10T12:05:22.497 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.497 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.497 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.497 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.497 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.497 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.497 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.497 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.498 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.498 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.498 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.498 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.498 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.498 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.498 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.498 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.499 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.499 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.499 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.499 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.499 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.499 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.499 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.499 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.500 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.500 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.500 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.500 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.500 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.500 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.500 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.501 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.501 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.501 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.501 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.501 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.501 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.501 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.501 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.502 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.502 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.502 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.502 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.502 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.502 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.502 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.502 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.503 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.503 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.503 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.503 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.503 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.503 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.503 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.503 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.504 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.504 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.504 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.504 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.504 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.504 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.504 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.504 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.505 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.505 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.505 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.505 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.505 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.505 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.505 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.506 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.506 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.506 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.506 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.506 INFO:teuthology.orchestra.run.smithi073.stdout: "mark_out_threshold": { 2023-08-10T12:05:22.506 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mark_out_threshold", 2023-08-10T12:05:22.506 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:22.506 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.507 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.507 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "2419200", 2023-08-10T12:05:22.507 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.507 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.507 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.507 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-08-10T12:05:22.507 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.507 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.508 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.508 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.508 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": { 2023-08-10T12:05:22.508 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pool_name", 2023-08-10T12:05:22.508 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.508 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.508 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.508 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "device_health_metrics", 2023-08-10T12:05:22.509 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.509 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.509 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.509 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "name of pool in which to store device health metrics", 2023-08-10T12:05:22.509 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.509 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.509 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.509 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.510 INFO:teuthology.orchestra.run.smithi073.stdout: "retention_period": { 2023-08-10T12:05:22.510 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "retention_period", 2023-08-10T12:05:22.510 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:22.510 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.510 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.510 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15552000", 2023-08-10T12:05:22.510 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.510 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.511 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.511 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long to retain device health metrics", 2023-08-10T12:05:22.511 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.511 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.511 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.511 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.511 INFO:teuthology.orchestra.run.smithi073.stdout: "scrape_frequency": { 2023-08-10T12:05:22.511 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "scrape_frequency", 2023-08-10T12:05:22.512 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:22.512 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.512 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.512 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "86400", 2023-08-10T12:05:22.512 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.512 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.512 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.513 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to scrape device health metrics", 2023-08-10T12:05:22.513 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.513 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.513 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.513 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.513 INFO:teuthology.orchestra.run.smithi073.stdout: "self_heal": { 2023-08-10T12:05:22.513 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "self_heal", 2023-08-10T12:05:22.513 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.514 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.514 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.514 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.514 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.514 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.514 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.514 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-08-10T12:05:22.514 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.515 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.515 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.515 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.515 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2023-08-10T12:05:22.515 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2023-08-10T12:05:22.515 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:22.515 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.515 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.516 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2023-08-10T12:05:22.516 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.516 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.516 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.516 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to wake up and check device health", 2023-08-10T12:05:22.516 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.516 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.516 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.517 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.517 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_threshold": { 2023-08-10T12:05:22.517 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_threshold", 2023-08-10T12:05:22.517 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:22.517 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.517 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.517 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "7257600", 2023-08-10T12:05:22.517 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.518 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.518 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.518 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-08-10T12:05:22.518 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.518 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.518 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.518 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.518 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.519 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.519 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.519 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "diskprediction_local", 2023-08-10T12:05:22.519 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.519 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.519 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.519 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.519 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.520 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.520 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.520 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.520 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.520 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.520 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.520 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.521 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.521 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.521 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.521 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.521 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.521 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.521 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.521 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.522 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.522 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.522 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.522 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.522 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.522 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.522 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.522 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.523 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.523 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.523 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.523 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.523 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.523 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.523 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.523 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.524 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.524 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.524 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.524 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.524 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.524 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.524 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.524 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.525 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.525 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.525 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.525 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.525 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.525 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.525 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.525 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.526 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.526 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.526 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.526 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.526 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.526 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.526 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.526 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.527 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.527 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.527 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.527 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.527 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.527 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.527 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.527 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.528 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.528 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.528 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.528 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.528 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.528 INFO:teuthology.orchestra.run.smithi073.stdout: "predict_interval": { 2023-08-10T12:05:22.528 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "predict_interval", 2023-08-10T12:05:22.529 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.529 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.529 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.529 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "86400", 2023-08-10T12:05:22.529 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.529 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.529 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.529 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.530 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.530 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.530 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.530 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.530 INFO:teuthology.orchestra.run.smithi073.stdout: "predictor_model": { 2023-08-10T12:05:22.530 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "predictor_model", 2023-08-10T12:05:22.530 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.530 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.531 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.531 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "prophetstor", 2023-08-10T12:05:22.531 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.531 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.531 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.531 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.531 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.531 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.532 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.532 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.532 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2023-08-10T12:05:22.532 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2023-08-10T12:05:22.532 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.532 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.532 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.532 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2023-08-10T12:05:22.533 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.533 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.533 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.533 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.533 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.533 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.533 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.534 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.534 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.534 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.534 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.534 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "influx", 2023-08-10T12:05:22.534 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": false, 2023-08-10T12:05:22.534 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "influxdb python module not found", 2023-08-10T12:05:22.534 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.535 INFO:teuthology.orchestra.run.smithi073.stdout: "batch_size": { 2023-08-10T12:05:22.535 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "batch_size", 2023-08-10T12:05:22.535 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.535 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.535 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.535 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5000", 2023-08-10T12:05:22.535 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.535 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.536 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.536 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-08-10T12:05:22.536 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.536 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.536 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.536 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.536 INFO:teuthology.orchestra.run.smithi073.stdout: "database": { 2023-08-10T12:05:22.536 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "database", 2023-08-10T12:05:22.537 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.537 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.537 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.537 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "ceph", 2023-08-10T12:05:22.537 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.537 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.537 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.537 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-08-10T12:05:22.538 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.538 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.538 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.538 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.538 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": { 2023-08-10T12:05:22.538 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "hostname", 2023-08-10T12:05:22.538 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.538 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.539 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.539 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.539 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.539 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.539 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.539 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB server hostname", 2023-08-10T12:05:22.539 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.539 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.540 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.540 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.540 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2023-08-10T12:05:22.540 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2023-08-10T12:05:22.540 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:22.540 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.540 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.541 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "30", 2023-08-10T12:05:22.541 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "5", 2023-08-10T12:05:22.541 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.541 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.541 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-08-10T12:05:22.541 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.541 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.541 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.542 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.542 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.542 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.542 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.542 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.542 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.542 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.542 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.543 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.543 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.543 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.543 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.543 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.543 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.543 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.543 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.544 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.544 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.544 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.544 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.544 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.544 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.544 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.545 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.545 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.545 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.545 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.545 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.545 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.545 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.545 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.546 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.546 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.546 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.546 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.546 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.546 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.546 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.546 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.547 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.547 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.547 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.547 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.547 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.547 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.547 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.547 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.548 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.548 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.548 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.548 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.548 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.548 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.548 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.548 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.549 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.549 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.549 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.549 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.549 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.549 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.549 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.549 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.550 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.550 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.550 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.550 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.550 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.550 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.550 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.550 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.551 INFO:teuthology.orchestra.run.smithi073.stdout: "password": { 2023-08-10T12:05:22.551 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "password", 2023-08-10T12:05:22.551 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.551 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.551 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.551 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.551 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.551 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.552 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.552 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "password of InfluxDB server user", 2023-08-10T12:05:22.552 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.552 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.552 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.552 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.552 INFO:teuthology.orchestra.run.smithi073.stdout: "port": { 2023-08-10T12:05:22.553 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "port", 2023-08-10T12:05:22.553 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.553 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.553 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.553 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8086", 2023-08-10T12:05:22.553 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.553 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.553 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.554 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB server port", 2023-08-10T12:05:22.554 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.554 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.554 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.554 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.554 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl": { 2023-08-10T12:05:22.554 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl", 2023-08-10T12:05:22.554 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.555 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.555 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.555 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "false", 2023-08-10T12:05:22.555 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.555 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.555 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.555 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-08-10T12:05:22.556 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.556 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.556 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.556 INFO:teuthology.orchestra.run.smithi073.stdout: "threads": { 2023-08-10T12:05:22.556 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "threads", 2023-08-10T12:05:22.556 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.556 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.557 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.557 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2023-08-10T12:05:22.557 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2023-08-10T12:05:22.557 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "32", 2023-08-10T12:05:22.557 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.557 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-08-10T12:05:22.557 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.557 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.558 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.558 INFO:teuthology.orchestra.run.smithi073.stdout: "username": { 2023-08-10T12:05:22.558 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "username", 2023-08-10T12:05:22.558 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.558 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.558 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.558 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.559 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.559 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.559 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.559 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "username of InfluxDB server user", 2023-08-10T12:05:22.559 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.559 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.559 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.560 INFO:teuthology.orchestra.run.smithi073.stdout: "verify_ssl": { 2023-08-10T12:05:22.560 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "verify_ssl", 2023-08-10T12:05:22.560 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.560 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.560 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.560 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "true", 2023-08-10T12:05:22.560 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.561 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.561 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.561 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-08-10T12:05:22.561 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.561 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.561 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.561 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.561 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.562 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "insights", 2023-08-10T12:05:22.562 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.562 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.562 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.562 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.562 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.563 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.563 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.563 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.563 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.563 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.563 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.563 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.563 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.564 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.564 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.564 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.564 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.564 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.564 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.564 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.565 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.565 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.565 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.565 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.565 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.565 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.565 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.566 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.566 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.566 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.566 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.566 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.566 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.566 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.566 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.567 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.567 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.567 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.567 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.567 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.567 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.567 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.568 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.568 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.568 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.568 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.568 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.568 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.568 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.568 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.569 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.569 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.569 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.569 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.569 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.569 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.569 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.569 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.570 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.570 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.570 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.570 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.570 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.570 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.570 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.571 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.571 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.571 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.571 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.571 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.571 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.571 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.572 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "iostat", 2023-08-10T12:05:22.572 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.572 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.572 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.572 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.572 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.572 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.573 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.573 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.573 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.573 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.573 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.573 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.573 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.573 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.574 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.574 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.574 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.574 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.574 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.574 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.574 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.574 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.575 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.575 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.575 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.575 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.575 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.575 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.575 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.576 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.576 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.576 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.576 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.576 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.576 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.576 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.577 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.577 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.577 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.577 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.577 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.577 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.577 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.578 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.578 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.578 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.578 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.578 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.578 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.578 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.578 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.579 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.579 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.579 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.579 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.579 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.579 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.579 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.580 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.580 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.580 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.580 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.580 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.580 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.580 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.580 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.581 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.581 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.581 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.581 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.581 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.581 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.581 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "k8sevents", 2023-08-10T12:05:22.582 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.582 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.582 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.582 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_event_retention_days": { 2023-08-10T12:05:22.582 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ceph_event_retention_days", 2023-08-10T12:05:22.582 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.582 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.583 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.583 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "7", 2023-08-10T12:05:22.583 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.583 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.583 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.583 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Days to hold ceph event information within local cache", 2023-08-10T12:05:22.583 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.583 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.584 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.584 INFO:teuthology.orchestra.run.smithi073.stdout: "config_check_secs": { 2023-08-10T12:05:22.584 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_check_secs", 2023-08-10T12:05:22.584 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.584 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.584 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.584 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-08-10T12:05:22.585 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "10", 2023-08-10T12:05:22.585 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.585 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.585 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-08-10T12:05:22.585 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.585 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.585 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.586 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.586 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.586 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.586 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.586 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.586 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.586 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.586 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.587 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.587 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.587 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.587 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.587 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.587 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.587 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.587 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.588 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.588 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.588 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.588 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.588 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.588 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.588 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.589 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.589 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.589 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.589 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.589 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.589 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.589 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.589 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.590 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.590 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.590 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.590 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.590 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.590 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.590 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.591 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.591 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.591 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.591 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.591 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.591 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.591 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.592 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.592 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.592 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.592 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.592 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.592 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.592 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.592 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.593 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.593 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.593 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.593 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.593 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.593 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.593 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.593 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.594 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.594 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.594 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.594 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.594 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.594 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.594 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.594 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.595 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.595 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "localpool", 2023-08-10T12:05:22.595 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.595 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.595 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.595 INFO:teuthology.orchestra.run.smithi073.stdout: "failure_domain": { 2023-08-10T12:05:22.595 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "failure_domain", 2023-08-10T12:05:22.596 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.596 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.596 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.596 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "host", 2023-08-10T12:05:22.596 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.596 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.596 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.596 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "failure domain for any created local pool", 2023-08-10T12:05:22.597 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-08-10T12:05:22.597 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.597 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.597 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.597 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.597 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.597 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.597 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.598 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.598 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.598 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.598 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.598 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.598 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.598 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.598 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.599 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.599 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.599 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.599 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.599 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.599 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.599 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.599 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.600 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.600 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.600 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.600 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.600 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.600 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.601 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.601 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.601 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.601 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.601 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.601 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.601 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.601 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.602 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.602 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.602 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.602 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.603 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.603 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.603 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.603 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.603 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.603 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.603 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.604 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.604 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.604 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.604 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.604 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.604 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.604 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.604 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.605 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.605 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.605 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.605 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.605 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.605 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.605 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.606 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.606 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.606 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.606 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.606 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.606 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.606 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.607 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": { 2023-08-10T12:05:22.607 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "min_size", 2023-08-10T12:05:22.607 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.607 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.607 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.607 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.607 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.608 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.608 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.608 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default min_size for any created local pool", 2023-08-10T12:05:22.608 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-08-10T12:05:22.608 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.608 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.608 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.608 INFO:teuthology.orchestra.run.smithi073.stdout: "num_rep": { 2023-08-10T12:05:22.609 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "num_rep", 2023-08-10T12:05:22.609 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.609 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.609 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.609 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3", 2023-08-10T12:05:22.609 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.609 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.609 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.610 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default replica count for any created local pool", 2023-08-10T12:05:22.610 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.610 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.610 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.610 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": { 2023-08-10T12:05:22.610 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pg_num", 2023-08-10T12:05:22.610 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.611 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.611 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.611 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "128", 2023-08-10T12:05:22.611 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.611 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.611 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.611 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default pg_num for any created local pool", 2023-08-10T12:05:22.611 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.612 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.612 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.612 INFO:teuthology.orchestra.run.smithi073.stdout: "prefix": { 2023-08-10T12:05:22.612 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prefix", 2023-08-10T12:05:22.612 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.612 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.613 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.613 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.613 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.613 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.613 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.613 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "name prefix for any created local pool", 2023-08-10T12:05:22.613 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.613 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.614 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.614 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.614 INFO:teuthology.orchestra.run.smithi073.stdout: "subtree": { 2023-08-10T12:05:22.614 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "subtree", 2023-08-10T12:05:22.614 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.614 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.614 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.614 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "rack", 2023-08-10T12:05:22.615 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.615 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.615 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.615 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "CRUSH level for which to create a local pool", 2023-08-10T12:05:22.615 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-08-10T12:05:22.615 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.615 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.615 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.616 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.616 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.616 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.616 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mds_autoscaler", 2023-08-10T12:05:22.616 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.616 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.616 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.616 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.617 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.617 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.617 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.617 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.617 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.617 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.617 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.618 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.618 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.618 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.618 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.618 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.618 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.618 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.618 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.619 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.619 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.619 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.619 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.619 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.619 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.619 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.620 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.620 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.620 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.620 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.620 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.620 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.620 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.620 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.621 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.621 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.621 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.621 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.621 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.621 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.621 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.621 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.622 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.622 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.622 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.622 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.622 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.622 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.622 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.622 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.623 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.623 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.623 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.623 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.623 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.623 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.623 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.624 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.624 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.624 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.624 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.624 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.624 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.624 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.625 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.625 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.625 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.625 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.625 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.625 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.626 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.626 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.626 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.626 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.626 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mirroring", 2023-08-10T12:05:22.626 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.626 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.627 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.627 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.627 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.627 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.627 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.627 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.627 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.628 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.628 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.628 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.628 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.628 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.628 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.628 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.628 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.629 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.629 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.629 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.629 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.629 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.629 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.629 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.629 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.630 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.630 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.630 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.630 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.630 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.630 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.630 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.630 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.631 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.631 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.631 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.631 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.631 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.631 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.631 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.632 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.632 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.632 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.632 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.632 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.632 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.632 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.633 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.633 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.633 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.633 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.633 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.633 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.633 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.633 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.634 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.634 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.634 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.634 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.634 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.634 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.634 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.635 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.635 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.635 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.635 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.635 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.635 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.635 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.635 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.636 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.636 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.636 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.636 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.636 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "nfs", 2023-08-10T12:05:22.636 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.636 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.636 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.637 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.637 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.637 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.637 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.637 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.637 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.637 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.637 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.638 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.638 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.638 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.638 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.638 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.638 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.638 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.639 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.639 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.639 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.639 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.639 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.639 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.639 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.640 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.640 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.640 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.640 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.640 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.640 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.640 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.640 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.641 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.641 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.641 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.641 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.641 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.641 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.641 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.641 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.642 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.642 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.642 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.642 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.642 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.642 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.642 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.642 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.643 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.643 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.643 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.643 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.643 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.643 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.643 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.643 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.644 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.644 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.644 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.644 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.644 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.644 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.645 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.645 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.645 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.645 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.645 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.645 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.645 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.645 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.646 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.646 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "orchestrator", 2023-08-10T12:05:22.646 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.646 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.646 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.646 INFO:teuthology.orchestra.run.smithi073.stdout: "fail_fs": { 2023-08-10T12:05:22.647 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "fail_fs", 2023-08-10T12:05:22.647 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.647 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.647 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.647 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.647 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.647 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.647 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.648 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-08-10T12:05:22.648 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.648 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.648 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.648 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.648 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.648 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.649 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.649 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.649 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.649 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.649 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.649 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.649 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.649 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.650 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.650 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.650 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.650 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.650 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.650 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.650 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.650 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.651 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.651 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.651 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.651 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.651 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.651 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.652 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.652 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.652 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.652 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.652 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.652 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.652 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.652 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.653 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.653 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.653 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.653 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.653 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.653 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.653 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.654 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.654 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.654 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.654 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.654 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.654 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.654 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.654 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.655 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.655 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.655 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.655 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.655 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.655 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.655 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.656 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.656 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.656 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.656 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.656 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.656 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.656 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.656 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.657 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.657 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.657 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.657 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.657 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.657 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator": { 2023-08-10T12:05:22.657 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "orchestrator", 2023-08-10T12:05:22.657 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.658 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.658 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.658 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.658 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.658 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.658 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.658 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm", 2023-08-10T12:05:22.658 INFO:teuthology.orchestra.run.smithi073.stdout: "rook", 2023-08-10T12:05:22.659 INFO:teuthology.orchestra.run.smithi073.stdout: "test_orchestrator" 2023-08-10T12:05:22.659 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.659 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Orchestrator backend", 2023-08-10T12:05:22.659 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.659 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.659 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.659 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.660 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.660 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "osd_perf_query", 2023-08-10T12:05:22.660 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.660 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.660 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.660 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.661 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.661 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.661 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.661 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.661 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.661 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.661 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.661 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.662 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.662 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.662 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.662 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.662 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.662 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.662 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.662 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.663 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.663 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.663 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.663 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.663 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.663 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.663 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.664 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.664 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.664 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.664 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.664 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.664 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.664 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.664 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.665 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.665 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.665 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.665 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.665 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.665 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.665 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.665 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.666 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.666 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.666 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.666 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.666 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.666 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.666 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.667 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.667 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.667 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.667 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.667 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.667 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.667 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.667 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.668 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.668 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.668 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.668 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.668 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.668 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.668 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.668 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.669 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.669 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.669 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.669 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.669 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.669 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.669 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.669 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.670 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.670 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "osd_support", 2023-08-10T12:05:22.670 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.670 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.670 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.670 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.670 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.670 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.671 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.671 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.671 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.671 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.671 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.671 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.671 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.671 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.672 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.672 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.672 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.672 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.672 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.672 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.672 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.672 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.673 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.673 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.673 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.673 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.673 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.673 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.674 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.674 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.674 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.674 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.674 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.674 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.674 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.674 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.675 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.675 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.675 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.675 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.675 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.675 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.675 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.675 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.676 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.676 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.676 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.676 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.676 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.676 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.676 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.677 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.677 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.677 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.677 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.677 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.677 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.677 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.677 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.678 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.678 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.678 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.678 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.678 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.678 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.678 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.678 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.679 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.679 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.679 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.679 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.679 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.679 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.679 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.679 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.680 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pg_autoscaler", 2023-08-10T12:05:22.680 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.680 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.680 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.680 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.680 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.680 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.681 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.681 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.681 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.681 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.681 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.681 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.681 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.681 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.682 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.682 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.682 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.682 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.682 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.682 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.682 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.682 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.683 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.683 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.683 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.683 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.683 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.683 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.683 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.684 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.684 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.684 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.684 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.684 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.684 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.684 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.684 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.685 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.685 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.685 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.685 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.685 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.685 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.685 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.686 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.686 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.686 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.686 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.686 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.686 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.686 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.686 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.687 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.687 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.687 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.687 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.687 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.687 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.687 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.687 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.688 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.688 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.688 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.688 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.688 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.688 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.688 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.688 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.689 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.689 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.689 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.689 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.689 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.689 INFO:teuthology.orchestra.run.smithi073.stdout: "noautoscale": { 2023-08-10T12:05:22.689 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "noautoscale", 2023-08-10T12:05:22.689 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.690 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.690 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.690 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.690 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.690 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.690 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.690 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "global autoscale flag", 2023-08-10T12:05:22.690 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-08-10T12:05:22.691 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.691 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.691 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.691 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2023-08-10T12:05:22.691 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2023-08-10T12:05:22.691 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:22.691 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.691 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.692 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2023-08-10T12:05:22.692 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.692 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.692 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.692 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.692 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.692 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.692 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.693 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.693 INFO:teuthology.orchestra.run.smithi073.stdout: "threshold": { 2023-08-10T12:05:22.693 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "threshold", 2023-08-10T12:05:22.693 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-08-10T12:05:22.693 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.693 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.693 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3.0", 2023-08-10T12:05:22.693 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1.0", 2023-08-10T12:05:22.694 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.694 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.694 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "scaling threshold", 2023-08-10T12:05:22.694 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-08-10T12:05:22.694 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.694 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.694 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.695 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.695 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.695 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.695 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "progress", 2023-08-10T12:05:22.695 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.695 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.695 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.695 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_pg_recovery_event": { 2023-08-10T12:05:22.696 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_pg_recovery_event", 2023-08-10T12:05:22.696 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.696 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.696 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.696 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.696 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.696 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.696 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.697 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow the module to show pg recovery progress", 2023-08-10T12:05:22.697 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.697 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.697 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.697 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.697 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": { 2023-08-10T12:05:22.697 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enabled", 2023-08-10T12:05:22.697 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.698 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.698 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.698 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.698 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.698 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.698 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.698 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.698 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.699 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.699 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.699 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.699 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.699 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.699 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.699 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.699 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.700 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.700 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.700 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.700 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.700 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.700 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.700 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.701 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.701 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.701 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.701 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.701 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.701 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.701 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.701 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.702 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.702 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.702 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.702 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.702 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.702 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.702 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.702 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.703 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.703 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.703 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.703 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.703 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.703 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.704 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.704 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.704 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.704 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.704 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.704 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.704 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.704 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.705 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.705 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.705 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.705 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.705 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.705 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.705 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.705 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.706 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.706 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.706 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.706 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.706 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.706 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.706 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.707 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.707 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.707 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.707 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.707 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.707 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.707 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.707 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.708 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.708 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.708 INFO:teuthology.orchestra.run.smithi073.stdout: "max_completed_events": { 2023-08-10T12:05:22.708 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_completed_events", 2023-08-10T12:05:22.708 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.708 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.708 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.709 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "50", 2023-08-10T12:05:22.709 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.709 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.709 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.709 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "number of past completed events to remember", 2023-08-10T12:05:22.709 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.709 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.709 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.710 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2023-08-10T12:05:22.710 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2023-08-10T12:05:22.710 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:22.710 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.710 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.710 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2023-08-10T12:05:22.710 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.711 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.711 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.711 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long the module is going to sleep", 2023-08-10T12:05:22.711 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.711 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.711 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.711 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.711 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.712 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.712 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus", 2023-08-10T12:05:22.712 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.712 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.712 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.712 INFO:teuthology.orchestra.run.smithi073.stdout: "cache": { 2023-08-10T12:05:22.713 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cache", 2023-08-10T12:05:22.713 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.713 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.713 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.713 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.713 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.713 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.713 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.714 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.714 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.714 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.714 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.714 INFO:teuthology.orchestra.run.smithi073.stdout: "exclude_perf_counters": { 2023-08-10T12:05:22.714 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "exclude_perf_counters", 2023-08-10T12:05:22.714 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.715 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.715 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.715 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.715 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.715 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.715 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.715 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-08-10T12:05:22.715 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-08-10T12:05:22.716 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.716 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.716 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.716 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.716 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.716 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.716 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.717 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.717 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.717 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.717 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.717 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.717 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.717 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.717 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.718 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.718 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.718 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.718 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.718 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.718 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.718 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.718 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.719 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.719 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.719 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.719 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.719 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.719 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.719 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.719 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.720 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.720 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.720 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.720 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.720 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.720 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.720 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.720 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.721 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.721 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.721 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.721 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.721 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.721 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.721 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.721 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.722 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.722 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.722 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.722 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.722 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.722 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.722 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.723 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.723 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.723 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.723 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.723 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.723 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.723 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.723 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.724 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.724 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.724 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.724 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.724 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.724 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.724 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.724 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.725 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.725 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_stats_pools": { 2023-08-10T12:05:22.725 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_stats_pools", 2023-08-10T12:05:22.725 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.725 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.725 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.725 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.726 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.726 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.726 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.726 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.726 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.726 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.726 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.726 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.727 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_stats_pools_refresh_interval": { 2023-08-10T12:05:22.727 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-08-10T12:05:22.727 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.727 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.727 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.727 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "300", 2023-08-10T12:05:22.727 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.728 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.728 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.728 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.728 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.728 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.728 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.728 INFO:teuthology.orchestra.run.smithi073.stdout: "scrape_interval": { 2023-08-10T12:05:22.729 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "scrape_interval", 2023-08-10T12:05:22.729 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-08-10T12:05:22.729 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.729 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.729 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15.0", 2023-08-10T12:05:22.729 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.729 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.729 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.730 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.730 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.730 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.730 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.730 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.730 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2023-08-10T12:05:22.730 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2023-08-10T12:05:22.730 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.731 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.731 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.731 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "::", 2023-08-10T12:05:22.731 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.731 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.731 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.731 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-08-10T12:05:22.731 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.732 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.732 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.732 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.732 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2023-08-10T12:05:22.732 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2023-08-10T12:05:22.732 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.732 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.732 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.733 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "9283", 2023-08-10T12:05:22.733 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.733 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.733 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.733 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-08-10T12:05:22.733 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.733 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.733 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.734 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.734 INFO:teuthology.orchestra.run.smithi073.stdout: "stale_cache_strategy": { 2023-08-10T12:05:22.734 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "stale_cache_strategy", 2023-08-10T12:05:22.734 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.734 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.734 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.734 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "log", 2023-08-10T12:05:22.734 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.735 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.735 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.735 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.735 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.735 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.735 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.735 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_behaviour": { 2023-08-10T12:05:22.736 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_behaviour", 2023-08-10T12:05:22.736 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.736 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.736 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.736 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "default", 2023-08-10T12:05:22.736 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.736 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.737 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.737 INFO:teuthology.orchestra.run.smithi073.stdout: "default", 2023-08-10T12:05:22.737 INFO:teuthology.orchestra.run.smithi073.stdout: "error" 2023-08-10T12:05:22.737 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.737 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.737 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.737 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.737 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.738 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_error_status_code": { 2023-08-10T12:05:22.738 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_error_status_code", 2023-08-10T12:05:22.738 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.738 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.738 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.738 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "500", 2023-08-10T12:05:22.738 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "400", 2023-08-10T12:05:22.739 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "599", 2023-08-10T12:05:22.739 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.739 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.739 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.739 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.739 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.739 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.739 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.740 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.740 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_support", 2023-08-10T12:05:22.740 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.740 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.740 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.740 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.740 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.741 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.741 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.741 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.741 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.741 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.741 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.741 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.741 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.742 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.742 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.742 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.742 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.742 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.742 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.742 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.742 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.743 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.743 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.743 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.743 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.743 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.743 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.743 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.744 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.744 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.744 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.744 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.744 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.744 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.744 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.744 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.745 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.745 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.745 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.745 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.745 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.745 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.745 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.745 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.746 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.746 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.746 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.746 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.746 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.746 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.746 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.746 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.747 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.747 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.747 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.747 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.747 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.747 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.747 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.747 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.748 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.748 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.748 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.748 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.748 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.748 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.748 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.749 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.749 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.749 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.749 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.749 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.749 INFO:teuthology.orchestra.run.smithi073.stdout: "max_concurrent_snap_create": { 2023-08-10T12:05:22.749 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_concurrent_snap_create", 2023-08-10T12:05:22.750 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.750 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.750 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.750 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-08-10T12:05:22.750 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.750 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.750 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.750 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.751 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.751 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.751 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.751 INFO:teuthology.orchestra.run.smithi073.stdout: "mirror_snapshot_schedule": { 2023-08-10T12:05:22.751 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mirror_snapshot_schedule", 2023-08-10T12:05:22.751 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.751 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.752 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.752 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.752 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.752 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.752 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.752 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.752 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.753 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.753 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.753 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.753 INFO:teuthology.orchestra.run.smithi073.stdout: "trash_purge_schedule": { 2023-08-10T12:05:22.753 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "trash_purge_schedule", 2023-08-10T12:05:22.753 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.753 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.753 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.754 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.754 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.754 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.754 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.754 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.754 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.754 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.754 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.755 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.755 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.755 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.755 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.755 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "restful", 2023-08-10T12:05:22.755 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.755 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.755 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.756 INFO:teuthology.orchestra.run.smithi073.stdout: "enable_auth": { 2023-08-10T12:05:22.756 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enable_auth", 2023-08-10T12:05:22.756 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.756 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.756 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.756 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.756 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.756 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.757 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.757 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.757 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.757 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.757 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.757 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.757 INFO:teuthology.orchestra.run.smithi073.stdout: "key_file": { 2023-08-10T12:05:22.757 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "key_file", 2023-08-10T12:05:22.758 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.758 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.758 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.758 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.758 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.758 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.758 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.759 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.759 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.759 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.759 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.759 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.759 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.759 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.759 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.760 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.760 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.760 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.760 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.760 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.760 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.760 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.760 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.761 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.761 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.761 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.761 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.761 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.761 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.761 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.761 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.762 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.762 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.762 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.762 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.762 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.762 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.762 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.762 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.763 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.763 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.763 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.763 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.763 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.763 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.763 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.763 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.764 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.764 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.764 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.764 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.764 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.764 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.764 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.764 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.765 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.765 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.765 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.765 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.765 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.765 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.765 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.765 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.766 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.766 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.766 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.766 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.766 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.766 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.766 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.767 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.767 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.767 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.767 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.767 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.767 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.767 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.767 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.768 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.768 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.768 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.768 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2023-08-10T12:05:22.768 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2023-08-10T12:05:22.768 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.768 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.768 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.769 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.769 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.769 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.769 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.769 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.769 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.769 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.769 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.770 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.770 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2023-08-10T12:05:22.770 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2023-08-10T12:05:22.770 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.770 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.770 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.770 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.770 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.771 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.771 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.771 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.771 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.771 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.771 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.771 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.771 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.772 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rgw", 2023-08-10T12:05:22.772 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.772 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.772 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.772 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.773 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.773 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.773 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.773 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.773 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.773 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.773 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.773 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.774 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.774 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.774 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.774 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.774 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.774 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.774 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.774 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.775 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.775 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.775 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.775 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.775 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.775 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.775 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.776 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.776 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.776 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.776 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.776 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.776 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.776 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.777 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.777 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.777 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.777 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.777 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.777 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.777 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.778 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.778 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.778 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.778 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.778 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.778 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.778 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.778 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.779 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.779 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.779 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.779 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.779 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.779 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.779 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.780 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.780 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.780 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.780 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.780 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.780 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.780 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.780 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.781 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.781 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.781 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.781 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.781 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.781 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.781 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.782 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.782 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rook", 2023-08-10T12:05:22.782 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.782 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.782 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.782 INFO:teuthology.orchestra.run.smithi073.stdout: "drive_group_interval": { 2023-08-10T12:05:22.782 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "drive_group_interval", 2023-08-10T12:05:22.783 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-08-10T12:05:22.783 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.783 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.783 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "300.0", 2023-08-10T12:05:22.783 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.783 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.783 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.784 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-08-10T12:05:22.784 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.784 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.784 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.785 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.785 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.785 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.785 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.785 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.785 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.785 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.786 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.786 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.786 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.786 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.786 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.786 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.786 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.786 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.787 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.787 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.787 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.787 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.787 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.787 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.788 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.788 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.788 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.788 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.788 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.788 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.788 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.789 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.789 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.789 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.789 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.789 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.789 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.789 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.790 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.790 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.790 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.790 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.790 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.790 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.790 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.791 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.791 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.791 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.791 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.791 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.791 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.791 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.791 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.792 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.792 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.792 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.792 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.792 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.792 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.792 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.793 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.793 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.793 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.793 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.793 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.793 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.793 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.793 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.794 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.794 INFO:teuthology.orchestra.run.smithi073.stdout: "storage_class": { 2023-08-10T12:05:22.794 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "storage_class", 2023-08-10T12:05:22.794 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.794 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.794 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.794 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "local", 2023-08-10T12:05:22.795 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.795 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.795 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.795 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-08-10T12:05:22.795 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.795 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.795 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.795 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.796 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.796 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "selftest", 2023-08-10T12:05:22.796 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.796 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.796 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.797 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.797 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.797 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.797 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.797 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.797 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.797 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.797 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.798 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.798 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.798 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.798 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.798 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.798 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.798 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.798 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.799 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.799 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.799 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.799 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.799 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.799 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.800 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.800 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.800 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.800 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.800 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.800 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.800 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.800 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.801 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.801 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.801 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.801 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.801 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.801 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.802 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.802 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.802 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.802 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.802 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.802 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.802 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.802 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.803 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.803 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.803 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.803 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.803 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.803 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.803 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.803 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.804 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.804 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.804 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.804 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.804 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.804 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.804 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.805 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.805 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.805 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.805 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.805 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.805 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.805 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.806 INFO:teuthology.orchestra.run.smithi073.stdout: "roption1": { 2023-08-10T12:05:22.806 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "roption1", 2023-08-10T12:05:22.806 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.806 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.806 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.806 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.806 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.807 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.807 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.807 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.807 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.807 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.807 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.807 INFO:teuthology.orchestra.run.smithi073.stdout: "roption2": { 2023-08-10T12:05:22.808 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "roption2", 2023-08-10T12:05:22.808 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.808 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.808 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.808 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "xyz", 2023-08-10T12:05:22.808 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.808 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.808 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.809 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.809 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.809 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.809 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.809 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption1": { 2023-08-10T12:05:22.809 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption1", 2023-08-10T12:05:22.809 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.810 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.810 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.810 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.810 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.810 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.810 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.810 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.811 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.811 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.811 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.811 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption2": { 2023-08-10T12:05:22.811 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption2", 2023-08-10T12:05:22.811 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.811 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.812 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.812 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.812 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.812 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.812 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.812 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.812 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.812 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.813 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.813 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption3": { 2023-08-10T12:05:22.813 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption3", 2023-08-10T12:05:22.813 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-08-10T12:05:22.813 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.813 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.813 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.814 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.814 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.814 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.814 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.814 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.814 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.814 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.815 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption4": { 2023-08-10T12:05:22.815 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption4", 2023-08-10T12:05:22.815 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.815 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.815 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.815 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.815 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.816 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.816 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.816 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.816 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.816 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.816 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.816 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption5": { 2023-08-10T12:05:22.817 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption5", 2023-08-10T12:05:22.817 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.817 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.817 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.817 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.817 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.817 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.817 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.818 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.818 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.818 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.818 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.818 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption6": { 2023-08-10T12:05:22.818 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption6", 2023-08-10T12:05:22.818 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.819 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.819 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.819 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.819 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.819 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.819 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.819 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.819 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.820 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.820 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.820 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption7": { 2023-08-10T12:05:22.820 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption7", 2023-08-10T12:05:22.820 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.820 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.821 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.821 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.821 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2023-08-10T12:05:22.821 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "42", 2023-08-10T12:05:22.821 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.821 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.821 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.821 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.822 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.822 INFO:teuthology.orchestra.run.smithi073.stdout: "testkey": { 2023-08-10T12:05:22.822 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testkey", 2023-08-10T12:05:22.822 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.822 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.822 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.822 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.823 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.823 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.823 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.823 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.823 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.823 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.823 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.823 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.824 INFO:teuthology.orchestra.run.smithi073.stdout: "testlkey": { 2023-08-10T12:05:22.824 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testlkey", 2023-08-10T12:05:22.824 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.824 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.824 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.824 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.824 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.825 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.825 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.825 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.825 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.825 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.825 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.825 INFO:teuthology.orchestra.run.smithi073.stdout: "testnewline": { 2023-08-10T12:05:22.826 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testnewline", 2023-08-10T12:05:22.826 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.826 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.826 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.826 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.826 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.826 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.826 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.827 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.827 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.827 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.827 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.827 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.827 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.827 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.828 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snap_schedule", 2023-08-10T12:05:22.828 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.828 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.828 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.828 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_m_granularity": { 2023-08-10T12:05:22.828 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_m_granularity", 2023-08-10T12:05:22.828 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.828 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.829 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.829 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.829 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.829 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.829 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.829 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow minute scheduled snapshots", 2023-08-10T12:05:22.829 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.830 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.830 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.830 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.830 INFO:teuthology.orchestra.run.smithi073.stdout: "dump_on_update": { 2023-08-10T12:05:22.830 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "dump_on_update", 2023-08-10T12:05:22.830 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.830 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.830 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.831 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.831 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.831 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.831 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.831 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "dump database to debug log on update", 2023-08-10T12:05:22.831 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.831 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.831 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.832 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.832 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.832 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.832 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.832 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.832 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.832 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.832 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.833 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.833 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.833 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.833 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.833 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.833 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.833 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.833 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.834 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.834 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.834 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.834 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.834 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.834 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.834 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.834 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.835 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.835 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.835 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.835 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.835 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.835 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.835 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.835 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.836 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.836 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.836 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.836 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.836 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.836 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.836 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.837 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.837 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.837 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.837 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.837 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.837 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.837 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.837 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.838 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.838 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.838 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.838 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.838 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.838 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.838 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.838 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.839 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.839 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.839 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.839 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.839 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.839 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.839 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.840 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.840 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.840 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.840 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.840 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.840 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.840 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.841 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.841 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.841 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.841 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "stats", 2023-08-10T12:05:22.841 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.841 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.841 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.842 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.842 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.842 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.842 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.842 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.842 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.842 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.842 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.843 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.843 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.843 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.843 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.843 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.843 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.843 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.843 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.844 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.844 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.844 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.844 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.844 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.844 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.844 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.845 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.845 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.845 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.845 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.845 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.845 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.845 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.846 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.846 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.846 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.846 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.846 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.846 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.846 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.847 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.847 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.847 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.847 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.847 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.847 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.847 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.847 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.848 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.848 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.848 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.848 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.848 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.848 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.848 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.848 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.849 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.849 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.849 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.849 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.849 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.849 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.849 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.850 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.850 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.850 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.850 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.850 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.850 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.850 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.850 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.851 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.851 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.851 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "status", 2023-08-10T12:05:22.851 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.851 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.851 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.851 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.852 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.852 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.852 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.852 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.852 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.852 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.852 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.852 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.853 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.853 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.853 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.853 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.853 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.853 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.853 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.853 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.854 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.854 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.854 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.854 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.854 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.854 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.854 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.854 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.855 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.855 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.855 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.855 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.855 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.855 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.855 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.855 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.856 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.856 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.856 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.856 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.856 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.856 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.857 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.857 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.857 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.857 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.857 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.857 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.857 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.857 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.858 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.858 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.858 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.858 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.858 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.858 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.858 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.858 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.859 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.859 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.859 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.859 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.859 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.859 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.859 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.859 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.860 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.860 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.860 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.860 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.860 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.860 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.860 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.860 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.861 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.861 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "telegraf", 2023-08-10T12:05:22.861 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.861 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.861 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.861 INFO:teuthology.orchestra.run.smithi073.stdout: "address": { 2023-08-10T12:05:22.861 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "address", 2023-08-10T12:05:22.862 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.862 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.862 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.862 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-08-10T12:05:22.862 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.862 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.862 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.862 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.863 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.863 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.863 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.863 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2023-08-10T12:05:22.863 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2023-08-10T12:05:22.863 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:22.863 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.864 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.864 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15", 2023-08-10T12:05:22.864 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.864 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.864 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.864 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.864 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.864 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.865 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.865 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.865 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.865 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.865 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.865 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.865 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.866 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.866 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.866 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.866 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.866 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.866 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.866 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.866 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.867 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.867 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.867 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.867 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.867 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.867 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.867 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.867 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.868 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.868 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.868 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.868 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.868 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.868 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.868 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.869 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.869 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.869 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.869 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.869 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.869 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.869 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.870 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.870 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.870 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.870 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.870 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.870 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.870 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.870 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.871 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.871 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.871 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.871 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.871 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.871 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.871 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.871 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.872 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.872 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.872 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.872 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.872 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.872 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.872 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.872 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.873 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.873 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.873 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.873 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.873 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.873 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.873 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.873 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.874 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.874 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.874 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.874 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "telemetry", 2023-08-10T12:05:22.874 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.874 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.875 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.875 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_basic": { 2023-08-10T12:05:22.875 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_basic", 2023-08-10T12:05:22.875 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.875 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.875 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.875 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.875 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.876 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.876 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.876 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share basic cluster information (size, version)", 2023-08-10T12:05:22.876 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.876 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.876 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.877 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_crash": { 2023-08-10T12:05:22.877 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_crash", 2023-08-10T12:05:22.877 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.877 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.877 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.877 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.877 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.877 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.878 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.878 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-08-10T12:05:22.878 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.878 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.878 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.878 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_device": { 2023-08-10T12:05:22.878 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_device", 2023-08-10T12:05:22.879 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.879 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.879 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.879 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.879 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.879 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.879 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.879 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-08-10T12:05:22.880 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.880 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.880 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.880 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_ident": { 2023-08-10T12:05:22.880 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_ident", 2023-08-10T12:05:22.880 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.880 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.881 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.881 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.881 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.881 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.881 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.881 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-08-10T12:05:22.881 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.881 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.882 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.882 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_perf": { 2023-08-10T12:05:22.882 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_perf", 2023-08-10T12:05:22.882 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.882 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.882 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.883 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.883 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.883 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.883 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.883 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share various performance metrics of a cluster", 2023-08-10T12:05:22.883 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.883 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.883 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.884 INFO:teuthology.orchestra.run.smithi073.stdout: "contact": { 2023-08-10T12:05:22.884 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "contact", 2023-08-10T12:05:22.884 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.884 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.884 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.884 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.884 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.885 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.885 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.885 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.885 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.885 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.885 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.885 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.885 INFO:teuthology.orchestra.run.smithi073.stdout: "description": { 2023-08-10T12:05:22.886 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "description", 2023-08-10T12:05:22.886 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.886 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.886 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.886 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.886 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.886 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.886 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: "device_url": { 2023-08-10T12:05:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_url", 2023-08-10T12:05:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-08-10T12:05:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.889 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.889 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.889 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.889 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": { 2023-08-10T12:05:22.889 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enabled", 2023-08-10T12:05:22.889 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.889 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.889 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.890 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.890 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.890 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.890 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.890 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.890 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.890 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.890 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.891 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.891 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2023-08-10T12:05:22.891 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2023-08-10T12:05:22.891 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.891 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.891 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.891 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "24", 2023-08-10T12:05:22.891 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "8", 2023-08-10T12:05:22.892 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.892 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.892 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.892 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.892 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.892 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.892 INFO:teuthology.orchestra.run.smithi073.stdout: "last_opt_revision": { 2023-08-10T12:05:22.893 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "last_opt_revision", 2023-08-10T12:05:22.893 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.893 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.893 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.893 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1", 2023-08-10T12:05:22.893 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.893 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.893 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.894 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.894 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.894 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.894 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.894 INFO:teuthology.orchestra.run.smithi073.stdout: "leaderboard": { 2023-08-10T12:05:22.894 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "leaderboard", 2023-08-10T12:05:22.895 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.895 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.895 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.895 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.895 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.895 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.895 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.895 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.896 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.896 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.896 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.896 INFO:teuthology.orchestra.run.smithi073.stdout: "leaderboard_description": { 2023-08-10T12:05:22.896 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "leaderboard_description", 2023-08-10T12:05:22.896 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.896 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.897 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.897 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.897 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.897 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.897 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.897 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.897 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.897 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.898 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.898 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.898 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.898 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.898 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.898 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.899 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.899 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.899 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.899 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.899 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.899 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.899 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.899 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.900 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.900 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.900 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.900 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.900 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.900 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.900 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.901 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.901 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.901 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.901 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.901 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.901 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.901 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.901 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.902 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.902 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.902 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.902 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.902 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.902 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.902 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.903 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.903 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.903 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.903 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.903 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.903 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.903 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.903 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.904 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.904 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.904 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.904 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.904 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.904 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.904 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.904 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.905 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.905 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.905 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.905 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.905 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.905 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.905 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.906 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.906 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.906 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.906 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.906 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.906 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.906 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.906 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.907 INFO:teuthology.orchestra.run.smithi073.stdout: "organization": { 2023-08-10T12:05:22.907 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "organization", 2023-08-10T12:05:22.907 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.907 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.907 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.907 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.907 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.908 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.908 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.908 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.908 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.908 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.908 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.909 INFO:teuthology.orchestra.run.smithi073.stdout: "proxy": { 2023-08-10T12:05:22.909 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "proxy", 2023-08-10T12:05:22.909 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.909 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.909 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.909 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.909 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.909 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.910 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.910 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.910 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.910 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.910 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.910 INFO:teuthology.orchestra.run.smithi073.stdout: "url": { 2023-08-10T12:05:22.910 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "url", 2023-08-10T12:05:22.911 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.911 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.911 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.911 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-08-10T12:05:22.911 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.911 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.911 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.911 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.912 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.912 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.912 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.912 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.912 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.912 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "test_orchestrator", 2023-08-10T12:05:22.913 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.913 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.913 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.913 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.913 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.913 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.913 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.913 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.914 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.914 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.914 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.914 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.914 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.914 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.914 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.914 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.915 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.915 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.915 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.915 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.915 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.915 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.915 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.916 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.916 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.916 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.916 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.916 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.916 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.916 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.916 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.917 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.917 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.917 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.917 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.917 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.917 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.917 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.918 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.918 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.918 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.918 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.918 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.918 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.918 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.918 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.919 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.919 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.919 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.919 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.919 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.919 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.919 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.919 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.920 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.920 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.920 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.920 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.920 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.920 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.921 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.921 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.921 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.921 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.921 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.921 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.921 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.921 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.922 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.922 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.922 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.922 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "volumes", 2023-08-10T12:05:22.922 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.922 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.923 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.923 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.923 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.923 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.923 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.923 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.923 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.923 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.924 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.924 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.924 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.924 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.924 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.924 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.924 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.924 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.925 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.925 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.925 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.925 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.925 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.925 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.925 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.926 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.926 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.926 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.926 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.926 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.926 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.926 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.926 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.927 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.927 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.927 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.927 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.927 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.927 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.927 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.928 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.928 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.928 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.928 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.928 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.928 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.928 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.928 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.929 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.929 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.929 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.929 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.929 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.929 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.929 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.929 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.930 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.930 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.930 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.930 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.930 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.930 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.930 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.931 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.931 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.931 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.931 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.931 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.931 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.931 INFO:teuthology.orchestra.run.smithi073.stdout: "max_concurrent_clones": { 2023-08-10T12:05:22.932 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_concurrent_clones", 2023-08-10T12:05:22.932 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.932 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.932 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.932 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "4", 2023-08-10T12:05:22.932 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.932 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.933 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.933 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Number of asynchronous cloner threads", 2023-08-10T12:05:22.933 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.933 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.933 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.933 INFO:teuthology.orchestra.run.smithi073.stdout: "snapshot_clone_delay": { 2023-08-10T12:05:22.933 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snapshot_clone_delay", 2023-08-10T12:05:22.934 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.934 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.934 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.934 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2023-08-10T12:05:22.934 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.934 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.934 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.934 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-08-10T12:05:22.935 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.935 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.935 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.935 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.935 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.935 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix", 2023-08-10T12:05:22.936 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.936 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.936 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.936 INFO:teuthology.orchestra.run.smithi073.stdout: "discovery_interval": { 2023-08-10T12:05:22.936 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "discovery_interval", 2023-08-10T12:05:22.936 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2023-08-10T12:05:22.936 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.936 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.937 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "100", 2023-08-10T12:05:22.937 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.937 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.937 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.937 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.937 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.937 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.937 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.938 INFO:teuthology.orchestra.run.smithi073.stdout: "identifier": { 2023-08-10T12:05:22.938 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "identifier", 2023-08-10T12:05:22.938 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.938 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.938 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.938 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.938 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.939 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.939 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.939 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.939 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.939 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.939 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.940 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2023-08-10T12:05:22.940 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2023-08-10T12:05:22.940 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:22.940 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.940 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.940 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2023-08-10T12:05:22.940 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.940 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.941 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.941 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.941 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.941 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.941 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.941 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.941 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.942 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.942 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.942 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.942 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.942 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.942 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.942 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.942 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.943 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.943 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.943 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.943 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.943 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.943 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.943 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.943 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.944 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.944 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.944 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.944 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.944 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.944 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.945 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.945 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.945 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.945 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.945 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.945 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.945 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.945 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.946 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.946 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.946 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.946 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.946 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.946 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.946 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.947 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.947 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.947 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.947 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.947 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.947 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.947 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.947 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.948 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.948 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.948 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.948 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.948 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.948 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.948 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.949 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.949 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.949 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.949 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.949 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.949 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.949 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.949 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.950 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.950 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.950 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.950 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.950 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_host": { 2023-08-10T12:05:22.950 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_host", 2023-08-10T12:05:22.950 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.951 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.951 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.951 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.951 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.951 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.951 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.951 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.951 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.952 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.952 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.952 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_port": { 2023-08-10T12:05:22.952 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_port", 2023-08-10T12:05:22.952 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.952 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.953 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.953 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10051", 2023-08-10T12:05:22.953 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.953 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.953 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.953 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.953 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.953 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.954 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.954 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_sender": { 2023-08-10T12:05:22.954 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_sender", 2023-08-10T12:05:22.954 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.954 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.954 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:22.954 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-08-10T12:05:22.955 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.955 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.955 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.955 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.955 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.955 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.955 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.955 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.956 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.956 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.956 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-08-10T12:05:22.956 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.956 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.956 INFO:teuthology.orchestra.run.smithi073.stdout: "modules": [ 2023-08-10T12:05:22.956 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm", 2023-08-10T12:05:22.956 INFO:teuthology.orchestra.run.smithi073.stdout: "dashboard", 2023-08-10T12:05:22.957 INFO:teuthology.orchestra.run.smithi073.stdout: "iostat", 2023-08-10T12:05:22.957 INFO:teuthology.orchestra.run.smithi073.stdout: "nfs", 2023-08-10T12:05:22.957 INFO:teuthology.orchestra.run.smithi073.stdout: "restful", 2023-08-10T12:05:22.957 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_schedule" 2023-08-10T12:05:22.957 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.957 INFO:teuthology.orchestra.run.smithi073.stdout: "available_modules": [ 2023-08-10T12:05:22.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.957 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "alerts", 2023-08-10T12:05:22.958 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.958 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.958 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.958 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2023-08-10T12:05:22.958 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2023-08-10T12:05:22.958 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:22.958 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.959 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.959 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2023-08-10T12:05:22.959 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.959 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.959 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.959 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How frequently to reexamine health status", 2023-08-10T12:05:22.959 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.959 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.960 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.960 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.960 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.960 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.960 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.960 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.960 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.961 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.961 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.961 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.961 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.961 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.961 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.961 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.961 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.962 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.962 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.962 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.962 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.962 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.962 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.962 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:22.963 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:22.963 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.963 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.963 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.963 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.963 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.963 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.963 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.964 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.964 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.964 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.964 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.964 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:22.964 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:22.964 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.965 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.965 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.965 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:22.965 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.965 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.965 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.965 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.965 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.966 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:22.966 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:22.966 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:22.966 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:22.966 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:22.966 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.966 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.966 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.967 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.967 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:22.967 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:22.967 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.967 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.967 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.968 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:22.968 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.968 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.968 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.968 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:22.968 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.968 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.968 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.969 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_destination": { 2023-08-10T12:05:22.969 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_destination", 2023-08-10T12:05:22.969 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.969 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.969 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.969 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.969 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.970 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.970 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.970 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Email address to send alerts to", 2023-08-10T12:05:22.970 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.970 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.970 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.970 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_from_name": { 2023-08-10T12:05:22.971 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_from_name", 2023-08-10T12:05:22.971 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.971 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.971 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.971 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "Ceph", 2023-08-10T12:05:22.971 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.971 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.971 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.972 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Email From: name", 2023-08-10T12:05:22.972 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.972 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.972 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.972 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_host": { 2023-08-10T12:05:22.972 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_host", 2023-08-10T12:05:22.972 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.973 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.973 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.973 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.973 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.973 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.973 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.973 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP server", 2023-08-10T12:05:22.974 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.974 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.974 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.974 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_password": { 2023-08-10T12:05:22.974 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_password", 2023-08-10T12:05:22.974 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.974 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.975 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.975 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.975 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.975 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.975 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.975 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Password to authenticate with", 2023-08-10T12:05:22.975 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.975 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.976 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.976 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_port": { 2023-08-10T12:05:22.976 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_port", 2023-08-10T12:05:22.976 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:22.976 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.976 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.976 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "465", 2023-08-10T12:05:22.977 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.977 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.977 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.977 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP port", 2023-08-10T12:05:22.977 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.977 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.977 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.978 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_sender": { 2023-08-10T12:05:22.978 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_sender", 2023-08-10T12:05:22.978 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.978 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.978 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.978 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.978 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.979 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.979 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.979 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP envelope sender", 2023-08-10T12:05:22.979 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.979 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.979 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.979 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_ssl": { 2023-08-10T12:05:22.980 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_ssl", 2023-08-10T12:05:22.980 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.980 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.980 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.980 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.980 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.980 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.980 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.981 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use SSL to connect to SMTP server", 2023-08-10T12:05:22.981 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.981 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.981 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.981 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_user": { 2023-08-10T12:05:22.981 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_user", 2023-08-10T12:05:22.981 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.982 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.982 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.982 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.982 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.982 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.982 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.982 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "User to authenticate as", 2023-08-10T12:05:22.982 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.983 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.983 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.983 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.983 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:22.983 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.983 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:22.983 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "balancer", 2023-08-10T12:05:22.983 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:22.984 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:22.984 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:22.984 INFO:teuthology.orchestra.run.smithi073.stdout: "active": { 2023-08-10T12:05:22.984 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "active", 2023-08-10T12:05:22.984 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:22.984 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.984 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.985 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:22.985 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.985 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.985 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.985 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "automatically balance PGs across cluster", 2023-08-10T12:05:22.985 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.985 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.985 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.986 INFO:teuthology.orchestra.run.smithi073.stdout: "begin_time": { 2023-08-10T12:05:22.986 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "begin_time", 2023-08-10T12:05:22.986 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.986 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.986 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.986 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0000", 2023-08-10T12:05:22.986 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.987 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.987 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.987 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "beginning time of day to automatically balance", 2023-08-10T12:05:22.987 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-08-10T12:05:22.987 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.987 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.987 INFO:teuthology.orchestra.run.smithi073.stdout: "begin_weekday": { 2023-08-10T12:05:22.988 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "begin_weekday", 2023-08-10T12:05:22.988 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2023-08-10T12:05:22.988 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.988 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.988 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2023-08-10T12:05:22.988 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0", 2023-08-10T12:05:22.988 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "6", 2023-08-10T12:05:22.988 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.989 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-08-10T12:05:22.989 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-08-10T12:05:22.989 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.989 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.989 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_max_iterations": { 2023-08-10T12:05:22.989 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_max_iterations", 2023-08-10T12:05:22.989 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2023-08-10T12:05:22.990 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.990 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.990 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "25", 2023-08-10T12:05:22.990 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2023-08-10T12:05:22.990 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "250", 2023-08-10T12:05:22.990 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.990 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-08-10T12:05:22.990 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:22.991 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.991 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.991 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_metrics": { 2023-08-10T12:05:22.991 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_metrics", 2023-08-10T12:05:22.991 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.991 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.991 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.992 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "pgs,objects,bytes", 2023-08-10T12:05:22.992 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.992 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.992 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.992 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-08-10T12:05:22.992 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-08-10T12:05:22.992 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.993 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.993 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_step": { 2023-08-10T12:05:22.993 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_step", 2023-08-10T12:05:22.993 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-08-10T12:05:22.993 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.993 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.993 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0.5", 2023-08-10T12:05:22.994 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0.001", 2023-08-10T12:05:22.994 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "0.999", 2023-08-10T12:05:22.994 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.994 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "aggressiveness of optimization", 2023-08-10T12:05:22.994 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-08-10T12:05:22.994 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.994 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.995 INFO:teuthology.orchestra.run.smithi073.stdout: "end_time": { 2023-08-10T12:05:22.995 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "end_time", 2023-08-10T12:05:22.995 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.995 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.995 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.995 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "2359", 2023-08-10T12:05:22.995 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.995 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.996 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.996 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "ending time of day to automatically balance", 2023-08-10T12:05:22.996 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-08-10T12:05:22.996 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.996 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.996 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.996 INFO:teuthology.orchestra.run.smithi073.stdout: "end_weekday": { 2023-08-10T12:05:22.996 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "end_weekday", 2023-08-10T12:05:22.997 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2023-08-10T12:05:22.997 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.997 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.997 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2023-08-10T12:05:22.997 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0", 2023-08-10T12:05:22.997 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "6", 2023-08-10T12:05:22.997 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:22.997 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-08-10T12:05:22.998 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-08-10T12:05:22.998 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:22.998 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:22.998 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:22.998 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:22.998 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:22.998 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:22.998 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:22.999 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:22.999 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:22.999 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:22.999 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:22.999 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:22.999 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:22.999 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:22.999 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.000 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.000 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.000 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.000 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.000 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.000 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.000 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.000 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.001 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.001 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.001 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.001 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.001 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.001 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.001 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.002 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.002 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.002 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.002 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.002 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.002 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.002 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.003 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.003 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.003 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.003 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.003 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.003 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.003 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.003 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.004 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.004 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.004 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.004 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.004 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.004 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.004 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.005 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.005 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.005 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.005 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.005 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.005 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.005 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.006 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.006 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.006 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.006 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.006 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.006 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.006 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.006 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.007 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.007 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.007 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.008 INFO:teuthology.orchestra.run.smithi073.stdout: "min_score": { 2023-08-10T12:05:23.008 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "min_score", 2023-08-10T12:05:23.008 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-08-10T12:05:23.008 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.008 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.008 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2023-08-10T12:05:23.008 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.009 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.009 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.009 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-08-10T12:05:23.009 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.009 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.009 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.009 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.009 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": { 2023-08-10T12:05:23.010 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mode", 2023-08-10T12:05:23.010 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.010 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.010 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.010 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "upmap", 2023-08-10T12:05:23.010 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.010 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.011 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.011 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-compat", 2023-08-10T12:05:23.011 INFO:teuthology.orchestra.run.smithi073.stdout: "none", 2023-08-10T12:05:23.011 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap" 2023-08-10T12:05:23.011 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.011 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Balancer mode", 2023-08-10T12:05:23.011 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.012 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.012 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.012 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_ids": { 2023-08-10T12:05:23.012 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pool_ids", 2023-08-10T12:05:23.012 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.012 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.013 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.013 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.013 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.013 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.013 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.013 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-08-10T12:05:23.013 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.013 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.014 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.014 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.014 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2023-08-10T12:05:23.014 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2023-08-10T12:05:23.014 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:23.014 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.014 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.014 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2023-08-10T12:05:23.015 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.015 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.015 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.015 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-08-10T12:05:23.015 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.015 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.015 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.016 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.016 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap_max_deviation": { 2023-08-10T12:05:23.016 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "upmap_max_deviation", 2023-08-10T12:05:23.016 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.016 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.016 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.017 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2023-08-10T12:05:23.017 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2023-08-10T12:05:23.017 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.017 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.017 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "deviation below which no optimization is attempted", 2023-08-10T12:05:23.017 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-08-10T12:05:23.017 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.018 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.018 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap_max_optimizations": { 2023-08-10T12:05:23.018 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "upmap_max_optimizations", 2023-08-10T12:05:23.018 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2023-08-10T12:05:23.018 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.019 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.019 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-08-10T12:05:23.019 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.019 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.019 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.019 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-08-10T12:05:23.019 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.020 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.020 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.020 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.020 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.020 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.020 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.021 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cephadm", 2023-08-10T12:05:23.021 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.021 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.021 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.021 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_down_multiplier": { 2023-08-10T12:05:23.021 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_down_multiplier", 2023-08-10T12:05:23.021 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-08-10T12:05:23.022 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.022 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.022 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3.0", 2023-08-10T12:05:23.022 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.022 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.022 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.023 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-08-10T12:05:23.023 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.023 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.023 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.023 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_refresh_rate": { 2023-08-10T12:05:23.023 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_refresh_rate", 2023-08-10T12:05:23.024 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:23.024 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.024 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.024 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "20", 2023-08-10T12:05:23.024 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.024 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.025 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.025 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-08-10T12:05:23.025 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.025 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.025 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.026 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_starting_port": { 2023-08-10T12:05:23.026 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_starting_port", 2023-08-10T12:05:23.026 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.026 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.026 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.026 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "4721", 2023-08-10T12:05:23.027 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.027 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.027 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.027 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-08-10T12:05:23.027 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.027 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.027 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.028 INFO:teuthology.orchestra.run.smithi073.stdout: "alertmanager_web_password": { 2023-08-10T12:05:23.028 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "alertmanager_web_password", 2023-08-10T12:05:23.028 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.028 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.028 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.028 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2023-08-10T12:05:23.028 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.029 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.029 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.029 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Alertmanager web password", 2023-08-10T12:05:23.029 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.029 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.029 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.029 INFO:teuthology.orchestra.run.smithi073.stdout: "alertmanager_web_user": { 2023-08-10T12:05:23.030 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "alertmanager_web_user", 2023-08-10T12:05:23.030 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.030 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.030 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.030 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2023-08-10T12:05:23.030 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.030 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.030 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.031 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Alertmanager web user", 2023-08-10T12:05:23.031 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.031 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.031 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.031 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_ptrace": { 2023-08-10T12:05:23.031 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_ptrace", 2023-08-10T12:05:23.031 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.032 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.032 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.032 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.032 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.032 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.032 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.032 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-08-10T12:05:23.033 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-08-10T12:05:23.033 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.033 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.033 INFO:teuthology.orchestra.run.smithi073.stdout: "autotune_interval": { 2023-08-10T12:05:23.033 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "autotune_interval", 2023-08-10T12:05:23.033 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:23.034 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.034 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.034 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2023-08-10T12:05:23.034 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.034 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.034 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.034 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to autotune daemon memory", 2023-08-10T12:05:23.035 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.035 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.035 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.035 INFO:teuthology.orchestra.run.smithi073.stdout: "autotune_memory_target_ratio": { 2023-08-10T12:05:23.036 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "autotune_memory_target_ratio", 2023-08-10T12:05:23.036 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-08-10T12:05:23.036 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.036 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.036 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0.7", 2023-08-10T12:05:23.036 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.036 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.037 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.037 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-08-10T12:05:23.037 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.037 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.037 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.037 INFO:teuthology.orchestra.run.smithi073.stdout: "cgroups_split": { 2023-08-10T12:05:23.037 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cgroups_split", 2023-08-10T12:05:23.038 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.038 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.038 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.038 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.038 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.038 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.038 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.038 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-08-10T12:05:23.039 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.039 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.039 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.039 INFO:teuthology.orchestra.run.smithi073.stdout: "config_checks_enabled": { 2023-08-10T12:05:23.039 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_checks_enabled", 2023-08-10T12:05:23.040 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.040 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.040 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.040 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.040 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.040 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.040 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.041 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-08-10T12:05:23.041 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.041 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.041 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.041 INFO:teuthology.orchestra.run.smithi073.stdout: "config_dashboard": { 2023-08-10T12:05:23.041 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_dashboard", 2023-08-10T12:05:23.041 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.042 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.042 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.042 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.042 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.042 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.042 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.042 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-08-10T12:05:23.043 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.043 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.043 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.043 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_alertmanager": { 2023-08-10T12:05:23.043 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_alertmanager", 2023-08-10T12:05:23.043 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.043 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.044 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.044 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-08-10T12:05:23.044 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.044 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.044 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.044 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2023-08-10T12:05:23.044 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.045 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.045 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.045 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_base": { 2023-08-10T12:05:23.045 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_base", 2023-08-10T12:05:23.045 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.045 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.045 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.046 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/ceph", 2023-08-10T12:05:23.046 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.046 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.046 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.046 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Container image name, without the tag", 2023-08-10T12:05:23.046 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.046 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.046 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.047 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_elasticsearch": { 2023-08-10T12:05:23.047 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_elasticsearch", 2023-08-10T12:05:23.047 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.047 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.047 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.047 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-08-10T12:05:23.047 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.048 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.048 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.048 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "elasticsearch container image", 2023-08-10T12:05:23.048 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.048 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.048 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.049 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_grafana": { 2023-08-10T12:05:23.049 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_grafana", 2023-08-10T12:05:23.049 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.049 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.049 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.049 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-08-10T12:05:23.049 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.050 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.050 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.050 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2023-08-10T12:05:23.050 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.050 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.050 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.050 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_haproxy": { 2023-08-10T12:05:23.051 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_haproxy", 2023-08-10T12:05:23.051 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.051 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.051 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.051 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-08-10T12:05:23.051 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.051 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.051 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.052 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "HAproxy container image", 2023-08-10T12:05:23.052 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.052 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.052 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.052 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_agent": { 2023-08-10T12:05:23.052 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_agent", 2023-08-10T12:05:23.053 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.053 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.053 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.053 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-08-10T12:05:23.053 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.053 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.053 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.053 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger agent container image", 2023-08-10T12:05:23.054 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.054 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.054 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.054 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_collector": { 2023-08-10T12:05:23.054 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_collector", 2023-08-10T12:05:23.054 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.054 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.055 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.055 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-08-10T12:05:23.055 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.055 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.055 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.055 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger collector container image", 2023-08-10T12:05:23.055 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.055 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.056 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.056 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_query": { 2023-08-10T12:05:23.056 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_query", 2023-08-10T12:05:23.056 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.056 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.056 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.057 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-08-10T12:05:23.057 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.057 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.057 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.057 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger query container image", 2023-08-10T12:05:23.057 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.057 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.057 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.058 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_keepalived": { 2023-08-10T12:05:23.058 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_keepalived", 2023-08-10T12:05:23.058 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.058 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.058 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.058 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-08-10T12:05:23.059 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.059 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.059 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.059 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Keepalived container image", 2023-08-10T12:05:23.059 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.059 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.059 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.060 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_loki": { 2023-08-10T12:05:23.060 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_loki", 2023-08-10T12:05:23.060 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.060 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.060 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.060 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-08-10T12:05:23.060 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.061 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.061 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.061 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Loki container image", 2023-08-10T12:05:23.061 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.061 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.061 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.061 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_node_exporter": { 2023-08-10T12:05:23.062 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_node_exporter", 2023-08-10T12:05:23.062 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.062 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.062 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.062 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-08-10T12:05:23.062 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.062 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.062 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.063 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2023-08-10T12:05:23.063 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.063 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.063 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.063 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_prometheus": { 2023-08-10T12:05:23.063 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_prometheus", 2023-08-10T12:05:23.064 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.064 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.064 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.064 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-08-10T12:05:23.064 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.064 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.064 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.064 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2023-08-10T12:05:23.065 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.065 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.065 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.065 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_promtail": { 2023-08-10T12:05:23.065 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_promtail", 2023-08-10T12:05:23.065 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.066 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.066 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.066 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-08-10T12:05:23.066 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.066 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.066 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.066 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Promtail container image", 2023-08-10T12:05:23.066 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.067 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.067 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.067 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_snmp_gateway": { 2023-08-10T12:05:23.067 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_snmp_gateway", 2023-08-10T12:05:23.067 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.067 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.067 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.068 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-08-10T12:05:23.068 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.068 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.068 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.068 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SNMP Gateway container image", 2023-08-10T12:05:23.068 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.068 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.069 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.069 INFO:teuthology.orchestra.run.smithi073.stdout: "container_init": { 2023-08-10T12:05:23.069 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_init", 2023-08-10T12:05:23.069 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.069 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.069 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.069 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.070 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.070 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.070 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.070 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Run podman/docker with `--init`", 2023-08-10T12:05:23.070 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.070 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.070 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.071 INFO:teuthology.orchestra.run.smithi073.stdout: "daemon_cache_timeout": { 2023-08-10T12:05:23.071 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "daemon_cache_timeout", 2023-08-10T12:05:23.071 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:23.071 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.071 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.071 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2023-08-10T12:05:23.072 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.072 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.072 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.072 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-08-10T12:05:23.072 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.072 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.072 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.073 INFO:teuthology.orchestra.run.smithi073.stdout: "default_cephadm_command_timeout": { 2023-08-10T12:05:23.073 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "default_cephadm_command_timeout", 2023-08-10T12:05:23.073 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:23.073 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.073 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.073 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "900", 2023-08-10T12:05:23.073 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.073 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.074 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.074 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-08-10T12:05:23.074 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.074 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.074 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.074 INFO:teuthology.orchestra.run.smithi073.stdout: "default_registry": { 2023-08-10T12:05:23.074 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "default_registry", 2023-08-10T12:05:23.075 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.075 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.075 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.075 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io", 2023-08-10T12:05:23.075 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.075 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.075 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.076 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-08-10T12:05:23.076 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.076 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.076 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.076 INFO:teuthology.orchestra.run.smithi073.stdout: "device_cache_timeout": { 2023-08-10T12:05:23.076 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_cache_timeout", 2023-08-10T12:05:23.076 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:23.077 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.077 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.077 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1800", 2023-08-10T12:05:23.077 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.077 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.077 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.077 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache device inventory", 2023-08-10T12:05:23.077 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.078 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.078 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.078 INFO:teuthology.orchestra.run.smithi073.stdout: "device_enhanced_scan": { 2023-08-10T12:05:23.078 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_enhanced_scan", 2023-08-10T12:05:23.078 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.078 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.078 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.079 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.079 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.079 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.079 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.079 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use libstoragemgmt during device scans", 2023-08-10T12:05:23.079 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.079 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.079 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.080 INFO:teuthology.orchestra.run.smithi073.stdout: "facts_cache_timeout": { 2023-08-10T12:05:23.080 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "facts_cache_timeout", 2023-08-10T12:05:23.080 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:23.080 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.080 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.080 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2023-08-10T12:05:23.081 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.081 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.081 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.081 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache host facts data", 2023-08-10T12:05:23.081 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.081 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.081 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.082 INFO:teuthology.orchestra.run.smithi073.stdout: "host_check_interval": { 2023-08-10T12:05:23.082 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "host_check_interval", 2023-08-10T12:05:23.082 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:23.082 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.082 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.082 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2023-08-10T12:05:23.082 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.082 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.083 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.083 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to perform a host check", 2023-08-10T12:05:23.083 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.083 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.083 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.083 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.083 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.084 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.084 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.084 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.084 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.084 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.084 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.084 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.084 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.085 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.085 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.085 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.085 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.085 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.085 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.085 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.085 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.086 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.086 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.086 INFO:teuthology.orchestra.run.smithi073.stdout: "log_refresh_metadata": { 2023-08-10T12:05:23.086 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_refresh_metadata", 2023-08-10T12:05:23.086 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.086 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.087 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.087 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.087 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.087 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.087 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.087 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-08-10T12:05:23.087 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.087 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.088 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.088 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.088 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.088 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.088 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.088 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.088 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.089 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.089 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.089 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.089 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-08-10T12:05:23.089 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.089 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.089 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.090 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.090 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.090 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.090 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.090 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.090 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.090 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.091 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.091 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.091 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.091 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.091 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.091 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.091 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.091 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.092 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.092 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.092 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.092 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.092 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.092 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.092 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.093 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.093 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.093 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.093 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.093 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.093 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.093 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.094 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.094 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.094 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.094 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.094 INFO:teuthology.orchestra.run.smithi073.stdout: "manage_etc_ceph_ceph_conf": { 2023-08-10T12:05:23.094 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-08-10T12:05:23.094 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.095 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.095 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.095 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.095 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.095 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.095 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.095 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-08-10T12:05:23.095 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.096 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.096 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.096 INFO:teuthology.orchestra.run.smithi073.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-08-10T12:05:23.096 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-08-10T12:05:23.096 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.096 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.096 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.097 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "*", 2023-08-10T12:05:23.097 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.097 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.097 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.097 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-08-10T12:05:23.097 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.097 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.098 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.098 INFO:teuthology.orchestra.run.smithi073.stdout: "max_count_per_host": { 2023-08-10T12:05:23.098 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_count_per_host", 2023-08-10T12:05:23.098 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.098 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.098 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.098 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-08-10T12:05:23.099 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.099 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.099 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.099 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "max number of daemons per service per host", 2023-08-10T12:05:23.099 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.099 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.099 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.100 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd_draining_count": { 2023-08-10T12:05:23.100 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_osd_draining_count", 2023-08-10T12:05:23.100 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.100 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.100 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.100 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-08-10T12:05:23.100 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.100 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.101 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.101 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-08-10T12:05:23.101 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.101 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.101 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.101 INFO:teuthology.orchestra.run.smithi073.stdout: "migration_current": { 2023-08-10T12:05:23.101 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "migration_current", 2023-08-10T12:05:23.102 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.102 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.102 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.102 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.102 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.102 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.102 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.103 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "internal - do not modify", 2023-08-10T12:05:23.103 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.103 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.103 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.103 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": { 2023-08-10T12:05:23.103 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mode", 2023-08-10T12:05:23.103 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.104 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.104 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.104 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "root", 2023-08-10T12:05:23.104 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.104 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.104 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.104 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm-package", 2023-08-10T12:05:23.104 INFO:teuthology.orchestra.run.smithi073.stdout: "root" 2023-08-10T12:05:23.105 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.105 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "mode for remote execution of cephadm", 2023-08-10T12:05:23.105 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.105 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.105 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.105 INFO:teuthology.orchestra.run.smithi073.stdout: "prometheus_alerts_path": { 2023-08-10T12:05:23.105 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus_alerts_path", 2023-08-10T12:05:23.106 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.106 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.106 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.106 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-08-10T12:05:23.106 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.106 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.106 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.106 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-08-10T12:05:23.107 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.107 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.107 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.107 INFO:teuthology.orchestra.run.smithi073.stdout: "prometheus_web_password": { 2023-08-10T12:05:23.107 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus_web_password", 2023-08-10T12:05:23.107 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.107 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.108 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.108 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2023-08-10T12:05:23.108 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.108 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.108 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.108 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus web password", 2023-08-10T12:05:23.108 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.108 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.109 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.109 INFO:teuthology.orchestra.run.smithi073.stdout: "prometheus_web_user": { 2023-08-10T12:05:23.109 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus_web_user", 2023-08-10T12:05:23.109 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.109 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.109 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.110 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2023-08-10T12:05:23.110 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.110 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.110 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.110 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus web user", 2023-08-10T12:05:23.110 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.110 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.110 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.111 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_insecure": { 2023-08-10T12:05:23.111 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_insecure", 2023-08-10T12:05:23.111 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.111 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.111 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.111 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.111 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.112 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.112 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.112 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-08-10T12:05:23.112 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.112 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.112 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.112 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_password": { 2023-08-10T12:05:23.113 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_password", 2023-08-10T12:05:23.113 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.113 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.113 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.113 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.113 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.113 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.113 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.114 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-08-10T12:05:23.114 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.114 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.114 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.114 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_url": { 2023-08-10T12:05:23.114 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_url", 2023-08-10T12:05:23.114 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.115 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.115 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.115 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.115 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.115 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.115 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.115 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-08-10T12:05:23.116 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.116 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.116 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.116 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_username": { 2023-08-10T12:05:23.116 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_username", 2023-08-10T12:05:23.116 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.116 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.117 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.117 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.117 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.117 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.117 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.117 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-08-10T12:05:23.117 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.117 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.118 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.118 INFO:teuthology.orchestra.run.smithi073.stdout: "secure_monitoring_stack": { 2023-08-10T12:05:23.118 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "secure_monitoring_stack", 2023-08-10T12:05:23.118 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.118 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.118 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.118 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.119 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.119 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.119 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.119 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-08-10T12:05:23.119 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.119 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.119 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.120 INFO:teuthology.orchestra.run.smithi073.stdout: "service_discovery_port": { 2023-08-10T12:05:23.120 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "service_discovery_port", 2023-08-10T12:05:23.120 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.120 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.120 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.120 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8765", 2023-08-10T12:05:23.120 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.121 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.121 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.121 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "cephadm service discovery port", 2023-08-10T12:05:23.121 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.121 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.121 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.121 INFO:teuthology.orchestra.run.smithi073.stdout: "ssh_config_file": { 2023-08-10T12:05:23.122 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssh_config_file", 2023-08-10T12:05:23.122 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.122 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.122 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.122 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.122 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.122 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.122 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.123 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-08-10T12:05:23.123 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.123 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.123 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.123 INFO:teuthology.orchestra.run.smithi073.stdout: "use_agent": { 2023-08-10T12:05:23.123 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "use_agent", 2023-08-10T12:05:23.123 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.124 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.124 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.124 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.124 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.124 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.124 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.124 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-08-10T12:05:23.125 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.125 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.125 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.125 INFO:teuthology.orchestra.run.smithi073.stdout: "use_repo_digest": { 2023-08-10T12:05:23.125 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "use_repo_digest", 2023-08-10T12:05:23.125 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.125 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.126 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.126 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.126 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.126 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.126 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.126 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-08-10T12:05:23.126 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.126 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.127 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.127 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_failed_host_check": { 2023-08-10T12:05:23.127 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_failed_host_check", 2023-08-10T12:05:23.127 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.127 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.127 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.128 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.128 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.128 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.128 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.128 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if the host check fails", 2023-08-10T12:05:23.128 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.128 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.128 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.129 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_stray_daemons": { 2023-08-10T12:05:23.129 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_stray_daemons", 2023-08-10T12:05:23.129 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.129 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.129 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.129 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.129 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.130 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.130 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.130 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-08-10T12:05:23.130 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.130 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.130 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.131 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_stray_hosts": { 2023-08-10T12:05:23.131 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_stray_hosts", 2023-08-10T12:05:23.131 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.131 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.131 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.131 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.131 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.131 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.132 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.132 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-08-10T12:05:23.132 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.132 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.132 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.132 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.132 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.133 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crash", 2023-08-10T12:05:23.133 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.133 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.133 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.133 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.134 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.134 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.134 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.134 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.134 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.134 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.134 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.134 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.135 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.135 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.135 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.135 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.135 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.135 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.135 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.135 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.136 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.136 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.136 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.136 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.136 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.136 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.136 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.137 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.137 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.137 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.137 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.137 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.137 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.137 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.138 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.138 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.138 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.138 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.138 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.138 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.138 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.139 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.139 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.139 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.139 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.139 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.139 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.139 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.139 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.140 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.140 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.140 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.140 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.140 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.140 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.140 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.141 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.141 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.141 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.141 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.141 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.141 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.141 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.142 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.142 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.142 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.142 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.142 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.142 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.142 INFO:teuthology.orchestra.run.smithi073.stdout: "retain_interval": { 2023-08-10T12:05:23.143 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "retain_interval", 2023-08-10T12:05:23.143 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:23.143 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.143 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.143 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "31536000", 2023-08-10T12:05:23.143 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.143 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.143 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.144 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long to retain crashes before pruning them", 2023-08-10T12:05:23.144 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.144 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.144 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.144 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_recent_interval": { 2023-08-10T12:05:23.144 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_recent_interval", 2023-08-10T12:05:23.145 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:23.145 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.145 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.145 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1209600", 2023-08-10T12:05:23.145 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.145 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.145 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.145 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "time interval in which to warn about recent crashes", 2023-08-10T12:05:23.146 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.146 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.146 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.146 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.146 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.146 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "dashboard", 2023-08-10T12:05:23.147 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.147 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.147 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.147 INFO:teuthology.orchestra.run.smithi073.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-08-10T12:05:23.147 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-08-10T12:05:23.147 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.147 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.147 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.148 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-08-10T12:05:23.148 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.148 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.148 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.148 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.148 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.148 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.148 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.149 INFO:teuthology.orchestra.run.smithi073.stdout: "ALERTMANAGER_API_HOST": { 2023-08-10T12:05:23.149 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ALERTMANAGER_API_HOST", 2023-08-10T12:05:23.149 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.149 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.149 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.149 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.149 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.150 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.150 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.150 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.150 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.150 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.150 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.151 INFO:teuthology.orchestra.run.smithi073.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-08-10T12:05:23.151 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-08-10T12:05:23.151 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.151 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.151 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.151 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.151 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.151 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.152 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.152 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.152 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.152 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.152 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.152 INFO:teuthology.orchestra.run.smithi073.stdout: "AUDIT_API_ENABLED": { 2023-08-10T12:05:23.153 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "AUDIT_API_ENABLED", 2023-08-10T12:05:23.153 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.153 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.153 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.153 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.153 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.153 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.153 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.154 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.154 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.154 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.154 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.154 INFO:teuthology.orchestra.run.smithi073.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-08-10T12:05:23.154 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-08-10T12:05:23.154 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.155 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.155 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.155 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.155 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.155 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.155 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.155 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.155 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.156 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.156 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.156 INFO:teuthology.orchestra.run.smithi073.stdout: "ENABLE_BROWSABLE_API": { 2023-08-10T12:05:23.156 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ENABLE_BROWSABLE_API", 2023-08-10T12:05:23.156 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.156 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.157 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.157 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.157 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.157 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.157 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.157 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.157 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.157 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.158 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.158 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-08-10T12:05:23.158 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-08-10T12:05:23.158 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.158 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.158 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.158 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.159 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.159 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.159 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.159 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.159 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.159 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.159 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.160 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-08-10T12:05:23.160 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-08-10T12:05:23.160 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.160 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.160 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.160 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.160 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.160 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.161 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.161 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.161 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.161 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.161 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.161 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-08-10T12:05:23.162 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-08-10T12:05:23.162 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.162 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.162 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.162 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.162 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.162 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.162 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.163 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.163 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.163 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.163 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.163 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-08-10T12:05:23.163 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-08-10T12:05:23.163 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.164 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.164 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.164 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.164 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.164 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.164 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.164 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.164 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.165 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.165 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.165 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_NFS": { 2023-08-10T12:05:23.165 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-08-10T12:05:23.165 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.165 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.165 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.166 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.166 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.166 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.166 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.166 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.166 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.166 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.166 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.167 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_RBD": { 2023-08-10T12:05:23.167 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-08-10T12:05:23.167 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.167 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.167 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.167 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.167 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.168 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.168 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.168 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.168 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.168 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.168 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.169 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_RGW": { 2023-08-10T12:05:23.169 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-08-10T12:05:23.169 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.169 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.169 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.169 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.169 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.169 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.170 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.170 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.170 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.170 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.170 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.170 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.170 INFO:teuthology.orchestra.run.smithi073.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-08-10T12:05:23.170 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-08-10T12:05:23.171 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.171 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.171 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.171 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.171 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.171 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.171 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.171 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.172 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.172 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.172 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.172 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_PASSWORD": { 2023-08-10T12:05:23.172 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_PASSWORD", 2023-08-10T12:05:23.172 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.173 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.173 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.173 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2023-08-10T12:05:23.173 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.173 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.173 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.173 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.173 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.174 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.174 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.174 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-08-10T12:05:23.174 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-08-10T12:05:23.174 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.174 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.174 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.175 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.175 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.175 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.175 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.175 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.175 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.175 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.175 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.176 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.176 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_URL": { 2023-08-10T12:05:23.176 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_URL", 2023-08-10T12:05:23.176 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.176 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.176 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.176 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.176 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.177 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.177 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.177 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.177 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.177 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.177 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.178 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_USERNAME": { 2023-08-10T12:05:23.178 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_USERNAME", 2023-08-10T12:05:23.178 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.178 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.178 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.178 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2023-08-10T12:05:23.178 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.178 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.179 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.179 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.179 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.179 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.179 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.180 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-08-10T12:05:23.180 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-08-10T12:05:23.180 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.180 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.180 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.180 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.180 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.181 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.181 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.181 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.181 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.181 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.181 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.182 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-08-10T12:05:23.182 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-08-10T12:05:23.182 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.182 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.182 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.182 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.182 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.183 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.183 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.183 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.183 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.184 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.184 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.184 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.184 INFO:teuthology.orchestra.run.smithi073.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-08-10T12:05:23.184 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-08-10T12:05:23.185 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.185 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.185 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.185 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.185 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.185 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.185 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.186 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.186 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.186 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.186 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.186 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.186 INFO:teuthology.orchestra.run.smithi073.stdout: "ISSUE_TRACKER_API_KEY": { 2023-08-10T12:05:23.186 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-08-10T12:05:23.187 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.187 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.187 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.187 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.187 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.187 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.187 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.187 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.188 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.188 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.188 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.188 INFO:teuthology.orchestra.run.smithi073.stdout: "PROMETHEUS_API_HOST": { 2023-08-10T12:05:23.188 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PROMETHEUS_API_HOST", 2023-08-10T12:05:23.188 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.189 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.189 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.189 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.189 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.189 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.189 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.189 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.190 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.190 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.190 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.190 INFO:teuthology.orchestra.run.smithi073.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-08-10T12:05:23.190 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-08-10T12:05:23.190 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.190 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.191 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.191 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.191 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.191 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.191 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.191 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.191 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.191 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.192 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.192 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-08-10T12:05:23.192 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-08-10T12:05:23.192 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.192 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.192 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.193 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.193 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.193 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.193 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.193 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.193 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.193 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.193 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.194 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-08-10T12:05:23.194 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-08-10T12:05:23.194 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.194 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.194 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.194 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.194 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.195 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.195 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.195 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.195 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.195 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.195 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.195 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.195 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-08-10T12:05:23.196 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-08-10T12:05:23.196 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.196 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.196 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.196 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.196 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.196 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.197 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.197 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.197 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.197 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.197 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.197 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.198 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-08-10T12:05:23.198 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-08-10T12:05:23.198 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.199 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.199 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.199 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.199 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.200 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.200 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.200 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.200 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.201 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.201 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.201 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.201 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-08-10T12:05:23.202 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-08-10T12:05:23.202 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.202 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.203 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.203 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.203 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.203 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.204 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.204 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.204 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.204 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.205 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.205 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.205 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-08-10T12:05:23.205 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-08-10T12:05:23.206 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.206 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.206 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.207 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.207 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.207 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.207 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.208 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.208 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.208 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.208 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.209 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.209 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-08-10T12:05:23.209 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-08-10T12:05:23.210 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.210 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.210 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.210 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.211 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.211 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.211 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.211 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.212 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.212 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.212 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.213 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_ENABLED": { 2023-08-10T12:05:23.213 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_ENABLED", 2023-08-10T12:05:23.213 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.213 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.214 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.214 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.214 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.214 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.215 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.215 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.215 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.216 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.216 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.216 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-08-10T12:05:23.217 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-08-10T12:05:23.217 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.217 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.217 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.218 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-08-10T12:05:23.218 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.218 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.218 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.219 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.219 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.219 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.220 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.220 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.220 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-08-10T12:05:23.220 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-08-10T12:05:23.220 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.221 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.221 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.221 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-08-10T12:05:23.221 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.222 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.222 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.222 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.222 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.223 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.223 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.224 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-08-10T12:05:23.224 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-08-10T12:05:23.224 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.225 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.225 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.225 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8", 2023-08-10T12:05:23.225 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.226 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.226 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.226 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.227 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.227 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.227 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.228 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.228 INFO:teuthology.orchestra.run.smithi073.stdout: "REST_REQUESTS_TIMEOUT": { 2023-08-10T12:05:23.228 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-08-10T12:05:23.229 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.229 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.229 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.229 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "45", 2023-08-10T12:05:23.230 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.230 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.230 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.230 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.231 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.231 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.231 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.231 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.232 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_ACCESS_KEY": { 2023-08-10T12:05:23.232 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_ACCESS_KEY", 2023-08-10T12:05:23.232 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.232 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.233 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.233 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.233 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.233 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.233 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.234 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.234 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.234 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.234 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.235 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.235 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-08-10T12:05:23.235 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-08-10T12:05:23.235 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.236 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.236 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.236 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2023-08-10T12:05:23.236 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.237 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.237 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.237 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.238 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.238 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.238 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.239 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_SECRET_KEY": { 2023-08-10T12:05:23.239 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_SECRET_KEY", 2023-08-10T12:05:23.239 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.239 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.240 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.240 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.240 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.241 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.241 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.241 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.242 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.242 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.242 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.242 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.243 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_SSL_VERIFY": { 2023-08-10T12:05:23.243 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_SSL_VERIFY", 2023-08-10T12:05:23.243 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.244 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.244 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.244 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.244 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.245 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.245 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.245 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.245 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.245 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.245 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.245 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.246 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-08-10T12:05:23.246 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-08-10T12:05:23.246 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.246 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.246 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.246 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2023-08-10T12:05:23.247 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.247 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.247 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.247 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.247 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.247 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.247 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.248 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.248 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-08-10T12:05:23.248 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-08-10T12:05:23.248 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.248 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.248 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.248 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-08-10T12:05:23.249 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.249 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.249 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.249 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.249 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.249 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.249 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.249 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.250 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-08-10T12:05:23.250 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-08-10T12:05:23.250 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.250 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.250 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.250 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2023-08-10T12:05:23.250 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.251 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.251 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.251 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.251 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.251 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.251 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.251 INFO:teuthology.orchestra.run.smithi073.stdout: "cross_origin_url": { 2023-08-10T12:05:23.252 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cross_origin_url", 2023-08-10T12:05:23.252 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.252 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.252 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.252 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.252 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.252 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.253 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.253 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.253 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.253 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.253 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.253 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.253 INFO:teuthology.orchestra.run.smithi073.stdout: "crt_file": { 2023-08-10T12:05:23.253 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crt_file", 2023-08-10T12:05:23.254 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.254 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.254 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.254 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.254 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.254 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.254 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.255 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.255 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.255 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.255 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.255 INFO:teuthology.orchestra.run.smithi073.stdout: "debug": { 2023-08-10T12:05:23.255 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "debug", 2023-08-10T12:05:23.255 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.256 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.256 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.256 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.256 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.256 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.256 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.256 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable/disable debug options", 2023-08-10T12:05:23.257 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.257 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.257 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.257 INFO:teuthology.orchestra.run.smithi073.stdout: "jwt_token_ttl": { 2023-08-10T12:05:23.257 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "jwt_token_ttl", 2023-08-10T12:05:23.257 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.257 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.258 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.258 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "28800", 2023-08-10T12:05:23.258 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.258 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.258 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.258 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.258 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.258 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.259 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.259 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.259 INFO:teuthology.orchestra.run.smithi073.stdout: "key_file": { 2023-08-10T12:05:23.259 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "key_file", 2023-08-10T12:05:23.259 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.259 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.259 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.259 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.260 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.260 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.260 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.260 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.260 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.260 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.261 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.261 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.261 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.261 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.261 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.261 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.261 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.261 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.262 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.262 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.262 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.262 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.262 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.262 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.262 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.263 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.263 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.263 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.263 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.263 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.263 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.263 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.263 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.264 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.264 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.264 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.264 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.264 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.264 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.264 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.265 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.265 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.265 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.265 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.265 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.265 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.265 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.265 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.266 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.266 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.266 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.266 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.266 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.266 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.266 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.266 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.267 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.267 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.267 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.267 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.267 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.267 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.267 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.268 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.268 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.268 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.268 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.268 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.269 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.269 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.269 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.269 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.269 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.269 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.270 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.270 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.270 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.270 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.271 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.271 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.272 INFO:teuthology.orchestra.run.smithi073.stdout: "motd": { 2023-08-10T12:05:23.272 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "motd", 2023-08-10T12:05:23.272 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.273 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.273 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.273 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.274 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.274 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.274 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.274 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "The message of the day", 2023-08-10T12:05:23.275 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.275 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.275 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.275 INFO:teuthology.orchestra.run.smithi073.stdout: "redirect_resolve_ip_addr": { 2023-08-10T12:05:23.275 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "redirect_resolve_ip_addr", 2023-08-10T12:05:23.275 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.275 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.276 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.276 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.276 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.276 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.276 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.276 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.276 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.277 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.277 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.277 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2023-08-10T12:05:23.277 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2023-08-10T12:05:23.277 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.277 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.277 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.278 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "::", 2023-08-10T12:05:23.278 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.278 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.278 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.278 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.278 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.278 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.279 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.279 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2023-08-10T12:05:23.279 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2023-08-10T12:05:23.279 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.279 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.279 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.279 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8080", 2023-08-10T12:05:23.280 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.280 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.280 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.280 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.280 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.280 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.280 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.281 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl": { 2023-08-10T12:05:23.281 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl", 2023-08-10T12:05:23.281 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.281 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.281 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.281 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.281 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.282 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.282 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.282 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.282 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.282 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.282 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.282 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.282 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl_server_port": { 2023-08-10T12:05:23.283 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl_server_port", 2023-08-10T12:05:23.283 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.283 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.283 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.283 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8443", 2023-08-10T12:05:23.283 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.283 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.284 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.284 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.284 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.284 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.284 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.284 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.284 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_behaviour": { 2023-08-10T12:05:23.285 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_behaviour", 2023-08-10T12:05:23.285 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.285 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.285 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.285 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "redirect", 2023-08-10T12:05:23.285 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.285 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.285 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.286 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.286 INFO:teuthology.orchestra.run.smithi073.stdout: "redirect" 2023-08-10T12:05:23.286 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.286 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.286 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.286 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.286 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.286 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.287 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_error_status_code": { 2023-08-10T12:05:23.287 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_error_status_code", 2023-08-10T12:05:23.287 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.287 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.287 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.287 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "500", 2023-08-10T12:05:23.287 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "400", 2023-08-10T12:05:23.287 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "599", 2023-08-10T12:05:23.288 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.288 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.288 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.288 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.288 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.288 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.288 INFO:teuthology.orchestra.run.smithi073.stdout: "url_prefix": { 2023-08-10T12:05:23.289 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "url_prefix", 2023-08-10T12:05:23.289 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.289 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.289 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.289 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.289 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.289 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.289 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.290 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.290 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.290 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.290 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.290 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.291 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.291 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.291 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.291 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "devicehealth", 2023-08-10T12:05:23.291 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.291 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.291 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.292 INFO:teuthology.orchestra.run.smithi073.stdout: "enable_monitoring": { 2023-08-10T12:05:23.292 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enable_monitoring", 2023-08-10T12:05:23.292 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.292 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.292 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.292 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.292 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.293 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.293 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.293 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "monitor device health metrics", 2023-08-10T12:05:23.293 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.293 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.293 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.293 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.293 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.294 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.294 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.294 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.294 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.294 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.294 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.294 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.295 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.295 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.295 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.295 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.295 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.295 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.296 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.296 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.296 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.296 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.296 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.296 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.297 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.297 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.297 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.297 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.297 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.297 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.297 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.297 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.298 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.298 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.298 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.298 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.298 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.298 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.298 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.299 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.299 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.299 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.299 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.299 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.299 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.299 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.299 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.300 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.300 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.300 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.300 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.300 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.300 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.300 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.301 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.301 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.301 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.301 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.301 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.301 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.301 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.302 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.302 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.302 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.302 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.302 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.302 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.302 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.302 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.303 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.303 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.303 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.303 INFO:teuthology.orchestra.run.smithi073.stdout: "mark_out_threshold": { 2023-08-10T12:05:23.303 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mark_out_threshold", 2023-08-10T12:05:23.303 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:23.303 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.304 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.304 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "2419200", 2023-08-10T12:05:23.304 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.304 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.304 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.304 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-08-10T12:05:23.304 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.305 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.305 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.305 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": { 2023-08-10T12:05:23.305 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pool_name", 2023-08-10T12:05:23.305 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.305 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.305 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.306 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "device_health_metrics", 2023-08-10T12:05:23.306 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.306 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.306 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.306 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "name of pool in which to store device health metrics", 2023-08-10T12:05:23.306 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.306 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.306 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.307 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.307 INFO:teuthology.orchestra.run.smithi073.stdout: "retention_period": { 2023-08-10T12:05:23.307 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "retention_period", 2023-08-10T12:05:23.307 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:23.307 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.307 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.307 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15552000", 2023-08-10T12:05:23.307 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.308 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.308 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.308 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long to retain device health metrics", 2023-08-10T12:05:23.308 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.308 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.308 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.309 INFO:teuthology.orchestra.run.smithi073.stdout: "scrape_frequency": { 2023-08-10T12:05:23.309 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "scrape_frequency", 2023-08-10T12:05:23.309 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:23.309 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.309 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.309 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "86400", 2023-08-10T12:05:23.309 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.309 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.310 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.310 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to scrape device health metrics", 2023-08-10T12:05:23.310 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.310 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.310 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.310 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.310 INFO:teuthology.orchestra.run.smithi073.stdout: "self_heal": { 2023-08-10T12:05:23.310 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "self_heal", 2023-08-10T12:05:23.311 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.311 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.311 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.311 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.311 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.311 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.311 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.311 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-08-10T12:05:23.312 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.312 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.312 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.312 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.312 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2023-08-10T12:05:23.312 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2023-08-10T12:05:23.312 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:23.313 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.313 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.313 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2023-08-10T12:05:23.313 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.313 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.313 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.313 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to wake up and check device health", 2023-08-10T12:05:23.313 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.314 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.314 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.314 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.314 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_threshold": { 2023-08-10T12:05:23.314 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_threshold", 2023-08-10T12:05:23.314 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:23.314 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.315 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.315 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "7257600", 2023-08-10T12:05:23.315 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.315 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.315 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.315 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-08-10T12:05:23.315 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.315 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.316 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.316 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.316 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.316 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.316 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "diskprediction_local", 2023-08-10T12:05:23.316 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.317 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.317 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.317 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.317 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.317 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.317 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.317 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.318 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.318 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.318 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.318 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.318 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.318 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.318 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.318 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.319 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.319 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.319 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.319 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.319 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.319 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.320 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.320 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.320 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.320 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.320 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.320 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.321 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.321 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.321 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.321 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.321 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.321 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.321 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.321 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.322 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.322 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.322 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.322 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.322 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.322 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.323 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.323 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.323 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.323 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.323 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.323 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.323 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.323 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.324 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.324 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.324 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.324 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.325 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.325 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.325 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.326 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.326 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.326 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.326 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.327 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.327 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.327 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.328 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.328 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.328 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.328 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.328 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.329 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.329 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.329 INFO:teuthology.orchestra.run.smithi073.stdout: "predict_interval": { 2023-08-10T12:05:23.329 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "predict_interval", 2023-08-10T12:05:23.330 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.330 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.330 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.330 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "86400", 2023-08-10T12:05:23.331 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.331 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.331 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.331 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.331 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.331 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.331 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.332 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.332 INFO:teuthology.orchestra.run.smithi073.stdout: "predictor_model": { 2023-08-10T12:05:23.332 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "predictor_model", 2023-08-10T12:05:23.332 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.332 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.332 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.332 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "prophetstor", 2023-08-10T12:05:23.333 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.333 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.333 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.333 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.333 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.333 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.333 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.333 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.334 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2023-08-10T12:05:23.334 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2023-08-10T12:05:23.334 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.334 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.334 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.334 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2023-08-10T12:05:23.334 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.335 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.335 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.335 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.335 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.335 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.335 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.335 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.335 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.336 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.336 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.336 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "influx", 2023-08-10T12:05:23.336 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": false, 2023-08-10T12:05:23.336 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "influxdb python module not found", 2023-08-10T12:05:23.336 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.336 INFO:teuthology.orchestra.run.smithi073.stdout: "batch_size": { 2023-08-10T12:05:23.337 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "batch_size", 2023-08-10T12:05:23.337 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.337 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.337 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.337 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5000", 2023-08-10T12:05:23.337 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.337 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.337 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.338 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-08-10T12:05:23.338 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.338 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.338 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.338 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.338 INFO:teuthology.orchestra.run.smithi073.stdout: "database": { 2023-08-10T12:05:23.338 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "database", 2023-08-10T12:05:23.338 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.339 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.339 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.339 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "ceph", 2023-08-10T12:05:23.339 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.339 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.339 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.339 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-08-10T12:05:23.339 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.340 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.340 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.340 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": { 2023-08-10T12:05:23.340 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "hostname", 2023-08-10T12:05:23.340 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.340 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.341 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.341 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.341 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.341 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.341 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.341 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB server hostname", 2023-08-10T12:05:23.341 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.341 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.342 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.342 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.342 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2023-08-10T12:05:23.342 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2023-08-10T12:05:23.342 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:23.342 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.342 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.342 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "30", 2023-08-10T12:05:23.343 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "5", 2023-08-10T12:05:23.343 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.343 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.343 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-08-10T12:05:23.343 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.343 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.343 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.343 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.344 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.344 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.344 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.344 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.344 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.344 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.345 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.345 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.345 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.345 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.345 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.345 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.345 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.345 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.346 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.346 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.346 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.346 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.346 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.346 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.346 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.347 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.347 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.347 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.347 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.347 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.347 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.347 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.348 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.348 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.348 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.348 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.349 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.349 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.349 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.349 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.350 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.350 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.350 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.350 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.351 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.351 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.351 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.351 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.352 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.352 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.352 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.353 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.353 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.353 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.353 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.354 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.354 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.354 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.355 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.355 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.355 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.355 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.356 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.356 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.356 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.357 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.357 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.357 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.357 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.357 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.358 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.358 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.358 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.358 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.358 INFO:teuthology.orchestra.run.smithi073.stdout: "password": { 2023-08-10T12:05:23.358 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "password", 2023-08-10T12:05:23.359 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.359 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.359 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.359 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.359 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.359 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.359 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.359 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "password of InfluxDB server user", 2023-08-10T12:05:23.360 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.360 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.360 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.360 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.360 INFO:teuthology.orchestra.run.smithi073.stdout: "port": { 2023-08-10T12:05:23.360 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "port", 2023-08-10T12:05:23.360 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.360 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.361 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.361 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8086", 2023-08-10T12:05:23.361 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.361 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.361 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.362 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB server port", 2023-08-10T12:05:23.362 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.362 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.362 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.362 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.362 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl": { 2023-08-10T12:05:23.362 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl", 2023-08-10T12:05:23.362 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.363 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.363 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.363 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "false", 2023-08-10T12:05:23.363 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.363 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.363 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.363 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-08-10T12:05:23.364 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.364 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.364 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.364 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.364 INFO:teuthology.orchestra.run.smithi073.stdout: "threads": { 2023-08-10T12:05:23.364 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "threads", 2023-08-10T12:05:23.364 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.364 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.365 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.365 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2023-08-10T12:05:23.365 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2023-08-10T12:05:23.365 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "32", 2023-08-10T12:05:23.365 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.365 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-08-10T12:05:23.365 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.365 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.366 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.366 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.366 INFO:teuthology.orchestra.run.smithi073.stdout: "username": { 2023-08-10T12:05:23.366 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "username", 2023-08-10T12:05:23.366 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.366 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.366 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.367 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.367 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.367 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.367 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.367 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "username of InfluxDB server user", 2023-08-10T12:05:23.367 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.367 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.367 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.368 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.368 INFO:teuthology.orchestra.run.smithi073.stdout: "verify_ssl": { 2023-08-10T12:05:23.368 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "verify_ssl", 2023-08-10T12:05:23.368 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.368 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.368 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.368 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "true", 2023-08-10T12:05:23.368 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.369 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.369 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.369 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-08-10T12:05:23.369 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.369 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.369 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.369 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.369 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.370 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.370 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.370 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "insights", 2023-08-10T12:05:23.370 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.370 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.370 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.370 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.371 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.371 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.371 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.371 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.371 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.371 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.371 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.371 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.372 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.372 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.372 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.372 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.372 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.372 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.372 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.372 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.373 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.373 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.373 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.373 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.373 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.373 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.373 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.373 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.374 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.374 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.374 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.374 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.374 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.374 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.374 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.374 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.375 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.375 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.375 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.375 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.375 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.375 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.375 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.375 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.376 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.376 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.376 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.376 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.376 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.376 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.376 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.377 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.377 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.377 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.377 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.377 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.377 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.377 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.377 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.378 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.378 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.378 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.378 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.378 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.378 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.378 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.378 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.379 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.379 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.379 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.379 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.379 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.379 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.379 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.379 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.380 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.380 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "iostat", 2023-08-10T12:05:23.380 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.380 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.380 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.380 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.380 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.380 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.381 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.381 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.381 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.381 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.381 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.381 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.381 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.382 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.382 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.382 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.382 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.382 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.382 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.382 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.382 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.383 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.383 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.383 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.383 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.383 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.383 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.383 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.383 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.384 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.384 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.384 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.384 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.384 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.384 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.384 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.384 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.385 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.385 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.385 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.385 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.385 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.385 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.385 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.385 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.386 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.386 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.386 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.386 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.386 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.386 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.386 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.386 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.387 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.387 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.387 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.387 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.387 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.387 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.387 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.388 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.388 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.388 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.388 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.388 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.388 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.388 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.388 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.389 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.389 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.389 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.389 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.389 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.389 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.389 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.389 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.390 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "k8sevents", 2023-08-10T12:05:23.390 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.390 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.390 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.390 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_event_retention_days": { 2023-08-10T12:05:23.390 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ceph_event_retention_days", 2023-08-10T12:05:23.390 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.390 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.391 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.391 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "7", 2023-08-10T12:05:23.391 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.391 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.391 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.391 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Days to hold ceph event information within local cache", 2023-08-10T12:05:23.391 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.392 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.392 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.392 INFO:teuthology.orchestra.run.smithi073.stdout: "config_check_secs": { 2023-08-10T12:05:23.392 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_check_secs", 2023-08-10T12:05:23.392 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.392 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.392 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.393 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-08-10T12:05:23.393 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "10", 2023-08-10T12:05:23.393 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.393 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.393 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-08-10T12:05:23.393 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.393 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.394 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.394 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.394 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.394 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.394 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.394 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.394 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.395 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.395 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.395 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.395 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.395 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.395 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.395 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.395 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.396 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.396 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.396 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.396 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.396 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.396 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.396 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.397 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.397 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.397 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.397 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.397 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.397 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.397 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.398 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.398 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.398 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.398 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.398 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.398 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.398 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.398 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.399 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.399 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.399 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.399 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.399 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.399 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.399 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.399 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.400 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.400 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.400 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.400 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.400 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.400 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.400 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.400 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.401 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.401 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.401 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.401 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.401 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.401 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.401 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.402 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.402 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.402 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.402 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.402 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.402 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.402 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.402 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.403 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.403 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.403 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.403 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "localpool", 2023-08-10T12:05:23.403 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.403 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.403 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.404 INFO:teuthology.orchestra.run.smithi073.stdout: "failure_domain": { 2023-08-10T12:05:23.404 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "failure_domain", 2023-08-10T12:05:23.404 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.404 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.404 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.404 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "host", 2023-08-10T12:05:23.404 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.405 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.405 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.405 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "failure domain for any created local pool", 2023-08-10T12:05:23.405 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-08-10T12:05:23.405 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.405 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.405 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.405 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.406 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.406 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.406 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.406 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.406 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.406 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.406 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.406 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.407 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.407 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.407 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.407 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.407 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.407 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.407 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.407 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.408 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.408 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.408 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.408 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.408 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.408 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.408 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.408 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.409 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.409 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.409 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.409 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.409 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.409 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.409 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.409 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.410 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.410 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.410 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.410 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.410 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.410 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.410 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.410 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.411 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.411 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.411 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.411 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.411 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.411 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.411 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.411 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.412 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.412 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.412 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.412 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.412 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.412 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.412 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.413 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.413 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.413 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.413 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.413 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.413 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.413 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.413 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.414 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.414 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.414 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.414 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.414 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.414 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.414 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": { 2023-08-10T12:05:23.414 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "min_size", 2023-08-10T12:05:23.415 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.415 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.415 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.415 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.415 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.415 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.415 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.415 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default min_size for any created local pool", 2023-08-10T12:05:23.416 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-08-10T12:05:23.416 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.416 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.416 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.416 INFO:teuthology.orchestra.run.smithi073.stdout: "num_rep": { 2023-08-10T12:05:23.416 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "num_rep", 2023-08-10T12:05:23.416 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.417 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.417 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.417 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3", 2023-08-10T12:05:23.417 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.417 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.417 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.418 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default replica count for any created local pool", 2023-08-10T12:05:23.418 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.418 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.418 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.418 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.418 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": { 2023-08-10T12:05:23.419 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pg_num", 2023-08-10T12:05:23.419 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.419 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.419 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.419 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "128", 2023-08-10T12:05:23.419 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.420 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.420 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.420 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default pg_num for any created local pool", 2023-08-10T12:05:23.420 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.420 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.420 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.421 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.421 INFO:teuthology.orchestra.run.smithi073.stdout: "prefix": { 2023-08-10T12:05:23.421 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prefix", 2023-08-10T12:05:23.421 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.421 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.421 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.422 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.422 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.422 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.422 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.422 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "name prefix for any created local pool", 2023-08-10T12:05:23.422 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.423 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.423 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.423 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.423 INFO:teuthology.orchestra.run.smithi073.stdout: "subtree": { 2023-08-10T12:05:23.423 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "subtree", 2023-08-10T12:05:23.423 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.424 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.424 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.424 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "rack", 2023-08-10T12:05:23.424 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.424 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.424 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.424 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "CRUSH level for which to create a local pool", 2023-08-10T12:05:23.424 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-08-10T12:05:23.425 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.425 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.425 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.425 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.425 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.425 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.425 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mds_autoscaler", 2023-08-10T12:05:23.425 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.426 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.426 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.426 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.426 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.426 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.426 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.426 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.426 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.427 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.427 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.427 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.427 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.427 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.427 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.427 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.427 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.428 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.428 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.428 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.428 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.428 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.428 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.428 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.429 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.429 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.429 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.429 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.429 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.429 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.429 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.429 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.430 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.430 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.430 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.430 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.430 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.430 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.430 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.430 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.431 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.431 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.431 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.431 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.431 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.431 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.431 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.431 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.432 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.432 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.432 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.432 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.432 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.432 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.432 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.432 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.433 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.433 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.433 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.433 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.433 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.433 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.433 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.433 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.434 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.434 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.434 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.434 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.434 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.434 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.434 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.434 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.435 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.435 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.435 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.435 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.435 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mirroring", 2023-08-10T12:05:23.435 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.435 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.435 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.436 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.436 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.436 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.436 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.436 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.436 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.436 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.437 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.437 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.437 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.437 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.437 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.437 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.437 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.437 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.438 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.438 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.438 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.438 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.438 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.438 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.438 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.438 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.439 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.439 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.439 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.439 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.439 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.439 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.439 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.439 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.440 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.440 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.440 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.440 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.440 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.440 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.440 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.440 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.441 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.441 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.441 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.441 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.441 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.441 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.441 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.441 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.442 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.442 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.442 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.442 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.442 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.442 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.442 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.442 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.443 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.443 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.443 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.443 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.443 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.443 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.443 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.443 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.444 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.444 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.444 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.444 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.444 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.444 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.444 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.445 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.445 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.445 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.445 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "nfs", 2023-08-10T12:05:23.445 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.445 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.445 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.445 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.446 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.446 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.446 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.446 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.446 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.446 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.446 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.446 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.447 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.447 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.447 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.447 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.447 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.447 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.447 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.447 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.448 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.448 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.448 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.448 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.448 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.448 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.448 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.449 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.449 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.449 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.449 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.449 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.449 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.449 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.449 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.450 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.450 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.450 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.450 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.450 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.450 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.450 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.451 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.451 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.451 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.451 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.451 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.451 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.451 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.451 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.452 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.452 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.452 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.452 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.452 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.452 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.452 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.452 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.453 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.453 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.453 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.453 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.453 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.453 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.453 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.453 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.454 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.454 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.454 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.454 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.454 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.454 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.454 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.455 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.455 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.455 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "orchestrator", 2023-08-10T12:05:23.455 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.455 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.455 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.455 INFO:teuthology.orchestra.run.smithi073.stdout: "fail_fs": { 2023-08-10T12:05:23.455 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "fail_fs", 2023-08-10T12:05:23.456 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.456 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.456 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.456 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.456 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.456 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.456 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.456 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-08-10T12:05:23.457 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.457 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.457 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.457 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.457 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.457 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.457 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.457 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.458 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.458 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.458 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.458 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.458 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.458 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.458 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.459 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.459 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.459 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.459 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.459 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.459 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.459 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.459 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.460 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.460 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.460 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.460 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.460 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.460 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.460 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.460 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.461 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.461 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.461 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.461 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.461 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.461 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.461 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.461 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.462 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.462 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.462 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.462 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.462 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.462 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.462 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.462 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.463 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.463 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.463 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.463 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.463 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.463 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.463 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.463 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.464 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.464 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.464 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.464 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.464 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.464 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.464 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.465 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.465 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.465 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.465 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.465 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.465 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.465 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.465 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.466 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.466 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.466 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.466 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator": { 2023-08-10T12:05:23.466 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "orchestrator", 2023-08-10T12:05:23.466 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.466 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.467 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.467 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.467 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.467 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.467 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.467 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm", 2023-08-10T12:05:23.467 INFO:teuthology.orchestra.run.smithi073.stdout: "rook", 2023-08-10T12:05:23.467 INFO:teuthology.orchestra.run.smithi073.stdout: "test_orchestrator" 2023-08-10T12:05:23.468 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.468 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Orchestrator backend", 2023-08-10T12:05:23.468 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.468 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.468 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.468 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.468 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.469 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.469 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "osd_perf_query", 2023-08-10T12:05:23.469 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.469 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.469 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.469 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.469 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.470 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.470 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.470 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.470 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.470 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.470 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.470 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.470 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.471 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.471 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.471 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.471 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.471 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.471 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.471 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.471 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.472 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.472 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.472 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.472 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.472 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.472 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.472 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.472 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.473 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.473 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.473 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.473 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.473 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.473 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.473 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.474 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.474 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.474 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.474 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.474 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.474 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.474 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.474 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.475 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.475 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.475 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.475 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.475 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.475 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.475 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.475 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.476 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.476 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.476 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.476 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.476 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.476 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.476 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.476 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.477 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.477 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.477 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.477 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.477 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.477 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.477 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.477 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.478 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.478 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.478 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.478 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.478 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.478 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.478 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.479 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.479 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "osd_support", 2023-08-10T12:05:23.479 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.479 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.479 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.479 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.479 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.479 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.480 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.480 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.480 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.480 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.480 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.480 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.480 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.480 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.481 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.481 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.481 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.481 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.481 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.481 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.481 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.481 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.482 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.482 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.482 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.482 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.482 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.482 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.482 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.482 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.483 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.483 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.483 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.483 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.483 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.483 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.483 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.484 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.484 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.484 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.484 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.484 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.484 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.484 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.484 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.485 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.485 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.485 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.485 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.485 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.485 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.485 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.486 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.486 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.486 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.486 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.486 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.486 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.486 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.486 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.487 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.487 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.487 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.487 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.487 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.487 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.487 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.487 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.488 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.488 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.488 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.488 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.488 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.488 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.488 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.488 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pg_autoscaler", 2023-08-10T12:05:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.490 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.490 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.490 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.490 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.490 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.490 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.490 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.490 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.491 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.491 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.491 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.491 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.491 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.491 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.491 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.492 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.492 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.492 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.492 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.492 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.492 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.492 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.494 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.494 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.494 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.494 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.494 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.494 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.494 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.494 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.495 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.495 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.495 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.495 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.495 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.495 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.495 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.495 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.496 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.496 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.496 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.496 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.496 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.496 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.496 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.496 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.497 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.497 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.497 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.497 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.497 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.497 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.497 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.497 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.498 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.498 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.498 INFO:teuthology.orchestra.run.smithi073.stdout: "noautoscale": { 2023-08-10T12:05:23.498 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "noautoscale", 2023-08-10T12:05:23.498 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.498 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.498 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.498 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.499 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.499 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.499 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.499 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "global autoscale flag", 2023-08-10T12:05:23.499 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-08-10T12:05:23.499 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.499 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.500 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.500 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2023-08-10T12:05:23.500 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2023-08-10T12:05:23.500 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:23.500 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.500 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.500 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2023-08-10T12:05:23.500 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.501 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.501 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.501 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.501 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.501 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.501 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.501 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.501 INFO:teuthology.orchestra.run.smithi073.stdout: "threshold": { 2023-08-10T12:05:23.502 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "threshold", 2023-08-10T12:05:23.502 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-08-10T12:05:23.502 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.502 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.502 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3.0", 2023-08-10T12:05:23.502 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1.0", 2023-08-10T12:05:23.502 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.502 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.503 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "scaling threshold", 2023-08-10T12:05:23.503 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-08-10T12:05:23.503 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.503 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.503 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.503 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.503 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.504 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.504 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "progress", 2023-08-10T12:05:23.504 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.504 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.504 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.504 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_pg_recovery_event": { 2023-08-10T12:05:23.504 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_pg_recovery_event", 2023-08-10T12:05:23.504 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.505 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.505 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.505 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.505 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.505 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.505 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.505 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow the module to show pg recovery progress", 2023-08-10T12:05:23.505 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.506 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.506 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.506 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.506 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": { 2023-08-10T12:05:23.506 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enabled", 2023-08-10T12:05:23.506 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.506 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.506 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.507 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.507 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.507 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.507 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.507 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.507 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.507 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.507 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.508 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.508 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.508 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.508 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.508 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.508 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.508 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.509 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.509 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.509 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.509 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.509 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.509 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.509 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.509 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.510 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.510 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.510 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.510 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.510 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.510 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.510 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.510 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.511 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.511 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.511 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.511 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.511 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.511 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.511 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.511 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.512 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.512 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.512 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.512 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.512 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.512 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.512 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.512 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.513 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.513 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.513 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.513 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.513 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.513 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.513 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.513 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.514 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.514 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.514 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.514 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.514 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.514 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.514 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.514 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.515 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.515 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.515 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.515 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.515 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.515 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.515 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: "max_completed_events": { 2023-08-10T12:05:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_completed_events", 2023-08-10T12:05:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "50", 2023-08-10T12:05:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.518 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.518 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.518 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "number of past completed events to remember", 2023-08-10T12:05:23.518 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.518 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.518 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.518 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.518 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2023-08-10T12:05:23.519 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2023-08-10T12:05:23.519 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:23.519 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.519 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.519 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2023-08-10T12:05:23.519 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.519 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.520 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.520 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long the module is going to sleep", 2023-08-10T12:05:23.520 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.520 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.520 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.520 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.520 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.520 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.521 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.521 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus", 2023-08-10T12:05:23.521 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.521 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.521 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.521 INFO:teuthology.orchestra.run.smithi073.stdout: "cache": { 2023-08-10T12:05:23.521 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cache", 2023-08-10T12:05:23.521 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.522 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.522 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.522 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.522 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.522 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.522 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.522 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.522 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.523 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.523 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.523 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.523 INFO:teuthology.orchestra.run.smithi073.stdout: "exclude_perf_counters": { 2023-08-10T12:05:23.523 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "exclude_perf_counters", 2023-08-10T12:05:23.523 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.523 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.523 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.524 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.524 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.524 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.524 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.524 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-08-10T12:05:23.524 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-08-10T12:05:23.524 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.524 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.525 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.525 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.525 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.525 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.525 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.525 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.525 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.526 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.526 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.526 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.526 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.526 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.526 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.526 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.526 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.527 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.527 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.527 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.527 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.527 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.527 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.527 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.527 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.528 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.528 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.528 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.528 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.528 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.528 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.528 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.528 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.529 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.529 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.529 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.529 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.529 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.529 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.529 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.529 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.530 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.530 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.530 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.530 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.530 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.530 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.530 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.530 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.531 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.531 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.531 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.531 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.531 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.531 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.531 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.531 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.532 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.532 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.532 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.532 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.532 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.532 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.532 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.533 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.533 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.533 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.533 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.533 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.533 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.533 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.533 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.534 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.534 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_stats_pools": { 2023-08-10T12:05:23.534 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_stats_pools", 2023-08-10T12:05:23.534 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.534 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.534 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.534 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.534 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.535 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.535 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.535 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.535 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.535 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.535 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.535 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.535 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_stats_pools_refresh_interval": { 2023-08-10T12:05:23.536 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-08-10T12:05:23.536 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.536 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.536 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.536 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "300", 2023-08-10T12:05:23.536 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.536 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.536 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.537 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.537 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.537 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.537 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.537 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.537 INFO:teuthology.orchestra.run.smithi073.stdout: "scrape_interval": { 2023-08-10T12:05:23.537 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "scrape_interval", 2023-08-10T12:05:23.537 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-08-10T12:05:23.538 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.538 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.538 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15.0", 2023-08-10T12:05:23.538 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.538 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.538 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.538 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.538 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.539 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.539 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.539 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.539 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2023-08-10T12:05:23.539 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2023-08-10T12:05:23.539 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.539 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.539 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.540 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "::", 2023-08-10T12:05:23.540 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.540 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.540 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.540 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-08-10T12:05:23.540 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.540 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.541 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.541 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.541 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2023-08-10T12:05:23.541 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2023-08-10T12:05:23.541 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.541 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.541 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.541 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "9283", 2023-08-10T12:05:23.542 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.542 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.542 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.542 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-08-10T12:05:23.542 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.542 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.542 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.542 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.543 INFO:teuthology.orchestra.run.smithi073.stdout: "stale_cache_strategy": { 2023-08-10T12:05:23.543 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "stale_cache_strategy", 2023-08-10T12:05:23.543 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.543 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.543 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.543 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "log", 2023-08-10T12:05:23.543 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.543 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.544 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.544 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.544 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.544 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.544 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.544 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.544 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_behaviour": { 2023-08-10T12:05:23.545 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_behaviour", 2023-08-10T12:05:23.545 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.545 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.545 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.545 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "default", 2023-08-10T12:05:23.545 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.545 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.545 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.546 INFO:teuthology.orchestra.run.smithi073.stdout: "default", 2023-08-10T12:05:23.546 INFO:teuthology.orchestra.run.smithi073.stdout: "error" 2023-08-10T12:05:23.546 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.546 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.546 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.546 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.546 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.546 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.547 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_error_status_code": { 2023-08-10T12:05:23.547 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_error_status_code", 2023-08-10T12:05:23.547 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.547 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.547 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.547 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "500", 2023-08-10T12:05:23.547 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "400", 2023-08-10T12:05:23.547 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "599", 2023-08-10T12:05:23.548 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.548 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.548 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.548 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.548 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.548 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.548 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.548 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.549 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.549 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_support", 2023-08-10T12:05:23.549 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.549 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.549 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.549 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.549 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.549 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.550 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.550 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.550 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.550 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.550 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.550 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.550 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.551 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.551 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.551 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.551 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.551 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.551 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.551 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.551 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.552 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.552 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.552 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.552 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.552 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.552 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.552 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.552 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.553 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.553 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.553 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.553 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.553 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.553 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.553 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.553 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.554 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.554 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.554 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.554 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.554 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.554 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.554 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.554 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.555 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.555 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.555 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.555 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.555 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.555 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.555 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.555 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.556 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.556 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.556 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.556 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.556 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.556 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.557 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.557 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.557 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.557 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.557 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.557 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.557 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.557 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.558 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.558 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.558 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.558 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.558 INFO:teuthology.orchestra.run.smithi073.stdout: "max_concurrent_snap_create": { 2023-08-10T12:05:23.558 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_concurrent_snap_create", 2023-08-10T12:05:23.558 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.559 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.559 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.559 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-08-10T12:05:23.559 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.559 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.559 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.559 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.559 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.560 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.560 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.560 INFO:teuthology.orchestra.run.smithi073.stdout: "mirror_snapshot_schedule": { 2023-08-10T12:05:23.560 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mirror_snapshot_schedule", 2023-08-10T12:05:23.560 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.560 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.561 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.561 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.561 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.561 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.561 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.561 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.561 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.561 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.562 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.562 INFO:teuthology.orchestra.run.smithi073.stdout: "trash_purge_schedule": { 2023-08-10T12:05:23.562 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "trash_purge_schedule", 2023-08-10T12:05:23.562 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.562 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.562 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.562 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.563 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.563 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.563 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.563 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.563 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.563 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.563 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.563 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.564 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.564 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.564 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.564 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "restful", 2023-08-10T12:05:23.564 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.564 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.564 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.564 INFO:teuthology.orchestra.run.smithi073.stdout: "enable_auth": { 2023-08-10T12:05:23.565 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enable_auth", 2023-08-10T12:05:23.565 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.565 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.565 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.565 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.565 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.565 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.565 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.566 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.566 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.566 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.566 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.566 INFO:teuthology.orchestra.run.smithi073.stdout: "key_file": { 2023-08-10T12:05:23.566 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "key_file", 2023-08-10T12:05:23.566 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.567 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.567 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.567 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.567 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.567 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.567 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.567 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.568 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.568 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.568 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.568 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.568 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.568 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.568 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.569 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.569 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.569 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.569 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.569 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.569 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.569 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.569 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.570 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.570 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.570 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.570 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.570 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.570 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.570 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.570 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.571 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.571 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.571 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.571 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.571 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.571 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.571 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.572 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.572 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.572 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.572 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.572 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.572 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.572 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.573 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.573 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.573 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.573 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.573 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.573 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.573 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.573 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.574 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.574 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.574 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.574 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.574 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.574 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.574 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.575 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.575 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.575 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.575 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.575 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.575 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.575 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.576 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.576 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.576 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.576 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.576 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.576 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.576 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.576 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.577 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.577 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.577 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2023-08-10T12:05:23.577 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2023-08-10T12:05:23.577 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.577 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.577 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.578 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.578 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.578 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.578 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.578 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.578 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.578 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.579 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.579 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2023-08-10T12:05:23.579 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2023-08-10T12:05:23.579 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.579 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.579 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.579 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.580 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.580 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.580 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.580 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.580 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.580 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.580 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.580 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.581 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.581 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.581 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rgw", 2023-08-10T12:05:23.581 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.581 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.581 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.581 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.582 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.582 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.582 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.582 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.582 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.582 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.582 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.582 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.583 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.583 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.583 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.583 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.583 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.583 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.583 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.583 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.584 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.584 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.584 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.584 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.584 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.584 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.585 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.585 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.585 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.585 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.585 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.585 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.585 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.585 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.586 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.586 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.586 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.586 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.586 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.586 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.586 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.586 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.587 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.587 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.587 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.587 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.587 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.587 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.587 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.587 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.588 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.588 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.588 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.588 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.588 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.588 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.588 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.589 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.589 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.589 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.589 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.589 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.589 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.589 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.590 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.590 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.590 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.590 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.590 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.590 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.590 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.590 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.591 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.591 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rook", 2023-08-10T12:05:23.591 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.591 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.591 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.591 INFO:teuthology.orchestra.run.smithi073.stdout: "drive_group_interval": { 2023-08-10T12:05:23.591 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "drive_group_interval", 2023-08-10T12:05:23.592 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-08-10T12:05:23.592 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.592 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.592 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "300.0", 2023-08-10T12:05:23.592 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.592 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.592 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.592 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-08-10T12:05:23.593 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.593 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.593 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.593 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.593 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.593 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.593 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.594 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.594 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.594 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.594 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.594 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.594 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.594 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.594 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.595 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.595 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.595 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.595 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.595 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.595 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.595 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.595 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.596 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.596 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.596 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.596 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.596 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.596 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.596 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.596 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.597 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.597 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.597 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.597 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.597 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.597 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.597 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.597 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.598 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.598 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.598 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.598 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.598 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.598 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.598 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.598 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.599 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.599 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.599 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.599 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.599 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.599 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.599 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.599 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.600 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.600 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.600 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.600 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.600 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.600 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.601 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.601 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.601 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.601 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.601 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.601 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.601 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.601 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.602 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.602 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.602 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.602 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.602 INFO:teuthology.orchestra.run.smithi073.stdout: "storage_class": { 2023-08-10T12:05:23.602 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "storage_class", 2023-08-10T12:05:23.602 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.602 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.603 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.603 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "local", 2023-08-10T12:05:23.603 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.603 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.603 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.603 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-08-10T12:05:23.603 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.603 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.604 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.604 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.604 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.604 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.604 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.604 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "selftest", 2023-08-10T12:05:23.604 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.604 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.605 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.605 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.605 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.605 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.605 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.605 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.605 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.606 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.606 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.606 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.606 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.606 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.606 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.606 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.606 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.607 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.607 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.607 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.607 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.607 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.607 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.607 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.608 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.608 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.608 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.608 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.608 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.608 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.608 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.608 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.609 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.609 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.609 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.609 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.609 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.609 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.610 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.610 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.610 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.610 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.610 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.610 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.610 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.610 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.611 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.611 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.611 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.611 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.611 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.611 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.611 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.611 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.612 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.612 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.612 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.612 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.612 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.612 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.612 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.613 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.613 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.613 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.613 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.613 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.613 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.613 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.614 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.614 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.614 INFO:teuthology.orchestra.run.smithi073.stdout: "roption1": { 2023-08-10T12:05:23.614 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "roption1", 2023-08-10T12:05:23.614 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.614 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.614 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.614 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.615 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.615 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.615 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.615 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.615 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.615 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.615 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.616 INFO:teuthology.orchestra.run.smithi073.stdout: "roption2": { 2023-08-10T12:05:23.616 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "roption2", 2023-08-10T12:05:23.616 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.616 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.616 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.616 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "xyz", 2023-08-10T12:05:23.616 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.616 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.617 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.617 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.617 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.617 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.617 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.617 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.617 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption1": { 2023-08-10T12:05:23.617 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption1", 2023-08-10T12:05:23.618 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.618 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.618 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.618 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.618 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.618 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.618 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.618 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.619 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.619 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.619 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.619 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption2": { 2023-08-10T12:05:23.619 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption2", 2023-08-10T12:05:23.619 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.620 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.620 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.620 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.620 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.620 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.620 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.620 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.620 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.621 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.621 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.621 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.621 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption3": { 2023-08-10T12:05:23.621 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption3", 2023-08-10T12:05:23.621 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-08-10T12:05:23.621 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.621 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.622 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.622 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.622 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.622 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.622 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.622 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.622 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.622 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.623 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.623 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption4": { 2023-08-10T12:05:23.623 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption4", 2023-08-10T12:05:23.623 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.623 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.623 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.623 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.623 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.624 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.624 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.624 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.624 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.624 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.624 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.624 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption5": { 2023-08-10T12:05:23.625 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption5", 2023-08-10T12:05:23.625 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.625 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.625 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.625 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.625 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.625 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.626 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.626 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.626 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.626 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.626 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.626 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.626 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption6": { 2023-08-10T12:05:23.626 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption6", 2023-08-10T12:05:23.627 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.627 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.627 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.627 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.627 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.627 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.627 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.627 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.628 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.628 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.628 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.628 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption7": { 2023-08-10T12:05:23.628 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption7", 2023-08-10T12:05:23.628 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.628 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.629 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.629 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.629 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2023-08-10T12:05:23.629 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "42", 2023-08-10T12:05:23.629 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.629 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.629 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.629 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.630 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.630 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.630 INFO:teuthology.orchestra.run.smithi073.stdout: "testkey": { 2023-08-10T12:05:23.630 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testkey", 2023-08-10T12:05:23.630 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.630 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.630 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.630 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.631 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.631 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.631 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.631 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.631 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.631 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.631 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.632 INFO:teuthology.orchestra.run.smithi073.stdout: "testlkey": { 2023-08-10T12:05:23.632 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testlkey", 2023-08-10T12:05:23.632 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.632 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.632 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.632 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.632 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.633 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.633 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.633 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.633 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.633 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.633 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.633 INFO:teuthology.orchestra.run.smithi073.stdout: "testnewline": { 2023-08-10T12:05:23.634 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testnewline", 2023-08-10T12:05:23.634 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.634 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.634 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.634 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.634 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.634 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.634 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.635 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.635 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.635 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.635 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.635 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.635 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.635 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.636 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snap_schedule", 2023-08-10T12:05:23.636 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.636 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.636 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.636 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_m_granularity": { 2023-08-10T12:05:23.636 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_m_granularity", 2023-08-10T12:05:23.636 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.637 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.637 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.637 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.637 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.637 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.637 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.637 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow minute scheduled snapshots", 2023-08-10T12:05:23.637 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.638 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.638 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.638 INFO:teuthology.orchestra.run.smithi073.stdout: "dump_on_update": { 2023-08-10T12:05:23.638 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "dump_on_update", 2023-08-10T12:05:23.638 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.638 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.638 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.639 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.639 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.639 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.639 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.639 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "dump database to debug log on update", 2023-08-10T12:05:23.639 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.639 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.639 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.640 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.640 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.640 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.640 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.640 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.640 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.641 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.641 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.641 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.641 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.641 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.641 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.641 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.641 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.642 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.642 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.642 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.642 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.642 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.642 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.642 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.642 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.643 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.643 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.643 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.643 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.643 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.643 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.643 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.643 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.644 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.644 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.644 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.644 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.644 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.644 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.644 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.645 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.645 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.645 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.645 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.645 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.645 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.645 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.645 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.646 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.646 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.646 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.646 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.646 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.646 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.646 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.646 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.647 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.647 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.647 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.647 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.647 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.647 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.647 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.648 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.648 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.648 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.648 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.648 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.648 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.648 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.649 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.649 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.649 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "stats", 2023-08-10T12:05:23.649 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.649 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.649 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.650 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.650 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.650 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.650 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.650 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.650 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.650 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.650 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.651 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.651 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.651 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.651 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.651 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.651 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.651 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.651 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.652 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.652 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.652 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.652 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.652 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.652 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.652 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.653 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.653 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.653 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.653 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.653 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.653 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.653 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.653 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.654 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.654 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.654 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.654 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.654 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.654 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.654 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.654 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.655 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.655 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.655 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.655 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.655 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.655 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.655 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.655 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.656 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.656 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.656 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.656 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.656 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.656 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.656 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.657 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.657 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.657 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.657 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.657 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.657 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.657 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.657 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.658 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.658 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.658 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.658 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.658 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.658 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.658 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.658 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.659 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.659 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "status", 2023-08-10T12:05:23.659 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.659 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.659 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.659 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.659 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.660 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.660 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.660 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.660 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.660 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.660 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.660 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.660 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.661 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.661 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.661 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.661 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.661 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.661 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.661 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.661 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.662 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.662 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.662 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.662 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.662 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.662 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.663 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.663 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.663 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.663 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.663 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.663 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.663 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.663 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.664 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.664 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.664 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.664 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.664 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.664 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.664 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.665 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.665 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.665 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.665 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.665 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.665 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.665 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.665 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.666 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.666 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.666 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.666 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.666 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.666 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.666 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.666 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.667 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.667 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.667 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.667 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.667 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.667 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.667 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.668 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.668 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.668 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.668 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.668 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.668 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.668 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.668 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.669 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.669 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "telegraf", 2023-08-10T12:05:23.669 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.669 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.669 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.669 INFO:teuthology.orchestra.run.smithi073.stdout: "address": { 2023-08-10T12:05:23.669 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "address", 2023-08-10T12:05:23.669 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.670 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.670 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.670 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-08-10T12:05:23.670 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.670 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.670 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.670 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.670 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.671 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.671 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.671 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.671 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2023-08-10T12:05:23.671 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2023-08-10T12:05:23.671 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:23.671 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.671 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.672 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15", 2023-08-10T12:05:23.672 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.672 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.672 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.672 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.672 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.672 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.672 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.673 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.673 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.673 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.673 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.673 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.673 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.674 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.674 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.674 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.674 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.674 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.674 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.674 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.674 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.675 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.675 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.675 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.675 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.675 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.675 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.675 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.675 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.676 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.676 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.676 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.676 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.676 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.676 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.676 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.676 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.677 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.677 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.677 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.677 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.677 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.677 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.677 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.677 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.678 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.678 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.678 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.678 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.678 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.678 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.678 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.678 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.679 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.679 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.679 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.679 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.679 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.679 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.679 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.679 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.680 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.680 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.680 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.680 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.680 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.680 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.680 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.680 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.681 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.681 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.681 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.681 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.681 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.681 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.681 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.682 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.682 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.682 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.682 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.682 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "telemetry", 2023-08-10T12:05:23.682 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.682 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.682 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.683 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_basic": { 2023-08-10T12:05:23.683 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_basic", 2023-08-10T12:05:23.683 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.683 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.683 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.683 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.683 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.683 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.684 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.684 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share basic cluster information (size, version)", 2023-08-10T12:05:23.684 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.684 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.684 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.684 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.684 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_crash": { 2023-08-10T12:05:23.684 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_crash", 2023-08-10T12:05:23.685 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.685 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.685 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.685 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.685 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.685 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.685 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.685 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-08-10T12:05:23.686 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.686 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.686 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.686 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.686 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_device": { 2023-08-10T12:05:23.686 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_device", 2023-08-10T12:05:23.686 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.686 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.687 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.687 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-08-10T12:05:23.687 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.687 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.687 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.687 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-08-10T12:05:23.687 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.687 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.688 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.688 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.688 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_ident": { 2023-08-10T12:05:23.688 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_ident", 2023-08-10T12:05:23.688 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.688 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.688 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.688 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.689 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.689 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.689 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.689 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-08-10T12:05:23.689 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.689 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.689 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.690 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.690 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_perf": { 2023-08-10T12:05:23.690 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_perf", 2023-08-10T12:05:23.690 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.690 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.690 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.690 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.690 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.691 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.691 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.691 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share various performance metrics of a cluster", 2023-08-10T12:05:23.691 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.691 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.691 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.691 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.691 INFO:teuthology.orchestra.run.smithi073.stdout: "contact": { 2023-08-10T12:05:23.692 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "contact", 2023-08-10T12:05:23.692 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.692 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.692 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.692 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.692 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.692 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.693 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.693 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.693 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.693 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.693 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.693 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.693 INFO:teuthology.orchestra.run.smithi073.stdout: "description": { 2023-08-10T12:05:23.693 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "description", 2023-08-10T12:05:23.694 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.694 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.694 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.694 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.694 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.694 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.694 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.694 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.695 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.695 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.695 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.695 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.695 INFO:teuthology.orchestra.run.smithi073.stdout: "device_url": { 2023-08-10T12:05:23.695 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_url", 2023-08-10T12:05:23.695 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.695 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.696 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.696 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-08-10T12:05:23.696 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.696 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.696 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.696 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.696 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.697 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.697 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.697 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.697 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": { 2023-08-10T12:05:23.697 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enabled", 2023-08-10T12:05:23.697 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.697 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.697 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.698 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.698 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.698 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.698 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.698 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.698 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.698 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.698 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.699 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.699 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2023-08-10T12:05:23.699 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2023-08-10T12:05:23.699 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.699 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.699 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.699 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "24", 2023-08-10T12:05:23.699 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "8", 2023-08-10T12:05:23.700 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.700 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.700 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.700 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.700 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.700 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.700 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.700 INFO:teuthology.orchestra.run.smithi073.stdout: "last_opt_revision": { 2023-08-10T12:05:23.701 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "last_opt_revision", 2023-08-10T12:05:23.701 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.701 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.701 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.701 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1", 2023-08-10T12:05:23.701 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.701 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.702 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.702 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.702 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.702 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.702 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.702 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.702 INFO:teuthology.orchestra.run.smithi073.stdout: "leaderboard": { 2023-08-10T12:05:23.702 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "leaderboard", 2023-08-10T12:05:23.703 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.703 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.703 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.703 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.703 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.703 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.703 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.703 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.704 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.704 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.704 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.704 INFO:teuthology.orchestra.run.smithi073.stdout: "leaderboard_description": { 2023-08-10T12:05:23.704 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "leaderboard_description", 2023-08-10T12:05:23.704 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.704 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.705 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.705 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.705 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.705 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.705 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.705 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.705 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.705 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.706 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.706 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.706 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.706 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.706 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.706 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.706 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.707 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.707 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.707 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.707 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.707 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.707 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.707 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.707 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.708 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.708 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.708 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.708 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.708 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.708 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.709 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.709 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.709 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.709 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.709 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.709 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.709 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.709 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.710 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.710 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.710 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.710 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.710 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.710 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.710 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.711 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.711 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.711 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.711 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.711 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.711 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.711 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.711 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.712 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.712 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.712 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.712 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.712 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.712 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.712 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.713 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.713 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.713 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.713 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.713 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.713 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.713 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.714 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.714 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.714 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.714 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.714 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.714 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.714 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.714 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.715 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.715 INFO:teuthology.orchestra.run.smithi073.stdout: "organization": { 2023-08-10T12:05:23.715 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "organization", 2023-08-10T12:05:23.715 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.715 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.715 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.715 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.716 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.716 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.716 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.716 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.716 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.716 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.716 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.717 INFO:teuthology.orchestra.run.smithi073.stdout: "proxy": { 2023-08-10T12:05:23.717 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "proxy", 2023-08-10T12:05:23.717 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.717 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.717 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.717 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.717 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.718 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.718 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.718 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.718 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.718 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.718 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.718 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.718 INFO:teuthology.orchestra.run.smithi073.stdout: "url": { 2023-08-10T12:05:23.719 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "url", 2023-08-10T12:05:23.719 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.719 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.719 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.719 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-08-10T12:05:23.719 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.719 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.719 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.720 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.720 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.720 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.720 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.720 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.720 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.720 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.720 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.721 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "test_orchestrator", 2023-08-10T12:05:23.721 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.721 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.721 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.721 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.721 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.721 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.721 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.722 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.722 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.722 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.722 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.722 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.722 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.722 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.723 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.723 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.723 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.723 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.723 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.723 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.723 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.723 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.724 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.724 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.724 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.724 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.724 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.724 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.724 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.725 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.725 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.725 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.725 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.725 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.725 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.725 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.726 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.726 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.726 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.726 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.726 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.726 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.726 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.726 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.727 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.727 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.727 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.727 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.727 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.727 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.727 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.728 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.728 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.728 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.728 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.728 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.728 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.728 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.729 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.729 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.729 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.729 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.729 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.729 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.729 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.729 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.730 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.730 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.730 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.730 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.730 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.730 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.730 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.730 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "volumes", 2023-08-10T12:05:23.731 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.731 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.731 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.731 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.731 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.731 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.731 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.732 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.732 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.732 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.732 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.732 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.732 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.732 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.732 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.733 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.733 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.733 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.733 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.733 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.733 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.733 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.733 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.734 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.734 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.734 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.734 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.734 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.734 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.734 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.734 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.735 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.735 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.735 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.735 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.735 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.735 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.735 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.736 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.736 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.736 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.736 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.736 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.736 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.736 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.737 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.737 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.737 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.737 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.737 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.737 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.737 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.737 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.738 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.738 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.738 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.738 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.738 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.738 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.738 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.739 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.739 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.739 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.739 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.739 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.739 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.739 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.739 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.740 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.740 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.740 INFO:teuthology.orchestra.run.smithi073.stdout: "max_concurrent_clones": { 2023-08-10T12:05:23.740 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_concurrent_clones", 2023-08-10T12:05:23.740 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.740 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.741 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.741 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "4", 2023-08-10T12:05:23.741 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.741 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.741 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.741 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Number of asynchronous cloner threads", 2023-08-10T12:05:23.741 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.741 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.742 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.742 INFO:teuthology.orchestra.run.smithi073.stdout: "snapshot_clone_delay": { 2023-08-10T12:05:23.742 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snapshot_clone_delay", 2023-08-10T12:05:23.742 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.742 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.742 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.742 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2023-08-10T12:05:23.743 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.743 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.743 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.743 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-08-10T12:05:23.743 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.743 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.743 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.743 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.744 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.744 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.744 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix", 2023-08-10T12:05:23.744 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-08-10T12:05:23.744 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-08-10T12:05:23.744 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-08-10T12:05:23.745 INFO:teuthology.orchestra.run.smithi073.stdout: "discovery_interval": { 2023-08-10T12:05:23.745 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "discovery_interval", 2023-08-10T12:05:23.745 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2023-08-10T12:05:23.745 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.745 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.745 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "100", 2023-08-10T12:05:23.745 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.745 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.746 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.746 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.746 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.746 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.746 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.746 INFO:teuthology.orchestra.run.smithi073.stdout: "identifier": { 2023-08-10T12:05:23.746 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "identifier", 2023-08-10T12:05:23.747 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.747 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.747 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.747 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.747 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.747 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.747 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.747 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.748 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.748 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.748 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.748 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.748 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2023-08-10T12:05:23.748 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2023-08-10T12:05:23.748 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-08-10T12:05:23.749 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.749 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.749 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2023-08-10T12:05:23.749 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.749 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.749 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.749 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.749 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.750 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.750 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.750 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.750 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-08-10T12:05:23.750 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-08-10T12:05:23.750 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.750 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.750 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.751 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.751 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.751 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.751 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.751 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.751 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.751 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.751 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.752 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.752 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.752 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.752 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.752 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.752 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.752 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.753 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-08-10T12:05:23.753 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-08-10T12:05:23.753 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.753 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.753 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.753 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.753 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.754 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.754 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.754 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.754 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.754 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.754 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.754 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-08-10T12:05:23.755 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-08-10T12:05:23.755 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.755 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.755 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.755 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-08-10T12:05:23.755 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.755 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.755 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-08-10T12:05:23.756 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-08-10T12:05:23.756 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-08-10T12:05:23.756 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-08-10T12:05:23.756 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-08-10T12:05:23.756 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-08-10T12:05:23.756 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-08-10T12:05:23.756 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.756 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.757 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.757 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.757 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.757 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.757 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-08-10T12:05:23.757 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-08-10T12:05:23.757 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-08-10T12:05:23.757 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.758 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-08-10T12:05:23.758 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-08-10T12:05:23.758 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.758 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.758 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.758 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.758 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.758 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.759 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.759 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.759 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_host": { 2023-08-10T12:05:23.759 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_host", 2023-08-10T12:05:23.759 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.759 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.759 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.760 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-08-10T12:05:23.760 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.760 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.760 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.760 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.760 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.760 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.760 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.761 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.761 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_port": { 2023-08-10T12:05:23.761 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_port", 2023-08-10T12:05:23.761 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-08-10T12:05:23.761 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.761 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.761 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10051", 2023-08-10T12:05:23.761 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.762 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.762 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.762 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.762 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.762 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.762 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.762 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.762 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_sender": { 2023-08-10T12:05:23.763 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_sender", 2023-08-10T12:05:23.763 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-08-10T12:05:23.763 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-08-10T12:05:23.763 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-08-10T12:05:23.763 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-08-10T12:05:23.763 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-08-10T12:05:23.763 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-08-10T12:05:23.763 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-08-10T12:05:23.764 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-08-10T12:05:23.764 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-08-10T12:05:23.764 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-08-10T12:05:23.764 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-08-10T12:05:23.764 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.764 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.764 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.764 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.765 INFO:teuthology.orchestra.run.smithi073.stdout: "services": { 2023-08-10T12:05:23.765 INFO:teuthology.orchestra.run.smithi073.stdout: "dashboard": "https://172.21.15.73:8443/" 2023-08-10T12:05:23.765 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.765 INFO:teuthology.orchestra.run.smithi073.stdout: "always_on_modules": { 2023-08-10T12:05:23.765 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus": [ 2023-08-10T12:05:23.765 INFO:teuthology.orchestra.run.smithi073.stdout: "balancer", 2023-08-10T12:05:23.765 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2023-08-10T12:05:23.766 INFO:teuthology.orchestra.run.smithi073.stdout: "devicehealth", 2023-08-10T12:05:23.766 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator", 2023-08-10T12:05:23.766 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscaler", 2023-08-10T12:05:23.766 INFO:teuthology.orchestra.run.smithi073.stdout: "progress", 2023-08-10T12:05:23.766 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_support", 2023-08-10T12:05:23.766 INFO:teuthology.orchestra.run.smithi073.stdout: "status", 2023-08-10T12:05:23.766 INFO:teuthology.orchestra.run.smithi073.stdout: "telemetry", 2023-08-10T12:05:23.766 INFO:teuthology.orchestra.run.smithi073.stdout: "volumes" 2023-08-10T12:05:23.767 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.767 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific": [ 2023-08-10T12:05:23.767 INFO:teuthology.orchestra.run.smithi073.stdout: "balancer", 2023-08-10T12:05:23.767 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2023-08-10T12:05:23.767 INFO:teuthology.orchestra.run.smithi073.stdout: "devicehealth", 2023-08-10T12:05:23.767 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator", 2023-08-10T12:05:23.767 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscaler", 2023-08-10T12:05:23.767 INFO:teuthology.orchestra.run.smithi073.stdout: "progress", 2023-08-10T12:05:23.768 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_support", 2023-08-10T12:05:23.768 INFO:teuthology.orchestra.run.smithi073.stdout: "status", 2023-08-10T12:05:23.768 INFO:teuthology.orchestra.run.smithi073.stdout: "telemetry", 2023-08-10T12:05:23.768 INFO:teuthology.orchestra.run.smithi073.stdout: "volumes" 2023-08-10T12:05:23.768 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.768 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy": [ 2023-08-10T12:05:23.768 INFO:teuthology.orchestra.run.smithi073.stdout: "balancer", 2023-08-10T12:05:23.768 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2023-08-10T12:05:23.769 INFO:teuthology.orchestra.run.smithi073.stdout: "devicehealth", 2023-08-10T12:05:23.769 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator", 2023-08-10T12:05:23.769 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscaler", 2023-08-10T12:05:23.769 INFO:teuthology.orchestra.run.smithi073.stdout: "progress", 2023-08-10T12:05:23.769 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_support", 2023-08-10T12:05:23.769 INFO:teuthology.orchestra.run.smithi073.stdout: "status", 2023-08-10T12:05:23.769 INFO:teuthology.orchestra.run.smithi073.stdout: "telemetry", 2023-08-10T12:05:23.769 INFO:teuthology.orchestra.run.smithi073.stdout: "volumes" 2023-08-10T12:05:23.770 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-08-10T12:05:23.770 INFO:teuthology.orchestra.run.smithi073.stdout: "reef": [ 2023-08-10T12:05:23.770 INFO:teuthology.orchestra.run.smithi073.stdout: "balancer", 2023-08-10T12:05:23.770 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2023-08-10T12:05:23.770 INFO:teuthology.orchestra.run.smithi073.stdout: "devicehealth", 2023-08-10T12:05:23.770 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator", 2023-08-10T12:05:23.770 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscaler", 2023-08-10T12:05:23.770 INFO:teuthology.orchestra.run.smithi073.stdout: "progress", 2023-08-10T12:05:23.771 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_support", 2023-08-10T12:05:23.771 INFO:teuthology.orchestra.run.smithi073.stdout: "status", 2023-08-10T12:05:23.771 INFO:teuthology.orchestra.run.smithi073.stdout: "telemetry", 2023-08-10T12:05:23.771 INFO:teuthology.orchestra.run.smithi073.stdout: "volumes" 2023-08-10T12:05:23.771 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-08-10T12:05:23.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.771 INFO:teuthology.orchestra.run.smithi073.stdout: "last_failure_osd_epoch": 86, 2023-08-10T12:05:23.771 INFO:teuthology.orchestra.run.smithi073.stdout: "active_clients": [ 2023-08-10T12:05:23.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.772 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "devicehealth", 2023-08-10T12:05:23.772 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2023-08-10T12:05:23.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.772 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2023-08-10T12:05:23.772 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2023-08-10T12:05:23.772 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2105285128 2023-08-10T12:05:23.773 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.773 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-08-10T12:05:23.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.773 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.773 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "libcephsqlite", 2023-08-10T12:05:23.773 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2023-08-10T12:05:23.773 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.773 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2023-08-10T12:05:23.774 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2023-08-10T12:05:23.774 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2188759072 2023-08-10T12:05:23.774 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.774 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-08-10T12:05:23.774 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.774 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.774 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_support", 2023-08-10T12:05:23.774 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2023-08-10T12:05:23.775 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.775 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2023-08-10T12:05:23.775 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2023-08-10T12:05:23.775 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2223564166 2023-08-10T12:05:23.775 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.775 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-08-10T12:05:23.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.775 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.776 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snap_schedule", 2023-08-10T12:05:23.776 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2023-08-10T12:05:23.776 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.776 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2023-08-10T12:05:23.776 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2023-08-10T12:05:23.776 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3157295336 2023-08-10T12:05:23.776 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.776 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-08-10T12:05:23.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.777 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.777 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snap_schedule", 2023-08-10T12:05:23.777 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2023-08-10T12:05:23.777 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.777 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2023-08-10T12:05:23.777 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2023-08-10T12:05:23.778 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2624353382 2023-08-10T12:05:23.778 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.778 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-08-10T12:05:23.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:23.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.778 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "volumes", 2023-08-10T12:05:23.778 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2023-08-10T12:05:23.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-08-10T12:05:23.779 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2023-08-10T12:05:23.779 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2023-08-10T12:05:23.779 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1915980355 2023-08-10T12:05:23.779 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.779 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-08-10T12:05:23.779 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:23.779 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-08-10T12:05:23.780 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T12:05:23.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.433+0000 7fb67eece700 1 -- 172.21.15.73:0/3787435009 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb6680a1300 msgr2=0x7fb6680a37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:23.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.433+0000 7fb67eece700 1 --2- 172.21.15.73:0/3787435009 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb6680a1300 0x7fb6680a37c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb678100710 tx=0x7fb66c009260 comp rx=0 tx=0).stop 2023-08-10T12:05:23.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.433+0000 7fb67eece700 1 -- 172.21.15.73:0/3787435009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb678105670 msgr2=0x7fb678196670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:23.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.433+0000 7fb67eece700 1 --2- 172.21.15.73:0/3787435009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb678105670 0x7fb678196670 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fb670009850 tx=0x7fb6700077f0 comp rx=0 tx=0).stop 2023-08-10T12:05:23.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.433+0000 7fb67eece700 1 -- 172.21.15.73:0/3787435009 shutdown_connections 2023-08-10T12:05:23.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.433+0000 7fb67eece700 1 --2- 172.21.15.73:0/3787435009 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fb6680a1300 0x7fb6680a37c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:23.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.433+0000 7fb67eece700 1 --2- 172.21.15.73:0/3787435009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb678105670 0x7fb678196670 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:23.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.433+0000 7fb67eece700 1 --2- 172.21.15.73:0/3787435009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6780ff5d0 0x7fb67819c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:23.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.433+0000 7fb67eece700 1 --2- 172.21.15.73:0/3787435009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6780fff90 0x7fb67819cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:23.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.433+0000 7fb67eece700 1 -- 172.21.15.73:0/3787435009 >> 172.21.15.73:0/3787435009 conn(0x7fb6780fb080 msgr2=0x7fb678068920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:23.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.433+0000 7fb67eece700 1 -- 172.21.15.73:0/3787435009 shutdown_connections 2023-08-10T12:05:23.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:21.433+0000 7fb67eece700 1 -- 172.21.15.73:0/3787435009 wait complete. 2023-08-10T12:05:23.783 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:21 smithi073 ceph-mon[128869]: pgmap v396: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 327 op/s 2023-08-10T12:05:23.783 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:21 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3499347989' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T12:05:23.783 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:21 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2658586798' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T12:05:23.784 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:21 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3533598736' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T12:05:23.784 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:21 smithi156 ceph-mon[130574]: pgmap v396: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 327 op/s 2023-08-10T12:05:23.784 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:21 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3499347989' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T12:05:23.784 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:21 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/2658586798' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T12:05:23.784 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:21 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3533598736' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T12:05:23.784 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:22 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3787435009' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-08-10T12:05:23.785 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:23 smithi156 ceph-mon[130574]: pgmap v397: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 328 op/s 2023-08-10T12:05:23.785 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:21 smithi152 ceph-mon[130220]: pgmap v396: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 327 op/s 2023-08-10T12:05:23.785 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:21 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3499347989' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T12:05:23.785 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:21 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/2658586798' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T12:05:23.785 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:21 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3533598736' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T12:05:23.785 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:22 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3787435009' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-08-10T12:05:23.786 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:23 smithi152 ceph-mon[130220]: pgmap v397: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 328 op/s 2023-08-10T12:05:23.793 DEBUG:tasks.check_counter:Getting stats from a 2023-08-10T12:05:23.793 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph daemon mds.a perf dump 2023-08-10T12:05:23.794 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:22 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3787435009' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-08-10T12:05:23.794 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:23 smithi073 ceph-mon[128869]: pgmap v397: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 328 op/s 2023-08-10T12:05:24.361 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T12:05:25.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:24 smithi152 ceph-mon[130220]: pgmap v398: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 256 op/s 2023-08-10T12:05:25.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:24 smithi156 ceph-mon[130574]: pgmap v398: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 256 op/s 2023-08-10T12:05:25.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:24 smithi073 ceph-mon[128869]: pgmap v398: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 256 op/s 2023-08-10T12:05:26.961 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T12:05:26.961 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-0": { 2023-08-10T12:05:26.961 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 1394, 2023-08-10T12:05:26.961 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 1396, 2023-08-10T12:05:26.961 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 71746867, 2023-08-10T12:05:26.962 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 433535, 2023-08-10T12:05:26.962 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 8, 2023-08-10T12:05:26.962 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 4, 2023-08-10T12:05:26.962 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.177836290, 2023-08-10T12:05:26.962 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.037917118, 2023-08-10T12:05:26.962 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.077641152, 2023-08-10T12:05:26.962 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.049424277, 2023-08-10T12:05:26.963 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:26.963 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 1394, 2023-08-10T12:05:26.963 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.346934123, 2023-08-10T12:05:26.963 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000248876 2023-08-10T12:05:26.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.963 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:26.963 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:26.964 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:26.964 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:26.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.964 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 0, 2023-08-10T12:05:26.964 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 0 2023-08-10T12:05:26.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.964 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-1": { 2023-08-10T12:05:26.964 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 934, 2023-08-10T12:05:26.965 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 1112, 2023-08-10T12:05:26.965 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 101676941, 2023-08-10T12:05:26.965 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 757904, 2023-08-10T12:05:26.965 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 8, 2023-08-10T12:05:26.965 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 6, 2023-08-10T12:05:26.965 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.171756733, 2023-08-10T12:05:26.965 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.031682091, 2023-08-10T12:05:26.966 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.098286870, 2023-08-10T12:05:26.966 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.032397906, 2023-08-10T12:05:26.966 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:26.966 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 1109, 2023-08-10T12:05:26.966 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.382865400, 2023-08-10T12:05:26.966 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000345234 2023-08-10T12:05:26.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.967 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:26.967 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:26.967 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:26.967 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:26.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.967 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 320, 2023-08-10T12:05:26.967 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 467984 2023-08-10T12:05:26.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.968 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-2": { 2023-08-10T12:05:26.968 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 1039, 2023-08-10T12:05:26.968 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 996, 2023-08-10T12:05:26.968 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 69080469, 2023-08-10T12:05:26.968 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 367861, 2023-08-10T12:05:26.968 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 5, 2023-08-10T12:05:26.968 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 4, 2023-08-10T12:05:26.968 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.139864394, 2023-08-10T12:05:26.969 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.031801843, 2023-08-10T12:05:26.969 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.085111114, 2023-08-10T12:05:26.969 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.027662853, 2023-08-10T12:05:26.969 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:26.969 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 996, 2023-08-10T12:05:26.969 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.146749282, 2023-08-10T12:05:26.969 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000147338 2023-08-10T12:05:26.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.970 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:26.970 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:26.970 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:26.970 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:26.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.970 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 1647040, 2023-08-10T12:05:26.970 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 138032 2023-08-10T12:05:26.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.971 INFO:teuthology.orchestra.run.smithi073.stdout: "cct": { 2023-08-10T12:05:26.971 INFO:teuthology.orchestra.run.smithi073.stdout: "total_workers": 1, 2023-08-10T12:05:26.971 INFO:teuthology.orchestra.run.smithi073.stdout: "unhealthy_workers": 0 2023-08-10T12:05:26.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.971 INFO:teuthology.orchestra.run.smithi073.stdout: "finisher-MDSRank": { 2023-08-10T12:05:26.971 INFO:teuthology.orchestra.run.smithi073.stdout: "queue_len": 0, 2023-08-10T12:05:26.972 INFO:teuthology.orchestra.run.smithi073.stdout: "complete_latency": { 2023-08-10T12:05:26.972 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 4899, 2023-08-10T12:05:26.972 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.145012788, 2023-08-10T12:05:26.972 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000029600 2023-08-10T12:05:26.972 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:26.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.972 INFO:teuthology.orchestra.run.smithi073.stdout: "finisher-PurgeQueue": { 2023-08-10T12:05:26.972 INFO:teuthology.orchestra.run.smithi073.stdout: "queue_len": 0, 2023-08-10T12:05:26.973 INFO:teuthology.orchestra.run.smithi073.stdout: "complete_latency": { 2023-08-10T12:05:26.973 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:26.973 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:26.973 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:26.973 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:26.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.973 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2023-08-10T12:05:26.973 INFO:teuthology.orchestra.run.smithi073.stdout: "request": 0, 2023-08-10T12:05:26.974 INFO:teuthology.orchestra.run.smithi073.stdout: "reply": 0, 2023-08-10T12:05:26.974 INFO:teuthology.orchestra.run.smithi073.stdout: "reply_latency": { 2023-08-10T12:05:26.974 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:26.974 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:26.974 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:26.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.974 INFO:teuthology.orchestra.run.smithi073.stdout: "slow_reply": 0, 2023-08-10T12:05:26.975 INFO:teuthology.orchestra.run.smithi073.stdout: "forward": 0, 2023-08-10T12:05:26.975 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_fetch_complete": 0, 2023-08-10T12:05:26.975 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_fetch_keys": 0, 2023-08-10T12:05:26.975 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_commit": 0, 2023-08-10T12:05:26.975 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_split": 0, 2023-08-10T12:05:26.975 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_merge": 0, 2023-08-10T12:05:26.975 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes": 28887, 2023-08-10T12:05:26.975 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_top": 181, 2023-08-10T12:05:26.976 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_bottom": 13896, 2023-08-10T12:05:26.976 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_pin_tail": 14810, 2023-08-10T12:05:26.976 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_pinned": 28628, 2023-08-10T12:05:26.976 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_expired": 774, 2023-08-10T12:05:26.976 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_with_caps": 0, 2023-08-10T12:05:26.976 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": 0, 2023-08-10T12:05:26.976 INFO:teuthology.orchestra.run.smithi073.stdout: "subtrees": 1, 2023-08-10T12:05:26.977 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse": 0, 2023-08-10T12:05:26.977 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_hit": 0, 2023-08-10T12:05:26.978 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_forward": 0, 2023-08-10T12:05:26.978 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_discover": 0, 2023-08-10T12:05:26.978 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_dir_fetch": 0, 2023-08-10T12:05:26.978 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_remote_ino": 0, 2023-08-10T12:05:26.978 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_lock": 0, 2023-08-10T12:05:26.978 INFO:teuthology.orchestra.run.smithi073.stdout: "load_cent": 0, 2023-08-10T12:05:26.978 INFO:teuthology.orchestra.run.smithi073.stdout: "q": 0, 2023-08-10T12:05:26.979 INFO:teuthology.orchestra.run.smithi073.stdout: "exported": 0, 2023-08-10T12:05:26.979 INFO:teuthology.orchestra.run.smithi073.stdout: "exported_inodes": 0, 2023-08-10T12:05:26.979 INFO:teuthology.orchestra.run.smithi073.stdout: "imported": 0, 2023-08-10T12:05:26.979 INFO:teuthology.orchestra.run.smithi073.stdout: "imported_inodes": 0, 2023-08-10T12:05:26.979 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_dir_fetch": 0, 2023-08-10T12:05:26.979 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_backtrace_fetch": 0, 2023-08-10T12:05:26.979 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_peer_discover": 0, 2023-08-10T12:05:26.979 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rfiles": 0, 2023-08-10T12:05:26.980 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rbytes": 0, 2023-08-10T12:05:26.980 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rsnaps": 0, 2023-08-10T12:05:26.980 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_backtrace_fetch": 0, 2023-08-10T12:05:26.980 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_set_tag": 0, 2023-08-10T12:05:26.980 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_backtrace_repaired": 0, 2023-08-10T12:05:26.980 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_inotable_repaired": 0, 2023-08-10T12:05:26.980 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dir_inodes": 0, 2023-08-10T12:05:26.981 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dir_base_inodes": 0, 2023-08-10T12:05:26.981 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dirfrag_rstats": 0, 2023-08-10T12:05:26.981 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_file_inodes": 0, 2023-08-10T12:05:26.981 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_inode_file_caps": 0, 2023-08-10T12:05:26.981 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_revoke": 0, 2023-08-10T12:05:26.981 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_grant": 0, 2023-08-10T12:05:26.981 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_trunc": 0, 2023-08-10T12:05:26.981 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-10T12:05:26.982 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-10T12:05:26.982 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_caps": 0, 2023-08-10T12:05:26.982 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_caps_dirty": 0, 2023-08-10T12:05:26.982 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_cap_release": 0, 2023-08-10T12:05:26.982 INFO:teuthology.orchestra.run.smithi073.stdout: "process_request_cap_release": 0 2023-08-10T12:05:26.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.982 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache": { 2023-08-10T12:05:26.982 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_update": 0, 2023-08-10T12:05:26.983 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_update_receipt": 0, 2023-08-10T12:05:26.983 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_try_discover": 0, 2023-08-10T12:05:26.983 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_send_discover": 0, 2023-08-10T12:05:26.983 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_handle_discover": 0, 2023-08-10T12:05:26.983 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays": 0, 2023-08-10T12:05:26.983 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays_delayed": 0, 2023-08-10T12:05:26.983 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays_enqueuing": 0, 2023-08-10T12:05:26.983 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_created": 0, 2023-08-10T12:05:26.984 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_enqueued": 0, 2023-08-10T12:05:26.984 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_reintegrated": 0, 2023-08-10T12:05:26.984 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_migrated": 0, 2023-08-10T12:05:26.984 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_processing": 0, 2023-08-10T12:05:26.984 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_enqueued": 0, 2023-08-10T12:05:26.984 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_prioritized": 0, 2023-08-10T12:05:26.984 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_started": 0, 2023-08-10T12:05:26.985 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_completed": 0, 2023-08-10T12:05:26.985 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_enqueue_scrub": 0, 2023-08-10T12:05:26.985 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_exportdir": 0, 2023-08-10T12:05:26.985 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_flush": 0, 2023-08-10T12:05:26.985 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_fragmentdir": 0, 2023-08-10T12:05:26.985 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_fragstats": 0, 2023-08-10T12:05:26.986 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_inodestats": 0 2023-08-10T12:05:26.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.986 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log": { 2023-08-10T12:05:26.986 INFO:teuthology.orchestra.run.smithi073.stdout: "evadd": 0, 2023-08-10T12:05:26.986 INFO:teuthology.orchestra.run.smithi073.stdout: "evex": 0, 2023-08-10T12:05:26.987 INFO:teuthology.orchestra.run.smithi073.stdout: "evtrm": 0, 2023-08-10T12:05:26.987 INFO:teuthology.orchestra.run.smithi073.stdout: "ev": 0, 2023-08-10T12:05:26.987 INFO:teuthology.orchestra.run.smithi073.stdout: "evexg": 0, 2023-08-10T12:05:26.987 INFO:teuthology.orchestra.run.smithi073.stdout: "evexd": 0, 2023-08-10T12:05:26.987 INFO:teuthology.orchestra.run.smithi073.stdout: "segadd": 0, 2023-08-10T12:05:26.987 INFO:teuthology.orchestra.run.smithi073.stdout: "segex": 0, 2023-08-10T12:05:26.987 INFO:teuthology.orchestra.run.smithi073.stdout: "segtrm": 0, 2023-08-10T12:05:26.988 INFO:teuthology.orchestra.run.smithi073.stdout: "seg": 110, 2023-08-10T12:05:26.988 INFO:teuthology.orchestra.run.smithi073.stdout: "segexg": 0, 2023-08-10T12:05:26.988 INFO:teuthology.orchestra.run.smithi073.stdout: "segexd": 0, 2023-08-10T12:05:26.988 INFO:teuthology.orchestra.run.smithi073.stdout: "expos": 4194304, 2023-08-10T12:05:26.988 INFO:teuthology.orchestra.run.smithi073.stdout: "wrpos": 0, 2023-08-10T12:05:26.988 INFO:teuthology.orchestra.run.smithi073.stdout: "rdpos": 243832728, 2023-08-10T12:05:26.989 INFO:teuthology.orchestra.run.smithi073.stdout: "jlat": { 2023-08-10T12:05:26.989 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:26.989 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:26.989 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:26.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.989 INFO:teuthology.orchestra.run.smithi073.stdout: "replayed": 73761 2023-08-10T12:05:26.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.989 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_mem": { 2023-08-10T12:05:26.990 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 7988, 2023-08-10T12:05:26.990 INFO:teuthology.orchestra.run.smithi073.stdout: "ino+": 29097, 2023-08-10T12:05:26.990 INFO:teuthology.orchestra.run.smithi073.stdout: "ino-": 21109, 2023-08-10T12:05:26.990 INFO:teuthology.orchestra.run.smithi073.stdout: "dir": 359, 2023-08-10T12:05:26.990 INFO:teuthology.orchestra.run.smithi073.stdout: "dir+": 905, 2023-08-10T12:05:26.990 INFO:teuthology.orchestra.run.smithi073.stdout: "dir-": 546, 2023-08-10T12:05:26.990 INFO:teuthology.orchestra.run.smithi073.stdout: "dn": 28887, 2023-08-10T12:05:26.990 INFO:teuthology.orchestra.run.smithi073.stdout: "dn+": 50784, 2023-08-10T12:05:26.991 INFO:teuthology.orchestra.run.smithi073.stdout: "dn-": 21897, 2023-08-10T12:05:26.991 INFO:teuthology.orchestra.run.smithi073.stdout: "cap": 0, 2023-08-10T12:05:26.991 INFO:teuthology.orchestra.run.smithi073.stdout: "cap+": 0, 2023-08-10T12:05:26.991 INFO:teuthology.orchestra.run.smithi073.stdout: "cap-": 0, 2023-08-10T12:05:26.991 INFO:teuthology.orchestra.run.smithi073.stdout: "rss": 116708, 2023-08-10T12:05:26.991 INFO:teuthology.orchestra.run.smithi073.stdout: "heap": 207152 2023-08-10T12:05:26.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.992 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_server": { 2023-08-10T12:05:26.992 INFO:teuthology.orchestra.run.smithi073.stdout: "dispatch_client_request": 0, 2023-08-10T12:05:26.992 INFO:teuthology.orchestra.run.smithi073.stdout: "dispatch_server_request": 0, 2023-08-10T12:05:26.992 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_request": 0, 2023-08-10T12:05:26.992 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_session": 0, 2023-08-10T12:05:26.992 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_peer_request": 0, 2023-08-10T12:05:26.992 INFO:teuthology.orchestra.run.smithi073.stdout: "req_create_latency": { 2023-08-10T12:05:26.992 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:26.993 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:26.993 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:26.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.993 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getattr_latency": { 2023-08-10T12:05:26.993 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:26.993 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:26.993 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:26.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.994 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getfilelock_latency": { 2023-08-10T12:05:26.994 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:26.994 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:26.994 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:26.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.994 INFO:teuthology.orchestra.run.smithi073.stdout: "req_link_latency": { 2023-08-10T12:05:26.994 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:26.994 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:26.995 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:26.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.995 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookup_latency": { 2023-08-10T12:05:26.995 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:26.995 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:26.995 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:26.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.995 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookuphash_latency": { 2023-08-10T12:05:26.996 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:26.996 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:26.996 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:26.996 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.996 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupino_latency": { 2023-08-10T12:05:26.996 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:26.996 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:26.997 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:26.997 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.997 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupname_latency": { 2023-08-10T12:05:26.997 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:26.997 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:26.997 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:26.997 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.997 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupparent_latency": { 2023-08-10T12:05:26.998 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:26.998 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:26.998 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:26.998 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.998 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupsnap_latency": { 2023-08-10T12:05:26.998 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:26.998 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:26.998 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:26.999 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:26.999 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lssnap_latency": { 2023-08-10T12:05:26.999 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:26.999 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:26.999 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:26.999 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.000 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mkdir_latency": { 2023-08-10T12:05:27.000 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:27.000 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:27.000 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:27.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.000 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mknod_latency": { 2023-08-10T12:05:27.001 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:27.001 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:27.001 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:27.001 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.001 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mksnap_latency": { 2023-08-10T12:05:27.001 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:27.001 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:27.002 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:27.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.002 INFO:teuthology.orchestra.run.smithi073.stdout: "req_open_latency": { 2023-08-10T12:05:27.002 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:27.002 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:27.002 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:27.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.003 INFO:teuthology.orchestra.run.smithi073.stdout: "req_readdir_latency": { 2023-08-10T12:05:27.003 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:27.003 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:27.003 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:27.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.003 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rename_latency": { 2023-08-10T12:05:27.004 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:27.004 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:27.004 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:27.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.004 INFO:teuthology.orchestra.run.smithi073.stdout: "req_renamesnap_latency": { 2023-08-10T12:05:27.004 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:27.004 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:27.005 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:27.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.005 INFO:teuthology.orchestra.run.smithi073.stdout: "req_snapdiff_latency": { 2023-08-10T12:05:27.005 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:27.005 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:27.006 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:27.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.006 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmdir_latency": { 2023-08-10T12:05:27.006 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:27.006 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:27.006 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:27.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.007 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmsnap_latency": { 2023-08-10T12:05:27.007 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:27.007 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:27.007 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:27.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.007 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmxattr_latency": { 2023-08-10T12:05:27.007 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:27.008 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:27.008 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:27.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.008 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setattr_latency": { 2023-08-10T12:05:27.008 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:27.008 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:27.009 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:27.009 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.009 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setdirlayout_latency": { 2023-08-10T12:05:27.009 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:27.009 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:27.009 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:27.009 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.009 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setfilelock_latency": { 2023-08-10T12:05:27.010 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:27.010 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:27.010 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:27.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.010 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setlayout_latency": { 2023-08-10T12:05:27.010 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:27.010 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:27.011 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:27.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.011 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setxattr_latency": { 2023-08-10T12:05:27.011 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:27.011 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:27.012 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:27.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.012 INFO:teuthology.orchestra.run.smithi073.stdout: "req_symlink_latency": { 2023-08-10T12:05:27.012 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:27.012 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:27.012 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:27.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.012 INFO:teuthology.orchestra.run.smithi073.stdout: "req_unlink_latency": { 2023-08-10T12:05:27.013 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:27.013 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:27.013 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:27.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.013 INFO:teuthology.orchestra.run.smithi073.stdout: "cap_revoke_eviction": 0, 2023-08-10T12:05:27.013 INFO:teuthology.orchestra.run.smithi073.stdout: "cap_acquisition_throttle": 0, 2023-08-10T12:05:27.013 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getvxattr_latency": { 2023-08-10T12:05:27.013 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:27.014 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:27.014 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:27.014 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:27.014 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.014 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_sessions": { 2023-08-10T12:05:27.014 INFO:teuthology.orchestra.run.smithi073.stdout: "session_count": 2, 2023-08-10T12:05:27.014 INFO:teuthology.orchestra.run.smithi073.stdout: "session_add": 5, 2023-08-10T12:05:27.015 INFO:teuthology.orchestra.run.smithi073.stdout: "session_remove": 3, 2023-08-10T12:05:27.015 INFO:teuthology.orchestra.run.smithi073.stdout: "sessions_open": 4, 2023-08-10T12:05:27.015 INFO:teuthology.orchestra.run.smithi073.stdout: "sessions_stale": 0, 2023-08-10T12:05:27.015 INFO:teuthology.orchestra.run.smithi073.stdout: "total_load": 0, 2023-08-10T12:05:27.015 INFO:teuthology.orchestra.run.smithi073.stdout: "average_load": 0, 2023-08-10T12:05:27.015 INFO:teuthology.orchestra.run.smithi073.stdout: "avg_session_uptime": 5238 2023-08-10T12:05:27.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.015 INFO:teuthology.orchestra.run.smithi073.stdout: "mempool": { 2023-08-10T12:05:27.016 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_bytes": 0, 2023-08-10T12:05:27.016 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_items": 0, 2023-08-10T12:05:27.016 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_bytes": 0, 2023-08-10T12:05:27.016 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_items": 0, 2023-08-10T12:05:27.016 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_bytes": 0, 2023-08-10T12:05:27.016 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_items": 0, 2023-08-10T12:05:27.016 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-10T12:05:27.016 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_items": 0, 2023-08-10T12:05:27.017 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-10T12:05:27.017 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_items": 0, 2023-08-10T12:05:27.017 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_bytes": 0, 2023-08-10T12:05:27.017 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_items": 0, 2023-08-10T12:05:27.017 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-10T12:05:27.017 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_items": 0, 2023-08-10T12:05:27.017 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_bytes": 0, 2023-08-10T12:05:27.017 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_items": 0, 2023-08-10T12:05:27.018 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_bytes": 0, 2023-08-10T12:05:27.018 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_items": 0, 2023-08-10T12:05:27.018 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-10T12:05:27.018 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_items": 0, 2023-08-10T12:05:27.018 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-10T12:05:27.018 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_items": 0, 2023-08-10T12:05:27.018 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_bytes": 0, 2023-08-10T12:05:27.019 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_items": 0, 2023-08-10T12:05:27.019 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_bytes": 0, 2023-08-10T12:05:27.019 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_items": 0, 2023-08-10T12:05:27.019 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-10T12:05:27.019 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_items": 0, 2023-08-10T12:05:27.019 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_bytes": 0, 2023-08-10T12:05:27.019 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_items": 0, 2023-08-10T12:05:27.019 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_bytes": 0, 2023-08-10T12:05:27.020 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_items": 0, 2023-08-10T12:05:27.020 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_bytes": 0, 2023-08-10T12:05:27.020 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_items": 0, 2023-08-10T12:05:27.020 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_bytes": 0, 2023-08-10T12:05:27.020 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_items": 0, 2023-08-10T12:05:27.020 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_bytes": 510033, 2023-08-10T12:05:27.020 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_items": 8250, 2023-08-10T12:05:27.020 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_bytes": 0, 2023-08-10T12:05:27.021 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_items": 0, 2023-08-10T12:05:27.021 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bytes": 0, 2023-08-10T12:05:27.021 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_items": 0, 2023-08-10T12:05:27.021 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_bytes": 0, 2023-08-10T12:05:27.021 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_items": 0, 2023-08-10T12:05:27.021 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_bytes": 0, 2023-08-10T12:05:27.021 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_items": 0, 2023-08-10T12:05:27.021 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_bytes": 8032, 2023-08-10T12:05:27.022 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_items": 167, 2023-08-10T12:05:27.022 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_bytes": 0, 2023-08-10T12:05:27.022 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_items": 0, 2023-08-10T12:05:27.022 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_bytes": 0, 2023-08-10T12:05:27.022 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_items": 0, 2023-08-10T12:05:27.022 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_bytes": 38858330, 2023-08-10T12:05:27.023 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_items": 407712, 2023-08-10T12:05:27.023 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_bytes": 0, 2023-08-10T12:05:27.023 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_items": 0, 2023-08-10T12:05:27.023 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_bytes": 0, 2023-08-10T12:05:27.023 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_items": 0 2023-08-10T12:05:27.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.023 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter": { 2023-08-10T12:05:27.024 INFO:teuthology.orchestra.run.smithi073.stdout: "op_active": 0, 2023-08-10T12:05:27.024 INFO:teuthology.orchestra.run.smithi073.stdout: "op_laggy": 0, 2023-08-10T12:05:27.024 INFO:teuthology.orchestra.run.smithi073.stdout: "op_send": 3065, 2023-08-10T12:05:27.024 INFO:teuthology.orchestra.run.smithi073.stdout: "op_send_bytes": 21, 2023-08-10T12:05:27.024 INFO:teuthology.orchestra.run.smithi073.stdout: "op_resend": 3, 2023-08-10T12:05:27.024 INFO:teuthology.orchestra.run.smithi073.stdout: "op_reply": 3065, 2023-08-10T12:05:27.024 INFO:teuthology.orchestra.run.smithi073.stdout: "op_latency": { 2023-08-10T12:05:27.024 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 3065, 2023-08-10T12:05:27.025 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 18.506571670, 2023-08-10T12:05:27.025 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.006038033 2023-08-10T12:05:27.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.025 INFO:teuthology.orchestra.run.smithi073.stdout: "op_inflight": 0, 2023-08-10T12:05:27.025 INFO:teuthology.orchestra.run.smithi073.stdout: "oplen_avg": { 2023-08-10T12:05:27.025 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 3065, 2023-08-10T12:05:27.025 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 3066 2023-08-10T12:05:27.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.026 INFO:teuthology.orchestra.run.smithi073.stdout: "op": 3065, 2023-08-10T12:05:27.026 INFO:teuthology.orchestra.run.smithi073.stdout: "op_r": 3065, 2023-08-10T12:05:27.026 INFO:teuthology.orchestra.run.smithi073.stdout: "op_w": 0, 2023-08-10T12:05:27.026 INFO:teuthology.orchestra.run.smithi073.stdout: "op_rmw": 0, 2023-08-10T12:05:27.026 INFO:teuthology.orchestra.run.smithi073.stdout: "op_pg": 0, 2023-08-10T12:05:27.026 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_stat": 1858, 2023-08-10T12:05:27.026 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_create": 0, 2023-08-10T12:05:27.026 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_read": 1205, 2023-08-10T12:05:27.027 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_write": 0, 2023-08-10T12:05:27.027 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_writefull": 0, 2023-08-10T12:05:27.027 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_writesame": 0, 2023-08-10T12:05:27.027 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_append": 0, 2023-08-10T12:05:27.027 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_zero": 0, 2023-08-10T12:05:27.027 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_truncate": 0, 2023-08-10T12:05:27.027 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_delete": 0, 2023-08-10T12:05:27.028 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_mapext": 0, 2023-08-10T12:05:27.028 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_sparse_read": 0, 2023-08-10T12:05:27.028 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_clonerange": 0, 2023-08-10T12:05:27.028 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_getxattr": 1, 2023-08-10T12:05:27.028 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_setxattr": 0, 2023-08-10T12:05:27.028 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_cmpxattr": 0, 2023-08-10T12:05:27.028 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_rmxattr": 0, 2023-08-10T12:05:27.028 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_resetxattrs": 0, 2023-08-10T12:05:27.029 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_call": 0, 2023-08-10T12:05:27.029 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_watch": 0, 2023-08-10T12:05:27.029 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_notify": 0, 2023-08-10T12:05:27.029 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_src_cmpxattr": 0, 2023-08-10T12:05:27.029 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_pgls": 0, 2023-08-10T12:05:27.029 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_pgls_filter": 0, 2023-08-10T12:05:27.029 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_other": 0, 2023-08-10T12:05:27.029 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_active": 0, 2023-08-10T12:05:27.030 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_send": 0, 2023-08-10T12:05:27.030 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_resend": 0, 2023-08-10T12:05:27.030 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_ping": 0, 2023-08-10T12:05:27.030 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_active": 0, 2023-08-10T12:05:27.030 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_send": 0, 2023-08-10T12:05:27.030 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_resend": 0, 2023-08-10T12:05:27.030 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_active": 0, 2023-08-10T12:05:27.030 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_send": 0, 2023-08-10T12:05:27.031 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_resend": 0, 2023-08-10T12:05:27.031 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_active": 0, 2023-08-10T12:05:27.031 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_send": 0, 2023-08-10T12:05:27.031 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_resend": 0, 2023-08-10T12:05:27.031 INFO:teuthology.orchestra.run.smithi073.stdout: "command_active": 0, 2023-08-10T12:05:27.031 INFO:teuthology.orchestra.run.smithi073.stdout: "command_send": 0, 2023-08-10T12:05:27.031 INFO:teuthology.orchestra.run.smithi073.stdout: "command_resend": 0, 2023-08-10T12:05:27.031 INFO:teuthology.orchestra.run.smithi073.stdout: "map_epoch": 98, 2023-08-10T12:05:27.032 INFO:teuthology.orchestra.run.smithi073.stdout: "map_full": 0, 2023-08-10T12:05:27.032 INFO:teuthology.orchestra.run.smithi073.stdout: "map_inc": 15, 2023-08-10T12:05:27.032 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_sessions": 10, 2023-08-10T12:05:27.032 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_session_open": 10, 2023-08-10T12:05:27.032 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_session_close": 0, 2023-08-10T12:05:27.032 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_laggy": 0, 2023-08-10T12:05:27.032 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_wr": 0, 2023-08-10T12:05:27.033 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_rd": 2, 2023-08-10T12:05:27.033 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_del": 0 2023-08-10T12:05:27.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.033 INFO:teuthology.orchestra.run.smithi073.stdout: "oft": { 2023-08-10T12:05:27.033 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_objs": 0, 2023-08-10T12:05:27.033 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_kv_pairs": 0, 2023-08-10T12:05:27.033 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_updates": 0, 2023-08-10T12:05:27.033 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_removes": 0 2023-08-10T12:05:27.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.034 INFO:teuthology.orchestra.run.smithi073.stdout: "osd-slow-ops": { 2023-08-10T12:05:27.034 INFO:teuthology.orchestra.run.smithi073.stdout: "slow_ops_count": 0 2023-08-10T12:05:27.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.034 INFO:teuthology.orchestra.run.smithi073.stdout: "purge_queue": { 2023-08-10T12:05:27.034 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_ops": 0, 2023-08-10T12:05:27.034 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_ops_high_water": 0, 2023-08-10T12:05:27.034 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing": 0, 2023-08-10T12:05:27.035 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_high_water": 0, 2023-08-10T12:05:27.035 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executed": 0, 2023-08-10T12:05:27.035 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_item_in_journal": 0 2023-08-10T12:05:27.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.035 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-10T12:05:27.035 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2023-08-10T12:05:27.035 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2023-08-10T12:05:27.035 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2023-08-10T12:05:27.036 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 3363, 2023-08-10T12:05:27.036 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 242183596, 2023-08-10T12:05:27.036 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:27.036 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 3363, 2023-08-10T12:05:27.036 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2023-08-10T12:05:27.036 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2023-08-10T12:05:27.036 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 3363, 2023-08-10T12:05:27.037 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 242183596, 2023-08-10T12:05:27.037 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2023-08-10T12:05:27.037 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:27.037 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:27.037 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:27.037 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:27.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.037 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-objecter_bytes": { 2023-08-10T12:05:27.038 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2023-08-10T12:05:27.038 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2023-08-10T12:05:27.038 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2023-08-10T12:05:27.038 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2023-08-10T12:05:27.038 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2023-08-10T12:05:27.038 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:27.038 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:27.038 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 3065, 2023-08-10T12:05:27.039 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 240005697, 2023-08-10T12:05:27.039 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 3065, 2023-08-10T12:05:27.039 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 240005697, 2023-08-10T12:05:27.039 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2023-08-10T12:05:27.039 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:27.039 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:27.039 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:27.039 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:27.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.040 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-objecter_ops": { 2023-08-10T12:05:27.040 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2023-08-10T12:05:27.040 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 1024, 2023-08-10T12:05:27.040 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2023-08-10T12:05:27.040 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2023-08-10T12:05:27.041 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2023-08-10T12:05:27.041 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:27.041 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:27.041 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 3065, 2023-08-10T12:05:27.041 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 3065, 2023-08-10T12:05:27.041 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 3065, 2023-08-10T12:05:27.041 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 3065, 2023-08-10T12:05:27.042 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2023-08-10T12:05:27.042 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:27.042 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:27.042 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:27.042 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:27.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.042 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-write_buf_throttle": { 2023-08-10T12:05:27.042 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2023-08-10T12:05:27.043 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 3758096384, 2023-08-10T12:05:27.043 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2023-08-10T12:05:27.043 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2023-08-10T12:05:27.043 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2023-08-10T12:05:27.043 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:27.043 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:27.043 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2023-08-10T12:05:27.043 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2023-08-10T12:05:27.044 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 0, 2023-08-10T12:05:27.044 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 0, 2023-08-10T12:05:27.044 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2023-08-10T12:05:27.044 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:27.044 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:27.044 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:27.044 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:27.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:27.045 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-write_buf_throttle-0x55b1a3246460": { 2023-08-10T12:05:27.045 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2023-08-10T12:05:27.045 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 3758096384, 2023-08-10T12:05:27.045 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2023-08-10T12:05:27.045 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2023-08-10T12:05:27.045 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2023-08-10T12:05:27.045 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:27.045 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:27.046 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2023-08-10T12:05:27.046 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2023-08-10T12:05:27.046 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 0, 2023-08-10T12:05:27.046 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 0, 2023-08-10T12:05:27.046 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2023-08-10T12:05:27.046 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:27.046 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:27.046 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:27.047 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:27.047 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:27.047 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T12:05:27.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:27 smithi073 ceph-mon[128869]: pgmap v399: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 232 op/s 2023-08-10T12:05:27.427 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2023-08-10T12:05:27.427 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2023-08-10T12:05:27.428 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2023-08-10T12:05:27.428 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2023-08-10T12:05:27.428 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2023-08-10T12:05:27.428 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2023-08-10T12:05:27.428 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2023-08-10T12:05:27.429 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=0 2023-08-10T12:05:27.429 DEBUG:tasks.check_counter:Getting stats from d 2023-08-10T12:05:27.429 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph daemon mds.d perf dump 2023-08-10T12:05:27.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:27 smithi152 ceph-mon[130220]: pgmap v399: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 232 op/s 2023-08-10T12:05:27.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:27 smithi156 ceph-mon[130574]: pgmap v399: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 232 op/s 2023-08-10T12:05:27.981 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T12:05:29.182 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:29 smithi073 ceph-mon[128869]: pgmap v400: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 971 KiB/s wr, 131 op/s 2023-08-10T12:05:29.444 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T12:05:29.445 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-0": { 2023-08-10T12:05:29.445 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 938, 2023-08-10T12:05:29.445 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 940, 2023-08-10T12:05:29.445 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 114380997, 2023-08-10T12:05:29.445 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 291728, 2023-08-10T12:05:29.445 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 7, 2023-08-10T12:05:29.446 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 3, 2023-08-10T12:05:29.446 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.152472013, 2023-08-10T12:05:29.446 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.024115464, 2023-08-10T12:05:29.446 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.086814216, 2023-08-10T12:05:29.446 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.032264362, 2023-08-10T12:05:29.446 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:29.446 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 938, 2023-08-10T12:05:29.446 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.298953706, 2023-08-10T12:05:29.447 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000318713 2023-08-10T12:05:29.447 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.447 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:29.447 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.447 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.447 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.447 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.448 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 0, 2023-08-10T12:05:29.448 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 0 2023-08-10T12:05:29.448 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.448 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-1": { 2023-08-10T12:05:29.448 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 612, 2023-08-10T12:05:29.448 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 792, 2023-08-10T12:05:29.448 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 96699619, 2023-08-10T12:05:29.449 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 529364, 2023-08-10T12:05:29.449 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 8, 2023-08-10T12:05:29.449 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 6, 2023-08-10T12:05:29.449 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.113600111, 2023-08-10T12:05:29.449 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.023300268, 2023-08-10T12:05:29.449 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.065373450, 2023-08-10T12:05:29.449 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.018794866, 2023-08-10T12:05:29.449 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:29.450 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 790, 2023-08-10T12:05:29.450 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.124316338, 2023-08-10T12:05:29.450 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000157362 2023-08-10T12:05:29.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.450 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:29.450 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.450 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.450 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.451 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.451 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-08-10T12:05:29.451 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 340832 2023-08-10T12:05:29.451 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.451 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-2": { 2023-08-10T12:05:29.451 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 784, 2023-08-10T12:05:29.451 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 755, 2023-08-10T12:05:29.451 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 94498170, 2023-08-10T12:05:29.452 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 294744, 2023-08-10T12:05:29.452 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 5, 2023-08-10T12:05:29.452 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 4, 2023-08-10T12:05:29.452 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.131284804, 2023-08-10T12:05:29.452 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.025814202, 2023-08-10T12:05:29.452 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.090837159, 2023-08-10T12:05:29.452 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.019940409, 2023-08-10T12:05:29.453 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:29.453 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 754, 2023-08-10T12:05:29.453 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.132537278, 2023-08-10T12:05:29.453 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000175778 2023-08-10T12:05:29.453 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.453 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:29.453 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.453 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.454 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.454 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.454 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 1571168, 2023-08-10T12:05:29.454 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 140176 2023-08-10T12:05:29.454 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.454 INFO:teuthology.orchestra.run.smithi073.stdout: "cct": { 2023-08-10T12:05:29.454 INFO:teuthology.orchestra.run.smithi073.stdout: "total_workers": 1, 2023-08-10T12:05:29.454 INFO:teuthology.orchestra.run.smithi073.stdout: "unhealthy_workers": 0 2023-08-10T12:05:29.455 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.455 INFO:teuthology.orchestra.run.smithi073.stdout: "finisher-MDSRank": { 2023-08-10T12:05:29.455 INFO:teuthology.orchestra.run.smithi073.stdout: "queue_len": 0, 2023-08-10T12:05:29.455 INFO:teuthology.orchestra.run.smithi073.stdout: "complete_latency": { 2023-08-10T12:05:29.455 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 3156, 2023-08-10T12:05:29.455 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.691301716, 2023-08-10T12:05:29.455 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000219043 2023-08-10T12:05:29.456 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:29.456 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.456 INFO:teuthology.orchestra.run.smithi073.stdout: "finisher-PurgeQueue": { 2023-08-10T12:05:29.456 INFO:teuthology.orchestra.run.smithi073.stdout: "queue_len": 0, 2023-08-10T12:05:29.456 INFO:teuthology.orchestra.run.smithi073.stdout: "complete_latency": { 2023-08-10T12:05:29.456 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.456 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.456 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.457 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:29.457 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.457 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2023-08-10T12:05:29.457 INFO:teuthology.orchestra.run.smithi073.stdout: "request": 0, 2023-08-10T12:05:29.457 INFO:teuthology.orchestra.run.smithi073.stdout: "reply": 0, 2023-08-10T12:05:29.457 INFO:teuthology.orchestra.run.smithi073.stdout: "reply_latency": { 2023-08-10T12:05:29.457 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.457 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.458 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.458 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.458 INFO:teuthology.orchestra.run.smithi073.stdout: "slow_reply": 0, 2023-08-10T12:05:29.458 INFO:teuthology.orchestra.run.smithi073.stdout: "forward": 0, 2023-08-10T12:05:29.458 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_fetch_complete": 0, 2023-08-10T12:05:29.458 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_fetch_keys": 0, 2023-08-10T12:05:29.458 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_commit": 0, 2023-08-10T12:05:29.458 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_split": 0, 2023-08-10T12:05:29.459 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_merge": 0, 2023-08-10T12:05:29.459 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes": 78644, 2023-08-10T12:05:29.459 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_top": 54929, 2023-08-10T12:05:29.459 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_bottom": 23711, 2023-08-10T12:05:29.459 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_pin_tail": 4, 2023-08-10T12:05:29.459 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_pinned": 174, 2023-08-10T12:05:29.459 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_expired": 1254, 2023-08-10T12:05:29.460 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_with_caps": 0, 2023-08-10T12:05:29.460 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": 0, 2023-08-10T12:05:29.460 INFO:teuthology.orchestra.run.smithi073.stdout: "subtrees": 3, 2023-08-10T12:05:29.460 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse": 0, 2023-08-10T12:05:29.460 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_hit": 0, 2023-08-10T12:05:29.460 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_forward": 0, 2023-08-10T12:05:29.460 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_discover": 0, 2023-08-10T12:05:29.460 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_dir_fetch": 0, 2023-08-10T12:05:29.461 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_remote_ino": 0, 2023-08-10T12:05:29.461 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_lock": 0, 2023-08-10T12:05:29.461 INFO:teuthology.orchestra.run.smithi073.stdout: "load_cent": 0, 2023-08-10T12:05:29.461 INFO:teuthology.orchestra.run.smithi073.stdout: "q": 0, 2023-08-10T12:05:29.461 INFO:teuthology.orchestra.run.smithi073.stdout: "exported": 0, 2023-08-10T12:05:29.461 INFO:teuthology.orchestra.run.smithi073.stdout: "exported_inodes": 0, 2023-08-10T12:05:29.461 INFO:teuthology.orchestra.run.smithi073.stdout: "imported": 0, 2023-08-10T12:05:29.461 INFO:teuthology.orchestra.run.smithi073.stdout: "imported_inodes": 0, 2023-08-10T12:05:29.462 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_dir_fetch": 0, 2023-08-10T12:05:29.462 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_backtrace_fetch": 0, 2023-08-10T12:05:29.462 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_peer_discover": 0, 2023-08-10T12:05:29.462 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rfiles": 599, 2023-08-10T12:05:29.462 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rbytes": 12120191, 2023-08-10T12:05:29.463 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rsnaps": 7, 2023-08-10T12:05:29.463 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_backtrace_fetch": 0, 2023-08-10T12:05:29.463 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_set_tag": 0, 2023-08-10T12:05:29.463 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_backtrace_repaired": 0, 2023-08-10T12:05:29.463 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_inotable_repaired": 0, 2023-08-10T12:05:29.463 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dir_inodes": 0, 2023-08-10T12:05:29.463 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dir_base_inodes": 0, 2023-08-10T12:05:29.463 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dirfrag_rstats": 0, 2023-08-10T12:05:29.464 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_file_inodes": 0, 2023-08-10T12:05:29.464 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_inode_file_caps": 0, 2023-08-10T12:05:29.464 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_revoke": 0, 2023-08-10T12:05:29.464 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_grant": 0, 2023-08-10T12:05:29.464 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_trunc": 0, 2023-08-10T12:05:29.464 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-10T12:05:29.464 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-10T12:05:29.464 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_caps": 0, 2023-08-10T12:05:29.465 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_caps_dirty": 0, 2023-08-10T12:05:29.465 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_cap_release": 0, 2023-08-10T12:05:29.465 INFO:teuthology.orchestra.run.smithi073.stdout: "process_request_cap_release": 0 2023-08-10T12:05:29.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.465 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache": { 2023-08-10T12:05:29.465 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_update": 0, 2023-08-10T12:05:29.465 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_update_receipt": 0, 2023-08-10T12:05:29.465 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_try_discover": 0, 2023-08-10T12:05:29.466 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_send_discover": 0, 2023-08-10T12:05:29.466 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_handle_discover": 0, 2023-08-10T12:05:29.466 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays": 0, 2023-08-10T12:05:29.466 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays_delayed": 0, 2023-08-10T12:05:29.466 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays_enqueuing": 0, 2023-08-10T12:05:29.466 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_created": 0, 2023-08-10T12:05:29.466 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_enqueued": 0, 2023-08-10T12:05:29.467 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_reintegrated": 0, 2023-08-10T12:05:29.467 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_migrated": 0, 2023-08-10T12:05:29.467 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_processing": 0, 2023-08-10T12:05:29.467 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_enqueued": 0, 2023-08-10T12:05:29.467 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_prioritized": 0, 2023-08-10T12:05:29.467 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_started": 0, 2023-08-10T12:05:29.467 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_completed": 0, 2023-08-10T12:05:29.467 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_enqueue_scrub": 0, 2023-08-10T12:05:29.468 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_exportdir": 0, 2023-08-10T12:05:29.468 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_flush": 0, 2023-08-10T12:05:29.468 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_fragmentdir": 0, 2023-08-10T12:05:29.468 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_fragstats": 0, 2023-08-10T12:05:29.468 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_inodestats": 0 2023-08-10T12:05:29.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.468 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log": { 2023-08-10T12:05:29.468 INFO:teuthology.orchestra.run.smithi073.stdout: "evadd": 0, 2023-08-10T12:05:29.469 INFO:teuthology.orchestra.run.smithi073.stdout: "evex": 0, 2023-08-10T12:05:29.469 INFO:teuthology.orchestra.run.smithi073.stdout: "evtrm": 0, 2023-08-10T12:05:29.469 INFO:teuthology.orchestra.run.smithi073.stdout: "ev": 0, 2023-08-10T12:05:29.469 INFO:teuthology.orchestra.run.smithi073.stdout: "evexg": 0, 2023-08-10T12:05:29.469 INFO:teuthology.orchestra.run.smithi073.stdout: "evexd": 0, 2023-08-10T12:05:29.469 INFO:teuthology.orchestra.run.smithi073.stdout: "segadd": 0, 2023-08-10T12:05:29.469 INFO:teuthology.orchestra.run.smithi073.stdout: "segex": 0, 2023-08-10T12:05:29.469 INFO:teuthology.orchestra.run.smithi073.stdout: "segtrm": 0, 2023-08-10T12:05:29.470 INFO:teuthology.orchestra.run.smithi073.stdout: "seg": 2, 2023-08-10T12:05:29.470 INFO:teuthology.orchestra.run.smithi073.stdout: "segexg": 0, 2023-08-10T12:05:29.470 INFO:teuthology.orchestra.run.smithi073.stdout: "segexd": 0, 2023-08-10T12:05:29.470 INFO:teuthology.orchestra.run.smithi073.stdout: "expos": 402503308, 2023-08-10T12:05:29.470 INFO:teuthology.orchestra.run.smithi073.stdout: "wrpos": 0, 2023-08-10T12:05:29.470 INFO:teuthology.orchestra.run.smithi073.stdout: "rdpos": 402525630, 2023-08-10T12:05:29.470 INFO:teuthology.orchestra.run.smithi073.stdout: "jlat": { 2023-08-10T12:05:29.470 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.471 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.471 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.471 INFO:teuthology.orchestra.run.smithi073.stdout: "replayed": 81782 2023-08-10T12:05:29.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.471 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_mem": { 2023-08-10T12:05:29.471 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 27159, 2023-08-10T12:05:29.471 INFO:teuthology.orchestra.run.smithi073.stdout: "ino+": 57560, 2023-08-10T12:05:29.472 INFO:teuthology.orchestra.run.smithi073.stdout: "ino-": 30401, 2023-08-10T12:05:29.472 INFO:teuthology.orchestra.run.smithi073.stdout: "dir": 1037, 2023-08-10T12:05:29.472 INFO:teuthology.orchestra.run.smithi073.stdout: "dir+": 1522, 2023-08-10T12:05:29.472 INFO:teuthology.orchestra.run.smithi073.stdout: "dir-": 485, 2023-08-10T12:05:29.472 INFO:teuthology.orchestra.run.smithi073.stdout: "dn": 78644, 2023-08-10T12:05:29.472 INFO:teuthology.orchestra.run.smithi073.stdout: "dn+": 96766, 2023-08-10T12:05:29.472 INFO:teuthology.orchestra.run.smithi073.stdout: "dn-": 18122, 2023-08-10T12:05:29.473 INFO:teuthology.orchestra.run.smithi073.stdout: "cap": 0, 2023-08-10T12:05:29.473 INFO:teuthology.orchestra.run.smithi073.stdout: "cap+": 0, 2023-08-10T12:05:29.473 INFO:teuthology.orchestra.run.smithi073.stdout: "cap-": 0, 2023-08-10T12:05:29.473 INFO:teuthology.orchestra.run.smithi073.stdout: "rss": 188984, 2023-08-10T12:05:29.473 INFO:teuthology.orchestra.run.smithi073.stdout: "heap": 207152 2023-08-10T12:05:29.473 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.473 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_server": { 2023-08-10T12:05:29.473 INFO:teuthology.orchestra.run.smithi073.stdout: "dispatch_client_request": 0, 2023-08-10T12:05:29.474 INFO:teuthology.orchestra.run.smithi073.stdout: "dispatch_server_request": 0, 2023-08-10T12:05:29.474 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_request": 0, 2023-08-10T12:05:29.474 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_session": 0, 2023-08-10T12:05:29.474 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_peer_request": 0, 2023-08-10T12:05:29.474 INFO:teuthology.orchestra.run.smithi073.stdout: "req_create_latency": { 2023-08-10T12:05:29.474 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.474 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.474 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.475 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.475 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getattr_latency": { 2023-08-10T12:05:29.475 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.475 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.475 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.475 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.475 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getfilelock_latency": { 2023-08-10T12:05:29.475 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.476 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.476 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.476 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.476 INFO:teuthology.orchestra.run.smithi073.stdout: "req_link_latency": { 2023-08-10T12:05:29.476 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.476 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.476 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.477 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.477 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookup_latency": { 2023-08-10T12:05:29.477 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.477 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.477 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.477 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.477 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookuphash_latency": { 2023-08-10T12:05:29.477 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.478 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.478 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.478 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.478 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupino_latency": { 2023-08-10T12:05:29.478 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.478 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.478 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.478 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.479 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupname_latency": { 2023-08-10T12:05:29.479 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.479 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.479 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.479 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.479 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupparent_latency": { 2023-08-10T12:05:29.479 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.479 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.480 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.480 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.480 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupsnap_latency": { 2023-08-10T12:05:29.480 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.480 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.480 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.480 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.481 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lssnap_latency": { 2023-08-10T12:05:29.481 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.481 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.481 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.481 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.481 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mkdir_latency": { 2023-08-10T12:05:29.481 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.481 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.482 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.482 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.482 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mknod_latency": { 2023-08-10T12:05:29.482 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.482 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.482 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.482 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.482 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mksnap_latency": { 2023-08-10T12:05:29.483 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.483 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.483 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.483 INFO:teuthology.orchestra.run.smithi073.stdout: "req_open_latency": { 2023-08-10T12:05:29.483 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.483 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.483 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.484 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.484 INFO:teuthology.orchestra.run.smithi073.stdout: "req_readdir_latency": { 2023-08-10T12:05:29.484 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.484 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.484 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.484 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.484 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rename_latency": { 2023-08-10T12:05:29.485 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.485 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.485 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.485 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.485 INFO:teuthology.orchestra.run.smithi073.stdout: "req_renamesnap_latency": { 2023-08-10T12:05:29.485 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.485 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.485 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.486 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.486 INFO:teuthology.orchestra.run.smithi073.stdout: "req_snapdiff_latency": { 2023-08-10T12:05:29.486 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.486 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.486 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.486 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.486 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmdir_latency": { 2023-08-10T12:05:29.486 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.487 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.487 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.487 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.487 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmsnap_latency": { 2023-08-10T12:05:29.487 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.487 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.487 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.487 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.488 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmxattr_latency": { 2023-08-10T12:05:29.488 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.488 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.488 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.488 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.488 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setattr_latency": { 2023-08-10T12:05:29.488 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.489 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.489 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.489 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setdirlayout_latency": { 2023-08-10T12:05:29.489 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.489 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.489 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.490 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setfilelock_latency": { 2023-08-10T12:05:29.490 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.490 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.490 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.490 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.490 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setlayout_latency": { 2023-08-10T12:05:29.490 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.490 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.491 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.491 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setxattr_latency": { 2023-08-10T12:05:29.491 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.491 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.491 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.491 INFO:teuthology.orchestra.run.smithi073.stdout: "req_symlink_latency": { 2023-08-10T12:05:29.492 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.492 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.492 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.492 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.492 INFO:teuthology.orchestra.run.smithi073.stdout: "req_unlink_latency": { 2023-08-10T12:05:29.492 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.492 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.493 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.493 INFO:teuthology.orchestra.run.smithi073.stdout: "cap_revoke_eviction": 0, 2023-08-10T12:05:29.493 INFO:teuthology.orchestra.run.smithi073.stdout: "cap_acquisition_throttle": 0, 2023-08-10T12:05:29.493 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getvxattr_latency": { 2023-08-10T12:05:29.493 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.493 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.493 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.494 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:29.494 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.494 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_sessions": { 2023-08-10T12:05:29.494 INFO:teuthology.orchestra.run.smithi073.stdout: "session_count": 2, 2023-08-10T12:05:29.494 INFO:teuthology.orchestra.run.smithi073.stdout: "session_add": 2, 2023-08-10T12:05:29.494 INFO:teuthology.orchestra.run.smithi073.stdout: "session_remove": 0, 2023-08-10T12:05:29.494 INFO:teuthology.orchestra.run.smithi073.stdout: "sessions_open": 0, 2023-08-10T12:05:29.494 INFO:teuthology.orchestra.run.smithi073.stdout: "sessions_stale": 0, 2023-08-10T12:05:29.495 INFO:teuthology.orchestra.run.smithi073.stdout: "total_load": 0, 2023-08-10T12:05:29.495 INFO:teuthology.orchestra.run.smithi073.stdout: "average_load": 0, 2023-08-10T12:05:29.495 INFO:teuthology.orchestra.run.smithi073.stdout: "avg_session_uptime": 3005 2023-08-10T12:05:29.495 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.495 INFO:teuthology.orchestra.run.smithi073.stdout: "mempool": { 2023-08-10T12:05:29.495 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_bytes": 0, 2023-08-10T12:05:29.495 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_items": 0, 2023-08-10T12:05:29.495 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_bytes": 0, 2023-08-10T12:05:29.496 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_items": 0, 2023-08-10T12:05:29.496 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_bytes": 0, 2023-08-10T12:05:29.496 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_items": 0, 2023-08-10T12:05:29.496 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-10T12:05:29.496 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_items": 0, 2023-08-10T12:05:29.496 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-10T12:05:29.496 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_items": 0, 2023-08-10T12:05:29.497 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_bytes": 0, 2023-08-10T12:05:29.497 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_items": 0, 2023-08-10T12:05:29.497 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-10T12:05:29.497 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_items": 0, 2023-08-10T12:05:29.497 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_bytes": 0, 2023-08-10T12:05:29.497 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_items": 0, 2023-08-10T12:05:29.497 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_bytes": 0, 2023-08-10T12:05:29.497 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_items": 0, 2023-08-10T12:05:29.498 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-10T12:05:29.498 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_items": 0, 2023-08-10T12:05:29.498 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-10T12:05:29.498 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_items": 0, 2023-08-10T12:05:29.498 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_bytes": 0, 2023-08-10T12:05:29.498 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_items": 0, 2023-08-10T12:05:29.498 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_bytes": 0, 2023-08-10T12:05:29.498 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_items": 0, 2023-08-10T12:05:29.499 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-10T12:05:29.499 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_items": 0, 2023-08-10T12:05:29.499 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_bytes": 0, 2023-08-10T12:05:29.499 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_items": 0, 2023-08-10T12:05:29.499 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_bytes": 0, 2023-08-10T12:05:29.499 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_items": 0, 2023-08-10T12:05:29.499 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_bytes": 0, 2023-08-10T12:05:29.499 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_items": 0, 2023-08-10T12:05:29.500 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_bytes": 0, 2023-08-10T12:05:29.500 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_items": 0, 2023-08-10T12:05:29.500 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_bytes": 1166497, 2023-08-10T12:05:29.500 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_items": 27833, 2023-08-10T12:05:29.500 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_bytes": 0, 2023-08-10T12:05:29.500 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_items": 0, 2023-08-10T12:05:29.500 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bytes": 0, 2023-08-10T12:05:29.500 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_items": 0, 2023-08-10T12:05:29.501 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_bytes": 0, 2023-08-10T12:05:29.501 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_items": 0, 2023-08-10T12:05:29.501 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_bytes": 0, 2023-08-10T12:05:29.501 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_items": 0, 2023-08-10T12:05:29.501 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_bytes": 8032, 2023-08-10T12:05:29.501 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_items": 167, 2023-08-10T12:05:29.501 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_bytes": 0, 2023-08-10T12:05:29.502 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_items": 0, 2023-08-10T12:05:29.502 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_bytes": 0, 2023-08-10T12:05:29.502 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_items": 0, 2023-08-10T12:05:29.502 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_bytes": 117611928, 2023-08-10T12:05:29.502 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_items": 1108402, 2023-08-10T12:05:29.502 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_bytes": 0, 2023-08-10T12:05:29.502 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_items": 0, 2023-08-10T12:05:29.502 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_bytes": 0, 2023-08-10T12:05:29.503 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_items": 0 2023-08-10T12:05:29.503 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.503 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter": { 2023-08-10T12:05:29.503 INFO:teuthology.orchestra.run.smithi073.stdout: "op_active": 0, 2023-08-10T12:05:29.503 INFO:teuthology.orchestra.run.smithi073.stdout: "op_laggy": 0, 2023-08-10T12:05:29.503 INFO:teuthology.orchestra.run.smithi073.stdout: "op_send": 2041, 2023-08-10T12:05:29.503 INFO:teuthology.orchestra.run.smithi073.stdout: "op_send_bytes": 26, 2023-08-10T12:05:29.503 INFO:teuthology.orchestra.run.smithi073.stdout: "op_resend": 4, 2023-08-10T12:05:29.504 INFO:teuthology.orchestra.run.smithi073.stdout: "op_reply": 2041, 2023-08-10T12:05:29.504 INFO:teuthology.orchestra.run.smithi073.stdout: "op_latency": { 2023-08-10T12:05:29.504 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 2041, 2023-08-10T12:05:29.504 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 9.822775257, 2023-08-10T12:05:29.504 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.004812726 2023-08-10T12:05:29.504 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.504 INFO:teuthology.orchestra.run.smithi073.stdout: "op_inflight": 0, 2023-08-10T12:05:29.504 INFO:teuthology.orchestra.run.smithi073.stdout: "oplen_avg": { 2023-08-10T12:05:29.505 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 2041, 2023-08-10T12:05:29.505 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 2042 2023-08-10T12:05:29.505 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.505 INFO:teuthology.orchestra.run.smithi073.stdout: "op": 2041, 2023-08-10T12:05:29.505 INFO:teuthology.orchestra.run.smithi073.stdout: "op_r": 2041, 2023-08-10T12:05:29.505 INFO:teuthology.orchestra.run.smithi073.stdout: "op_w": 0, 2023-08-10T12:05:29.505 INFO:teuthology.orchestra.run.smithi073.stdout: "op_rmw": 0, 2023-08-10T12:05:29.505 INFO:teuthology.orchestra.run.smithi073.stdout: "op_pg": 0, 2023-08-10T12:05:29.506 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_stat": 1229, 2023-08-10T12:05:29.506 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_create": 0, 2023-08-10T12:05:29.506 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_read": 809, 2023-08-10T12:05:29.506 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_write": 0, 2023-08-10T12:05:29.506 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_writefull": 0, 2023-08-10T12:05:29.506 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_writesame": 0, 2023-08-10T12:05:29.506 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_append": 0, 2023-08-10T12:05:29.506 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_zero": 0, 2023-08-10T12:05:29.507 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_truncate": 0, 2023-08-10T12:05:29.507 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_delete": 0, 2023-08-10T12:05:29.507 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_mapext": 0, 2023-08-10T12:05:29.507 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_sparse_read": 0, 2023-08-10T12:05:29.507 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_clonerange": 0, 2023-08-10T12:05:29.507 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_getxattr": 2, 2023-08-10T12:05:29.507 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_setxattr": 0, 2023-08-10T12:05:29.507 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_cmpxattr": 0, 2023-08-10T12:05:29.508 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_rmxattr": 0, 2023-08-10T12:05:29.508 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_resetxattrs": 0, 2023-08-10T12:05:29.508 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_call": 0, 2023-08-10T12:05:29.508 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_watch": 0, 2023-08-10T12:05:29.508 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_notify": 0, 2023-08-10T12:05:29.508 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_src_cmpxattr": 0, 2023-08-10T12:05:29.508 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_pgls": 0, 2023-08-10T12:05:29.509 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_pgls_filter": 0, 2023-08-10T12:05:29.509 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_other": 0, 2023-08-10T12:05:29.509 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_active": 0, 2023-08-10T12:05:29.509 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_send": 0, 2023-08-10T12:05:29.509 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_resend": 0, 2023-08-10T12:05:29.509 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_ping": 0, 2023-08-10T12:05:29.509 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_active": 0, 2023-08-10T12:05:29.509 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_send": 0, 2023-08-10T12:05:29.510 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_resend": 0, 2023-08-10T12:05:29.510 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_active": 0, 2023-08-10T12:05:29.510 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_send": 0, 2023-08-10T12:05:29.510 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_resend": 0, 2023-08-10T12:05:29.510 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_active": 0, 2023-08-10T12:05:29.510 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_send": 0, 2023-08-10T12:05:29.510 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_resend": 0, 2023-08-10T12:05:29.510 INFO:teuthology.orchestra.run.smithi073.stdout: "command_active": 0, 2023-08-10T12:05:29.511 INFO:teuthology.orchestra.run.smithi073.stdout: "command_send": 0, 2023-08-10T12:05:29.511 INFO:teuthology.orchestra.run.smithi073.stdout: "command_resend": 0, 2023-08-10T12:05:29.511 INFO:teuthology.orchestra.run.smithi073.stdout: "map_epoch": 98, 2023-08-10T12:05:29.511 INFO:teuthology.orchestra.run.smithi073.stdout: "map_full": 0, 2023-08-10T12:05:29.511 INFO:teuthology.orchestra.run.smithi073.stdout: "map_inc": 12, 2023-08-10T12:05:29.511 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_sessions": 9, 2023-08-10T12:05:29.511 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_session_open": 9, 2023-08-10T12:05:29.511 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_session_close": 0, 2023-08-10T12:05:29.512 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_laggy": 0, 2023-08-10T12:05:29.512 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_wr": 0, 2023-08-10T12:05:29.512 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_rd": 2, 2023-08-10T12:05:29.512 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_del": 0 2023-08-10T12:05:29.512 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.512 INFO:teuthology.orchestra.run.smithi073.stdout: "oft": { 2023-08-10T12:05:29.512 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_objs": 0, 2023-08-10T12:05:29.512 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_kv_pairs": 0, 2023-08-10T12:05:29.513 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_updates": 0, 2023-08-10T12:05:29.513 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_removes": 0 2023-08-10T12:05:29.513 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.513 INFO:teuthology.orchestra.run.smithi073.stdout: "osd-slow-ops": { 2023-08-10T12:05:29.513 INFO:teuthology.orchestra.run.smithi073.stdout: "slow_ops_count": 0 2023-08-10T12:05:29.513 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.513 INFO:teuthology.orchestra.run.smithi073.stdout: "purge_queue": { 2023-08-10T12:05:29.513 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_ops": 0, 2023-08-10T12:05:29.514 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_ops_high_water": 0, 2023-08-10T12:05:29.514 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing": 0, 2023-08-10T12:05:29.514 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_high_water": 0, 2023-08-10T12:05:29.514 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executed": 0, 2023-08-10T12:05:29.514 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_item_in_journal": 0 2023-08-10T12:05:29.514 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.514 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-10T12:05:29.514 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2023-08-10T12:05:29.515 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2023-08-10T12:05:29.515 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2023-08-10T12:05:29.515 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 2330, 2023-08-10T12:05:29.515 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 305351443, 2023-08-10T12:05:29.515 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:29.515 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 2330, 2023-08-10T12:05:29.515 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2023-08-10T12:05:29.516 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2023-08-10T12:05:29.516 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 2330, 2023-08-10T12:05:29.516 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 305351443, 2023-08-10T12:05:29.516 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2023-08-10T12:05:29.516 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.516 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.516 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.516 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:29.517 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.517 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-objecter_bytes": { 2023-08-10T12:05:29.517 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2023-08-10T12:05:29.517 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2023-08-10T12:05:29.517 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2023-08-10T12:05:29.517 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2023-08-10T12:05:29.517 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2023-08-10T12:05:29.517 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:29.518 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:29.518 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 2041, 2023-08-10T12:05:29.518 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 303387123, 2023-08-10T12:05:29.518 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 2041, 2023-08-10T12:05:29.518 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 303387123, 2023-08-10T12:05:29.518 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2023-08-10T12:05:29.518 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.518 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.519 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.519 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:29.519 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.519 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-objecter_ops": { 2023-08-10T12:05:29.519 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2023-08-10T12:05:29.519 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 1024, 2023-08-10T12:05:29.519 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2023-08-10T12:05:29.520 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2023-08-10T12:05:29.520 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2023-08-10T12:05:29.520 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:29.520 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:29.520 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 2041, 2023-08-10T12:05:29.520 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 2041, 2023-08-10T12:05:29.520 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 2041, 2023-08-10T12:05:29.520 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 2041, 2023-08-10T12:05:29.521 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2023-08-10T12:05:29.521 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.521 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.521 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.521 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:29.521 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.521 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-write_buf_throttle": { 2023-08-10T12:05:29.521 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2023-08-10T12:05:29.522 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 3758096384, 2023-08-10T12:05:29.522 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2023-08-10T12:05:29.522 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2023-08-10T12:05:29.522 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2023-08-10T12:05:29.522 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:29.522 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:29.522 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2023-08-10T12:05:29.523 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2023-08-10T12:05:29.523 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 0, 2023-08-10T12:05:29.523 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 0, 2023-08-10T12:05:29.523 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2023-08-10T12:05:29.523 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.523 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.523 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.523 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:29.524 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:29.524 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-write_buf_throttle-0x5592c98b2460": { 2023-08-10T12:05:29.524 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2023-08-10T12:05:29.524 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 3758096384, 2023-08-10T12:05:29.524 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2023-08-10T12:05:29.524 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2023-08-10T12:05:29.524 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2023-08-10T12:05:29.524 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:29.525 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:29.525 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2023-08-10T12:05:29.525 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2023-08-10T12:05:29.525 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 0, 2023-08-10T12:05:29.525 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 0, 2023-08-10T12:05:29.525 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2023-08-10T12:05:29.525 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:29.525 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:29.526 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:29.526 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:29.526 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:29.526 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T12:05:29.527 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:29 smithi156 ceph-mon[130574]: pgmap v400: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 971 KiB/s wr, 131 op/s 2023-08-10T12:05:29.527 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:29 smithi152 ceph-mon[130220]: pgmap v400: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 971 KiB/s wr, 131 op/s 2023-08-10T12:05:30.032 INFO:tasks.check_counter:Daemon mds.d mds.exported=0 2023-08-10T12:05:30.033 INFO:tasks.check_counter:Daemon mds.d mds.imported=0 2023-08-10T12:05:30.033 INFO:tasks.check_counter:Daemon mds.d mds_cache.dir_update=0 2023-08-10T12:05:30.033 INFO:tasks.check_counter:Daemon mds.d mds_cache.dir_update_receipt=0 2023-08-10T12:05:30.033 INFO:tasks.check_counter:Daemon mds.d mds.root_rsnaps=7 2023-08-10T12:05:30.033 INFO:tasks.check_counter:Daemon mds.d mds_server.req_mksnap_latency.avgcount=0 2023-08-10T12:05:30.034 INFO:tasks.check_counter:Daemon mds.d mds_server.req_rmsnap_latency.avgcount=0 2023-08-10T12:05:30.034 INFO:tasks.check_counter:Daemon mds.d mds.dir_split=0 2023-08-10T12:05:30.034 DEBUG:tasks.check_counter:Getting stats from g 2023-08-10T12:05:30.034 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph daemon mds.g perf dump 2023-08-10T12:05:30.589 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T12:05:31.454 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:31 smithi073 ceph-mon[128869]: pgmap v401: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 956 KiB/s wr, 118 op/s 2023-08-10T12:05:31.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:31 smithi152 ceph-mon[130220]: pgmap v401: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 956 KiB/s wr, 118 op/s 2023-08-10T12:05:31.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:31 smithi156 ceph-mon[130574]: pgmap v401: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 956 KiB/s wr, 118 op/s 2023-08-10T12:05:31.952 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T12:05:31.953 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-0": { 2023-08-10T12:05:31.953 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 1747, 2023-08-10T12:05:31.953 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 1705, 2023-08-10T12:05:31.953 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 36500702, 2023-08-10T12:05:31.953 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 589096, 2023-08-10T12:05:31.954 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 7, 2023-08-10T12:05:31.954 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 3, 2023-08-10T12:05:31.954 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.195915073, 2023-08-10T12:05:31.954 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.061818011, 2023-08-10T12:05:31.954 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.081477549, 2023-08-10T12:05:31.954 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.051177648, 2023-08-10T12:05:31.954 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:31.955 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 1704, 2023-08-10T12:05:31.955 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.394702884, 2023-08-10T12:05:31.955 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000231633 2023-08-10T12:05:31.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.955 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:31.955 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.955 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:31.956 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:31.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.956 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 1644592, 2023-08-10T12:05:31.956 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 138768 2023-08-10T12:05:31.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.956 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-1": { 2023-08-10T12:05:31.956 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 875, 2023-08-10T12:05:31.957 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 1055, 2023-08-10T12:05:31.957 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 54888958, 2023-08-10T12:05:31.957 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 741448, 2023-08-10T12:05:31.957 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 8, 2023-08-10T12:05:31.957 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 6, 2023-08-10T12:05:31.957 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.118020782, 2023-08-10T12:05:31.957 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.025328754, 2023-08-10T12:05:31.958 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.059851553, 2023-08-10T12:05:31.958 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.025330261, 2023-08-10T12:05:31.958 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:31.958 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 1052, 2023-08-10T12:05:31.958 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.301674849, 2023-08-10T12:05:31.958 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000286763 2023-08-10T12:05:31.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.959 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:31.959 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.959 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:31.959 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:31.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.959 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 320, 2023-08-10T12:05:31.959 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 469888 2023-08-10T12:05:31.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.960 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-2": { 2023-08-10T12:05:31.960 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 637, 2023-08-10T12:05:31.960 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 637, 2023-08-10T12:05:31.960 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 84078241, 2023-08-10T12:05:31.960 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 197323, 2023-08-10T12:05:31.960 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 6, 2023-08-10T12:05:31.961 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 5, 2023-08-10T12:05:31.961 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.103421801, 2023-08-10T12:05:31.961 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.013204121, 2023-08-10T12:05:31.961 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.065740885, 2023-08-10T12:05:31.961 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.020100798, 2023-08-10T12:05:31.961 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:31.961 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 636, 2023-08-10T12:05:31.962 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.163218897, 2023-08-10T12:05:31.962 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000256633 2023-08-10T12:05:31.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.962 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:31.962 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.962 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:31.962 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:31.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.963 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-08-10T12:05:31.963 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 448 2023-08-10T12:05:31.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.963 INFO:teuthology.orchestra.run.smithi073.stdout: "cct": { 2023-08-10T12:05:31.963 INFO:teuthology.orchestra.run.smithi073.stdout: "total_workers": 1, 2023-08-10T12:05:31.963 INFO:teuthology.orchestra.run.smithi073.stdout: "unhealthy_workers": 0 2023-08-10T12:05:31.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.964 INFO:teuthology.orchestra.run.smithi073.stdout: "finisher-MDSRank": { 2023-08-10T12:05:31.964 INFO:teuthology.orchestra.run.smithi073.stdout: "queue_len": 0, 2023-08-10T12:05:31.964 INFO:teuthology.orchestra.run.smithi073.stdout: "complete_latency": { 2023-08-10T12:05:31.964 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 4915, 2023-08-10T12:05:31.964 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.126330874, 2023-08-10T12:05:31.964 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000025703 2023-08-10T12:05:31.965 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:31.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.965 INFO:teuthology.orchestra.run.smithi073.stdout: "finisher-PurgeQueue": { 2023-08-10T12:05:31.965 INFO:teuthology.orchestra.run.smithi073.stdout: "queue_len": 0, 2023-08-10T12:05:31.965 INFO:teuthology.orchestra.run.smithi073.stdout: "complete_latency": { 2023-08-10T12:05:31.965 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.965 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:31.965 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:31.966 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:31.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.966 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2023-08-10T12:05:31.966 INFO:teuthology.orchestra.run.smithi073.stdout: "request": 0, 2023-08-10T12:05:31.966 INFO:teuthology.orchestra.run.smithi073.stdout: "reply": 0, 2023-08-10T12:05:31.966 INFO:teuthology.orchestra.run.smithi073.stdout: "reply_latency": { 2023-08-10T12:05:31.966 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.967 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:31.967 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:31.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.967 INFO:teuthology.orchestra.run.smithi073.stdout: "slow_reply": 0, 2023-08-10T12:05:31.967 INFO:teuthology.orchestra.run.smithi073.stdout: "forward": 0, 2023-08-10T12:05:31.967 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_fetch_complete": 0, 2023-08-10T12:05:31.967 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_fetch_keys": 0, 2023-08-10T12:05:31.968 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_commit": 0, 2023-08-10T12:05:31.968 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_split": 0, 2023-08-10T12:05:31.968 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_merge": 0, 2023-08-10T12:05:31.968 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes": 25842, 2023-08-10T12:05:31.968 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_top": 273, 2023-08-10T12:05:31.968 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_bottom": 20258, 2023-08-10T12:05:31.968 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_pin_tail": 5311, 2023-08-10T12:05:31.969 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_pinned": 25451, 2023-08-10T12:05:31.969 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_expired": 237, 2023-08-10T12:05:31.969 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_with_caps": 0, 2023-08-10T12:05:31.969 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": 0, 2023-08-10T12:05:31.969 INFO:teuthology.orchestra.run.smithi073.stdout: "subtrees": 1, 2023-08-10T12:05:31.969 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse": 0, 2023-08-10T12:05:31.969 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_hit": 0, 2023-08-10T12:05:31.970 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_forward": 0, 2023-08-10T12:05:31.970 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_discover": 0, 2023-08-10T12:05:31.970 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_dir_fetch": 0, 2023-08-10T12:05:31.970 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_remote_ino": 0, 2023-08-10T12:05:31.970 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_lock": 0, 2023-08-10T12:05:31.970 INFO:teuthology.orchestra.run.smithi073.stdout: "load_cent": 0, 2023-08-10T12:05:31.970 INFO:teuthology.orchestra.run.smithi073.stdout: "q": 0, 2023-08-10T12:05:31.971 INFO:teuthology.orchestra.run.smithi073.stdout: "exported": 0, 2023-08-10T12:05:31.971 INFO:teuthology.orchestra.run.smithi073.stdout: "exported_inodes": 0, 2023-08-10T12:05:31.971 INFO:teuthology.orchestra.run.smithi073.stdout: "imported": 0, 2023-08-10T12:05:31.971 INFO:teuthology.orchestra.run.smithi073.stdout: "imported_inodes": 0, 2023-08-10T12:05:31.971 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_dir_fetch": 0, 2023-08-10T12:05:31.971 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_backtrace_fetch": 0, 2023-08-10T12:05:31.971 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_peer_discover": 0, 2023-08-10T12:05:31.972 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rfiles": 0, 2023-08-10T12:05:31.972 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rbytes": 0, 2023-08-10T12:05:31.972 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rsnaps": 0, 2023-08-10T12:05:31.972 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_backtrace_fetch": 0, 2023-08-10T12:05:31.972 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_set_tag": 0, 2023-08-10T12:05:31.972 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_backtrace_repaired": 0, 2023-08-10T12:05:31.972 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_inotable_repaired": 0, 2023-08-10T12:05:31.973 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dir_inodes": 0, 2023-08-10T12:05:31.973 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dir_base_inodes": 0, 2023-08-10T12:05:31.973 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dirfrag_rstats": 0, 2023-08-10T12:05:31.973 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_file_inodes": 0, 2023-08-10T12:05:31.973 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_inode_file_caps": 0, 2023-08-10T12:05:31.973 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_revoke": 0, 2023-08-10T12:05:31.973 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_grant": 0, 2023-08-10T12:05:31.974 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_trunc": 0, 2023-08-10T12:05:31.974 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-10T12:05:31.974 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-10T12:05:31.974 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_caps": 0, 2023-08-10T12:05:31.974 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_caps_dirty": 0, 2023-08-10T12:05:31.974 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_cap_release": 0, 2023-08-10T12:05:31.974 INFO:teuthology.orchestra.run.smithi073.stdout: "process_request_cap_release": 0 2023-08-10T12:05:31.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.975 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache": { 2023-08-10T12:05:31.975 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_update": 0, 2023-08-10T12:05:31.975 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_update_receipt": 0, 2023-08-10T12:05:31.975 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_try_discover": 0, 2023-08-10T12:05:31.975 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_send_discover": 0, 2023-08-10T12:05:31.975 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_handle_discover": 0, 2023-08-10T12:05:31.975 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays": 0, 2023-08-10T12:05:31.976 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays_delayed": 0, 2023-08-10T12:05:31.976 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays_enqueuing": 0, 2023-08-10T12:05:31.976 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_created": 0, 2023-08-10T12:05:31.976 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_enqueued": 0, 2023-08-10T12:05:31.976 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_reintegrated": 0, 2023-08-10T12:05:31.976 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_migrated": 0, 2023-08-10T12:05:31.976 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_processing": 0, 2023-08-10T12:05:31.977 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_enqueued": 0, 2023-08-10T12:05:31.977 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_prioritized": 0, 2023-08-10T12:05:31.977 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_started": 0, 2023-08-10T12:05:31.977 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_completed": 0, 2023-08-10T12:05:31.977 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_enqueue_scrub": 0, 2023-08-10T12:05:31.977 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_exportdir": 0, 2023-08-10T12:05:31.977 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_flush": 0, 2023-08-10T12:05:31.978 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_fragmentdir": 0, 2023-08-10T12:05:31.978 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_fragstats": 0, 2023-08-10T12:05:31.978 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_inodestats": 0 2023-08-10T12:05:31.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.978 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log": { 2023-08-10T12:05:31.978 INFO:teuthology.orchestra.run.smithi073.stdout: "evadd": 0, 2023-08-10T12:05:31.978 INFO:teuthology.orchestra.run.smithi073.stdout: "evex": 0, 2023-08-10T12:05:31.979 INFO:teuthology.orchestra.run.smithi073.stdout: "evtrm": 0, 2023-08-10T12:05:31.979 INFO:teuthology.orchestra.run.smithi073.stdout: "ev": 0, 2023-08-10T12:05:31.979 INFO:teuthology.orchestra.run.smithi073.stdout: "evexg": 0, 2023-08-10T12:05:31.979 INFO:teuthology.orchestra.run.smithi073.stdout: "evexd": 0, 2023-08-10T12:05:31.979 INFO:teuthology.orchestra.run.smithi073.stdout: "segadd": 0, 2023-08-10T12:05:31.979 INFO:teuthology.orchestra.run.smithi073.stdout: "segex": 0, 2023-08-10T12:05:31.979 INFO:teuthology.orchestra.run.smithi073.stdout: "segtrm": 0, 2023-08-10T12:05:31.980 INFO:teuthology.orchestra.run.smithi073.stdout: "seg": 72, 2023-08-10T12:05:31.980 INFO:teuthology.orchestra.run.smithi073.stdout: "segexg": 0, 2023-08-10T12:05:31.980 INFO:teuthology.orchestra.run.smithi073.stdout: "segexd": 0, 2023-08-10T12:05:31.980 INFO:teuthology.orchestra.run.smithi073.stdout: "expos": 4194304, 2023-08-10T12:05:31.980 INFO:teuthology.orchestra.run.smithi073.stdout: "wrpos": 0, 2023-08-10T12:05:31.980 INFO:teuthology.orchestra.run.smithi073.stdout: "rdpos": 177016648, 2023-08-10T12:05:31.980 INFO:teuthology.orchestra.run.smithi073.stdout: "jlat": { 2023-08-10T12:05:31.981 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.981 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:31.981 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:31.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.981 INFO:teuthology.orchestra.run.smithi073.stdout: "replayed": 52699 2023-08-10T12:05:31.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.981 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_mem": { 2023-08-10T12:05:31.981 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 7400, 2023-08-10T12:05:31.982 INFO:teuthology.orchestra.run.smithi073.stdout: "ino+": 26629, 2023-08-10T12:05:31.982 INFO:teuthology.orchestra.run.smithi073.stdout: "ino-": 19229, 2023-08-10T12:05:31.982 INFO:teuthology.orchestra.run.smithi073.stdout: "dir": 276, 2023-08-10T12:05:31.982 INFO:teuthology.orchestra.run.smithi073.stdout: "dir+": 720, 2023-08-10T12:05:31.982 INFO:teuthology.orchestra.run.smithi073.stdout: "dir-": 444, 2023-08-10T12:05:31.982 INFO:teuthology.orchestra.run.smithi073.stdout: "dn": 25842, 2023-08-10T12:05:31.982 INFO:teuthology.orchestra.run.smithi073.stdout: "dn+": 46444, 2023-08-10T12:05:31.983 INFO:teuthology.orchestra.run.smithi073.stdout: "dn-": 20602, 2023-08-10T12:05:31.983 INFO:teuthology.orchestra.run.smithi073.stdout: "cap": 0, 2023-08-10T12:05:31.983 INFO:teuthology.orchestra.run.smithi073.stdout: "cap+": 0, 2023-08-10T12:05:31.983 INFO:teuthology.orchestra.run.smithi073.stdout: "cap-": 0, 2023-08-10T12:05:31.983 INFO:teuthology.orchestra.run.smithi073.stdout: "rss": 104044, 2023-08-10T12:05:31.983 INFO:teuthology.orchestra.run.smithi073.stdout: "heap": 207152 2023-08-10T12:05:31.983 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.984 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_server": { 2023-08-10T12:05:31.984 INFO:teuthology.orchestra.run.smithi073.stdout: "dispatch_client_request": 0, 2023-08-10T12:05:31.984 INFO:teuthology.orchestra.run.smithi073.stdout: "dispatch_server_request": 0, 2023-08-10T12:05:31.984 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_request": 0, 2023-08-10T12:05:31.984 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_session": 0, 2023-08-10T12:05:31.984 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_peer_request": 0, 2023-08-10T12:05:31.984 INFO:teuthology.orchestra.run.smithi073.stdout: "req_create_latency": { 2023-08-10T12:05:31.985 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.985 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:31.985 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:31.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.985 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getattr_latency": { 2023-08-10T12:05:31.985 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.985 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:31.986 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:31.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.986 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getfilelock_latency": { 2023-08-10T12:05:31.986 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.986 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:31.986 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:31.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.987 INFO:teuthology.orchestra.run.smithi073.stdout: "req_link_latency": { 2023-08-10T12:05:31.987 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.987 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:31.987 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:31.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.987 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookup_latency": { 2023-08-10T12:05:31.987 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.988 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:31.988 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:31.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.988 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookuphash_latency": { 2023-08-10T12:05:31.988 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.988 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:31.988 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:31.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.989 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupino_latency": { 2023-08-10T12:05:31.989 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.989 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:31.989 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:31.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.989 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupname_latency": { 2023-08-10T12:05:31.990 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.990 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:31.990 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:31.990 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.990 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupparent_latency": { 2023-08-10T12:05:31.990 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.990 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:31.991 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:31.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.991 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupsnap_latency": { 2023-08-10T12:05:31.991 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.991 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:31.991 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:31.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.991 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lssnap_latency": { 2023-08-10T12:05:31.992 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.992 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:31.992 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:31.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.992 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mkdir_latency": { 2023-08-10T12:05:31.992 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.992 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:31.993 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:31.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.993 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mknod_latency": { 2023-08-10T12:05:31.993 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.993 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:31.993 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:31.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.994 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mksnap_latency": { 2023-08-10T12:05:31.994 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.994 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:31.994 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:31.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.994 INFO:teuthology.orchestra.run.smithi073.stdout: "req_open_latency": { 2023-08-10T12:05:31.994 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.995 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:31.995 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:31.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.995 INFO:teuthology.orchestra.run.smithi073.stdout: "req_readdir_latency": { 2023-08-10T12:05:31.995 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.995 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:31.995 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:31.996 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.996 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rename_latency": { 2023-08-10T12:05:31.996 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.996 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:31.996 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:31.996 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.996 INFO:teuthology.orchestra.run.smithi073.stdout: "req_renamesnap_latency": { 2023-08-10T12:05:31.997 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.997 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:31.997 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:31.997 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.997 INFO:teuthology.orchestra.run.smithi073.stdout: "req_snapdiff_latency": { 2023-08-10T12:05:31.997 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.997 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:31.997 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:31.998 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.998 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmdir_latency": { 2023-08-10T12:05:31.998 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.998 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:31.998 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:31.998 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.998 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmsnap_latency": { 2023-08-10T12:05:31.999 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.999 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:31.999 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:31.999 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:31.999 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmxattr_latency": { 2023-08-10T12:05:31.999 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:31.999 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:32.000 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:32.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:32.000 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setattr_latency": { 2023-08-10T12:05:32.000 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:32.000 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:32.000 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:32.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:32.001 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setdirlayout_latency": { 2023-08-10T12:05:32.001 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:32.001 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:32.001 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:32.001 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:32.001 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setfilelock_latency": { 2023-08-10T12:05:32.001 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:32.002 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:32.002 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:32.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:32.002 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setlayout_latency": { 2023-08-10T12:05:32.002 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:32.002 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:32.002 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:32.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:32.003 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setxattr_latency": { 2023-08-10T12:05:32.003 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:32.003 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:32.003 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:32.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:32.003 INFO:teuthology.orchestra.run.smithi073.stdout: "req_symlink_latency": { 2023-08-10T12:05:32.003 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:32.004 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:32.004 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:32.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:32.004 INFO:teuthology.orchestra.run.smithi073.stdout: "req_unlink_latency": { 2023-08-10T12:05:32.004 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:32.004 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:32.004 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:32.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:32.005 INFO:teuthology.orchestra.run.smithi073.stdout: "cap_revoke_eviction": 0, 2023-08-10T12:05:32.005 INFO:teuthology.orchestra.run.smithi073.stdout: "cap_acquisition_throttle": 0, 2023-08-10T12:05:32.005 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getvxattr_latency": { 2023-08-10T12:05:32.005 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:32.005 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:32.005 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:32.006 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:32.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:32.006 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_sessions": { 2023-08-10T12:05:32.006 INFO:teuthology.orchestra.run.smithi073.stdout: "session_count": 2, 2023-08-10T12:05:32.006 INFO:teuthology.orchestra.run.smithi073.stdout: "session_add": 2, 2023-08-10T12:05:32.006 INFO:teuthology.orchestra.run.smithi073.stdout: "session_remove": 0, 2023-08-10T12:05:32.006 INFO:teuthology.orchestra.run.smithi073.stdout: "sessions_open": 2, 2023-08-10T12:05:32.007 INFO:teuthology.orchestra.run.smithi073.stdout: "sessions_stale": 0, 2023-08-10T12:05:32.007 INFO:teuthology.orchestra.run.smithi073.stdout: "total_load": 0, 2023-08-10T12:05:32.007 INFO:teuthology.orchestra.run.smithi073.stdout: "average_load": 0, 2023-08-10T12:05:32.007 INFO:teuthology.orchestra.run.smithi073.stdout: "avg_session_uptime": 3009 2023-08-10T12:05:32.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:32.007 INFO:teuthology.orchestra.run.smithi073.stdout: "mempool": { 2023-08-10T12:05:32.007 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_bytes": 0, 2023-08-10T12:05:32.008 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_items": 0, 2023-08-10T12:05:32.008 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_bytes": 0, 2023-08-10T12:05:32.008 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_items": 0, 2023-08-10T12:05:32.008 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_bytes": 0, 2023-08-10T12:05:32.008 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_items": 0, 2023-08-10T12:05:32.008 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-10T12:05:32.008 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_items": 0, 2023-08-10T12:05:32.009 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-10T12:05:32.009 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_items": 0, 2023-08-10T12:05:32.009 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_bytes": 0, 2023-08-10T12:05:32.009 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_items": 0, 2023-08-10T12:05:32.009 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-10T12:05:32.009 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_items": 0, 2023-08-10T12:05:32.009 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_bytes": 0, 2023-08-10T12:05:32.009 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_items": 0, 2023-08-10T12:05:32.010 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_bytes": 0, 2023-08-10T12:05:32.010 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_items": 0, 2023-08-10T12:05:32.010 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-10T12:05:32.010 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_items": 0, 2023-08-10T12:05:32.010 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-10T12:05:32.010 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_items": 0, 2023-08-10T12:05:32.010 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_bytes": 0, 2023-08-10T12:05:32.011 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_items": 0, 2023-08-10T12:05:32.011 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_bytes": 0, 2023-08-10T12:05:32.011 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_items": 0, 2023-08-10T12:05:32.011 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-10T12:05:32.011 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_items": 0, 2023-08-10T12:05:32.011 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_bytes": 0, 2023-08-10T12:05:32.011 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_items": 0, 2023-08-10T12:05:32.012 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_bytes": 0, 2023-08-10T12:05:32.012 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_items": 0, 2023-08-10T12:05:32.012 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_bytes": 0, 2023-08-10T12:05:32.012 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_items": 0, 2023-08-10T12:05:32.012 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_bytes": 0, 2023-08-10T12:05:32.012 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_items": 0, 2023-08-10T12:05:32.012 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_bytes": 489629, 2023-08-10T12:05:32.013 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_items": 7649, 2023-08-10T12:05:32.013 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_bytes": 0, 2023-08-10T12:05:32.013 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_items": 0, 2023-08-10T12:05:32.013 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bytes": 0, 2023-08-10T12:05:32.013 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_items": 0, 2023-08-10T12:05:32.013 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_bytes": 0, 2023-08-10T12:05:32.013 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_items": 0, 2023-08-10T12:05:32.014 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_bytes": 0, 2023-08-10T12:05:32.014 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_items": 0, 2023-08-10T12:05:32.014 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_bytes": 8032, 2023-08-10T12:05:32.014 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_items": 167, 2023-08-10T12:05:32.014 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_bytes": 0, 2023-08-10T12:05:32.014 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_items": 0, 2023-08-10T12:05:32.014 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_bytes": 0, 2023-08-10T12:05:32.014 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_items": 0, 2023-08-10T12:05:32.015 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_bytes": 35271049, 2023-08-10T12:05:32.015 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_items": 356804, 2023-08-10T12:05:32.015 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_bytes": 0, 2023-08-10T12:05:32.015 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_items": 0, 2023-08-10T12:05:32.015 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_bytes": 0, 2023-08-10T12:05:32.015 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_items": 0 2023-08-10T12:05:32.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:32.016 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter": { 2023-08-10T12:05:32.016 INFO:teuthology.orchestra.run.smithi073.stdout: "op_active": 0, 2023-08-10T12:05:32.016 INFO:teuthology.orchestra.run.smithi073.stdout: "op_laggy": 0, 2023-08-10T12:05:32.016 INFO:teuthology.orchestra.run.smithi073.stdout: "op_send": 2954, 2023-08-10T12:05:32.016 INFO:teuthology.orchestra.run.smithi073.stdout: "op_send_bytes": 21, 2023-08-10T12:05:32.016 INFO:teuthology.orchestra.run.smithi073.stdout: "op_resend": 3, 2023-08-10T12:05:32.016 INFO:teuthology.orchestra.run.smithi073.stdout: "op_reply": 2954, 2023-08-10T12:05:32.017 INFO:teuthology.orchestra.run.smithi073.stdout: "op_latency": { 2023-08-10T12:05:32.017 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 2954, 2023-08-10T12:05:32.017 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 15.616636893, 2023-08-10T12:05:32.017 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.005286606 2023-08-10T12:05:32.017 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:32.017 INFO:teuthology.orchestra.run.smithi073.stdout: "op_inflight": 0, 2023-08-10T12:05:32.017 INFO:teuthology.orchestra.run.smithi073.stdout: "oplen_avg": { 2023-08-10T12:05:32.018 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 2954, 2023-08-10T12:05:32.018 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 2955 2023-08-10T12:05:32.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:32.018 INFO:teuthology.orchestra.run.smithi073.stdout: "op": 2954, 2023-08-10T12:05:32.018 INFO:teuthology.orchestra.run.smithi073.stdout: "op_r": 2954, 2023-08-10T12:05:32.018 INFO:teuthology.orchestra.run.smithi073.stdout: "op_w": 0, 2023-08-10T12:05:32.018 INFO:teuthology.orchestra.run.smithi073.stdout: "op_rmw": 0, 2023-08-10T12:05:32.019 INFO:teuthology.orchestra.run.smithi073.stdout: "op_pg": 0, 2023-08-10T12:05:32.019 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_stat": 1718, 2023-08-10T12:05:32.019 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_create": 0, 2023-08-10T12:05:32.019 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_read": 1234, 2023-08-10T12:05:32.019 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_write": 0, 2023-08-10T12:05:32.019 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_writefull": 0, 2023-08-10T12:05:32.019 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_writesame": 0, 2023-08-10T12:05:32.020 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_append": 0, 2023-08-10T12:05:32.020 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_zero": 0, 2023-08-10T12:05:32.020 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_truncate": 0, 2023-08-10T12:05:32.020 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_delete": 0, 2023-08-10T12:05:32.020 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_mapext": 0, 2023-08-10T12:05:32.020 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_sparse_read": 0, 2023-08-10T12:05:32.020 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_clonerange": 0, 2023-08-10T12:05:32.021 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_getxattr": 1, 2023-08-10T12:05:32.021 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_setxattr": 0, 2023-08-10T12:05:32.021 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_cmpxattr": 0, 2023-08-10T12:05:32.021 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_rmxattr": 0, 2023-08-10T12:05:32.021 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_resetxattrs": 0, 2023-08-10T12:05:32.021 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_call": 0, 2023-08-10T12:05:32.021 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_watch": 0, 2023-08-10T12:05:32.021 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_notify": 0, 2023-08-10T12:05:32.022 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_src_cmpxattr": 0, 2023-08-10T12:05:32.022 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_pgls": 0, 2023-08-10T12:05:32.022 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_pgls_filter": 0, 2023-08-10T12:05:32.022 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_other": 0, 2023-08-10T12:05:32.022 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_active": 0, 2023-08-10T12:05:32.022 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_send": 0, 2023-08-10T12:05:32.022 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_resend": 0, 2023-08-10T12:05:32.023 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_ping": 0, 2023-08-10T12:05:32.023 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_active": 0, 2023-08-10T12:05:32.023 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_send": 0, 2023-08-10T12:05:32.023 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_resend": 0, 2023-08-10T12:05:32.023 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_active": 0, 2023-08-10T12:05:32.023 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_send": 0, 2023-08-10T12:05:32.023 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_resend": 0, 2023-08-10T12:05:32.024 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_active": 0, 2023-08-10T12:05:32.024 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_send": 0, 2023-08-10T12:05:32.024 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_resend": 0, 2023-08-10T12:05:32.024 INFO:teuthology.orchestra.run.smithi073.stdout: "command_active": 0, 2023-08-10T12:05:32.024 INFO:teuthology.orchestra.run.smithi073.stdout: "command_send": 0, 2023-08-10T12:05:32.024 INFO:teuthology.orchestra.run.smithi073.stdout: "command_resend": 0, 2023-08-10T12:05:32.024 INFO:teuthology.orchestra.run.smithi073.stdout: "map_epoch": 98, 2023-08-10T12:05:32.025 INFO:teuthology.orchestra.run.smithi073.stdout: "map_full": 0, 2023-08-10T12:05:32.025 INFO:teuthology.orchestra.run.smithi073.stdout: "map_inc": 15, 2023-08-10T12:05:32.025 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_sessions": 10, 2023-08-10T12:05:32.025 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_session_open": 10, 2023-08-10T12:05:32.025 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_session_close": 0, 2023-08-10T12:05:32.025 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_laggy": 0, 2023-08-10T12:05:32.025 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_wr": 0, 2023-08-10T12:05:32.026 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_rd": 2, 2023-08-10T12:05:32.026 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_del": 0 2023-08-10T12:05:32.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:32.026 INFO:teuthology.orchestra.run.smithi073.stdout: "oft": { 2023-08-10T12:05:32.026 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_objs": 0, 2023-08-10T12:05:32.026 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_kv_pairs": 0, 2023-08-10T12:05:32.026 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_updates": 0, 2023-08-10T12:05:32.027 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_removes": 0 2023-08-10T12:05:32.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:32.027 INFO:teuthology.orchestra.run.smithi073.stdout: "osd-slow-ops": { 2023-08-10T12:05:32.027 INFO:teuthology.orchestra.run.smithi073.stdout: "slow_ops_count": 0 2023-08-10T12:05:32.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:32.027 INFO:teuthology.orchestra.run.smithi073.stdout: "purge_queue": { 2023-08-10T12:05:32.027 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_ops": 0, 2023-08-10T12:05:32.027 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_ops_high_water": 0, 2023-08-10T12:05:32.028 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing": 0, 2023-08-10T12:05:32.028 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_high_water": 0, 2023-08-10T12:05:32.028 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executed": 0, 2023-08-10T12:05:32.028 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_item_in_journal": 0 2023-08-10T12:05:32.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:32.028 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-10T12:05:32.028 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2023-08-10T12:05:32.029 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2023-08-10T12:05:32.029 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2023-08-10T12:05:32.029 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 3255, 2023-08-10T12:05:32.029 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 175156836, 2023-08-10T12:05:32.029 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:32.029 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 3255, 2023-08-10T12:05:32.029 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2023-08-10T12:05:32.030 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2023-08-10T12:05:32.030 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 3255, 2023-08-10T12:05:32.030 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 175156836, 2023-08-10T12:05:32.030 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2023-08-10T12:05:32.030 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:32.030 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:32.030 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:32.031 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:32.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:32.031 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-objecter_bytes": { 2023-08-10T12:05:32.031 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2023-08-10T12:05:32.031 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2023-08-10T12:05:32.031 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2023-08-10T12:05:32.031 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2023-08-10T12:05:32.032 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2023-08-10T12:05:32.032 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:32.032 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:32.032 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 2954, 2023-08-10T12:05:32.032 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 172997601, 2023-08-10T12:05:32.032 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 2954, 2023-08-10T12:05:32.032 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 172997601, 2023-08-10T12:05:32.033 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2023-08-10T12:05:32.033 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:32.033 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:32.033 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:32.033 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:32.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:32.033 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-objecter_ops": { 2023-08-10T12:05:32.034 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2023-08-10T12:05:32.034 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 1024, 2023-08-10T12:05:32.034 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2023-08-10T12:05:32.034 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2023-08-10T12:05:32.034 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2023-08-10T12:05:32.034 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:32.034 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:32.035 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 2954, 2023-08-10T12:05:32.035 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 2954, 2023-08-10T12:05:32.035 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 2954, 2023-08-10T12:05:32.035 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 2954, 2023-08-10T12:05:32.035 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2023-08-10T12:05:32.035 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:32.035 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:32.035 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:32.036 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:32.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:32.036 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-write_buf_throttle": { 2023-08-10T12:05:32.036 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2023-08-10T12:05:32.036 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 3758096384, 2023-08-10T12:05:32.036 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2023-08-10T12:05:32.037 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2023-08-10T12:05:32.037 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2023-08-10T12:05:32.037 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:32.037 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:32.037 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2023-08-10T12:05:32.037 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2023-08-10T12:05:32.037 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 0, 2023-08-10T12:05:32.037 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 0, 2023-08-10T12:05:32.038 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2023-08-10T12:05:32.038 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:32.038 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:32.038 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:32.038 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:32.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:32.038 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-write_buf_throttle-0x560cecc52460": { 2023-08-10T12:05:32.039 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2023-08-10T12:05:32.039 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 3758096384, 2023-08-10T12:05:32.039 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2023-08-10T12:05:32.039 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2023-08-10T12:05:32.039 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2023-08-10T12:05:32.039 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:32.039 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:32.040 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2023-08-10T12:05:32.040 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2023-08-10T12:05:32.040 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 0, 2023-08-10T12:05:32.040 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 0, 2023-08-10T12:05:32.040 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2023-08-10T12:05:32.040 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:32.040 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:32.041 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:32.041 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:32.041 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:32.041 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T12:05:32.443 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2023-08-10T12:05:32.443 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2023-08-10T12:05:32.444 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2023-08-10T12:05:32.444 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2023-08-10T12:05:32.444 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2023-08-10T12:05:32.444 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2023-08-10T12:05:32.444 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2023-08-10T12:05:32.445 INFO:tasks.check_counter:Daemon mds.g mds.dir_split=0 2023-08-10T12:05:32.445 DEBUG:tasks.check_counter:Getting stats from j 2023-08-10T12:05:32.445 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph daemon mds.j perf dump 2023-08-10T12:05:33.003 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T12:05:33.442 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:33 smithi073 ceph-mon[128869]: pgmap v402: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 624 KiB/s wr, 74 op/s 2023-08-10T12:05:33.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:33 smithi152 ceph-mon[130220]: pgmap v402: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 624 KiB/s wr, 74 op/s 2023-08-10T12:05:33.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:33 smithi156 ceph-mon[130574]: pgmap v402: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 624 KiB/s wr, 74 op/s 2023-08-10T12:05:34.410 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-08-10T12:05:34.411 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-0": { 2023-08-10T12:05:34.411 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 0, 2023-08-10T12:05:34.411 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 2, 2023-08-10T12:05:34.411 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 0, 2023-08-10T12:05:34.411 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 0, 2023-08-10T12:05:34.411 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 4, 2023-08-10T12:05:34.412 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 0, 2023-08-10T12:05:34.412 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.001233887, 2023-08-10T12:05:34.412 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.000000000, 2023-08-10T12:05:34.412 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.000319949, 2023-08-10T12:05:34.412 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-08-10T12:05:34.412 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:34.412 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:34.413 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:34.413 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:34.413 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:34.413 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:34.413 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:34.413 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:34.413 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:34.414 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:34.414 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 0, 2023-08-10T12:05:34.414 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 0 2023-08-10T12:05:34.414 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:34.414 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-1": { 2023-08-10T12:05:34.414 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 6, 2023-08-10T12:05:34.414 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 188, 2023-08-10T12:05:34.414 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 3312, 2023-08-10T12:05:34.415 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 184944, 2023-08-10T12:05:34.415 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 5, 2023-08-10T12:05:34.415 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 3, 2023-08-10T12:05:34.415 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.013056460, 2023-08-10T12:05:34.415 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.008966200, 2023-08-10T12:05:34.415 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.002096012, 2023-08-10T12:05:34.415 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-08-10T12:05:34.416 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:34.416 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 186, 2023-08-10T12:05:34.416 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.047193496, 2023-08-10T12:05:34.416 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000253728 2023-08-10T12:05:34.416 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:34.416 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:34.416 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:34.417 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:34.417 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:34.417 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:34.417 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-08-10T12:05:34.417 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 184944 2023-08-10T12:05:34.417 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:34.417 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-2": { 2023-08-10T12:05:34.417 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 253, 2023-08-10T12:05:34.418 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 243, 2023-08-10T12:05:34.418 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 1430928, 2023-08-10T12:05:34.418 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 138592, 2023-08-10T12:05:34.418 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 2, 2023-08-10T12:05:34.418 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 1, 2023-08-10T12:05:34.418 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.043714874, 2023-08-10T12:05:34.418 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.014608001, 2023-08-10T12:05:34.418 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.031235643, 2023-08-10T12:05:34.419 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.005883786, 2023-08-10T12:05:34.419 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:34.419 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 242, 2023-08-10T12:05:34.419 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.054863200, 2023-08-10T12:05:34.419 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000226707 2023-08-10T12:05:34.419 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:34.419 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:34.419 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:34.420 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:34.420 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:34.420 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:34.420 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 1430928, 2023-08-10T12:05:34.420 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 138592 2023-08-10T12:05:34.420 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:34.420 INFO:teuthology.orchestra.run.smithi073.stdout: "cct": { 2023-08-10T12:05:34.421 INFO:teuthology.orchestra.run.smithi073.stdout: "total_workers": 0, 2023-08-10T12:05:34.421 INFO:teuthology.orchestra.run.smithi073.stdout: "unhealthy_workers": 0 2023-08-10T12:05:34.421 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:34.421 INFO:teuthology.orchestra.run.smithi073.stdout: "mempool": { 2023-08-10T12:05:34.421 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_bytes": 0, 2023-08-10T12:05:34.421 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_items": 0, 2023-08-10T12:05:34.421 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_bytes": 0, 2023-08-10T12:05:34.421 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_items": 0, 2023-08-10T12:05:34.422 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_bytes": 0, 2023-08-10T12:05:34.422 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_items": 0, 2023-08-10T12:05:34.422 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-10T12:05:34.422 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_items": 0, 2023-08-10T12:05:34.422 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-10T12:05:34.422 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_items": 0, 2023-08-10T12:05:34.422 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_bytes": 0, 2023-08-10T12:05:34.422 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_items": 0, 2023-08-10T12:05:34.423 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-10T12:05:34.423 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_items": 0, 2023-08-10T12:05:34.423 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_bytes": 0, 2023-08-10T12:05:34.423 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_items": 0, 2023-08-10T12:05:34.423 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_bytes": 0, 2023-08-10T12:05:34.423 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_items": 0, 2023-08-10T12:05:34.423 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-10T12:05:34.423 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_items": 0, 2023-08-10T12:05:34.424 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-10T12:05:34.424 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_items": 0, 2023-08-10T12:05:34.424 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_bytes": 0, 2023-08-10T12:05:34.424 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_items": 0, 2023-08-10T12:05:34.424 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_bytes": 0, 2023-08-10T12:05:34.424 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_items": 0, 2023-08-10T12:05:34.424 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-10T12:05:34.425 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_items": 0, 2023-08-10T12:05:34.425 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_bytes": 0, 2023-08-10T12:05:34.425 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_items": 0, 2023-08-10T12:05:34.425 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_bytes": 0, 2023-08-10T12:05:34.425 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_items": 0, 2023-08-10T12:05:34.425 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_bytes": 0, 2023-08-10T12:05:34.425 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_items": 0, 2023-08-10T12:05:34.425 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_bytes": 0, 2023-08-10T12:05:34.426 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_items": 0, 2023-08-10T12:05:34.426 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_bytes": 148994, 2023-08-10T12:05:34.426 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_items": 31, 2023-08-10T12:05:34.426 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_bytes": 0, 2023-08-10T12:05:34.426 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_items": 0, 2023-08-10T12:05:34.426 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bytes": 0, 2023-08-10T12:05:34.426 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_items": 0, 2023-08-10T12:05:34.426 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_bytes": 0, 2023-08-10T12:05:34.427 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_items": 0, 2023-08-10T12:05:34.427 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_bytes": 0, 2023-08-10T12:05:34.427 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_items": 0, 2023-08-10T12:05:34.427 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_bytes": 0, 2023-08-10T12:05:34.427 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_items": 0, 2023-08-10T12:05:34.427 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_bytes": 0, 2023-08-10T12:05:34.427 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_items": 0, 2023-08-10T12:05:34.427 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_bytes": 0, 2023-08-10T12:05:34.428 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_items": 0, 2023-08-10T12:05:34.428 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_bytes": 928, 2023-08-10T12:05:34.428 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_items": 2, 2023-08-10T12:05:34.428 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_bytes": 0, 2023-08-10T12:05:34.428 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_items": 0, 2023-08-10T12:05:34.428 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_bytes": 0, 2023-08-10T12:05:34.428 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_items": 0 2023-08-10T12:05:34.429 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-08-10T12:05:34.429 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-10T12:05:34.429 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2023-08-10T12:05:34.429 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2023-08-10T12:05:34.429 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2023-08-10T12:05:34.429 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 255, 2023-08-10T12:05:34.429 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 1395211, 2023-08-10T12:05:34.429 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:34.430 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 255, 2023-08-10T12:05:34.430 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2023-08-10T12:05:34.430 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2023-08-10T12:05:34.430 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 255, 2023-08-10T12:05:34.430 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 1395211, 2023-08-10T12:05:34.430 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2023-08-10T12:05:34.430 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-08-10T12:05:34.431 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-08-10T12:05:34.431 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-08-10T12:05:34.431 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:34.431 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-08-10T12:05:34.431 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-08-10T12:05:34.868 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2023-08-10T12:05:34.868 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2023-08-10T12:05:34.868 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2023-08-10T12:05:34.868 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2023-08-10T12:05:34.869 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2023-08-10T12:05:34.869 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2023-08-10T12:05:34.869 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2023-08-10T12:05:34.869 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2023-08-10T12:05:34.869 DEBUG:tasks.check_counter:Getting stats from b 2023-08-10T12:05:34.870 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph daemon mds.b perf dump 2023-08-10T12:05:35.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:34 smithi152 ceph-mon[130220]: pgmap v403: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 17 op/s 2023-08-10T12:05:35.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:34 smithi156 ceph-mon[130574]: pgmap v403: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 17 op/s 2023-08-10T12:05:35.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:34 smithi073 ceph-mon[128869]: pgmap v403: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 17 op/s 2023-08-10T12:05:35.607 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.b/config 2023-08-10T12:05:37.052 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-08-10T12:05:37.052 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-0": { 2023-08-10T12:05:37.052 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 45515, 2023-08-10T12:05:37.053 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 44734, 2023-08-10T12:05:37.053 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 19049915, 2023-08-10T12:05:37.053 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 201640664, 2023-08-10T12:05:37.053 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 16, 2023-08-10T12:05:37.053 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 3, 2023-08-10T12:05:37.053 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 3.115329670, 2023-08-10T12:05:37.053 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 1.059025742, 2023-08-10T12:05:37.053 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.981477510, 2023-08-10T12:05:37.054 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 1.135906570, 2023-08-10T12:05:37.054 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:37.054 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 44732, 2023-08-10T12:05:37.054 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 93.150418783, 2023-08-10T12:05:37.054 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.002082411 2023-08-10T12:05:37.054 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.055 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:37.055 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 32670, 2023-08-10T12:05:37.055 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.005909873, 2023-08-10T12:05:37.055 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000180 2023-08-10T12:05:37.055 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.055 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 160, 2023-08-10T12:05:37.056 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 362656 2023-08-10T12:05:37.056 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.056 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-1": { 2023-08-10T12:05:37.056 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 223828, 2023-08-10T12:05:37.056 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 337670, 2023-08-10T12:05:37.056 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 87227966, 2023-08-10T12:05:37.056 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 351681211, 2023-08-10T12:05:37.057 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 22, 2023-08-10T12:05:37.057 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 6, 2023-08-10T12:05:37.057 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 13.153798839, 2023-08-10T12:05:37.057 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 6.221453896, 2023-08-10T12:05:37.057 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 300.819745319, 2023-08-10T12:05:37.057 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 1.030752913, 2023-08-10T12:05:37.057 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:37.058 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 337667, 2023-08-10T12:05:37.058 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 111.391313271, 2023-08-10T12:05:37.058 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000329885 2023-08-10T12:05:37.058 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.058 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:37.058 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 370830, 2023-08-10T12:05:37.058 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.071534961, 2023-08-10T12:05:37.059 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000192 2023-08-10T12:05:37.059 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.059 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 67478928, 2023-08-10T12:05:37.059 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 161808448 2023-08-10T12:05:37.059 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.059 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-2": { 2023-08-10T12:05:37.059 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 444322, 2023-08-10T12:05:37.059 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 450978, 2023-08-10T12:05:37.060 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 109212560, 2023-08-10T12:05:37.060 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 191455902, 2023-08-10T12:05:37.060 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 164, 2023-08-10T12:05:37.060 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 7, 2023-08-10T12:05:37.060 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 20.852128320, 2023-08-10T12:05:37.060 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 8.999526030, 2023-08-10T12:05:37.060 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 13.829497528, 2023-08-10T12:05:37.060 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.776467150, 2023-08-10T12:05:37.061 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:37.061 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 450978, 2023-08-10T12:05:37.061 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 46.896745185, 2023-08-10T12:05:37.061 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000103988 2023-08-10T12:05:37.061 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.061 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:37.061 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 862320, 2023-08-10T12:05:37.062 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.111036122, 2023-08-10T12:05:37.062 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000128 2023-08-10T12:05:37.062 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.062 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 1732016, 2023-08-10T12:05:37.062 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 154704 2023-08-10T12:05:37.062 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.062 INFO:teuthology.orchestra.run.smithi152.stdout: "cct": { 2023-08-10T12:05:37.062 INFO:teuthology.orchestra.run.smithi152.stdout: "total_workers": 1, 2023-08-10T12:05:37.063 INFO:teuthology.orchestra.run.smithi152.stdout: "unhealthy_workers": 0 2023-08-10T12:05:37.063 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.063 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-MDSRank": { 2023-08-10T12:05:37.063 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2023-08-10T12:05:37.063 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2023-08-10T12:05:37.063 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 7607, 2023-08-10T12:05:37.063 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 94.280039638, 2023-08-10T12:05:37.063 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.012393852 2023-08-10T12:05:37.064 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:37.064 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.064 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-PurgeQueue": { 2023-08-10T12:05:37.064 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2023-08-10T12:05:37.064 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2023-08-10T12:05:37.064 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 38608, 2023-08-10T12:05:37.064 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 7.762120600, 2023-08-10T12:05:37.065 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000201049 2023-08-10T12:05:37.065 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:37.065 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.065 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2023-08-10T12:05:37.065 INFO:teuthology.orchestra.run.smithi152.stdout: "request": 109500, 2023-08-10T12:05:37.065 INFO:teuthology.orchestra.run.smithi152.stdout: "reply": 99300, 2023-08-10T12:05:37.066 INFO:teuthology.orchestra.run.smithi152.stdout: "reply_latency": { 2023-08-10T12:05:37.066 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 99300, 2023-08-10T12:05:37.066 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1217.725732968, 2023-08-10T12:05:37.066 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.012263099 2023-08-10T12:05:37.066 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.067 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_reply": 0, 2023-08-10T12:05:37.067 INFO:teuthology.orchestra.run.smithi152.stdout: "forward": 10192, 2023-08-10T12:05:37.067 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_complete": 213, 2023-08-10T12:05:37.067 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_keys": 1, 2023-08-10T12:05:37.067 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_commit": 6300, 2023-08-10T12:05:37.067 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_split": 69, 2023-08-10T12:05:37.068 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_merge": 0, 2023-08-10T12:05:37.068 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes": 48358, 2023-08-10T12:05:37.068 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_top": 33728, 2023-08-10T12:05:37.068 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_bottom": 14460, 2023-08-10T12:05:37.068 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pin_tail": 170, 2023-08-10T12:05:37.068 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pinned": 173, 2023-08-10T12:05:37.068 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_expired": 38840, 2023-08-10T12:05:37.069 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_with_caps": 2, 2023-08-10T12:05:37.069 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": 2, 2023-08-10T12:05:37.069 INFO:teuthology.orchestra.run.smithi152.stdout: "subtrees": 7, 2023-08-10T12:05:37.069 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse": 175907, 2023-08-10T12:05:37.069 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_hit": 144989, 2023-08-10T12:05:37.069 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_forward": 9982, 2023-08-10T12:05:37.069 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_discover": 839, 2023-08-10T12:05:37.069 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_dir_fetch": 94, 2023-08-10T12:05:37.070 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_remote_ino": 0, 2023-08-10T12:05:37.070 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_lock": 416, 2023-08-10T12:05:37.070 INFO:teuthology.orchestra.run.smithi152.stdout: "load_cent": 9, 2023-08-10T12:05:37.070 INFO:teuthology.orchestra.run.smithi152.stdout: "q": 0, 2023-08-10T12:05:37.070 INFO:teuthology.orchestra.run.smithi152.stdout: "exported": 291, 2023-08-10T12:05:37.070 INFO:teuthology.orchestra.run.smithi152.stdout: "exported_inodes": 26704, 2023-08-10T12:05:37.071 INFO:teuthology.orchestra.run.smithi152.stdout: "imported": 274, 2023-08-10T12:05:37.071 INFO:teuthology.orchestra.run.smithi152.stdout: "imported_inodes": 44440, 2023-08-10T12:05:37.071 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_dir_fetch": 0, 2023-08-10T12:05:37.071 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_backtrace_fetch": 135, 2023-08-10T12:05:37.071 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_peer_discover": 0, 2023-08-10T12:05:37.071 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rfiles": 4, 2023-08-10T12:05:37.071 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rbytes": 246, 2023-08-10T12:05:37.072 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rsnaps": 7, 2023-08-10T12:05:37.072 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_fetch": 135, 2023-08-10T12:05:37.072 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_set_tag": 0, 2023-08-10T12:05:37.072 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_repaired": 0, 2023-08-10T12:05:37.072 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_inotable_repaired": 0, 2023-08-10T12:05:37.072 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_inodes": 36, 2023-08-10T12:05:37.072 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_base_inodes": 4, 2023-08-10T12:05:37.072 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dirfrag_rstats": 32, 2023-08-10T12:05:37.073 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_file_inodes": 99, 2023-08-10T12:05:37.073 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_inode_file_caps": 168, 2023-08-10T12:05:37.073 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_revoke": 15908, 2023-08-10T12:05:37.073 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_grant": 38855, 2023-08-10T12:05:37.073 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_trunc": 5, 2023-08-10T12:05:37.073 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flushsnap_ack": 33, 2023-08-10T12:05:37.073 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-10T12:05:37.074 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps": 32115, 2023-08-10T12:05:37.074 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps_dirty": 15665, 2023-08-10T12:05:37.074 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_cap_release": 489, 2023-08-10T12:05:37.074 INFO:teuthology.orchestra.run.smithi152.stdout: "process_request_cap_release": 40327 2023-08-10T12:05:37.074 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.074 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_cache": { 2023-08-10T12:05:37.074 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update": 4272, 2023-08-10T12:05:37.074 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update_receipt": 6970, 2023-08-10T12:05:37.075 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_try_discover": 4281, 2023-08-10T12:05:37.075 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_send_discover": 5742, 2023-08-10T12:05:37.075 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_handle_discover": 7598, 2023-08-10T12:05:37.075 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays": 164, 2023-08-10T12:05:37.075 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_delayed": 0, 2023-08-10T12:05:37.075 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_enqueuing": 0, 2023-08-10T12:05:37.075 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_created": 21341, 2023-08-10T12:05:37.076 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_enqueued": 21177, 2023-08-10T12:05:37.076 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_reintegrated": 0, 2023-08-10T12:05:37.076 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_migrated": 0, 2023-08-10T12:05:37.076 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_processing": 0, 2023-08-10T12:05:37.076 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_enqueued": 0, 2023-08-10T12:05:37.076 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_prioritized": 0, 2023-08-10T12:05:37.077 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_started": 0, 2023-08-10T12:05:37.077 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_completed": 0, 2023-08-10T12:05:37.077 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_enqueue_scrub": 4, 2023-08-10T12:05:37.077 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_exportdir": 293, 2023-08-10T12:05:37.077 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_flush": 0, 2023-08-10T12:05:37.077 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragmentdir": 137, 2023-08-10T12:05:37.078 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragstats": 0, 2023-08-10T12:05:37.078 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_inodestats": 0 2023-08-10T12:05:37.078 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.078 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_log": { 2023-08-10T12:05:37.078 INFO:teuthology.orchestra.run.smithi152.stdout: "evadd": 114550, 2023-08-10T12:05:37.078 INFO:teuthology.orchestra.run.smithi152.stdout: "evex": 114546, 2023-08-10T12:05:37.079 INFO:teuthology.orchestra.run.smithi152.stdout: "evtrm": 114546, 2023-08-10T12:05:37.079 INFO:teuthology.orchestra.run.smithi152.stdout: "ev": 4, 2023-08-10T12:05:37.079 INFO:teuthology.orchestra.run.smithi152.stdout: "evexg": 0, 2023-08-10T12:05:37.079 INFO:teuthology.orchestra.run.smithi152.stdout: "evexd": 159, 2023-08-10T12:05:37.079 INFO:teuthology.orchestra.run.smithi152.stdout: "segadd": 206, 2023-08-10T12:05:37.079 INFO:teuthology.orchestra.run.smithi152.stdout: "segex": 205, 2023-08-10T12:05:37.079 INFO:teuthology.orchestra.run.smithi152.stdout: "segtrm": 205, 2023-08-10T12:05:37.080 INFO:teuthology.orchestra.run.smithi152.stdout: "seg": 2, 2023-08-10T12:05:37.080 INFO:teuthology.orchestra.run.smithi152.stdout: "segexg": 0, 2023-08-10T12:05:37.080 INFO:teuthology.orchestra.run.smithi152.stdout: "segexd": 1, 2023-08-10T12:05:37.080 INFO:teuthology.orchestra.run.smithi152.stdout: "expos": 402503308, 2023-08-10T12:05:37.080 INFO:teuthology.orchestra.run.smithi152.stdout: "wrpos": 402534493, 2023-08-10T12:05:37.080 INFO:teuthology.orchestra.run.smithi152.stdout: "rdpos": 0, 2023-08-10T12:05:37.081 INFO:teuthology.orchestra.run.smithi152.stdout: "jlat": { 2023-08-10T12:05:37.081 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2927, 2023-08-10T12:05:37.081 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 130.262573466, 2023-08-10T12:05:37.081 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.044503783 2023-08-10T12:05:37.081 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.081 INFO:teuthology.orchestra.run.smithi152.stdout: "replayed": 0 2023-08-10T12:05:37.081 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.082 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_mem": { 2023-08-10T12:05:37.082 INFO:teuthology.orchestra.run.smithi152.stdout: "ino": 25981, 2023-08-10T12:05:37.082 INFO:teuthology.orchestra.run.smithi152.stdout: "ino+": 65962, 2023-08-10T12:05:37.082 INFO:teuthology.orchestra.run.smithi152.stdout: "ino-": 39981, 2023-08-10T12:05:37.082 INFO:teuthology.orchestra.run.smithi152.stdout: "dir": 1060, 2023-08-10T12:05:37.082 INFO:teuthology.orchestra.run.smithi152.stdout: "dir+": 4251, 2023-08-10T12:05:37.082 INFO:teuthology.orchestra.run.smithi152.stdout: "dir-": 3191, 2023-08-10T12:05:37.082 INFO:teuthology.orchestra.run.smithi152.stdout: "dn": 48358, 2023-08-10T12:05:37.083 INFO:teuthology.orchestra.run.smithi152.stdout: "dn+": 118872, 2023-08-10T12:05:37.083 INFO:teuthology.orchestra.run.smithi152.stdout: "dn-": 70514, 2023-08-10T12:05:37.083 INFO:teuthology.orchestra.run.smithi152.stdout: "cap": 2, 2023-08-10T12:05:37.083 INFO:teuthology.orchestra.run.smithi152.stdout: "cap+": 37449, 2023-08-10T12:05:37.083 INFO:teuthology.orchestra.run.smithi152.stdout: "cap-": 37447, 2023-08-10T12:05:37.083 INFO:teuthology.orchestra.run.smithi152.stdout: "rss": 217772, 2023-08-10T12:05:37.083 INFO:teuthology.orchestra.run.smithi152.stdout: "heap": 207152 2023-08-10T12:05:37.083 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.084 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_server": { 2023-08-10T12:05:37.084 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_client_request": 128761, 2023-08-10T12:05:37.084 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_server_request": 2323, 2023-08-10T12:05:37.084 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_request": 109500, 2023-08-10T12:05:37.084 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_session": 407, 2023-08-10T12:05:37.084 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_peer_request": 4151, 2023-08-10T12:05:37.084 INFO:teuthology.orchestra.run.smithi152.stdout: "req_create_latency": { 2023-08-10T12:05:37.085 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 15353, 2023-08-10T12:05:37.085 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 52.580239231, 2023-08-10T12:05:37.085 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.003424753 2023-08-10T12:05:37.085 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.085 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getattr_latency": { 2023-08-10T12:05:37.085 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1977, 2023-08-10T12:05:37.086 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 77.704766295, 2023-08-10T12:05:37.086 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.039304383 2023-08-10T12:05:37.086 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.086 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getfilelock_latency": { 2023-08-10T12:05:37.086 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:37.086 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:37.086 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:37.087 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.087 INFO:teuthology.orchestra.run.smithi152.stdout: "req_link_latency": { 2023-08-10T12:05:37.087 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:37.087 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:37.087 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:37.087 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.087 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookup_latency": { 2023-08-10T12:05:37.088 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 41785, 2023-08-10T12:05:37.088 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 721.505057257, 2023-08-10T12:05:37.088 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.017267082 2023-08-10T12:05:37.088 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.089 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookuphash_latency": { 2023-08-10T12:05:37.089 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:37.089 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:37.089 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:37.089 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.089 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupino_latency": { 2023-08-10T12:05:37.089 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:37.089 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:37.090 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:37.090 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.090 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupname_latency": { 2023-08-10T12:05:37.090 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:37.090 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:37.090 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:37.090 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.091 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupparent_latency": { 2023-08-10T12:05:37.091 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:37.091 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:37.091 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:37.091 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.091 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupsnap_latency": { 2023-08-10T12:05:37.091 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:37.091 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:37.092 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:37.092 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.092 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lssnap_latency": { 2023-08-10T12:05:37.092 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 13, 2023-08-10T12:05:37.092 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.007924647, 2023-08-10T12:05:37.092 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000609588 2023-08-10T12:05:37.092 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.093 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mkdir_latency": { 2023-08-10T12:05:37.093 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 118, 2023-08-10T12:05:37.093 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 2.409921718, 2023-08-10T12:05:37.093 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.020423065 2023-08-10T12:05:37.093 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.093 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mknod_latency": { 2023-08-10T12:05:37.093 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:37.094 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:37.094 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:37.094 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.094 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mksnap_latency": { 2023-08-10T12:05:37.094 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 13, 2023-08-10T12:05:37.094 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 7.599595643, 2023-08-10T12:05:37.094 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.584584280 2023-08-10T12:05:37.094 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.095 INFO:teuthology.orchestra.run.smithi152.stdout: "req_open_latency": { 2023-08-10T12:05:37.095 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 4538, 2023-08-10T12:05:37.095 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 29.818377115, 2023-08-10T12:05:37.095 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.006570819 2023-08-10T12:05:37.095 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.095 INFO:teuthology.orchestra.run.smithi152.stdout: "req_readdir_latency": { 2023-08-10T12:05:37.095 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 973, 2023-08-10T12:05:37.096 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 4.477424513, 2023-08-10T12:05:37.096 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.004601669 2023-08-10T12:05:37.096 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.096 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rename_latency": { 2023-08-10T12:05:37.096 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 14944, 2023-08-10T12:05:37.096 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 244.241083237, 2023-08-10T12:05:37.097 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.016343755 2023-08-10T12:05:37.097 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.097 INFO:teuthology.orchestra.run.smithi152.stdout: "req_renamesnap_latency": { 2023-08-10T12:05:37.097 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:37.097 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:37.097 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:37.097 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.097 INFO:teuthology.orchestra.run.smithi152.stdout: "req_snapdiff_latency": { 2023-08-10T12:05:37.098 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:37.098 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:37.098 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:37.098 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.098 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmdir_latency": { 2023-08-10T12:05:37.098 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 167, 2023-08-10T12:05:37.098 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 38.507818326, 2023-08-10T12:05:37.099 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.230585738 2023-08-10T12:05:37.099 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.099 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmsnap_latency": { 2023-08-10T12:05:37.099 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 6, 2023-08-10T12:05:37.099 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 6.496040604, 2023-08-10T12:05:37.099 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 1.082673434 2023-08-10T12:05:37.100 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.100 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmxattr_latency": { 2023-08-10T12:05:37.100 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:37.100 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:37.100 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:37.100 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.100 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setattr_latency": { 2023-08-10T12:05:37.100 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 6, 2023-08-10T12:05:37.101 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.029522836, 2023-08-10T12:05:37.101 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.004920472 2023-08-10T12:05:37.101 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.101 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setdirlayout_latency": { 2023-08-10T12:05:37.101 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:37.101 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:37.101 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:37.102 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.102 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setfilelock_latency": { 2023-08-10T12:05:37.102 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:37.102 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:37.102 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:37.102 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.102 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setlayout_latency": { 2023-08-10T12:05:37.103 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:37.103 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:37.103 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:37.103 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.103 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setxattr_latency": { 2023-08-10T12:05:37.103 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 6, 2023-08-10T12:05:37.104 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.016872660, 2023-08-10T12:05:37.104 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.002812110 2023-08-10T12:05:37.104 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.104 INFO:teuthology.orchestra.run.smithi152.stdout: "req_symlink_latency": { 2023-08-10T12:05:37.105 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 3, 2023-08-10T12:05:37.105 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.002285763, 2023-08-10T12:05:37.105 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000761921 2023-08-10T12:05:37.105 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.106 INFO:teuthology.orchestra.run.smithi152.stdout: "req_unlink_latency": { 2023-08-10T12:05:37.106 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 19398, 2023-08-10T12:05:37.106 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 32.328803123, 2023-08-10T12:05:37.106 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001666604 2023-08-10T12:05:37.107 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.107 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_revoke_eviction": 0, 2023-08-10T12:05:37.107 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_acquisition_throttle": 0, 2023-08-10T12:05:37.107 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getvxattr_latency": { 2023-08-10T12:05:37.107 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:37.107 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:37.107 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:37.108 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:37.108 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.108 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_sessions": { 2023-08-10T12:05:37.108 INFO:teuthology.orchestra.run.smithi152.stdout: "session_count": 2, 2023-08-10T12:05:37.108 INFO:teuthology.orchestra.run.smithi152.stdout: "session_add": 5, 2023-08-10T12:05:37.108 INFO:teuthology.orchestra.run.smithi152.stdout: "session_remove": 3, 2023-08-10T12:05:37.108 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_open": 2, 2023-08-10T12:05:37.109 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_stale": 0, 2023-08-10T12:05:37.109 INFO:teuthology.orchestra.run.smithi152.stdout: "total_load": 12039, 2023-08-10T12:05:37.109 INFO:teuthology.orchestra.run.smithi152.stdout: "average_load": 6019, 2023-08-10T12:05:37.109 INFO:teuthology.orchestra.run.smithi152.stdout: "avg_session_uptime": 773 2023-08-10T12:05:37.109 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.109 INFO:teuthology.orchestra.run.smithi152.stdout: "mempool": { 2023-08-10T12:05:37.110 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_bytes": 240, 2023-08-10T12:05:37.110 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_items": 240, 2023-08-10T12:05:37.110 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_bytes": 0, 2023-08-10T12:05:37.110 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_items": 0, 2023-08-10T12:05:37.110 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_bytes": 0, 2023-08-10T12:05:37.110 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_items": 0, 2023-08-10T12:05:37.110 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-10T12:05:37.111 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_items": 0, 2023-08-10T12:05:37.111 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-10T12:05:37.111 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_items": 0, 2023-08-10T12:05:37.111 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_bytes": 0, 2023-08-10T12:05:37.111 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_items": 0, 2023-08-10T12:05:37.111 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-10T12:05:37.111 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_items": 0, 2023-08-10T12:05:37.111 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_bytes": 0, 2023-08-10T12:05:37.112 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_items": 0, 2023-08-10T12:05:37.112 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_bytes": 0, 2023-08-10T12:05:37.112 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_items": 0, 2023-08-10T12:05:37.112 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-10T12:05:37.112 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_items": 0, 2023-08-10T12:05:37.112 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-10T12:05:37.112 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_items": 0, 2023-08-10T12:05:37.113 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_bytes": 0, 2023-08-10T12:05:37.113 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_items": 0, 2023-08-10T12:05:37.113 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_bytes": 0, 2023-08-10T12:05:37.113 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_items": 0, 2023-08-10T12:05:37.113 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-10T12:05:37.113 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_items": 0, 2023-08-10T12:05:37.113 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_bytes": 0, 2023-08-10T12:05:37.114 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_items": 0, 2023-08-10T12:05:37.114 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_bytes": 0, 2023-08-10T12:05:37.114 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_items": 0, 2023-08-10T12:05:37.114 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_bytes": 0, 2023-08-10T12:05:37.114 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_items": 0, 2023-08-10T12:05:37.114 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_bytes": 0, 2023-08-10T12:05:37.114 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_items": 0, 2023-08-10T12:05:37.115 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_bytes": 2542613, 2023-08-10T12:05:37.115 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_items": 26610, 2023-08-10T12:05:37.115 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_bytes": 0, 2023-08-10T12:05:37.115 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_items": 0, 2023-08-10T12:05:37.115 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_bytes": 0, 2023-08-10T12:05:37.115 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_items": 0, 2023-08-10T12:05:37.115 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_bytes": 0, 2023-08-10T12:05:37.116 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_items": 0, 2023-08-10T12:05:37.116 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_bytes": 0, 2023-08-10T12:05:37.116 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_items": 0, 2023-08-10T12:05:37.116 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_bytes": 8032, 2023-08-10T12:05:37.116 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_items": 167, 2023-08-10T12:05:37.116 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_bytes": 0, 2023-08-10T12:05:37.116 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_items": 0, 2023-08-10T12:05:37.117 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_bytes": 0, 2023-08-10T12:05:37.117 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_items": 0, 2023-08-10T12:05:37.117 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_bytes": 94911996, 2023-08-10T12:05:37.117 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_items": 945523, 2023-08-10T12:05:37.117 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_bytes": 0, 2023-08-10T12:05:37.117 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_items": 0, 2023-08-10T12:05:37.117 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_bytes": 0, 2023-08-10T12:05:37.118 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_items": 0 2023-08-10T12:05:37.118 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.118 INFO:teuthology.orchestra.run.smithi152.stdout: "objecter": { 2023-08-10T12:05:37.118 INFO:teuthology.orchestra.run.smithi152.stdout: "op_active": 0, 2023-08-10T12:05:37.118 INFO:teuthology.orchestra.run.smithi152.stdout: "op_laggy": 0, 2023-08-10T12:05:37.118 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send": 66599, 2023-08-10T12:05:37.118 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send_bytes": 475400647, 2023-08-10T12:05:37.119 INFO:teuthology.orchestra.run.smithi152.stdout: "op_resend": 37, 2023-08-10T12:05:37.119 INFO:teuthology.orchestra.run.smithi152.stdout: "op_reply": 66599, 2023-08-10T12:05:37.119 INFO:teuthology.orchestra.run.smithi152.stdout: "op_latency": { 2023-08-10T12:05:37.119 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 66599, 2023-08-10T12:05:37.119 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 26135.136231781, 2023-08-10T12:05:37.119 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.392425355 2023-08-10T12:05:37.120 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.120 INFO:teuthology.orchestra.run.smithi152.stdout: "op_inflight": 0, 2023-08-10T12:05:37.120 INFO:teuthology.orchestra.run.smithi152.stdout: "oplen_avg": { 2023-08-10T12:05:37.120 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 66599, 2023-08-10T12:05:37.120 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 146666 2023-08-10T12:05:37.120 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.121 INFO:teuthology.orchestra.run.smithi152.stdout: "op": 66599, 2023-08-10T12:05:37.121 INFO:teuthology.orchestra.run.smithi152.stdout: "op_r": 1358, 2023-08-10T12:05:37.121 INFO:teuthology.orchestra.run.smithi152.stdout: "op_w": 65241, 2023-08-10T12:05:37.121 INFO:teuthology.orchestra.run.smithi152.stdout: "op_rmw": 0, 2023-08-10T12:05:37.121 INFO:teuthology.orchestra.run.smithi152.stdout: "op_pg": 0, 2023-08-10T12:05:37.122 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_stat": 5589, 2023-08-10T12:05:37.122 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_create": 32867, 2023-08-10T12:05:37.122 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_read": 506, 2023-08-10T12:05:37.122 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_write": 3430, 2023-08-10T12:05:37.123 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writefull": 475, 2023-08-10T12:05:37.123 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writesame": 0, 2023-08-10T12:05:37.123 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_append": 0, 2023-08-10T12:05:37.123 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_zero": 0, 2023-08-10T12:05:37.124 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_truncate": 69, 2023-08-10T12:05:37.124 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_delete": 21877, 2023-08-10T12:05:37.124 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_mapext": 0, 2023-08-10T12:05:37.124 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_sparse_read": 0, 2023-08-10T12:05:37.124 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_clonerange": 0, 2023-08-10T12:05:37.124 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_getxattr": 147, 2023-08-10T12:05:37.125 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_setxattr": 65734, 2023-08-10T12:05:37.125 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_cmpxattr": 0, 2023-08-10T12:05:37.125 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_rmxattr": 0, 2023-08-10T12:05:37.125 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_resetxattrs": 0, 2023-08-10T12:05:37.125 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_call": 0, 2023-08-10T12:05:37.125 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_watch": 0, 2023-08-10T12:05:37.126 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_notify": 0, 2023-08-10T12:05:37.126 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_src_cmpxattr": 0, 2023-08-10T12:05:37.126 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls": 0, 2023-08-10T12:05:37.126 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls_filter": 0, 2023-08-10T12:05:37.126 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_other": 5, 2023-08-10T12:05:37.127 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_active": 0, 2023-08-10T12:05:37.127 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_send": 0, 2023-08-10T12:05:37.127 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_resend": 0, 2023-08-10T12:05:37.127 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_ping": 0, 2023-08-10T12:05:37.127 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_active": 0, 2023-08-10T12:05:37.127 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_send": 0, 2023-08-10T12:05:37.128 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_resend": 0, 2023-08-10T12:05:37.128 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_active": 0, 2023-08-10T12:05:37.128 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_send": 0, 2023-08-10T12:05:37.128 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_resend": 0, 2023-08-10T12:05:37.128 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_active": 0, 2023-08-10T12:05:37.129 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_send": 0, 2023-08-10T12:05:37.129 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_resend": 0, 2023-08-10T12:05:37.129 INFO:teuthology.orchestra.run.smithi152.stdout: "command_active": 0, 2023-08-10T12:05:37.129 INFO:teuthology.orchestra.run.smithi152.stdout: "command_send": 0, 2023-08-10T12:05:37.129 INFO:teuthology.orchestra.run.smithi152.stdout: "command_resend": 0, 2023-08-10T12:05:37.129 INFO:teuthology.orchestra.run.smithi152.stdout: "map_epoch": 98, 2023-08-10T12:05:37.129 INFO:teuthology.orchestra.run.smithi152.stdout: "map_full": 0, 2023-08-10T12:05:37.130 INFO:teuthology.orchestra.run.smithi152.stdout: "map_inc": 16, 2023-08-10T12:05:37.130 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_sessions": 12, 2023-08-10T12:05:37.130 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_open": 12, 2023-08-10T12:05:37.130 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_close": 0, 2023-08-10T12:05:37.130 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_laggy": 0, 2023-08-10T12:05:37.130 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_wr": 12147, 2023-08-10T12:05:37.131 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_rd": 927, 2023-08-10T12:05:37.131 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_del": 2893 2023-08-10T12:05:37.131 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.131 INFO:teuthology.orchestra.run.smithi152.stdout: "oft": { 2023-08-10T12:05:37.131 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_objs": 1, 2023-08-10T12:05:37.131 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_kv_pairs": 0, 2023-08-10T12:05:37.131 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_updates": 0, 2023-08-10T12:05:37.132 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_removes": 0 2023-08-10T12:05:37.132 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.132 INFO:teuthology.orchestra.run.smithi152.stdout: "osd-slow-ops": { 2023-08-10T12:05:37.132 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_ops_count": 9 2023-08-10T12:05:37.132 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.132 INFO:teuthology.orchestra.run.smithi152.stdout: "purge_queue": { 2023-08-10T12:05:37.132 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops": 0, 2023-08-10T12:05:37.133 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops_high_water": 6, 2023-08-10T12:05:37.133 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing": 0, 2023-08-10T12:05:37.133 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_high_water": 6, 2023-08-10T12:05:37.133 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed": 21177, 2023-08-10T12:05:37.133 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_item_in_journal": 0 2023-08-10T12:05:37.133 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.133 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-10T12:05:37.133 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-08-10T12:05:37.134 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2023-08-10T12:05:37.134 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-08-10T12:05:37.134 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 713661, 2023-08-10T12:05:37.134 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 142834346, 2023-08-10T12:05:37.134 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:37.134 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 713661, 2023-08-10T12:05:37.134 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2023-08-10T12:05:37.134 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2023-08-10T12:05:37.135 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 713661, 2023-08-10T12:05:37.135 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 142834346, 2023-08-10T12:05:37.135 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-08-10T12:05:37.135 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:37.135 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:37.135 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:37.135 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:37.135 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.136 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_bytes": { 2023-08-10T12:05:37.136 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-08-10T12:05:37.136 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2023-08-10T12:05:37.136 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-08-10T12:05:37.136 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2023-08-10T12:05:37.136 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2023-08-10T12:05:37.136 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:37.137 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:37.137 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 66599, 2023-08-10T12:05:37.137 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 478349287, 2023-08-10T12:05:37.137 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 66599, 2023-08-10T12:05:37.137 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 478349287, 2023-08-10T12:05:37.137 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-08-10T12:05:37.137 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:37.137 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:37.138 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:37.138 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:37.138 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.138 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_ops": { 2023-08-10T12:05:37.138 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-08-10T12:05:37.138 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 1024, 2023-08-10T12:05:37.138 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-08-10T12:05:37.139 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2023-08-10T12:05:37.139 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2023-08-10T12:05:37.139 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:37.139 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:37.139 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 66599, 2023-08-10T12:05:37.139 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 66599, 2023-08-10T12:05:37.140 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 66599, 2023-08-10T12:05:37.140 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 66599, 2023-08-10T12:05:37.140 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-08-10T12:05:37.140 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:37.140 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:37.140 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:37.140 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:37.141 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.141 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle": { 2023-08-10T12:05:37.141 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-08-10T12:05:37.141 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2023-08-10T12:05:37.142 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-08-10T12:05:37.142 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 21177, 2023-08-10T12:05:37.142 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 2968981, 2023-08-10T12:05:37.142 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:37.143 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 21177, 2023-08-10T12:05:37.143 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2023-08-10T12:05:37.143 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2023-08-10T12:05:37.143 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 502, 2023-08-10T12:05:37.144 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 2968981, 2023-08-10T12:05:37.144 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-08-10T12:05:37.144 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:37.144 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:37.145 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:37.145 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:37.145 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:37.145 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle-0x560dcd24e0a0": { 2023-08-10T12:05:37.145 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-08-10T12:05:37.145 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2023-08-10T12:05:37.146 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-08-10T12:05:37.146 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 114550, 2023-08-10T12:05:37.146 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 398340189, 2023-08-10T12:05:37.146 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:37.146 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 114550, 2023-08-10T12:05:37.146 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2023-08-10T12:05:37.146 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2023-08-10T12:05:37.146 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 2927, 2023-08-10T12:05:37.147 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 398340189, 2023-08-10T12:05:37.147 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-08-10T12:05:37.147 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:37.147 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:37.147 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:37.147 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:37.148 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:37.148 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-08-10T12:05:37.419 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:37 smithi152 ceph-mon[130220]: pgmap v404: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 KiB/s wr, 15 op/s 2023-08-10T12:05:37.465 INFO:tasks.check_counter:Daemon mds.b mds.exported=291 2023-08-10T12:05:37.465 INFO:tasks.check_counter:Daemon mds.b mds.imported=274 2023-08-10T12:05:37.466 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=4272 2023-08-10T12:05:37.466 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=6970 2023-08-10T12:05:37.466 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=7 2023-08-10T12:05:37.466 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=13 2023-08-10T12:05:37.466 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=6 2023-08-10T12:05:37.467 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=69 2023-08-10T12:05:37.467 DEBUG:tasks.check_counter:Getting stats from e 2023-08-10T12:05:37.467 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph daemon mds.e perf dump 2023-08-10T12:05:37.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:37 smithi156 ceph-mon[130574]: pgmap v404: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 KiB/s wr, 15 op/s 2023-08-10T12:05:37.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:37 smithi073 ceph-mon[128869]: pgmap v404: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 KiB/s wr, 15 op/s 2023-08-10T12:05:38.042 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.b/config 2023-08-10T12:05:39.244 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-08-10T12:05:39.244 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-0": { 2023-08-10T12:05:39.244 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 1195489, 2023-08-10T12:05:39.244 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 1249354, 2023-08-10T12:05:39.244 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 236512502, 2023-08-10T12:05:39.244 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 365504101, 2023-08-10T12:05:39.245 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 23, 2023-08-10T12:05:39.245 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 8, 2023-08-10T12:05:39.245 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 47.742479761, 2023-08-10T12:05:39.245 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 21.329987421, 2023-08-10T12:05:39.245 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 229.538043468, 2023-08-10T12:05:39.245 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.221187023, 2023-08-10T12:05:39.245 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:39.246 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1249348, 2023-08-10T12:05:39.246 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 48.145470449, 2023-08-10T12:05:39.246 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000038536 2023-08-10T12:05:39.246 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.246 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:39.246 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2322044, 2023-08-10T12:05:39.246 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.261502635, 2023-08-10T12:05:39.246 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000112 2023-08-10T12:05:39.247 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.247 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 49811376, 2023-08-10T12:05:39.247 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 94135376 2023-08-10T12:05:39.247 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.247 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-1": { 2023-08-10T12:05:39.247 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 38976, 2023-08-10T12:05:39.247 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 36290, 2023-08-10T12:05:39.248 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 17286511, 2023-08-10T12:05:39.248 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 110574456, 2023-08-10T12:05:39.248 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 12, 2023-08-10T12:05:39.248 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 5, 2023-08-10T12:05:39.248 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 2.484024522, 2023-08-10T12:05:39.248 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 1.169835338, 2023-08-10T12:05:39.248 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 1.481194512, 2023-08-10T12:05:39.248 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.166955421, 2023-08-10T12:05:39.249 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:39.249 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 36293, 2023-08-10T12:05:39.249 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 4.288193944, 2023-08-10T12:05:39.249 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000118154 2023-08-10T12:05:39.249 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.249 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:39.249 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 63815, 2023-08-10T12:05:39.249 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.012141980, 2023-08-10T12:05:39.250 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000190 2023-08-10T12:05:39.250 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.250 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-08-10T12:05:39.250 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 478512 2023-08-10T12:05:39.250 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.250 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-2": { 2023-08-10T12:05:39.250 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 14289, 2023-08-10T12:05:39.251 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 14050, 2023-08-10T12:05:39.251 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 8000674, 2023-08-10T12:05:39.251 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 51275650, 2023-08-10T12:05:39.251 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 11, 2023-08-10T12:05:39.251 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 7, 2023-08-10T12:05:39.251 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.943250045, 2023-08-10T12:05:39.251 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.380191654, 2023-08-10T12:05:39.251 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.485538441, 2023-08-10T12:05:39.252 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.148633970, 2023-08-10T12:05:39.252 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:39.252 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 14048, 2023-08-10T12:05:39.252 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1.494023857, 2023-08-10T12:05:39.252 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000106351 2023-08-10T12:05:39.252 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.252 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:39.253 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 18183, 2023-08-10T12:05:39.253 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.003471420, 2023-08-10T12:05:39.253 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000190 2023-08-10T12:05:39.253 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.253 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 1672416, 2023-08-10T12:05:39.253 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 158864 2023-08-10T12:05:39.253 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.254 INFO:teuthology.orchestra.run.smithi152.stdout: "cct": { 2023-08-10T12:05:39.254 INFO:teuthology.orchestra.run.smithi152.stdout: "total_workers": 1, 2023-08-10T12:05:39.254 INFO:teuthology.orchestra.run.smithi152.stdout: "unhealthy_workers": 0 2023-08-10T12:05:39.254 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.254 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-MDSRank": { 2023-08-10T12:05:39.254 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2023-08-10T12:05:39.254 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2023-08-10T12:05:39.254 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 4839, 2023-08-10T12:05:39.255 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 54.413825116, 2023-08-10T12:05:39.255 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.011244849 2023-08-10T12:05:39.255 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:39.255 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.255 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-PurgeQueue": { 2023-08-10T12:05:39.255 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2023-08-10T12:05:39.255 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2023-08-10T12:05:39.255 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 16100, 2023-08-10T12:05:39.256 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 5.027482662, 2023-08-10T12:05:39.256 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000312266 2023-08-10T12:05:39.256 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:39.256 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.256 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2023-08-10T12:05:39.256 INFO:teuthology.orchestra.run.smithi152.stdout: "request": 62640, 2023-08-10T12:05:39.256 INFO:teuthology.orchestra.run.smithi152.stdout: "reply": 53278, 2023-08-10T12:05:39.256 INFO:teuthology.orchestra.run.smithi152.stdout: "reply_latency": { 2023-08-10T12:05:39.257 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 53278, 2023-08-10T12:05:39.257 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 635.282884417, 2023-08-10T12:05:39.257 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.011923925 2023-08-10T12:05:39.257 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.257 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_reply": 0, 2023-08-10T12:05:39.257 INFO:teuthology.orchestra.run.smithi152.stdout: "forward": 9362, 2023-08-10T12:05:39.257 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_complete": 45, 2023-08-10T12:05:39.258 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_keys": 0, 2023-08-10T12:05:39.258 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_commit": 586, 2023-08-10T12:05:39.258 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_split": 64, 2023-08-10T12:05:39.258 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_merge": 0, 2023-08-10T12:05:39.258 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes": 16387, 2023-08-10T12:05:39.258 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_top": 16, 2023-08-10T12:05:39.258 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_bottom": 13, 2023-08-10T12:05:39.258 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pin_tail": 16358, 2023-08-10T12:05:39.259 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pinned": 16361, 2023-08-10T12:05:39.259 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_expired": 27457, 2023-08-10T12:05:39.259 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_with_caps": 0, 2023-08-10T12:05:39.259 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": 0, 2023-08-10T12:05:39.259 INFO:teuthology.orchestra.run.smithi152.stdout: "subtrees": 6, 2023-08-10T12:05:39.259 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse": 102016, 2023-08-10T12:05:39.259 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_hit": 80442, 2023-08-10T12:05:39.259 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_forward": 9202, 2023-08-10T12:05:39.260 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_discover": 1183, 2023-08-10T12:05:39.260 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_dir_fetch": 40, 2023-08-10T12:05:39.260 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_remote_ino": 0, 2023-08-10T12:05:39.260 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_lock": 874, 2023-08-10T12:05:39.260 INFO:teuthology.orchestra.run.smithi152.stdout: "load_cent": 0, 2023-08-10T12:05:39.260 INFO:teuthology.orchestra.run.smithi152.stdout: "q": 0, 2023-08-10T12:05:39.260 INFO:teuthology.orchestra.run.smithi152.stdout: "exported": 152, 2023-08-10T12:05:39.261 INFO:teuthology.orchestra.run.smithi152.stdout: "exported_inodes": 20141, 2023-08-10T12:05:39.261 INFO:teuthology.orchestra.run.smithi152.stdout: "imported": 152, 2023-08-10T12:05:39.261 INFO:teuthology.orchestra.run.smithi152.stdout: "imported_inodes": 12120, 2023-08-10T12:05:39.261 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_dir_fetch": 0, 2023-08-10T12:05:39.261 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_backtrace_fetch": 269, 2023-08-10T12:05:39.261 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_peer_discover": 0, 2023-08-10T12:05:39.261 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rfiles": 1767, 2023-08-10T12:05:39.261 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rbytes": 37429583, 2023-08-10T12:05:39.262 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rsnaps": 2, 2023-08-10T12:05:39.262 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_fetch": 269, 2023-08-10T12:05:39.262 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_set_tag": 0, 2023-08-10T12:05:39.262 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_repaired": 0, 2023-08-10T12:05:39.262 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_inotable_repaired": 0, 2023-08-10T12:05:39.262 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_inodes": 0, 2023-08-10T12:05:39.262 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_base_inodes": 0, 2023-08-10T12:05:39.262 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dirfrag_rstats": 0, 2023-08-10T12:05:39.263 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_file_inodes": 269, 2023-08-10T12:05:39.263 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_inode_file_caps": 74, 2023-08-10T12:05:39.263 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_revoke": 12813, 2023-08-10T12:05:39.263 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_grant": 23305, 2023-08-10T12:05:39.263 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_trunc": 0, 2023-08-10T12:05:39.263 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flushsnap_ack": 84, 2023-08-10T12:05:39.263 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-10T12:05:39.263 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps": 29708, 2023-08-10T12:05:39.264 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps_dirty": 13740, 2023-08-10T12:05:39.264 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_cap_release": 427, 2023-08-10T12:05:39.264 INFO:teuthology.orchestra.run.smithi152.stdout: "process_request_cap_release": 27038 2023-08-10T12:05:39.264 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.264 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_cache": { 2023-08-10T12:05:39.264 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update": 2384, 2023-08-10T12:05:39.264 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update_receipt": 8668, 2023-08-10T12:05:39.265 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_try_discover": 5159, 2023-08-10T12:05:39.265 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_send_discover": 6879, 2023-08-10T12:05:39.265 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_handle_discover": 3964, 2023-08-10T12:05:39.265 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays": 54, 2023-08-10T12:05:39.265 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_delayed": 0, 2023-08-10T12:05:39.265 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_enqueuing": 0, 2023-08-10T12:05:39.265 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_created": 8758, 2023-08-10T12:05:39.265 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_enqueued": 8704, 2023-08-10T12:05:39.266 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_reintegrated": 0, 2023-08-10T12:05:39.266 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_migrated": 0, 2023-08-10T12:05:39.266 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_processing": 0, 2023-08-10T12:05:39.266 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_enqueued": 0, 2023-08-10T12:05:39.266 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_prioritized": 0, 2023-08-10T12:05:39.266 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_started": 0, 2023-08-10T12:05:39.266 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_completed": 0, 2023-08-10T12:05:39.266 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_enqueue_scrub": 0, 2023-08-10T12:05:39.267 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_exportdir": 153, 2023-08-10T12:05:39.267 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_flush": 0, 2023-08-10T12:05:39.267 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragmentdir": 69, 2023-08-10T12:05:39.267 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragstats": 0, 2023-08-10T12:05:39.267 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_inodestats": 0 2023-08-10T12:05:39.267 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.267 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_log": { 2023-08-10T12:05:39.267 INFO:teuthology.orchestra.run.smithi152.stdout: "evadd": 73761, 2023-08-10T12:05:39.268 INFO:teuthology.orchestra.run.smithi152.stdout: "evex": 0, 2023-08-10T12:05:39.268 INFO:teuthology.orchestra.run.smithi152.stdout: "evtrm": 0, 2023-08-10T12:05:39.268 INFO:teuthology.orchestra.run.smithi152.stdout: "ev": 73761, 2023-08-10T12:05:39.268 INFO:teuthology.orchestra.run.smithi152.stdout: "evexg": 0, 2023-08-10T12:05:39.268 INFO:teuthology.orchestra.run.smithi152.stdout: "evexd": 0, 2023-08-10T12:05:39.268 INFO:teuthology.orchestra.run.smithi152.stdout: "segadd": 110, 2023-08-10T12:05:39.268 INFO:teuthology.orchestra.run.smithi152.stdout: "segex": 0, 2023-08-10T12:05:39.269 INFO:teuthology.orchestra.run.smithi152.stdout: "segtrm": 0, 2023-08-10T12:05:39.269 INFO:teuthology.orchestra.run.smithi152.stdout: "seg": 110, 2023-08-10T12:05:39.269 INFO:teuthology.orchestra.run.smithi152.stdout: "segexg": 0, 2023-08-10T12:05:39.269 INFO:teuthology.orchestra.run.smithi152.stdout: "segexd": 0, 2023-08-10T12:05:39.269 INFO:teuthology.orchestra.run.smithi152.stdout: "expos": 4194304, 2023-08-10T12:05:39.269 INFO:teuthology.orchestra.run.smithi152.stdout: "wrpos": 243839640, 2023-08-10T12:05:39.269 INFO:teuthology.orchestra.run.smithi152.stdout: "rdpos": 0, 2023-08-10T12:05:39.269 INFO:teuthology.orchestra.run.smithi152.stdout: "jlat": { 2023-08-10T12:05:39.270 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2256, 2023-08-10T12:05:39.270 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 133.967584871, 2023-08-10T12:05:39.270 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.059382794 2023-08-10T12:05:39.270 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.270 INFO:teuthology.orchestra.run.smithi152.stdout: "replayed": 0 2023-08-10T12:05:39.270 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.270 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_mem": { 2023-08-10T12:05:39.270 INFO:teuthology.orchestra.run.smithi152.stdout: "ino": 7958, 2023-08-10T12:05:39.271 INFO:teuthology.orchestra.run.smithi152.stdout: "ino+": 30120, 2023-08-10T12:05:39.271 INFO:teuthology.orchestra.run.smithi152.stdout: "ino-": 22162, 2023-08-10T12:05:39.271 INFO:teuthology.orchestra.run.smithi152.stdout: "dir": 392, 2023-08-10T12:05:39.271 INFO:teuthology.orchestra.run.smithi152.stdout: "dir+": 4378, 2023-08-10T12:05:39.271 INFO:teuthology.orchestra.run.smithi152.stdout: "dir-": 3986, 2023-08-10T12:05:39.271 INFO:teuthology.orchestra.run.smithi152.stdout: "dn": 16387, 2023-08-10T12:05:39.271 INFO:teuthology.orchestra.run.smithi152.stdout: "dn+": 55310, 2023-08-10T12:05:39.272 INFO:teuthology.orchestra.run.smithi152.stdout: "dn-": 38923, 2023-08-10T12:05:39.272 INFO:teuthology.orchestra.run.smithi152.stdout: "cap": 0, 2023-08-10T12:05:39.272 INFO:teuthology.orchestra.run.smithi152.stdout: "cap+": 19054, 2023-08-10T12:05:39.272 INFO:teuthology.orchestra.run.smithi152.stdout: "cap-": 19054, 2023-08-10T12:05:39.272 INFO:teuthology.orchestra.run.smithi152.stdout: "rss": 157500, 2023-08-10T12:05:39.272 INFO:teuthology.orchestra.run.smithi152.stdout: "heap": 198960 2023-08-10T12:05:39.272 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.272 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_server": { 2023-08-10T12:05:39.273 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_client_request": 77904, 2023-08-10T12:05:39.273 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_server_request": 2884, 2023-08-10T12:05:39.273 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_request": 62640, 2023-08-10T12:05:39.273 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_session": 305, 2023-08-10T12:05:39.273 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_peer_request": 4851, 2023-08-10T12:05:39.273 INFO:teuthology.orchestra.run.smithi152.stdout: "req_create_latency": { 2023-08-10T12:05:39.273 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 12196, 2023-08-10T12:05:39.273 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 28.965857490, 2023-08-10T12:05:39.274 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.002375029 2023-08-10T12:05:39.274 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.274 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getattr_latency": { 2023-08-10T12:05:39.274 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 785, 2023-08-10T12:05:39.274 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 29.126209162, 2023-08-10T12:05:39.274 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.037103451 2023-08-10T12:05:39.274 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.274 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getfilelock_latency": { 2023-08-10T12:05:39.275 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:39.275 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:39.275 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:39.275 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.275 INFO:teuthology.orchestra.run.smithi152.stdout: "req_link_latency": { 2023-08-10T12:05:39.275 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:39.275 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:39.275 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:39.276 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.276 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookup_latency": { 2023-08-10T12:05:39.276 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 15983, 2023-08-10T12:05:39.276 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 344.857465276, 2023-08-10T12:05:39.276 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.021576516 2023-08-10T12:05:39.276 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.276 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookuphash_latency": { 2023-08-10T12:05:39.277 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:39.277 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:39.277 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:39.277 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.277 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupino_latency": { 2023-08-10T12:05:39.277 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:39.277 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:39.277 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:39.278 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.278 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupname_latency": { 2023-08-10T12:05:39.278 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:39.278 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:39.278 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:39.278 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.278 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupparent_latency": { 2023-08-10T12:05:39.278 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:39.279 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:39.279 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:39.279 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.279 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupsnap_latency": { 2023-08-10T12:05:39.279 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:39.279 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:39.279 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:39.279 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.280 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lssnap_latency": { 2023-08-10T12:05:39.280 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:39.280 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:39.280 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:39.280 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.280 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mkdir_latency": { 2023-08-10T12:05:39.280 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 72, 2023-08-10T12:05:39.281 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.334414830, 2023-08-10T12:05:39.281 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.004644650 2023-08-10T12:05:39.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.281 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mknod_latency": { 2023-08-10T12:05:39.281 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:39.281 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:39.281 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:39.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.282 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mksnap_latency": { 2023-08-10T12:05:39.282 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:39.282 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:39.282 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:39.282 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.282 INFO:teuthology.orchestra.run.smithi152.stdout: "req_open_latency": { 2023-08-10T12:05:39.282 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 5155, 2023-08-10T12:05:39.282 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 13.248486028, 2023-08-10T12:05:39.283 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.002570026 2023-08-10T12:05:39.283 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.283 INFO:teuthology.orchestra.run.smithi152.stdout: "req_readdir_latency": { 2023-08-10T12:05:39.283 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 342, 2023-08-10T12:05:39.283 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.721706719, 2023-08-10T12:05:39.283 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.002110253 2023-08-10T12:05:39.283 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.283 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rename_latency": { 2023-08-10T12:05:39.284 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 12185, 2023-08-10T12:05:39.284 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 196.671251346, 2023-08-10T12:05:39.284 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.016140439 2023-08-10T12:05:39.284 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.284 INFO:teuthology.orchestra.run.smithi152.stdout: "req_renamesnap_latency": { 2023-08-10T12:05:39.284 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:39.284 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:39.285 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:39.285 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.285 INFO:teuthology.orchestra.run.smithi152.stdout: "req_snapdiff_latency": { 2023-08-10T12:05:39.285 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:39.285 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:39.285 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:39.285 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.285 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmdir_latency": { 2023-08-10T12:05:39.286 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 54, 2023-08-10T12:05:39.286 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 10.011129535, 2023-08-10T12:05:39.286 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.185391287 2023-08-10T12:05:39.286 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.286 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmsnap_latency": { 2023-08-10T12:05:39.286 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:39.286 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:39.286 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:39.287 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.287 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmxattr_latency": { 2023-08-10T12:05:39.287 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:39.287 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:39.287 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:39.287 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.287 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setattr_latency": { 2023-08-10T12:05:39.287 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:39.288 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:39.288 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:39.288 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.288 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setdirlayout_latency": { 2023-08-10T12:05:39.288 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:39.288 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:39.288 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:39.289 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.289 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setfilelock_latency": { 2023-08-10T12:05:39.289 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:39.289 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:39.289 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:39.289 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.289 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setlayout_latency": { 2023-08-10T12:05:39.289 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:39.290 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:39.290 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:39.290 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.290 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setxattr_latency": { 2023-08-10T12:05:39.290 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:39.290 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:39.290 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:39.290 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.291 INFO:teuthology.orchestra.run.smithi152.stdout: "req_symlink_latency": { 2023-08-10T12:05:39.291 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:39.291 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:39.291 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:39.291 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.291 INFO:teuthology.orchestra.run.smithi152.stdout: "req_unlink_latency": { 2023-08-10T12:05:39.291 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 6506, 2023-08-10T12:05:39.291 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 11.346364031, 2023-08-10T12:05:39.292 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001743984 2023-08-10T12:05:39.292 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.292 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_revoke_eviction": 0, 2023-08-10T12:05:39.292 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_acquisition_throttle": 0, 2023-08-10T12:05:39.292 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getvxattr_latency": { 2023-08-10T12:05:39.292 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:39.292 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:39.292 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:39.293 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:39.293 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.293 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_sessions": { 2023-08-10T12:05:39.293 INFO:teuthology.orchestra.run.smithi152.stdout: "session_count": 2, 2023-08-10T12:05:39.293 INFO:teuthology.orchestra.run.smithi152.stdout: "session_add": 5, 2023-08-10T12:05:39.293 INFO:teuthology.orchestra.run.smithi152.stdout: "session_remove": 3, 2023-08-10T12:05:39.293 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_open": 2, 2023-08-10T12:05:39.294 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_stale": 0, 2023-08-10T12:05:39.294 INFO:teuthology.orchestra.run.smithi152.stdout: "total_load": 7408, 2023-08-10T12:05:39.294 INFO:teuthology.orchestra.run.smithi152.stdout: "average_load": 3704, 2023-08-10T12:05:39.294 INFO:teuthology.orchestra.run.smithi152.stdout: "avg_session_uptime": 737 2023-08-10T12:05:39.294 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.294 INFO:teuthology.orchestra.run.smithi152.stdout: "mempool": { 2023-08-10T12:05:39.294 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_bytes": 0, 2023-08-10T12:05:39.294 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_items": 0, 2023-08-10T12:05:39.295 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_bytes": 0, 2023-08-10T12:05:39.295 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_items": 0, 2023-08-10T12:05:39.295 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_bytes": 0, 2023-08-10T12:05:39.295 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_items": 0, 2023-08-10T12:05:39.295 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-10T12:05:39.295 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_items": 0, 2023-08-10T12:05:39.295 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-10T12:05:39.295 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_items": 0, 2023-08-10T12:05:39.296 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_bytes": 0, 2023-08-10T12:05:39.296 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_items": 0, 2023-08-10T12:05:39.296 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-10T12:05:39.296 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_items": 0, 2023-08-10T12:05:39.296 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_bytes": 0, 2023-08-10T12:05:39.296 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_items": 0, 2023-08-10T12:05:39.296 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_bytes": 0, 2023-08-10T12:05:39.296 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_items": 0, 2023-08-10T12:05:39.297 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-10T12:05:39.297 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_items": 0, 2023-08-10T12:05:39.297 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-10T12:05:39.297 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_items": 0, 2023-08-10T12:05:39.297 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_bytes": 0, 2023-08-10T12:05:39.297 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_items": 0, 2023-08-10T12:05:39.297 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_bytes": 0, 2023-08-10T12:05:39.297 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_items": 0, 2023-08-10T12:05:39.298 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-10T12:05:39.298 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_items": 0, 2023-08-10T12:05:39.298 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_bytes": 0, 2023-08-10T12:05:39.298 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_items": 0, 2023-08-10T12:05:39.298 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_bytes": 0, 2023-08-10T12:05:39.298 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_items": 0, 2023-08-10T12:05:39.298 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_bytes": 0, 2023-08-10T12:05:39.298 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_items": 0, 2023-08-10T12:05:39.299 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_bytes": 0, 2023-08-10T12:05:39.299 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_items": 0, 2023-08-10T12:05:39.299 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_bytes": 1035230, 2023-08-10T12:05:39.299 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_items": 7567, 2023-08-10T12:05:39.299 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_bytes": 0, 2023-08-10T12:05:39.299 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_items": 0, 2023-08-10T12:05:39.299 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_bytes": 0, 2023-08-10T12:05:39.299 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_items": 0, 2023-08-10T12:05:39.300 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_bytes": 0, 2023-08-10T12:05:39.300 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_items": 0, 2023-08-10T12:05:39.300 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_bytes": 0, 2023-08-10T12:05:39.300 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_items": 0, 2023-08-10T12:05:39.300 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_bytes": 8032, 2023-08-10T12:05:39.300 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_items": 167, 2023-08-10T12:05:39.300 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_bytes": 0, 2023-08-10T12:05:39.301 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_items": 0, 2023-08-10T12:05:39.301 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_bytes": 0, 2023-08-10T12:05:39.301 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_items": 0, 2023-08-10T12:05:39.301 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_bytes": 30394959, 2023-08-10T12:05:39.301 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_items": 330841, 2023-08-10T12:05:39.301 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_bytes": 0, 2023-08-10T12:05:39.301 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_items": 0, 2023-08-10T12:05:39.301 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_bytes": 0, 2023-08-10T12:05:39.302 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_items": 0 2023-08-10T12:05:39.302 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.302 INFO:teuthology.orchestra.run.smithi152.stdout: "objecter": { 2023-08-10T12:05:39.302 INFO:teuthology.orchestra.run.smithi152.stdout: "op_active": 0, 2023-08-10T12:05:39.302 INFO:teuthology.orchestra.run.smithi152.stdout: "op_laggy": 0, 2023-08-10T12:05:39.302 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send": 12948, 2023-08-10T12:05:39.302 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send_bytes": 252270189, 2023-08-10T12:05:39.302 INFO:teuthology.orchestra.run.smithi152.stdout: "op_resend": 28, 2023-08-10T12:05:39.303 INFO:teuthology.orchestra.run.smithi152.stdout: "op_reply": 12948, 2023-08-10T12:05:39.303 INFO:teuthology.orchestra.run.smithi152.stdout: "op_latency": { 2023-08-10T12:05:39.303 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 12948, 2023-08-10T12:05:39.303 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 197.672641692, 2023-08-10T12:05:39.303 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.015266654 2023-08-10T12:05:39.303 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.303 INFO:teuthology.orchestra.run.smithi152.stdout: "op_inflight": 0, 2023-08-10T12:05:39.303 INFO:teuthology.orchestra.run.smithi152.stdout: "oplen_avg": { 2023-08-10T12:05:39.304 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 12948, 2023-08-10T12:05:39.304 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 13833 2023-08-10T12:05:39.304 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.304 INFO:teuthology.orchestra.run.smithi152.stdout: "op": 12948, 2023-08-10T12:05:39.304 INFO:teuthology.orchestra.run.smithi152.stdout: "op_r": 664, 2023-08-10T12:05:39.304 INFO:teuthology.orchestra.run.smithi152.stdout: "op_w": 12284, 2023-08-10T12:05:39.304 INFO:teuthology.orchestra.run.smithi152.stdout: "op_rmw": 0, 2023-08-10T12:05:39.304 INFO:teuthology.orchestra.run.smithi152.stdout: "op_pg": 0, 2023-08-10T12:05:39.305 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_stat": 0, 2023-08-10T12:05:39.305 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_create": 10, 2023-08-10T12:05:39.305 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_read": 305, 2023-08-10T12:05:39.305 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_write": 2562, 2023-08-10T12:05:39.305 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writefull": 186, 2023-08-10T12:05:39.305 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writesame": 0, 2023-08-10T12:05:39.305 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_append": 0, 2023-08-10T12:05:39.306 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_zero": 0, 2023-08-10T12:05:39.306 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_truncate": 64, 2023-08-10T12:05:39.306 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_delete": 8773, 2023-08-10T12:05:39.306 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_mapext": 0, 2023-08-10T12:05:39.306 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_sparse_read": 0, 2023-08-10T12:05:39.306 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_clonerange": 0, 2023-08-10T12:05:39.306 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_getxattr": 269, 2023-08-10T12:05:39.306 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_setxattr": 20, 2023-08-10T12:05:39.307 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_cmpxattr": 0, 2023-08-10T12:05:39.307 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_rmxattr": 0, 2023-08-10T12:05:39.307 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_resetxattrs": 0, 2023-08-10T12:05:39.307 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_call": 0, 2023-08-10T12:05:39.307 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_watch": 0, 2023-08-10T12:05:39.307 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_notify": 0, 2023-08-10T12:05:39.307 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_src_cmpxattr": 0, 2023-08-10T12:05:39.307 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls": 0, 2023-08-10T12:05:39.308 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls_filter": 0, 2023-08-10T12:05:39.308 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_other": 0, 2023-08-10T12:05:39.308 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_active": 0, 2023-08-10T12:05:39.308 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_send": 0, 2023-08-10T12:05:39.308 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_resend": 0, 2023-08-10T12:05:39.308 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_ping": 0, 2023-08-10T12:05:39.308 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_active": 0, 2023-08-10T12:05:39.308 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_send": 0, 2023-08-10T12:05:39.309 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_resend": 0, 2023-08-10T12:05:39.309 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_active": 0, 2023-08-10T12:05:39.309 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_send": 0, 2023-08-10T12:05:39.309 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_resend": 0, 2023-08-10T12:05:39.309 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_active": 0, 2023-08-10T12:05:39.309 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_send": 0, 2023-08-10T12:05:39.309 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_resend": 0, 2023-08-10T12:05:39.309 INFO:teuthology.orchestra.run.smithi152.stdout: "command_active": 0, 2023-08-10T12:05:39.310 INFO:teuthology.orchestra.run.smithi152.stdout: "command_send": 0, 2023-08-10T12:05:39.310 INFO:teuthology.orchestra.run.smithi152.stdout: "command_resend": 0, 2023-08-10T12:05:39.310 INFO:teuthology.orchestra.run.smithi152.stdout: "map_epoch": 98, 2023-08-10T12:05:39.310 INFO:teuthology.orchestra.run.smithi152.stdout: "map_full": 0, 2023-08-10T12:05:39.310 INFO:teuthology.orchestra.run.smithi152.stdout: "map_inc": 15, 2023-08-10T12:05:39.310 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_sessions": 12, 2023-08-10T12:05:39.310 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_open": 12, 2023-08-10T12:05:39.310 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_close": 0, 2023-08-10T12:05:39.311 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_laggy": 0, 2023-08-10T12:05:39.311 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_wr": 1356, 2023-08-10T12:05:39.311 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_rd": 135, 2023-08-10T12:05:39.311 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_del": 153 2023-08-10T12:05:39.311 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.311 INFO:teuthology.orchestra.run.smithi152.stdout: "oft": { 2023-08-10T12:05:39.311 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_objs": 1, 2023-08-10T12:05:39.311 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_kv_pairs": 0, 2023-08-10T12:05:39.312 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_updates": 0, 2023-08-10T12:05:39.312 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_removes": 0 2023-08-10T12:05:39.312 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.312 INFO:teuthology.orchestra.run.smithi152.stdout: "osd-slow-ops": { 2023-08-10T12:05:39.312 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_ops_count": 2 2023-08-10T12:05:39.312 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.312 INFO:teuthology.orchestra.run.smithi152.stdout: "purge_queue": { 2023-08-10T12:05:39.313 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops": 0, 2023-08-10T12:05:39.313 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops_high_water": 6, 2023-08-10T12:05:39.313 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing": 0, 2023-08-10T12:05:39.313 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_high_water": 6, 2023-08-10T12:05:39.313 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed": 8704, 2023-08-10T12:05:39.313 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_item_in_journal": 0 2023-08-10T12:05:39.313 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.313 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-10T12:05:39.314 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-08-10T12:05:39.314 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2023-08-10T12:05:39.314 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-08-10T12:05:39.314 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 1248750, 2023-08-10T12:05:39.314 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 143343236, 2023-08-10T12:05:39.314 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:39.314 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 1248750, 2023-08-10T12:05:39.314 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2023-08-10T12:05:39.315 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2023-08-10T12:05:39.315 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 1248750, 2023-08-10T12:05:39.315 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 143343236, 2023-08-10T12:05:39.315 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-08-10T12:05:39.315 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:39.315 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:39.315 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:39.315 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:39.316 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.316 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_bytes": { 2023-08-10T12:05:39.316 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-08-10T12:05:39.316 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2023-08-10T12:05:39.316 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-08-10T12:05:39.316 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2023-08-10T12:05:39.316 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2023-08-10T12:05:39.316 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:39.317 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:39.317 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 12948, 2023-08-10T12:05:39.317 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 253394445, 2023-08-10T12:05:39.317 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 12948, 2023-08-10T12:05:39.317 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 253394445, 2023-08-10T12:05:39.317 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-08-10T12:05:39.317 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:39.318 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:39.318 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:39.318 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:39.318 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.318 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_ops": { 2023-08-10T12:05:39.318 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-08-10T12:05:39.318 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 1024, 2023-08-10T12:05:39.318 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-08-10T12:05:39.319 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2023-08-10T12:05:39.319 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2023-08-10T12:05:39.319 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:39.319 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:39.319 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 12948, 2023-08-10T12:05:39.319 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 12948, 2023-08-10T12:05:39.319 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 12948, 2023-08-10T12:05:39.319 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 12948, 2023-08-10T12:05:39.320 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-08-10T12:05:39.320 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:39.320 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:39.320 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:39.320 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:39.320 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.320 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle": { 2023-08-10T12:05:39.320 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-08-10T12:05:39.321 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2023-08-10T12:05:39.321 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-08-10T12:05:39.321 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 8704, 2023-08-10T12:05:39.321 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 1126544, 2023-08-10T12:05:39.321 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:39.321 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 8704, 2023-08-10T12:05:39.321 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2023-08-10T12:05:39.321 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2023-08-10T12:05:39.322 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 306, 2023-08-10T12:05:39.322 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 1126544, 2023-08-10T12:05:39.322 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-08-10T12:05:39.322 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:39.322 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:39.322 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:39.322 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:39.323 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:39.323 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle-0x55fcdf97c0a0": { 2023-08-10T12:05:39.323 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-08-10T12:05:39.323 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2023-08-10T12:05:39.323 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-08-10T12:05:39.323 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 73761, 2023-08-10T12:05:39.323 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 239645336, 2023-08-10T12:05:39.323 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:39.324 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 73761, 2023-08-10T12:05:39.324 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2023-08-10T12:05:39.324 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2023-08-10T12:05:39.324 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 2256, 2023-08-10T12:05:39.324 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 239645336, 2023-08-10T12:05:39.324 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-08-10T12:05:39.324 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:39.324 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:39.325 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:39.325 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:39.325 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:39.325 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-08-10T12:05:39.386 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:39 smithi152 ceph-mon[130220]: pgmap v405: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.6 KiB/s wr, 10 op/s 2023-08-10T12:05:39.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:39 smithi156 ceph-mon[130574]: pgmap v405: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.6 KiB/s wr, 10 op/s 2023-08-10T12:05:39.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:39 smithi073 ceph-mon[128869]: pgmap v405: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.6 KiB/s wr, 10 op/s 2023-08-10T12:05:39.701 INFO:tasks.check_counter:Daemon mds.e mds.exported=152 2023-08-10T12:05:39.702 INFO:tasks.check_counter:Daemon mds.e mds.imported=152 2023-08-10T12:05:39.702 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=2384 2023-08-10T12:05:39.702 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=8668 2023-08-10T12:05:39.702 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=2 2023-08-10T12:05:39.703 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2023-08-10T12:05:39.703 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2023-08-10T12:05:39.703 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=64 2023-08-10T12:05:39.703 DEBUG:tasks.check_counter:Getting stats from h 2023-08-10T12:05:39.704 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph daemon mds.h perf dump 2023-08-10T12:05:40.261 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.b/config 2023-08-10T12:05:41.470 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-08-10T12:05:41.470 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-0": { 2023-08-10T12:05:41.470 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 1060278, 2023-08-10T12:05:41.470 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 1069457, 2023-08-10T12:05:41.470 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 182971136, 2023-08-10T12:05:41.471 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 286782515, 2023-08-10T12:05:41.471 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 25, 2023-08-10T12:05:41.471 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 7, 2023-08-10T12:05:41.471 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 40.825099832, 2023-08-10T12:05:41.471 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 18.094859171, 2023-08-10T12:05:41.471 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 28.141406139, 2023-08-10T12:05:41.471 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.322349155, 2023-08-10T12:05:41.472 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:41.472 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1069450, 2023-08-10T12:05:41.472 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 19.269373200, 2023-08-10T12:05:41.472 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000018018 2023-08-10T12:05:41.472 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.472 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:41.472 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2107539, 2023-08-10T12:05:41.473 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.223150774, 2023-08-10T12:05:41.473 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000105 2023-08-10T12:05:41.473 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.473 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 1684400, 2023-08-10T12:05:41.473 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 199056 2023-08-10T12:05:41.473 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.473 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-1": { 2023-08-10T12:05:41.474 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 451181, 2023-08-10T12:05:41.474 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 448868, 2023-08-10T12:05:41.474 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 94646682, 2023-08-10T12:05:41.474 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 264915262, 2023-08-10T12:05:41.474 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 10, 2023-08-10T12:05:41.474 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 5, 2023-08-10T12:05:41.474 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 20.010050401, 2023-08-10T12:05:41.475 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 9.042308332, 2023-08-10T12:05:41.475 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 13.281673913, 2023-08-10T12:05:41.475 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.464193741, 2023-08-10T12:05:41.475 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:41.475 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 448870, 2023-08-10T12:05:41.475 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 15.339192885, 2023-08-10T12:05:41.475 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000034172 2023-08-10T12:05:41.475 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.476 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:41.476 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 871503, 2023-08-10T12:05:41.476 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.103819692, 2023-08-10T12:05:41.476 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000119 2023-08-10T12:05:41.476 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.477 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 320, 2023-08-10T12:05:41.477 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 477712 2023-08-10T12:05:41.477 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.477 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-2": { 2023-08-10T12:05:41.477 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 1306767, 2023-08-10T12:05:41.477 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 1490862, 2023-08-10T12:05:41.477 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 277785988, 2023-08-10T12:05:41.478 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 770020762, 2023-08-10T12:05:41.478 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 9, 2023-08-10T12:05:41.478 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 6, 2023-08-10T12:05:41.478 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 50.166371597, 2023-08-10T12:05:41.478 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 21.626175901, 2023-08-10T12:05:41.478 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 309.955609261, 2023-08-10T12:05:41.478 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.542407399, 2023-08-10T12:05:41.479 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:41.479 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1490862, 2023-08-10T12:05:41.479 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 56.043519966, 2023-08-10T12:05:41.479 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000037591 2023-08-10T12:05:41.479 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.479 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:41.479 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2606721, 2023-08-10T12:05:41.480 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.325765298, 2023-08-10T12:05:41.480 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000124 2023-08-10T12:05:41.480 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.480 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 84369520, 2023-08-10T12:05:41.480 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 238157680 2023-08-10T12:05:41.480 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.480 INFO:teuthology.orchestra.run.smithi152.stdout: "cct": { 2023-08-10T12:05:41.481 INFO:teuthology.orchestra.run.smithi152.stdout: "total_workers": 1, 2023-08-10T12:05:41.481 INFO:teuthology.orchestra.run.smithi152.stdout: "unhealthy_workers": 0 2023-08-10T12:05:41.481 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.481 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-MDSRank": { 2023-08-10T12:05:41.481 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2023-08-10T12:05:41.481 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2023-08-10T12:05:41.481 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 10318, 2023-08-10T12:05:41.482 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 111.105766542, 2023-08-10T12:05:41.482 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.010768149 2023-08-10T12:05:41.482 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:41.482 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.482 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-PurgeQueue": { 2023-08-10T12:05:41.482 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2023-08-10T12:05:41.482 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2023-08-10T12:05:41.483 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 44158, 2023-08-10T12:05:41.483 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 10.633762997, 2023-08-10T12:05:41.483 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000240811 2023-08-10T12:05:41.483 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:41.483 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.483 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2023-08-10T12:05:41.483 INFO:teuthology.orchestra.run.smithi152.stdout: "request": 163363, 2023-08-10T12:05:41.484 INFO:teuthology.orchestra.run.smithi152.stdout: "reply": 151592, 2023-08-10T12:05:41.484 INFO:teuthology.orchestra.run.smithi152.stdout: "reply_latency": { 2023-08-10T12:05:41.484 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 151592, 2023-08-10T12:05:41.484 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 4477.046452090, 2023-08-10T12:05:41.484 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.029533527 2023-08-10T12:05:41.484 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.484 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_reply": 0, 2023-08-10T12:05:41.485 INFO:teuthology.orchestra.run.smithi152.stdout: "forward": 11765, 2023-08-10T12:05:41.485 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_complete": 162, 2023-08-10T12:05:41.485 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_keys": 0, 2023-08-10T12:05:41.485 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_commit": 1032, 2023-08-10T12:05:41.485 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_split": 110, 2023-08-10T12:05:41.485 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_merge": 0, 2023-08-10T12:05:41.485 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes": 57729, 2023-08-10T12:05:41.486 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_top": 685, 2023-08-10T12:05:41.486 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_bottom": 52701, 2023-08-10T12:05:41.486 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pin_tail": 4343, 2023-08-10T12:05:41.486 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pinned": 56750, 2023-08-10T12:05:41.486 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_expired": 70072, 2023-08-10T12:05:41.486 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_with_caps": 2, 2023-08-10T12:05:41.486 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": 2, 2023-08-10T12:05:41.487 INFO:teuthology.orchestra.run.smithi152.stdout: "subtrees": 6, 2023-08-10T12:05:41.487 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse": 265393, 2023-08-10T12:05:41.487 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_hit": 226940, 2023-08-10T12:05:41.487 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_forward": 11522, 2023-08-10T12:05:41.487 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_discover": 932, 2023-08-10T12:05:41.487 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_dir_fetch": 8, 2023-08-10T12:05:41.487 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_remote_ino": 0, 2023-08-10T12:05:41.487 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_lock": 1050, 2023-08-10T12:05:41.488 INFO:teuthology.orchestra.run.smithi152.stdout: "load_cent": 32, 2023-08-10T12:05:41.488 INFO:teuthology.orchestra.run.smithi152.stdout: "q": 0, 2023-08-10T12:05:41.488 INFO:teuthology.orchestra.run.smithi152.stdout: "exported": 209, 2023-08-10T12:05:41.488 INFO:teuthology.orchestra.run.smithi152.stdout: "exported_inodes": 51430, 2023-08-10T12:05:41.488 INFO:teuthology.orchestra.run.smithi152.stdout: "imported": 361, 2023-08-10T12:05:41.488 INFO:teuthology.orchestra.run.smithi152.stdout: "imported_inodes": 54951, 2023-08-10T12:05:41.488 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_dir_fetch": 0, 2023-08-10T12:05:41.489 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_backtrace_fetch": 1836, 2023-08-10T12:05:41.489 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_peer_discover": 0, 2023-08-10T12:05:41.489 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rfiles": 1767, 2023-08-10T12:05:41.489 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rbytes": 37429583, 2023-08-10T12:05:41.489 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rsnaps": 2, 2023-08-10T12:05:41.489 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_fetch": 1836, 2023-08-10T12:05:41.489 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_set_tag": 0, 2023-08-10T12:05:41.490 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_repaired": 0, 2023-08-10T12:05:41.490 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_inotable_repaired": 0, 2023-08-10T12:05:41.490 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_inodes": 19, 2023-08-10T12:05:41.490 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_base_inodes": 0, 2023-08-10T12:05:41.491 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dirfrag_rstats": 19, 2023-08-10T12:05:41.492 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_file_inodes": 1817, 2023-08-10T12:05:41.492 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_inode_file_caps": 195, 2023-08-10T12:05:41.492 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_revoke": 27754, 2023-08-10T12:05:41.492 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_grant": 55707, 2023-08-10T12:05:41.492 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_trunc": 1, 2023-08-10T12:05:41.492 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flushsnap_ack": 9, 2023-08-10T12:05:41.492 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-10T12:05:41.493 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps": 48509, 2023-08-10T12:05:41.493 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps_dirty": 26740, 2023-08-10T12:05:41.493 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_cap_release": 918, 2023-08-10T12:05:41.493 INFO:teuthology.orchestra.run.smithi152.stdout: "process_request_cap_release": 56592 2023-08-10T12:05:41.493 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.493 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_cache": { 2023-08-10T12:05:41.493 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update": 4154, 2023-08-10T12:05:41.494 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update_receipt": 4550, 2023-08-10T12:05:41.494 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_try_discover": 2556, 2023-08-10T12:05:41.494 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_send_discover": 3974, 2023-08-10T12:05:41.494 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_handle_discover": 11713, 2023-08-10T12:05:41.494 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays": 175, 2023-08-10T12:05:41.494 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_delayed": 0, 2023-08-10T12:05:41.494 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_enqueuing": 0, 2023-08-10T12:05:41.495 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_created": 24125, 2023-08-10T12:05:41.495 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_enqueued": 23950, 2023-08-10T12:05:41.495 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_reintegrated": 0, 2023-08-10T12:05:41.495 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_migrated": 0, 2023-08-10T12:05:41.495 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_processing": 0, 2023-08-10T12:05:41.495 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_enqueued": 0, 2023-08-10T12:05:41.495 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_prioritized": 0, 2023-08-10T12:05:41.496 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_started": 0, 2023-08-10T12:05:41.496 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_completed": 0, 2023-08-10T12:05:41.496 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_enqueue_scrub": 0, 2023-08-10T12:05:41.496 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_exportdir": 216, 2023-08-10T12:05:41.496 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_flush": 0, 2023-08-10T12:05:41.496 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragmentdir": 111, 2023-08-10T12:05:41.496 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragstats": 0, 2023-08-10T12:05:41.497 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_inodestats": 0 2023-08-10T12:05:41.497 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.497 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_log": { 2023-08-10T12:05:41.497 INFO:teuthology.orchestra.run.smithi152.stdout: "evadd": 155786, 2023-08-10T12:05:41.497 INFO:teuthology.orchestra.run.smithi152.stdout: "evex": 70787, 2023-08-10T12:05:41.497 INFO:teuthology.orchestra.run.smithi152.stdout: "evtrm": 70787, 2023-08-10T12:05:41.497 INFO:teuthology.orchestra.run.smithi152.stdout: "ev": 84999, 2023-08-10T12:05:41.498 INFO:teuthology.orchestra.run.smithi152.stdout: "evexg": 0, 2023-08-10T12:05:41.498 INFO:teuthology.orchestra.run.smithi152.stdout: "evexd": 1126, 2023-08-10T12:05:41.498 INFO:teuthology.orchestra.run.smithi152.stdout: "segadd": 226, 2023-08-10T12:05:41.498 INFO:teuthology.orchestra.run.smithi152.stdout: "segex": 98, 2023-08-10T12:05:41.498 INFO:teuthology.orchestra.run.smithi152.stdout: "segtrm": 98, 2023-08-10T12:05:41.498 INFO:teuthology.orchestra.run.smithi152.stdout: "seg": 130, 2023-08-10T12:05:41.498 INFO:teuthology.orchestra.run.smithi152.stdout: "segexg": 0, 2023-08-10T12:05:41.498 INFO:teuthology.orchestra.run.smithi152.stdout: "segexd": 2, 2023-08-10T12:05:41.499 INFO:teuthology.orchestra.run.smithi152.stdout: "expos": 208780375, 2023-08-10T12:05:41.499 INFO:teuthology.orchestra.run.smithi152.stdout: "wrpos": 616425775, 2023-08-10T12:05:41.499 INFO:teuthology.orchestra.run.smithi152.stdout: "rdpos": 0, 2023-08-10T12:05:41.499 INFO:teuthology.orchestra.run.smithi152.stdout: "jlat": { 2023-08-10T12:05:41.499 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 4390, 2023-08-10T12:05:41.499 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 230.705879663, 2023-08-10T12:05:41.499 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.052552592 2023-08-10T12:05:41.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.500 INFO:teuthology.orchestra.run.smithi152.stdout: "replayed": 0 2023-08-10T12:05:41.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.500 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_mem": { 2023-08-10T12:05:41.500 INFO:teuthology.orchestra.run.smithi152.stdout: "ino": 28673, 2023-08-10T12:05:41.500 INFO:teuthology.orchestra.run.smithi152.stdout: "ino+": 86827, 2023-08-10T12:05:41.500 INFO:teuthology.orchestra.run.smithi152.stdout: "ino-": 58154, 2023-08-10T12:05:41.501 INFO:teuthology.orchestra.run.smithi152.stdout: "dir": 1117, 2023-08-10T12:05:41.501 INFO:teuthology.orchestra.run.smithi152.stdout: "dir+": 4627, 2023-08-10T12:05:41.501 INFO:teuthology.orchestra.run.smithi152.stdout: "dir-": 3510, 2023-08-10T12:05:41.501 INFO:teuthology.orchestra.run.smithi152.stdout: "dn": 57729, 2023-08-10T12:05:41.501 INFO:teuthology.orchestra.run.smithi152.stdout: "dn+": 158688, 2023-08-10T12:05:41.501 INFO:teuthology.orchestra.run.smithi152.stdout: "dn-": 100959, 2023-08-10T12:05:41.501 INFO:teuthology.orchestra.run.smithi152.stdout: "cap": 2, 2023-08-10T12:05:41.502 INFO:teuthology.orchestra.run.smithi152.stdout: "cap+": 54382, 2023-08-10T12:05:41.502 INFO:teuthology.orchestra.run.smithi152.stdout: "cap-": 54380, 2023-08-10T12:05:41.502 INFO:teuthology.orchestra.run.smithi152.stdout: "rss": 255812, 2023-08-10T12:05:41.502 INFO:teuthology.orchestra.run.smithi152.stdout: "heap": 198960 2023-08-10T12:05:41.502 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.502 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_server": { 2023-08-10T12:05:41.502 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_client_request": 197915, 2023-08-10T12:05:41.503 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_server_request": 3186, 2023-08-10T12:05:41.503 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_request": 163363, 2023-08-10T12:05:41.503 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_session": 324, 2023-08-10T12:05:41.503 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_peer_request": 6979, 2023-08-10T12:05:41.503 INFO:teuthology.orchestra.run.smithi152.stdout: "req_create_latency": { 2023-08-10T12:05:41.503 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 26777, 2023-08-10T12:05:41.503 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 167.014828875, 2023-08-10T12:05:41.504 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.006237249 2023-08-10T12:05:41.504 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.504 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getattr_latency": { 2023-08-10T12:05:41.504 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 3320, 2023-08-10T12:05:41.504 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 145.925682104, 2023-08-10T12:05:41.504 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.043953518 2023-08-10T12:05:41.504 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.505 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getfilelock_latency": { 2023-08-10T12:05:41.505 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:41.505 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:41.505 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:41.505 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.505 INFO:teuthology.orchestra.run.smithi152.stdout: "req_link_latency": { 2023-08-10T12:05:41.505 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:41.505 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:41.506 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:41.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.506 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookup_latency": { 2023-08-10T12:05:41.506 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 64607, 2023-08-10T12:05:41.506 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 3493.927307652, 2023-08-10T12:05:41.506 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.054079702 2023-08-10T12:05:41.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.507 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookuphash_latency": { 2023-08-10T12:05:41.507 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:41.507 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:41.507 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:41.507 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.507 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupino_latency": { 2023-08-10T12:05:41.507 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1, 2023-08-10T12:05:41.508 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000218836, 2023-08-10T12:05:41.508 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000218836 2023-08-10T12:05:41.508 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.508 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupname_latency": { 2023-08-10T12:05:41.508 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:41.508 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:41.508 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:41.509 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.509 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupparent_latency": { 2023-08-10T12:05:41.509 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:41.509 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:41.509 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:41.509 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.509 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupsnap_latency": { 2023-08-10T12:05:41.510 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:41.510 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:41.510 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:41.510 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.510 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lssnap_latency": { 2023-08-10T12:05:41.510 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:41.510 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:41.511 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:41.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.511 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mkdir_latency": { 2023-08-10T12:05:41.511 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 194, 2023-08-10T12:05:41.511 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 5.546284899, 2023-08-10T12:05:41.511 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.028589097 2023-08-10T12:05:41.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.512 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mknod_latency": { 2023-08-10T12:05:41.512 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:41.512 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:41.512 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:41.512 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.512 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mksnap_latency": { 2023-08-10T12:05:41.512 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:41.513 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:41.513 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:41.513 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.513 INFO:teuthology.orchestra.run.smithi152.stdout: "req_open_latency": { 2023-08-10T12:05:41.513 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 7434, 2023-08-10T12:05:41.513 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 53.059251148, 2023-08-10T12:05:41.513 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.007137375 2023-08-10T12:05:41.514 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.514 INFO:teuthology.orchestra.run.smithi152.stdout: "req_readdir_latency": { 2023-08-10T12:05:41.514 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 988, 2023-08-10T12:05:41.514 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 2.598541213, 2023-08-10T12:05:41.514 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.002630102 2023-08-10T12:05:41.514 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.514 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rename_latency": { 2023-08-10T12:05:41.514 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 26819, 2023-08-10T12:05:41.515 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 545.860458103, 2023-08-10T12:05:41.515 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.020353497 2023-08-10T12:05:41.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.515 INFO:teuthology.orchestra.run.smithi152.stdout: "req_renamesnap_latency": { 2023-08-10T12:05:41.515 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:41.515 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:41.515 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:41.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.516 INFO:teuthology.orchestra.run.smithi152.stdout: "req_snapdiff_latency": { 2023-08-10T12:05:41.516 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:41.516 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:41.516 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:41.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.516 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmdir_latency": { 2023-08-10T12:05:41.517 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 175, 2023-08-10T12:05:41.517 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 30.238130647, 2023-08-10T12:05:41.517 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.172789317 2023-08-10T12:05:41.517 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.517 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmsnap_latency": { 2023-08-10T12:05:41.517 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:41.517 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:41.518 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:41.518 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.518 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmxattr_latency": { 2023-08-10T12:05:41.518 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:41.518 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:41.518 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:41.518 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.519 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setattr_latency": { 2023-08-10T12:05:41.519 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1, 2023-08-10T12:05:41.519 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.133460713, 2023-08-10T12:05:41.519 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.133460713 2023-08-10T12:05:41.519 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.519 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setdirlayout_latency": { 2023-08-10T12:05:41.519 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:41.520 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:41.520 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:41.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.520 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setfilelock_latency": { 2023-08-10T12:05:41.520 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:41.520 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:41.520 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:41.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.521 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setlayout_latency": { 2023-08-10T12:05:41.521 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:41.521 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:41.521 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:41.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.521 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setxattr_latency": { 2023-08-10T12:05:41.522 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:41.522 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:41.522 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:41.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.522 INFO:teuthology.orchestra.run.smithi152.stdout: "req_symlink_latency": { 2023-08-10T12:05:41.522 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:41.522 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:41.523 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:41.523 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.523 INFO:teuthology.orchestra.run.smithi152.stdout: "req_unlink_latency": { 2023-08-10T12:05:41.523 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 21276, 2023-08-10T12:05:41.523 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 32.742287900, 2023-08-10T12:05:41.523 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001538930 2023-08-10T12:05:41.523 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.523 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_revoke_eviction": 0, 2023-08-10T12:05:41.524 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_acquisition_throttle": 0, 2023-08-10T12:05:41.524 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getvxattr_latency": { 2023-08-10T12:05:41.524 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:41.524 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:41.524 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:41.524 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:41.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.525 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_sessions": { 2023-08-10T12:05:41.525 INFO:teuthology.orchestra.run.smithi152.stdout: "session_count": 1, 2023-08-10T12:05:41.525 INFO:teuthology.orchestra.run.smithi152.stdout: "session_add": 2, 2023-08-10T12:05:41.525 INFO:teuthology.orchestra.run.smithi152.stdout: "session_remove": 1, 2023-08-10T12:05:41.525 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_open": 1, 2023-08-10T12:05:41.525 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_stale": 0, 2023-08-10T12:05:41.525 INFO:teuthology.orchestra.run.smithi152.stdout: "total_load": 17896, 2023-08-10T12:05:41.526 INFO:teuthology.orchestra.run.smithi152.stdout: "average_load": 17896, 2023-08-10T12:05:41.526 INFO:teuthology.orchestra.run.smithi152.stdout: "avg_session_uptime": 776 2023-08-10T12:05:41.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.526 INFO:teuthology.orchestra.run.smithi152.stdout: "mempool": { 2023-08-10T12:05:41.526 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_bytes": 0, 2023-08-10T12:05:41.526 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_items": 0, 2023-08-10T12:05:41.526 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_bytes": 0, 2023-08-10T12:05:41.527 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_items": 0, 2023-08-10T12:05:41.527 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_bytes": 0, 2023-08-10T12:05:41.527 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_items": 0, 2023-08-10T12:05:41.527 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-10T12:05:41.527 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_items": 0, 2023-08-10T12:05:41.527 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-10T12:05:41.527 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_items": 0, 2023-08-10T12:05:41.528 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_bytes": 0, 2023-08-10T12:05:41.528 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_items": 0, 2023-08-10T12:05:41.528 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-10T12:05:41.528 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_items": 0, 2023-08-10T12:05:41.528 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_bytes": 0, 2023-08-10T12:05:41.528 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_items": 0, 2023-08-10T12:05:41.528 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_bytes": 0, 2023-08-10T12:05:41.528 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_items": 0, 2023-08-10T12:05:41.529 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-10T12:05:41.529 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_items": 0, 2023-08-10T12:05:41.529 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-10T12:05:41.529 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_items": 0, 2023-08-10T12:05:41.529 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_bytes": 0, 2023-08-10T12:05:41.529 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_items": 0, 2023-08-10T12:05:41.529 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_bytes": 0, 2023-08-10T12:05:41.530 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_items": 0, 2023-08-10T12:05:41.530 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-10T12:05:41.530 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_items": 0, 2023-08-10T12:05:41.530 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_bytes": 0, 2023-08-10T12:05:41.530 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_items": 0, 2023-08-10T12:05:41.530 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_bytes": 0, 2023-08-10T12:05:41.530 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_items": 0, 2023-08-10T12:05:41.531 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_bytes": 0, 2023-08-10T12:05:41.531 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_items": 0, 2023-08-10T12:05:41.531 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_bytes": 0, 2023-08-10T12:05:41.531 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_items": 0, 2023-08-10T12:05:41.531 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_bytes": 2713455, 2023-08-10T12:05:41.531 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_items": 29437, 2023-08-10T12:05:41.531 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_bytes": 0, 2023-08-10T12:05:41.532 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_items": 0, 2023-08-10T12:05:41.532 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_bytes": 0, 2023-08-10T12:05:41.532 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_items": 0, 2023-08-10T12:05:41.532 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_bytes": 0, 2023-08-10T12:05:41.532 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_items": 0, 2023-08-10T12:05:41.532 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_bytes": 0, 2023-08-10T12:05:41.532 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_items": 0, 2023-08-10T12:05:41.533 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_bytes": 8032, 2023-08-10T12:05:41.533 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_items": 167, 2023-08-10T12:05:41.533 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_bytes": 0, 2023-08-10T12:05:41.533 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_items": 0, 2023-08-10T12:05:41.533 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_bytes": 0, 2023-08-10T12:05:41.533 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_items": 0, 2023-08-10T12:05:41.533 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_bytes": 107908572, 2023-08-10T12:05:41.533 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_items": 1168297, 2023-08-10T12:05:41.534 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_bytes": 0, 2023-08-10T12:05:41.534 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_items": 0, 2023-08-10T12:05:41.534 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_bytes": 0, 2023-08-10T12:05:41.534 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_items": 0 2023-08-10T12:05:41.534 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.534 INFO:teuthology.orchestra.run.smithi152.stdout: "objecter": { 2023-08-10T12:05:41.534 INFO:teuthology.orchestra.run.smithi152.stdout: "op_active": 0, 2023-08-10T12:05:41.535 INFO:teuthology.orchestra.run.smithi152.stdout: "op_laggy": 0, 2023-08-10T12:05:41.535 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send": 34716, 2023-08-10T12:05:41.535 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send_bytes": 636597895, 2023-08-10T12:05:41.535 INFO:teuthology.orchestra.run.smithi152.stdout: "op_resend": 28, 2023-08-10T12:05:41.535 INFO:teuthology.orchestra.run.smithi152.stdout: "op_reply": 34716, 2023-08-10T12:05:41.535 INFO:teuthology.orchestra.run.smithi152.stdout: "op_latency": { 2023-08-10T12:05:41.535 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 34716, 2023-08-10T12:05:41.536 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 415.194217548, 2023-08-10T12:05:41.536 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.011959736 2023-08-10T12:05:41.536 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.536 INFO:teuthology.orchestra.run.smithi152.stdout: "op_inflight": 0, 2023-08-10T12:05:41.536 INFO:teuthology.orchestra.run.smithi152.stdout: "oplen_avg": { 2023-08-10T12:05:41.536 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 34716, 2023-08-10T12:05:41.536 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 38269 2023-08-10T12:05:41.537 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.537 INFO:teuthology.orchestra.run.smithi152.stdout: "op": 34716, 2023-08-10T12:05:41.537 INFO:teuthology.orchestra.run.smithi152.stdout: "op_r": 2946, 2023-08-10T12:05:41.537 INFO:teuthology.orchestra.run.smithi152.stdout: "op_w": 31770, 2023-08-10T12:05:41.537 INFO:teuthology.orchestra.run.smithi152.stdout: "op_rmw": 0, 2023-08-10T12:05:41.537 INFO:teuthology.orchestra.run.smithi152.stdout: "op_pg": 0, 2023-08-10T12:05:41.537 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_stat": 34, 2023-08-10T12:05:41.538 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_create": 986, 2023-08-10T12:05:41.538 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_read": 618, 2023-08-10T12:05:41.538 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_write": 5008, 2023-08-10T12:05:41.538 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writefull": 360, 2023-08-10T12:05:41.538 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writesame": 0, 2023-08-10T12:05:41.538 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_append": 0, 2023-08-10T12:05:41.538 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_zero": 0, 2023-08-10T12:05:41.539 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_truncate": 110, 2023-08-10T12:05:41.539 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_delete": 24155, 2023-08-10T12:05:41.539 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_mapext": 0, 2023-08-10T12:05:41.539 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_sparse_read": 0, 2023-08-10T12:05:41.539 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_clonerange": 0, 2023-08-10T12:05:41.539 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_getxattr": 1842, 2023-08-10T12:05:41.539 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_setxattr": 1972, 2023-08-10T12:05:41.539 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_cmpxattr": 0, 2023-08-10T12:05:41.540 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_rmxattr": 0, 2023-08-10T12:05:41.540 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_resetxattrs": 0, 2023-08-10T12:05:41.540 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_call": 0, 2023-08-10T12:05:41.540 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_watch": 0, 2023-08-10T12:05:41.540 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_notify": 0, 2023-08-10T12:05:41.540 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_src_cmpxattr": 0, 2023-08-10T12:05:41.540 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls": 0, 2023-08-10T12:05:41.541 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls_filter": 0, 2023-08-10T12:05:41.541 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_other": 1, 2023-08-10T12:05:41.541 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_active": 0, 2023-08-10T12:05:41.541 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_send": 0, 2023-08-10T12:05:41.541 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_resend": 0, 2023-08-10T12:05:41.541 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_ping": 0, 2023-08-10T12:05:41.541 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_active": 0, 2023-08-10T12:05:41.542 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_send": 0, 2023-08-10T12:05:41.542 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_resend": 0, 2023-08-10T12:05:41.542 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_active": 0, 2023-08-10T12:05:41.542 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_send": 0, 2023-08-10T12:05:41.542 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_resend": 0, 2023-08-10T12:05:41.542 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_active": 0, 2023-08-10T12:05:41.542 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_send": 0, 2023-08-10T12:05:41.543 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_resend": 0, 2023-08-10T12:05:41.543 INFO:teuthology.orchestra.run.smithi152.stdout: "command_active": 0, 2023-08-10T12:05:41.543 INFO:teuthology.orchestra.run.smithi152.stdout: "command_send": 0, 2023-08-10T12:05:41.543 INFO:teuthology.orchestra.run.smithi152.stdout: "command_resend": 0, 2023-08-10T12:05:41.543 INFO:teuthology.orchestra.run.smithi152.stdout: "map_epoch": 98, 2023-08-10T12:05:41.543 INFO:teuthology.orchestra.run.smithi152.stdout: "map_full": 0, 2023-08-10T12:05:41.543 INFO:teuthology.orchestra.run.smithi152.stdout: "map_inc": 15, 2023-08-10T12:05:41.544 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_sessions": 12, 2023-08-10T12:05:41.544 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_open": 12, 2023-08-10T12:05:41.544 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_close": 0, 2023-08-10T12:05:41.544 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_laggy": 0, 2023-08-10T12:05:41.544 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_wr": 2277, 2023-08-10T12:05:41.544 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_rd": 654, 2023-08-10T12:05:41.544 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_del": 252 2023-08-10T12:05:41.544 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.545 INFO:teuthology.orchestra.run.smithi152.stdout: "oft": { 2023-08-10T12:05:41.545 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_objs": 1, 2023-08-10T12:05:41.545 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_kv_pairs": 0, 2023-08-10T12:05:41.545 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_updates": 0, 2023-08-10T12:05:41.545 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_removes": 0 2023-08-10T12:05:41.545 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.545 INFO:teuthology.orchestra.run.smithi152.stdout: "osd-slow-ops": { 2023-08-10T12:05:41.546 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_ops_count": 15 2023-08-10T12:05:41.546 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.546 INFO:teuthology.orchestra.run.smithi152.stdout: "purge_queue": { 2023-08-10T12:05:41.546 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops": 0, 2023-08-10T12:05:41.546 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops_high_water": 6, 2023-08-10T12:05:41.546 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing": 0, 2023-08-10T12:05:41.546 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_high_water": 6, 2023-08-10T12:05:41.547 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed": 23950, 2023-08-10T12:05:41.547 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_item_in_journal": 0 2023-08-10T12:05:41.547 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.547 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-10T12:05:41.547 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-08-10T12:05:41.547 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2023-08-10T12:05:41.547 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-08-10T12:05:41.548 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 2818222, 2023-08-10T12:05:41.548 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 290955138, 2023-08-10T12:05:41.548 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:41.548 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 2818222, 2023-08-10T12:05:41.548 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2023-08-10T12:05:41.548 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2023-08-10T12:05:41.548 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 2818222, 2023-08-10T12:05:41.549 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 290955138, 2023-08-10T12:05:41.549 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-08-10T12:05:41.549 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:41.549 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:41.549 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:41.549 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:41.549 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.549 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_bytes": { 2023-08-10T12:05:41.550 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-08-10T12:05:41.550 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2023-08-10T12:05:41.550 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-08-10T12:05:41.550 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2023-08-10T12:05:41.550 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2023-08-10T12:05:41.550 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:41.550 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:41.551 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 34716, 2023-08-10T12:05:41.551 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 639987271, 2023-08-10T12:05:41.551 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 34716, 2023-08-10T12:05:41.551 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 639987271, 2023-08-10T12:05:41.551 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-08-10T12:05:41.551 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:41.551 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:41.552 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:41.552 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:41.552 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.552 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_ops": { 2023-08-10T12:05:41.552 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-08-10T12:05:41.552 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 1024, 2023-08-10T12:05:41.552 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-08-10T12:05:41.553 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2023-08-10T12:05:41.553 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2023-08-10T12:05:41.553 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:41.553 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:41.553 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 34716, 2023-08-10T12:05:41.553 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 34716, 2023-08-10T12:05:41.553 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 34716, 2023-08-10T12:05:41.554 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 34716, 2023-08-10T12:05:41.554 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-08-10T12:05:41.554 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:41.554 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:41.554 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:41.554 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:41.554 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.555 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle": { 2023-08-10T12:05:41.555 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-08-10T12:05:41.555 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2023-08-10T12:05:41.555 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-08-10T12:05:41.555 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 23950, 2023-08-10T12:05:41.555 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 3403230, 2023-08-10T12:05:41.555 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:41.556 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 23950, 2023-08-10T12:05:41.556 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2023-08-10T12:05:41.556 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2023-08-10T12:05:41.556 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 618, 2023-08-10T12:05:41.556 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 3403230, 2023-08-10T12:05:41.556 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-08-10T12:05:41.556 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:41.556 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:41.557 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:41.557 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:41.557 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:41.557 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle-0x5561c793c0a0": { 2023-08-10T12:05:41.557 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-08-10T12:05:41.557 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2023-08-10T12:05:41.557 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-08-10T12:05:41.558 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 155786, 2023-08-10T12:05:41.558 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 612231471, 2023-08-10T12:05:41.558 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:41.558 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 155786, 2023-08-10T12:05:41.558 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2023-08-10T12:05:41.558 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2023-08-10T12:05:41.558 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 4390, 2023-08-10T12:05:41.559 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 612231471, 2023-08-10T12:05:41.559 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-08-10T12:05:41.559 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:41.559 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:41.559 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:41.559 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:41.559 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:41.560 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-08-10T12:05:41.560 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:41 smithi073 ceph-mon[128869]: pgmap v406: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.6 KiB/s wr, 9 op/s 2023-08-10T12:05:41.561 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:41 smithi156 ceph-mon[130574]: pgmap v406: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.6 KiB/s wr, 9 op/s 2023-08-10T12:05:41.561 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:41 smithi152 ceph-mon[130220]: pgmap v406: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.6 KiB/s wr, 9 op/s 2023-08-10T12:05:41.817 INFO:tasks.check_counter:Daemon mds.h mds.exported=209 2023-08-10T12:05:41.818 INFO:tasks.check_counter:Daemon mds.h mds.imported=361 2023-08-10T12:05:41.818 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=4154 2023-08-10T12:05:41.818 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=4550 2023-08-10T12:05:41.819 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=2 2023-08-10T12:05:41.819 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2023-08-10T12:05:41.819 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2023-08-10T12:05:41.819 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=110 2023-08-10T12:05:41.819 DEBUG:tasks.check_counter:Getting stats from k 2023-08-10T12:05:41.820 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph daemon mds.k perf dump 2023-08-10T12:05:42.375 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.b/config 2023-08-10T12:05:43.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:43 smithi152 ceph-mon[130220]: pgmap v407: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 KiB/s wr, 14 op/s 2023-08-10T12:05:43.508 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:43 smithi156 ceph-mon[130574]: pgmap v407: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 KiB/s wr, 14 op/s 2023-08-10T12:05:43.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:43 smithi073 ceph-mon[128869]: pgmap v407: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 KiB/s wr, 14 op/s 2023-08-10T12:05:43.671 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-08-10T12:05:43.671 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-0": { 2023-08-10T12:05:43.672 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 42641, 2023-08-10T12:05:43.672 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 41175, 2023-08-10T12:05:43.672 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 29960367, 2023-08-10T12:05:43.672 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 64865975, 2023-08-10T12:05:43.672 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 19, 2023-08-10T12:05:43.672 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 9, 2023-08-10T12:05:43.672 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 2.713524338, 2023-08-10T12:05:43.673 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 1.228107648, 2023-08-10T12:05:43.673 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 1.774440770, 2023-08-10T12:05:43.673 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.133919928, 2023-08-10T12:05:43.673 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:43.673 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 41172, 2023-08-10T12:05:43.673 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 4.441550514, 2023-08-10T12:05:43.673 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000107877 2023-08-10T12:05:43.673 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.674 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:43.674 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 71729, 2023-08-10T12:05:43.674 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.013463829, 2023-08-10T12:05:43.674 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000187 2023-08-10T12:05:43.674 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.674 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 1661392, 2023-08-10T12:05:43.674 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 150208 2023-08-10T12:05:43.675 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.675 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-1": { 2023-08-10T12:05:43.675 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 176348, 2023-08-10T12:05:43.675 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 209856, 2023-08-10T12:05:43.675 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 71432950, 2023-08-10T12:05:43.675 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 152301537, 2023-08-10T12:05:43.675 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 10, 2023-08-10T12:05:43.675 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 5, 2023-08-10T12:05:43.676 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 8.362216423, 2023-08-10T12:05:43.676 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 3.984471197, 2023-08-10T12:05:43.676 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 157.671824590, 2023-08-10T12:05:43.676 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.106745162, 2023-08-10T12:05:43.676 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:43.676 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 209858, 2023-08-10T12:05:43.676 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 39.916636524, 2023-08-10T12:05:43.676 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000190207 2023-08-10T12:05:43.677 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.677 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:43.677 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 280157, 2023-08-10T12:05:43.677 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.058835348, 2023-08-10T12:05:43.677 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000210 2023-08-10T12:05:43.677 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.677 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 50697328, 2023-08-10T12:05:43.678 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 103227984 2023-08-10T12:05:43.678 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.678 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-2": { 2023-08-10T12:05:43.678 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 5424, 2023-08-10T12:05:43.678 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 5623, 2023-08-10T12:05:43.678 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 1727120, 2023-08-10T12:05:43.678 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 83357152, 2023-08-10T12:05:43.678 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 16, 2023-08-10T12:05:43.679 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 7, 2023-08-10T12:05:43.679 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.592139614, 2023-08-10T12:05:43.679 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.277979126, 2023-08-10T12:05:43.679 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.092106914, 2023-08-10T12:05:43.680 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.192765811, 2023-08-10T12:05:43.680 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:43.680 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 5619, 2023-08-10T12:05:43.680 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.699470636, 2023-08-10T12:05:43.680 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000124483 2023-08-10T12:05:43.680 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.680 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:43.681 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 68, 2023-08-10T12:05:43.681 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000013902, 2023-08-10T12:05:43.681 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000204 2023-08-10T12:05:43.681 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.681 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 6848, 2023-08-10T12:05:43.681 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 372736 2023-08-10T12:05:43.681 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.681 INFO:teuthology.orchestra.run.smithi152.stdout: "cct": { 2023-08-10T12:05:43.682 INFO:teuthology.orchestra.run.smithi152.stdout: "total_workers": 1, 2023-08-10T12:05:43.682 INFO:teuthology.orchestra.run.smithi152.stdout: "unhealthy_workers": 0 2023-08-10T12:05:43.682 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.682 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-MDSRank": { 2023-08-10T12:05:43.682 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2023-08-10T12:05:43.682 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2023-08-10T12:05:43.682 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 5401, 2023-08-10T12:05:43.682 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 34.113538188, 2023-08-10T12:05:43.683 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.006316152 2023-08-10T12:05:43.683 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:43.683 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.683 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-PurgeQueue": { 2023-08-10T12:05:43.683 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2023-08-10T12:05:43.683 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2023-08-10T12:05:43.683 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 15654, 2023-08-10T12:05:43.684 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 2.942167093, 2023-08-10T12:05:43.684 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000187949 2023-08-10T12:05:43.684 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:43.684 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.684 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2023-08-10T12:05:43.684 INFO:teuthology.orchestra.run.smithi152.stdout: "request": 74682, 2023-08-10T12:05:43.684 INFO:teuthology.orchestra.run.smithi152.stdout: "reply": 72693, 2023-08-10T12:05:43.684 INFO:teuthology.orchestra.run.smithi152.stdout: "reply_latency": { 2023-08-10T12:05:43.685 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 72693, 2023-08-10T12:05:43.685 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 2027.499052327, 2023-08-10T12:05:43.685 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.027891255 2023-08-10T12:05:43.685 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.685 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_reply": 0, 2023-08-10T12:05:43.685 INFO:teuthology.orchestra.run.smithi152.stdout: "forward": 1988, 2023-08-10T12:05:43.685 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_complete": 45, 2023-08-10T12:05:43.686 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_keys": 0, 2023-08-10T12:05:43.686 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_commit": 316, 2023-08-10T12:05:43.686 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_split": 34, 2023-08-10T12:05:43.686 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_merge": 0, 2023-08-10T12:05:43.686 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes": 15216, 2023-08-10T12:05:43.686 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_top": 11, 2023-08-10T12:05:43.686 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_bottom": 11, 2023-08-10T12:05:43.687 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pin_tail": 15194, 2023-08-10T12:05:43.687 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pinned": 15197, 2023-08-10T12:05:43.687 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_expired": 24722, 2023-08-10T12:05:43.687 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_with_caps": 3, 2023-08-10T12:05:43.687 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": 3, 2023-08-10T12:05:43.687 INFO:teuthology.orchestra.run.smithi152.stdout: "subtrees": 5, 2023-08-10T12:05:43.687 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse": 143733, 2023-08-10T12:05:43.688 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_hit": 107768, 2023-08-10T12:05:43.688 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_forward": 1862, 2023-08-10T12:05:43.688 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_discover": 1518, 2023-08-10T12:05:43.688 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_dir_fetch": 22, 2023-08-10T12:05:43.688 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_remote_ino": 0, 2023-08-10T12:05:43.688 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_lock": 974, 2023-08-10T12:05:43.688 INFO:teuthology.orchestra.run.smithi152.stdout: "load_cent": 0, 2023-08-10T12:05:43.688 INFO:teuthology.orchestra.run.smithi152.stdout: "q": 0, 2023-08-10T12:05:43.689 INFO:teuthology.orchestra.run.smithi152.stdout: "exported": 337, 2023-08-10T12:05:43.689 INFO:teuthology.orchestra.run.smithi152.stdout: "exported_inodes": 16829, 2023-08-10T12:05:43.689 INFO:teuthology.orchestra.run.smithi152.stdout: "imported": 264, 2023-08-10T12:05:43.689 INFO:teuthology.orchestra.run.smithi152.stdout: "imported_inodes": 19396, 2023-08-10T12:05:43.689 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_dir_fetch": 0, 2023-08-10T12:05:43.689 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_backtrace_fetch": 0, 2023-08-10T12:05:43.689 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_peer_discover": 0, 2023-08-10T12:05:43.689 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rfiles": 1767, 2023-08-10T12:05:43.690 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rbytes": 37429583, 2023-08-10T12:05:43.690 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rsnaps": 2, 2023-08-10T12:05:43.690 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_fetch": 0, 2023-08-10T12:05:43.690 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_set_tag": 0, 2023-08-10T12:05:43.690 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_repaired": 0, 2023-08-10T12:05:43.690 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_inotable_repaired": 0, 2023-08-10T12:05:43.690 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_inodes": 0, 2023-08-10T12:05:43.690 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_base_inodes": 0, 2023-08-10T12:05:43.691 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dirfrag_rstats": 0, 2023-08-10T12:05:43.691 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_file_inodes": 0, 2023-08-10T12:05:43.691 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_inode_file_caps": 190, 2023-08-10T12:05:43.691 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_revoke": 8018, 2023-08-10T12:05:43.691 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_grant": 16920, 2023-08-10T12:05:43.691 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_trunc": 0, 2023-08-10T12:05:43.691 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-10T12:05:43.691 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-10T12:05:43.692 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps": 20065, 2023-08-10T12:05:43.692 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps_dirty": 7319, 2023-08-10T12:05:43.692 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_cap_release": 338, 2023-08-10T12:05:43.692 INFO:teuthology.orchestra.run.smithi152.stdout: "process_request_cap_release": 21095 2023-08-10T12:05:43.692 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.692 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_cache": { 2023-08-10T12:05:43.692 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update": 2386, 2023-08-10T12:05:43.693 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update_receipt": 8000, 2023-08-10T12:05:43.693 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_try_discover": 4766, 2023-08-10T12:05:43.693 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_send_discover": 6450, 2023-08-10T12:05:43.693 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_handle_discover": 3902, 2023-08-10T12:05:43.693 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays": 42, 2023-08-10T12:05:43.693 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_delayed": 0, 2023-08-10T12:05:43.693 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_enqueuing": 0, 2023-08-10T12:05:43.693 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_created": 8318, 2023-08-10T12:05:43.694 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_enqueued": 8276, 2023-08-10T12:05:43.694 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_reintegrated": 0, 2023-08-10T12:05:43.694 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_migrated": 0, 2023-08-10T12:05:43.694 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_processing": 0, 2023-08-10T12:05:43.694 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_enqueued": 0, 2023-08-10T12:05:43.694 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_prioritized": 0, 2023-08-10T12:05:43.694 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_started": 0, 2023-08-10T12:05:43.694 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_completed": 0, 2023-08-10T12:05:43.695 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_enqueue_scrub": 0, 2023-08-10T12:05:43.695 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_exportdir": 339, 2023-08-10T12:05:43.695 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_flush": 0, 2023-08-10T12:05:43.695 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragmentdir": 34, 2023-08-10T12:05:43.695 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragstats": 0, 2023-08-10T12:05:43.695 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_inodestats": 0 2023-08-10T12:05:43.695 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.695 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_log": { 2023-08-10T12:05:43.696 INFO:teuthology.orchestra.run.smithi152.stdout: "evadd": 52699, 2023-08-10T12:05:43.696 INFO:teuthology.orchestra.run.smithi152.stdout: "evex": 0, 2023-08-10T12:05:43.696 INFO:teuthology.orchestra.run.smithi152.stdout: "evtrm": 0, 2023-08-10T12:05:43.696 INFO:teuthology.orchestra.run.smithi152.stdout: "ev": 52699, 2023-08-10T12:05:43.696 INFO:teuthology.orchestra.run.smithi152.stdout: "evexg": 0, 2023-08-10T12:05:43.696 INFO:teuthology.orchestra.run.smithi152.stdout: "evexd": 0, 2023-08-10T12:05:43.696 INFO:teuthology.orchestra.run.smithi152.stdout: "segadd": 72, 2023-08-10T12:05:43.696 INFO:teuthology.orchestra.run.smithi152.stdout: "segex": 0, 2023-08-10T12:05:43.697 INFO:teuthology.orchestra.run.smithi152.stdout: "segtrm": 0, 2023-08-10T12:05:43.697 INFO:teuthology.orchestra.run.smithi152.stdout: "seg": 72, 2023-08-10T12:05:43.697 INFO:teuthology.orchestra.run.smithi152.stdout: "segexg": 0, 2023-08-10T12:05:43.697 INFO:teuthology.orchestra.run.smithi152.stdout: "segexd": 0, 2023-08-10T12:05:43.697 INFO:teuthology.orchestra.run.smithi152.stdout: "expos": 4194304, 2023-08-10T12:05:43.697 INFO:teuthology.orchestra.run.smithi152.stdout: "wrpos": 177022993, 2023-08-10T12:05:43.697 INFO:teuthology.orchestra.run.smithi152.stdout: "rdpos": 0, 2023-08-10T12:05:43.697 INFO:teuthology.orchestra.run.smithi152.stdout: "jlat": { 2023-08-10T12:05:43.698 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2634, 2023-08-10T12:05:43.698 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 78.682587077, 2023-08-10T12:05:43.698 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.029871900 2023-08-10T12:05:43.698 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.698 INFO:teuthology.orchestra.run.smithi152.stdout: "replayed": 0 2023-08-10T12:05:43.698 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.698 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_mem": { 2023-08-10T12:05:43.698 INFO:teuthology.orchestra.run.smithi152.stdout: "ino": 7300, 2023-08-10T12:05:43.699 INFO:teuthology.orchestra.run.smithi152.stdout: "ino+": 27865, 2023-08-10T12:05:43.699 INFO:teuthology.orchestra.run.smithi152.stdout: "ino-": 20565, 2023-08-10T12:05:43.699 INFO:teuthology.orchestra.run.smithi152.stdout: "dir": 301, 2023-08-10T12:05:43.699 INFO:teuthology.orchestra.run.smithi152.stdout: "dir+": 3868, 2023-08-10T12:05:43.699 INFO:teuthology.orchestra.run.smithi152.stdout: "dir-": 3567, 2023-08-10T12:05:43.699 INFO:teuthology.orchestra.run.smithi152.stdout: "dn": 15216, 2023-08-10T12:05:43.699 INFO:teuthology.orchestra.run.smithi152.stdout: "dn+": 50195, 2023-08-10T12:05:43.699 INFO:teuthology.orchestra.run.smithi152.stdout: "dn-": 34979, 2023-08-10T12:05:43.700 INFO:teuthology.orchestra.run.smithi152.stdout: "cap": 3, 2023-08-10T12:05:43.700 INFO:teuthology.orchestra.run.smithi152.stdout: "cap+": 17260, 2023-08-10T12:05:43.700 INFO:teuthology.orchestra.run.smithi152.stdout: "cap-": 17257, 2023-08-10T12:05:43.700 INFO:teuthology.orchestra.run.smithi152.stdout: "rss": 145840, 2023-08-10T12:05:43.700 INFO:teuthology.orchestra.run.smithi152.stdout: "heap": 198960 2023-08-10T12:05:43.700 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.700 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_server": { 2023-08-10T12:05:43.701 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_client_request": 83828, 2023-08-10T12:05:43.701 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_server_request": 4982, 2023-08-10T12:05:43.701 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_request": 74682, 2023-08-10T12:05:43.701 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_session": 317, 2023-08-10T12:05:43.701 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_peer_request": 6954, 2023-08-10T12:05:43.701 INFO:teuthology.orchestra.run.smithi152.stdout: "req_create_latency": { 2023-08-10T12:05:43.701 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 5946, 2023-08-10T12:05:43.701 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 40.662060293, 2023-08-10T12:05:43.702 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.006838557 2023-08-10T12:05:43.702 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.702 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getattr_latency": { 2023-08-10T12:05:43.702 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 120, 2023-08-10T12:05:43.702 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 17.272419302, 2023-08-10T12:05:43.702 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.143936827 2023-08-10T12:05:43.702 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.702 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getfilelock_latency": { 2023-08-10T12:05:43.703 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:43.703 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:43.703 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:43.703 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.703 INFO:teuthology.orchestra.run.smithi152.stdout: "req_link_latency": { 2023-08-10T12:05:43.703 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:43.703 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:43.703 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:43.704 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.704 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookup_latency": { 2023-08-10T12:05:43.704 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 50721, 2023-08-10T12:05:43.704 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1647.290771747, 2023-08-10T12:05:43.704 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.032477490 2023-08-10T12:05:43.704 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.704 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookuphash_latency": { 2023-08-10T12:05:43.704 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:43.705 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:43.705 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:43.705 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.705 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupino_latency": { 2023-08-10T12:05:43.705 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1, 2023-08-10T12:05:43.705 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000118873, 2023-08-10T12:05:43.705 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000118873 2023-08-10T12:05:43.705 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.706 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupname_latency": { 2023-08-10T12:05:43.706 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:43.706 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:43.706 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:43.706 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.706 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupparent_latency": { 2023-08-10T12:05:43.706 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:43.706 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:43.707 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:43.707 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.707 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupsnap_latency": { 2023-08-10T12:05:43.707 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:43.707 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:43.707 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:43.707 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.707 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lssnap_latency": { 2023-08-10T12:05:43.708 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:43.708 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:43.708 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:43.708 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.708 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mkdir_latency": { 2023-08-10T12:05:43.708 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 24, 2023-08-10T12:05:43.708 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1.404223624, 2023-08-10T12:05:43.709 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.058509317 2023-08-10T12:05:43.709 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.709 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mknod_latency": { 2023-08-10T12:05:43.709 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:43.709 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:43.709 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:43.709 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.709 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mksnap_latency": { 2023-08-10T12:05:43.710 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:43.710 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:43.710 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:43.710 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.710 INFO:teuthology.orchestra.run.smithi152.stdout: "req_open_latency": { 2023-08-10T12:05:43.710 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2680, 2023-08-10T12:05:43.710 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 11.870203521, 2023-08-10T12:05:43.710 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.004429180 2023-08-10T12:05:43.711 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.711 INFO:teuthology.orchestra.run.smithi152.stdout: "req_readdir_latency": { 2023-08-10T12:05:43.711 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 315, 2023-08-10T12:05:43.711 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.784503643, 2023-08-10T12:05:43.711 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.002490487 2023-08-10T12:05:43.711 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.711 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rename_latency": { 2023-08-10T12:05:43.711 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 5916, 2023-08-10T12:05:43.712 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 277.875048915, 2023-08-10T12:05:43.712 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.046970089 2023-08-10T12:05:43.712 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.712 INFO:teuthology.orchestra.run.smithi152.stdout: "req_renamesnap_latency": { 2023-08-10T12:05:43.712 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:43.712 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:43.712 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:43.713 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.713 INFO:teuthology.orchestra.run.smithi152.stdout: "req_snapdiff_latency": { 2023-08-10T12:05:43.713 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:43.713 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:43.713 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:43.713 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.713 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmdir_latency": { 2023-08-10T12:05:43.713 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 41, 2023-08-10T12:05:43.714 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 18.010029453, 2023-08-10T12:05:43.714 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.439269011 2023-08-10T12:05:43.714 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.714 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmsnap_latency": { 2023-08-10T12:05:43.714 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:43.714 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:43.714 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:43.714 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.715 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmxattr_latency": { 2023-08-10T12:05:43.715 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:43.715 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:43.715 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:43.715 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.715 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setattr_latency": { 2023-08-10T12:05:43.715 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:43.715 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:43.716 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:43.716 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.716 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setdirlayout_latency": { 2023-08-10T12:05:43.716 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:43.716 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:43.716 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:43.716 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.717 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setfilelock_latency": { 2023-08-10T12:05:43.717 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:43.717 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:43.717 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:43.717 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.717 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setlayout_latency": { 2023-08-10T12:05:43.717 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:43.717 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:43.718 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:43.718 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.718 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setxattr_latency": { 2023-08-10T12:05:43.718 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:43.718 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:43.718 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:43.718 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.718 INFO:teuthology.orchestra.run.smithi152.stdout: "req_symlink_latency": { 2023-08-10T12:05:43.719 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:43.719 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:43.719 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:43.719 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.719 INFO:teuthology.orchestra.run.smithi152.stdout: "req_unlink_latency": { 2023-08-10T12:05:43.719 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 6929, 2023-08-10T12:05:43.719 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 12.329672956, 2023-08-10T12:05:43.719 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001779430 2023-08-10T12:05:43.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.720 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_revoke_eviction": 0, 2023-08-10T12:05:43.720 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_acquisition_throttle": 0, 2023-08-10T12:05:43.720 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getvxattr_latency": { 2023-08-10T12:05:43.720 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:43.720 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:43.720 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:43.720 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:43.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.721 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_sessions": { 2023-08-10T12:05:43.721 INFO:teuthology.orchestra.run.smithi152.stdout: "session_count": 2, 2023-08-10T12:05:43.721 INFO:teuthology.orchestra.run.smithi152.stdout: "session_add": 2, 2023-08-10T12:05:43.721 INFO:teuthology.orchestra.run.smithi152.stdout: "session_remove": 0, 2023-08-10T12:05:43.721 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_open": 2, 2023-08-10T12:05:43.721 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_stale": 0, 2023-08-10T12:05:43.722 INFO:teuthology.orchestra.run.smithi152.stdout: "total_load": 2728, 2023-08-10T12:05:43.722 INFO:teuthology.orchestra.run.smithi152.stdout: "average_load": 1364, 2023-08-10T12:05:43.722 INFO:teuthology.orchestra.run.smithi152.stdout: "avg_session_uptime": 771 2023-08-10T12:05:43.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.722 INFO:teuthology.orchestra.run.smithi152.stdout: "mempool": { 2023-08-10T12:05:43.722 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_bytes": 0, 2023-08-10T12:05:43.722 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_items": 0, 2023-08-10T12:05:43.722 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_bytes": 0, 2023-08-10T12:05:43.723 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_items": 0, 2023-08-10T12:05:43.723 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_bytes": 0, 2023-08-10T12:05:43.723 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_items": 0, 2023-08-10T12:05:43.723 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-10T12:05:43.723 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_items": 0, 2023-08-10T12:05:43.723 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-10T12:05:43.723 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_items": 0, 2023-08-10T12:05:43.723 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_bytes": 0, 2023-08-10T12:05:43.724 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_items": 0, 2023-08-10T12:05:43.724 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-10T12:05:43.724 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_items": 0, 2023-08-10T12:05:43.724 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_bytes": 0, 2023-08-10T12:05:43.724 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_items": 0, 2023-08-10T12:05:43.724 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_bytes": 0, 2023-08-10T12:05:43.724 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_items": 0, 2023-08-10T12:05:43.724 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-10T12:05:43.725 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_items": 0, 2023-08-10T12:05:43.725 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-10T12:05:43.725 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_items": 0, 2023-08-10T12:05:43.725 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_bytes": 0, 2023-08-10T12:05:43.725 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_items": 0, 2023-08-10T12:05:43.725 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_bytes": 0, 2023-08-10T12:05:43.725 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_items": 0, 2023-08-10T12:05:43.725 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-10T12:05:43.726 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_items": 0, 2023-08-10T12:05:43.726 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_bytes": 0, 2023-08-10T12:05:43.726 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_items": 0, 2023-08-10T12:05:43.726 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_bytes": 0, 2023-08-10T12:05:43.726 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_items": 0, 2023-08-10T12:05:43.726 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_bytes": 0, 2023-08-10T12:05:43.726 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_items": 0, 2023-08-10T12:05:43.726 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_bytes": 0, 2023-08-10T12:05:43.727 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_items": 0, 2023-08-10T12:05:43.727 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_bytes": 959856, 2023-08-10T12:05:43.727 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_items": 7127, 2023-08-10T12:05:43.727 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_bytes": 264, 2023-08-10T12:05:43.727 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_items": 3, 2023-08-10T12:05:43.727 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_bytes": 0, 2023-08-10T12:05:43.727 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_items": 0, 2023-08-10T12:05:43.727 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_bytes": 0, 2023-08-10T12:05:43.728 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_items": 0, 2023-08-10T12:05:43.728 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_bytes": 0, 2023-08-10T12:05:43.728 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_items": 0, 2023-08-10T12:05:43.728 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_bytes": 8032, 2023-08-10T12:05:43.728 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_items": 167, 2023-08-10T12:05:43.728 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_bytes": 0, 2023-08-10T12:05:43.728 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_items": 0, 2023-08-10T12:05:43.729 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_bytes": 0, 2023-08-10T12:05:43.729 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_items": 0, 2023-08-10T12:05:43.729 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_bytes": 27950781, 2023-08-10T12:05:43.729 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_items": 313127, 2023-08-10T12:05:43.729 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_bytes": 0, 2023-08-10T12:05:43.729 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_items": 0, 2023-08-10T12:05:43.729 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_bytes": 0, 2023-08-10T12:05:43.729 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_items": 0 2023-08-10T12:05:43.730 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.730 INFO:teuthology.orchestra.run.smithi152.stdout: "objecter": { 2023-08-10T12:05:43.730 INFO:teuthology.orchestra.run.smithi152.stdout: "op_active": 0, 2023-08-10T12:05:43.730 INFO:teuthology.orchestra.run.smithi152.stdout: "op_laggy": 0, 2023-08-10T12:05:43.730 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send": 12516, 2023-08-10T12:05:43.730 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send_bytes": 180474897, 2023-08-10T12:05:43.730 INFO:teuthology.orchestra.run.smithi152.stdout: "op_resend": 33, 2023-08-10T12:05:43.730 INFO:teuthology.orchestra.run.smithi152.stdout: "op_reply": 12516, 2023-08-10T12:05:43.731 INFO:teuthology.orchestra.run.smithi152.stdout: "op_latency": { 2023-08-10T12:05:43.731 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 12516, 2023-08-10T12:05:43.731 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 166.117057853, 2023-08-10T12:05:43.731 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.013272375 2023-08-10T12:05:43.731 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.731 INFO:teuthology.orchestra.run.smithi152.stdout: "op_inflight": 0, 2023-08-10T12:05:43.731 INFO:teuthology.orchestra.run.smithi152.stdout: "oplen_avg": { 2023-08-10T12:05:43.731 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 12516, 2023-08-10T12:05:43.732 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 13141 2023-08-10T12:05:43.732 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.732 INFO:teuthology.orchestra.run.smithi152.stdout: "op": 12516, 2023-08-10T12:05:43.732 INFO:teuthology.orchestra.run.smithi152.stdout: "op_r": 473, 2023-08-10T12:05:43.732 INFO:teuthology.orchestra.run.smithi152.stdout: "op_w": 12043, 2023-08-10T12:05:43.732 INFO:teuthology.orchestra.run.smithi152.stdout: "op_rmw": 0, 2023-08-10T12:05:43.732 INFO:teuthology.orchestra.run.smithi152.stdout: "op_pg": 0, 2023-08-10T12:05:43.732 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_stat": 0, 2023-08-10T12:05:43.733 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_create": 10, 2023-08-10T12:05:43.733 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_read": 367, 2023-08-10T12:05:43.733 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_write": 3001, 2023-08-10T12:05:43.733 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writefull": 226, 2023-08-10T12:05:43.733 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writesame": 0, 2023-08-10T12:05:43.733 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_append": 0, 2023-08-10T12:05:43.733 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_zero": 0, 2023-08-10T12:05:43.733 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_truncate": 34, 2023-08-10T12:05:43.734 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_delete": 8329, 2023-08-10T12:05:43.734 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_mapext": 0, 2023-08-10T12:05:43.734 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_sparse_read": 0, 2023-08-10T12:05:43.734 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_clonerange": 0, 2023-08-10T12:05:43.734 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_getxattr": 0, 2023-08-10T12:05:43.734 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_setxattr": 20, 2023-08-10T12:05:43.734 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_cmpxattr": 0, 2023-08-10T12:05:43.734 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_rmxattr": 0, 2023-08-10T12:05:43.735 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_resetxattrs": 0, 2023-08-10T12:05:43.735 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_call": 0, 2023-08-10T12:05:43.735 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_watch": 0, 2023-08-10T12:05:43.735 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_notify": 0, 2023-08-10T12:05:43.735 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_src_cmpxattr": 0, 2023-08-10T12:05:43.735 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls": 0, 2023-08-10T12:05:43.735 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls_filter": 0, 2023-08-10T12:05:43.735 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_other": 0, 2023-08-10T12:05:43.736 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_active": 0, 2023-08-10T12:05:43.736 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_send": 0, 2023-08-10T12:05:43.736 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_resend": 0, 2023-08-10T12:05:43.736 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_ping": 0, 2023-08-10T12:05:43.736 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_active": 0, 2023-08-10T12:05:43.736 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_send": 0, 2023-08-10T12:05:43.736 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_resend": 0, 2023-08-10T12:05:43.737 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_active": 0, 2023-08-10T12:05:43.737 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_send": 0, 2023-08-10T12:05:43.737 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_resend": 0, 2023-08-10T12:05:43.737 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_active": 0, 2023-08-10T12:05:43.737 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_send": 0, 2023-08-10T12:05:43.737 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_resend": 0, 2023-08-10T12:05:43.737 INFO:teuthology.orchestra.run.smithi152.stdout: "command_active": 0, 2023-08-10T12:05:43.737 INFO:teuthology.orchestra.run.smithi152.stdout: "command_send": 0, 2023-08-10T12:05:43.738 INFO:teuthology.orchestra.run.smithi152.stdout: "command_resend": 0, 2023-08-10T12:05:43.738 INFO:teuthology.orchestra.run.smithi152.stdout: "map_epoch": 98, 2023-08-10T12:05:43.738 INFO:teuthology.orchestra.run.smithi152.stdout: "map_full": 0, 2023-08-10T12:05:43.738 INFO:teuthology.orchestra.run.smithi152.stdout: "map_inc": 15, 2023-08-10T12:05:43.738 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_sessions": 12, 2023-08-10T12:05:43.738 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_open": 12, 2023-08-10T12:05:43.738 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_close": 0, 2023-08-10T12:05:43.738 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_laggy": 0, 2023-08-10T12:05:43.739 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_wr": 860, 2023-08-10T12:05:43.739 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_rd": 151, 2023-08-10T12:05:43.739 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_del": 143 2023-08-10T12:05:43.739 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.739 INFO:teuthology.orchestra.run.smithi152.stdout: "oft": { 2023-08-10T12:05:43.739 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_objs": 1, 2023-08-10T12:05:43.739 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_kv_pairs": 0, 2023-08-10T12:05:43.739 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_updates": 0, 2023-08-10T12:05:43.740 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_removes": 0 2023-08-10T12:05:43.740 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.740 INFO:teuthology.orchestra.run.smithi152.stdout: "osd-slow-ops": { 2023-08-10T12:05:43.740 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_ops_count": 5 2023-08-10T12:05:43.740 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.740 INFO:teuthology.orchestra.run.smithi152.stdout: "purge_queue": { 2023-08-10T12:05:43.740 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops": 0, 2023-08-10T12:05:43.740 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops_high_water": 6, 2023-08-10T12:05:43.741 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing": 0, 2023-08-10T12:05:43.741 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_high_water": 6, 2023-08-10T12:05:43.741 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed": 8276, 2023-08-10T12:05:43.741 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_item_in_journal": 0 2023-08-10T12:05:43.741 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.741 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-10T12:05:43.741 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-08-10T12:05:43.741 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2023-08-10T12:05:43.742 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-08-10T12:05:43.742 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 224409, 2023-08-10T12:05:43.742 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 76526045, 2023-08-10T12:05:43.742 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:43.742 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 224409, 2023-08-10T12:05:43.742 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2023-08-10T12:05:43.742 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2023-08-10T12:05:43.742 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 224409, 2023-08-10T12:05:43.743 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 76526045, 2023-08-10T12:05:43.743 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-08-10T12:05:43.743 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:43.743 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:43.743 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:43.743 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:43.743 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.743 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_bytes": { 2023-08-10T12:05:43.744 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-08-10T12:05:43.744 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2023-08-10T12:05:43.744 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-08-10T12:05:43.744 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2023-08-10T12:05:43.744 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2023-08-10T12:05:43.744 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:43.744 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:43.745 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 12516, 2023-08-10T12:05:43.745 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 181608805, 2023-08-10T12:05:43.745 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 12516, 2023-08-10T12:05:43.745 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 181608805, 2023-08-10T12:05:43.745 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-08-10T12:05:43.745 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:43.745 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:43.745 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:43.746 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:43.746 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.746 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_ops": { 2023-08-10T12:05:43.746 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-08-10T12:05:43.746 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 1024, 2023-08-10T12:05:43.746 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-08-10T12:05:43.746 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2023-08-10T12:05:43.746 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2023-08-10T12:05:43.747 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:43.747 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:43.747 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 12516, 2023-08-10T12:05:43.747 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 12516, 2023-08-10T12:05:43.747 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 12516, 2023-08-10T12:05:43.747 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 12516, 2023-08-10T12:05:43.747 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-08-10T12:05:43.747 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:43.748 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:43.748 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:43.748 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:43.748 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.748 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle": { 2023-08-10T12:05:43.748 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-08-10T12:05:43.748 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2023-08-10T12:05:43.749 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-08-10T12:05:43.749 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 8276, 2023-08-10T12:05:43.749 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 1136724, 2023-08-10T12:05:43.749 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:43.749 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 8276, 2023-08-10T12:05:43.749 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2023-08-10T12:05:43.749 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2023-08-10T12:05:43.749 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 367, 2023-08-10T12:05:43.750 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 1136724, 2023-08-10T12:05:43.750 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-08-10T12:05:43.750 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:43.750 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:43.750 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:43.750 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:43.750 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-08-10T12:05:43.750 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle-0x56212ad760a0": { 2023-08-10T12:05:43.751 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2023-08-10T12:05:43.751 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2023-08-10T12:05:43.751 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2023-08-10T12:05:43.751 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 52699, 2023-08-10T12:05:43.751 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 172828689, 2023-08-10T12:05:43.751 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:43.751 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 52699, 2023-08-10T12:05:43.751 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2023-08-10T12:05:43.752 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2023-08-10T12:05:43.752 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 2634, 2023-08-10T12:05:43.752 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 172828689, 2023-08-10T12:05:43.752 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2023-08-10T12:05:43.752 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2023-08-10T12:05:43.752 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2023-08-10T12:05:43.752 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2023-08-10T12:05:43.752 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:43.753 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-08-10T12:05:43.753 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-08-10T12:05:44.134 INFO:tasks.check_counter:Daemon mds.k mds.exported=337 2023-08-10T12:05:44.134 INFO:tasks.check_counter:Daemon mds.k mds.imported=264 2023-08-10T12:05:44.134 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=2386 2023-08-10T12:05:44.134 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=8000 2023-08-10T12:05:44.135 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=2 2023-08-10T12:05:44.135 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2023-08-10T12:05:44.135 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2023-08-10T12:05:44.135 INFO:tasks.check_counter:Daemon mds.k mds.dir_split=34 2023-08-10T12:05:44.135 DEBUG:tasks.check_counter:Getting stats from c 2023-08-10T12:05:44.136 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph daemon mds.c perf dump 2023-08-10T12:05:44.701 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T12:05:45.226 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:44 smithi156 ceph-mon[130574]: pgmap v408: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2023-08-10T12:05:45.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:44 smithi152 ceph-mon[130220]: pgmap v408: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2023-08-10T12:05:45.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:44 smithi073 ceph-mon[128869]: pgmap v408: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2023-08-10T12:05:45.922 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2023-08-10T12:05:45.922 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-0": { 2023-08-10T12:05:45.922 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 1889, 2023-08-10T12:05:45.923 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 1891, 2023-08-10T12:05:45.923 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 235827150, 2023-08-10T12:05:45.923 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 587486, 2023-08-10T12:05:45.923 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 8, 2023-08-10T12:05:45.924 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 4, 2023-08-10T12:05:45.924 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.236814077, 2023-08-10T12:05:45.924 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.042154575, 2023-08-10T12:05:45.925 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.126389525, 2023-08-10T12:05:45.925 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.054653399, 2023-08-10T12:05:45.925 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:45.926 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 1889, 2023-08-10T12:05:45.926 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.113139363, 2023-08-10T12:05:45.926 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000059893 2023-08-10T12:05:45.926 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.927 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:45.927 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.927 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.928 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.928 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.928 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 0, 2023-08-10T12:05:45.929 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 0 2023-08-10T12:05:45.929 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.929 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-1": { 2023-08-10T12:05:45.929 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 942, 2023-08-10T12:05:45.930 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 892, 2023-08-10T12:05:45.930 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 161242796, 2023-08-10T12:05:45.930 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 337571, 2023-08-10T12:05:45.931 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 5, 2023-08-10T12:05:45.931 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 4, 2023-08-10T12:05:45.931 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.163253906, 2023-08-10T12:05:45.931 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.022012158, 2023-08-10T12:05:45.932 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.125501143, 2023-08-10T12:05:45.932 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.021286114, 2023-08-10T12:05:45.932 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:45.932 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 892, 2023-08-10T12:05:45.933 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.076836612, 2023-08-10T12:05:45.933 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000086139 2023-08-10T12:05:45.933 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.933 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:45.934 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.934 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.934 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.934 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.935 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 1676144, 2023-08-10T12:05:45.935 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 142512 2023-08-10T12:05:45.935 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.935 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-2": { 2023-08-10T12:05:45.936 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 925, 2023-08-10T12:05:45.936 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 1109, 2023-08-10T12:05:45.936 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 218248365, 2023-08-10T12:05:45.936 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 763853, 2023-08-10T12:05:45.936 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 8, 2023-08-10T12:05:45.936 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 6, 2023-08-10T12:05:45.937 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.157344203, 2023-08-10T12:05:45.937 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.021705874, 2023-08-10T12:05:45.937 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.106482574, 2023-08-10T12:05:45.937 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.022207602, 2023-08-10T12:05:45.937 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:45.937 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 1106, 2023-08-10T12:05:45.937 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.094002254, 2023-08-10T12:05:45.938 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000084992 2023-08-10T12:05:45.938 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.938 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:45.938 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.938 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.938 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.938 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.938 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 320, 2023-08-10T12:05:45.939 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 476800 2023-08-10T12:05:45.939 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.939 INFO:teuthology.orchestra.run.smithi156.stdout: "cct": { 2023-08-10T12:05:45.939 INFO:teuthology.orchestra.run.smithi156.stdout: "total_workers": 1, 2023-08-10T12:05:45.939 INFO:teuthology.orchestra.run.smithi156.stdout: "unhealthy_workers": 0 2023-08-10T12:05:45.939 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.939 INFO:teuthology.orchestra.run.smithi156.stdout: "finisher-MDSRank": { 2023-08-10T12:05:45.939 INFO:teuthology.orchestra.run.smithi156.stdout: "queue_len": 0, 2023-08-10T12:05:45.940 INFO:teuthology.orchestra.run.smithi156.stdout: "complete_latency": { 2023-08-10T12:05:45.940 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 5573, 2023-08-10T12:05:45.940 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.161387256, 2023-08-10T12:05:45.940 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000028958 2023-08-10T12:05:45.940 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:45.940 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.940 INFO:teuthology.orchestra.run.smithi156.stdout: "finisher-PurgeQueue": { 2023-08-10T12:05:45.941 INFO:teuthology.orchestra.run.smithi156.stdout: "queue_len": 0, 2023-08-10T12:05:45.941 INFO:teuthology.orchestra.run.smithi156.stdout: "complete_latency": { 2023-08-10T12:05:45.941 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.941 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.941 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.941 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:45.941 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.941 INFO:teuthology.orchestra.run.smithi156.stdout: "mds": { 2023-08-10T12:05:45.942 INFO:teuthology.orchestra.run.smithi156.stdout: "request": 0, 2023-08-10T12:05:45.942 INFO:teuthology.orchestra.run.smithi156.stdout: "reply": 0, 2023-08-10T12:05:45.942 INFO:teuthology.orchestra.run.smithi156.stdout: "reply_latency": { 2023-08-10T12:05:45.942 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.942 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.942 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.943 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.943 INFO:teuthology.orchestra.run.smithi156.stdout: "slow_reply": 0, 2023-08-10T12:05:45.943 INFO:teuthology.orchestra.run.smithi156.stdout: "forward": 0, 2023-08-10T12:05:45.943 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_fetch_complete": 0, 2023-08-10T12:05:45.943 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_fetch_keys": 0, 2023-08-10T12:05:45.943 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_commit": 0, 2023-08-10T12:05:45.943 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_split": 0, 2023-08-10T12:05:45.943 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_merge": 0, 2023-08-10T12:05:45.944 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes": 89938, 2023-08-10T12:05:45.944 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_top": 7927, 2023-08-10T12:05:45.944 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_bottom": 81997, 2023-08-10T12:05:45.944 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_pin_tail": 14, 2023-08-10T12:05:45.944 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_pinned": 78613, 2023-08-10T12:05:45.944 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_expired": 1765, 2023-08-10T12:05:45.944 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_with_caps": 0, 2023-08-10T12:05:45.945 INFO:teuthology.orchestra.run.smithi156.stdout: "caps": 0, 2023-08-10T12:05:45.945 INFO:teuthology.orchestra.run.smithi156.stdout: "subtrees": 3, 2023-08-10T12:05:45.945 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse": 0, 2023-08-10T12:05:45.945 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_hit": 0, 2023-08-10T12:05:45.945 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_forward": 0, 2023-08-10T12:05:45.945 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_discover": 0, 2023-08-10T12:05:45.946 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_dir_fetch": 0, 2023-08-10T12:05:45.946 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_remote_ino": 0, 2023-08-10T12:05:45.946 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_lock": 0, 2023-08-10T12:05:45.946 INFO:teuthology.orchestra.run.smithi156.stdout: "load_cent": 0, 2023-08-10T12:05:45.946 INFO:teuthology.orchestra.run.smithi156.stdout: "q": 0, 2023-08-10T12:05:45.946 INFO:teuthology.orchestra.run.smithi156.stdout: "exported": 0, 2023-08-10T12:05:45.946 INFO:teuthology.orchestra.run.smithi156.stdout: "exported_inodes": 0, 2023-08-10T12:05:45.946 INFO:teuthology.orchestra.run.smithi156.stdout: "imported": 0, 2023-08-10T12:05:45.947 INFO:teuthology.orchestra.run.smithi156.stdout: "imported_inodes": 0, 2023-08-10T12:05:45.947 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_dir_fetch": 0, 2023-08-10T12:05:45.947 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_backtrace_fetch": 0, 2023-08-10T12:05:45.947 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_peer_discover": 0, 2023-08-10T12:05:45.947 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rfiles": 0, 2023-08-10T12:05:45.947 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rbytes": 0, 2023-08-10T12:05:45.947 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rsnaps": 0, 2023-08-10T12:05:45.948 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_backtrace_fetch": 0, 2023-08-10T12:05:45.948 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_set_tag": 0, 2023-08-10T12:05:45.948 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_backtrace_repaired": 0, 2023-08-10T12:05:45.948 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_inotable_repaired": 0, 2023-08-10T12:05:45.948 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dir_inodes": 0, 2023-08-10T12:05:45.948 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dir_base_inodes": 0, 2023-08-10T12:05:45.948 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dirfrag_rstats": 0, 2023-08-10T12:05:45.948 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_file_inodes": 0, 2023-08-10T12:05:45.949 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_inode_file_caps": 0, 2023-08-10T12:05:45.949 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_revoke": 0, 2023-08-10T12:05:45.949 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_grant": 0, 2023-08-10T12:05:45.949 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_trunc": 0, 2023-08-10T12:05:45.949 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-10T12:05:45.949 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-10T12:05:45.949 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_caps": 0, 2023-08-10T12:05:45.950 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_caps_dirty": 0, 2023-08-10T12:05:45.950 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_cap_release": 0, 2023-08-10T12:05:45.950 INFO:teuthology.orchestra.run.smithi156.stdout: "process_request_cap_release": 0 2023-08-10T12:05:45.950 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.950 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_cache": { 2023-08-10T12:05:45.950 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_update": 0, 2023-08-10T12:05:45.950 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_update_receipt": 0, 2023-08-10T12:05:45.950 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_try_discover": 0, 2023-08-10T12:05:45.951 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_send_discover": 0, 2023-08-10T12:05:45.951 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_handle_discover": 0, 2023-08-10T12:05:45.951 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays": 0, 2023-08-10T12:05:45.951 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays_delayed": 0, 2023-08-10T12:05:45.951 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays_enqueuing": 0, 2023-08-10T12:05:45.951 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_created": 0, 2023-08-10T12:05:45.951 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_enqueued": 0, 2023-08-10T12:05:45.951 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_reintegrated": 0, 2023-08-10T12:05:45.952 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_migrated": 0, 2023-08-10T12:05:45.952 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_processing": 0, 2023-08-10T12:05:45.952 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_enqueued": 0, 2023-08-10T12:05:45.952 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_prioritized": 0, 2023-08-10T12:05:45.952 INFO:teuthology.orchestra.run.smithi156.stdout: "recovery_started": 0, 2023-08-10T12:05:45.952 INFO:teuthology.orchestra.run.smithi156.stdout: "recovery_completed": 0, 2023-08-10T12:05:45.952 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_enqueue_scrub": 0, 2023-08-10T12:05:45.953 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_exportdir": 0, 2023-08-10T12:05:45.953 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_flush": 0, 2023-08-10T12:05:45.953 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_fragmentdir": 0, 2023-08-10T12:05:45.953 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_fragstats": 0, 2023-08-10T12:05:45.953 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_inodestats": 0 2023-08-10T12:05:45.953 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.953 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_log": { 2023-08-10T12:05:45.953 INFO:teuthology.orchestra.run.smithi156.stdout: "evadd": 0, 2023-08-10T12:05:45.954 INFO:teuthology.orchestra.run.smithi156.stdout: "evex": 0, 2023-08-10T12:05:45.954 INFO:teuthology.orchestra.run.smithi156.stdout: "evtrm": 0, 2023-08-10T12:05:45.954 INFO:teuthology.orchestra.run.smithi156.stdout: "ev": 0, 2023-08-10T12:05:45.954 INFO:teuthology.orchestra.run.smithi156.stdout: "evexg": 0, 2023-08-10T12:05:45.954 INFO:teuthology.orchestra.run.smithi156.stdout: "evexd": 0, 2023-08-10T12:05:45.954 INFO:teuthology.orchestra.run.smithi156.stdout: "segadd": 0, 2023-08-10T12:05:45.954 INFO:teuthology.orchestra.run.smithi156.stdout: "segex": 0, 2023-08-10T12:05:45.955 INFO:teuthology.orchestra.run.smithi156.stdout: "segtrm": 0, 2023-08-10T12:05:45.955 INFO:teuthology.orchestra.run.smithi156.stdout: "seg": 128, 2023-08-10T12:05:45.955 INFO:teuthology.orchestra.run.smithi156.stdout: "segexg": 0, 2023-08-10T12:05:45.956 INFO:teuthology.orchestra.run.smithi156.stdout: "segexd": 0, 2023-08-10T12:05:45.956 INFO:teuthology.orchestra.run.smithi156.stdout: "expos": 208780375, 2023-08-10T12:05:45.956 INFO:teuthology.orchestra.run.smithi156.stdout: "wrpos": 0, 2023-08-10T12:05:45.956 INFO:teuthology.orchestra.run.smithi156.stdout: "rdpos": 616405863, 2023-08-10T12:05:45.957 INFO:teuthology.orchestra.run.smithi156.stdout: "jlat": { 2023-08-10T12:05:45.957 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.957 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.957 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.958 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.958 INFO:teuthology.orchestra.run.smithi156.stdout: "replayed": 155786 2023-08-10T12:05:45.958 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.959 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_mem": { 2023-08-10T12:05:45.959 INFO:teuthology.orchestra.run.smithi156.stdout: "ino": 28807, 2023-08-10T12:05:45.959 INFO:teuthology.orchestra.run.smithi156.stdout: "ino+": 85344, 2023-08-10T12:05:45.960 INFO:teuthology.orchestra.run.smithi156.stdout: "ino-": 56537, 2023-08-10T12:05:45.960 INFO:teuthology.orchestra.run.smithi156.stdout: "dir": 1087, 2023-08-10T12:05:45.960 INFO:teuthology.orchestra.run.smithi156.stdout: "dir+": 2573, 2023-08-10T12:05:45.960 INFO:teuthology.orchestra.run.smithi156.stdout: "dir-": 1486, 2023-08-10T12:05:45.961 INFO:teuthology.orchestra.run.smithi156.stdout: "dn": 89938, 2023-08-10T12:05:45.961 INFO:teuthology.orchestra.run.smithi156.stdout: "dn+": 151929, 2023-08-10T12:05:45.961 INFO:teuthology.orchestra.run.smithi156.stdout: "dn-": 61991, 2023-08-10T12:05:45.962 INFO:teuthology.orchestra.run.smithi156.stdout: "cap": 0, 2023-08-10T12:05:45.962 INFO:teuthology.orchestra.run.smithi156.stdout: "cap+": 0, 2023-08-10T12:05:45.962 INFO:teuthology.orchestra.run.smithi156.stdout: "cap-": 0, 2023-08-10T12:05:45.962 INFO:teuthology.orchestra.run.smithi156.stdout: "rss": 214060, 2023-08-10T12:05:45.963 INFO:teuthology.orchestra.run.smithi156.stdout: "heap": 207152 2023-08-10T12:05:45.963 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.963 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_server": { 2023-08-10T12:05:45.963 INFO:teuthology.orchestra.run.smithi156.stdout: "dispatch_client_request": 0, 2023-08-10T12:05:45.963 INFO:teuthology.orchestra.run.smithi156.stdout: "dispatch_server_request": 0, 2023-08-10T12:05:45.964 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_request": 0, 2023-08-10T12:05:45.964 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_session": 0, 2023-08-10T12:05:45.964 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_peer_request": 0, 2023-08-10T12:05:45.964 INFO:teuthology.orchestra.run.smithi156.stdout: "req_create_latency": { 2023-08-10T12:05:45.965 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.965 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.965 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.966 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.966 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getattr_latency": { 2023-08-10T12:05:45.966 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.966 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.966 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.966 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.966 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getfilelock_latency": { 2023-08-10T12:05:45.967 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.967 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.967 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.967 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.967 INFO:teuthology.orchestra.run.smithi156.stdout: "req_link_latency": { 2023-08-10T12:05:45.967 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.967 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.968 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.968 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.968 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookup_latency": { 2023-08-10T12:05:45.968 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.968 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.968 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.968 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.969 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookuphash_latency": { 2023-08-10T12:05:45.969 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.969 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.969 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.969 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.969 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupino_latency": { 2023-08-10T12:05:45.969 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.969 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.970 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.970 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.970 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupname_latency": { 2023-08-10T12:05:45.970 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.970 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.970 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.970 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.970 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupparent_latency": { 2023-08-10T12:05:45.971 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.971 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.971 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.971 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.971 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupsnap_latency": { 2023-08-10T12:05:45.971 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.971 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.972 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.972 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.972 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lssnap_latency": { 2023-08-10T12:05:45.972 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.972 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.972 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.972 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.973 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mkdir_latency": { 2023-08-10T12:05:45.973 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.973 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.973 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.973 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.973 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mknod_latency": { 2023-08-10T12:05:45.973 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.974 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.974 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.974 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.974 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mksnap_latency": { 2023-08-10T12:05:45.974 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.974 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.974 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.974 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.975 INFO:teuthology.orchestra.run.smithi156.stdout: "req_open_latency": { 2023-08-10T12:05:45.975 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.975 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.975 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.975 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.975 INFO:teuthology.orchestra.run.smithi156.stdout: "req_readdir_latency": { 2023-08-10T12:05:45.975 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.975 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.976 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.976 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.976 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rename_latency": { 2023-08-10T12:05:45.976 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.976 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.976 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.976 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.977 INFO:teuthology.orchestra.run.smithi156.stdout: "req_renamesnap_latency": { 2023-08-10T12:05:45.977 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.977 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.977 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.977 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.977 INFO:teuthology.orchestra.run.smithi156.stdout: "req_snapdiff_latency": { 2023-08-10T12:05:45.978 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.978 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.978 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.978 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.978 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmdir_latency": { 2023-08-10T12:05:45.978 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.979 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.979 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.979 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.979 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmsnap_latency": { 2023-08-10T12:05:45.979 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.979 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.979 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.980 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.980 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmxattr_latency": { 2023-08-10T12:05:45.980 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.980 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.980 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.980 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.980 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setattr_latency": { 2023-08-10T12:05:45.981 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.981 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.981 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.981 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.981 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setdirlayout_latency": { 2023-08-10T12:05:45.981 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.981 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.982 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.982 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.982 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setfilelock_latency": { 2023-08-10T12:05:45.982 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.982 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.982 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.982 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.982 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setlayout_latency": { 2023-08-10T12:05:45.983 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.983 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.983 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.983 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.983 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setxattr_latency": { 2023-08-10T12:05:45.983 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.983 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.983 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.984 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.984 INFO:teuthology.orchestra.run.smithi156.stdout: "req_symlink_latency": { 2023-08-10T12:05:45.984 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.984 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.984 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.984 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.985 INFO:teuthology.orchestra.run.smithi156.stdout: "req_unlink_latency": { 2023-08-10T12:05:45.985 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.985 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.985 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.985 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.985 INFO:teuthology.orchestra.run.smithi156.stdout: "cap_revoke_eviction": 0, 2023-08-10T12:05:45.985 INFO:teuthology.orchestra.run.smithi156.stdout: "cap_acquisition_throttle": 0, 2023-08-10T12:05:45.985 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getvxattr_latency": { 2023-08-10T12:05:45.986 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:45.986 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:45.986 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:45.986 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:45.986 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.986 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_sessions": { 2023-08-10T12:05:45.986 INFO:teuthology.orchestra.run.smithi156.stdout: "session_count": 1, 2023-08-10T12:05:45.986 INFO:teuthology.orchestra.run.smithi156.stdout: "session_add": 2, 2023-08-10T12:05:45.987 INFO:teuthology.orchestra.run.smithi156.stdout: "session_remove": 1, 2023-08-10T12:05:45.987 INFO:teuthology.orchestra.run.smithi156.stdout: "sessions_open": 2, 2023-08-10T12:05:45.987 INFO:teuthology.orchestra.run.smithi156.stdout: "sessions_stale": 0, 2023-08-10T12:05:45.987 INFO:teuthology.orchestra.run.smithi156.stdout: "total_load": 0, 2023-08-10T12:05:45.987 INFO:teuthology.orchestra.run.smithi156.stdout: "average_load": 0, 2023-08-10T12:05:45.987 INFO:teuthology.orchestra.run.smithi156.stdout: "avg_session_uptime": 5285 2023-08-10T12:05:45.987 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.987 INFO:teuthology.orchestra.run.smithi156.stdout: "mempool": { 2023-08-10T12:05:45.988 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_bytes": 0, 2023-08-10T12:05:45.988 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_items": 0, 2023-08-10T12:05:45.988 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_bytes": 0, 2023-08-10T12:05:45.988 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_items": 0, 2023-08-10T12:05:45.988 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_bytes": 0, 2023-08-10T12:05:45.988 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_items": 0, 2023-08-10T12:05:45.988 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-10T12:05:45.989 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_items": 0, 2023-08-10T12:05:45.989 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-10T12:05:45.989 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_items": 0, 2023-08-10T12:05:45.989 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_bytes": 0, 2023-08-10T12:05:45.989 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_items": 0, 2023-08-10T12:05:45.989 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-10T12:05:45.989 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_items": 0, 2023-08-10T12:05:45.989 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_bytes": 0, 2023-08-10T12:05:45.990 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_items": 0, 2023-08-10T12:05:45.990 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_bytes": 0, 2023-08-10T12:05:45.990 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_items": 0, 2023-08-10T12:05:45.990 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-10T12:05:45.991 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_items": 0, 2023-08-10T12:05:45.991 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-10T12:05:45.991 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_items": 0, 2023-08-10T12:05:45.991 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_bytes": 0, 2023-08-10T12:05:45.991 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_items": 0, 2023-08-10T12:05:45.991 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_bytes": 0, 2023-08-10T12:05:45.991 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_items": 0, 2023-08-10T12:05:45.991 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-10T12:05:45.992 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_items": 0, 2023-08-10T12:05:45.992 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_bytes": 0, 2023-08-10T12:05:45.992 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_items": 0, 2023-08-10T12:05:45.992 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_bytes": 0, 2023-08-10T12:05:45.992 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_items": 0, 2023-08-10T12:05:45.992 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_bytes": 0, 2023-08-10T12:05:45.992 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_items": 0, 2023-08-10T12:05:45.993 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_bytes": 0, 2023-08-10T12:05:45.993 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_items": 0, 2023-08-10T12:05:45.993 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_bytes": 1234461, 2023-08-10T12:05:45.993 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_items": 29599, 2023-08-10T12:05:45.993 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_bytes": 0, 2023-08-10T12:05:45.993 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_items": 0, 2023-08-10T12:05:45.993 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_bytes": 0, 2023-08-10T12:05:45.994 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_items": 0, 2023-08-10T12:05:45.994 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_bytes": 0, 2023-08-10T12:05:45.994 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_items": 0, 2023-08-10T12:05:45.994 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_bytes": 0, 2023-08-10T12:05:45.994 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_items": 0, 2023-08-10T12:05:45.994 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_bytes": 8032, 2023-08-10T12:05:45.994 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_items": 167, 2023-08-10T12:05:45.994 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_bytes": 0, 2023-08-10T12:05:45.995 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_items": 0, 2023-08-10T12:05:45.995 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_bytes": 0, 2023-08-10T12:05:45.995 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_items": 0, 2023-08-10T12:05:45.995 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_bytes": 129456965, 2023-08-10T12:05:45.995 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_items": 1248794, 2023-08-10T12:05:45.995 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_bytes": 0, 2023-08-10T12:05:45.995 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_items": 0, 2023-08-10T12:05:45.996 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_bytes": 0, 2023-08-10T12:05:45.996 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_items": 0 2023-08-10T12:05:45.996 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.996 INFO:teuthology.orchestra.run.smithi156.stdout: "objecter": { 2023-08-10T12:05:45.996 INFO:teuthology.orchestra.run.smithi156.stdout: "op_active": 0, 2023-08-10T12:05:45.996 INFO:teuthology.orchestra.run.smithi156.stdout: "op_laggy": 0, 2023-08-10T12:05:45.996 INFO:teuthology.orchestra.run.smithi156.stdout: "op_send": 3439, 2023-08-10T12:05:45.996 INFO:teuthology.orchestra.run.smithi156.stdout: "op_send_bytes": 21, 2023-08-10T12:05:45.997 INFO:teuthology.orchestra.run.smithi156.stdout: "op_resend": 3, 2023-08-10T12:05:45.997 INFO:teuthology.orchestra.run.smithi156.stdout: "op_reply": 3439, 2023-08-10T12:05:45.997 INFO:teuthology.orchestra.run.smithi156.stdout: "op_latency": { 2023-08-10T12:05:45.997 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 3439, 2023-08-10T12:05:45.997 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 14.830780993, 2023-08-10T12:05:45.997 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.004312527 2023-08-10T12:05:45.997 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.997 INFO:teuthology.orchestra.run.smithi156.stdout: "op_inflight": 0, 2023-08-10T12:05:45.998 INFO:teuthology.orchestra.run.smithi156.stdout: "oplen_avg": { 2023-08-10T12:05:45.998 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 3439, 2023-08-10T12:05:45.998 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 3440 2023-08-10T12:05:45.998 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:45.998 INFO:teuthology.orchestra.run.smithi156.stdout: "op": 3439, 2023-08-10T12:05:45.998 INFO:teuthology.orchestra.run.smithi156.stdout: "op_r": 3439, 2023-08-10T12:05:45.998 INFO:teuthology.orchestra.run.smithi156.stdout: "op_w": 0, 2023-08-10T12:05:45.998 INFO:teuthology.orchestra.run.smithi156.stdout: "op_rmw": 0, 2023-08-10T12:05:45.999 INFO:teuthology.orchestra.run.smithi156.stdout: "op_pg": 0, 2023-08-10T12:05:45.999 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_stat": 1967, 2023-08-10T12:05:45.999 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_create": 0, 2023-08-10T12:05:45.999 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_read": 1470, 2023-08-10T12:05:45.999 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_write": 0, 2023-08-10T12:05:45.999 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_writefull": 0, 2023-08-10T12:05:45.999 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_writesame": 0, 2023-08-10T12:05:45.999 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_append": 0, 2023-08-10T12:05:46.000 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_zero": 0, 2023-08-10T12:05:46.000 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_truncate": 0, 2023-08-10T12:05:46.000 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_delete": 0, 2023-08-10T12:05:46.000 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_mapext": 0, 2023-08-10T12:05:46.000 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_sparse_read": 0, 2023-08-10T12:05:46.000 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_clonerange": 0, 2023-08-10T12:05:46.000 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_getxattr": 1, 2023-08-10T12:05:46.001 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_setxattr": 0, 2023-08-10T12:05:46.001 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_cmpxattr": 0, 2023-08-10T12:05:46.001 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_rmxattr": 0, 2023-08-10T12:05:46.001 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_resetxattrs": 0, 2023-08-10T12:05:46.001 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_call": 0, 2023-08-10T12:05:46.001 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_watch": 0, 2023-08-10T12:05:46.001 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_notify": 0, 2023-08-10T12:05:46.001 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_src_cmpxattr": 0, 2023-08-10T12:05:46.002 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_pgls": 0, 2023-08-10T12:05:46.002 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_pgls_filter": 0, 2023-08-10T12:05:46.002 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_other": 0, 2023-08-10T12:05:46.002 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_active": 0, 2023-08-10T12:05:46.002 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_send": 0, 2023-08-10T12:05:46.002 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_resend": 0, 2023-08-10T12:05:46.002 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_ping": 0, 2023-08-10T12:05:46.002 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_active": 0, 2023-08-10T12:05:46.003 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_send": 0, 2023-08-10T12:05:46.003 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_resend": 0, 2023-08-10T12:05:46.003 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_active": 0, 2023-08-10T12:05:46.003 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_send": 0, 2023-08-10T12:05:46.003 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_resend": 0, 2023-08-10T12:05:46.003 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_active": 0, 2023-08-10T12:05:46.003 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_send": 0, 2023-08-10T12:05:46.004 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_resend": 0, 2023-08-10T12:05:46.004 INFO:teuthology.orchestra.run.smithi156.stdout: "command_active": 0, 2023-08-10T12:05:46.004 INFO:teuthology.orchestra.run.smithi156.stdout: "command_send": 0, 2023-08-10T12:05:46.004 INFO:teuthology.orchestra.run.smithi156.stdout: "command_resend": 0, 2023-08-10T12:05:46.004 INFO:teuthology.orchestra.run.smithi156.stdout: "map_epoch": 98, 2023-08-10T12:05:46.004 INFO:teuthology.orchestra.run.smithi156.stdout: "map_full": 0, 2023-08-10T12:05:46.004 INFO:teuthology.orchestra.run.smithi156.stdout: "map_inc": 15, 2023-08-10T12:05:46.004 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_sessions": 10, 2023-08-10T12:05:46.005 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_session_open": 10, 2023-08-10T12:05:46.005 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_session_close": 0, 2023-08-10T12:05:46.005 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_laggy": 0, 2023-08-10T12:05:46.005 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_wr": 0, 2023-08-10T12:05:46.005 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_rd": 2, 2023-08-10T12:05:46.005 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_del": 0 2023-08-10T12:05:46.005 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:46.005 INFO:teuthology.orchestra.run.smithi156.stdout: "oft": { 2023-08-10T12:05:46.006 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_objs": 0, 2023-08-10T12:05:46.006 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_kv_pairs": 0, 2023-08-10T12:05:46.006 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_updates": 0, 2023-08-10T12:05:46.006 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_removes": 0 2023-08-10T12:05:46.006 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:46.006 INFO:teuthology.orchestra.run.smithi156.stdout: "osd-slow-ops": { 2023-08-10T12:05:46.006 INFO:teuthology.orchestra.run.smithi156.stdout: "slow_ops_count": 0 2023-08-10T12:05:46.007 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:46.007 INFO:teuthology.orchestra.run.smithi156.stdout: "purge_queue": { 2023-08-10T12:05:46.007 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_ops": 0, 2023-08-10T12:05:46.007 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_ops_high_water": 0, 2023-08-10T12:05:46.007 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing": 0, 2023-08-10T12:05:46.007 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_high_water": 0, 2023-08-10T12:05:46.007 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executed": 0, 2023-08-10T12:05:46.007 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_item_in_journal": 0 2023-08-10T12:05:46.008 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:46.008 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-10T12:05:46.008 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-08-10T12:05:46.008 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 104857600, 2023-08-10T12:05:46.008 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-08-10T12:05:46.008 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 3752, 2023-08-10T12:05:46.008 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 614961892, 2023-08-10T12:05:46.009 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:46.009 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 3752, 2023-08-10T12:05:46.009 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-08-10T12:05:46.009 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-08-10T12:05:46.009 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 3752, 2023-08-10T12:05:46.009 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 614961892, 2023-08-10T12:05:46.009 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-08-10T12:05:46.009 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:46.010 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:46.010 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:46.010 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:46.010 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:46.010 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-objecter_bytes": { 2023-08-10T12:05:46.010 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-08-10T12:05:46.010 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 104857600, 2023-08-10T12:05:46.010 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-08-10T12:05:46.011 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-08-10T12:05:46.011 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-08-10T12:05:46.011 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:46.011 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:46.011 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 3439, 2023-08-10T12:05:46.011 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 612693799, 2023-08-10T12:05:46.011 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 3439, 2023-08-10T12:05:46.012 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 612693799, 2023-08-10T12:05:46.012 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-08-10T12:05:46.012 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:46.012 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:46.012 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:46.012 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:46.012 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:46.012 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-objecter_ops": { 2023-08-10T12:05:46.013 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-08-10T12:05:46.013 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 1024, 2023-08-10T12:05:46.013 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-08-10T12:05:46.013 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-08-10T12:05:46.013 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-08-10T12:05:46.013 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:46.013 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:46.014 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 3439, 2023-08-10T12:05:46.014 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 3439, 2023-08-10T12:05:46.014 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 3439, 2023-08-10T12:05:46.014 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 3439, 2023-08-10T12:05:46.014 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-08-10T12:05:46.014 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:46.014 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:46.014 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:46.015 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:46.015 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:46.015 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-write_buf_throttle": { 2023-08-10T12:05:46.015 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-08-10T12:05:46.015 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 3758096384, 2023-08-10T12:05:46.015 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-08-10T12:05:46.015 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-08-10T12:05:46.015 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-08-10T12:05:46.016 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:46.016 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:46.016 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-08-10T12:05:46.016 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-08-10T12:05:46.016 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 0, 2023-08-10T12:05:46.016 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 0, 2023-08-10T12:05:46.016 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-08-10T12:05:46.016 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:46.017 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:46.017 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:46.017 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:46.017 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:46.017 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-write_buf_throttle-0x55570dc30460": { 2023-08-10T12:05:46.017 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-08-10T12:05:46.017 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 3758096384, 2023-08-10T12:05:46.017 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-08-10T12:05:46.018 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-08-10T12:05:46.018 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-08-10T12:05:46.018 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:46.018 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:46.018 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-08-10T12:05:46.018 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-08-10T12:05:46.018 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 0, 2023-08-10T12:05:46.019 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 0, 2023-08-10T12:05:46.019 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-08-10T12:05:46.019 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:46.019 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:46.019 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:46.019 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:46.019 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:46.019 INFO:teuthology.orchestra.run.smithi156.stdout:} 2023-08-10T12:05:46.343 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2023-08-10T12:05:46.344 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2023-08-10T12:05:46.344 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2023-08-10T12:05:46.344 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2023-08-10T12:05:46.344 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=0 2023-08-10T12:05:46.345 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2023-08-10T12:05:46.345 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2023-08-10T12:05:46.345 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2023-08-10T12:05:46.345 DEBUG:tasks.check_counter:Getting stats from f 2023-08-10T12:05:46.346 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph daemon mds.f perf dump 2023-08-10T12:05:46.899 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T12:05:47.467 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:47 smithi156 ceph-mon[130574]: pgmap v409: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2023-08-10T12:05:47.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:47 smithi152 ceph-mon[130220]: pgmap v409: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2023-08-10T12:05:47.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:47 smithi073 ceph-mon[128869]: pgmap v409: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2023-08-10T12:05:48.361 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2023-08-10T12:05:48.362 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-0": { 2023-08-10T12:05:48.362 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 20084, 2023-08-10T12:05:48.363 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 21183, 2023-08-10T12:05:48.363 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 12468854, 2023-08-10T12:05:48.363 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 95831758, 2023-08-10T12:05:48.363 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 15, 2023-08-10T12:05:48.364 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 3, 2023-08-10T12:05:48.364 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 1.193569092, 2023-08-10T12:05:48.364 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.517345424, 2023-08-10T12:05:48.365 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.657891008, 2023-08-10T12:05:48.365 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.128107407, 2023-08-10T12:05:48.365 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:48.366 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 21183, 2023-08-10T12:05:48.366 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 1.682977955, 2023-08-10T12:05:48.366 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000079449 2023-08-10T12:05:48.366 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.367 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:48.367 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 32516, 2023-08-10T12:05:48.367 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.005012523, 2023-08-10T12:05:48.368 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000154 2023-08-10T12:05:48.368 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.368 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 160, 2023-08-10T12:05:48.369 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 362512 2023-08-10T12:05:48.369 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.369 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-1": { 2023-08-10T12:05:48.369 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 1204252, 2023-08-10T12:05:48.370 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 1247740, 2023-08-10T12:05:48.370 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 236961773, 2023-08-10T12:05:48.370 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 339829644, 2023-08-10T12:05:48.371 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 12, 2023-08-10T12:05:48.371 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 7, 2023-08-10T12:05:48.371 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 34.570452379, 2023-08-10T12:05:48.371 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 13.604532002, 2023-08-10T12:05:48.372 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 142.480469724, 2023-08-10T12:05:48.372 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.151683468, 2023-08-10T12:05:48.372 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:48.373 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 1247739, 2023-08-10T12:05:48.373 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 27.275139115, 2023-08-10T12:05:48.373 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000021859 2023-08-10T12:05:48.373 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.374 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:48.374 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 2343008, 2023-08-10T12:05:48.374 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.248295172, 2023-08-10T12:05:48.375 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000105 2023-08-10T12:05:48.375 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.375 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 52212288, 2023-08-10T12:05:48.375 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 100525584 2023-08-10T12:05:48.376 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.376 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-2": { 2023-08-10T12:05:48.376 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 25980, 2023-08-10T12:05:48.377 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 33477, 2023-08-10T12:05:48.377 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 13041816, 2023-08-10T12:05:48.377 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 30536345, 2023-08-10T12:05:48.377 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 17, 2023-08-10T12:05:48.378 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 6, 2023-08-10T12:05:48.378 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 1.336232680, 2023-08-10T12:05:48.378 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.533940158, 2023-08-10T12:05:48.379 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.816686653, 2023-08-10T12:05:48.379 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.093478500, 2023-08-10T12:05:48.379 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:48.379 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 33473, 2023-08-10T12:05:48.380 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 2.179382402, 2023-08-10T12:05:48.380 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000065108 2023-08-10T12:05:48.380 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.381 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:48.381 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 49692, 2023-08-10T12:05:48.381 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.007255622, 2023-08-10T12:05:48.381 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000146 2023-08-10T12:05:48.382 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.382 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 5264, 2023-08-10T12:05:48.382 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 121008 2023-08-10T12:05:48.383 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.383 INFO:teuthology.orchestra.run.smithi156.stdout: "cct": { 2023-08-10T12:05:48.383 INFO:teuthology.orchestra.run.smithi156.stdout: "total_workers": 1, 2023-08-10T12:05:48.383 INFO:teuthology.orchestra.run.smithi156.stdout: "unhealthy_workers": 0 2023-08-10T12:05:48.384 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.384 INFO:teuthology.orchestra.run.smithi156.stdout: "finisher-MDSRank": { 2023-08-10T12:05:48.384 INFO:teuthology.orchestra.run.smithi156.stdout: "queue_len": 0, 2023-08-10T12:05:48.385 INFO:teuthology.orchestra.run.smithi156.stdout: "complete_latency": { 2023-08-10T12:05:48.385 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 6582, 2023-08-10T12:05:48.385 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 30.085233397, 2023-08-10T12:05:48.386 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.004570834 2023-08-10T12:05:48.386 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:48.386 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.386 INFO:teuthology.orchestra.run.smithi156.stdout: "finisher-PurgeQueue": { 2023-08-10T12:05:48.387 INFO:teuthology.orchestra.run.smithi156.stdout: "queue_len": 0, 2023-08-10T12:05:48.387 INFO:teuthology.orchestra.run.smithi156.stdout: "complete_latency": { 2023-08-10T12:05:48.387 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 12644, 2023-08-10T12:05:48.388 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 1.644279300, 2023-08-10T12:05:48.388 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000130044 2023-08-10T12:05:48.388 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:48.388 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.389 INFO:teuthology.orchestra.run.smithi156.stdout: "mds": { 2023-08-10T12:05:48.389 INFO:teuthology.orchestra.run.smithi156.stdout: "request": 72197, 2023-08-10T12:05:48.389 INFO:teuthology.orchestra.run.smithi156.stdout: "reply": 66546, 2023-08-10T12:05:48.390 INFO:teuthology.orchestra.run.smithi156.stdout: "reply_latency": { 2023-08-10T12:05:48.390 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 66546, 2023-08-10T12:05:48.390 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 1890.348302507, 2023-08-10T12:05:48.390 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.028406640 2023-08-10T12:05:48.391 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.391 INFO:teuthology.orchestra.run.smithi156.stdout: "slow_reply": 0, 2023-08-10T12:05:48.391 INFO:teuthology.orchestra.run.smithi156.stdout: "forward": 5651, 2023-08-10T12:05:48.392 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_fetch_complete": 74, 2023-08-10T12:05:48.392 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_fetch_keys": 0, 2023-08-10T12:05:48.392 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_commit": 441, 2023-08-10T12:05:48.392 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_split": 48, 2023-08-10T12:05:48.392 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_merge": 0, 2023-08-10T12:05:48.392 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes": 21, 2023-08-10T12:05:48.392 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_top": 5, 2023-08-10T12:05:48.393 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_bottom": 6, 2023-08-10T12:05:48.393 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_pin_tail": 10, 2023-08-10T12:05:48.393 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_pinned": 13, 2023-08-10T12:05:48.393 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_expired": 39991, 2023-08-10T12:05:48.393 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_with_caps": 0, 2023-08-10T12:05:48.393 INFO:teuthology.orchestra.run.smithi156.stdout: "caps": 0, 2023-08-10T12:05:48.393 INFO:teuthology.orchestra.run.smithi156.stdout: "subtrees": 4, 2023-08-10T12:05:48.394 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse": 133463, 2023-08-10T12:05:48.394 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_hit": 96280, 2023-08-10T12:05:48.394 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_forward": 5377, 2023-08-10T12:05:48.394 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_discover": 982, 2023-08-10T12:05:48.394 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_dir_fetch": 8, 2023-08-10T12:05:48.394 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_remote_ino": 0, 2023-08-10T12:05:48.394 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_lock": 1119, 2023-08-10T12:05:48.394 INFO:teuthology.orchestra.run.smithi156.stdout: "load_cent": 0, 2023-08-10T12:05:48.395 INFO:teuthology.orchestra.run.smithi156.stdout: "q": 0, 2023-08-10T12:05:48.395 INFO:teuthology.orchestra.run.smithi156.stdout: "exported": 303, 2023-08-10T12:05:48.395 INFO:teuthology.orchestra.run.smithi156.stdout: "exported_inodes": 33125, 2023-08-10T12:05:48.395 INFO:teuthology.orchestra.run.smithi156.stdout: "imported": 241, 2023-08-10T12:05:48.395 INFO:teuthology.orchestra.run.smithi156.stdout: "imported_inodes": 17322, 2023-08-10T12:05:48.395 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_dir_fetch": 0, 2023-08-10T12:05:48.395 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_backtrace_fetch": 28, 2023-08-10T12:05:48.395 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_peer_discover": 0, 2023-08-10T12:05:48.396 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rfiles": 1767, 2023-08-10T12:05:48.396 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rbytes": 37429583, 2023-08-10T12:05:48.396 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rsnaps": 2, 2023-08-10T12:05:48.396 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_backtrace_fetch": 28, 2023-08-10T12:05:48.396 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_set_tag": 0, 2023-08-10T12:05:48.396 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_backtrace_repaired": 0, 2023-08-10T12:05:48.396 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_inotable_repaired": 0, 2023-08-10T12:05:48.397 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dir_inodes": 0, 2023-08-10T12:05:48.397 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dir_base_inodes": 0, 2023-08-10T12:05:48.397 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dirfrag_rstats": 0, 2023-08-10T12:05:48.397 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_file_inodes": 28, 2023-08-10T12:05:48.397 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_inode_file_caps": 387, 2023-08-10T12:05:48.397 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_revoke": 10262, 2023-08-10T12:05:48.397 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_grant": 18270, 2023-08-10T12:05:48.398 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_trunc": 0, 2023-08-10T12:05:48.398 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_flushsnap_ack": 125, 2023-08-10T12:05:48.398 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-10T12:05:48.398 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_caps": 25767, 2023-08-10T12:05:48.398 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_caps_dirty": 10223, 2023-08-10T12:05:48.398 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_cap_release": 425, 2023-08-10T12:05:48.398 INFO:teuthology.orchestra.run.smithi156.stdout: "process_request_cap_release": 23639 2023-08-10T12:05:48.399 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.399 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_cache": { 2023-08-10T12:05:48.399 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_update": 1880, 2023-08-10T12:05:48.399 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_update_receipt": 9126, 2023-08-10T12:05:48.399 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_try_discover": 5476, 2023-08-10T12:05:48.399 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_send_discover": 6640, 2023-08-10T12:05:48.399 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_handle_discover": 3125, 2023-08-10T12:05:48.399 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays": 0, 2023-08-10T12:05:48.400 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays_delayed": 0, 2023-08-10T12:05:48.400 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays_enqueuing": 0, 2023-08-10T12:05:48.400 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_created": 6456, 2023-08-10T12:05:48.400 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_enqueued": 6456, 2023-08-10T12:05:48.400 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_reintegrated": 0, 2023-08-10T12:05:48.400 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_migrated": 0, 2023-08-10T12:05:48.400 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_processing": 0, 2023-08-10T12:05:48.401 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_enqueued": 0, 2023-08-10T12:05:48.401 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_prioritized": 0, 2023-08-10T12:05:48.401 INFO:teuthology.orchestra.run.smithi156.stdout: "recovery_started": 0, 2023-08-10T12:05:48.401 INFO:teuthology.orchestra.run.smithi156.stdout: "recovery_completed": 0, 2023-08-10T12:05:48.401 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_enqueue_scrub": 0, 2023-08-10T12:05:48.401 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_exportdir": 303, 2023-08-10T12:05:48.401 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_flush": 0, 2023-08-10T12:05:48.401 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_fragmentdir": 48, 2023-08-10T12:05:48.402 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_fragstats": 0, 2023-08-10T12:05:48.402 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_inodestats": 0 2023-08-10T12:05:48.402 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.402 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_log": { 2023-08-10T12:05:48.402 INFO:teuthology.orchestra.run.smithi156.stdout: "evadd": 56046, 2023-08-10T12:05:48.402 INFO:teuthology.orchestra.run.smithi156.stdout: "evex": 0, 2023-08-10T12:05:48.402 INFO:teuthology.orchestra.run.smithi156.stdout: "evtrm": 0, 2023-08-10T12:05:48.403 INFO:teuthology.orchestra.run.smithi156.stdout: "ev": 56046, 2023-08-10T12:05:48.403 INFO:teuthology.orchestra.run.smithi156.stdout: "evexg": 0, 2023-08-10T12:05:48.403 INFO:teuthology.orchestra.run.smithi156.stdout: "evexd": 0, 2023-08-10T12:05:48.403 INFO:teuthology.orchestra.run.smithi156.stdout: "segadd": 81, 2023-08-10T12:05:48.403 INFO:teuthology.orchestra.run.smithi156.stdout: "segex": 0, 2023-08-10T12:05:48.403 INFO:teuthology.orchestra.run.smithi156.stdout: "segtrm": 0, 2023-08-10T12:05:48.403 INFO:teuthology.orchestra.run.smithi156.stdout: "seg": 81, 2023-08-10T12:05:48.403 INFO:teuthology.orchestra.run.smithi156.stdout: "segexg": 0, 2023-08-10T12:05:48.404 INFO:teuthology.orchestra.run.smithi156.stdout: "segexd": 0, 2023-08-10T12:05:48.404 INFO:teuthology.orchestra.run.smithi156.stdout: "expos": 4194304, 2023-08-10T12:05:48.404 INFO:teuthology.orchestra.run.smithi156.stdout: "wrpos": 171215291, 2023-08-10T12:05:48.404 INFO:teuthology.orchestra.run.smithi156.stdout: "rdpos": 0, 2023-08-10T12:05:48.404 INFO:teuthology.orchestra.run.smithi156.stdout: "jlat": { 2023-08-10T12:05:48.404 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 2919, 2023-08-10T12:05:48.405 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 81.646831773, 2023-08-10T12:05:48.405 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.027970822 2023-08-10T12:05:48.405 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.405 INFO:teuthology.orchestra.run.smithi156.stdout: "replayed": 0 2023-08-10T12:05:48.405 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.405 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_mem": { 2023-08-10T12:05:48.405 INFO:teuthology.orchestra.run.smithi156.stdout: "ino": 28, 2023-08-10T12:05:48.405 INFO:teuthology.orchestra.run.smithi156.stdout: "ino+": 27927, 2023-08-10T12:05:48.406 INFO:teuthology.orchestra.run.smithi156.stdout: "ino-": 27899, 2023-08-10T12:05:48.406 INFO:teuthology.orchestra.run.smithi156.stdout: "dir": 24, 2023-08-10T12:05:48.406 INFO:teuthology.orchestra.run.smithi156.stdout: "dir+": 4354, 2023-08-10T12:05:48.406 INFO:teuthology.orchestra.run.smithi156.stdout: "dir-": 4330, 2023-08-10T12:05:48.406 INFO:teuthology.orchestra.run.smithi156.stdout: "dn": 21, 2023-08-10T12:05:48.406 INFO:teuthology.orchestra.run.smithi156.stdout: "dn+": 47369, 2023-08-10T12:05:48.406 INFO:teuthology.orchestra.run.smithi156.stdout: "dn-": 47348, 2023-08-10T12:05:48.406 INFO:teuthology.orchestra.run.smithi156.stdout: "cap": 0, 2023-08-10T12:05:48.407 INFO:teuthology.orchestra.run.smithi156.stdout: "cap+": 19211, 2023-08-10T12:05:48.407 INFO:teuthology.orchestra.run.smithi156.stdout: "cap-": 19211, 2023-08-10T12:05:48.407 INFO:teuthology.orchestra.run.smithi156.stdout: "rss": 125964, 2023-08-10T12:05:48.407 INFO:teuthology.orchestra.run.smithi156.stdout: "heap": 198960 2023-08-10T12:05:48.407 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.407 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_server": { 2023-08-10T12:05:48.407 INFO:teuthology.orchestra.run.smithi156.stdout: "dispatch_client_request": 85269, 2023-08-10T12:05:48.407 INFO:teuthology.orchestra.run.smithi156.stdout: "dispatch_server_request": 3449, 2023-08-10T12:05:48.408 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_request": 72197, 2023-08-10T12:05:48.408 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_session": 267, 2023-08-10T12:05:48.408 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_peer_request": 7003, 2023-08-10T12:05:48.408 INFO:teuthology.orchestra.run.smithi156.stdout: "req_create_latency": { 2023-08-10T12:05:48.408 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 8290, 2023-08-10T12:05:48.408 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 25.640748628, 2023-08-10T12:05:48.408 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.003092973 2023-08-10T12:05:48.409 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.409 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getattr_latency": { 2023-08-10T12:05:48.409 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 2087, 2023-08-10T12:05:48.409 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 27.112602259, 2023-08-10T12:05:48.409 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.012991184 2023-08-10T12:05:48.409 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.409 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getfilelock_latency": { 2023-08-10T12:05:48.409 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:48.410 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:48.410 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:48.410 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.410 INFO:teuthology.orchestra.run.smithi156.stdout: "req_link_latency": { 2023-08-10T12:05:48.410 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:48.410 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:48.410 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:48.411 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.411 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookup_latency": { 2023-08-10T12:05:48.411 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 40085, 2023-08-10T12:05:48.411 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 1499.065852706, 2023-08-10T12:05:48.411 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.037397177 2023-08-10T12:05:48.411 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.412 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookuphash_latency": { 2023-08-10T12:05:48.412 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:48.412 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:48.412 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:48.412 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.412 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupino_latency": { 2023-08-10T12:05:48.413 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:48.413 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:48.413 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:48.413 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.413 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupname_latency": { 2023-08-10T12:05:48.413 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:48.413 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:48.414 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:48.414 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.414 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupparent_latency": { 2023-08-10T12:05:48.414 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:48.414 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:48.414 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:48.415 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.415 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupsnap_latency": { 2023-08-10T12:05:48.415 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:48.415 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:48.415 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:48.415 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.415 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lssnap_latency": { 2023-08-10T12:05:48.415 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:48.416 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:48.416 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:48.416 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.416 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mkdir_latency": { 2023-08-10T12:05:48.416 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 35, 2023-08-10T12:05:48.416 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 1.588248288, 2023-08-10T12:05:48.416 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.045378522 2023-08-10T12:05:48.417 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.417 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mknod_latency": { 2023-08-10T12:05:48.417 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:48.417 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:48.417 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:48.417 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.417 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mksnap_latency": { 2023-08-10T12:05:48.417 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:48.418 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:48.418 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:48.418 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.418 INFO:teuthology.orchestra.run.smithi156.stdout: "req_open_latency": { 2023-08-10T12:05:48.418 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 3436, 2023-08-10T12:05:48.418 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 9.075642007, 2023-08-10T12:05:48.418 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.002641339 2023-08-10T12:05:48.419 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.419 INFO:teuthology.orchestra.run.smithi156.stdout: "req_readdir_latency": { 2023-08-10T12:05:48.419 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 168, 2023-08-10T12:05:48.419 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.434580231, 2023-08-10T12:05:48.419 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.002586787 2023-08-10T12:05:48.419 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.419 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rename_latency": { 2023-08-10T12:05:48.419 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 8306, 2023-08-10T12:05:48.420 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 321.397111330, 2023-08-10T12:05:48.420 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.038694571 2023-08-10T12:05:48.420 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.420 INFO:teuthology.orchestra.run.smithi156.stdout: "req_renamesnap_latency": { 2023-08-10T12:05:48.420 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:48.420 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:48.421 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:48.421 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.421 INFO:teuthology.orchestra.run.smithi156.stdout: "req_snapdiff_latency": { 2023-08-10T12:05:48.421 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:48.421 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:48.421 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:48.422 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.422 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmdir_latency": { 2023-08-10T12:05:48.422 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:48.422 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:48.422 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:48.422 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.422 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmsnap_latency": { 2023-08-10T12:05:48.422 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:48.423 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:48.423 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:48.423 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.423 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmxattr_latency": { 2023-08-10T12:05:48.423 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:48.423 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:48.423 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:48.424 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.424 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setattr_latency": { 2023-08-10T12:05:48.424 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:48.424 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:48.424 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:48.424 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.424 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setdirlayout_latency": { 2023-08-10T12:05:48.424 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:48.425 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:48.425 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:48.425 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.425 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setfilelock_latency": { 2023-08-10T12:05:48.425 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:48.425 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:48.425 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:48.425 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.426 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setlayout_latency": { 2023-08-10T12:05:48.426 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:48.426 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:48.426 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:48.426 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.426 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setxattr_latency": { 2023-08-10T12:05:48.426 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:48.427 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:48.427 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:48.427 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.427 INFO:teuthology.orchestra.run.smithi156.stdout: "req_symlink_latency": { 2023-08-10T12:05:48.427 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:48.427 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:48.427 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:48.427 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.428 INFO:teuthology.orchestra.run.smithi156.stdout: "req_unlink_latency": { 2023-08-10T12:05:48.428 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 4139, 2023-08-10T12:05:48.428 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 6.033517058, 2023-08-10T12:05:48.428 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.001457723 2023-08-10T12:05:48.428 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.428 INFO:teuthology.orchestra.run.smithi156.stdout: "cap_revoke_eviction": 0, 2023-08-10T12:05:48.428 INFO:teuthology.orchestra.run.smithi156.stdout: "cap_acquisition_throttle": 0, 2023-08-10T12:05:48.428 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getvxattr_latency": { 2023-08-10T12:05:48.429 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:48.429 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:48.429 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:48.429 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:48.429 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.429 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_sessions": { 2023-08-10T12:05:48.429 INFO:teuthology.orchestra.run.smithi156.stdout: "session_count": 1, 2023-08-10T12:05:48.430 INFO:teuthology.orchestra.run.smithi156.stdout: "session_add": 2, 2023-08-10T12:05:48.430 INFO:teuthology.orchestra.run.smithi156.stdout: "session_remove": 1, 2023-08-10T12:05:48.430 INFO:teuthology.orchestra.run.smithi156.stdout: "sessions_open": 1, 2023-08-10T12:05:48.430 INFO:teuthology.orchestra.run.smithi156.stdout: "sessions_stale": 0, 2023-08-10T12:05:48.430 INFO:teuthology.orchestra.run.smithi156.stdout: "total_load": 2098, 2023-08-10T12:05:48.430 INFO:teuthology.orchestra.run.smithi156.stdout: "average_load": 2098, 2023-08-10T12:05:48.430 INFO:teuthology.orchestra.run.smithi156.stdout: "avg_session_uptime": 725 2023-08-10T12:05:48.430 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.431 INFO:teuthology.orchestra.run.smithi156.stdout: "mempool": { 2023-08-10T12:05:48.431 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_bytes": 0, 2023-08-10T12:05:48.431 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_items": 0, 2023-08-10T12:05:48.431 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_bytes": 0, 2023-08-10T12:05:48.431 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_items": 0, 2023-08-10T12:05:48.431 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_bytes": 0, 2023-08-10T12:05:48.431 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_items": 0, 2023-08-10T12:05:48.431 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-10T12:05:48.432 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_items": 0, 2023-08-10T12:05:48.432 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-10T12:05:48.432 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_items": 0, 2023-08-10T12:05:48.432 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_bytes": 0, 2023-08-10T12:05:48.432 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_items": 0, 2023-08-10T12:05:48.432 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-10T12:05:48.432 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_items": 0, 2023-08-10T12:05:48.433 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_bytes": 0, 2023-08-10T12:05:48.433 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_items": 0, 2023-08-10T12:05:48.433 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_bytes": 0, 2023-08-10T12:05:48.433 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_items": 0, 2023-08-10T12:05:48.433 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-10T12:05:48.433 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_items": 0, 2023-08-10T12:05:48.433 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-10T12:05:48.433 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_items": 0, 2023-08-10T12:05:48.434 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_bytes": 0, 2023-08-10T12:05:48.434 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_items": 0, 2023-08-10T12:05:48.434 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_bytes": 0, 2023-08-10T12:05:48.434 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_items": 0, 2023-08-10T12:05:48.434 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-10T12:05:48.434 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_items": 0, 2023-08-10T12:05:48.434 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_bytes": 0, 2023-08-10T12:05:48.434 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_items": 0, 2023-08-10T12:05:48.435 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_bytes": 0, 2023-08-10T12:05:48.435 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_items": 0, 2023-08-10T12:05:48.435 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_bytes": 0, 2023-08-10T12:05:48.436 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_items": 0, 2023-08-10T12:05:48.436 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_bytes": 0, 2023-08-10T12:05:48.436 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_items": 0, 2023-08-10T12:05:48.437 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_bytes": 315700, 2023-08-10T12:05:48.437 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_items": 126, 2023-08-10T12:05:48.437 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_bytes": 0, 2023-08-10T12:05:48.437 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_items": 0, 2023-08-10T12:05:48.438 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_bytes": 0, 2023-08-10T12:05:48.438 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_items": 0, 2023-08-10T12:05:48.438 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_bytes": 0, 2023-08-10T12:05:48.439 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_items": 0, 2023-08-10T12:05:48.439 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_bytes": 0, 2023-08-10T12:05:48.439 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_items": 0, 2023-08-10T12:05:48.439 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_bytes": 8032, 2023-08-10T12:05:48.440 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_items": 167, 2023-08-10T12:05:48.440 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_bytes": 0, 2023-08-10T12:05:48.440 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_items": 0, 2023-08-10T12:05:48.441 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_bytes": 0, 2023-08-10T12:05:48.441 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_items": 0, 2023-08-10T12:05:48.441 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_bytes": 229397, 2023-08-10T12:05:48.441 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_items": 715, 2023-08-10T12:05:48.442 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_bytes": 0, 2023-08-10T12:05:48.442 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_items": 0, 2023-08-10T12:05:48.442 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_bytes": 0, 2023-08-10T12:05:48.443 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_items": 0 2023-08-10T12:05:48.443 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.443 INFO:teuthology.orchestra.run.smithi156.stdout: "objecter": { 2023-08-10T12:05:48.443 INFO:teuthology.orchestra.run.smithi156.stdout: "op_active": 0, 2023-08-10T12:05:48.444 INFO:teuthology.orchestra.run.smithi156.stdout: "op_laggy": 0, 2023-08-10T12:05:48.444 INFO:teuthology.orchestra.run.smithi156.stdout: "op_send": 11302, 2023-08-10T12:05:48.444 INFO:teuthology.orchestra.run.smithi156.stdout: "op_send_bytes": 176458161, 2023-08-10T12:05:48.445 INFO:teuthology.orchestra.run.smithi156.stdout: "op_resend": 33, 2023-08-10T12:05:48.445 INFO:teuthology.orchestra.run.smithi156.stdout: "op_reply": 11302, 2023-08-10T12:05:48.445 INFO:teuthology.orchestra.run.smithi156.stdout: "op_latency": { 2023-08-10T12:05:48.446 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 11302, 2023-08-10T12:05:48.446 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 154.771691798, 2023-08-10T12:05:48.446 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.013694186 2023-08-10T12:05:48.446 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.447 INFO:teuthology.orchestra.run.smithi156.stdout: "op_inflight": 0, 2023-08-10T12:05:48.447 INFO:teuthology.orchestra.run.smithi156.stdout: "oplen_avg": { 2023-08-10T12:05:48.447 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 11302, 2023-08-10T12:05:48.447 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 12069 2023-08-10T12:05:48.448 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.448 INFO:teuthology.orchestra.run.smithi156.stdout: "op": 11302, 2023-08-10T12:05:48.448 INFO:teuthology.orchestra.run.smithi156.stdout: "op_r": 653, 2023-08-10T12:05:48.449 INFO:teuthology.orchestra.run.smithi156.stdout: "op_w": 10649, 2023-08-10T12:05:48.449 INFO:teuthology.orchestra.run.smithi156.stdout: "op_rmw": 0, 2023-08-10T12:05:48.449 INFO:teuthology.orchestra.run.smithi156.stdout: "op_pg": 0, 2023-08-10T12:05:48.450 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_stat": 0, 2023-08-10T12:05:48.450 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_create": 10, 2023-08-10T12:05:48.450 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_read": 384, 2023-08-10T12:05:48.450 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_write": 3304, 2023-08-10T12:05:48.451 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_writefull": 227, 2023-08-10T12:05:48.451 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_writesame": 0, 2023-08-10T12:05:48.451 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_append": 0, 2023-08-10T12:05:48.452 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_zero": 0, 2023-08-10T12:05:48.452 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_truncate": 48, 2023-08-10T12:05:48.452 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_delete": 6507, 2023-08-10T12:05:48.452 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_mapext": 0, 2023-08-10T12:05:48.453 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_sparse_read": 0, 2023-08-10T12:05:48.453 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_clonerange": 0, 2023-08-10T12:05:48.453 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_getxattr": 33, 2023-08-10T12:05:48.454 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_setxattr": 20, 2023-08-10T12:05:48.454 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_cmpxattr": 0, 2023-08-10T12:05:48.454 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_rmxattr": 0, 2023-08-10T12:05:48.454 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_resetxattrs": 0, 2023-08-10T12:05:48.455 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_call": 0, 2023-08-10T12:05:48.455 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_watch": 0, 2023-08-10T12:05:48.455 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_notify": 0, 2023-08-10T12:05:48.456 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_src_cmpxattr": 0, 2023-08-10T12:05:48.456 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_pgls": 0, 2023-08-10T12:05:48.456 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_pgls_filter": 0, 2023-08-10T12:05:48.456 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_other": 0, 2023-08-10T12:05:48.457 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_active": 0, 2023-08-10T12:05:48.457 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_send": 0, 2023-08-10T12:05:48.457 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_resend": 0, 2023-08-10T12:05:48.458 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_ping": 0, 2023-08-10T12:05:48.458 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_active": 0, 2023-08-10T12:05:48.458 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_send": 0, 2023-08-10T12:05:48.459 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_resend": 0, 2023-08-10T12:05:48.459 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_active": 0, 2023-08-10T12:05:48.459 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_send": 0, 2023-08-10T12:05:48.459 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_resend": 0, 2023-08-10T12:05:48.460 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_active": 0, 2023-08-10T12:05:48.460 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_send": 0, 2023-08-10T12:05:48.460 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_resend": 0, 2023-08-10T12:05:48.461 INFO:teuthology.orchestra.run.smithi156.stdout: "command_active": 0, 2023-08-10T12:05:48.461 INFO:teuthology.orchestra.run.smithi156.stdout: "command_send": 0, 2023-08-10T12:05:48.461 INFO:teuthology.orchestra.run.smithi156.stdout: "command_resend": 0, 2023-08-10T12:05:48.461 INFO:teuthology.orchestra.run.smithi156.stdout: "map_epoch": 98, 2023-08-10T12:05:48.462 INFO:teuthology.orchestra.run.smithi156.stdout: "map_full": 0, 2023-08-10T12:05:48.462 INFO:teuthology.orchestra.run.smithi156.stdout: "map_inc": 15, 2023-08-10T12:05:48.462 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_sessions": 12, 2023-08-10T12:05:48.463 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_session_open": 12, 2023-08-10T12:05:48.463 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_session_close": 0, 2023-08-10T12:05:48.463 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_laggy": 0, 2023-08-10T12:05:48.463 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_wr": 1081, 2023-08-10T12:05:48.464 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_rd": 315, 2023-08-10T12:05:48.464 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_del": 140 2023-08-10T12:05:48.464 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.465 INFO:teuthology.orchestra.run.smithi156.stdout: "oft": { 2023-08-10T12:05:48.465 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_objs": 1, 2023-08-10T12:05:48.465 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_kv_pairs": 0, 2023-08-10T12:05:48.465 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_updates": 0, 2023-08-10T12:05:48.466 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_removes": 0 2023-08-10T12:05:48.466 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.466 INFO:teuthology.orchestra.run.smithi156.stdout: "osd-slow-ops": { 2023-08-10T12:05:48.467 INFO:teuthology.orchestra.run.smithi156.stdout: "slow_ops_count": 3 2023-08-10T12:05:48.467 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.467 INFO:teuthology.orchestra.run.smithi156.stdout: "purge_queue": { 2023-08-10T12:05:48.467 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_ops": 0, 2023-08-10T12:05:48.468 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_ops_high_water": 6, 2023-08-10T12:05:48.468 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing": 0, 2023-08-10T12:05:48.468 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_high_water": 6, 2023-08-10T12:05:48.469 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executed": 6456, 2023-08-10T12:05:48.469 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_item_in_journal": 0 2023-08-10T12:05:48.469 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.469 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-10T12:05:48.470 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-08-10T12:05:48.470 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 104857600, 2023-08-10T12:05:48.470 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-08-10T12:05:48.471 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 1250312, 2023-08-10T12:05:48.471 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 143615664, 2023-08-10T12:05:48.471 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:48.471 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 1250312, 2023-08-10T12:05:48.472 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-08-10T12:05:48.472 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-08-10T12:05:48.472 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 1250312, 2023-08-10T12:05:48.473 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 143615664, 2023-08-10T12:05:48.473 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-08-10T12:05:48.473 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:48.473 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:48.474 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:48.474 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:48.474 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.475 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-objecter_bytes": { 2023-08-10T12:05:48.475 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-08-10T12:05:48.475 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 104857600, 2023-08-10T12:05:48.475 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-08-10T12:05:48.476 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-08-10T12:05:48.476 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-08-10T12:05:48.476 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:48.477 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:48.477 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 11302, 2023-08-10T12:05:48.477 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 177258119, 2023-08-10T12:05:48.478 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 11302, 2023-08-10T12:05:48.478 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 177258119, 2023-08-10T12:05:48.478 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-08-10T12:05:48.478 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:48.479 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:48.479 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:48.479 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:48.480 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.480 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-objecter_ops": { 2023-08-10T12:05:48.480 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-08-10T12:05:48.480 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 1024, 2023-08-10T12:05:48.481 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-08-10T12:05:48.481 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-08-10T12:05:48.481 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-08-10T12:05:48.482 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:48.482 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:48.482 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 11302, 2023-08-10T12:05:48.482 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 11302, 2023-08-10T12:05:48.483 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 11302, 2023-08-10T12:05:48.483 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 11302, 2023-08-10T12:05:48.483 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-08-10T12:05:48.484 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:48.484 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:48.484 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:48.485 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:48.485 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.485 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-write_buf_throttle": { 2023-08-10T12:05:48.485 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-08-10T12:05:48.486 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 3758096384, 2023-08-10T12:05:48.486 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-08-10T12:05:48.486 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 6456, 2023-08-10T12:05:48.486 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 806888, 2023-08-10T12:05:48.487 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:48.487 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 6456, 2023-08-10T12:05:48.487 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-08-10T12:05:48.487 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-08-10T12:05:48.487 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 385, 2023-08-10T12:05:48.487 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 806888, 2023-08-10T12:05:48.488 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-08-10T12:05:48.488 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:48.488 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:48.488 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:48.488 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:48.489 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:48.489 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-write_buf_throttle-0x55a570aaa0a0": { 2023-08-10T12:05:48.489 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-08-10T12:05:48.489 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 3758096384, 2023-08-10T12:05:48.489 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-08-10T12:05:48.490 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 56046, 2023-08-10T12:05:48.490 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 167020987, 2023-08-10T12:05:48.490 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:48.490 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 56046, 2023-08-10T12:05:48.490 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-08-10T12:05:48.490 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-08-10T12:05:48.491 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 2919, 2023-08-10T12:05:48.491 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 167020987, 2023-08-10T12:05:48.491 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-08-10T12:05:48.491 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:48.492 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:48.492 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:48.492 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:48.492 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:48.493 INFO:teuthology.orchestra.run.smithi156.stdout:} 2023-08-10T12:05:48.493 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:48 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:05:48.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:48 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:05:48.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:48 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:05:48.754 INFO:tasks.check_counter:Daemon mds.f mds.exported=303 2023-08-10T12:05:48.754 INFO:tasks.check_counter:Daemon mds.f mds.imported=241 2023-08-10T12:05:48.755 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=1880 2023-08-10T12:05:48.755 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=9126 2023-08-10T12:05:48.755 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=2 2023-08-10T12:05:48.755 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2023-08-10T12:05:48.755 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2023-08-10T12:05:48.756 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=48 2023-08-10T12:05:48.756 DEBUG:tasks.check_counter:Getting stats from i 2023-08-10T12:05:48.756 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph daemon mds.i perf dump 2023-08-10T12:05:49.313 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T12:05:49.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:49 smithi152 ceph-mon[130220]: pgmap v410: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2023-08-10T12:05:49.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:49 smithi156 ceph-mon[130574]: pgmap v410: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2023-08-10T12:05:49.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:49 smithi073 ceph-mon[128869]: pgmap v410: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2023-08-10T12:05:50.551 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2023-08-10T12:05:50.551 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-0": { 2023-08-10T12:05:50.551 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 821, 2023-08-10T12:05:50.551 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 821, 2023-08-10T12:05:50.552 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 33796696, 2023-08-10T12:05:50.552 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 254545, 2023-08-10T12:05:50.552 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 7, 2023-08-10T12:05:50.552 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 3, 2023-08-10T12:05:50.552 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.087219058, 2023-08-10T12:05:50.552 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.018680419, 2023-08-10T12:05:50.552 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.035588047, 2023-08-10T12:05:50.553 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.025566652, 2023-08-10T12:05:50.553 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:50.553 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 820, 2023-08-10T12:05:50.553 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.045790789, 2023-08-10T12:05:50.553 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000055842 2023-08-10T12:05:50.553 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.553 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:50.554 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.554 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.554 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.554 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.554 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-08-10T12:05:50.554 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 448 2023-08-10T12:05:50.554 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.555 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-1": { 2023-08-10T12:05:50.555 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 230, 2023-08-10T12:05:50.555 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 414, 2023-08-10T12:05:50.555 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 21031564, 2023-08-10T12:05:50.555 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 379982, 2023-08-10T12:05:50.555 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 8, 2023-08-10T12:05:50.555 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 6, 2023-08-10T12:05:50.555 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.032686572, 2023-08-10T12:05:50.556 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.007318179, 2023-08-10T12:05:50.556 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.017264960, 2023-08-10T12:05:50.556 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.005626686, 2023-08-10T12:05:50.556 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:50.556 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 313, 2023-08-10T12:05:50.556 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.019596008, 2023-08-10T12:05:50.556 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000062607 2023-08-10T12:05:50.557 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.557 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:50.557 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.557 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.557 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.557 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.557 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 320, 2023-08-10T12:05:50.557 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 309008 2023-08-10T12:05:50.558 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.558 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-2": { 2023-08-10T12:05:50.558 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 1149, 2023-08-10T12:05:50.558 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 1099, 2023-08-10T12:05:50.558 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 21355407, 2023-08-10T12:05:50.558 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 316283, 2023-08-10T12:05:50.558 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 5, 2023-08-10T12:05:50.558 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 4, 2023-08-10T12:05:50.559 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.091012692, 2023-08-10T12:05:50.559 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.030174644, 2023-08-10T12:05:50.559 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.069027632, 2023-08-10T12:05:50.559 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.010346446, 2023-08-10T12:05:50.559 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:50.559 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 1098, 2023-08-10T12:05:50.559 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.082240097, 2023-08-10T12:05:50.560 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000074899 2023-08-10T12:05:50.560 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.560 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:50.560 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.560 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.561 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.561 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.561 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 2042176, 2023-08-10T12:05:50.561 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 239776 2023-08-10T12:05:50.561 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.561 INFO:teuthology.orchestra.run.smithi156.stdout: "cct": { 2023-08-10T12:05:50.561 INFO:teuthology.orchestra.run.smithi156.stdout: "total_workers": 1, 2023-08-10T12:05:50.562 INFO:teuthology.orchestra.run.smithi156.stdout: "unhealthy_workers": 1 2023-08-10T12:05:50.562 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.562 INFO:teuthology.orchestra.run.smithi156.stdout: "finisher-MDSRank": { 2023-08-10T12:05:50.562 INFO:teuthology.orchestra.run.smithi156.stdout: "queue_len": 0, 2023-08-10T12:05:50.562 INFO:teuthology.orchestra.run.smithi156.stdout: "complete_latency": { 2023-08-10T12:05:50.562 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 2162, 2023-08-10T12:05:50.563 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.215814455, 2023-08-10T12:05:50.563 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000099821 2023-08-10T12:05:50.563 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:50.563 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.563 INFO:teuthology.orchestra.run.smithi156.stdout: "finisher-PurgeQueue": { 2023-08-10T12:05:50.564 INFO:teuthology.orchestra.run.smithi156.stdout: "queue_len": 0, 2023-08-10T12:05:50.564 INFO:teuthology.orchestra.run.smithi156.stdout: "complete_latency": { 2023-08-10T12:05:50.564 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.564 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.564 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.564 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:50.564 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.564 INFO:teuthology.orchestra.run.smithi156.stdout: "mds": { 2023-08-10T12:05:50.565 INFO:teuthology.orchestra.run.smithi156.stdout: "request": 0, 2023-08-10T12:05:50.565 INFO:teuthology.orchestra.run.smithi156.stdout: "reply": 0, 2023-08-10T12:05:50.565 INFO:teuthology.orchestra.run.smithi156.stdout: "reply_latency": { 2023-08-10T12:05:50.565 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.565 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.565 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.565 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.565 INFO:teuthology.orchestra.run.smithi156.stdout: "slow_reply": 0, 2023-08-10T12:05:50.566 INFO:teuthology.orchestra.run.smithi156.stdout: "forward": 0, 2023-08-10T12:05:50.566 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_fetch_complete": 0, 2023-08-10T12:05:50.566 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_fetch_keys": 0, 2023-08-10T12:05:50.566 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_commit": 0, 2023-08-10T12:05:50.567 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_split": 0, 2023-08-10T12:05:50.567 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_merge": 0, 2023-08-10T12:05:50.567 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes": 15898, 2023-08-10T12:05:50.567 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_top": 9850, 2023-08-10T12:05:50.568 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_bottom": 6039, 2023-08-10T12:05:50.568 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_pin_tail": 9, 2023-08-10T12:05:50.568 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_pinned": 1827, 2023-08-10T12:05:50.569 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_expired": 178, 2023-08-10T12:05:50.569 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_with_caps": 0, 2023-08-10T12:05:50.570 INFO:teuthology.orchestra.run.smithi156.stdout: "caps": 0, 2023-08-10T12:05:50.570 INFO:teuthology.orchestra.run.smithi156.stdout: "subtrees": 118, 2023-08-10T12:05:50.570 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse": 0, 2023-08-10T12:05:50.570 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_hit": 0, 2023-08-10T12:05:50.571 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_forward": 0, 2023-08-10T12:05:50.571 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_discover": 0, 2023-08-10T12:05:50.571 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_dir_fetch": 0, 2023-08-10T12:05:50.571 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_remote_ino": 0, 2023-08-10T12:05:50.571 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_lock": 0, 2023-08-10T12:05:50.572 INFO:teuthology.orchestra.run.smithi156.stdout: "load_cent": 0, 2023-08-10T12:05:50.572 INFO:teuthology.orchestra.run.smithi156.stdout: "q": 0, 2023-08-10T12:05:50.572 INFO:teuthology.orchestra.run.smithi156.stdout: "exported": 0, 2023-08-10T12:05:50.572 INFO:teuthology.orchestra.run.smithi156.stdout: "exported_inodes": 0, 2023-08-10T12:05:50.572 INFO:teuthology.orchestra.run.smithi156.stdout: "imported": 0, 2023-08-10T12:05:50.572 INFO:teuthology.orchestra.run.smithi156.stdout: "imported_inodes": 0, 2023-08-10T12:05:50.572 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_dir_fetch": 0, 2023-08-10T12:05:50.572 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_backtrace_fetch": 0, 2023-08-10T12:05:50.573 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_peer_discover": 0, 2023-08-10T12:05:50.573 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rfiles": 32707, 2023-08-10T12:05:50.573 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rbytes": 697043801, 2023-08-10T12:05:50.573 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rsnaps": 4, 2023-08-10T12:05:50.573 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_backtrace_fetch": 0, 2023-08-10T12:05:50.573 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_set_tag": 0, 2023-08-10T12:05:50.573 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_backtrace_repaired": 0, 2023-08-10T12:05:50.574 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_inotable_repaired": 0, 2023-08-10T12:05:50.574 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dir_inodes": 0, 2023-08-10T12:05:50.574 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dir_base_inodes": 0, 2023-08-10T12:05:50.574 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dirfrag_rstats": 0, 2023-08-10T12:05:50.574 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_file_inodes": 0, 2023-08-10T12:05:50.574 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_inode_file_caps": 0, 2023-08-10T12:05:50.574 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_revoke": 0, 2023-08-10T12:05:50.574 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_grant": 0, 2023-08-10T12:05:50.575 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_trunc": 0, 2023-08-10T12:05:50.575 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-10T12:05:50.575 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-10T12:05:50.575 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_caps": 0, 2023-08-10T12:05:50.575 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_caps_dirty": 0, 2023-08-10T12:05:50.575 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_cap_release": 0, 2023-08-10T12:05:50.575 INFO:teuthology.orchestra.run.smithi156.stdout: "process_request_cap_release": 0 2023-08-10T12:05:50.575 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.576 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_cache": { 2023-08-10T12:05:50.576 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_update": 0, 2023-08-10T12:05:50.576 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_update_receipt": 0, 2023-08-10T12:05:50.576 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_try_discover": 0, 2023-08-10T12:05:50.576 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_send_discover": 0, 2023-08-10T12:05:50.576 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_handle_discover": 0, 2023-08-10T12:05:50.576 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays": 0, 2023-08-10T12:05:50.576 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays_delayed": 0, 2023-08-10T12:05:50.577 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays_enqueuing": 0, 2023-08-10T12:05:50.577 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_created": 0, 2023-08-10T12:05:50.577 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_enqueued": 0, 2023-08-10T12:05:50.577 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_reintegrated": 0, 2023-08-10T12:05:50.577 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_migrated": 0, 2023-08-10T12:05:50.577 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_processing": 0, 2023-08-10T12:05:50.577 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_enqueued": 0, 2023-08-10T12:05:50.578 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_prioritized": 0, 2023-08-10T12:05:50.578 INFO:teuthology.orchestra.run.smithi156.stdout: "recovery_started": 0, 2023-08-10T12:05:50.578 INFO:teuthology.orchestra.run.smithi156.stdout: "recovery_completed": 0, 2023-08-10T12:05:50.578 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_enqueue_scrub": 0, 2023-08-10T12:05:50.578 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_exportdir": 0, 2023-08-10T12:05:50.578 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_flush": 0, 2023-08-10T12:05:50.578 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_fragmentdir": 0, 2023-08-10T12:05:50.578 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_fragstats": 0, 2023-08-10T12:05:50.579 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_inodestats": 0 2023-08-10T12:05:50.579 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.579 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_log": { 2023-08-10T12:05:50.579 INFO:teuthology.orchestra.run.smithi156.stdout: "evadd": 0, 2023-08-10T12:05:50.579 INFO:teuthology.orchestra.run.smithi156.stdout: "evex": 0, 2023-08-10T12:05:50.579 INFO:teuthology.orchestra.run.smithi156.stdout: "evtrm": 0, 2023-08-10T12:05:50.579 INFO:teuthology.orchestra.run.smithi156.stdout: "ev": 0, 2023-08-10T12:05:50.579 INFO:teuthology.orchestra.run.smithi156.stdout: "evexg": 0, 2023-08-10T12:05:50.580 INFO:teuthology.orchestra.run.smithi156.stdout: "evexd": 0, 2023-08-10T12:05:50.580 INFO:teuthology.orchestra.run.smithi156.stdout: "segadd": 0, 2023-08-10T12:05:50.580 INFO:teuthology.orchestra.run.smithi156.stdout: "segex": 0, 2023-08-10T12:05:50.580 INFO:teuthology.orchestra.run.smithi156.stdout: "segtrm": 0, 2023-08-10T12:05:50.580 INFO:teuthology.orchestra.run.smithi156.stdout: "seg": 6, 2023-08-10T12:05:50.580 INFO:teuthology.orchestra.run.smithi156.stdout: "segexg": 0, 2023-08-10T12:05:50.580 INFO:teuthology.orchestra.run.smithi156.stdout: "segexd": 0, 2023-08-10T12:05:50.580 INFO:teuthology.orchestra.run.smithi156.stdout: "expos": 75513482, 2023-08-10T12:05:50.581 INFO:teuthology.orchestra.run.smithi156.stdout: "wrpos": 0, 2023-08-10T12:05:50.581 INFO:teuthology.orchestra.run.smithi156.stdout: "rdpos": 77440754, 2023-08-10T12:05:50.581 INFO:teuthology.orchestra.run.smithi156.stdout: "jlat": { 2023-08-10T12:05:50.581 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.581 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.581 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.581 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.581 INFO:teuthology.orchestra.run.smithi156.stdout: "replayed": 26110 2023-08-10T12:05:50.582 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.582 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_mem": { 2023-08-10T12:05:50.582 INFO:teuthology.orchestra.run.smithi156.stdout: "ino": 8488, 2023-08-10T12:05:50.582 INFO:teuthology.orchestra.run.smithi156.stdout: "ino+": 12086, 2023-08-10T12:05:50.582 INFO:teuthology.orchestra.run.smithi156.stdout: "ino-": 3598, 2023-08-10T12:05:50.582 INFO:teuthology.orchestra.run.smithi156.stdout: "dir": 447, 2023-08-10T12:05:50.582 INFO:teuthology.orchestra.run.smithi156.stdout: "dir+": 585, 2023-08-10T12:05:50.583 INFO:teuthology.orchestra.run.smithi156.stdout: "dir-": 138, 2023-08-10T12:05:50.583 INFO:teuthology.orchestra.run.smithi156.stdout: "dn": 16328, 2023-08-10T12:05:50.583 INFO:teuthology.orchestra.run.smithi156.stdout: "dn+": 20966, 2023-08-10T12:05:50.583 INFO:teuthology.orchestra.run.smithi156.stdout: "dn-": 4638, 2023-08-10T12:05:50.583 INFO:teuthology.orchestra.run.smithi156.stdout: "cap": 0, 2023-08-10T12:05:50.583 INFO:teuthology.orchestra.run.smithi156.stdout: "cap+": 0, 2023-08-10T12:05:50.583 INFO:teuthology.orchestra.run.smithi156.stdout: "cap-": 0, 2023-08-10T12:05:50.583 INFO:teuthology.orchestra.run.smithi156.stdout: "rss": 91340, 2023-08-10T12:05:50.584 INFO:teuthology.orchestra.run.smithi156.stdout: "heap": 207152 2023-08-10T12:05:50.584 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.584 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_server": { 2023-08-10T12:05:50.584 INFO:teuthology.orchestra.run.smithi156.stdout: "dispatch_client_request": 0, 2023-08-10T12:05:50.584 INFO:teuthology.orchestra.run.smithi156.stdout: "dispatch_server_request": 0, 2023-08-10T12:05:50.584 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_request": 0, 2023-08-10T12:05:50.584 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_session": 0, 2023-08-10T12:05:50.584 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_peer_request": 0, 2023-08-10T12:05:50.585 INFO:teuthology.orchestra.run.smithi156.stdout: "req_create_latency": { 2023-08-10T12:05:50.585 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.585 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.585 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.585 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.585 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getattr_latency": { 2023-08-10T12:05:50.585 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.586 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.586 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.586 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.586 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getfilelock_latency": { 2023-08-10T12:05:50.586 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.586 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.586 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.586 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.587 INFO:teuthology.orchestra.run.smithi156.stdout: "req_link_latency": { 2023-08-10T12:05:50.587 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.587 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.587 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.587 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.587 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookup_latency": { 2023-08-10T12:05:50.587 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.587 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.588 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.588 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.588 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookuphash_latency": { 2023-08-10T12:05:50.588 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.588 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.588 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.588 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.588 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupino_latency": { 2023-08-10T12:05:50.589 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.589 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.589 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.589 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.589 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupname_latency": { 2023-08-10T12:05:50.589 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.589 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.589 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.590 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.590 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupparent_latency": { 2023-08-10T12:05:50.590 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.590 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.590 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.590 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.590 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupsnap_latency": { 2023-08-10T12:05:50.591 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.591 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.591 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.591 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.591 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lssnap_latency": { 2023-08-10T12:05:50.591 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.591 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.591 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.592 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.592 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mkdir_latency": { 2023-08-10T12:05:50.592 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.592 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.592 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.592 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.592 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mknod_latency": { 2023-08-10T12:05:50.592 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.593 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.593 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.593 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.593 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mksnap_latency": { 2023-08-10T12:05:50.593 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.593 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.593 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.593 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.594 INFO:teuthology.orchestra.run.smithi156.stdout: "req_open_latency": { 2023-08-10T12:05:50.594 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.594 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.594 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.594 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.594 INFO:teuthology.orchestra.run.smithi156.stdout: "req_readdir_latency": { 2023-08-10T12:05:50.594 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.594 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.595 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.595 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.595 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rename_latency": { 2023-08-10T12:05:50.595 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.595 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.595 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.595 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.596 INFO:teuthology.orchestra.run.smithi156.stdout: "req_renamesnap_latency": { 2023-08-10T12:05:50.596 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.596 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.596 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.596 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.596 INFO:teuthology.orchestra.run.smithi156.stdout: "req_snapdiff_latency": { 2023-08-10T12:05:50.596 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.596 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.597 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.597 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.597 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmdir_latency": { 2023-08-10T12:05:50.597 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.597 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.597 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.597 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.597 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmsnap_latency": { 2023-08-10T12:05:50.598 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.598 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.598 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.598 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.598 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmxattr_latency": { 2023-08-10T12:05:50.598 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.598 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.598 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.599 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.599 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setattr_latency": { 2023-08-10T12:05:50.599 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.599 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.599 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.599 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.599 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setdirlayout_latency": { 2023-08-10T12:05:50.599 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.600 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.600 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.600 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.600 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setfilelock_latency": { 2023-08-10T12:05:50.600 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.600 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.600 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.601 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.601 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setlayout_latency": { 2023-08-10T12:05:50.601 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.601 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.601 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.601 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.601 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setxattr_latency": { 2023-08-10T12:05:50.601 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.602 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.602 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.602 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.602 INFO:teuthology.orchestra.run.smithi156.stdout: "req_symlink_latency": { 2023-08-10T12:05:50.602 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.602 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.602 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.603 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.603 INFO:teuthology.orchestra.run.smithi156.stdout: "req_unlink_latency": { 2023-08-10T12:05:50.603 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.603 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.603 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.603 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.603 INFO:teuthology.orchestra.run.smithi156.stdout: "cap_revoke_eviction": 0, 2023-08-10T12:05:50.603 INFO:teuthology.orchestra.run.smithi156.stdout: "cap_acquisition_throttle": 0, 2023-08-10T12:05:50.604 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getvxattr_latency": { 2023-08-10T12:05:50.604 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.604 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.604 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.604 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:50.604 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.604 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_sessions": { 2023-08-10T12:05:50.605 INFO:teuthology.orchestra.run.smithi156.stdout: "session_count": 2, 2023-08-10T12:05:50.605 INFO:teuthology.orchestra.run.smithi156.stdout: "session_add": 5, 2023-08-10T12:05:50.605 INFO:teuthology.orchestra.run.smithi156.stdout: "session_remove": 3, 2023-08-10T12:05:50.605 INFO:teuthology.orchestra.run.smithi156.stdout: "sessions_open": 4, 2023-08-10T12:05:50.605 INFO:teuthology.orchestra.run.smithi156.stdout: "sessions_stale": 0, 2023-08-10T12:05:50.605 INFO:teuthology.orchestra.run.smithi156.stdout: "total_load": 0, 2023-08-10T12:05:50.605 INFO:teuthology.orchestra.run.smithi156.stdout: "average_load": 0, 2023-08-10T12:05:50.605 INFO:teuthology.orchestra.run.smithi156.stdout: "avg_session_uptime": 4759 2023-08-10T12:05:50.606 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.606 INFO:teuthology.orchestra.run.smithi156.stdout: "mempool": { 2023-08-10T12:05:50.606 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_bytes": 0, 2023-08-10T12:05:50.606 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_items": 0, 2023-08-10T12:05:50.606 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_bytes": 0, 2023-08-10T12:05:50.606 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_items": 0, 2023-08-10T12:05:50.606 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_bytes": 0, 2023-08-10T12:05:50.606 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_items": 0, 2023-08-10T12:05:50.607 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-10T12:05:50.607 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_items": 0, 2023-08-10T12:05:50.607 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-10T12:05:50.607 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_items": 0, 2023-08-10T12:05:50.607 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_bytes": 0, 2023-08-10T12:05:50.607 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_items": 0, 2023-08-10T12:05:50.607 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-10T12:05:50.607 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_items": 0, 2023-08-10T12:05:50.608 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_bytes": 0, 2023-08-10T12:05:50.608 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_items": 0, 2023-08-10T12:05:50.608 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_bytes": 0, 2023-08-10T12:05:50.608 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_items": 0, 2023-08-10T12:05:50.608 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-10T12:05:50.608 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_items": 0, 2023-08-10T12:05:50.608 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-10T12:05:50.608 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_items": 0, 2023-08-10T12:05:50.609 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_bytes": 0, 2023-08-10T12:05:50.609 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_items": 0, 2023-08-10T12:05:50.609 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_bytes": 0, 2023-08-10T12:05:50.609 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_items": 0, 2023-08-10T12:05:50.609 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-10T12:05:50.609 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_items": 0, 2023-08-10T12:05:50.609 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_bytes": 0, 2023-08-10T12:05:50.609 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_items": 0, 2023-08-10T12:05:50.610 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_bytes": 0, 2023-08-10T12:05:50.610 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_items": 0, 2023-08-10T12:05:50.610 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_bytes": 0, 2023-08-10T12:05:50.610 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_items": 0, 2023-08-10T12:05:50.610 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_bytes": 0, 2023-08-10T12:05:50.610 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_items": 0, 2023-08-10T12:05:50.610 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_bytes": 1957791, 2023-08-10T12:05:50.611 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_items": 9414, 2023-08-10T12:05:50.611 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_bytes": 88, 2023-08-10T12:05:50.611 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_items": 1, 2023-08-10T12:05:50.611 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_bytes": 0, 2023-08-10T12:05:50.611 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_items": 0, 2023-08-10T12:05:50.611 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_bytes": 0, 2023-08-10T12:05:50.611 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_items": 0, 2023-08-10T12:05:50.611 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_bytes": 0, 2023-08-10T12:05:50.612 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_items": 0, 2023-08-10T12:05:50.612 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_bytes": 7912, 2023-08-10T12:05:50.612 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_items": 164, 2023-08-10T12:05:50.612 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_bytes": 0, 2023-08-10T12:05:50.612 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_items": 0, 2023-08-10T12:05:50.612 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_bytes": 0, 2023-08-10T12:05:50.612 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_items": 0, 2023-08-10T12:05:50.612 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_bytes": 31733549, 2023-08-10T12:05:50.613 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_items": 393992, 2023-08-10T12:05:50.613 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_bytes": 0, 2023-08-10T12:05:50.613 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_items": 0, 2023-08-10T12:05:50.613 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_bytes": 0, 2023-08-10T12:05:50.613 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_items": 0 2023-08-10T12:05:50.613 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.613 INFO:teuthology.orchestra.run.smithi156.stdout: "objecter": { 2023-08-10T12:05:50.613 INFO:teuthology.orchestra.run.smithi156.stdout: "op_active": 0, 2023-08-10T12:05:50.614 INFO:teuthology.orchestra.run.smithi156.stdout: "op_laggy": 0, 2023-08-10T12:05:50.614 INFO:teuthology.orchestra.run.smithi156.stdout: "op_send": 1291, 2023-08-10T12:05:50.614 INFO:teuthology.orchestra.run.smithi156.stdout: "op_send_bytes": 26, 2023-08-10T12:05:50.614 INFO:teuthology.orchestra.run.smithi156.stdout: "op_resend": 4, 2023-08-10T12:05:50.614 INFO:teuthology.orchestra.run.smithi156.stdout: "op_reply": 1291, 2023-08-10T12:05:50.614 INFO:teuthology.orchestra.run.smithi156.stdout: "op_latency": { 2023-08-10T12:05:50.614 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 1291, 2023-08-10T12:05:50.614 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 2.313965289, 2023-08-10T12:05:50.615 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.001792382 2023-08-10T12:05:50.615 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.615 INFO:teuthology.orchestra.run.smithi156.stdout: "op_inflight": 0, 2023-08-10T12:05:50.615 INFO:teuthology.orchestra.run.smithi156.stdout: "oplen_avg": { 2023-08-10T12:05:50.615 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 1291, 2023-08-10T12:05:50.615 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 1292 2023-08-10T12:05:50.615 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.615 INFO:teuthology.orchestra.run.smithi156.stdout: "op": 1291, 2023-08-10T12:05:50.616 INFO:teuthology.orchestra.run.smithi156.stdout: "op_r": 1291, 2023-08-10T12:05:50.616 INFO:teuthology.orchestra.run.smithi156.stdout: "op_w": 0, 2023-08-10T12:05:50.616 INFO:teuthology.orchestra.run.smithi156.stdout: "op_rmw": 0, 2023-08-10T12:05:50.616 INFO:teuthology.orchestra.run.smithi156.stdout: "op_pg": 0, 2023-08-10T12:05:50.616 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_stat": 728, 2023-08-10T12:05:50.617 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_create": 0, 2023-08-10T12:05:50.617 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_read": 560, 2023-08-10T12:05:50.617 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_write": 0, 2023-08-10T12:05:50.617 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_writefull": 0, 2023-08-10T12:05:50.617 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_writesame": 0, 2023-08-10T12:05:50.617 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_append": 0, 2023-08-10T12:05:50.617 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_zero": 0, 2023-08-10T12:05:50.618 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_truncate": 0, 2023-08-10T12:05:50.618 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_delete": 0, 2023-08-10T12:05:50.618 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_mapext": 0, 2023-08-10T12:05:50.618 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_sparse_read": 0, 2023-08-10T12:05:50.618 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_clonerange": 0, 2023-08-10T12:05:50.618 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_getxattr": 2, 2023-08-10T12:05:50.618 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_setxattr": 0, 2023-08-10T12:05:50.618 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_cmpxattr": 0, 2023-08-10T12:05:50.619 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_rmxattr": 0, 2023-08-10T12:05:50.619 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_resetxattrs": 0, 2023-08-10T12:05:50.619 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_call": 0, 2023-08-10T12:05:50.619 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_watch": 0, 2023-08-10T12:05:50.619 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_notify": 0, 2023-08-10T12:05:50.619 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_src_cmpxattr": 0, 2023-08-10T12:05:50.619 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_pgls": 0, 2023-08-10T12:05:50.619 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_pgls_filter": 0, 2023-08-10T12:05:50.620 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_other": 0, 2023-08-10T12:05:50.620 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_active": 0, 2023-08-10T12:05:50.620 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_send": 0, 2023-08-10T12:05:50.620 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_resend": 0, 2023-08-10T12:05:50.620 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_ping": 0, 2023-08-10T12:05:50.620 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_active": 0, 2023-08-10T12:05:50.620 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_send": 0, 2023-08-10T12:05:50.621 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_resend": 0, 2023-08-10T12:05:50.621 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_active": 0, 2023-08-10T12:05:50.621 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_send": 0, 2023-08-10T12:05:50.621 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_resend": 0, 2023-08-10T12:05:50.621 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_active": 0, 2023-08-10T12:05:50.621 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_send": 0, 2023-08-10T12:05:50.621 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_resend": 0, 2023-08-10T12:05:50.622 INFO:teuthology.orchestra.run.smithi156.stdout: "command_active": 0, 2023-08-10T12:05:50.622 INFO:teuthology.orchestra.run.smithi156.stdout: "command_send": 0, 2023-08-10T12:05:50.622 INFO:teuthology.orchestra.run.smithi156.stdout: "command_resend": 0, 2023-08-10T12:05:50.622 INFO:teuthology.orchestra.run.smithi156.stdout: "map_epoch": 86, 2023-08-10T12:05:50.622 INFO:teuthology.orchestra.run.smithi156.stdout: "map_full": 0, 2023-08-10T12:05:50.622 INFO:teuthology.orchestra.run.smithi156.stdout: "map_inc": 3, 2023-08-10T12:05:50.622 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_sessions": 9, 2023-08-10T12:05:50.623 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_session_open": 9, 2023-08-10T12:05:50.623 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_session_close": 0, 2023-08-10T12:05:50.623 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_laggy": 0, 2023-08-10T12:05:50.623 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_wr": 0, 2023-08-10T12:05:50.623 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_rd": 2, 2023-08-10T12:05:50.623 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_del": 0 2023-08-10T12:05:50.623 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.624 INFO:teuthology.orchestra.run.smithi156.stdout: "oft": { 2023-08-10T12:05:50.624 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_objs": 0, 2023-08-10T12:05:50.624 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_kv_pairs": 0, 2023-08-10T12:05:50.624 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_updates": 0, 2023-08-10T12:05:50.624 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_removes": 0 2023-08-10T12:05:50.625 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.625 INFO:teuthology.orchestra.run.smithi156.stdout: "osd-slow-ops": { 2023-08-10T12:05:50.625 INFO:teuthology.orchestra.run.smithi156.stdout: "slow_ops_count": 0 2023-08-10T12:05:50.625 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.625 INFO:teuthology.orchestra.run.smithi156.stdout: "purge_queue": { 2023-08-10T12:05:50.625 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_ops": 0, 2023-08-10T12:05:50.625 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_ops_high_water": 0, 2023-08-10T12:05:50.625 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing": 0, 2023-08-10T12:05:50.626 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_high_water": 0, 2023-08-10T12:05:50.626 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executed": 0, 2023-08-10T12:05:50.626 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_item_in_journal": 0 2023-08-10T12:05:50.626 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.626 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-10T12:05:50.626 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 435593, 2023-08-10T12:05:50.626 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 104857600, 2023-08-10T12:05:50.627 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-08-10T12:05:50.627 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 2196, 2023-08-10T12:05:50.627 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 75939521, 2023-08-10T12:05:50.627 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:50.627 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 2196, 2023-08-10T12:05:50.627 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-08-10T12:05:50.627 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-08-10T12:05:50.627 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 1439, 2023-08-10T12:05:50.628 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 75503928, 2023-08-10T12:05:50.628 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-08-10T12:05:50.628 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.628 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.628 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.628 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:50.628 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.628 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-objecter_bytes": { 2023-08-10T12:05:50.629 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-08-10T12:05:50.629 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 104857600, 2023-08-10T12:05:50.629 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-08-10T12:05:50.629 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-08-10T12:05:50.629 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-08-10T12:05:50.629 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:50.629 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:50.629 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 1291, 2023-08-10T12:05:50.630 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 73779377, 2023-08-10T12:05:50.630 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 1291, 2023-08-10T12:05:50.630 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 73779377, 2023-08-10T12:05:50.630 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-08-10T12:05:50.630 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.630 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.630 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.630 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:50.631 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.631 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-objecter_ops": { 2023-08-10T12:05:50.631 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-08-10T12:05:50.631 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 1024, 2023-08-10T12:05:50.631 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-08-10T12:05:50.631 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-08-10T12:05:50.631 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-08-10T12:05:50.632 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:50.632 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:50.632 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 1291, 2023-08-10T12:05:50.632 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 1291, 2023-08-10T12:05:50.632 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 1291, 2023-08-10T12:05:50.632 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 1291, 2023-08-10T12:05:50.632 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-08-10T12:05:50.632 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.633 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.633 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.633 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:50.633 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.633 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-write_buf_throttle": { 2023-08-10T12:05:50.633 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-08-10T12:05:50.633 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 3758096384, 2023-08-10T12:05:50.633 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-08-10T12:05:50.634 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-08-10T12:05:50.634 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-08-10T12:05:50.634 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:50.634 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:50.634 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-08-10T12:05:50.634 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-08-10T12:05:50.634 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 0, 2023-08-10T12:05:50.634 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 0, 2023-08-10T12:05:50.635 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-08-10T12:05:50.635 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.635 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.635 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.635 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:50.635 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:50.635 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-write_buf_throttle-0x562db8000460": { 2023-08-10T12:05:50.635 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-08-10T12:05:50.636 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 3758096384, 2023-08-10T12:05:50.636 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-08-10T12:05:50.636 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-08-10T12:05:50.636 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-08-10T12:05:50.636 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:50.636 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:50.636 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-08-10T12:05:50.637 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-08-10T12:05:50.637 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 0, 2023-08-10T12:05:50.637 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 0, 2023-08-10T12:05:50.637 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-08-10T12:05:50.637 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:50.637 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:50.637 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:50.637 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:50.638 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:50.638 INFO:teuthology.orchestra.run.smithi156.stdout:} 2023-08-10T12:05:50.974 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2023-08-10T12:05:50.974 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2023-08-10T12:05:50.975 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2023-08-10T12:05:50.975 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=0 2023-08-10T12:05:50.975 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=4 2023-08-10T12:05:50.975 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2023-08-10T12:05:50.975 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2023-08-10T12:05:50.976 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=0 2023-08-10T12:05:50.976 DEBUG:tasks.check_counter:Getting stats from l 2023-08-10T12:05:50.976 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 0e619a74-3773-11ee-9b37-001a4aab830c -- ceph daemon mds.l perf dump 2023-08-10T12:05:51.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:51 smithi156 ceph-mon[130574]: pgmap v411: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2023-08-10T12:05:51.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:51 smithi152 ceph-mon[130220]: pgmap v411: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2023-08-10T12:05:51.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:51 smithi073 ceph-mon[128869]: pgmap v411: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2023-08-10T12:05:51.530 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/0e619a74-3773-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T12:05:52.769 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2023-08-10T12:05:52.770 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-0": { 2023-08-10T12:05:52.770 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 613, 2023-08-10T12:05:52.770 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 569, 2023-08-10T12:05:52.770 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 43680947, 2023-08-10T12:05:52.770 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 238467, 2023-08-10T12:05:52.770 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 6, 2023-08-10T12:05:52.770 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 2, 2023-08-10T12:05:52.771 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.085803160, 2023-08-10T12:05:52.771 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.017345210, 2023-08-10T12:05:52.771 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.063327056, 2023-08-10T12:05:52.771 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.013148217, 2023-08-10T12:05:52.771 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:52.771 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 569, 2023-08-10T12:05:52.771 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.047923249, 2023-08-10T12:05:52.771 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000084223 2023-08-10T12:05:52.772 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.772 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:52.772 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.772 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.772 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.772 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.772 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 1657280, 2023-08-10T12:05:52.773 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 145472 2023-08-10T12:05:52.773 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.773 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-1": { 2023-08-10T12:05:52.773 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 963, 2023-08-10T12:05:52.773 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 1151, 2023-08-10T12:05:52.773 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 84140835, 2023-08-10T12:05:52.773 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 776380, 2023-08-10T12:05:52.774 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 8, 2023-08-10T12:05:52.774 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 6, 2023-08-10T12:05:52.774 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.111252757, 2023-08-10T12:05:52.774 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.025959110, 2023-08-10T12:05:52.774 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.053135917, 2023-08-10T12:05:52.774 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.024791302, 2023-08-10T12:05:52.774 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:52.774 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 1148, 2023-08-10T12:05:52.775 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.082670248, 2023-08-10T12:05:52.775 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000072012 2023-08-10T12:05:52.775 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.775 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:52.775 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.775 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.776 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.776 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.776 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 320, 2023-08-10T12:05:52.776 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 477504 2023-08-10T12:05:52.776 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.776 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-2": { 2023-08-10T12:05:52.776 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 1736, 2023-08-10T12:05:52.777 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 1738, 2023-08-10T12:05:52.777 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 41707768, 2023-08-10T12:05:52.777 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 539954, 2023-08-10T12:05:52.777 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 6, 2023-08-10T12:05:52.777 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 5, 2023-08-10T12:05:52.777 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.161631648, 2023-08-10T12:05:52.777 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.034801961, 2023-08-10T12:05:52.778 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.061350787, 2023-08-10T12:05:52.778 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.053431143, 2023-08-10T12:05:52.778 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T12:05:52.778 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 1736, 2023-08-10T12:05:52.778 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.102034774, 2023-08-10T12:05:52.778 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000058775 2023-08-10T12:05:52.778 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.778 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-08-10T12:05:52.779 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.779 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.779 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.779 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.779 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 0, 2023-08-10T12:05:52.779 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 0 2023-08-10T12:05:52.779 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.780 INFO:teuthology.orchestra.run.smithi156.stdout: "cct": { 2023-08-10T12:05:52.780 INFO:teuthology.orchestra.run.smithi156.stdout: "total_workers": 1, 2023-08-10T12:05:52.780 INFO:teuthology.orchestra.run.smithi156.stdout: "unhealthy_workers": 0 2023-08-10T12:05:52.780 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.780 INFO:teuthology.orchestra.run.smithi156.stdout: "finisher-MDSRank": { 2023-08-10T12:05:52.780 INFO:teuthology.orchestra.run.smithi156.stdout: "queue_len": 0, 2023-08-10T12:05:52.780 INFO:teuthology.orchestra.run.smithi156.stdout: "complete_latency": { 2023-08-10T12:05:52.780 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 5024, 2023-08-10T12:05:52.781 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.131540481, 2023-08-10T12:05:52.781 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000026182 2023-08-10T12:05:52.781 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:52.781 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.781 INFO:teuthology.orchestra.run.smithi156.stdout: "finisher-PurgeQueue": { 2023-08-10T12:05:52.781 INFO:teuthology.orchestra.run.smithi156.stdout: "queue_len": 0, 2023-08-10T12:05:52.781 INFO:teuthology.orchestra.run.smithi156.stdout: "complete_latency": { 2023-08-10T12:05:52.782 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.782 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.782 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.782 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:52.782 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.782 INFO:teuthology.orchestra.run.smithi156.stdout: "mds": { 2023-08-10T12:05:52.782 INFO:teuthology.orchestra.run.smithi156.stdout: "request": 0, 2023-08-10T12:05:52.783 INFO:teuthology.orchestra.run.smithi156.stdout: "reply": 0, 2023-08-10T12:05:52.783 INFO:teuthology.orchestra.run.smithi156.stdout: "reply_latency": { 2023-08-10T12:05:52.783 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.783 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.783 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.783 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.783 INFO:teuthology.orchestra.run.smithi156.stdout: "slow_reply": 0, 2023-08-10T12:05:52.783 INFO:teuthology.orchestra.run.smithi156.stdout: "forward": 0, 2023-08-10T12:05:52.784 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_fetch_complete": 0, 2023-08-10T12:05:52.784 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_fetch_keys": 0, 2023-08-10T12:05:52.784 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_commit": 0, 2023-08-10T12:05:52.784 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_split": 0, 2023-08-10T12:05:52.784 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_merge": 0, 2023-08-10T12:05:52.784 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes": 6466, 2023-08-10T12:05:52.784 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_top": 0, 2023-08-10T12:05:52.785 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_bottom": 0, 2023-08-10T12:05:52.785 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_pin_tail": 6466, 2023-08-10T12:05:52.785 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_pinned": 6466, 2023-08-10T12:05:52.785 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_expired": 859, 2023-08-10T12:05:52.785 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_with_caps": 0, 2023-08-10T12:05:52.785 INFO:teuthology.orchestra.run.smithi156.stdout: "caps": 0, 2023-08-10T12:05:52.785 INFO:teuthology.orchestra.run.smithi156.stdout: "subtrees": 1, 2023-08-10T12:05:52.786 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse": 0, 2023-08-10T12:05:52.786 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_hit": 0, 2023-08-10T12:05:52.786 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_forward": 0, 2023-08-10T12:05:52.786 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_discover": 0, 2023-08-10T12:05:52.786 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_dir_fetch": 0, 2023-08-10T12:05:52.786 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_remote_ino": 0, 2023-08-10T12:05:52.786 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_lock": 0, 2023-08-10T12:05:52.787 INFO:teuthology.orchestra.run.smithi156.stdout: "load_cent": 0, 2023-08-10T12:05:52.787 INFO:teuthology.orchestra.run.smithi156.stdout: "q": 0, 2023-08-10T12:05:52.787 INFO:teuthology.orchestra.run.smithi156.stdout: "exported": 0, 2023-08-10T12:05:52.787 INFO:teuthology.orchestra.run.smithi156.stdout: "exported_inodes": 0, 2023-08-10T12:05:52.787 INFO:teuthology.orchestra.run.smithi156.stdout: "imported": 0, 2023-08-10T12:05:52.787 INFO:teuthology.orchestra.run.smithi156.stdout: "imported_inodes": 0, 2023-08-10T12:05:52.787 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_dir_fetch": 0, 2023-08-10T12:05:52.788 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_backtrace_fetch": 0, 2023-08-10T12:05:52.788 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_peer_discover": 0, 2023-08-10T12:05:52.788 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rfiles": 0, 2023-08-10T12:05:52.788 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rbytes": 0, 2023-08-10T12:05:52.788 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rsnaps": 0, 2023-08-10T12:05:52.788 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_backtrace_fetch": 0, 2023-08-10T12:05:52.788 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_set_tag": 0, 2023-08-10T12:05:52.788 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_backtrace_repaired": 0, 2023-08-10T12:05:52.789 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_inotable_repaired": 0, 2023-08-10T12:05:52.789 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dir_inodes": 0, 2023-08-10T12:05:52.789 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dir_base_inodes": 0, 2023-08-10T12:05:52.789 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dirfrag_rstats": 0, 2023-08-10T12:05:52.789 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_file_inodes": 0, 2023-08-10T12:05:52.789 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_inode_file_caps": 0, 2023-08-10T12:05:52.789 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_revoke": 0, 2023-08-10T12:05:52.789 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_grant": 0, 2023-08-10T12:05:52.790 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_trunc": 0, 2023-08-10T12:05:52.790 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-10T12:05:52.790 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-10T12:05:52.790 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_caps": 0, 2023-08-10T12:05:52.790 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_caps_dirty": 0, 2023-08-10T12:05:52.790 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_cap_release": 0, 2023-08-10T12:05:52.790 INFO:teuthology.orchestra.run.smithi156.stdout: "process_request_cap_release": 0 2023-08-10T12:05:52.790 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.791 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_cache": { 2023-08-10T12:05:52.791 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_update": 0, 2023-08-10T12:05:52.791 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_update_receipt": 0, 2023-08-10T12:05:52.791 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_try_discover": 0, 2023-08-10T12:05:52.791 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_send_discover": 0, 2023-08-10T12:05:52.791 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_handle_discover": 0, 2023-08-10T12:05:52.791 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays": 0, 2023-08-10T12:05:52.792 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays_delayed": 0, 2023-08-10T12:05:52.792 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays_enqueuing": 0, 2023-08-10T12:05:52.792 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_created": 0, 2023-08-10T12:05:52.792 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_enqueued": 0, 2023-08-10T12:05:52.792 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_reintegrated": 0, 2023-08-10T12:05:52.792 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_migrated": 0, 2023-08-10T12:05:52.792 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_processing": 0, 2023-08-10T12:05:52.793 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_enqueued": 0, 2023-08-10T12:05:52.793 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_prioritized": 0, 2023-08-10T12:05:52.793 INFO:teuthology.orchestra.run.smithi156.stdout: "recovery_started": 0, 2023-08-10T12:05:52.793 INFO:teuthology.orchestra.run.smithi156.stdout: "recovery_completed": 0, 2023-08-10T12:05:52.793 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_enqueue_scrub": 0, 2023-08-10T12:05:52.793 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_exportdir": 0, 2023-08-10T12:05:52.793 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_flush": 0, 2023-08-10T12:05:52.793 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_fragmentdir": 0, 2023-08-10T12:05:52.794 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_fragstats": 0, 2023-08-10T12:05:52.794 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_inodestats": 0 2023-08-10T12:05:52.794 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.794 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_log": { 2023-08-10T12:05:52.794 INFO:teuthology.orchestra.run.smithi156.stdout: "evadd": 0, 2023-08-10T12:05:52.794 INFO:teuthology.orchestra.run.smithi156.stdout: "evex": 0, 2023-08-10T12:05:52.794 INFO:teuthology.orchestra.run.smithi156.stdout: "evtrm": 0, 2023-08-10T12:05:52.794 INFO:teuthology.orchestra.run.smithi156.stdout: "ev": 0, 2023-08-10T12:05:52.795 INFO:teuthology.orchestra.run.smithi156.stdout: "evexg": 0, 2023-08-10T12:05:52.795 INFO:teuthology.orchestra.run.smithi156.stdout: "evexd": 0, 2023-08-10T12:05:52.795 INFO:teuthology.orchestra.run.smithi156.stdout: "segadd": 0, 2023-08-10T12:05:52.795 INFO:teuthology.orchestra.run.smithi156.stdout: "segex": 0, 2023-08-10T12:05:52.795 INFO:teuthology.orchestra.run.smithi156.stdout: "segtrm": 0, 2023-08-10T12:05:52.795 INFO:teuthology.orchestra.run.smithi156.stdout: "seg": 81, 2023-08-10T12:05:52.795 INFO:teuthology.orchestra.run.smithi156.stdout: "segexg": 0, 2023-08-10T12:05:52.796 INFO:teuthology.orchestra.run.smithi156.stdout: "segexd": 0, 2023-08-10T12:05:52.796 INFO:teuthology.orchestra.run.smithi156.stdout: "expos": 4194304, 2023-08-10T12:05:52.796 INFO:teuthology.orchestra.run.smithi156.stdout: "wrpos": 0, 2023-08-10T12:05:52.796 INFO:teuthology.orchestra.run.smithi156.stdout: "rdpos": 171209419, 2023-08-10T12:05:52.796 INFO:teuthology.orchestra.run.smithi156.stdout: "jlat": { 2023-08-10T12:05:52.797 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.797 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.797 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.797 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.797 INFO:teuthology.orchestra.run.smithi156.stdout: "replayed": 56046 2023-08-10T12:05:52.797 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.797 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_mem": { 2023-08-10T12:05:52.797 INFO:teuthology.orchestra.run.smithi156.stdout: "ino": 13, 2023-08-10T12:05:52.798 INFO:teuthology.orchestra.run.smithi156.stdout: "ino+": 26669, 2023-08-10T12:05:52.798 INFO:teuthology.orchestra.run.smithi156.stdout: "ino-": 26656, 2023-08-10T12:05:52.798 INFO:teuthology.orchestra.run.smithi156.stdout: "dir": 11, 2023-08-10T12:05:52.798 INFO:teuthology.orchestra.run.smithi156.stdout: "dir+": 829, 2023-08-10T12:05:52.798 INFO:teuthology.orchestra.run.smithi156.stdout: "dir-": 818, 2023-08-10T12:05:52.798 INFO:teuthology.orchestra.run.smithi156.stdout: "dn": 6466, 2023-08-10T12:05:52.798 INFO:teuthology.orchestra.run.smithi156.stdout: "dn+": 44360, 2023-08-10T12:05:52.798 INFO:teuthology.orchestra.run.smithi156.stdout: "dn-": 37894, 2023-08-10T12:05:52.799 INFO:teuthology.orchestra.run.smithi156.stdout: "cap": 0, 2023-08-10T12:05:52.799 INFO:teuthology.orchestra.run.smithi156.stdout: "cap+": 0, 2023-08-10T12:05:52.799 INFO:teuthology.orchestra.run.smithi156.stdout: "cap-": 0, 2023-08-10T12:05:52.799 INFO:teuthology.orchestra.run.smithi156.stdout: "rss": 76936, 2023-08-10T12:05:52.799 INFO:teuthology.orchestra.run.smithi156.stdout: "heap": 207152 2023-08-10T12:05:52.799 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.799 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_server": { 2023-08-10T12:05:52.799 INFO:teuthology.orchestra.run.smithi156.stdout: "dispatch_client_request": 0, 2023-08-10T12:05:52.800 INFO:teuthology.orchestra.run.smithi156.stdout: "dispatch_server_request": 0, 2023-08-10T12:05:52.800 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_request": 0, 2023-08-10T12:05:52.800 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_session": 0, 2023-08-10T12:05:52.800 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_peer_request": 0, 2023-08-10T12:05:52.800 INFO:teuthology.orchestra.run.smithi156.stdout: "req_create_latency": { 2023-08-10T12:05:52.800 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.800 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.801 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.801 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.801 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getattr_latency": { 2023-08-10T12:05:52.801 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.801 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.801 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.801 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.801 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getfilelock_latency": { 2023-08-10T12:05:52.802 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.802 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.802 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.802 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.802 INFO:teuthology.orchestra.run.smithi156.stdout: "req_link_latency": { 2023-08-10T12:05:52.802 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.802 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.803 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.803 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.803 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookup_latency": { 2023-08-10T12:05:52.803 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.803 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.803 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.803 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.803 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookuphash_latency": { 2023-08-10T12:05:52.804 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.804 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.804 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.804 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.804 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupino_latency": { 2023-08-10T12:05:52.804 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.804 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.804 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.805 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.805 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupname_latency": { 2023-08-10T12:05:52.805 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.805 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.805 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.805 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.805 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupparent_latency": { 2023-08-10T12:05:52.806 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.806 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.806 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.806 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.806 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupsnap_latency": { 2023-08-10T12:05:52.806 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.806 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.807 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.807 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.807 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lssnap_latency": { 2023-08-10T12:05:52.807 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.807 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.807 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.807 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.808 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mkdir_latency": { 2023-08-10T12:05:52.808 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.808 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.808 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.808 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.808 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mknod_latency": { 2023-08-10T12:05:52.808 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.809 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.809 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.809 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.809 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mksnap_latency": { 2023-08-10T12:05:52.809 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.809 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.809 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.809 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.810 INFO:teuthology.orchestra.run.smithi156.stdout: "req_open_latency": { 2023-08-10T12:05:52.810 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.810 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.810 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.810 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.810 INFO:teuthology.orchestra.run.smithi156.stdout: "req_readdir_latency": { 2023-08-10T12:05:52.810 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.810 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.811 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.811 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.811 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rename_latency": { 2023-08-10T12:05:52.811 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.811 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.811 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.811 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.811 INFO:teuthology.orchestra.run.smithi156.stdout: "req_renamesnap_latency": { 2023-08-10T12:05:52.812 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.812 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.812 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.812 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.812 INFO:teuthology.orchestra.run.smithi156.stdout: "req_snapdiff_latency": { 2023-08-10T12:05:52.812 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.812 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.813 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.813 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.813 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmdir_latency": { 2023-08-10T12:05:52.813 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.813 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.813 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.813 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.813 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmsnap_latency": { 2023-08-10T12:05:52.814 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.814 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.814 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.814 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.814 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmxattr_latency": { 2023-08-10T12:05:52.814 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.814 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.814 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.815 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.815 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setattr_latency": { 2023-08-10T12:05:52.815 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.815 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.815 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.815 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.815 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setdirlayout_latency": { 2023-08-10T12:05:52.816 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.816 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.816 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.816 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.816 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setfilelock_latency": { 2023-08-10T12:05:52.816 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.816 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.817 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.817 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.817 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setlayout_latency": { 2023-08-10T12:05:52.817 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.817 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.817 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.817 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.818 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setxattr_latency": { 2023-08-10T12:05:52.818 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.818 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.818 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.818 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.818 INFO:teuthology.orchestra.run.smithi156.stdout: "req_symlink_latency": { 2023-08-10T12:05:52.818 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.818 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.819 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.819 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.819 INFO:teuthology.orchestra.run.smithi156.stdout: "req_unlink_latency": { 2023-08-10T12:05:52.819 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.819 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.819 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.819 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.820 INFO:teuthology.orchestra.run.smithi156.stdout: "cap_revoke_eviction": 0, 2023-08-10T12:05:52.820 INFO:teuthology.orchestra.run.smithi156.stdout: "cap_acquisition_throttle": 0, 2023-08-10T12:05:52.820 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getvxattr_latency": { 2023-08-10T12:05:52.820 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.820 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.820 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.820 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:52.820 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.821 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_sessions": { 2023-08-10T12:05:52.821 INFO:teuthology.orchestra.run.smithi156.stdout: "session_count": 1, 2023-08-10T12:05:52.821 INFO:teuthology.orchestra.run.smithi156.stdout: "session_add": 2, 2023-08-10T12:05:52.821 INFO:teuthology.orchestra.run.smithi156.stdout: "session_remove": 1, 2023-08-10T12:05:52.821 INFO:teuthology.orchestra.run.smithi156.stdout: "sessions_open": 2, 2023-08-10T12:05:52.821 INFO:teuthology.orchestra.run.smithi156.stdout: "sessions_stale": 0, 2023-08-10T12:05:52.821 INFO:teuthology.orchestra.run.smithi156.stdout: "total_load": 0, 2023-08-10T12:05:52.822 INFO:teuthology.orchestra.run.smithi156.stdout: "average_load": 0, 2023-08-10T12:05:52.822 INFO:teuthology.orchestra.run.smithi156.stdout: "avg_session_uptime": 5291 2023-08-10T12:05:52.822 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.822 INFO:teuthology.orchestra.run.smithi156.stdout: "mempool": { 2023-08-10T12:05:52.822 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_bytes": 0, 2023-08-10T12:05:52.822 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_items": 0, 2023-08-10T12:05:52.822 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_bytes": 0, 2023-08-10T12:05:52.823 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_items": 0, 2023-08-10T12:05:52.823 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_bytes": 0, 2023-08-10T12:05:52.823 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_items": 0, 2023-08-10T12:05:52.823 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-10T12:05:52.823 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_items": 0, 2023-08-10T12:05:52.823 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-10T12:05:52.823 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_items": 0, 2023-08-10T12:05:52.823 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_bytes": 0, 2023-08-10T12:05:52.824 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_items": 0, 2023-08-10T12:05:52.824 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-10T12:05:52.824 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_items": 0, 2023-08-10T12:05:52.824 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_bytes": 0, 2023-08-10T12:05:52.824 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_items": 0, 2023-08-10T12:05:52.824 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_bytes": 0, 2023-08-10T12:05:52.824 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_items": 0, 2023-08-10T12:05:52.824 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-10T12:05:52.825 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_items": 0, 2023-08-10T12:05:52.825 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-10T12:05:52.825 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_items": 0, 2023-08-10T12:05:52.825 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_bytes": 0, 2023-08-10T12:05:52.825 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_items": 0, 2023-08-10T12:05:52.825 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_bytes": 0, 2023-08-10T12:05:52.825 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_items": 0, 2023-08-10T12:05:52.825 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-10T12:05:52.826 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_items": 0, 2023-08-10T12:05:52.826 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_bytes": 0, 2023-08-10T12:05:52.826 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_items": 0, 2023-08-10T12:05:52.826 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_bytes": 0, 2023-08-10T12:05:52.826 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_items": 0, 2023-08-10T12:05:52.826 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_bytes": 0, 2023-08-10T12:05:52.826 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_items": 0, 2023-08-10T12:05:52.827 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_bytes": 0, 2023-08-10T12:05:52.827 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_items": 0, 2023-08-10T12:05:52.827 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_bytes": 223311, 2023-08-10T12:05:52.827 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_items": 71, 2023-08-10T12:05:52.827 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_bytes": 0, 2023-08-10T12:05:52.827 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_items": 0, 2023-08-10T12:05:52.828 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_bytes": 0, 2023-08-10T12:05:52.828 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_items": 0, 2023-08-10T12:05:52.828 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_bytes": 0, 2023-08-10T12:05:52.828 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_items": 0, 2023-08-10T12:05:52.828 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_bytes": 0, 2023-08-10T12:05:52.828 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_items": 0, 2023-08-10T12:05:52.828 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_bytes": 8032, 2023-08-10T12:05:52.829 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_items": 167, 2023-08-10T12:05:52.829 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_bytes": 0, 2023-08-10T12:05:52.829 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_items": 0, 2023-08-10T12:05:52.829 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_bytes": 0, 2023-08-10T12:05:52.829 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_items": 0, 2023-08-10T12:05:52.829 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_bytes": 4642752, 2023-08-10T12:05:52.829 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_items": 26066, 2023-08-10T12:05:52.829 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_bytes": 0, 2023-08-10T12:05:52.830 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_items": 0, 2023-08-10T12:05:52.830 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_bytes": 0, 2023-08-10T12:05:52.830 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_items": 0 2023-08-10T12:05:52.830 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.830 INFO:teuthology.orchestra.run.smithi156.stdout: "objecter": { 2023-08-10T12:05:52.830 INFO:teuthology.orchestra.run.smithi156.stdout: "op_active": 0, 2023-08-10T12:05:52.830 INFO:teuthology.orchestra.run.smithi156.stdout: "op_laggy": 0, 2023-08-10T12:05:52.830 INFO:teuthology.orchestra.run.smithi156.stdout: "op_send": 2996, 2023-08-10T12:05:52.831 INFO:teuthology.orchestra.run.smithi156.stdout: "op_send_bytes": 21, 2023-08-10T12:05:52.831 INFO:teuthology.orchestra.run.smithi156.stdout: "op_resend": 3, 2023-08-10T12:05:52.831 INFO:teuthology.orchestra.run.smithi156.stdout: "op_reply": 2996, 2023-08-10T12:05:52.831 INFO:teuthology.orchestra.run.smithi156.stdout: "op_latency": { 2023-08-10T12:05:52.831 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 2996, 2023-08-10T12:05:52.831 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 15.793768019, 2023-08-10T12:05:52.831 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.005271618 2023-08-10T12:05:52.831 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.832 INFO:teuthology.orchestra.run.smithi156.stdout: "op_inflight": 0, 2023-08-10T12:05:52.832 INFO:teuthology.orchestra.run.smithi156.stdout: "oplen_avg": { 2023-08-10T12:05:52.832 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 2996, 2023-08-10T12:05:52.832 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 2997 2023-08-10T12:05:52.832 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.832 INFO:teuthology.orchestra.run.smithi156.stdout: "op": 2996, 2023-08-10T12:05:52.832 INFO:teuthology.orchestra.run.smithi156.stdout: "op_r": 2996, 2023-08-10T12:05:52.833 INFO:teuthology.orchestra.run.smithi156.stdout: "op_w": 0, 2023-08-10T12:05:52.833 INFO:teuthology.orchestra.run.smithi156.stdout: "op_rmw": 0, 2023-08-10T12:05:52.833 INFO:teuthology.orchestra.run.smithi156.stdout: "op_pg": 0, 2023-08-10T12:05:52.833 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_stat": 1749, 2023-08-10T12:05:52.833 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_create": 0, 2023-08-10T12:05:52.833 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_read": 1245, 2023-08-10T12:05:52.833 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_write": 0, 2023-08-10T12:05:52.833 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_writefull": 0, 2023-08-10T12:05:52.834 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_writesame": 0, 2023-08-10T12:05:52.834 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_append": 0, 2023-08-10T12:05:52.834 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_zero": 0, 2023-08-10T12:05:52.834 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_truncate": 0, 2023-08-10T12:05:52.834 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_delete": 0, 2023-08-10T12:05:52.834 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_mapext": 0, 2023-08-10T12:05:52.834 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_sparse_read": 0, 2023-08-10T12:05:52.834 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_clonerange": 0, 2023-08-10T12:05:52.835 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_getxattr": 1, 2023-08-10T12:05:52.835 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_setxattr": 0, 2023-08-10T12:05:52.835 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_cmpxattr": 0, 2023-08-10T12:05:52.835 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_rmxattr": 0, 2023-08-10T12:05:52.835 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_resetxattrs": 0, 2023-08-10T12:05:52.835 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_call": 0, 2023-08-10T12:05:52.835 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_watch": 0, 2023-08-10T12:05:52.835 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_notify": 0, 2023-08-10T12:05:52.836 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_src_cmpxattr": 0, 2023-08-10T12:05:52.836 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_pgls": 0, 2023-08-10T12:05:52.836 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_pgls_filter": 0, 2023-08-10T12:05:52.836 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_other": 0, 2023-08-10T12:05:52.836 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_active": 0, 2023-08-10T12:05:52.836 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_send": 0, 2023-08-10T12:05:52.836 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_resend": 0, 2023-08-10T12:05:52.836 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_ping": 0, 2023-08-10T12:05:52.837 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_active": 0, 2023-08-10T12:05:52.837 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_send": 0, 2023-08-10T12:05:52.837 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_resend": 0, 2023-08-10T12:05:52.837 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_active": 0, 2023-08-10T12:05:52.837 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_send": 0, 2023-08-10T12:05:52.837 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_resend": 0, 2023-08-10T12:05:52.838 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_active": 0, 2023-08-10T12:05:52.838 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_send": 0, 2023-08-10T12:05:52.838 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_resend": 0, 2023-08-10T12:05:52.838 INFO:teuthology.orchestra.run.smithi156.stdout: "command_active": 0, 2023-08-10T12:05:52.838 INFO:teuthology.orchestra.run.smithi156.stdout: "command_send": 0, 2023-08-10T12:05:52.838 INFO:teuthology.orchestra.run.smithi156.stdout: "command_resend": 0, 2023-08-10T12:05:52.838 INFO:teuthology.orchestra.run.smithi156.stdout: "map_epoch": 98, 2023-08-10T12:05:52.838 INFO:teuthology.orchestra.run.smithi156.stdout: "map_full": 0, 2023-08-10T12:05:52.839 INFO:teuthology.orchestra.run.smithi156.stdout: "map_inc": 15, 2023-08-10T12:05:52.839 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_sessions": 9, 2023-08-10T12:05:52.839 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_session_open": 9, 2023-08-10T12:05:52.839 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_session_close": 0, 2023-08-10T12:05:52.839 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_laggy": 0, 2023-08-10T12:05:52.839 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_wr": 0, 2023-08-10T12:05:52.839 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_rd": 2, 2023-08-10T12:05:52.840 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_del": 0 2023-08-10T12:05:52.840 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.840 INFO:teuthology.orchestra.run.smithi156.stdout: "oft": { 2023-08-10T12:05:52.840 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_objs": 0, 2023-08-10T12:05:52.840 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_kv_pairs": 0, 2023-08-10T12:05:52.840 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_updates": 0, 2023-08-10T12:05:52.840 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_removes": 0 2023-08-10T12:05:52.841 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.841 INFO:teuthology.orchestra.run.smithi156.stdout: "osd-slow-ops": { 2023-08-10T12:05:52.841 INFO:teuthology.orchestra.run.smithi156.stdout: "slow_ops_count": 0 2023-08-10T12:05:52.841 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.841 INFO:teuthology.orchestra.run.smithi156.stdout: "purge_queue": { 2023-08-10T12:05:52.841 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_ops": 0, 2023-08-10T12:05:52.841 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_ops_high_water": 0, 2023-08-10T12:05:52.841 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing": 0, 2023-08-10T12:05:52.842 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_high_water": 0, 2023-08-10T12:05:52.842 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executed": 0, 2023-08-10T12:05:52.842 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_item_in_journal": 0 2023-08-10T12:05:52.842 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.842 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-10T12:05:52.842 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-08-10T12:05:52.842 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 104857600, 2023-08-10T12:05:52.843 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-08-10T12:05:52.843 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 3308, 2023-08-10T12:05:52.843 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 169213111, 2023-08-10T12:05:52.843 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:52.843 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 3308, 2023-08-10T12:05:52.843 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-08-10T12:05:52.843 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-08-10T12:05:52.843 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 3308, 2023-08-10T12:05:52.844 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 169213111, 2023-08-10T12:05:52.844 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-08-10T12:05:52.844 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.844 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.844 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.844 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:52.844 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.845 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-objecter_bytes": { 2023-08-10T12:05:52.845 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-08-10T12:05:52.845 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 104857600, 2023-08-10T12:05:52.845 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-08-10T12:05:52.845 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-08-10T12:05:52.845 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-08-10T12:05:52.845 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:52.845 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:52.846 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 2996, 2023-08-10T12:05:52.846 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 167036852, 2023-08-10T12:05:52.846 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 2996, 2023-08-10T12:05:52.846 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 167036852, 2023-08-10T12:05:52.846 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-08-10T12:05:52.846 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.846 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.846 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.847 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:52.847 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.847 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-objecter_ops": { 2023-08-10T12:05:52.847 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-08-10T12:05:52.847 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 1024, 2023-08-10T12:05:52.847 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-08-10T12:05:52.847 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-08-10T12:05:52.847 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-08-10T12:05:52.848 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:52.848 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:52.848 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 2996, 2023-08-10T12:05:52.848 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 2996, 2023-08-10T12:05:52.848 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 2996, 2023-08-10T12:05:52.848 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 2996, 2023-08-10T12:05:52.849 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-08-10T12:05:52.849 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.849 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.849 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.849 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:52.849 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.849 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-write_buf_throttle": { 2023-08-10T12:05:52.850 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-08-10T12:05:52.850 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 3758096384, 2023-08-10T12:05:52.850 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-08-10T12:05:52.850 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-08-10T12:05:52.850 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-08-10T12:05:52.850 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:52.850 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:52.850 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-08-10T12:05:52.851 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-08-10T12:05:52.851 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 0, 2023-08-10T12:05:52.851 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 0, 2023-08-10T12:05:52.851 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-08-10T12:05:52.851 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.851 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.851 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.851 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:52.852 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-08-10T12:05:52.852 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-write_buf_throttle-0x5581c8c04460": { 2023-08-10T12:05:52.852 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-08-10T12:05:52.852 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 3758096384, 2023-08-10T12:05:52.852 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-08-10T12:05:52.852 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-08-10T12:05:52.852 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-08-10T12:05:52.853 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-08-10T12:05:52.853 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-08-10T12:05:52.853 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-08-10T12:05:52.853 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-08-10T12:05:52.853 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 0, 2023-08-10T12:05:52.853 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 0, 2023-08-10T12:05:52.853 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-08-10T12:05:52.853 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-08-10T12:05:52.854 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-08-10T12:05:52.854 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-08-10T12:05:52.854 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:52.854 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-08-10T12:05:52.854 INFO:teuthology.orchestra.run.smithi156.stdout:} 2023-08-10T12:05:53.175 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2023-08-10T12:05:53.175 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2023-08-10T12:05:53.176 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2023-08-10T12:05:53.176 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2023-08-10T12:05:53.176 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2023-08-10T12:05:53.177 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2023-08-10T12:05:53.177 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2023-08-10T12:05:53.177 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=0 2023-08-10T12:05:53.177 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-08-10T12:05:53.189 INFO:tasks.kclient:Unmounting kernel clients... 2023-08-10T12:05:53.190 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-08-10T12:05:53.190 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T12:05:53.213 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-08-10T12:05:53.214 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T12:05:53.274 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T12:05:53.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.449+0000 7f4ebca9f700 1 -- 172.21.15.73:0/2688571857 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eb80ff210 msgr2=0x7f4eb80ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:53.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.449+0000 7f4ebca9f700 1 --2- 172.21.15.73:0/2688571857 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eb80ff210 0x7f4eb80ff5f0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f4eac0099c0 tx=0x7f4eac009cd0 comp rx=0 tx=0).stop 2023-08-10T12:05:53.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.449+0000 7f4ebca9f700 1 -- 172.21.15.73:0/2688571857 shutdown_connections 2023-08-10T12:05:53.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.449+0000 7f4ebca9f700 1 --2- 172.21.15.73:0/2688571857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4eb8104100 0x7f4eb810bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:53.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.449+0000 7f4ebca9f700 1 --2- 172.21.15.73:0/2688571857 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eb80ff210 0x7f4eb80ff5f0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:53.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.449+0000 7f4ebca9f700 1 --2- 172.21.15.73:0/2688571857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4eb80ffbc0 0x7f4eb81039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:53.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.449+0000 7f4ebca9f700 1 -- 172.21.15.73:0/2688571857 >> 172.21.15.73:0/2688571857 conn(0x7f4eb8075900 msgr2=0x7f4eb8075d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:53.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.449+0000 7f4ebca9f700 1 -- 172.21.15.73:0/2688571857 shutdown_connections 2023-08-10T12:05:53.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.449+0000 7f4ebca9f700 1 -- 172.21.15.73:0/2688571857 wait complete. 2023-08-10T12:05:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.450+0000 7f4ebca9f700 1 Processor -- start 2023-08-10T12:05:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.450+0000 7f4ebca9f700 1 -- start start 2023-08-10T12:05:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.450+0000 7f4ebca9f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4eb80ff210 0x7f4eb8196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:53.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.450+0000 7f4ebca9f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4eb8104100 0x7f4eb8196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:53.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.450+0000 7f4ebca9f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eb8199ff0 0x7f4eb819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:53.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.450+0000 7f4ebca9f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb819a9e0 con 0x7f4eb8199ff0 2023-08-10T12:05:53.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.450+0000 7f4ebca9f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb819ab50 con 0x7f4eb80ff210 2023-08-10T12:05:53.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.450+0000 7f4ebca9f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb819ad10 con 0x7f4eb8104100 2023-08-10T12:05:53.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.450+0000 7f4eb6d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eb8199ff0 0x7f4eb819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:53.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.451+0000 7f4eb6d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eb8199ff0 0x7f4eb819a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37128/0 (socket says 172.21.15.73:37128) 2023-08-10T12:05:53.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.451+0000 7f4eb6d9d700 1 -- 172.21.15.73:0/1682373813 learned_addr learned my addr 172.21.15.73:0/1682373813 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:05:53.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.451+0000 7f4eb5d9b700 1 --2- 172.21.15.73:0/1682373813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4eb8104100 0x7f4eb8196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:53.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.451+0000 7f4eb659c700 1 --2- 172.21.15.73:0/1682373813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4eb80ff210 0x7f4eb8196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:53.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.451+0000 7f4eb6d9d700 1 -- 172.21.15.73:0/1682373813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4eb8104100 msgr2=0x7f4eb8196c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:53.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.451+0000 7f4eb6d9d700 1 --2- 172.21.15.73:0/1682373813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4eb8104100 0x7f4eb8196c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:53.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.451+0000 7f4eb6d9d700 1 -- 172.21.15.73:0/1682373813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4eb80ff210 msgr2=0x7f4eb8196700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:53.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.451+0000 7f4eb6d9d700 1 --2- 172.21.15.73:0/1682373813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4eb80ff210 0x7f4eb8196700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:53.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.451+0000 7f4eb6d9d700 1 -- 172.21.15.73:0/1682373813 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eac0095f0 con 0x7f4eb8199ff0 2023-08-10T12:05:53.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.451+0000 7f4eb6d9d700 1 --2- 172.21.15.73:0/1682373813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eb8199ff0 0x7f4eb819a4a0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0007d70 tx=0x7f4eb000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:53.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.451+0000 7f4ea77fe700 1 -- 172.21.15.73:0/1682373813 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb000ac90 con 0x7f4eb8199ff0 2023-08-10T12:05:53.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.451+0000 7f4ea77fe700 1 -- 172.21.15.73:0/1682373813 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4eb000adf0 con 0x7f4eb8199ff0 2023-08-10T12:05:53.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.451+0000 7f4ebca9f700 1 -- 172.21.15.73:0/1682373813 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb81a3380 con 0x7f4eb8199ff0 2023-08-10T12:05:53.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.451+0000 7f4ea77fe700 1 -- 172.21.15.73:0/1682373813 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb00115e0 con 0x7f4eb8199ff0 2023-08-10T12:05:53.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.451+0000 7f4ebca9f700 1 -- 172.21.15.73:0/1682373813 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb81a3890 con 0x7f4eb8199ff0 2023-08-10T12:05:53.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.452+0000 7f4ebca9f700 1 -- 172.21.15.73:0/1682373813 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb81093a0 con 0x7f4eb8199ff0 2023-08-10T12:05:53.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.453+0000 7f4ea77fe700 1 -- 172.21.15.73:0/1682373813 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f4eb0012420 con 0x7f4eb8199ff0 2023-08-10T12:05:53.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.454+0000 7f4ea77fe700 1 --2- 172.21.15.73:0/1682373813 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f4ea00a1340 0x7f4ea00a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:53.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.454+0000 7f4eb659c700 1 --2- 172.21.15.73:0/1682373813 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f4ea00a1340 0x7f4ea00a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:53.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.454+0000 7f4ea77fe700 1 -- 172.21.15.73:0/1682373813 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4eb00cd0f0 con 0x7f4eb8199ff0 2023-08-10T12:05:53.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.454+0000 7f4eb659c700 1 --2- 172.21.15.73:0/1682373813 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f4ea00a1340 0x7f4ea00a3800 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4eac009fd0 tx=0x7f4eac005fb0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:53.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.457+0000 7f4ea77fe700 1 -- 172.21.15.73:0/1682373813 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f4eb0096610 con 0x7f4eb8199ff0 2023-08-10T12:05:53.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:53 smithi152 ceph-mon[130220]: pgmap v412: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.6 KiB/s wr, 12 op/s 2023-08-10T12:05:53.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:53 smithi156 ceph-mon[130574]: pgmap v412: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.6 KiB/s wr, 12 op/s 2023-08-10T12:05:53.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:53 smithi073 ceph-mon[128869]: pgmap v412: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.6 KiB/s wr, 12 op/s 2023-08-10T12:05:53.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.648+0000 7f4ebca9f700 1 -- 172.21.15.73:0/1682373813 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4eb8066cd0 con 0x7f4eb8199ff0 2023-08-10T12:05:53.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.649+0000 7f4ea77fe700 1 -- 172.21.15.73:0/1682373813 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+22949 (secure 0 0 0) 0x7f4eb0099c30 con 0x7f4eb8199ff0 2023-08-10T12:05:53.651 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-10T12:05:53.652 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":98,"fsid":"0e619a74-3773-11ee-9b37-001a4aab830c","created":"2023-08-10T11:43:53.974768+0000","modified":"2023-08-10T12:04:48.887005+0000","last_up_change":"2023-08-10T11:50:12.914422+0000","last_in_change":"2023-08-10T11:49:54.624543+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T11:46:58.735153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T11:50:52.517974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T11:50:53.465357+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":19,"snap_epoch":97,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3219ae18-cc4c-4712-b616-79f6949066e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6803","nonce":2725694252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6805","nonce":2725694252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6809","nonce":2725694252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2725694252},{"type":"v1","addr":"172.21.15.73:6807","nonce":2725694252}]},"public_addr":"172.21.15.73:6803/2725694252","cluster_addr":"172.21.15.73:6805/2725694252","heartbeat_back_addr":"172.21.15.73:6809/2725694252","heartbeat_front_addr":"172.21.15.73:6807/2725694252","state":["exists","up"]},{"osd":1,"uuid":"bbfe6cd9-b3d3-4b8d-8814-507a867f8c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6801","nonce":836829168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6803","nonce":836829168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6807","nonce":836829168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":836829168},{"type":"v1","addr":"172.21.15.152:6805","nonce":836829168}]},"public_addr":"172.21.15.152:6801/836829168","cluster_addr":"172.21.15.152:6803/836829168","heartbeat_back_addr":"172.21.15.152:6807/836829168","heartbeat_front_addr":"172.21.15.152:6805/836829168","state":["exists","up"]},{"osd":2,"uuid":"f57f5b2c-3208-45c0-beba-8501694b99c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6801","nonce":1789212298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6803","nonce":1789212298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6807","nonce":1789212298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":1789212298},{"type":"v1","addr":"172.21.15.156:6805","nonce":1789212298}]},"public_addr":"172.21.15.156:6801/1789212298","cluster_addr":"172.21.15.156:6803/1789212298","heartbeat_back_addr":"172.21.15.156:6807/1789212298","heartbeat_front_addr":"172.21.15.156:6805/1789212298","state":["exists","up"]},{"osd":3,"uuid":"18592408-3696-4ab8-ad41-c172b8409829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6811","nonce":3101572649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6813","nonce":3101572649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6817","nonce":3101572649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":3101572649},{"type":"v1","addr":"172.21.15.73:6815","nonce":3101572649}]},"public_addr":"172.21.15.73:6811/3101572649","cluster_addr":"172.21.15.73:6813/3101572649","heartbeat_back_addr":"172.21.15.73:6817/3101572649","heartbeat_front_addr":"172.21.15.73:6815/3101572649","state":["exists","up"]},{"osd":4,"uuid":"fb3adb09-8807-42d9-8db9-1867c5fe02da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6809","nonce":1451517889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6811","nonce":1451517889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6815","nonce":1451517889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1451517889},{"type":"v1","addr":"172.21.15.152:6813","nonce":1451517889}]},"public_addr":"172.21.15.152:6809/1451517889","cluster_addr":"172.21.15.152:6811/1451517889","heartbeat_back_addr":"172.21.15.152:6815/1451517889","heartbeat_front_addr":"172.21.15.152:6813/1451517889","state":["exists","up"]},{"osd":5,"uuid":"af58a7bd-4e58-4639-95b2-4a76011b61dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6809","nonce":3823368741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6811","nonce":3823368741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6815","nonce":3823368741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3823368741},{"type":"v1","addr":"172.21.15.156:6813","nonce":3823368741}]},"public_addr":"172.21.15.156:6809/3823368741","cluster_addr":"172.21.15.156:6811/3823368741","heartbeat_back_addr":"172.21.15.156:6815/3823368741","heartbeat_front_addr":"172.21.15.156:6813/3823368741","state":["exists","up"]},{"osd":6,"uuid":"f6ae502d-4af9-4f6a-8636-b5b683dfdfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6819","nonce":2533620458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6821","nonce":2533620458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6825","nonce":2533620458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2533620458},{"type":"v1","addr":"172.21.15.73:6823","nonce":2533620458}]},"public_addr":"172.21.15.73:6819/2533620458","cluster_addr":"172.21.15.73:6821/2533620458","heartbeat_back_addr":"172.21.15.73:6825/2533620458","heartbeat_front_addr":"172.21.15.73:6823/2533620458","state":["exists","up"]},{"osd":7,"uuid":"398fd334-5f6f-427c-95ae-3244fb466f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6817","nonce":4059538477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6819","nonce":4059538477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6823","nonce":4059538477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":4059538477},{"type":"v1","addr":"172.21.15.152:6821","nonce":4059538477}]},"public_addr":"172.21.15.152:6817/4059538477","cluster_addr":"172.21.15.152:6819/4059538477","heartbeat_back_addr":"172.21.15.152:6823/4059538477","heartbeat_front_addr":"172.21.15.152:6821/4059538477","state":["exists","up"]},{"osd":8,"uuid":"58f46e64-2624-4ad4-bb6a-225624153837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6817","nonce":96487555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6819","nonce":96487555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6823","nonce":96487555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":96487555},{"type":"v1","addr":"172.21.15.156:6821","nonce":96487555}]},"public_addr":"172.21.15.156:6817/96487555","cluster_addr":"172.21.15.156:6819/96487555","heartbeat_back_addr":"172.21.15.156:6823/96487555","heartbeat_front_addr":"172.21.15.156:6821/96487555","state":["exists","up"]},{"osd":9,"uuid":"9389dd5b-da2d-43b6-8bc0-bb1af13f72c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6827","nonce":2050124321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6829","nonce":2050124321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6833","nonce":2050124321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2050124321},{"type":"v1","addr":"172.21.15.73:6831","nonce":2050124321}]},"public_addr":"172.21.15.73:6827/2050124321","cluster_addr":"172.21.15.73:6829/2050124321","heartbeat_back_addr":"172.21.15.73:6833/2050124321","heartbeat_front_addr":"172.21.15.73:6831/2050124321","state":["exists","up"]},{"osd":10,"uuid":"563c1e34-3acd-46ab-ba36-e9d87f635e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6825","nonce":1513186350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6827","nonce":1513186350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6831","nonce":1513186350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1513186350},{"type":"v1","addr":"172.21.15.152:6829","nonce":1513186350}]},"public_addr":"172.21.15.152:6825/1513186350","cluster_addr":"172.21.15.152:6827/1513186350","heartbeat_back_addr":"172.21.15.152:6831/1513186350","heartbeat_front_addr":"172.21.15.152:6829/1513186350","state":["exists","up"]},{"osd":11,"uuid":"f1b55889-14fd-4cc9-bed7-43748086fb77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6825","nonce":737904755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6827","nonce":737904755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6831","nonce":737904755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":737904755},{"type":"v1","addr":"172.21.15.156:6829","nonce":737904755}]},"public_addr":"172.21.15.156:6825/737904755","cluster_addr":"172.21.15.156:6827/737904755","heartbeat_back_addr":"172.21.15.156:6831/737904755","heartbeat_front_addr":"172.21.15.156:6829/737904755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:12.023797+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:33.872883+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:46:55.856970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:18.013196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:47:39.202872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:00.393920+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:22.743083+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:48:43.921728+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:05.859488+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:27.618714+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:49:48.880286+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T11:50:11.055141+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6800/3797582815":"2023-08-11T11:52:37.545186+0000","172.21.15.73:0/3346699990":"2023-08-11T11:52:37.545186+0000","172.21.15.73:0/2211661782":"2023-08-11T11:52:37.545186+0000","172.21.15.73:0/4199164995":"2023-08-11T11:52:37.545186+0000","172.21.15.73:0/978777874":"2023-08-11T11:52:37.545186+0000","172.21.15.73:0/2202785670":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6800/16358451":"2023-08-11T11:44:48.401660+0000","172.21.15.73:6801/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:6801/3797582815":"2023-08-11T11:52:37.545186+0000","172.21.15.73:6800/3290717807":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/1447381524":"2023-08-11T11:44:48.401660+0000","172.21.15.73:0/2545059698":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/4193457623":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2561039569":"2023-08-11T11:44:25.974867+0000","172.21.15.73:0/2927950081":"2023-08-11T11:44:48.401660+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":7,"length":1},{"begin":19,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T12:05:53.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.651+0000 7f4ebca9f700 1 -- 172.21.15.73:0/1682373813 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f4ea00a1340 msgr2=0x7f4ea00a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:53.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.651+0000 7f4ebca9f700 1 --2- 172.21.15.73:0/1682373813 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f4ea00a1340 0x7f4ea00a3800 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4eac009fd0 tx=0x7f4eac005fb0 comp rx=0 tx=0).stop 2023-08-10T12:05:53.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.651+0000 7f4ebca9f700 1 -- 172.21.15.73:0/1682373813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eb8199ff0 msgr2=0x7f4eb819a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:53.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.651+0000 7f4ebca9f700 1 --2- 172.21.15.73:0/1682373813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eb8199ff0 0x7f4eb819a4a0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0007d70 tx=0x7f4eb000a340 comp rx=0 tx=0).stop 2023-08-10T12:05:53.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.651+0000 7f4ebca9f700 1 -- 172.21.15.73:0/1682373813 shutdown_connections 2023-08-10T12:05:53.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.651+0000 7f4ebca9f700 1 --2- 172.21.15.73:0/1682373813 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f4ea00a1340 0x7f4ea00a3800 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:53.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.651+0000 7f4ebca9f700 1 --2- 172.21.15.73:0/1682373813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4eb80ff210 0x7f4eb8196700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:53.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.651+0000 7f4ebca9f700 1 --2- 172.21.15.73:0/1682373813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eb8199ff0 0x7f4eb819a4a0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:53.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.651+0000 7f4ebca9f700 1 --2- 172.21.15.73:0/1682373813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4eb8104100 0x7f4eb8196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:53.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.651+0000 7f4ebca9f700 1 -- 172.21.15.73:0/1682373813 >> 172.21.15.73:0/1682373813 conn(0x7f4eb8075900 msgr2=0x7f4eb8102bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:53.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.651+0000 7f4ebca9f700 1 -- 172.21.15.73:0/1682373813 shutdown_connections 2023-08-10T12:05:53.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.651+0000 7f4ebca9f700 1 -- 172.21.15.73:0/1682373813 wait complete. 2023-08-10T12:05:53.665 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T11:46:58.735153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T11:50:52.517974+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T11:50:53.465357+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 19, 'snap_epoch': 97, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T12:05:53.666 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T12:05:53.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.790+0000 7f1b46f18700 1 -- 172.21.15.73:0/30023139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b400fff90 msgr2=0x7f1b4010c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:53.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.790+0000 7f1b46f18700 1 --2- 172.21.15.73:0/30023139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b400fff90 0x7f1b4010c450 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800b0d0 tx=0x7f1b3800b3e0 comp rx=0 tx=0).stop 2023-08-10T12:05:53.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.791+0000 7f1b46f18700 1 -- 172.21.15.73:0/30023139 shutdown_connections 2023-08-10T12:05:53.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.791+0000 7f1b46f18700 1 --2- 172.21.15.73:0/30023139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b400fff90 0x7f1b4010c450 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:53.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.791+0000 7f1b46f18700 1 --2- 172.21.15.73:0/30023139 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b40105690 0x7f1b40105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:53.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.791+0000 7f1b46f18700 1 --2- 172.21.15.73:0/30023139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b400ff5d0 0x7f1b400ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:53.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.791+0000 7f1b46f18700 1 -- 172.21.15.73:0/30023139 >> 172.21.15.73:0/30023139 conn(0x7f1b400fb0c0 msgr2=0x7f1b400fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:53.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.791+0000 7f1b46f18700 1 -- 172.21.15.73:0/30023139 shutdown_connections 2023-08-10T12:05:53.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.791+0000 7f1b46f18700 1 -- 172.21.15.73:0/30023139 wait complete. 2023-08-10T12:05:53.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.791+0000 7f1b46f18700 1 Processor -- start 2023-08-10T12:05:53.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.791+0000 7f1b46f18700 1 -- start start 2023-08-10T12:05:53.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.791+0000 7f1b46f18700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b400ff5d0 0x7f1b4019b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:53.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.791+0000 7f1b46f18700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b400fff90 0x7f1b4019ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:53.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.791+0000 7f1b46f18700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b40105690 0x7f1b401955b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:53.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.791+0000 7f1b46f18700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b40195c20 con 0x7f1b400ff5d0 2023-08-10T12:05:53.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.791+0000 7f1b46f18700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b40195d90 con 0x7f1b400fff90 2023-08-10T12:05:53.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.791+0000 7f1b46f18700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b40195f50 con 0x7f1b40105690 2023-08-10T12:05:53.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.791+0000 7f1b44cb4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b400ff5d0 0x7f1b4019b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:53.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.792+0000 7f1b44cb4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b400ff5d0 0x7f1b4019b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37138/0 (socket says 172.21.15.73:37138) 2023-08-10T12:05:53.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.792+0000 7f1b44cb4700 1 -- 172.21.15.73:0/3901877653 learned_addr learned my addr 172.21.15.73:0/3901877653 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:05:53.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.792+0000 7f1b454b5700 1 --2- 172.21.15.73:0/3901877653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b40105690 0x7f1b401955b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:53.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.792+0000 7f1b3ffff700 1 --2- 172.21.15.73:0/3901877653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b400fff90 0x7f1b4019ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:53.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.792+0000 7f1b44cb4700 1 -- 172.21.15.73:0/3901877653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b40105690 msgr2=0x7f1b401955b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:53.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.792+0000 7f1b44cb4700 1 --2- 172.21.15.73:0/3901877653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b40105690 0x7f1b401955b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:53.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.792+0000 7f1b44cb4700 1 -- 172.21.15.73:0/3901877653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b400fff90 msgr2=0x7f1b4019ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:53.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.792+0000 7f1b44cb4700 1 --2- 172.21.15.73:0/3901877653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b400fff90 0x7f1b4019ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:53.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.792+0000 7f1b44cb4700 1 -- 172.21.15.73:0/3901877653 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b34009520 con 0x7f1b400ff5d0 2023-08-10T12:05:53.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.792+0000 7f1b3ffff700 1 --2- 172.21.15.73:0/3901877653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b400fff90 0x7f1b4019ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T12:05:53.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.792+0000 7f1b44cb4700 1 --2- 172.21.15.73:0/3901877653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b400ff5d0 0x7f1b4019b540 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400ec40 tx=0x7f1b3400ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:53.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.792+0000 7f1b3dffb700 1 -- 172.21.15.73:0/3901877653 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b34013070 con 0x7f1b400ff5d0 2023-08-10T12:05:53.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.792+0000 7f1b3dffb700 1 -- 172.21.15.73:0/3901877653 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b34004020 con 0x7f1b400ff5d0 2023-08-10T12:05:53.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.792+0000 7f1b46f18700 1 -- 172.21.15.73:0/3901877653 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b38009d00 con 0x7f1b400ff5d0 2023-08-10T12:05:53.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.792+0000 7f1b3dffb700 1 -- 172.21.15.73:0/3901877653 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b34003be0 con 0x7f1b400ff5d0 2023-08-10T12:05:53.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.792+0000 7f1b46f18700 1 -- 172.21.15.73:0/3901877653 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b400678d0 con 0x7f1b400ff5d0 2023-08-10T12:05:53.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.793+0000 7f1b46f18700 1 -- 172.21.15.73:0/3901877653 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b400674f0 con 0x7f1b400ff5d0 2023-08-10T12:05:53.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.794+0000 7f1b3dffb700 1 -- 172.21.15.73:0/3901877653 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f1b34003d40 con 0x7f1b400ff5d0 2023-08-10T12:05:53.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.795+0000 7f1b3dffb700 1 --2- 172.21.15.73:0/3901877653 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f1b300a12c0 0x7f1b300a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:53.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.795+0000 7f1b3ffff700 1 --2- 172.21.15.73:0/3901877653 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f1b300a12c0 0x7f1b300a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:53.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.795+0000 7f1b3dffb700 1 -- 172.21.15.73:0/3901877653 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1b340ce3a0 con 0x7f1b400ff5d0 2023-08-10T12:05:53.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.795+0000 7f1b3ffff700 1 --2- 172.21.15.73:0/3901877653 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f1b300a12c0 0x7f1b300a3780 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1b40104f70 tx=0x7f1b2c009260 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:53.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.799+0000 7f1b3dffb700 1 -- 172.21.15.73:0/3901877653 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f1b34050790 con 0x7f1b400ff5d0 2023-08-10T12:05:53.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.988+0000 7f1b46f18700 1 -- 172.21.15.73:0/3901877653 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1b40067cf0 con 0x7f1b400ff5d0 2023-08-10T12:05:53.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.988+0000 7f1b3dffb700 1 -- 172.21.15.73:0/3901877653 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1b340977b0 con 0x7f1b400ff5d0 2023-08-10T12:05:53.990 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-08-10T12:05:53.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.990+0000 7f1b46f18700 1 -- 172.21.15.73:0/3901877653 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f1b300a12c0 msgr2=0x7f1b300a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:53.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.990+0000 7f1b46f18700 1 --2- 172.21.15.73:0/3901877653 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f1b300a12c0 0x7f1b300a3780 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1b40104f70 tx=0x7f1b2c009260 comp rx=0 tx=0).stop 2023-08-10T12:05:53.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.990+0000 7f1b46f18700 1 -- 172.21.15.73:0/3901877653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b400ff5d0 msgr2=0x7f1b4019b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:53.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.990+0000 7f1b46f18700 1 --2- 172.21.15.73:0/3901877653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b400ff5d0 0x7f1b4019b540 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400ec40 tx=0x7f1b3400ef50 comp rx=0 tx=0).stop 2023-08-10T12:05:53.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.991+0000 7f1b46f18700 1 -- 172.21.15.73:0/3901877653 shutdown_connections 2023-08-10T12:05:53.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.991+0000 7f1b46f18700 1 --2- 172.21.15.73:0/3901877653 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f1b300a12c0 0x7f1b300a3780 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:53.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.991+0000 7f1b46f18700 1 --2- 172.21.15.73:0/3901877653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b40105690 0x7f1b401955b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:53.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.991+0000 7f1b46f18700 1 --2- 172.21.15.73:0/3901877653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b400ff5d0 0x7f1b4019b540 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:53.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.991+0000 7f1b46f18700 1 --2- 172.21.15.73:0/3901877653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b400fff90 0x7f1b4019ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:53.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.991+0000 7f1b46f18700 1 -- 172.21.15.73:0/3901877653 >> 172.21.15.73:0/3901877653 conn(0x7f1b400fb0c0 msgr2=0x7f1b400fc760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:53.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.991+0000 7f1b46f18700 1 -- 172.21.15.73:0/3901877653 shutdown_connections 2023-08-10T12:05:53.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:53.991+0000 7f1b46f18700 1 -- 172.21.15.73:0/3901877653 wait complete. 2023-08-10T12:05:54.004 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T12:05:54.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.127+0000 7f4b9f40f700 1 -- 172.21.15.73:0/2460994852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b98105660 msgr2=0x7f4b98105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:54.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.127+0000 7f4b9f40f700 1 --2- 172.21.15.73:0/2460994852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b98105660 0x7f4b98105a40 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f4b88009990 tx=0x7f4b88009ca0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.127+0000 7f4b9f40f700 1 -- 172.21.15.73:0/2460994852 shutdown_connections 2023-08-10T12:05:54.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.127+0000 7f4b9f40f700 1 --2- 172.21.15.73:0/2460994852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b980fff80 0x7f4b9810c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.127+0000 7f4b9f40f700 1 --2- 172.21.15.73:0/2460994852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b98105660 0x7f4b98105a40 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.127+0000 7f4b9f40f700 1 --2- 172.21.15.73:0/2460994852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b980ff5c0 0x7f4b980ffa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.127+0000 7f4b9f40f700 1 -- 172.21.15.73:0/2460994852 >> 172.21.15.73:0/2460994852 conn(0x7f4b980fb090 msgr2=0x7f4b980fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:54.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.127+0000 7f4b9f40f700 1 -- 172.21.15.73:0/2460994852 shutdown_connections 2023-08-10T12:05:54.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.127+0000 7f4b9f40f700 1 -- 172.21.15.73:0/2460994852 wait complete. 2023-08-10T12:05:54.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.128+0000 7f4b9f40f700 1 Processor -- start 2023-08-10T12:05:54.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.128+0000 7f4b9f40f700 1 -- start start 2023-08-10T12:05:54.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.128+0000 7f4b9f40f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b980ff5c0 0x7f4b98197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:54.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.128+0000 7f4b9f40f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b980fff80 0x7f4b98197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:54.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.128+0000 7f4b9f40f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b98105660 0x7f4b981a25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:54.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.128+0000 7f4b9f40f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b981983d0 con 0x7f4b980fff80 2023-08-10T12:05:54.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.128+0000 7f4b9f40f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b981a2b10 con 0x7f4b98105660 2023-08-10T12:05:54.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.128+0000 7f4b9f40f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b981a2cd0 con 0x7f4b980ff5c0 2023-08-10T12:05:54.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.128+0000 7f4b9c9aa700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b980fff80 0x7f4b98197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:54.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.128+0000 7f4b9c9aa700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b980fff80 0x7f4b98197a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37154/0 (socket says 172.21.15.73:37154) 2023-08-10T12:05:54.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.128+0000 7f4b9c9aa700 1 -- 172.21.15.73:0/1715758144 learned_addr learned my addr 172.21.15.73:0/1715758144 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:05:54.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.128+0000 7f4b9d1ab700 1 --2- 172.21.15.73:0/1715758144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b980ff5c0 0x7f4b98197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:54.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.128+0000 7f4b9d9ac700 1 --2- 172.21.15.73:0/1715758144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b98105660 0x7f4b981a25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:54.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.128+0000 7f4b9c9aa700 1 -- 172.21.15.73:0/1715758144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b980ff5c0 msgr2=0x7f4b98197550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:54.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.128+0000 7f4b9c9aa700 1 --2- 172.21.15.73:0/1715758144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b980ff5c0 0x7f4b98197550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.128+0000 7f4b9c9aa700 1 -- 172.21.15.73:0/1715758144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b98105660 msgr2=0x7f4b981a25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:54.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.128+0000 7f4b9c9aa700 1 --2- 172.21.15.73:0/1715758144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b98105660 0x7f4b981a25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.128+0000 7f4b9c9aa700 1 -- 172.21.15.73:0/1715758144 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b880095f0 con 0x7f4b980fff80 2023-08-10T12:05:54.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.128+0000 7f4b9c9aa700 1 --2- 172.21.15.73:0/1715758144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b980fff80 0x7f4b98197a90 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400e9a0 tx=0x7f4b9400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:54.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.129+0000 7f4b8e7fc700 1 -- 172.21.15.73:0/1715758144 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b94009790 con 0x7f4b980fff80 2023-08-10T12:05:54.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.129+0000 7f4b8e7fc700 1 -- 172.21.15.73:0/1715758144 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b9400cbd0 con 0x7f4b980fff80 2023-08-10T12:05:54.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.129+0000 7f4b9f40f700 1 -- 172.21.15.73:0/1715758144 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b981a2fb0 con 0x7f4b980fff80 2023-08-10T12:05:54.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.129+0000 7f4b8e7fc700 1 -- 172.21.15.73:0/1715758144 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b94018680 con 0x7f4b980fff80 2023-08-10T12:05:54.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.129+0000 7f4b9f40f700 1 -- 172.21.15.73:0/1715758144 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b981a3430 con 0x7f4b980fff80 2023-08-10T12:05:54.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.130+0000 7f4b9f40f700 1 -- 172.21.15.73:0/1715758144 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b98066c60 con 0x7f4b980fff80 2023-08-10T12:05:54.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.131+0000 7f4b8e7fc700 1 -- 172.21.15.73:0/1715758144 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f4b9400cd40 con 0x7f4b980fff80 2023-08-10T12:05:54.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.132+0000 7f4b8e7fc700 1 --2- 172.21.15.73:0/1715758144 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f4b840a12c0 0x7f4b840a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:54.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.132+0000 7f4b9d1ab700 1 --2- 172.21.15.73:0/1715758144 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f4b840a12c0 0x7f4b840a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:54.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.132+0000 7f4b8e7fc700 1 -- 172.21.15.73:0/1715758144 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4b94014070 con 0x7f4b980fff80 2023-08-10T12:05:54.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.132+0000 7f4b9d1ab700 1 --2- 172.21.15.73:0/1715758144 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f4b840a12c0 0x7f4b840a3780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4b8800b2e0 tx=0x7f4b88005fd0 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:54.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.135+0000 7f4b8e7fc700 1 -- 172.21.15.73:0/1715758144 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f4b94096610 con 0x7f4b980fff80 2023-08-10T12:05:54.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:54 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1682373813' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T12:05:54.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:54 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/3901877653' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T12:05:54.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.326+0000 7f4b9f40f700 1 -- 172.21.15.73:0/1715758144 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4b98068f10 con 0x7f4b980fff80 2023-08-10T12:05:54.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.326+0000 7f4b8e7fc700 1 -- 172.21.15.73:0/1715758144 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v98) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4b94099c30 con 0x7f4b980fff80 2023-08-10T12:05:54.328 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-08-10T12:05:54.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.328+0000 7f4b9f40f700 1 -- 172.21.15.73:0/1715758144 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f4b840a12c0 msgr2=0x7f4b840a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:54.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.328+0000 7f4b9f40f700 1 --2- 172.21.15.73:0/1715758144 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f4b840a12c0 0x7f4b840a3780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4b8800b2e0 tx=0x7f4b88005fd0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.328+0000 7f4b9f40f700 1 -- 172.21.15.73:0/1715758144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b980fff80 msgr2=0x7f4b98197a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:54.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.328+0000 7f4b9f40f700 1 --2- 172.21.15.73:0/1715758144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b980fff80 0x7f4b98197a90 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400e9a0 tx=0x7f4b9400ecb0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.328+0000 7f4b9f40f700 1 -- 172.21.15.73:0/1715758144 shutdown_connections 2023-08-10T12:05:54.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.328+0000 7f4b9f40f700 1 --2- 172.21.15.73:0/1715758144 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f4b840a12c0 0x7f4b840a3780 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.328+0000 7f4b9f40f700 1 --2- 172.21.15.73:0/1715758144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b98105660 0x7f4b981a25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.328+0000 7f4b9f40f700 1 --2- 172.21.15.73:0/1715758144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b980ff5c0 0x7f4b98197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.328+0000 7f4b9f40f700 1 --2- 172.21.15.73:0/1715758144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b980fff80 0x7f4b98197a90 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.328+0000 7f4b9f40f700 1 -- 172.21.15.73:0/1715758144 >> 172.21.15.73:0/1715758144 conn(0x7f4b980fb090 msgr2=0x7f4b980fc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:54.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.328+0000 7f4b9f40f700 1 -- 172.21.15.73:0/1715758144 shutdown_connections 2023-08-10T12:05:54.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.328+0000 7f4b9f40f700 1 -- 172.21.15.73:0/1715758144 wait complete. 2023-08-10T12:05:54.342 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T12:05:54.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.464+0000 7fd3168ab700 1 -- 172.21.15.73:0/3161737590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3101066f0 msgr2=0x7fd310106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:54.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.464+0000 7fd3168ab700 1 --2- 172.21.15.73:0/3161737590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3101066f0 0x7fd310106ad0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fd304009990 tx=0x7fd304009ca0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.464+0000 7fd3168ab700 1 -- 172.21.15.73:0/3161737590 shutdown_connections 2023-08-10T12:05:54.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.464+0000 7fd3168ab700 1 --2- 172.21.15.73:0/3161737590 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3101010a0 0x7fd31010d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.464+0000 7fd3168ab700 1 --2- 172.21.15.73:0/3161737590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3101066f0 0x7fd310106ad0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.464+0000 7fd3168ab700 1 --2- 172.21.15.73:0/3161737590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3101006e0 0x7fd310100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.464+0000 7fd3168ab700 1 -- 172.21.15.73:0/3161737590 >> 172.21.15.73:0/3161737590 conn(0x7fd3100fc1d0 msgr2=0x7fd3100fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:54.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.464+0000 7fd3168ab700 1 -- 172.21.15.73:0/3161737590 shutdown_connections 2023-08-10T12:05:54.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.464+0000 7fd3168ab700 1 -- 172.21.15.73:0/3161737590 wait complete. 2023-08-10T12:05:54.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.465+0000 7fd3168ab700 1 Processor -- start 2023-08-10T12:05:54.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.465+0000 7fd3168ab700 1 -- start start 2023-08-10T12:05:54.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.465+0000 7fd3168ab700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3101006e0 0x7fd310072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:54.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.465+0000 7fd3168ab700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3101010a0 0x7fd310072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:54.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.465+0000 7fd3168ab700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3101066f0 0x7fd3100734f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:54.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.465+0000 7fd3168ab700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3101a4cb0 con 0x7fd3101010a0 2023-08-10T12:05:54.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.465+0000 7fd3168ab700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3101a4e20 con 0x7fd3101006e0 2023-08-10T12:05:54.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.465+0000 7fd3168ab700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3101a4fe0 con 0x7fd3101066f0 2023-08-10T12:05:54.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.465+0000 7fd30f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3101010a0 0x7fd310072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:54.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.466+0000 7fd30f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3101010a0 0x7fd310072fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37168/0 (socket says 172.21.15.73:37168) 2023-08-10T12:05:54.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.466+0000 7fd30f7fe700 1 -- 172.21.15.73:0/1786802268 learned_addr learned my addr 172.21.15.73:0/1786802268 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:05:54.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.466+0000 7fd314e48700 1 --2- 172.21.15.73:0/1786802268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3101066f0 0x7fd3100734f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:54.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.466+0000 7fd30ffff700 1 --2- 172.21.15.73:0/1786802268 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3101006e0 0x7fd310072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:54.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.466+0000 7fd30f7fe700 1 -- 172.21.15.73:0/1786802268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3101066f0 msgr2=0x7fd3100734f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:54.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.466+0000 7fd30f7fe700 1 --2- 172.21.15.73:0/1786802268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3101066f0 0x7fd3100734f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.466+0000 7fd30f7fe700 1 -- 172.21.15.73:0/1786802268 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3101006e0 msgr2=0x7fd310072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:54.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.466+0000 7fd30f7fe700 1 --2- 172.21.15.73:0/1786802268 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3101006e0 0x7fd310072a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.466+0000 7fd30f7fe700 1 -- 172.21.15.73:0/1786802268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3040095f0 con 0x7fd3101010a0 2023-08-10T12:05:54.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.466+0000 7fd30ffff700 1 --2- 172.21.15.73:0/1786802268 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3101006e0 0x7fd310072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T12:05:54.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.466+0000 7fd30f7fe700 1 --2- 172.21.15.73:0/1786802268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3101010a0 0x7fd310072fb0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fd30000d950 tx=0x7fd30000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:54.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.466+0000 7fd30d7fa700 1 -- 172.21.15.73:0/1786802268 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd300009940 con 0x7fd3101010a0 2023-08-10T12:05:54.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.466+0000 7fd3168ab700 1 -- 172.21.15.73:0/1786802268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3101a52c0 con 0x7fd3101010a0 2023-08-10T12:05:54.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.466+0000 7fd30d7fa700 1 -- 172.21.15.73:0/1786802268 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd300010460 con 0x7fd3101010a0 2023-08-10T12:05:54.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.466+0000 7fd30d7fa700 1 -- 172.21.15.73:0/1786802268 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30000f620 con 0x7fd3101010a0 2023-08-10T12:05:54.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.466+0000 7fd3168ab700 1 -- 172.21.15.73:0/1786802268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3101a5820 con 0x7fd3101010a0 2023-08-10T12:05:54.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.467+0000 7fd3168ab700 1 -- 172.21.15.73:0/1786802268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3100674f0 con 0x7fd3101010a0 2023-08-10T12:05:54.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.468+0000 7fd30d7fa700 1 -- 172.21.15.73:0/1786802268 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fd3000108d0 con 0x7fd3101010a0 2023-08-10T12:05:54.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.469+0000 7fd30d7fa700 1 --2- 172.21.15.73:0/1786802268 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd2f80a12c0 0x7fd2f80a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:54.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.469+0000 7fd30ffff700 1 --2- 172.21.15.73:0/1786802268 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd2f80a12c0 0x7fd2f80a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:54.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.469+0000 7fd30d7fa700 1 -- 172.21.15.73:0/1786802268 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fd3000ccf70 con 0x7fd3101010a0 2023-08-10T12:05:54.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.469+0000 7fd30ffff700 1 --2- 172.21.15.73:0/1786802268 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd2f80a12c0 0x7fd2f80a3780 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd30400b2e0 tx=0x7fd304005e80 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:54.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.473+0000 7fd30d7fa700 1 -- 172.21.15.73:0/1786802268 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fd300096320 con 0x7fd3101010a0 2023-08-10T12:05:54.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:54 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1682373813' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T12:05:54.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:54 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/3901877653' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T12:05:54.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:54 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1682373813' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T12:05:54.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:54 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/3901877653' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T12:05:54.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.662+0000 7fd3168ab700 1 -- 172.21.15.73:0/1786802268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd3101a5a70 con 0x7fd3101010a0 2023-08-10T12:05:54.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.662+0000 7fd30d7fa700 1 -- 172.21.15.73:0/1786802268 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd3000200a0 con 0x7fd3101010a0 2023-08-10T12:05:54.664 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-08-10T12:05:54.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.665+0000 7fd3168ab700 1 -- 172.21.15.73:0/1786802268 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd2f80a12c0 msgr2=0x7fd2f80a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:54.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.665+0000 7fd3168ab700 1 --2- 172.21.15.73:0/1786802268 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd2f80a12c0 0x7fd2f80a3780 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd30400b2e0 tx=0x7fd304005e80 comp rx=0 tx=0).stop 2023-08-10T12:05:54.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.665+0000 7fd3168ab700 1 -- 172.21.15.73:0/1786802268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3101010a0 msgr2=0x7fd310072fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:54.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.665+0000 7fd3168ab700 1 --2- 172.21.15.73:0/1786802268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3101010a0 0x7fd310072fb0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fd30000d950 tx=0x7fd30000dc60 comp rx=0 tx=0).stop 2023-08-10T12:05:54.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.665+0000 7fd3168ab700 1 -- 172.21.15.73:0/1786802268 shutdown_connections 2023-08-10T12:05:54.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.665+0000 7fd3168ab700 1 --2- 172.21.15.73:0/1786802268 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7fd2f80a12c0 0x7fd2f80a3780 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.665+0000 7fd3168ab700 1 --2- 172.21.15.73:0/1786802268 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3101006e0 0x7fd310072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.665+0000 7fd3168ab700 1 --2- 172.21.15.73:0/1786802268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3101066f0 0x7fd3100734f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.665+0000 7fd3168ab700 1 --2- 172.21.15.73:0/1786802268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3101010a0 0x7fd310072fb0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.665+0000 7fd3168ab700 1 -- 172.21.15.73:0/1786802268 >> 172.21.15.73:0/1786802268 conn(0x7fd3100fc1d0 msgr2=0x7fd3100fc930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:54.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.665+0000 7fd3168ab700 1 -- 172.21.15.73:0/1786802268 shutdown_connections 2023-08-10T12:05:54.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.665+0000 7fd3168ab700 1 -- 172.21.15.73:0/1786802268 wait complete. 2023-08-10T12:05:54.679 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T12:05:54.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.800+0000 7f7b0dbbb700 1 -- 172.21.15.73:0/1772216524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b081021a0 msgr2=0x7f7b0810a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:54.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.800+0000 7f7b0dbbb700 1 --2- 172.21.15.73:0/1772216524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b081021a0 0x7f7b0810a680 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f7af0009990 tx=0x7f7af0009ca0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.800+0000 7f7b0dbbb700 1 -- 172.21.15.73:0/1772216524 shutdown_connections 2023-08-10T12:05:54.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.800+0000 7f7b0dbbb700 1 --2- 172.21.15.73:0/1772216524 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b08101880 0x7f7b08101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.800+0000 7f7b0dbbb700 1 --2- 172.21.15.73:0/1772216524 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b0810aca0 0x7f7b0810d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.800+0000 7f7b0dbbb700 1 --2- 172.21.15.73:0/1772216524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b081021a0 0x7f7b0810a680 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.800+0000 7f7b0dbbb700 1 -- 172.21.15.73:0/1772216524 >> 172.21.15.73:0/1772216524 conn(0x7f7b080fb0c0 msgr2=0x7f7b080fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:54.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.800+0000 7f7b0dbbb700 1 -- 172.21.15.73:0/1772216524 shutdown_connections 2023-08-10T12:05:54.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.800+0000 7f7b0dbbb700 1 -- 172.21.15.73:0/1772216524 wait complete. 2023-08-10T12:05:54.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.800+0000 7f7b0dbbb700 1 Processor -- start 2023-08-10T12:05:54.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.800+0000 7f7b0dbbb700 1 -- start start 2023-08-10T12:05:54.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.801+0000 7f7b0dbbb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b08101880 0x7f7b0819c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:54.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.801+0000 7f7b0dbbb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b081021a0 0x7f7b0819cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:54.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.801+0000 7f7b0dbbb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b0810aca0 0x7f7b081965f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:54.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.801+0000 7f7b0dbbb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b08196c60 con 0x7f7b0810aca0 2023-08-10T12:05:54.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.801+0000 7f7b0dbbb700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b08196dd0 con 0x7f7b08101880 2023-08-10T12:05:54.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.801+0000 7f7b0dbbb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b08196f90 con 0x7f7b081021a0 2023-08-10T12:05:54.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.801+0000 7f7b07fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b0810aca0 0x7f7b081965f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:54.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.801+0000 7f7b07fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b0810aca0 0x7f7b081965f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37184/0 (socket says 172.21.15.73:37184) 2023-08-10T12:05:54.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.801+0000 7f7b07fff700 1 -- 172.21.15.73:0/2801871940 learned_addr learned my addr 172.21.15.73:0/2801871940 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-08-10T12:05:54.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.801+0000 7f7afeffd700 1 --2- 172.21.15.73:0/2801871940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b081021a0 0x7f7b0819cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:54.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.801+0000 7f7b077fe700 1 --2- 172.21.15.73:0/2801871940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b08101880 0x7f7b0819c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:54.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.801+0000 7f7b07fff700 1 -- 172.21.15.73:0/2801871940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b081021a0 msgr2=0x7f7b0819cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:54.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.801+0000 7f7b07fff700 1 --2- 172.21.15.73:0/2801871940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b081021a0 0x7f7b0819cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.801+0000 7f7b07fff700 1 -- 172.21.15.73:0/2801871940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b08101880 msgr2=0x7f7b0819c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:54.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.801+0000 7f7b07fff700 1 --2- 172.21.15.73:0/2801871940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b08101880 0x7f7b0819c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:54.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.801+0000 7f7b07fff700 1 -- 172.21.15.73:0/2801871940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b00009c40 con 0x7f7b0810aca0 2023-08-10T12:05:54.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.801+0000 7f7b07fff700 1 --2- 172.21.15.73:0/2801871940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b0810aca0 0x7f7b081965f0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000c370 tx=0x7f7b0000c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:54.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.801+0000 7f7b057fa700 1 -- 172.21.15.73:0/2801871940 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b00017070 con 0x7f7b0810aca0 2023-08-10T12:05:54.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.801+0000 7f7b0dbbb700 1 -- 172.21.15.73:0/2801871940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af00095f0 con 0x7f7b0810aca0 2023-08-10T12:05:54.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.802+0000 7f7b057fa700 1 -- 172.21.15.73:0/2801871940 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b0000f040 con 0x7f7b0810aca0 2023-08-10T12:05:54.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.802+0000 7f7b057fa700 1 -- 172.21.15.73:0/2801871940 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0000e050 con 0x7f7b0810aca0 2023-08-10T12:05:54.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.802+0000 7f7b0dbbb700 1 -- 172.21.15.73:0/2801871940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b081a3390 con 0x7f7b0810aca0 2023-08-10T12:05:54.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.802+0000 7f7b0dbbb700 1 -- 172.21.15.73:0/2801871940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b080674f0 con 0x7f7b0810aca0 2023-08-10T12:05:54.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.803+0000 7f7b057fa700 1 -- 172.21.15.73:0/2801871940 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f7b0000cb60 con 0x7f7b0810aca0 2023-08-10T12:05:54.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.804+0000 7f7b057fa700 1 --2- 172.21.15.73:0/2801871940 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f7af40a12c0 0x7f7af40a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T12:05:54.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.804+0000 7f7b077fe700 1 --2- 172.21.15.73:0/2801871940 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f7af40a12c0 0x7f7af40a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T12:05:54.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.804+0000 7f7b057fa700 1 -- 172.21.15.73:0/2801871940 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7b000cc650 con 0x7f7b0810aca0 2023-08-10T12:05:54.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.804+0000 7f7b077fe700 1 --2- 172.21.15.73:0/2801871940 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f7af40a12c0 0x7f7af40a3780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7af800ac50 tx=0x7f7af800a380 comp rx=0 tx=0).ready entity=mgr.25060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T12:05:54.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:54.809+0000 7f7b057fa700 1 -- 172.21.15.73:0/2801871940 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f7b00095a60 con 0x7f7b0810aca0 2023-08-10T12:05:55.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:55.013+0000 7f7b0dbbb700 1 -- 172.21.15.73:0/2801871940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7b081a35d0 con 0x7f7b0810aca0 2023-08-10T12:05:55.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:55.014+0000 7f7b057fa700 1 -- 172.21.15.73:0/2801871940 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v98) v1 ==== 81+0+941 (secure 0 0 0) 0x7f7b00099080 con 0x7f7b0810aca0 2023-08-10T12:05:55.016 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6800/3797582815 2023-08-11T11:52:37.545186+0000 2023-08-10T12:05:55.016 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/3346699990 2023-08-11T11:52:37.545186+0000 2023-08-10T12:05:55.016 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/2211661782 2023-08-11T11:52:37.545186+0000 2023-08-10T12:05:55.016 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/4199164995 2023-08-11T11:52:37.545186+0000 2023-08-10T12:05:55.016 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/978777874 2023-08-11T11:52:37.545186+0000 2023-08-10T12:05:55.016 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/2202785670 2023-08-11T11:44:48.401660+0000 2023-08-10T12:05:55.016 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6801/16358451 2023-08-11T11:44:48.401660+0000 2023-08-10T12:05:55.017 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6800/16358451 2023-08-11T11:44:48.401660+0000 2023-08-10T12:05:55.017 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6801/3290717807 2023-08-11T11:44:25.974867+0000 2023-08-10T12:05:55.017 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6801/3797582815 2023-08-11T11:52:37.545186+0000 2023-08-10T12:05:55.017 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6800/3290717807 2023-08-11T11:44:25.974867+0000 2023-08-10T12:05:55.017 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/1447381524 2023-08-11T11:44:48.401660+0000 2023-08-10T12:05:55.017 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/2545059698 2023-08-11T11:44:25.974867+0000 2023-08-10T12:05:55.017 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/4193457623 2023-08-11T11:44:25.974867+0000 2023-08-10T12:05:55.018 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/2561039569 2023-08-11T11:44:25.974867+0000 2023-08-10T12:05:55.018 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/2927950081 2023-08-11T11:44:48.401660+0000 2023-08-10T12:05:55.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:55.016+0000 7f7b0dbbb700 1 -- 172.21.15.73:0/2801871940 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f7af40a12c0 msgr2=0x7f7af40a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:55.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:55.016+0000 7f7b0dbbb700 1 --2- 172.21.15.73:0/2801871940 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f7af40a12c0 0x7f7af40a3780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7af800ac50 tx=0x7f7af800a380 comp rx=0 tx=0).stop 2023-08-10T12:05:55.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:55.016+0000 7f7b0dbbb700 1 -- 172.21.15.73:0/2801871940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b0810aca0 msgr2=0x7f7b081965f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T12:05:55.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:55.016+0000 7f7b0dbbb700 1 --2- 172.21.15.73:0/2801871940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b0810aca0 0x7f7b081965f0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000c370 tx=0x7f7b0000c680 comp rx=0 tx=0).stop 2023-08-10T12:05:55.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:55.016+0000 7f7b0dbbb700 1 -- 172.21.15.73:0/2801871940 shutdown_connections 2023-08-10T12:05:55.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:55.016+0000 7f7b0dbbb700 1 --2- 172.21.15.73:0/2801871940 >> [v2:172.21.15.73:6800/807677460,v1:172.21.15.73:6801/807677460] conn(0x7f7af40a12c0 0x7f7af40a3780 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:55.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:55.016+0000 7f7b0dbbb700 1 --2- 172.21.15.73:0/2801871940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b08101880 0x7f7b0819c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:55.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:55.016+0000 7f7b0dbbb700 1 --2- 172.21.15.73:0/2801871940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b0810aca0 0x7f7b081965f0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:55.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:55.016+0000 7f7b0dbbb700 1 --2- 172.21.15.73:0/2801871940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b081021a0 0x7f7b0819cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T12:05:55.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:55.016+0000 7f7b0dbbb700 1 -- 172.21.15.73:0/2801871940 >> 172.21.15.73:0/2801871940 conn(0x7f7b080fb0c0 msgr2=0x7f7b0810ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T12:05:55.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:55.016+0000 7f7b0dbbb700 1 -- 172.21.15.73:0/2801871940 shutdown_connections 2023-08-10T12:05:55.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-08-10T12:05:55.016+0000 7f7b0dbbb700 1 -- 172.21.15.73:0/2801871940 wait complete. 2023-08-10T12:05:55.020 INFO:teuthology.orchestra.run.smithi073.stderr:listed 16 entries 2023-08-10T12:05:55.030 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-10T12:05:55.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T12:05:55.031 DEBUG:teuthology.orchestra.run.smithi073:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-10T12:05:55.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:55 smithi152 ceph-mon[130220]: pgmap v413: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 8 op/s 2023-08-10T12:05:55.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:55 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1715758144' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T12:05:55.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:55 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/1786802268' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T12:05:55.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:55 smithi152 ceph-mon[130220]: from='client.? 172.21.15.73:0/2801871940' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-08-10T12:05:55.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:55 smithi156 ceph-mon[130574]: pgmap v413: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 8 op/s 2023-08-10T12:05:55.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:55 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1715758144' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T12:05:55.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:55 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/1786802268' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T12:05:55.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:55 smithi156 ceph-mon[130574]: from='client.? 172.21.15.73:0/2801871940' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-08-10T12:05:55.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:55 smithi073 ceph-mon[128869]: pgmap v413: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 8 op/s 2023-08-10T12:05:55.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:55 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1715758144' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T12:05:55.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:55 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/1786802268' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T12:05:55.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:55 smithi073 ceph-mon[128869]: from='client.? 172.21.15.73:0/2801871940' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-08-10T12:05:57.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:57 smithi152 ceph-mon[130220]: pgmap v414: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 938 B/s wr, 12 op/s 2023-08-10T12:05:57.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:57 smithi156 ceph-mon[130574]: pgmap v414: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 938 B/s wr, 12 op/s 2023-08-10T12:05:57.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:57 smithi073 ceph-mon[128869]: pgmap v414: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 938 B/s wr, 12 op/s 2023-08-10T12:05:59.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:05:59 smithi152 ceph-mon[130220]: pgmap v415: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 938 B/s wr, 9 op/s 2023-08-10T12:05:59.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:05:59 smithi156 ceph-mon[130574]: pgmap v415: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 938 B/s wr, 9 op/s 2023-08-10T12:05:59.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:05:59 smithi073 ceph-mon[128869]: pgmap v415: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 938 B/s wr, 9 op/s 2023-08-10T12:06:01.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:01 smithi152 ceph-mon[130220]: pgmap v416: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-08-10T12:06:01.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:01 smithi156 ceph-mon[130574]: pgmap v416: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-08-10T12:06:01.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:01 smithi073 ceph-mon[128869]: pgmap v416: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-08-10T12:06:03.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:03 smithi152 ceph-mon[130220]: pgmap v417: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 938 B/s wr, 12 op/s 2023-08-10T12:06:03.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:03 smithi156 ceph-mon[130574]: pgmap v417: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 938 B/s wr, 12 op/s 2023-08-10T12:06:03.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:03 smithi073 ceph-mon[128869]: pgmap v417: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 938 B/s wr, 12 op/s 2023-08-10T12:06:05.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:04 smithi152 ceph-mon[130220]: pgmap v418: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-08-10T12:06:05.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:04 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:06:05.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:04 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:06:05.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:04 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:06:05.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:04 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:06:05.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:04 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:06:05.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:04 smithi156 ceph-mon[130574]: pgmap v418: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-08-10T12:06:05.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:04 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:06:05.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:04 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:06:05.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:04 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:06:05.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:04 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:06:05.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:04 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:06:05.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:04 smithi073 ceph-mon[128869]: pgmap v418: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-08-10T12:06:05.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:04 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:06:05.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:04 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:06:05.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:04 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:06:05.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:04 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:06:05.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:04 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:06:06.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:05 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:06:06.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:05 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:06:06.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:05 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:06:06.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:05 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:06:06.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:05 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:06:06.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:05 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:06:06.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:05 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:06:06.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:05 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:06:06.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:05 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:06:07.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:06 smithi152 ceph-mon[130220]: pgmap v419: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-08-10T12:06:07.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:06 smithi156 ceph-mon[130574]: pgmap v419: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-08-10T12:06:07.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:06 smithi073 ceph-mon[128869]: pgmap v419: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-08-10T12:06:09.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:09 smithi152 ceph-mon[130220]: pgmap v420: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-08-10T12:06:09.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:09 smithi156 ceph-mon[130574]: pgmap v420: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-08-10T12:06:09.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:09 smithi073 ceph-mon[128869]: pgmap v420: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-08-10T12:06:11.505 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:11 smithi152 ceph-mon[130220]: pgmap v421: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-08-10T12:06:11.505 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:11 smithi152 ceph-mon[130220]: osdmap e99: 12 total, 12 up, 12 in 2023-08-10T12:06:11.510 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:11 smithi156 ceph-mon[130574]: pgmap v421: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-08-10T12:06:11.510 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:11 smithi156 ceph-mon[130574]: osdmap e99: 12 total, 12 up, 12 in 2023-08-10T12:06:11.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:11 smithi073 ceph-mon[128869]: pgmap v421: 97 pgs: 97 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-08-10T12:06:11.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:11 smithi073 ceph-mon[128869]: osdmap e99: 12 total, 12 up, 12 in 2023-08-10T12:06:13.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:13 smithi152 ceph-mon[130220]: pgmap v423: 97 pgs: 14 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 64 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-08-10T12:06:13.512 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:13 smithi156 ceph-mon[130574]: pgmap v423: 97 pgs: 14 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 64 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-08-10T12:06:13.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:13 smithi073 ceph-mon[128869]: pgmap v423: 97 pgs: 14 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 64 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-08-10T12:06:15.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:14 smithi152 ceph-mon[130220]: pgmap v424: 97 pgs: 18 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 49 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-08-10T12:06:15.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:14 smithi156 ceph-mon[130574]: pgmap v424: 97 pgs: 18 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 49 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-08-10T12:06:15.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:14 smithi073 ceph-mon[128869]: pgmap v424: 97 pgs: 18 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 49 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-08-10T12:06:17.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:17 smithi152 ceph-mon[130220]: pgmap v425: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:06:17.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:17 smithi156 ceph-mon[130574]: pgmap v425: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:06:17.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:17 smithi073 ceph-mon[128869]: pgmap v425: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:06:19.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:19 smithi152 ceph-mon[130220]: pgmap v426: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:06:19.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:19 smithi156 ceph-mon[130574]: pgmap v426: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:06:19.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:19 smithi073 ceph-mon[128869]: pgmap v426: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:06:21.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:21 smithi152 ceph-mon[130220]: pgmap v427: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:06:21.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:21 smithi156 ceph-mon[130574]: pgmap v427: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:06:21.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:21 smithi073 ceph-mon[128869]: pgmap v427: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:06:23.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:23 smithi152 ceph-mon[130220]: pgmap v428: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 171 B/s wr, 12 op/s 2023-08-10T12:06:23.509 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:23 smithi156 ceph-mon[130574]: pgmap v428: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 171 B/s wr, 12 op/s 2023-08-10T12:06:23.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:23 smithi073 ceph-mon[128869]: pgmap v428: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 171 B/s wr, 12 op/s 2023-08-10T12:06:25.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:24 smithi152 ceph-mon[130220]: pgmap v429: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2023-08-10T12:06:25.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:24 smithi156 ceph-mon[130574]: pgmap v429: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2023-08-10T12:06:25.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:24 smithi073 ceph-mon[128869]: pgmap v429: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2023-08-10T12:06:27.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:27 smithi152 ceph-mon[130220]: pgmap v430: 97 pgs: 22 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 36 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-10T12:06:27.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:27 smithi156 ceph-mon[130574]: pgmap v430: 97 pgs: 22 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 36 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-10T12:06:27.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:27 smithi073 ceph-mon[128869]: pgmap v430: 97 pgs: 22 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 36 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-10T12:06:29.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:29 smithi152 ceph-mon[130220]: pgmap v431: 97 pgs: 22 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 36 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:06:29.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:29 smithi156 ceph-mon[130574]: pgmap v431: 97 pgs: 22 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 36 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:06:29.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:29 smithi073 ceph-mon[128869]: pgmap v431: 97 pgs: 22 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 36 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:06:31.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:31 smithi152 ceph-mon[130220]: pgmap v432: 97 pgs: 22 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 36 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:06:31.511 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:31 smithi156 ceph-mon[130574]: pgmap v432: 97 pgs: 22 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 36 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:06:31.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:31 smithi073 ceph-mon[128869]: pgmap v432: 97 pgs: 22 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 36 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:06:33.499 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:33 smithi152 ceph-mon[130220]: pgmap v433: 97 pgs: 22 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 36 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:06:33.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:33 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:06:33.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:33 smithi156 ceph-mon[130574]: pgmap v433: 97 pgs: 22 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 36 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:06:33.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:33 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:06:33.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:33 smithi073 ceph-mon[128869]: pgmap v433: 97 pgs: 22 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 36 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:06:33.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:33 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:06:35.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:34 smithi152 ceph-mon[130220]: pgmap v434: 97 pgs: 22 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 36 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-10T12:06:35.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:34 smithi156 ceph-mon[130574]: pgmap v434: 97 pgs: 22 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 36 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-10T12:06:35.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:34 smithi073 ceph-mon[128869]: pgmap v434: 97 pgs: 22 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 36 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-10T12:06:37.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:37 smithi152 ceph-mon[130220]: pgmap v435: 97 pgs: 18 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 44 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:06:37.510 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:37 smithi156 ceph-mon[130574]: pgmap v435: 97 pgs: 18 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 44 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:06:37.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:37 smithi073 ceph-mon[128869]: pgmap v435: 97 pgs: 18 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 44 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:06:39.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:39 smithi152 ceph-mon[130220]: pgmap v436: 97 pgs: 18 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 44 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:06:39.508 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:39 smithi156 ceph-mon[130574]: pgmap v436: 97 pgs: 18 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 44 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:06:39.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:39 smithi073 ceph-mon[128869]: pgmap v436: 97 pgs: 18 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 44 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:06:41.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:41 smithi152 ceph-mon[130220]: pgmap v437: 97 pgs: 18 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 44 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:06:41.513 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:41 smithi156 ceph-mon[130574]: pgmap v437: 97 pgs: 18 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 44 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:06:41.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:41 smithi073 ceph-mon[128869]: pgmap v437: 97 pgs: 18 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 44 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:06:43.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:43 smithi152 ceph-mon[130220]: pgmap v438: 97 pgs: 15 active+clean+snaptrim, 32 active+clean+snaptrim_wait, 50 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:06:43.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:43 smithi156 ceph-mon[130574]: pgmap v438: 97 pgs: 15 active+clean+snaptrim, 32 active+clean+snaptrim_wait, 50 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:06:43.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:43 smithi073 ceph-mon[128869]: pgmap v438: 97 pgs: 15 active+clean+snaptrim, 32 active+clean+snaptrim_wait, 50 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:06:45.246 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:44 smithi152 ceph-mon[130220]: pgmap v439: 97 pgs: 15 active+clean+snaptrim, 32 active+clean+snaptrim_wait, 50 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:06:45.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:44 smithi156 ceph-mon[130574]: pgmap v439: 97 pgs: 15 active+clean+snaptrim, 32 active+clean+snaptrim_wait, 50 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:06:45.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:44 smithi073 ceph-mon[128869]: pgmap v439: 97 pgs: 15 active+clean+snaptrim, 32 active+clean+snaptrim_wait, 50 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:06:47.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:47 smithi152 ceph-mon[130220]: pgmap v440: 97 pgs: 14 active+clean+snaptrim, 28 active+clean+snaptrim_wait, 55 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-10T12:06:47.509 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:47 smithi156 ceph-mon[130574]: pgmap v440: 97 pgs: 14 active+clean+snaptrim, 28 active+clean+snaptrim_wait, 55 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-10T12:06:47.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:47 smithi073 ceph-mon[128869]: pgmap v440: 97 pgs: 14 active+clean+snaptrim, 28 active+clean+snaptrim_wait, 55 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-10T12:06:49.499 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:49 smithi152 ceph-mon[130220]: pgmap v441: 97 pgs: 14 active+clean+snaptrim, 28 active+clean+snaptrim_wait, 55 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:06:49.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:49 smithi156 ceph-mon[130574]: pgmap v441: 97 pgs: 14 active+clean+snaptrim, 28 active+clean+snaptrim_wait, 55 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:06:49.523 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:49 smithi073 ceph-mon[128869]: pgmap v441: 97 pgs: 14 active+clean+snaptrim, 28 active+clean+snaptrim_wait, 55 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:06:51.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:51 smithi152 ceph-mon[130220]: pgmap v442: 97 pgs: 13 active+clean+snaptrim, 28 active+clean+snaptrim_wait, 56 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:06:51.510 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:51 smithi156 ceph-mon[130574]: pgmap v442: 97 pgs: 13 active+clean+snaptrim, 28 active+clean+snaptrim_wait, 56 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:06:51.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:51 smithi073 ceph-mon[128869]: pgmap v442: 97 pgs: 13 active+clean+snaptrim, 28 active+clean+snaptrim_wait, 56 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:06:53.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:53 smithi152 ceph-mon[130220]: pgmap v443: 97 pgs: 10 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 65 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:06:53.509 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:53 smithi156 ceph-mon[130574]: pgmap v443: 97 pgs: 10 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 65 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:06:53.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:53 smithi073 ceph-mon[128869]: pgmap v443: 97 pgs: 10 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 65 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:06:55.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:54 smithi152 ceph-mon[130220]: pgmap v444: 97 pgs: 10 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 65 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:06:55.259 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:54 smithi156 ceph-mon[130574]: pgmap v444: 97 pgs: 10 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 65 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:06:55.271 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:54 smithi073 ceph-mon[128869]: pgmap v444: 97 pgs: 10 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 65 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:06:57.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:57 smithi152 ceph-mon[130220]: pgmap v445: 97 pgs: 9 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 66 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:06:57.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:57 smithi156 ceph-mon[130574]: pgmap v445: 97 pgs: 9 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 66 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:06:57.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:57 smithi073 ceph-mon[128869]: pgmap v445: 97 pgs: 9 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 66 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:06:59.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:06:59 smithi152 ceph-mon[130220]: pgmap v446: 97 pgs: 8 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 67 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:06:59.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:06:59 smithi156 ceph-mon[130574]: pgmap v446: 97 pgs: 8 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 67 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:06:59.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:06:59 smithi073 ceph-mon[128869]: pgmap v446: 97 pgs: 8 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 67 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:07:01.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:01 smithi152 ceph-mon[130220]: pgmap v447: 97 pgs: 3 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 89 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:07:01.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:01 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:07:01.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:01 smithi156 ceph-mon[130574]: pgmap v447: 97 pgs: 3 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 89 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:07:01.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:01 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:07:01.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:01 smithi073 ceph-mon[128869]: pgmap v447: 97 pgs: 3 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 89 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:07:01.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:01 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:07:03.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:03 smithi152 ceph-mon[130220]: pgmap v448: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:07:03.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:03 smithi156 ceph-mon[130574]: pgmap v448: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:07:03.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:03 smithi073 ceph-mon[128869]: pgmap v448: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:07:05.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:04 smithi152 ceph-mon[130220]: pgmap v449: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:07:05.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:04 smithi156 ceph-mon[130574]: pgmap v449: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:07:05.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:04 smithi073 ceph-mon[128869]: pgmap v449: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:07:06.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:05 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:07:06.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:05 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:07:06.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:05 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:07:06.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:05 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:07:06.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:05 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:07:06.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:05 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:07:06.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:05 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:07:06.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:05 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:07:06.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:05 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:07:06.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:05 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:07:06.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:05 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:07:06.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:05 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:07:07.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:06 smithi152 ceph-mon[130220]: pgmap v450: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-08-10T12:07:07.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:06 smithi156 ceph-mon[130574]: pgmap v450: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-08-10T12:07:07.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:06 smithi073 ceph-mon[128869]: pgmap v450: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-08-10T12:07:08.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:07 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:07:08.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:07 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:07:08.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:07 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:07:09.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:08 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:07:09.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:08 smithi152 ceph-mon[130220]: pgmap v451: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-08-10T12:07:09.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:08 smithi152 ceph-mon[130220]: osdmap e100: 12 total, 12 up, 12 in 2023-08-10T12:07:09.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:08 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:07:09.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:08 smithi156 ceph-mon[130574]: pgmap v451: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-08-10T12:07:09.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:08 smithi156 ceph-mon[130574]: osdmap e100: 12 total, 12 up, 12 in 2023-08-10T12:07:09.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:08 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:07:09.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:08 smithi073 ceph-mon[128869]: pgmap v451: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-08-10T12:07:09.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:08 smithi073 ceph-mon[128869]: osdmap e100: 12 total, 12 up, 12 in 2023-08-10T12:07:11.249 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:10 smithi152 ceph-mon[130220]: osdmap e101: 12 total, 12 up, 12 in 2023-08-10T12:07:11.249 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:10 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:07:11.249 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:10 smithi152 ceph-mon[130220]: pgmap v454: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 28 op/s 2023-08-10T12:07:11.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:10 smithi156 ceph-mon[130574]: osdmap e101: 12 total, 12 up, 12 in 2023-08-10T12:07:11.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:10 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:07:11.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:10 smithi156 ceph-mon[130574]: pgmap v454: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 28 op/s 2023-08-10T12:07:11.272 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:10 smithi073 ceph-mon[128869]: osdmap e101: 12 total, 12 up, 12 in 2023-08-10T12:07:11.272 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:10 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:07:11.272 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:10 smithi073 ceph-mon[128869]: pgmap v454: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 28 op/s 2023-08-10T12:07:13.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:13 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:07:13.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:13 smithi152 ceph-mon[130220]: pgmap v455: 97 pgs: 12 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 70 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-08-10T12:07:13.508 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:13 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:07:13.509 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:13 smithi156 ceph-mon[130574]: pgmap v455: 97 pgs: 12 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 70 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-08-10T12:07:13.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:13 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:07:13.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:13 smithi073 ceph-mon[128869]: pgmap v455: 97 pgs: 12 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 70 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-08-10T12:07:15.247 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:14 smithi152 ceph-mon[130220]: pgmap v456: 97 pgs: 18 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 49 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 7 op/s 2023-08-10T12:07:15.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:14 smithi156 ceph-mon[130574]: pgmap v456: 97 pgs: 18 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 49 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 7 op/s 2023-08-10T12:07:15.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:14 smithi073 ceph-mon[128869]: pgmap v456: 97 pgs: 18 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 49 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 7 op/s 2023-08-10T12:07:17.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:17 smithi152 ceph-mon[130220]: pgmap v457: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-08-10T12:07:17.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:17 smithi156 ceph-mon[130574]: pgmap v457: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-08-10T12:07:17.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:17 smithi073 ceph-mon[128869]: pgmap v457: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2023-08-10T12:07:19.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:19 smithi152 ceph-mon[130220]: pgmap v458: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 223 B/s wr, 11 op/s 2023-08-10T12:07:19.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:19 smithi156 ceph-mon[130574]: pgmap v458: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 223 B/s wr, 11 op/s 2023-08-10T12:07:19.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:19 smithi073 ceph-mon[128869]: pgmap v458: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 223 B/s wr, 11 op/s 2023-08-10T12:07:21.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:21 smithi152 ceph-mon[130220]: pgmap v459: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 201 B/s wr, 10 op/s 2023-08-10T12:07:21.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:21 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:07:21.508 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:21 smithi156 ceph-mon[130574]: pgmap v459: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 201 B/s wr, 10 op/s 2023-08-10T12:07:21.508 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:21 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:07:21.524 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:21 smithi073 ceph-mon[128869]: pgmap v459: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 201 B/s wr, 10 op/s 2023-08-10T12:07:21.524 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:21 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:07:23.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:23 smithi073 ceph-mon[128869]: pgmap v460: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 12 op/s 2023-08-10T12:07:23.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:23 smithi152 ceph-mon[130220]: pgmap v460: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 12 op/s 2023-08-10T12:07:23.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:23 smithi156 ceph-mon[130574]: pgmap v460: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 12 op/s 2023-08-10T12:07:25.250 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:24 smithi152 ceph-mon[130220]: pgmap v461: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-08-10T12:07:25.258 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:24 smithi156 ceph-mon[130574]: pgmap v461: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-08-10T12:07:25.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:24 smithi073 ceph-mon[128869]: pgmap v461: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-08-10T12:07:27.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:27 smithi152 ceph-mon[130220]: pgmap v462: 97 pgs: 23 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 35 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-10T12:07:27.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:27 smithi156 ceph-mon[130574]: pgmap v462: 97 pgs: 23 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 35 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-10T12:07:27.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:27 smithi073 ceph-mon[128869]: pgmap v462: 97 pgs: 23 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 35 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-10T12:07:29.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:29 smithi152 ceph-mon[130220]: pgmap v463: 97 pgs: 23 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 35 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:07:29.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:29 smithi156 ceph-mon[130574]: pgmap v463: 97 pgs: 23 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 35 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:07:29.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:29 smithi073 ceph-mon[128869]: pgmap v463: 97 pgs: 23 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 35 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:07:31.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:31 smithi152 ceph-mon[130220]: pgmap v464: 97 pgs: 23 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 35 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:07:31.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:31 smithi156 ceph-mon[130574]: pgmap v464: 97 pgs: 23 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 35 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:07:31.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:31 smithi073 ceph-mon[128869]: pgmap v464: 97 pgs: 23 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 35 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:07:33.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:33 smithi152 ceph-mon[130220]: pgmap v465: 97 pgs: 23 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 35 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:07:33.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:33 smithi156 ceph-mon[130574]: pgmap v465: 97 pgs: 23 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 35 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:07:33.523 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:33 smithi073 ceph-mon[128869]: pgmap v465: 97 pgs: 23 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 35 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:07:35.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:34 smithi152 ceph-mon[130220]: pgmap v466: 97 pgs: 23 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 35 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:07:35.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:34 smithi156 ceph-mon[130574]: pgmap v466: 97 pgs: 23 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 35 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:07:35.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:34 smithi073 ceph-mon[128869]: pgmap v466: 97 pgs: 23 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 35 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:07:37.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:37 smithi152 ceph-mon[130220]: pgmap v467: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:07:37.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:37 smithi156 ceph-mon[130574]: pgmap v467: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:07:37.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:37 smithi073 ceph-mon[128869]: pgmap v467: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:07:39.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:39 smithi152 ceph-mon[130220]: pgmap v468: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:07:39.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:39 smithi156 ceph-mon[130574]: pgmap v468: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:07:39.523 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:39 smithi073 ceph-mon[128869]: pgmap v468: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:07:41.499 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:41 smithi152 ceph-mon[130220]: pgmap v469: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:07:41.508 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:41 smithi156 ceph-mon[130574]: pgmap v469: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:07:41.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:41 smithi073 ceph-mon[128869]: pgmap v469: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:07:43.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:43 smithi156 ceph-mon[130574]: pgmap v470: 97 pgs: 17 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 45 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 12 op/s 2023-08-10T12:07:43.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:43 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:07:43.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:43 smithi073 ceph-mon[128869]: pgmap v470: 97 pgs: 17 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 45 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 12 op/s 2023-08-10T12:07:43.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:43 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:07:43.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:43 smithi152 ceph-mon[130220]: pgmap v470: 97 pgs: 17 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 45 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 12 op/s 2023-08-10T12:07:43.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:43 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:07:45.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:44 smithi152 ceph-mon[130220]: pgmap v471: 97 pgs: 16 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 48 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2023-08-10T12:07:45.257 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:44 smithi156 ceph-mon[130574]: pgmap v471: 97 pgs: 16 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 48 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2023-08-10T12:07:45.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:44 smithi073 ceph-mon[128869]: pgmap v471: 97 pgs: 16 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 48 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2023-08-10T12:07:47.502 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:47 smithi152 ceph-mon[130220]: pgmap v472: 97 pgs: 14 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 53 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 12 op/s 2023-08-10T12:07:47.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:47 smithi156 ceph-mon[130574]: pgmap v472: 97 pgs: 14 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 53 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 12 op/s 2023-08-10T12:07:47.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:47 smithi073 ceph-mon[128869]: pgmap v472: 97 pgs: 14 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 53 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 12 op/s 2023-08-10T12:07:48.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:48 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:07:48.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:48 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:07:48.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:48 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:07:49.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:49 smithi152 ceph-mon[130220]: pgmap v473: 97 pgs: 14 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 53 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:07:49.508 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:49 smithi156 ceph-mon[130574]: pgmap v473: 97 pgs: 14 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 53 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:07:49.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:49 smithi073 ceph-mon[128869]: pgmap v473: 97 pgs: 14 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 53 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:07:51.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:51 smithi152 ceph-mon[130220]: pgmap v474: 97 pgs: 11 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 64 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:07:51.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:51 smithi156 ceph-mon[130574]: pgmap v474: 97 pgs: 11 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 64 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:07:51.523 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:51 smithi073 ceph-mon[128869]: pgmap v474: 97 pgs: 11 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 64 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:07:53.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:53 smithi152 ceph-mon[130220]: pgmap v475: 97 pgs: 10 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 65 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:07:53.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:53 smithi156 ceph-mon[130574]: pgmap v475: 97 pgs: 10 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 65 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:07:53.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:53 smithi073 ceph-mon[128869]: pgmap v475: 97 pgs: 10 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 65 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:07:55.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:54 smithi152 ceph-mon[130220]: pgmap v476: 97 pgs: 8 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 73 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:07:55.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:54 smithi156 ceph-mon[130574]: pgmap v476: 97 pgs: 8 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 73 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:07:55.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:54 smithi073 ceph-mon[128869]: pgmap v476: 97 pgs: 8 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 73 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:07:57.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:57 smithi152 ceph-mon[130220]: pgmap v477: 97 pgs: 5 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 87 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:07:57.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:57 smithi156 ceph-mon[130574]: pgmap v477: 97 pgs: 5 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 87 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:07:57.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:57 smithi073 ceph-mon[128869]: pgmap v477: 97 pgs: 5 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 87 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:07:59.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:07:59 smithi152 ceph-mon[130220]: pgmap v478: 97 pgs: 5 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 87 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-08-10T12:07:59.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:07:59 smithi156 ceph-mon[130574]: pgmap v478: 97 pgs: 5 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 87 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-08-10T12:07:59.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:07:59 smithi073 ceph-mon[128869]: pgmap v478: 97 pgs: 5 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 87 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-08-10T12:08:01.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:01 smithi152 ceph-mon[130220]: pgmap v479: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-08-10T12:08:01.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:01 smithi156 ceph-mon[130574]: pgmap v479: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-08-10T12:08:01.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:01 smithi073 ceph-mon[128869]: pgmap v479: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-08-10T12:08:03.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:03 smithi152 ceph-mon[130220]: pgmap v480: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-08-10T12:08:03.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:03 smithi156 ceph-mon[130574]: pgmap v480: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-08-10T12:08:03.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:03 smithi073 ceph-mon[128869]: pgmap v480: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-08-10T12:08:05.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:04 smithi152 ceph-mon[130220]: osdmap e102: 12 total, 12 up, 12 in 2023-08-10T12:08:05.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:04 smithi152 ceph-mon[130220]: pgmap v482: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-10T12:08:05.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:04 smithi156 ceph-mon[130574]: osdmap e102: 12 total, 12 up, 12 in 2023-08-10T12:08:05.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:04 smithi156 ceph-mon[130574]: pgmap v482: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-10T12:08:05.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:04 smithi073 ceph-mon[128869]: osdmap e102: 12 total, 12 up, 12 in 2023-08-10T12:08:05.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:04 smithi073 ceph-mon[128869]: pgmap v482: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-10T12:08:06.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:06 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:08:06.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:06 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:08:06.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:06 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:08:07.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:07 smithi152 ceph-mon[130220]: pgmap v483: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-08-10T12:08:07.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:07 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:08:07.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:07 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:08:07.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:07 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:08:07.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:07 smithi156 ceph-mon[130574]: pgmap v483: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-08-10T12:08:07.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:07 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:08:07.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:07 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:08:07.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:07 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:08:07.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:07 smithi073 ceph-mon[128869]: pgmap v483: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-08-10T12:08:07.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:07 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:08:07.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:07 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:08:07.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:07 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:08:09.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:09 smithi152 ceph-mon[130220]: pgmap v484: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-08-10T12:08:09.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:09 smithi156 ceph-mon[130574]: pgmap v484: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-08-10T12:08:09.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:09 smithi073 ceph-mon[128869]: pgmap v484: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-08-10T12:08:11.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:11 smithi152 ceph-mon[130220]: pgmap v485: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-08-10T12:08:11.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:11 smithi152 ceph-mon[130220]: osdmap e103: 12 total, 12 up, 12 in 2023-08-10T12:08:11.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:11 smithi156 ceph-mon[130574]: pgmap v485: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-08-10T12:08:11.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:11 smithi156 ceph-mon[130574]: osdmap e103: 12 total, 12 up, 12 in 2023-08-10T12:08:11.522 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:11 smithi073 ceph-mon[128869]: pgmap v485: 97 pgs: 97 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-08-10T12:08:11.522 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:11 smithi073 ceph-mon[128869]: osdmap e103: 12 total, 12 up, 12 in 2023-08-10T12:08:13.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:13 smithi152 ceph-mon[130220]: pgmap v487: 97 pgs: 8 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 81 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 251 B/s wr, 12 op/s 2023-08-10T12:08:13.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:13 smithi156 ceph-mon[130574]: pgmap v487: 97 pgs: 8 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 81 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 251 B/s wr, 12 op/s 2023-08-10T12:08:13.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:13 smithi073 ceph-mon[128869]: pgmap v487: 97 pgs: 8 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 81 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 251 B/s wr, 12 op/s 2023-08-10T12:08:15.256 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:15 smithi156 ceph-mon[130574]: pgmap v488: 97 pgs: 16 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 56 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:08:15.273 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:15 smithi073 ceph-mon[128869]: pgmap v488: 97 pgs: 16 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 56 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:08:15.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:15 smithi152 ceph-mon[130220]: pgmap v488: 97 pgs: 16 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 56 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:08:17.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:17 smithi152 ceph-mon[130220]: pgmap v489: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:08:17.517 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:17 smithi156 ceph-mon[130574]: pgmap v489: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:08:17.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:17 smithi073 ceph-mon[128869]: pgmap v489: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:08:18.499 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:18 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:08:18.508 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:18 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:08:18.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:18 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:08:19.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:19 smithi073 ceph-mon[128869]: pgmap v490: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:08:19.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:19 smithi152 ceph-mon[130220]: pgmap v490: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:08:19.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:19 smithi156 ceph-mon[130574]: pgmap v490: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:08:21.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:21 smithi073 ceph-mon[128869]: pgmap v491: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:08:21.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:21 smithi152 ceph-mon[130220]: pgmap v491: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:08:21.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:21 smithi156 ceph-mon[130574]: pgmap v491: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:08:23.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:23 smithi152 ceph-mon[130220]: pgmap v492: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 171 B/s wr, 12 op/s 2023-08-10T12:08:23.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:23 smithi156 ceph-mon[130574]: pgmap v492: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 171 B/s wr, 12 op/s 2023-08-10T12:08:23.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:23 smithi073 ceph-mon[128869]: pgmap v492: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 171 B/s wr, 12 op/s 2023-08-10T12:08:25.270 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:25 smithi073 ceph-mon[128869]: pgmap v493: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-08-10T12:08:25.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:25 smithi152 ceph-mon[130220]: pgmap v493: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-08-10T12:08:25.513 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:25 smithi156 ceph-mon[130574]: pgmap v493: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-08-10T12:08:27.499 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:27 smithi152 ceph-mon[130220]: pgmap v494: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-10T12:08:27.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:27 smithi156 ceph-mon[130574]: pgmap v494: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-10T12:08:27.524 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:27 smithi073 ceph-mon[128869]: pgmap v494: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-10T12:08:29.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:29 smithi152 ceph-mon[130220]: pgmap v495: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:08:29.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:29 smithi156 ceph-mon[130574]: pgmap v495: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:08:29.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:29 smithi073 ceph-mon[128869]: pgmap v495: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:08:31.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:31 smithi152 ceph-mon[130220]: pgmap v496: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2023-08-10T12:08:31.508 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:31 smithi156 ceph-mon[130574]: pgmap v496: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2023-08-10T12:08:31.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:31 smithi073 ceph-mon[128869]: pgmap v496: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2023-08-10T12:08:33.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:33 smithi156 ceph-mon[130574]: pgmap v497: 97 pgs: 18 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 44 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 12 op/s 2023-08-10T12:08:33.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:33 smithi073 ceph-mon[128869]: pgmap v497: 97 pgs: 18 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 44 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 12 op/s 2023-08-10T12:08:33.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:33 smithi152 ceph-mon[130220]: pgmap v497: 97 pgs: 18 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 44 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 12 op/s 2023-08-10T12:08:35.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:35 smithi152 ceph-mon[130220]: pgmap v498: 97 pgs: 18 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 44 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:08:35.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:35 smithi156 ceph-mon[130574]: pgmap v498: 97 pgs: 18 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 44 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:08:35.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:35 smithi073 ceph-mon[128869]: pgmap v498: 97 pgs: 18 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 44 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:08:37.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:37 smithi152 ceph-mon[130220]: pgmap v499: 97 pgs: 15 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 51 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:08:37.513 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:37 smithi156 ceph-mon[130574]: pgmap v499: 97 pgs: 15 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 51 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:08:37.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:37 smithi073 ceph-mon[128869]: pgmap v499: 97 pgs: 15 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 51 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:08:39.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:39 smithi152 ceph-mon[130220]: pgmap v500: 97 pgs: 15 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 51 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:08:39.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:39 smithi156 ceph-mon[130574]: pgmap v500: 97 pgs: 15 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 51 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:08:39.522 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:39 smithi073 ceph-mon[128869]: pgmap v500: 97 pgs: 15 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 51 active+clean; 2.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:08:41.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:41 smithi152 ceph-mon[130220]: pgmap v501: 97 pgs: 11 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 61 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:08:41.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:41 smithi156 ceph-mon[130574]: pgmap v501: 97 pgs: 11 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 61 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:08:41.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:41 smithi073 ceph-mon[128869]: pgmap v501: 97 pgs: 11 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 61 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:08:43.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:43 smithi156 ceph-mon[130574]: pgmap v502: 97 pgs: 9 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 66 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:08:43.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:43 smithi073 ceph-mon[128869]: pgmap v502: 97 pgs: 9 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 66 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:08:43.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:43 smithi152 ceph-mon[130220]: pgmap v502: 97 pgs: 9 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 66 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:08:45.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:44 smithi152 ceph-mon[130220]: pgmap v503: 97 pgs: 6 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 80 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:08:45.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:44 smithi156 ceph-mon[130574]: pgmap v503: 97 pgs: 6 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 80 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:08:45.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:44 smithi073 ceph-mon[128869]: pgmap v503: 97 pgs: 6 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 80 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:08:47.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:47 smithi152 ceph-mon[130220]: pgmap v504: 97 pgs: 4 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 88 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:08:47.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:47 smithi156 ceph-mon[130574]: pgmap v504: 97 pgs: 4 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 88 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:08:47.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:47 smithi073 ceph-mon[128869]: pgmap v504: 97 pgs: 4 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 88 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:08:49.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:49 smithi152 ceph-mon[130220]: pgmap v505: 97 pgs: 4 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 88 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:08:49.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:49 smithi156 ceph-mon[130574]: pgmap v505: 97 pgs: 4 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 88 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:08:49.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:49 smithi073 ceph-mon[128869]: pgmap v505: 97 pgs: 4 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 88 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:08:51.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:51 smithi152 ceph-mon[130220]: pgmap v506: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:08:51.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:51 smithi156 ceph-mon[130574]: pgmap v506: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:08:51.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:51 smithi073 ceph-mon[128869]: pgmap v506: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:08:53.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:53 smithi152 ceph-mon[130220]: pgmap v507: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:08:53.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:53 smithi156 ceph-mon[130574]: pgmap v507: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:08:53.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:53 smithi073 ceph-mon[128869]: pgmap v507: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:08:55.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:54 smithi152 ceph-mon[130220]: osdmap e104: 12 total, 12 up, 12 in 2023-08-10T12:08:55.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:54 smithi152 ceph-mon[130220]: pgmap v509: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:08:55.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:54 smithi156 ceph-mon[130574]: osdmap e104: 12 total, 12 up, 12 in 2023-08-10T12:08:55.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:54 smithi156 ceph-mon[130574]: pgmap v509: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:08:55.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:54 smithi073 ceph-mon[128869]: osdmap e104: 12 total, 12 up, 12 in 2023-08-10T12:08:55.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:54 smithi073 ceph-mon[128869]: pgmap v509: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:08:57.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:57 smithi152 ceph-mon[130220]: pgmap v510: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:08:57.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:57 smithi156 ceph-mon[130574]: pgmap v510: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:08:57.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:57 smithi073 ceph-mon[128869]: pgmap v510: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:08:59.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:08:59 smithi152 ceph-mon[130220]: pgmap v511: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:08:59.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:08:59 smithi156 ceph-mon[130574]: pgmap v511: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:08:59.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:08:59 smithi073 ceph-mon[128869]: pgmap v511: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:09:01.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:01 smithi152 ceph-mon[130220]: pgmap v512: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:09:01.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:01 smithi156 ceph-mon[130574]: pgmap v512: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:09:01.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:01 smithi073 ceph-mon[128869]: pgmap v512: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:09:03.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:03 smithi152 ceph-mon[130220]: pgmap v513: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-10T12:09:03.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:03 smithi156 ceph-mon[130574]: pgmap v513: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-10T12:09:03.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:03 smithi073 ceph-mon[128869]: pgmap v513: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-10T12:09:05.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:04 smithi152 ceph-mon[130220]: pgmap v514: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-10T12:09:05.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:04 smithi156 ceph-mon[130574]: pgmap v514: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-10T12:09:05.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:04 smithi073 ceph-mon[128869]: pgmap v514: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-10T12:09:07.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:07 smithi152 ceph-mon[130220]: pgmap v515: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-08-10T12:09:07.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:07 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:09:07.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:07 smithi156 ceph-mon[130574]: pgmap v515: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-08-10T12:09:07.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:07 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:09:07.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:07 smithi073 ceph-mon[128869]: pgmap v515: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-08-10T12:09:07.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:07 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:09:08.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:08 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:09:08.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:08 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:09:08.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:08 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:09:08.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:08 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:09:08.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:08 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:09:08.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:08 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:09:08.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:08 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:09:08.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:08 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:09:08.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:08 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:09:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:09 smithi152 ceph-mon[130220]: pgmap v516: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-08-10T12:09:09.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:09 smithi156 ceph-mon[130574]: pgmap v516: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-08-10T12:09:09.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:09 smithi073 ceph-mon[128869]: pgmap v516: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-08-10T12:09:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:11 smithi152 ceph-mon[130220]: pgmap v517: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-08-10T12:09:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:11 smithi152 ceph-mon[130220]: osdmap e105: 12 total, 12 up, 12 in 2023-08-10T12:09:11.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:11 smithi156 ceph-mon[130574]: pgmap v517: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-08-10T12:09:11.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:11 smithi156 ceph-mon[130574]: osdmap e105: 12 total, 12 up, 12 in 2023-08-10T12:09:11.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:11 smithi073 ceph-mon[128869]: pgmap v517: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-08-10T12:09:11.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:11 smithi073 ceph-mon[128869]: osdmap e105: 12 total, 12 up, 12 in 2023-08-10T12:09:13.754 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:13 smithi152 ceph-mon[130220]: pgmap v519: 97 pgs: 8 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 81 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:09:13.758 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:13 smithi156 ceph-mon[130574]: pgmap v519: 97 pgs: 8 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 81 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:09:13.770 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:13 smithi073 ceph-mon[128869]: pgmap v519: 97 pgs: 8 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 81 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:09:15.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:15 smithi152 ceph-mon[130220]: pgmap v520: 97 pgs: 16 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 56 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:09:15.509 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:15 smithi156 ceph-mon[130574]: pgmap v520: 97 pgs: 16 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 56 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:09:15.522 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:15 smithi073 ceph-mon[128869]: pgmap v520: 97 pgs: 16 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 56 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:09:17.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:17 smithi156 ceph-mon[130574]: pgmap v521: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:09:17.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:17 smithi073 ceph-mon[128869]: pgmap v521: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:09:17.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:17 smithi152 ceph-mon[130220]: pgmap v521: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:09:19.509 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:19 smithi156 ceph-mon[130574]: pgmap v522: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:09:19.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:19 smithi073 ceph-mon[128869]: pgmap v522: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:09:19.749 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:19 smithi152 ceph-mon[130220]: pgmap v522: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:09:21.524 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:21 smithi073 ceph-mon[128869]: pgmap v523: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:09:21.748 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:21 smithi152 ceph-mon[130220]: pgmap v523: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:09:21.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:21 smithi156 ceph-mon[130574]: pgmap v523: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:09:23.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:23 smithi152 ceph-mon[130220]: pgmap v524: 97 pgs: 23 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 35 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 172 B/s wr, 12 op/s 2023-08-10T12:09:23.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:23 smithi156 ceph-mon[130574]: pgmap v524: 97 pgs: 23 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 35 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 172 B/s wr, 12 op/s 2023-08-10T12:09:23.772 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:23 smithi073 ceph-mon[128869]: pgmap v524: 97 pgs: 23 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 35 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 172 B/s wr, 12 op/s 2023-08-10T12:09:25.269 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:25 smithi073 ceph-mon[128869]: pgmap v525: 97 pgs: 23 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 35 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-08-10T12:09:25.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:25 smithi152 ceph-mon[130220]: pgmap v525: 97 pgs: 23 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 35 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-08-10T12:09:25.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:25 smithi156 ceph-mon[130574]: pgmap v525: 97 pgs: 23 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 35 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-08-10T12:09:27.510 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:27 smithi156 ceph-mon[130574]: pgmap v526: 97 pgs: 17 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 45 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-10T12:09:27.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:27 smithi073 ceph-mon[128869]: pgmap v526: 97 pgs: 17 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 45 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-10T12:09:27.748 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:27 smithi152 ceph-mon[130220]: pgmap v526: 97 pgs: 17 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 45 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-10T12:09:29.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:29 smithi073 ceph-mon[128869]: pgmap v527: 97 pgs: 17 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 45 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-10T12:09:29.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:29 smithi152 ceph-mon[130220]: pgmap v527: 97 pgs: 17 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 45 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-10T12:09:29.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:29 smithi156 ceph-mon[130574]: pgmap v527: 97 pgs: 17 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 45 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-10T12:09:31.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:31 smithi152 ceph-mon[130220]: pgmap v528: 97 pgs: 15 active+clean+snaptrim, 29 active+clean+snaptrim_wait, 53 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:09:31.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:31 smithi156 ceph-mon[130574]: pgmap v528: 97 pgs: 15 active+clean+snaptrim, 29 active+clean+snaptrim_wait, 53 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:09:31.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:31 smithi073 ceph-mon[128869]: pgmap v528: 97 pgs: 15 active+clean+snaptrim, 29 active+clean+snaptrim_wait, 53 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:09:33.753 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:33 smithi152 ceph-mon[130220]: pgmap v529: 97 pgs: 13 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 58 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:09:33.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:33 smithi156 ceph-mon[130574]: pgmap v529: 97 pgs: 13 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 58 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:09:33.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:33 smithi073 ceph-mon[128869]: pgmap v529: 97 pgs: 13 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 58 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:09:35.258 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:35 smithi156 ceph-mon[130574]: pgmap v530: 97 pgs: 8 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 78 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:09:35.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:35 smithi073 ceph-mon[128869]: pgmap v530: 97 pgs: 8 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 78 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:09:35.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:35 smithi152 ceph-mon[130220]: pgmap v530: 97 pgs: 8 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 78 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:09:37.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:37 smithi152 ceph-mon[130220]: pgmap v531: 97 pgs: 5 active+clean+snaptrim, 92 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:09:37.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:37 smithi156 ceph-mon[130574]: pgmap v531: 97 pgs: 5 active+clean+snaptrim, 92 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:09:37.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:37 smithi073 ceph-mon[128869]: pgmap v531: 97 pgs: 5 active+clean+snaptrim, 92 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:09:39.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:39 smithi152 ceph-mon[130220]: pgmap v532: 97 pgs: 4 active+clean+snaptrim, 93 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:09:39.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:39 smithi156 ceph-mon[130574]: pgmap v532: 97 pgs: 4 active+clean+snaptrim, 93 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:09:39.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:39 smithi073 ceph-mon[128869]: pgmap v532: 97 pgs: 4 active+clean+snaptrim, 93 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:09:41.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:41 smithi152 ceph-mon[130220]: pgmap v533: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:09:41.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:41 smithi156 ceph-mon[130574]: pgmap v533: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:09:41.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:41 smithi073 ceph-mon[128869]: pgmap v533: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:09:43.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:43 smithi152 ceph-mon[130220]: pgmap v534: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:09:43.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:43 smithi156 ceph-mon[130574]: pgmap v534: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:09:43.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:43 smithi073 ceph-mon[128869]: pgmap v534: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:09:45.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:45 smithi156 ceph-mon[130574]: osdmap e106: 12 total, 12 up, 12 in 2023-08-10T12:09:45.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:45 smithi156 ceph-mon[130574]: pgmap v536: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:09:45.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:45 smithi073 ceph-mon[128869]: osdmap e106: 12 total, 12 up, 12 in 2023-08-10T12:09:45.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:45 smithi073 ceph-mon[128869]: pgmap v536: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:09:45.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:45 smithi152 ceph-mon[130220]: osdmap e106: 12 total, 12 up, 12 in 2023-08-10T12:09:45.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:45 smithi152 ceph-mon[130220]: pgmap v536: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:09:47.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:47 smithi152 ceph-mon[130220]: pgmap v537: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:09:47.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:47 smithi156 ceph-mon[130574]: pgmap v537: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:09:47.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:47 smithi073 ceph-mon[128869]: pgmap v537: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:09:49.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:49 smithi152 ceph-mon[130220]: pgmap v538: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:09:49.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:49 smithi156 ceph-mon[130574]: pgmap v538: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:09:49.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:49 smithi073 ceph-mon[128869]: pgmap v538: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:09:51.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:51 smithi152 ceph-mon[130220]: pgmap v539: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:09:51.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:51 smithi156 ceph-mon[130574]: pgmap v539: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:09:51.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:51 smithi073 ceph-mon[128869]: pgmap v539: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:09:53.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:53 smithi152 ceph-mon[130220]: pgmap v540: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:09:53.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:53 smithi156 ceph-mon[130574]: pgmap v540: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:09:53.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:53 smithi073 ceph-mon[128869]: pgmap v540: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:09:55.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:55 smithi073 ceph-mon[128869]: pgmap v541: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-08-10T12:09:55.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:55 smithi152 ceph-mon[130220]: pgmap v541: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-08-10T12:09:55.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:55 smithi156 ceph-mon[130574]: pgmap v541: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-08-10T12:09:57.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:57 smithi152 ceph-mon[130220]: pgmap v542: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:09:57.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:57 smithi156 ceph-mon[130574]: pgmap v542: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:09:57.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:57 smithi073 ceph-mon[128869]: pgmap v542: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:09:59.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:09:59 smithi152 ceph-mon[130220]: pgmap v543: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:09:59.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:09:59 smithi156 ceph-mon[130574]: pgmap v543: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:09:59.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:09:59 smithi073 ceph-mon[128869]: pgmap v543: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:10:00.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:00 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mon-a[128845]: 2023-08-10T12:09:59.999+0000 7f3dd78d8700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 MDSs report damaged metadata 2023-08-10T12:10:00.268 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:00 smithi073 ceph-mon[128869]: overall HEALTH_ERR 1 MDSs report damaged metadata 2023-08-10T12:10:00.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:00 smithi152 ceph-mon[130220]: overall HEALTH_ERR 1 MDSs report damaged metadata 2023-08-10T12:10:00.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:00 smithi156 ceph-mon[130574]: overall HEALTH_ERR 1 MDSs report damaged metadata 2023-08-10T12:10:01.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:01 smithi152 ceph-mon[130220]: pgmap v544: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:10:01.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:01 smithi156 ceph-mon[130574]: pgmap v544: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:10:01.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:01 smithi073 ceph-mon[128869]: pgmap v544: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:10:03.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:03 smithi152 ceph-mon[130220]: pgmap v545: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:10:03.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:03 smithi156 ceph-mon[130574]: pgmap v545: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:10:03.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:03 smithi073 ceph-mon[128869]: pgmap v545: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:10:05.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:05 smithi073 ceph-mon[128869]: pgmap v546: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:10:05.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:05 smithi152 ceph-mon[130220]: pgmap v546: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:10:05.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:05 smithi156 ceph-mon[130574]: pgmap v546: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:10:07.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:07 smithi152 ceph-mon[130220]: pgmap v547: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:10:07.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:07 smithi156 ceph-mon[130574]: pgmap v547: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:10:07.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:07 smithi073 ceph-mon[128869]: pgmap v547: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:10:08.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:08 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:10:08.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:08 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:10:08.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:08 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:10:08.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:08 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:10:08.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:08 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:10:08.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:08 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:10:08.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:08 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:10:08.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:08 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:10:08.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:08 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:10:08.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:08 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:10:08.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:08 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:10:08.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:08 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:10:09.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:09 smithi152 ceph-mon[130220]: pgmap v548: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:10:09.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:09 smithi156 ceph-mon[130574]: pgmap v548: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:10:09.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:09 smithi073 ceph-mon[128869]: pgmap v548: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:10:11.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:11 smithi152 ceph-mon[130220]: pgmap v549: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:10:11.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:11 smithi152 ceph-mon[130220]: osdmap e107: 12 total, 12 up, 12 in 2023-08-10T12:10:11.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:11 smithi156 ceph-mon[130574]: pgmap v549: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:10:11.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:11 smithi156 ceph-mon[130574]: osdmap e107: 12 total, 12 up, 12 in 2023-08-10T12:10:11.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:11 smithi073 ceph-mon[128869]: pgmap v549: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:10:11.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:11 smithi073 ceph-mon[128869]: osdmap e107: 12 total, 12 up, 12 in 2023-08-10T12:10:13.523 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:13 smithi073 ceph-mon[128869]: pgmap v551: 97 pgs: 8 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 81 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:10:13.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:13 smithi152 ceph-mon[130220]: pgmap v551: 97 pgs: 8 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 81 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:10:13.758 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:13 smithi156 ceph-mon[130574]: pgmap v551: 97 pgs: 8 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 81 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:10:15.503 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:15 smithi152 ceph-mon[130220]: pgmap v552: 97 pgs: 16 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 56 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:10:15.514 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:15 smithi156 ceph-mon[130574]: pgmap v552: 97 pgs: 16 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 56 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:10:15.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:15 smithi073 ceph-mon[128869]: pgmap v552: 97 pgs: 16 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 56 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:10:17.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:17 smithi073 ceph-mon[128869]: pgmap v553: 97 pgs: 22 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 36 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:10:17.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:17 smithi152 ceph-mon[130220]: pgmap v553: 97 pgs: 22 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 36 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:10:17.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:17 smithi156 ceph-mon[130574]: pgmap v553: 97 pgs: 22 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 36 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:10:19.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:19 smithi073 ceph-mon[128869]: pgmap v554: 97 pgs: 22 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 36 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:10:19.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:19 smithi152 ceph-mon[130220]: pgmap v554: 97 pgs: 22 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 36 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:10:19.759 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:19 smithi156 ceph-mon[130574]: pgmap v554: 97 pgs: 22 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 36 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:10:21.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:21 smithi152 ceph-mon[130220]: pgmap v555: 97 pgs: 19 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 44 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:10:21.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:21 smithi156 ceph-mon[130574]: pgmap v555: 97 pgs: 19 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 44 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:10:21.770 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:21 smithi073 ceph-mon[128869]: pgmap v555: 97 pgs: 19 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 44 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:10:23.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:23 smithi152 ceph-mon[130220]: pgmap v556: 97 pgs: 12 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 58 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 171 B/s wr, 12 op/s 2023-08-10T12:10:23.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:23 smithi156 ceph-mon[130574]: pgmap v556: 97 pgs: 12 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 58 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 171 B/s wr, 12 op/s 2023-08-10T12:10:23.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:23 smithi073 ceph-mon[128869]: pgmap v556: 97 pgs: 12 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 58 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 171 B/s wr, 12 op/s 2023-08-10T12:10:25.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:25 smithi152 ceph-mon[130220]: pgmap v557: 97 pgs: 5 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 81 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 8 op/s 2023-08-10T12:10:25.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:25 smithi156 ceph-mon[130574]: pgmap v557: 97 pgs: 5 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 81 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 8 op/s 2023-08-10T12:10:25.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:25 smithi073 ceph-mon[128869]: pgmap v557: 97 pgs: 5 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 81 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 8 op/s 2023-08-10T12:10:27.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:27 smithi152 ceph-mon[130220]: pgmap v558: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-10T12:10:27.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:27 smithi156 ceph-mon[130574]: pgmap v558: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-10T12:10:27.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:27 smithi073 ceph-mon[128869]: pgmap v558: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 12 op/s 2023-08-10T12:10:29.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:29 smithi152 ceph-mon[130220]: pgmap v559: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-10T12:10:29.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:29 smithi152 ceph-mon[130220]: osdmap e108: 12 total, 12 up, 12 in 2023-08-10T12:10:29.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:29 smithi156 ceph-mon[130574]: pgmap v559: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-10T12:10:29.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:29 smithi156 ceph-mon[130574]: osdmap e108: 12 total, 12 up, 12 in 2023-08-10T12:10:29.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:29 smithi073 ceph-mon[128869]: pgmap v559: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-10T12:10:29.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:29 smithi073 ceph-mon[128869]: osdmap e108: 12 total, 12 up, 12 in 2023-08-10T12:10:31.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:31 smithi152 ceph-mon[130220]: pgmap v561: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-08-10T12:10:31.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:31 smithi156 ceph-mon[130574]: pgmap v561: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-08-10T12:10:31.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:31 smithi073 ceph-mon[128869]: pgmap v561: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-08-10T12:10:33.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:33 smithi152 ceph-mon[130220]: pgmap v562: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-08-10T12:10:33.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:33 smithi156 ceph-mon[130574]: pgmap v562: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-08-10T12:10:33.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:33 smithi073 ceph-mon[128869]: pgmap v562: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-08-10T12:10:35.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:35 smithi152 ceph-mon[130220]: pgmap v563: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:10:35.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:35 smithi156 ceph-mon[130574]: pgmap v563: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:10:35.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:35 smithi073 ceph-mon[128869]: pgmap v563: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:10:37.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:37 smithi152 ceph-mon[130220]: pgmap v564: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:10:37.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:37 smithi156 ceph-mon[130574]: pgmap v564: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:10:37.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:37 smithi073 ceph-mon[128869]: pgmap v564: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:10:39.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:39 smithi152 ceph-mon[130220]: pgmap v565: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:10:39.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:39 smithi156 ceph-mon[130574]: pgmap v565: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:10:39.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:39 smithi073 ceph-mon[128869]: pgmap v565: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:10:41.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:41 smithi152 ceph-mon[130220]: pgmap v566: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:10:41.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:41 smithi156 ceph-mon[130574]: pgmap v566: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:10:41.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:41 smithi073 ceph-mon[128869]: pgmap v566: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:10:43.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:43 smithi152 ceph-mon[130220]: pgmap v567: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:10:43.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:43 smithi156 ceph-mon[130574]: pgmap v567: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:10:43.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:43 smithi073 ceph-mon[128869]: pgmap v567: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:10:45.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:45 smithi152 ceph-mon[130220]: pgmap v568: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:10:45.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:45 smithi156 ceph-mon[130574]: pgmap v568: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:10:45.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:45 smithi073 ceph-mon[128869]: pgmap v568: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:10:47.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:47 smithi152 ceph-mon[130220]: pgmap v569: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:10:47.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:47 smithi156 ceph-mon[130574]: pgmap v569: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:10:47.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:47 smithi073 ceph-mon[128869]: pgmap v569: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:10:49.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:49 smithi152 ceph-mon[130220]: pgmap v570: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:10:49.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:49 smithi156 ceph-mon[130574]: pgmap v570: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:10:49.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:49 smithi073 ceph-mon[128869]: pgmap v570: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:10:51.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:51 smithi156 ceph-mon[130574]: pgmap v571: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:10:51.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:51 smithi073 ceph-mon[128869]: pgmap v571: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:10:51.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:51 smithi152 ceph-mon[130220]: pgmap v571: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:10:53.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:53 smithi156 ceph-mon[130574]: pgmap v572: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:10:53.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:53 smithi073 ceph-mon[128869]: pgmap v572: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:10:53.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:53 smithi152 ceph-mon[130220]: pgmap v572: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:10:55.031 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:55 smithi152 ceph-mon[130220]: pgmap v573: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:10:55.035 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2023-08-10T12:10:55.040 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2023-08-10T12:10:55.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:55 smithi156 ceph-mon[130574]: pgmap v573: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:10:55.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:55 smithi073 ceph-mon[128869]: pgmap v573: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:10:57.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:57 smithi152 ceph-mon[130220]: pgmap v574: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:10:57.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:57 smithi152 ceph-mon[130220]: from='mds.? [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790]' entity='mds.f' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"192.168.0.1:0/2837499992"}]: dispatch 2023-08-10T12:10:57.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:57 smithi152 ceph-mon[130220]: from='mds.? ' entity='mds.f' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"192.168.0.1:0/2837499992"}]: dispatch 2023-08-10T12:10:57.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:57 smithi152 ceph-mon[130220]: from='mds.? [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154]' entity='mds.k' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"192.168.0.1:0/2837499992"}]: dispatch 2023-08-10T12:10:57.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:57 smithi152 ceph-mon[130220]: from='mds.? ' entity='mds.k' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"192.168.0.1:0/2837499992"}]: dispatch 2023-08-10T12:10:57.510 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:57 smithi156 ceph-mon[130574]: pgmap v574: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:10:57.510 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:57 smithi156 ceph-mon[130574]: from='mds.? [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790]' entity='mds.f' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"192.168.0.1:0/2837499992"}]: dispatch 2023-08-10T12:10:57.510 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:57 smithi156 ceph-mon[130574]: from='mds.? ' entity='mds.f' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"192.168.0.1:0/2837499992"}]: dispatch 2023-08-10T12:10:57.511 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:57 smithi156 ceph-mon[130574]: from='mds.? [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154]' entity='mds.k' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"192.168.0.1:0/2837499992"}]: dispatch 2023-08-10T12:10:57.511 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:57 smithi156 ceph-mon[130574]: from='mds.? ' entity='mds.k' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"192.168.0.1:0/2837499992"}]: dispatch 2023-08-10T12:10:57.534 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:57 smithi073 ceph-mon[128869]: pgmap v574: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:10:57.535 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:57 smithi073 ceph-mon[128869]: from='mds.? [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790]' entity='mds.f' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"192.168.0.1:0/2837499992"}]: dispatch 2023-08-10T12:10:57.535 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:57 smithi073 ceph-mon[128869]: from='mds.? ' entity='mds.f' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"192.168.0.1:0/2837499992"}]: dispatch 2023-08-10T12:10:57.535 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:57 smithi073 ceph-mon[128869]: from='mds.? [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154]' entity='mds.k' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"192.168.0.1:0/2837499992"}]: dispatch 2023-08-10T12:10:57.535 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:57 smithi073 ceph-mon[128869]: from='mds.? ' entity='mds.k' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"192.168.0.1:0/2837499992"}]: dispatch 2023-08-10T12:10:58.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:58 smithi152 ceph-mon[130220]: evicting unresponsive client smithi073:0 (15318), after 340.943 seconds 2023-08-10T12:10:58.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:58 smithi152 ceph-mon[130220]: Evicting (and blocklisting) client session 15318 (192.168.0.1:0/2837499992) 2023-08-10T12:10:58.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:58 smithi152 ceph-mon[130220]: evicting unresponsive client smithi073:0 (15318), after 341.505 seconds 2023-08-10T12:10:58.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:58 smithi152 ceph-mon[130220]: Evicting (and blocklisting) client session 15318 (192.168.0.1:0/2837499992) 2023-08-10T12:10:58.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:58 smithi152 ceph-mon[130220]: from='mds.? ' entity='mds.f' cmd='[{"prefix":"osd blocklist", "blocklistop":"add","addr":"192.168.0.1:0/2837499992"}]': finished 2023-08-10T12:10:58.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:58 smithi152 ceph-mon[130220]: from='mds.? ' entity='mds.k' cmd='[{"prefix":"osd blocklist", "blocklistop":"add","addr":"192.168.0.1:0/2837499992"}]': finished 2023-08-10T12:10:58.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:58 smithi152 ceph-mon[130220]: osdmap e109: 12 total, 12 up, 12 in 2023-08-10T12:10:58.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:58 smithi156 ceph-mon[130574]: evicting unresponsive client smithi073:0 (15318), after 340.943 seconds 2023-08-10T12:10:58.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:58 smithi156 ceph-mon[130574]: Evicting (and blocklisting) client session 15318 (192.168.0.1:0/2837499992) 2023-08-10T12:10:58.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:58 smithi156 ceph-mon[130574]: evicting unresponsive client smithi073:0 (15318), after 341.505 seconds 2023-08-10T12:10:58.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:58 smithi156 ceph-mon[130574]: Evicting (and blocklisting) client session 15318 (192.168.0.1:0/2837499992) 2023-08-10T12:10:58.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:58 smithi156 ceph-mon[130574]: from='mds.? ' entity='mds.f' cmd='[{"prefix":"osd blocklist", "blocklistop":"add","addr":"192.168.0.1:0/2837499992"}]': finished 2023-08-10T12:10:58.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:58 smithi156 ceph-mon[130574]: from='mds.? ' entity='mds.k' cmd='[{"prefix":"osd blocklist", "blocklistop":"add","addr":"192.168.0.1:0/2837499992"}]': finished 2023-08-10T12:10:58.757 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:58 smithi156 ceph-mon[130574]: osdmap e109: 12 total, 12 up, 12 in 2023-08-10T12:10:58.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:58 smithi073 ceph-mon[128869]: evicting unresponsive client smithi073:0 (15318), after 340.943 seconds 2023-08-10T12:10:58.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:58 smithi073 ceph-mon[128869]: Evicting (and blocklisting) client session 15318 (192.168.0.1:0/2837499992) 2023-08-10T12:10:58.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:58 smithi073 ceph-mon[128869]: evicting unresponsive client smithi073:0 (15318), after 341.505 seconds 2023-08-10T12:10:58.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:58 smithi073 ceph-mon[128869]: Evicting (and blocklisting) client session 15318 (192.168.0.1:0/2837499992) 2023-08-10T12:10:58.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:58 smithi073 ceph-mon[128869]: from='mds.? ' entity='mds.f' cmd='[{"prefix":"osd blocklist", "blocklistop":"add","addr":"192.168.0.1:0/2837499992"}]': finished 2023-08-10T12:10:58.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:58 smithi073 ceph-mon[128869]: from='mds.? ' entity='mds.k' cmd='[{"prefix":"osd blocklist", "blocklistop":"add","addr":"192.168.0.1:0/2837499992"}]': finished 2023-08-10T12:10:58.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:58 smithi073 ceph-mon[128869]: osdmap e109: 12 total, 12 up, 12 in 2023-08-10T12:10:59.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:10:59 smithi152 ceph-mon[130220]: pgmap v576: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:10:59.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:10:59 smithi156 ceph-mon[130574]: pgmap v576: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:10:59.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:10:59 smithi073 ceph-mon[128869]: pgmap v576: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:11:00.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:00 smithi152 ceph-mon[130220]: Health check failed: 1 client(s) laggy due to laggy OSDs (MDS_CLIENTS_LAGGY) 2023-08-10T12:11:00.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:00 smithi152 ceph-mon[130220]: mds.? [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] up:active 2023-08-10T12:11:00.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:00 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:11:00.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:00 smithi156 ceph-mon[130574]: Health check failed: 1 client(s) laggy due to laggy OSDs (MDS_CLIENTS_LAGGY) 2023-08-10T12:11:00.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:00 smithi156 ceph-mon[130574]: mds.? [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] up:active 2023-08-10T12:11:00.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:00 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:11:00.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:00 smithi073 ceph-mon[128869]: Health check failed: 1 client(s) laggy due to laggy OSDs (MDS_CLIENTS_LAGGY) 2023-08-10T12:11:00.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:00 smithi073 ceph-mon[128869]: mds.? [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] up:active 2023-08-10T12:11:00.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:00 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:11:01.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:01 smithi152 ceph-mon[130220]: pgmap v577: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-08-10T12:11:01.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:01 smithi156 ceph-mon[130574]: pgmap v577: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-08-10T12:11:01.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:01 smithi073 ceph-mon[128869]: pgmap v577: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-08-10T12:11:02.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:02 smithi152 ceph-mon[130220]: mds.? [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] up:active 2023-08-10T12:11:02.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:02 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:11:02.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:02 smithi156 ceph-mon[130574]: mds.? [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] up:active 2023-08-10T12:11:02.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:02 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:11:02.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:02 smithi073 ceph-mon[128869]: mds.? [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] up:active 2023-08-10T12:11:02.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:02 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:11:03.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:03 smithi152 ceph-mon[130220]: pgmap v578: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 30 op/s 2023-08-10T12:11:03.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:03 smithi152 ceph-mon[130220]: MDS health message cleared (mds.?): Client 15318 is laggy; not evicted because some OSD(s) is/are laggy 2023-08-10T12:11:03.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:03 smithi156 ceph-mon[130574]: pgmap v578: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 30 op/s 2023-08-10T12:11:03.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:03 smithi156 ceph-mon[130574]: MDS health message cleared (mds.?): Client 15318 is laggy; not evicted because some OSD(s) is/are laggy 2023-08-10T12:11:03.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:03 smithi073 ceph-mon[128869]: pgmap v578: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 30 op/s 2023-08-10T12:11:03.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:03 smithi073 ceph-mon[128869]: MDS health message cleared (mds.?): Client 15318 is laggy; not evicted because some OSD(s) is/are laggy 2023-08-10T12:11:04.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:04 smithi152 ceph-mon[130220]: mds.? [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] up:active 2023-08-10T12:11:04.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:04 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:11:04.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:04 smithi156 ceph-mon[130574]: mds.? [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] up:active 2023-08-10T12:11:04.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:04 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:11:04.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:04 smithi073 ceph-mon[128869]: mds.? [v2:172.21.15.156:6834/904126790,v1:172.21.15.156:6835/904126790] up:active 2023-08-10T12:11:04.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:04 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:11:05.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:05 smithi152 ceph-mon[130220]: pgmap v579: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 30 op/s 2023-08-10T12:11:05.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:05 smithi152 ceph-mon[130220]: MDS health message cleared (mds.?): Client 15318 is laggy; not evicted because some OSD(s) is/are laggy 2023-08-10T12:11:05.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:05 smithi156 ceph-mon[130574]: pgmap v579: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 30 op/s 2023-08-10T12:11:05.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:05 smithi156 ceph-mon[130574]: MDS health message cleared (mds.?): Client 15318 is laggy; not evicted because some OSD(s) is/are laggy 2023-08-10T12:11:05.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:05 smithi073 ceph-mon[128869]: pgmap v579: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 30 op/s 2023-08-10T12:11:05.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:05 smithi073 ceph-mon[128869]: MDS health message cleared (mds.?): Client 15318 is laggy; not evicted because some OSD(s) is/are laggy 2023-08-10T12:11:06.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:06 smithi152 ceph-mon[130220]: Health check cleared: MDS_CLIENTS_LAGGY (was: 1 client(s) laggy due to laggy OSDs) 2023-08-10T12:11:06.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:06 smithi152 ceph-mon[130220]: mds.? [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] up:active 2023-08-10T12:11:06.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:06 smithi152 ceph-mon[130220]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:11:06.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:06 smithi156 ceph-mon[130574]: Health check cleared: MDS_CLIENTS_LAGGY (was: 1 client(s) laggy due to laggy OSDs) 2023-08-10T12:11:06.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:06 smithi156 ceph-mon[130574]: mds.? [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] up:active 2023-08-10T12:11:06.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:06 smithi156 ceph-mon[130574]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:11:06.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:06 smithi073 ceph-mon[128869]: Health check cleared: MDS_CLIENTS_LAGGY (was: 1 client(s) laggy due to laggy OSDs) 2023-08-10T12:11:06.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:06 smithi073 ceph-mon[128869]: mds.? [v2:172.21.15.152:6832/4148407154,v1:172.21.15.152:6833/4148407154] up:active 2023-08-10T12:11:06.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:06 smithi073 ceph-mon[128869]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-08-10T12:11:07.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:07 smithi152 ceph-mon[130220]: pgmap v580: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 30 op/s 2023-08-10T12:11:07.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:07 smithi156 ceph-mon[130574]: pgmap v580: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 30 op/s 2023-08-10T12:11:07.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:07 smithi073 ceph-mon[128869]: pgmap v580: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 30 op/s 2023-08-10T12:11:08.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:08 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:11:08.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:08 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:11:08.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:08 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:11:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:09 smithi152 ceph-mon[130220]: pgmap v581: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 51 KiB/s wr, 28 op/s 2023-08-10T12:11:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:09 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:11:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:09 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:11:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:09 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:11:09.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:09 smithi156 ceph-mon[130574]: pgmap v581: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 51 KiB/s wr, 28 op/s 2023-08-10T12:11:09.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:09 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:11:09.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:09 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:11:09.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:09 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:11:09.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:09 smithi073 ceph-mon[128869]: pgmap v581: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 51 KiB/s wr, 28 op/s 2023-08-10T12:11:09.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:09 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:11:09.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:09 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:11:09.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:09 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:11:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:11 smithi152 ceph-mon[130220]: pgmap v582: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 46 KiB/s wr, 26 op/s 2023-08-10T12:11:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:11 smithi152 ceph-mon[130220]: osdmap e110: 12 total, 12 up, 12 in 2023-08-10T12:11:11.759 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:11 smithi156 ceph-mon[130574]: pgmap v582: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 46 KiB/s wr, 26 op/s 2023-08-10T12:11:11.759 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:11 smithi156 ceph-mon[130574]: osdmap e110: 12 total, 12 up, 12 in 2023-08-10T12:11:11.770 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:11 smithi073 ceph-mon[128869]: pgmap v582: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 46 KiB/s wr, 26 op/s 2023-08-10T12:11:11.771 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:11 smithi073 ceph-mon[128869]: osdmap e110: 12 total, 12 up, 12 in 2023-08-10T12:11:13.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:13 smithi152 ceph-mon[130220]: pgmap v584: 97 pgs: 8 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 81 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:11:13.759 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:13 smithi156 ceph-mon[130574]: pgmap v584: 97 pgs: 8 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 81 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:11:13.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:13 smithi073 ceph-mon[128869]: pgmap v584: 97 pgs: 8 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 81 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:11:15.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:15 smithi152 ceph-mon[130220]: pgmap v585: 97 pgs: 15 active+clean+snaptrim, 23 active+clean+snaptrim_wait, 59 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:11:15.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:15 smithi156 ceph-mon[130574]: pgmap v585: 97 pgs: 15 active+clean+snaptrim, 23 active+clean+snaptrim_wait, 59 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:11:15.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:15 smithi073 ceph-mon[128869]: pgmap v585: 97 pgs: 15 active+clean+snaptrim, 23 active+clean+snaptrim_wait, 59 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:11:17.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:17 smithi156 ceph-mon[130574]: pgmap v586: 97 pgs: 13 active+clean+snaptrim, 29 active+clean+snaptrim_wait, 55 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-08-10T12:11:17.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:17 smithi073 ceph-mon[128869]: pgmap v586: 97 pgs: 13 active+clean+snaptrim, 29 active+clean+snaptrim_wait, 55 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-08-10T12:11:17.702 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:17 smithi152 ceph-mon[130220]: pgmap v586: 97 pgs: 13 active+clean+snaptrim, 29 active+clean+snaptrim_wait, 55 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-08-10T12:11:19.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:19 smithi156 ceph-mon[130574]: pgmap v587: 97 pgs: 11 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 60 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-08-10T12:11:19.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:19 smithi073 ceph-mon[128869]: pgmap v587: 97 pgs: 11 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 60 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-08-10T12:11:19.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:19 smithi152 ceph-mon[130220]: pgmap v587: 97 pgs: 11 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 60 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-08-10T12:11:21.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:21 smithi073 ceph-mon[128869]: pgmap v588: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-08-10T12:11:21.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:21 smithi152 ceph-mon[130220]: pgmap v588: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-08-10T12:11:21.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:21 smithi156 ceph-mon[130574]: pgmap v588: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-08-10T12:11:23.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:23 smithi073 ceph-mon[128869]: pgmap v589: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 260 B/s wr, 12 op/s 2023-08-10T12:11:23.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:23 smithi152 ceph-mon[130220]: pgmap v589: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 260 B/s wr, 12 op/s 2023-08-10T12:11:23.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:23 smithi156 ceph-mon[130574]: pgmap v589: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 260 B/s wr, 12 op/s 2023-08-10T12:11:25.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:25 smithi152 ceph-mon[130220]: osdmap e111: 12 total, 12 up, 12 in 2023-08-10T12:11:25.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:25 smithi152 ceph-mon[130220]: pgmap v591: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:11:25.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:25 smithi156 ceph-mon[130574]: osdmap e111: 12 total, 12 up, 12 in 2023-08-10T12:11:25.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:25 smithi156 ceph-mon[130574]: pgmap v591: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:11:25.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:25 smithi073 ceph-mon[128869]: osdmap e111: 12 total, 12 up, 12 in 2023-08-10T12:11:25.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:25 smithi073 ceph-mon[128869]: pgmap v591: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:11:27.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:27 smithi156 ceph-mon[130574]: pgmap v592: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:11:27.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:27 smithi073 ceph-mon[128869]: pgmap v592: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:11:27.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:27 smithi152 ceph-mon[130220]: pgmap v592: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:11:29.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:29 smithi073 ceph-mon[128869]: pgmap v593: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:11:29.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:29 smithi152 ceph-mon[130220]: pgmap v593: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:11:29.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:29 smithi156 ceph-mon[130574]: pgmap v593: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:11:31.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:31 smithi073 ceph-mon[128869]: pgmap v594: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:11:31.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:31 smithi152 ceph-mon[130220]: pgmap v594: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:11:31.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:31 smithi156 ceph-mon[130574]: pgmap v594: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:11:33.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:33 smithi073 ceph-mon[128869]: pgmap v595: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:11:33.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:33 smithi152 ceph-mon[130220]: pgmap v595: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:11:33.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:33 smithi156 ceph-mon[130574]: pgmap v595: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:11:35.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:35 smithi152 ceph-mon[130220]: pgmap v596: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-08-10T12:11:35.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:35 smithi156 ceph-mon[130574]: pgmap v596: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-08-10T12:11:35.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:35 smithi073 ceph-mon[128869]: pgmap v596: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-08-10T12:11:37.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:37 smithi073 ceph-mon[128869]: pgmap v597: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:11:37.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:37 smithi152 ceph-mon[130220]: pgmap v597: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:11:37.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:37 smithi156 ceph-mon[130574]: pgmap v597: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:11:39.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:39 smithi073 ceph-mon[128869]: pgmap v598: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:11:39.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:39 smithi152 ceph-mon[130220]: pgmap v598: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:11:39.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:39 smithi156 ceph-mon[130574]: pgmap v598: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:11:41.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:41 smithi073 ceph-mon[128869]: pgmap v599: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:11:41.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:41 smithi152 ceph-mon[130220]: pgmap v599: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:11:41.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:41 smithi156 ceph-mon[130574]: pgmap v599: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:11:43.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:43 smithi073 ceph-mon[128869]: pgmap v600: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:11:43.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:43 smithi152 ceph-mon[130220]: pgmap v600: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:11:43.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:43 smithi156 ceph-mon[130574]: pgmap v600: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:11:45.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:45 smithi152 ceph-mon[130220]: pgmap v601: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:11:45.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:45 smithi156 ceph-mon[130574]: pgmap v601: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:11:45.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:45 smithi073 ceph-mon[128869]: pgmap v601: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:11:47.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:47 smithi073 ceph-mon[128869]: pgmap v602: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:11:47.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:47 smithi152 ceph-mon[130220]: pgmap v602: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:11:47.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:47 smithi156 ceph-mon[130574]: pgmap v602: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:11:49.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:49 smithi073 ceph-mon[128869]: pgmap v603: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:11:49.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:49 smithi152 ceph-mon[130220]: pgmap v603: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:11:49.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:49 smithi156 ceph-mon[130574]: pgmap v603: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:11:51.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:51 smithi152 ceph-mon[130220]: pgmap v604: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:11:51.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:51 smithi156 ceph-mon[130574]: pgmap v604: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:11:51.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:51 smithi073 ceph-mon[128869]: pgmap v604: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:11:53.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:53 smithi152 ceph-mon[130220]: pgmap v605: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:11:53.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:53 smithi156 ceph-mon[130574]: pgmap v605: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:11:53.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:53 smithi073 ceph-mon[128869]: pgmap v605: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:11:55.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:55 smithi152 ceph-mon[130220]: pgmap v606: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:11:55.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:55 smithi156 ceph-mon[130574]: pgmap v606: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:11:55.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:55 smithi073 ceph-mon[128869]: pgmap v606: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:11:57.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:57 smithi073 ceph-mon[128869]: pgmap v607: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:11:57.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:57 smithi152 ceph-mon[130220]: pgmap v607: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:11:57.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:57 smithi156 ceph-mon[130574]: pgmap v607: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:11:59.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:11:59 smithi073 ceph-mon[128869]: pgmap v608: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:11:59.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:11:59 smithi152 ceph-mon[130220]: pgmap v608: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:11:59.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:11:59 smithi156 ceph-mon[130574]: pgmap v608: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:12:01.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:01 smithi152 ceph-mon[130220]: pgmap v609: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:12:01.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:01 smithi156 ceph-mon[130574]: pgmap v609: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:12:01.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:01 smithi073 ceph-mon[128869]: pgmap v609: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:12:03.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:03 smithi152 ceph-mon[130220]: pgmap v610: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:12:03.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:03 smithi156 ceph-mon[130574]: pgmap v610: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:12:03.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:03 smithi073 ceph-mon[128869]: pgmap v610: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:12:05.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:05 smithi152 ceph-mon[130220]: pgmap v611: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:12:05.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:05 smithi156 ceph-mon[130574]: pgmap v611: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:12:05.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:05 smithi073 ceph-mon[128869]: pgmap v611: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:12:07.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:07 smithi073 ceph-mon[128869]: pgmap v612: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:12:07.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:07 smithi152 ceph-mon[130220]: pgmap v612: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:12:07.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:07 smithi156 ceph-mon[130574]: pgmap v612: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:12:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:09 smithi152 ceph-mon[130220]: pgmap v613: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:12:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:09 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:12:09.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:09 smithi156 ceph-mon[130574]: pgmap v613: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:12:09.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:09 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:12:09.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:09 smithi073 ceph-mon[128869]: pgmap v613: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:12:09.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:09 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:12:10.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:10 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:12:10.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:10 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:12:10.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:10 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:12:10.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:10 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:12:10.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:10 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:12:10.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:10 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:12:10.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:10 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:12:10.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:10 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:12:10.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:10 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:12:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:11 smithi152 ceph-mon[130220]: pgmap v614: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:12:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:11 smithi152 ceph-mon[130220]: osdmap e112: 12 total, 12 up, 12 in 2023-08-10T12:12:11.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:11 smithi156 ceph-mon[130574]: pgmap v614: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:12:11.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:11 smithi156 ceph-mon[130574]: osdmap e112: 12 total, 12 up, 12 in 2023-08-10T12:12:11.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:11 smithi073 ceph-mon[128869]: pgmap v614: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:12:11.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:11 smithi073 ceph-mon[128869]: osdmap e112: 12 total, 12 up, 12 in 2023-08-10T12:12:13.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:13 smithi152 ceph-mon[130220]: pgmap v616: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:12:13.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:13 smithi156 ceph-mon[130574]: pgmap v616: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:12:13.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:13 smithi073 ceph-mon[128869]: pgmap v616: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:12:15.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:15 smithi152 ceph-mon[130220]: pgmap v617: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:12:15.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:15 smithi156 ceph-mon[130574]: pgmap v617: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:12:15.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:15 smithi073 ceph-mon[128869]: pgmap v617: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:12:17.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:17 smithi152 ceph-mon[130220]: pgmap v618: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:12:17.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:17 smithi156 ceph-mon[130574]: pgmap v618: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:12:17.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:17 smithi073 ceph-mon[128869]: pgmap v618: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:12:19.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:19 smithi152 ceph-mon[130220]: pgmap v619: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:12:19.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:19 smithi152 ceph-mon[130220]: osdmap e113: 12 total, 12 up, 12 in 2023-08-10T12:12:19.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:19 smithi156 ceph-mon[130574]: pgmap v619: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:12:19.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:19 smithi156 ceph-mon[130574]: osdmap e113: 12 total, 12 up, 12 in 2023-08-10T12:12:19.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:19 smithi073 ceph-mon[128869]: pgmap v619: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:12:19.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:19 smithi073 ceph-mon[128869]: osdmap e113: 12 total, 12 up, 12 in 2023-08-10T12:12:21.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:21 smithi152 ceph-mon[130220]: pgmap v621: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-08-10T12:12:21.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:21 smithi156 ceph-mon[130574]: pgmap v621: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-08-10T12:12:21.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:21 smithi073 ceph-mon[128869]: pgmap v621: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-08-10T12:12:23.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:23 smithi152 ceph-mon[130220]: pgmap v622: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:12:23.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:23 smithi156 ceph-mon[130574]: pgmap v622: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:12:23.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:23 smithi073 ceph-mon[128869]: pgmap v622: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:12:25.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:25 smithi152 ceph-mon[130220]: pgmap v623: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:12:25.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:25 smithi156 ceph-mon[130574]: pgmap v623: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:12:25.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:25 smithi073 ceph-mon[128869]: pgmap v623: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:12:27.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:27 smithi152 ceph-mon[130220]: pgmap v624: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:12:27.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:27 smithi156 ceph-mon[130574]: pgmap v624: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:12:27.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:27 smithi073 ceph-mon[128869]: pgmap v624: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:12:29.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:29 smithi152 ceph-mon[130220]: pgmap v625: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:12:29.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:29 smithi156 ceph-mon[130574]: pgmap v625: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:12:29.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:29 smithi073 ceph-mon[128869]: pgmap v625: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:12:31.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:31 smithi152 ceph-mon[130220]: pgmap v626: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:12:31.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:31 smithi156 ceph-mon[130574]: pgmap v626: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:12:31.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:31 smithi073 ceph-mon[128869]: pgmap v626: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:12:33.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:33 smithi152 ceph-mon[130220]: pgmap v627: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:12:33.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:33 smithi156 ceph-mon[130574]: pgmap v627: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:12:33.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:33 smithi073 ceph-mon[128869]: pgmap v627: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:12:35.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:35 smithi152 ceph-mon[130220]: pgmap v628: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:12:35.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:35 smithi156 ceph-mon[130574]: pgmap v628: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:12:35.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:35 smithi073 ceph-mon[128869]: pgmap v628: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:12:37.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:37 smithi152 ceph-mon[130220]: pgmap v629: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:12:37.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:37 smithi156 ceph-mon[130574]: pgmap v629: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:12:37.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:37 smithi073 ceph-mon[128869]: pgmap v629: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:12:39.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:39 smithi152 ceph-mon[130220]: pgmap v630: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:12:39.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:39 smithi156 ceph-mon[130574]: pgmap v630: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:12:39.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:39 smithi073 ceph-mon[128869]: pgmap v630: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:12:41.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:41 smithi152 ceph-mon[130220]: pgmap v631: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:12:41.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:41 smithi156 ceph-mon[130574]: pgmap v631: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:12:41.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:41 smithi073 ceph-mon[128869]: pgmap v631: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:12:43.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:43 smithi073 ceph-mon[128869]: pgmap v632: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:12:43.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:43 smithi152 ceph-mon[130220]: pgmap v632: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:12:43.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:43 smithi156 ceph-mon[130574]: pgmap v632: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:12:45.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:45 smithi152 ceph-mon[130220]: pgmap v633: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:12:45.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:45 smithi156 ceph-mon[130574]: pgmap v633: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:12:45.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:45 smithi073 ceph-mon[128869]: pgmap v633: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:12:47.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:47 smithi152 ceph-mon[130220]: pgmap v634: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:12:47.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:47 smithi156 ceph-mon[130574]: pgmap v634: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:12:47.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:47 smithi073 ceph-mon[128869]: pgmap v634: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:12:49.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:49 smithi152 ceph-mon[130220]: pgmap v635: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:12:49.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:49 smithi156 ceph-mon[130574]: pgmap v635: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:12:49.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:49 smithi073 ceph-mon[128869]: pgmap v635: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:12:51.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:51 smithi152 ceph-mon[130220]: pgmap v636: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:12:51.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:51 smithi156 ceph-mon[130574]: pgmap v636: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:12:51.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:51 smithi073 ceph-mon[128869]: pgmap v636: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:12:53.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:53 smithi152 ceph-mon[130220]: pgmap v637: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:12:53.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:53 smithi156 ceph-mon[130574]: pgmap v637: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:12:53.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:53 smithi073 ceph-mon[128869]: pgmap v637: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:12:55.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:55 smithi152 ceph-mon[130220]: pgmap v638: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:12:55.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:55 smithi156 ceph-mon[130574]: pgmap v638: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:12:55.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:55 smithi073 ceph-mon[128869]: pgmap v638: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:12:57.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:57 smithi152 ceph-mon[130220]: pgmap v639: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:12:57.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:57 smithi156 ceph-mon[130574]: pgmap v639: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:12:57.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:57 smithi073 ceph-mon[128869]: pgmap v639: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:12:59.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:12:59 smithi152 ceph-mon[130220]: pgmap v640: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:12:59.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:12:59 smithi156 ceph-mon[130574]: pgmap v640: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:12:59.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:12:59 smithi073 ceph-mon[128869]: pgmap v640: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:13:01.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:01 smithi152 ceph-mon[130220]: pgmap v641: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:13:01.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:01 smithi156 ceph-mon[130574]: pgmap v641: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:13:01.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:01 smithi073 ceph-mon[128869]: pgmap v641: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:13:03.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:03 smithi152 ceph-mon[130220]: pgmap v642: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:13:03.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:03 smithi156 ceph-mon[130574]: pgmap v642: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:13:03.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:03 smithi073 ceph-mon[128869]: pgmap v642: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:13:05.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:05 smithi152 ceph-mon[130220]: pgmap v643: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:13:05.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:05 smithi156 ceph-mon[130574]: pgmap v643: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:13:05.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:05 smithi073 ceph-mon[128869]: pgmap v643: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:13:07.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:07 smithi152 ceph-mon[130220]: pgmap v644: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:13:07.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:07 smithi156 ceph-mon[130574]: pgmap v644: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:13:07.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:07 smithi073 ceph-mon[128869]: pgmap v644: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:13:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:09 smithi152 ceph-mon[130220]: pgmap v645: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:13:09.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:09 smithi156 ceph-mon[130574]: pgmap v645: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:13:09.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:09 smithi073 ceph-mon[128869]: pgmap v645: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:13:10.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:10 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:13:10.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:10 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:13:10.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:10 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:13:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:11 smithi152 ceph-mon[130220]: pgmap v646: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:13:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:11 smithi152 ceph-mon[130220]: osdmap e114: 12 total, 12 up, 12 in 2023-08-10T12:13:11.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:11 smithi156 ceph-mon[130574]: pgmap v646: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:13:11.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:11 smithi156 ceph-mon[130574]: osdmap e114: 12 total, 12 up, 12 in 2023-08-10T12:13:11.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:11 smithi073 ceph-mon[128869]: pgmap v646: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:13:11.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:11 smithi073 ceph-mon[128869]: osdmap e114: 12 total, 12 up, 12 in 2023-08-10T12:13:13.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:13:13.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:13:13.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: pgmap v648: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:13:13.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:13:13.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:13:13.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:13:13.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:13:13.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.497 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: Adjusting osd_memory_target on smithi073 to 196.2M 2023-08-10T12:13:13.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: Unable to set osd_memory_target on smithi073 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-08-10T12:13:13.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.499 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.499 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.499 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.499 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: Adjusting osd_memory_target on smithi156 to 196.2M 2023-08-10T12:13:13.499 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: Unable to set osd_memory_target on smithi156 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-08-10T12:13:13.499 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.499 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.499 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:13:13.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:13:13.501 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:13 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:13:13.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:13:13.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:13:13.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: pgmap v648: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:13:13.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:13:13.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:13:13.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:13:13.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:13:13.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.507 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: Adjusting osd_memory_target on smithi073 to 196.2M 2023-08-10T12:13:13.508 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: Unable to set osd_memory_target on smithi073 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-08-10T12:13:13.508 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.508 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.508 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.508 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.508 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.508 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.508 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.509 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.509 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: Adjusting osd_memory_target on smithi156 to 196.2M 2023-08-10T12:13:13.509 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: Unable to set osd_memory_target on smithi156 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-08-10T12:13:13.509 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.509 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.509 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.509 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.509 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.510 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.510 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.510 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.510 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:13:13.510 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:13:13.510 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:13 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:13:13.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:13:13.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:13:13.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: pgmap v648: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:13:13.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:13:13.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:13:13.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:13:13.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:13:13.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.519 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: Adjusting osd_memory_target on smithi073 to 196.2M 2023-08-10T12:13:13.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: Unable to set osd_memory_target on smithi073 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-08-10T12:13:13.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.520 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: Adjusting osd_memory_target on smithi156 to 196.2M 2023-08-10T12:13:13.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: Unable to set osd_memory_target on smithi156 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-08-10T12:13:13.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.521 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.522 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.522 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.522 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.522 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:13:13.522 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:13:13.522 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:13:13.522 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:13 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:13:14.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:14 smithi152 ceph-mon[130220]: Adjusting osd_memory_target on smithi152 to 196.2M 2023-08-10T12:13:14.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:14 smithi152 ceph-mon[130220]: Unable to set osd_memory_target on smithi152 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-08-10T12:13:14.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:14 smithi156 ceph-mon[130574]: Adjusting osd_memory_target on smithi152 to 196.2M 2023-08-10T12:13:14.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:14 smithi156 ceph-mon[130574]: Unable to set osd_memory_target on smithi152 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-08-10T12:13:14.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:14 smithi073 ceph-mon[128869]: Adjusting osd_memory_target on smithi152 to 196.2M 2023-08-10T12:13:14.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:14 smithi073 ceph-mon[128869]: Unable to set osd_memory_target on smithi152 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-08-10T12:13:15.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:15 smithi152 ceph-mon[130220]: pgmap v649: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:13:15.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:15 smithi156 ceph-mon[130574]: pgmap v649: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:13:15.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:15 smithi073 ceph-mon[128869]: pgmap v649: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:13:17.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:17 smithi152 ceph-mon[130220]: pgmap v650: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:13:17.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:17 smithi156 ceph-mon[130574]: pgmap v650: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:13:17.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:17 smithi073 ceph-mon[128869]: pgmap v650: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:13:19.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:19 smithi152 ceph-mon[130220]: pgmap v651: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:13:19.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:19 smithi152 ceph-mon[130220]: osdmap e115: 12 total, 12 up, 12 in 2023-08-10T12:13:19.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:19 smithi156 ceph-mon[130574]: pgmap v651: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:13:19.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:19 smithi156 ceph-mon[130574]: osdmap e115: 12 total, 12 up, 12 in 2023-08-10T12:13:19.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:19 smithi073 ceph-mon[128869]: pgmap v651: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:13:19.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:19 smithi073 ceph-mon[128869]: osdmap e115: 12 total, 12 up, 12 in 2023-08-10T12:13:21.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:21 smithi156 ceph-mon[130574]: pgmap v653: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:13:21.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:21 smithi073 ceph-mon[128869]: pgmap v653: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:13:21.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:21 smithi152 ceph-mon[130220]: pgmap v653: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:13:23.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:23 smithi156 ceph-mon[130574]: pgmap v654: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:13:23.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:23 smithi073 ceph-mon[128869]: pgmap v654: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:13:23.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:23 smithi152 ceph-mon[130220]: pgmap v654: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:13:25.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:25 smithi152 ceph-mon[130220]: pgmap v655: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:13:25.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:25 smithi156 ceph-mon[130574]: pgmap v655: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:13:25.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:25 smithi073 ceph-mon[128869]: pgmap v655: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:13:27.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:27 smithi152 ceph-mon[130220]: pgmap v656: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:13:27.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:27 smithi156 ceph-mon[130574]: pgmap v656: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:13:27.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:27 smithi073 ceph-mon[128869]: pgmap v656: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:13:29.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:29 smithi152 ceph-mon[130220]: pgmap v657: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:13:29.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:29 smithi156 ceph-mon[130574]: pgmap v657: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:13:29.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:29 smithi073 ceph-mon[128869]: pgmap v657: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:13:31.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:31 smithi152 ceph-mon[130220]: pgmap v658: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:13:31.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:31 smithi156 ceph-mon[130574]: pgmap v658: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:13:31.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:31 smithi073 ceph-mon[128869]: pgmap v658: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:13:33.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:33 smithi152 ceph-mon[130220]: pgmap v659: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:13:33.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:33 smithi156 ceph-mon[130574]: pgmap v659: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:13:33.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:33 smithi073 ceph-mon[128869]: pgmap v659: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:13:35.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:35 smithi152 ceph-mon[130220]: pgmap v660: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:13:35.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:35 smithi156 ceph-mon[130574]: pgmap v660: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:13:35.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:35 smithi073 ceph-mon[128869]: pgmap v660: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:13:37.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:37 smithi152 ceph-mon[130220]: pgmap v661: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:13:37.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:37 smithi156 ceph-mon[130574]: pgmap v661: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:13:37.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:37 smithi073 ceph-mon[128869]: pgmap v661: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:13:39.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:39 smithi152 ceph-mon[130220]: pgmap v662: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:13:39.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:39 smithi156 ceph-mon[130574]: pgmap v662: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:13:39.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:39 smithi073 ceph-mon[128869]: pgmap v662: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:13:41.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:41 smithi152 ceph-mon[130220]: pgmap v663: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:13:41.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:41 smithi156 ceph-mon[130574]: pgmap v663: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:13:41.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:41 smithi073 ceph-mon[128869]: pgmap v663: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:13:43.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:43 smithi152 ceph-mon[130220]: pgmap v664: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-10T12:13:43.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:43 smithi156 ceph-mon[130574]: pgmap v664: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-10T12:13:43.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:43 smithi073 ceph-mon[128869]: pgmap v664: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-10T12:13:45.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:45 smithi152 ceph-mon[130220]: pgmap v665: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:13:45.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:45 smithi156 ceph-mon[130574]: pgmap v665: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:13:45.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:45 smithi073 ceph-mon[128869]: pgmap v665: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:13:47.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:47 smithi152 ceph-mon[130220]: pgmap v666: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:13:47.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:47 smithi156 ceph-mon[130574]: pgmap v666: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:13:47.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:47 smithi073 ceph-mon[128869]: pgmap v666: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:13:49.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:49 smithi152 ceph-mon[130220]: pgmap v667: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-10T12:13:49.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:49 smithi156 ceph-mon[130574]: pgmap v667: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-10T12:13:49.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:49 smithi073 ceph-mon[128869]: pgmap v667: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-10T12:13:51.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:51 smithi152 ceph-mon[130220]: pgmap v668: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:13:51.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:51 smithi156 ceph-mon[130574]: pgmap v668: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:13:51.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:51 smithi073 ceph-mon[128869]: pgmap v668: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:13:53.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:53 smithi152 ceph-mon[130220]: pgmap v669: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:13:53.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:53 smithi156 ceph-mon[130574]: pgmap v669: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:13:53.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:53 smithi073 ceph-mon[128869]: pgmap v669: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:13:55.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:55 smithi152 ceph-mon[130220]: pgmap v670: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:13:55.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:55 smithi156 ceph-mon[130574]: pgmap v670: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:13:55.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:55 smithi073 ceph-mon[128869]: pgmap v670: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:13:57.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:57 smithi152 ceph-mon[130220]: pgmap v671: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:13:57.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:57 smithi156 ceph-mon[130574]: pgmap v671: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:13:57.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:57 smithi073 ceph-mon[128869]: pgmap v671: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:13:59.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:13:59 smithi152 ceph-mon[130220]: pgmap v672: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:13:59.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:13:59 smithi156 ceph-mon[130574]: pgmap v672: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:13:59.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:13:59 smithi073 ceph-mon[128869]: pgmap v672: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:14:01.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:01 smithi152 ceph-mon[130220]: pgmap v673: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:14:01.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:01 smithi156 ceph-mon[130574]: pgmap v673: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:14:01.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:01 smithi073 ceph-mon[128869]: pgmap v673: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:14:03.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:03 smithi152 ceph-mon[130220]: pgmap v674: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:14:03.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:03 smithi156 ceph-mon[130574]: pgmap v674: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:14:03.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:03 smithi073 ceph-mon[128869]: pgmap v674: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:14:05.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:05 smithi152 ceph-mon[130220]: pgmap v675: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:14:05.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:05 smithi156 ceph-mon[130574]: pgmap v675: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:14:05.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:05 smithi073 ceph-mon[128869]: pgmap v675: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:14:07.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:07 smithi152 ceph-mon[130220]: pgmap v676: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:14:07.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:07 smithi156 ceph-mon[130574]: pgmap v676: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:14:07.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:07 smithi073 ceph-mon[128869]: pgmap v676: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:14:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:09 smithi152 ceph-mon[130220]: pgmap v677: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:14:09.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:09 smithi156 ceph-mon[130574]: pgmap v677: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:14:09.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:09 smithi073 ceph-mon[128869]: pgmap v677: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:14:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:11 smithi152 ceph-mon[130220]: pgmap v678: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:14:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:11 smithi152 ceph-mon[130220]: osdmap e116: 12 total, 12 up, 12 in 2023-08-10T12:14:11.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:11 smithi156 ceph-mon[130574]: pgmap v678: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:14:11.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:11 smithi156 ceph-mon[130574]: osdmap e116: 12 total, 12 up, 12 in 2023-08-10T12:14:11.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:11 smithi073 ceph-mon[128869]: pgmap v678: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:14:11.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:11 smithi073 ceph-mon[128869]: osdmap e116: 12 total, 12 up, 12 in 2023-08-10T12:14:13.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:13 smithi152 ceph-mon[130220]: pgmap v680: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:14:13.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:13 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:14:13.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:13 smithi156 ceph-mon[130574]: pgmap v680: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:14:13.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:13 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:14:13.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:13 smithi073 ceph-mon[128869]: pgmap v680: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:14:13.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:13 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:14:14.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:14 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:14:14.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:14 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:14:14.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:14 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:14:14.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:14 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:14:14.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:14 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:14:14.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:14 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:14:14.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:14 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:14:14.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:14 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:14:14.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:14 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:14:15.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:15 smithi152 ceph-mon[130220]: pgmap v681: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:14:15.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:15 smithi156 ceph-mon[130574]: pgmap v681: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:14:15.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:15 smithi073 ceph-mon[128869]: pgmap v681: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:14:17.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:17 smithi152 ceph-mon[130220]: pgmap v682: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:14:17.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:17 smithi156 ceph-mon[130574]: pgmap v682: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:14:17.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:17 smithi073 ceph-mon[128869]: pgmap v682: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:14:19.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:19 smithi152 ceph-mon[130220]: pgmap v683: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:14:19.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:19 smithi152 ceph-mon[130220]: osdmap e117: 12 total, 12 up, 12 in 2023-08-10T12:14:19.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:19 smithi156 ceph-mon[130574]: pgmap v683: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:14:19.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:19 smithi156 ceph-mon[130574]: osdmap e117: 12 total, 12 up, 12 in 2023-08-10T12:14:19.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:19 smithi073 ceph-mon[128869]: pgmap v683: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:14:19.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:19 smithi073 ceph-mon[128869]: osdmap e117: 12 total, 12 up, 12 in 2023-08-10T12:14:21.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:21 smithi152 ceph-mon[130220]: pgmap v685: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 205 B/s wr, 10 op/s 2023-08-10T12:14:21.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:21 smithi156 ceph-mon[130574]: pgmap v685: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 205 B/s wr, 10 op/s 2023-08-10T12:14:21.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:21 smithi073 ceph-mon[128869]: pgmap v685: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 205 B/s wr, 10 op/s 2023-08-10T12:14:23.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:23 smithi152 ceph-mon[130220]: pgmap v686: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:14:23.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:23 smithi156 ceph-mon[130574]: pgmap v686: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:14:23.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:23 smithi073 ceph-mon[128869]: pgmap v686: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:14:25.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:25 smithi152 ceph-mon[130220]: pgmap v687: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:14:25.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:25 smithi156 ceph-mon[130574]: pgmap v687: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:14:25.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:25 smithi073 ceph-mon[128869]: pgmap v687: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:14:27.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:27 smithi152 ceph-mon[130220]: pgmap v688: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:14:27.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:27 smithi156 ceph-mon[130574]: pgmap v688: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:14:27.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:27 smithi073 ceph-mon[128869]: pgmap v688: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:14:29.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:29 smithi152 ceph-mon[130220]: pgmap v689: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:14:29.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:29 smithi156 ceph-mon[130574]: pgmap v689: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:14:29.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:29 smithi073 ceph-mon[128869]: pgmap v689: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:14:31.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:31 smithi152 ceph-mon[130220]: pgmap v690: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:14:31.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:31 smithi156 ceph-mon[130574]: pgmap v690: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:14:31.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:31 smithi073 ceph-mon[128869]: pgmap v690: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:14:33.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:33 smithi152 ceph-mon[130220]: pgmap v691: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:14:33.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:33 smithi156 ceph-mon[130574]: pgmap v691: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:14:33.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:33 smithi073 ceph-mon[128869]: pgmap v691: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:14:35.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:35 smithi152 ceph-mon[130220]: pgmap v692: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:14:35.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:35 smithi156 ceph-mon[130574]: pgmap v692: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:14:35.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:35 smithi073 ceph-mon[128869]: pgmap v692: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:14:37.748 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:37 smithi152 ceph-mon[130220]: pgmap v693: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:14:37.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:37 smithi156 ceph-mon[130574]: pgmap v693: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:14:37.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:37 smithi073 ceph-mon[128869]: pgmap v693: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:14:39.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:39 smithi152 ceph-mon[130220]: pgmap v694: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:14:39.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:39 smithi156 ceph-mon[130574]: pgmap v694: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:14:39.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:39 smithi073 ceph-mon[128869]: pgmap v694: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:14:41.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:41 smithi152 ceph-mon[130220]: pgmap v695: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:14:41.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:41 smithi156 ceph-mon[130574]: pgmap v695: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:14:41.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:41 smithi073 ceph-mon[128869]: pgmap v695: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:14:43.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:43 smithi152 ceph-mon[130220]: pgmap v696: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:14:43.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:43 smithi156 ceph-mon[130574]: pgmap v696: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:14:43.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:43 smithi073 ceph-mon[128869]: pgmap v696: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:14:45.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:45 smithi152 ceph-mon[130220]: pgmap v697: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:14:45.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:45 smithi156 ceph-mon[130574]: pgmap v697: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:14:45.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:45 smithi073 ceph-mon[128869]: pgmap v697: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:14:47.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:47 smithi152 ceph-mon[130220]: pgmap v698: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:14:47.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:47 smithi156 ceph-mon[130574]: pgmap v698: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:14:47.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:47 smithi073 ceph-mon[128869]: pgmap v698: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:14:49.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:49 smithi152 ceph-mon[130220]: pgmap v699: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:14:49.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:49 smithi156 ceph-mon[130574]: pgmap v699: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:14:49.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:49 smithi073 ceph-mon[128869]: pgmap v699: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:14:51.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:51 smithi152 ceph-mon[130220]: pgmap v700: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:14:51.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:51 smithi156 ceph-mon[130574]: pgmap v700: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:14:51.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:51 smithi073 ceph-mon[128869]: pgmap v700: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:14:53.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:53 smithi152 ceph-mon[130220]: pgmap v701: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:14:53.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:53 smithi156 ceph-mon[130574]: pgmap v701: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:14:53.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:53 smithi073 ceph-mon[128869]: pgmap v701: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:14:55.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:55 smithi152 ceph-mon[130220]: pgmap v702: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:14:55.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:55 smithi156 ceph-mon[130574]: pgmap v702: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:14:55.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:55 smithi073 ceph-mon[128869]: pgmap v702: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:14:57.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:57 smithi152 ceph-mon[130220]: pgmap v703: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:14:57.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:57 smithi156 ceph-mon[130574]: pgmap v703: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:14:57.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:57 smithi073 ceph-mon[128869]: pgmap v703: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:14:59.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:14:59 smithi152 ceph-mon[130220]: pgmap v704: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:14:59.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:14:59 smithi156 ceph-mon[130574]: pgmap v704: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:14:59.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:14:59 smithi073 ceph-mon[128869]: pgmap v704: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:15:01.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:01 smithi152 ceph-mon[130220]: pgmap v705: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:15:01.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:01 smithi156 ceph-mon[130574]: pgmap v705: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:15:01.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:01 smithi073 ceph-mon[128869]: pgmap v705: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:15:03.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:03 smithi152 ceph-mon[130220]: pgmap v706: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:15:03.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:03 smithi156 ceph-mon[130574]: pgmap v706: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:15:03.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:03 smithi073 ceph-mon[128869]: pgmap v706: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:15:05.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:05 smithi152 ceph-mon[130220]: pgmap v707: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:15:05.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:05 smithi156 ceph-mon[130574]: pgmap v707: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:15:05.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:05 smithi073 ceph-mon[128869]: pgmap v707: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:15:07.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:07 smithi152 ceph-mon[130220]: pgmap v708: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:15:07.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:07 smithi156 ceph-mon[130574]: pgmap v708: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:15:07.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:07 smithi073 ceph-mon[128869]: pgmap v708: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:15:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:09 smithi152 ceph-mon[130220]: pgmap v709: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:15:09.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:09 smithi156 ceph-mon[130574]: pgmap v709: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:15:09.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:09 smithi073 ceph-mon[128869]: pgmap v709: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:15:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:11 smithi152 ceph-mon[130220]: pgmap v710: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:15:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:11 smithi152 ceph-mon[130220]: osdmap e118: 12 total, 12 up, 12 in 2023-08-10T12:15:11.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:11 smithi156 ceph-mon[130574]: pgmap v710: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:15:11.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:11 smithi156 ceph-mon[130574]: osdmap e118: 12 total, 12 up, 12 in 2023-08-10T12:15:11.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:11 smithi073 ceph-mon[128869]: pgmap v710: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:15:11.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:11 smithi073 ceph-mon[128869]: osdmap e118: 12 total, 12 up, 12 in 2023-08-10T12:15:13.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:13 smithi152 ceph-mon[130220]: pgmap v712: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:15:13.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:13 smithi156 ceph-mon[130574]: pgmap v712: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:15:13.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:13 smithi073 ceph-mon[128869]: pgmap v712: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:15:14.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:14 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:15:14.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:14 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:15:14.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:14 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:15:14.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:14 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:15:14.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:14 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:15:14.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:14 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:15:14.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:14 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:15:14.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:14 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:15:14.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:14 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:15:15.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:15 smithi152 ceph-mon[130220]: pgmap v713: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:15:15.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:15 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:15:15.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:15 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:15:15.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:15 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:15:15.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:15 smithi156 ceph-mon[130574]: pgmap v713: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:15:15.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:15 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:15:15.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:15 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:15:15.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:15 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:15:15.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:15 smithi073 ceph-mon[128869]: pgmap v713: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:15:15.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:15 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:15:15.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:15 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:15:15.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:15 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:15:17.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:17 smithi152 ceph-mon[130220]: pgmap v714: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:15:17.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:17 smithi156 ceph-mon[130574]: pgmap v714: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:15:17.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:17 smithi073 ceph-mon[128869]: pgmap v714: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:15:19.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:19 smithi152 ceph-mon[130220]: pgmap v715: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:15:19.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:19 smithi152 ceph-mon[130220]: osdmap e119: 12 total, 12 up, 12 in 2023-08-10T12:15:19.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:19 smithi156 ceph-mon[130574]: pgmap v715: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:15:19.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:19 smithi156 ceph-mon[130574]: osdmap e119: 12 total, 12 up, 12 in 2023-08-10T12:15:19.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:19 smithi073 ceph-mon[128869]: pgmap v715: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:15:19.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:19 smithi073 ceph-mon[128869]: osdmap e119: 12 total, 12 up, 12 in 2023-08-10T12:15:21.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:21 smithi152 ceph-mon[130220]: pgmap v717: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:15:21.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:21 smithi156 ceph-mon[130574]: pgmap v717: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:15:21.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:21 smithi073 ceph-mon[128869]: pgmap v717: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:15:23.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:23 smithi152 ceph-mon[130220]: pgmap v718: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:15:23.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:23 smithi156 ceph-mon[130574]: pgmap v718: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:15:23.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:23 smithi073 ceph-mon[128869]: pgmap v718: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:15:25.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:25 smithi152 ceph-mon[130220]: pgmap v719: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:15:25.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:25 smithi156 ceph-mon[130574]: pgmap v719: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:15:25.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:25 smithi073 ceph-mon[128869]: pgmap v719: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:15:27.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:27 smithi152 ceph-mon[130220]: pgmap v720: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:15:27.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:27 smithi156 ceph-mon[130574]: pgmap v720: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:15:27.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:27 smithi073 ceph-mon[128869]: pgmap v720: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:15:29.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:29 smithi152 ceph-mon[130220]: pgmap v721: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:15:29.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:29 smithi156 ceph-mon[130574]: pgmap v721: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:15:29.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:29 smithi073 ceph-mon[128869]: pgmap v721: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:15:31.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:31 smithi152 ceph-mon[130220]: pgmap v722: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:15:31.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:31 smithi156 ceph-mon[130574]: pgmap v722: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:15:31.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:31 smithi073 ceph-mon[128869]: pgmap v722: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:15:33.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:33 smithi152 ceph-mon[130220]: pgmap v723: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:15:33.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:33 smithi156 ceph-mon[130574]: pgmap v723: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:15:33.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:33 smithi073 ceph-mon[128869]: pgmap v723: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:15:35.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:35 smithi152 ceph-mon[130220]: pgmap v724: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:15:35.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:35 smithi156 ceph-mon[130574]: pgmap v724: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:15:35.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:35 smithi073 ceph-mon[128869]: pgmap v724: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:15:37.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:37 smithi152 ceph-mon[130220]: pgmap v725: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:15:37.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:37 smithi156 ceph-mon[130574]: pgmap v725: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:15:37.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:37 smithi073 ceph-mon[128869]: pgmap v725: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:15:39.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:39 smithi152 ceph-mon[130220]: pgmap v726: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:15:39.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:39 smithi156 ceph-mon[130574]: pgmap v726: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:15:39.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:39 smithi073 ceph-mon[128869]: pgmap v726: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:15:41.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:41 smithi152 ceph-mon[130220]: pgmap v727: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:15:41.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:41 smithi156 ceph-mon[130574]: pgmap v727: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:15:41.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:41 smithi073 ceph-mon[128869]: pgmap v727: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:15:43.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:43 smithi152 ceph-mon[130220]: pgmap v728: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:15:43.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:43 smithi156 ceph-mon[130574]: pgmap v728: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:15:43.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:43 smithi073 ceph-mon[128869]: pgmap v728: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:15:45.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:45 smithi152 ceph-mon[130220]: pgmap v729: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:15:45.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:45 smithi156 ceph-mon[130574]: pgmap v729: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:15:45.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:45 smithi073 ceph-mon[128869]: pgmap v729: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:15:47.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:47 smithi152 ceph-mon[130220]: pgmap v730: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:15:47.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:47 smithi156 ceph-mon[130574]: pgmap v730: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:15:47.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:47 smithi073 ceph-mon[128869]: pgmap v730: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:15:49.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:49 smithi152 ceph-mon[130220]: pgmap v731: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:15:49.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:49 smithi156 ceph-mon[130574]: pgmap v731: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:15:49.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:49 smithi073 ceph-mon[128869]: pgmap v731: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:15:51.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:51 smithi152 ceph-mon[130220]: pgmap v732: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:15:51.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:51 smithi156 ceph-mon[130574]: pgmap v732: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:15:51.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:51 smithi073 ceph-mon[128869]: pgmap v732: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:15:53.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:53 smithi152 ceph-mon[130220]: pgmap v733: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:15:53.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:53 smithi156 ceph-mon[130574]: pgmap v733: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:15:53.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:53 smithi073 ceph-mon[128869]: pgmap v733: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:15:55.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:55 smithi152 ceph-mon[130220]: pgmap v734: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:15:55.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:55 smithi156 ceph-mon[130574]: pgmap v734: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:15:55.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:55 smithi073 ceph-mon[128869]: pgmap v734: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:15:57.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:57 smithi152 ceph-mon[130220]: pgmap v735: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:15:57.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:57 smithi156 ceph-mon[130574]: pgmap v735: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:15:57.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:57 smithi073 ceph-mon[128869]: pgmap v735: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:15:59.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:15:59 smithi152 ceph-mon[130220]: pgmap v736: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:15:59.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:15:59 smithi156 ceph-mon[130574]: pgmap v736: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:15:59.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:15:59 smithi073 ceph-mon[128869]: pgmap v736: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:16:01.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:01 smithi152 ceph-mon[130220]: pgmap v737: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:16:01.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:01 smithi156 ceph-mon[130574]: pgmap v737: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:16:01.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:01 smithi073 ceph-mon[128869]: pgmap v737: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:16:03.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:03 smithi152 ceph-mon[130220]: pgmap v738: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:16:03.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:03 smithi156 ceph-mon[130574]: pgmap v738: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:16:03.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:03 smithi073 ceph-mon[128869]: pgmap v738: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:16:05.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:05 smithi152 ceph-mon[130220]: pgmap v739: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:16:05.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:05 smithi156 ceph-mon[130574]: pgmap v739: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:16:05.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:05 smithi073 ceph-mon[128869]: pgmap v739: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:16:07.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:07 smithi152 ceph-mon[130220]: pgmap v740: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:16:07.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:07 smithi156 ceph-mon[130574]: pgmap v740: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:16:07.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:07 smithi073 ceph-mon[128869]: pgmap v740: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:16:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:09 smithi152 ceph-mon[130220]: pgmap v741: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:16:09.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:09 smithi156 ceph-mon[130574]: pgmap v741: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:16:09.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:09 smithi073 ceph-mon[128869]: pgmap v741: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:16:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:11 smithi152 ceph-mon[130220]: pgmap v742: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:16:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:11 smithi152 ceph-mon[130220]: osdmap e120: 12 total, 12 up, 12 in 2023-08-10T12:16:11.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:11 smithi156 ceph-mon[130574]: pgmap v742: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:16:11.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:11 smithi156 ceph-mon[130574]: osdmap e120: 12 total, 12 up, 12 in 2023-08-10T12:16:11.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:11 smithi073 ceph-mon[128869]: pgmap v742: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:16:11.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:11 smithi073 ceph-mon[128869]: osdmap e120: 12 total, 12 up, 12 in 2023-08-10T12:16:13.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:13 smithi152 ceph-mon[130220]: pgmap v744: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:16:13.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:13 smithi156 ceph-mon[130574]: pgmap v744: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:16:13.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:13 smithi073 ceph-mon[128869]: pgmap v744: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:16:15.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:15 smithi152 ceph-mon[130220]: pgmap v745: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:16:15.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:15 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:16:15.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:15 smithi156 ceph-mon[130574]: pgmap v745: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:16:15.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:15 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:16:15.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:15 smithi073 ceph-mon[128869]: pgmap v745: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:16:15.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:15 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:16:16.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:16 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:16:16.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:16 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:16:16.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:16 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:16:16.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:16 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:16:16.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:16 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:16:16.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:16 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:16:16.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:16 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:16:16.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:16 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:16:16.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:16 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:16:16.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:16 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:16:16.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:16 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:16:16.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:16 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:16:16.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:16 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:16:16.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:16 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:16:16.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:16 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:16:16.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:16 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:16:16.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:16 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:16:16.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:16 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:16:16.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:16 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:16:16.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:16 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:16:16.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:16 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:16:17.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:17 smithi152 ceph-mon[130220]: pgmap v746: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:16:17.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:17 smithi156 ceph-mon[130574]: pgmap v746: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:16:17.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:17 smithi073 ceph-mon[128869]: pgmap v746: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:16:19.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:19 smithi152 ceph-mon[130220]: pgmap v747: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:16:19.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:19 smithi152 ceph-mon[130220]: osdmap e121: 12 total, 12 up, 12 in 2023-08-10T12:16:19.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:19 smithi156 ceph-mon[130574]: pgmap v747: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:16:19.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:19 smithi156 ceph-mon[130574]: osdmap e121: 12 total, 12 up, 12 in 2023-08-10T12:16:19.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:19 smithi073 ceph-mon[128869]: pgmap v747: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:16:19.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:19 smithi073 ceph-mon[128869]: osdmap e121: 12 total, 12 up, 12 in 2023-08-10T12:16:21.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:21 smithi152 ceph-mon[130220]: pgmap v749: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:16:21.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:21 smithi156 ceph-mon[130574]: pgmap v749: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:16:21.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:21 smithi073 ceph-mon[128869]: pgmap v749: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:16:23.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:23 smithi152 ceph-mon[130220]: pgmap v750: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:16:23.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:23 smithi156 ceph-mon[130574]: pgmap v750: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:16:23.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:23 smithi073 ceph-mon[128869]: pgmap v750: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:16:25.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:25 smithi152 ceph-mon[130220]: pgmap v751: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:16:25.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:25 smithi156 ceph-mon[130574]: pgmap v751: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:16:25.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:25 smithi073 ceph-mon[128869]: pgmap v751: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:16:27.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:27 smithi152 ceph-mon[130220]: pgmap v752: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:16:27.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:27 smithi156 ceph-mon[130574]: pgmap v752: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:16:27.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:27 smithi073 ceph-mon[128869]: pgmap v752: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:16:29.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:29 smithi152 ceph-mon[130220]: pgmap v753: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:16:29.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:29 smithi156 ceph-mon[130574]: pgmap v753: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:16:29.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:29 smithi073 ceph-mon[128869]: pgmap v753: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:16:31.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:31 smithi152 ceph-mon[130220]: pgmap v754: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:16:31.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:31 smithi156 ceph-mon[130574]: pgmap v754: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:16:31.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:31 smithi073 ceph-mon[128869]: pgmap v754: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:16:33.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:33 smithi152 ceph-mon[130220]: pgmap v755: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:16:33.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:33 smithi156 ceph-mon[130574]: pgmap v755: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:16:33.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:33 smithi073 ceph-mon[128869]: pgmap v755: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:16:35.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:35 smithi152 ceph-mon[130220]: pgmap v756: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:16:35.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:35 smithi156 ceph-mon[130574]: pgmap v756: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:16:35.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:35 smithi073 ceph-mon[128869]: pgmap v756: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:16:37.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:37 smithi152 ceph-mon[130220]: pgmap v757: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:16:37.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:37 smithi156 ceph-mon[130574]: pgmap v757: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:16:37.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:37 smithi073 ceph-mon[128869]: pgmap v757: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:16:39.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:39 smithi152 ceph-mon[130220]: pgmap v758: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:16:39.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:39 smithi156 ceph-mon[130574]: pgmap v758: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:16:39.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:39 smithi073 ceph-mon[128869]: pgmap v758: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:16:41.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:41 smithi152 ceph-mon[130220]: pgmap v759: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:16:41.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:41 smithi156 ceph-mon[130574]: pgmap v759: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:16:41.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:41 smithi073 ceph-mon[128869]: pgmap v759: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:16:43.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:43 smithi152 ceph-mon[130220]: pgmap v760: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-10T12:16:43.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:43 smithi156 ceph-mon[130574]: pgmap v760: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-10T12:16:43.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:43 smithi073 ceph-mon[128869]: pgmap v760: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-10T12:16:45.498 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:45 smithi152 ceph-mon[130220]: pgmap v761: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:16:45.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:45 smithi156 ceph-mon[130574]: pgmap v761: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:16:45.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:45 smithi073 ceph-mon[128869]: pgmap v761: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:16:47.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:47 smithi152 ceph-mon[130220]: pgmap v762: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:16:47.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:47 smithi156 ceph-mon[130574]: pgmap v762: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:16:47.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:47 smithi073 ceph-mon[128869]: pgmap v762: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:16:49.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:49 smithi152 ceph-mon[130220]: pgmap v763: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-10T12:16:49.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:49 smithi156 ceph-mon[130574]: pgmap v763: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-10T12:16:49.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:49 smithi073 ceph-mon[128869]: pgmap v763: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-10T12:16:51.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:51 smithi152 ceph-mon[130220]: pgmap v764: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:16:51.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:51 smithi156 ceph-mon[130574]: pgmap v764: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:16:51.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:51 smithi073 ceph-mon[128869]: pgmap v764: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:16:53.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:53 smithi152 ceph-mon[130220]: pgmap v765: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:16:53.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:53 smithi156 ceph-mon[130574]: pgmap v765: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:16:53.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:53 smithi073 ceph-mon[128869]: pgmap v765: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:16:55.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:55 smithi152 ceph-mon[130220]: pgmap v766: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:16:55.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:55 smithi156 ceph-mon[130574]: pgmap v766: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:16:55.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:55 smithi073 ceph-mon[128869]: pgmap v766: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:16:57.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:57 smithi152 ceph-mon[130220]: pgmap v767: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:16:57.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:57 smithi156 ceph-mon[130574]: pgmap v767: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:16:57.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:57 smithi073 ceph-mon[128869]: pgmap v767: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:16:59.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:16:59 smithi152 ceph-mon[130220]: pgmap v768: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:16:59.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:16:59 smithi156 ceph-mon[130574]: pgmap v768: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:16:59.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:16:59 smithi073 ceph-mon[128869]: pgmap v768: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:17:01.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:01 smithi152 ceph-mon[130220]: pgmap v769: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:17:01.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:01 smithi156 ceph-mon[130574]: pgmap v769: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:17:01.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:01 smithi073 ceph-mon[128869]: pgmap v769: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:17:03.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:03 smithi152 ceph-mon[130220]: pgmap v770: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:17:03.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:03 smithi156 ceph-mon[130574]: pgmap v770: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:17:03.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:03 smithi073 ceph-mon[128869]: pgmap v770: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:17:05.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:05 smithi152 ceph-mon[130220]: pgmap v771: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:17:05.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:05 smithi156 ceph-mon[130574]: pgmap v771: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:17:05.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:05 smithi073 ceph-mon[128869]: pgmap v771: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:17:07.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:07 smithi152 ceph-mon[130220]: pgmap v772: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:17:07.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:07 smithi156 ceph-mon[130574]: pgmap v772: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:17:07.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:07 smithi073 ceph-mon[128869]: pgmap v772: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:17:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:09 smithi152 ceph-mon[130220]: pgmap v773: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:17:09.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:09 smithi156 ceph-mon[130574]: pgmap v773: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:17:09.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:09 smithi073 ceph-mon[128869]: pgmap v773: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:17:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:11 smithi152 ceph-mon[130220]: pgmap v774: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:17:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:11 smithi152 ceph-mon[130220]: osdmap e122: 12 total, 12 up, 12 in 2023-08-10T12:17:11.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:11 smithi156 ceph-mon[130574]: pgmap v774: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:17:11.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:11 smithi156 ceph-mon[130574]: osdmap e122: 12 total, 12 up, 12 in 2023-08-10T12:17:11.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:11 smithi073 ceph-mon[128869]: pgmap v774: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:17:11.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:11 smithi073 ceph-mon[128869]: osdmap e122: 12 total, 12 up, 12 in 2023-08-10T12:17:13.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:13 smithi152 ceph-mon[130220]: pgmap v776: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:17:13.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:13 smithi156 ceph-mon[130574]: pgmap v776: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:17:13.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:13 smithi073 ceph-mon[128869]: pgmap v776: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:17:15.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:15 smithi152 ceph-mon[130220]: pgmap v777: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:17:15.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:15 smithi156 ceph-mon[130574]: pgmap v777: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:17:15.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:15 smithi073 ceph-mon[128869]: pgmap v777: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:17:16.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:16 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:17:16.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:16 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:17:16.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:16 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:17:17.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:17 smithi152 ceph-mon[130220]: pgmap v778: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:17:17.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:17 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:17:17.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:17 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:17:17.496 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:17 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:17:17.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:17 smithi156 ceph-mon[130574]: pgmap v778: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:17:17.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:17 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:17:17.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:17 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:17:17.506 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:17 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:17:17.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:17 smithi073 ceph-mon[128869]: pgmap v778: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:17:17.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:17 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:17:17.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:17 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:17:17.518 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:17 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:17:19.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:19 smithi152 ceph-mon[130220]: pgmap v779: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:17:19.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:19 smithi152 ceph-mon[130220]: osdmap e123: 12 total, 12 up, 12 in 2023-08-10T12:17:19.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:19 smithi156 ceph-mon[130574]: pgmap v779: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:17:19.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:19 smithi156 ceph-mon[130574]: osdmap e123: 12 total, 12 up, 12 in 2023-08-10T12:17:19.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:19 smithi073 ceph-mon[128869]: pgmap v779: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:17:19.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:19 smithi073 ceph-mon[128869]: osdmap e123: 12 total, 12 up, 12 in 2023-08-10T12:17:21.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:21 smithi152 ceph-mon[130220]: pgmap v781: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:17:21.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:21 smithi156 ceph-mon[130574]: pgmap v781: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:17:21.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:21 smithi073 ceph-mon[128869]: pgmap v781: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:17:23.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:23 smithi152 ceph-mon[130220]: pgmap v782: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:17:23.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:23 smithi156 ceph-mon[130574]: pgmap v782: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:17:23.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:23 smithi073 ceph-mon[128869]: pgmap v782: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:17:25.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:25 smithi152 ceph-mon[130220]: pgmap v783: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:17:25.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:25 smithi156 ceph-mon[130574]: pgmap v783: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:17:25.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:25 smithi073 ceph-mon[128869]: pgmap v783: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:17:27.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:27 smithi152 ceph-mon[130220]: pgmap v784: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:17:27.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:27 smithi156 ceph-mon[130574]: pgmap v784: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:17:27.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:27 smithi073 ceph-mon[128869]: pgmap v784: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:17:29.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:29 smithi152 ceph-mon[130220]: pgmap v785: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:17:29.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:29 smithi156 ceph-mon[130574]: pgmap v785: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:17:29.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:29 smithi073 ceph-mon[128869]: pgmap v785: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:17:31.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:31 smithi152 ceph-mon[130220]: pgmap v786: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:17:31.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:31 smithi156 ceph-mon[130574]: pgmap v786: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:17:31.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:31 smithi073 ceph-mon[128869]: pgmap v786: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:17:33.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:33 smithi152 ceph-mon[130220]: pgmap v787: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:17:33.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:33 smithi156 ceph-mon[130574]: pgmap v787: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:17:33.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:33 smithi073 ceph-mon[128869]: pgmap v787: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:17:35.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:35 smithi152 ceph-mon[130220]: pgmap v788: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:17:35.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:35 smithi156 ceph-mon[130574]: pgmap v788: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:17:35.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:35 smithi073 ceph-mon[128869]: pgmap v788: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:17:37.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:37 smithi152 ceph-mon[130220]: pgmap v789: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:17:37.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:37 smithi156 ceph-mon[130574]: pgmap v789: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:17:37.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:37 smithi073 ceph-mon[128869]: pgmap v789: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:17:39.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:39 smithi152 ceph-mon[130220]: pgmap v790: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:17:39.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:39 smithi156 ceph-mon[130574]: pgmap v790: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:17:39.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:39 smithi073 ceph-mon[128869]: pgmap v790: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:17:41.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:41 smithi152 ceph-mon[130220]: pgmap v791: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:17:41.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:41 smithi156 ceph-mon[130574]: pgmap v791: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:17:41.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:41 smithi073 ceph-mon[128869]: pgmap v791: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:17:43.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:43 smithi152 ceph-mon[130220]: pgmap v792: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:17:43.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:43 smithi156 ceph-mon[130574]: pgmap v792: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:17:43.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:43 smithi073 ceph-mon[128869]: pgmap v792: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:17:45.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:45 smithi152 ceph-mon[130220]: pgmap v793: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:17:45.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:45 smithi156 ceph-mon[130574]: pgmap v793: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:17:45.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:45 smithi073 ceph-mon[128869]: pgmap v793: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:17:47.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:47 smithi152 ceph-mon[130220]: pgmap v794: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:17:47.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:47 smithi156 ceph-mon[130574]: pgmap v794: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:17:47.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:47 smithi073 ceph-mon[128869]: pgmap v794: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:17:49.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:49 smithi152 ceph-mon[130220]: pgmap v795: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:17:49.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:49 smithi156 ceph-mon[130574]: pgmap v795: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:17:49.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:49 smithi073 ceph-mon[128869]: pgmap v795: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:17:51.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:51 smithi152 ceph-mon[130220]: pgmap v796: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:17:51.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:51 smithi156 ceph-mon[130574]: pgmap v796: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:17:51.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:51 smithi073 ceph-mon[128869]: pgmap v796: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:17:53.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:53 smithi152 ceph-mon[130220]: pgmap v797: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:17:53.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:53 smithi156 ceph-mon[130574]: pgmap v797: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:17:53.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:53 smithi073 ceph-mon[128869]: pgmap v797: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:17:55.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:55 smithi152 ceph-mon[130220]: pgmap v798: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:17:55.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:55 smithi156 ceph-mon[130574]: pgmap v798: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:17:55.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:55 smithi073 ceph-mon[128869]: pgmap v798: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:17:57.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:57 smithi152 ceph-mon[130220]: pgmap v799: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:17:57.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:57 smithi156 ceph-mon[130574]: pgmap v799: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:17:57.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:57 smithi073 ceph-mon[128869]: pgmap v799: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:17:59.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:17:59 smithi152 ceph-mon[130220]: pgmap v800: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:17:59.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:17:59 smithi156 ceph-mon[130574]: pgmap v800: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:17:59.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:17:59 smithi073 ceph-mon[128869]: pgmap v800: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:18:01.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:01 smithi152 ceph-mon[130220]: pgmap v801: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:18:01.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:01 smithi156 ceph-mon[130574]: pgmap v801: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:18:01.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:01 smithi073 ceph-mon[128869]: pgmap v801: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:18:03.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:03 smithi152 ceph-mon[130220]: pgmap v802: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:18:03.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:03 smithi156 ceph-mon[130574]: pgmap v802: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:18:03.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:03 smithi073 ceph-mon[128869]: pgmap v802: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:18:05.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:05 smithi152 ceph-mon[130220]: pgmap v803: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:18:05.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:05 smithi156 ceph-mon[130574]: pgmap v803: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:18:05.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:05 smithi073 ceph-mon[128869]: pgmap v803: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:18:07.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:07 smithi152 ceph-mon[130220]: pgmap v804: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:18:07.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:07 smithi156 ceph-mon[130574]: pgmap v804: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:18:07.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:07 smithi073 ceph-mon[128869]: pgmap v804: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:18:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:09 smithi152 ceph-mon[130220]: pgmap v805: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:18:09.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:09 smithi156 ceph-mon[130574]: pgmap v805: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:18:09.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:09 smithi073 ceph-mon[128869]: pgmap v805: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:18:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:11 smithi152 ceph-mon[130220]: pgmap v806: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:18:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:11 smithi152 ceph-mon[130220]: osdmap e124: 12 total, 12 up, 12 in 2023-08-10T12:18:11.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:11 smithi156 ceph-mon[130574]: pgmap v806: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:18:11.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:11 smithi156 ceph-mon[130574]: osdmap e124: 12 total, 12 up, 12 in 2023-08-10T12:18:11.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:11 smithi073 ceph-mon[128869]: pgmap v806: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:18:11.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:11 smithi073 ceph-mon[128869]: osdmap e124: 12 total, 12 up, 12 in 2023-08-10T12:18:13.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:13 smithi152 ceph-mon[130220]: pgmap v808: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:18:13.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:13 smithi156 ceph-mon[130574]: pgmap v808: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:18:13.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:13 smithi073 ceph-mon[128869]: pgmap v808: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:18:15.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:15 smithi152 ceph-mon[130220]: pgmap v809: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:18:15.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:15 smithi156 ceph-mon[130574]: pgmap v809: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:18:15.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:15 smithi073 ceph-mon[128869]: pgmap v809: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:18:17.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:17 smithi152 ceph-mon[130220]: pgmap v810: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:18:17.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:17 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:18:17.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:17 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:18:17.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:17 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:18:17.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:17 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:18:17.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:17 smithi156 ceph-mon[130574]: pgmap v810: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:18:17.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:17 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:18:17.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:17 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:18:17.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:17 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:18:17.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:17 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:18:17.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:17 smithi073 ceph-mon[128869]: pgmap v810: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:18:17.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:17 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:18:17.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:17 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:18:17.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:17 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:18:17.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:17 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:18:19.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:19 smithi152 ceph-mon[130220]: pgmap v811: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:18:19.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:19 smithi152 ceph-mon[130220]: osdmap e125: 12 total, 12 up, 12 in 2023-08-10T12:18:19.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:19 smithi156 ceph-mon[130574]: pgmap v811: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:18:19.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:19 smithi156 ceph-mon[130574]: osdmap e125: 12 total, 12 up, 12 in 2023-08-10T12:18:19.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:19 smithi073 ceph-mon[128869]: pgmap v811: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:18:19.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:19 smithi073 ceph-mon[128869]: osdmap e125: 12 total, 12 up, 12 in 2023-08-10T12:18:21.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:21 smithi152 ceph-mon[130220]: pgmap v813: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:18:21.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:21 smithi156 ceph-mon[130574]: pgmap v813: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:18:21.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:21 smithi073 ceph-mon[128869]: pgmap v813: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:18:23.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:23 smithi152 ceph-mon[130220]: pgmap v814: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:18:23.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:23 smithi156 ceph-mon[130574]: pgmap v814: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:18:23.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:23 smithi073 ceph-mon[128869]: pgmap v814: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:18:25.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:25 smithi152 ceph-mon[130220]: pgmap v815: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:18:25.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:25 smithi156 ceph-mon[130574]: pgmap v815: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:18:25.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:25 smithi073 ceph-mon[128869]: pgmap v815: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:18:27.751 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:27 smithi152 ceph-mon[130220]: pgmap v816: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:18:27.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:27 smithi156 ceph-mon[130574]: pgmap v816: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:18:27.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:27 smithi073 ceph-mon[128869]: pgmap v816: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:18:29.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:29 smithi152 ceph-mon[130220]: pgmap v817: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:18:29.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:29 smithi156 ceph-mon[130574]: pgmap v817: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:18:29.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:29 smithi073 ceph-mon[128869]: pgmap v817: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:18:31.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:31 smithi152 ceph-mon[130220]: pgmap v818: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:18:31.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:31 smithi156 ceph-mon[130574]: pgmap v818: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:18:31.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:31 smithi073 ceph-mon[128869]: pgmap v818: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:18:33.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:33 smithi152 ceph-mon[130220]: pgmap v819: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:18:33.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:33 smithi156 ceph-mon[130574]: pgmap v819: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:18:33.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:33 smithi073 ceph-mon[128869]: pgmap v819: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:18:35.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:35 smithi152 ceph-mon[130220]: pgmap v820: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:18:35.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:35 smithi156 ceph-mon[130574]: pgmap v820: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:18:35.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:35 smithi073 ceph-mon[128869]: pgmap v820: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:18:37.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:37 smithi152 ceph-mon[130220]: pgmap v821: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:18:37.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:37 smithi156 ceph-mon[130574]: pgmap v821: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:18:37.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:37 smithi073 ceph-mon[128869]: pgmap v821: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:18:39.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:39 smithi152 ceph-mon[130220]: pgmap v822: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:18:39.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:39 smithi156 ceph-mon[130574]: pgmap v822: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:18:39.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:39 smithi073 ceph-mon[128869]: pgmap v822: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:18:41.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:41 smithi152 ceph-mon[130220]: pgmap v823: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:18:41.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:41 smithi156 ceph-mon[130574]: pgmap v823: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:18:41.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:41 smithi073 ceph-mon[128869]: pgmap v823: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:18:43.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:43 smithi152 ceph-mon[130220]: pgmap v824: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:18:43.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:43 smithi156 ceph-mon[130574]: pgmap v824: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:18:43.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:43 smithi073 ceph-mon[128869]: pgmap v824: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:18:45.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:45 smithi152 ceph-mon[130220]: pgmap v825: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:18:45.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:45 smithi156 ceph-mon[130574]: pgmap v825: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:18:45.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:45 smithi073 ceph-mon[128869]: pgmap v825: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:18:47.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:47 smithi152 ceph-mon[130220]: pgmap v826: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:18:47.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:47 smithi156 ceph-mon[130574]: pgmap v826: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:18:47.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:47 smithi073 ceph-mon[128869]: pgmap v826: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:18:49.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:49 smithi152 ceph-mon[130220]: pgmap v827: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:18:49.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:49 smithi156 ceph-mon[130574]: pgmap v827: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:18:49.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:49 smithi073 ceph-mon[128869]: pgmap v827: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:18:51.698 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:51 smithi073 ceph-mon[128869]: pgmap v828: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:18:51.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:51 smithi152 ceph-mon[130220]: pgmap v828: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:18:51.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:51 smithi156 ceph-mon[130574]: pgmap v828: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:18:53.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:53 smithi152 ceph-mon[130220]: pgmap v829: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:18:53.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:53 smithi156 ceph-mon[130574]: pgmap v829: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:18:53.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:53 smithi073 ceph-mon[128869]: pgmap v829: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:18:55.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:55 smithi152 ceph-mon[130220]: pgmap v830: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:18:55.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:55 smithi156 ceph-mon[130574]: pgmap v830: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:18:55.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:55 smithi073 ceph-mon[128869]: pgmap v830: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:18:57.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:57 smithi152 ceph-mon[130220]: pgmap v831: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:18:57.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:57 smithi156 ceph-mon[130574]: pgmap v831: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:18:57.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:57 smithi073 ceph-mon[128869]: pgmap v831: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:18:59.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:18:59 smithi152 ceph-mon[130220]: pgmap v832: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:18:59.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:18:59 smithi156 ceph-mon[130574]: pgmap v832: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:18:59.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:18:59 smithi073 ceph-mon[128869]: pgmap v832: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:19:01.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:01 smithi152 ceph-mon[130220]: pgmap v833: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:19:01.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:01 smithi156 ceph-mon[130574]: pgmap v833: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:19:01.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:01 smithi073 ceph-mon[128869]: pgmap v833: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:19:03.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:03 smithi152 ceph-mon[130220]: pgmap v834: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 34 KiB/s wr, 19 op/s 2023-08-10T12:19:03.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:03 smithi156 ceph-mon[130574]: pgmap v834: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 34 KiB/s wr, 19 op/s 2023-08-10T12:19:03.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:03 smithi073 ceph-mon[128869]: pgmap v834: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 34 KiB/s wr, 19 op/s 2023-08-10T12:19:05.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:05 smithi152 ceph-mon[130220]: pgmap v835: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 34 KiB/s wr, 16 op/s 2023-08-10T12:19:05.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:05 smithi156 ceph-mon[130574]: pgmap v835: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 34 KiB/s wr, 16 op/s 2023-08-10T12:19:05.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:05 smithi073 ceph-mon[128869]: pgmap v835: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 34 KiB/s wr, 16 op/s 2023-08-10T12:19:07.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:07 smithi152 ceph-mon[130220]: pgmap v836: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:19:07.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:07 smithi156 ceph-mon[130574]: pgmap v836: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:19:07.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:07 smithi073 ceph-mon[128869]: pgmap v836: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:19:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:09 smithi152 ceph-mon[130220]: pgmap v837: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:19:09.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:09 smithi156 ceph-mon[130574]: pgmap v837: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:19:09.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:09 smithi073 ceph-mon[128869]: pgmap v837: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:19:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:11 smithi152 ceph-mon[130220]: pgmap v838: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:19:11.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:11 smithi152 ceph-mon[130220]: osdmap e126: 12 total, 12 up, 12 in 2023-08-10T12:19:11.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:11 smithi156 ceph-mon[130574]: pgmap v838: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:19:11.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:11 smithi156 ceph-mon[130574]: osdmap e126: 12 total, 12 up, 12 in 2023-08-10T12:19:11.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:11 smithi073 ceph-mon[128869]: pgmap v838: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:19:11.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:11 smithi073 ceph-mon[128869]: osdmap e126: 12 total, 12 up, 12 in 2023-08-10T12:19:13.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:13 smithi152 ceph-mon[130220]: pgmap v840: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 KiB/s wr, 19 op/s 2023-08-10T12:19:13.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:13 smithi156 ceph-mon[130574]: pgmap v840: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 KiB/s wr, 19 op/s 2023-08-10T12:19:13.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:13 smithi073 ceph-mon[128869]: pgmap v840: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 KiB/s wr, 19 op/s 2023-08-10T12:19:15.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:15 smithi152 ceph-mon[130220]: pgmap v841: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 KiB/s wr, 19 op/s 2023-08-10T12:19:15.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:15 smithi156 ceph-mon[130574]: pgmap v841: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 KiB/s wr, 19 op/s 2023-08-10T12:19:15.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:15 smithi073 ceph-mon[128869]: pgmap v841: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 KiB/s wr, 19 op/s 2023-08-10T12:19:17.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:17 smithi152 ceph-mon[130220]: pgmap v842: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:19:17.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:17 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:19:17.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:17 smithi156 ceph-mon[130574]: pgmap v842: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:19:17.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:17 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:19:17.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:17 smithi073 ceph-mon[128869]: pgmap v842: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:19:17.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:17 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:19:18.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:18 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:19:18.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:18 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:19:18.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:18 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:19:18.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:18 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:19:18.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:18 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:19:18.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:18 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:19:18.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:18 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:19:18.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:18 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:19:18.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:18 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:19:20.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:19 smithi073 ceph-mon[128869]: pgmap v843: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:19:20.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:19 smithi073 ceph-mon[128869]: osdmap e127: 12 total, 12 up, 12 in 2023-08-10T12:19:20.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:19 smithi152 ceph-mon[130220]: pgmap v843: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:19:20.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:19 smithi152 ceph-mon[130220]: osdmap e127: 12 total, 12 up, 12 in 2023-08-10T12:19:20.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:19 smithi156 ceph-mon[130574]: pgmap v843: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:19:20.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:19 smithi156 ceph-mon[130574]: osdmap e127: 12 total, 12 up, 12 in 2023-08-10T12:19:22.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:21 smithi073 ceph-mon[128869]: pgmap v845: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:19:22.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:21 smithi152 ceph-mon[130220]: pgmap v845: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:19:22.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:21 smithi156 ceph-mon[130574]: pgmap v845: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:19:24.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:23 smithi152 ceph-mon[130220]: pgmap v846: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:19:24.255 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:23 smithi156 ceph-mon[130574]: pgmap v846: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:19:24.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:23 smithi073 ceph-mon[128869]: pgmap v846: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:19:25.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:25 smithi152 ceph-mon[130220]: pgmap v847: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:19:25.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:25 smithi156 ceph-mon[130574]: pgmap v847: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:19:25.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:25 smithi073 ceph-mon[128869]: pgmap v847: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:19:27.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:27 smithi152 ceph-mon[130220]: pgmap v848: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:19:27.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:27 smithi156 ceph-mon[130574]: pgmap v848: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:19:27.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:27 smithi073 ceph-mon[128869]: pgmap v848: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:19:29.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:29 smithi152 ceph-mon[130220]: pgmap v849: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:19:29.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:29 smithi156 ceph-mon[130574]: pgmap v849: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:19:29.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:29 smithi073 ceph-mon[128869]: pgmap v849: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:19:31.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:31 smithi152 ceph-mon[130220]: pgmap v850: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:19:31.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:31 smithi156 ceph-mon[130574]: pgmap v850: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:19:31.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:31 smithi073 ceph-mon[128869]: pgmap v850: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:19:33.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:33 smithi152 ceph-mon[130220]: pgmap v851: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:19:33.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:33 smithi156 ceph-mon[130574]: pgmap v851: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:19:33.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:33 smithi073 ceph-mon[128869]: pgmap v851: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:19:35.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:35 smithi152 ceph-mon[130220]: pgmap v852: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:19:35.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:35 smithi156 ceph-mon[130574]: pgmap v852: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:19:35.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:35 smithi073 ceph-mon[128869]: pgmap v852: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:19:37.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:37 smithi152 ceph-mon[130220]: pgmap v853: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:19:37.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:37 smithi156 ceph-mon[130574]: pgmap v853: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:19:37.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:37 smithi073 ceph-mon[128869]: pgmap v853: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:19:39.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:39 smithi152 ceph-mon[130220]: pgmap v854: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:19:39.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:39 smithi156 ceph-mon[130574]: pgmap v854: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:19:39.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:39 smithi073 ceph-mon[128869]: pgmap v854: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:19:41.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:41 smithi152 ceph-mon[130220]: pgmap v855: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:19:41.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:41 smithi156 ceph-mon[130574]: pgmap v855: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:19:41.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:41 smithi073 ceph-mon[128869]: pgmap v855: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:19:43.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:43 smithi152 ceph-mon[130220]: pgmap v856: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:19:43.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:43 smithi156 ceph-mon[130574]: pgmap v856: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:19:43.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:43 smithi073 ceph-mon[128869]: pgmap v856: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:19:45.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:45 smithi152 ceph-mon[130220]: pgmap v857: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:19:45.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:45 smithi156 ceph-mon[130574]: pgmap v857: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:19:45.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:45 smithi073 ceph-mon[128869]: pgmap v857: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:19:47.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:47 smithi152 ceph-mon[130220]: pgmap v858: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:19:47.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:47 smithi156 ceph-mon[130574]: pgmap v858: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:19:47.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:47 smithi073 ceph-mon[128869]: pgmap v858: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:19:49.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:49 smithi152 ceph-mon[130220]: pgmap v859: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:19:49.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:49 smithi156 ceph-mon[130574]: pgmap v859: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:19:49.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:49 smithi073 ceph-mon[128869]: pgmap v859: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:19:51.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:51 smithi152 ceph-mon[130220]: pgmap v860: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:19:51.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:51 smithi156 ceph-mon[130574]: pgmap v860: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:19:51.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:51 smithi073 ceph-mon[128869]: pgmap v860: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:19:53.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:53 smithi152 ceph-mon[130220]: pgmap v861: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:19:53.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:53 smithi156 ceph-mon[130574]: pgmap v861: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:19:53.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:53 smithi073 ceph-mon[128869]: pgmap v861: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:19:55.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:55 smithi152 ceph-mon[130220]: pgmap v862: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:19:55.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:55 smithi156 ceph-mon[130574]: pgmap v862: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:19:55.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:55 smithi073 ceph-mon[128869]: pgmap v862: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:19:57.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:57 smithi152 ceph-mon[130220]: pgmap v863: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:19:57.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:57 smithi156 ceph-mon[130574]: pgmap v863: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:19:57.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:57 smithi073 ceph-mon[128869]: pgmap v863: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:19:59.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:19:59 smithi152 ceph-mon[130220]: pgmap v864: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:19:59.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:19:59 smithi156 ceph-mon[130574]: pgmap v864: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:19:59.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:19:59 smithi073 ceph-mon[128869]: pgmap v864: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:20:00.267 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:00 smithi073 ceph-0e619a74-3773-11ee-9b37-001a4aab830c-mon-a[128845]: 2023-08-10T12:19:59.999+0000 7f3dd78d8700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 MDSs report damaged metadata 2023-08-10T12:20:00.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:00 smithi152 ceph-mon[130220]: overall HEALTH_ERR 1 MDSs report damaged metadata 2023-08-10T12:20:00.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:00 smithi156 ceph-mon[130574]: overall HEALTH_ERR 1 MDSs report damaged metadata 2023-08-10T12:20:00.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:00 smithi073 ceph-mon[128869]: overall HEALTH_ERR 1 MDSs report damaged metadata 2023-08-10T12:20:01.726 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:01 smithi156 ceph-mon[130574]: pgmap v865: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:20:01.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:01 smithi152 ceph-mon[130220]: pgmap v865: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:20:01.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:01 smithi073 ceph-mon[128869]: pgmap v865: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:20:03.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:03 smithi152 ceph-mon[130220]: pgmap v866: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 23 KiB/s wr, 14 op/s 2023-08-10T12:20:03.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:03 smithi156 ceph-mon[130574]: pgmap v866: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 23 KiB/s wr, 14 op/s 2023-08-10T12:20:03.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:03 smithi073 ceph-mon[128869]: pgmap v866: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 23 KiB/s wr, 14 op/s 2023-08-10T12:20:05.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:05 smithi152 ceph-mon[130220]: pgmap v867: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 23 KiB/s wr, 11 op/s 2023-08-10T12:20:05.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:05 smithi156 ceph-mon[130574]: pgmap v867: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 23 KiB/s wr, 11 op/s 2023-08-10T12:20:05.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:05 smithi073 ceph-mon[128869]: pgmap v867: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 23 KiB/s wr, 11 op/s 2023-08-10T12:20:07.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:07 smithi152 ceph-mon[130220]: pgmap v868: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:20:07.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:07 smithi156 ceph-mon[130574]: pgmap v868: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:20:07.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:07 smithi073 ceph-mon[128869]: pgmap v868: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:20:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:09 smithi152 ceph-mon[130220]: pgmap v869: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:20:09.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:09 smithi156 ceph-mon[130574]: pgmap v869: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:20:09.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:09 smithi073 ceph-mon[128869]: pgmap v869: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:20:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:11 smithi152 ceph-mon[130220]: pgmap v870: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:20:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:11 smithi152 ceph-mon[130220]: osdmap e128: 12 total, 12 up, 12 in 2023-08-10T12:20:11.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:11 smithi156 ceph-mon[130574]: pgmap v870: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:20:11.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:11 smithi156 ceph-mon[130574]: osdmap e128: 12 total, 12 up, 12 in 2023-08-10T12:20:11.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:11 smithi073 ceph-mon[128869]: pgmap v870: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:20:11.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:11 smithi073 ceph-mon[128869]: osdmap e128: 12 total, 12 up, 12 in 2023-08-10T12:20:13.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:13 smithi152 ceph-mon[130220]: pgmap v872: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 KiB/s wr, 25 op/s 2023-08-10T12:20:13.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:13 smithi156 ceph-mon[130574]: pgmap v872: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 KiB/s wr, 25 op/s 2023-08-10T12:20:13.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:13 smithi073 ceph-mon[128869]: pgmap v872: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 KiB/s wr, 25 op/s 2023-08-10T12:20:15.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:15 smithi152 ceph-mon[130220]: pgmap v873: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 KiB/s wr, 25 op/s 2023-08-10T12:20:15.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:15 smithi156 ceph-mon[130574]: pgmap v873: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 KiB/s wr, 25 op/s 2023-08-10T12:20:15.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:15 smithi073 ceph-mon[128869]: pgmap v873: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 KiB/s wr, 25 op/s 2023-08-10T12:20:17.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:17 smithi152 ceph-mon[130220]: pgmap v874: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:20:17.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:17 smithi156 ceph-mon[130574]: pgmap v874: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:20:17.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:17 smithi073 ceph-mon[128869]: pgmap v874: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:20:18.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:18 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:20:18.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:18 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:20:18.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:18 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:20:19.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:19 smithi152 ceph-mon[130220]: pgmap v875: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:20:19.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:19 smithi152 ceph-mon[130220]: osdmap e129: 12 total, 12 up, 12 in 2023-08-10T12:20:19.577 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:19 smithi156 ceph-mon[130574]: pgmap v875: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:20:19.577 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:19 smithi156 ceph-mon[130574]: osdmap e129: 12 total, 12 up, 12 in 2023-08-10T12:20:19.682 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:19 smithi073 ceph-mon[128869]: pgmap v875: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:20:19.682 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:19 smithi073 ceph-mon[128869]: osdmap e129: 12 total, 12 up, 12 in 2023-08-10T12:20:21.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:21 smithi152 ceph-mon[130220]: pgmap v877: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:20:21.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:21 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:20:21.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:21 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:20:21.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:21 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:20:21.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:21 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:20:21.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:21 smithi156 ceph-mon[130574]: pgmap v877: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:20:21.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:21 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:20:21.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:21 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:20:21.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:21 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:20:21.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:21 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:20:21.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:21 smithi073 ceph-mon[128869]: pgmap v877: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:20:21.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:21 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:20:21.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:21 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:20:21.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:21 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:20:21.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:21 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:20:22.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:22 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:20:22.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:22 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:20:22.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:22 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:20:22.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:22 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:20:22.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:22 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:20:22.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:22 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:20:22.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:22 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:20:22.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:22 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:20:22.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:22 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:20:22.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:22 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:20:22.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:22 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:20:22.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:22 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:20:22.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:22 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:20:22.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:22 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:20:22.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:22 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:20:23.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:23 smithi152 ceph-mon[130220]: pgmap v878: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:20:23.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:23 smithi156 ceph-mon[130574]: pgmap v878: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:20:23.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:23 smithi073 ceph-mon[128869]: pgmap v878: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:20:25.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:25 smithi152 ceph-mon[130220]: pgmap v879: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:20:25.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:25 smithi156 ceph-mon[130574]: pgmap v879: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:20:25.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:25 smithi073 ceph-mon[128869]: pgmap v879: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:20:27.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:27 smithi152 ceph-mon[130220]: pgmap v880: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:20:27.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:27 smithi156 ceph-mon[130574]: pgmap v880: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:20:27.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:27 smithi073 ceph-mon[128869]: pgmap v880: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:20:29.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:29 smithi152 ceph-mon[130220]: pgmap v881: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:20:29.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:29 smithi156 ceph-mon[130574]: pgmap v881: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:20:29.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:29 smithi073 ceph-mon[128869]: pgmap v881: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:20:31.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:31 smithi152 ceph-mon[130220]: pgmap v882: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:20:31.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:31 smithi156 ceph-mon[130574]: pgmap v882: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:20:31.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:31 smithi073 ceph-mon[128869]: pgmap v882: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:20:33.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:33 smithi152 ceph-mon[130220]: pgmap v883: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:20:33.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:33 smithi156 ceph-mon[130574]: pgmap v883: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:20:33.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:33 smithi073 ceph-mon[128869]: pgmap v883: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:20:35.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:35 smithi152 ceph-mon[130220]: pgmap v884: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:20:35.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:35 smithi156 ceph-mon[130574]: pgmap v884: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:20:35.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:35 smithi073 ceph-mon[128869]: pgmap v884: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:20:37.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:37 smithi152 ceph-mon[130220]: pgmap v885: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:20:37.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:37 smithi156 ceph-mon[130574]: pgmap v885: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:20:37.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:37 smithi073 ceph-mon[128869]: pgmap v885: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:20:39.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:39 smithi152 ceph-mon[130220]: pgmap v886: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:20:39.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:39 smithi156 ceph-mon[130574]: pgmap v886: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:20:39.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:39 smithi073 ceph-mon[128869]: pgmap v886: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:20:41.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:41 smithi152 ceph-mon[130220]: pgmap v887: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:20:41.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:41 smithi156 ceph-mon[130574]: pgmap v887: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:20:41.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:41 smithi073 ceph-mon[128869]: pgmap v887: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:20:43.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:43 smithi152 ceph-mon[130220]: pgmap v888: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:20:43.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:43 smithi156 ceph-mon[130574]: pgmap v888: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:20:43.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:43 smithi073 ceph-mon[128869]: pgmap v888: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:20:45.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:45 smithi152 ceph-mon[130220]: pgmap v889: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:20:45.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:45 smithi156 ceph-mon[130574]: pgmap v889: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:20:45.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:45 smithi073 ceph-mon[128869]: pgmap v889: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:20:47.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:47 smithi152 ceph-mon[130220]: pgmap v890: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:20:47.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:47 smithi156 ceph-mon[130574]: pgmap v890: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:20:47.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:47 smithi073 ceph-mon[128869]: pgmap v890: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:20:49.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:49 smithi152 ceph-mon[130220]: pgmap v891: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-10T12:20:49.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:49 smithi156 ceph-mon[130574]: pgmap v891: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-10T12:20:49.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:49 smithi073 ceph-mon[128869]: pgmap v891: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-10T12:20:51.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:51 smithi152 ceph-mon[130220]: pgmap v892: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:20:51.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:51 smithi156 ceph-mon[130574]: pgmap v892: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:20:51.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:51 smithi073 ceph-mon[128869]: pgmap v892: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:20:53.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:53 smithi152 ceph-mon[130220]: pgmap v893: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:20:53.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:53 smithi156 ceph-mon[130574]: pgmap v893: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:20:53.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:53 smithi073 ceph-mon[128869]: pgmap v893: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T12:20:55.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:55 smithi152 ceph-mon[130220]: pgmap v894: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:20:55.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:55 smithi156 ceph-mon[130574]: pgmap v894: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:20:55.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:55 smithi073 ceph-mon[128869]: pgmap v894: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:20:57.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:57 smithi152 ceph-mon[130220]: pgmap v895: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:20:57.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:57 smithi156 ceph-mon[130574]: pgmap v895: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:20:57.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:57 smithi073 ceph-mon[128869]: pgmap v895: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:20:59.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:20:59 smithi152 ceph-mon[130220]: pgmap v896: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:20:59.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:20:59 smithi156 ceph-mon[130574]: pgmap v896: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:20:59.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:20:59 smithi073 ceph-mon[128869]: pgmap v896: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:21:01.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:01 smithi152 ceph-mon[130220]: pgmap v897: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:21:01.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:01 smithi156 ceph-mon[130574]: pgmap v897: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:21:01.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:01 smithi073 ceph-mon[128869]: pgmap v897: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:21:03.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:03 smithi152 ceph-mon[130220]: pgmap v898: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:21:03.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:03 smithi156 ceph-mon[130574]: pgmap v898: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:21:03.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:03 smithi073 ceph-mon[128869]: pgmap v898: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:21:05.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:05 smithi152 ceph-mon[130220]: pgmap v899: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:21:05.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:05 smithi156 ceph-mon[130574]: pgmap v899: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:21:05.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:05 smithi073 ceph-mon[128869]: pgmap v899: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:21:07.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:07 smithi152 ceph-mon[130220]: pgmap v900: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:21:07.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:07 smithi156 ceph-mon[130574]: pgmap v900: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:21:07.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:07 smithi073 ceph-mon[128869]: pgmap v900: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:21:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:09 smithi152 ceph-mon[130220]: pgmap v901: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:21:09.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:09 smithi156 ceph-mon[130574]: pgmap v901: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:21:09.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:09 smithi073 ceph-mon[128869]: pgmap v901: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:21:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:11 smithi152 ceph-mon[130220]: pgmap v902: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:21:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:11 smithi152 ceph-mon[130220]: osdmap e130: 12 total, 12 up, 12 in 2023-08-10T12:21:11.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:11 smithi156 ceph-mon[130574]: pgmap v902: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:21:11.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:11 smithi156 ceph-mon[130574]: osdmap e130: 12 total, 12 up, 12 in 2023-08-10T12:21:11.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:11 smithi073 ceph-mon[128869]: pgmap v902: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:21:11.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:11 smithi073 ceph-mon[128869]: osdmap e130: 12 total, 12 up, 12 in 2023-08-10T12:21:13.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:13 smithi152 ceph-mon[130220]: pgmap v904: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:21:13.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:13 smithi156 ceph-mon[130574]: pgmap v904: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:21:13.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:13 smithi073 ceph-mon[128869]: pgmap v904: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:21:15.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:15 smithi152 ceph-mon[130220]: pgmap v905: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:21:15.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:15 smithi156 ceph-mon[130574]: pgmap v905: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:21:15.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:15 smithi073 ceph-mon[128869]: pgmap v905: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:21:17.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:17 smithi152 ceph-mon[130220]: pgmap v906: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:21:17.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:17 smithi156 ceph-mon[130574]: pgmap v906: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:21:17.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:17 smithi073 ceph-mon[128869]: pgmap v906: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:21:19.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:19 smithi152 ceph-mon[130220]: pgmap v907: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:21:19.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:19 smithi152 ceph-mon[130220]: osdmap e131: 12 total, 12 up, 12 in 2023-08-10T12:21:19.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:19 smithi156 ceph-mon[130574]: pgmap v907: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:21:19.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:19 smithi156 ceph-mon[130574]: osdmap e131: 12 total, 12 up, 12 in 2023-08-10T12:21:19.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:19 smithi073 ceph-mon[128869]: pgmap v907: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:21:19.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:19 smithi073 ceph-mon[128869]: osdmap e131: 12 total, 12 up, 12 in 2023-08-10T12:21:21.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:21 smithi152 ceph-mon[130220]: pgmap v909: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:21:21.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:21 smithi156 ceph-mon[130574]: pgmap v909: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:21:21.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:21 smithi073 ceph-mon[128869]: pgmap v909: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:21:22.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:22 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:21:22.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:22 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:21:22.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:22 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:21:22.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:22 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:21:22.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:22 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:21:22.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:22 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:21:22.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:22 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:21:22.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:22 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:21:22.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:22 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:21:22.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:22 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:21:22.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:22 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:21:22.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:22 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:21:23.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:23 smithi152 ceph-mon[130220]: pgmap v910: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:21:23.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:23 smithi156 ceph-mon[130574]: pgmap v910: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:21:23.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:23 smithi073 ceph-mon[128869]: pgmap v910: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:21:25.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:25 smithi152 ceph-mon[130220]: pgmap v911: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:21:25.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:25 smithi156 ceph-mon[130574]: pgmap v911: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:21:25.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:25 smithi073 ceph-mon[128869]: pgmap v911: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:21:27.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:27 smithi152 ceph-mon[130220]: pgmap v912: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:21:27.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:27 smithi156 ceph-mon[130574]: pgmap v912: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:21:27.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:27 smithi073 ceph-mon[128869]: pgmap v912: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:21:29.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:29 smithi152 ceph-mon[130220]: pgmap v913: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:21:29.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:29 smithi156 ceph-mon[130574]: pgmap v913: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:21:29.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:29 smithi073 ceph-mon[128869]: pgmap v913: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:21:31.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:31 smithi152 ceph-mon[130220]: pgmap v914: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:21:31.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:31 smithi156 ceph-mon[130574]: pgmap v914: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:21:31.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:31 smithi073 ceph-mon[128869]: pgmap v914: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:21:33.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:33 smithi152 ceph-mon[130220]: pgmap v915: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:21:33.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:33 smithi156 ceph-mon[130574]: pgmap v915: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:21:33.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:33 smithi073 ceph-mon[128869]: pgmap v915: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:21:35.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:35 smithi152 ceph-mon[130220]: pgmap v916: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:21:35.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:35 smithi156 ceph-mon[130574]: pgmap v916: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:21:35.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:35 smithi073 ceph-mon[128869]: pgmap v916: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:21:37.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:37 smithi152 ceph-mon[130220]: pgmap v917: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:21:37.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:37 smithi156 ceph-mon[130574]: pgmap v917: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:21:37.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:37 smithi073 ceph-mon[128869]: pgmap v917: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:21:39.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:39 smithi152 ceph-mon[130220]: pgmap v918: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:21:39.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:39 smithi156 ceph-mon[130574]: pgmap v918: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:21:39.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:39 smithi073 ceph-mon[128869]: pgmap v918: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:21:41.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:41 smithi152 ceph-mon[130220]: pgmap v919: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:21:41.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:41 smithi156 ceph-mon[130574]: pgmap v919: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:21:41.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:41 smithi073 ceph-mon[128869]: pgmap v919: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:21:43.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:43 smithi152 ceph-mon[130220]: pgmap v920: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:21:43.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:43 smithi156 ceph-mon[130574]: pgmap v920: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:21:43.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:43 smithi073 ceph-mon[128869]: pgmap v920: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:21:45.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:45 smithi152 ceph-mon[130220]: pgmap v921: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:21:45.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:45 smithi156 ceph-mon[130574]: pgmap v921: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:21:45.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:45 smithi073 ceph-mon[128869]: pgmap v921: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:21:47.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:47 smithi152 ceph-mon[130220]: pgmap v922: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:21:47.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:47 smithi156 ceph-mon[130574]: pgmap v922: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:21:47.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:47 smithi073 ceph-mon[128869]: pgmap v922: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:21:49.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:49 smithi152 ceph-mon[130220]: pgmap v923: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:21:49.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:49 smithi156 ceph-mon[130574]: pgmap v923: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:21:49.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:49 smithi073 ceph-mon[128869]: pgmap v923: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:21:51.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:51 smithi152 ceph-mon[130220]: pgmap v924: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:21:51.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:51 smithi156 ceph-mon[130574]: pgmap v924: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:21:51.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:51 smithi073 ceph-mon[128869]: pgmap v924: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:21:53.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:53 smithi152 ceph-mon[130220]: pgmap v925: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:21:53.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:53 smithi156 ceph-mon[130574]: pgmap v925: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:21:53.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:53 smithi073 ceph-mon[128869]: pgmap v925: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:21:55.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:55 smithi152 ceph-mon[130220]: pgmap v926: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:21:55.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:55 smithi156 ceph-mon[130574]: pgmap v926: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:21:55.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:55 smithi073 ceph-mon[128869]: pgmap v926: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:21:57.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:57 smithi152 ceph-mon[130220]: pgmap v927: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:21:57.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:57 smithi156 ceph-mon[130574]: pgmap v927: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:21:57.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:57 smithi073 ceph-mon[128869]: pgmap v927: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:21:59.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:21:59 smithi152 ceph-mon[130220]: pgmap v928: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:21:59.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:21:59 smithi156 ceph-mon[130574]: pgmap v928: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:21:59.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:21:59 smithi073 ceph-mon[128869]: pgmap v928: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:22:01.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:01 smithi152 ceph-mon[130220]: pgmap v929: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:22:01.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:01 smithi156 ceph-mon[130574]: pgmap v929: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:22:01.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:01 smithi073 ceph-mon[128869]: pgmap v929: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:22:03.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:03 smithi152 ceph-mon[130220]: pgmap v930: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:22:03.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:03 smithi156 ceph-mon[130574]: pgmap v930: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:22:03.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:03 smithi073 ceph-mon[128869]: pgmap v930: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:22:05.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:05 smithi152 ceph-mon[130220]: pgmap v931: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:22:05.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:05 smithi156 ceph-mon[130574]: pgmap v931: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:22:05.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:05 smithi073 ceph-mon[128869]: pgmap v931: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:22:07.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:07 smithi152 ceph-mon[130220]: pgmap v932: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:22:07.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:07 smithi156 ceph-mon[130574]: pgmap v932: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:22:07.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:07 smithi073 ceph-mon[128869]: pgmap v932: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-08-10T12:22:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:09 smithi152 ceph-mon[130220]: pgmap v933: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:22:09.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:09 smithi156 ceph-mon[130574]: pgmap v933: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:22:09.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:09 smithi073 ceph-mon[128869]: pgmap v933: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:22:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:11 smithi152 ceph-mon[130220]: pgmap v934: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:22:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:11 smithi152 ceph-mon[130220]: osdmap e132: 12 total, 12 up, 12 in 2023-08-10T12:22:11.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:11 smithi156 ceph-mon[130574]: pgmap v934: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:22:11.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:11 smithi156 ceph-mon[130574]: osdmap e132: 12 total, 12 up, 12 in 2023-08-10T12:22:11.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:11 smithi073 ceph-mon[128869]: pgmap v934: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:22:11.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:11 smithi073 ceph-mon[128869]: osdmap e132: 12 total, 12 up, 12 in 2023-08-10T12:22:13.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:13 smithi152 ceph-mon[130220]: pgmap v936: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:22:13.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:13 smithi156 ceph-mon[130574]: pgmap v936: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:22:13.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:13 smithi073 ceph-mon[128869]: pgmap v936: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:22:15.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:15 smithi152 ceph-mon[130220]: pgmap v937: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:22:15.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:15 smithi156 ceph-mon[130574]: pgmap v937: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:22:15.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:15 smithi073 ceph-mon[128869]: pgmap v937: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:22:17.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:17 smithi152 ceph-mon[130220]: pgmap v938: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:22:17.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:17 smithi156 ceph-mon[130574]: pgmap v938: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:22:17.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:17 smithi073 ceph-mon[128869]: pgmap v938: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:22:19.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:19 smithi152 ceph-mon[130220]: pgmap v939: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:22:19.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:19 smithi152 ceph-mon[130220]: osdmap e133: 12 total, 12 up, 12 in 2023-08-10T12:22:19.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:19 smithi156 ceph-mon[130574]: pgmap v939: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:22:19.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:19 smithi156 ceph-mon[130574]: osdmap e133: 12 total, 12 up, 12 in 2023-08-10T12:22:19.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:19 smithi073 ceph-mon[128869]: pgmap v939: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:22:19.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:19 smithi073 ceph-mon[128869]: osdmap e133: 12 total, 12 up, 12 in 2023-08-10T12:22:21.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:21 smithi152 ceph-mon[130220]: pgmap v941: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:22:21.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:21 smithi156 ceph-mon[130574]: pgmap v941: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:22:21.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:21 smithi073 ceph-mon[128869]: pgmap v941: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:22:22.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:22 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:22:22.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:22 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:22:22.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:22 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:22:23.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:23 smithi152 ceph-mon[130220]: pgmap v942: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:22:23.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:23 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:22:23.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:23 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:22:23.747 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:23 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:22:23.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:23 smithi156 ceph-mon[130574]: pgmap v942: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:22:23.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:23 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:22:23.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:23 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:22:23.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:23 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:22:23.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:23 smithi073 ceph-mon[128869]: pgmap v942: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:22:23.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:23 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:22:23.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:23 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:22:23.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:23 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:22:25.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:25 smithi152 ceph-mon[130220]: pgmap v943: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:22:25.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:25 smithi156 ceph-mon[130574]: pgmap v943: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:22:25.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:25 smithi073 ceph-mon[128869]: pgmap v943: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:22:27.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:27 smithi152 ceph-mon[130220]: pgmap v944: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:22:27.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:27 smithi156 ceph-mon[130574]: pgmap v944: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:22:27.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:27 smithi073 ceph-mon[128869]: pgmap v944: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:22:29.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:29 smithi152 ceph-mon[130220]: pgmap v945: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:22:29.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:29 smithi156 ceph-mon[130574]: pgmap v945: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:22:29.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:29 smithi073 ceph-mon[128869]: pgmap v945: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T12:22:31.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:31 smithi152 ceph-mon[130220]: pgmap v946: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:22:31.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:31 smithi156 ceph-mon[130574]: pgmap v946: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:22:31.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:31 smithi073 ceph-mon[128869]: pgmap v946: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:22:33.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:33 smithi152 ceph-mon[130220]: pgmap v947: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:22:33.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:33 smithi156 ceph-mon[130574]: pgmap v947: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:22:33.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:33 smithi073 ceph-mon[128869]: pgmap v947: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:22:35.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:35 smithi152 ceph-mon[130220]: pgmap v948: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:22:35.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:35 smithi156 ceph-mon[130574]: pgmap v948: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:22:35.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:35 smithi073 ceph-mon[128869]: pgmap v948: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T12:22:37.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:37 smithi152 ceph-mon[130220]: pgmap v949: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:22:37.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:37 smithi156 ceph-mon[130574]: pgmap v949: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:22:37.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:37 smithi073 ceph-mon[128869]: pgmap v949: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-08-10T12:22:39.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:39 smithi152 ceph-mon[130220]: pgmap v950: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:22:39.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:39 smithi156 ceph-mon[130574]: pgmap v950: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:22:39.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:39 smithi073 ceph-mon[128869]: pgmap v950: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:22:41.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:41 smithi152 ceph-mon[130220]: pgmap v951: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-08-10T12:22:41.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:41 smithi156 ceph-mon[130574]: pgmap v951: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-08-10T12:22:41.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:41 smithi073 ceph-mon[128869]: pgmap v951: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-08-10T12:22:43.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:43 smithi152 ceph-mon[130220]: pgmap v952: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-08-10T12:22:43.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:43 smithi156 ceph-mon[130574]: pgmap v952: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-08-10T12:22:43.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:43 smithi073 ceph-mon[128869]: pgmap v952: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-08-10T12:22:45.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:45 smithi152 ceph-mon[130220]: pgmap v953: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-08-10T12:22:45.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:45 smithi156 ceph-mon[130574]: pgmap v953: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-08-10T12:22:45.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:45 smithi073 ceph-mon[128869]: pgmap v953: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-08-10T12:22:47.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:47 smithi152 ceph-mon[130220]: pgmap v954: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-08-10T12:22:47.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:47 smithi156 ceph-mon[130574]: pgmap v954: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-08-10T12:22:47.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:47 smithi073 ceph-mon[128869]: pgmap v954: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-08-10T12:22:49.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:49 smithi152 ceph-mon[130220]: pgmap v955: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-08-10T12:22:49.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:49 smithi156 ceph-mon[130574]: pgmap v955: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-08-10T12:22:49.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:49 smithi073 ceph-mon[128869]: pgmap v955: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-08-10T12:22:51.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:51 smithi152 ceph-mon[130220]: pgmap v956: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-08-10T12:22:51.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:51 smithi156 ceph-mon[130574]: pgmap v956: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-08-10T12:22:51.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:51 smithi073 ceph-mon[128869]: pgmap v956: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-08-10T12:22:53.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:53 smithi152 ceph-mon[130220]: pgmap v957: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:22:53.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:53 smithi156 ceph-mon[130574]: pgmap v957: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:22:53.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:53 smithi073 ceph-mon[128869]: pgmap v957: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:22:55.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:55 smithi152 ceph-mon[130220]: pgmap v958: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:22:55.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:55 smithi156 ceph-mon[130574]: pgmap v958: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:22:55.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:55 smithi073 ceph-mon[128869]: pgmap v958: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:22:57.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:57 smithi152 ceph-mon[130220]: pgmap v959: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:22:57.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:57 smithi156 ceph-mon[130574]: pgmap v959: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:22:57.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:57 smithi073 ceph-mon[128869]: pgmap v959: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:22:59.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:22:59 smithi152 ceph-mon[130220]: pgmap v960: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:22:59.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:22:59 smithi156 ceph-mon[130574]: pgmap v960: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:22:59.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:22:59 smithi073 ceph-mon[128869]: pgmap v960: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:01.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:01 smithi152 ceph-mon[130220]: pgmap v961: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:23:01.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:01 smithi156 ceph-mon[130574]: pgmap v961: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:23:01.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:01 smithi073 ceph-mon[128869]: pgmap v961: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:23:03.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:03 smithi152 ceph-mon[130220]: pgmap v962: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:03.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:03 smithi156 ceph-mon[130574]: pgmap v962: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:03.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:03 smithi073 ceph-mon[128869]: pgmap v962: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:05.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:05 smithi152 ceph-mon[130220]: pgmap v963: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-10T12:23:05.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:05 smithi156 ceph-mon[130574]: pgmap v963: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-10T12:23:05.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:05 smithi073 ceph-mon[128869]: pgmap v963: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-10T12:23:07.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:07 smithi152 ceph-mon[130220]: pgmap v964: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-10T12:23:07.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:07 smithi156 ceph-mon[130574]: pgmap v964: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-10T12:23:07.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:07 smithi073 ceph-mon[128869]: pgmap v964: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-10T12:23:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:09 smithi152 ceph-mon[130220]: pgmap v965: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-10T12:23:09.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:09 smithi156 ceph-mon[130574]: pgmap v965: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-10T12:23:09.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:09 smithi073 ceph-mon[128869]: pgmap v965: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-10T12:23:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:11 smithi152 ceph-mon[130220]: pgmap v966: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-10T12:23:11.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:11 smithi152 ceph-mon[130220]: osdmap e134: 12 total, 12 up, 12 in 2023-08-10T12:23:11.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:11 smithi156 ceph-mon[130574]: pgmap v966: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-10T12:23:11.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:11 smithi156 ceph-mon[130574]: osdmap e134: 12 total, 12 up, 12 in 2023-08-10T12:23:11.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:11 smithi073 ceph-mon[128869]: pgmap v966: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-10T12:23:11.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:11 smithi073 ceph-mon[128869]: osdmap e134: 12 total, 12 up, 12 in 2023-08-10T12:23:13.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:13 smithi152 ceph-mon[130220]: pgmap v968: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-10T12:23:13.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:13 smithi156 ceph-mon[130574]: pgmap v968: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-10T12:23:13.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:13 smithi073 ceph-mon[128869]: pgmap v968: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-10T12:23:15.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:15 smithi152 ceph-mon[130220]: pgmap v969: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:23:15.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:15 smithi156 ceph-mon[130574]: pgmap v969: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:23:15.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:15 smithi073 ceph-mon[128869]: pgmap v969: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:23:17.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:17 smithi152 ceph-mon[130220]: pgmap v970: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:23:17.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:17 smithi156 ceph-mon[130574]: pgmap v970: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:23:17.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:17 smithi073 ceph-mon[128869]: pgmap v970: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:23:19.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:19 smithi152 ceph-mon[130220]: pgmap v971: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:23:19.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:19 smithi152 ceph-mon[130220]: osdmap e135: 12 total, 12 up, 12 in 2023-08-10T12:23:19.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:19 smithi156 ceph-mon[130574]: pgmap v971: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:23:19.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:19 smithi156 ceph-mon[130574]: osdmap e135: 12 total, 12 up, 12 in 2023-08-10T12:23:19.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:19 smithi073 ceph-mon[128869]: pgmap v971: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:23:19.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:19 smithi073 ceph-mon[128869]: osdmap e135: 12 total, 12 up, 12 in 2023-08-10T12:23:21.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:21 smithi152 ceph-mon[130220]: pgmap v973: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:23:21.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:21 smithi156 ceph-mon[130574]: pgmap v973: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:23:21.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:21 smithi073 ceph-mon[128869]: pgmap v973: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:23:23.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:23 smithi152 ceph-mon[130220]: pgmap v974: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:23:23.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:23 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:23:23.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:23 smithi156 ceph-mon[130574]: pgmap v974: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:23:23.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:23 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:23:23.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:23 smithi073 ceph-mon[128869]: pgmap v974: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:23:23.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:23 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:23:25.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:25 smithi152 ceph-mon[130220]: pgmap v975: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:23:25.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:25 smithi156 ceph-mon[130574]: pgmap v975: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:23:25.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:25 smithi073 ceph-mon[128869]: pgmap v975: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:23:26.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:26 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:26.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:26 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:26.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:26 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:26.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:26 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:26.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:26 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:26.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:26 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:26.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:26 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:26.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:26 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:26.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:26 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:26.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:26 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:26.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:26 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:26.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:26 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:26.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:26 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:26.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:26 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:26.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:26 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:26.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:26 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:26.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:26 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:26.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:26 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:26.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:26 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:26.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:26 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:26.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:26 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:26.999 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:26 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:26.999 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:26 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:26.999 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:26 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:26.999 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:26 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:26.999 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:26 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:26 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:27.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:26 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:27.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:26 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:27.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:26 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:27.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:26 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:27.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:26 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:27.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:26 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:27.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:26 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:27.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:26 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:27.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:26 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:26 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:27.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:26 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:26 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:26 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:26 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:26 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:26 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:26 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:26 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:26 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:26 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:26 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:26 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.009 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:26 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.010 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:26 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.010 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:26 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:26 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:27.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:26 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:27.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:26 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:27.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:26 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:27.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:26 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:27.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:26 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:27.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:26 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:27.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:26 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:27.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:26 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:27.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:26 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:26 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:27.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:26 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:26 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:26 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:26 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:26 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:26 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:26 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:26 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:26 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:26 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:26 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:26 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:26 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:26 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.021 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:26 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:27 smithi152 ceph-mon[130220]: pgmap v976: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:23:27.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:27 smithi152 ceph-mon[130220]: Adjusting osd_memory_target on smithi073 to 196.2M 2023-08-10T12:23:27.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:27 smithi152 ceph-mon[130220]: Unable to set osd_memory_target on smithi073 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-08-10T12:23:27.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:27 smithi152 ceph-mon[130220]: Adjusting osd_memory_target on smithi156 to 196.2M 2023-08-10T12:23:27.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:27 smithi152 ceph-mon[130220]: Unable to set osd_memory_target on smithi156 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-08-10T12:23:27.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:27 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:27.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:27 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:27.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:27 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:27 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:27 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:27 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:27 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:27 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:27 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:27 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:27.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:27 smithi152 ceph-mon[130220]: Adjusting osd_memory_target on smithi152 to 196.2M 2023-08-10T12:23:27.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:27 smithi152 ceph-mon[130220]: Unable to set osd_memory_target on smithi152 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-08-10T12:23:27.997 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:27 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:23:27.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:27 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:23:27.998 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:27 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:28.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:27 smithi156 ceph-mon[130574]: pgmap v976: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:23:28.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:27 smithi156 ceph-mon[130574]: Adjusting osd_memory_target on smithi073 to 196.2M 2023-08-10T12:23:28.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:27 smithi156 ceph-mon[130574]: Unable to set osd_memory_target on smithi073 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-08-10T12:23:28.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:27 smithi156 ceph-mon[130574]: Adjusting osd_memory_target on smithi156 to 196.2M 2023-08-10T12:23:28.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:27 smithi156 ceph-mon[130574]: Unable to set osd_memory_target on smithi156 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-08-10T12:23:28.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:27 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:28.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:27 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:28.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:27 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:28.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:27 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:28.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:27 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:28.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:27 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:28.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:27 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:28.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:27 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:28.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:27 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:28.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:27 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:28.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:27 smithi156 ceph-mon[130574]: Adjusting osd_memory_target on smithi152 to 196.2M 2023-08-10T12:23:28.007 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:27 smithi156 ceph-mon[130574]: Unable to set osd_memory_target on smithi152 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-08-10T12:23:28.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:27 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:23:28.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:27 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:23:28.008 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:27 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:28.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:27 smithi073 ceph-mon[128869]: pgmap v976: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:23:28.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:27 smithi073 ceph-mon[128869]: Adjusting osd_memory_target on smithi073 to 196.2M 2023-08-10T12:23:28.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:27 smithi073 ceph-mon[128869]: Unable to set osd_memory_target on smithi073 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-08-10T12:23:28.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:27 smithi073 ceph-mon[128869]: Adjusting osd_memory_target on smithi156 to 196.2M 2023-08-10T12:23:28.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:27 smithi073 ceph-mon[128869]: Unable to set osd_memory_target on smithi156 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-08-10T12:23:28.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:27 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:28.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:27 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:28.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:27 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:28.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:27 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:28.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:27 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:28.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:27 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:28.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:27 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:28.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:27 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:28.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:27 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:28.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:27 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T12:23:28.019 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:27 smithi073 ceph-mon[128869]: Adjusting osd_memory_target on smithi152 to 196.2M 2023-08-10T12:23:28.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:27 smithi073 ceph-mon[128869]: Unable to set osd_memory_target on smithi152 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-08-10T12:23:28.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:27 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:23:28.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:27 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:23:28.020 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:27 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:23:29.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:29 smithi152 ceph-mon[130220]: pgmap v977: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:23:30.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:29 smithi156 ceph-mon[130574]: pgmap v977: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:23:30.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:29 smithi073 ceph-mon[128869]: pgmap v977: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:23:31.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:31 smithi152 ceph-mon[130220]: pgmap v978: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:23:32.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:31 smithi156 ceph-mon[130574]: pgmap v978: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:23:32.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:31 smithi073 ceph-mon[128869]: pgmap v978: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:23:33.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:33 smithi152 ceph-mon[130220]: pgmap v979: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:34.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:33 smithi156 ceph-mon[130574]: pgmap v979: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:34.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:33 smithi073 ceph-mon[128869]: pgmap v979: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:35.495 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:35 smithi152 ceph-mon[130220]: pgmap v980: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:23:35.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:35 smithi156 ceph-mon[130574]: pgmap v980: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:23:35.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:35 smithi073 ceph-mon[128869]: pgmap v980: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:23:37.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:37 smithi152 ceph-mon[130220]: pgmap v981: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:37.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:37 smithi156 ceph-mon[130574]: pgmap v981: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:37.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:37 smithi073 ceph-mon[128869]: pgmap v981: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:39.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:39 smithi152 ceph-mon[130220]: pgmap v982: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:39.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:39 smithi156 ceph-mon[130574]: pgmap v982: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:39.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:39 smithi073 ceph-mon[128869]: pgmap v982: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:41.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:41 smithi152 ceph-mon[130220]: pgmap v983: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:23:41.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:41 smithi156 ceph-mon[130574]: pgmap v983: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:23:41.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:41 smithi073 ceph-mon[128869]: pgmap v983: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:23:43.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:43 smithi152 ceph-mon[130220]: pgmap v984: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:43.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:43 smithi156 ceph-mon[130574]: pgmap v984: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:43.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:43 smithi073 ceph-mon[128869]: pgmap v984: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:45.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:45 smithi156 ceph-mon[130574]: pgmap v985: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:23:45.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:45 smithi073 ceph-mon[128869]: pgmap v985: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:23:45.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:45 smithi152 ceph-mon[130220]: pgmap v985: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:23:47.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:47 smithi152 ceph-mon[130220]: pgmap v986: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:47.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:47 smithi156 ceph-mon[130574]: pgmap v986: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:47.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:47 smithi073 ceph-mon[128869]: pgmap v986: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:49.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:49 smithi152 ceph-mon[130220]: pgmap v987: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:49.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:49 smithi156 ceph-mon[130574]: pgmap v987: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:49.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:49 smithi073 ceph-mon[128869]: pgmap v987: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:51.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:51 smithi152 ceph-mon[130220]: pgmap v988: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:23:51.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:51 smithi156 ceph-mon[130574]: pgmap v988: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:23:51.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:51 smithi073 ceph-mon[128869]: pgmap v988: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:23:53.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:53 smithi152 ceph-mon[130220]: pgmap v989: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:53.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:53 smithi156 ceph-mon[130574]: pgmap v989: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:53.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:53 smithi073 ceph-mon[128869]: pgmap v989: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:55.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:55 smithi156 ceph-mon[130574]: pgmap v990: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:23:55.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:55 smithi073 ceph-mon[128869]: pgmap v990: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:23:55.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:55 smithi152 ceph-mon[130220]: pgmap v990: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:23:57.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:57 smithi152 ceph-mon[130220]: pgmap v991: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:57.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:57 smithi156 ceph-mon[130574]: pgmap v991: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:57.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:57 smithi073 ceph-mon[128869]: pgmap v991: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:59.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:23:59 smithi152 ceph-mon[130220]: pgmap v992: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:59.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:23:59 smithi156 ceph-mon[130574]: pgmap v992: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:23:59.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:23:59 smithi073 ceph-mon[128869]: pgmap v992: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:01.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:01 smithi152 ceph-mon[130220]: pgmap v993: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:24:01.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:01 smithi156 ceph-mon[130574]: pgmap v993: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:24:01.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:01 smithi073 ceph-mon[128869]: pgmap v993: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:24:03.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:03 smithi152 ceph-mon[130220]: pgmap v994: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:03.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:03 smithi156 ceph-mon[130574]: pgmap v994: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:03.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:03 smithi073 ceph-mon[128869]: pgmap v994: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:05.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:05 smithi156 ceph-mon[130574]: pgmap v995: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-10T12:24:05.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:05 smithi073 ceph-mon[128869]: pgmap v995: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-10T12:24:05.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:05 smithi152 ceph-mon[130220]: pgmap v995: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-10T12:24:07.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:07 smithi152 ceph-mon[130220]: pgmap v996: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-10T12:24:07.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:07 smithi156 ceph-mon[130574]: pgmap v996: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-10T12:24:07.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:07 smithi073 ceph-mon[128869]: pgmap v996: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-10T12:24:09.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:09 smithi152 ceph-mon[130220]: pgmap v997: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-10T12:24:09.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:09 smithi156 ceph-mon[130574]: pgmap v997: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-10T12:24:09.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:09 smithi073 ceph-mon[128869]: pgmap v997: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-08-10T12:24:11.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:11 smithi156 ceph-mon[130574]: pgmap v998: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-10T12:24:11.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:11 smithi156 ceph-mon[130574]: osdmap e136: 12 total, 12 up, 12 in 2023-08-10T12:24:11.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:11 smithi073 ceph-mon[128869]: pgmap v998: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-10T12:24:11.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:11 smithi073 ceph-mon[128869]: osdmap e136: 12 total, 12 up, 12 in 2023-08-10T12:24:11.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:11 smithi152 ceph-mon[130220]: pgmap v998: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-10T12:24:11.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:11 smithi152 ceph-mon[130220]: osdmap e136: 12 total, 12 up, 12 in 2023-08-10T12:24:13.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:13 smithi156 ceph-mon[130574]: pgmap v1000: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-10T12:24:13.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:13 smithi073 ceph-mon[128869]: pgmap v1000: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-10T12:24:13.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:13 smithi152 ceph-mon[130220]: pgmap v1000: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-10T12:24:15.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:15 smithi156 ceph-mon[130574]: pgmap v1001: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:24:15.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:15 smithi073 ceph-mon[128869]: pgmap v1001: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:24:15.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:15 smithi152 ceph-mon[130220]: pgmap v1001: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:24:17.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:17 smithi152 ceph-mon[130220]: pgmap v1002: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:24:17.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:17 smithi156 ceph-mon[130574]: pgmap v1002: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:24:17.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:17 smithi073 ceph-mon[128869]: pgmap v1002: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:24:19.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:19 smithi152 ceph-mon[130220]: pgmap v1003: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:24:19.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:19 smithi152 ceph-mon[130220]: osdmap e137: 12 total, 12 up, 12 in 2023-08-10T12:24:19.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:19 smithi156 ceph-mon[130574]: pgmap v1003: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:24:19.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:19 smithi156 ceph-mon[130574]: osdmap e137: 12 total, 12 up, 12 in 2023-08-10T12:24:19.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:19 smithi073 ceph-mon[128869]: pgmap v1003: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:24:19.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:19 smithi073 ceph-mon[128869]: osdmap e137: 12 total, 12 up, 12 in 2023-08-10T12:24:21.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:21 smithi156 ceph-mon[130574]: pgmap v1005: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:24:21.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:21 smithi073 ceph-mon[128869]: pgmap v1005: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:24:21.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:21 smithi152 ceph-mon[130220]: pgmap v1005: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:24:23.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:23 smithi156 ceph-mon[130574]: pgmap v1006: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:24:23.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:23 smithi073 ceph-mon[128869]: pgmap v1006: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:24:23.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:23 smithi152 ceph-mon[130220]: pgmap v1006: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:24:25.505 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:25 smithi156 ceph-mon[130574]: pgmap v1007: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:24:25.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:25 smithi073 ceph-mon[128869]: pgmap v1007: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:24:25.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:25 smithi152 ceph-mon[130220]: pgmap v1007: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:24:27.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:27 smithi152 ceph-mon[130220]: pgmap v1008: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:24:27.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:27 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:24:27.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:27 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:24:27.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:27 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:24:27.746 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:27 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:24:27.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:27 smithi156 ceph-mon[130574]: pgmap v1008: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:24:27.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:27 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:24:27.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:27 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:24:27.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:27 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:24:27.756 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:27 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:24:27.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:27 smithi073 ceph-mon[128869]: pgmap v1008: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:24:27.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:27 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:24:27.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:27 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:24:27.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:27 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:24:27.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:27 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:24:29.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:29 smithi156 ceph-mon[130574]: pgmap v1009: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:24:29.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:29 smithi073 ceph-mon[128869]: pgmap v1009: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:24:29.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:29 smithi152 ceph-mon[130220]: pgmap v1009: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:24:31.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:31 smithi156 ceph-mon[130574]: pgmap v1010: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:24:31.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:31 smithi073 ceph-mon[128869]: pgmap v1010: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:24:31.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:31 smithi152 ceph-mon[130220]: pgmap v1010: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:24:33.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:33 smithi156 ceph-mon[130574]: pgmap v1011: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:33.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:33 smithi073 ceph-mon[128869]: pgmap v1011: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:33.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:33 smithi152 ceph-mon[130220]: pgmap v1011: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:35.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:35 smithi073 ceph-mon[128869]: pgmap v1012: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:24:35.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:35 smithi152 ceph-mon[130220]: pgmap v1012: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:24:35.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:35 smithi156 ceph-mon[130574]: pgmap v1012: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:24:37.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:37 smithi156 ceph-mon[130574]: pgmap v1013: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:37.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:37 smithi073 ceph-mon[128869]: pgmap v1013: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:37.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:37 smithi152 ceph-mon[130220]: pgmap v1013: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:39.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:39 smithi156 ceph-mon[130574]: pgmap v1014: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:39.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:39 smithi073 ceph-mon[128869]: pgmap v1014: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:39.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:39 smithi152 ceph-mon[130220]: pgmap v1014: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:41.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:41 smithi156 ceph-mon[130574]: pgmap v1015: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:24:41.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:41 smithi073 ceph-mon[128869]: pgmap v1015: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:24:41.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:41 smithi152 ceph-mon[130220]: pgmap v1015: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:24:43.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:43 smithi156 ceph-mon[130574]: pgmap v1016: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:43.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:43 smithi073 ceph-mon[128869]: pgmap v1016: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:43.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:43 smithi152 ceph-mon[130220]: pgmap v1016: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:45.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:45 smithi073 ceph-mon[128869]: pgmap v1017: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:24:45.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:45 smithi152 ceph-mon[130220]: pgmap v1017: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:24:45.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:45 smithi156 ceph-mon[130574]: pgmap v1017: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:24:47.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:47 smithi156 ceph-mon[130574]: pgmap v1018: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:47.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:47 smithi073 ceph-mon[128869]: pgmap v1018: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:47.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:47 smithi152 ceph-mon[130220]: pgmap v1018: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:49.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:49 smithi156 ceph-mon[130574]: pgmap v1019: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:49.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:49 smithi073 ceph-mon[128869]: pgmap v1019: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:49.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:49 smithi152 ceph-mon[130220]: pgmap v1019: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:51.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:51 smithi156 ceph-mon[130574]: pgmap v1020: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:24:51.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:51 smithi073 ceph-mon[128869]: pgmap v1020: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:24:51.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:51 smithi152 ceph-mon[130220]: pgmap v1020: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:24:53.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:53 smithi073 ceph-mon[128869]: pgmap v1021: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:53.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:53 smithi152 ceph-mon[130220]: pgmap v1021: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:54.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:53 smithi156 ceph-mon[130574]: pgmap v1021: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:55.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:55 smithi073 ceph-mon[128869]: pgmap v1022: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:24:55.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:55 smithi152 ceph-mon[130220]: pgmap v1022: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:24:55.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:55 smithi156 ceph-mon[130574]: pgmap v1022: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:24:57.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:57 smithi156 ceph-mon[130574]: pgmap v1023: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:57.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:57 smithi073 ceph-mon[128869]: pgmap v1023: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:57.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:57 smithi152 ceph-mon[130220]: pgmap v1023: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:59.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:24:59 smithi156 ceph-mon[130574]: pgmap v1024: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:59.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:24:59 smithi073 ceph-mon[128869]: pgmap v1024: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:24:59.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:24:59 smithi152 ceph-mon[130220]: pgmap v1024: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:25:01.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:01 smithi073 ceph-mon[128869]: pgmap v1025: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:25:01.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:01 smithi152 ceph-mon[130220]: pgmap v1025: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:25:02.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:01 smithi156 ceph-mon[130574]: pgmap v1025: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:25:03.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:03 smithi073 ceph-mon[128869]: pgmap v1026: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:25:03.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:03 smithi152 ceph-mon[130220]: pgmap v1026: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:25:04.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:03 smithi156 ceph-mon[130574]: pgmap v1026: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:25:05.517 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:05 smithi073 ceph-mon[128869]: pgmap v1027: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-10T12:25:05.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:05 smithi152 ceph-mon[130220]: pgmap v1027: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-10T12:25:05.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:05 smithi156 ceph-mon[130574]: pgmap v1027: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-10T12:25:07.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:07 smithi156 ceph-mon[130574]: pgmap v1028: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:25:07.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:07 smithi073 ceph-mon[128869]: pgmap v1028: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:25:07.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:07 smithi152 ceph-mon[130220]: pgmap v1028: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:25:09.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:09 smithi073 ceph-mon[128869]: pgmap v1029: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:25:09.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:09 smithi152 ceph-mon[130220]: pgmap v1029: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:25:10.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:09 smithi156 ceph-mon[130574]: pgmap v1029: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:25:11.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:11 smithi073 ceph-mon[128869]: pgmap v1030: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-08-10T12:25:11.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:11 smithi073 ceph-mon[128869]: osdmap e138: 12 total, 12 up, 12 in 2023-08-10T12:25:11.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:11 smithi152 ceph-mon[130220]: pgmap v1030: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-08-10T12:25:11.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:11 smithi152 ceph-mon[130220]: osdmap e138: 12 total, 12 up, 12 in 2023-08-10T12:25:12.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:11 smithi156 ceph-mon[130574]: pgmap v1030: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-08-10T12:25:12.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:11 smithi156 ceph-mon[130574]: osdmap e138: 12 total, 12 up, 12 in 2023-08-10T12:25:13.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:13 smithi152 ceph-mon[130220]: pgmap v1032: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-08-10T12:25:14.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:13 smithi156 ceph-mon[130574]: pgmap v1032: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-08-10T12:25:14.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:13 smithi073 ceph-mon[128869]: pgmap v1032: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-08-10T12:25:15.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:15 smithi152 ceph-mon[130220]: pgmap v1033: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 716 B/s wr, 11 op/s 2023-08-10T12:25:15.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:15 smithi156 ceph-mon[130574]: pgmap v1033: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 716 B/s wr, 11 op/s 2023-08-10T12:25:15.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:15 smithi073 ceph-mon[128869]: pgmap v1033: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 716 B/s wr, 11 op/s 2023-08-10T12:25:17.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:17 smithi073 ceph-mon[128869]: pgmap v1034: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 716 B/s wr, 11 op/s 2023-08-10T12:25:17.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:17 smithi152 ceph-mon[130220]: pgmap v1034: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 716 B/s wr, 11 op/s 2023-08-10T12:25:18.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:17 smithi156 ceph-mon[130574]: pgmap v1034: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 716 B/s wr, 11 op/s 2023-08-10T12:25:19.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:19 smithi073 ceph-mon[128869]: pgmap v1035: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 716 B/s wr, 11 op/s 2023-08-10T12:25:19.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:19 smithi073 ceph-mon[128869]: osdmap e139: 12 total, 12 up, 12 in 2023-08-10T12:25:19.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:19 smithi152 ceph-mon[130220]: pgmap v1035: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 716 B/s wr, 11 op/s 2023-08-10T12:25:19.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:19 smithi152 ceph-mon[130220]: osdmap e139: 12 total, 12 up, 12 in 2023-08-10T12:25:20.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:19 smithi156 ceph-mon[130574]: pgmap v1035: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 716 B/s wr, 11 op/s 2023-08-10T12:25:20.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:19 smithi156 ceph-mon[130574]: osdmap e139: 12 total, 12 up, 12 in 2023-08-10T12:25:21.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:21 smithi073 ceph-mon[128869]: pgmap v1037: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 11 op/s 2023-08-10T12:25:21.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:21 smithi152 ceph-mon[130220]: pgmap v1037: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 11 op/s 2023-08-10T12:25:22.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:21 smithi156 ceph-mon[130574]: pgmap v1037: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 11 op/s 2023-08-10T12:25:23.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:23 smithi073 ceph-mon[128869]: pgmap v1038: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-08-10T12:25:23.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:23 smithi152 ceph-mon[130220]: pgmap v1038: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-08-10T12:25:24.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:23 smithi156 ceph-mon[130574]: pgmap v1038: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-08-10T12:25:25.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:25 smithi152 ceph-mon[130220]: pgmap v1039: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-08-10T12:25:25.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:25 smithi156 ceph-mon[130574]: pgmap v1039: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-08-10T12:25:25.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:25 smithi073 ceph-mon[128869]: pgmap v1039: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-08-10T12:25:27.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:27 smithi073 ceph-mon[128869]: pgmap v1040: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-08-10T12:25:27.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:27 smithi152 ceph-mon[130220]: pgmap v1040: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-08-10T12:25:28.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:27 smithi156 ceph-mon[130574]: pgmap v1040: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-08-10T12:25:28.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:28 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:25:28.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:28 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:25:28.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:28 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:25:28.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:28 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:25:28.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:28 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:25:28.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:28 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:25:29.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:28 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:25:29.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:28 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:25:29.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:28 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:25:29.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:29 smithi073 ceph-mon[128869]: pgmap v1041: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-08-10T12:25:29.768 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:29 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:25:29.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:29 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:25:29.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:29 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:25:29.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:29 smithi152 ceph-mon[130220]: pgmap v1041: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-08-10T12:25:29.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:29 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:25:29.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:29 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:25:29.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:29 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:25:30.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:29 smithi156 ceph-mon[130574]: pgmap v1041: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-08-10T12:25:30.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:29 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:25:30.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:29 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:25:30.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:29 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:25:31.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:31 smithi152 ceph-mon[130220]: pgmap v1042: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-08-10T12:25:32.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:31 smithi156 ceph-mon[130574]: pgmap v1042: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-08-10T12:25:32.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:31 smithi073 ceph-mon[128869]: pgmap v1042: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-08-10T12:25:33.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:33 smithi152 ceph-mon[130220]: pgmap v1043: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:25:34.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:33 smithi156 ceph-mon[130574]: pgmap v1043: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:25:34.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:33 smithi073 ceph-mon[128869]: pgmap v1043: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:25:35.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:35 smithi152 ceph-mon[130220]: pgmap v1044: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-08-10T12:25:35.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:35 smithi156 ceph-mon[130574]: pgmap v1044: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-08-10T12:25:35.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:35 smithi073 ceph-mon[128869]: pgmap v1044: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-08-10T12:25:37.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:37 smithi073 ceph-mon[128869]: pgmap v1045: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:25:37.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:37 smithi152 ceph-mon[130220]: pgmap v1045: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:25:38.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:37 smithi156 ceph-mon[130574]: pgmap v1045: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:25:39.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:39 smithi152 ceph-mon[130220]: pgmap v1046: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:25:40.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:39 smithi156 ceph-mon[130574]: pgmap v1046: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:25:40.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:39 smithi073 ceph-mon[128869]: pgmap v1046: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:25:41.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:41 smithi152 ceph-mon[130220]: pgmap v1047: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-08-10T12:25:42.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:41 smithi156 ceph-mon[130574]: pgmap v1047: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-08-10T12:25:42.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:41 smithi073 ceph-mon[128869]: pgmap v1047: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-08-10T12:25:43.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:43 smithi152 ceph-mon[130220]: pgmap v1048: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:25:44.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:43 smithi156 ceph-mon[130574]: pgmap v1048: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:25:44.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:43 smithi073 ceph-mon[128869]: pgmap v1048: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:25:45.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:45 smithi152 ceph-mon[130220]: pgmap v1049: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-08-10T12:25:45.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:45 smithi156 ceph-mon[130574]: pgmap v1049: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-08-10T12:25:45.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:45 smithi073 ceph-mon[128869]: pgmap v1049: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-08-10T12:25:47.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:47 smithi073 ceph-mon[128869]: pgmap v1050: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:25:47.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:47 smithi152 ceph-mon[130220]: pgmap v1050: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:25:48.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:47 smithi156 ceph-mon[130574]: pgmap v1050: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:25:49.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:49 smithi152 ceph-mon[130220]: pgmap v1051: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:25:50.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:49 smithi156 ceph-mon[130574]: pgmap v1051: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:25:50.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:49 smithi073 ceph-mon[128869]: pgmap v1051: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:25:51.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:51 smithi152 ceph-mon[130220]: pgmap v1052: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-08-10T12:25:52.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:51 smithi156 ceph-mon[130574]: pgmap v1052: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-08-10T12:25:52.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:51 smithi073 ceph-mon[128869]: pgmap v1052: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-08-10T12:25:53.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:53 smithi152 ceph-mon[130220]: pgmap v1053: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:25:54.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:53 smithi156 ceph-mon[130574]: pgmap v1053: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:25:54.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:53 smithi073 ceph-mon[128869]: pgmap v1053: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:25:55.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:55 smithi152 ceph-mon[130220]: pgmap v1054: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-08-10T12:25:55.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:55 smithi156 ceph-mon[130574]: pgmap v1054: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-08-10T12:25:55.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:55 smithi073 ceph-mon[128869]: pgmap v1054: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-08-10T12:25:57.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:57 smithi152 ceph-mon[130220]: pgmap v1055: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:25:58.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:57 smithi156 ceph-mon[130574]: pgmap v1055: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:25:58.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:57 smithi073 ceph-mon[128869]: pgmap v1055: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:25:59.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:25:59 smithi152 ceph-mon[130220]: pgmap v1056: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:26:00.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:25:59 smithi156 ceph-mon[130574]: pgmap v1056: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:26:00.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:25:59 smithi073 ceph-mon[128869]: pgmap v1056: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:26:01.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:01 smithi152 ceph-mon[130220]: pgmap v1057: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-08-10T12:26:02.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:01 smithi156 ceph-mon[130574]: pgmap v1057: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-08-10T12:26:02.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:01 smithi073 ceph-mon[128869]: pgmap v1057: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-08-10T12:26:03.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:03 smithi152 ceph-mon[130220]: pgmap v1058: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:26:04.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:03 smithi156 ceph-mon[130574]: pgmap v1058: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:26:04.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:03 smithi073 ceph-mon[128869]: pgmap v1058: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-08-10T12:26:05.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:05 smithi152 ceph-mon[130220]: pgmap v1059: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-08-10T12:26:05.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:05 smithi156 ceph-mon[130574]: pgmap v1059: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-08-10T12:26:05.769 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:05 smithi073 ceph-mon[128869]: pgmap v1059: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-08-10T12:26:07.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:07 smithi152 ceph-mon[130220]: pgmap v1060: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:26:08.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:07 smithi156 ceph-mon[130574]: pgmap v1060: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:26:08.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:07 smithi073 ceph-mon[128869]: pgmap v1060: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:26:09.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:09 smithi152 ceph-mon[130220]: pgmap v1061: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:26:10.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:09 smithi156 ceph-mon[130574]: pgmap v1061: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:26:10.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:09 smithi073 ceph-mon[128869]: pgmap v1061: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-08-10T12:26:11.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:11 smithi152 ceph-mon[130220]: pgmap v1062: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-10T12:26:11.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:11 smithi152 ceph-mon[130220]: osdmap e140: 12 total, 12 up, 12 in 2023-08-10T12:26:12.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:11 smithi156 ceph-mon[130574]: pgmap v1062: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-10T12:26:12.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:11 smithi156 ceph-mon[130574]: osdmap e140: 12 total, 12 up, 12 in 2023-08-10T12:26:12.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:11 smithi073 ceph-mon[128869]: pgmap v1062: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-08-10T12:26:12.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:11 smithi073 ceph-mon[128869]: osdmap e140: 12 total, 12 up, 12 in 2023-08-10T12:26:13.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:13 smithi152 ceph-mon[130220]: pgmap v1064: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-10T12:26:14.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:13 smithi156 ceph-mon[130574]: pgmap v1064: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-10T12:26:14.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:13 smithi073 ceph-mon[128869]: pgmap v1064: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-08-10T12:26:15.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:15 smithi152 ceph-mon[130220]: pgmap v1065: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:26:15.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:15 smithi156 ceph-mon[130574]: pgmap v1065: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:26:15.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:15 smithi073 ceph-mon[128869]: pgmap v1065: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:26:17.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:17 smithi152 ceph-mon[130220]: pgmap v1066: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:26:18.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:17 smithi156 ceph-mon[130574]: pgmap v1066: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:26:18.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:17 smithi073 ceph-mon[128869]: pgmap v1066: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:26:19.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:19 smithi152 ceph-mon[130220]: pgmap v1067: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:26:19.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:19 smithi152 ceph-mon[130220]: osdmap e141: 12 total, 12 up, 12 in 2023-08-10T12:26:20.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:19 smithi156 ceph-mon[130574]: pgmap v1067: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:26:20.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:19 smithi156 ceph-mon[130574]: osdmap e141: 12 total, 12 up, 12 in 2023-08-10T12:26:20.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:19 smithi073 ceph-mon[128869]: pgmap v1067: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:26:20.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:19 smithi073 ceph-mon[128869]: osdmap e141: 12 total, 12 up, 12 in 2023-08-10T12:26:21.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:21 smithi152 ceph-mon[130220]: pgmap v1069: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:26:22.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:21 smithi156 ceph-mon[130574]: pgmap v1069: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:26:22.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:21 smithi073 ceph-mon[128869]: pgmap v1069: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-08-10T12:26:23.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:23 smithi152 ceph-mon[130220]: pgmap v1070: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:26:24.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:23 smithi156 ceph-mon[130574]: pgmap v1070: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:26:24.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:23 smithi073 ceph-mon[128869]: pgmap v1070: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-08-10T12:26:25.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:25 smithi152 ceph-mon[130220]: pgmap v1071: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:26:25.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:25 smithi156 ceph-mon[130574]: pgmap v1071: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:26:25.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:25 smithi073 ceph-mon[128869]: pgmap v1071: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:26:27.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:27 smithi152 ceph-mon[130220]: pgmap v1072: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:26:28.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:27 smithi156 ceph-mon[130574]: pgmap v1072: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:26:28.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:27 smithi073 ceph-mon[128869]: pgmap v1072: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:26:29.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:29 smithi152 ceph-mon[130220]: pgmap v1073: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:26:29.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:29 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:26:29.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:29 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:26:29.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:29 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:26:29.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:29 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:26:29.996 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:29 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:26:30.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:29 smithi156 ceph-mon[130574]: pgmap v1073: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:26:30.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:29 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:26:30.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:29 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:26:30.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:29 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:26:30.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:29 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:26:30.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:29 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:26:30.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:29 smithi073 ceph-mon[128869]: pgmap v1073: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-08-10T12:26:30.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:29 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T12:26:30.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:29 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:26:30.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:29 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:26:30.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:29 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:26:30.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:29 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:26:30.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:30 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:26:30.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:30 smithi152 ceph-mon[130220]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:26:30.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:30 smithi152 ceph-mon[130220]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:26:31.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:30 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:26:31.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:30 smithi156 ceph-mon[130574]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:26:31.006 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:30 smithi156 ceph-mon[130574]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:26:31.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:30 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T12:26:31.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:30 smithi073 ceph-mon[128869]: from='mgr.25060 172.21.15.73:0/1307217422' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T12:26:31.018 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:30 smithi073 ceph-mon[128869]: from='mgr.25060 ' entity='mgr.x' 2023-08-10T12:26:31.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:31 smithi152 ceph-mon[130220]: pgmap v1074: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:26:32.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:31 smithi156 ceph-mon[130574]: pgmap v1074: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:26:32.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:31 smithi073 ceph-mon[128869]: pgmap v1074: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T12:26:33.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:33 smithi152 ceph-mon[130220]: pgmap v1075: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:26:34.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:33 smithi156 ceph-mon[130574]: pgmap v1075: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:26:34.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:33 smithi073 ceph-mon[128869]: pgmap v1075: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:26:35.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:35 smithi152 ceph-mon[130220]: pgmap v1076: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:26:35.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:35 smithi156 ceph-mon[130574]: pgmap v1076: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:26:35.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:35 smithi073 ceph-mon[128869]: pgmap v1076: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:26:37.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:37 smithi152 ceph-mon[130220]: pgmap v1077: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:26:38.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:37 smithi156 ceph-mon[130574]: pgmap v1077: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:26:38.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:37 smithi073 ceph-mon[128869]: pgmap v1077: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:26:39.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:39 smithi152 ceph-mon[130220]: pgmap v1078: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:26:40.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:39 smithi156 ceph-mon[130574]: pgmap v1078: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:26:40.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:39 smithi073 ceph-mon[128869]: pgmap v1078: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:26:41.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:41 smithi152 ceph-mon[130220]: pgmap v1079: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:26:42.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:41 smithi156 ceph-mon[130574]: pgmap v1079: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:26:42.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:41 smithi073 ceph-mon[128869]: pgmap v1079: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:26:43.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:43 smithi152 ceph-mon[130220]: pgmap v1080: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:26:44.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:43 smithi156 ceph-mon[130574]: pgmap v1080: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:26:44.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:43 smithi073 ceph-mon[128869]: pgmap v1080: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:26:45.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:45 smithi152 ceph-mon[130220]: pgmap v1081: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:26:45.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:45 smithi156 ceph-mon[130574]: pgmap v1081: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:26:45.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:45 smithi073 ceph-mon[128869]: pgmap v1081: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:26:47.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:47 smithi152 ceph-mon[130220]: pgmap v1082: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:26:48.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:47 smithi156 ceph-mon[130574]: pgmap v1082: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:26:48.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:47 smithi073 ceph-mon[128869]: pgmap v1082: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:26:49.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:49 smithi152 ceph-mon[130220]: pgmap v1083: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:26:50.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:49 smithi156 ceph-mon[130574]: pgmap v1083: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:26:50.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:49 smithi073 ceph-mon[128869]: pgmap v1083: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:26:51.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:51 smithi152 ceph-mon[130220]: pgmap v1084: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:26:52.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:51 smithi156 ceph-mon[130574]: pgmap v1084: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:26:52.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:51 smithi073 ceph-mon[128869]: pgmap v1084: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:26:53.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:53 smithi152 ceph-mon[130220]: pgmap v1085: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:26:54.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:53 smithi156 ceph-mon[130574]: pgmap v1085: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:26:54.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:53 smithi073 ceph-mon[128869]: pgmap v1085: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:26:55.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:55 smithi152 ceph-mon[130220]: pgmap v1086: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:26:55.755 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:55 smithi156 ceph-mon[130574]: pgmap v1086: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:26:55.767 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:55 smithi073 ceph-mon[128869]: pgmap v1086: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-08-10T12:26:57.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:57 smithi152 ceph-mon[130220]: pgmap v1087: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:26:58.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:57 smithi156 ceph-mon[130574]: pgmap v1087: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:26:58.017 INFO:journalctl@ceph.mon.a.smithi073.stdout:Aug 10 12:26:57 smithi073 ceph-mon[128869]: pgmap v1087: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:26:59.126 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T12:26:59.127 DEBUG:tasks.cephfs.kernel_mount:Killing processes on client.0... 2023-08-10T12:26:59.128 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-08-10T12:26:59.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T12:26:59.131 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-08-10T12:26:59.995 INFO:journalctl@ceph.mon.b.smithi152.stdout:Aug 10 12:26:59 smithi152 ceph-mon[130220]: pgmap v1088: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:27:00.005 INFO:journalctl@ceph.mon.c.smithi156.stdout:Aug 10 12:26:59 smithi156 ceph-mon[130574]: pgmap v1088: 97 pgs: 97 active+clean; 2.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T12:27:08.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-08-10T12:27:08.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T12:28:08.201 DEBUG:teuthology.orchestra.remote:timed out 2023-08-10T12:28:20.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-08-10T12:28:20.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T12:28:23.284 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-08-10T12:28:26.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-08-10T12:28:26.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T12:28:26.352 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-08-10T12:28:26.353 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-10T12:28:26.353 INFO:tasks.kclient:Unmounting kernel clients... 2023-08-10T12:28:26.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-08-10T12:28:26.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T12:28:29.424 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-08-10T12:28:38.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-08-10T12:28:38.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T12:28:56.820 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-08-10T12:29:08.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-08-10T12:29:08.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T12:29:08.910 ERROR:teuthology.orchestra.connection:Error authenticating with smithi073.front.sepia.ceph.com: Authentication failed. 2023-08-10T12:29:08.912 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-08-10T12:29:08.913 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-10T12:31:11.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-08-10T12:31:11.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T12:31:11.959 ERROR:teuthology.orchestra.connection:Error authenticating with smithi073.front.sepia.ceph.com: Authentication failed. 2023-08-10T12:31:11.961 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-08-10T12:31:11.963 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-10T12:33:11.848 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-10T12:33:11.849 ERROR:teuthology.run_tasks:Manager failed: kclient Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/kclient.py", line 134, in task File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/fwd_scrub.py", line 164, in task File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/cephfs/kernel_mount.py", line 160, in umount File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/kclient.py", line 136, in task File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/kclient.py", line 121, in umount_all File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/cephfs/kernel_mount.py", line 163, in umount File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi073 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/kclient.py", line 139, in task File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/kclient.py", line 119, in umount_all File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/cephfs/mount.py", line 220, in is_mounted File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/remote.py", line 253, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi073 2023-08-10T12:33:11.851 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-08-10T12:33:11.865 INFO:tasks.cephadm:Teardown begin 2023-08-10T12:33:11.866 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/cephadm.py", line 1677, in task File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/fwd_scrub.py", line 164, in task File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2023-08-10T12:33:11.867 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-08-10T12:33:11.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T12:33:11.942 ERROR:teuthology.orchestra.connection:Error authenticating with smithi073.front.sepia.ceph.com: Authentication failed. 2023-08-10T12:33:11.943 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-08-10T12:33:11.944 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')